2024-09-21T07:06:53.101 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T07:06:53.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:06:53.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} email: pdonnell@redhat.com first_in_suite: false job_id: '7913586' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mds: mds cache max size: 1000 mds log max segments: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDi8ehDSnRTDHfXVl6EsOnEjCDEcCYApG5ucp91wey78JCiDWFWFHM0Kc3EDTsQO5WWNMQVBbS9ZaUTP84CD9pE= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTsaCUUYCa1CEgoUWUH9tKh6STeLPB2hOQJy11Ot1N2q9RQC9Zcm3piCKnJrtRCGFH+XBD/IdsUroUNKkQq/B0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T07:06:53.195 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T07:06:53.196 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T07:06:53.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T07:06:53.197 INFO:teuthology.task.internal:Checking packages... 2024-09-21T07:06:53.216 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T07:06:53.216 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:06:53.216 INFO:teuthology.packaging:ref: None 2024-09-21T07:06:53.216 INFO:teuthology.packaging:tag: None 2024-09-21T07:06:53.217 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:06:53.217 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:06:53.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:06:53.352 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120-g18432218-1jammy 2024-09-21T07:06:53.353 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T07:06:53.361 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T07:06:53.361 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T07:06:53.370 INFO:teuthology.task.internal:Saving configuration 2024-09-21T07:06:53.385 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T07:06:53.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T07:06:53.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:00:23.924116', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILccY/8KL94VVhIyvyANWG1M5TaQgfp63eDQe+RQFYRt'} 2024-09-21T07:06:53.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:00:23.922565', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG2tEfGFE5OxhVDV6ca2byeLqq22jLQeoabsZvVlbUrp'} 2024-09-21T07:06:53.437 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T07:06:53.443 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T07:06:53.443 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T07:06:53.443 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T07:06:53.554 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0aac9a0160>, signals=[15]) 2024-09-21T07:06:53.554 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T07:06:53.562 INFO:teuthology.task.internal:Opening connections... 2024-09-21T07:06:53.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:06:53.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:06:53.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:06:53.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:06:53.723 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T07:06:53.732 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-09-21T07:06:53.737 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-09-21T07:06:53.737 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2024-09-21T07:06:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T07:06:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T07:06:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T07:06:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T07:06:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2024-09-21T07:06:53.788 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-09-21T07:06:53.812 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-21T07:06:53.816 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-21T07:06:53.816 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-21T07:06:53.863 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="22.04" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=jammy 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T07:06:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=jammy 2024-09-21T07:06:53.864 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-21T07:06:53.887 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T07:06:53.898 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T07:06:53.907 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T07:06:53.907 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:06:53.909 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:06:53.913 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T07:06:53.922 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T07:06:53.923 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:06:53.956 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:06:53.968 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T07:06:54.023 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T07:06:54.039 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T07:06:54.039 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-21T07:06:54.040 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-21T07:06:54.040 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:06:54.040 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:06:54.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:06:54.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-21T07:06:54.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:06:54.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-21T07:06:54.207 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:06:54.207 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T07:06:54.207 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-09-21T07:06:54.211 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:06:54.211 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T07:06:54.211 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-21T07:06:54.213 INFO:teuthology.orchestra.run.smithi064.stdout:5.15.0-56-generic 2024-09-21T07:06:54.213 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:06:54.213 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T07:06:54.213 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-21T07:06:54.214 DEBUG:teuthology.orchestra.run.smithi064:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-21T07:06:54.217 INFO:teuthology.orchestra.run.smithi090.stdout:5.15.0-56-generic 2024-09-21T07:06:54.217 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:06:54.217 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T07:06:54.217 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-21T07:06:54.217 DEBUG:teuthology.orchestra.run.smithi090:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-21T07:06:54.267 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-21T07:06:54.277 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-21T07:06:54.401 INFO:teuthology.orchestra.run.smithi064.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: git config --global init.defaultBranch 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2024-09-21T07:06:54.402 INFO:teuthology.orchestra.run.smithi064.stderr:hint: git branch -m 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi064.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: git config --global init.defaultBranch 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-21T07:06:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-21T07:06:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:hint: 2024-09-21T07:06:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:hint: git branch -m 2024-09-21T07:06:54.404 INFO:teuthology.orchestra.run.smithi090.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-21T07:06:54.405 DEBUG:teuthology.orchestra.run.smithi064:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-21T07:06:54.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-21T07:06:54.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-21T07:06:54.474 DEBUG:teuthology.orchestra.run.smithi064:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-21T07:06:54.528 DEBUG:teuthology.orchestra.run.smithi090:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-21T07:06:54.532 DEBUG:teuthology.orchestra.run.smithi064:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-21T07:07:18.520 INFO:teuthology.orchestra.run.smithi090.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-21T07:07:18.520 INFO:teuthology.orchestra.run.smithi090.stderr: * [new branch] main -> origin/main 2024-09-21T07:07:18.548 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190312 -> 20190312 2024-09-21T07:07:18.548 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190416 -> 20190416 2024-09-21T07:07:18.548 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190514 -> 20190514 2024-09-21T07:07:18.549 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190618 -> 20190618 2024-09-21T07:07:18.549 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190717 -> 20190717 2024-09-21T07:07:18.549 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190815 -> 20190815 2024-09-21T07:07:18.549 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190923 -> 20190923 2024-09-21T07:07:18.549 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20191022 -> 20191022 2024-09-21T07:07:18.550 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20191215 -> 20191215 2024-09-21T07:07:18.550 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200122 -> 20200122 2024-09-21T07:07:18.550 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200316 -> 20200316 2024-09-21T07:07:18.550 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200421 -> 20200421 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200519 -> 20200519 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200619 -> 20200619 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200721 -> 20200721 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200817 -> 20200817 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200918 -> 20200918 2024-09-21T07:07:18.551 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201022 -> 20201022 2024-09-21T07:07:18.552 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201118 -> 20201118 2024-09-21T07:07:18.552 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201218 -> 20201218 2024-09-21T07:07:18.552 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210208 -> 20210208 2024-09-21T07:07:18.552 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210315 -> 20210315 2024-09-21T07:07:18.552 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210511 -> 20210511 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210716 -> 20210716 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210818 -> 20210818 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210919 -> 20210919 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20211027 -> 20211027 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20211216 -> 20211216 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220209 -> 20220209 2024-09-21T07:07:18.553 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220310 -> 20220310 2024-09-21T07:07:18.554 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220411 -> 20220411 2024-09-21T07:07:18.554 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220509 -> 20220509 2024-09-21T07:07:18.554 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220610 -> 20220610 2024-09-21T07:07:18.554 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220708 -> 20220708 2024-09-21T07:07:18.554 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220815 -> 20220815 2024-09-21T07:07:18.555 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220913 -> 20220913 2024-09-21T07:07:18.555 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221012 -> 20221012 2024-09-21T07:07:18.555 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221109 -> 20221109 2024-09-21T07:07:18.555 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221214 -> 20221214 2024-09-21T07:07:18.555 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230117 -> 20230117 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230210 -> 20230210 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230310 -> 20230310 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230404 -> 20230404 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230515 -> 20230515 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230625 -> 20230625 2024-09-21T07:07:18.556 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230804 -> 20230804 2024-09-21T07:07:18.557 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230919 -> 20230919 2024-09-21T07:07:18.557 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20231030 -> 20231030 2024-09-21T07:07:18.557 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20231111 -> 20231111 2024-09-21T07:07:18.557 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20231211 -> 20231211 2024-09-21T07:07:18.558 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240115 -> 20240115 2024-09-21T07:07:18.558 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240220 -> 20240220 2024-09-21T07:07:18.558 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240312 -> 20240312 2024-09-21T07:07:18.558 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240410 -> 20240410 2024-09-21T07:07:18.558 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240513 -> 20240513 2024-09-21T07:07:18.559 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240610 -> 20240610 2024-09-21T07:07:18.559 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240709 -> 20240709 2024-09-21T07:07:18.559 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240811 -> 20240811 2024-09-21T07:07:18.559 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20240909 -> 20240909 2024-09-21T07:07:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-21T07:07:21.323 INFO:teuthology.orchestra.run.smithi064.stderr: * [new branch] main -> origin/main 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190312 -> 20190312 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190416 -> 20190416 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190514 -> 20190514 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190618 -> 20190618 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190717 -> 20190717 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190815 -> 20190815 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190923 -> 20190923 2024-09-21T07:07:21.362 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20191022 -> 20191022 2024-09-21T07:07:21.363 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20191215 -> 20191215 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200122 -> 20200122 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200316 -> 20200316 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200421 -> 20200421 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200519 -> 20200519 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200619 -> 20200619 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200721 -> 20200721 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200817 -> 20200817 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200918 -> 20200918 2024-09-21T07:07:21.364 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201022 -> 20201022 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201118 -> 20201118 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201218 -> 20201218 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210208 -> 20210208 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210315 -> 20210315 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210511 -> 20210511 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210716 -> 20210716 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210818 -> 20210818 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210919 -> 20210919 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20211027 -> 20211027 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20211216 -> 20211216 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220209 -> 20220209 2024-09-21T07:07:21.366 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220310 -> 20220310 2024-09-21T07:07:21.367 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220411 -> 20220411 2024-09-21T07:07:21.367 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220509 -> 20220509 2024-09-21T07:07:21.367 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220610 -> 20220610 2024-09-21T07:07:21.367 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220708 -> 20220708 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220815 -> 20220815 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220913 -> 20220913 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221012 -> 20221012 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221109 -> 20221109 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221214 -> 20221214 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230117 -> 20230117 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230210 -> 20230210 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230310 -> 20230310 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230404 -> 20230404 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230515 -> 20230515 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230625 -> 20230625 2024-09-21T07:07:21.369 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230804 -> 20230804 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230919 -> 20230919 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20231030 -> 20231030 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20231111 -> 20231111 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20231211 -> 20231211 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240115 -> 20240115 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240220 -> 20240220 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240312 -> 20240312 2024-09-21T07:07:21.370 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240410 -> 20240410 2024-09-21T07:07:21.371 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240513 -> 20240513 2024-09-21T07:07:21.371 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240610 -> 20240610 2024-09-21T07:07:21.371 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240709 -> 20240709 2024-09-21T07:07:21.371 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240811 -> 20240811 2024-09-21T07:07:21.371 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20240909 -> 20240909 2024-09-21T07:07:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2079/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2436/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-21T07:07:23.151 INFO:teuthology.orchestra.run.smithi090.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-21T07:07:23.173 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T07:07:23.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:07:23.324 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:07:23.324 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-21T07:07:23.327 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi090.front.sepia.ceph.com to complete... 2024-09-21T07:07:24.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21 07:07:23 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-21T07:07:24.341 INFO:teuthology.orchestra.run.smithi090.stderr:FINISHED --2024-09-21 07:07:23-- 2024-09-21T07:07:24.341 INFO:teuthology.orchestra.run.smithi090.stderr:Total wall clock time: 1.0s 2024-09-21T07:07:24.341 INFO:teuthology.orchestra.run.smithi090.stderr:Downloaded: 1 files, 43M in 0.9s (50.1 MB/s) 2024-09-21T07:07:24.345 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T07:07:24.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo dpkg -i /tmp/linux-image.deb 2024-09-21T07:07:24.645 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-21T07:07:26.230 INFO:teuthology.orchestra.run.smithi064.stderr:Updating files: 28% (1004/3520) Updating files: 29% (1021/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2055/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 68% (2426/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 81% (2884/3520) Updating files: 82% (2887/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-21T07:07:26.235 INFO:teuthology.orchestra.run.smithi064.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-21T07:07:26.259 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T07:07:26.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:07:26.404 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:07:26.404 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-21T07:07:26.407 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi064.front.sepia.ceph.com to complete... 2024-09-21T07:07:27.302 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-21T07:07:27.306 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-21T07:07:27.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21 07:07:27 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-21T07:07:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:FINISHED --2024-09-21 07:07:27-- 2024-09-21T07:07:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:Total wall clock time: 1.0s 2024-09-21T07:07:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:Downloaded: 1 files, 43M in 0.8s (51.1 MB/s) 2024-09-21T07:07:27.402 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T07:07:27.402 DEBUG:teuthology.orchestra.run.smithi064:> sudo dpkg -i /tmp/linux-image.deb 2024-09-21T07:07:27.408 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-21T07:07:27.624 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-21T07:07:29.534 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-21T07:07:29.539 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-21T07:07:29.623 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-21T07:07:32.636 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-21T07:07:32.774 INFO:teuthology.orchestra.run.smithi090.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:33.348 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-21T07:07:33.443 INFO:teuthology.orchestra.run.smithi064.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub' 2024-09-21T07:07:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T07:07:54.412 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2024-09-21T07:07:54.727 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:54.752 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.031 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T07:07:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T07:07:55.094 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T07:07:55.100 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T07:07:55.264 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T07:07:55.264 INFO:teuthology.orchestra.run.smithi064.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T07:07:55.264 INFO:teuthology.orchestra.run.smithi064.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T07:07:55.307 INFO:teuthology.orchestra.run.smithi064.stderr:done 2024-09-21T07:07:55.500 DEBUG:teuthology.orchestra.run.smithi064:> dpkg-deb -c /tmp/linux-image.deb 2024-09-21T07:07:55.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-21T07:07:55.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-21T07:07:55.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.564 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.564 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.586 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-21T07:07:55.586 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-21T07:07:55.587 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T07:07:55.588 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T07:07:55.589 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T07:07:55.590 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T07:07:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T07:07:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-21T07:07:55.653 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T07:07:55.654 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T07:07:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-21T07:07:55.656 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T07:07:55.657 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T07:07:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T07:07:55.659 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T07:07:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T07:07:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-21T07:07:55.662 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T07:07:55.663 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T07:07:55.664 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T07:07:55.665 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T07:07:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-21T07:07:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T07:07:55.668 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-21T07:07:55.669 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-21T07:07:55.670 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-21T07:07:55.671 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T07:07:55.672 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T07:07:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T07:07:55.674 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T07:07:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T07:07:55.676 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T07:07:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-21T07:07:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T07:07:55.679 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T07:07:55.680 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-21T07:07:55.681 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T07:07:55.682 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T07:07:55.683 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T07:07:55.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T07:07:55.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T07:07:55.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T07:07:55.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T07:07:55.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-21T07:07:55.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T07:07:55.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T07:07:55.690 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-21T07:07:55.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-21T07:07:55.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T07:07:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-21T07:07:55.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T07:07:55.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T07:07:55.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T07:07:55.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-21T07:07:55.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T07:07:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-21T07:07:55.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-21T07:07:55.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T07:07:55.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-21T07:07:55.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-21T07:07:55.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-21T07:07:55.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T07:07:55.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-21T07:07:55.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-21T07:07:55.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-21T07:07:55.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T07:07:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-21T07:07:55.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T07:07:55.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T07:07:55.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T07:07:55.788 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-21T07:07:55.789 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-21T07:07:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-21T07:07:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-21T07:07:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T07:07:55.793 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T07:07:55.794 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-21T07:07:55.795 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-21T07:07:55.796 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-21T07:07:55.797 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T07:07:55.798 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T07:07:55.799 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T07:07:55.800 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T07:07:55.801 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-21T07:07:55.802 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-21T07:07:55.803 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T07:07:55.804 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-21T07:07:55.805 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T07:07:55.806 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-21T07:07:55.807 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T07:07:55.808 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T07:07:55.809 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T07:07:55.810 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T07:07:55.811 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T07:07:55.812 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T07:07:55.813 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-21T07:07:55.814 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-21T07:07:55.815 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-21T07:07:55.816 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-21T07:07:55.817 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T07:07:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T07:07:55.819 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-21T07:07:55.820 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-21T07:07:55.821 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-21T07:07:55.822 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-21T07:07:55.823 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T07:07:55.824 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-21T07:07:55.825 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T07:07:55.826 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T07:07:55.827 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-21T07:07:55.828 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-21T07:07:55.829 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T07:07:55.830 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-21T07:07:55.831 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-21T07:07:55.832 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T07:07:55.833 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T07:07:55.834 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T07:07:55.835 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T07:07:55.836 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T07:07:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-21T07:07:55.838 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-21T07:07:55.839 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T07:07:55.840 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-21T07:07:55.841 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-21T07:07:55.842 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-21T07:07:55.843 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-21T07:07:55.844 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-21T07:07:55.845 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T07:07:55.846 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T07:07:55.847 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T07:07:55.848 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T07:07:55.849 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T07:07:55.850 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T07:07:55.851 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T07:07:55.852 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T07:07:55.853 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-21T07:07:55.854 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-21T07:07:55.855 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T07:07:55.856 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T07:07:55.857 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-21T07:07:55.858 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T07:07:55.859 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-21T07:07:55.860 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-21T07:07:55.861 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T07:07:55.862 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-21T07:07:55.863 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-21T07:07:55.864 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-21T07:07:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-21T07:07:55.918 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-21T07:07:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T07:07:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T07:07:55.921 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T07:07:55.922 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T07:07:55.923 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T07:07:55.924 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T07:07:55.925 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-21T07:07:55.926 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T07:07:55.927 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-21T07:07:55.928 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-21T07:07:55.929 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-21T07:07:55.930 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-21T07:07:55.931 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T07:07:55.932 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T07:07:55.933 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T07:07:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T07:07:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T07:07:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-21T07:07:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-21T07:07:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T07:07:55.939 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-21T07:07:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T07:07:55.941 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T07:07:55.942 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T07:07:55.943 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T07:07:55.944 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T07:07:55.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T07:07:55.946 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-21T07:07:55.947 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T07:07:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T07:07:55.949 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T07:07:55.950 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T07:07:55.951 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T07:07:55.952 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T07:07:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T07:07:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T07:07:55.955 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T07:07:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T07:07:55.957 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T07:07:55.958 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T07:07:55.959 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T07:07:55.960 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T07:07:55.961 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-21T07:07:55.962 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T07:07:55.963 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T07:07:55.964 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T07:07:55.965 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T07:07:55.966 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T07:07:55.967 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-21T07:07:55.968 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T07:07:55.969 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-21T07:07:55.970 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T07:07:55.971 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-21T07:07:55.972 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-21T07:07:55.977 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.977 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.977 DEBUG:teuthology.orchestra.run.smithi064:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-21T07:07:55.984 INFO:teuthology.orchestra.run.smithi064.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:07:55.984 INFO:teuthology.orchestra.run.smithi064.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:07:55.984 INFO:teuthology.orchestra.run.smithi064.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:07:55.984 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-21T07:07:55.984 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:55.984 DEBUG:teuthology.orchestra.run.smithi064:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-21T07:07:56.027 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi064.front.sepia.ceph.com to complete... 2024-09-21T07:07:56.396 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub' 2024-09-21T07:07:56.397 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T07:07:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2024-09-21T07:07:56.622 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:56.628 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:07:56.858 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T07:07:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T07:07:56.903 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T07:07:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T07:07:57.048 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T07:07:57.048 INFO:teuthology.orchestra.run.smithi064.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T07:07:57.048 INFO:teuthology.orchestra.run.smithi064.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T07:07:57.058 INFO:teuthology.orchestra.run.smithi064.stderr:done 2024-09-21T07:08:00.452 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2024-09-21T07:08:00.473 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T07:08:00.499 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-21T07:08:00.922 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:00.950 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:01.293 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T07:08:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T07:08:01.393 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T07:08:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T07:08:01.662 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T07:08:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T07:08:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T07:08:01.772 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-21T07:08:02.009 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-deb -c /tmp/linux-image.deb 2024-09-21T07:08:02.017 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-21T07:08:02.017 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-21T07:08:02.018 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-21T07:08:02.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-21T07:08:02.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-21T07:08:02.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T07:08:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T07:08:02.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T07:08:02.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T07:08:02.068 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T07:08:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T07:08:02.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T07:08:02.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T07:08:02.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T07:08:02.073 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T07:08:02.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T07:08:02.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T07:08:02.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T07:08:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T07:08:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T07:08:02.136 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T07:08:02.137 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-21T07:08:02.138 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-21T07:08:02.139 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T07:08:02.140 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T07:08:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-21T07:08:02.142 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-21T07:08:02.143 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-21T07:08:02.144 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-21T07:08:02.145 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T07:08:02.146 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T07:08:02.147 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T07:08:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T07:08:02.149 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T07:08:02.150 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T07:08:02.151 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T07:08:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T07:08:02.153 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T07:08:02.154 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T07:08:02.155 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T07:08:02.156 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T07:08:02.157 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T07:08:02.158 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T07:08:02.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T07:08:02.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T07:08:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T07:08:02.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T07:08:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T07:08:02.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T07:08:02.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-21T07:08:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-21T07:08:02.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-21T07:08:02.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-21T07:08:02.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T07:08:02.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-21T07:08:02.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-21T07:08:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-21T07:08:02.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-21T07:08:02.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-21T07:08:02.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T07:08:02.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T07:08:02.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T07:08:02.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T07:08:02.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-21T07:08:02.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-21T07:08:02.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-21T07:08:02.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-21T07:08:02.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-21T07:08:02.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-21T07:08:02.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T07:08:02.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T07:08:02.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T07:08:02.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-21T07:08:02.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T07:08:02.235 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-21T07:08:02.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T07:08:02.235 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-21T07:08:02.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T07:08:02.235 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-21T07:08:02.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T07:08:02.237 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T07:08:02.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-21T07:08:02.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-21T07:08:02.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-21T07:08:02.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T07:08:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T07:08:02.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T07:08:02.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T07:08:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T07:08:02.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T07:08:02.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-21T07:08:02.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T07:08:02.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-21T07:08:02.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T07:08:02.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-21T07:08:02.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-21T07:08:02.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-21T07:08:02.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-21T07:08:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-21T07:08:02.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T07:08:02.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-21T07:08:02.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T07:08:02.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T07:08:02.260 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-21T07:08:02.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T07:08:02.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T07:08:02.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T07:08:02.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-21T07:08:02.265 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T07:08:02.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-21T07:08:02.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T07:08:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T07:08:02.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-21T07:08:02.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-21T07:08:02.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-21T07:08:02.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T07:08:02.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-21T07:08:02.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-21T07:08:02.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-21T07:08:02.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-21T07:08:02.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-21T07:08:02.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T07:08:02.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-21T07:08:02.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T07:08:02.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T07:08:02.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T07:08:02.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T07:08:02.307 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-21T07:08:02.308 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T07:08:02.309 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T07:08:02.310 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T07:08:02.311 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-21T07:08:02.312 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T07:08:02.313 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T07:08:02.314 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T07:08:02.315 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T07:08:02.316 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-21T07:08:02.317 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-21T07:08:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-21T07:08:02.319 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-21T07:08:02.320 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T07:08:02.321 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-21T07:08:02.322 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T07:08:02.323 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T07:08:02.324 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T07:08:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T07:08:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T07:08:02.327 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T07:08:02.328 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-21T07:08:02.329 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-21T07:08:02.330 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T07:08:02.331 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-21T07:08:02.332 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-21T07:08:02.333 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-21T07:08:02.367 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T07:08:02.368 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T07:08:02.369 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T07:08:02.370 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T07:08:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T07:08:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T07:08:02.373 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T07:08:02.374 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T07:08:02.375 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T07:08:02.376 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T07:08:02.377 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T07:08:02.378 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T07:08:02.379 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T07:08:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-21T07:08:02.381 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T07:08:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T07:08:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T07:08:02.384 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T07:08:02.385 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T07:08:02.386 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-21T07:08:02.387 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T07:08:02.388 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T07:08:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T07:08:02.390 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T07:08:02.391 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T07:08:02.392 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T07:08:02.393 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T07:08:02.394 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T07:08:02.395 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T07:08:02.396 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T07:08:02.397 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T07:08:02.398 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T07:08:02.399 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T07:08:02.400 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-21T07:08:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-21T07:08:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-21T07:08:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-21T07:08:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-21T07:08:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-21T07:08:02.405 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.405 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.406 DEBUG:teuthology.orchestra.run.smithi090:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-21T07:08:02.417 INFO:teuthology.orchestra.run.smithi090.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:08:02.418 INFO:teuthology.orchestra.run.smithi090.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:08:02.418 INFO:teuthology.orchestra.run.smithi090.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-21T07:08:02.418 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-21T07:08:02.418 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:02.418 DEBUG:teuthology.orchestra.run.smithi090:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-21T07:08:02.460 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi090.front.sepia.ceph.com to complete... 2024-09-21T07:08:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2024-09-21T07:08:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T07:08:03.116 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-21T07:08:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:03.470 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:08:03.934 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T07:08:03.939 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T07:08:03.979 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T07:08:03.984 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T07:08:04.137 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T07:08:04.137 INFO:teuthology.orchestra.run.smithi090.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T07:08:04.137 INFO:teuthology.orchestra.run.smithi090.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T07:08:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-21T07:08:28.188 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T07:08:28.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:08:28.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:08:35.320 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T07:08:35.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:08:35.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:09:02.831 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-09-21T07:09:09.999 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T07:09:11.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:09:11.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:09:19.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:09:19.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:09:22.127 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T07:09:30.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-09-21T07:09:34.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:09:34.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:09:42.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:09:42.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:09:43.356 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-21T07:09:47.450 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-09-21T07:09:48.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:09:48.072 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T07:09:48.072 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-09-21T07:09:48.121 INFO:teuthology.orchestra.run.smithi064.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:09:48.122 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:09:48.122 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:09:48.122 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T07:09:49.125 DEBUG:teuthology.parallel:result is None 2024-09-21T07:09:52.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T07:10:07.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:10:07.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:10:07.499 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T07:10:25.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:10:25.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:10:25.737 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-21T07:10:26.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:10:26.460 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T07:10:26.461 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-21T07:10:26.509 INFO:teuthology.orchestra.run.smithi090.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:10:26.509 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:10:26.509 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:10:26.509 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T07:10:27.510 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:27.510 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:10:27.521 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:10:27.521 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:10:27.525 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:10:27.533 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:10:27.548 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:10:27.588 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:10:27.588 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:10:27.591 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:10:27.615 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:10:27.622 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:10:27.622 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:10:27.652 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:10:27.740 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:10:27.766 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:10:27.769 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:10:27.790 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:10:27.793 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:10:27.801 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:10:27.801 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:10:27.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:10:27.826 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:10:27.834 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:10:27.834 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:10:27.869 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:10:27.877 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:10:27.930 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:10:27.987 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:10:27.988 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:10:28.064 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:10:28.073 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:10:28.122 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:10:28.122 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:10:28.205 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-09-21T07:10:28.208 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-21T07:10:28.335 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:10:28.342 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:10:28.342 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:10:28.352 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:10:28.362 DEBUG:teuthology.task.selinux:Excluding smithi064: OS 'ubuntu' does not support SELinux 2024-09-21T07:10:28.362 DEBUG:teuthology.task.selinux:Excluding smithi090: OS 'ubuntu' does not support SELinux 2024-09-21T07:10:28.362 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:10:28.362 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-21T07:10:28.362 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:10:28.362 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:10:28.370 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:10:28.381 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:10:28.382 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi064.front.sepia.ceph.com,smithi090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:18:48.006 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi064.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com')] 2024-09-21T07:18:48.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:18:48.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:18:48.099 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-09-21T07:18:48.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-21T07:18:48.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:18:48.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:18:48.302 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-21T07:18:48.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T07:18:48.429 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:18:48.448 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:18:48.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:18:48.448 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:18:48.451 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:18:48.451 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Command line: ntpd -gq 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: ---------------------------------------------------- 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: corporation. Support and training for ntp-4 are 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: available at https://www.nwtime.org/support 2024-09-21T07:18:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: ---------------------------------------------------- 2024-09-21T07:18:48.488 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: proto: precision = 0.043 usec (-24) 2024-09-21T07:18:48.488 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: basedate set to 2022-02-04 2024-09-21T07:18:48.488 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: gps base set to 2022-02-06 (week 2196) 2024-09-21T07:18:48.489 INFO:teuthology.orchestra.run.smithi064.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T07:18:48.489 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T07:18:48.489 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T07:18:48.489 INFO:teuthology.orchestra.run.smithi064.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen normally on 3 enp3s0f1 172.21.15.64:123 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen normally on 4 lo [::1]:123 2024-09-21T07:18:48.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8df%5]:123 2024-09-21T07:18:48.491 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:48 ntpd[18464]: Listening on routing socket on fd #22 for interface updates 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Command line: ntpd -gq 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: ---------------------------------------------------- 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: corporation. Support and training for ntp-4 are 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: available at https://www.nwtime.org/support 2024-09-21T07:18:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: ---------------------------------------------------- 2024-09-21T07:18:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: proto: precision = 0.041 usec (-24) 2024-09-21T07:18:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: basedate set to 2022-02-04 2024-09-21T07:18:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: gps base set to 2022-02-06 (week 2196) 2024-09-21T07:18:48.511 INFO:teuthology.orchestra.run.smithi090.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T07:18:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T07:18:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T07:18:48.512 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T07:18:48.513 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T07:18:48.513 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T07:18:48.513 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T07:18:48.514 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen normally on 3 enp3s0f1 172.21.15.90:123 2024-09-21T07:18:48.514 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen normally on 4 lo [::1]:123 2024-09-21T07:18:48.514 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d767%5]:123 2024-09-21T07:18:48.514 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:48 ntpd[18498]: Listening on routing socket on fd #22 for interface updates 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:49.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:49 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:49.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:49.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:49.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:49.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:49.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:49 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:50.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:50 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:51.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:51 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:51 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:52 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:52 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:53.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:53 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:53.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:53 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:54.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:54 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:54.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:54 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stdout:21 Sep 07:18:55 ntpd[18464]: ntpd: time slew -0.001068 s 2024-09-21T07:18:55.490 INFO:teuthology.orchestra.run.smithi064.stdout:ntpd: time slew -0.001068s 2024-09-21T07:18:55.491 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T07:18:55.491 INFO:teuthology.orchestra.run.smithi064.stderr:21 Sep 07:18:55 ntpd[18464]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T07:18:55.510 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T07:18:55.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T07:18:55.511 INFO:teuthology.orchestra.run.smithi090.stdout:21 Sep 07:18:55 ntpd[18498]: ntpd: time slew -0.000777 s 2024-09-21T07:18:55.511 INFO:teuthology.orchestra.run.smithi090.stdout:ntpd: time slew -0.000777s 2024-09-21T07:18:55.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T07:18:55.511 INFO:teuthology.orchestra.run.smithi090.stderr:21 Sep 07:18:55 ntpd[18498]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================== 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.584 INFO:teuthology.orchestra.run.smithi064.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.609 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T07:18:55.610 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:18:55.625 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:18:55.625 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T07:18:55.625 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T07:18:55.625 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:18:55.630 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:18:55.630 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T07:18:55.631 DEBUG:teuthology.orchestra.run.smithi064:> sudo apt-key list | grep Ceph 2024-09-21T07:18:55.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-key list | grep Ceph 2024-09-21T07:18:55.736 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T07:18:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T07:18:55.788 INFO:teuthology.orchestra.run.smithi064.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T07:18:55.788 INFO:teuthology.orchestra.run.smithi064.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T07:18:55.789 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-21T07:18:55.789 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-21T07:18:55.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:18:55.847 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T07:18:55.848 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T07:18:55.849 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-21T07:18:55.849 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-21T07:18:55.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:18:55.949 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default/ 2024-09-21T07:18:55.949 INFO:teuthology.task.install.deb:Package version is 19.3.0-5120-g18432218-1jammy 2024-09-21T07:18:55.990 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default/ 2024-09-21T07:18:55.990 INFO:teuthology.task.install.deb:Package version is 19.3.0-5120-g18432218-1jammy 2024-09-21T07:18:56.062 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:18:56.062 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T07:18:56.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo apt-get update 2024-09-21T07:18:56.107 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:18:56.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T07:18:56.126 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2024-09-21T07:18:56.271 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T07:18:56.278 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T07:18:56.295 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T07:18:56.307 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T07:18:56.322 INFO:teuthology.orchestra.run.smithi064.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T07:18:56.344 INFO:teuthology.orchestra.run.smithi064.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-21T07:18:56.359 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T07:18:56.366 INFO:teuthology.orchestra.run.smithi064.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T07:18:56.380 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-21T07:18:56.387 INFO:teuthology.orchestra.run.smithi064.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-21T07:18:56.403 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T07:18:56.407 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T07:18:56.420 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-21T07:18:56.426 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T07:18:56.426 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-21T07:18:56.457 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-21T07:18:56.507 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T07:18:56.588 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T07:18:56.890 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 28.6 kB in 1s (50.0 kB/s) 2024-09-21T07:18:56.913 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 28.6 kB in 1s (51.1 kB/s) 2024-09-21T07:18:57.947 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-21T07:18:57.961 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5120-g18432218-1jammy cephadm=19.3.0-5120-g18432218-1jammy ceph-mds=19.3.0-5120-g18432218-1jammy ceph-mgr=19.3.0-5120-g18432218-1jammy ceph-common=19.3.0-5120-g18432218-1jammy ceph-fuse=19.3.0-5120-g18432218-1jammy ceph-test=19.3.0-5120-g18432218-1jammy ceph-volume=19.3.0-5120-g18432218-1jammy radosgw=19.3.0-5120-g18432218-1jammy python3-rados=19.3.0-5120-g18432218-1jammy python3-rgw=19.3.0-5120-g18432218-1jammy python3-cephfs=19.3.0-5120-g18432218-1jammy python3-rbd=19.3.0-5120-g18432218-1jammy libcephfs2=19.3.0-5120-g18432218-1jammy libcephfs-dev=19.3.0-5120-g18432218-1jammy librados2=19.3.0-5120-g18432218-1jammy librbd1=19.3.0-5120-g18432218-1jammy rbd-fuse=19.3.0-5120-g18432218-1jammy python3-cephfs=19.3.0-5120-g18432218-1jammy cephfs-shell=19.3.0-5120-g18432218-1jammy cephfs-top=19.3.0-5120-g18432218-1jammy cephfs-mirror=19.3.0-5120-g18432218-1jammy 2024-09-21T07:18:57.965 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2024-09-21T07:18:57.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5120-g18432218-1jammy cephadm=19.3.0-5120-g18432218-1jammy ceph-mds=19.3.0-5120-g18432218-1jammy ceph-mgr=19.3.0-5120-g18432218-1jammy ceph-common=19.3.0-5120-g18432218-1jammy ceph-fuse=19.3.0-5120-g18432218-1jammy ceph-test=19.3.0-5120-g18432218-1jammy ceph-volume=19.3.0-5120-g18432218-1jammy radosgw=19.3.0-5120-g18432218-1jammy python3-rados=19.3.0-5120-g18432218-1jammy python3-rgw=19.3.0-5120-g18432218-1jammy python3-cephfs=19.3.0-5120-g18432218-1jammy python3-rbd=19.3.0-5120-g18432218-1jammy libcephfs2=19.3.0-5120-g18432218-1jammy libcephfs-dev=19.3.0-5120-g18432218-1jammy librados2=19.3.0-5120-g18432218-1jammy librbd1=19.3.0-5120-g18432218-1jammy rbd-fuse=19.3.0-5120-g18432218-1jammy python3-cephfs=19.3.0-5120-g18432218-1jammy cephfs-shell=19.3.0-5120-g18432218-1jammy cephfs-top=19.3.0-5120-g18432218-1jammy cephfs-mirror=19.3.0-5120-g18432218-1jammy 2024-09-21T07:18:58.038 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-21T07:18:58.060 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2024-09-21T07:18:58.228 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-21T07:18:58.229 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-21T07:18:58.253 INFO:teuthology.orchestra.run.smithi064.stdout:Building dependency tree... 2024-09-21T07:18:58.254 INFO:teuthology.orchestra.run.smithi064.stdout:Reading state information... 2024-09-21T07:18:58.419 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T07:18:58.419 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T07:18:58.419 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T07:18:58.419 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T07:18:58.420 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T07:18:58.420 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T07:18:58.420 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-21T07:18:58.421 INFO:teuthology.orchestra.run.smithi090.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-21T07:18:58.422 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-21T07:18:58.423 INFO:teuthology.orchestra.run.smithi090.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-21T07:18:58.424 INFO:teuthology.orchestra.run.smithi090.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-21T07:18:58.424 INFO:teuthology.orchestra.run.smithi090.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T07:18:58.424 INFO:teuthology.orchestra.run.smithi090.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-21T07:18:58.424 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2024-09-21T07:18:58.424 INFO:teuthology.orchestra.run.smithi090.stdout: btrfs-tools 2024-09-21T07:18:58.452 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T07:18:58.453 INFO:teuthology.orchestra.run.smithi064.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T07:18:58.453 INFO:teuthology.orchestra.run.smithi064.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T07:18:58.453 INFO:teuthology.orchestra.run.smithi064.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T07:18:58.453 INFO:teuthology.orchestra.run.smithi064.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T07:18:58.454 INFO:teuthology.orchestra.run.smithi064.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T07:18:58.454 INFO:teuthology.orchestra.run.smithi064.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T07:18:58.454 INFO:teuthology.orchestra.run.smithi064.stdout:The following additional packages will be installed: 2024-09-21T07:18:58.454 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T07:18:58.455 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T07:18:58.455 INFO:teuthology.orchestra.run.smithi064.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-21T07:18:58.455 INFO:teuthology.orchestra.run.smithi064.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-21T07:18:58.455 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-21T07:18:58.456 INFO:teuthology.orchestra.run.smithi064.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-21T07:18:58.456 INFO:teuthology.orchestra.run.smithi064.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-21T07:18:58.456 INFO:teuthology.orchestra.run.smithi064.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T07:18:58.456 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-21T07:18:58.456 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-21T07:18:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout:Suggested packages: 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T07:18:58.458 INFO:teuthology.orchestra.run.smithi064.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-21T07:18:58.459 INFO:teuthology.orchestra.run.smithi064.stdout:Recommended packages: 2024-09-21T07:18:58.459 INFO:teuthology.orchestra.run.smithi064.stdout: btrfs-tools 2024-09-21T07:18:58.575 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2024-09-21T07:18:58.576 INFO:teuthology.orchestra.run.smithi090.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T07:18:58.576 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T07:18:58.576 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-21T07:18:58.577 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-21T07:18:58.577 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-21T07:18:58.577 INFO:teuthology.orchestra.run.smithi090.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-21T07:18:58.577 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-21T07:18:58.578 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-21T07:18:58.579 INFO:teuthology.orchestra.run.smithi090.stdout: socat unzip xmlstarlet zip 2024-09-21T07:18:58.618 INFO:teuthology.orchestra.run.smithi064.stdout:The following NEW packages will be installed: 2024-09-21T07:18:58.618 INFO:teuthology.orchestra.run.smithi064.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T07:18:58.618 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T07:18:58.618 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-21T07:18:58.618 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T07:18:58.620 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-21T07:18:58.621 INFO:teuthology.orchestra.run.smithi064.stdout: socat unzip xmlstarlet zip 2024-09-21T07:18:58.688 INFO:teuthology.orchestra.run.smithi064.stdout:0 upgraded, 125 newly installed, 0 to remove and 335 not upgraded. 2024-09-21T07:18:58.688 INFO:teuthology.orchestra.run.smithi064.stdout:Need to get 239 MB of archives. 2024-09-21T07:18:58.689 INFO:teuthology.orchestra.run.smithi064.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-21T07:18:58.689 INFO:teuthology.orchestra.run.smithi064.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-21T07:18:58.706 INFO:teuthology.orchestra.run.smithi064.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T07:18:58.716 INFO:teuthology.orchestra.run.smithi064.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-21T07:18:58.727 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 125 newly installed, 0 to remove and 335 not upgraded. 2024-09-21T07:18:58.727 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 239 MB of archives. 2024-09-21T07:18:58.727 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-21T07:18:58.727 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5120-g18432218-1jammy [3,591 kB] 2024-09-21T07:18:58.757 INFO:teuthology.orchestra.run.smithi064.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T07:18:58.771 INFO:teuthology.orchestra.run.smithi064.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5120-g18432218-1jammy [3,591 kB] 2024-09-21T07:18:58.774 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-21T07:18:58.778 INFO:teuthology.orchestra.run.smithi064.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T07:18:58.782 INFO:teuthology.orchestra.run.smithi064.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T07:18:58.791 INFO:teuthology.orchestra.run.smithi064.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T07:18:58.829 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T07:18:58.832 INFO:teuthology.orchestra.run.smithi064.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T07:18:58.839 INFO:teuthology.orchestra.run.smithi064.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T07:18:58.842 INFO:teuthology.orchestra.run.smithi064.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-21T07:18:58.843 INFO:teuthology.orchestra.run.smithi064.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T07:18:58.844 INFO:teuthology.orchestra.run.smithi064.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T07:18:58.850 INFO:teuthology.orchestra.run.smithi064.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-21T07:18:58.851 INFO:teuthology.orchestra.run.smithi064.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-21T07:18:58.853 INFO:teuthology.orchestra.run.smithi064.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-21T07:18:58.854 INFO:teuthology.orchestra.run.smithi064.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-21T07:18:58.856 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T07:18:58.866 INFO:teuthology.orchestra.run.smithi064.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-21T07:18:58.869 INFO:teuthology.orchestra.run.smithi064.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-21T07:18:58.871 INFO:teuthology.orchestra.run.smithi064.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-21T07:18:58.873 INFO:teuthology.orchestra.run.smithi064.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T07:18:58.873 INFO:teuthology.orchestra.run.smithi064.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T07:18:58.882 INFO:teuthology.orchestra.run.smithi064.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T07:18:58.883 INFO:teuthology.orchestra.run.smithi064.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T07:18:58.884 INFO:teuthology.orchestra.run.smithi064.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T07:18:58.884 INFO:teuthology.orchestra.run.smithi064.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T07:18:58.884 INFO:teuthology.orchestra.run.smithi064.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T07:18:58.899 INFO:teuthology.orchestra.run.smithi064.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T07:18:58.900 INFO:teuthology.orchestra.run.smithi064.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T07:18:58.900 INFO:teuthology.orchestra.run.smithi064.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T07:18:58.902 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-21T07:18:58.902 INFO:teuthology.orchestra.run.smithi064.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T07:18:58.903 INFO:teuthology.orchestra.run.smithi064.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T07:18:58.903 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5120-g18432218-1jammy [3,370 kB] 2024-09-21T07:18:58.916 INFO:teuthology.orchestra.run.smithi064.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T07:18:58.917 INFO:teuthology.orchestra.run.smithi064.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T07:18:58.918 INFO:teuthology.orchestra.run.smithi064.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T07:18:58.918 INFO:teuthology.orchestra.run.smithi064.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T07:18:58.918 INFO:teuthology.orchestra.run.smithi064.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T07:18:58.933 INFO:teuthology.orchestra.run.smithi064.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T07:18:58.934 INFO:teuthology.orchestra.run.smithi064.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T07:18:58.935 INFO:teuthology.orchestra.run.smithi064.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T07:18:58.940 INFO:teuthology.orchestra.run.smithi064.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T07:18:58.941 INFO:teuthology.orchestra.run.smithi064.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T07:18:58.950 INFO:teuthology.orchestra.run.smithi064.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T07:18:58.951 INFO:teuthology.orchestra.run.smithi064.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T07:18:58.952 INFO:teuthology.orchestra.run.smithi064.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T07:18:58.954 INFO:teuthology.orchestra.run.smithi064.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T07:18:58.954 INFO:teuthology.orchestra.run.smithi064.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T07:18:58.956 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5120-g18432218-1jammy [733 kB] 2024-09-21T07:18:58.970 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5120-g18432218-1jammy [356 kB] 2024-09-21T07:18:58.970 INFO:teuthology.orchestra.run.smithi064.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T07:18:58.971 INFO:teuthology.orchestra.run.smithi064.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T07:18:58.973 INFO:teuthology.orchestra.run.smithi064.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T07:18:58.973 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5120-g18432218-1jammy [32.8 kB] 2024-09-21T07:18:58.973 INFO:teuthology.orchestra.run.smithi064.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T07:18:58.974 INFO:teuthology.orchestra.run.smithi064.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T07:18:58.974 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5120-g18432218-1jammy [180 kB] 2024-09-21T07:18:58.978 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5120-g18432218-1jammy [72.9 kB] 2024-09-21T07:18:58.980 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5120-g18432218-1jammy [340 kB] 2024-09-21T07:18:58.988 INFO:teuthology.orchestra.run.smithi064.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T07:18:58.989 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5120-g18432218-1jammy [8,845 kB] 2024-09-21T07:18:59.034 INFO:teuthology.orchestra.run.smithi064.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T07:18:59.035 INFO:teuthology.orchestra.run.smithi064.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T07:18:59.037 INFO:teuthology.orchestra.run.smithi064.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T07:18:59.037 INFO:teuthology.orchestra.run.smithi064.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T07:18:59.038 INFO:teuthology.orchestra.run.smithi064.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T07:18:59.057 INFO:teuthology.orchestra.run.smithi064.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T07:18:59.059 INFO:teuthology.orchestra.run.smithi064.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T07:18:59.059 INFO:teuthology.orchestra.run.smithi064.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T07:18:59.076 INFO:teuthology.orchestra.run.smithi064.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T07:18:59.076 INFO:teuthology.orchestra.run.smithi064.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T07:18:59.077 INFO:teuthology.orchestra.run.smithi064.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T07:18:59.077 INFO:teuthology.orchestra.run.smithi064.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T07:18:59.078 INFO:teuthology.orchestra.run.smithi064.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T07:18:59.078 INFO:teuthology.orchestra.run.smithi064.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T07:18:59.087 INFO:teuthology.orchestra.run.smithi064.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T07:18:59.088 INFO:teuthology.orchestra.run.smithi064.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T07:18:59.091 INFO:teuthology.orchestra.run.smithi064.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T07:18:59.099 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T07:18:59.104 INFO:teuthology.orchestra.run.smithi064.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T07:18:59.105 INFO:teuthology.orchestra.run.smithi064.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T07:18:59.106 INFO:teuthology.orchestra.run.smithi064.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T07:18:59.110 INFO:teuthology.orchestra.run.smithi064.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T07:18:59.112 INFO:teuthology.orchestra.run.smithi064.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-21T07:18:59.113 INFO:teuthology.orchestra.run.smithi064.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-21T07:18:59.114 INFO:teuthology.orchestra.run.smithi064.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-21T07:18:59.121 INFO:teuthology.orchestra.run.smithi064.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T07:18:59.126 INFO:teuthology.orchestra.run.smithi064.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-21T07:18:59.126 INFO:teuthology.orchestra.run.smithi064.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T07:18:59.138 INFO:teuthology.orchestra.run.smithi064.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T07:18:59.138 INFO:teuthology.orchestra.run.smithi064.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T07:18:59.139 INFO:teuthology.orchestra.run.smithi064.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T07:18:59.140 INFO:teuthology.orchestra.run.smithi064.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T07:18:59.141 INFO:teuthology.orchestra.run.smithi064.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T07:18:59.142 INFO:teuthology.orchestra.run.smithi064.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T07:18:59.149 INFO:teuthology.orchestra.run.smithi064.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T07:18:59.155 INFO:teuthology.orchestra.run.smithi064.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T07:18:59.156 INFO:teuthology.orchestra.run.smithi064.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T07:18:59.157 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5120-g18432218-1jammy [112 kB] 2024-09-21T07:18:59.158 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5120-g18432218-1jammy [478 kB] 2024-09-21T07:18:59.158 INFO:teuthology.orchestra.run.smithi064.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T07:18:59.164 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5120-g18432218-1jammy [29.1 MB] 2024-09-21T07:18:59.173 INFO:teuthology.orchestra.run.smithi064.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T07:18:59.190 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T07:18:59.203 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T07:18:59.253 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T07:18:59.298 INFO:teuthology.orchestra.run.smithi064.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5120-g18432218-1jammy [3,370 kB] 2024-09-21T07:18:59.426 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T07:18:59.434 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T07:18:59.461 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T07:18:59.470 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-21T07:18:59.473 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T07:18:59.473 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T07:18:59.491 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-21T07:18:59.495 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-21T07:18:59.499 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-21T07:18:59.507 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-21T07:18:59.583 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-21T07:18:59.585 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-21T07:18:59.587 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-21T07:18:59.589 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T07:18:59.590 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T07:18:59.590 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T07:18:59.591 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T07:18:59.591 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T07:18:59.592 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T07:18:59.634 INFO:teuthology.orchestra.run.smithi064.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5120-g18432218-1jammy [733 kB] 2024-09-21T07:18:59.671 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T07:18:59.671 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T07:18:59.671 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T07:18:59.691 INFO:teuthology.orchestra.run.smithi064.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5120-g18432218-1jammy [356 kB] 2024-09-21T07:18:59.697 INFO:teuthology.orchestra.run.smithi064.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5120-g18432218-1jammy [32.8 kB] 2024-09-21T07:18:59.698 INFO:teuthology.orchestra.run.smithi064.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5120-g18432218-1jammy [180 kB] 2024-09-21T07:18:59.739 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5120-g18432218-1jammy [5,023 kB] 2024-09-21T07:18:59.748 INFO:teuthology.orchestra.run.smithi064.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5120-g18432218-1jammy [72.9 kB] 2024-09-21T07:18:59.749 INFO:teuthology.orchestra.run.smithi064.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5120-g18432218-1jammy [340 kB] 2024-09-21T07:18:59.752 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T07:18:59.754 INFO:teuthology.orchestra.run.smithi064.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5120-g18432218-1jammy [8,845 kB] 2024-09-21T07:18:59.754 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T07:18:59.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T07:18:59.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T07:18:59.756 INFO:teuthology.orchestra.run.smithi090.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T07:18:59.756 INFO:teuthology.orchestra.run.smithi090.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T07:18:59.757 INFO:teuthology.orchestra.run.smithi090.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T07:18:59.833 INFO:teuthology.orchestra.run.smithi090.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T07:18:59.834 INFO:teuthology.orchestra.run.smithi090.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T07:18:59.835 INFO:teuthology.orchestra.run.smithi090.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T07:18:59.837 INFO:teuthology.orchestra.run.smithi090.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5120-g18432218-1jammy [252 kB] 2024-09-21T07:18:59.840 INFO:teuthology.orchestra.run.smithi090.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5120-g18432218-1jammy [126 kB] 2024-09-21T07:18:59.842 INFO:teuthology.orchestra.run.smithi090.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5120-g18432218-1jammy [1,552 kB] 2024-09-21T07:18:59.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5120-g18432218-1jammy [6,198 kB] 2024-09-21T07:18:59.915 INFO:teuthology.orchestra.run.smithi090.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T07:18:59.920 INFO:teuthology.orchestra.run.smithi090.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T07:18:59.920 INFO:teuthology.orchestra.run.smithi090.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T07:18:59.921 INFO:teuthology.orchestra.run.smithi090.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T07:18:59.922 INFO:teuthology.orchestra.run.smithi090.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T07:18:59.923 INFO:teuthology.orchestra.run.smithi090.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T07:18:59.924 INFO:teuthology.orchestra.run.smithi090.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T07:18:59.996 INFO:teuthology.orchestra.run.smithi090.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T07:18:59.998 INFO:teuthology.orchestra.run.smithi090.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T07:18:59.998 INFO:teuthology.orchestra.run.smithi090.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T07:19:00.012 INFO:teuthology.orchestra.run.smithi090.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5120-g18432218-1jammy [22.9 MB] 2024-09-21T07:19:00.078 INFO:teuthology.orchestra.run.smithi090.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T07:19:00.078 INFO:teuthology.orchestra.run.smithi090.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T07:19:00.079 INFO:teuthology.orchestra.run.smithi090.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T07:19:00.081 INFO:teuthology.orchestra.run.smithi090.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T07:19:00.190 INFO:teuthology.orchestra.run.smithi090.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T07:19:00.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T07:19:00.192 INFO:teuthology.orchestra.run.smithi090.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T07:19:00.192 INFO:teuthology.orchestra.run.smithi090.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T07:19:00.193 INFO:teuthology.orchestra.run.smithi090.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T07:19:00.265 INFO:teuthology.orchestra.run.smithi090.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T07:19:00.267 INFO:teuthology.orchestra.run.smithi090.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T07:19:00.268 INFO:teuthology.orchestra.run.smithi090.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T07:19:00.338 INFO:teuthology.orchestra.run.smithi090.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T07:19:00.338 INFO:teuthology.orchestra.run.smithi090.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T07:19:00.339 INFO:teuthology.orchestra.run.smithi090.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T07:19:00.340 INFO:teuthology.orchestra.run.smithi090.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T07:19:00.340 INFO:teuthology.orchestra.run.smithi090.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T07:19:00.341 INFO:teuthology.orchestra.run.smithi090.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T07:19:00.367 INFO:teuthology.orchestra.run.smithi064.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5120-g18432218-1jammy [112 kB] 2024-09-21T07:19:00.368 INFO:teuthology.orchestra.run.smithi064.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5120-g18432218-1jammy [478 kB] 2024-09-21T07:19:00.374 INFO:teuthology.orchestra.run.smithi064.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5120-g18432218-1jammy [29.1 MB] 2024-09-21T07:19:00.405 INFO:teuthology.orchestra.run.smithi090.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T07:19:00.405 INFO:teuthology.orchestra.run.smithi090.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T07:19:00.409 INFO:teuthology.orchestra.run.smithi090.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T07:19:00.486 INFO:teuthology.orchestra.run.smithi090.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T07:19:00.488 INFO:teuthology.orchestra.run.smithi090.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T07:19:00.488 INFO:teuthology.orchestra.run.smithi090.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T07:19:00.492 INFO:teuthology.orchestra.run.smithi090.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T07:19:00.495 INFO:teuthology.orchestra.run.smithi090.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-21T07:19:00.495 INFO:teuthology.orchestra.run.smithi090.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-21T07:19:00.496 INFO:teuthology.orchestra.run.smithi090.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-21T07:19:00.533 INFO:teuthology.orchestra.run.smithi090.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5120-g18432218-1jammy [14.0 kB] 2024-09-21T07:19:00.534 INFO:teuthology.orchestra.run.smithi090.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5120-g18432218-1jammy [865 kB] 2024-09-21T07:19:00.541 INFO:teuthology.orchestra.run.smithi090.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5120-g18432218-1jammy [2,390 kB] 2024-09-21T07:19:00.567 INFO:teuthology.orchestra.run.smithi090.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T07:19:00.572 INFO:teuthology.orchestra.run.smithi090.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-21T07:19:00.573 INFO:teuthology.orchestra.run.smithi090.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T07:19:00.603 INFO:teuthology.orchestra.run.smithi090.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5120-g18432218-1jammy [813 kB] 2024-09-21T07:19:00.616 INFO:teuthology.orchestra.run.smithi090.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5120-g18432218-1jammy [160 kB] 2024-09-21T07:19:00.619 INFO:teuthology.orchestra.run.smithi090.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5120-g18432218-1jammy [61.5 MB] 2024-09-21T07:19:00.649 INFO:teuthology.orchestra.run.smithi090.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T07:19:00.649 INFO:teuthology.orchestra.run.smithi090.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T07:19:00.650 INFO:teuthology.orchestra.run.smithi090.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T07:19:00.650 INFO:teuthology.orchestra.run.smithi090.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T07:19:00.652 INFO:teuthology.orchestra.run.smithi090.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T07:19:00.653 INFO:teuthology.orchestra.run.smithi090.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T07:19:00.660 INFO:teuthology.orchestra.run.smithi090.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T07:19:00.730 INFO:teuthology.orchestra.run.smithi090.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T07:19:00.731 INFO:teuthology.orchestra.run.smithi090.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T07:19:00.733 INFO:teuthology.orchestra.run.smithi090.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T07:19:00.811 INFO:teuthology.orchestra.run.smithi090.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T07:19:01.591 INFO:teuthology.orchestra.run.smithi064.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5120-g18432218-1jammy [5,023 kB] 2024-09-21T07:19:01.767 INFO:teuthology.orchestra.run.smithi064.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5120-g18432218-1jammy [252 kB] 2024-09-21T07:19:01.769 INFO:teuthology.orchestra.run.smithi064.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5120-g18432218-1jammy [126 kB] 2024-09-21T07:19:01.771 INFO:teuthology.orchestra.run.smithi064.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5120-g18432218-1jammy [1,552 kB] 2024-09-21T07:19:01.823 INFO:teuthology.orchestra.run.smithi064.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5120-g18432218-1jammy [6,198 kB] 2024-09-21T07:19:02.033 INFO:teuthology.orchestra.run.smithi064.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5120-g18432218-1jammy [22.9 MB] 2024-09-21T07:19:02.509 INFO:teuthology.orchestra.run.smithi090.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5120-g18432218-1jammy [8,625 kB] 2024-09-21T07:19:02.751 INFO:teuthology.orchestra.run.smithi090.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5120-g18432218-1jammy [14.2 kB] 2024-09-21T07:19:02.752 INFO:teuthology.orchestra.run.smithi090.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5120-g18432218-1jammy [40.9 MB] 2024-09-21T07:19:02.789 INFO:teuthology.orchestra.run.smithi064.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5120-g18432218-1jammy [14.0 kB] 2024-09-21T07:19:02.790 INFO:teuthology.orchestra.run.smithi064.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5120-g18432218-1jammy [865 kB] 2024-09-21T07:19:02.826 INFO:teuthology.orchestra.run.smithi064.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5120-g18432218-1jammy [2,390 kB] 2024-09-21T07:19:02.897 INFO:teuthology.orchestra.run.smithi064.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5120-g18432218-1jammy [813 kB] 2024-09-21T07:19:02.941 INFO:teuthology.orchestra.run.smithi064.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5120-g18432218-1jammy [160 kB] 2024-09-21T07:19:02.943 INFO:teuthology.orchestra.run.smithi064.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5120-g18432218-1jammy [61.5 MB] 2024-09-21T07:19:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5120-g18432218-1jammy [130 kB] 2024-09-21T07:19:03.970 INFO:teuthology.orchestra.run.smithi090.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-5120-g18432218-1jammy [237 kB] 2024-09-21T07:19:03.972 INFO:teuthology.orchestra.run.smithi090.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-5120-g18432218-1jammy [34.0 kB] 2024-09-21T07:19:03.972 INFO:teuthology.orchestra.run.smithi090.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-5120-g18432218-1jammy [23.6 kB] 2024-09-21T07:19:03.973 INFO:teuthology.orchestra.run.smithi090.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5120-g18432218-1jammy [39.0 kB] 2024-09-21T07:19:03.973 INFO:teuthology.orchestra.run.smithi090.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5120-g18432218-1jammy [17.6 MB] 2024-09-21T07:19:04.441 INFO:teuthology.orchestra.run.smithi090.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5120-g18432218-1jammy [93.1 kB] 2024-09-21T07:19:04.841 INFO:teuthology.orchestra.run.smithi064.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5120-g18432218-1jammy [8,625 kB] 2024-09-21T07:19:04.976 INFO:teuthology.orchestra.run.smithi064.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5120-g18432218-1jammy [14.2 kB] 2024-09-21T07:19:04.976 INFO:teuthology.orchestra.run.smithi064.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5120-g18432218-1jammy [40.9 MB] 2024-09-21T07:19:05.095 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 239 MB in 6s (40.9 MB/s) 2024-09-21T07:19:05.259 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-21T07:19:05.324 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-21T07:19:05.327 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-21T07:19:05.366 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-21T07:19:05.657 INFO:teuthology.orchestra.run.smithi064.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5120-g18432218-1jammy [130 kB] 2024-09-21T07:19:05.658 INFO:teuthology.orchestra.run.smithi064.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-5120-g18432218-1jammy [237 kB] 2024-09-21T07:19:05.661 INFO:teuthology.orchestra.run.smithi064.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-5120-g18432218-1jammy [34.0 kB] 2024-09-21T07:19:05.661 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T07:19:05.661 INFO:teuthology.orchestra.run.smithi064.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-5120-g18432218-1jammy [23.6 kB] 2024-09-21T07:19:05.661 INFO:teuthology.orchestra.run.smithi064.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5120-g18432218-1jammy [39.0 kB] 2024-09-21T07:19:05.662 INFO:teuthology.orchestra.run.smithi064.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5120-g18432218-1jammy [17.6 MB] 2024-09-21T07:19:05.674 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T07:19:05.711 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T07:19:05.946 INFO:teuthology.orchestra.run.smithi064.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5120-g18432218-1jammy [93.1 kB] 2024-09-21T07:19:06.055 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cmd2. 2024-09-21T07:19:06.069 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-21T07:19:06.107 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-21T07:19:06.435 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T07:19:06.449 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T07:19:06.536 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T07:19:06.623 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 239 MB in 7s (32.7 MB/s) 2024-09-21T07:19:06.746 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-21T07:19:06.814 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-21T07:19:06.817 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-21T07:19:06.861 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-21T07:19:06.873 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T07:19:06.888 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T07:19:06.931 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T07:19:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T07:19:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T07:19:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T07:19:07.228 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T07:19:07.243 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T07:19:07.277 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T07:19:07.500 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cmd2. 2024-09-21T07:19:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-21T07:19:07.550 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-21T07:19:07.715 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T07:19:07.730 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:07.798 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:07.886 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T07:19:07.901 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T07:19:07.970 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T07:19:08.170 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T07:19:08.185 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:08.220 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:08.315 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T07:19:08.331 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T07:19:08.373 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T07:19:08.540 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T07:19:08.555 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:08.598 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:08.710 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T07:19:08.725 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T07:19:08.768 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T07:19:08.953 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T07:19:08.968 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T07:19:09.013 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T07:19:09.331 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librados2. 2024-09-21T07:19:09.346 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T07:19:09.347 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../010-librados2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:09.362 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:09.390 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librados2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:09.412 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:09.799 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T07:19:09.814 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:09.857 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:09.901 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libnbd0. 2024-09-21T07:19:09.915 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-21T07:19:09.960 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-21T07:19:10.194 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T07:19:10.210 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T07:19:10.247 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librbd1. 2024-09-21T07:19:10.252 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:19:10.261 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../012-librbd1_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:10.297 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librbd1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:10.555 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T07:19:10.570 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T07:19:10.628 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T07:19:10.742 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T07:19:10.756 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:10.792 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:10.941 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librados2. 2024-09-21T07:19:10.956 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../010-librados2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:10.999 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librados2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:11.379 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rados. 2024-09-21T07:19:11.393 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../014-python3-rados_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:11.436 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libnbd0. 2024-09-21T07:19:11.438 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rados (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:11.451 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-21T07:19:11.485 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-21T07:19:11.763 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librbd1. 2024-09-21T07:19:11.775 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T07:19:11.780 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../012-librbd1_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:11.789 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:11.833 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-argparse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:11.838 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librbd1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:12.061 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T07:19:12.076 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:12.111 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cephfs (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:12.299 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T07:19:12.315 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:12.358 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libcephfs2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:12.423 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T07:19:12.438 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:12.482 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:12.635 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rados. 2024-09-21T07:19:12.650 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../014-python3-rados_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:12.693 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rados (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:12.810 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T07:19:12.825 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T07:19:12.869 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T07:19:12.963 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T07:19:12.977 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:13.012 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-ceph-argparse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:13.105 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T07:19:13.120 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:13.155 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rbd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:13.240 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T07:19:13.255 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:13.298 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cephfs (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:13.501 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T07:19:13.516 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T07:19:13.560 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T07:19:13.634 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T07:19:13.650 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:13.692 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:13.863 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-21T07:19:13.877 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-21T07:19:13.921 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T07:19:13.996 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T07:19:14.011 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T07:19:14.045 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T07:19:14.217 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-21T07:19:14.232 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-21T07:19:14.265 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T07:19:14.275 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T07:19:14.280 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rbd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:14.604 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua5.1. 2024-09-21T07:19:14.619 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-21T07:19:14.634 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T07:19:14.650 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T07:19:14.662 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-21T07:19:14.692 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T07:19:14.945 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-21T07:19:14.960 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-21T07:19:14.983 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-any. 2024-09-21T07:19:14.997 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-21T07:19:15.003 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T07:19:15.032 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-21T07:19:15.278 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package zip. 2024-09-21T07:19:15.293 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-21T07:19:15.314 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-21T07:19:15.330 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-21T07:19:15.337 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking zip (3.0-12build2) ... 2024-09-21T07:19:15.373 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T07:19:15.701 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua5.1. 2024-09-21T07:19:15.717 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-21T07:19:15.759 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-21T07:19:15.790 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package unzip. 2024-09-21T07:19:15.806 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-21T07:19:15.849 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-21T07:19:16.046 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-any. 2024-09-21T07:19:16.061 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-21T07:19:16.095 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-21T07:19:16.306 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package zip. 2024-09-21T07:19:16.322 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-21T07:19:16.355 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package luarocks. 2024-09-21T07:19:16.365 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking zip (3.0-12build2) ... 2024-09-21T07:19:16.370 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-21T07:19:16.421 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-21T07:19:16.710 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package unzip. 2024-09-21T07:19:16.725 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-21T07:19:16.768 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librgw2. 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../028-librgw2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:16.931 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librgw2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:17.163 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package luarocks. 2024-09-21T07:19:17.178 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-21T07:19:17.221 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-21T07:19:17.612 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librgw2. 2024-09-21T07:19:17.627 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../028-librgw2_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:17.662 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librgw2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:17.693 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T07:19:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:17.751 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:18.172 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T07:19:18.188 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T07:19:18.239 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T07:19:18.298 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T07:19:18.313 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:18.356 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:18.601 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T07:19:18.615 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:18.659 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libradosstriper1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:18.692 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T07:19:18.708 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T07:19:18.751 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T07:19:19.028 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T07:19:19.045 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:19.078 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libradosstriper1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:19.188 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-common. 2024-09-21T07:19:19.203 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../032-ceph-common_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:19.256 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:19.673 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-common. 2024-09-21T07:19:19.689 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../032-ceph-common_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:19.731 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:20.812 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-base. 2024-09-21T07:19:20.827 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../033-ceph-base_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:20.880 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-base (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:21.045 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-base. 2024-09-21T07:19:21.061 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../033-ceph-base_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:21.113 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-base (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:21.543 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T07:19:21.564 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T07:19:21.658 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T07:19:21.673 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T07:19:21.708 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T07:19:21.827 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T07:19:21.993 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T07:19:22.009 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T07:19:22.052 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T07:19:22.130 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T07:19:22.166 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T07:19:22.180 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T07:19:22.371 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T07:19:22.387 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T07:19:22.430 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T07:19:22.501 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T07:19:22.516 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T07:19:22.560 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T07:19:22.766 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T07:19:22.782 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T07:19:22.824 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T07:19:22.854 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T07:19:22.870 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T07:19:22.913 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T07:19:23.069 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T07:19:23.084 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T07:19:23.118 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T07:19:23.166 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T07:19:23.180 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T07:19:23.217 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T07:19:23.405 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T07:19:23.420 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T07:19:23.463 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T07:19:23.537 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T07:19:23.553 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T07:19:23.596 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T07:19:23.774 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-portend. 2024-09-21T07:19:23.790 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-21T07:19:23.832 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T07:19:23.907 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-portend. 2024-09-21T07:19:23.922 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-21T07:19:23.965 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T07:19:24.152 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T07:19:24.167 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T07:19:24.201 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T07:19:24.253 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T07:19:24.269 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T07:19:24.311 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T07:19:24.438 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T07:19:24.453 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T07:19:24.496 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T07:19:24.607 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T07:19:24.622 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T07:19:24.665 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T07:19:24.841 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T07:19:24.857 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T07:19:24.900 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T07:19:25.012 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T07:19:25.026 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T07:19:25.062 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T07:19:25.161 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T07:19:25.176 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T07:19:25.210 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T07:19:25.357 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T07:19:25.372 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T07:19:25.415 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T07:19:25.505 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T07:19:25.521 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T07:19:25.563 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T07:19:25.735 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T07:19:25.750 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T07:19:25.794 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T07:19:25.866 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-mako. 2024-09-21T07:19:25.882 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T07:19:25.924 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T07:19:26.098 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-mako. 2024-09-21T07:19:26.113 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T07:19:26.156 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T07:19:26.262 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T07:19:26.277 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T07:19:26.319 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T07:19:26.477 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T07:19:26.492 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T07:19:26.535 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T07:19:26.597 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T07:19:26.612 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T07:19:26.646 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T07:19:26.832 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T07:19:26.846 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T07:19:26.890 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T07:19:26.908 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-webob. 2024-09-21T07:19:26.924 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T07:19:26.974 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T07:19:27.160 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webob. 2024-09-21T07:19:27.175 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T07:19:27.218 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T07:19:27.311 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T07:19:27.327 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T07:19:27.372 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T07:19:27.588 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T07:19:27.603 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T07:19:27.649 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T07:19:27.680 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T07:19:27.696 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T07:19:27.738 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T07:19:27.943 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T07:19:27.957 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T07:19:27.992 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T07:19:28.050 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-paste. 2024-09-21T07:19:28.066 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T07:19:28.108 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T07:19:28.279 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-paste. 2024-09-21T07:19:28.294 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T07:19:28.337 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T07:19:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T07:19:28.468 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T07:19:28.511 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T07:19:28.626 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T07:19:28.640 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T07:19:28.684 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T07:19:28.813 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T07:19:28.829 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T07:19:28.872 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T07:19:28.971 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T07:19:28.986 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T07:19:29.029 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T07:19:29.133 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T07:19:29.149 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T07:19:29.183 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T07:19:29.307 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T07:19:29.322 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T07:19:29.382 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T07:19:29.436 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T07:19:29.451 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T07:19:29.494 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T07:19:29.695 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T07:19:29.710 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T07:19:29.753 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T07:19:29.857 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T07:19:29.872 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T07:19:29.949 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T07:19:30.067 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T07:19:30.082 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T07:19:30.117 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T07:19:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-idna. 2024-09-21T07:19:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T07:19:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T07:19:30.430 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-idna. 2024-09-21T07:19:30.445 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T07:19:30.488 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T07:19:30.554 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T07:19:30.570 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T07:19:30.604 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T07:19:30.817 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T07:19:30.832 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T07:19:30.867 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T07:19:30.907 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-requests. 2024-09-21T07:19:30.922 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T07:19:30.958 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T07:19:31.172 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests. 2024-09-21T07:19:31.187 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T07:19:31.218 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T07:19:31.221 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T07:19:31.234 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T07:19:31.268 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T07:19:32.463 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T07:19:32.478 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:32.521 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:32.704 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T07:19:32.720 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T07:19:32.834 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T07:19:32.943 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T07:19:32.959 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:33.001 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:33.122 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T07:19:33.137 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:33.172 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:33.312 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T07:19:33.328 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T07:19:33.370 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T07:19:33.569 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T07:19:33.584 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:33.627 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:33.673 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T07:19:33.688 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T07:19:33.731 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T07:19:33.932 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T07:19:33.947 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T07:19:33.990 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T07:19:34.043 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T07:19:34.058 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:34.092 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:34.318 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T07:19:34.330 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T07:19:34.368 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T07:19:34.454 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T07:19:34.470 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:34.512 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mon (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:34.688 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T07:19:34.701 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:34.747 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:35.127 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T07:19:35.137 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:35.176 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mon (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:35.266 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T07:19:35.281 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:35.324 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-osd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:35.772 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T07:19:35.783 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:35.822 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-osd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:36.035 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph. 2024-09-21T07:19:36.050 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../069-ceph_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:36.085 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:36.405 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T07:19:36.420 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:36.462 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:36.744 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph. 2024-09-21T07:19:36.755 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../069-ceph_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:36.802 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:36.824 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T07:19:36.839 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:36.882 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mds (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:37.105 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T07:19:37.116 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:37.155 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:37.244 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephadm. 2024-09-21T07:19:37.259 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../072-cephadm_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:37.310 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:37.588 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T07:19:37.603 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T07:19:37.646 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T07:19:37.768 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T07:19:37.779 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:37.826 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mds (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:37.907 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T07:19:37.922 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T07:19:37.956 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T07:19:38.205 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephadm. 2024-09-21T07:19:38.216 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../072-cephadm_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:38.254 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:38.566 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T07:19:38.577 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T07:19:38.616 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T07:19:38.929 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T07:19:38.939 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T07:19:38.953 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-babel. 2024-09-21T07:19:38.968 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T07:19:38.979 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T07:19:39.011 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T07:19:39.331 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T07:19:39.345 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T07:19:39.389 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T07:19:39.736 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T07:19:39.751 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:39.794 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:39.951 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-babel. 2024-09-21T07:19:39.963 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T07:19:40.018 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T07:19:40.114 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T07:19:40.129 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T07:19:40.172 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T07:19:40.423 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T07:19:40.436 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T07:19:40.489 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T07:19:40.499 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-routes. 2024-09-21T07:19:40.515 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T07:19:40.558 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T07:19:40.868 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T07:19:40.880 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:40.894 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T07:19:40.910 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:40.926 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:40.952 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:41.314 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T07:19:41.327 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T07:19:41.373 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T07:19:41.667 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-routes. 2024-09-21T07:19:41.680 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T07:19:41.726 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T07:19:42.062 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T07:19:42.075 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:42.112 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:43.148 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T07:19:43.164 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T07:19:43.228 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T07:19:43.726 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T07:19:43.741 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T07:19:43.862 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T07:19:44.216 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T07:19:44.231 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T07:19:44.238 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T07:19:44.250 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T07:19:44.274 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T07:19:44.296 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T07:19:44.577 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T07:19:44.593 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T07:19:44.627 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T07:19:44.784 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T07:19:44.795 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T07:19:44.920 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T07:19:45.283 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T07:19:45.285 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T07:19:45.291 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T07:19:45.300 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:45.332 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T07:19:45.335 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:45.654 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T07:19:45.665 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T07:19:45.712 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T07:19:46.356 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T07:19:46.368 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:46.414 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:46.447 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T07:19:46.463 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T07:19:46.496 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T07:19:46.766 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T07:19:46.782 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T07:19:46.824 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T07:19:47.152 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T07:19:47.168 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T07:19:47.218 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T07:19:47.326 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T07:19:47.341 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T07:19:47.376 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T07:19:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T07:19:47.530 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-21T07:19:47.571 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T07:19:47.714 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T07:19:47.727 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T07:19:47.764 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T07:19:47.969 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T07:19:47.984 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T07:19:48.027 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T07:19:48.345 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T07:19:48.351 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T07:19:48.361 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T07:19:48.364 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T07:19:48.395 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T07:19:48.409 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T07:19:48.690 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T07:19:48.706 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T07:19:48.713 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T07:19:48.727 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-21T07:19:48.747 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T07:19:48.772 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T07:19:49.059 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T07:19:49.067 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T07:19:49.072 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T07:19:49.084 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T07:19:49.117 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T07:19:49.146 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T07:19:49.446 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T07:19:49.459 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T07:19:49.496 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T07:19:49.748 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T07:19:49.763 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:49.798 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:49.800 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T07:19:49.814 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T07:19:49.850 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T07:19:50.154 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T07:19:50.166 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T07:19:50.212 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T07:19:50.242 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T07:19:50.257 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T07:19:50.300 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T07:19:50.670 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T07:19:50.685 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T07:19:50.728 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T07:19:50.869 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T07:19:50.881 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:50.928 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:50.980 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package jq. 2024-09-21T07:19:50.996 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T07:19:51.030 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T07:19:51.222 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T07:19:51.234 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T07:19:51.258 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package socat. 2024-09-21T07:19:51.272 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T07:19:51.273 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T07:19:51.316 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T07:19:51.603 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T07:19:51.618 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T07:19:51.635 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T07:19:51.647 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T07:19:51.669 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T07:19:51.694 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T07:19:51.963 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package jq. 2024-09-21T07:19:51.976 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T07:19:52.007 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-test. 2024-09-21T07:19:52.021 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T07:19:52.022 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../100-ceph-test_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:52.065 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-test (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:52.249 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package socat. 2024-09-21T07:19:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T07:19:52.299 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T07:19:52.612 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T07:19:52.625 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T07:19:52.662 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T07:19:53.008 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-test. 2024-09-21T07:19:53.021 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../100-ceph-test_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:53.058 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-test (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:53.911 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T07:19:53.927 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:53.969 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-volume (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:54.348 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-21T07:19:54.365 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:54.406 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-mirror (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:54.675 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-colorama. 2024-09-21T07:19:54.692 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-21T07:19:54.725 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-21T07:19:54.978 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-shell. 2024-09-21T07:19:54.994 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:55.044 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-shell (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T07:19:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:55.323 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-volume (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:55.347 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-top. 2024-09-21T07:19:55.364 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:55.405 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-top (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:55.658 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T07:19:55.675 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:55.716 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libcephfs-dev (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:55.719 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-21T07:19:55.733 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:55.778 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-mirror (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:56.010 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-21T07:19:56.027 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-21T07:19:56.068 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T07:19:56.090 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-colorama. 2024-09-21T07:19:56.104 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-21T07:19:56.140 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-21T07:19:56.381 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-21T07:19:56.393 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-shell. 2024-09-21T07:19:56.398 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-21T07:19:56.406 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:56.439 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-21T07:19:56.451 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-shell (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:56.721 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-top. 2024-09-21T07:19:56.735 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-5120-g18432218-1jammy_all.deb ... 2024-09-21T07:19:56.780 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-top (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:56.794 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T07:19:56.810 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T07:19:56.851 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T07:19:57.016 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T07:19:57.029 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:19:57.066 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs-dev (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:19:57.231 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package pkg-config. 2024-09-21T07:19:57.247 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-21T07:19:57.289 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T07:19:57.542 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T07:19:57.559 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T07:19:57.600 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T07:19:57.644 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-21T07:19:57.658 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-21T07:19:57.702 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T07:19:58.029 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T07:19:58.042 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-21T07:19:58.046 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T07:19:58.055 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-21T07:19:58.092 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-21T07:19:58.103 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T07:19:58.373 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T07:19:58.389 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T07:19:58.422 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T07:19:58.684 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T07:19:58.701 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T07:19:58.742 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T07:19:58.796 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T07:19:58.809 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T07:19:58.854 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T07:19:59.070 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T07:19:59.087 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T07:19:59.128 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T07:19:59.253 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package pkg-config. 2024-09-21T07:19:59.265 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-21T07:19:59.311 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T07:19:59.448 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-py. 2024-09-21T07:19:59.465 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-21T07:19:59.506 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T07:19:59.631 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T07:19:59.644 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T07:19:59.689 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T07:19:59.851 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T07:19:59.868 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T07:19:59.909 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T07:20:00.135 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T07:20:00.148 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T07:20:00.193 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T07:20:00.346 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T07:20:00.362 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T07:20:00.404 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T07:20:00.480 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T07:20:00.493 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T07:20:00.530 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T07:20:00.707 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-toml. 2024-09-21T07:20:00.723 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-21T07:20:00.765 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T07:20:00.843 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T07:20:00.856 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T07:20:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T07:20:01.010 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T07:20:01.025 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T07:20:01.084 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T07:20:01.204 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T07:20:01.218 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T07:20:01.263 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T07:20:01.421 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T07:20:01.437 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T07:20:01.479 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T07:20:01.641 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-py. 2024-09-21T07:20:01.655 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-21T07:20:01.699 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T07:20:02.007 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T07:20:02.021 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T07:20:02.024 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T07:20:02.034 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T07:20:02.065 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T07:20:02.079 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T07:20:02.550 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T07:20:02.562 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T07:20:02.600 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T07:20:02.735 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package radosgw. 2024-09-21T07:20:02.751 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../123-radosgw_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:20:02.785 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking radosgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:02.904 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-toml. 2024-09-21T07:20:02.916 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-21T07:20:02.962 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T07:20:03.265 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T07:20:03.278 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T07:20:03.340 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T07:20:03.597 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T07:20:03.614 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:20:03.655 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking rbd-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:03.694 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T07:20:03.708 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T07:20:03.744 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T07:20:03.958 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T07:20:03.998 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T07:20:04.011 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T07:20:04.048 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T07:20:04.260 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T07:20:04.386 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T07:20:04.664 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T07:20:04.703 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package radosgw. 2024-09-21T07:20:04.715 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../123-radosgw_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:20:04.752 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking radosgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:05.066 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T07:20:05.617 INFO:teuthology.orchestra.run.smithi064.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T07:20:05.665 INFO:teuthology.orchestra.run.smithi064.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-21T07:20:05.704 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:05.816 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T07:20:05.830 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-5120-g18432218-1jammy_amd64.deb ... 2024-09-21T07:20:05.873 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking rbd-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:06.159 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T07:20:06.206 INFO:teuthology.orchestra.run.smithi064.stdout:Adding system user cephadm....done 2024-09-21T07:20:06.360 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T07:20:06.421 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T07:20:06.547 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T07:20:06.645 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T07:20:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T07:20:06.913 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T07:20:07.064 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T07:20:07.210 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T07:20:07.323 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T07:20:07.591 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T07:20:07.717 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T07:20:07.815 INFO:teuthology.orchestra.run.smithi090.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T07:20:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-21T07:20:07.909 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:08.035 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T07:20:08.412 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T07:20:08.570 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user cephadm....done 2024-09-21T07:20:08.655 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-21T07:20:08.907 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T07:20:09.050 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T07:20:09.191 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-21T07:20:09.335 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T07:20:09.459 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T07:20:09.620 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T07:20:09.746 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T07:20:09.844 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T07:20:10.005 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T07:20:10.112 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T07:20:10.274 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T07:20:10.363 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-ceph-argparse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:10.401 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T07:20:10.630 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T07:20:10.703 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T07:20:10.756 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-21T07:20:10.882 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T07:20:11.008 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-21T07:20:11.072 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T07:20:11.276 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T07:20:11.331 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-21T07:20:11.401 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T07:20:11.616 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T07:20:11.694 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-21T07:20:11.902 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-21T07:20:12.059 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-21T07:20:12.100 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-21T07:20:12.163 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T07:20:12.172 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T07:20:12.273 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T07:20:12.422 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T07:20:12.658 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T07:20:12.690 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T07:20:12.767 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T07:20:12.949 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-argparse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:13.035 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T07:20:13.209 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T07:20:13.311 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T07:20:13.360 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-21T07:20:13.487 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T07:20:13.637 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up zip (3.0-12build2) ... 2024-09-21T07:20:13.714 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-21T07:20:13.763 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T07:20:13.990 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T07:20:14.124 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T07:20:14.384 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-21T07:20:14.481 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T07:20:14.766 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T07:20:14.858 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-21T07:20:14.867 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T07:20:14.891 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-21T07:20:14.955 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T07:20:14.976 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T07:20:15.081 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T07:20:15.302 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T07:20:15.450 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T07:20:15.550 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T07:20:15.720 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T07:20:15.818 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T07:20:15.979 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T07:20:16.086 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T07:20:16.356 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T07:20:16.397 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up zip (3.0-12build2) ... 2024-09-21T07:20:16.523 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T07:20:16.666 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-21T07:20:16.983 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T07:20:17.276 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T07:20:17.493 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T07:20:17.543 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T07:20:17.669 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T07:20:17.761 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T07:20:17.796 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T07:20:17.887 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:18.105 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T07:20:18.205 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T07:20:18.508 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T07:20:18.556 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T07:20:18.751 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T07:20:19.136 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T07:20:19.487 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-21T07:20:19.805 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T07:20:19.836 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T07:20:20.055 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:20.158 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T07:20:20.180 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T07:20:20.401 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T07:20:20.482 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T07:20:20.527 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:20.591 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T07:20:20.692 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T07:20:20.837 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T07:20:20.985 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T07:20:21.230 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T07:20:21.261 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T07:20:21.529 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T07:20:21.973 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T07:20:22.240 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T07:20:22.479 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T07:20:22.500 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T07:20:22.731 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T07:20:22.865 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T07:20:23.027 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T07:20:23.175 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T07:20:23.294 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T07:20:23.319 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T07:20:23.420 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T07:20:23.456 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T07:20:23.721 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T07:20:23.748 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T07:20:23.849 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T07:20:23.989 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T07:20:24.134 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T07:20:24.249 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:24.392 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T07:20:24.443 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T07:20:24.711 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T07:20:24.711 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T07:20:24.821 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-21T07:20:24.954 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T07:20:24.971 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T07:20:25.026 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T07:20:25.239 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T07:20:25.264 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T07:20:25.382 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T07:20:25.498 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T07:20:25.758 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T07:20:25.775 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T07:20:26.034 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T07:20:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-21T07:20:26.160 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T07:20:26.177 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T07:20:26.421 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T07:20:26.445 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:26.547 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T07:20:26.570 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T07:20:26.840 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T07:20:26.905 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T07:20:27.150 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T07:20:27.231 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T07:20:27.418 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T07:20:27.543 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-21T07:20:27.601 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T07:20:27.653 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T07:20:27.727 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T07:20:27.733 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T07:20:27.973 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T07:20:28.053 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T07:20:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T07:20:28.330 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T07:20:28.492 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T07:20:28.606 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T07:20:28.760 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-21T07:20:28.886 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T07:20:29.008 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T07:20:29.146 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T07:20:29.273 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T07:20:29.317 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T07:20:29.599 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T07:20:29.678 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T07:20:29.804 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librados2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:29.909 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T07:20:29.930 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-21T07:20:30.271 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T07:20:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libcephfs2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:30.397 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T07:20:30.460 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libradosstriper1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:30.586 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T07:20:30.666 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T07:20:30.879 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librbd1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:30.943 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T07:20:31.005 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-modules-core (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:31.139 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:31.228 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T07:20:31.357 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T07:20:31.357 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T07:20:31.596 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T07:20:31.890 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T07:20:32.032 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libcephfs-dev (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.167 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rados (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.243 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T07:20:32.318 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librgw2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.361 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librados2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.444 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-top (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.471 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:32.544 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T07:20:32.597 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-21T07:20:32.967 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.094 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libradosstriper1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.212 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T07:20:33.489 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librbd1 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.615 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-modules-core (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.741 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.865 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rbd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:33.950 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T07:20:33.950 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T07:20:33.991 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up rbd-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.117 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.243 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cephfs (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.369 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-shell (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.470 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.584 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs-dev (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.711 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rados (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.812 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librgw2 (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.955 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-top (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:34.973 INFO:teuthology.orchestra.run.smithi064.stdout:Adding group ceph....done 2024-09-21T07:20:35.081 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T07:20:35.332 INFO:teuthology.orchestra.run.smithi064.stdout:Adding system user ceph....done 2024-09-21T07:20:35.460 INFO:teuthology.orchestra.run.smithi064.stdout:Setting system user ceph properties....done 2024-09-21T07:20:35.479 INFO:teuthology.orchestra.run.smithi064.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T07:20:35.635 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T07:20:36.047 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T07:20:36.361 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rbd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.488 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up rbd-fuse (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.614 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.737 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-mirror (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.740 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cephfs (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.908 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-shell (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:36.953 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:20:36.953 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:20:37.034 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-common (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:37.547 INFO:teuthology.orchestra.run.smithi090.stdout:Adding group ceph....done 2024-09-21T07:20:37.555 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-test (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:37.707 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up radosgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:37.923 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user ceph....done 2024-09-21T07:20:38.092 INFO:teuthology.orchestra.run.smithi090.stdout:Setting system user ceph properties....done 2024-09-21T07:20:38.113 INFO:teuthology.orchestra.run.smithi090.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T07:20:38.254 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T07:20:38.254 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:20:38.255 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:20:38.655 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T07:20:38.942 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-base (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:39.388 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-mirror (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:39.605 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:20:39.606 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:20:39.651 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T07:20:40.207 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-test (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:40.319 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mds (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:40.333 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up radosgw (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:40.533 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T07:20:40.533 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T07:20:40.864 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:20:40.864 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:20:41.137 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:41.367 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T07:20:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T07:20:41.444 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-base (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:41.802 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T07:20:41.972 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-osd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:42.284 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T07:20:42.284 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T07:20:42.488 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mds (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:42.713 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T07:20:42.713 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T07:20:42.891 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:43.017 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:43.160 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mon (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:43.366 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:43.366 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T07:20:43.366 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T07:20:43.578 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T07:20:43.578 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T07:20:44.011 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:44.162 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:44.176 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-osd (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:44.263 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-dashboard (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:44.397 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-volume (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:44.504 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T07:20:44.504 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T07:20:44.775 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T07:20:44.892 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T07:20:45.027 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T07:20:45.137 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:45.255 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:45.381 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mon (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:45.588 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T07:20:45.589 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T07:20:46.194 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T07:20:46.208 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-cephadm (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:46.351 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:46.477 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-dashboard (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:46.662 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-volume (19.3.0-5120-g18432218-1jammy) ... 2024-09-21T07:20:46.878 INFO:teuthology.orchestra.run.smithi064.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T07:20:46.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-21T07:20:46.962 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2024-09-21T07:20:47.023 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T07:20:47.132 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T07:20:47.148 INFO:teuthology.orchestra.run.smithi064.stdout:Building dependency tree... 2024-09-21T07:20:47.149 INFO:teuthology.orchestra.run.smithi064.stdout:Reading state information... 2024-09-21T07:20:47.286 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T07:20:47.345 INFO:teuthology.orchestra.run.smithi064.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T07:20:47.346 INFO:teuthology.orchestra.run.smithi064.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T07:20:47.346 INFO:teuthology.orchestra.run.smithi064.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T07:20:47.346 INFO:teuthology.orchestra.run.smithi064.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T07:20:47.347 INFO:teuthology.orchestra.run.smithi064.stdout:The following additional packages will be installed: 2024-09-21T07:20:47.347 INFO:teuthology.orchestra.run.smithi064.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-21T07:20:47.347 INFO:teuthology.orchestra.run.smithi064.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-21T07:20:47.347 INFO:teuthology.orchestra.run.smithi064.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-21T07:20:47.347 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-21T07:20:47.348 INFO:teuthology.orchestra.run.smithi064.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-21T07:20:47.349 INFO:teuthology.orchestra.run.smithi064.stdout:Suggested packages: 2024-09-21T07:20:47.349 INFO:teuthology.orchestra.run.smithi064.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-21T07:20:47.349 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-21T07:20:47.349 INFO:teuthology.orchestra.run.smithi064.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-21T07:20:47.405 INFO:teuthology.orchestra.run.smithi064.stdout:The following NEW packages will be installed: 2024-09-21T07:20:47.406 INFO:teuthology.orchestra.run.smithi064.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-21T07:20:47.406 INFO:teuthology.orchestra.run.smithi064.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-21T07:20:47.407 INFO:teuthology.orchestra.run.smithi064.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-21T07:20:47.407 INFO:teuthology.orchestra.run.smithi064.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-21T07:20:47.407 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-21T07:20:47.407 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-21T07:20:47.407 INFO:teuthology.orchestra.run.smithi064.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-21T07:20:47.408 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages will be upgraded: 2024-09-21T07:20:47.409 INFO:teuthology.orchestra.run.smithi064.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-21T07:20:47.502 INFO:teuthology.orchestra.run.smithi064.stdout:4 upgraded, 39 newly installed, 0 to remove and 331 not upgraded. 2024-09-21T07:20:47.502 INFO:teuthology.orchestra.run.smithi064.stdout:Need to get 55.8 MB of archives. 2024-09-21T07:20:47.503 INFO:teuthology.orchestra.run.smithi064.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-21T07:20:47.503 INFO:teuthology.orchestra.run.smithi064.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-21T07:20:47.634 INFO:teuthology.orchestra.run.smithi064.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-21T07:20:47.638 INFO:teuthology.orchestra.run.smithi064.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-21T07:20:47.665 INFO:teuthology.orchestra.run.smithi064.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-21T07:20:47.665 INFO:teuthology.orchestra.run.smithi064.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-21T07:20:47.666 INFO:teuthology.orchestra.run.smithi064.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-21T07:20:47.674 INFO:teuthology.orchestra.run.smithi064.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-21T07:20:47.674 INFO:teuthology.orchestra.run.smithi064.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-21T07:20:47.676 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-21T07:20:47.677 INFO:teuthology.orchestra.run.smithi064.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-21T07:20:47.678 INFO:teuthology.orchestra.run.smithi064.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-21T07:20:47.679 INFO:teuthology.orchestra.run.smithi064.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-21T07:20:47.686 INFO:teuthology.orchestra.run.smithi064.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-21T07:20:47.687 INFO:teuthology.orchestra.run.smithi064.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-21T07:20:47.687 INFO:teuthology.orchestra.run.smithi064.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-21T07:20:47.703 INFO:teuthology.orchestra.run.smithi064.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-21T07:20:47.919 INFO:teuthology.orchestra.run.smithi064.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-21T07:20:47.928 INFO:teuthology.orchestra.run.smithi064.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-21T07:20:47.939 INFO:teuthology.orchestra.run.smithi064.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.4 [262 kB] 2024-09-21T07:20:47.949 INFO:teuthology.orchestra.run.smithi064.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-21T07:20:47.950 INFO:teuthology.orchestra.run.smithi064.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-21T07:20:47.964 INFO:teuthology.orchestra.run.smithi064.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-21T07:20:47.975 INFO:teuthology.orchestra.run.smithi064.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-21T07:20:47.992 INFO:teuthology.orchestra.run.smithi064.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-21T07:20:47.993 INFO:teuthology.orchestra.run.smithi064.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-21T07:20:48.038 INFO:teuthology.orchestra.run.smithi064.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-21T07:20:48.038 INFO:teuthology.orchestra.run.smithi064.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.4 [1,094 kB] 2024-09-21T07:20:48.051 INFO:teuthology.orchestra.run.smithi064.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-21T07:20:48.072 INFO:teuthology.orchestra.run.smithi064.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-21T07:20:48.076 INFO:teuthology.orchestra.run.smithi064.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-21T07:20:48.077 INFO:teuthology.orchestra.run.smithi064.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-21T07:20:48.078 INFO:teuthology.orchestra.run.smithi064.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-21T07:20:48.078 INFO:teuthology.orchestra.run.smithi064.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-21T07:20:48.094 INFO:teuthology.orchestra.run.smithi064.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-21T07:20:48.097 INFO:teuthology.orchestra.run.smithi064.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-21T07:20:48.243 INFO:teuthology.orchestra.run.smithi064.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-21T07:20:48.243 INFO:teuthology.orchestra.run.smithi064.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-21T07:20:48.243 INFO:teuthology.orchestra.run.smithi064.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-21T07:20:48.243 INFO:teuthology.orchestra.run.smithi064.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-21T07:20:48.244 INFO:teuthology.orchestra.run.smithi064.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-21T07:20:48.244 INFO:teuthology.orchestra.run.smithi064.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-21T07:20:48.257 INFO:teuthology.orchestra.run.smithi064.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-21T07:20:48.257 INFO:teuthology.orchestra.run.smithi064.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-21T07:20:48.414 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T07:20:48.663 INFO:teuthology.orchestra.run.smithi064.stdout:Preconfiguring packages ... 2024-09-21T07:20:48.812 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 55.8 MB in 1s (66.4 MB/s) 2024-09-21T07:20:49.109 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-21T07:20:49.113 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T07:20:49.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-21T07:20:49.219 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-21T07:20:49.277 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:49.402 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-21T07:20:49.402 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T07:20:49.587 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T07:20:49.588 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T07:20:49.588 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T07:20:49.588 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T07:20:49.589 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2024-09-21T07:20:49.589 INFO:teuthology.orchestra.run.smithi090.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-21T07:20:49.589 INFO:teuthology.orchestra.run.smithi090.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-21T07:20:49.589 INFO:teuthology.orchestra.run.smithi090.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-21T07:20:49.589 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-21T07:20:49.590 INFO:teuthology.orchestra.run.smithi090.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-21T07:20:49.591 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2024-09-21T07:20:49.591 INFO:teuthology.orchestra.run.smithi090.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-21T07:20:49.591 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-21T07:20:49.591 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-21T07:20:49.646 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2024-09-21T07:20:49.647 INFO:teuthology.orchestra.run.smithi090.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-21T07:20:49.647 INFO:teuthology.orchestra.run.smithi090.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-21T07:20:49.647 INFO:teuthology.orchestra.run.smithi090.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-21T07:20:49.647 INFO:teuthology.orchestra.run.smithi090.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-21T07:20:49.647 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-21T07:20:49.648 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-21T07:20:49.648 INFO:teuthology.orchestra.run.smithi090.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-21T07:20:49.649 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2024-09-21T07:20:49.649 INFO:teuthology.orchestra.run.smithi090.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-21T07:20:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:4 upgraded, 39 newly installed, 0 to remove and 331 not upgraded. 2024-09-21T07:20:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 55.8 MB of archives. 2024-09-21T07:20:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-21T07:20:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-21T07:20:49.837 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-21T07:20:49.841 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-21T07:20:49.868 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-21T07:20:49.869 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-21T07:20:49.869 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-21T07:20:49.876 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-21T07:20:49.877 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-21T07:20:49.879 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-21T07:20:49.879 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-21T07:20:49.880 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-21T07:20:49.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-21T07:20:49.885 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-21T07:20:49.889 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-21T07:20:49.889 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-21T07:20:49.889 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-21T07:20:49.906 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-21T07:20:50.118 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-21T07:20:50.120 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-21T07:20:50.120 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.4 [262 kB] 2024-09-21T07:20:50.122 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-21T07:20:50.123 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-21T07:20:50.127 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-21T07:20:50.129 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-21T07:20:50.136 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-21T07:20:50.136 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-21T07:20:50.157 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-21T07:20:50.157 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.4 [1,094 kB] 2024-09-21T07:20:50.167 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-21T07:20:50.187 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-21T07:20:50.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-21T07:20:50.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-21T07:20:50.192 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-21T07:20:50.192 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-21T07:20:50.204 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-21T07:20:50.206 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-21T07:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-21T07:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-21T07:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-21T07:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-21T07:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-21T07:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-21T07:20:50.366 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-21T07:20:50.366 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-21T07:20:50.749 INFO:teuthology.orchestra.run.smithi090.stdout:Preconfiguring packages ... 2024-09-21T07:20:50.908 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 55.8 MB in 1s (78.6 MB/s) 2024-09-21T07:20:51.014 INFO:teuthology.orchestra.run.smithi064.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-21T07:20:51.193 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-21T07:20:51.197 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:51.281 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package flex. 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:20:53.044 INFO:teuthology.orchestra.run.smithi090.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-21T07:20:53.075 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-21T07:20:53.079 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:53.200 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:53.310 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package flex. 2024-09-21T07:20:53.378 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-21T07:20:53.382 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:53.425 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-21T07:20:53.706 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:53.928 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-21T07:20:54.090 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-21T07:20:54.141 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-21T07:20:54.489 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:20:54.533 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package bison. 2024-09-21T07:20:54.613 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-21T07:20:54.617 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-21T07:20:54.661 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-21T07:20:55.070 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-21T07:20:55.086 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-21T07:20:55.128 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-21T07:20:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-21T07:20:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:55.414 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package dump. 2024-09-21T07:20:55.431 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-21T07:20:55.473 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking dump (0.4b47-3) ... 2024-09-21T07:20:55.527 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:55.760 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package indent. 2024-09-21T07:20:55.777 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:20:55.818 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-21T07:20:55.907 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-21T07:20:56.026 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-21T07:20:56.104 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-21T07:20:56.121 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-21T07:20:56.162 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-21T07:20:56.343 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-21T07:20:56.491 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-21T07:20:56.508 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-21T07:20:56.549 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-21T07:20:56.745 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package bison. 2024-09-21T07:20:56.802 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-21T07:20:56.817 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-21T07:20:56.819 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-21T07:20:56.821 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-21T07:20:56.860 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-21T07:20:56.864 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-21T07:20:57.172 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-21T07:20:57.189 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:57.222 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-21T07:20:57.250 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-21T07:20:57.265 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-21T07:20:57.300 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-21T07:20:57.466 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-21T07:20:57.483 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:57.525 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-21T07:20:57.629 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package dump. 2024-09-21T07:20:57.643 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-21T07:20:57.687 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking dump (0.4b47-3) ... 2024-09-21T07:20:57.777 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libjson-perl. 2024-09-21T07:20:57.794 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-21T07:20:57.835 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-21T07:20:57.958 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package indent. 2024-09-21T07:20:57.973 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:20:58.017 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-21T07:20:58.147 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-21T07:20:58.164 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-21T07:20:58.205 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-21T07:20:58.245 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-21T07:20:58.259 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-21T07:20:58.295 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-21T07:20:58.625 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-21T07:20:58.640 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-21T07:20:58.684 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-21T07:20:58.936 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-21T07:20:58.951 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-21T07:20:58.986 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-21T07:20:59.325 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-21T07:20:59.340 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:59.383 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-21T07:20:59.542 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-21T07:20:59.559 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-21T07:20:59.600 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:20:59.644 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-21T07:20:59.659 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-21T07:20:59.694 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-21T07:20:59.861 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-21T07:20:59.878 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-21T07:20:59.911 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:20:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjson-perl. 2024-09-21T07:20:59.954 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-21T07:20:59.997 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-21T07:21:00.197 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-21T07:21:00.214 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2024-09-21T07:21:00.255 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:00.310 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-21T07:21:00.326 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-21T07:21:00.438 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-21T07:21:00.608 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-21T07:21:00.625 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-21T07:21:00.667 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-21T07:21:01.003 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-21T07:21:01.019 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-21T07:21:01.061 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-21T07:21:01.380 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-21T07:21:01.397 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:01.783 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-21T07:21:01.801 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:01.841 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:01.948 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-21T07:21:01.964 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-21T07:21:02.006 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:02.136 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-21T07:21:02.153 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:02.219 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:02.268 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-21T07:21:02.284 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-21T07:21:02.326 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:02.472 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-21T07:21:02.488 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-21T07:21:02.530 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:21:02.672 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-21T07:21:02.688 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2024-09-21T07:21:02.721 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:03.034 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-21T07:21:03.050 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-21T07:21:03.058 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-21T07:21:03.074 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-21T07:21:03.083 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-21T07:21:03.116 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-21T07:21:03.386 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package modemmanager. 2024-09-21T07:21:03.403 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2024-09-21T07:21:03.437 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-21T07:21:03.445 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:03.453 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-21T07:21:03.496 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-21T07:21:03.799 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-21T07:21:03.814 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:03.849 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:04.178 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package network-manager. 2024-09-21T07:21:04.193 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-21T07:21:04.195 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-21T07:21:04.209 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:04.245 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-21T07:21:04.252 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:04.581 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-21T07:21:04.597 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:04.640 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:04.869 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ppp. 2024-09-21T07:21:04.875 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-21T07:21:04.885 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-21T07:21:04.891 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-21T07:21:04.934 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:21:05.252 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-21T07:21:05.456 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-21T07:21:05.471 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-21T07:21:05.565 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package pptp-linux. 2024-09-21T07:21:05.580 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-21T07:21:05.623 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-21T07:21:05.623 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-21T07:21:05.859 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-21T07:21:05.874 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-21T07:21:05.909 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-21T07:21:05.960 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package modemmanager. 2024-09-21T07:21:05.976 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2024-09-21T07:21:06.019 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:06.154 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-21T07:21:06.169 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-21T07:21:06.203 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client-common (238) ... 2024-09-21T07:21:06.507 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-21T07:21:06.523 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:06.566 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager. 2024-09-21T07:21:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-21T07:21:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-21T07:21:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-common. 2024-09-21T07:21:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-21T07:21:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-21T07:21:07.277 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-common (238) ... 2024-09-21T07:21:07.403 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ppp. 2024-09-21T07:21:07.420 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-21T07:21:07.710 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-14. 2024-09-21T07:21:07.727 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:07.763 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:07.770 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-21T07:21:08.093 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package pptp-linux. 2024-09-21T07:21:08.108 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-21T07:21:08.151 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-21T07:21:08.454 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-21T07:21:08.469 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-21T07:21:08.808 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-21T07:21:08.822 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-21T07:21:08.866 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-common (238) ... 2024-09-21T07:21:08.957 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql. 2024-09-21T07:21:08.973 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-21T07:21:09.007 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql (14+238) ... 2024-09-21T07:21:09.172 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-21T07:21:09.186 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:09.226 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client. 2024-09-21T07:21:09.230 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:09.241 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-21T07:21:09.285 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client (14+238) ... 2024-09-21T07:21:09.553 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-21T07:21:09.569 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-21T07:21:09.611 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-21T07:21:09.861 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-common. 2024-09-21T07:21:09.876 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-21T07:21:09.937 INFO:teuthology.orchestra.run.smithi090.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-21T07:21:09.956 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package tcl8.6. 2024-09-21T07:21:09.968 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-common (238) ... 2024-09-21T07:21:09.972 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-21T07:21:10.014 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-21T07:21:10.308 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package tcl. 2024-09-21T07:21:10.325 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-21T07:21:10.372 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-14. 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-21T07:21:10.497 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:10.730 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package wpasupplicant. 2024-09-21T07:21:10.745 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-21T07:21:10.786 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-21T07:21:11.115 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-21T07:21:11.134 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-21T07:21:11.190 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-21T07:21:11.544 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-21T07:21:11.561 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-21T07:21:11.612 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-21T07:21:11.897 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client-common (238) ... 2024-09-21T07:21:12.107 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-21T07:21:12.211 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql. 2024-09-21T07:21:12.226 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-21T07:21:12.233 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-21T07:21:12.302 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql (14+238) ... 2024-09-21T07:21:12.359 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:12.477 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-21T07:21:12.546 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client. 2024-09-21T07:21:12.561 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-21T07:21:12.578 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-21T07:21:12.604 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client (14+238) ... 2024-09-21T07:21:12.713 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:12.833 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-21T07:21:12.848 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-21T07:21:12.883 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-21T07:21:13.202 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package tcl8.6. 2024-09-21T07:21:13.217 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-21T07:21:13.261 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-21T07:21:13.556 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package tcl. 2024-09-21T07:21:13.570 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-21T07:21:13.618 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-21T07:21:13.685 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-21T07:21:13.793 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-21T07:21:13.926 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package wpasupplicant. 2024-09-21T07:21:13.942 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-21T07:21:13.976 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-21T07:21:14.131 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-21T07:21:14.131 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-21T07:21:14.356 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-21T07:21:14.371 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-21T07:21:14.414 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-21T07:21:14.794 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-21T07:21:14.809 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-21T07:21:14.846 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-21T07:21:14.860 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-21T07:21:14.972 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-21T07:21:15.098 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:21:15.137 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-common (238) ... 2024-09-21T07:21:15.224 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-21T07:21:15.327 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-21T07:21:15.350 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-21T07:21:15.453 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-21T07:21:15.476 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-21T07:21:15.579 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:15.627 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-21T07:21:15.705 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-21T07:21:15.728 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-21T07:21:15.831 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-21T07:21:15.958 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:16.408 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-21T07:21:16.534 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up dump (0.4b47-3) ... 2024-09-21T07:21:16.629 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-21T07:21:16.694 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:16.795 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-21T07:21:16.895 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-21T07:21:16.896 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-21T07:21:16.990 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-21T07:21:17.014 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-21T07:21:17.165 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-21T07:21:17.254 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-21T07:21:17.316 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-21T07:21:17.360 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-21T07:21:17.360 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-21T07:21:17.442 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-21T07:21:17.635 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-21T07:21:17.761 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:17.887 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-21T07:21:18.027 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-21T07:21:18.055 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client (14+238) ... 2024-09-21T07:21:18.181 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-21T07:21:18.188 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-21T07:21:18.314 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-21T07:21:18.440 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-21T07:21:18.549 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-21T07:21:18.658 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout:which means they are currently configured by ifupdown: 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout:- enp3s0f1 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-21T07:21:18.755 INFO:teuthology.orchestra.run.smithi064.stdout:remove their configuration from /etc/network/interfaces. 2024-09-21T07:21:18.756 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:18.785 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-21T07:21:18.911 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-21T07:21:18.915 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-21T07:21:19.328 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-21T07:21:19.660 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-21T07:21:19.754 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-21T07:21:19.786 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up dump (0.4b47-3) ... 2024-09-21T07:21:19.881 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-21T07:21:19.946 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:20.115 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-21T07:21:20.249 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-21T07:21:20.359 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-21T07:21:20.467 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:20.493 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-21T07:21:20.583 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-21T07:21:20.627 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-21T07:21:20.645 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-21T07:21:20.761 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-21T07:21:20.771 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-21T07:21:20.887 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-common (238) ... 2024-09-21T07:21:20.948 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-21T07:21:21.075 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:21.184 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-21T07:21:21.352 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client (14+238) ... 2024-09-21T07:21:21.479 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-21T07:21:21.846 INFO:teuthology.orchestra.run.smithi064.stdout:Adding user postgres to group ssl-cert 2024-09-21T07:21:22.101 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:22.102 INFO:teuthology.orchestra.run.smithi064.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-21T07:21:22.362 INFO:teuthology.orchestra.run.smithi064.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-21T07:21:22.362 INFO:teuthology.orchestra.run.smithi064.stdout:Removing obsolete dictionary files: 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:which means they are currently configured by ifupdown: 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:- enp3s0f1 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:remove their configuration from /etc/network/interfaces. 2024-09-21T07:21:22.644 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:22.777 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-21T07:21:23.077 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-21T07:21:23.160 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-21T07:21:23.587 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-21T07:21:23.597 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:23.948 INFO:teuthology.orchestra.run.smithi064.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-21T07:21:23.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:This user must also own the server process. 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:The database cluster will be initialized with locale "en_US". 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:The default text search configuration will be set to "english". 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:24.017 INFO:teuthology.orchestra.run.smithi064.stdout:Data page checksums are disabled. 2024-09-21T07:21:24.018 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:24.018 INFO:teuthology.orchestra.run.smithi064.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-21T07:21:24.018 INFO:teuthology.orchestra.run.smithi064.stdout:creating subdirectories ... ok 2024-09-21T07:21:24.018 INFO:teuthology.orchestra.run.smithi064.stdout:selecting dynamic shared memory implementation ... posix 2024-09-21T07:21:24.043 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default max_connections ... 100 2024-09-21T07:21:24.078 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default shared_buffers ... 128MB 2024-09-21T07:21:24.092 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default time zone ... Etc/UTC 2024-09-21T07:21:24.093 INFO:teuthology.orchestra.run.smithi064.stdout:creating configuration files ... ok 2024-09-21T07:21:24.263 INFO:teuthology.orchestra.run.smithi064.stdout:running bootstrap script ... ok 2024-09-21T07:21:24.342 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-21T07:21:24.485 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-21T07:21:24.611 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-21T07:21:24.737 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-common (238) ... 2024-09-21T07:21:24.889 INFO:teuthology.orchestra.run.smithi064.stdout:performing post-bootstrap initialization ... ok 2024-09-21T07:21:25.393 INFO:teuthology.orchestra.run.smithi064.stdout:syncing data to disk ... ok 2024-09-21T07:21:25.682 INFO:teuthology.orchestra.run.smithi090.stdout:Adding user postgres to group ssl-cert 2024-09-21T07:21:25.935 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-21T07:21:25.965 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:25.965 INFO:teuthology.orchestra.run.smithi090.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-21T07:21:26.286 INFO:teuthology.orchestra.run.smithi090.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-21T07:21:26.286 INFO:teuthology.orchestra.run.smithi090.stdout:Removing obsolete dictionary files: 2024-09-21T07:21:27.056 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-21T07:21:27.700 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-21T07:21:28.048 INFO:teuthology.orchestra.run.smithi090.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-21T07:21:28.065 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:This user must also own the server process. 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:The database cluster will be initialized with locale "en_US". 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:The default text search configuration will be set to "english". 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:Data page checksums are disabled. 2024-09-21T07:21:28.174 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-21T07:21:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:creating subdirectories ... ok 2024-09-21T07:21:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:selecting dynamic shared memory implementation ... posix 2024-09-21T07:21:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default max_connections ... 100 2024-09-21T07:21:28.232 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default shared_buffers ... 128MB 2024-09-21T07:21:28.246 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default time zone ... Etc/UTC 2024-09-21T07:21:28.247 INFO:teuthology.orchestra.run.smithi090.stdout:creating configuration files ... ok 2024-09-21T07:21:28.415 INFO:teuthology.orchestra.run.smithi090.stdout:running bootstrap script ... ok 2024-09-21T07:21:29.038 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:29.174 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-21T07:21:29.175 INFO:teuthology.orchestra.run.smithi090.stdout:performing post-bootstrap initialization ... ok 2024-09-21T07:21:29.298 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql (14+238) ... 2024-09-21T07:21:29.424 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:29.549 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:29.677 INFO:teuthology.orchestra.run.smithi090.stdout:syncing data to disk ... ok 2024-09-21T07:21:29.811 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-21T07:21:29.811 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-21T07:21:30.155 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-21T07:21:30.569 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T07:21:30.653 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-21T07:21:30.971 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T07:21:31.123 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T07:21:32.500 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-21T07:21:32.592 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T07:21:33.135 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:33.138 INFO:teuthology.orchestra.run.smithi064.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T07:21:33.145 DEBUG:teuthology.parallel:result is None 2024-09-21T07:21:33.261 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-21T07:21:33.387 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql (14+238) ... 2024-09-21T07:21:33.515 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-21T07:21:33.641 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.4) ... 2024-09-21T07:21:33.901 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-21T07:21:33.901 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-21T07:21:34.677 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T07:21:34.769 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-21T07:21:35.138 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T07:21:35.291 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T07:21:36.378 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-21T07:21:36.486 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T07:21:37.041 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T07:21:37.047 DEBUG:teuthology.parallel:result is None 2024-09-21T07:21:37.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:21:37.189 DEBUG:teuthology.orchestra.run.smithi064:> dpkg-query -W -f '${Version}' ceph 2024-09-21T07:21:37.214 INFO:teuthology.orchestra.run.smithi064.stdout:19.3.0-5120-g18432218-1jammy 2024-09-21T07:21:37.214 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120-g18432218-1jammy 2024-09-21T07:21:37.215 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120-g18432218-1jammy is installed. 2024-09-21T07:21:37.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:21:37.355 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-query -W -f '${Version}' ceph 2024-09-21T07:21:37.377 INFO:teuthology.orchestra.run.smithi090.stdout:19.3.0-5120-g18432218-1jammy 2024-09-21T07:21:37.378 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120-g18432218-1jammy 2024-09-21T07:21:37.378 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120-g18432218-1jammy is installed. 2024-09-21T07:21:37.380 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:21:37.380 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:37.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:21:37.402 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:37.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:21:37.438 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:21:37.439 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:37.439 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:21:37.471 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:21:37.535 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:37.535 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:21:37.553 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:21:37.613 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:21:37.613 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:37.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:21:37.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:21:37.703 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:37.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:21:37.721 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:21:37.781 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:21:37.781 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:37.781 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:21:37.803 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:21:37.871 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:37.871 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:21:37.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:21:37.949 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T07:21:38.029 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T07:21:38.029 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /var/log/ceph 2024-09-21T07:21:38.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-09-21T07:21:38.051 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T07:21:38.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T07:21:38.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T07:21:38.115 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T07:21:38.115 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T07:21:38.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T07:21:38.185 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T07:21:38.185 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T07:21:38.185 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T07:21:38.186 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:38.186 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T07:21:38.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T07:21:38.324 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:38.324 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T07:21:38.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T07:21:38.423 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T07:21:38.423 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T07:21:38.424 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913586', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDi8ehDSnRTDHfXVl6EsOnEjCDEcCYApG5ucp91wey78JCiDWFWFHM0Kc3EDTsQO5WWNMQVBbS9ZaUTP84CD9pE=', 'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTsaCUUYCa1CEgoUWUH9tKh6STeLPB2hOQJy11Ot1N2q9RQC9Zcm3piCKnJrtRCGFH+XBD/IdsUroUNKkQq/B0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T07:21:38.424 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T07:21:38.427 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T07:21:38.471 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T07:21:38.477 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T07:21:38.531 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:38.531 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:21:38.550 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:21:38.551 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-21 07:14:57.590972670 +0000 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-21 07:14:57.178976350 +0000 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-21 07:14:57.178976350 +0000 2024-09-21T07:21:38.603 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-21 07:14:57.178976350 +0000 2024-09-21T07:21:38.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:21:38.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:21:38.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:21:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000373418 s, 1.4 MB/s 2024-09-21T07:21:38.667 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:21:38.725 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-09-21T07:21:38.779 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:21:38.779 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:38.779 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-21T07:21:38.779 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:38.780 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-21 07:14:58.142967740 +0000 2024-09-21T07:21:38.780 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-21 07:14:57.886970026 +0000 2024-09-21T07:21:38.780 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-21 07:14:57.886970026 +0000 2024-09-21T07:21:38.780 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-21 07:14:57.886970026 +0000 2024-09-21T07:21:38.780 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:21:38.845 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:21:38.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:21:38.846 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000372392 s, 1.4 MB/s 2024-09-21T07:21:38.848 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:21:38.901 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-21 07:14:58.738962416 +0000 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-21 07:14:58.454964953 +0000 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-21 07:14:58.454964953 +0000 2024-09-21T07:21:38.951 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-21 07:14:58.454964953 +0000 2024-09-21T07:21:38.952 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:21:39.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:21:39.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:21:39.018 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000373883 s, 1.4 MB/s 2024-09-21T07:21:39.020 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:21:39.072 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-09-21T07:21:39.123 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:21:39.123 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:39.123 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-09-21T07:21:39.123 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:39.124 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-21 07:14:59.294957450 +0000 2024-09-21T07:21:39.124 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-21 07:14:59.030959807 +0000 2024-09-21T07:21:39.124 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-21 07:14:59.030959807 +0000 2024-09-21T07:21:39.124 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-21 07:14:59.030959807 +0000 2024-09-21T07:21:39.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:21:39.185 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:21:39.185 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:21:39.185 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000385783 s, 1.3 MB/s 2024-09-21T07:21:39.187 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:21:39.245 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:39.245 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:39.245 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:21:39.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:21:39.254 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 892 Links: 1 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 07:14:59.813064902 +0000 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 07:14:59.541067332 +0000 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 07:14:59.541067332 +0000 2024-09-21T07:21:39.304 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 07:14:59.541067332 +0000 2024-09-21T07:21:39.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:21:39.365 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T07:21:39.365 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T07:21:39.365 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000657719 s, 778 kB/s 2024-09-21T07:21:39.367 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:21:39.422 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 906 Links: 1 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 07:15:00.117062186 +0000 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 07:15:00.113062223 +0000 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 07:15:00.113062223 +0000 2024-09-21T07:21:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 07:15:00.113062223 +0000 2024-09-21T07:21:39.472 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:21:39.534 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T07:21:39.534 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T07:21:39.534 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000375869 s, 1.4 MB/s 2024-09-21T07:21:39.536 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:21:39.590 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 925 Links: 1 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 07:15:00.965054613 +0000 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 07:15:00.693057042 +0000 2024-09-21T07:21:39.640 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 07:15:00.693057042 +0000 2024-09-21T07:21:39.641 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 07:15:00.693057042 +0000 2024-09-21T07:21:39.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:21:39.702 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T07:21:39.702 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T07:21:39.702 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000379123 s, 1.4 MB/s 2024-09-21T07:21:39.704 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:21:39.758 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-21T07:21:39.808 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:21:39.808 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:21:39.808 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 940 Links: 1 2024-09-21T07:21:39.808 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:21:39.808 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 07:15:01.525049610 +0000 2024-09-21T07:21:39.809 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 07:15:01.257052005 +0000 2024-09-21T07:21:39.809 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 07:15:01.257052005 +0000 2024-09-21T07:21:39.809 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 07:15:01.257052005 +0000 2024-09-21T07:21:39.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:21:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T07:21:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T07:21:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000385549 s, 1.3 MB/s 2024-09-21T07:21:39.872 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:21:39.925 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:39.925 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T07:21:39.925 INFO:tasks.ceph:Generating config... 2024-09-21T07:21:39.926 INFO:tasks.ceph:[client] pid file = 2024-09-21T07:21:39.927 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T07:21:39.927 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T07:21:39.927 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T07:21:39.927 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T07:21:39.928 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T07:21:39.928 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T07:21:39.928 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T07:21:39.988 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T07:21:40.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T07:21:40.071 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:21:40.091 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.64'), ('mon.b', '172.21.15.90'), ('mon.c', '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]')] 2024-09-21T07:21:40.091 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}} 2024-09-21T07:21:40.092 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:40.092 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T07:21:40.146 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.64 --add b 172.21.15.90 --addv c '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: generated fsid be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:21:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:setting min_mon_release = quincy 2024-09-21T07:21:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 0 2024-09-21T07:21:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:fsid be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:last_changed 2024-09-21T07:21:40.247408+0000 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:created 2024-09-21T07:21:40.247408+0000 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:min_mon_release 17 (quincy) 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:election_strategy: 1 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:0: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.a 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-09-21T07:21:40.247 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T07:21:40.250 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T07:21:40.258 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID be0ccda5-3d1a-4615-9c09-c8d9d4461231... 2024-09-21T07:21:40.258 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:21:40.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:21:40.344 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-09-21T07:21:40.344 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-09-21T07:21:40.344 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:21:40.344 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-09-21T07:21:40.344 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-09-21T07:21:40.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:21:40.346 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:21:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-09-21T07:21:40.348 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-09-21T07:21:40.349 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:21:40.350 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-09-21T07:21:40.351 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:21:40.352 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:21:40.353 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi064.stdout: mds cache max size = 1000 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi064.stdout: mds log max segments = 1 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.355 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.356 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.357 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T07:21:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:21:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:21:40.360 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:21:40.361 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:21:40.362 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout: mds cache max size = 1000 2024-09-21T07:21:40.363 INFO:teuthology.orchestra.run.smithi090.stdout: mds log max segments = 1 2024-09-21T07:21:40.366 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T07:21:40.366 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T07:21:40.475 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T07:21:40.476 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:40.476 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T07:21:40.484 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:40.484 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T07:21:40.538 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:21:40.538 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:40.538 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T07:21:40.538 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:21:40.610 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:21:40.610 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:40.658 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:21:40.658 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:40.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T07:21:40.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:21:40.691 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:21:40.691 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:40.739 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T07:21:40.739 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T07:21:40.739 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T07:21:40.804 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T07:21:40.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T07:21:40.876 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T07:21:40.894 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T07:21:40.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T07:21:40.960 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T07:21:40.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T07:21:40.984 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T07:21:41.091 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T07:21:41.096 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T07:21:41.116 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T07:21:41.181 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T07:21:41.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T07:21:41.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T07:21:41.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T07:21:41.337 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T07:21:41.337 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:21:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T07:21:41.409 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T07:21:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T07:21:41.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T07:21:41.530 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T07:21:41.547 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T07:21:41.598 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T07:21:41.615 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T07:21:41.615 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T07:21:41.615 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T07:21:41.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:41.635 INFO:tasks.ceph:role: osd.0 2024-09-21T07:21:41.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:21:41.635 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:41.710 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:42.122 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-09-21T07:21:42.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-09-21T07:21:42.125 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T07:21:42.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T07:21:42.285 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:42.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:42.286 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T07:21:42.349 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:42.349 INFO:tasks.ceph:role: osd.1 2024-09-21T07:21:42.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:21:42.349 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:42.776 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-09-21T07:21:42.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-09-21T07:21:42.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T07:21:42.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T07:21:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:42.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:42.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T07:21:42.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:42.982 INFO:tasks.ceph:role: osd.2 2024-09-21T07:21:42.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:21:42.982 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:43.053 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:43.054 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:43.054 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:43.054 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:43.054 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:43.440 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-09-21T07:21:43.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-09-21T07:21:43.443 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T07:21:43.550 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T07:21:43.567 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:43.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:43.569 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T07:21:43.630 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:43.630 INFO:tasks.ceph:role: osd.3 2024-09-21T07:21:43.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:21:43.630 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:43.698 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:43.699 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:43.699 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:43.699 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:43.699 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:44.087 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-09-21T07:21:44.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-09-21T07:21:44.090 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T07:21:44.225 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T07:21:44.243 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:44.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:44.244 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:44.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:44.387+0000 7f2f2e52d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T07:21:44.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:44.395+0000 7f2f2e52d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T07:21:44.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:44.395+0000 7f2f2e52d7c0 -1 bdev(0x5584a1972a00 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T07:21:44.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:44.395+0000 7f2f2e52d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T07:21:47.684 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T07:21:47.705 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:47.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:47.811+0000 7fd9d34287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T07:21:47.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:47.811+0000 7fd9d34287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T07:21:47.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:47.811+0000 7fd9d34287c0 -1 bdev(0x557896590a00 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T07:21:47.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:47.811+0000 7fd9d34287c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T07:21:51.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T07:21:51.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:51.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:51.155+0000 7f11633037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T07:21:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:51.159+0000 7f11633037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T07:21:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:51.159+0000 7f11633037c0 -1 bdev(0x556504730a00 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T07:21:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:51.159+0000 7f11633037c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T07:21:54.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T07:21:54.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:21:54.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:54.511+0000 7eff0777a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T07:21:54.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:54.511+0000 7eff0777a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T07:21:54.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:54.511+0000 7eff0777a7c0 -1 bdev(0x55fef5b80a00 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T07:21:54.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:21:54.511+0000 7eff0777a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T07:21:57.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T07:21:57.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T07:21:57.796 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:57.796 INFO:tasks.ceph:role: osd.4 2024-09-21T07:21:57.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:21:57.797 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T07:21:57.867 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:57.868 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:58.270 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T07:21:58.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T07:21:58.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T07:21:58.376 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:58.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:58.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T07:21:58.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:58.459 INFO:tasks.ceph:role: osd.5 2024-09-21T07:21:58.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:21:58.459 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:58.536 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:58.537 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:58.537 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:58.537 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:58.941 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T07:21:58.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T07:21:58.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T07:21:59.079 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T07:21:59.096 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:59.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:59.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T07:21:59.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:59.159 INFO:tasks.ceph:role: osd.6 2024-09-21T07:21:59.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:21:59.159 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:59.227 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:21:59.645 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T07:21:59.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T07:21:59.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T07:21:59.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T07:21:59.803 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:21:59.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:21:59.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T07:21:59.867 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:21:59.868 INFO:tasks.ceph:role: osd.7 2024-09-21T07:21:59.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:21:59.868 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:21:59.939 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:22:00.304 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T07:22:00.306 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T07:22:00.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T07:22:00.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T07:22:00.439 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T07:22:00.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:22:00.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:00.602+0000 7f4238a8e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T07:22:00.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:00.602+0000 7f4238a8e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T07:22:00.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:00.602+0000 7f4238a8e7c0 -1 bdev(0x55c0583b0a00 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T07:22:00.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:00.602+0000 7f4238a8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T07:22:03.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T07:22:03.847 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:03.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:03.954+0000 7f76f76a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T07:22:03.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:03.954+0000 7f76f76a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T07:22:03.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:03.954+0000 7f76f76a47c0 -1 bdev(0x5575488c2a00 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T07:22:03.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:03.954+0000 7f76f76a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T07:22:07.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T07:22:07.260 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:07.366+0000 7fb82f8c77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T07:22:07.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:07.366+0000 7fb82f8c77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T07:22:07.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:07.366+0000 7fb82f8c77c0 -1 bdev(0x55ae088a0a00 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T07:22:07.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:07.366+0000 7fb82f8c77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T07:22:08.425 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:22:08.428 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:22:10.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T07:22:10.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:10.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:10.690+0000 7f931c42b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T07:22:10.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:10.690+0000 7f931c42b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T07:22:10.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:10.690+0000 7f931c42b7c0 -1 bdev(0x5592d4572a00 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T07:22:10.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:10.690+0000 7f931c42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T07:22:13.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T07:22:13.851 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T07:22:13.851 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:13.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T07:22:13.874 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:13.874 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T07:22:13.939 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:13.939 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T07:22:14.003 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.003 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T07:22:14.067 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.067 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T07:22:14.131 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.131 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T07:22:14.195 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T07:22:14.259 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T07:22:14.279 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.279 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T07:22:14.338 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.338 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T07:22:14.398 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T07:22:14.458 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T07:22:14.518 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.518 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T07:22:14.578 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T07:22:14.638 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.638 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T07:22:14.647 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:14.647 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T07:22:14.698 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.698 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T07:22:14.706 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:14.706 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T07:22:14.755 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T07:22:14.755 DEBUG:teuthology.orchestra.run.smithi064:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T07:22:14.758 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T07:22:14.798 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.y] 2024-09-21T07:22:14.798 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.0] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.1] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.2] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.3] 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw== 2024-09-21T07:22:14.799 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.x] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.4] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.5] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.6] 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ== 2024-09-21T07:22:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.7] 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ== 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout:[client.2] 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg== 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA== 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout:[client.3] 2024-09-21T07:22:14.801 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ== 2024-09-21T07:22:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w== 2024-09-21T07:22:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ== 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ== 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout:[client.2] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg== 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA== 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout:[client.3] 2024-09-21T07:22:14.814 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw== 2024-09-21T07:22:14.815 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:22:14.849 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:22:14.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:14.927 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:14.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:14.999 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:15.067 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.338 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:22:15.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:22:15.405 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:15.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:15.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:15.479 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:22:15.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.745 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:22:15.813 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:15.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:15.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:15.887 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:15.955 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:15.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:16.026 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:16.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:22:16.096 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T07:22:16.096 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T07:22:16.116 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:22:16.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T07:22:16.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T07:22:16.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:22:16.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T07:22:16.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T07:22:16.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:22:16.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T07:22:16.625 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:16.628 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:22:16.675 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T07:22:16.676 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T07:22:16.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T07:22:16.679 INFO:tasks.ceph.mon.a:Started 2024-09-21T07:22:16.679 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T07:22:16.679 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T07:22:16.721 INFO:tasks.ceph.mon.b:Started 2024-09-21T07:22:16.793 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T07:22:16.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T07:22:16.797 INFO:tasks.ceph.mon.c:Started 2024-09-21T07:22:16.797 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T07:22:16.797 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T07:22:16.797 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T07:22:16.800 INFO:tasks.ceph.mgr.y:Started 2024-09-21T07:22:16.800 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T07:22:16.800 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T07:22:16.803 INFO:tasks.ceph.mgr.x:Started 2024-09-21T07:22:16.803 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T07:22:16.803 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T07:22:16.806 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T07:22:16.806 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T07:22:16.852 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T07:22:16.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T07:22:16.896 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:22:16.896 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T07:22:16.940 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:22:16.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T07:22:16.989 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T07:22:16.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T07:22:17.040 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:22:17.040 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T07:22:17.084 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T07:22:17.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T07:22:17.132 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T07:22:17.132 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T07:22:17.176 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:22:17.176 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T07:22:17.221 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:22:17.222 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T07:22:17.268 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T07:22:17.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T07:22:17.317 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:22:17.317 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T07:22:17.364 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:22:17.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:22:17.408 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:22:17.409 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:22:17.456 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:22:17.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T07:22:17.504 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T07:22:17.505 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T07:22:17.548 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T07:22:17.548 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T07:22:17.596 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T07:22:17.597 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T07:22:17.644 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:22:17.645 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:22:17.692 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:22:17.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T07:22:17.740 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:22:17.741 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T07:22:17.790 DEBUG:tasks.ceph:set 22 configs 2024-09-21T07:22:17.790 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi064') 2024-09-21T07:22:22.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.278+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c15ff20 con 0x7fb23c146ca0 2024-09-21T07:22:22.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.278+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c15ab20 con 0x7fb23c146ca0 2024-09-21T07:22:22.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.282+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 5 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb2280ca020 con 0x7fb23c146ca0 2024-09-21T07:22:22.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.282+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb2280b7430 con 0x7fb23c146ca0 2024-09-21T07:22:22.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c15ca20 con 0x7fb23c146ca0 2024-09-21T07:22:22.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 -- 172.21.15.64:0/437816599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9fc15bab0 msgr2=0x7ff9fc1e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 --2- 172.21.15.64:0/437816599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9fc15bab0 0x7ff9fc1e5450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0c82c0 tx=0x7ff9f4013b70 comp rx=0 tx=0).stop 2024-09-21T07:22:22.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 -- 172.21.15.64:0/1950436185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6c8003ad0 msgr2=0x7fc6e014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 --2- 172.21.15.64:0/1950436185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6c8003ad0 0x7fc6e014e2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6d401c720 tx=0x7fc6c8005840 comp rx=0 tx=0).stop 2024-09-21T07:22:22.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb42c004160 con 0x7fb438004810 2024-09-21T07:22:22.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 -- 172.21.15.64:0/437816599 shutdown_connections 2024-09-21T07:22:22.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 --2- 172.21.15.64:0/437816599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9fc15bab0 0x7ff9fc1e5450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 --2- 172.21.15.64:0/437816599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9fc06d330 0x7ff9fc1e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 --2- 172.21.15.64:0/437816599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9e0004f50 0x7ff9fc15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7ffa01a00640 1 -- 172.21.15.64:0/437816599 >> 172.21.15.64:0/437816599 conn(0x7ff9fc0cdcc0 msgr2=0x7ff9fc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 -- 172.21.15.64:0/1950436185 shutdown_connections 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 --2- 172.21.15.64:0/1950436185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6c80099c0 0x7fc6e01fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 --2- 172.21.15.64:0/1950436185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c8004810 0x7fc6e0150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 --2- 172.21.15.64:0/1950436185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6c8003ad0 0x7fc6e014e2a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.286+0000 7fc6e6c00640 1 -- 172.21.15.64:0/1950436185 >> 172.21.15.64:0/1950436185 conn(0x7fc6e00b2b80 msgr2=0x7fc6e00b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.290+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7faa38075820 con 0x7faa1c004810 2024-09-21T07:22:22.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.290+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f788c000e40 con 0x7f78980053b0 2024-09-21T07:22:22.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.294+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb2280d1030 con 0x7fb23c146ca0 2024-09-21T07:22:22.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.294+0000 7fc6e6c00640 1 -- 172.21.15.64:0/1950436185 shutdown_connections 2024-09-21T07:22:22.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.294+0000 7fc6e6c00640 1 -- 172.21.15.64:0/1950436185 wait complete. 2024-09-21T07:22:22.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.302+0000 7ffa01a00640 1 -- 172.21.15.64:0/437816599 shutdown_connections 2024-09-21T07:22:22.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.302+0000 7ffa01a00640 1 -- 172.21.15.64:0/437816599 wait complete. 2024-09-21T07:22:22.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.306+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c280be020 con 0x7f0c14003700 2024-09-21T07:22:22.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.306+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c280b7950 con 0x7f0c14003700 2024-09-21T07:22:22.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.310+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3806e3f0 con 0x7f0c14003700 2024-09-21T07:22:22.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.310+0000 7fb44b400640 1 -- 172.21.15.64:0/3446214879 <== mon.1 v2:172.21.15.90:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v10)=0 v10) ==== 121+0+0 (secure 0 0 0) 0x7fb4400047b0 con 0x7fb438004810 2024-09-21T07:22:22.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7f78aa000640 1 -- 172.21.15.64:0/2565499827 <== mon.2 v2:172.21.15.90:3301/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f78ac0cb070 con 0x7f78980053b0 2024-09-21T07:22:22.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0c280c5030 con 0x7f0c14003700 2024-09-21T07:22:22.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 7 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f0c28004230 con 0x7f0c14003700 2024-09-21T07:22:22.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7fe67ea00640 1 -- 172.21.15.64:0/2630834398 <== mon.1 v2:172.21.15.90:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7fe678000e50 con 0x7fe68806d330 2024-09-21T07:22:22.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7fb228005a80 con 0x7fb23c146ca0 2024-09-21T07:22:22.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7faa2fe00640 1 -- 172.21.15.64:0/3124689794 <== mon.0 v2:172.21.15.64:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v11)=0 v11) ==== 114+0+0 (secure 0 0 0) 0x7faa380b5760 con 0x7faa1c004810 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7faa2fe00640 1 -- 172.21.15.64:0/3124689794 <== mon.0 v2:172.21.15.64:3300/0 9 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7faa2401e720 con 0x7faa1c004810 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7fa7acc00640 1 -- 172.21.15.64:0/1256924814 <== mon.0 v2:172.21.15.64:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7fa7a8010900 con 0x7fa7b006d330 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.314+0000 7fb44b400640 1 -- 172.21.15.64:0/3446214879 <== mon.1 v2:172.21.15.90:3300/0 9 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7fb440005120 con 0x7fb438004810 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb438004810 msgr2=0x7fb4540cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 --2- 172.21.15.64:0/3446214879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb438004810 0x7fb4540cef70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb434009f20 tx=0x7fb440013f10 comp rx=0 tx=0).stop 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 shutdown_connections 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 --2- 172.21.15.64:0/3446214879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4380053b0 0x7fb4540cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 --2- 172.21.15.64:0/3446214879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb438004810 0x7fb4540cef70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 --2- 172.21.15.64:0/3446214879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb438003a30 0x7fb4541538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 >> 172.21.15.64:0/3446214879 conn(0x7fb4540b2b80 msgr2=0x7fb45415f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 shutdown_connections 2024-09-21T07:22:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7fb453e00640 1 -- 172.21.15.64:0/3446214879 wait complete. 2024-09-21T07:22:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.318+0000 7ff673e00640 1 -- 172.21.15.64:0/690021293 <== mon.0 v2:172.21.15.64:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7ff674010480 con 0x7ff67c157050 2024-09-21T07:22:22.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7fa7acc00640 1 -- 172.21.15.64:0/1256924814 <== mon.0 v2:172.21.15.64:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fa7a8010bb0 con 0x7fa7b006d330 2024-09-21T07:22:22.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa2fe00640 1 -- 172.21.15.64:0/3124689794 <== mon.0 v2:172.21.15.64:3300/0 10 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7faa2401e9b0 con 0x7faa1c004810 2024-09-21T07:22:22.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c004810 msgr2=0x7faa382023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 --2- 172.21.15.64:0/3124689794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c004810 0x7faa382023f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faa24000c10 tx=0x7faa24013820 comp rx=0 tx=0).stop 2024-09-21T07:22:22.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa784005110 con 0x7fa7b006d330 2024-09-21T07:22:22.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7ff673e00640 1 -- 172.21.15.64:0/690021293 <== mon.0 v2:172.21.15.64:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7ff674010700 con 0x7ff67c157050 2024-09-21T07:22:22.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7fe67ea00640 1 -- 172.21.15.64:0/2630834398 <== mon.1 v2:172.21.15.90:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fe678012990 con 0x7fe68806d330 2024-09-21T07:22:22.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f0c280b7410 con 0x7f0c14003700 2024-09-21T07:22:22.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7f78aa000640 1 -- 172.21.15.64:0/2565499827 <== mon.2 v2:172.21.15.90:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f78ac0110d0 con 0x7f78980053b0 2024-09-21T07:22:22.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.334+0000 7f78aa000640 1 -- 172.21.15.64:0/2565499827 <== mon.2 v2:172.21.15.90:3301/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f78ac017660 con 0x7f78980053b0 2024-09-21T07:22:22.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 shutdown_connections 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 --2- 172.21.15.64:0/3124689794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa380b4e10 0x7faa380b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 --2- 172.21.15.64:0/3124689794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c004810 0x7faa382023f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 --2- 172.21.15.64:0/3124689794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa1c003a80 0x7faa380cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 >> 172.21.15.64:0/3124689794 conn(0x7faa380b2db0 msgr2=0x7faa380746f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.334+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 shutdown_connections 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.330+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fb2280c3aa0 con 0x7fb23c146ca0 2024-09-21T07:22:22.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.334+0000 7faa3ec00640 1 -- 172.21.15.64:0/3124689794 wait complete. 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78980053b0 msgr2=0x7f78b40b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 --2- 172.21.15.64:0/2565499827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78980053b0 0x7f78b40b5ed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f789800c4e0 tx=0x7f7898005840 comp rx=0 tx=0).stop 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 shutdown_connections 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 --2- 172.21.15.64:0/2565499827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78980053b0 0x7f78b40b5ed0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 --2- 172.21.15.64:0/2565499827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7898004810 0x7f78b4201110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 --2- 172.21.15.64:0/2565499827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7898003a80 0x7f78b4156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 >> 172.21.15.64:0/2565499827 conn(0x7f78b40b2b80 msgr2=0x7f78b40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.338+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 shutdown_connections 2024-09-21T07:22:22.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.342+0000 7f78b3200640 1 -- 172.21.15.64:0/2565499827 wait complete. 2024-09-21T07:22:22.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.342+0000 7fa7acc00640 1 -- 172.21.15.64:0/1256924814 <== mon.0 v2:172.21.15.64:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v13)=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7fa7a8024430 con 0x7fa7b006d330 2024-09-21T07:22:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.346+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe65c005110 con 0x7fe68806d330 2024-09-21T07:22:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.346+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7b006d330 msgr2=0x7fa7b01f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.346+0000 7fa7b7600640 1 --2- 172.21.15.64:0/1256924814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7b006d330 0x7fa7b01f0fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa790007320 tx=0x7fa7a8001b70 comp rx=0 tx=0).stop 2024-09-21T07:22:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 shutdown_connections 2024-09-21T07:22:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 --2- 172.21.15.64:0/1256924814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7b006d330 0x7fa7b01f0fb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 --2- 172.21.15.64:0/1256924814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa798004e70 0x7fa7b01f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 --2- 172.21.15.64:0/1256924814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7980040b0 0x7fa7b0155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 >> 172.21.15.64:0/1256924814 conn(0x7fa7b00b2db0 msgr2=0x7fa7b0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fe67ea00640 1 -- 172.21.15.64:0/2630834398 <== mon.1 v2:172.21.15.90:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fe678012cb0 con 0x7fe68806d330 2024-09-21T07:22:22.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f0c280b7ba0 con 0x7f0c14003700 2024-09-21T07:22:22.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb2280c3d80 con 0x7fb23c146ca0 2024-09-21T07:22:22.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 shutdown_connections 2024-09-21T07:22:22.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.350+0000 7fa7b7600640 1 -- 172.21.15.64:0/1256924814 wait complete. 2024-09-21T07:22:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.354+0000 7ff673e00640 1 -- 172.21.15.64:0/690021293 <== mon.0 v2:172.21.15.64:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff674010a00 con 0x7ff67c157050 2024-09-21T07:22:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.354+0000 7fe67ea00640 1 -- 172.21.15.64:0/2630834398 <== mon.1 v2:172.21.15.90:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fe67801a7c0 con 0x7fe68806d330 2024-09-21T07:22:22.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.366+0000 7f6a04c00640 1 -- 172.21.15.64:0/2118193069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e00061c0 msgr2=0x7f69e00086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.366+0000 7f6a04c00640 1 --2- 172.21.15.64:0/2118193069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e00061c0 0x7f69e00086b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006b30 tx=0x7f69ec01f620 comp rx=0 tx=0).stop 2024-09-21T07:22:22.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.366+0000 7f69fe800640 1 -- 172.21.15.64:0/2118193069 reap_dead start 2024-09-21T07:22:22.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.366+0000 7f6a04c00640 1 -- 172.21.15.64:0/2118193069 shutdown_connections 2024-09-21T07:22:22.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.366+0000 7f6a04c00640 1 -- 172.21.15.64:0/2118193069 >> 172.21.15.64:0/2118193069 conn(0x7f6a0006d450 msgr2=0x7f6a000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68806d330 msgr2=0x7fe688155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7f6a04c00640 1 -- 172.21.15.64:0/2118193069 shutdown_connections 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7f6a04c00640 1 -- 172.21.15.64:0/2118193069 wait complete. 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 --2- 172.21.15.64:0/2630834398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68806d330 0x7fe688155160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe67801f160 tx=0x7fe66c005840 comp rx=0 tx=0).stop 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 shutdown_connections 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 --2- 172.21.15.64:0/2630834398 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe688201760 0x7fe68815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 --2- 172.21.15.64:0/2630834398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe688201350 0x7fe68815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 --2- 172.21.15.64:0/2630834398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68806d330 0x7fe688155160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 >> 172.21.15.64:0/2630834398 conn(0x7fe6880b2db0 msgr2=0x7fe6880d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 shutdown_connections 2024-09-21T07:22:22.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.370+0000 7fe68da00640 1 -- 172.21.15.64:0/2630834398 wait complete. 2024-09-21T07:22:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.374+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7ff650005300 con 0x7ff67c157050 2024-09-21T07:22:22.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.378+0000 7f6a04c00640 1 Processor -- start 2024-09-21T07:22:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.378+0000 7ff673e00640 1 -- 172.21.15.64:0/690021293 <== mon.0 v2:172.21.15.64:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v15)=0 v15) ==== 111+0+0 (secure 0 0 0) 0x7ff67401a780 con 0x7ff67c157050 2024-09-21T07:22:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.378+0000 7f6a04c00640 1 -- start start 2024-09-21T07:22:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.378+0000 7f6a04c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f6a04c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f6a04c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a001fe470 0x7f6a00156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fd400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fd400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:54802/0 (socket says 172.21.15.64:54802) 2024-09-21T07:22:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50052/0 (socket says 172.21.15.64:50052) 2024-09-21T07:22:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f6a04c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a000cdb00 con 0x7f6a000c7d60 2024-09-21T07:22:22.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f6a04c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a000cd980 con 0x7f6a001fe470 2024-09-21T07:22:22.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f6a04c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6a001695c0 con 0x7f6a000c8170 2024-09-21T07:22:22.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fd400640 1 -- 172.21.15.64:0/3853781255 learned_addr learned my addr 172.21.15.64:0/3853781255 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:22.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 -- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 msgr2=0x7f6a00156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 -- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a001fe470 msgr2=0x7f6a00156ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a001fe470 0x7f6a00156ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 -- 172.21.15.64:0/3853781255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a000ca150 con 0x7f6a000c7d60 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fde00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f69f0012890 tx=0x7f69f0012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.382+0000 7f69fd400640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011c30 con 0x7f6a000c7d60 2024-09-21T07:22:22.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a000c98f0 con 0x7f6a000c7d60 2024-09-21T07:22:22.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a000c9e70 con 0x7f6a000c7d60 2024-09-21T07:22:22.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f69f001e420 con 0x7f6a000c7d60 2024-09-21T07:22:22.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011c30 con 0x7f6a000c7d60 2024-09-21T07:22:22.390 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi064') 2024-09-21T07:22:22.391 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi064') 2024-09-21T07:22:22.391 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi064') 2024-09-21T07:22:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69f001e5d0 con 0x7f6a000c7d60 2024-09-21T07:22:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69f001b040 con 0x7f6a000c7d60 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c157050 msgr2=0x7ff67c157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 --2- 172.21.15.64:0/690021293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c157050 0x7ff67c157460 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0c82c0 tx=0x7ff67400c9a0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 shutdown_connections 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 --2- 172.21.15.64:0/690021293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c157050 0x7ff67c157460 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 --2- 172.21.15.64:0/690021293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff67c15bb50 0x7ff67c204e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 --2- 172.21.15.64:0/690021293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c003730 0x7ff67c159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.386+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 >> 172.21.15.64:0/690021293 conn(0x7ff67c0cdcc0 msgr2=0x7ff67c0ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.390+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 shutdown_connections 2024-09-21T07:22:22.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.390+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d80052a0 con 0x7f6a000c7d60 2024-09-21T07:22:22.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.390+0000 7ff683200640 1 -- 172.21.15.64:0/690021293 wait complete. 2024-09-21T07:22:22.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.390+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f69f0027d60 con 0x7f6a000c7d60 2024-09-21T07:22:22.412 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi064') 2024-09-21T07:22:22.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.430+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb23c0b2440 con 0x7fb23c146ca0 2024-09-21T07:22:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.434+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f0c08005320 con 0x7f0c14003700 2024-09-21T07:22:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.434+0000 7fb232a00640 1 -- 172.21.15.64:0/2770492753 <== mon.1 v2:172.21.15.90:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7fb2280162b0 con 0x7fb23c146ca0 2024-09-21T07:22:22.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb23c146ca0 msgr2=0x7fb23c154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 --2- 172.21.15.64:0/2770492753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb23c146ca0 0x7fb23c154600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb228000c10 tx=0x7fb228019390 comp rx=0 tx=0).stop 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 shutdown_connections 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 --2- 172.21.15.64:0/2770492753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb23c15a240 0x7fb23c1f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 --2- 172.21.15.64:0/2770492753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb23c146ca0 0x7fb23c154600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 --2- 172.21.15.64:0/2770492753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21c0062b0 0x7fb23c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 >> 172.21.15.64:0/2770492753 conn(0x7fb23c0b2db0 msgr2=0x7fb23c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 shutdown_connections 2024-09-21T07:22:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.438+0000 7fb241c00640 1 -- 172.21.15.64:0/2770492753 wait complete. 2024-09-21T07:22:22.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2f400640 1 -- 172.21.15.64:0/1891535978 <== mon.1 v2:172.21.15.90:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7f0c28015e00 con 0x7f0c14003700 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c14003700 msgr2=0x7f0c38204f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1891535978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c14003700 0x7f0c38204f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0c280b0040 tx=0x7f0c2801b030 comp rx=0 tx=0).stop 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 shutdown_connections 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1891535978 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c38205bb0 0x7f0c3815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1891535978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c382057a0 0x7f0c3815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1891535978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c14003700 0x7f0c38204f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 >> 172.21.15.64:0/1891535978 conn(0x7f0c3806d4e0 msgr2=0x7f0c3815ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 shutdown_connections 2024-09-21T07:22:22.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.442+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1891535978 wait complete. 2024-09-21T07:22:22.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.470+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f69d8005590 con 0x7f6a000c7d60 2024-09-21T07:22:22.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.470+0000 7f69f6000640 1 -- 172.21.15.64:0/3853781255 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f69f0027400 con 0x7f6a000c7d60 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 msgr2=0x7f6a001fdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f69f0012890 tx=0x7f69f0012d50 comp rx=0 tx=0).stop 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 shutdown_connections 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a001fe470 0x7f6a00156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a000c8170 0x7f6a00156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 --2- 172.21.15.64:0/3853781255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a000c7d60 0x7f6a001fdf30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 >> 172.21.15.64:0/3853781255 conn(0x7f6a0006d450 msgr2=0x7f6a00158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 shutdown_connections 2024-09-21T07:22:22.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:22.474+0000 7f6a04c00640 1 -- 172.21.15.64:0/3853781255 wait complete. 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 -- 172.21.15.64:0/1674528797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 msgr2=0x7f6b7c006fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/1674528797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b7c006fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0b0760 tx=0x7f6b8801d7f0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 -- 172.21.15.64:0/1674528797 shutdown_connections 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/1674528797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b7c006fd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/1674528797 >> v2:172.21.15.90:3300/0 conn(0x7f6b7c003b30 0x7f6b7c006680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 -- 172.21.15.64:0/1674528797 >> 172.21.15.64:0/1674528797 conn(0x7f6b9c0d12d0 msgr2=0x7f6b9c0d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 -- 172.21.15.64:0/1674528797 shutdown_connections 2024-09-21T07:22:23.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.150+0000 7f6ba0a00640 1 -- 172.21.15.64:0/1674528797 wait complete. 2024-09-21T07:22:23.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 Processor -- start 2024-09-21T07:22:23.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 -- start start 2024-09-21T07:22:23.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b7c003b30 0x7f6b9c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b7c0076a0 0x7f6b9c0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c06d200 con 0x7f6b7c006bc0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b2620 con 0x7f6b7c0076a0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6ba0a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c06d380 con 0x7f6b7c003b30 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6b99400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6b99400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50074/0 (socket says 172.21.15.64:50074) 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6b99400640 1 -- 172.21.15.64:0/3620811609 learned_addr learned my addr 172.21.15.64:0/3620811609 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6b99e00640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b7c003b30 0x7f6b9c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.154+0000 7f6b9a800640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b7c0076a0 0x7f6b9c0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 -- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b7c003b30 msgr2=0x7f6b9c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b7c003b30 0x7f6b9c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 -- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b7c0076a0 msgr2=0x7f6b9c0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b7c0076a0 0x7f6b9c0af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 -- 172.21.15.64:0/3620811609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c152f40 con 0x7f6b7c006bc0 2024-09-21T07:22:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b99400640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b8801b420 tx=0x7f6b880a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880ac040 con 0x7f6b7c006bc0 2024-09-21T07:22:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f6b880bf070 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88003860 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c160460 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1f99c0 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b880b7070 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6b880c45c0 con 0x7f6b7c006bc0 2024-09-21T07:22:23.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.158+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c1f9450 con 0x7f6b7c006bc0 2024-09-21T07:22:23.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.162+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6b88017540 con 0x7f6b7c006bc0 2024-09-21T07:22:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.222+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f6b9c0ccdf0 con 0x7f6b7c006bc0 2024-09-21T07:22:23.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.226+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7f6b880a68e0 con 0x7f6b7c006bc0 2024-09-21T07:22:23.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.226+0000 7f6b92000640 1 -- 172.21.15.64:0/3620811609 <== mon.0 v2:172.21.15.64:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b880062e0 con 0x7f6b7c006bc0 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 msgr2=0x7f6b9c0af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b8801b420 tx=0x7f6b880a66e0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 shutdown_connections 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b7c0076a0 0x7f6b9c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b7c006bc0 0x7f6b9c0af270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 --2- 172.21.15.64:0/3620811609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b7c003b30 0x7f6b9c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 >> 172.21.15.64:0/3620811609 conn(0x7f6b9c0d12d0 msgr2=0x7f6b9c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 shutdown_connections 2024-09-21T07:22:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.230+0000 7f6ba0a00640 1 -- 172.21.15.64:0/3620811609 wait complete. 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 -- 172.21.15.64:0/746242517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74007d80 msgr2=0x7f0e74008190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 --2- 172.21.15.64:0/746242517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74007d80 0x7f0e74008190 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006b30 tx=0x7f0e8001d770 comp rx=0 tx=0).stop 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 -- 172.21.15.64:0/746242517 shutdown_connections 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 --2- 172.21.15.64:0/746242517 >> v2:172.21.15.90:3300/0 conn(0x7f0e7400b300 0x7f0e7400d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 --2- 172.21.15.64:0/746242517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74007d80 0x7f0e74008190 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 -- 172.21.15.64:0/746242517 >> 172.21.15.64:0/746242517 conn(0x7f0e940b2b80 msgr2=0x7f0e940b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 -- 172.21.15.64:0/746242517 shutdown_connections 2024-09-21T07:22:23.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.246+0000 7f0e9a000640 1 -- 172.21.15.64:0/746242517 wait complete. 2024-09-21T07:22:23.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.252 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 Processor -- start 2024-09-21T07:22:23.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- start start 2024-09-21T07:22:23.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 0x7f0e94149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e74007d80 0x7f0e9414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 0x7f0e9414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940cf8d0 con 0x7f0e7400b300 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940cf750 con 0x7f0e74007d80 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0e94162400 con 0x7f0e74003b30 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e99600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 0x7f0e9414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 0x7f0e94149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e99600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 0x7f0e9414cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50088/0 (socket says 172.21.15.64:50088) 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e99600640 1 -- 172.21.15.64:0/2012974594 learned_addr learned my addr 172.21.15.64:0/2012974594 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e93e00640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e74007d80 0x7f0e9414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 -- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e74007d80 msgr2=0x7f0e9414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e74007d80 0x7f0e9414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 -- 172.21.15.64:0/2012974594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 msgr2=0x7f0e9414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 0x7f0e9414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 -- 172.21.15.64:0/2012974594 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e941f8fe0 con 0x7f0e74003b30 2024-09-21T07:22:23.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e98c00640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 0x7f0e94149fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e74008f80 tx=0x7f0e88011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88010d90 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e88022070 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8801d650 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9414a8e0 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9414aea0 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e8801d7f0 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.250+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e88027da0 con 0x7f0e74003b30 2024-09-21T07:22:23.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.254+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e94162960 con 0x7f0e74003b30 2024-09-21T07:22:23.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.254+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e8801dcc0 con 0x7f0e74003b30 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 -- 172.21.15.64:0/1343665999 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c80088a0 msgr2=0x7f87c800d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 --2- 172.21.15.64:0/1343665999 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c80088a0 0x7f87c800d350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87e8073a60 tx=0x7f87e001c640 comp rx=0 tx=0).stop 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 -- 172.21.15.64:0/1343665999 shutdown_connections 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 --2- 172.21.15.64:0/1343665999 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c80088a0 0x7f87c800d350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 --2- 172.21.15.64:0/1343665999 >> v2:172.21.15.90:3300/0 conn(0x7f87c8003b30 0x7f87c8006680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 -- 172.21.15.64:0/1343665999 >> 172.21.15.64:0/1343665999 conn(0x7f87e80cdb10 msgr2=0x7f87e80cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 -- 172.21.15.64:0/1343665999 shutdown_connections 2024-09-21T07:22:23.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.294+0000 7f87ede00640 1 -- 172.21.15.64:0/1343665999 wait complete. 2024-09-21T07:22:23.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 Processor -- start 2024-09-21T07:22:23.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 -- start start 2024-09-21T07:22:23.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 0x7f87e80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 0x7f87e81f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f87e80cbb80 con 0x7f87c80088a0 2024-09-21T07:22:23.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87e815d900 con 0x7f87c8003b30 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ede00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f87e80cbd00 con 0x7f87c8006bc0 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ed400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 0x7f87e81f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ed400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50094/0 (socket says 172.21.15.64:50094) 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87ed400640 1 -- 172.21.15.64:0/1209622270 learned_addr learned my addr 172.21.15.64:0/1209622270 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87eca00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 0x7f87e80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87e7e00640 1 -- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 msgr2=0x7f87e80c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87e7e00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 0x7f87e80c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87e7e00640 1 -- 172.21.15.64:0/1209622270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 msgr2=0x7f87e81f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.298+0000 7f87e7e00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e7e00640 1 -- 172.21.15.64:0/1209622270 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e80c4d40 con 0x7f87c8006bc0 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87ed400640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:23.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87eca00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 0x7f87e80c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e7e00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 0x7f87e81f6540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87d4004c30 tx=0x7f87d4014830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4012650 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87d40128e0 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4012cf0 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e81f72e0 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e80c52e0 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f87d401d650 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f87d4026cf0 con 0x7f87c8006bc0 2024-09-21T07:22:23.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.302+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e81f7050 con 0x7f87c8006bc0 2024-09-21T07:22:23.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.306+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f87d402b020 con 0x7f87c8006bc0 2024-09-21T07:22:23.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.334+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0e940b7010 con 0x7f0e74003b30 2024-09-21T07:22:23.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e90c00640 1 -- 172.21.15.64:0/2012974594 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f0e88027460 con 0x7f0e74003b30 2024-09-21T07:22:23.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 msgr2=0x7f0e94149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 0x7f0e94149fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e74008f80 tx=0x7f0e88011d90 comp rx=0 tx=0).stop 2024-09-21T07:22:23.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 shutdown_connections 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e7400b300 0x7f0e9414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e74007d80 0x7f0e9414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 --2- 172.21.15.64:0/2012974594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e74003b30 0x7f0e94149fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 >> 172.21.15.64:0/2012974594 conn(0x7f0e940b2b80 msgr2=0x7f0e940ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 shutdown_connections 2024-09-21T07:22:23.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.342+0000 7f0e9a000640 1 -- 172.21.15.64:0/2012974594 wait complete. 2024-09-21T07:22:23.371 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.394+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f87e80c4b40 con 0x7f87c8006bc0 2024-09-21T07:22:23.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.398+0000 7f87e4c00640 1 -- 172.21.15.64:0/1209622270 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f87d40263f0 con 0x7f87c8006bc0 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 msgr2=0x7f87e81f6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 0x7f87e81f6540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87d4004c30 tx=0x7f87d4014830 comp rx=0 tx=0).stop 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 shutdown_connections 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c80088a0 0x7f87e81f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c8006bc0 0x7f87e81f6540 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 --2- 172.21.15.64:0/1209622270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87c8003b30 0x7f87e80c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 >> 172.21.15.64:0/1209622270 conn(0x7f87e80cdb10 msgr2=0x7f87e815da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 shutdown_connections 2024-09-21T07:22:23.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.402+0000 7f87ede00640 1 -- 172.21.15.64:0/1209622270 wait complete. 2024-09-21T07:22:23.423 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.423 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.423 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.424 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- 172.21.15.64:0/2476478892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c009290 msgr2=0x7f941c00b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 --2- 172.21.15.64:0/2476478892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c009290 0x7f941c00b6b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f943c0b09c0 tx=0x7f942c01d730 comp rx=0 tx=0).stop 2024-09-21T07:22:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- 172.21.15.64:0/2476478892 shutdown_connections 2024-09-21T07:22:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 --2- 172.21.15.64:0/2476478892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c006730 0x7f941c003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 --2- 172.21.15.64:0/2476478892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c009290 0x7f941c00b6b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- 172.21.15.64:0/2476478892 >> 172.21.15.64:0/2476478892 conn(0x7f943c0d1010 msgr2=0x7f943c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- 172.21.15.64:0/2476478892 shutdown_connections 2024-09-21T07:22:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- 172.21.15.64:0/2476478892 wait complete. 2024-09-21T07:22:23.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 Processor -- start 2024-09-21T07:22:23.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.478+0000 7f943be00640 1 -- start start 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c004170 0x7f943c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 0x7f943c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0b2ef0 con 0x7f941c009290 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0b2d70 con 0x7f941c006730 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f943c0b3070 con 0x7f941c004170 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50098/0 (socket says 172.21.15.64:50098) 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 -- 172.21.15.64:0/3265000616 learned_addr learned my addr 172.21.15.64:0/3265000616 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943a000640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 0x7f943c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943aa00640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c004170 0x7f943c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 -- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c004170 msgr2=0x7f943c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c004170 0x7f943c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 -- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 msgr2=0x7f943c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 0x7f943c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 -- 172.21.15.64:0/3265000616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c0cd6a0 con 0x7f941c009290 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943a000640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 0x7f943c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943b400640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f943c0c7fe0 tx=0x7f94340138d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434011910 con 0x7f941c009290 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9434011bc0 con 0x7f941c009290 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c0cd980 con 0x7f941c009290 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943401b3f0 con 0x7f941c009290 2024-09-21T07:22:23.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c0cdf40 con 0x7f941c009290 2024-09-21T07:22:23.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9434022020 con 0x7f941c009290 2024-09-21T07:22:23.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9434024830 con 0x7f941c009290 2024-09-21T07:22:23.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.482+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943c0cd3f0 con 0x7f941c009290 2024-09-21T07:22:23.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.486+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f943402a020 con 0x7f941c009290 2024-09-21T07:22:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.546+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f943c06cdf0 con 0x7f941c009290 2024-09-21T07:22:23.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.550+0000 7f9432a00640 1 -- 172.21.15.64:0/3265000616 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f9434018070 con 0x7f941c009290 2024-09-21T07:22:23.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.550+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 msgr2=0x7f943c1f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.550+0000 7f943be00640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f943c0c7fe0 tx=0x7f94340138d0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 shutdown_connections 2024-09-21T07:22:23.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f941c009290 0x7f943c1f9150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f941c006730 0x7f943c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 --2- 172.21.15.64:0/3265000616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f941c004170 0x7f943c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 >> 172.21.15.64:0/3265000616 conn(0x7f943c0d1010 msgr2=0x7f943c154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 shutdown_connections 2024-09-21T07:22:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.554+0000 7f943be00640 1 -- 172.21.15.64:0/3265000616 wait complete. 2024-09-21T07:22:23.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- 172.21.15.64:0/1146912093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 msgr2=0x7f471c005670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 --2- 172.21.15.64:0/1146912093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f471c005670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4728005fd0 tx=0x7f472801e430 comp rx=0 tx=0).stop 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- 172.21.15.64:0/1146912093 shutdown_connections 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 --2- 172.21.15.64:0/1146912093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 0x7f471c00d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 --2- 172.21.15.64:0/1146912093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f471c005670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- 172.21.15.64:0/1146912093 >> 172.21.15.64:0/1146912093 conn(0x7f473c0cdcc0 msgr2=0x7f473c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- 172.21.15.64:0/1146912093 shutdown_connections 2024-09-21T07:22:23.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- 172.21.15.64:0/1146912093 wait complete. 2024-09-21T07:22:23.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 Processor -- start 2024-09-21T07:22:23.574 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.574 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.570+0000 7f4743c00640 1 -- start start 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f473c1fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 0x7f473c1f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b2cc0 con 0x7f471c006710 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b4ab0 con 0x7f471c005260 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0b2e40 con 0x7f471c005d00 2024-09-21T07:22:23.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50106/0 (socket says 172.21.15.64:50106) 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f473be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 0x7f473c1f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 -- 172.21.15.64:0/2172641289 learned_addr learned my addr 172.21.15.64:0/2172641289 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741200640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f473c1fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 -- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 msgr2=0x7f473c1f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 0x7f473c1f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 -- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 msgr2=0x7f473c1fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f473c1fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 -- 172.21.15.64:0/2172641289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c1fd2f0 con 0x7f471c006710 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4741c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f473c0c82c0 tx=0x7f4734006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473400f960 con 0x7f471c006710 2024-09-21T07:22:23.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4734018070 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c1fd5d0 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473400fe90 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1f98a0 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f473401d460 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.574+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f47340117f0 con 0x7f471c006710 2024-09-21T07:22:23.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.578+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c1fa300 con 0x7f471c006710 2024-09-21T07:22:23.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.578+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f473c1fa300 con 0x7f471c006710 2024-09-21T07:22:23.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.642+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f473c0b3350 con 0x7f471c006710 2024-09-21T07:22:23.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4738c00640 1 -- 172.21.15.64:0/2172641289 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f47340119f0 con 0x7f471c006710 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 msgr2=0x7f473c15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f473c0c82c0 tx=0x7f4734006430 comp rx=0 tx=0).stop 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 shutdown_connections 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f471c006710 0x7f473c15f4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f471c005d00 0x7f473c1f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 --2- 172.21.15.64:0/2172641289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471c005260 0x7f473c1fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 >> 172.21.15.64:0/2172641289 conn(0x7f473c0cdcc0 msgr2=0x7f473c0ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 shutdown_connections 2024-09-21T07:22:23.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.646+0000 7f4743c00640 1 -- 172.21.15.64:0/2172641289 wait complete. 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.670 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi064') 2024-09-21T07:22:23.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config dump 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 -- 172.21.15.64:0/823597016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980ceda0 msgr2=0x7fc6980cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 --2- 172.21.15.64:0/823597016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980ceda0 0x7fc6980cf1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc688009840 tx=0x7fc68801c7f0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 -- 172.21.15.64:0/823597016 shutdown_connections 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 --2- 172.21.15.64:0/823597016 >> v2:172.21.15.90:3300/0 conn(0x7fc6980b3e10 0x7fc6980b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 --2- 172.21.15.64:0/823597016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980ceda0 0x7fc6980cf1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 -- 172.21.15.64:0/823597016 >> 172.21.15.64:0/823597016 conn(0x7fc698071140 msgr2=0x7fc698071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 -- 172.21.15.64:0/823597016 shutdown_connections 2024-09-21T07:22:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.862+0000 7fc69e600640 1 -- 172.21.15.64:0/823597016 wait complete. 2024-09-21T07:22:23.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 Processor -- start 2024-09-21T07:22:23.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 -- start start 2024-09-21T07:22:23.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980b3e10 0x7fc6980cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6980b4760 0x7fc69814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc698169bb0 con 0x7fc6980ceda0 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc698169a30 con 0x7fc6980b4760 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc69e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc698169d30 con 0x7fc6980b3e10 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc68fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6980b4760 0x7fc69814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980b3e10 0x7fc6980cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50116/0 (socket says 172.21.15.64:50116) 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 -- 172.21.15.64:0/2410200983 learned_addr learned my addr 172.21.15.64:0/2410200983 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 -- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980b3e10 msgr2=0x7fc6980cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980b3e10 0x7fc6980cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 -- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6980b4760 msgr2=0x7fc69814a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6980b4760 0x7fc69814a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.866+0000 7fc697e00640 1 -- 172.21.15.64:0/2410200983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6980cc430 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc697e00640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c730 tx=0x7fc69000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690003b80 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc690003d40 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900052d0 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6980cc710 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69814a460 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc690005680 con 0x7fc6980ceda0 2024-09-21T07:22:23.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc69001bb20 con 0x7fc6980ceda0 2024-09-21T07:22:23.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6980cc1a0 con 0x7fc6980ceda0 2024-09-21T07:22:23.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.870+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc6980cf6f0 con 0x7fc6980ceda0 2024-09-21T07:22:23.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc6980b4220 con 0x7fc6980ceda0 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc68f400640 1 -- 172.21.15.64:0/2410200983 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fc69001bd20 con 0x7fc6980ceda0 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:22:23.937 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:22:23.938 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:22:23.939 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:22:23.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 msgr2=0x7fc6980b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c730 tx=0x7fc69000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 shutdown_connections 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6980ceda0 0x7fc6980b73a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6980b4760 0x7fc69814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 --2- 172.21.15.64:0/2410200983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6980b3e10 0x7fc6980cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 >> 172.21.15.64:0/2410200983 conn(0x7fc698071140 msgr2=0x7fc69815c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 shutdown_connections 2024-09-21T07:22:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:23.934+0000 7fc69e600640 1 -- 172.21.15.64:0/2410200983 wait complete. 2024-09-21T07:22:23.957 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T07:22:23.957 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- 172.21.15.64:0/697850783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 msgr2=0x7f64e8167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 --2- 172.21.15.64:0/697850783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e8167450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009bc0 tx=0x7f64e401cae0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- 172.21.15.64:0/697850783 shutdown_connections 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 --2- 172.21.15.64:0/697850783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e8167450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- 172.21.15.64:0/697850783 >> 172.21.15.64:0/697850783 conn(0x7f64e806d1c0 msgr2=0x7f64e806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- 172.21.15.64:0/697850783 shutdown_connections 2024-09-21T07:22:24.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- 172.21.15.64:0/697850783 wait complete. 2024-09-21T07:22:24.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 Processor -- start 2024-09-21T07:22:24.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.114+0000 7f64f0800640 1 -- start start 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64e80b3d60 0x7f64e80caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64e80d1d00 0x7f64e80b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64e816ae70 con 0x7f64e80c6eb0 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64e816acf0 con 0x7f64e80b3d60 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f64e816aff0 con 0x7f64e80d1d00 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:50134/0 (socket says 172.21.15.64:50134) 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 -- 172.21.15.64:0/427648356 learned_addr learned my addr 172.21.15.64:0/427648356 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ede00640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64e80b3d60 0x7f64e80caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ee800640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64e80d1d00 0x7f64e80b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 -- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64e80d1d00 msgr2=0x7f64e80b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64e80d1d00 0x7f64e80b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 -- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64e80b3d60 msgr2=0x7f64e80caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64e80b3d60 0x7f64e80caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 -- 172.21.15.64:0/427648356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e80b52b0 con 0x7f64e80c6eb0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64ed400640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c430 tx=0x7f64d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011790 con 0x7f64e80c6eb0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64d8017070 con 0x7f64e80c6eb0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011ce0 con 0x7f64e80c6eb0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e80b5590 con 0x7f64e80c6eb0 2024-09-21T07:22:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e80b5b50 con 0x7f64e80c6eb0 2024-09-21T07:22:24.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f64d801c460 con 0x7f64e80c6eb0 2024-09-21T07:22:24.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64d8012790 con 0x7f64e80c6eb0 2024-09-21T07:22:24.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.118+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e80d03f0 con 0x7f64e80c6eb0 2024-09-21T07:22:24.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.122+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f64d8012990 con 0x7f64e80c6eb0 2024-09-21T07:22:24.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.186+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f64e80c81e0 con 0x7f64e80c6eb0 2024-09-21T07:22:24.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64e2000640 1 -- 172.21.15.64:0/427648356 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f64d8012b70 con 0x7f64e80c6eb0 2024-09-21T07:22:24.192 INFO:teuthology.orchestra.run.smithi064.stderr:adjusted tunables profile to default 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 msgr2=0x7f64e81517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c430 tx=0x7f64d800c8f0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 shutdown_connections 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64e80d1d00 0x7f64e80b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e80c6eb0 0x7f64e81517f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 --2- 172.21.15.64:0/427648356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64e80b3d60 0x7f64e80caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 >> 172.21.15.64:0/427648356 conn(0x7f64e806d1c0 msgr2=0x7f64e80c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:24.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 shutdown_connections 2024-09-21T07:22:24.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:24.190+0000 7f64f0800640 1 -- 172.21.15.64:0/427648356 wait complete. 2024-09-21T07:22:24.212 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T07:22:24.212 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T07:22:24.212 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:24.212 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T07:22:24.232 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:24.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T07:22:24.295 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:24.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T07:22:24.362 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:22:24.362 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T07:22:24.425 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:24.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T07:22:24.445 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:24.445 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T07:22:24.506 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:24.506 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T07:22:24.566 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:22:24.566 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T07:22:24.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 27e52307-21f7-43a7-b61a-f64c8573c9d6 0 2024-09-21T07:22:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- 172.21.15.90:0/1888872084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 msgr2=0x7f12780aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 --2- 172.21.15.90:0/1888872084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780aee90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f126800a980 tx=0x7f126801db90 comp rx=0 tx=0).stop 2024-09-21T07:22:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- 172.21.15.90:0/1888872084 shutdown_connections 2024-09-21T07:22:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 --2- 172.21.15.90:0/1888872084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780aee90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- 172.21.15.90:0/1888872084 >> 172.21.15.90:0/1888872084 conn(0x7f12780ccbe0 msgr2=0x7f12780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- 172.21.15.90:0/1888872084 shutdown_connections 2024-09-21T07:22:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- 172.21.15.90:0/1888872084 wait complete. 2024-09-21T07:22:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 Processor -- start 2024-09-21T07:22:24.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.814+0000 7f127da00640 1 -- start start 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f127806f3b0 0x7f12781511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f127815b2d0 0x7f1278165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1278169120 con 0x7f127815b2d0 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1278168fa0 con 0x7f127806f3b0 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f12781692a0 con 0x7f127806efa0 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:47726/0 (socket says 172.21.15.90:47726) 2024-09-21T07:22:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f127806f3b0 0x7f12781511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 -- 172.21.15.90:0/3048020467 learned_addr learned my addr 172.21.15.90:0/3048020467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1277400640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f127815b2d0 0x7f1278165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 -- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f127806f3b0 msgr2=0x7f12781511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f127806f3b0 0x7f12781511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 -- 172.21.15.90:0/3048020467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f127815b2d0 msgr2=0x7f1278165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f127815b2d0 0x7f1278165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 -- 172.21.15.90:0/3048020467 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781f9dd0 con 0x7f127806efa0 2024-09-21T07:22:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f1276a00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1268000c10 tx=0x7f1268005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680be070 con 0x7f127806efa0 2024-09-21T07:22:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12680038f0 con 0x7f127806efa0 2024-09-21T07:22:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781fc5f0 con 0x7f127806efa0 2024-09-21T07:22:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680b3040 con 0x7f127806efa0 2024-09-21T07:22:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781fcbb0 con 0x7f127806efa0 2024-09-21T07:22:24.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1268003d20 con 0x7f127806efa0 2024-09-21T07:22:24.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f12680b9430 con 0x7f127806efa0 2024-09-21T07:22:24.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.818+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1278153490 con 0x7f127806efa0 2024-09-21T07:22:24.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.822+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1268017780 con 0x7f127806efa0 2024-09-21T07:22:24.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.934+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "27e52307-21f7-43a7-b61a-f64c8573c9d6", "id": 0} v 0) -- 0x7f127815b6e0 con 0x7f127806efa0 2024-09-21T07:22:24.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f126ea00640 1 -- 172.21.15.90:0/3048020467 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27e52307-21f7-43a7-b61a-f64c8573c9d6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f12680a6bd0 con 0x7f127806efa0 2024-09-21T07:22:24.942 INFO:teuthology.orchestra.run.smithi090.stdout:0 2024-09-21T07:22:24.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 msgr2=0x7f12780cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:24.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1268000c10 tx=0x7f1268005d40 comp rx=0 tx=0).stop 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 shutdown_connections 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f127815b2d0 0x7f1278165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f127806f3b0 0x7f12781511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 --2- 172.21.15.90:0/3048020467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f127806efa0 0x7f12780cbe10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 >> 172.21.15.90:0/3048020467 conn(0x7f12780ccbe0 msgr2=0x7f12780d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 shutdown_connections 2024-09-21T07:22:24.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:24.938+0000 7f127da00640 1 -- 172.21.15.90:0/3048020467 wait complete. 2024-09-21T07:22:24.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006 1 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 -- 172.21.15.90:0/1269767281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c0cbf80 msgr2=0x7fc91c0711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 --2- 172.21.15.90:0/1269767281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c0cbf80 0x7fc91c0711f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc904009900 tx=0x7fc90401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 -- 172.21.15.90:0/1269767281 shutdown_connections 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 --2- 172.21.15.90:0/1269767281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c0cbf80 0x7fc91c0711f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 --2- 172.21.15.90:0/1269767281 >> v2:172.21.15.64:3300/0 conn(0x7fc91c072410 0x7fc91c0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 -- 172.21.15.90:0/1269767281 >> 172.21.15.90:0/1269767281 conn(0x7fc91c0b2cd0 msgr2=0x7fc91c0b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 -- 172.21.15.90:0/1269767281 shutdown_connections 2024-09-21T07:22:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.110+0000 7fc921a00640 1 -- 172.21.15.90:0/1269767281 wait complete. 2024-09-21T07:22:25.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 Processor -- start 2024-09-21T07:22:25.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- start start 2024-09-21T07:22:25.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c071730 0x7fc91c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc91c0cbf80 0x7fc91c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c15d940 con 0x7fc91c0cbf80 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c15d7c0 con 0x7fc91c072410 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc91c15dac0 con 0x7fc91c071730 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56948/0 (socket says 172.21.15.90:56948) 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 -- 172.21.15.90:0/2589651233 learned_addr learned my addr 172.21.15.90:0/2589651233 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc91aa00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c071730 0x7fc91c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc91b400640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc91c0cbf80 0x7fc91c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 -- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c071730 msgr2=0x7fc91c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c071730 0x7fc91c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 -- 172.21.15.90:0/2589651233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc91c0cbf80 msgr2=0x7fc91c15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc91c0cbf80 0x7fc91c15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 -- 172.21.15.90:0/2589651233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c0cf720 con 0x7fc91c072410 2024-09-21T07:22:25.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc913e00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc904009850 tx=0x7fc904005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:25.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9040b2040 con 0x7fc91c072410 2024-09-21T07:22:25.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc904004130 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904003600 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c0cf9c0 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c15e7f0 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc9040bf020 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.114+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc9040b8d80 con 0x7fc91c072410 2024-09-21T07:22:25.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.118+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91c0cba40 con 0x7fc91c072410 2024-09-21T07:22:25.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.118+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc9040c6020 con 0x7fc91c072410 2024-09-21T07:22:25.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.186+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006", "id": 1} v 0) -- 0x7fc91c0d0d60 con 0x7fc91c072410 2024-09-21T07:22:25.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.190+0000 7fc912a00640 1 -- 172.21.15.90:0/2589651233 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc9040164d0 con 0x7fc91c072410 2024-09-21T07:22:25.196 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 msgr2=0x7fc91c15ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc904009850 tx=0x7fc904005e70 comp rx=0 tx=0).stop 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 shutdown_connections 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc91c0cbf80 0x7fc91c15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c072410 0x7fc91c15ed10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 --2- 172.21.15.90:0/2589651233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc91c071730 0x7fc91c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 >> 172.21.15.90:0/2589651233 conn(0x7fc91c0b2cd0 msgr2=0x7fc91c068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 shutdown_connections 2024-09-21T07:22:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.194+0000 7fc921a00640 1 -- 172.21.15.90:0/2589651233 wait complete. 2024-09-21T07:22:25.200 INFO:tasks.ceph.mgr.x.smithi090.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T07:22:25.200 INFO:tasks.ceph.mgr.x.smithi090.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T07:22:25.201 INFO:tasks.ceph.mgr.x.smithi090.stderr: from numpy import show_config as show_numpy_config 2024-09-21T07:22:25.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new cee34831-35ea-494f-8a6c-72dd9ecf8203 2 2024-09-21T07:22:25.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 -- 172.21.15.90:0/2787983679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00d1d00 msgr2=0x7ff4d00d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 --2- 172.21.15.90:0/2787983679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00d1d00 0x7ff4d00d03f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00d2290 tx=0x7ff4c001c740 comp rx=0 tx=0).stop 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 -- 172.21.15.90:0/2787983679 shutdown_connections 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 --2- 172.21.15.90:0/2787983679 >> v2:172.21.15.90:3300/0 conn(0x7ff4d00c5ea0 0x7ff4d00c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 --2- 172.21.15.90:0/2787983679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00d1d00 0x7ff4d00d03f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 -- 172.21.15.90:0/2787983679 >> 172.21.15.90:0/2787983679 conn(0x7ff4d006d1c0 msgr2=0x7ff4d006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 -- 172.21.15.90:0/2787983679 shutdown_connections 2024-09-21T07:22:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.362+0000 7ff4d5600640 1 -- 172.21.15.90:0/2787983679 wait complete. 2024-09-21T07:22:25.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 Processor -- start 2024-09-21T07:22:25.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 -- start start 2024-09-21T07:22:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 0x7ff4d014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0169ed0 con 0x7ff4d00c5ea0 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0169d50 con 0x7ff4d00d1d00 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4d5600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d016a050 con 0x7ff4d00b3d60 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cf400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4ce000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 0x7ff4d014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cf400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56954/0 (socket says 172.21.15.90:56954) 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:47752/0 (socket says 172.21.15.90:47752) 2024-09-21T07:22:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cf400640 1 -- 172.21.15.90:0/1146924747 learned_addr learned my addr 172.21.15.90:0/1146924747 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 -- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 msgr2=0x7ff4d0166a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 -- 172.21.15.90:0/1146924747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 msgr2=0x7ff4d014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 0x7ff4d014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.366+0000 7ff4cea00640 1 -- 172.21.15.90:0/1146924747 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d006e2c0 con 0x7ff4d00b3d60 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4cf400640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4ce000640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 0x7ff4d014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4cea00640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00ac000 tx=0x7ff4c00a5640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00bb070 con 0x7ff4d00b3d60 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4c0004490 con 0x7ff4d00b3d60 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d006e5a0 con 0x7ff4d00b3d60 2024-09-21T07:22:25.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00b2040 con 0x7ff4d00b3d60 2024-09-21T07:22:25.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d01f9340 con 0x7ff4d00b3d60 2024-09-21T07:22:25.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4c00be070 con 0x7ff4d00b3d60 2024-09-21T07:22:25.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff4c0003600 con 0x7ff4d00b3d60 2024-09-21T07:22:25.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.370+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d00c62b0 con 0x7ff4d00b3d60 2024-09-21T07:22:25.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.374+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff4c00c5070 con 0x7ff4d00b3d60 2024-09-21T07:22:25.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.442+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cee34831-35ea-494f-8a6c-72dd9ecf8203", "id": 2} v 0) -- 0x7ff4d00b14e0 con 0x7ff4d00b3d60 2024-09-21T07:22:25.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.446+0000 7ff4c6a00640 1 -- 172.21.15.90:0/1146924747 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cee34831-35ea-494f-8a6c-72dd9ecf8203", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff4c00163f0 con 0x7ff4d00b3d60 2024-09-21T07:22:25.451 INFO:teuthology.orchestra.run.smithi090.stdout:2 2024-09-21T07:22:25.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 msgr2=0x7ff4d01f8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00ac000 tx=0x7ff4c00a5640 comp rx=0 tx=0).stop 2024-09-21T07:22:25.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 shutdown_connections 2024-09-21T07:22:25.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0166a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4d00c5ea0 0x7ff4d014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 --2- 172.21.15.90:0/1146924747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4d00b3d60 0x7ff4d01f8d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 >> 172.21.15.90:0/1146924747 conn(0x7ff4d006d1c0 msgr2=0x7ff4d0153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 shutdown_connections 2024-09-21T07:22:25.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.450+0000 7ff4d5600640 1 -- 172.21.15.90:0/1146924747 wait complete. 2024-09-21T07:22:25.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6 3 2024-09-21T07:22:25.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 -- 172.21.15.90:0/1714513508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 msgr2=0x7f5cf00c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/1714513508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf00c62b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00d2290 tx=0x7f5ce801cac0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 -- 172.21.15.90:0/1714513508 shutdown_connections 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/1714513508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf00c62b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/1714513508 >> v2:172.21.15.64:3300/0 conn(0x7f5cf00b3d60 0x7f5cf00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 -- 172.21.15.90:0/1714513508 >> 172.21.15.90:0/1714513508 conn(0x7f5cf006d1c0 msgr2=0x7f5cf006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 -- 172.21.15.90:0/1714513508 shutdown_connections 2024-09-21T07:22:25.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.618+0000 7f5cf6a00640 1 -- 172.21.15.90:0/1714513508 wait complete. 2024-09-21T07:22:25.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 Processor -- start 2024-09-21T07:22:25.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 -- start start 2024-09-21T07:22:25.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5cf00b3d60 0x7f5cf014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 0x7f5cf00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0169eb0 con 0x7f5cf00d1d00 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0169d30 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf6a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf016a030 con 0x7f5cf00b3d60 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56968/0 (socket says 172.21.15.90:56968) 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 -- 172.21.15.90:0/2906105252 learned_addr learned my addr 172.21.15.90:0/2906105252 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cefe00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5cf00b3d60 0x7f5cf014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf4a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 0x7f5cf00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 -- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5cf00b3d60 msgr2=0x7f5cf014d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5cf00b3d60 0x7f5cf014d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 -- 172.21.15.90:0/2906105252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 msgr2=0x7f5cf00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 0x7f5cf00b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 -- 172.21.15.90:0/2906105252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf0071be0 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cf4a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 0x7f5cf00b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.622+0000 7f5cef400640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e7a0 tx=0x7f5cdc00ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00ccc0 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cdc00ce60 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004280 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01646f0 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01f90b0 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cdc004b80 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5cdc004420 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf00b4170 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.626+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5cdc005020 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.698+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6", "id": 3} v 0) -- 0x7f5cf00d0800 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5ce7e00640 1 -- 172.21.15.90:0/2906105252 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5cdc0052a0 con 0x7f5cf00c5ea0 2024-09-21T07:22:25.705 INFO:teuthology.orchestra.run.smithi090.stdout:3 2024-09-21T07:22:25.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 msgr2=0x7f5cf0165c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e7a0 tx=0x7f5cdc00ec60 comp rx=0 tx=0).stop 2024-09-21T07:22:25.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 shutdown_connections 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf00d1d00 0x7f5cf00b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf00c5ea0 0x7f5cf0165c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 --2- 172.21.15.90:0/2906105252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5cf00b3d60 0x7f5cf014d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 >> 172.21.15.90:0/2906105252 conn(0x7f5cf006d1c0 msgr2=0x7f5cf015bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 shutdown_connections 2024-09-21T07:22:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.702+0000 7f5cf6a00640 1 -- 172.21.15.90:0/2906105252 wait complete. 2024-09-21T07:22:25.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 65586954-a471-4591-b349-4e1b5876d002 4 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 -- 172.21.15.90:0/3333538408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 msgr2=0x7fb5b40aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 --2- 172.21.15.90:0/3333538408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b40aee90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 -- 172.21.15.90:0/3333538408 shutdown_connections 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 --2- 172.21.15.90:0/3333538408 >> v2:172.21.15.64:3300/0 conn(0x7fb5b406f3b0 0x7fb5b40af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 --2- 172.21.15.90:0/3333538408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b40aee90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 -- 172.21.15.90:0/3333538408 >> 172.21.15.90:0/3333538408 conn(0x7fb5b40ccbe0 msgr2=0x7fb5b40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 -- 172.21.15.90:0/3333538408 shutdown_connections 2024-09-21T07:22:25.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.870+0000 7fb5ba200640 1 -- 172.21.15.90:0/3333538408 wait complete. 2024-09-21T07:22:25.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 Processor -- start 2024-09-21T07:22:25.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 -- start start 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b406f3b0 0x7fb5b40ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5b40b2fb0 0x7fb5b40ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b415ee30 con 0x7fb5b40b2fb0 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b415ecb0 con 0x7fb5b406f3b0 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5ba200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b415efb0 con 0x7fb5b406efa0 2024-09-21T07:22:25.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5b3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5b3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:47774/0 (socket says 172.21.15.90:47774) 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5b3400640 1 -- 172.21.15.90:0/628624726 learned_addr learned my addr 172.21.15.90:0/628624726 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5aaa00640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b406f3b0 0x7fb5b40ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.874+0000 7fb5b3e00640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5b40b2fb0 0x7fb5b40ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 -- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b406f3b0 msgr2=0x7fb5b40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b406f3b0 0x7fb5b40ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 -- 172.21.15.90:0/628624726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5b40b2fb0 msgr2=0x7fb5b40ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5b40b2fb0 0x7fb5b40ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 -- 172.21.15.90:0/628624726 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b40aecf0 con 0x7fb5b406efa0 2024-09-21T07:22:25.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5b3400640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009850 tx=0x7fb5a40a5630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:25.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40b2040 con 0x7fb5b406efa0 2024-09-21T07:22:25.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a40043b0 con 0x7fb5b406efa0 2024-09-21T07:22:25.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b40aefd0 con 0x7fb5b406efa0 2024-09-21T07:22:25.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4005290 con 0x7fb5b406efa0 2024-09-21T07:22:25.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41448b0 con 0x7fb5b406efa0 2024-09-21T07:22:25.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5a4004a60 con 0x7fb5b406efa0 2024-09-21T07:22:25.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb5a4003600 con 0x7fb5b406efa0 2024-09-21T07:22:25.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.878+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b415c410 con 0x7fb5b406efa0 2024-09-21T07:22:25.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.882+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb5b415c410 con 0x7fb5b406efa0 2024-09-21T07:22:25.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.950+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "65586954-a471-4591-b349-4e1b5876d002", "id": 4} v 0) -- 0x7fb5b415f550 con 0x7fb5b406efa0 2024-09-21T07:22:25.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5abe00640 1 -- 172.21.15.90:0/628624726 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65586954-a471-4591-b349-4e1b5876d002", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb5a40bc060 con 0x7fb5b406efa0 2024-09-21T07:22:25.958 INFO:teuthology.orchestra.run.smithi090.stdout:4 2024-09-21T07:22:25.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 msgr2=0x7fb5b4144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:25.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009850 tx=0x7fb5a40a5630 comp rx=0 tx=0).stop 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 shutdown_connections 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5b40b2fb0 0x7fb5b40ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b406f3b0 0x7fb5b40ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 --2- 172.21.15.90:0/628624726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5b406efa0 0x7fb5b4144370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 >> 172.21.15.90:0/628624726 conn(0x7fb5b40ccbe0 msgr2=0x7fb5b40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 shutdown_connections 2024-09-21T07:22:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:25.954+0000 7fb5ba200640 1 -- 172.21.15.90:0/628624726 wait complete. 2024-09-21T07:22:25.978 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 05b54446-204d-4776-9dc0-441779bcd20b 5 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 -- 172.21.15.90:0/2885462766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe244075150 msgr2=0x7fe24415f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 --2- 172.21.15.90:0/2885462766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe244075150 0x7fe24415f660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe230009840 tx=0x7fe23001c7f0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 -- 172.21.15.90:0/2885462766 shutdown_connections 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 --2- 172.21.15.90:0/2885462766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe244075150 0x7fe24415f660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 --2- 172.21.15.90:0/2885462766 >> v2:172.21.15.90:3300/0 conn(0x7fe244074d40 0x7fe24415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 -- 172.21.15.90:0/2885462766 >> 172.21.15.90:0/2885462766 conn(0x7fe2440b20b0 msgr2=0x7fe2440b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 -- 172.21.15.90:0/2885462766 shutdown_connections 2024-09-21T07:22:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.126+0000 7fe24be00640 1 -- 172.21.15.90:0/2885462766 wait complete. 2024-09-21T07:22:26.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 Processor -- start 2024-09-21T07:22:26.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 -- start start 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe244075150 0x7fe2441fa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 0x7fe2441fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe244168e50 con 0x7fe244075150 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe244168cd0 con 0x7fe244074d40 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe24be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe244168fd0 con 0x7fe2440cffe0 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 0x7fe2441fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56998/0 (socket says 172.21.15.90:56998) 2024-09-21T07:22:26.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 -- 172.21.15.90:0/3117222491 learned_addr learned my addr 172.21.15.90:0/3117222491 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:26.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe248a00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe244075150 0x7fe2441fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 -- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 msgr2=0x7fe2441fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 0x7fe2441fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 -- 172.21.15.90:0/3117222491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe244075150 msgr2=0x7fe2441fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe244075150 0x7fe2441fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 -- 172.21.15.90:0/3117222491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440ca4d0 con 0x7fe244074d40 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249e00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 0x7fe2441fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe249400640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe23800ea70 tx=0x7fe23800ef30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23800ce40 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.130+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe238004020 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2440ca1f0 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238004470 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2440c68f0 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2380053c0 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe238003e00 con 0x7fe244074d40 2024-09-21T07:22:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2440d03f0 con 0x7fe244074d40 2024-09-21T07:22:26.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.134+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe238003880 con 0x7fe244074d40 2024-09-21T07:22:26.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.202+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05b54446-204d-4776-9dc0-441779bcd20b", "id": 5} v 0) -- 0x7fe2440b0130 con 0x7fe244074d40 2024-09-21T07:22:26.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe241600640 1 -- 172.21.15.90:0/3117222491 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05b54446-204d-4776-9dc0-441779bcd20b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe238003a60 con 0x7fe244074d40 2024-09-21T07:22:26.213 INFO:teuthology.orchestra.run.smithi090.stdout:5 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 msgr2=0x7fe24414d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe23800ea70 tx=0x7fe23800ef30 comp rx=0 tx=0).stop 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 shutdown_connections 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2440cffe0 0x7fe2441fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe244075150 0x7fe2441fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 --2- 172.21.15.90:0/3117222491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe244074d40 0x7fe24414d7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 >> 172.21.15.90:0/3117222491 conn(0x7fe2440b20b0 msgr2=0x7fe2441519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 shutdown_connections 2024-09-21T07:22:26.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.210+0000 7fe24be00640 1 -- 172.21.15.90:0/3117222491 wait complete. 2024-09-21T07:22:26.232 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 1b037aae-7625-47c5-8813-f6ea51348b33 6 2024-09-21T07:22:26.266 INFO:tasks.ceph.mgr.y.smithi064.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T07:22:26.266 INFO:tasks.ceph.mgr.y.smithi064.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T07:22:26.266 INFO:tasks.ceph.mgr.y.smithi064.stderr: from numpy import show_config as show_numpy_config 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 -- 172.21.15.90:0/1194087834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff8071b10 msgr2=0x7f8ff80b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 --2- 172.21.15.90:0/1194087834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff8071b10 0x7f8ff80b2cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80b3b90 tx=0x7f8fe801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 -- 172.21.15.90:0/1194087834 shutdown_connections 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 --2- 172.21.15.90:0/1194087834 >> v2:172.21.15.64:3300/0 conn(0x7f8ff80709a0 0x7f8ff80b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 --2- 172.21.15.90:0/1194087834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff80b31f0 0x7f8ff8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 --2- 172.21.15.90:0/1194087834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff8071b10 0x7f8ff80b2cb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 -- 172.21.15.90:0/1194087834 >> 172.21.15.90:0/1194087834 conn(0x7f8ff80cdcb0 msgr2=0x7f8ff80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 -- 172.21.15.90:0/1194087834 shutdown_connections 2024-09-21T07:22:26.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.382+0000 7f8ffe200640 1 -- 172.21.15.90:0/1194087834 wait complete. 2024-09-21T07:22:26.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 Processor -- start 2024-09-21T07:22:26.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 -- start start 2024-09-21T07:22:26.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff8071b10 0x7f8ff80b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff80b31f0 0x7f8ff80adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8074ad0 con 0x7f8ff80b31f0 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8074950 con 0x7f8ff80709a0 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ffe200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff8074c50 con 0x7f8ff8071b10 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.386+0000 7f8ff7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff6a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff8071b10 0x7f8ff80b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57010/0 (socket says 172.21.15.90:57010) 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 -- 172.21.15.90:0/4209636697 learned_addr learned my addr 172.21.15.90:0/4209636697 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7e00640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff80b31f0 0x7f8ff80adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 -- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff8071b10 msgr2=0x7f8ff80b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff8071b10 0x7f8ff80b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 -- 172.21.15.90:0/4209636697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff80b31f0 msgr2=0x7f8ff80adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff80b31f0 0x7f8ff80adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 -- 172.21.15.90:0/4209636697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff809d8e0 con 0x7f8ff80709a0 2024-09-21T07:22:26.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ff7400640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b0040 tx=0x7f8fe80a5630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b2040 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fe80043b0 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff809dbc0 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8005290 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff80ae950 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fe80bd060 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8fe8003d30 con 0x7f8ff80709a0 2024-09-21T07:22:26.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.390+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff809d640 con 0x7f8ff80709a0 2024-09-21T07:22:26.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.394+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8fe80164b0 con 0x7f8ff80709a0 2024-09-21T07:22:26.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.462+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b037aae-7625-47c5-8813-f6ea51348b33", "id": 6} v 0) -- 0x7f8ff806da70 con 0x7f8ff80709a0 2024-09-21T07:22:26.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.466+0000 7f8fef400640 1 -- 172.21.15.90:0/4209636697 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b037aae-7625-47c5-8813-f6ea51348b33", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8fe80c3020 con 0x7f8ff80709a0 2024-09-21T07:22:26.472 INFO:teuthology.orchestra.run.smithi090.stdout:6 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 msgr2=0x7f8ff809e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b0040 tx=0x7f8fe80a5630 comp rx=0 tx=0).stop 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 shutdown_connections 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff80b31f0 0x7f8ff80adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ff8071b10 0x7f8ff80b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 --2- 172.21.15.90:0/4209636697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff80709a0 0x7f8ff809e6a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 >> 172.21.15.90:0/4209636697 conn(0x7f8ff80cdcb0 msgr2=0x7f8ff80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 shutdown_connections 2024-09-21T07:22:26.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.470+0000 7f8ffe200640 1 -- 172.21.15.90:0/4209636697 wait complete. 2024-09-21T07:22:26.491 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new ae4f006c-9cff-4a93-bdfa-40f07b109aa3 7 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 -- 172.21.15.90:0/1843402774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 msgr2=0x7f74fc0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 --2- 172.21.15.90:0/1843402774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc0c62b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0d2290 tx=0x7f74f401cac0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 -- 172.21.15.90:0/1843402774 shutdown_connections 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 --2- 172.21.15.90:0/1843402774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc0c62b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 --2- 172.21.15.90:0/1843402774 >> v2:172.21.15.64:3300/0 conn(0x7f74fc0d1d00 0x7f74fc0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 -- 172.21.15.90:0/1843402774 >> 172.21.15.90:0/1843402774 conn(0x7f74fc06d1c0 msgr2=0x7f74fc06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 -- 172.21.15.90:0/1843402774 shutdown_connections 2024-09-21T07:22:26.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.638+0000 7f7500c00640 1 -- 172.21.15.90:0/1843402774 wait complete. 2024-09-21T07:22:26.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 Processor -- start 2024-09-21T07:22:26.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 -- start start 2024-09-21T07:22:26.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 0x7f74fc15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 0x7f74fc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:26.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc169f00 con 0x7f74fc0d1d00 2024-09-21T07:22:26.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc169d80 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f7500c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc16a080 con 0x7f74fc0b3d60 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74f9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74f9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 0x7f74fc15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74f9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57028/0 (socket says 172.21.15.90:57028) 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74f9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 0x7f74fc15bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:47828/0 (socket says 172.21.15.90:47828) 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74f9400640 1 -- 172.21.15.90:0/1539041521 learned_addr learned my addr 172.21.15.90:0/1539041521 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.642+0000 7f74fa800640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 0x7f74fc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 -- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 msgr2=0x7f74fc15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 0x7f74fc15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 -- 172.21.15.90:0/1539041521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 msgr2=0x7f74fc0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 0x7f74fc0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 -- 172.21.15.90:0/1539041521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc158f70 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74fa800640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 0x7f74fc0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f9400640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c400 tx=0x7f74e800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011790 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e8017070 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc1589e0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011cc0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc0c94c0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74e801c460 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f74e8012da0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.646+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc0c62b0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.650+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f74fc158f70 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.718+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae4f006c-9cff-4a93-bdfa-40f07b109aa3", "id": 7} v 0) -- 0x7f74fc0d03f0 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f74f2000640 1 -- 172.21.15.90:0/1539041521 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae4f006c-9cff-4a93-bdfa-40f07b109aa3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f74e8012740 con 0x7f74fc0c5ea0 2024-09-21T07:22:26.726 INFO:teuthology.orchestra.run.smithi090.stdout:7 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 msgr2=0x7f74fc1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c400 tx=0x7f74e800c8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 shutdown_connections 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74fc0d1d00 0x7f74fc0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74fc0c5ea0 0x7f74fc1584a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 --2- 172.21.15.90:0/1539041521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74fc0b3d60 0x7f74fc15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 >> 172.21.15.90:0/1539041521 conn(0x7f74fc06d1c0 msgr2=0x7f74fc0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 shutdown_connections 2024-09-21T07:22:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:22:26.722+0000 7f7500c00640 1 -- 172.21.15.90:0/1539041521 wait complete. 2024-09-21T07:22:26.746 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T07:22:26.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T07:22:26.749 INFO:tasks.ceph.osd.0:Started 2024-09-21T07:22:26.750 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T07:22:26.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T07:22:26.752 INFO:tasks.ceph.osd.1:Started 2024-09-21T07:22:26.753 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T07:22:26.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T07:22:26.758 INFO:tasks.ceph.osd.2:Started 2024-09-21T07:22:26.758 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T07:22:26.759 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T07:22:26.763 INFO:tasks.ceph.osd.3:Started 2024-09-21T07:22:26.763 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T07:22:26.763 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T07:22:26.766 INFO:tasks.ceph.osd.4:Started 2024-09-21T07:22:26.766 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T07:22:26.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T07:22:26.768 INFO:tasks.ceph.osd.5:Started 2024-09-21T07:22:26.769 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T07:22:26.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T07:22:26.771 INFO:tasks.ceph.osd.6:Started 2024-09-21T07:22:26.771 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T07:22:26.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T07:22:26.775 INFO:tasks.ceph.osd.7:Started 2024-09-21T07:22:26.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:26.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 -- 172.21.15.64:0/708935330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0cc4e0 msgr2=0x7f13fc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:27.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 --2- 172.21.15.64:0/708935330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0cc4e0 0x7f13fc0cb970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009bc0 tx=0x7f13f401cba0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 -- 172.21.15.64:0/708935330 shutdown_connections 2024-09-21T07:22:27.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 --2- 172.21.15.64:0/708935330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0cc4e0 0x7f13fc0cb970 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 --2- 172.21.15.64:0/708935330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0b22f0 0x7f13fc0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 -- 172.21.15.64:0/708935330 >> 172.21.15.64:0/708935330 conn(0x7f13fc0ccbe0 msgr2=0x7f13fc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:27.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 -- 172.21.15.64:0/708935330 shutdown_connections 2024-09-21T07:22:27.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 -- 172.21.15.64:0/708935330 wait complete. 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.982+0000 7f1400e00640 1 Processor -- start 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- start start 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 0x7f13fc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 0x7f13fc1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1662e0 con 0x7f13fc15a2f0 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc166160 con 0x7f13fc0b4170 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc166460 con 0x7f13fc0cc4e0 2024-09-21T07:22:27.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32936/0 (socket says 172.21.15.64:32936) 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 -- 172.21.15.64:0/372107902 learned_addr learned my addr 172.21.15.64:0/372107902 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f9e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 0x7f13fc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f3e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 0x7f13fc1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 -- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 msgr2=0x7f13fc1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 0x7f13fc1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 -- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 msgr2=0x7f13fc156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 0x7f13fc156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 -- 172.21.15.64:0/372107902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc0ad2c0 con 0x7f13fc15a2f0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f3e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 0x7f13fc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f9e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 0x7f13fc156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13fa800640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009b10 tx=0x7f13f4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40bb070 con 0x7f13fc15a2f0 2024-09-21T07:22:27.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f4004d40 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc0ad6b0 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40b2040 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1f95a0 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f13f40be070 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.986+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f13f4005700 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.990+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc0cb430 con 0x7f13fc15a2f0 2024-09-21T07:22:27.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:26.994+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f13f40d8860 con 0x7f13fc15a2f0 2024-09-21T07:22:27.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13fc0ad490 con 0x7f13fc15a2f0 2024-09-21T07:22:27.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f13f2000640 1 -- 172.21.15.64:0/372107902 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f13f40c6030 con 0x7f13fc15a2f0 2024-09-21T07:22:27.057 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:27.058 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":10,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:26.723063+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 msgr2=0x7f13fc0c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009b10 tx=0x7f13f4003f60 comp rx=0 tx=0).stop 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 shutdown_connections 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13fc15a2f0 0x7f13fc0c8000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13fc0cc4e0 0x7f13fc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 --2- 172.21.15.64:0/372107902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13fc0b4170 0x7f13fc156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 >> 172.21.15.64:0/372107902 conn(0x7f13fc0ccbe0 msgr2=0x7f13fc0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 shutdown_connections 2024-09-21T07:22:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:27.054+0000 7f1400e00640 1 -- 172.21.15.64:0/372107902 wait complete. 2024-09-21T07:22:27.078 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T07:22:27.078 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T07:22:27.883 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:28.032 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- 172.21.15.64:0/756761184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b415d800 msgr2=0x7fb8b415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:28.032 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/756761184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b415d800 0x7fb8b415c840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40d3400 tx=0x7fb8a801c800 comp rx=0 tx=0).stop 2024-09-21T07:22:28.032 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- 172.21.15.64:0/756761184 shutdown_connections 2024-09-21T07:22:28.032 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/756761184 >> v2:172.21.15.90:3300/0 conn(0x7fb8b4160fe0 0x7fb8b40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.033 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/756761184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b415d800 0x7fb8b415c840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.033 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- 172.21.15.64:0/756761184 >> 172.21.15.64:0/756761184 conn(0x7fb8b40b3e60 msgr2=0x7fb8b40b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:28.033 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- 172.21.15.64:0/756761184 shutdown_connections 2024-09-21T07:22:28.033 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- 172.21.15.64:0/756761184 wait complete. 2024-09-21T07:22:28.034 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 Processor -- start 2024-09-21T07:22:28.034 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.030+0000 7fb8bbe00640 1 -- start start 2024-09-21T07:22:28.036 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b415d800 0x7fb8b406f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8b4160bd0 0x7fb8b4158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b416a3e0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b416a260 con 0x7fb8b415d800 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b416a560 con 0x7fb8b4160bd0 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32954/0 (socket says 172.21.15.64:32954) 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 -- 172.21.15.64:0/3686383511 learned_addr learned my addr 172.21.15.64:0/3686383511 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b8a00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8b4160bd0 0x7fb8b4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9400640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b415d800 0x7fb8b406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 -- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8b4160bd0 msgr2=0x7fb8b4158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8b4160bd0 0x7fb8b4158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.037 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 -- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b415d800 msgr2=0x7fb8b406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:28.038 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b415d800 0x7fb8b406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.038 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 -- 172.21.15.64:0/3686383511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b41595a0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.038 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b9e00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009fd0 tx=0x7fb8ac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00ce20 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8ac004b30 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac005020 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b41fcbc0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b41fd180 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.034+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b415c840 con 0x7fb8b4160fe0 2024-09-21T07:22:28.039 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.038+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 2) ==== 48655+0+0 (secure 0 0 0) 0x7fb8ac0051c0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.040 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.038+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb8ac04f980 con 0x7fb8b4160fe0 2024-09-21T07:22:28.042 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.038+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb8ac00f3c0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.103 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8b40b8220 con 0x7fb8b4160fe0 2024-09-21T07:22:28.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8b1600640 1 -- 172.21.15.64:0/3686383511 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb8ac0217c0 con 0x7fb8b4160fe0 2024-09-21T07:22:28.104 INFO:teuthology.misc.health.smithi064.stdout: 2024-09-21T07:22:28.104 INFO:teuthology.misc.health.smithi064.stdout:{"epoch":10,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:26.723063+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 msgr2=0x7fb8b40b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009fd0 tx=0x7fb8ac00ef10 comp rx=0 tx=0).stop 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 shutdown_connections 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b4160fe0 0x7fb8b40b2e50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8b4160bd0 0x7fb8b4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 --2- 172.21.15.64:0/3686383511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b415d800 0x7fb8b406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:28.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 >> 172.21.15.64:0/3686383511 conn(0x7fb8b40b3e60 msgr2=0x7fb8b415bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:28.106 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 shutdown_connections 2024-09-21T07:22:28.106 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:28.102+0000 7fb8bbe00640 1 -- 172.21.15.64:0/3686383511 wait complete. 2024-09-21T07:22:28.123 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T07:22:28.205 INFO:tasks.ceph.osd.3.smithi064.stderr:2024-09-21T07:22:28.202+0000 7fea0c8467c0 -1 Falling back to public interface 2024-09-21T07:22:28.370 INFO:tasks.ceph.osd.7.smithi090.stderr:2024-09-21T07:22:28.366+0000 7f3bf2e487c0 -1 Falling back to public interface 2024-09-21T07:22:28.420 INFO:tasks.ceph.mgr.x.smithi090.stderr:2024-09-21T07:22:28.418+0000 7fc388600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T07:22:28.421 INFO:tasks.ceph.mgr.x.smithi090.stderr:2024-09-21T07:22:28.418+0000 7fc388600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T07:22:28.448 INFO:tasks.ceph.osd.2.smithi064.stderr:2024-09-21T07:22:28.446+0000 7f78e58cf7c0 -1 Falling back to public interface 2024-09-21T07:22:28.554 INFO:tasks.ceph.osd.4.smithi090.stderr:2024-09-21T07:22:28.550+0000 7f061e0e47c0 -1 Falling back to public interface 2024-09-21T07:22:28.569 INFO:tasks.ceph.osd.6.smithi090.stderr:2024-09-21T07:22:28.566+0000 7f09edd207c0 -1 Falling back to public interface 2024-09-21T07:22:28.714 INFO:tasks.ceph.osd.5.smithi090.stderr:2024-09-21T07:22:28.710+0000 7ff5e2a487c0 -1 Falling back to public interface 2024-09-21T07:22:28.716 INFO:tasks.ceph.osd.0.smithi064.stderr:2024-09-21T07:22:28.714+0000 7f78c9acb7c0 -1 Falling back to public interface 2024-09-21T07:22:28.768 INFO:tasks.ceph.osd.1.smithi064.stderr:2024-09-21T07:22:28.766+0000 7f95462d97c0 -1 Falling back to public interface 2024-09-21T07:22:32.484 INFO:tasks.ceph.osd.7.smithi090.stderr:2024-09-21T07:22:32.477+0000 7f3bf2e487c0 -1 osd.7 0 log_to_monitors true 2024-09-21T07:22:32.515 INFO:tasks.ceph.osd.3.smithi064.stderr:2024-09-21T07:22:32.510+0000 7fea0c8467c0 -1 osd.3 0 log_to_monitors true 2024-09-21T07:22:32.709 INFO:tasks.ceph.osd.6.smithi090.stderr:2024-09-21T07:22:32.705+0000 7f09edd207c0 -1 osd.6 0 log_to_monitors true 2024-09-21T07:22:32.751 INFO:tasks.ceph.osd.4.smithi090.stderr:2024-09-21T07:22:32.745+0000 7f061e0e47c0 -1 osd.4 0 log_to_monitors true 2024-09-21T07:22:32.850 INFO:tasks.ceph.osd.0.smithi064.stderr:2024-09-21T07:22:32.846+0000 7f78c9acb7c0 -1 osd.0 0 log_to_monitors true 2024-09-21T07:22:33.197 INFO:tasks.ceph.osd.5.smithi090.stderr:2024-09-21T07:22:33.193+0000 7ff5e2a487c0 -1 osd.5 0 log_to_monitors true 2024-09-21T07:22:33.250 INFO:tasks.ceph.osd.2.smithi064.stderr:2024-09-21T07:22:33.246+0000 7f78e58cf7c0 -1 osd.2 0 log_to_monitors true 2024-09-21T07:22:33.622 INFO:tasks.ceph.osd.1.smithi064.stderr:2024-09-21T07:22:33.618+0000 7f95462d97c0 -1 osd.1 0 log_to_monitors true 2024-09-21T07:22:34.481 INFO:tasks.ceph.osd.3.smithi064.stderr:2024-09-21T07:22:34.478+0000 7fea07800640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:22:34.508 INFO:tasks.ceph.osd.3.smithi064.stderr:2024-09-21T07:22:34.506+0000 7fe9fd800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:34.644 INFO:tasks.ceph.osd.7.smithi090.stderr:2024-09-21T07:22:34.641+0000 7f3bee800640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:22:34.815 INFO:tasks.ceph.osd.7.smithi090.stderr:2024-09-21T07:22:34.809+0000 7f3be3e00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:34.930 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:35.097 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 -- 172.21.15.64:0/2115072505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160bd0 msgr2=0x7f8df80d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2115072505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160bd0 0x7f8df80d0690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8df8160270 tx=0x7f8de401c800 comp rx=0 tx=0).stop 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 -- 172.21.15.64:0/2115072505 shutdown_connections 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2115072505 >> v2:172.21.15.90:3300/0 conn(0x7f8df8160fe0 0x7f8df80d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2115072505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160bd0 0x7f8df80d0690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2115072505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8df815d800 0x7f8df815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 -- 172.21.15.64:0/2115072505 >> 172.21.15.64:0/2115072505 conn(0x7f8df80b3e60 msgr2=0x7f8df80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 -- 172.21.15.64:0/2115072505 shutdown_connections 2024-09-21T07:22:35.098 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.093+0000 7f8dffc00640 1 -- 172.21.15.64:0/2115072505 wait complete. 2024-09-21T07:22:35.100 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 Processor -- start 2024-09-21T07:22:35.100 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 -- start start 2024-09-21T07:22:35.102 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8df815d800 0x7f8df81fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.102 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.102 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160fe0 0x7f8df815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.102 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8071770 con 0x7f8df8160fe0 2024-09-21T07:22:35.102 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8df80715f0 con 0x7f8df8160bd0 2024-09-21T07:22:35.103 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8dffc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8df80718f0 con 0x7f8df815d800 2024-09-21T07:22:35.103 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.103 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:41638/0 (socket says 172.21.15.64:41638) 2024-09-21T07:22:35.103 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 -- 172.21.15.64:0/2732246014 learned_addr learned my addr 172.21.15.64:0/2732246014 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 -- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8df815d800 msgr2=0x7f8df81fc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8df815d800 0x7f8df81fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 -- 172.21.15.64:0/2732246014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160fe0 msgr2=0x7f8df815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160fe0 0x7f8df815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.097+0000 7f8df7e00640 1 -- 172.21.15.64:0/2732246014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df80a9460 con 0x7f8df8160bd0 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8df7e00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8de401c630 tx=0x7f8de40052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40ac030 con 0x7f8df8160bd0 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de4004020 con 0x7f8df8160bd0 2024-09-21T07:22:35.104 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df81f8ae0 con 0x7f8df8160bd0 2024-09-21T07:22:35.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df81f90a0 con 0x7f8df8160bd0 2024-09-21T07:22:35.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4004410 con 0x7f8df8160bd0 2024-09-21T07:22:35.105 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df815c840 con 0x7f8df8160bd0 2024-09-21T07:22:35.106 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.101+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) ==== 97178+0+0 (secure 0 0 0) 0x7f8de40af070 con 0x7f8df8160bd0 2024-09-21T07:22:35.108 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.105+0000 7f8df4c00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 0x7f8dd8075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.108 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.105+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2495+0+0 (secure 0 0 0) 0x7f8de412db90 con 0x7f8df8160bd0 2024-09-21T07:22:35.108 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.105+0000 7f8dfd200640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 0x7f8dd8075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.109 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.105+0000 7f8dfd200640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 0x7f8dd8075680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009a40 tx=0x7f8dec009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.113 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.109+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8de40bf030 con 0x7f8df8160bd0 2024-09-21T07:22:35.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.337+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8df80b3c20 con 0x7f8df8160bd0 2024-09-21T07:22:35.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.337+0000 7f8df4c00640 1 -- 172.21.15.64:0/2732246014 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7f8de40163f0 con 0x7f8df8160bd0 2024-09-21T07:22:35.342 INFO:teuthology.misc.health.smithi064.stdout: 2024-09-21T07:22:35.342 INFO:teuthology.misc.health.smithi064.stdout:{"epoch":13,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:34.543664+0000","last_up_change":"2024-09-21T07:22:34.543664+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:35.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 msgr2=0x7f8dd8075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 0x7f8dd8075680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009a40 tx=0x7f8dec009500 comp rx=0 tx=0).stop 2024-09-21T07:22:35.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 msgr2=0x7f8df8158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8de401c630 tx=0x7f8de40052d0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 shutdown_connections 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8dd8073170 0x7f8dd8075680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df8160fe0 0x7f8df815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df8160bd0 0x7f8df8158790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 --2- 172.21.15.64:0/2732246014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8df815d800 0x7f8df81fc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.345 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 >> 172.21.15.64:0/2732246014 conn(0x7f8df80b3e60 msgr2=0x7f8df81669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.346 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 shutdown_connections 2024-09-21T07:22:35.346 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:35.341+0000 7f8dffc00640 1 -- 172.21.15.64:0/2732246014 wait complete. 2024-09-21T07:22:35.367 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T07:22:36.026 INFO:tasks.ceph.osd.0.smithi064.stderr:2024-09-21T07:22:36.021+0000 7f78c5400640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:22:36.060 INFO:tasks.ceph.osd.0.smithi064.stderr:2024-09-21T07:22:36.057+0000 7f78baa00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:36.066 INFO:tasks.ceph.osd.2.smithi064.stderr:2024-09-21T07:22:36.061+0000 7f78e0800640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:22:36.104 INFO:tasks.ceph.osd.2.smithi064.stderr:2024-09-21T07:22:36.101+0000 7f78d6800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:36.407 INFO:tasks.ceph.osd.5.smithi090.stderr:2024-09-21T07:22:36.401+0000 7ff5dda00640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:22:36.437 INFO:tasks.ceph.osd.5.smithi090.stderr:2024-09-21T07:22:36.433+0000 7ff5d3a00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:36.456 INFO:tasks.ceph.osd.4.smithi090.stderr:2024-09-21T07:22:36.453+0000 7f0619000640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:22:36.480 INFO:tasks.ceph.osd.6.smithi090.stderr:2024-09-21T07:22:36.473+0000 7f09e9600640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:22:36.489 INFO:tasks.ceph.osd.4.smithi090.stderr:2024-09-21T07:22:36.485+0000 7f060f000640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:36.497 INFO:tasks.ceph.osd.6.smithi090.stderr:2024-09-21T07:22:36.493+0000 7f09dec00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:36.754 INFO:tasks.ceph.osd.1.smithi064.stderr:2024-09-21T07:22:36.749+0000 7f9541200640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:22:36.772 INFO:tasks.ceph.osd.1.smithi064.stderr:2024-09-21T07:22:36.769+0000 7f9537200640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:22:38.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:22:38.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:22:42.174 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:42.335 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 -- 172.21.15.64:0/2787023479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8004d50 msgr2=0x7f39e8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.335 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 --2- 172.21.15.64:0/2787023479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e8004d50 0x7f39e8005160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3a040cc9b0 tx=0x7f39fc01f880 comp rx=0 tx=0).stop 2024-09-21T07:22:42.335 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a03400640 1 -- 172.21.15.64:0/2787023479 reap_dead start 2024-09-21T07:22:42.336 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 -- 172.21.15.64:0/2787023479 shutdown_connections 2024-09-21T07:22:42.336 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 -- 172.21.15.64:0/2787023479 >> 172.21.15.64:0/2787023479 conn(0x7f3a040b3770 msgr2=0x7f3a040b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.336 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 -- 172.21.15.64:0/2787023479 shutdown_connections 2024-09-21T07:22:42.336 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.329+0000 7f3a09a00640 1 -- 172.21.15.64:0/2787023479 wait complete. 2024-09-21T07:22:42.337 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 Processor -- start 2024-09-21T07:22:42.337 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 -- start start 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39e8004d50 0x7f3a041f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a040c5f30 0x7f3a040c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a040707f0 con 0x7f3a0415dd60 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04070670 con 0x7f39e8004d50 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a09a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0406cd80 con 0x7f3a040c5f30 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.333+0000 7f3a03400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36354/0 (socket says 172.21.15.64:36354) 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 -- 172.21.15.64:0/3228223867 learned_addr learned my addr 172.21.15.64:0/3228223867 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a02a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39e8004d50 0x7f3a041f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a02000640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a040c5f30 0x7f3a040c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.340 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 -- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a040c5f30 msgr2=0x7f3a040c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a040c5f30 0x7f3a040c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 -- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39e8004d50 msgr2=0x7f3a041f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39e8004d50 0x7f3a041f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 -- 172.21.15.64:0/3228223867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0415e6b0 con 0x7f3a0415dd60 2024-09-21T07:22:42.341 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a03400640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39fc09c180 tx=0x7f39fc001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc003b80 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39fc003e10 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc006300 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a040c5c60 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a040c5180 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a040c6a10 con 0x7f3a0415dd60 2024-09-21T07:22:42.342 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.337+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f39fc0064a0 con 0x7f3a0415dd60 2024-09-21T07:22:42.343 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.341+0000 7f39faa00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 0x7f39e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.343 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.341+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f39fc132300 con 0x7f3a0415dd60 2024-09-21T07:22:42.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.341+0000 7f3a02a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 0x7f39e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.344 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.341+0000 7f3a02a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 0x7f39e4075710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.349 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.345+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3a0415e6b0 con 0x7f3a0415dd60 2024-09-21T07:22:42.527 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a040ce150 con 0x7f3a0415dd60 2024-09-21T07:22:42.528 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f39faa00640 1 -- 172.21.15.64:0/3228223867 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12848 (secure 0 0 0) 0x7f3a040ceaa0 con 0x7f3a0415dd60 2024-09-21T07:22:42.528 INFO:teuthology.misc.health.smithi064.stdout: 2024-09-21T07:22:42.529 INFO:teuthology.misc.health.smithi064.stdout:{"epoch":18,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:40.048396+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:42.531 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 msgr2=0x7f39e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.531 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 0x7f39e4075710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4005f40 comp rx=0 tx=0).stop 2024-09-21T07:22:42.531 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 msgr2=0x7f3a0415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.531 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39fc09c180 tx=0x7f39fc001d60 comp rx=0 tx=0).stop 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 shutdown_connections 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39e4073200 0x7f39e4075710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a0415dd60 0x7f3a0415e170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a040c5f30 0x7f3a040c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 --2- 172.21.15.64:0/3228223867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39e8004d50 0x7f3a041f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.525+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 >> 172.21.15.64:0/3228223867 conn(0x7f3a040b3770 msgr2=0x7f3a040ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.529+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 shutdown_connections 2024-09-21T07:22:42.532 INFO:teuthology.misc.health.smithi064.stderr:2024-09-21T07:22:42.529+0000 7f3a09a00640 1 -- 172.21.15.64:0/3228223867 wait complete. 2024-09-21T07:22:42.549 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T07:22:42.549 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T07:22:42.550 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:22:42.550 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:22:42.553 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:22:42.553 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:22:42.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:22:42.556 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:22:42.556 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:22:42.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:22:42.559 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:22:42.559 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:22:42.560 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:22:42.562 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:22:42.563 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T07:22:42.563 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:22:42.661 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:22:42.663 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:22:42.725 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:22:42.727 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:22:42.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 -- 172.21.15.64:0/3405936359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c0cba10 msgr2=0x7fa30c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 --2- 172.21.15.64:0/3405936359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cbe20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009840 tx=0x7fa2f801c760 comp rx=0 tx=0).stop 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 -- 172.21.15.64:0/3405936359 shutdown_connections 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 --2- 172.21.15.64:0/3405936359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cbe20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 -- 172.21.15.64:0/3405936359 >> 172.21.15.64:0/3405936359 conn(0x7fa30c0b2ca0 msgr2=0x7fa30c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 -- 172.21.15.64:0/3405936359 shutdown_connections 2024-09-21T07:22:42.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.725+0000 7fa311c00640 1 -- 172.21.15.64:0/3405936359 wait complete. 2024-09-21T07:22:42.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 Processor -- start 2024-09-21T07:22:42.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- start start 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa30c15fca0 0x7fa30c0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 0x7fa30c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c16acb0 con 0x7fa30c164200 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c16ab30 con 0x7fa30c0cba10 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa30c16ae30 con 0x7fa30c15fca0 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:41686/0 (socket says 172.21.15.64:41686) 2024-09-21T07:22:42.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 0x7fa30c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30aa00640 1 -- 172.21.15.64:0/843714918 learned_addr learned my addr 172.21.15.64:0/843714918 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:42.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30a000640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa30c15fca0 0x7fa30c0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 -- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa30c15fca0 msgr2=0x7fa30c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa30c15fca0 0x7fa30c0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 -- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 msgr2=0x7fa30c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 -- 172.21.15.64:0/843714918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c0ca5c0 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa30b400640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 0x7fa30c0cf230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa304001780 tx=0x7fa30400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304016020 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30c144c90 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa30400ab10 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304012420 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.729+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30c0b0210 con 0x7fa30c164200 2024-09-21T07:22:42.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.733+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30c0cbe20 con 0x7fa30c164200 2024-09-21T07:22:42.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.733+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa304019020 con 0x7fa30c164200 2024-09-21T07:22:42.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.733+0000 7fa302a00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 0x7fa2ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.733+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa304094310 con 0x7fa30c164200 2024-09-21T07:22:42.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.733+0000 7fa30aa00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 0x7fa2ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.737+0000 7fa30aa00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 0x7fa2ec075710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc000c10 tx=0x7fa2fc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.737+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa304020020 con 0x7fa30c164200 2024-09-21T07:22:42.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.949+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa30c074e10 con 0x7fa30c164200 2024-09-21T07:22:42.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.949+0000 7fa302a00640 1 -- 172.21.15.64:0/843714918 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fa30c0b4000 con 0x7fa30c164200 2024-09-21T07:22:42.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:42.956 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":2,"btime":"2024-09-21T07:22:42:676959+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:22:42.956 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 2 2024-09-21T07:22:42.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 msgr2=0x7fa2ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 0x7fa2ec075710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc000c10 tx=0x7fa2fc009040 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 msgr2=0x7fa30c0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 0x7fa30c0cf230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa304001780 tx=0x7fa30400cce0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 shutdown_connections 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa2ec073200 0x7fa2ec075710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa30c164200 0x7fa30c0cf230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa30c15fca0 0x7fa30c0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 --2- 172.21.15.64:0/843714918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0cba10 0x7fa30c0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 >> 172.21.15.64:0/843714918 conn(0x7fa30c0b2ca0 msgr2=0x7fa30c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 shutdown_connections 2024-09-21T07:22:42.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:42.953+0000 7fa311c00640 1 -- 172.21.15.64:0/843714918 wait complete. 2024-09-21T07:22:44.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- 172.21.15.64:0/3373733643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 msgr2=0x7ff7180d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 --2- 172.21.15.64:0/3373733643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff7180d03f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff708009840 tx=0x7ff70801c760 comp rx=0 tx=0).stop 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- 172.21.15.64:0/3373733643 shutdown_connections 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 --2- 172.21.15.64:0/3373733643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7180b3d60 0x7ff7180b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 --2- 172.21.15.64:0/3373733643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff7180d03f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- 172.21.15.64:0/3373733643 >> 172.21.15.64:0/3373733643 conn(0x7ff71806d1c0 msgr2=0x7ff71806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- 172.21.15.64:0/3373733643 shutdown_connections 2024-09-21T07:22:45.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- 172.21.15.64:0/3373733643 wait complete. 2024-09-21T07:22:45.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 Processor -- start 2024-09-21T07:22:45.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.145+0000 7ff71dc00640 1 -- start start 2024-09-21T07:22:45.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff718071190 0x7ff718166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff71815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff71816a3e0 con 0x7ff7180b3d60 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff71816a260 con 0x7ff7180d1d00 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff71816a560 con 0x7ff718071190 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58280/0 (socket says 172.21.15.64:58280) 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 -- 172.21.15.64:0/2211910213 learned_addr learned my addr 172.21.15.64:0/2211910213 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716a00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff718071190 0x7ff718166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff717400640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff71815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 -- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff718071190 msgr2=0x7ff718166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff718071190 0x7ff718166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 -- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 msgr2=0x7ff71815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff71815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 -- 172.21.15.64:0/2211910213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff718165440 con 0x7ff7180b3d60 2024-09-21T07:22:45.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff716000640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff70400e9f0 tx=0x7ff70400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70400cd80 con 0x7ff7180b3d60 2024-09-21T07:22:45.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff704004020 con 0x7ff7180b3d60 2024-09-21T07:22:45.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704004470 con 0x7ff7180b3d60 2024-09-21T07:22:45.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff718165720 con 0x7ff7180b3d60 2024-09-21T07:22:45.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff718156fb0 con 0x7ff7180b3d60 2024-09-21T07:22:45.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.149+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7180b4170 con 0x7ff7180b3d60 2024-09-21T07:22:45.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.153+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff704003600 con 0x7ff7180b3d60 2024-09-21T07:22:45.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.153+0000 7ff70ea00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 0x7ff6f8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.153+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff704094710 con 0x7ff7180b3d60 2024-09-21T07:22:45.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.153+0000 7ff716a00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 0x7ff6f8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.153+0000 7ff716a00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 0x7ff6f8075740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff70801afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.157+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff70405f420 con 0x7ff7180b3d60 2024-09-21T07:22:45.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7180b7f20 con 0x7ff7180b3d60 2024-09-21T07:22:45.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff70ea00640 1 -- 172.21.15.64:0/2211910213 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7ff704063e50 con 0x7ff7180b3d60 2024-09-21T07:22:45.372 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:45.372 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":3,"btime":"2024-09-21T07:22:43:678508+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:22:45.373 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 3 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 msgr2=0x7ff6f8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 0x7ff6f8075740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff70801afa0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 msgr2=0x7ff7181562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff70400e9f0 tx=0x7ff70400edf0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 shutdown_connections 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073230 0x7ff6f8075740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7180d1d00 0x7ff71815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7180b3d60 0x7ff7181562d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 --2- 172.21.15.64:0/2211910213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff718071190 0x7ff718166110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 >> 172.21.15.64:0/2211910213 conn(0x7ff71806d1c0 msgr2=0x7ff7180715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 shutdown_connections 2024-09-21T07:22:45.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.369+0000 7ff71dc00640 1 -- 172.21.15.64:0/2211910213 wait complete. 2024-09-21T07:22:45.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:22:45.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- 172.21.15.64:0/1021834748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687015b810 msgr2=0x7f68700ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 --2- 172.21.15.64:0/1021834748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687015b810 0x7f68700ce5b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6860009840 tx=0x7f686001c7f0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- 172.21.15.64:0/1021834748 shutdown_connections 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 --2- 172.21.15.64:0/1021834748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687006f620 0x7f687006fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 --2- 172.21.15.64:0/1021834748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687015b810 0x7f68700ce5b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- 172.21.15.64:0/1021834748 >> 172.21.15.64:0/1021834748 conn(0x7f68700d0de0 msgr2=0x7f68700d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- 172.21.15.64:0/1021834748 shutdown_connections 2024-09-21T07:22:45.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- 172.21.15.64:0/1021834748 wait complete. 2024-09-21T07:22:45.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 Processor -- start 2024-09-21T07:22:45.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.549+0000 7f6875c00640 1 -- start start 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f687006d020 0x7f6870156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687015b810 0x7f6870157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6870168be0 con 0x7f687006f620 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6870168a60 con 0x7f687006d020 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6870168d60 con 0x7f687015b810 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58300/0 (socket says 172.21.15.64:58300) 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 -- 172.21.15.64:0/3969874577 learned_addr learned my addr 172.21.15.64:0/3969874577 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686f400640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687015b810 0x7f6870157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686ea00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f687006d020 0x7f6870156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 -- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687015b810 msgr2=0x7f6870157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687015b810 0x7f6870157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 -- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f687006d020 msgr2=0x7f6870156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f687006d020 0x7f6870156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 -- 172.21.15.64:0/3969874577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700c8740 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f686e000640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c3c0 tx=0x7f685c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c011790 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f685c017070 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68700c8a20 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c011d00 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68700c8fe0 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.553+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687006fa30 con 0x7f687006f620 2024-09-21T07:22:45.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.557+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f685c01c460 con 0x7f687006f620 2024-09-21T07:22:45.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.557+0000 7f6866a00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 0x7f6850075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.557+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f685c093c80 con 0x7f687006f620 2024-09-21T07:22:45.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.557+0000 7f686ea00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 0x7f6850075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.557+0000 7f686ea00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 0x7f6850075710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68600af000 tx=0x7f686001b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.561+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f685c05e900 con 0x7f687006f620 2024-09-21T07:22:45.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.737+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f68700c84d0 con 0x7f687006f620 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.737+0000 7f6866a00640 1 -- 172.21.15.64:0/3969874577 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f685c063330 con 0x7f687006f620 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:22:45.743 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 msgr2=0x7f6850075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 0x7f6850075710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68600af000 tx=0x7f686001b030 comp rx=0 tx=0).stop 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 msgr2=0x7f6870156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c3c0 tx=0x7f685c00c880 comp rx=0 tx=0).stop 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 shutdown_connections 2024-09-21T07:22:45.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6850073200 0x7f6850075710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f687015b810 0x7f6870157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f687006f620 0x7f6870156000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 --2- 172.21.15.64:0/3969874577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f687006d020 0x7f6870156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 >> 172.21.15.64:0/3969874577 conn(0x7f68700d0de0 msgr2=0x7f68700aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 shutdown_connections 2024-09-21T07:22:45.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.741+0000 7f6875c00640 1 -- 172.21.15.64:0/3969874577 wait complete. 2024-09-21T07:22:45.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:22:45.765 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:22:45.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- 172.21.15.64:0/1747697596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cd440 msgr2=0x7f43f80b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 --2- 172.21.15.64:0/1747697596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cd440 0x7f43f80b51c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43f8073e40 tx=0x7f43e801c830 comp rx=0 tx=0).stop 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- 172.21.15.64:0/1747697596 shutdown_connections 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 --2- 172.21.15.64:0/1747697596 >> v2:172.21.15.90:3300/0 conn(0x7f43f815c6e0 0x7f43f80cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 --2- 172.21.15.64:0/1747697596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cd440 0x7f43f80b51c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- 172.21.15.64:0/1747697596 >> 172.21.15.64:0/1747697596 conn(0x7f43f806d480 msgr2=0x7f43f80710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- 172.21.15.64:0/1747697596 shutdown_connections 2024-09-21T07:22:45.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- 172.21.15.64:0/1747697596 wait complete. 2024-09-21T07:22:45.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 Processor -- start 2024-09-21T07:22:45.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.925+0000 7f43fde00640 1 -- start start 2024-09-21T07:22:45.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43f815c6e0 0x7f43f815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f43f816a080 con 0x7f43f80cf130 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43f8169f00 con 0x7f43f815c6e0 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f43f816a200 con 0x7f43f80cd440 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43f6a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58316/0 (socket says 172.21.15.64:58316) 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43f6a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:49352/0 (socket says 172.21.15.64:49352) 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 -- 172.21.15.64:0/1275751498 learned_addr learned my addr 172.21.15.64:0/1275751498 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:45.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43f7400640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43f815c6e0 0x7f43f815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 -- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 msgr2=0x7f43f81fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 -- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43f815c6e0 msgr2=0x7f43f815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43f815c6e0 0x7f43f815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 -- 172.21.15.64:0/1275751498 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f80c9200 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43f6a00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43efe00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e7f0 tx=0x7f43e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000cc60 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43e000ce20 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0005280 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f815ecb0 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f815cfb0 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.929+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f815f1d0 con 0x7f43f80cf130 2024-09-21T07:22:45.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.933+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f43e0005420 con 0x7f43f80cf130 2024-09-21T07:22:45.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.933+0000 7f43ef400640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 0x7f43d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.933+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f43e00947d0 con 0x7f43f80cf130 2024-09-21T07:22:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.933+0000 7f43f6a00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 0x7f43d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.933+0000 7f43f6a00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 0x7f43d4075710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43e80af000 tx=0x7f43e801b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:45.937+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f43e005f450 con 0x7f43f80cf130 2024-09-21T07:22:46.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.113+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f43f80b51c0 con 0x7f43f80cf130 2024-09-21T07:22:46.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43ef400640 1 -- 172.21.15.64:0/1275751498 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f43e0063e80 con 0x7f43f80cf130 2024-09-21T07:22:46.696 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 msgr2=0x7f43d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 0x7f43d4075710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43e80af000 tx=0x7f43e801b070 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 msgr2=0x7f43f814c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e7f0 tx=0x7f43e000ecb0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 shutdown_connections 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f43d4073200 0x7f43d4075710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43f815c6e0 0x7f43f815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43f80cf130 0x7f43f814c810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 --2- 172.21.15.64:0/1275751498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43f80cd440 0x7f43f81fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.693+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 >> 172.21.15.64:0/1275751498 conn(0x7f43f806d480 msgr2=0x7f43f8166980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:46.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.697+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 shutdown_connections 2024-09-21T07:22:46.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.697+0000 7f43fde00640 1 -- 172.21.15.64:0/1275751498 wait complete. 2024-09-21T07:22:46.728 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- 172.21.15.64:0/464619969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05e4004d50 msgr2=0x7f05e4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 --2- 172.21.15.64:0/464619969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05e4004d50 0x7f05e4005200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f06000cca20 tx=0x7f05f801d590 comp rx=0 tx=0).stop 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f05ffe00640 1 -- 172.21.15.64:0/464619969 reap_dead start 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- 172.21.15.64:0/464619969 shutdown_connections 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- 172.21.15.64:0/464619969 >> 172.21.15.64:0/464619969 conn(0x7f060006d1c0 msgr2=0x7f060006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- 172.21.15.64:0/464619969 shutdown_connections 2024-09-21T07:22:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- 172.21.15.64:0/464619969 wait complete. 2024-09-21T07:22:46.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 Processor -- start 2024-09-21T07:22:46.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.893+0000 7f0606200640 1 -- start start 2024-09-21T07:22:46.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05e4004d50 0x7f0600152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:46.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:46.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 0x7f06001f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:46.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0600165b30 con 0x7f0600151b90 2024-09-21T07:22:46.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06001659b0 con 0x7f06000b2e40 2024-09-21T07:22:46.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0600165cb0 con 0x7f05e4004d50 2024-09-21T07:22:46.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:46.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58332/0 (socket says 172.21.15.64:58332) 2024-09-21T07:22:46.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 -- 172.21.15.64:0/1329047635 learned_addr learned my addr 172.21.15.64:0/1329047635 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05ff400640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05e4004d50 0x7f0600152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05ffe00640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 0x7f06001f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 -- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05e4004d50 msgr2=0x7f0600152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05e4004d50 0x7f0600152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 -- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 msgr2=0x7f06001f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 0x7f06001f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 -- 172.21.15.64:0/1329047635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06000b1860 con 0x7f0600151b90 2024-09-21T07:22:46.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05ffe00640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 0x7f06001f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7e00640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006330 tx=0x7f05e80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8015070 con 0x7f0600151b90 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05e8011840 con 0x7f0600151b90 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8011c90 con 0x7f0600151b90 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06000b1b40 con 0x7f0600151b90 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06000b2100 con 0x7f0600151b90 2024-09-21T07:22:46.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.897+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06000d0ba0 con 0x7f0600151b90 2024-09-21T07:22:46.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.901+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f05e8018070 con 0x7f0600151b90 2024-09-21T07:22:46.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.901+0000 7f05f7400640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 0x7f05dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:46.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.901+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f05e8094ee0 con 0x7f0600151b90 2024-09-21T07:22:46.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.901+0000 7f05ff400640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 0x7f05dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:46.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.901+0000 7f05ff400640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 0x7f05dc075710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c10 tx=0x7f05f0006660 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:46.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:46.905+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f05e8060150 con 0x7f0600151b90 2024-09-21T07:22:47.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.089+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0600069370 con 0x7f0600151b90 2024-09-21T07:22:47.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.697+0000 7f05f7400640 1 -- 172.21.15.64:0/1329047635 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f05e805fa50 con 0x7f0600151b90 2024-09-21T07:22:47.703 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:22:47.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 msgr2=0x7f05dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 0x7f05dc075710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c10 tx=0x7f05f0006660 comp rx=0 tx=0).stop 2024-09-21T07:22:47.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 msgr2=0x7f06000b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006330 tx=0x7f05e80039d0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 shutdown_connections 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05dc073200 0x7f05dc075710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000b2e40 0x7f06001f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0600151b90 0x7f06000b2900 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 --2- 172.21.15.64:0/1329047635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05e4004d50 0x7f0600152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.705+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 >> 172.21.15.64:0/1329047635 conn(0x7f060006d1c0 msgr2=0x7f0600155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.709+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 shutdown_connections 2024-09-21T07:22:47.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.709+0000 7f0606200640 1 -- 172.21.15.64:0/1329047635 wait complete. 2024-09-21T07:22:47.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:22:47.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 -- 172.21.15.64:0/106308401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d440b3e30 msgr2=0x7f8d440b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 --2- 172.21.15.64:0/106308401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d440b3e30 0x7f8d440b4240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d4415d100 tx=0x7f8d4001cd40 comp rx=0 tx=0).stop 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 -- 172.21.15.64:0/106308401 shutdown_connections 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 --2- 172.21.15.64:0/106308401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d440b3e30 0x7f8d440b4240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 --2- 172.21.15.64:0/106308401 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440cfef0 0x7f8d440d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 -- 172.21.15.64:0/106308401 >> 172.21.15.64:0/106308401 conn(0x7f8d440d23b0 msgr2=0x7f8d440d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.909+0000 7f8d4c800640 1 -- 172.21.15.64:0/106308401 shutdown_connections 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 -- 172.21.15.64:0/106308401 wait complete. 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 Processor -- start 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 -- start start 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440b3e30 0x7f8d441f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d440cfef0 0x7f8d440b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8d44169f50 con 0x7f8d4415c9f0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d44169dd0 con 0x7f8d440cfef0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4416a0d0 con 0x7f8d440b3e30 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d49e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440b3e30 0x7f8d441f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58358/0 (socket says 172.21.15.64:58358) 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.913+0000 7f8d4a800640 1 -- 172.21.15.64:0/2315917561 learned_addr learned my addr 172.21.15.64:0/2315917561 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d49400640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d440cfef0 0x7f8d440b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 -- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440b3e30 msgr2=0x7f8d441f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440b3e30 0x7f8d441f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 -- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d440cfef0 msgr2=0x7f8d440b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d440cfef0 0x7f8d440b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 -- 172.21.15.64:0/2315917561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d441f6e30 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4a800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d4001b450 tx=0x7f8d40003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400bc070 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d400042f0 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400b2040 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4414e2d0 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d441f70d0 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d440b4240 con 0x7f8d4415c9f0 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.917+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8d40004720 con 0x7f8d4415c9f0 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.921+0000 7f8d3e000640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 0x7f8d28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.921+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f8d4012e140 con 0x7f8d4415c9f0 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.921+0000 7f8d49e00640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 0x7f8d28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.921+0000 7f8d49e00640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 0x7f8d28075710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098e0 tx=0x7f8d38009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:47.925+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8d40016990 con 0x7f8d4415c9f0 2024-09-21T07:22:48.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.137+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8d440c5c10 con 0x7f8d4415c9f0 2024-09-21T07:22:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.701+0000 7f8d3e000640 1 -- 172.21.15.64:0/2315917561 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8d400f8be0 con 0x7f8d4415c9f0 2024-09-21T07:22:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:22:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 msgr2=0x7f8d28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 0x7f8d28075710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098e0 tx=0x7f8d38009060 comp rx=0 tx=0).stop 2024-09-21T07:22:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 msgr2=0x7f8d4414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d4001b450 tx=0x7f8d40003f80 comp rx=0 tx=0).stop 2024-09-21T07:22:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 shutdown_connections 2024-09-21T07:22:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d28073200 0x7f8d28075710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4415c9f0 0x7f8d4414dd90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d440cfef0 0x7f8d440b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 --2- 172.21.15.64:0/2315917561 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d440b3e30 0x7f8d441f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.705+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 >> 172.21.15.64:0/2315917561 conn(0x7f8d440d23b0 msgr2=0x7f8d4415f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:48.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.709+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 shutdown_connections 2024-09-21T07:22:48.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.709+0000 7f8d4c800640 1 -- 172.21.15.64:0/2315917561 wait complete. 2024-09-21T07:22:48.762 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T07:22:48.762 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T07:22:48.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 -- 172.21.15.64:0/863706735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 msgr2=0x7ffb2815c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 --2- 172.21.15.64:0/863706735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb2815c850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009900 tx=0x7ffb1c01c850 comp rx=0 tx=0).stop 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 -- 172.21.15.64:0/863706735 shutdown_connections 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 --2- 172.21.15.64:0/863706735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ad210 0x7ffb28072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 --2- 172.21.15.64:0/863706735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb2815c850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 -- 172.21.15.64:0/863706735 >> 172.21.15.64:0/863706735 conn(0x7ffb280d0170 msgr2=0x7ffb280d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 -- 172.21.15.64:0/863706735 shutdown_connections 2024-09-21T07:22:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.921+0000 7ffb30600640 1 -- 172.21.15.64:0/863706735 wait complete. 2024-09-21T07:22:48.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 Processor -- start 2024-09-21T07:22:48.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 -- start start 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ace00 0x7ffb2814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb280ad210 0x7ffb28155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28169fd0 con 0x7ffb280ca7c0 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28169e50 con 0x7ffb280ad210 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2816a150 con 0x7ffb280ace00 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58374/0 (socket says 172.21.15.64:58374) 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 -- 172.21.15.64:0/1057545349 learned_addr learned my addr 172.21.15.64:0/1057545349 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2d200640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb280ad210 0x7ffb28155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2dc00640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ace00 0x7ffb2814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 -- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ace00 msgr2=0x7ffb2814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ace00 0x7ffb2814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 -- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb280ad210 msgr2=0x7ffb28155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb280ad210 0x7ffb28155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 -- 172.21.15.64:0/1057545349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb280c8920 con 0x7ffb280ca7c0 2024-09-21T07:22:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb2e600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009fd0 tx=0x7ffb2000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000ce20 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb20004b30 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb280c8c00 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.925+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20005020 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb280c91c0 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb28072dd0 con 0x7ffb280ca7c0 2024-09-21T07:22:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffb200051c0 con 0x7ffb280ca7c0 2024-09-21T07:22:48.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb25600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 0x7ffb08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:48.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb20094e00 con 0x7ffb280ca7c0 2024-09-21T07:22:48.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.929+0000 7ffb2dc00640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 0x7ffb08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.933+0000 7ffb2dc00640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 0x7ffb08075710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0af000 tx=0x7ffb1c01b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:48.933+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffb2005f730 con 0x7ffb280ca7c0 2024-09-21T07:22:49.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.117+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ffb280c86b0 con 0x7ffb280ca7c0 2024-09-21T07:22:49.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.725+0000 7ffb25600640 1 -- 172.21.15.64:0/1057545349 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7ffb20064160 con 0x7ffb280ca7c0 2024-09-21T07:22:49.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 msgr2=0x7ffb08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 0x7ffb08075710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0af000 tx=0x7ffb1c01b090 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 msgr2=0x7ffb28155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009fd0 tx=0x7ffb2000ef10 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 shutdown_connections 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffb08073200 0x7ffb08075710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb280ca7c0 0x7ffb28155e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb280ad210 0x7ffb28155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 --2- 172.21.15.64:0/1057545349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb280ace00 0x7ffb2814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 >> 172.21.15.64:0/1057545349 conn(0x7ffb280d0170 msgr2=0x7ffb28166a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 shutdown_connections 2024-09-21T07:22:49.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.729+0000 7ffb30600640 1 -- 172.21.15.64:0/1057545349 wait complete. 2024-09-21T07:22:49.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:22:49.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- 172.21.15.64:0/1629098854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 msgr2=0x7f2de00d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 --2- 172.21.15.64:0/1629098854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00d0150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009840 tx=0x7f2dd001c710 comp rx=0 tx=0).stop 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- 172.21.15.64:0/1629098854 shutdown_connections 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 --2- 172.21.15.64:0/1629098854 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 0x7f2de00b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 --2- 172.21.15.64:0/1629098854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00d0150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- 172.21.15.64:0/1629098854 >> 172.21.15.64:0/1629098854 conn(0x7f2de00d22e0 msgr2=0x7f2de00d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- 172.21.15.64:0/1629098854 shutdown_connections 2024-09-21T07:22:49.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- 172.21.15.64:0/1629098854 wait complete. 2024-09-21T07:22:49.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 Processor -- start 2024-09-21T07:22:49.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.925+0000 7f2de5800640 1 -- start start 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 0x7f2de00cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2de016bdd0 con 0x7f2de00b42a0 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2de016bc50 con 0x7f2de01630a0 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2de016bf50 con 0x7f2de015fb40 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58378/0 (socket says 172.21.15.64:58378) 2024-09-21T07:22:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 -- 172.21.15.64:0/1998442838 learned_addr learned my addr 172.21.15.64:0/1998442838 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 0x7f2de00cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddf400640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 -- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 msgr2=0x7f2de00cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 0x7f2de00cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 -- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 msgr2=0x7f2de00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 -- 172.21.15.64:0/1998442838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de0155af0 con 0x7f2de00b42a0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2ddea00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000c10 tx=0x7f2dd00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0004750 con 0x7f2de00b42a0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dd00048f0 con 0x7f2de00b42a0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de0155ff0 con 0x7f2de00b42a0 2024-09-21T07:22:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0004ce0 con 0x7f2de00b42a0 2024-09-21T07:22:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de01565b0 con 0x7f2de00b42a0 2024-09-21T07:22:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.929+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de00b3d60 con 0x7f2de00b42a0 2024-09-21T07:22:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.933+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2dd00a8550 con 0x7f2de00b42a0 2024-09-21T07:22:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.933+0000 7f2dd6a00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 0x7f2dbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.933+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f2dd012e6d0 con 0x7f2de00b42a0 2024-09-21T07:22:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.933+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 0x7f2dbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.933+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 0x7f2dbc075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2de00cddc0 tx=0x7f2dc80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:49.937+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2dd00c1030 con 0x7f2de00b42a0 2024-09-21T07:22:50.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:50.229+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2de00b3a50 con 0x7f2de00b42a0 2024-09-21T07:22:51.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.741+0000 7f2dd6a00640 1 -- 172.21.15.64:0/1998442838 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f2dd00ac030 con 0x7f2de00b42a0 2024-09-21T07:22:51.747 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data_ec' created 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 msgr2=0x7f2dbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 0x7f2dbc075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2de00cddc0 tx=0x7f2dc80091e0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 msgr2=0x7f2de01552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000c10 tx=0x7f2dd00056d0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 shutdown_connections 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073200 0x7f2dbc075710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de01630a0 0x7f2de00cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de015fb40 0x7f2de00cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 --2- 172.21.15.64:0/1998442838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de00b42a0 0x7f2de01552c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 >> 172.21.15.64:0/1998442838 conn(0x7f2de00d22e0 msgr2=0x7f2de00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:51.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 shutdown_connections 2024-09-21T07:22:51.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.749+0000 7f2de5800640 1 -- 172.21.15.64:0/1998442838 wait complete. 2024-09-21T07:22:51.785 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T07:22:51.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- 172.21.15.64:0/2354711815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 msgr2=0x7fa38c15f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 --2- 172.21.15.64:0/2354711815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c15f480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa38c073fa0 tx=0x7fa38401c740 comp rx=0 tx=0).stop 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- 172.21.15.64:0/2354711815 shutdown_connections 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 --2- 172.21.15.64:0/2354711815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c15f480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- 172.21.15.64:0/2354711815 >> 172.21.15.64:0/2354711815 conn(0x7fa38c0d0170 msgr2=0x7fa38c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- 172.21.15.64:0/2354711815 shutdown_connections 2024-09-21T07:22:51.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- 172.21.15.64:0/2354711815 wait complete. 2024-09-21T07:22:51.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 Processor -- start 2024-09-21T07:22:51.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.949+0000 7fa392000640 1 -- start start 2024-09-21T07:22:51.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c1fa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa38c1573b0 0x7fa38c1facd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c16a0f0 con 0x7fa38c06ec70 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c169f70 con 0x7fa38c0af530 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c16a270 con 0x7fa38c1573b0 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58394/0 (socket says 172.21.15.64:58394) 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 -- 172.21.15.64:0/2396365294 learned_addr learned my addr 172.21.15.64:0/2396365294 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38be00640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa38c1573b0 0x7fa38c1facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa382a00640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c1fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 -- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa38c1573b0 msgr2=0x7fa38c1facd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa38c1573b0 0x7fa38c1facd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 -- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 msgr2=0x7fa38c1fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:51.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c1fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:51.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 -- 172.21.15.64:0/2396365294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c0b2400 con 0x7fa38c06ec70 2024-09-21T07:22:51.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa38b400640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00c7a0 tx=0x7fa37c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:51.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c003b80 con 0x7fa38c06ec70 2024-09-21T07:22:51.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa37c003d20 con 0x7fa38c06ec70 2024-09-21T07:22:51.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c167240 con 0x7fa38c06ec70 2024-09-21T07:22:51.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00aab0 con 0x7fa38c06ec70 2024-09-21T07:22:51.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c0b29a0 con 0x7fa38c06ec70 2024-09-21T07:22:51.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.953+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c15f480 con 0x7fa38c06ec70 2024-09-21T07:22:51.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.957+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa37c00ac50 con 0x7fa38c06ec70 2024-09-21T07:22:51.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.957+0000 7fa383e00640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 0x7fa368075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:51.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.957+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fa37c094130 con 0x7fa38c06ec70 2024-09-21T07:22:51.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.957+0000 7fa382a00640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 0x7fa368075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:51.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.957+0000 7fa382a00640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 0x7fa368075740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c10 tx=0x7fa374001760 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:51.961+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa37c05e8e0 con 0x7fa38c06ec70 2024-09-21T07:22:52.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.141+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa38c0cb2b0 con 0x7fa38c06ec70 2024-09-21T07:22:52.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.745+0000 7fa383e00640 1 -- 172.21.15.64:0/2396365294 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7fa37c063310 con 0x7fa38c06ec70 2024-09-21T07:22:52.749 INFO:teuthology.orchestra.run.smithi064.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T07:22:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 msgr2=0x7fa368075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 0x7fa368075740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c10 tx=0x7fa374001760 comp rx=0 tx=0).stop 2024-09-21T07:22:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 msgr2=0x7fa38c1fa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00c7a0 tx=0x7fa37c00cc60 comp rx=0 tx=0).stop 2024-09-21T07:22:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 shutdown_connections 2024-09-21T07:22:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073230 0x7fa368075740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa38c1573b0 0x7fa38c1facd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38c0af530 0x7fa38c1fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 --2- 172.21.15.64:0/2396365294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa38c06ec70 0x7fa38c1fa250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.749+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 >> 172.21.15.64:0/2396365294 conn(0x7fa38c0d0170 msgr2=0x7fa38c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:52.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.753+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 shutdown_connections 2024-09-21T07:22:52.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.753+0000 7fa392000640 1 -- 172.21.15.64:0/2396365294 wait complete. 2024-09-21T07:22:52.799 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- 172.21.15.64:0/3897136211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 msgr2=0x7fd37c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 --2- 172.21.15.64:0/3897136211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c0b4170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0d2290 tx=0x7fd36401c800 comp rx=0 tx=0).stop 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- 172.21.15.64:0/3897136211 shutdown_connections 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 --2- 172.21.15.64:0/3897136211 >> v2:172.21.15.90:3300/0 conn(0x7fd37c071190 0x7fd37c0715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 --2- 172.21.15.64:0/3897136211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c0b4170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 --2- 172.21.15.64:0/3897136211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 0x7fd37c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- 172.21.15.64:0/3897136211 >> 172.21.15.64:0/3897136211 conn(0x7fd37c06d1c0 msgr2=0x7fd37c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- 172.21.15.64:0/3897136211 shutdown_connections 2024-09-21T07:22:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- 172.21.15.64:0/3897136211 wait complete. 2024-09-21T07:22:52.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 Processor -- start 2024-09-21T07:22:52.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.957+0000 7fd382600640 1 -- start start 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 0x7fd37c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 0x7fd37c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c0c6d40 con 0x7fd37c0b3d60 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c0c6bc0 con 0x7fd37c071190 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c0c6ec0 con 0x7fd37c0d1d00 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58418/0 (socket says 172.21.15.64:58418) 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd37b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 0x7fd37c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 -- 172.21.15.64:0/2327378425 learned_addr learned my addr 172.21.15.64:0/2327378425 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd37be00640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 0x7fd37c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 -- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 msgr2=0x7fd37c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 0x7fd37c0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 -- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 msgr2=0x7fd37c0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 0x7fd37c0b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 -- 172.21.15.64:0/2327378425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c14bdd0 con 0x7fd37c0b3d60 2024-09-21T07:22:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd37b400640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 0x7fd37c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373e00640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd36401aeb0 tx=0x7fd3640050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640b2040 con 0x7fd37c0b3d60 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3640054b0 con 0x7fd37c0b3d60 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364005660 con 0x7fd37c0b3d60 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c0b7190 con 0x7fd37c0b3d60 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c0b7910 con 0x7fd37c0b3d60 2024-09-21T07:22:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.961+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c0b4170 con 0x7fd37c0b3d60 2024-09-21T07:22:52.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.965+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd364004910 con 0x7fd37c0b3d60 2024-09-21T07:22:52.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.965+0000 7fd373400640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 0x7fd358075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:52.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.965+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fd36412e830 con 0x7fd37c0b3d60 2024-09-21T07:22:52.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.965+0000 7fd37b400640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 0x7fd358075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:52.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.965+0000 7fd37b400640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 0x7fd358075740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00bec0 tx=0x7fd36c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:52.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:52.969+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd3640164b0 con 0x7fd37c0b3d60 2024-09-21T07:22:53.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.189+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd37c0b7360 con 0x7fd37c0b3d60 2024-09-21T07:22:53.688 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:22:53.685+0000 7ff9de200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:22:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd373400640 1 -- 172.21.15.64:0/2327378425 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fd3640f8ed0 con 0x7fd37c0b3d60 2024-09-21T07:22:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:added data pool 4 to fsmap 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 msgr2=0x7fd358075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 0x7fd358075740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00bec0 tx=0x7fd36c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 msgr2=0x7fd37c14b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd36401aeb0 tx=0x7fd3640050c0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 shutdown_connections 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd358073230 0x7fd358075740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd37c0d1d00 0x7fd37c0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd37c0b3d60 0x7fd37c14b890 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 --2- 172.21.15.64:0/2327378425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd37c071190 0x7fd37c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 >> 172.21.15.64:0/2327378425 conn(0x7fd37c06d1c0 msgr2=0x7fd37c159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 shutdown_connections 2024-09-21T07:22:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.765+0000 7fd382600640 1 -- 172.21.15.64:0/2327378425 wait complete. 2024-09-21T07:22:53.793 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- 172.21.15.64:0/1156503525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c30004880 msgr2=0x7f7c30004d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 --2- 172.21.15.64:0/1156503525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c30004880 0x7f7c30004d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009b40 tx=0x7f7c3801d220 comp rx=0 tx=0).stop 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- 172.21.15.64:0/1156503525 shutdown_connections 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 --2- 172.21.15.64:0/1156503525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c30004880 0x7f7c30004d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- 172.21.15.64:0/1156503525 >> 172.21.15.64:0/1156503525 conn(0x7f7c4c0b2ca0 msgr2=0x7f7c4c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- 172.21.15.64:0/1156503525 shutdown_connections 2024-09-21T07:22:53.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- 172.21.15.64:0/1156503525 wait complete. 2024-09-21T07:22:53.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 Processor -- start 2024-09-21T07:22:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.949+0000 7f7c53200640 1 -- start start 2024-09-21T07:22:53.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30004880 0x7f7c4c1f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:53.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c4c15d680 0x7f7c4c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c070340 con 0x7f7c4c15d270 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0701c0 con 0x7f7c30004880 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0704c0 con 0x7f7c4c15d680 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58436/0 (socket says 172.21.15.64:58436) 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 -- 172.21.15.64:0/3971320152 learned_addr learned my addr 172.21.15.64:0/3971320152 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4be00640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30004880 0x7f7c4c1f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c51200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c4c15d680 0x7f7c4c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 -- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c4c15d680 msgr2=0x7f7c4c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c4c15d680 0x7f7c4c071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 -- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30004880 msgr2=0x7f7c4c1f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:53.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30004880 0x7f7c4c1f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:53.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 -- 172.21.15.64:0/3971320152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0ad9a0 con 0x7f7c4c15d270 2024-09-21T07:22:53.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c4b400640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c3801d050 tx=0x7f7c38005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:53.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c380bb030 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c380046d0 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c0adc80 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004b20 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c0ae240 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.953+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c0b61e0 con 0x7f7c4c15d270 2024-09-21T07:22:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.957+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7c380be030 con 0x7f7c4c15d270 2024-09-21T07:22:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.957+0000 7f7c43e00640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 0x7f7c2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.957+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c3812f820 con 0x7f7c4c15d270 2024-09-21T07:22:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.957+0000 7f7c4be00640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 0x7f7c2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.957+0000 7f7c4be00640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 0x7f7c2c075710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c06c110 tx=0x7f7c3c006b70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:53.961+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7c38016f60 con 0x7f7c4c15d270 2024-09-21T07:22:54.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c4c0b5b90 con 0x7f7c4c15d270 2024-09-21T07:22:54.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c43e00640 1 -- 172.21.15.64:0/3971320152 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7f7c380f9e10 con 0x7f7c4c15d270 2024-09-21T07:22:54.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:54.181 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":7,"btime":"2024-09-21T07:22:53:760203+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:22:53.193515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:22:54.181 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 7 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 msgr2=0x7f7c2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 0x7f7c2c075710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c06c110 tx=0x7f7c3c006b70 comp rx=0 tx=0).stop 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 msgr2=0x7f7c4c0716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c3801d050 tx=0x7f7c38005850 comp rx=0 tx=0).stop 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 shutdown_connections 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c2c073200 0x7f7c2c075710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c4c15d680 0x7f7c4c071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c4c15d270 0x7f7c4c0716b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 --2- 172.21.15.64:0/3971320152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30004880 0x7f7c4c1f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 >> 172.21.15.64:0/3971320152 conn(0x7f7c4c0b2ca0 msgr2=0x7f7c4c0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:54.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 shutdown_connections 2024-09-21T07:22:54.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.177+0000 7f7c53200640 1 -- 172.21.15.64:0/3971320152 wait complete. 2024-09-21T07:22:54.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:54.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 -- 172.21.15.64:0/3943002553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 msgr2=0x7f91b40b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 --2- 172.21.15.64:0/3943002553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b40b4170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f919c009840 tx=0x7f919c01c760 comp rx=0 tx=0).stop 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 -- 172.21.15.64:0/3943002553 shutdown_connections 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 --2- 172.21.15.64:0/3943002553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b40b4170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 -- 172.21.15.64:0/3943002553 >> 172.21.15.64:0/3943002553 conn(0x7f91b406d1c0 msgr2=0x7f91b406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 -- 172.21.15.64:0/3943002553 shutdown_connections 2024-09-21T07:22:54.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.357+0000 7f91ba000640 1 -- 172.21.15.64:0/3943002553 wait complete. 2024-09-21T07:22:54.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 Processor -- start 2024-09-21T07:22:54.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 -- start start 2024-09-21T07:22:54.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91b40c5ea0 0x7f91b41fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91b40d1d00 0x7f91b40b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91b416af90 con 0x7f91b40b3d60 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f91b416ae10 con 0x7f91b40c5ea0 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91ba000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f91b416b110 con 0x7f91b40d1d00 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58460/0 (socket says 172.21.15.64:58460) 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.361+0000 7f91b3400640 1 -- 172.21.15.64:0/992710964 learned_addr learned my addr 172.21.15.64:0/992710964 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91aaa00640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91b40c5ea0 0x7f91b41fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3e00640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91b40d1d00 0x7f91b40b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 -- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91b40d1d00 msgr2=0x7f91b40b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91b40d1d00 0x7f91b40b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 -- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91b40c5ea0 msgr2=0x7f91b41fce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91b40c5ea0 0x7f91b41fce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 -- 172.21.15.64:0/992710964 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41fd340 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91b3400640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c400 tx=0x7f91a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4011790 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91a4017070 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b41f9420 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4011cc0 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41f99e0 con 0x7f91b40b3d60 2024-09-21T07:22:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b40b4170 con 0x7f91b40b3d60 2024-09-21T07:22:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.365+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91a401c460 con 0x7f91b40b3d60 2024-09-21T07:22:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.369+0000 7f91abe00640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 0x7f9190075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.369+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f91a4094420 con 0x7f91b40b3d60 2024-09-21T07:22:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.369+0000 7f91aaa00640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 0x7f9190075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.369+0000 7f91aaa00640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 0x7f9190075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f919c0af000 tx=0x7f919c01afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.373+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f91b40b46b0 con 0x7f91b40b3d60 2024-09-21T07:22:54.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.553+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91b4071a60 con 0x7f91b40b3d60 2024-09-21T07:22:54.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.553+0000 7f91abe00640 1 -- 172.21.15.64:0/992710964 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f91a405f060 con 0x7f91b40b3d60 2024-09-21T07:22:54.558 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:54.558 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 msgr2=0x7f9190075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 0x7f9190075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f919c0af000 tx=0x7f919c01afa0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 msgr2=0x7f91b41556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c400 tx=0x7f91a400c8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 shutdown_connections 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9190073200 0x7f9190075710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91b40d1d00 0x7f91b40b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91b40c5ea0 0x7f91b41fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 --2- 172.21.15.64:0/992710964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91b40b3d60 0x7f91b41556b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 >> 172.21.15.64:0/992710964 conn(0x7f91b406d1c0 msgr2=0x7f91b40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:54.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 shutdown_connections 2024-09-21T07:22:54.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.557+0000 7f91ba000640 1 -- 172.21.15.64:0/992710964 wait complete. 2024-09-21T07:22:54.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:54.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 -- 172.21.15.64:0/1977217130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f1015edb0 msgr2=0x7f3f100700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1977217130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f1015edb0 0x7f3f100700b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f100afb50 tx=0x7f3f0001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 -- 172.21.15.64:0/1977217130 shutdown_connections 2024-09-21T07:22:54.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1977217130 >> v2:172.21.15.90:3300/0 conn(0x7f3f100b48d0 0x7f3f10072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1977217130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f1015edb0 0x7f3f100700b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 -- 172.21.15.64:0/1977217130 >> 172.21.15.64:0/1977217130 conn(0x7f3f100ccbe0 msgr2=0x7f3f100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:54.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 -- 172.21.15.64:0/1977217130 shutdown_connections 2024-09-21T07:22:54.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.733+0000 7f3f16c00640 1 -- 172.21.15.64:0/1977217130 wait complete. 2024-09-21T07:22:54.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 Processor -- start 2024-09-21T07:22:54.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 -- start start 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f100709b0 0x7f3f10150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1015edb0 0x7f3f10155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10168b60 con 0x7f3f10156150 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101689e0 con 0x7f3f100709b0 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f16c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f10168ce0 con 0x7f3f1015edb0 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f14c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f14c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58482/0 (socket says 172.21.15.64:58482) 2024-09-21T07:22:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f14c00640 1 -- 172.21.15.64:0/1688878820 learned_addr learned my addr 172.21.15.64:0/1688878820 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f0fe00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f100709b0 0x7f3f10150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.737+0000 7f3f07e00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1015edb0 0x7f3f10155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 -- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1015edb0 msgr2=0x7f3f10155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1015edb0 0x7f3f10155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 -- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f100709b0 msgr2=0x7f3f10150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f100709b0 0x7f3f10150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 -- 172.21.15.64:0/1688878820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1009c290 con 0x7f3f10156150 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f14c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e910 tx=0x7f3f0800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004d30 con 0x7f3f10156150 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f0800cb20 con 0x7f3f10156150 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1009c570 con 0x7f3f10156150 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08005020 con 0x7f3f10156150 2024-09-21T07:22:54.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101509a0 con 0x7f3f10156150 2024-09-21T07:22:54.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f10072e20 con 0x7f3f10156150 2024-09-21T07:22:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.741+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f080051c0 con 0x7f3f10156150 2024-09-21T07:22:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.745+0000 7f3f0cc00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 0x7f3eec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.745+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3f08095150 con 0x7f3f10156150 2024-09-21T07:22:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.745+0000 7f3f0fe00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 0x7f3eec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.745+0000 7f3f0fe00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 0x7f3eec075740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f000af000 tx=0x7f3f0001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:54.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.745+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f08016030 con 0x7f3f10156150 2024-09-21T07:22:54.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f101565f0 con 0x7f3f10156150 2024-09-21T07:22:54.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f0cc00640 1 -- 172.21.15.64:0/1688878820 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f3f0805f7c0 con 0x7f3f10156150 2024-09-21T07:22:54.929 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:54.929 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 msgr2=0x7f3eec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 0x7f3eec075740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f000af000 tx=0x7f3f0001b100 comp rx=0 tx=0).stop 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 msgr2=0x7f3f100ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e910 tx=0x7f3f0800edd0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 shutdown_connections 2024-09-21T07:22:54.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3eec073230 0x7f3eec075740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f10156150 0x7f3f100ae4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1015edb0 0x7f3f10155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 --2- 172.21.15.64:0/1688878820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f100709b0 0x7f3f10150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 >> 172.21.15.64:0/1688878820 conn(0x7f3f100ccbe0 msgr2=0x7f3f1015b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 shutdown_connections 2024-09-21T07:22:54.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:54.925+0000 7f3f16c00640 1 -- 172.21.15.64:0/1688878820 wait complete. 2024-09-21T07:22:54.966 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- 172.21.15.64:0/1751834678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 msgr2=0x7ff800070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 --2- 172.21.15.64:0/1751834678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800070880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009900 tx=0x7ff7f001c790 comp rx=0 tx=0).stop 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- 172.21.15.64:0/1751834678 shutdown_connections 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 --2- 172.21.15.64:0/1751834678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff80006d500 0x7ff800160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 --2- 172.21.15.64:0/1751834678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800070880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- 172.21.15.64:0/1751834678 >> 172.21.15.64:0/1751834678 conn(0x7ff80006e890 msgr2=0x7ff8000b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- 172.21.15.64:0/1751834678 shutdown_connections 2024-09-21T07:22:55.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- 172.21.15.64:0/1751834678 wait complete. 2024-09-21T07:22:55.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 Processor -- start 2024-09-21T07:22:55.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 -- start start 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.121+0000 7ff806000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff800148cd0 0x7ff8001658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff800165e00 0x7ff80015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff800169f70 con 0x7ff80015c660 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff800169df0 con 0x7ff800165e00 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff80016a0f0 con 0x7ff800148cd0 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48394/0 (socket says 172.21.15.64:48394) 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 -- 172.21.15.64:0/1555095521 learned_addr learned my addr 172.21.15.64:0/1555095521 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7f7e00640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff800148cd0 0x7ff8001658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ffe00640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff800165e00 0x7ff80015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 -- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff800148cd0 msgr2=0x7ff8001658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff800148cd0 0x7ff8001658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 -- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff800165e00 msgr2=0x7ff80015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff800165e00 0x7ff80015a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 -- 172.21.15.64:0/1555095521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff800166210 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7ff400640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b0040 tx=0x7ff7f00a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00bb070 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7f00044b0 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00b2040 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80015d5b0 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff800148a80 con 0x7ff80015c660 2024-09-21T07:22:55.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.125+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff800160480 con 0x7ff80015c660 2024-09-21T07:22:55.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.129+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff7f00be070 con 0x7ff80015c660 2024-09-21T07:22:55.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.129+0000 7ff7f7400640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 0x7ff7dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.129+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff7f012e4a0 con 0x7ff80015c660 2024-09-21T07:22:55.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.129+0000 7ff7f7e00640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 0x7ff7dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.129+0000 7ff7f7e00640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 0x7ff7dc075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff80015d800 tx=0x7ff7e8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:55.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.133+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff800166210 con 0x7ff80015c660 2024-09-21T07:22:55.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.345+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff800166d30 con 0x7ff80015c660 2024-09-21T07:22:55.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.345+0000 7ff7f7400640 1 -- 172.21.15.64:0/1555095521 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7ff7f00f9e20 con 0x7ff80015c660 2024-09-21T07:22:55.350 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:55.351 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":7,"btime":"2024-09-21T07:22:53:760203+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:22:53.193515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:22:55.351 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 7 2024-09-21T07:22:55.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 msgr2=0x7ff7dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 0x7ff7dc075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff80015d800 tx=0x7ff7e8009040 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 msgr2=0x7ff800148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b0040 tx=0x7ff7f00a57d0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 shutdown_connections 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7dc073200 0x7ff7dc075710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff800165e00 0x7ff80015a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff800148cd0 0x7ff8001658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 --2- 172.21.15.64:0/1555095521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff80015c660 0x7ff800148540 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 >> 172.21.15.64:0/1555095521 conn(0x7ff80006e890 msgr2=0x7ff80006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 shutdown_connections 2024-09-21T07:22:55.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.349+0000 7ff806000640 1 -- 172.21.15.64:0/1555095521 wait complete. 2024-09-21T07:22:55.373 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:22:55.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 -- 172.21.15.64:0/2084674022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d64074620 msgr2=0x7f5d6406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 --2- 172.21.15.64:0/2084674022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d64074620 0x7f5d6406cdf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5d64072c00 tx=0x7f5d5001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 -- 172.21.15.64:0/2084674022 shutdown_connections 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 --2- 172.21.15.64:0/2084674022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d6406d330 0x7f5d6406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 --2- 172.21.15.64:0/2084674022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d64074620 0x7f5d6406cdf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 --2- 172.21.15.64:0/2084674022 >> v2:172.21.15.90:3300/0 conn(0x7f5d64073cd0 0x7f5d640740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 -- 172.21.15.64:0/2084674022 >> 172.21.15.64:0/2084674022 conn(0x7f5d640b2b50 msgr2=0x7f5d640b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 -- 172.21.15.64:0/2084674022 shutdown_connections 2024-09-21T07:22:55.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.525+0000 7f5d63e00640 1 -- 172.21.15.64:0/2084674022 wait complete. 2024-09-21T07:22:55.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 Processor -- start 2024-09-21T07:22:55.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 -- start start 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 0x7f5d640b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d64074620 0x7f5d640b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6415d410 con 0x7f5d6406d330 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6415d290 con 0x7f5d64073cd0 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6415d590 con 0x7f5d64074620 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48422/0 (socket says 172.21.15.64:48422) 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 -- 172.21.15.64:0/1713927788 learned_addr learned my addr 172.21.15.64:0/1713927788 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63400640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d64074620 0x7f5d640b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62000640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 0x7f5d640b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 -- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d64074620 msgr2=0x7f5d640b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d64074620 0x7f5d640b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 -- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 msgr2=0x7f5d640b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 0x7f5d640b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 -- 172.21.15.64:0/1713927788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d64154a60 con 0x7f5d6406d330 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62000640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 0x7f5d640b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:55.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d62a00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400d750 tx=0x7f5d5400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54017070 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d54004310 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400de60 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.529+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6415dc80 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6415e240 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d640740e0 con 0x7f5d6406d330 2024-09-21T07:22:55.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5d54009c30 con 0x7f5d6406d330 2024-09-21T07:22:55.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d5b400640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 0x7f5d44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:55.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5d540946a0 con 0x7f5d6406d330 2024-09-21T07:22:55.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.533+0000 7f5d62000640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 0x7f5d44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:55.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.537+0000 7f5d62000640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 0x7f5d44075710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d500af000 tx=0x7f5d5001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:55.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.537+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5d5405ec90 con 0x7f5d6406d330 2024-09-21T07:22:55.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.717+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d640725f0 con 0x7f5d6406d330 2024-09-21T07:22:55.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.717+0000 7f5d5b400640 1 -- 172.21.15.64:0/1713927788 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f5d540636c0 con 0x7f5d6406d330 2024-09-21T07:22:55.722 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:22:55.722 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 msgr2=0x7f5d44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 0x7f5d44075710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d500af000 tx=0x7f5d5001b100 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 msgr2=0x7f5d64154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400d750 tx=0x7f5d5400dc10 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 shutdown_connections 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073200 0x7f5d44075710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d64074620 0x7f5d640b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d64073cd0 0x7f5d640b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 --2- 172.21.15.64:0/1713927788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d6406d330 0x7f5d64154520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 >> 172.21.15.64:0/1713927788 conn(0x7f5d640b2b50 msgr2=0x7f5d641562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:55.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 shutdown_connections 2024-09-21T07:22:55.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:55.721+0000 7f5d63e00640 1 -- 172.21.15.64:0/1713927788 wait complete. 2024-09-21T07:22:56.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:22:48.142974+0000', 'modified': '2024-09-21T07:22:53.193515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/310445642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 310445642}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 310445642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4365, 'qdb_cluster': [4365]} 2024-09-21T07:22:56.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:22:56.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:22:56.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 -- 172.21.15.64:0/3865428458 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800b59e0 msgr2=0x7f28800cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 --2- 172.21.15.64:0/3865428458 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800b59e0 0x7f28800cf190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f286c009840 tx=0x7f286c01c790 comp rx=0 tx=0).stop 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 -- 172.21.15.64:0/3865428458 shutdown_connections 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 --2- 172.21.15.64:0/3865428458 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800b59e0 0x7f28800cf190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 --2- 172.21.15.64:0/3865428458 >> v2:172.21.15.90:3300/0 conn(0x7f288006ff90 0x7f2880073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 -- 172.21.15.64:0/3865428458 >> 172.21.15.64:0/3865428458 conn(0x7f28800cdd10 msgr2=0x7f28800ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 -- 172.21.15.64:0/3865428458 shutdown_connections 2024-09-21T07:22:56.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.309+0000 7f2887e00640 1 -- 172.21.15.64:0/3865428458 wait complete. 2024-09-21T07:22:56.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 Processor -- start 2024-09-21T07:22:56.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 -- start start 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 0x7f28801576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 0x7f2880159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28800b5430 con 0x7f28800b59e0 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2880169610 con 0x7f288006ff90 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2887e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f288015a680 con 0x7f28800cf6d0 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48436/0 (socket says 172.21.15.64:48436) 2024-09-21T07:22:56.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.313+0000 7f2884a00640 1 -- 172.21.15.64:0/2495643366 learned_addr learned my addr 172.21.15.64:0/2495643366 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2885e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 0x7f2880159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2885400640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 0x7f28801576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 -- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 msgr2=0x7f2880159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 0x7f2880159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 -- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 msgr2=0x7f28801576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 0x7f28801576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 -- 172.21.15.64:0/2495643366 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2880167390 con 0x7f28800b59e0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2885400640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 0x7f28801576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2885e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 0x7f2880159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2884a00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f286c01cc70 tx=0x7f286c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f287d600640 1 -- 172.21.15.64:0/2495643366 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0b2040 con 0x7f28800b59e0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f287d600640 1 -- 172.21.15.64:0/2495643366 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f286c0bc070 con 0x7f28800b59e0 2024-09-21T07:22:56.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f287d600640 1 -- 172.21.15.64:0/2495643366 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c004330 con 0x7f28800b59e0 2024-09-21T07:22:56.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288015d8a0 con 0x7f28800b59e0 2024-09-21T07:22:56.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f288015de60 con 0x7f28800b59e0 2024-09-21T07:22:56.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.317+0000 7f287d600640 1 -- 172.21.15.64:0/2495643366 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f286c003600 con 0x7f28800b59e0 2024-09-21T07:22:56.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f287d600640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 0x7f2860075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f287d600640 1 -- 172.21.15.64:0/2495643366 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f286c12e8d0 con 0x7f28800b59e0 2024-09-21T07:22:56.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 Processor -- start 2024-09-21T07:22:56.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2885400640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 0x7f2860075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 -- start start 2024-09-21T07:22:56.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2885400640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 0x7f2860075740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2874005fd0 tx=0x7f2874005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5b8f9460 0x557c5be3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bcd2ca0 0x557c5be3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557c5bd0f410 con 0x557c5bce9950 2024-09-21T07:22:56.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557c5bc4cb40 con 0x557c5b8f9460 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557c5bc3bf70 con 0x557c5bcd2ca0 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48444/0 (socket says 172.21.15.64:48444) 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 -- 172.21.15.64:0/3358680991 learned_addr learned my addr 172.21.15.64:0/3358680991 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2885400640 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5b8f9460 0x557c5be3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2885e00640 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bcd2ca0 0x557c5be3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 -- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bcd2ca0 msgr2=0x557c5be3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bcd2ca0 0x557c5be3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 -- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5b8f9460 msgr2=0x557c5be3a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5b8f9460 0x557c5be3a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 -- 172.21.15.64:0/3358680991 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5bc035b0 con 0x557c5bce9950 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2884a00640 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b0040 tx=0x7f286c0f8d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50030e31b126c77a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2871c00640 1 -- 172.21.15.64:0/3358680991 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0f9510 con 0x557c5bce9950 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2871c00640 1 -- 172.21.15.64:0/3358680991 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f286c0f8e10 con 0x557c5bce9950 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.321+0000 7f2871c00640 1 -- 172.21.15.64:0/3358680991 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0fd8f0 con 0x557c5bce9950 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- 172.21.15.64:0/3358680991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 msgr2=0x557c5be3abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b0040 tx=0x7f286c0f8d10 comp rx=0 tx=0).stop 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- 172.21.15.64:0/3358680991 shutdown_connections 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bcd2ca0 0x557c5be3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5be3abe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- 172.21.15.64:0/3358680991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5b8f9460 0x557c5be3a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- 172.21.15.64:0/3358680991 >> 172.21.15.64:0/3358680991 conn(0x557c5bdbfd90 msgr2=0x557c5bdef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- 172.21.15.64:0/3358680991 shutdown_connections 2024-09-21T07:22:56.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- 172.21.15.64:0/3358680991 wait complete. 2024-09-21T07:22:56.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- start start 2024-09-21T07:22:56.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 Processor -- start 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5be41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 0x557c5be423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557c5bbd65f0 con 0x557c5b8f9460 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557c5bc3fd80 con 0x557c5bcd2ca0 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557c5bbe2520 con 0x557c5bce9950 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f288f4e4000 10 client.0 _ll_register_callbacks cb 0x557c5bbe6830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48456/0 (socket says 172.21.15.64:48456) 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 -- 172.21.15.64:0/2813302192 learned_addr learned my addr 172.21.15.64:0/2813302192 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2884a00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5be41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885e00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 0x557c5be423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 -- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 msgr2=0x557c5be423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 0x557c5be423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 -- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 msgr2=0x557c5be41e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5be41e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885400640 1 -- 172.21.15.64:0/2813302192 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5bbda190 con 0x557c5b8f9460 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2885e00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 0x557c5be423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.325+0000 7f2884a00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5be41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2885400640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2874010fb0 tx=0x7f28740046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6de0ee51dd2d9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874009750 con 0x557c5b8f9460 2024-09-21T07:22:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c5bbd4110 con 0x557c5b8f9460 2024-09-21T07:22:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2874004220 con 0x557c5b8f9460 2024-09-21T07:22:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f287402f050 con 0x557c5b8f9460 2024-09-21T07:22:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 10 client.4485 fetch_fsmap learned FSMap version 7 2024-09-21T07:22:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x557c5bcc0f10 con 0x557c5b8f9460 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557c5bbd4110 con 0x557c5b8f9460 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f2874032020 con 0x557c5b8f9460 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 10 client.4485 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 10 client.4485 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 20 client.4485 populate_metadata read hostname 'smithi064' 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8de7d0 0x557c5be4bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 4 client.4485 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 --> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5bc4ea90 con 0x557c5b8de7d0 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2884a00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8de7d0 0x557c5be4bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2884a00640 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8de7d0 0x557c5be4bd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93673eb3f0f09ec6 server_cookie=ce4201b765fa953 in_seq=0 out_seq=0 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 10 client.4485 ms_handle_connect on v2:172.21.15.64:6834/310445642 2024-09-21T07:22:56.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 1 -- 172.21.15.64:0/2813302192 <== mds.0 v2:172.21.15.64:6834/310445642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c5bc4ea90 con 0x557c5b8de7d0 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 10 client.4485 handle_command_reply: tid=0 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 client.4485 shutdown 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 msgr2=0x557c5be41920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2874010fb0 tx=0x7f28740046d0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 shutdown_connections 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8de7d0 0x557c5be4bd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5bce9950 0x557c5be423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5be41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2813302192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5b8f9460 0x557c5be41920 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f2866000640 0 client.4485 ms_handle_reset on v2:172.21.15.64:6834/310445642 2024-09-21T07:22:56.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 >> 172.21.15.64:0/2813302192 conn(0x557c5bdbfd90 msgr2=0x557c5bdf6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 shutdown_connections 2024-09-21T07:22:56.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 1 -- 172.21.15.64:0/2813302192 wait complete. 2024-09-21T07:22:56.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.329+0000 7f288f4e4000 20 client.4485 trim_cache size 0 max 16384 2024-09-21T07:22:56.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.349+0000 7f288f4e4000 1 Processor -- start 2024-09-21T07:22:56.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.349+0000 7f288f4e4000 1 -- start start 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5bdeecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5bdef210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2880206d00 con 0x557c5bce9950 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2880205d70 con 0x557c5bcd2ca0 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f28801657c0 con 0x557c5b8f9460 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48466/0 (socket says 172.21.15.64:48466) 2024-09-21T07:22:56.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 -- 172.21.15.64:0/2519665449 learned_addr learned my addr 172.21.15.64:0/2519665449 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2884a00640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5bdef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885400640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5bdeecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 -- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 msgr2=0x557c5bdeecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5bdeecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 -- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 msgr2=0x557c5bdef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5bdef210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 -- 172.21.15.64:0/2519665449 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5bc97db0 con 0x557c5bce9950 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885400640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5bdeecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2884a00640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5bdef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2885e00640 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2878001e70 tx=0x7f2878001f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a089bb06e4318b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2871200640 1 -- 172.21.15.64:0/2519665449 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878019020 con 0x557c5bce9950 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2871200640 1 -- 172.21.15.64:0/2519665449 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2878010a50 con 0x557c5bce9950 2024-09-21T07:22:56.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f2871200640 1 -- 172.21.15.64:0/2519665449 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878010e80 con 0x557c5bce9950 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- 172.21.15.64:0/2519665449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 msgr2=0x557c5bdef750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2878001e70 tx=0x7f2878001f60 comp rx=0 tx=0).stop 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- 172.21.15.64:0/2519665449 shutdown_connections 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bce9950 0x557c5bdef750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bcd2ca0 0x557c5bdef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 --2- 172.21.15.64:0/2519665449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5bdeecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- 172.21.15.64:0/2519665449 >> 172.21.15.64:0/2519665449 conn(0x557c5bdbfd90 msgr2=0x557c5be38620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- 172.21.15.64:0/2519665449 shutdown_connections 2024-09-21T07:22:56.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- 172.21.15.64:0/2519665449 wait complete. 2024-09-21T07:22:56.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 -- start start 2024-09-21T07:22:56.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.353+0000 7f288f4e4000 1 Processor -- start 2024-09-21T07:22:56.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5beb0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bce9950 0x557c5beb0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557c5bc07ee0 con 0x557c5bcd2ca0 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557c5bc443b0 con 0x557c5bce9950 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557c5bc3f090 con 0x557c5b8f9460 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 10 client.0 _ll_register_callbacks cb 0x7f2874016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48470/0 (socket says 172.21.15.64:48470) 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 -- 172.21.15.64:0/222650074 learned_addr learned my addr 172.21.15.64:0/222650074 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2885400640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5beb0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2885e00640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bce9950 0x557c5beb0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 -- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 msgr2=0x557c5beb0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5beb0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 -- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bce9950 msgr2=0x557c5beb0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bce9950 0x557c5beb0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 -- 172.21.15.64:0/222650074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5bc02ab0 con 0x557c5bcd2ca0 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2884a00640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f286c009790 tx=0x7f286c12c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4db4de6a044d28b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:22:56.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c102830 con 0x557c5bcd2ca0 2024-09-21T07:22:56.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f286c1023a0 con 0x557c5bcd2ca0 2024-09-21T07:22:56.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2878010a50 con 0x557c5bcd2ca0 2024-09-21T07:22:56.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f286c0fd8f0 con 0x557c5bcd2ca0 2024-09-21T07:22:56.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 10 client.4491 fetch_fsmap learned FSMap version 7 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x557c5bbe1070 con 0x557c5bcd2ca0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2878010a50 con 0x557c5bcd2ca0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f286c0b5070 con 0x557c5bcd2ca0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 10 client.4491 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 10 client.4491 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 20 client.4491 populate_metadata read hostname 'smithi064' 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8cc830 0x557c5be6c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 4 client.4491 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 --> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] -- command(tid 0: {"prefix": "status"}) -- 0x557c5bc4a540 con 0x557c5b8cc830 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2885400640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8cc830 0x557c5be6c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2866000640 10 client.4491 ms_handle_connect on v2:172.21.15.64:6834/310445642 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.357+0000 7f2885400640 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8cc830 0x557c5be6c640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96cf696dbaea2a09 server_cookie=f0b39f57fe79e079 in_seq=0 out_seq=0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2866000640 1 -- 172.21.15.64:0/222650074 <== mds.0 v2:172.21.15.64:6834/310445642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557c5bc4a540 con 0x557c5b8cc830 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2866000640 10 client.4491 handle_command_reply: tid=0 2024-09-21T07:22:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 client.4491 shutdown 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 msgr2=0x557c5beb08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f286c009790 tx=0x7f286c12c8f0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 shutdown_connections 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x557c5b8cc830 0x557c5be6c640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c5bce9950 0x557c5beb0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c5bcd2ca0 0x557c5beb08d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 --2- 172.21.15.64:0/222650074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557c5b8f9460 0x557c5beb0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2866000640 0 client.4491 ms_handle_reset on v2:172.21.15.64:6834/310445642 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 >> 172.21.15.64:0/222650074 conn(0x557c5bdbfd90 msgr2=0x557c5be4b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 shutdown_connections 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 1 -- 172.21.15.64:0/222650074 wait complete. 2024-09-21T07:22:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f288f4e4000 20 client.4491 trim_cache size 0 max 16384 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4365, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 7.6573167360000003, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 7, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 26, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 26, 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 13.695556013999999 2024-09-21T07:22:56.368 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:22:56.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 msgr2=0x7f2860075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 0x7f2860075740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2874005fd0 tx=0x7f2874005f40 comp rx=0 tx=0).stop 2024-09-21T07:22:56.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 msgr2=0x7f28801595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f286c01cc70 tx=0x7f286c005760 comp rx=0 tx=0).stop 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 shutdown_connections 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2860073230 0x7f2860075740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28800cf6d0 0x7f2880159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28800b59e0 0x7f28801595e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 --2- 172.21.15.64:0/2495643366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f288006ff90 0x7f28801576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 >> 172.21.15.64:0/2495643366 conn(0x7f28800cdd10 msgr2=0x7f28800b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 shutdown_connections 2024-09-21T07:22:56.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.361+0000 7f2887e00640 1 -- 172.21.15.64:0/2495643366 wait complete. 2024-09-21T07:22:56.384 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:22:56.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:56.384 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:22:56.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 -- 172.21.15.64:0/843073244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c06d730 msgr2=0x7f864c0c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 --2- 172.21.15.64:0/843073244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c06d730 0x7f864c0c4af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8638009900 tx=0x7f863801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 -- 172.21.15.64:0/843073244 shutdown_connections 2024-09-21T07:22:56.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 --2- 172.21.15.64:0/843073244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 --2- 172.21.15.64:0/843073244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c06d730 0x7f864c0c4af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 -- 172.21.15.64:0/843073244 >> 172.21.15.64:0/843073244 conn(0x7f864c0d0de0 msgr2=0x7f864c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 -- 172.21.15.64:0/843073244 shutdown_connections 2024-09-21T07:22:56.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.537+0000 7f8650e00640 1 -- 172.21.15.64:0/843073244 wait complete. 2024-09-21T07:22:56.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 Processor -- start 2024-09-21T07:22:56.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- start start 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f864c0ca390 0x7f864c1f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f864c16a090 con 0x7f864c0cf8b0 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f864c169f10 con 0x7f864c0ca390 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f864c16a210 con 0x7f864c0c5030 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48482/0 (socket says 172.21.15.64:48482) 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 -- 172.21.15.64:0/1263058306 learned_addr learned my addr 172.21.15.64:0/1263058306 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:22:56.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f864a800640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f864c0ca390 0x7f864c1f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 -- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 msgr2=0x7f864c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 -- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f864c0ca390 msgr2=0x7f864c1f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f864c0ca390 0x7f864c1f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 -- 172.21.15.64:0/1263058306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c0b5a90 con 0x7f864c0cf8b0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8649400640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86380b0040 tx=0x7f86380a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380ba070 con 0x7f864c0cf8b0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86380043b0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380b2040 con 0x7f864c0cf8b0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c1fb170 con 0x7f864c0cf8b0 2024-09-21T07:22:56.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.541+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c1fabb0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c1fa640 con 0x7f864c0cf8b0 2024-09-21T07:22:56.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8638005280 con 0x7f864c0cf8b0 2024-09-21T07:22:56.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8642000640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 0x7f862c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:56.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f863812dfe0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8649e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 0x7f862c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:56.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.545+0000 7f8649e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 0x7f862c075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f863c0016b0 tx=0x7f863c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:56.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.549+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f86380164d0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f864c0c4af0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8642000640 1 -- 172.21.15.64:0/1263058306 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f86380f8ce0 con 0x7f864c0cf8b0 2024-09-21T07:22:56.769 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:22:56.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 msgr2=0x7f862c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 0x7f862c075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f863c0016b0 tx=0x7f863c009040 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 msgr2=0x7f864c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86380b0040 tx=0x7f86380a5620 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 shutdown_connections 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f862c073230 0x7f862c075740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f864c0ca390 0x7f864c1f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f864c0cf8b0 0x7f864c15e7f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 --2- 172.21.15.64:0/1263058306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f864c0c5030 0x7f864c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 >> 172.21.15.64:0/1263058306 conn(0x7f864c0d0de0 msgr2=0x7f864c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.765+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 shutdown_connections 2024-09-21T07:22:56.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56.769+0000 7f8650e00640 1 -- 172.21.15.64:0/1263058306 wait complete. 2024-09-21T07:22:56.792 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:22:56.792 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:22:56.793 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:22:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:56.794 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:22:56.802 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:22:56.802 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:22:56.803 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:22:56.804 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:22:56.805 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:22:56.805 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:22:56.805 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:22:56.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:22:56.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2024-09-21T07:22:56.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2024-09-21T07:22:56.806 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:22:56.806 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:22:56.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:22:56.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:56.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:56.962 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:22:56.981 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:22:56.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:56.983 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:22:57.062 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:22:57.062 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:22:57.062 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:22:57.062 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:22:57.062 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:22:57.063 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:22:57.065 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:22:57.066 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:22:57.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:22:57.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:22:57.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:22:57.066 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:22:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:22:57.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:57.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:57.198 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:22:57.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:57.208 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-09-21T07:22:57.264 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:22:57.264 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:22:57.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:57.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T07:22:57.264 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:22:57.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:22:57.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:57.392 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T07:22:57.392 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:22:57.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:22:57.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:57.596 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:22:57.596 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:22:57.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:22:57.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:22:57.596 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:22:57.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:22:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:57.881 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T07:22:57.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:22:57.881 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:57.892 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:22:57.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:22:57.892 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:57.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2024-09-21T07:22:58.010 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2024-09-21T07:22:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/run/lock 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/bpf 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/fs/nfsd 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysusers.service 2024-09-21T07:22:58.067 INFO:teuthology.orchestra.run.smithi064.stdout:/run/rpc_pipefs 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:58.068 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:58.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:58.069 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2024-09-21T07:22:58.119 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T07:22:58.119 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T07:22:58.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2024-09-21T07:22:58.190 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:22:58.245 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2024-09-21T07:22:58.245 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/run/lock 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/bpf 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2024-09-21T07:22:58.246 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/fs/nfsd 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysusers.service 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/run/rpc_pipefs 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2024-09-21T07:22:58.247 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:58.248 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:58.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:58.248 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2024-09-21T07:22:58.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:2024-09-21T07:22:58.277+0000 7f609e3a0580 -1 init, newargv = 0x564ea28819f0 newargc=15 2024-09-21T07:22:58.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[34700]: starting ceph client 2024-09-21T07:22:58.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[34700]: starting fuse 2024-09-21T07:22:59.391 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2024-09-21T07:22:59.415 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:22:59.469 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/run/lock 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/bpf 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2024-09-21T07:22:59.470 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/fs/nfsd 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysusers.service 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run/rpc_pipefs 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2024-09-21T07:22:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:59.472 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:22:59.472 INFO:teuthology.orchestra.run.smithi064.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:59.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:59.472 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2024-09-21T07:22:59.524 INFO:teuthology.orchestra.run.smithi064.stdout:44 2024-09-21T07:22:59.524 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> sudo stdin-killer -- python3 -c ' 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> import glob 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> import re 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> import subprocess 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:22:59.524 DEBUG:teuthology.orchestra.run.smithi064:> def _find_admin_socket(client_name): 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> files = glob.glob(asok_path) 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> # Given a non-glob path, it better be there 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> if "*" not in asok_path: 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> assert(len(files) == 1) 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> return files[0] 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> for f in files: 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> contents = proc_f.read() 2024-09-21T07:22:59.525 DEBUG:teuthology.orchestra.run.smithi064:> if mountpoint in contents: 2024-09-21T07:22:59.526 DEBUG:teuthology.orchestra.run.smithi064:> return f 2024-09-21T07:22:59.526 DEBUG:teuthology.orchestra.run.smithi064:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T07:22:59.526 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:22:59.526 DEBUG:teuthology.orchestra.run.smithi064:> print(_find_admin_socket("client.admin")) 2024-09-21T07:22:59.526 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:22:59.662 INFO:teuthology.orchestra.run.smithi064.stdout:/var/run/ceph/ceph-client.admin.34700.asok 2024-09-21T07:22:59.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:22:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:22:59.674 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34700.asok 2024-09-21T07:22:59.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:59.674 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34700.asok status 2024-09-21T07:22:59.862 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:22:59.862 INFO:teuthology.orchestra.run.smithi064.stdout: "metadata": { 2024-09-21T07:22:59.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T07:22:59.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "entity_id": "admin", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "hostname": "smithi064", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "pid": "34700", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "root": "/" 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_count": 0, 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_pinned_count": 0, 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4503, 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "inst": { 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "name": { 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "client", 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "num": 4503 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:22:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 2190248251 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 2190248251 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "inst_str": "client.4503 192.168.0.1:0/2190248251", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "addr_str": "192.168.0.1:0/2190248251", 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "inode_count": 1, 2024-09-21T07:22:59.864 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_epoch": 7, 2024-09-21T07:22:59.865 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch": 26, 2024-09-21T07:22:59.865 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch_barrier": 0, 2024-09-21T07:22:59.865 INFO:teuthology.orchestra.run.smithi064.stdout: "blocklisted": false, 2024-09-21T07:22:59.865 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs" 2024-09-21T07:22:59.865 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:22:59.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:59.877 DEBUG:teuthology.orchestra.run.smithi064:> stat --file-system '--printf=%T 2024-09-21T07:22:59.878 DEBUG:teuthology.orchestra.run.smithi064:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:59.887 INFO:teuthology.orchestra.run.smithi064.stdout:fuseblk 2024-09-21T07:22:59.887 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:59.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:22:59.887 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:22:59.952 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T07:23:00.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:00.079 INFO:teuthology.orchestra.run.smithi064.stdout:# file: . 2024-09-21T07:23:00.079 INFO:teuthology.orchestra.run.smithi064.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T07:23:00.079 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:00.085 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:00.086 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:00.094 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 -- 172.21.15.64:0/2437085423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 msgr2=0x7fa8d80b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 --2- 172.21.15.64:0/2437085423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d80b33d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80ca850 tx=0x7fa8cc01c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 -- 172.21.15.64:0/2437085423 shutdown_connections 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 --2- 172.21.15.64:0/2437085423 >> v2:172.21.15.90:3300/0 conn(0x7fa8d80ce730 0x7fa8d80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 --2- 172.21.15.64:0/2437085423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80b3910 0x7fa8d80ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 --2- 172.21.15.64:0/2437085423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d80b33d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 -- 172.21.15.64:0/2437085423 >> 172.21.15.64:0/2437085423 conn(0x7fa8d806d450 msgr2=0x7fa8d80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 -- 172.21.15.64:0/2437085423 shutdown_connections 2024-09-21T07:23:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.293+0000 7fa8df600640 1 -- 172.21.15.64:0/2437085423 wait complete. 2024-09-21T07:23:00.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 Processor -- start 2024-09-21T07:23:00.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- start start 2024-09-21T07:23:00.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d80b3910 0x7fa8d815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 0x7fa8d815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d806fa10 con 0x7fa8d809df30 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d806f890 con 0x7fa8d80b3910 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d806fb90 con 0x7fa8d80ce730 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48510/0 (socket says 172.21.15.64:48510) 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 -- 172.21.15.64:0/4141752955 learned_addr learned my addr 172.21.15.64:0/4141752955 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8d7e00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d80b3910 0x7fa8d815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dd600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 0x7fa8d815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 -- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 msgr2=0x7fa8d815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 0x7fa8d815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 -- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d80b3910 msgr2=0x7fa8d815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d80b3910 0x7fa8d815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 -- 172.21.15.64:0/4141752955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d809a9f0 con 0x7fa8d809df30 2024-09-21T07:23:00.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dd600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 0x7fa8d815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8dcc00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc000c10 tx=0x7fa8cc005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0ba020 con 0x7fa8d809df30 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8cc004330 con 0x7fa8d809df30 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d80b2270 con 0x7fa8d809df30 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0b2040 con 0x7fa8d809df30 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.297+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d809d520 con 0x7fa8d809df30 2024-09-21T07:23:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d809abc0 con 0x7fa8d809df30 2024-09-21T07:23:00.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa8cc0bd070 con 0x7fa8d809df30 2024-09-21T07:23:00.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8d4c00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 0x7fa8b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa8cc12e0d0 con 0x7fa8d809df30 2024-09-21T07:23:00.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8d7e00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 0x7fa8b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.301+0000 7fa8d7e00640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 0x7fa8b8075740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815d230 tx=0x7fa8c400b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:00.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.305+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa8cc016490 con 0x7fa8d809df30 2024-09-21T07:23:00.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.493+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8d80ce1f0 con 0x7fa8d809df30 2024-09-21T07:23:00.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.493+0000 7fa8d4c00640 1 -- 172.21.15.64:0/4141752955 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fa8cc0f8860 con 0x7fa8d809df30 2024-09-21T07:23:00.499 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 msgr2=0x7fa8b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 0x7fa8b8075740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815d230 tx=0x7fa8c400b260 comp rx=0 tx=0).stop 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 msgr2=0x7fa8d81f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc000c10 tx=0x7fa8cc005d00 comp rx=0 tx=0).stop 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 shutdown_connections 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b8073230 0x7fa8b8075740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d80ce730 0x7fa8d815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d80b3910 0x7fa8d815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 --2- 172.21.15.64:0/4141752955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d809df30 0x7fa8d81f8100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 >> 172.21.15.64:0/4141752955 conn(0x7fa8d806d450 msgr2=0x7fa8d80cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 shutdown_connections 2024-09-21T07:23:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.497+0000 7fa8df600640 1 -- 172.21.15.64:0/4141752955 wait complete. 2024-09-21T07:23:00.520 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:00.521 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:00.529 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 -- 172.21.15.64:0/2543491843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80b3910 msgr2=0x7f15d80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 --2- 172.21.15.64:0/2543491843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80b3910 0x7f15d80ce1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009840 tx=0x7f15c401c820 comp rx=0 tx=0).stop 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 -- 172.21.15.64:0/2543491843 shutdown_connections 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 --2- 172.21.15.64:0/2543491843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80b3910 0x7f15d80ce1f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 --2- 172.21.15.64:0/2543491843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 0x7f15d80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 -- 172.21.15.64:0/2543491843 >> 172.21.15.64:0/2543491843 conn(0x7f15d806d450 msgr2=0x7f15d80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 -- 172.21.15.64:0/2543491843 shutdown_connections 2024-09-21T07:23:00.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.729+0000 7f15e0200640 1 -- 172.21.15.64:0/2543491843 wait complete. 2024-09-21T07:23:00.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 Processor -- start 2024-09-21T07:23:00.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- start start 2024-09-21T07:23:00.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 0x7f15d8074580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80ce730 0x7f15d80cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8169160 con 0x7f15d80b3910 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8168fe0 con 0x7f15d80ce730 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f15d81692e0 con 0x7f15d809df30 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48524/0 (socket says 172.21.15.64:48524) 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 -- 172.21.15.64:0/1090991667 learned_addr learned my addr 172.21.15.64:0/1090991667 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15de200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80ce730 0x7f15d80cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dd800640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 0x7f15d8074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 -- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 msgr2=0x7f15d8074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 0x7f15d8074580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 -- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80ce730 msgr2=0x7f15d80cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80ce730 0x7f15d80cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 -- 172.21.15.64:0/1090991667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d81fa190 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15dce00640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009790 tx=0x7f15c40a6570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40be070 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d81fa450 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c4004330 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40052d0 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.733+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d81faa10 con 0x7f15d80b3910 2024-09-21T07:23:00.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.737+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d80b33d0 con 0x7f15d80b3910 2024-09-21T07:23:00.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.737+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f15c4005470 con 0x7f15d80b3910 2024-09-21T07:23:00.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.737+0000 7f15d5600640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 0x7f15b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:00.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.737+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f15c412ea80 con 0x7f15d80b3910 2024-09-21T07:23:00.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.737+0000 7f15dd800640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 0x7f15b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:00.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.741+0000 7f15dd800640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 0x7f15b8075740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009660 tx=0x7f15cc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:00.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.741+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f15c4130e20 con 0x7f15d80b3910 2024-09-21T07:23:00.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.937+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15d80c6fa0 con 0x7f15d80b3910 2024-09-21T07:23:00.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.937+0000 7f15d5600640 1 -- 172.21.15.64:0/1090991667 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f15c4016410 con 0x7f15d80b3910 2024-09-21T07:23:00.942 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 msgr2=0x7f15b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 0x7f15b8075740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009660 tx=0x7f15cc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 msgr2=0x7f15d81498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009790 tx=0x7f15c40a6570 comp rx=0 tx=0).stop 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 shutdown_connections 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15b8073230 0x7f15b8075740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d80ce730 0x7f15d80cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d80b3910 0x7f15d81498f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 --2- 172.21.15.64:0/1090991667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d809df30 0x7f15d8074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:00.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 >> 172.21.15.64:0/1090991667 conn(0x7f15d806d450 msgr2=0x7f15d80cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:00.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 shutdown_connections 2024-09-21T07:23:00.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:00.941+0000 7f15e0200640 1 -- 172.21.15.64:0/1090991667 wait complete. 2024-09-21T07:23:00.964 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi064.front.sepia.ceph.com... 2024-09-21T07:23:00.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:00.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:23:00.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[34700]: fuse finished with error 0 and tester_r 0 2024-09-21T07:23:00.995 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:01.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:23:01.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:01.049 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T07:23:01.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:01.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 -- 172.21.15.64:0/4201709422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c003c90 msgr2=0x7ff58c0040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 --2- 172.21.15.64:0/4201709422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c003c90 0x7ff58c0040e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff598001830 tx=0x7ff5a80b4580 comp rx=0 tx=0).stop 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5a7400640 1 -- 172.21.15.64:0/4201709422 reap_dead start 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 -- 172.21.15.64:0/4201709422 shutdown_connections 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 -- 172.21.15.64:0/4201709422 >> 172.21.15.64:0/4201709422 conn(0x7ff5a80ccbe0 msgr2=0x7ff5a80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 -- 172.21.15.64:0/4201709422 shutdown_connections 2024-09-21T07:23:01.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.257+0000 7ff5ad800640 1 -- 172.21.15.64:0/4201709422 wait complete. 2024-09-21T07:23:01.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 Processor -- start 2024-09-21T07:23:01.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- start start 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c003c90 0x7ff5a814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a81fc040 0x7ff5a81fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8166b40 con 0x7ff5a8164b70 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a80b2270 con 0x7ff58c003c90 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a8166cc0 con 0x7ff5a81fc040 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48536/0 (socket says 172.21.15.64:48536) 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 -- 172.21.15.64:0/2772357532 learned_addr learned my addr 172.21.15.64:0/2772357532 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a6a00640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c003c90 0x7ff5a814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff59fe00640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a81fc040 0x7ff5a81fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 -- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a81fc040 msgr2=0x7ff5a81fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a81fc040 0x7ff5a81fc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 -- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c003c90 msgr2=0x7ff5a814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c003c90 0x7ff5a814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 -- 172.21.15.64:0/2772357532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a81654c0 con 0x7ff5a8164b70 2024-09-21T07:23:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5a7400640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80cc6f0 tx=0x7ff5a0006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000fa00 con 0x7ff5a8164b70 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5a0018070 con 0x7ff5a8164b70 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000fe60 con 0x7ff5a8164b70 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a81fcde0 con 0x7ff5a8164b70 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.261+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a814c2f0 con 0x7ff5a8164b70 2024-09-21T07:23:01.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a81fcb50 con 0x7ff5a8164b70 2024-09-21T07:23:01.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff5a001d460 con 0x7ff5a8164b70 2024-09-21T07:23:01.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff59ea00640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 0x7ff584075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff5a00957d0 con 0x7ff5a8164b70 2024-09-21T07:23:01.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff5a6a00640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 0x7ff584075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.265+0000 7ff5a6a00640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 0x7ff584075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0057f0 tx=0x7ff5980196e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:01.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.269+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff5a81654c0 con 0x7ff5a8164b70 2024-09-21T07:23:01.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.445+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5a80ca7b0 con 0x7ff5a8164b70 2024-09-21T07:23:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.445+0000 7ff59ea00640 1 -- 172.21.15.64:0/2772357532 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7ff5a0060490 con 0x7ff5a8164b70 2024-09-21T07:23:01.451 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:01.451 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 msgr2=0x7ff584075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 0x7ff584075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0057f0 tx=0x7ff5980196e0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 msgr2=0x7ff5a8164f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80cc6f0 tx=0x7ff5a0006660 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 shutdown_connections 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff584073200 0x7ff584075710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8164b70 0x7ff5a8164f80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a81fc040 0x7ff5a81fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 --2- 172.21.15.64:0/2772357532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c003c90 0x7ff5a814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 >> 172.21.15.64:0/2772357532 conn(0x7ff5a80ccbe0 msgr2=0x7ff5a8073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:01.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 shutdown_connections 2024-09-21T07:23:01.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.449+0000 7ff5ad800640 1 -- 172.21.15.64:0/2772357532 wait complete. 2024-09-21T07:23:01.473 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.625+0000 7f10d3c00640 1 -- 172.21.15.64:0/1870135570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b7a60 msgr2=0x7f10cc0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.625+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1870135570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b7a60 0x7f10cc0cd1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009870 tx=0x7f10bc01c860 comp rx=0 tx=0).stop 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- 172.21.15.64:0/1870135570 shutdown_connections 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1870135570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b7a60 0x7f10cc0cd1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- 172.21.15.64:0/1870135570 >> 172.21.15.64:0/1870135570 conn(0x7f10cc06d480 msgr2=0x7f10cc0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- 172.21.15.64:0/1870135570 shutdown_connections 2024-09-21T07:23:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- 172.21.15.64:0/1870135570 wait complete. 2024-09-21T07:23:01.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 Processor -- start 2024-09-21T07:23:01.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- start start 2024-09-21T07:23:01.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b3ce0 0x7f10cc165720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 0x7f10cc151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc16b140 con 0x7f10cc0d0080 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc16afc0 con 0x7f10cc0b7a60 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.629+0000 7f10d3c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc16b2c0 con 0x7f10cc0b3ce0 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48550/0 (socket says 172.21.15.64:48550) 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 -- 172.21.15.64:0/1398927003 learned_addr learned my addr 172.21.15.64:0/1398927003 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1200640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b3ce0 0x7f10cc165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c3e00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 0x7f10cc151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 -- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b3ce0 msgr2=0x7f10cc165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b3ce0 0x7f10cc165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 -- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 msgr2=0x7f10cc151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 0x7f10cc151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 -- 172.21.15.64:0/1398927003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc167160 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c3e00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 0x7f10cc151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d1c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c760 tx=0x7f10c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4003b80 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10c4003d20 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc167440 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c400aa50 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1574c0 con 0x7f10cc0d0080 2024-09-21T07:23:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc167960 con 0x7f10cc0d0080 2024-09-21T07:23:01.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.633+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f10c400abf0 con 0x7f10cc0d0080 2024-09-21T07:23:01.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.637+0000 7f10c9600640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 0x7f10a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:01.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.637+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f10c4094310 con 0x7f10cc0d0080 2024-09-21T07:23:01.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.637+0000 7f10d1200640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 0x7f10a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.637+0000 7f10d1200640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 0x7f10a8075710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0af000 tx=0x7f10bc01b0a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:01.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.641+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f10cc167960 con 0x7f10cc0d0080 2024-09-21T07:23:01.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.821+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10cc0cd1c0 con 0x7f10cc0d0080 2024-09-21T07:23:01.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.821+0000 7f10c9600640 1 -- 172.21.15.64:0/1398927003 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f10c405efe0 con 0x7f10cc0d0080 2024-09-21T07:23:01.826 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:01.826 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 msgr2=0x7f10a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 0x7f10a8075710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0af000 tx=0x7f10bc01b0a0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 msgr2=0x7f10cc1f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c760 tx=0x7f10c400cc20 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 shutdown_connections 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10a8073200 0x7f10a8075710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10cc0d0080 0x7f10cc1f9330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10cc0b7a60 0x7f10cc151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 --2- 172.21.15.64:0/1398927003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10cc0b3ce0 0x7f10cc165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 >> 172.21.15.64:0/1398927003 conn(0x7f10cc06d480 msgr2=0x7f10cc068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 shutdown_connections 2024-09-21T07:23:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:01.825+0000 7f10d3c00640 1 -- 172.21.15.64:0/1398927003 wait complete. 2024-09-21T07:23:01.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:23:02.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 -- 172.21.15.64:0/3024649772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe810004810 msgr2=0x7fe810004ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 --2- 172.21.15.64:0/3024649772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe810004810 0x7fe810004ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe814006f50 tx=0x7fe81401ce60 comp rx=0 tx=0).stop 2024-09-21T07:23:02.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 -- 172.21.15.64:0/3024649772 shutdown_connections 2024-09-21T07:23:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 --2- 172.21.15.64:0/3024649772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe810004810 0x7fe810004ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 -- 172.21.15.64:0/3024649772 >> 172.21.15.64:0/3024649772 conn(0x7fe82c09b3b0 msgr2=0x7fe82c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 -- 172.21.15.64:0/3024649772 shutdown_connections 2024-09-21T07:23:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.005+0000 7fe830a00640 1 -- 172.21.15.64:0/3024649772 wait complete. 2024-09-21T07:23:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 Processor -- start 2024-09-21T07:23:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 -- start start 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe810004810 0x7fe82c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe82c0b5460 0x7fe82c1f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0ceec0 con 0x7fe82c1f9510 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0b16f0 con 0x7fe82c0b5460 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe830a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c0cf040 con 0x7fe810004810 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48580/0 (socket says 172.21.15.64:48580) 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 -- 172.21.15.64:0/3171344805 learned_addr learned my addr 172.21.15.64:0/3171344805 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82b400640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe810004810 0x7fe82c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe822a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe82c0b5460 0x7fe82c1f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 -- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe810004810 msgr2=0x7fe82c0b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe810004810 0x7fe82c0b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 -- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe82c0b5460 msgr2=0x7fe82c1f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe82c0b5460 0x7fe82c1f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.009+0000 7fe82be00640 1 -- 172.21.15.64:0/3171344805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c1f9920 con 0x7fe82c1f9510 2024-09-21T07:23:02.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe82be00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0d1bc0 tx=0x7fe82400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824003d90 con 0x7fe82c1f9510 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe824004b30 con 0x7fe82c1f9510 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c0b5b70 con 0x7fe82c1f9510 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824004030 con 0x7fe82c1f9510 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c0b6130 con 0x7fe82c1f9510 2024-09-21T07:23:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c0b58e0 con 0x7fe82c1f9510 2024-09-21T07:23:02.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8240041d0 con 0x7fe82c1f9510 2024-09-21T07:23:02.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 0x7fe808075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:02.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe8240953d0 con 0x7fe82c1f9510 2024-09-21T07:23:02.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.013+0000 7fe82b400640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 0x7fe808075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:02.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.017+0000 7fe82b400640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 0x7fe808075740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c10 tx=0x7fe81c006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:02.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.021+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe82c1f9920 con 0x7fe82c1f9510 2024-09-21T07:23:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.233+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe82c0b1af0 con 0x7fe82c1f9510 2024-09-21T07:23:02.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.793+0000 7fe823e00640 1 -- 172.21.15.64:0/3171344805 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fe8240600a0 con 0x7fe82c1f9510 2024-09-21T07:23:02.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 msgr2=0x7fe808075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 0x7fe808075740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c10 tx=0x7fe81c006b20 comp rx=0 tx=0).stop 2024-09-21T07:23:02.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 msgr2=0x7fe82c0c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0d1bc0 tx=0x7fe82400f790 comp rx=0 tx=0).stop 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 shutdown_connections 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe808073230 0x7fe808075740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe82c1f9510 0x7fe82c0c81f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe82c0b5460 0x7fe82c1f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 --2- 172.21.15.64:0/3171344805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe810004810 0x7fe82c0b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 >> 172.21.15.64:0/3171344805 conn(0x7fe82c09b3b0 msgr2=0x7fe82c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 shutdown_connections 2024-09-21T07:23:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.797+0000 7fe830a00640 1 -- 172.21.15.64:0/3171344805 wait complete. 2024-09-21T07:23:02.822 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-21T07:23:02.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:23:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- 172.21.15.64:0/618726008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c06ef80 msgr2=0x7f6e2c169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 --2- 172.21.15.64:0/618726008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c06ef80 0x7f6e2c169830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009bc0 tx=0x7f6e2401cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- 172.21.15.64:0/618726008 shutdown_connections 2024-09-21T07:23:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 --2- 172.21.15.64:0/618726008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c06ef80 0x7f6e2c169830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- 172.21.15.64:0/618726008 >> 172.21.15.64:0/618726008 conn(0x7f6e2c0d23b0 msgr2=0x7f6e2c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- 172.21.15.64:0/618726008 shutdown_connections 2024-09-21T07:23:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- 172.21.15.64:0/618726008 wait complete. 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 Processor -- start 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- start start 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e2c06ef80 0x7f6e2c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c0b3e30 0x7f6e2c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c16ce90 con 0x7f6e2c0d0240 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c16cd10 con 0x7f6e2c0b3e30 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.989+0000 7f6e32200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2c16d010 con 0x7f6e2c06ef80 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48584/0 (socket says 172.21.15.64:48584) 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 -- 172.21.15.64:0/1867626553 learned_addr learned my addr 172.21.15.64:0/1867626553 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:03.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2b400640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e2c06ef80 0x7f6e2c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e23e00640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c0b3e30 0x7f6e2c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 -- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e2c06ef80 msgr2=0x7f6e2c14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e2c06ef80 0x7f6e2c14f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 -- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c0b3e30 msgr2=0x7f6e2c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c0b3e30 0x7f6e2c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 -- 172.21.15.64:0/1867626553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c157d60 con 0x7f6e2c0d0240 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e2be00640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e240197b0 tx=0x7f6e24003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e240bb070 con 0x7f6e2c0d0240 2024-09-21T07:23:03.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e24004a50 con 0x7f6e2c0d0240 2024-09-21T07:23:03.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c158040 con 0x7f6e2c0d0240 2024-09-21T07:23:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b2040 con 0x7f6e2c0d0240 2024-09-21T07:23:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c0b6920 con 0x7f6e2c0d0240 2024-09-21T07:23:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c157ad0 con 0x7f6e2c0d0240 2024-09-21T07:23:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.993+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6e240be070 con 0x7f6e2c0d0240 2024-09-21T07:23:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.997+0000 7f6e23400640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 0x7f6e08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.997+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6e2412dff0 con 0x7f6e2c0d0240 2024-09-21T07:23:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.997+0000 7f6e2b400640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 0x7f6e08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:02.997+0000 7f6e2b400640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 0x7f6e08075710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007fd0 tx=0x7f6e1c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.001+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6e24016790 con 0x7f6e2c0d0240 2024-09-21T07:23:03.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.213+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6e2c0d0650 con 0x7f6e2c0d0240 2024-09-21T07:23:03.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.801+0000 7f6e23400640 1 -- 172.21.15.64:0/1867626553 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f6e240f8620 con 0x7f6e2c0d0240 2024-09-21T07:23:03.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 msgr2=0x7f6e08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 0x7f6e08075710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007fd0 tx=0x7f6e1c009040 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 msgr2=0x7f6e2c0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e240197b0 tx=0x7f6e24003f60 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 shutdown_connections 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e08073200 0x7f6e08075710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c0d0240 0x7f6e2c0b22a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c0b3e30 0x7f6e2c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 --2- 172.21.15.64:0/1867626553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e2c06ef80 0x7f6e2c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 >> 172.21.15.64:0/1867626553 conn(0x7f6e2c0d23b0 msgr2=0x7f6e2c0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 shutdown_connections 2024-09-21T07:23:03.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.805+0000 7f6e32200640 1 -- 172.21.15.64:0/1867626553 wait complete. 2024-09-21T07:23:03.830 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:23:03.831 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 -- 172.21.15.64:0/3266416511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 msgr2=0x7fe39c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 --2- 172.21.15.64:0/3266416511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c0b41c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe384009900 tx=0x7fe38401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 -- 172.21.15.64:0/3266416511 shutdown_connections 2024-09-21T07:23:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 --2- 172.21.15.64:0/3266416511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c0b41c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 --2- 172.21.15.64:0/3266416511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 0x7fe39c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 -- 172.21.15.64:0/3266416511 >> 172.21.15.64:0/3266416511 conn(0x7fe39c0ccbe0 msgr2=0x7fe39c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 -- 172.21.15.64:0/3266416511 shutdown_connections 2024-09-21T07:23:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.985+0000 7fe3a1200640 1 -- 172.21.15.64:0/3266416511 wait complete. 2024-09-21T07:23:03.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 Processor -- start 2024-09-21T07:23:03.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 -- start start 2024-09-21T07:23:03.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0b4700 0x7fe39c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 0x7fe39c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c1690c0 con 0x7fe39c0709b0 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c168f40 con 0x7fe39c0b4700 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe3a1200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe39c169240 con 0x7fe39c15edb0 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48612/0 (socket says 172.21.15.64:48612) 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 -- 172.21.15.64:0/274118009 learned_addr learned my addr 172.21.15.64:0/274118009 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe391400640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0b4700 0x7fe39c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe39a800640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 0x7fe39c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 -- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 msgr2=0x7fe39c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 0x7fe39c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 -- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0b4700 msgr2=0x7fe39c1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0b4700 0x7fe39c1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:03.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.989+0000 7fe399e00640 1 -- 172.21.15.64:0/274118009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c1660a0 con 0x7fe39c0709b0 2024-09-21T07:23:03.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe399e00640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00ebc0 tx=0x7fe38c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:03.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c010630 con 0x7fe39c0709b0 2024-09-21T07:23:03.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c0108c0 con 0x7fe39c0709b0 2024-09-21T07:23:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39c1648a0 con 0x7fe39c0709b0 2024-09-21T07:23:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c010cf0 con 0x7fe39c0709b0 2024-09-21T07:23:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39c164e60 con 0x7fe39c0709b0 2024-09-21T07:23:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39c0b41c0 con 0x7fe39c0709b0 2024-09-21T07:23:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe38c018420 con 0x7fe39c0709b0 2024-09-21T07:23:03.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.993+0000 7fe392a00640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 0x7fe378075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:03.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.997+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe38c0952f0 con 0x7fe39c0709b0 2024-09-21T07:23:04.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.997+0000 7fe391400640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 0x7fe378075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:03.997+0000 7fe391400640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 0x7fe378075710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3840af000 tx=0x7fe38401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:04.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.001+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe38c05f8e0 con 0x7fe39c0709b0 2024-09-21T07:23:04.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.213+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe39c15e2f0 con 0x7fe39c0709b0 2024-09-21T07:23:04.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.213+0000 7fe392a00640 1 -- 172.21.15.64:0/274118009 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fe38c064310 con 0x7fe39c0709b0 2024-09-21T07:23:04.218 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:04.218 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:04.219 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:04.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.213+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 msgr2=0x7fe378075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.213+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 0x7fe378075710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3840af000 tx=0x7fe38401b120 comp rx=0 tx=0).stop 2024-09-21T07:23:04.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 msgr2=0x7fe39c1f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00ebc0 tx=0x7fe38c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 shutdown_connections 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe378073200 0x7fe378075710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c15edb0 0x7fe39c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0b4700 0x7fe39c1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 --2- 172.21.15.64:0/274118009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe39c0709b0 0x7fe39c1f9cf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 >> 172.21.15.64:0/274118009 conn(0x7fe39c0ccbe0 msgr2=0x7fe39c159580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 shutdown_connections 2024-09-21T07:23:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.217+0000 7fe3a1200640 1 -- 172.21.15.64:0/274118009 wait complete. 2024-09-21T07:23:04.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- 172.21.15.64:0/2159698124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 msgr2=0x7f9c6c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 --2- 172.21.15.64:0/2159698124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c06d200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009840 tx=0x7f9c5c01c820 comp rx=0 tx=0).stop 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- 172.21.15.64:0/2159698124 shutdown_connections 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 --2- 172.21.15.64:0/2159698124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c06d200 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- 172.21.15.64:0/2159698124 >> 172.21.15.64:0/2159698124 conn(0x7f9c6c06e890 msgr2=0x7f9c6c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- 172.21.15.64:0/2159698124 shutdown_connections 2024-09-21T07:23:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- 172.21.15.64:0/2159698124 wait complete. 2024-09-21T07:23:04.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 Processor -- start 2024-09-21T07:23:04.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.393+0000 7f9c72c00640 1 -- start start 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c6c0cf260 0x7f9c6c1f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c1604b0 0x7f9c6c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c16b480 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c16b300 con 0x7f9c6c1604b0 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6c16b600 con 0x7f9c6c0cf260 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48630/0 (socket says 172.21.15.64:48630) 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 -- 172.21.15.64:0/1159193569 learned_addr learned my addr 172.21.15.64:0/1159193569 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c63e00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c6c0cf260 0x7f9c6c1f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c70c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c1604b0 0x7f9c6c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 -- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c6c0cf260 msgr2=0x7f9c6c1f9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c6c0cf260 0x7f9c6c1f9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 -- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c1604b0 msgr2=0x7f9c6c0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c1604b0 0x7f9c6c0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 -- 172.21.15.64:0/1159193569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c152cb0 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c6be00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009790 tx=0x7f9c5c0a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0b2040 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c5c004380 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c1fa4a0 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0052b0 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6c0b5350 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.397+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c06d200 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.401+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9c5c005450 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.401+0000 7f9c68c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 0x7f9c48075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.401+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c5c12e640 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.401+0000 7f9c63e00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 0x7f9c48075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.401+0000 7f9c63e00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 0x7f9c48075740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c54007d70 tx=0x7f9c54007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:04.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.405+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9c5c016410 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.581+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c6c15eb70 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c68c00640 1 -- 172.21.15.64:0/1159193569 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f9c5c118e20 con 0x7f9c6c06cdf0 2024-09-21T07:23:04.589 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:04.589 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 msgr2=0x7f9c48075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 0x7f9c48075740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c54007d70 tx=0x7f9c54007d00 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 msgr2=0x7f9c6c152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009790 tx=0x7f9c5c0a5670 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 shutdown_connections 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c48073230 0x7f9c48075740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c1604b0 0x7f9c6c0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c6c0cf260 0x7f9c6c1f9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 --2- 172.21.15.64:0/1159193569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c6c06cdf0 0x7f9c6c152770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 >> 172.21.15.64:0/1159193569 conn(0x7f9c6c06e890 msgr2=0x7f9c6c153610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:04.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 shutdown_connections 2024-09-21T07:23:04.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.585+0000 7f9c72c00640 1 -- 172.21.15.64:0/1159193569 wait complete. 2024-09-21T07:23:04.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:23:04.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:04.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 -- 172.21.15.64:0/19804312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c15edb0 msgr2=0x7f456c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 --2- 172.21.15.64:0/19804312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c15edb0 0x7f456c0700b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f456c06f220 tx=0x7f455c01c6c0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 -- 172.21.15.64:0/19804312 shutdown_connections 2024-09-21T07:23:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 --2- 172.21.15.64:0/19804312 >> v2:172.21.15.90:3300/0 conn(0x7f456c0709b0 0x7f456c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 --2- 172.21.15.64:0/19804312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c15edb0 0x7f456c0700b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 -- 172.21.15.64:0/19804312 >> 172.21.15.64:0/19804312 conn(0x7f456c0ccbe0 msgr2=0x7f456c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 -- 172.21.15.64:0/19804312 shutdown_connections 2024-09-21T07:23:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.769+0000 7f4572e00640 1 -- 172.21.15.64:0/19804312 wait complete. 2024-09-21T07:23:04.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 Processor -- start 2024-09-21T07:23:04.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 -- start start 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f456c0b4700 0x7f456c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f456c15edb0 0x7f456c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f456c168fb0 con 0x7f456c0709b0 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f456c168e30 con 0x7f456c0b4700 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4572e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f456c169130 con 0x7f456c15edb0 2024-09-21T07:23:04.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f456be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f456be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48650/0 (socket says 172.21.15.64:48650) 2024-09-21T07:23:04.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f456be00640 1 -- 172.21.15.64:0/2277022947 learned_addr learned my addr 172.21.15.64:0/2277022947 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:04.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4563e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f456c0b4700 0x7f456c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.773+0000 7f4570e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f456c15edb0 0x7f456c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 -- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f456c15edb0 msgr2=0x7f456c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f456c15edb0 0x7f456c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 -- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f456c0b4700 msgr2=0x7f456c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f456c0b4700 0x7f456c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 -- 172.21.15.64:0/2277022947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c15d200 con 0x7f456c0709b0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f456be00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f455c01ad70 tx=0x7f455c0a94d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0ad070 con 0x7f456c0709b0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f455c0a9d20 con 0x7f456c0709b0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c15c4f0 con 0x7f456c0709b0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c005290 con 0x7f456c0709b0 2024-09-21T07:23:04.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c15c960 con 0x7f456c0709b0 2024-09-21T07:23:04.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456c0b41c0 con 0x7f456c0709b0 2024-09-21T07:23:04.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f455c0b0070 con 0x7f456c0709b0 2024-09-21T07:23:04.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.777+0000 7f4568c00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 0x7f4548075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:04.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.781+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f455c12ea10 con 0x7f456c0709b0 2024-09-21T07:23:04.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.781+0000 7f4563e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 0x7f4548075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:04.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.781+0000 7f4563e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 0x7f4548075740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f456c0af050 tx=0x7f455400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:04.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.785+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f456c0b4b10 con 0x7f456c0709b0 2024-09-21T07:23:04.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.961+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f456c09da20 con 0x7f4548073230 2024-09-21T07:23:04.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.969+0000 7f4568c00640 1 -- 172.21.15.64:0/2277022947 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332547 (secure 0 0 0) 0x7f456c09da20 con 0x7f4548073230 2024-09-21T07:23:04.973 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 msgr2=0x7f4548075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 0x7f4548075740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f456c0af050 tx=0x7f455400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 msgr2=0x7f456c1fc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f455c01ad70 tx=0x7f455c0a94d0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 shutdown_connections 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4548073230 0x7f4548075740 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f456c15edb0 0x7f456c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f456c0b4700 0x7f456c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 --2- 172.21.15.64:0/2277022947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f456c0709b0 0x7f456c1fc7b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:04.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 >> 172.21.15.64:0/2277022947 conn(0x7f456c0ccbe0 msgr2=0x7f456c0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:04.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 shutdown_connections 2024-09-21T07:23:04.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:04.973+0000 7f4572e00640 1 -- 172.21.15.64:0/2277022947 wait complete. 2024-09-21T07:23:04.997 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-21T07:23:03.419858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2046891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003033"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027628+0000","last_change":"2024-09-21T07:22:47.742250+0000","last_active":"2024-09-21T07:22:54.027628+0000","last_peered":"2024-09-21T07:22:54.027628+0000","last_clean":"2024-09-21T07:22:54.027628+0000","last_became_active":"2024-09-21T07:22:47.741257+0000","last_became_peered":"2024-09-21T07:22:47.741257+0000","last_unstale":"2024-09-21T07:22:54.027628+0000","last_undegraded":"2024-09-21T07:22:54.027628+0000","last_fullsized":"2024-09-21T07:22:54.027628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764663+0000","last_change":"2024-09-21T07:22:48.740833+0000","last_active":"2024-09-21T07:22:53.764663+0000","last_peered":"2024-09-21T07:22:53.764663+0000","last_clean":"2024-09-21T07:22:53.764663+0000","last_became_active":"2024-09-21T07:22:48.740377+0000","last_became_peered":"2024-09-21T07:22:48.740377+0000","last_unstale":"2024-09-21T07:22:53.764663+0000","last_undegraded":"2024-09-21T07:22:53.764663+0000","last_fullsized":"2024-09-21T07:22:53.764663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:17.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764017+0000","last_change":"2024-09-21T07:22:53.073187+0000","last_active":"2024-09-21T07:22:53.764017+0000","last_peered":"2024-09-21T07:22:53.764017+0000","last_clean":"2024-09-21T07:22:53.764017+0000","last_became_active":"2024-09-21T07:22:53.072636+0000","last_became_peered":"2024-09-21T07:22:53.072636+0000","last_unstale":"2024-09-21T07:22:53.764017+0000","last_undegraded":"2024-09-21T07:22:53.764017+0000","last_fullsized":"2024-09-21T07:22:53.764017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:13.190959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764937+0000","last_change":"2024-09-21T07:22:47.736091+0000","last_active":"2024-09-21T07:22:53.764937+0000","last_peered":"2024-09-21T07:22:53.764937+0000","last_clean":"2024-09-21T07:22:53.764937+0000","last_became_active":"2024-09-21T07:22:47.735733+0000","last_became_peered":"2024-09-21T07:22:47.735733+0000","last_unstale":"2024-09-21T07:22:53.764937+0000","last_undegraded":"2024-09-21T07:22:53.764937+0000","last_fullsized":"2024-09-21T07:22:53.764937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:08.564048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027377+0000","last_change":"2024-09-21T07:22:48.751664+0000","last_active":"2024-09-21T07:22:54.027377+0000","last_peered":"2024-09-21T07:22:54.027377+0000","last_clean":"2024-09-21T07:22:54.027377+0000","last_became_active":"2024-09-21T07:22:48.751327+0000","last_became_peered":"2024-09-21T07:22:48.751327+0000","last_unstale":"2024-09-21T07:22:54.027377+0000","last_undegraded":"2024-09-21T07:22:54.027377+0000","last_fullsized":"2024-09-21T07:22:54.027377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024710+0000","last_change":"2024-09-21T07:22:52.783270+0000","last_active":"2024-09-21T07:22:54.024710+0000","last_peered":"2024-09-21T07:22:54.024710+0000","last_clean":"2024-09-21T07:22:54.024710+0000","last_became_active":"2024-09-21T07:22:52.782796+0000","last_became_peered":"2024-09-21T07:22:52.782796+0000","last_unstale":"2024-09-21T07:22:54.024710+0000","last_undegraded":"2024-09-21T07:22:54.024710+0000","last_fullsized":"2024-09-21T07:22:54.024710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:50:20.520920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893408+0000","last_change":"2024-09-21T07:22:47.744126+0000","last_active":"2024-09-21T07:22:53.893408+0000","last_peered":"2024-09-21T07:22:53.893408+0000","last_clean":"2024-09-21T07:22:53.893408+0000","last_became_active":"2024-09-21T07:22:47.743644+0000","last_became_peered":"2024-09-21T07:22:47.743644+0000","last_unstale":"2024-09-21T07:22:53.893408+0000","last_undegraded":"2024-09-21T07:22:53.893408+0000","last_fullsized":"2024-09-21T07:22:53.893408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:29.063190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766496+0000","last_change":"2024-09-21T07:22:48.734135+0000","last_active":"2024-09-21T07:22:53.766496+0000","last_peered":"2024-09-21T07:22:53.766496+0000","last_clean":"2024-09-21T07:22:53.766496+0000","last_became_active":"2024-09-21T07:22:48.733798+0000","last_became_peered":"2024-09-21T07:22:48.733798+0000","last_unstale":"2024-09-21T07:22:53.766496+0000","last_undegraded":"2024-09-21T07:22:53.766496+0000","last_fullsized":"2024-09-21T07:22:53.766496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:34.239566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025181+0000","last_change":"2024-09-21T07:22:52.783122+0000","last_active":"2024-09-21T07:22:54.025181+0000","last_peered":"2024-09-21T07:22:54.025181+0000","last_clean":"2024-09-21T07:22:54.025181+0000","last_became_active":"2024-09-21T07:22:52.782549+0000","last_became_peered":"2024-09-21T07:22:52.782549+0000","last_unstale":"2024-09-21T07:22:54.025181+0000","last_undegraded":"2024-09-21T07:22:54.025181+0000","last_fullsized":"2024-09-21T07:22:54.025181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:34.419031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893397+0000","last_change":"2024-09-21T07:22:47.742860+0000","last_active":"2024-09-21T07:22:53.893397+0000","last_peered":"2024-09-21T07:22:53.893397+0000","last_clean":"2024-09-21T07:22:53.893397+0000","last_became_active":"2024-09-21T07:22:47.742543+0000","last_became_peered":"2024-09-21T07:22:47.742543+0000","last_unstale":"2024-09-21T07:22:53.893397+0000","last_undegraded":"2024-09-21T07:22:53.893397+0000","last_fullsized":"2024-09-21T07:22:53.893397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:11.203283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767084+0000","last_change":"2024-09-21T07:22:48.731433+0000","last_active":"2024-09-21T07:22:53.767084+0000","last_peered":"2024-09-21T07:22:53.767084+0000","last_clean":"2024-09-21T07:22:53.767084+0000","last_became_active":"2024-09-21T07:22:48.730230+0000","last_became_peered":"2024-09-21T07:22:48.730230+0000","last_unstale":"2024-09-21T07:22:53.767084+0000","last_undegraded":"2024-09-21T07:22:53.767084+0000","last_fullsized":"2024-09-21T07:22:53.767084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:35.738074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024779+0000","last_change":"2024-09-21T07:22:52.785170+0000","last_active":"2024-09-21T07:22:54.024779+0000","last_peered":"2024-09-21T07:22:54.024779+0000","last_clean":"2024-09-21T07:22:54.024779+0000","last_became_active":"2024-09-21T07:22:52.784767+0000","last_became_peered":"2024-09-21T07:22:52.784767+0000","last_unstale":"2024-09-21T07:22:54.024779+0000","last_undegraded":"2024-09-21T07:22:54.024779+0000","last_fullsized":"2024-09-21T07:22:54.024779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:48.957476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766904+0000","last_change":"2024-09-21T07:22:48.741283+0000","last_active":"2024-09-21T07:22:53.766904+0000","last_peered":"2024-09-21T07:22:53.766904+0000","last_clean":"2024-09-21T07:22:53.766904+0000","last_became_active":"2024-09-21T07:22:48.740907+0000","last_became_peered":"2024-09-21T07:22:48.740907+0000","last_unstale":"2024-09-21T07:22:53.766904+0000","last_undegraded":"2024-09-21T07:22:53.766904+0000","last_fullsized":"2024-09-21T07:22:53.766904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893462+0000","last_change":"2024-09-21T07:22:47.744642+0000","last_active":"2024-09-21T07:22:53.893462+0000","last_peered":"2024-09-21T07:22:53.893462+0000","last_clean":"2024-09-21T07:22:53.893462+0000","last_became_active":"2024-09-21T07:22:47.744170+0000","last_became_peered":"2024-09-21T07:22:47.744170+0000","last_unstale":"2024-09-21T07:22:53.893462+0000","last_undegraded":"2024-09-21T07:22:53.893462+0000","last_fullsized":"2024-09-21T07:22:53.893462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:22.987361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025596+0000","last_change":"2024-09-21T07:22:52.790836+0000","last_active":"2024-09-21T07:22:54.025596+0000","last_peered":"2024-09-21T07:22:54.025596+0000","last_clean":"2024-09-21T07:22:54.025596+0000","last_became_active":"2024-09-21T07:22:52.790363+0000","last_became_peered":"2024-09-21T07:22:52.790363+0000","last_unstale":"2024-09-21T07:22:54.025596+0000","last_undegraded":"2024-09-21T07:22:54.025596+0000","last_fullsized":"2024-09-21T07:22:54.025596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:37.910110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764396+0000","last_change":"2024-09-21T07:22:48.745313+0000","last_active":"2024-09-21T07:22:53.764396+0000","last_peered":"2024-09-21T07:22:53.764396+0000","last_clean":"2024-09-21T07:22:53.764396+0000","last_became_active":"2024-09-21T07:22:48.744930+0000","last_became_peered":"2024-09-21T07:22:48.744930+0000","last_unstale":"2024-09-21T07:22:53.764396+0000","last_undegraded":"2024-09-21T07:22:53.764396+0000","last_fullsized":"2024-09-21T07:22:53.764396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:10.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025330+0000","last_change":"2024-09-21T07:22:47.734173+0000","last_active":"2024-09-21T07:22:54.025330+0000","last_peered":"2024-09-21T07:22:54.025330+0000","last_clean":"2024-09-21T07:22:54.025330+0000","last_became_active":"2024-09-21T07:22:47.733708+0000","last_became_peered":"2024-09-21T07:22:47.733708+0000","last_unstale":"2024-09-21T07:22:54.025330+0000","last_undegraded":"2024-09-21T07:22:54.025330+0000","last_fullsized":"2024-09-21T07:22:54.025330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:30.464654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025043+0000","last_change":"2024-09-21T07:22:52.783224+0000","last_active":"2024-09-21T07:22:54.025043+0000","last_peered":"2024-09-21T07:22:54.025043+0000","last_clean":"2024-09-21T07:22:54.025043+0000","last_became_active":"2024-09-21T07:22:52.782848+0000","last_became_peered":"2024-09-21T07:22:52.782848+0000","last_unstale":"2024-09-21T07:22:54.025043+0000","last_undegraded":"2024-09-21T07:22:54.025043+0000","last_fullsized":"2024-09-21T07:22:54.025043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:05.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764138+0000","last_change":"2024-09-21T07:22:48.732990+0000","last_active":"2024-09-21T07:22:53.764138+0000","last_peered":"2024-09-21T07:22:53.764138+0000","last_clean":"2024-09-21T07:22:53.764138+0000","last_became_active":"2024-09-21T07:22:48.721772+0000","last_became_peered":"2024-09-21T07:22:48.721772+0000","last_unstale":"2024-09-21T07:22:53.764138+0000","last_undegraded":"2024-09-21T07:22:53.764138+0000","last_fullsized":"2024-09-21T07:22:53.764138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:12.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:47.735072+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:47.734618+0000","last_became_peered":"2024-09-21T07:22:47.734618+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:28.092443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025531+0000","last_change":"2024-09-21T07:22:53.066457+0000","last_active":"2024-09-21T07:22:54.025531+0000","last_peered":"2024-09-21T07:22:54.025531+0000","last_clean":"2024-09-21T07:22:54.025531+0000","last_became_active":"2024-09-21T07:22:53.065989+0000","last_became_peered":"2024-09-21T07:22:53.065989+0000","last_unstale":"2024-09-21T07:22:54.025531+0000","last_undegraded":"2024-09-21T07:22:54.025531+0000","last_fullsized":"2024-09-21T07:22:54.025531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:44.966857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025245+0000","last_change":"2024-09-21T07:22:48.737581+0000","last_active":"2024-09-21T07:22:54.025245+0000","last_peered":"2024-09-21T07:22:54.025245+0000","last_clean":"2024-09-21T07:22:54.025245+0000","last_became_active":"2024-09-21T07:22:48.737143+0000","last_became_peered":"2024-09-21T07:22:48.737143+0000","last_unstale":"2024-09-21T07:22:54.025245+0000","last_undegraded":"2024-09-21T07:22:54.025245+0000","last_fullsized":"2024-09-21T07:22:54.025245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:45.110572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892658+0000","last_change":"2024-09-21T07:22:47.748620+0000","last_active":"2024-09-21T07:22:53.892658+0000","last_peered":"2024-09-21T07:22:53.892658+0000","last_clean":"2024-09-21T07:22:53.892658+0000","last_became_active":"2024-09-21T07:22:47.744065+0000","last_became_peered":"2024-09-21T07:22:47.744065+0000","last_unstale":"2024-09-21T07:22:53.892658+0000","last_undegraded":"2024-09-21T07:22:53.892658+0000","last_fullsized":"2024-09-21T07:22:53.892658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:49.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025379+0000","last_change":"2024-09-21T07:22:52.784325+0000","last_active":"2024-09-21T07:22:54.025379+0000","last_peered":"2024-09-21T07:22:54.025379+0000","last_clean":"2024-09-21T07:22:54.025379+0000","last_became_active":"2024-09-21T07:22:52.783906+0000","last_became_peered":"2024-09-21T07:22:52.783906+0000","last_unstale":"2024-09-21T07:22:54.025379+0000","last_undegraded":"2024-09-21T07:22:54.025379+0000","last_fullsized":"2024-09-21T07:22:54.025379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:39.780829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027640+0000","last_change":"2024-09-21T07:22:48.740991+0000","last_active":"2024-09-21T07:22:54.027640+0000","last_peered":"2024-09-21T07:22:54.027640+0000","last_clean":"2024-09-21T07:22:54.027640+0000","last_became_active":"2024-09-21T07:22:48.738376+0000","last_became_peered":"2024-09-21T07:22:48.738376+0000","last_unstale":"2024-09-21T07:22:54.027640+0000","last_undegraded":"2024-09-21T07:22:54.027640+0000","last_fullsized":"2024-09-21T07:22:54.027640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.768082+0000","last_change":"2024-09-21T07:22:47.733080+0000","last_active":"2024-09-21T07:22:53.768082+0000","last_peered":"2024-09-21T07:22:53.768082+0000","last_clean":"2024-09-21T07:22:53.768082+0000","last_became_active":"2024-09-21T07:22:47.731545+0000","last_became_peered":"2024-09-21T07:22:47.731545+0000","last_unstale":"2024-09-21T07:22:53.768082+0000","last_undegraded":"2024-09-21T07:22:53.768082+0000","last_fullsized":"2024-09-21T07:22:53.768082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:55.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:53.070212+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:53.069615+0000","last_became_peered":"2024-09-21T07:22:53.069615+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:37.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765003+0000","last_change":"2024-09-21T07:22:48.733662+0000","last_active":"2024-09-21T07:22:53.765003+0000","last_peered":"2024-09-21T07:22:53.765003+0000","last_clean":"2024-09-21T07:22:53.765003+0000","last_became_active":"2024-09-21T07:22:48.733358+0000","last_became_peered":"2024-09-21T07:22:48.733358+0000","last_unstale":"2024-09-21T07:22:53.765003+0000","last_undegraded":"2024-09-21T07:22:53.765003+0000","last_fullsized":"2024-09-21T07:22:53.765003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025409+0000","last_change":"2024-09-21T07:22:47.737459+0000","last_active":"2024-09-21T07:22:54.025409+0000","last_peered":"2024-09-21T07:22:54.025409+0000","last_clean":"2024-09-21T07:22:54.025409+0000","last_became_active":"2024-09-21T07:22:47.737043+0000","last_became_peered":"2024-09-21T07:22:47.737043+0000","last_unstale":"2024-09-21T07:22:54.025409+0000","last_undegraded":"2024-09-21T07:22:54.025409+0000","last_fullsized":"2024-09-21T07:22:54.025409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:49.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763838+0000","last_change":"2024-09-21T07:22:53.070153+0000","last_active":"2024-09-21T07:22:53.763838+0000","last_peered":"2024-09-21T07:22:53.763838+0000","last_clean":"2024-09-21T07:22:53.763838+0000","last_became_active":"2024-09-21T07:22:53.066002+0000","last_became_peered":"2024-09-21T07:22:53.066002+0000","last_unstale":"2024-09-21T07:22:53.763838+0000","last_undegraded":"2024-09-21T07:22:53.763838+0000","last_fullsized":"2024-09-21T07:22:53.763838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:49.615596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024993+0000","last_change":"2024-09-21T07:22:48.730184+0000","last_active":"2024-09-21T07:22:54.024993+0000","last_peered":"2024-09-21T07:22:54.024993+0000","last_clean":"2024-09-21T07:22:54.024993+0000","last_became_active":"2024-09-21T07:22:48.729821+0000","last_became_peered":"2024-09-21T07:22:48.729821+0000","last_unstale":"2024-09-21T07:22:54.024993+0000","last_undegraded":"2024-09-21T07:22:54.024993+0000","last_fullsized":"2024-09-21T07:22:54.024993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:54.261987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893561+0000","last_change":"2024-09-21T07:22:47.745201+0000","last_active":"2024-09-21T07:22:53.893561+0000","last_peered":"2024-09-21T07:22:53.893561+0000","last_clean":"2024-09-21T07:22:53.893561+0000","last_became_active":"2024-09-21T07:22:47.744914+0000","last_became_peered":"2024-09-21T07:22:47.744914+0000","last_unstale":"2024-09-21T07:22:53.893561+0000","last_undegraded":"2024-09-21T07:22:53.893561+0000","last_fullsized":"2024-09-21T07:22:53.893561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.942934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026739+0000","last_change":"2024-09-21T07:22:53.063753+0000","last_active":"2024-09-21T07:22:54.026739+0000","last_peered":"2024-09-21T07:22:54.026739+0000","last_clean":"2024-09-21T07:22:54.026739+0000","last_became_active":"2024-09-21T07:22:53.063293+0000","last_became_peered":"2024-09-21T07:22:53.063293+0000","last_unstale":"2024-09-21T07:22:54.026739+0000","last_undegraded":"2024-09-21T07:22:54.026739+0000","last_fullsized":"2024-09-21T07:22:54.026739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767116+0000","last_change":"2024-09-21T07:22:48.753861+0000","last_active":"2024-09-21T07:22:53.767116+0000","last_peered":"2024-09-21T07:22:53.767116+0000","last_clean":"2024-09-21T07:22:53.767116+0000","last_became_active":"2024-09-21T07:22:48.753511+0000","last_became_peered":"2024-09-21T07:22:48.753511+0000","last_unstale":"2024-09-21T07:22:53.767116+0000","last_undegraded":"2024-09-21T07:22:53.767116+0000","last_fullsized":"2024-09-21T07:22:53.767116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:01.976003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025525+0000","last_change":"2024-09-21T07:22:47.737833+0000","last_active":"2024-09-21T07:22:54.025525+0000","last_peered":"2024-09-21T07:22:54.025525+0000","last_clean":"2024-09-21T07:22:54.025525+0000","last_became_active":"2024-09-21T07:22:47.736895+0000","last_became_peered":"2024-09-21T07:22:47.736895+0000","last_unstale":"2024-09-21T07:22:54.025525+0000","last_undegraded":"2024-09-21T07:22:54.025525+0000","last_fullsized":"2024-09-21T07:22:54.025525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:17.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024946+0000","last_change":"2024-09-21T07:22:52.781483+0000","last_active":"2024-09-21T07:22:54.024946+0000","last_peered":"2024-09-21T07:22:54.024946+0000","last_clean":"2024-09-21T07:22:54.024946+0000","last_became_active":"2024-09-21T07:22:52.778544+0000","last_became_peered":"2024-09-21T07:22:52.778544+0000","last_unstale":"2024-09-21T07:22:54.024946+0000","last_undegraded":"2024-09-21T07:22:54.024946+0000","last_fullsized":"2024-09-21T07:22:54.024946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:58.932426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025560+0000","last_change":"2024-09-21T07:22:48.751678+0000","last_active":"2024-09-21T07:22:54.025560+0000","last_peered":"2024-09-21T07:22:54.025560+0000","last_clean":"2024-09-21T07:22:54.025560+0000","last_became_active":"2024-09-21T07:22:48.744782+0000","last_became_peered":"2024-09-21T07:22:48.744782+0000","last_unstale":"2024-09-21T07:22:54.025560+0000","last_undegraded":"2024-09-21T07:22:54.025560+0000","last_fullsized":"2024-09-21T07:22:54.025560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:56.871086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766106+0000","last_change":"2024-09-21T07:22:47.727167+0000","last_active":"2024-09-21T07:22:53.766106+0000","last_peered":"2024-09-21T07:22:53.766106+0000","last_clean":"2024-09-21T07:22:53.766106+0000","last_became_active":"2024-09-21T07:22:47.726894+0000","last_became_peered":"2024-09-21T07:22:47.726894+0000","last_unstale":"2024-09-21T07:22:53.766106+0000","last_undegraded":"2024-09-21T07:22:53.766106+0000","last_fullsized":"2024-09-21T07:22:53.766106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:31.716302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024795+0000","last_change":"2024-09-21T07:22:52.783725+0000","last_active":"2024-09-21T07:22:54.024795+0000","last_peered":"2024-09-21T07:22:54.024795+0000","last_clean":"2024-09-21T07:22:54.024795+0000","last_became_active":"2024-09-21T07:22:52.778895+0000","last_became_peered":"2024-09-21T07:22:52.778895+0000","last_unstale":"2024-09-21T07:22:54.024795+0000","last_undegraded":"2024-09-21T07:22:54.024795+0000","last_fullsized":"2024-09-21T07:22:54.024795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:19.056150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024676+0000","last_change":"2024-09-21T07:22:48.737222+0000","last_active":"2024-09-21T07:22:54.024676+0000","last_peered":"2024-09-21T07:22:54.024676+0000","last_clean":"2024-09-21T07:22:54.024676+0000","last_became_active":"2024-09-21T07:22:48.736340+0000","last_became_peered":"2024-09-21T07:22:48.736340+0000","last_unstale":"2024-09-21T07:22:54.024676+0000","last_undegraded":"2024-09-21T07:22:54.024676+0000","last_fullsized":"2024-09-21T07:22:54.024676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:37.469062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024338+0000","last_change":"2024-09-21T07:22:47.713035+0000","last_active":"2024-09-21T07:22:54.024338+0000","last_peered":"2024-09-21T07:22:54.024338+0000","last_clean":"2024-09-21T07:22:54.024338+0000","last_became_active":"2024-09-21T07:22:47.711447+0000","last_became_peered":"2024-09-21T07:22:47.711447+0000","last_unstale":"2024-09-21T07:22:54.024338+0000","last_undegraded":"2024-09-21T07:22:54.024338+0000","last_fullsized":"2024-09-21T07:22:54.024338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:21.821706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025552+0000","last_change":"2024-09-21T07:22:52.783218+0000","last_active":"2024-09-21T07:22:54.025552+0000","last_peered":"2024-09-21T07:22:54.025552+0000","last_clean":"2024-09-21T07:22:54.025552+0000","last_became_active":"2024-09-21T07:22:52.778288+0000","last_became_peered":"2024-09-21T07:22:52.778288+0000","last_unstale":"2024-09-21T07:22:54.025552+0000","last_undegraded":"2024-09-21T07:22:54.025552+0000","last_fullsized":"2024-09-21T07:22:54.025552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:50.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026221+0000","last_change":"2024-09-21T07:22:48.748027+0000","last_active":"2024-09-21T07:22:54.026221+0000","last_peered":"2024-09-21T07:22:54.026221+0000","last_clean":"2024-09-21T07:22:54.026221+0000","last_became_active":"2024-09-21T07:22:48.747687+0000","last_became_peered":"2024-09-21T07:22:48.747687+0000","last_unstale":"2024-09-21T07:22:54.026221+0000","last_undegraded":"2024-09-21T07:22:54.026221+0000","last_fullsized":"2024-09-21T07:22:54.026221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:55.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893031+0000","last_change":"2024-09-21T07:22:47.744531+0000","last_active":"2024-09-21T07:22:53.893031+0000","last_peered":"2024-09-21T07:22:53.893031+0000","last_clean":"2024-09-21T07:22:53.893031+0000","last_became_active":"2024-09-21T07:22:47.744113+0000","last_became_peered":"2024-09-21T07:22:47.744113+0000","last_unstale":"2024-09-21T07:22:53.893031+0000","last_undegraded":"2024-09-21T07:22:53.893031+0000","last_fullsized":"2024-09-21T07:22:53.893031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:16.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027637+0000","last_change":"2024-09-21T07:22:53.068210+0000","last_active":"2024-09-21T07:22:54.027637+0000","last_peered":"2024-09-21T07:22:54.027637+0000","last_clean":"2024-09-21T07:22:54.027637+0000","last_became_active":"2024-09-21T07:22:53.067263+0000","last_became_peered":"2024-09-21T07:22:53.067263+0000","last_unstale":"2024-09-21T07:22:54.027637+0000","last_undegraded":"2024-09-21T07:22:54.027637+0000","last_fullsized":"2024-09-21T07:22:54.027637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:27.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764606+0000","last_change":"2024-09-21T07:22:48.738259+0000","last_active":"2024-09-21T07:22:53.764606+0000","last_peered":"2024-09-21T07:22:53.764606+0000","last_clean":"2024-09-21T07:22:53.764606+0000","last_became_active":"2024-09-21T07:22:48.737926+0000","last_became_peered":"2024-09-21T07:22:48.737926+0000","last_unstale":"2024-09-21T07:22:53.764606+0000","last_undegraded":"2024-09-21T07:22:53.764606+0000","last_fullsized":"2024-09-21T07:22:53.764606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:55.324437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766223+0000","last_change":"2024-09-21T07:22:47.719687+0000","last_active":"2024-09-21T07:22:53.766223+0000","last_peered":"2024-09-21T07:22:53.766223+0000","last_clean":"2024-09-21T07:22:53.766223+0000","last_became_active":"2024-09-21T07:22:47.719298+0000","last_became_peered":"2024-09-21T07:22:47.719298+0000","last_unstale":"2024-09-21T07:22:53.766223+0000","last_undegraded":"2024-09-21T07:22:53.766223+0000","last_fullsized":"2024-09-21T07:22:53.766223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:44.103579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892817+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:22:53.892817+0000","last_peered":"2024-09-21T07:22:53.892817+0000","last_clean":"2024-09-21T07:22:53.892817+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:22:53.892817+0000","last_undegraded":"2024-09-21T07:22:53.892817+0000","last_fullsized":"2024-09-21T07:22:53.892817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767042+0000","last_change":"2024-09-21T07:22:53.066672+0000","last_active":"2024-09-21T07:22:53.767042+0000","last_peered":"2024-09-21T07:22:53.767042+0000","last_clean":"2024-09-21T07:22:53.767042+0000","last_became_active":"2024-09-21T07:22:53.066192+0000","last_became_peered":"2024-09-21T07:22:53.066192+0000","last_unstale":"2024-09-21T07:22:53.767042+0000","last_undegraded":"2024-09-21T07:22:53.767042+0000","last_fullsized":"2024-09-21T07:22:53.767042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.796201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893182+0000","last_change":"2024-09-21T07:22:48.734582+0000","last_active":"2024-09-21T07:22:53.893182+0000","last_peered":"2024-09-21T07:22:53.893182+0000","last_clean":"2024-09-21T07:22:53.893182+0000","last_became_active":"2024-09-21T07:22:48.734240+0000","last_became_peered":"2024-09-21T07:22:48.734240+0000","last_unstale":"2024-09-21T07:22:53.893182+0000","last_undegraded":"2024-09-21T07:22:53.893182+0000","last_fullsized":"2024-09-21T07:22:53.893182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:09.879302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025524+0000","last_change":"2024-09-21T07:22:47.733880+0000","last_active":"2024-09-21T07:22:54.025524+0000","last_peered":"2024-09-21T07:22:54.025524+0000","last_clean":"2024-09-21T07:22:54.025524+0000","last_became_active":"2024-09-21T07:22:47.733393+0000","last_became_peered":"2024-09-21T07:22:47.733393+0000","last_unstale":"2024-09-21T07:22:54.025524+0000","last_undegraded":"2024-09-21T07:22:54.025524+0000","last_fullsized":"2024-09-21T07:22:54.025524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766698+0000","last_change":"2024-09-21T07:22:53.063609+0000","last_active":"2024-09-21T07:22:53.766698+0000","last_peered":"2024-09-21T07:22:53.766698+0000","last_clean":"2024-09-21T07:22:53.766698+0000","last_became_active":"2024-09-21T07:22:53.062759+0000","last_became_peered":"2024-09-21T07:22:53.062759+0000","last_unstale":"2024-09-21T07:22:53.766698+0000","last_undegraded":"2024-09-21T07:22:53.766698+0000","last_fullsized":"2024-09-21T07:22:53.766698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:30.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766569+0000","last_change":"2024-09-21T07:22:48.749460+0000","last_active":"2024-09-21T07:22:53.766569+0000","last_peered":"2024-09-21T07:22:53.766569+0000","last_clean":"2024-09-21T07:22:53.766569+0000","last_became_active":"2024-09-21T07:22:48.748693+0000","last_became_peered":"2024-09-21T07:22:48.748693+0000","last_unstale":"2024-09-21T07:22:53.766569+0000","last_undegraded":"2024-09-21T07:22:53.766569+0000","last_fullsized":"2024-09-21T07:22:53.766569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.090779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025285+0000","last_change":"2024-09-21T07:22:47.733842+0000","last_active":"2024-09-21T07:22:54.025285+0000","last_peered":"2024-09-21T07:22:54.025285+0000","last_clean":"2024-09-21T07:22:54.025285+0000","last_became_active":"2024-09-21T07:22:47.733469+0000","last_became_peered":"2024-09-21T07:22:47.733469+0000","last_unstale":"2024-09-21T07:22:54.025285+0000","last_undegraded":"2024-09-21T07:22:54.025285+0000","last_fullsized":"2024-09-21T07:22:54.025285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:51.768208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026922+0000","last_change":"2024-09-21T07:22:52.788401+0000","last_active":"2024-09-21T07:22:54.026922+0000","last_peered":"2024-09-21T07:22:54.026922+0000","last_clean":"2024-09-21T07:22:54.026922+0000","last_became_active":"2024-09-21T07:22:52.787726+0000","last_became_peered":"2024-09-21T07:22:52.787726+0000","last_unstale":"2024-09-21T07:22:54.026922+0000","last_undegraded":"2024-09-21T07:22:54.026922+0000","last_fullsized":"2024-09-21T07:22:54.026922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:50.336899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893535+0000","last_change":"2024-09-21T07:22:48.741294+0000","last_active":"2024-09-21T07:22:53.893535+0000","last_peered":"2024-09-21T07:22:53.893535+0000","last_clean":"2024-09-21T07:22:53.893535+0000","last_became_active":"2024-09-21T07:22:48.739470+0000","last_became_peered":"2024-09-21T07:22:48.739470+0000","last_unstale":"2024-09-21T07:22:53.893535+0000","last_undegraded":"2024-09-21T07:22:53.893535+0000","last_fullsized":"2024-09-21T07:22:53.893535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:45.572840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026041+0000","last_change":"2024-09-21T07:22:47.712265+0000","last_active":"2024-09-21T07:22:54.026041+0000","last_peered":"2024-09-21T07:22:54.026041+0000","last_clean":"2024-09-21T07:22:54.026041+0000","last_became_active":"2024-09-21T07:22:47.711366+0000","last_became_peered":"2024-09-21T07:22:47.711366+0000","last_unstale":"2024-09-21T07:22:54.026041+0000","last_undegraded":"2024-09-21T07:22:54.026041+0000","last_fullsized":"2024-09-21T07:22:54.026041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765294+0000","last_change":"2024-09-21T07:22:53.064301+0000","last_active":"2024-09-21T07:22:53.765294+0000","last_peered":"2024-09-21T07:22:53.765294+0000","last_clean":"2024-09-21T07:22:53.765294+0000","last_became_active":"2024-09-21T07:22:53.062833+0000","last_became_peered":"2024-09-21T07:22:53.062833+0000","last_unstale":"2024-09-21T07:22:53.765294+0000","last_undegraded":"2024-09-21T07:22:53.765294+0000","last_fullsized":"2024-09-21T07:22:53.765294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:27.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893385+0000","last_change":"2024-09-21T07:22:48.739480+0000","last_active":"2024-09-21T07:22:53.893385+0000","last_peered":"2024-09-21T07:22:53.893385+0000","last_clean":"2024-09-21T07:22:53.893385+0000","last_became_active":"2024-09-21T07:22:48.735630+0000","last_became_peered":"2024-09-21T07:22:48.735630+0000","last_unstale":"2024-09-21T07:22:53.893385+0000","last_undegraded":"2024-09-21T07:22:53.893385+0000","last_fullsized":"2024-09-21T07:22:53.893385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:46.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025673+0000","last_change":"2024-09-21T07:22:47.730814+0000","last_active":"2024-09-21T07:22:54.025673+0000","last_peered":"2024-09-21T07:22:54.025673+0000","last_clean":"2024-09-21T07:22:54.025673+0000","last_became_active":"2024-09-21T07:22:47.730342+0000","last_became_peered":"2024-09-21T07:22:47.730342+0000","last_unstale":"2024-09-21T07:22:54.025673+0000","last_undegraded":"2024-09-21T07:22:54.025673+0000","last_fullsized":"2024-09-21T07:22:54.025673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024615+0000","last_change":"2024-09-21T07:22:52.784700+0000","last_active":"2024-09-21T07:22:54.024615+0000","last_peered":"2024-09-21T07:22:54.024615+0000","last_clean":"2024-09-21T07:22:54.024615+0000","last_became_active":"2024-09-21T07:22:52.784177+0000","last_became_peered":"2024-09-21T07:22:52.784177+0000","last_unstale":"2024-09-21T07:22:54.024615+0000","last_undegraded":"2024-09-21T07:22:54.024615+0000","last_fullsized":"2024-09-21T07:22:54.024615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.035862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740423+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.739493+0000","last_became_peered":"2024-09-21T07:22:48.739493+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024092+0000","last_change":"2024-09-21T07:22:47.726109+0000","last_active":"2024-09-21T07:22:54.024092+0000","last_peered":"2024-09-21T07:22:54.024092+0000","last_clean":"2024-09-21T07:22:54.024092+0000","last_became_active":"2024-09-21T07:22:47.725696+0000","last_became_peered":"2024-09-21T07:22:47.725696+0000","last_unstale":"2024-09-21T07:22:54.024092+0000","last_undegraded":"2024-09-21T07:22:54.024092+0000","last_fullsized":"2024-09-21T07:22:54.024092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027353+0000","last_change":"2024-09-21T07:22:52.781696+0000","last_active":"2024-09-21T07:22:54.027353+0000","last_peered":"2024-09-21T07:22:54.027353+0000","last_clean":"2024-09-21T07:22:54.027353+0000","last_became_active":"2024-09-21T07:22:52.781211+0000","last_became_peered":"2024-09-21T07:22:52.781211+0000","last_unstale":"2024-09-21T07:22:54.027353+0000","last_undegraded":"2024-09-21T07:22:54.027353+0000","last_fullsized":"2024-09-21T07:22:54.027353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:51.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765137+0000","last_change":"2024-09-21T07:22:48.746169+0000","last_active":"2024-09-21T07:22:53.765137+0000","last_peered":"2024-09-21T07:22:53.765137+0000","last_clean":"2024-09-21T07:22:53.765137+0000","last_became_active":"2024-09-21T07:22:48.745804+0000","last_became_peered":"2024-09-21T07:22:48.745804+0000","last_unstale":"2024-09-21T07:22:53.765137+0000","last_undegraded":"2024-09-21T07:22:53.765137+0000","last_fullsized":"2024-09-21T07:22:53.765137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766637+0000","last_change":"2024-09-21T07:22:47.723745+0000","last_active":"2024-09-21T07:22:53.766637+0000","last_peered":"2024-09-21T07:22:53.766637+0000","last_clean":"2024-09-21T07:22:53.766637+0000","last_became_active":"2024-09-21T07:22:47.723299+0000","last_became_peered":"2024-09-21T07:22:47.723299+0000","last_unstale":"2024-09-21T07:22:53.766637+0000","last_undegraded":"2024-09-21T07:22:53.766637+0000","last_fullsized":"2024-09-21T07:22:53.766637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764852+0000","last_change":"2024-09-21T07:22:53.067494+0000","last_active":"2024-09-21T07:22:53.764852+0000","last_peered":"2024-09-21T07:22:53.764852+0000","last_clean":"2024-09-21T07:22:53.764852+0000","last_became_active":"2024-09-21T07:22:53.066168+0000","last_became_peered":"2024-09-21T07:22:53.066168+0000","last_unstale":"2024-09-21T07:22:53.764852+0000","last_undegraded":"2024-09-21T07:22:53.764852+0000","last_fullsized":"2024-09-21T07:22:53.764852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740397+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.736271+0000","last_became_peered":"2024-09-21T07:22:48.736271+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:50.369048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765981+0000","last_change":"2024-09-21T07:22:47.742213+0000","last_active":"2024-09-21T07:22:53.765981+0000","last_peered":"2024-09-21T07:22:53.765981+0000","last_clean":"2024-09-21T07:22:53.765981+0000","last_became_active":"2024-09-21T07:22:47.741132+0000","last_became_peered":"2024-09-21T07:22:47.741132+0000","last_unstale":"2024-09-21T07:22:53.765981+0000","last_undegraded":"2024-09-21T07:22:53.765981+0000","last_fullsized":"2024-09-21T07:22:53.765981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:09.749747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765129+0000","last_change":"2024-09-21T07:22:53.066418+0000","last_active":"2024-09-21T07:22:53.765129+0000","last_peered":"2024-09-21T07:22:53.765129+0000","last_clean":"2024-09-21T07:22:53.765129+0000","last_became_active":"2024-09-21T07:22:53.065948+0000","last_became_peered":"2024-09-21T07:22:53.065948+0000","last_unstale":"2024-09-21T07:22:53.765129+0000","last_undegraded":"2024-09-21T07:22:53.765129+0000","last_fullsized":"2024-09-21T07:22:53.765129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:44.474322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026570+0000","last_change":"2024-09-21T07:22:48.737346+0000","last_active":"2024-09-21T07:22:54.026570+0000","last_peered":"2024-09-21T07:22:54.026570+0000","last_clean":"2024-09-21T07:22:54.026570+0000","last_became_active":"2024-09-21T07:22:48.736875+0000","last_became_peered":"2024-09-21T07:22:48.736875+0000","last_unstale":"2024-09-21T07:22:54.026570+0000","last_undegraded":"2024-09-21T07:22:54.026570+0000","last_fullsized":"2024-09-21T07:22:54.026570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:22.528204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027111+0000","last_change":"2024-09-21T07:22:47.730642+0000","last_active":"2024-09-21T07:22:54.027111+0000","last_peered":"2024-09-21T07:22:54.027111+0000","last_clean":"2024-09-21T07:22:54.027111+0000","last_became_active":"2024-09-21T07:22:47.730256+0000","last_became_peered":"2024-09-21T07:22:47.730256+0000","last_unstale":"2024-09-21T07:22:54.027111+0000","last_undegraded":"2024-09-21T07:22:54.027111+0000","last_fullsized":"2024-09-21T07:22:54.027111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766769+0000","last_change":"2024-09-21T07:22:53.067757+0000","last_active":"2024-09-21T07:22:53.766769+0000","last_peered":"2024-09-21T07:22:53.766769+0000","last_clean":"2024-09-21T07:22:53.766769+0000","last_became_active":"2024-09-21T07:22:53.067310+0000","last_became_peered":"2024-09-21T07:22:53.067310+0000","last_unstale":"2024-09-21T07:22:53.766769+0000","last_undegraded":"2024-09-21T07:22:53.766769+0000","last_fullsized":"2024-09-21T07:22:53.766769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:51.644247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893021+0000","last_change":"2024-09-21T07:22:48.748135+0000","last_active":"2024-09-21T07:22:53.893021+0000","last_peered":"2024-09-21T07:22:53.893021+0000","last_clean":"2024-09-21T07:22:53.893021+0000","last_became_active":"2024-09-21T07:22:48.747791+0000","last_became_peered":"2024-09-21T07:22:48.747791+0000","last_unstale":"2024-09-21T07:22:53.893021+0000","last_undegraded":"2024-09-21T07:22:53.893021+0000","last_fullsized":"2024-09-21T07:22:53.893021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:50.042620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:23:00.072821+0000","last_change":"2024-09-21T07:22:47.731720+0000","last_active":"2024-09-21T07:23:00.072821+0000","last_peered":"2024-09-21T07:23:00.072821+0000","last_clean":"2024-09-21T07:23:00.072821+0000","last_became_active":"2024-09-21T07:22:47.731257+0000","last_became_peered":"2024-09-21T07:22:47.731257+0000","last_unstale":"2024-09-21T07:23:00.072821+0000","last_undegraded":"2024-09-21T07:23:00.072821+0000","last_fullsized":"2024-09-21T07:23:00.072821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025005+0000","last_change":"2024-09-21T07:22:52.777427+0000","last_active":"2024-09-21T07:22:54.025005+0000","last_peered":"2024-09-21T07:22:54.025005+0000","last_clean":"2024-09-21T07:22:54.025005+0000","last_became_active":"2024-09-21T07:22:52.776894+0000","last_became_peered":"2024-09-21T07:22:52.776894+0000","last_unstale":"2024-09-21T07:22:54.025005+0000","last_undegraded":"2024-09-21T07:22:54.025005+0000","last_fullsized":"2024-09-21T07:22:54.025005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:10.994515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025528+0000","last_change":"2024-09-21T07:22:48.751759+0000","last_active":"2024-09-21T07:22:54.025528+0000","last_peered":"2024-09-21T07:22:54.025528+0000","last_clean":"2024-09-21T07:22:54.025528+0000","last_became_active":"2024-09-21T07:22:48.751434+0000","last_became_peered":"2024-09-21T07:22:48.751434+0000","last_unstale":"2024-09-21T07:22:54.025528+0000","last_undegraded":"2024-09-21T07:22:54.025528+0000","last_fullsized":"2024-09-21T07:22:54.025528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025150+0000","last_change":"2024-09-21T07:22:47.724152+0000","last_active":"2024-09-21T07:22:54.025150+0000","last_peered":"2024-09-21T07:22:54.025150+0000","last_clean":"2024-09-21T07:22:54.025150+0000","last_became_active":"2024-09-21T07:22:47.723668+0000","last_became_peered":"2024-09-21T07:22:47.723668+0000","last_unstale":"2024-09-21T07:22:54.025150+0000","last_undegraded":"2024-09-21T07:22:54.025150+0000","last_fullsized":"2024-09-21T07:22:54.025150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:38.422165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025008+0000","last_change":"2024-09-21T07:22:52.790871+0000","last_active":"2024-09-21T07:22:54.025008+0000","last_peered":"2024-09-21T07:22:54.025008+0000","last_clean":"2024-09-21T07:22:54.025008+0000","last_became_active":"2024-09-21T07:22:52.790349+0000","last_became_peered":"2024-09-21T07:22:52.790349+0000","last_unstale":"2024-09-21T07:22:54.025008+0000","last_undegraded":"2024-09-21T07:22:54.025008+0000","last_fullsized":"2024-09-21T07:22:54.025008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:08.100330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027512+0000","last_change":"2024-09-21T07:22:48.749463+0000","last_active":"2024-09-21T07:22:54.027512+0000","last_peered":"2024-09-21T07:22:54.027512+0000","last_clean":"2024-09-21T07:22:54.027512+0000","last_became_active":"2024-09-21T07:22:48.747781+0000","last_became_peered":"2024-09-21T07:22:48.747781+0000","last_unstale":"2024-09-21T07:22:54.027512+0000","last_undegraded":"2024-09-21T07:22:54.027512+0000","last_fullsized":"2024-09-21T07:22:54.027512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767422+0000","last_change":"2024-09-21T07:22:47.737032+0000","last_active":"2024-09-21T07:22:53.767422+0000","last_peered":"2024-09-21T07:22:53.767422+0000","last_clean":"2024-09-21T07:22:53.767422+0000","last_became_active":"2024-09-21T07:22:47.736616+0000","last_became_peered":"2024-09-21T07:22:47.736616+0000","last_unstale":"2024-09-21T07:22:53.767422+0000","last_undegraded":"2024-09-21T07:22:53.767422+0000","last_fullsized":"2024-09-21T07:22:53.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:53.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764281+0000","last_change":"2024-09-21T07:22:52.774334+0000","last_active":"2024-09-21T07:22:53.764281+0000","last_peered":"2024-09-21T07:22:53.764281+0000","last_clean":"2024-09-21T07:22:53.764281+0000","last_became_active":"2024-09-21T07:22:52.773910+0000","last_became_peered":"2024-09-21T07:22:52.773910+0000","last_unstale":"2024-09-21T07:22:53.764281+0000","last_undegraded":"2024-09-21T07:22:53.764281+0000","last_fullsized":"2024-09-21T07:22:53.764281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:08.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767415+0000","last_change":"2024-09-21T07:22:48.751082+0000","last_active":"2024-09-21T07:22:53.767415+0000","last_peered":"2024-09-21T07:22:53.767415+0000","last_clean":"2024-09-21T07:22:53.767415+0000","last_became_active":"2024-09-21T07:22:48.750721+0000","last_became_peered":"2024-09-21T07:22:48.750721+0000","last_unstale":"2024-09-21T07:22:53.767415+0000","last_undegraded":"2024-09-21T07:22:53.767415+0000","last_fullsized":"2024-09-21T07:22:53.767415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:46.294144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767956+0000","last_change":"2024-09-21T07:22:47.732653+0000","last_active":"2024-09-21T07:22:53.767956+0000","last_peered":"2024-09-21T07:22:53.767956+0000","last_clean":"2024-09-21T07:22:53.767956+0000","last_became_active":"2024-09-21T07:22:47.731145+0000","last_became_peered":"2024-09-21T07:22:47.731145+0000","last_unstale":"2024-09-21T07:22:53.767956+0000","last_undegraded":"2024-09-21T07:22:53.767956+0000","last_fullsized":"2024-09-21T07:22:53.767956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764072+0000","last_change":"2024-09-21T07:22:53.068578+0000","last_active":"2024-09-21T07:22:53.764072+0000","last_peered":"2024-09-21T07:22:53.764072+0000","last_clean":"2024-09-21T07:22:53.764072+0000","last_became_active":"2024-09-21T07:22:53.068094+0000","last_became_peered":"2024-09-21T07:22:53.068094+0000","last_unstale":"2024-09-21T07:22:53.764072+0000","last_undegraded":"2024-09-21T07:22:53.764072+0000","last_fullsized":"2024-09-21T07:22:53.764072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:48.304004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027350+0000","last_change":"2024-09-21T07:22:53.067719+0000","last_active":"2024-09-21T07:22:54.027350+0000","last_peered":"2024-09-21T07:22:54.027350+0000","last_clean":"2024-09-21T07:22:54.027350+0000","last_became_active":"2024-09-21T07:22:53.066586+0000","last_became_peered":"2024-09-21T07:22:53.066586+0000","last_unstale":"2024-09-21T07:22:54.027350+0000","last_undegraded":"2024-09-21T07:22:54.027350+0000","last_fullsized":"2024-09-21T07:22:54.027350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:08.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024581+0000","last_change":"2024-09-21T07:22:48.721331+0000","last_active":"2024-09-21T07:22:54.024581+0000","last_peered":"2024-09-21T07:22:54.024581+0000","last_clean":"2024-09-21T07:22:54.024581+0000","last_became_active":"2024-09-21T07:22:48.721004+0000","last_became_peered":"2024-09-21T07:22:48.721004+0000","last_unstale":"2024-09-21T07:22:54.024581+0000","last_undegraded":"2024-09-21T07:22:54.024581+0000","last_fullsized":"2024-09-21T07:22:54.024581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765811+0000","last_change":"2024-09-21T07:22:47.725525+0000","last_active":"2024-09-21T07:22:53.765811+0000","last_peered":"2024-09-21T07:22:53.765811+0000","last_clean":"2024-09-21T07:22:53.765811+0000","last_became_active":"2024-09-21T07:22:47.724955+0000","last_became_peered":"2024-09-21T07:22:47.724955+0000","last_unstale":"2024-09-21T07:22:53.765811+0000","last_undegraded":"2024-09-21T07:22:53.765811+0000","last_fullsized":"2024-09-21T07:22:53.765811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:57.216986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767880+0000","last_change":"2024-09-21T07:22:52.775953+0000","last_active":"2024-09-21T07:22:53.767880+0000","last_peered":"2024-09-21T07:22:53.767880+0000","last_clean":"2024-09-21T07:22:53.767880+0000","last_became_active":"2024-09-21T07:22:52.775495+0000","last_became_peered":"2024-09-21T07:22:52.775495+0000","last_unstale":"2024-09-21T07:22:53.767880+0000","last_undegraded":"2024-09-21T07:22:53.767880+0000","last_fullsized":"2024-09-21T07:22:53.767880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763992+0000","last_change":"2024-09-21T07:22:48.753975+0000","last_active":"2024-09-21T07:22:53.763992+0000","last_peered":"2024-09-21T07:22:53.763992+0000","last_clean":"2024-09-21T07:22:53.763992+0000","last_became_active":"2024-09-21T07:22:48.753724+0000","last_became_peered":"2024-09-21T07:22:48.753724+0000","last_unstale":"2024-09-21T07:22:53.763992+0000","last_undegraded":"2024-09-21T07:22:53.763992+0000","last_fullsized":"2024-09-21T07:22:53.763992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:22.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764342+0000","last_change":"2024-09-21T07:22:47.730250+0000","last_active":"2024-09-21T07:22:53.764342+0000","last_peered":"2024-09-21T07:22:53.764342+0000","last_clean":"2024-09-21T07:22:53.764342+0000","last_became_active":"2024-09-21T07:22:47.729848+0000","last_became_peered":"2024-09-21T07:22:47.729848+0000","last_unstale":"2024-09-21T07:22:53.764342+0000","last_undegraded":"2024-09-21T07:22:53.764342+0000","last_fullsized":"2024-09-21T07:22:53.764342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:55.323370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767164+0000","last_change":"2024-09-21T07:22:47.725746+0000","last_active":"2024-09-21T07:22:53.767164+0000","last_peered":"2024-09-21T07:22:53.767164+0000","last_clean":"2024-09-21T07:22:53.767164+0000","last_became_active":"2024-09-21T07:22:47.725422+0000","last_became_peered":"2024-09-21T07:22:47.725422+0000","last_unstale":"2024-09-21T07:22:53.767164+0000","last_undegraded":"2024-09-21T07:22:53.767164+0000","last_fullsized":"2024-09-21T07:22:53.767164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:00.603887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027060+0000","last_change":"2024-09-21T07:22:48.744596+0000","last_active":"2024-09-21T07:22:54.027060+0000","last_peered":"2024-09-21T07:22:54.027060+0000","last_clean":"2024-09-21T07:22:54.027060+0000","last_became_active":"2024-09-21T07:22:48.744299+0000","last_became_peered":"2024-09-21T07:22:48.744299+0000","last_unstale":"2024-09-21T07:22:54.027060+0000","last_undegraded":"2024-09-21T07:22:54.027060+0000","last_fullsized":"2024-09-21T07:22:54.027060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024935+0000","last_change":"2024-09-21T07:22:52.787834+0000","last_active":"2024-09-21T07:22:54.024935+0000","last_peered":"2024-09-21T07:22:54.024935+0000","last_clean":"2024-09-21T07:22:54.024935+0000","last_became_active":"2024-09-21T07:22:52.786824+0000","last_became_peered":"2024-09-21T07:22:52.786824+0000","last_unstale":"2024-09-21T07:22:54.024935+0000","last_undegraded":"2024-09-21T07:22:54.024935+0000","last_fullsized":"2024-09-21T07:22:54.024935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:57.435599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764323+0000","last_change":"2024-09-21T07:22:47.741714+0000","last_active":"2024-09-21T07:22:53.764323+0000","last_peered":"2024-09-21T07:22:53.764323+0000","last_clean":"2024-09-21T07:22:53.764323+0000","last_became_active":"2024-09-21T07:22:47.741389+0000","last_became_peered":"2024-09-21T07:22:47.741389+0000","last_unstale":"2024-09-21T07:22:53.764323+0000","last_undegraded":"2024-09-21T07:22:53.764323+0000","last_fullsized":"2024-09-21T07:22:53.764323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:45.062537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025167+0000","last_change":"2024-09-21T07:22:48.734053+0000","last_active":"2024-09-21T07:22:54.025167+0000","last_peered":"2024-09-21T07:22:54.025167+0000","last_clean":"2024-09-21T07:22:54.025167+0000","last_became_active":"2024-09-21T07:22:48.733585+0000","last_became_peered":"2024-09-21T07:22:48.733585+0000","last_unstale":"2024-09-21T07:22:54.025167+0000","last_undegraded":"2024-09-21T07:22:54.025167+0000","last_fullsized":"2024-09-21T07:22:54.025167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:42.987988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764844+0000","last_change":"2024-09-21T07:22:52.783230+0000","last_active":"2024-09-21T07:22:53.764844+0000","last_peered":"2024-09-21T07:22:53.764844+0000","last_clean":"2024-09-21T07:22:53.764844+0000","last_became_active":"2024-09-21T07:22:52.782669+0000","last_became_peered":"2024-09-21T07:22:52.782669+0000","last_unstale":"2024-09-21T07:22:53.764844+0000","last_undegraded":"2024-09-21T07:22:53.764844+0000","last_fullsized":"2024-09-21T07:22:53.764844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:10.593769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764996+0000","last_change":"2024-09-21T07:22:48.746272+0000","last_active":"2024-09-21T07:22:53.764996+0000","last_peered":"2024-09-21T07:22:53.764996+0000","last_clean":"2024-09-21T07:22:53.764996+0000","last_became_active":"2024-09-21T07:22:48.745859+0000","last_became_peered":"2024-09-21T07:22:48.745859+0000","last_unstale":"2024-09-21T07:22:53.764996+0000","last_undegraded":"2024-09-21T07:22:53.764996+0000","last_fullsized":"2024-09-21T07:22:53.764996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024230+0000","last_change":"2024-09-21T07:22:48.735624+0000","last_active":"2024-09-21T07:22:54.024230+0000","last_peered":"2024-09-21T07:22:54.024230+0000","last_clean":"2024-09-21T07:22:54.024230+0000","last_became_active":"2024-09-21T07:22:48.735299+0000","last_became_peered":"2024-09-21T07:22:48.735299+0000","last_unstale":"2024-09-21T07:22:54.024230+0000","last_undegraded":"2024-09-21T07:22:54.024230+0000","last_fullsized":"2024-09-21T07:22:54.024230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765809+0000","last_change":"2024-09-21T07:22:48.754562+0000","last_active":"2024-09-21T07:22:53.765809+0000","last_peered":"2024-09-21T07:22:53.765809+0000","last_clean":"2024-09-21T07:22:53.765809+0000","last_became_active":"2024-09-21T07:22:48.753457+0000","last_became_peered":"2024-09-21T07:22:48.753457+0000","last_unstale":"2024-09-21T07:22:53.765809+0000","last_undegraded":"2024-09-21T07:22:53.765809+0000","last_fullsized":"2024-09-21T07:22:53.765809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:41.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027009+0000","last_change":"2024-09-21T07:22:48.751689+0000","last_active":"2024-09-21T07:22:54.027009+0000","last_peered":"2024-09-21T07:22:54.027009+0000","last_clean":"2024-09-21T07:22:54.027009+0000","last_became_active":"2024-09-21T07:22:48.751361+0000","last_became_peered":"2024-09-21T07:22:48.751361+0000","last_unstale":"2024-09-21T07:22:54.027009+0000","last_undegraded":"2024-09-21T07:22:54.027009+0000","last_fullsized":"2024-09-21T07:22:54.027009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764765+0000","last_change":"2024-09-21T07:22:48.759019+0000","last_active":"2024-09-21T07:22:53.764765+0000","last_peered":"2024-09-21T07:22:53.764765+0000","last_clean":"2024-09-21T07:22:53.764765+0000","last_became_active":"2024-09-21T07:22:48.758694+0000","last_became_peered":"2024-09-21T07:22:48.758694+0000","last_unstale":"2024-09-21T07:22:53.764765+0000","last_undegraded":"2024-09-21T07:22:53.764765+0000","last_fullsized":"2024-09-21T07:22:53.764765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024926+0000","last_change":"2024-09-21T07:22:48.723104+0000","last_active":"2024-09-21T07:22:54.024926+0000","last_peered":"2024-09-21T07:22:54.024926+0000","last_clean":"2024-09-21T07:22:54.024926+0000","last_became_active":"2024-09-21T07:22:48.722764+0000","last_became_peered":"2024-09-21T07:22:48.722764+0000","last_unstale":"2024-09-21T07:22:54.024926+0000","last_undegraded":"2024-09-21T07:22:54.024926+0000","last_fullsized":"2024-09-21T07:22:54.024926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:01.478325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767699+0000","last_change":"2024-09-21T07:22:48.742610+0000","last_active":"2024-09-21T07:22:53.767699+0000","last_peered":"2024-09-21T07:22:53.767699+0000","last_clean":"2024-09-21T07:22:53.767699+0000","last_became_active":"2024-09-21T07:22:48.737384+0000","last_became_peered":"2024-09-21T07:22:48.737384+0000","last_unstale":"2024-09-21T07:22:53.767699+0000","last_undegraded":"2024-09-21T07:22:53.767699+0000","last_fullsized":"2024-09-21T07:22:53.767699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764922+0000","last_change":"2024-09-21T07:22:48.738148+0000","last_active":"2024-09-21T07:22:53.764922+0000","last_peered":"2024-09-21T07:22:53.764922+0000","last_clean":"2024-09-21T07:22:53.764922+0000","last_became_active":"2024-09-21T07:22:48.737843+0000","last_became_peered":"2024-09-21T07:22:48.737843+0000","last_unstale":"2024-09-21T07:22:53.764922+0000","last_undegraded":"2024-09-21T07:22:53.764922+0000","last_fullsized":"2024-09-21T07:22:53.764922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:17.737322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765676+0000","last_change":"2024-09-21T07:22:48.740105+0000","last_active":"2024-09-21T07:22:53.765676+0000","last_peered":"2024-09-21T07:22:53.765676+0000","last_clean":"2024-09-21T07:22:53.765676+0000","last_became_active":"2024-09-21T07:22:48.739816+0000","last_became_peered":"2024-09-21T07:22:48.739816+0000","last_unstale":"2024-09-21T07:22:53.765676+0000","last_undegraded":"2024-09-21T07:22:53.765676+0000","last_fullsized":"2024-09-21T07:22:53.765676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764141+0000","last_change":"2024-09-21T07:22:48.741924+0000","last_active":"2024-09-21T07:22:53.764141+0000","last_peered":"2024-09-21T07:22:53.764141+0000","last_clean":"2024-09-21T07:22:53.764141+0000","last_became_active":"2024-09-21T07:22:48.741567+0000","last_became_peered":"2024-09-21T07:22:48.741567+0000","last_unstale":"2024-09-21T07:22:53.764141+0000","last_undegraded":"2024-09-21T07:22:53.764141+0000","last_fullsized":"2024-09-21T07:22:53.764141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:33.518751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765851+0000","last_change":"2024-09-21T07:22:48.729429+0000","last_active":"2024-09-21T07:22:53.765851+0000","last_peered":"2024-09-21T07:22:53.765851+0000","last_clean":"2024-09-21T07:22:53.765851+0000","last_became_active":"2024-09-21T07:22:48.729115+0000","last_became_peered":"2024-09-21T07:22:48.729115+0000","last_unstale":"2024-09-21T07:22:53.765851+0000","last_undegraded":"2024-09-21T07:22:53.765851+0000","last_fullsized":"2024-09-21T07:22:53.765851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:45.792793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026833+0000","last_change":"2024-09-21T07:22:48.739366+0000","last_active":"2024-09-21T07:22:54.026833+0000","last_peered":"2024-09-21T07:22:54.026833+0000","last_clean":"2024-09-21T07:22:54.026833+0000","last_became_active":"2024-09-21T07:22:48.738848+0000","last_became_peered":"2024-09-21T07:22:48.738848+0000","last_unstale":"2024-09-21T07:22:54.026833+0000","last_undegraded":"2024-09-21T07:22:54.026833+0000","last_fullsized":"2024-09-21T07:22:54.026833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742010+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.741123+0000","last_became_peered":"2024-09-21T07:22:48.741123+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893554+0000","last_change":"2024-09-21T07:22:48.733725+0000","last_active":"2024-09-21T07:22:53.893554+0000","last_peered":"2024-09-21T07:22:53.893554+0000","last_clean":"2024-09-21T07:22:53.893554+0000","last_became_active":"2024-09-21T07:22:48.733408+0000","last_became_peered":"2024-09-21T07:22:48.733408+0000","last_unstale":"2024-09-21T07:22:53.893554+0000","last_undegraded":"2024-09-21T07:22:53.893554+0000","last_fullsized":"2024-09-21T07:22:53.893554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:56.573091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025995+0000","last_change":"2024-09-21T07:22:48.733307+0000","last_active":"2024-09-21T07:22:54.025995+0000","last_peered":"2024-09-21T07:22:54.025995+0000","last_clean":"2024-09-21T07:22:54.025995+0000","last_became_active":"2024-09-21T07:22:48.732920+0000","last_became_peered":"2024-09-21T07:22:48.732920+0000","last_unstale":"2024-09-21T07:22:54.025995+0000","last_undegraded":"2024-09-21T07:22:54.025995+0000","last_fullsized":"2024-09-21T07:22:54.025995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.733360+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.733032+0000","last_became_peered":"2024-09-21T07:22:48.733032+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:34.232644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765534+0000","last_change":"2024-09-21T07:22:48.746150+0000","last_active":"2024-09-21T07:22:53.765534+0000","last_peered":"2024-09-21T07:22:53.765534+0000","last_clean":"2024-09-21T07:22:53.765534+0000","last_became_active":"2024-09-21T07:22:48.745814+0000","last_became_peered":"2024-09-21T07:22:48.745814+0000","last_unstale":"2024-09-21T07:22:53.765534+0000","last_undegraded":"2024-09-21T07:22:53.765534+0000","last_fullsized":"2024-09-21T07:22:53.765534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024701+0000","last_change":"2024-09-21T07:22:48.739733+0000","last_active":"2024-09-21T07:22:54.024701+0000","last_peered":"2024-09-21T07:22:54.024701+0000","last_clean":"2024-09-21T07:22:54.024701+0000","last_became_active":"2024-09-21T07:22:48.739428+0000","last_became_peered":"2024-09-21T07:22:48.739428+0000","last_unstale":"2024-09-21T07:22:54.024701+0000","last_undegraded":"2024-09-21T07:22:54.024701+0000","last_fullsized":"2024-09-21T07:22:54.024701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:08.474202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026517+0000","last_change":"2024-09-21T07:22:48.737610+0000","last_active":"2024-09-21T07:22:54.026517+0000","last_peered":"2024-09-21T07:22:54.026517+0000","last_clean":"2024-09-21T07:22:54.026517+0000","last_became_active":"2024-09-21T07:22:48.737248+0000","last_became_peered":"2024-09-21T07:22:48.737248+0000","last_unstale":"2024-09-21T07:22:54.026517+0000","last_undegraded":"2024-09-21T07:22:54.026517+0000","last_fullsized":"2024-09-21T07:22:54.026517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:12.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764170+0000","last_change":"2024-09-21T07:22:48.740790+0000","last_active":"2024-09-21T07:22:53.764170+0000","last_peered":"2024-09-21T07:22:53.764170+0000","last_clean":"2024-09-21T07:22:53.764170+0000","last_became_active":"2024-09-21T07:22:48.740145+0000","last_became_peered":"2024-09-21T07:22:48.740145+0000","last_unstale":"2024-09-21T07:22:53.764170+0000","last_undegraded":"2024-09-21T07:22:53.764170+0000","last_fullsized":"2024-09-21T07:22:53.764170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:31.562981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025501+0000","last_change":"2024-09-21T07:22:48.751370+0000","last_active":"2024-09-21T07:22:54.025501+0000","last_peered":"2024-09-21T07:22:54.025501+0000","last_clean":"2024-09-21T07:22:54.025501+0000","last_became_active":"2024-09-21T07:22:48.746516+0000","last_became_peered":"2024-09-21T07:22:48.746516+0000","last_unstale":"2024-09-21T07:22:54.025501+0000","last_undegraded":"2024-09-21T07:22:54.025501+0000","last_fullsized":"2024-09-21T07:22:54.025501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742862+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.736975+0000","last_became_peered":"2024-09-21T07:22:48.736975+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.732301+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.731301+0000","last_became_peered":"2024-09-21T07:22:48.731301+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893478+0000","last_change":"2024-09-21T07:22:48.736203+0000","last_active":"2024-09-21T07:22:53.893478+0000","last_peered":"2024-09-21T07:22:53.893478+0000","last_clean":"2024-09-21T07:22:53.893478+0000","last_became_active":"2024-09-21T07:22:48.735217+0000","last_became_peered":"2024-09-21T07:22:48.735217+0000","last_unstale":"2024-09-21T07:22:53.893478+0000","last_undegraded":"2024-09-21T07:22:53.893478+0000","last_fullsized":"2024-09-21T07:22:53.893478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:10.751312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763848+0000","last_change":"2024-09-21T07:22:48.739850+0000","last_active":"2024-09-21T07:22:53.763848+0000","last_peered":"2024-09-21T07:22:53.763848+0000","last_clean":"2024-09-21T07:22:53.763848+0000","last_became_active":"2024-09-21T07:22:48.738820+0000","last_became_peered":"2024-09-21T07:22:48.738820+0000","last_unstale":"2024-09-21T07:22:53.763848+0000","last_undegraded":"2024-09-21T07:22:53.763848+0000","last_fullsized":"2024-09-21T07:22:53.763848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:11.644683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892810+0000","last_change":"2024-09-21T07:22:48.749899+0000","last_active":"2024-09-21T07:22:53.892810+0000","last_peered":"2024-09-21T07:22:53.892810+0000","last_clean":"2024-09-21T07:22:53.892810+0000","last_became_active":"2024-09-21T07:22:48.748269+0000","last_became_peered":"2024-09-21T07:22:48.748269+0000","last_unstale":"2024-09-21T07:22:53.892810+0000","last_undegraded":"2024-09-21T07:22:53.892810+0000","last_fullsized":"2024-09-21T07:22:53.892810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:54.034703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765685+0000","last_change":"2024-09-21T07:22:48.750088+0000","last_active":"2024-09-21T07:22:53.765685+0000","last_peered":"2024-09-21T07:22:53.765685+0000","last_clean":"2024-09-21T07:22:53.765685+0000","last_became_active":"2024-09-21T07:22:48.749780+0000","last_became_peered":"2024-09-21T07:22:48.749780+0000","last_unstale":"2024-09-21T07:22:53.765685+0000","last_undegraded":"2024-09-21T07:22:53.765685+0000","last_fullsized":"2024-09-21T07:22:53.765685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:23.057892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892813+0000","last_change":"2024-09-21T07:22:48.741748+0000","last_active":"2024-09-21T07:22:53.892813+0000","last_peered":"2024-09-21T07:22:53.892813+0000","last_clean":"2024-09-21T07:22:53.892813+0000","last_became_active":"2024-09-21T07:22:48.739240+0000","last_became_peered":"2024-09-21T07:22:48.739240+0000","last_unstale":"2024-09-21T07:22:53.892813+0000","last_undegraded":"2024-09-21T07:22:53.892813+0000","last_fullsized":"2024-09-21T07:22:53.892813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766446+0000","last_change":"2024-09-21T07:22:48.749807+0000","last_active":"2024-09-21T07:22:53.766446+0000","last_peered":"2024-09-21T07:22:53.766446+0000","last_clean":"2024-09-21T07:22:53.766446+0000","last_became_active":"2024-09-21T07:22:48.749133+0000","last_became_peered":"2024-09-21T07:22:48.749133+0000","last_unstale":"2024-09-21T07:22:53.766446+0000","last_undegraded":"2024-09-21T07:22:53.766446+0000","last_fullsized":"2024-09-21T07:22:53.766446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:04.259181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027319+0000","last_change":"2024-09-21T07:22:48.747149+0000","last_active":"2024-09-21T07:22:54.027319+0000","last_peered":"2024-09-21T07:22:54.027319+0000","last_clean":"2024-09-21T07:22:54.027319+0000","last_became_active":"2024-09-21T07:22:48.745587+0000","last_became_peered":"2024-09-21T07:22:48.745587+0000","last_unstale":"2024-09-21T07:22:54.027319+0000","last_undegraded":"2024-09-21T07:22:54.027319+0000","last_fullsized":"2024-09-21T07:22:54.027319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025332+0000","last_change":"2024-09-21T07:22:48.738773+0000","last_active":"2024-09-21T07:22:54.025332+0000","last_peered":"2024-09-21T07:22:54.025332+0000","last_clean":"2024-09-21T07:22:54.025332+0000","last_became_active":"2024-09-21T07:22:48.738521+0000","last_became_peered":"2024-09-21T07:22:48.738521+0000","last_unstale":"2024-09-21T07:22:54.025332+0000","last_undegraded":"2024-09-21T07:22:54.025332+0000","last_fullsized":"2024-09-21T07:22:54.025332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:42.041043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893340+0000","last_change":"2024-09-21T07:22:48.750274+0000","last_active":"2024-09-21T07:22:53.893340+0000","last_peered":"2024-09-21T07:22:53.893340+0000","last_clean":"2024-09-21T07:22:53.893340+0000","last_became_active":"2024-09-21T07:22:48.748751+0000","last_became_peered":"2024-09-21T07:22:48.748751+0000","last_unstale":"2024-09-21T07:22:53.893340+0000","last_undegraded":"2024-09-21T07:22:53.893340+0000","last_fullsized":"2024-09-21T07:22:53.893340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:28.162100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":107492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":698282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:05.002 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:05.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- 172.21.15.64:0/4106279530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 msgr2=0x7effc40040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 --2- 172.21.15.64:0/4106279530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effc40040e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7effd0009b60 tx=0x7effd001d260 comp rx=0 tx=0).stop 2024-09-21T07:23:05.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe1600640 1 -- 172.21.15.64:0/4106279530 reap_dead start 2024-09-21T07:23:05.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- 172.21.15.64:0/4106279530 shutdown_connections 2024-09-21T07:23:05.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- 172.21.15.64:0/4106279530 >> 172.21.15.64:0/4106279530 conn(0x7effdc06d1c0 msgr2=0x7effdc06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:05.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- 172.21.15.64:0/4106279530 shutdown_connections 2024-09-21T07:23:05.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- 172.21.15.64:0/4106279530 wait complete. 2024-09-21T07:23:05.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 Processor -- start 2024-09-21T07:23:05.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.201+0000 7effe3600640 1 -- start start 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effdc154da0 0x7effdc1f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effdc0b75a0 0x7effdc0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7effdc168ef0 con 0x7effc4003c90 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effdc168d70 con 0x7effdc154da0 2024-09-21T07:23:05.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7effdc169070 con 0x7effdc0b75a0 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39572/0 (socket says 172.21.15.64:39572) 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 -- 172.21.15.64:0/475143102 learned_addr learned my addr 172.21.15.64:0/475143102 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effdbe00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effdc154da0 0x7effdc1f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe1600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effdc0b75a0 0x7effdc0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 -- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effdc0b75a0 msgr2=0x7effdc0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effdc0b75a0 0x7effdc0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 -- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effdc154da0 msgr2=0x7effdc1f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effdc154da0 0x7effdc1f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 -- 172.21.15.64:0/475143102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc153fe0 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe0c00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7effd0009b60 tx=0x7effd0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd00b1040 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd00bb070 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc0c71d0 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc1542c0 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc154880 con 0x7effc4003c90 2024-09-21T07:23:05.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.205+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc0c62b0 con 0x7effc4003c90 2024-09-21T07:23:05.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.209+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7effd0004290 con 0x7effc4003c90 2024-09-21T07:23:05.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.209+0000 7effd8c00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 0x7effbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.209+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7effd012f510 con 0x7effc4003c90 2024-09-21T07:23:05.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.209+0000 7effdbe00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 0x7effbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.209+0000 7effdbe00640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 0x7effbc075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc8001000 tx=0x7effc8000f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:05.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.213+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7effd0016fa0 con 0x7effc4003c90 2024-09-21T07:23:05.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.385+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effdc069400 con 0x7effbc073200 2024-09-21T07:23:05.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.393+0000 7effd8c00640 1 -- 172.21.15.64:0/475143102 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332547 (secure 0 0 0) 0x7effdc069400 con 0x7effbc073200 2024-09-21T07:23:05.401 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:05.403 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 msgr2=0x7effbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 0x7effbc075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc8001000 tx=0x7effc8000f90 comp rx=0 tx=0).stop 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 msgr2=0x7effdc1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7effd0009b60 tx=0x7effd0005590 comp rx=0 tx=0).stop 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 shutdown_connections 2024-09-21T07:23:05.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effbc073200 0x7effbc075710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effdc0b75a0 0x7effdc0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effdc154da0 0x7effdc1f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 --2- 172.21.15.64:0/475143102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effc4003c90 0x7effdc1552d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 >> 172.21.15.64:0/475143102 conn(0x7effdc06d1c0 msgr2=0x7effdc15a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 shutdown_connections 2024-09-21T07:23:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.397+0000 7effe3600640 1 -- 172.21.15.64:0/475143102 wait complete. 2024-09-21T07:23:05.422 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-21T07:23:03.419858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2046891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003033"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027628+0000","last_change":"2024-09-21T07:22:47.742250+0000","last_active":"2024-09-21T07:22:54.027628+0000","last_peered":"2024-09-21T07:22:54.027628+0000","last_clean":"2024-09-21T07:22:54.027628+0000","last_became_active":"2024-09-21T07:22:47.741257+0000","last_became_peered":"2024-09-21T07:22:47.741257+0000","last_unstale":"2024-09-21T07:22:54.027628+0000","last_undegraded":"2024-09-21T07:22:54.027628+0000","last_fullsized":"2024-09-21T07:22:54.027628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764663+0000","last_change":"2024-09-21T07:22:48.740833+0000","last_active":"2024-09-21T07:22:53.764663+0000","last_peered":"2024-09-21T07:22:53.764663+0000","last_clean":"2024-09-21T07:22:53.764663+0000","last_became_active":"2024-09-21T07:22:48.740377+0000","last_became_peered":"2024-09-21T07:22:48.740377+0000","last_unstale":"2024-09-21T07:22:53.764663+0000","last_undegraded":"2024-09-21T07:22:53.764663+0000","last_fullsized":"2024-09-21T07:22:53.764663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:17.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764017+0000","last_change":"2024-09-21T07:22:53.073187+0000","last_active":"2024-09-21T07:22:53.764017+0000","last_peered":"2024-09-21T07:22:53.764017+0000","last_clean":"2024-09-21T07:22:53.764017+0000","last_became_active":"2024-09-21T07:22:53.072636+0000","last_became_peered":"2024-09-21T07:22:53.072636+0000","last_unstale":"2024-09-21T07:22:53.764017+0000","last_undegraded":"2024-09-21T07:22:53.764017+0000","last_fullsized":"2024-09-21T07:22:53.764017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:13.190959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764937+0000","last_change":"2024-09-21T07:22:47.736091+0000","last_active":"2024-09-21T07:22:53.764937+0000","last_peered":"2024-09-21T07:22:53.764937+0000","last_clean":"2024-09-21T07:22:53.764937+0000","last_became_active":"2024-09-21T07:22:47.735733+0000","last_became_peered":"2024-09-21T07:22:47.735733+0000","last_unstale":"2024-09-21T07:22:53.764937+0000","last_undegraded":"2024-09-21T07:22:53.764937+0000","last_fullsized":"2024-09-21T07:22:53.764937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:08.564048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027377+0000","last_change":"2024-09-21T07:22:48.751664+0000","last_active":"2024-09-21T07:22:54.027377+0000","last_peered":"2024-09-21T07:22:54.027377+0000","last_clean":"2024-09-21T07:22:54.027377+0000","last_became_active":"2024-09-21T07:22:48.751327+0000","last_became_peered":"2024-09-21T07:22:48.751327+0000","last_unstale":"2024-09-21T07:22:54.027377+0000","last_undegraded":"2024-09-21T07:22:54.027377+0000","last_fullsized":"2024-09-21T07:22:54.027377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024710+0000","last_change":"2024-09-21T07:22:52.783270+0000","last_active":"2024-09-21T07:22:54.024710+0000","last_peered":"2024-09-21T07:22:54.024710+0000","last_clean":"2024-09-21T07:22:54.024710+0000","last_became_active":"2024-09-21T07:22:52.782796+0000","last_became_peered":"2024-09-21T07:22:52.782796+0000","last_unstale":"2024-09-21T07:22:54.024710+0000","last_undegraded":"2024-09-21T07:22:54.024710+0000","last_fullsized":"2024-09-21T07:22:54.024710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:50:20.520920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893408+0000","last_change":"2024-09-21T07:22:47.744126+0000","last_active":"2024-09-21T07:22:53.893408+0000","last_peered":"2024-09-21T07:22:53.893408+0000","last_clean":"2024-09-21T07:22:53.893408+0000","last_became_active":"2024-09-21T07:22:47.743644+0000","last_became_peered":"2024-09-21T07:22:47.743644+0000","last_unstale":"2024-09-21T07:22:53.893408+0000","last_undegraded":"2024-09-21T07:22:53.893408+0000","last_fullsized":"2024-09-21T07:22:53.893408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:29.063190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766496+0000","last_change":"2024-09-21T07:22:48.734135+0000","last_active":"2024-09-21T07:22:53.766496+0000","last_peered":"2024-09-21T07:22:53.766496+0000","last_clean":"2024-09-21T07:22:53.766496+0000","last_became_active":"2024-09-21T07:22:48.733798+0000","last_became_peered":"2024-09-21T07:22:48.733798+0000","last_unstale":"2024-09-21T07:22:53.766496+0000","last_undegraded":"2024-09-21T07:22:53.766496+0000","last_fullsized":"2024-09-21T07:22:53.766496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:34.239566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025181+0000","last_change":"2024-09-21T07:22:52.783122+0000","last_active":"2024-09-21T07:22:54.025181+0000","last_peered":"2024-09-21T07:22:54.025181+0000","last_clean":"2024-09-21T07:22:54.025181+0000","last_became_active":"2024-09-21T07:22:52.782549+0000","last_became_peered":"2024-09-21T07:22:52.782549+0000","last_unstale":"2024-09-21T07:22:54.025181+0000","last_undegraded":"2024-09-21T07:22:54.025181+0000","last_fullsized":"2024-09-21T07:22:54.025181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:34.419031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893397+0000","last_change":"2024-09-21T07:22:47.742860+0000","last_active":"2024-09-21T07:22:53.893397+0000","last_peered":"2024-09-21T07:22:53.893397+0000","last_clean":"2024-09-21T07:22:53.893397+0000","last_became_active":"2024-09-21T07:22:47.742543+0000","last_became_peered":"2024-09-21T07:22:47.742543+0000","last_unstale":"2024-09-21T07:22:53.893397+0000","last_undegraded":"2024-09-21T07:22:53.893397+0000","last_fullsized":"2024-09-21T07:22:53.893397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:11.203283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767084+0000","last_change":"2024-09-21T07:22:48.731433+0000","last_active":"2024-09-21T07:22:53.767084+0000","last_peered":"2024-09-21T07:22:53.767084+0000","last_clean":"2024-09-21T07:22:53.767084+0000","last_became_active":"2024-09-21T07:22:48.730230+0000","last_became_peered":"2024-09-21T07:22:48.730230+0000","last_unstale":"2024-09-21T07:22:53.767084+0000","last_undegraded":"2024-09-21T07:22:53.767084+0000","last_fullsized":"2024-09-21T07:22:53.767084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:35.738074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024779+0000","last_change":"2024-09-21T07:22:52.785170+0000","last_active":"2024-09-21T07:22:54.024779+0000","last_peered":"2024-09-21T07:22:54.024779+0000","last_clean":"2024-09-21T07:22:54.024779+0000","last_became_active":"2024-09-21T07:22:52.784767+0000","last_became_peered":"2024-09-21T07:22:52.784767+0000","last_unstale":"2024-09-21T07:22:54.024779+0000","last_undegraded":"2024-09-21T07:22:54.024779+0000","last_fullsized":"2024-09-21T07:22:54.024779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:48.957476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766904+0000","last_change":"2024-09-21T07:22:48.741283+0000","last_active":"2024-09-21T07:22:53.766904+0000","last_peered":"2024-09-21T07:22:53.766904+0000","last_clean":"2024-09-21T07:22:53.766904+0000","last_became_active":"2024-09-21T07:22:48.740907+0000","last_became_peered":"2024-09-21T07:22:48.740907+0000","last_unstale":"2024-09-21T07:22:53.766904+0000","last_undegraded":"2024-09-21T07:22:53.766904+0000","last_fullsized":"2024-09-21T07:22:53.766904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893462+0000","last_change":"2024-09-21T07:22:47.744642+0000","last_active":"2024-09-21T07:22:53.893462+0000","last_peered":"2024-09-21T07:22:53.893462+0000","last_clean":"2024-09-21T07:22:53.893462+0000","last_became_active":"2024-09-21T07:22:47.744170+0000","last_became_peered":"2024-09-21T07:22:47.744170+0000","last_unstale":"2024-09-21T07:22:53.893462+0000","last_undegraded":"2024-09-21T07:22:53.893462+0000","last_fullsized":"2024-09-21T07:22:53.893462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:22.987361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025596+0000","last_change":"2024-09-21T07:22:52.790836+0000","last_active":"2024-09-21T07:22:54.025596+0000","last_peered":"2024-09-21T07:22:54.025596+0000","last_clean":"2024-09-21T07:22:54.025596+0000","last_became_active":"2024-09-21T07:22:52.790363+0000","last_became_peered":"2024-09-21T07:22:52.790363+0000","last_unstale":"2024-09-21T07:22:54.025596+0000","last_undegraded":"2024-09-21T07:22:54.025596+0000","last_fullsized":"2024-09-21T07:22:54.025596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:37.910110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764396+0000","last_change":"2024-09-21T07:22:48.745313+0000","last_active":"2024-09-21T07:22:53.764396+0000","last_peered":"2024-09-21T07:22:53.764396+0000","last_clean":"2024-09-21T07:22:53.764396+0000","last_became_active":"2024-09-21T07:22:48.744930+0000","last_became_peered":"2024-09-21T07:22:48.744930+0000","last_unstale":"2024-09-21T07:22:53.764396+0000","last_undegraded":"2024-09-21T07:22:53.764396+0000","last_fullsized":"2024-09-21T07:22:53.764396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:10.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025330+0000","last_change":"2024-09-21T07:22:47.734173+0000","last_active":"2024-09-21T07:22:54.025330+0000","last_peered":"2024-09-21T07:22:54.025330+0000","last_clean":"2024-09-21T07:22:54.025330+0000","last_became_active":"2024-09-21T07:22:47.733708+0000","last_became_peered":"2024-09-21T07:22:47.733708+0000","last_unstale":"2024-09-21T07:22:54.025330+0000","last_undegraded":"2024-09-21T07:22:54.025330+0000","last_fullsized":"2024-09-21T07:22:54.025330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:30.464654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025043+0000","last_change":"2024-09-21T07:22:52.783224+0000","last_active":"2024-09-21T07:22:54.025043+0000","last_peered":"2024-09-21T07:22:54.025043+0000","last_clean":"2024-09-21T07:22:54.025043+0000","last_became_active":"2024-09-21T07:22:52.782848+0000","last_became_peered":"2024-09-21T07:22:52.782848+0000","last_unstale":"2024-09-21T07:22:54.025043+0000","last_undegraded":"2024-09-21T07:22:54.025043+0000","last_fullsized":"2024-09-21T07:22:54.025043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:05.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764138+0000","last_change":"2024-09-21T07:22:48.732990+0000","last_active":"2024-09-21T07:22:53.764138+0000","last_peered":"2024-09-21T07:22:53.764138+0000","last_clean":"2024-09-21T07:22:53.764138+0000","last_became_active":"2024-09-21T07:22:48.721772+0000","last_became_peered":"2024-09-21T07:22:48.721772+0000","last_unstale":"2024-09-21T07:22:53.764138+0000","last_undegraded":"2024-09-21T07:22:53.764138+0000","last_fullsized":"2024-09-21T07:22:53.764138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:12.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:47.735072+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:47.734618+0000","last_became_peered":"2024-09-21T07:22:47.734618+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:28.092443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025531+0000","last_change":"2024-09-21T07:22:53.066457+0000","last_active":"2024-09-21T07:22:54.025531+0000","last_peered":"2024-09-21T07:22:54.025531+0000","last_clean":"2024-09-21T07:22:54.025531+0000","last_became_active":"2024-09-21T07:22:53.065989+0000","last_became_peered":"2024-09-21T07:22:53.065989+0000","last_unstale":"2024-09-21T07:22:54.025531+0000","last_undegraded":"2024-09-21T07:22:54.025531+0000","last_fullsized":"2024-09-21T07:22:54.025531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:44.966857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025245+0000","last_change":"2024-09-21T07:22:48.737581+0000","last_active":"2024-09-21T07:22:54.025245+0000","last_peered":"2024-09-21T07:22:54.025245+0000","last_clean":"2024-09-21T07:22:54.025245+0000","last_became_active":"2024-09-21T07:22:48.737143+0000","last_became_peered":"2024-09-21T07:22:48.737143+0000","last_unstale":"2024-09-21T07:22:54.025245+0000","last_undegraded":"2024-09-21T07:22:54.025245+0000","last_fullsized":"2024-09-21T07:22:54.025245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:45.110572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892658+0000","last_change":"2024-09-21T07:22:47.748620+0000","last_active":"2024-09-21T07:22:53.892658+0000","last_peered":"2024-09-21T07:22:53.892658+0000","last_clean":"2024-09-21T07:22:53.892658+0000","last_became_active":"2024-09-21T07:22:47.744065+0000","last_became_peered":"2024-09-21T07:22:47.744065+0000","last_unstale":"2024-09-21T07:22:53.892658+0000","last_undegraded":"2024-09-21T07:22:53.892658+0000","last_fullsized":"2024-09-21T07:22:53.892658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:49.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025379+0000","last_change":"2024-09-21T07:22:52.784325+0000","last_active":"2024-09-21T07:22:54.025379+0000","last_peered":"2024-09-21T07:22:54.025379+0000","last_clean":"2024-09-21T07:22:54.025379+0000","last_became_active":"2024-09-21T07:22:52.783906+0000","last_became_peered":"2024-09-21T07:22:52.783906+0000","last_unstale":"2024-09-21T07:22:54.025379+0000","last_undegraded":"2024-09-21T07:22:54.025379+0000","last_fullsized":"2024-09-21T07:22:54.025379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:39.780829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027640+0000","last_change":"2024-09-21T07:22:48.740991+0000","last_active":"2024-09-21T07:22:54.027640+0000","last_peered":"2024-09-21T07:22:54.027640+0000","last_clean":"2024-09-21T07:22:54.027640+0000","last_became_active":"2024-09-21T07:22:48.738376+0000","last_became_peered":"2024-09-21T07:22:48.738376+0000","last_unstale":"2024-09-21T07:22:54.027640+0000","last_undegraded":"2024-09-21T07:22:54.027640+0000","last_fullsized":"2024-09-21T07:22:54.027640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.768082+0000","last_change":"2024-09-21T07:22:47.733080+0000","last_active":"2024-09-21T07:22:53.768082+0000","last_peered":"2024-09-21T07:22:53.768082+0000","last_clean":"2024-09-21T07:22:53.768082+0000","last_became_active":"2024-09-21T07:22:47.731545+0000","last_became_peered":"2024-09-21T07:22:47.731545+0000","last_unstale":"2024-09-21T07:22:53.768082+0000","last_undegraded":"2024-09-21T07:22:53.768082+0000","last_fullsized":"2024-09-21T07:22:53.768082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:55.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:53.070212+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:53.069615+0000","last_became_peered":"2024-09-21T07:22:53.069615+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:37.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765003+0000","last_change":"2024-09-21T07:22:48.733662+0000","last_active":"2024-09-21T07:22:53.765003+0000","last_peered":"2024-09-21T07:22:53.765003+0000","last_clean":"2024-09-21T07:22:53.765003+0000","last_became_active":"2024-09-21T07:22:48.733358+0000","last_became_peered":"2024-09-21T07:22:48.733358+0000","last_unstale":"2024-09-21T07:22:53.765003+0000","last_undegraded":"2024-09-21T07:22:53.765003+0000","last_fullsized":"2024-09-21T07:22:53.765003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025409+0000","last_change":"2024-09-21T07:22:47.737459+0000","last_active":"2024-09-21T07:22:54.025409+0000","last_peered":"2024-09-21T07:22:54.025409+0000","last_clean":"2024-09-21T07:22:54.025409+0000","last_became_active":"2024-09-21T07:22:47.737043+0000","last_became_peered":"2024-09-21T07:22:47.737043+0000","last_unstale":"2024-09-21T07:22:54.025409+0000","last_undegraded":"2024-09-21T07:22:54.025409+0000","last_fullsized":"2024-09-21T07:22:54.025409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:49.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763838+0000","last_change":"2024-09-21T07:22:53.070153+0000","last_active":"2024-09-21T07:22:53.763838+0000","last_peered":"2024-09-21T07:22:53.763838+0000","last_clean":"2024-09-21T07:22:53.763838+0000","last_became_active":"2024-09-21T07:22:53.066002+0000","last_became_peered":"2024-09-21T07:22:53.066002+0000","last_unstale":"2024-09-21T07:22:53.763838+0000","last_undegraded":"2024-09-21T07:22:53.763838+0000","last_fullsized":"2024-09-21T07:22:53.763838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:49.615596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024993+0000","last_change":"2024-09-21T07:22:48.730184+0000","last_active":"2024-09-21T07:22:54.024993+0000","last_peered":"2024-09-21T07:22:54.024993+0000","last_clean":"2024-09-21T07:22:54.024993+0000","last_became_active":"2024-09-21T07:22:48.729821+0000","last_became_peered":"2024-09-21T07:22:48.729821+0000","last_unstale":"2024-09-21T07:22:54.024993+0000","last_undegraded":"2024-09-21T07:22:54.024993+0000","last_fullsized":"2024-09-21T07:22:54.024993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:54.261987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893561+0000","last_change":"2024-09-21T07:22:47.745201+0000","last_active":"2024-09-21T07:22:53.893561+0000","last_peered":"2024-09-21T07:22:53.893561+0000","last_clean":"2024-09-21T07:22:53.893561+0000","last_became_active":"2024-09-21T07:22:47.744914+0000","last_became_peered":"2024-09-21T07:22:47.744914+0000","last_unstale":"2024-09-21T07:22:53.893561+0000","last_undegraded":"2024-09-21T07:22:53.893561+0000","last_fullsized":"2024-09-21T07:22:53.893561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.942934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026739+0000","last_change":"2024-09-21T07:22:53.063753+0000","last_active":"2024-09-21T07:22:54.026739+0000","last_peered":"2024-09-21T07:22:54.026739+0000","last_clean":"2024-09-21T07:22:54.026739+0000","last_became_active":"2024-09-21T07:22:53.063293+0000","last_became_peered":"2024-09-21T07:22:53.063293+0000","last_unstale":"2024-09-21T07:22:54.026739+0000","last_undegraded":"2024-09-21T07:22:54.026739+0000","last_fullsized":"2024-09-21T07:22:54.026739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767116+0000","last_change":"2024-09-21T07:22:48.753861+0000","last_active":"2024-09-21T07:22:53.767116+0000","last_peered":"2024-09-21T07:22:53.767116+0000","last_clean":"2024-09-21T07:22:53.767116+0000","last_became_active":"2024-09-21T07:22:48.753511+0000","last_became_peered":"2024-09-21T07:22:48.753511+0000","last_unstale":"2024-09-21T07:22:53.767116+0000","last_undegraded":"2024-09-21T07:22:53.767116+0000","last_fullsized":"2024-09-21T07:22:53.767116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:01.976003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025525+0000","last_change":"2024-09-21T07:22:47.737833+0000","last_active":"2024-09-21T07:22:54.025525+0000","last_peered":"2024-09-21T07:22:54.025525+0000","last_clean":"2024-09-21T07:22:54.025525+0000","last_became_active":"2024-09-21T07:22:47.736895+0000","last_became_peered":"2024-09-21T07:22:47.736895+0000","last_unstale":"2024-09-21T07:22:54.025525+0000","last_undegraded":"2024-09-21T07:22:54.025525+0000","last_fullsized":"2024-09-21T07:22:54.025525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:17.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024946+0000","last_change":"2024-09-21T07:22:52.781483+0000","last_active":"2024-09-21T07:22:54.024946+0000","last_peered":"2024-09-21T07:22:54.024946+0000","last_clean":"2024-09-21T07:22:54.024946+0000","last_became_active":"2024-09-21T07:22:52.778544+0000","last_became_peered":"2024-09-21T07:22:52.778544+0000","last_unstale":"2024-09-21T07:22:54.024946+0000","last_undegraded":"2024-09-21T07:22:54.024946+0000","last_fullsized":"2024-09-21T07:22:54.024946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:58.932426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025560+0000","last_change":"2024-09-21T07:22:48.751678+0000","last_active":"2024-09-21T07:22:54.025560+0000","last_peered":"2024-09-21T07:22:54.025560+0000","last_clean":"2024-09-21T07:22:54.025560+0000","last_became_active":"2024-09-21T07:22:48.744782+0000","last_became_peered":"2024-09-21T07:22:48.744782+0000","last_unstale":"2024-09-21T07:22:54.025560+0000","last_undegraded":"2024-09-21T07:22:54.025560+0000","last_fullsized":"2024-09-21T07:22:54.025560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:56.871086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766106+0000","last_change":"2024-09-21T07:22:47.727167+0000","last_active":"2024-09-21T07:22:53.766106+0000","last_peered":"2024-09-21T07:22:53.766106+0000","last_clean":"2024-09-21T07:22:53.766106+0000","last_became_active":"2024-09-21T07:22:47.726894+0000","last_became_peered":"2024-09-21T07:22:47.726894+0000","last_unstale":"2024-09-21T07:22:53.766106+0000","last_undegraded":"2024-09-21T07:22:53.766106+0000","last_fullsized":"2024-09-21T07:22:53.766106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:31.716302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024795+0000","last_change":"2024-09-21T07:22:52.783725+0000","last_active":"2024-09-21T07:22:54.024795+0000","last_peered":"2024-09-21T07:22:54.024795+0000","last_clean":"2024-09-21T07:22:54.024795+0000","last_became_active":"2024-09-21T07:22:52.778895+0000","last_became_peered":"2024-09-21T07:22:52.778895+0000","last_unstale":"2024-09-21T07:22:54.024795+0000","last_undegraded":"2024-09-21T07:22:54.024795+0000","last_fullsized":"2024-09-21T07:22:54.024795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:19.056150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024676+0000","last_change":"2024-09-21T07:22:48.737222+0000","last_active":"2024-09-21T07:22:54.024676+0000","last_peered":"2024-09-21T07:22:54.024676+0000","last_clean":"2024-09-21T07:22:54.024676+0000","last_became_active":"2024-09-21T07:22:48.736340+0000","last_became_peered":"2024-09-21T07:22:48.736340+0000","last_unstale":"2024-09-21T07:22:54.024676+0000","last_undegraded":"2024-09-21T07:22:54.024676+0000","last_fullsized":"2024-09-21T07:22:54.024676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:37.469062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024338+0000","last_change":"2024-09-21T07:22:47.713035+0000","last_active":"2024-09-21T07:22:54.024338+0000","last_peered":"2024-09-21T07:22:54.024338+0000","last_clean":"2024-09-21T07:22:54.024338+0000","last_became_active":"2024-09-21T07:22:47.711447+0000","last_became_peered":"2024-09-21T07:22:47.711447+0000","last_unstale":"2024-09-21T07:22:54.024338+0000","last_undegraded":"2024-09-21T07:22:54.024338+0000","last_fullsized":"2024-09-21T07:22:54.024338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:21.821706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025552+0000","last_change":"2024-09-21T07:22:52.783218+0000","last_active":"2024-09-21T07:22:54.025552+0000","last_peered":"2024-09-21T07:22:54.025552+0000","last_clean":"2024-09-21T07:22:54.025552+0000","last_became_active":"2024-09-21T07:22:52.778288+0000","last_became_peered":"2024-09-21T07:22:52.778288+0000","last_unstale":"2024-09-21T07:22:54.025552+0000","last_undegraded":"2024-09-21T07:22:54.025552+0000","last_fullsized":"2024-09-21T07:22:54.025552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:50.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026221+0000","last_change":"2024-09-21T07:22:48.748027+0000","last_active":"2024-09-21T07:22:54.026221+0000","last_peered":"2024-09-21T07:22:54.026221+0000","last_clean":"2024-09-21T07:22:54.026221+0000","last_became_active":"2024-09-21T07:22:48.747687+0000","last_became_peered":"2024-09-21T07:22:48.747687+0000","last_unstale":"2024-09-21T07:22:54.026221+0000","last_undegraded":"2024-09-21T07:22:54.026221+0000","last_fullsized":"2024-09-21T07:22:54.026221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:55.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893031+0000","last_change":"2024-09-21T07:22:47.744531+0000","last_active":"2024-09-21T07:22:53.893031+0000","last_peered":"2024-09-21T07:22:53.893031+0000","last_clean":"2024-09-21T07:22:53.893031+0000","last_became_active":"2024-09-21T07:22:47.744113+0000","last_became_peered":"2024-09-21T07:22:47.744113+0000","last_unstale":"2024-09-21T07:22:53.893031+0000","last_undegraded":"2024-09-21T07:22:53.893031+0000","last_fullsized":"2024-09-21T07:22:53.893031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:16.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027637+0000","last_change":"2024-09-21T07:22:53.068210+0000","last_active":"2024-09-21T07:22:54.027637+0000","last_peered":"2024-09-21T07:22:54.027637+0000","last_clean":"2024-09-21T07:22:54.027637+0000","last_became_active":"2024-09-21T07:22:53.067263+0000","last_became_peered":"2024-09-21T07:22:53.067263+0000","last_unstale":"2024-09-21T07:22:54.027637+0000","last_undegraded":"2024-09-21T07:22:54.027637+0000","last_fullsized":"2024-09-21T07:22:54.027637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:27.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764606+0000","last_change":"2024-09-21T07:22:48.738259+0000","last_active":"2024-09-21T07:22:53.764606+0000","last_peered":"2024-09-21T07:22:53.764606+0000","last_clean":"2024-09-21T07:22:53.764606+0000","last_became_active":"2024-09-21T07:22:48.737926+0000","last_became_peered":"2024-09-21T07:22:48.737926+0000","last_unstale":"2024-09-21T07:22:53.764606+0000","last_undegraded":"2024-09-21T07:22:53.764606+0000","last_fullsized":"2024-09-21T07:22:53.764606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:55.324437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766223+0000","last_change":"2024-09-21T07:22:47.719687+0000","last_active":"2024-09-21T07:22:53.766223+0000","last_peered":"2024-09-21T07:22:53.766223+0000","last_clean":"2024-09-21T07:22:53.766223+0000","last_became_active":"2024-09-21T07:22:47.719298+0000","last_became_peered":"2024-09-21T07:22:47.719298+0000","last_unstale":"2024-09-21T07:22:53.766223+0000","last_undegraded":"2024-09-21T07:22:53.766223+0000","last_fullsized":"2024-09-21T07:22:53.766223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:44.103579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892817+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:22:53.892817+0000","last_peered":"2024-09-21T07:22:53.892817+0000","last_clean":"2024-09-21T07:22:53.892817+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:22:53.892817+0000","last_undegraded":"2024-09-21T07:22:53.892817+0000","last_fullsized":"2024-09-21T07:22:53.892817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767042+0000","last_change":"2024-09-21T07:22:53.066672+0000","last_active":"2024-09-21T07:22:53.767042+0000","last_peered":"2024-09-21T07:22:53.767042+0000","last_clean":"2024-09-21T07:22:53.767042+0000","last_became_active":"2024-09-21T07:22:53.066192+0000","last_became_peered":"2024-09-21T07:22:53.066192+0000","last_unstale":"2024-09-21T07:22:53.767042+0000","last_undegraded":"2024-09-21T07:22:53.767042+0000","last_fullsized":"2024-09-21T07:22:53.767042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.796201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893182+0000","last_change":"2024-09-21T07:22:48.734582+0000","last_active":"2024-09-21T07:22:53.893182+0000","last_peered":"2024-09-21T07:22:53.893182+0000","last_clean":"2024-09-21T07:22:53.893182+0000","last_became_active":"2024-09-21T07:22:48.734240+0000","last_became_peered":"2024-09-21T07:22:48.734240+0000","last_unstale":"2024-09-21T07:22:53.893182+0000","last_undegraded":"2024-09-21T07:22:53.893182+0000","last_fullsized":"2024-09-21T07:22:53.893182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:09.879302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025524+0000","last_change":"2024-09-21T07:22:47.733880+0000","last_active":"2024-09-21T07:22:54.025524+0000","last_peered":"2024-09-21T07:22:54.025524+0000","last_clean":"2024-09-21T07:22:54.025524+0000","last_became_active":"2024-09-21T07:22:47.733393+0000","last_became_peered":"2024-09-21T07:22:47.733393+0000","last_unstale":"2024-09-21T07:22:54.025524+0000","last_undegraded":"2024-09-21T07:22:54.025524+0000","last_fullsized":"2024-09-21T07:22:54.025524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766698+0000","last_change":"2024-09-21T07:22:53.063609+0000","last_active":"2024-09-21T07:22:53.766698+0000","last_peered":"2024-09-21T07:22:53.766698+0000","last_clean":"2024-09-21T07:22:53.766698+0000","last_became_active":"2024-09-21T07:22:53.062759+0000","last_became_peered":"2024-09-21T07:22:53.062759+0000","last_unstale":"2024-09-21T07:22:53.766698+0000","last_undegraded":"2024-09-21T07:22:53.766698+0000","last_fullsized":"2024-09-21T07:22:53.766698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:30.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766569+0000","last_change":"2024-09-21T07:22:48.749460+0000","last_active":"2024-09-21T07:22:53.766569+0000","last_peered":"2024-09-21T07:22:53.766569+0000","last_clean":"2024-09-21T07:22:53.766569+0000","last_became_active":"2024-09-21T07:22:48.748693+0000","last_became_peered":"2024-09-21T07:22:48.748693+0000","last_unstale":"2024-09-21T07:22:53.766569+0000","last_undegraded":"2024-09-21T07:22:53.766569+0000","last_fullsized":"2024-09-21T07:22:53.766569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.090779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025285+0000","last_change":"2024-09-21T07:22:47.733842+0000","last_active":"2024-09-21T07:22:54.025285+0000","last_peered":"2024-09-21T07:22:54.025285+0000","last_clean":"2024-09-21T07:22:54.025285+0000","last_became_active":"2024-09-21T07:22:47.733469+0000","last_became_peered":"2024-09-21T07:22:47.733469+0000","last_unstale":"2024-09-21T07:22:54.025285+0000","last_undegraded":"2024-09-21T07:22:54.025285+0000","last_fullsized":"2024-09-21T07:22:54.025285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:51.768208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026922+0000","last_change":"2024-09-21T07:22:52.788401+0000","last_active":"2024-09-21T07:22:54.026922+0000","last_peered":"2024-09-21T07:22:54.026922+0000","last_clean":"2024-09-21T07:22:54.026922+0000","last_became_active":"2024-09-21T07:22:52.787726+0000","last_became_peered":"2024-09-21T07:22:52.787726+0000","last_unstale":"2024-09-21T07:22:54.026922+0000","last_undegraded":"2024-09-21T07:22:54.026922+0000","last_fullsized":"2024-09-21T07:22:54.026922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:50.336899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893535+0000","last_change":"2024-09-21T07:22:48.741294+0000","last_active":"2024-09-21T07:22:53.893535+0000","last_peered":"2024-09-21T07:22:53.893535+0000","last_clean":"2024-09-21T07:22:53.893535+0000","last_became_active":"2024-09-21T07:22:48.739470+0000","last_became_peered":"2024-09-21T07:22:48.739470+0000","last_unstale":"2024-09-21T07:22:53.893535+0000","last_undegraded":"2024-09-21T07:22:53.893535+0000","last_fullsized":"2024-09-21T07:22:53.893535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:45.572840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026041+0000","last_change":"2024-09-21T07:22:47.712265+0000","last_active":"2024-09-21T07:22:54.026041+0000","last_peered":"2024-09-21T07:22:54.026041+0000","last_clean":"2024-09-21T07:22:54.026041+0000","last_became_active":"2024-09-21T07:22:47.711366+0000","last_became_peered":"2024-09-21T07:22:47.711366+0000","last_unstale":"2024-09-21T07:22:54.026041+0000","last_undegraded":"2024-09-21T07:22:54.026041+0000","last_fullsized":"2024-09-21T07:22:54.026041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765294+0000","last_change":"2024-09-21T07:22:53.064301+0000","last_active":"2024-09-21T07:22:53.765294+0000","last_peered":"2024-09-21T07:22:53.765294+0000","last_clean":"2024-09-21T07:22:53.765294+0000","last_became_active":"2024-09-21T07:22:53.062833+0000","last_became_peered":"2024-09-21T07:22:53.062833+0000","last_unstale":"2024-09-21T07:22:53.765294+0000","last_undegraded":"2024-09-21T07:22:53.765294+0000","last_fullsized":"2024-09-21T07:22:53.765294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:27.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893385+0000","last_change":"2024-09-21T07:22:48.739480+0000","last_active":"2024-09-21T07:22:53.893385+0000","last_peered":"2024-09-21T07:22:53.893385+0000","last_clean":"2024-09-21T07:22:53.893385+0000","last_became_active":"2024-09-21T07:22:48.735630+0000","last_became_peered":"2024-09-21T07:22:48.735630+0000","last_unstale":"2024-09-21T07:22:53.893385+0000","last_undegraded":"2024-09-21T07:22:53.893385+0000","last_fullsized":"2024-09-21T07:22:53.893385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:46.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025673+0000","last_change":"2024-09-21T07:22:47.730814+0000","last_active":"2024-09-21T07:22:54.025673+0000","last_peered":"2024-09-21T07:22:54.025673+0000","last_clean":"2024-09-21T07:22:54.025673+0000","last_became_active":"2024-09-21T07:22:47.730342+0000","last_became_peered":"2024-09-21T07:22:47.730342+0000","last_unstale":"2024-09-21T07:22:54.025673+0000","last_undegraded":"2024-09-21T07:22:54.025673+0000","last_fullsized":"2024-09-21T07:22:54.025673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024615+0000","last_change":"2024-09-21T07:22:52.784700+0000","last_active":"2024-09-21T07:22:54.024615+0000","last_peered":"2024-09-21T07:22:54.024615+0000","last_clean":"2024-09-21T07:22:54.024615+0000","last_became_active":"2024-09-21T07:22:52.784177+0000","last_became_peered":"2024-09-21T07:22:52.784177+0000","last_unstale":"2024-09-21T07:22:54.024615+0000","last_undegraded":"2024-09-21T07:22:54.024615+0000","last_fullsized":"2024-09-21T07:22:54.024615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.035862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740423+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.739493+0000","last_became_peered":"2024-09-21T07:22:48.739493+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024092+0000","last_change":"2024-09-21T07:22:47.726109+0000","last_active":"2024-09-21T07:22:54.024092+0000","last_peered":"2024-09-21T07:22:54.024092+0000","last_clean":"2024-09-21T07:22:54.024092+0000","last_became_active":"2024-09-21T07:22:47.725696+0000","last_became_peered":"2024-09-21T07:22:47.725696+0000","last_unstale":"2024-09-21T07:22:54.024092+0000","last_undegraded":"2024-09-21T07:22:54.024092+0000","last_fullsized":"2024-09-21T07:22:54.024092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027353+0000","last_change":"2024-09-21T07:22:52.781696+0000","last_active":"2024-09-21T07:22:54.027353+0000","last_peered":"2024-09-21T07:22:54.027353+0000","last_clean":"2024-09-21T07:22:54.027353+0000","last_became_active":"2024-09-21T07:22:52.781211+0000","last_became_peered":"2024-09-21T07:22:52.781211+0000","last_unstale":"2024-09-21T07:22:54.027353+0000","last_undegraded":"2024-09-21T07:22:54.027353+0000","last_fullsized":"2024-09-21T07:22:54.027353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:51.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765137+0000","last_change":"2024-09-21T07:22:48.746169+0000","last_active":"2024-09-21T07:22:53.765137+0000","last_peered":"2024-09-21T07:22:53.765137+0000","last_clean":"2024-09-21T07:22:53.765137+0000","last_became_active":"2024-09-21T07:22:48.745804+0000","last_became_peered":"2024-09-21T07:22:48.745804+0000","last_unstale":"2024-09-21T07:22:53.765137+0000","last_undegraded":"2024-09-21T07:22:53.765137+0000","last_fullsized":"2024-09-21T07:22:53.765137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766637+0000","last_change":"2024-09-21T07:22:47.723745+0000","last_active":"2024-09-21T07:22:53.766637+0000","last_peered":"2024-09-21T07:22:53.766637+0000","last_clean":"2024-09-21T07:22:53.766637+0000","last_became_active":"2024-09-21T07:22:47.723299+0000","last_became_peered":"2024-09-21T07:22:47.723299+0000","last_unstale":"2024-09-21T07:22:53.766637+0000","last_undegraded":"2024-09-21T07:22:53.766637+0000","last_fullsized":"2024-09-21T07:22:53.766637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764852+0000","last_change":"2024-09-21T07:22:53.067494+0000","last_active":"2024-09-21T07:22:53.764852+0000","last_peered":"2024-09-21T07:22:53.764852+0000","last_clean":"2024-09-21T07:22:53.764852+0000","last_became_active":"2024-09-21T07:22:53.066168+0000","last_became_peered":"2024-09-21T07:22:53.066168+0000","last_unstale":"2024-09-21T07:22:53.764852+0000","last_undegraded":"2024-09-21T07:22:53.764852+0000","last_fullsized":"2024-09-21T07:22:53.764852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740397+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.736271+0000","last_became_peered":"2024-09-21T07:22:48.736271+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:50.369048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765981+0000","last_change":"2024-09-21T07:22:47.742213+0000","last_active":"2024-09-21T07:22:53.765981+0000","last_peered":"2024-09-21T07:22:53.765981+0000","last_clean":"2024-09-21T07:22:53.765981+0000","last_became_active":"2024-09-21T07:22:47.741132+0000","last_became_peered":"2024-09-21T07:22:47.741132+0000","last_unstale":"2024-09-21T07:22:53.765981+0000","last_undegraded":"2024-09-21T07:22:53.765981+0000","last_fullsized":"2024-09-21T07:22:53.765981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:09.749747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765129+0000","last_change":"2024-09-21T07:22:53.066418+0000","last_active":"2024-09-21T07:22:53.765129+0000","last_peered":"2024-09-21T07:22:53.765129+0000","last_clean":"2024-09-21T07:22:53.765129+0000","last_became_active":"2024-09-21T07:22:53.065948+0000","last_became_peered":"2024-09-21T07:22:53.065948+0000","last_unstale":"2024-09-21T07:22:53.765129+0000","last_undegraded":"2024-09-21T07:22:53.765129+0000","last_fullsized":"2024-09-21T07:22:53.765129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:44.474322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026570+0000","last_change":"2024-09-21T07:22:48.737346+0000","last_active":"2024-09-21T07:22:54.026570+0000","last_peered":"2024-09-21T07:22:54.026570+0000","last_clean":"2024-09-21T07:22:54.026570+0000","last_became_active":"2024-09-21T07:22:48.736875+0000","last_became_peered":"2024-09-21T07:22:48.736875+0000","last_unstale":"2024-09-21T07:22:54.026570+0000","last_undegraded":"2024-09-21T07:22:54.026570+0000","last_fullsized":"2024-09-21T07:22:54.026570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:22.528204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027111+0000","last_change":"2024-09-21T07:22:47.730642+0000","last_active":"2024-09-21T07:22:54.027111+0000","last_peered":"2024-09-21T07:22:54.027111+0000","last_clean":"2024-09-21T07:22:54.027111+0000","last_became_active":"2024-09-21T07:22:47.730256+0000","last_became_peered":"2024-09-21T07:22:47.730256+0000","last_unstale":"2024-09-21T07:22:54.027111+0000","last_undegraded":"2024-09-21T07:22:54.027111+0000","last_fullsized":"2024-09-21T07:22:54.027111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766769+0000","last_change":"2024-09-21T07:22:53.067757+0000","last_active":"2024-09-21T07:22:53.766769+0000","last_peered":"2024-09-21T07:22:53.766769+0000","last_clean":"2024-09-21T07:22:53.766769+0000","last_became_active":"2024-09-21T07:22:53.067310+0000","last_became_peered":"2024-09-21T07:22:53.067310+0000","last_unstale":"2024-09-21T07:22:53.766769+0000","last_undegraded":"2024-09-21T07:22:53.766769+0000","last_fullsized":"2024-09-21T07:22:53.766769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:51.644247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893021+0000","last_change":"2024-09-21T07:22:48.748135+0000","last_active":"2024-09-21T07:22:53.893021+0000","last_peered":"2024-09-21T07:22:53.893021+0000","last_clean":"2024-09-21T07:22:53.893021+0000","last_became_active":"2024-09-21T07:22:48.747791+0000","last_became_peered":"2024-09-21T07:22:48.747791+0000","last_unstale":"2024-09-21T07:22:53.893021+0000","last_undegraded":"2024-09-21T07:22:53.893021+0000","last_fullsized":"2024-09-21T07:22:53.893021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:50.042620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:23:00.072821+0000","last_change":"2024-09-21T07:22:47.731720+0000","last_active":"2024-09-21T07:23:00.072821+0000","last_peered":"2024-09-21T07:23:00.072821+0000","last_clean":"2024-09-21T07:23:00.072821+0000","last_became_active":"2024-09-21T07:22:47.731257+0000","last_became_peered":"2024-09-21T07:22:47.731257+0000","last_unstale":"2024-09-21T07:23:00.072821+0000","last_undegraded":"2024-09-21T07:23:00.072821+0000","last_fullsized":"2024-09-21T07:23:00.072821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025005+0000","last_change":"2024-09-21T07:22:52.777427+0000","last_active":"2024-09-21T07:22:54.025005+0000","last_peered":"2024-09-21T07:22:54.025005+0000","last_clean":"2024-09-21T07:22:54.025005+0000","last_became_active":"2024-09-21T07:22:52.776894+0000","last_became_peered":"2024-09-21T07:22:52.776894+0000","last_unstale":"2024-09-21T07:22:54.025005+0000","last_undegraded":"2024-09-21T07:22:54.025005+0000","last_fullsized":"2024-09-21T07:22:54.025005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:10.994515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025528+0000","last_change":"2024-09-21T07:22:48.751759+0000","last_active":"2024-09-21T07:22:54.025528+0000","last_peered":"2024-09-21T07:22:54.025528+0000","last_clean":"2024-09-21T07:22:54.025528+0000","last_became_active":"2024-09-21T07:22:48.751434+0000","last_became_peered":"2024-09-21T07:22:48.751434+0000","last_unstale":"2024-09-21T07:22:54.025528+0000","last_undegraded":"2024-09-21T07:22:54.025528+0000","last_fullsized":"2024-09-21T07:22:54.025528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025150+0000","last_change":"2024-09-21T07:22:47.724152+0000","last_active":"2024-09-21T07:22:54.025150+0000","last_peered":"2024-09-21T07:22:54.025150+0000","last_clean":"2024-09-21T07:22:54.025150+0000","last_became_active":"2024-09-21T07:22:47.723668+0000","last_became_peered":"2024-09-21T07:22:47.723668+0000","last_unstale":"2024-09-21T07:22:54.025150+0000","last_undegraded":"2024-09-21T07:22:54.025150+0000","last_fullsized":"2024-09-21T07:22:54.025150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:38.422165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025008+0000","last_change":"2024-09-21T07:22:52.790871+0000","last_active":"2024-09-21T07:22:54.025008+0000","last_peered":"2024-09-21T07:22:54.025008+0000","last_clean":"2024-09-21T07:22:54.025008+0000","last_became_active":"2024-09-21T07:22:52.790349+0000","last_became_peered":"2024-09-21T07:22:52.790349+0000","last_unstale":"2024-09-21T07:22:54.025008+0000","last_undegraded":"2024-09-21T07:22:54.025008+0000","last_fullsized":"2024-09-21T07:22:54.025008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:08.100330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027512+0000","last_change":"2024-09-21T07:22:48.749463+0000","last_active":"2024-09-21T07:22:54.027512+0000","last_peered":"2024-09-21T07:22:54.027512+0000","last_clean":"2024-09-21T07:22:54.027512+0000","last_became_active":"2024-09-21T07:22:48.747781+0000","last_became_peered":"2024-09-21T07:22:48.747781+0000","last_unstale":"2024-09-21T07:22:54.027512+0000","last_undegraded":"2024-09-21T07:22:54.027512+0000","last_fullsized":"2024-09-21T07:22:54.027512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767422+0000","last_change":"2024-09-21T07:22:47.737032+0000","last_active":"2024-09-21T07:22:53.767422+0000","last_peered":"2024-09-21T07:22:53.767422+0000","last_clean":"2024-09-21T07:22:53.767422+0000","last_became_active":"2024-09-21T07:22:47.736616+0000","last_became_peered":"2024-09-21T07:22:47.736616+0000","last_unstale":"2024-09-21T07:22:53.767422+0000","last_undegraded":"2024-09-21T07:22:53.767422+0000","last_fullsized":"2024-09-21T07:22:53.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:53.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764281+0000","last_change":"2024-09-21T07:22:52.774334+0000","last_active":"2024-09-21T07:22:53.764281+0000","last_peered":"2024-09-21T07:22:53.764281+0000","last_clean":"2024-09-21T07:22:53.764281+0000","last_became_active":"2024-09-21T07:22:52.773910+0000","last_became_peered":"2024-09-21T07:22:52.773910+0000","last_unstale":"2024-09-21T07:22:53.764281+0000","last_undegraded":"2024-09-21T07:22:53.764281+0000","last_fullsized":"2024-09-21T07:22:53.764281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:08.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767415+0000","last_change":"2024-09-21T07:22:48.751082+0000","last_active":"2024-09-21T07:22:53.767415+0000","last_peered":"2024-09-21T07:22:53.767415+0000","last_clean":"2024-09-21T07:22:53.767415+0000","last_became_active":"2024-09-21T07:22:48.750721+0000","last_became_peered":"2024-09-21T07:22:48.750721+0000","last_unstale":"2024-09-21T07:22:53.767415+0000","last_undegraded":"2024-09-21T07:22:53.767415+0000","last_fullsized":"2024-09-21T07:22:53.767415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:46.294144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767956+0000","last_change":"2024-09-21T07:22:47.732653+0000","last_active":"2024-09-21T07:22:53.767956+0000","last_peered":"2024-09-21T07:22:53.767956+0000","last_clean":"2024-09-21T07:22:53.767956+0000","last_became_active":"2024-09-21T07:22:47.731145+0000","last_became_peered":"2024-09-21T07:22:47.731145+0000","last_unstale":"2024-09-21T07:22:53.767956+0000","last_undegraded":"2024-09-21T07:22:53.767956+0000","last_fullsized":"2024-09-21T07:22:53.767956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764072+0000","last_change":"2024-09-21T07:22:53.068578+0000","last_active":"2024-09-21T07:22:53.764072+0000","last_peered":"2024-09-21T07:22:53.764072+0000","last_clean":"2024-09-21T07:22:53.764072+0000","last_became_active":"2024-09-21T07:22:53.068094+0000","last_became_peered":"2024-09-21T07:22:53.068094+0000","last_unstale":"2024-09-21T07:22:53.764072+0000","last_undegraded":"2024-09-21T07:22:53.764072+0000","last_fullsized":"2024-09-21T07:22:53.764072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:48.304004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027350+0000","last_change":"2024-09-21T07:22:53.067719+0000","last_active":"2024-09-21T07:22:54.027350+0000","last_peered":"2024-09-21T07:22:54.027350+0000","last_clean":"2024-09-21T07:22:54.027350+0000","last_became_active":"2024-09-21T07:22:53.066586+0000","last_became_peered":"2024-09-21T07:22:53.066586+0000","last_unstale":"2024-09-21T07:22:54.027350+0000","last_undegraded":"2024-09-21T07:22:54.027350+0000","last_fullsized":"2024-09-21T07:22:54.027350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:08.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024581+0000","last_change":"2024-09-21T07:22:48.721331+0000","last_active":"2024-09-21T07:22:54.024581+0000","last_peered":"2024-09-21T07:22:54.024581+0000","last_clean":"2024-09-21T07:22:54.024581+0000","last_became_active":"2024-09-21T07:22:48.721004+0000","last_became_peered":"2024-09-21T07:22:48.721004+0000","last_unstale":"2024-09-21T07:22:54.024581+0000","last_undegraded":"2024-09-21T07:22:54.024581+0000","last_fullsized":"2024-09-21T07:22:54.024581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765811+0000","last_change":"2024-09-21T07:22:47.725525+0000","last_active":"2024-09-21T07:22:53.765811+0000","last_peered":"2024-09-21T07:22:53.765811+0000","last_clean":"2024-09-21T07:22:53.765811+0000","last_became_active":"2024-09-21T07:22:47.724955+0000","last_became_peered":"2024-09-21T07:22:47.724955+0000","last_unstale":"2024-09-21T07:22:53.765811+0000","last_undegraded":"2024-09-21T07:22:53.765811+0000","last_fullsized":"2024-09-21T07:22:53.765811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:57.216986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767880+0000","last_change":"2024-09-21T07:22:52.775953+0000","last_active":"2024-09-21T07:22:53.767880+0000","last_peered":"2024-09-21T07:22:53.767880+0000","last_clean":"2024-09-21T07:22:53.767880+0000","last_became_active":"2024-09-21T07:22:52.775495+0000","last_became_peered":"2024-09-21T07:22:52.775495+0000","last_unstale":"2024-09-21T07:22:53.767880+0000","last_undegraded":"2024-09-21T07:22:53.767880+0000","last_fullsized":"2024-09-21T07:22:53.767880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763992+0000","last_change":"2024-09-21T07:22:48.753975+0000","last_active":"2024-09-21T07:22:53.763992+0000","last_peered":"2024-09-21T07:22:53.763992+0000","last_clean":"2024-09-21T07:22:53.763992+0000","last_became_active":"2024-09-21T07:22:48.753724+0000","last_became_peered":"2024-09-21T07:22:48.753724+0000","last_unstale":"2024-09-21T07:22:53.763992+0000","last_undegraded":"2024-09-21T07:22:53.763992+0000","last_fullsized":"2024-09-21T07:22:53.763992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:22.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764342+0000","last_change":"2024-09-21T07:22:47.730250+0000","last_active":"2024-09-21T07:22:53.764342+0000","last_peered":"2024-09-21T07:22:53.764342+0000","last_clean":"2024-09-21T07:22:53.764342+0000","last_became_active":"2024-09-21T07:22:47.729848+0000","last_became_peered":"2024-09-21T07:22:47.729848+0000","last_unstale":"2024-09-21T07:22:53.764342+0000","last_undegraded":"2024-09-21T07:22:53.764342+0000","last_fullsized":"2024-09-21T07:22:53.764342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:55.323370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767164+0000","last_change":"2024-09-21T07:22:47.725746+0000","last_active":"2024-09-21T07:22:53.767164+0000","last_peered":"2024-09-21T07:22:53.767164+0000","last_clean":"2024-09-21T07:22:53.767164+0000","last_became_active":"2024-09-21T07:22:47.725422+0000","last_became_peered":"2024-09-21T07:22:47.725422+0000","last_unstale":"2024-09-21T07:22:53.767164+0000","last_undegraded":"2024-09-21T07:22:53.767164+0000","last_fullsized":"2024-09-21T07:22:53.767164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:00.603887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027060+0000","last_change":"2024-09-21T07:22:48.744596+0000","last_active":"2024-09-21T07:22:54.027060+0000","last_peered":"2024-09-21T07:22:54.027060+0000","last_clean":"2024-09-21T07:22:54.027060+0000","last_became_active":"2024-09-21T07:22:48.744299+0000","last_became_peered":"2024-09-21T07:22:48.744299+0000","last_unstale":"2024-09-21T07:22:54.027060+0000","last_undegraded":"2024-09-21T07:22:54.027060+0000","last_fullsized":"2024-09-21T07:22:54.027060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024935+0000","last_change":"2024-09-21T07:22:52.787834+0000","last_active":"2024-09-21T07:22:54.024935+0000","last_peered":"2024-09-21T07:22:54.024935+0000","last_clean":"2024-09-21T07:22:54.024935+0000","last_became_active":"2024-09-21T07:22:52.786824+0000","last_became_peered":"2024-09-21T07:22:52.786824+0000","last_unstale":"2024-09-21T07:22:54.024935+0000","last_undegraded":"2024-09-21T07:22:54.024935+0000","last_fullsized":"2024-09-21T07:22:54.024935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:57.435599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764323+0000","last_change":"2024-09-21T07:22:47.741714+0000","last_active":"2024-09-21T07:22:53.764323+0000","last_peered":"2024-09-21T07:22:53.764323+0000","last_clean":"2024-09-21T07:22:53.764323+0000","last_became_active":"2024-09-21T07:22:47.741389+0000","last_became_peered":"2024-09-21T07:22:47.741389+0000","last_unstale":"2024-09-21T07:22:53.764323+0000","last_undegraded":"2024-09-21T07:22:53.764323+0000","last_fullsized":"2024-09-21T07:22:53.764323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:45.062537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025167+0000","last_change":"2024-09-21T07:22:48.734053+0000","last_active":"2024-09-21T07:22:54.025167+0000","last_peered":"2024-09-21T07:22:54.025167+0000","last_clean":"2024-09-21T07:22:54.025167+0000","last_became_active":"2024-09-21T07:22:48.733585+0000","last_became_peered":"2024-09-21T07:22:48.733585+0000","last_unstale":"2024-09-21T07:22:54.025167+0000","last_undegraded":"2024-09-21T07:22:54.025167+0000","last_fullsized":"2024-09-21T07:22:54.025167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:42.987988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764844+0000","last_change":"2024-09-21T07:22:52.783230+0000","last_active":"2024-09-21T07:22:53.764844+0000","last_peered":"2024-09-21T07:22:53.764844+0000","last_clean":"2024-09-21T07:22:53.764844+0000","last_became_active":"2024-09-21T07:22:52.782669+0000","last_became_peered":"2024-09-21T07:22:52.782669+0000","last_unstale":"2024-09-21T07:22:53.764844+0000","last_undegraded":"2024-09-21T07:22:53.764844+0000","last_fullsized":"2024-09-21T07:22:53.764844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:10.593769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764996+0000","last_change":"2024-09-21T07:22:48.746272+0000","last_active":"2024-09-21T07:22:53.764996+0000","last_peered":"2024-09-21T07:22:53.764996+0000","last_clean":"2024-09-21T07:22:53.764996+0000","last_became_active":"2024-09-21T07:22:48.745859+0000","last_became_peered":"2024-09-21T07:22:48.745859+0000","last_unstale":"2024-09-21T07:22:53.764996+0000","last_undegraded":"2024-09-21T07:22:53.764996+0000","last_fullsized":"2024-09-21T07:22:53.764996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024230+0000","last_change":"2024-09-21T07:22:48.735624+0000","last_active":"2024-09-21T07:22:54.024230+0000","last_peered":"2024-09-21T07:22:54.024230+0000","last_clean":"2024-09-21T07:22:54.024230+0000","last_became_active":"2024-09-21T07:22:48.735299+0000","last_became_peered":"2024-09-21T07:22:48.735299+0000","last_unstale":"2024-09-21T07:22:54.024230+0000","last_undegraded":"2024-09-21T07:22:54.024230+0000","last_fullsized":"2024-09-21T07:22:54.024230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765809+0000","last_change":"2024-09-21T07:22:48.754562+0000","last_active":"2024-09-21T07:22:53.765809+0000","last_peered":"2024-09-21T07:22:53.765809+0000","last_clean":"2024-09-21T07:22:53.765809+0000","last_became_active":"2024-09-21T07:22:48.753457+0000","last_became_peered":"2024-09-21T07:22:48.753457+0000","last_unstale":"2024-09-21T07:22:53.765809+0000","last_undegraded":"2024-09-21T07:22:53.765809+0000","last_fullsized":"2024-09-21T07:22:53.765809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:41.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027009+0000","last_change":"2024-09-21T07:22:48.751689+0000","last_active":"2024-09-21T07:22:54.027009+0000","last_peered":"2024-09-21T07:22:54.027009+0000","last_clean":"2024-09-21T07:22:54.027009+0000","last_became_active":"2024-09-21T07:22:48.751361+0000","last_became_peered":"2024-09-21T07:22:48.751361+0000","last_unstale":"2024-09-21T07:22:54.027009+0000","last_undegraded":"2024-09-21T07:22:54.027009+0000","last_fullsized":"2024-09-21T07:22:54.027009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764765+0000","last_change":"2024-09-21T07:22:48.759019+0000","last_active":"2024-09-21T07:22:53.764765+0000","last_peered":"2024-09-21T07:22:53.764765+0000","last_clean":"2024-09-21T07:22:53.764765+0000","last_became_active":"2024-09-21T07:22:48.758694+0000","last_became_peered":"2024-09-21T07:22:48.758694+0000","last_unstale":"2024-09-21T07:22:53.764765+0000","last_undegraded":"2024-09-21T07:22:53.764765+0000","last_fullsized":"2024-09-21T07:22:53.764765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024926+0000","last_change":"2024-09-21T07:22:48.723104+0000","last_active":"2024-09-21T07:22:54.024926+0000","last_peered":"2024-09-21T07:22:54.024926+0000","last_clean":"2024-09-21T07:22:54.024926+0000","last_became_active":"2024-09-21T07:22:48.722764+0000","last_became_peered":"2024-09-21T07:22:48.722764+0000","last_unstale":"2024-09-21T07:22:54.024926+0000","last_undegraded":"2024-09-21T07:22:54.024926+0000","last_fullsized":"2024-09-21T07:22:54.024926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:01.478325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767699+0000","last_change":"2024-09-21T07:22:48.742610+0000","last_active":"2024-09-21T07:22:53.767699+0000","last_peered":"2024-09-21T07:22:53.767699+0000","last_clean":"2024-09-21T07:22:53.767699+0000","last_became_active":"2024-09-21T07:22:48.737384+0000","last_became_peered":"2024-09-21T07:22:48.737384+0000","last_unstale":"2024-09-21T07:22:53.767699+0000","last_undegraded":"2024-09-21T07:22:53.767699+0000","last_fullsized":"2024-09-21T07:22:53.767699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764922+0000","last_change":"2024-09-21T07:22:48.738148+0000","last_active":"2024-09-21T07:22:53.764922+0000","last_peered":"2024-09-21T07:22:53.764922+0000","last_clean":"2024-09-21T07:22:53.764922+0000","last_became_active":"2024-09-21T07:22:48.737843+0000","last_became_peered":"2024-09-21T07:22:48.737843+0000","last_unstale":"2024-09-21T07:22:53.764922+0000","last_undegraded":"2024-09-21T07:22:53.764922+0000","last_fullsized":"2024-09-21T07:22:53.764922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:17.737322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765676+0000","last_change":"2024-09-21T07:22:48.740105+0000","last_active":"2024-09-21T07:22:53.765676+0000","last_peered":"2024-09-21T07:22:53.765676+0000","last_clean":"2024-09-21T07:22:53.765676+0000","last_became_active":"2024-09-21T07:22:48.739816+0000","last_became_peered":"2024-09-21T07:22:48.739816+0000","last_unstale":"2024-09-21T07:22:53.765676+0000","last_undegraded":"2024-09-21T07:22:53.765676+0000","last_fullsized":"2024-09-21T07:22:53.765676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764141+0000","last_change":"2024-09-21T07:22:48.741924+0000","last_active":"2024-09-21T07:22:53.764141+0000","last_peered":"2024-09-21T07:22:53.764141+0000","last_clean":"2024-09-21T07:22:53.764141+0000","last_became_active":"2024-09-21T07:22:48.741567+0000","last_became_peered":"2024-09-21T07:22:48.741567+0000","last_unstale":"2024-09-21T07:22:53.764141+0000","last_undegraded":"2024-09-21T07:22:53.764141+0000","last_fullsized":"2024-09-21T07:22:53.764141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:33.518751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765851+0000","last_change":"2024-09-21T07:22:48.729429+0000","last_active":"2024-09-21T07:22:53.765851+0000","last_peered":"2024-09-21T07:22:53.765851+0000","last_clean":"2024-09-21T07:22:53.765851+0000","last_became_active":"2024-09-21T07:22:48.729115+0000","last_became_peered":"2024-09-21T07:22:48.729115+0000","last_unstale":"2024-09-21T07:22:53.765851+0000","last_undegraded":"2024-09-21T07:22:53.765851+0000","last_fullsized":"2024-09-21T07:22:53.765851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:45.792793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026833+0000","last_change":"2024-09-21T07:22:48.739366+0000","last_active":"2024-09-21T07:22:54.026833+0000","last_peered":"2024-09-21T07:22:54.026833+0000","last_clean":"2024-09-21T07:22:54.026833+0000","last_became_active":"2024-09-21T07:22:48.738848+0000","last_became_peered":"2024-09-21T07:22:48.738848+0000","last_unstale":"2024-09-21T07:22:54.026833+0000","last_undegraded":"2024-09-21T07:22:54.026833+0000","last_fullsized":"2024-09-21T07:22:54.026833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742010+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.741123+0000","last_became_peered":"2024-09-21T07:22:48.741123+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893554+0000","last_change":"2024-09-21T07:22:48.733725+0000","last_active":"2024-09-21T07:22:53.893554+0000","last_peered":"2024-09-21T07:22:53.893554+0000","last_clean":"2024-09-21T07:22:53.893554+0000","last_became_active":"2024-09-21T07:22:48.733408+0000","last_became_peered":"2024-09-21T07:22:48.733408+0000","last_unstale":"2024-09-21T07:22:53.893554+0000","last_undegraded":"2024-09-21T07:22:53.893554+0000","last_fullsized":"2024-09-21T07:22:53.893554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:56.573091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025995+0000","last_change":"2024-09-21T07:22:48.733307+0000","last_active":"2024-09-21T07:22:54.025995+0000","last_peered":"2024-09-21T07:22:54.025995+0000","last_clean":"2024-09-21T07:22:54.025995+0000","last_became_active":"2024-09-21T07:22:48.732920+0000","last_became_peered":"2024-09-21T07:22:48.732920+0000","last_unstale":"2024-09-21T07:22:54.025995+0000","last_undegraded":"2024-09-21T07:22:54.025995+0000","last_fullsized":"2024-09-21T07:22:54.025995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.733360+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.733032+0000","last_became_peered":"2024-09-21T07:22:48.733032+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:34.232644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765534+0000","last_change":"2024-09-21T07:22:48.746150+0000","last_active":"2024-09-21T07:22:53.765534+0000","last_peered":"2024-09-21T07:22:53.765534+0000","last_clean":"2024-09-21T07:22:53.765534+0000","last_became_active":"2024-09-21T07:22:48.745814+0000","last_became_peered":"2024-09-21T07:22:48.745814+0000","last_unstale":"2024-09-21T07:22:53.765534+0000","last_undegraded":"2024-09-21T07:22:53.765534+0000","last_fullsized":"2024-09-21T07:22:53.765534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024701+0000","last_change":"2024-09-21T07:22:48.739733+0000","last_active":"2024-09-21T07:22:54.024701+0000","last_peered":"2024-09-21T07:22:54.024701+0000","last_clean":"2024-09-21T07:22:54.024701+0000","last_became_active":"2024-09-21T07:22:48.739428+0000","last_became_peered":"2024-09-21T07:22:48.739428+0000","last_unstale":"2024-09-21T07:22:54.024701+0000","last_undegraded":"2024-09-21T07:22:54.024701+0000","last_fullsized":"2024-09-21T07:22:54.024701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:08.474202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026517+0000","last_change":"2024-09-21T07:22:48.737610+0000","last_active":"2024-09-21T07:22:54.026517+0000","last_peered":"2024-09-21T07:22:54.026517+0000","last_clean":"2024-09-21T07:22:54.026517+0000","last_became_active":"2024-09-21T07:22:48.737248+0000","last_became_peered":"2024-09-21T07:22:48.737248+0000","last_unstale":"2024-09-21T07:22:54.026517+0000","last_undegraded":"2024-09-21T07:22:54.026517+0000","last_fullsized":"2024-09-21T07:22:54.026517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:12.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764170+0000","last_change":"2024-09-21T07:22:48.740790+0000","last_active":"2024-09-21T07:22:53.764170+0000","last_peered":"2024-09-21T07:22:53.764170+0000","last_clean":"2024-09-21T07:22:53.764170+0000","last_became_active":"2024-09-21T07:22:48.740145+0000","last_became_peered":"2024-09-21T07:22:48.740145+0000","last_unstale":"2024-09-21T07:22:53.764170+0000","last_undegraded":"2024-09-21T07:22:53.764170+0000","last_fullsized":"2024-09-21T07:22:53.764170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:31.562981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025501+0000","last_change":"2024-09-21T07:22:48.751370+0000","last_active":"2024-09-21T07:22:54.025501+0000","last_peered":"2024-09-21T07:22:54.025501+0000","last_clean":"2024-09-21T07:22:54.025501+0000","last_became_active":"2024-09-21T07:22:48.746516+0000","last_became_peered":"2024-09-21T07:22:48.746516+0000","last_unstale":"2024-09-21T07:22:54.025501+0000","last_undegraded":"2024-09-21T07:22:54.025501+0000","last_fullsized":"2024-09-21T07:22:54.025501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742862+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.736975+0000","last_became_peered":"2024-09-21T07:22:48.736975+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.732301+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.731301+0000","last_became_peered":"2024-09-21T07:22:48.731301+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893478+0000","last_change":"2024-09-21T07:22:48.736203+0000","last_active":"2024-09-21T07:22:53.893478+0000","last_peered":"2024-09-21T07:22:53.893478+0000","last_clean":"2024-09-21T07:22:53.893478+0000","last_became_active":"2024-09-21T07:22:48.735217+0000","last_became_peered":"2024-09-21T07:22:48.735217+0000","last_unstale":"2024-09-21T07:22:53.893478+0000","last_undegraded":"2024-09-21T07:22:53.893478+0000","last_fullsized":"2024-09-21T07:22:53.893478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:10.751312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763848+0000","last_change":"2024-09-21T07:22:48.739850+0000","last_active":"2024-09-21T07:22:53.763848+0000","last_peered":"2024-09-21T07:22:53.763848+0000","last_clean":"2024-09-21T07:22:53.763848+0000","last_became_active":"2024-09-21T07:22:48.738820+0000","last_became_peered":"2024-09-21T07:22:48.738820+0000","last_unstale":"2024-09-21T07:22:53.763848+0000","last_undegraded":"2024-09-21T07:22:53.763848+0000","last_fullsized":"2024-09-21T07:22:53.763848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:11.644683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892810+0000","last_change":"2024-09-21T07:22:48.749899+0000","last_active":"2024-09-21T07:22:53.892810+0000","last_peered":"2024-09-21T07:22:53.892810+0000","last_clean":"2024-09-21T07:22:53.892810+0000","last_became_active":"2024-09-21T07:22:48.748269+0000","last_became_peered":"2024-09-21T07:22:48.748269+0000","last_unstale":"2024-09-21T07:22:53.892810+0000","last_undegraded":"2024-09-21T07:22:53.892810+0000","last_fullsized":"2024-09-21T07:22:53.892810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:54.034703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765685+0000","last_change":"2024-09-21T07:22:48.750088+0000","last_active":"2024-09-21T07:22:53.765685+0000","last_peered":"2024-09-21T07:22:53.765685+0000","last_clean":"2024-09-21T07:22:53.765685+0000","last_became_active":"2024-09-21T07:22:48.749780+0000","last_became_peered":"2024-09-21T07:22:48.749780+0000","last_unstale":"2024-09-21T07:22:53.765685+0000","last_undegraded":"2024-09-21T07:22:53.765685+0000","last_fullsized":"2024-09-21T07:22:53.765685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:23.057892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892813+0000","last_change":"2024-09-21T07:22:48.741748+0000","last_active":"2024-09-21T07:22:53.892813+0000","last_peered":"2024-09-21T07:22:53.892813+0000","last_clean":"2024-09-21T07:22:53.892813+0000","last_became_active":"2024-09-21T07:22:48.739240+0000","last_became_peered":"2024-09-21T07:22:48.739240+0000","last_unstale":"2024-09-21T07:22:53.892813+0000","last_undegraded":"2024-09-21T07:22:53.892813+0000","last_fullsized":"2024-09-21T07:22:53.892813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766446+0000","last_change":"2024-09-21T07:22:48.749807+0000","last_active":"2024-09-21T07:22:53.766446+0000","last_peered":"2024-09-21T07:22:53.766446+0000","last_clean":"2024-09-21T07:22:53.766446+0000","last_became_active":"2024-09-21T07:22:48.749133+0000","last_became_peered":"2024-09-21T07:22:48.749133+0000","last_unstale":"2024-09-21T07:22:53.766446+0000","last_undegraded":"2024-09-21T07:22:53.766446+0000","last_fullsized":"2024-09-21T07:22:53.766446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:04.259181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027319+0000","last_change":"2024-09-21T07:22:48.747149+0000","last_active":"2024-09-21T07:22:54.027319+0000","last_peered":"2024-09-21T07:22:54.027319+0000","last_clean":"2024-09-21T07:22:54.027319+0000","last_became_active":"2024-09-21T07:22:48.745587+0000","last_became_peered":"2024-09-21T07:22:48.745587+0000","last_unstale":"2024-09-21T07:22:54.027319+0000","last_undegraded":"2024-09-21T07:22:54.027319+0000","last_fullsized":"2024-09-21T07:22:54.027319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025332+0000","last_change":"2024-09-21T07:22:48.738773+0000","last_active":"2024-09-21T07:22:54.025332+0000","last_peered":"2024-09-21T07:22:54.025332+0000","last_clean":"2024-09-21T07:22:54.025332+0000","last_became_active":"2024-09-21T07:22:48.738521+0000","last_became_peered":"2024-09-21T07:22:48.738521+0000","last_unstale":"2024-09-21T07:22:54.025332+0000","last_undegraded":"2024-09-21T07:22:54.025332+0000","last_fullsized":"2024-09-21T07:22:54.025332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:42.041043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893340+0000","last_change":"2024-09-21T07:22:48.750274+0000","last_active":"2024-09-21T07:22:53.893340+0000","last_peered":"2024-09-21T07:22:53.893340+0000","last_clean":"2024-09-21T07:22:53.893340+0000","last_became_active":"2024-09-21T07:22:48.748751+0000","last_became_peered":"2024-09-21T07:22:48.748751+0000","last_unstale":"2024-09-21T07:22:53.893340+0000","last_undegraded":"2024-09-21T07:22:53.893340+0000","last_fullsized":"2024-09-21T07:22:53.893340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:28.162100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":107492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":698282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:05.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:23:05.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T07:23:05.429 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 -- 172.21.15.64:0/2325685937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40ceab0 msgr2=0x7f13e40ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 --2- 172.21.15.64:0/2325685937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40ceab0 0x7f13e40ceec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f13e40735a0 tx=0x7f13cc01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 -- 172.21.15.64:0/2325685937 shutdown_connections 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 --2- 172.21.15.64:0/2325685937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ccd00 0x7f13e40cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 --2- 172.21.15.64:0/2325685937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40ceab0 0x7f13e40ceec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 --2- 172.21.15.64:0/2325685937 >> v2:172.21.15.90:3300/0 conn(0x7f13e40cfed0 0x7f13e40b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 -- 172.21.15.64:0/2325685937 >> 172.21.15.64:0/2325685937 conn(0x7f13e409b3b0 msgr2=0x7f13e40d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 -- 172.21.15.64:0/2325685937 shutdown_connections 2024-09-21T07:23:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.617+0000 7f13e3e00640 1 -- 172.21.15.64:0/2325685937 wait complete. 2024-09-21T07:23:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 Processor -- start 2024-09-21T07:23:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- start start 2024-09-21T07:23:05.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e40ccd00 0x7f13e40b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ceab0 0x7f13e40c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40b26d0 con 0x7f13e40cfed0 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40b2550 con 0x7f13e40ccd00 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f13e40b2850 con 0x7f13e40ceab0 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39602/0 (socket says 172.21.15.64:39602) 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 -- 172.21.15.64:0/515679766 learned_addr learned my addr 172.21.15.64:0/515679766 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e2a00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e40ccd00 0x7f13e40b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13dbe00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ceab0 0x7f13e40c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 -- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ceab0 msgr2=0x7f13e40c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ceab0 0x7f13e40c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 -- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e40ccd00 msgr2=0x7f13e40b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e40ccd00 0x7f13e40b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 -- 172.21.15.64:0/515679766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e40b60a0 con 0x7f13e40cfed0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3400640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e990 tx=0x7f13dc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc004d30 con 0x7f13e40cfed0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13dc00caa0 con 0x7f13e40cfed0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41552b0 con 0x7f13e40cfed0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc005020 con 0x7f13e40cfed0 2024-09-21T07:23:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.621+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e40c6710 con 0x7f13e40cfed0 2024-09-21T07:23:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e40b2d90 con 0x7f13e40cfed0 2024-09-21T07:23:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f13dc0051c0 con 0x7f13e40cfed0 2024-09-21T07:23:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13daa00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 0x7f13c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f13dc094cb0 con 0x7f13e40cfed0 2024-09-21T07:23:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13e2a00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 0x7f13c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.625+0000 7f13e2a00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 0x7f13c0075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009b40 tx=0x7f13d40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.629+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f13dc016030 con 0x7f13e40cfed0 2024-09-21T07:23:05.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f13e40af520 con 0x7f13e40cfed0 2024-09-21T07:23:05.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13daa00640 1 -- 172.21.15.64:0/515679766 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f13dc05f330 con 0x7f13e40cfed0 2024-09-21T07:23:05.812 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 msgr2=0x7f13c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 0x7f13c0075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009b40 tx=0x7f13d40091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 msgr2=0x7f13e41f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e990 tx=0x7f13dc00ee50 comp rx=0 tx=0).stop 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 shutdown_connections 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c0073200 0x7f13c0075710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e40cfed0 0x7f13e41f92e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e40ceab0 0x7f13e40c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 --2- 172.21.15.64:0/515679766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e40ccd00 0x7f13e40b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 >> 172.21.15.64:0/515679766 conn(0x7f13e409b3b0 msgr2=0x7f13e415b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 shutdown_connections 2024-09-21T07:23:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.809+0000 7f13e3e00640 1 -- 172.21.15.64:0/515679766 wait complete. 2024-09-21T07:23:05.835 INFO:teuthology.orchestra.run.smithi064.stdout:[{"version":31,"timestamp":"2024-09-21T07:22:36.755303+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6432.347152"}]}] 2024-09-21T07:23:05.835 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T07:23:05.835 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:23:05.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:23:05.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T07:23:05.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- 172.21.15.64:0/72642252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb68004810 msgr2=0x7fcb68004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:05.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 --2- 172.21.15.64:0/72642252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb68004810 0x7fcb68004c20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009b70 tx=0x7fcb6c01d270 comp rx=0 tx=0).stop 2024-09-21T07:23:05.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb83e00640 1 -- 172.21.15.64:0/72642252 reap_dead start 2024-09-21T07:23:05.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- 172.21.15.64:0/72642252 shutdown_connections 2024-09-21T07:23:05.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- 172.21.15.64:0/72642252 >> 172.21.15.64:0/72642252 conn(0x7fcb840b2b50 msgr2=0x7fcb840b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:05.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- 172.21.15.64:0/72642252 shutdown_connections 2024-09-21T07:23:05.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- 172.21.15.64:0/72642252 wait complete. 2024-09-21T07:23:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 Processor -- start 2024-09-21T07:23:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.993+0000 7fcb89000640 1 -- start start 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb68004810 0x7fcb841f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb840ca220 0x7fcb8415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8406d780 con 0x7fcb840b5490 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8406d600 con 0x7fcb68004810 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8406d900 con 0x7fcb840ca220 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39630/0 (socket says 172.21.15.64:39630) 2024-09-21T07:23:06.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 -- 172.21.15.64:0/3112576085 learned_addr learned my addr 172.21.15.64:0/3112576085 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:06.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb7be00640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb840ca220 0x7fcb8415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83400640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb68004810 0x7fcb841f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 -- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb840ca220 msgr2=0x7fcb8415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb840ca220 0x7fcb8415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 -- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb68004810 msgr2=0x7fcb841f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb68004810 0x7fcb841f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 -- 172.21.15.64:0/3112576085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb840b5de0 con 0x7fcb840b5490 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb83e00640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb840b6d70 tx=0x7fcb7c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c004b30 con 0x7fcb840b5490 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb7c004cd0 con 0x7fcb840b5490 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c003be0 con 0x7fcb840b5490 2024-09-21T07:23:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb840caeb0 con 0x7fcb840b5490 2024-09-21T07:23:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb840c9820 con 0x7fcb840b5490 2024-09-21T07:23:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:05.997+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb840c92b0 con 0x7fcb840b5490 2024-09-21T07:23:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.001+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb7c004030 con 0x7fcb840b5490 2024-09-21T07:23:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.001+0000 7fcb7b400640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 0x7fcb60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.001+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcb7c094e10 con 0x7fcb840b5490 2024-09-21T07:23:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.001+0000 7fcb83400640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 0x7fcb60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.001+0000 7fcb83400640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 0x7fcb60075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb74000fc0 tx=0x7fcb74006cd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.005+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcb7c098030 con 0x7fcb840b5490 2024-09-21T07:23:06.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.225+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcb840ccdb0 con 0x7fcb840b5490 2024-09-21T07:23:06.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.225+0000 7fcb7b400640 1 -- 172.21.15.64:0/3112576085 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186454 (secure 0 0 0) 0x7fcb7c068030 con 0x7fcb840b5490 2024-09-21T07:23:06.234 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 msgr2=0x7fcb60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 0x7fcb60075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb74000fc0 tx=0x7fcb74006cd0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 msgr2=0x7fcb840b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb840b6d70 tx=0x7fcb7c00f3c0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 shutdown_connections 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb60073200 0x7fcb60075710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb840b5490 0x7fcb840b58a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb840ca220 0x7fcb8415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 --2- 172.21.15.64:0/3112576085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb68004810 0x7fcb841f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 >> 172.21.15.64:0/3112576085 conn(0x7fcb840b2b50 msgr2=0x7fcb84158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:06.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 shutdown_connections 2024-09-21T07:23:06.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.229+0000 7fcb89000640 1 -- 172.21.15.64:0/3112576085 wait complete. 2024-09-21T07:23:06.255 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":5,"flags":0,"active_gid":4120,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3453127412},{"type":"v1","addr":"172.21.15.90:6801","nonce":3453127412}]},"active_addr":"172.21.15.90:6801/3453127412","active_change":"2024-09-21T07:22:27.403938+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4167,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":397304876}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":21890083}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":1966804985}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":3744596380}]}]} 2024-09-21T07:23:06.258 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T07:23:06.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T07:23:06.259 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- 172.21.15.64:0/764532093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80709b0 msgr2=0x7f88c80b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 --2- 172.21.15.64:0/764532093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80709b0 0x7f88c80b41c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009c80 tx=0x7f88b001cda0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- 172.21.15.64:0/764532093 shutdown_connections 2024-09-21T07:23:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 --2- 172.21.15.64:0/764532093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80709b0 0x7f88c80b41c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- 172.21.15.64:0/764532093 >> 172.21.15.64:0/764532093 conn(0x7f88c80ccbe0 msgr2=0x7f88c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- 172.21.15.64:0/764532093 shutdown_connections 2024-09-21T07:23:06.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- 172.21.15.64:0/764532093 wait complete. 2024-09-21T07:23:06.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 Processor -- start 2024-09-21T07:23:06.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.413+0000 7f88ce200640 1 -- start start 2024-09-21T07:23:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88c80709b0 0x7f88c81662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 0x7f88c80adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f88c816a240 con 0x7f88c80b4700 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88c816a0c0 con 0x7f88c815edb0 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f88c816a3c0 con 0x7f88c80709b0 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39652/0 (socket says 172.21.15.64:39652) 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 -- 172.21.15.64:0/515640947 learned_addr learned my addr 172.21.15.64:0/515640947 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88c7e00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 0x7f88c80adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88c7400640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88c80709b0 0x7f88c81662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 -- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88c80709b0 msgr2=0x7f88c81662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88c80709b0 0x7f88c81662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 -- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 msgr2=0x7f88c80adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 0x7f88c80adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 -- 172.21.15.64:0/515640947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c809bf00 con 0x7f88c80b4700 2024-09-21T07:23:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88c7e00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 0x7f88c80adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bea00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88b0098790 tx=0x7f88b00092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00bb070 con 0x7f88c80b4700 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88b0004c50 con 0x7f88c80b4700 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00b2040 con 0x7f88c80b4700 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c809b190 con 0x7f88c80b4700 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c809b750 con 0x7f88c80b4700 2024-09-21T07:23:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.417+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c80b41c0 con 0x7f88c80b4700 2024-09-21T07:23:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.421+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f88b0004040 con 0x7f88c80b4700 2024-09-21T07:23:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.421+0000 7f88bfe00640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 0x7f88a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.421+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f88b012e4a0 con 0x7f88c80b4700 2024-09-21T07:23:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.421+0000 7f88c7400640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 0x7f88a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.421+0000 7f88c7400640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 0x7f88a4075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f70 tx=0x7f88b8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.425+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f88b0016990 con 0x7f88c80b4700 2024-09-21T07:23:06.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.601+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88c809aee0 con 0x7f88c80b4700 2024-09-21T07:23:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.601+0000 7f88bfe00640 1 -- 172.21.15.64:0/515640947 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f88b00f9180 con 0x7f88c80b4700 2024-09-21T07:23:06.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:06.606 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 msgr2=0x7f88a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 0x7f88a4075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f70 tx=0x7f88b8009040 comp rx=0 tx=0).stop 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 msgr2=0x7f88c8155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88b0098790 tx=0x7f88b00092e0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 shutdown_connections 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88a4073200 0x7f88a4075710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88c815edb0 0x7f88c80adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88c80b4700 0x7f88c8155740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 --2- 172.21.15.64:0/515640947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88c80709b0 0x7f88c81662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 >> 172.21.15.64:0/515640947 conn(0x7f88c80ccbe0 msgr2=0x7f88c8158600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:06.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 shutdown_connections 2024-09-21T07:23:06.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.605+0000 7f88ce200640 1 -- 172.21.15.64:0/515640947 wait complete. 2024-09-21T07:23:06.628 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T07:23:06.629 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:06.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- 172.21.15.64:0/751159951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c003ad0 msgr2=0x7f6e2c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 --2- 172.21.15.64:0/751159951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c003ad0 0x7f6e2c003f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800bb10 tx=0x7f6e3801cd80 comp rx=0 tx=0).stop 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- 172.21.15.64:0/751159951 shutdown_connections 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 --2- 172.21.15.64:0/751159951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e2c003ad0 0x7f6e2c003f40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- 172.21.15.64:0/751159951 >> 172.21.15.64:0/751159951 conn(0x7f6e4406e890 msgr2=0x7f6e440b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- 172.21.15.64:0/751159951 shutdown_connections 2024-09-21T07:23:06.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- 172.21.15.64:0/751159951 wait complete. 2024-09-21T07:23:06.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 Processor -- start 2024-09-21T07:23:06.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.785+0000 7f6e4c600640 1 -- start start 2024-09-21T07:23:06.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c003ad0 0x7f6e441f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e44158120 0x7f6e44158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44160ec0 con 0x7f6e440c7df0 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44160d40 con 0x7f6e2c003ad0 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6e44161040 con 0x7f6e44158120 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39684/0 (socket says 172.21.15.64:39684) 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 -- 172.21.15.64:0/2709541199 learned_addr learned my addr 172.21.15.64:0/2709541199 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4a600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e44158120 0x7f6e44158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49c00640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c003ad0 0x7f6e441f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 -- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e44158120 msgr2=0x7f6e44158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e44158120 0x7f6e44158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 -- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c003ad0 msgr2=0x7f6e441f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c003ad0 0x7f6e441f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 -- 172.21.15.64:0/2709541199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e440cd290 con 0x7f6e440c7df0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e49200640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e30003e80 tx=0x7f6e30001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30015070 con 0x7f6e440c7df0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e30011840 con 0x7f6e440c7df0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e441f90a0 con 0x7f6e440c7df0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011c70 con 0x7f6e440c7df0 2024-09-21T07:23:06.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e441f9360 con 0x7f6e440c7df0 2024-09-21T07:23:06.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.789+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e44073fa0 con 0x7f6e440c7df0 2024-09-21T07:23:06.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.793+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6e30018070 con 0x7f6e440c7df0 2024-09-21T07:23:06.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.793+0000 7f6e41600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 0x7f6e24075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:06.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.793+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6e30094df0 con 0x7f6e440c7df0 2024-09-21T07:23:06.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.793+0000 7f6e49c00640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 0x7f6e24075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:06.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.793+0000 7f6e49c00640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 0x7f6e24075740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e380b0000 tx=0x7f6e380a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:06.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.797+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6e3005fb40 con 0x7f6e440c7df0 2024-09-21T07:23:06.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.977+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e4415dd60 con 0x7f6e440c7df0 2024-09-21T07:23:06.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.977+0000 7f6e41600640 1 -- 172.21.15.64:0/2709541199 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f6e3005f440 con 0x7f6e440c7df0 2024-09-21T07:23:06.982 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:06.982 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 msgr2=0x7f6e24075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 0x7f6e24075740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e380b0000 tx=0x7f6e380a7040 comp rx=0 tx=0).stop 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 msgr2=0x7f6e440ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e30003e80 tx=0x7f6e30001640 comp rx=0 tx=0).stop 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 shutdown_connections 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6e24073230 0x7f6e24075740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e44158120 0x7f6e44158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e440c7df0 0x7f6e440ccd50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 --2- 172.21.15.64:0/2709541199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c003ad0 0x7f6e441f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 >> 172.21.15.64:0/2709541199 conn(0x7f6e4406e890 msgr2=0x7f6e4415e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 shutdown_connections 2024-09-21T07:23:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:06.981+0000 7f6e4c600640 1 -- 172.21.15.64:0/2709541199 wait complete. 2024-09-21T07:23:07.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T07:23:07.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T07:23:07.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T07:23:07.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T07:23:07.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T07:23:07.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T07:23:07.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T07:23:07.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T07:23:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 -- 172.21.15.64:0/733143388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034e30 msgr2=0x7efd88035240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 --2- 172.21.15.64:0/733143388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034e30 0x7efd88035240 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd880e4a80 tx=0x7efd7c01c770 comp rx=0 tx=0).stop 2024-09-21T07:23:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 -- 172.21.15.64:0/733143388 shutdown_connections 2024-09-21T07:23:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 --2- 172.21.15.64:0/733143388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034e30 0x7efd88035240 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 --2- 172.21.15.64:0/733143388 >> v2:172.21.15.90:3300/0 conn(0x7efd88034390 0x7efd880dfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.289+0000 7efd94a00640 1 -- 172.21.15.64:0/733143388 >> 172.21.15.64:0/733143388 conn(0x7efd8801d9b0 msgr2=0x7efd88039670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.293+0000 7efd94a00640 1 -- 172.21.15.64:0/733143388 shutdown_connections 2024-09-21T07:23:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.293+0000 7efd94a00640 1 -- 172.21.15.64:0/733143388 wait complete. 2024-09-21T07:23:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.293+0000 7ff6f7400640 1 -- 172.21.15.64:0/3863883872 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40a66e0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 -- 172.21.15.64:0/3863883872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b4e30 msgr2=0x7ff6f80d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3863883872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b4e30 0x7ff6f80d2ad0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806d280 tx=0x7ff6e401c850 comp rx=0 tx=0).stop 2024-09-21T07:23:07.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 -- 172.21.15.64:0/3863883872 shutdown_connections 2024-09-21T07:23:07.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3863883872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b4e30 0x7ff6f80d2ad0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3863883872 >> v2:172.21.15.90:3300/0 conn(0x7ff6f80b9830 0x7ff6f80d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 -- 172.21.15.64:0/3863883872 >> 172.21.15.64:0/3863883872 conn(0x7ff6f80d4310 msgr2=0x7ff6f80d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 -- 172.21.15.64:0/3863883872 shutdown_connections 2024-09-21T07:23:07.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7efd94a00640 1 Processor -- start 2024-09-21T07:23:07.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.297+0000 7ff6fe600640 1 -- 172.21.15.64:0/3863883872 wait complete. 2024-09-21T07:23:07.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 -- start start 2024-09-21T07:23:07.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 -- 172.21.15.64:0/745448010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 msgr2=0x7ffafc159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 --2- 172.21.15.64:0/745448010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 0x7ffafc159e80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0b3bc0 tx=0x7ffaf401c890 comp rx=0 tx=0).stop 2024-09-21T07:23:07.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ff6fe600640 1 Processor -- start 2024-09-21T07:23:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 -- 172.21.15.64:0/745448010 shutdown_connections 2024-09-21T07:23:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 --2- 172.21.15.64:0/745448010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 0x7ffafc159e80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 --2- 172.21.15.64:0/745448010 >> v2:172.21.15.64:3300/0 conn(0x7ffafc0cba10 0x7ffafc074770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 -- 172.21.15.64:0/745448010 >> 172.21.15.64:0/745448010 conn(0x7ffafc0d0fb0 msgr2=0x7ffafc0d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ff6fe600640 1 -- start start 2024-09-21T07:23:07.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 0x7efd880d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034390 0x7efd880d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd88034e30 0x7efd880d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efd88051850 con 0x7efd88034390 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd880516d0 con 0x7efd88005c60 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd94a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efd880519d0 con 0x7efd88034e30 2024-09-21T07:23:07.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd8e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 0x7efd880d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd8e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 0x7efd880d3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54434/0 (socket says 172.21.15.64:54434) 2024-09-21T07:23:07.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd8e800640 1 -- 172.21.15.64:0/700989670 learned_addr learned my addr 172.21.15.64:0/700989670 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd8f200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd88034e30 0x7efd880d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7efd8de00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034390 0x7efd880d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 -- 172.21.15.64:0/682428261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c1602f0 msgr2=0x7fc89c06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/682428261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c1602f0 0x7fc89c06f890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc89c06dda0 tx=0x7fc89401e730 comp rx=0 tx=0).stop 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 -- 172.21.15.64:0/682428261 shutdown_connections 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/682428261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c1602f0 0x7fc89c06f890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/682428261 >> v2:172.21.15.90:3300/0 conn(0x7fc89c15f9a0 0x7fc89c15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 -- 172.21.15.64:0/682428261 >> 172.21.15.64:0/682428261 conn(0x7fc89c06d450 msgr2=0x7fc89c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7fc8a1c00640 1 -- 172.21.15.64:0/682428261 shutdown_connections 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fc8a1c00640 1 -- 172.21.15.64:0/682428261 wait complete. 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7f53fd600640 1 -- 172.21.15.64:0/2761967850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 msgr2=0x7f53f8162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7f53fd600640 1 --2- 172.21.15.64:0/2761967850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f8162240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53f8071af0 tx=0x7f53e401c8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7f53fd600640 1 -- 172.21.15.64:0/2761967850 shutdown_connections 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f53fd600640 1 --2- 172.21.15.64:0/2761967850 >> v2:172.21.15.64:3300/0 conn(0x7f53f8162780 0x7f53f80cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f53fd600640 1 --2- 172.21.15.64:0/2761967850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f8162240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f53fd600640 1 -- 172.21.15.64:0/2761967850 >> 172.21.15.64:0/2761967850 conn(0x7f53f80d00f0 msgr2=0x7f53f80d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.301+0000 7ffb01e00640 1 -- 172.21.15.64:0/745448010 shutdown_connections 2024-09-21T07:23:07.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ffb01e00640 1 -- 172.21.15.64:0/745448010 wait complete. 2024-09-21T07:23:07.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f53fd600640 1 -- 172.21.15.64:0/2761967850 shutdown_connections 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 -- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd88034e30 msgr2=0x7efd880d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd88034e30 0x7efd880d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 -- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034390 msgr2=0x7efd880d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd88034390 0x7efd880d46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd880d7730 con 0x7efd88005c60 2024-09-21T07:23:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 -- 172.21.15.64:0/1694213219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f740cf110 msgr2=0x7f6f740cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 --2- 172.21.15.64:0/1694213219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f740cf110 0x7f6f740cf520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009870 tx=0x7f6f6401c720 comp rx=0 tx=0).stop 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 -- 172.21.15.64:0/1694213219 shutdown_connections 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 --2- 172.21.15.64:0/1694213219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f740cf110 0x7f6f740cf520 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 -- 172.21.15.64:0/1694213219 >> 172.21.15.64:0/1694213219 conn(0x7f6f7406feb0 msgr2=0x7f6f740702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 0x7ff6f80b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 -- 172.21.15.64:0/2272062503 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 msgr2=0x7ff81415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd8e800640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 0x7efd880d3f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8000b410 tx=0x7efd8000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 --2- 172.21.15.64:0/2272062503 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff81415edc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff800009900 tx=0x7ff80001db30 comp rx=0 tx=0).stop 2024-09-21T07:23:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 -- 172.21.15.64:0/2272062503 shutdown_connections 2024-09-21T07:23:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f53fd600640 1 -- 172.21.15.64:0/2761967850 wait complete. 2024-09-21T07:23:07.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80014e30 con 0x7efd88005c60 2024-09-21T07:23:07.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd80005980 con 0x7efd88005c60 2024-09-21T07:23:07.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 --2- 172.21.15.64:0/2272062503 >> v2:172.21.15.90:3300/0 conn(0x7ff8140cc9b0 0x7ff8140ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 --2- 172.21.15.64:0/2272062503 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff81415edc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80005e10 con 0x7efd88005c60 2024-09-21T07:23:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 -- 172.21.15.64:0/2272062503 >> 172.21.15.64:0/2272062503 conn(0x7ff8140b1c60 msgr2=0x7ff8140b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 -- 172.21.15.64:0/1694213219 shutdown_connections 2024-09-21T07:23:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b9830 0x7ff6f8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6f80d26c0 0x7ff6f81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f816be20 con 0x7ff6f80b9830 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f816bca0 con 0x7ff6f80d26c0 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fe600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f816bfa0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 -- 172.21.15.64:0/3157085156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0b3c60 msgr2=0x7fe18c0b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 --2- 172.21.15.64:0/3157085156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0b3c60 0x7fe18c0b4070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe174009840 tx=0x7fe17401c640 comp rx=0 tx=0).stop 2024-09-21T07:23:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 -- 172.21.15.64:0/3157085156 shutdown_connections 2024-09-21T07:23:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 --2- 172.21.15.64:0/3157085156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0b3c60 0x7fe18c0b4070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 --2- 172.21.15.64:0/3157085156 >> v2:172.21.15.64:3300/0 conn(0x7fe18c0d0d40 0x7fe18c0d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 -- 172.21.15.64:0/3157085156 >> 172.21.15.64:0/3157085156 conn(0x7fe18c09d5e0 msgr2=0x7fe18c0d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 -- 172.21.15.64:0/3157085156 shutdown_connections 2024-09-21T07:23:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fd200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 0x7ff6f80b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fd200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 0x7ff6f80b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37534/0 (socket says 172.21.15.64:37534) 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff6fd200640 1 -- 172.21.15.64:0/3634986933 learned_addr learned my addr 172.21.15.64:0/3634986933 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fdc00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6f80d26c0 0x7ff6f81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6f7e00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b9830 0x7ff6f8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 -- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6f80d26c0 msgr2=0x7ff6f81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6f80d26c0 0x7ff6f81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 -- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b9830 msgr2=0x7ff6f8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b9830 0x7ff6f8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f80b8c60 con 0x7ff6f80b4e30 2024-09-21T07:23:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6f7e00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6f80b9830 0x7ff6f8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:07.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd880d7450 con 0x7efd88005c60 2024-09-21T07:23:07.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd880d1af0 con 0x7efd88005c60 2024-09-21T07:23:07.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fd200640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 0x7ff6f80b7330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000ba50 tx=0x7ff6f000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ffb01e00640 1 Processor -- start 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0019070 con 0x7ff6f80b4e30 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6f000cd00 con 0x7ff6f80b4e30 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00146a0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ffb01e00640 1 -- start start 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 -- 172.21.15.64:0/2272062503 shutdown_connections 2024-09-21T07:23:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7ff818a00640 1 -- 172.21.15.64:0/2272062503 wait complete. 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fe18be00640 1 -- 172.21.15.64:0/3157085156 wait complete. 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fe18be00640 1 Processor -- start 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fe18be00640 1 -- start start 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f80cbf20 con 0x7ff6f80b4e30 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f80cc4e0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff818a00640 1 Processor -- start 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fc8a1c00640 1 Processor -- start 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7fc8a1c00640 1 -- start start 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc89c09df30 0x7fc89c1f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c15f9a0 0x7fc89c1f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 0x7fc89c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c0ccef0 con 0x7fc89c15f9a0 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c0ccd70 con 0x7fc89c09df30 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc8a1c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c0cd070 con 0x7fc89c1602f0 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 0x7fc89c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 0x7fc89c150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37544/0 (socket says 172.21.15.64:37544) 2024-09-21T07:23:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 -- 172.21.15.64:0/2184610229 learned_addr learned my addr 172.21.15.64:0/2184610229 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 -- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc89c09df30 msgr2=0x7fc89c1f7950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc89c09df30 0x7fc89c1f7950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 -- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c15f9a0 msgr2=0x7fc89c1f4d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc893e00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c15f9a0 0x7fc89c1f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7f53fd600640 1 Processor -- start 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7f53fd600640 1 -- start start 2024-09-21T07:23:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.305+0000 7f6f73200640 1 -- 172.21.15.64:0/1694213219 wait complete. 2024-09-21T07:23:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7ff818a00640 1 -- start start 2024-09-21T07:23:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc89c15f9a0 0x7fc89c1f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7fc89b400640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c1f7e90 con 0x7fc89c1602f0 2024-09-21T07:23:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7f6f73200640 1 Processor -- start 2024-09-21T07:23:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.309+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd880d44d0 con 0x7efd88005c60 2024-09-21T07:23:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc89b400640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 0x7fc89c150480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc89401cde0 tx=0x7fc8940ac7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f6f73200640 1 -- start start 2024-09-21T07:23:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6f80d2ad0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe18c0b3c60 0x7fe18c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8940ac2e0 con 0x7fc89c1602f0 2024-09-21T07:23:07.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd80005fb0 con 0x7efd88005c60 2024-09-21T07:23:07.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 0x7f53f81fc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe18c0b45b0 0x7fe18c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8940ac480 con 0x7fc89c1602f0 2024-09-21T07:23:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8940acb70 con 0x7fc89c1602f0 2024-09-21T07:23:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53f8162780 0x7f53f80b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c1f4550 con 0x7fc89c1602f0 2024-09-21T07:23:07.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 0x7fe18c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c1f8680 con 0x7fc89c1602f0 2024-09-21T07:23:07.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53f7400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 0x7f53f81fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53f7400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 0x7f53f81fc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37558/0 (socket says 172.21.15.64:37558) 2024-09-21T07:23:07.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f81522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54462/0 (socket says 172.21.15.64:54462) 2024-09-21T07:23:07.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8140ca5e0 0x7ff814154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53f7400640 1 -- 172.21.15.64:0/3512252418 learned_addr learned my addr 172.21.15.64:0/3512252418 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80cc640 con 0x7f53f8162780 2024-09-21T07:23:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c0d3030 con 0x7fe18c0b3c60 2024-09-21T07:23:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c1620f0 con 0x7fe18c0b45b0 2024-09-21T07:23:07.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd70073250 0x7efd70075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8140cc9b0 0x7ff81414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c0d31b0 con 0x7fe18c0d0d40 2024-09-21T07:23:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 0x7ffafc0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 0x7ffafc158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffafc0cba10 0x7ffafc15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc15d2e0 con 0x7ffafc0cba10 2024-09-21T07:23:07.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 0x7fe18c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe18c0b3c60 0x7fe18c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 0x7fe18c0b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37560/0 (socket says 172.21.15.64:37560) 2024-09-21T07:23:07.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe18b400640 1 -- 172.21.15.64:0/3069340127 learned_addr learned my addr 172.21.15.64:0/3069340127 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc15d160 con 0x7ffafc074cb0 2024-09-21T07:23:07.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffb01e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc15d460 con 0x7ffafc0cb600 2024-09-21T07:23:07.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff814156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd8009c070 con 0x7efd88005c60 2024-09-21T07:23:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7fe183e00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe18c0b45b0 0x7fe18c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff813400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8140ca5e0 0x7ff814154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 0x7ffafc158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 0x7ffafc158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37562/0 (socket says 172.21.15.64:37562) 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 -- 172.21.15.64:0/3142536896 learned_addr learned my addr 172.21.15.64:0/3142536896 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80cc4c0 con 0x7f53f80cc0b0 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f53f816c3e0 con 0x7f53f80ce030 2024-09-21T07:23:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff813e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff814156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff813e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff814156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37576/0 (socket says 172.21.15.64:37576) 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff813e00640 1 -- 172.21.15.64:0/772563007 learned_addr learned my addr 172.21.15.64:0/772563007 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff81416a0f0 con 0x7ff8140cc9b0 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd8de00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd70073250 0x7efd70075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7efd7007ca20 0x7efd7007eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd80024e50 con 0x7efd7007ca20 2024-09-21T07:23:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd800a3050 con 0x7efd88005c60 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff814169f70 con 0x7ff8140ca5e0 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff81416a270 con 0x7ff81415e9b0 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 -- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 msgr2=0x7ffafc0cada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc074cb0 0x7ffafc0cada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 -- 172.21.15.64:0/3142536896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffafc0cba10 msgr2=0x7ffafc15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffafc0cba10 0x7ffafc15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.313+0000 7ffafbe00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc15df10 con 0x7ffafc0cb600 2024-09-21T07:23:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7efd8de00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd70073250 0x7efd70075760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0af000 tx=0x7efd7c01afb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 -- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 msgr2=0x7f53f81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f80cc0b0 0x7f53f81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 -- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53f8162780 msgr2=0x7f53f80b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53f8162780 0x7f53f80b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f81fcfa0 con 0x7f53f80ce030 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 -- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 msgr2=0x7fe18c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 0x7fe18c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 -- 172.21.15.64:0/3069340127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe18c0b3c60 msgr2=0x7fe18c151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe18c0b3c60 0x7fe18c151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c15c180 con 0x7fe18c0b45b0 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 -- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 msgr2=0x7ff814156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff81415e9b0 0x7ff814156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ffafbe00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 0x7ffafc158d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffae80058d0 tx=0x7ffae800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 -- 172.21.15.64:0/772563007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8140cc9b0 msgr2=0x7ff81414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7efd8f200640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7efd7007ca20 0x7efd7007eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8140cc9b0 0x7ff81414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8140b2d90 con 0x7ff8140ca5e0 2024-09-21T07:23:07.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe18b400640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe18c0d0d40 0x7fe18c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53f7400640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 0x7f53f81fc230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e9f0 tx=0x7f53f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc89c15fdb0 con 0x7fc89c1602f0 2024-09-21T07:23:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc8940acd10 con 0x7fc89c1602f0 2024-09-21T07:23:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000cd80 con 0x7f53f80ce030 2024-09-21T07:23:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53f0011560 con 0x7f53f80ce030 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0011930 con 0x7f53f80ce030 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f815ab90 con 0x7f53f80ce030 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f815b150 con 0x7f53f80ce030 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8017070 con 0x7ffafc0cb600 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffae8009cc0 con 0x7ffafc0cb600 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80106c0 con 0x7ffafc0cb600 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc16c9d0 con 0x7ffafc0cb600 2024-09-21T07:23:07.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff813400640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8140ca5e0 0x7ff814154b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c390 tx=0x7ff80400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff8140ca5e0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe183e00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe18c0b45b0 0x7fe18c15bc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1740ac000 tx=0x7fe1740a9520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ad050 con 0x7fe18c0b45b0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe174004320 con 0x7fe18c0b45b0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740053a0 con 0x7fe18c0b45b0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c151e90 con 0x7fe18c0b45b0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c0b5070 con 0x7fe18c0b45b0 2024-09-21T07:23:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff804003600 con 0x7ff8140ca5e0 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804003a30 con 0x7ff8140ca5e0 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff6f001d3f0 con 0x7ff6f80b4e30 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6d8073230 0x7ff6d8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff6f0094850 con 0x7ff6f80b4e30 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7ff6d807ca00 0x7ff6d807ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6d807f560 con 0x7ff6d807ca00 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff6f0094c40 con 0x7ff6f80b4e30 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6f7e00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6d8073230 0x7ff6d8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 0x7f6f740b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 0x7f6f74204d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f74141540 0x7f6f740c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74074e40 con 0x7f6f740cf110 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74074cc0 con 0x7f6f74141540 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f73200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6f74074fc0 con 0x7f6f74071640 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fc892a00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8780732d0 0x7fc8780757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7efd8f200640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7efd7007ca20 0x7efd7007eeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc894130db0 con 0x7fc89c1602f0 2024-09-21T07:23:07.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f71e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 0x7f6f740b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f71400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 0x7f6f74204d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc89aa00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8780732d0 0x7fc8780757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 0x7f6f74204d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39846/0 (socket says 172.21.15.64:39846) 2024-09-21T07:23:07.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 -- 172.21.15.64:0/1403436765 learned_addr learned my addr 172.21.15.64:0/1403436765 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc16cf90 con 0x7ffafc0cb600 2024-09-21T07:23:07.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff6fdc00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7ff6d807ca00 0x7ff6d807ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81414e8d0 con 0x7ff8140ca5e0 2024-09-21T07:23:07.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8141facf0 con 0x7ff8140ca5e0 2024-09-21T07:23:07.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7ec001040 con 0x7ff8140ca5e0 2024-09-21T07:23:07.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe18c0b4070 con 0x7fe18c0b45b0 2024-09-21T07:23:07.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffafc16da60 con 0x7ffafc0cb600 2024-09-21T07:23:07.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc892a00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7fc87807caa0 0x7fc87807ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8940b8ec0 con 0x7fc87807caa0 2024-09-21T07:23:07.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc8941363a0 con 0x7fc89c1602f0 2024-09-21T07:23:07.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53d0001040 con 0x7f53f80ce030 2024-09-21T07:23:07.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f72800640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f74141540 0x7f6f740c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== osd.0 v2:172.21.15.64:6816/3519639794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd80024e50 con 0x7efd7007ca20 2024-09-21T07:23:07.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc893e00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7fc87807caa0 0x7fc87807ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 -- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 msgr2=0x7f6f740b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc89aa00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8780732d0 0x7fc8780757e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc884007890 tx=0x7fc884001550 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7ff6fdc00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7ff6d807ca00 0x7ff6d807ee90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7fc893e00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7fc87807caa0 0x7fc87807ef30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.317+0000 7f6f71e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 0x7f6f740b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37584/0 (socket says 172.21.15.64:37584) 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 0x7f6f740b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 -- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f74141540 msgr2=0x7f6f740c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f74141540 0x7f6f740c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f740ca0b0 con 0x7f6f740cf110 2024-09-21T07:23:07.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f72800640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f74141540 0x7f6f740c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:07.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53f0011ad0 con 0x7f53f80ce030 2024-09-21T07:23:07.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.321+0000 7f6f71400640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 0x7f6f74204d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c3a0 tx=0x7f6f6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe1740b0070 con 0x7fe18c0b45b0 2024-09-21T07:23:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffae801a070 con 0x7ffafc0cb600 2024-09-21T07:23:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff80401a070 con 0x7ff8140ca5e0 2024-09-21T07:23:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60017070 con 0x7f6f740cf110 2024-09-21T07:23:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f60003600 con 0x7f6f740cf110 2024-09-21T07:23:07.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53efe00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53d8073300 0x7f53d8075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f53f0094d30 con 0x7f53f80ce030 2024-09-21T07:23:07.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53f7e00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53d8073300 0x7f53d8075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe168073230 0x7fe168075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53efe00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f53d807cac0 0x7f53d807ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53d807f620 con 0x7f53d807cac0 2024-09-21T07:23:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53f00950a0 con 0x7f53f80ce030 2024-09-21T07:23:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffadc073200 0x7ffadc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffae8094b70 con 0x7ffafc0cb600 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe17412ed20 con 0x7fe18c0b45b0 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7fe16807c9f0 0x7fe16807ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe16807f550 con 0x7fe16807c9f0 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe174131380 con 0x7fe18c0b45b0 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== osd.1 v2:172.21.15.64:6824/1622648472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6d807f560 con 0x7ff6d807ca00 2024-09-21T07:23:07.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe18aa00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe168073230 0x7fe168075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffb00a00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffadc073200 0x7ffadc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7ffadc07c9c0 0x7ffadc07ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffae8013e50 con 0x7ffadc07c9c0 2024-09-21T07:23:07.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffae8094f60 con 0x7ffafc0cb600 2024-09-21T07:23:07.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== osd.2 v2:172.21.15.64:6808/3196938996 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8940b8ec0 con 0x7fc87807caa0 2024-09-21T07:23:07.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe18b400640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7fe16807c9f0 0x7fe16807ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff6f7e00640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6d8073230 0x7ff6d8075740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80d4d10 tx=0x7ff6e8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ffb01400640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7ffadc07c9c0 0x7ffadc07ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff80b400640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7f4073200 0x7ff7f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff804093a60 con 0x7ff8140ca5e0 2024-09-21T07:23:07.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53fcc00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f53d807cac0 0x7f53d807ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f53f7e00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53d8073300 0x7f53d8075810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53e40af000 tx=0x7f53e401b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60003a50 con 0x7f6f740cf110 2024-09-21T07:23:07.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7f6f71e00640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f74071640 0x7f6f740b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7ff812a00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7f4073200 0x7ff7f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe18b400640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7fe16807c9f0 0x7fe16807ee80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.325+0000 7fe18aa00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe168073230 0x7fe168075740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009a00 tx=0x7fe17c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ffb00a00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffadc073200 0x7ffadc075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffafc070fb0 tx=0x7ffaf00078b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f740ca390 con 0x7f6f740cf110 2024-09-21T07:23:07.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ffb01400640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7ffadc07c9c0 0x7ffadc07ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7f53fcc00640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f53d807cac0 0x7f53d807ef50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff80b400640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7ff7f407c9c0 0x7ff7f407ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7f407f520 con 0x7ff7f407c9c0 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff804093e50 con 0x7ff8140ca5e0 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff812a00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7f4073200 0x7ff7f4075710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0000 tx=0x7ff80000b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f740ca950 con 0x7f6f740cf110 2024-09-21T07:23:07.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== osd.7 v2:172.21.15.90:6802/46023510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe16807f550 con 0x7fe16807c9f0 2024-09-21T07:23:07.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== osd.4 v2:172.21.15.90:6810/2460854441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffae8013e50 con 0x7ffadc07c9c0 2024-09-21T07:23:07.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff813e00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7ff7f407c9c0 0x7ff7f407ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff813e00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7ff7f407c9c0 0x7ff7f407ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== osd.3 v2:172.21.15.64:6800/2986416528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53d807f620 con 0x7f53d807cac0 2024-09-21T07:23:07.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f740cf520 con 0x7f6f740cf110 2024-09-21T07:23:07.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.329+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== osd.6 v2:172.21.15.90:6818/1592578093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7f407f520 con 0x7ff7f407c9c0 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.333+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f6001a070 con 0x7f6f740cf110 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.333+0000 7f6f6a000640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f54073200 0x7f6f54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.333+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6f60093900 con 0x7f6f740cf110 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f71e00640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f54073200 0x7f6f54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f6a000640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7f6f5407c840 0x7f6f5407ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f5407f3a0 con 0x7f6f5407c840 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6f6005a4b0 con 0x7f6f740cf110 2024-09-21T07:23:07.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f71e00640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f54073200 0x7f6f54075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0015d0 tx=0x7f6f6c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f72800640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7f6f5407c840 0x7f6f5407ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.337+0000 7f6f72800640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7f6f5407c840 0x7f6f5407ecd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.341+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== osd.5 v2:172.21.15.90:6826/3363919567 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f5407f3a0 con 0x7f6f5407c840 2024-09-21T07:23:07.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 --> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe18c151c00 con 0x7fe16807c9f0 2024-09-21T07:23:07.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe182a00640 1 -- 172.21.15.64:0/3069340127 <== osd.7 v2:172.21.15.90:6802/46023510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe18c151c00 con 0x7fe16807c9f0 2024-09-21T07:23:07.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7fe16807c9f0 msgr2=0x7fe16807ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7fe16807c9f0 0x7fe16807ee80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe168073230 msgr2=0x7fe168075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe168073230 0x7fe168075740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009a00 tx=0x7fe17c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe18c0b45b0 msgr2=0x7fe18c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18be00640 1 --2- 172.21.15.64:0/3069340127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe18c0b45b0 0x7fe18c15bc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1740ac000 tx=0x7fe1740a9520 comp rx=0 tx=0).stop 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.349+0000 7fe18b400640 1 -- 172.21.15.64:0/3069340127 reap_dead start 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.353+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 shutdown_connections 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.353+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 >> 172.21.15.64:0/3069340127 conn(0x7fe18c09d5e0 msgr2=0x7fe18c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.353+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 shutdown_connections 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.353+0000 7fe18be00640 1 -- 172.21.15.64:0/3069340127 wait complete. 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 --> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6f806afe0 con 0x7ff6d807ca00 2024-09-21T07:23:07.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc89c1f8850 con 0x7fc87807caa0 2024-09-21T07:23:07.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd88051fb0 con 0x7efd7007ca20 2024-09-21T07:23:07.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc892a00640 1 -- 172.21.15.64:0/2184610229 <== osd.2 v2:172.21.15.64:6808/3196938996 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc89c1f8850 con 0x7fc87807caa0 2024-09-21T07:23:07.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd86a00640 1 -- 172.21.15.64:0/700989670 <== osd.0 v2:172.21.15.64:6816/3519639794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd88051fb0 con 0x7efd7007ca20 2024-09-21T07:23:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6f4c00640 1 -- 172.21.15.64:0/3634986933 <== osd.1 v2:172.21.15.64:6824/1622648472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff6f806afe0 con 0x7ff6d807ca00 2024-09-21T07:23:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7efd7007ca20 msgr2=0x7efd7007eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7efd7007ca20 0x7efd7007eeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7fc87807caa0 msgr2=0x7fc87807ef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7fc87807caa0 0x7fc87807ef30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8780732d0 msgr2=0x7fc8780757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd70073250 msgr2=0x7efd70075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd70073250 0x7efd70075760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0af000 tx=0x7efd7c01afb0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7ff6d807ca00 msgr2=0x7ff6d807ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7ff6d807ca00 0x7ff6d807ee90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 msgr2=0x7efd880d3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6d8073230 msgr2=0x7ff6d8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6d8073230 0x7ff6d8075740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80d4d10 tx=0x7ff6e8008040 comp rx=0 tx=0).stop 2024-09-21T07:23:07.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 msgr2=0x7ff6f80b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fe600640 1 --2- 172.21.15.64:0/3634986933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6f80b4e30 0x7ff6f80b7330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000ba50 tx=0x7ff6f000bf10 comp rx=0 tx=0).stop 2024-09-21T07:23:07.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8780732d0 0x7fc8780757e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc884007890 tx=0x7fc884001550 comp rx=0 tx=0).stop 2024-09-21T07:23:07.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 msgr2=0x7fc89c150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7fc8a1c00640 1 --2- 172.21.15.64:0/2184610229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc89c1602f0 0x7fc89c150480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc89401cde0 tx=0x7fc8940ac7a0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.357+0000 7ff6fdc00640 1 -- 172.21.15.64:0/3634986933 reap_dead start 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 shutdown_connections 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 >> 172.21.15.64:0/3634986933 conn(0x7ff6f80d4310 msgr2=0x7ff6f806e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 shutdown_connections 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7fc89b400640 1 -- 172.21.15.64:0/2184610229 reap_dead start 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 shutdown_connections 2024-09-21T07:23:07.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ff6fe600640 1 -- 172.21.15.64:0/3634986933 wait complete. 2024-09-21T07:23:07.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 >> 172.21.15.64:0/2184610229 conn(0x7fc89c06d450 msgr2=0x7fc89c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd94a00640 1 --2- 172.21.15.64:0/700989670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd88005c60 0x7efd880d3f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8000b410 tx=0x7efd8000b810 comp rx=0 tx=0).stop 2024-09-21T07:23:07.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 shutdown_connections 2024-09-21T07:23:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd8f200640 1 -- 172.21.15.64:0/700989670 reap_dead start 2024-09-21T07:23:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7fc8a1c00640 1 -- 172.21.15.64:0/2184610229 wait complete. 2024-09-21T07:23:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 shutdown_connections 2024-09-21T07:23:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 >> 172.21.15.64:0/700989670 conn(0x7efd8801d9b0 msgr2=0x7efd880d8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 shutdown_connections 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7efd94a00640 1 -- 172.21.15.64:0/700989670 wait complete. 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 --> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffafc159e80 con 0x7ffadc07c9c0 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53d0002de0 con 0x7f53d807cac0 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7f53efe00640 1 -- 172.21.15.64:0/3512252418 <== osd.3 v2:172.21.15.64:6800/2986416528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53d0002de0 con 0x7f53d807cac0 2024-09-21T07:23:07.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ffaf8c00640 1 -- 172.21.15.64:0/3142536896 <== osd.4 v2:172.21.15.90:6810/2460854441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffafc159e80 con 0x7ffadc07c9c0 2024-09-21T07:23:07.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 --> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7ec002de0 con 0x7ff7f407c9c0 2024-09-21T07:23:07.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7ffadc07c9c0 msgr2=0x7ffadc07ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.361+0000 7ffb01e00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7ffadc07c9c0 0x7ffadc07ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f53d807cac0 msgr2=0x7f53d807ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f53d807cac0 0x7f53d807ef50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53d8073300 msgr2=0x7f53d8075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53d8073300 0x7f53d8075810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53e40af000 tx=0x7f53e401b0f0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 msgr2=0x7f53f81fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 --2- 172.21.15.64:0/3512252418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53f80ce030 0x7f53f81fc230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e9f0 tx=0x7f53f000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffadc073200 msgr2=0x7ffadc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffadc073200 0x7ffadc075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffafc070fb0 tx=0x7ffaf00078b0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 msgr2=0x7ffafc158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 --2- 172.21.15.64:0/3142536896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffafc0cb600 0x7ffafc158d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffae80058d0 tx=0x7ffae800dde0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff80b400640 1 -- 172.21.15.64:0/772563007 <== osd.6 v2:172.21.15.90:6818/1592578093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7ec002de0 con 0x7ff7f407c9c0 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fcc00640 1 -- 172.21.15.64:0/3512252418 reap_dead start 2024-09-21T07:23:07.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 shutdown_connections 2024-09-21T07:23:07.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 >> 172.21.15.64:0/3512252418 conn(0x7f53f80d00f0 msgr2=0x7f53f80af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01400640 1 -- 172.21.15.64:0/3142536896 reap_dead start 2024-09-21T07:23:07.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 shutdown_connections 2024-09-21T07:23:07.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 >> 172.21.15.64:0/3142536896 conn(0x7ffafc0d0fb0 msgr2=0x7ffafc0c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 shutdown_connections 2024-09-21T07:23:07.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ffb01e00640 1 -- 172.21.15.64:0/3142536896 wait complete. 2024-09-21T07:23:07.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7ff7f407c9c0 msgr2=0x7ff7f407ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7ff7f407c9c0 0x7ff7f407ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7f4073200 msgr2=0x7ff7f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7f4073200 0x7ff7f4075710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0000 tx=0x7ff80000b040 comp rx=0 tx=0).stop 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8140ca5e0 msgr2=0x7ff814154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 --2- 172.21.15.64:0/772563007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8140ca5e0 0x7ff814154b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c390 tx=0x7ff80400c850 comp rx=0 tx=0).stop 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff813e00640 1 -- 172.21.15.64:0/772563007 reap_dead start 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 shutdown_connections 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 >> 172.21.15.64:0/772563007 conn(0x7ff8140b1c60 msgr2=0x7ff814074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 shutdown_connections 2024-09-21T07:23:07.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7ff818a00640 1 -- 172.21.15.64:0/772563007 wait complete. 2024-09-21T07:23:07.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 shutdown_connections 2024-09-21T07:23:07.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.365+0000 7f53fd600640 1 -- 172.21.15.64:0/3512252418 wait complete. 2024-09-21T07:23:07.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 --> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f740b6db0 con 0x7f6f5407c840 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f6a000640 1 -- 172.21.15.64:0/1403436765 <== osd.5 v2:172.21.15.90:6826/3363919567 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f740b6db0 con 0x7f6f5407c840 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7f6f5407c840 msgr2=0x7f6f5407ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7f6f5407c840 0x7f6f5407ecd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f54073200 msgr2=0x7f6f54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f54073200 0x7f6f54075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0015d0 tx=0x7f6f6c009040 comp rx=0 tx=0).stop 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 msgr2=0x7f6f74204d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 --2- 172.21.15.64:0/1403436765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f740cf110 0x7f6f74204d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c3a0 tx=0x7f6f6000c860 comp rx=0 tx=0).stop 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f72800640 1 -- 172.21.15.64:0/1403436765 reap_dead start 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 shutdown_connections 2024-09-21T07:23:07.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 >> 172.21.15.64:0/1403436765 conn(0x7f6f7406feb0 msgr2=0x7f6f74155880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 shutdown_connections 2024-09-21T07:23:07.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.377+0000 7f6f73200640 1 -- 172.21.15.64:0/1403436765 wait complete. 2024-09-21T07:23:07.400 INFO:teuthology.orchestra.run.smithi064.stdout:60129542154 2024-09-21T07:23:07.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T07:23:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:64424509448 2024-09-21T07:23:07.408 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T07:23:07.410 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:07.411 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T07:23:07.412 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:07.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T07:23:07.415 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:07.416 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:07.416 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T07:23:07.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T07:23:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:55834574856 2024-09-21T07:23:07.421 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T07:23:07.429 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:07.430 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T07:23:07.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 -- 172.21.15.64:0/1904560321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 msgr2=0x7f4fe0050990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 --2- 172.21.15.64:0/1904560321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe0050990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000ca80 tx=0x7f4fdc01c830 comp rx=0 tx=0).stop 2024-09-21T07:23:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 -- 172.21.15.64:0/1904560321 shutdown_connections 2024-09-21T07:23:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 --2- 172.21.15.64:0/1904560321 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe004edf0 0x7f4fe004f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 --2- 172.21.15.64:0/1904560321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe0050990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 -- 172.21.15.64:0/1904560321 >> 172.21.15.64:0/1904560321 conn(0x7f4fe001d9b0 msgr2=0x7f4fe0039670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.665+0000 7f4fee000640 1 -- 172.21.15.64:0/1904560321 shutdown_connections 2024-09-21T07:23:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.669+0000 7f4fee000640 1 -- 172.21.15.64:0/1904560321 wait complete. 2024-09-21T07:23:07.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.673+0000 7f4fee000640 1 Processor -- start 2024-09-21T07:23:07.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.673+0000 7f4fee000640 1 -- start start 2024-09-21T07:23:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe00df120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe00511b0 0x7f4fe00e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00f4bd0 con 0x7f4fe0033bc0 2024-09-21T07:23:07.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00f4a50 con 0x7f4fe004edf0 2024-09-21T07:23:07.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe00f4d50 con 0x7f4fe00511b0 2024-09-21T07:23:07.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54498/0 (socket says 172.21.15.64:54498) 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 -- 172.21.15.64:0/3173702237 learned_addr learned my addr 172.21.15.64:0/3173702237 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 -- 172.21.15.64:0/1769399968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940ccd30 msgr2=0x7faa940cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe7400640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe00df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 -- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe00511b0 msgr2=0x7f4fe00e29f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe7e00640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe00511b0 0x7f4fe00e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe00511b0 0x7f4fe00e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 -- 172.21.15.64:0/3173702237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 msgr2=0x7f4fe00df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe00df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 -- 172.21.15.64:0/3173702237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe00dc610 con 0x7f4fe004edf0 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fe6a00640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b3e0 tx=0x7f4fd400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 --2- 172.21.15.64:0/1769399968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940ccd30 0x7faa940cd140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa94072220 tx=0x7faa8c020d50 comp rx=0 tx=0).stop 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4015020 con 0x7f4fe004edf0 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fd4011940 con 0x7f4fe004edf0 2024-09-21T07:23:07.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4011d90 con 0x7f4fe004edf0 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 -- 172.21.15.64:0/1769399968 shutdown_connections 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 --2- 172.21.15.64:0/1769399968 >> v2:172.21.15.64:3300/0 conn(0x7faa94071180 0x7faa94071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 --2- 172.21.15.64:0/1769399968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940b3d50 0x7faa940b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 --2- 172.21.15.64:0/1769399968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940ccd30 0x7faa940cd140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7faa9b800640 1 -- 172.21.15.64:0/1769399968 >> 172.21.15.64:0/1769399968 conn(0x7faa9406d4e0 msgr2=0x7faa940ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.677+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe00df660 con 0x7f4fe004edf0 2024-09-21T07:23:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.681+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe0181de0 con 0x7f4fe004edf0 2024-09-21T07:23:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.681+0000 7faa9b800640 1 -- 172.21.15.64:0/1769399968 shutdown_connections 2024-09-21T07:23:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.681+0000 7faa9b800640 1 -- 172.21.15.64:0/1769399968 wait complete. 2024-09-21T07:23:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.681+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0185e60 con 0x7f4fe004edf0 2024-09-21T07:23:07.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.685+0000 7faa9b800640 1 Processor -- start 2024-09-21T07:23:07.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.685+0000 7faa9b800640 1 -- start start 2024-09-21T07:23:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.685+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4fd4018020 con 0x7f4fe004edf0 2024-09-21T07:23:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.685+0000 7f4fdb400640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 0x7f4fc8075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.685+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4fd4094990 con 0x7f4fe004edf0 2024-09-21T07:23:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa94071180 0x7faa941f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f4fe7400640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 0x7f4fc8075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 0x7faa940ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c6bb0 con 0x7faa94071180 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c6a30 con 0x7faa940b3d50 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa9b800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faa940c6d30 con 0x7faa940ccd30 2024-09-21T07:23:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 0x7faa940ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 -- 172.21.15.64:0/320615895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0d04a0 msgr2=0x7f9b5c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 --2- 172.21.15.64:0/320615895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0d04a0 0x7f9b5c0b2d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c073a70 tx=0x7f9b4c01cce0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa93e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa93e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54514/0 (socket says 172.21.15.64:54514) 2024-09-21T07:23:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa93e00640 1 -- 172.21.15.64:0/1338492686 learned_addr learned my addr 172.21.15.64:0/1338492686 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 -- 172.21.15.64:0/320615895 shutdown_connections 2024-09-21T07:23:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 --2- 172.21.15.64:0/320615895 >> v2:172.21.15.64:3300/0 conn(0x7f9b5c074430 0x7f9b5c074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 --2- 172.21.15.64:0/320615895 >> v2:172.21.15.90:3300/0 conn(0x7f9b5c0b3260 0x7f9b5c073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 --2- 172.21.15.64:0/320615895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0d04a0 0x7f9b5c0b2d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 -- 172.21.15.64:0/320615895 >> 172.21.15.64:0/320615895 conn(0x7f9b5c0cdd20 msgr2=0x7f9b5c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa98e00640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa94071180 0x7faa941f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 -- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 msgr2=0x7faa940b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 -- 172.21.15.64:0/1338492686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa94071180 msgr2=0x7faa941f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 -- 172.21.15.64:0/1238134860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 msgr2=0x7fa3f80cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/1238134860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f80cd1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400afd0 tx=0x7fa3e401d4d0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 -- 172.21.15.64:0/320615895 shutdown_connections 2024-09-21T07:23:07.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa94071180 0x7faa941f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 -- 172.21.15.64:0/1338492686 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa94158dc0 con 0x7faa940ccd30 2024-09-21T07:23:07.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa93e00640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:23:07.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7f9b62400640 1 -- 172.21.15.64:0/320615895 wait complete. 2024-09-21T07:23:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 -- 172.21.15.64:0/1238134860 shutdown_connections 2024-09-21T07:23:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/1238134860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f80cd1e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/1238134860 >> v2:172.21.15.90:3300/0 conn(0x7fa3f80ca550 0x7fa3f80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa99800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 0x7faa940ca970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e970 tx=0x7faa8400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8400ccc0 con 0x7faa940ccd30 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7fa3f7e00640 1 -- 172.21.15.64:0/1238134860 >> 172.21.15.64:0/1238134860 conn(0x7fa3f80b1a90 msgr2=0x7fa3f80b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7fa3f7e00640 1 -- 172.21.15.64:0/1238134860 shutdown_connections 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa84004030 con 0x7faa940ccd30 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.689+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84004480 con 0x7faa940ccd30 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941e4dc0 con 0x7faa940ccd30 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941f54f0 con 0x7faa940ccd30 2024-09-21T07:23:07.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7f4fe7400640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 0x7f4fc8075760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0af000 tx=0x7f4fdc01b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4fd401f020 con 0x7f4fe004edf0 2024-09-21T07:23:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7fa3f7e00640 1 -- 172.21.15.64:0/1238134860 wait complete. 2024-09-21T07:23:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa941e5030 con 0x7faa940ccd30 2024-09-21T07:23:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7f9b62400640 1 Processor -- start 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 Processor -- start 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 -- start start 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.693+0000 7f9b62400640 1 -- start start 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 0x7f9b5c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0d04a0 0x7f9b5c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b5530 con 0x7f9b5c0d04a0 2024-09-21T07:23:07.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b53b0 con 0x7f9b5c074430 2024-09-21T07:23:07.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b62400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b56b0 con 0x7f9b5c0b3260 2024-09-21T07:23:07.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa84005030 con 0x7faa940ccd30 2024-09-21T07:23:07.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b5b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b5b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54530/0 (socket says 172.21.15.64:54530) 2024-09-21T07:23:07.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b5b400640 1 -- 172.21.15.64:0/137115616 learned_addr learned my addr 172.21.15.64:0/137115616 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 0x7f9b5c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7faa90c00640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 0x7faa74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3f80ca550 0x7fa3f80b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8168820 con 0x7fa3f80ca550 2024-09-21T07:23:07.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81686a0 con 0x7fa3f815e2f0 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f81689a0 con 0x7fa3f80ccdd0 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 -- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 msgr2=0x7f9b5c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 -- 172.21.15.64:0/137115616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0d04a0 msgr2=0x7f9b5c0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0d04a0 0x7f9b5c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 -- 172.21.15.64:0/137115616 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c0cb000 con 0x7f9b5c0b3260 2024-09-21T07:23:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa84094960 con 0x7faa940ccd30 2024-09-21T07:23:07.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f6000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b5b400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:07.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f6000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f814dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37654/0 (socket says 172.21.15.64:37654) 2024-09-21T07:23:07.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f6000640 1 -- 172.21.15.64:0/2647262899 learned_addr learned my addr 172.21.15.64:0/2647262899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7fa3f7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54548/0 (socket says 172.21.15.64:54548) 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7faa98e00640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 0x7faa74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f6a00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3f80ca550 0x7fa3f80b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 -- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 msgr2=0x7fa3f814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f814dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 -- 172.21.15.64:0/2647262899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3f80ca550 msgr2=0x7fa3f80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3f80ca550 0x7fa3f80b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 -- 172.21.15.64:0/2647262899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f80b58e0 con 0x7fa3f815e2f0 2024-09-21T07:23:07.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.697+0000 7f9b52a00640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 0x7f9b5c14f910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c071820 tx=0x7f9b4400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7400640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c700 tx=0x7fa3f000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7faa98e00640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 0x7faa74075710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0b3000 tx=0x7faa8c01f590 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0003b80 con 0x7fa3f815e2f0 2024-09-21T07:23:07.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400ca80 con 0x7f9b5c0b3260 2024-09-21T07:23:07.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f814e200 con 0x7fa3f815e2f0 2024-09-21T07:23:07.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f814e710 con 0x7fa3f815e2f0 2024-09-21T07:23:07.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b4400cd10 con 0x7f9b5c0b3260 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44010690 con 0x7f9b5c0b3260 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faa94158dc0 con 0x7faa940ccd30 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f0003d20 con 0x7fa3f815e2f0 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f80b5b60 con 0x7fa3f815e2f0 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0003b80 con 0x7fa3f815e2f0 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5c0cb2e0 con 0x7f9b5c0b3260 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5c0b2800 con 0x7f9b5c0b3260 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fdb3cc00640 1 -- 172.21.15.64:0/403308192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb3806f3a0 msgr2=0x7fdb3815b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7fdb3cc00640 1 --2- 172.21.15.64:0/403308192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb3806f3a0 0x7fdb3815b340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb38070ce0 tx=0x7fdb2801c660 comp rx=0 tx=0).stop 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 -- 172.21.15.64:0/403308192 shutdown_connections 2024-09-21T07:23:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 --2- 172.21.15.64:0/403308192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb3806f3a0 0x7fdb3815b340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 --2- 172.21.15.64:0/403308192 >> v2:172.21.15.64:3300/0 conn(0x7fdb380cba90 0x7fdb3806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 -- 172.21.15.64:0/403308192 >> 172.21.15.64:0/403308192 conn(0x7fdb380b1c60 msgr2=0x7fdb380b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 -- 172.21.15.64:0/403308192 shutdown_connections 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.701+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b5c0b2340 con 0x7f9b5c0b3260 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9b44010830 con 0x7f9b5c0b3260 2024-09-21T07:23:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fdb3cc00640 1 -- 172.21.15.64:0/403308192 wait complete. 2024-09-21T07:23:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7f9b53e00640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 0x7f9b38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9b44094e60 con 0x7f9b5c0b3260 2024-09-21T07:23:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.705+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa3f00050d0 con 0x7fa3f815e2f0 2024-09-21T07:23:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f9b5b400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 0x7f9b38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fdb3cc00640 1 Processor -- start 2024-09-21T07:23:07.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fdb3cc00640 1 -- start start 2024-09-21T07:23:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fa3eea00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 0x7fa3d8075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa3f0094990 con 0x7fa3f815e2f0 2024-09-21T07:23:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa3f80caea0 con 0x7fa3f815e2f0 2024-09-21T07:23:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fa3f6a00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 0x7fa3d8075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f9b5b400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 0x7f9b38075710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c01d580 tx=0x7f9b4c01b520 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fdb3cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3806f3a0 0x7fdb38146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fdb3cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fdb3cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 0x7fdb380c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 -- 172.21.15.64:0/2711297767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0eb010 msgr2=0x7f14dc0eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 --2- 172.21.15.64:0/2711297767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0eb010 0x7f14dc0eb420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14dc053b10 tx=0x7f14d001c670 comp rx=0 tx=0).stop 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 -- 172.21.15.64:0/2711297767 shutdown_connections 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 --2- 172.21.15.64:0/2711297767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc053e20 0x7f14dc054230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 --2- 172.21.15.64:0/2711297767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0eb010 0x7f14dc0eb420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7f14e8800640 1 -- 172.21.15.64:0/2711297767 >> 172.21.15.64:0/2711297767 conn(0x7f14dc00e400 msgr2=0x7f14dc00e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.709+0000 7fa3f6a00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 0x7fa3d8075910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80058d0 tx=0x7fa3e8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54552/0 (socket says 172.21.15.64:54552) 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2fe00640 1 -- 172.21.15.64:0/3397382936 learned_addr learned my addr 172.21.15.64:0/3397382936 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb3cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb380cac60 con 0x7fdb3815b880 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb3cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381520e0 con 0x7fdb380cba90 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb3cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdb380cade0 con 0x7fdb3806f3a0 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 0x7fdb380c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37400640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3806f3a0 0x7fdb38146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9b5c0b2340 con 0x7f9b5c0b3260 2024-09-21T07:23:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 -- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3806f3a0 msgr2=0x7fdb38146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3806f3a0 0x7fdb38146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 -- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 msgr2=0x7fdb38152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb380b4870 con 0x7fdb3815b880 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2fe00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb37e00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 0x7fdb380c96b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c730 tx=0x7fdb3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7f14e8800640 1 -- 172.21.15.64:0/2711297767 shutdown_connections 2024-09-21T07:23:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30003b80 con 0x7fdb3815b880 2024-09-21T07:23:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb30003d40 con 0x7fdb3815b880 2024-09-21T07:23:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30005330 con 0x7fdb3815b880 2024-09-21T07:23:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.713+0000 7f14e8800640 1 -- 172.21.15.64:0/2711297767 wait complete. 2024-09-21T07:23:07.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.717+0000 7fdb3cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb380c8bd0 con 0x7fdb3815b880 2024-09-21T07:23:07.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.717+0000 7fdb3cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb380c9190 con 0x7fdb3815b880 2024-09-21T07:23:07.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.717+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb380c89f0 con 0x7fdb3815b880 2024-09-21T07:23:07.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.721+0000 7f14e8800640 1 Processor -- start 2024-09-21T07:23:07.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.721+0000 7f14e8800640 1 -- start start 2024-09-21T07:23:07.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14dc053e20 0x7f14dc0e1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.721+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb300054d0 con 0x7fdb3815b880 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7fdb2f400640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 0x7fdb140757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdb30093d00 con 0x7fdb3815b880 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0582d0 0x7f14dc03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc058860 con 0x7f14dc053e20 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0586e0 con 0x7f14dc0582d0 2024-09-21T07:23:07.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc0f49b0 con 0x7f14dc0eb010 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7fdb37400640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 0x7fdb140757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37680/0 (socket says 172.21.15.64:37680) 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 -- 172.21.15.64:0/2769176907 learned_addr learned my addr 172.21.15.64:0/2769176907 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e5400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0582d0 0x7f14dc03af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 -- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0582d0 msgr2=0x7f14dc03af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0582d0 0x7f14dc03af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 -- 172.21.15.64:0/2769176907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14dc053e20 msgr2=0x7f14dc0e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14dc053e20 0x7f14dc0e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 -- 172.21.15.64:0/2769176907 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc03b440 con 0x7f14dc0eb010 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e6800640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e0076730 tx=0x7f14e00009a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7fdb37400640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 0x7fdb140757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb200096c0 tx=0x7fdb20009260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0098070 con 0x7f14dc0eb010 2024-09-21T07:23:07.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14e006af20 con 0x7f14dc0eb010 2024-09-21T07:23:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0098070 con 0x7f14dc0eb010 2024-09-21T07:23:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 -- 172.21.15.64:0/2769176907 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc0e06c0 con 0x7f14dc0eb010 2024-09-21T07:23:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.725+0000 7f14e8800640 1 -- 172.21.15.64:0/2769176907 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc0e0c60 con 0x7f14dc0eb010 2024-09-21T07:23:07.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.729+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f14e009b070 con 0x7f14dc0eb010 2024-09-21T07:23:07.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.733+0000 7f14da000640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 0x7f14c4075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.733+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f14e010fd50 con 0x7f14dc0eb010 2024-09-21T07:23:07.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.733+0000 7f14e5e00640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 0x7f14c4075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.733+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc0052a0 con 0x7f14dc0eb010 2024-09-21T07:23:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.733+0000 7f14e5e00640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 0x7f14c4075940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009650 tx=0x7f14d4006bb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.737+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdb380c89f0 con 0x7fdb3815b880 2024-09-21T07:23:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.737+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f14dc03b440 con 0x7f14dc0eb010 2024-09-21T07:23:07.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.761+0000 7f98b7200640 1 -- 172.21.15.64:0/2325198107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 msgr2=0x7f989c009f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.761+0000 7f98b7200640 1 --2- 172.21.15.64:0/2325198107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f989c009f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009ec0 tx=0x7f98b001d610 comp rx=0 tx=0).stop 2024-09-21T07:23:07.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.765+0000 7f98b7200640 1 -- 172.21.15.64:0/2325198107 shutdown_connections 2024-09-21T07:23:07.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.765+0000 7f98b7200640 1 --2- 172.21.15.64:0/2325198107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f989c009f50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.765+0000 7f98b7200640 1 -- 172.21.15.64:0/2325198107 >> 172.21.15.64:0/2325198107 conn(0x7f98b80b1e70 msgr2=0x7f98b80b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.765+0000 7f98b7200640 1 -- 172.21.15.64:0/2325198107 shutdown_connections 2024-09-21T07:23:07.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.765+0000 7f98b7200640 1 -- 172.21.15.64:0/2325198107 wait complete. 2024-09-21T07:23:07.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b7200640 1 Processor -- start 2024-09-21T07:23:07.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b7200640 1 -- start start 2024-09-21T07:23:07.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f98b815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b7200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f13ed000640 1 -- 172.21.15.64:0/199475599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e80cd090 msgr2=0x7f13e80af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f13ed000640 1 --2- 172.21.15.64:0/199475599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e80cd090 0x7f13e80af610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13d000b420 tx=0x7f13d001d110 comp rx=0 tx=0).stop 2024-09-21T07:23:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f98b815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f13ed000640 1 -- 172.21.15.64:0/199475599 shutdown_connections 2024-09-21T07:23:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f13ed000640 1 --2- 172.21.15.64:0/199475599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e80cd090 0x7f13e80af610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f13ed000640 1 -- 172.21.15.64:0/199475599 >> 172.21.15.64:0/199475599 conn(0x7f13e806d450 msgr2=0x7f13e80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.777+0000 7f98b5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f98b815b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54594/0 (socket says 172.21.15.64:54594) 2024-09-21T07:23:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f13ed000640 1 -- 172.21.15.64:0/199475599 shutdown_connections 2024-09-21T07:23:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f13ed000640 1 -- 172.21.15.64:0/199475599 wait complete. 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37692/0 (socket says 172.21.15.64:37692) 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98b80c4870 0x7f98b80c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f98b80cfe50 con 0x7f98b80c4870 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5e00640 1 -- 172.21.15.64:0/1956114702 learned_addr learned my addr 172.21.15.64:0/1956114702 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98b80753e0 con 0x7f989c007a70 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f98b80cffd0 con 0x7f98b809a160 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b6800640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98b80c4870 0x7f98b80c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 -- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 msgr2=0x7f98b815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f98b815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 -- 172.21.15.64:0/1956114702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98b80c4870 msgr2=0x7f98b80c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98b80c4870 0x7f98b80c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.781+0000 7f98b5400640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b80c4e60 con 0x7f98b809a160 2024-09-21T07:23:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98b5400640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009000 tx=0x7f98b0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f13ed000640 1 Processor -- start 2024-09-21T07:23:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b00b0070 con 0x7f98b809a160 2024-09-21T07:23:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98b00b1040 con 0x7f98b809a160 2024-09-21T07:23:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0005260 con 0x7f98b809a160 2024-09-21T07:23:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b80c5770 con 0x7f98b809a160 2024-09-21T07:23:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b815be90 con 0x7f98b809a160 2024-09-21T07:23:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.785+0000 7f13ed000640 1 -- start start 2024-09-21T07:23:07.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 0x7f13e8148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 0x7f13e82013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8169360 con 0x7f13e8072e20 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13e81691e0 con 0x7f13e806ee80 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13ed000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f13e81694e0 con 0x7f13e814e1f0 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98b00c0060 con 0x7f98b809a160 2024-09-21T07:23:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b8075870 con 0x7f98b809a160 2024-09-21T07:23:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54598/0 (socket says 172.21.15.64:54598) 2024-09-21T07:23:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 -- 172.21.15.64:0/596142393 learned_addr learned my addr 172.21.15.64:0/596142393 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13dd400640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 0x7f13e8148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f98ae000640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 0x7f9898075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f98b012f1c0 con 0x7f98b809a160 2024-09-21T07:23:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e6800640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 0x7f13e82013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 -- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 msgr2=0x7f13e82013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 0x7f13e82013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 -- 172.21.15.64:0/596142393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 msgr2=0x7f13e8148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 0x7f13e8148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e5e00640 1 -- 172.21.15.64:0/596142393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e814aa70 con 0x7f13e806ee80 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13e6800640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 0x7f13e82013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.789+0000 7f13dd400640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 0x7f13e8148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f98b5e00640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 0x7f9898075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13e5e00640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c410 tx=0x7f13d80045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f98b5e00640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 0x7f9898075760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98a8003600 tx=0x7f98a8006be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8011790 con 0x7f13e806ee80 2024-09-21T07:23:07.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e814ad50 con 0x7f13e806ee80 2024-09-21T07:23:07.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e8200bf0 con 0x7f13e806ee80 2024-09-21T07:23:07.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13d8017070 con 0x7f13e806ee80 2024-09-21T07:23:07.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8011790 con 0x7f13e806ee80 2024-09-21T07:23:07.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.793+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c00052a0 con 0x7f13e806ee80 2024-09-21T07:23:07.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f13d8011aa0 con 0x7f13e806ee80 2024-09-21T07:23:07.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f13dea00640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 0x7f13c4075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:07.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f13d8011590 con 0x7f13e806ee80 2024-09-21T07:23:07.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f13dd400640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 0x7f13c4075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:07.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f98b00a7040 con 0x7f98b809a160 2024-09-21T07:23:07.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.797+0000 7f13dd400640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 0x7f13c4075b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13d00ae000 tx=0x7f13d001b950 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:07.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:07.801+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f13d805f480 con 0x7f13e806ee80 2024-09-21T07:23:08.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.073+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4fe0050990 con 0x7f4fe004edf0 2024-09-21T07:23:08.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.073+0000 7f4fdb400640 1 -- 172.21.15.64:0/3173702237 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fd405f750 con 0x7f4fe004edf0 2024-09-21T07:23:08.078 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:08.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 msgr2=0x7f4fc8075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 0x7f4fc8075760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0af000 tx=0x7f4fdc01b070 comp rx=0 tx=0).stop 2024-09-21T07:23:08.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 msgr2=0x7f4fe00e24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b3e0 tx=0x7f4fd400b8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 shutdown_connections 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fc8073250 0x7f4fc8075760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fe00511b0 0x7f4fe00e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe004edf0 0x7f4fe00e24b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 --2- 172.21.15.64:0/3173702237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fe0033bc0 0x7f4fe00df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.077+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 >> 172.21.15.64:0/3173702237 conn(0x7f4fe001d9b0 msgr2=0x7f4fe00dce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.081+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 shutdown_connections 2024-09-21T07:23:08.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.081+0000 7f4fee000640 1 -- 172.21.15.64:0/3173702237 wait complete. 2024-09-21T07:23:08.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.081+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faa940b4160 con 0x7faa940ccd30 2024-09-21T07:23:08.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.081+0000 7faa90c00640 1 -- 172.21.15.64:0/1338492686 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa8405f6b0 con 0x7faa940ccd30 2024-09-21T07:23:08.089 INFO:teuthology.orchestra.run.smithi064.stdout:60129542154 2024-09-21T07:23:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 msgr2=0x7faa74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 0x7faa74075710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0b3000 tx=0x7faa8c01f590 comp rx=0 tx=0).stop 2024-09-21T07:23:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 msgr2=0x7faa940ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 0x7faa940ca970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e970 tx=0x7faa8400ee30 comp rx=0 tx=0).stop 2024-09-21T07:23:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 shutdown_connections 2024-09-21T07:23:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa74073200 0x7faa74075710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa940ccd30 0x7faa940ca970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa940b3d50 0x7faa940b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 --2- 172.21.15.64:0/1338492686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa94071180 0x7faa941f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 >> 172.21.15.64:0/1338492686 conn(0x7faa9406d4e0 msgr2=0x7faa940b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 shutdown_connections 2024-09-21T07:23:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.085+0000 7faa9b800640 1 -- 172.21.15.64:0/1338492686 wait complete. 2024-09-21T07:23:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa3f8070050 con 0x7fa3f815e2f0 2024-09-21T07:23:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3eea00640 1 -- 172.21.15.64:0/2647262899 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3f005f6d0 con 0x7fa3f815e2f0 2024-09-21T07:23:08.097 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9b5c073ef0 con 0x7f9b5c0b3260 2024-09-21T07:23:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7f9b53e00640 1 -- 172.21.15.64:0/137115616 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b4405fb30 con 0x7f9b5c0b3260 2024-09-21T07:23:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 msgr2=0x7fa3d8075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 0x7fa3d8075910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80058d0 tx=0x7fa3e8005860 comp rx=0 tx=0).stop 2024-09-21T07:23:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 msgr2=0x7fa3f81553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.093+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c700 tx=0x7fa3f000cbc0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.100 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 shutdown_connections 2024-09-21T07:23:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3d8073400 0x7fa3d8075910 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80058d0 tx=0x7fa3e8005860 comp rx=0 tx=0).stop 2024-09-21T07:23:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f815e2f0 0x7fa3f81553c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f80ccdd0 0x7fa3f814dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 --2- 172.21.15.64:0/2647262899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3f80ca550 0x7fa3f80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 >> 172.21.15.64:0/2647262899 conn(0x7fa3f80b1a90 msgr2=0x7fa3f80d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 shutdown_connections 2024-09-21T07:23:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7fa3f7e00640 1 -- 172.21.15.64:0/2647262899 wait complete. 2024-09-21T07:23:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 msgr2=0x7f9b38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 0x7f9b38075710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c01d580 tx=0x7f9b4c01b520 comp rx=0 tx=0).stop 2024-09-21T07:23:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 msgr2=0x7f9b5c14f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 0x7f9b5c14f910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c071820 tx=0x7f9b4400eb50 comp rx=0 tx=0).stop 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 shutdown_connections 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b38073200 0x7f9b38075710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0d04a0 0x7f9b5c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c0b3260 0x7f9b5c14f910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 --2- 172.21.15.64:0/137115616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c074430 0x7f9b5c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.097+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 >> 172.21.15.64:0/137115616 conn(0x7f9b5c0cdd20 msgr2=0x7f9b5c15d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.101+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 shutdown_connections 2024-09-21T07:23:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.101+0000 7f9b62400640 1 -- 172.21.15.64:0/137115616 wait complete. 2024-09-21T07:23:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.101+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdb3806b150 con 0x7fdb3815b880 2024-09-21T07:23:08.111 INFO:teuthology.orchestra.run.smithi064.stdout:64424509448 2024-09-21T07:23:08.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.101+0000 7fdb2f400640 1 -- 172.21.15.64:0/3397382936 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdb30067020 con 0x7fdb3815b880 2024-09-21T07:23:08.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 msgr2=0x7fdb140757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 0x7fdb140757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb200096c0 tx=0x7fdb20009260 comp rx=0 tx=0).stop 2024-09-21T07:23:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 msgr2=0x7fdb380c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 0x7fdb380c96b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c730 tx=0x7fdb3000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 shutdown_connections 2024-09-21T07:23:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb140732d0 0x7fdb140757e0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb200096c0 tx=0x7fdb20009260 comp rx=0 tx=0).stop 2024-09-21T07:23:08.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb3815b880 0x7fdb380c96b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cba90 0x7fdb38152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 --2- 172.21.15.64:0/3397382936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3806f3a0 0x7fdb38146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 >> 172.21.15.64:0/3397382936 conn(0x7fdb380b1c60 msgr2=0x7fdb380ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 shutdown_connections 2024-09-21T07:23:08.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.113+0000 7fdb2cc00640 1 -- 172.21.15.64:0/3397382936 wait complete. 2024-09-21T07:23:08.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.117+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f14bc005590 con 0x7f14dc0eb010 2024-09-21T07:23:08.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-21T07:23:08.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.117+0000 7f14da000640 1 -- 172.21.15.64:0/2769176907 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14e0090070 con 0x7f14dc0eb010 2024-09-21T07:23:08.122 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.122 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:08.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 msgr2=0x7f14c4075940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 0x7f14c4075940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009650 tx=0x7f14d4006bb0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 msgr2=0x7f14dc04fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e0076730 tx=0x7f14e00009a0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 shutdown_connections 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14c4073430 0x7f14c4075940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14dc0eb010 0x7f14dc04fbd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14dc0582d0 0x7f14dc03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 --2- 172.21.15.64:0/2769176907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14dc053e20 0x7f14dc0e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 >> 172.21.15.64:0/2769176907 conn(0x7f14dc00e400 msgr2=0x7f14dc0ea2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 shutdown_connections 2024-09-21T07:23:08.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.121+0000 7f14cf400640 1 -- 172.21.15.64:0/2769176907 wait complete. 2024-09-21T07:23:08.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-09-21T07:23:08.131 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-21T07:23:08.140 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-21T07:23:08.143 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-21T07:23:08.157 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-21T07:23:08.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.157+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f13c0005860 con 0x7f13e806ee80 2024-09-21T07:23:08.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.157+0000 7f13dea00640 1 -- 172.21.15.64:0/596142393 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13d805f480 con 0x7f13e806ee80 2024-09-21T07:23:08.163 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.163 INFO:teuthology.orchestra.run.smithi064.stdout:64424509449 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 msgr2=0x7f13c4075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 0x7f13c4075b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13d00ae000 tx=0x7f13d001b950 comp rx=0 tx=0).stop 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 msgr2=0x7f13e814a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c410 tx=0x7f13d80045c0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 shutdown_connections 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f13c4073600 0x7f13c4075b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13e814e1f0 0x7f13e82013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13e8072e20 0x7f13e8148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 --2- 172.21.15.64:0/596142393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e806ee80 0x7f13e814a190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 >> 172.21.15.64:0/596142393 conn(0x7f13e806d450 msgr2=0x7f13e80add10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 shutdown_connections 2024-09-21T07:23:08.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.161+0000 7f13ed000640 1 -- 172.21.15.64:0/596142393 wait complete. 2024-09-21T07:23:08.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.169+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f98b80afc90 con 0x7f98b809a160 2024-09-21T07:23:08.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.169+0000 7f98ae000640 1 -- 172.21.15.64:0/1956114702 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98b0017320 con 0x7f98b809a160 2024-09-21T07:23:08.174 INFO:teuthology.orchestra.run.smithi064.stdout:55834574856 2024-09-21T07:23:08.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 msgr2=0x7f9898075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 0x7f9898075760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98a8003600 tx=0x7f98a8006be0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 msgr2=0x7f98b806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009000 tx=0x7f98b0009b30 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 shutdown_connections 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9898073250 0x7f9898075760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98b80c4870 0x7f98b80c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98b809a160 0x7f98b806f350 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 --2- 172.21.15.64:0/1956114702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c007a70 0x7f98b815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 >> 172.21.15.64:0/1956114702 conn(0x7f98b80b1e70 msgr2=0x7f98b80702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 shutdown_connections 2024-09-21T07:23:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.173+0000 7f98b7200640 1 -- 172.21.15.64:0/1956114702 wait complete. 2024-09-21T07:23:08.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-09-21T07:23:08.186 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-09-21T07:23:08.196 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:08.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:23:08.197 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- 172.21.15.64:0/4237335722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d5815cbd0 msgr2=0x7f8d58070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/4237335722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d5815cbd0 0x7f8d58070310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009900 tx=0x7f8d4801c870 comp rx=0 tx=0).stop 2024-09-21T07:23:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- 172.21.15.64:0/4237335722 shutdown_connections 2024-09-21T07:23:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/4237335722 >> v2:172.21.15.90:3300/0 conn(0x7f8d580b2120 0x7f8d580cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/4237335722 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 0x7f8d580b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/4237335722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d5815cbd0 0x7f8d58070310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- 172.21.15.64:0/4237335722 >> 172.21.15.64:0/4237335722 conn(0x7f8d580ccbe0 msgr2=0x7f8d580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- 172.21.15.64:0/4237335722 shutdown_connections 2024-09-21T07:23:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- 172.21.15.64:0/4237335722 wait complete. 2024-09-21T07:23:08.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 Processor -- start 2024-09-21T07:23:08.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.393+0000 7f8d5cc00640 1 -- start start 2024-09-21T07:23:08.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 0x7f8d580ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5815cbd0 0x7f8d580b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5806fb20 con 0x7f8d580b2120 2024-09-21T07:23:08.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5806f9a0 con 0x7f8d5815cbd0 2024-09-21T07:23:08.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8d580b2fb0 con 0x7f8d58070850 2024-09-21T07:23:08.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39970/0 (socket says 172.21.15.64:39970) 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 -- 172.21.15.64:0/2146491017 learned_addr learned my addr 172.21.15.64:0/2146491017 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d56800640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5815cbd0 0x7f8d580b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d55e00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 0x7f8d580ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 -- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 msgr2=0x7f8d580ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 0x7f8d580ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 -- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5815cbd0 msgr2=0x7f8d580b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5815cbd0 0x7f8d580b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 -- 172.21.15.64:0/2146491017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d58158350 con 0x7f8d580b2120 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4fe00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000d5f0 tx=0x7f8d4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40017070 con 0x7f8d580b2120 2024-09-21T07:23:08.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d40005310 con 0x7f8d580b2120 2024-09-21T07:23:08.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400047b0 con 0x7f8d580b2120 2024-09-21T07:23:08.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d580b00c0 con 0x7f8d580b2120 2024-09-21T07:23:08.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d580b1390 con 0x7f8d580b2120 2024-09-21T07:23:08.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d580cbcd0 con 0x7f8d580b2120 2024-09-21T07:23:08.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.397+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8d40004950 con 0x7f8d580b2120 2024-09-21T07:23:08.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.401+0000 7f8d4e000640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 0x7f8d34075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.401+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8d400942f0 con 0x7f8d580b2120 2024-09-21T07:23:08.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.401+0000 7f8d55e00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 0x7f8d34075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.401+0000 7f8d55e00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 0x7f8d34075740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af000 tx=0x7f8d4801b0b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:08.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.405+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8d4005ea80 con 0x7f8d580b2120 2024-09-21T07:23:08.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.577+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d58158630 con 0x7f8d34073230 2024-09-21T07:23:08.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:23:08.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:23:08.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.585+0000 7f8d4e000640 1 -- 172.21.15.64:0/2146491017 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f8d4810d300 con 0x7f8d34073230 2024-09-21T07:23:08.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:08.594 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 msgr2=0x7f8d34075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 0x7f8d34075740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af000 tx=0x7f8d4801b0b0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 msgr2=0x7f8d580ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000d5f0 tx=0x7f8d4000dab0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 shutdown_connections 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d34073230 0x7f8d34075740 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5815cbd0 0x7f8d580b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d580b2120 0x7f8d580ae8e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 --2- 172.21.15.64:0/2146491017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d58070850 0x7f8d580ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 >> 172.21.15.64:0/2146491017 conn(0x7f8d580ccbe0 msgr2=0x7f8d580af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 shutdown_connections 2024-09-21T07:23:08.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.589+0000 7f8d5cc00640 1 -- 172.21.15.64:0/2146491017 wait complete. 2024-09-21T07:23:08.614 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-21T07:23:07.421137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2048672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003979"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027628+0000","last_change":"2024-09-21T07:22:47.742250+0000","last_active":"2024-09-21T07:22:54.027628+0000","last_peered":"2024-09-21T07:22:54.027628+0000","last_clean":"2024-09-21T07:22:54.027628+0000","last_became_active":"2024-09-21T07:22:47.741257+0000","last_became_peered":"2024-09-21T07:22:47.741257+0000","last_unstale":"2024-09-21T07:22:54.027628+0000","last_undegraded":"2024-09-21T07:22:54.027628+0000","last_fullsized":"2024-09-21T07:22:54.027628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764663+0000","last_change":"2024-09-21T07:22:48.740833+0000","last_active":"2024-09-21T07:22:53.764663+0000","last_peered":"2024-09-21T07:22:53.764663+0000","last_clean":"2024-09-21T07:22:53.764663+0000","last_became_active":"2024-09-21T07:22:48.740377+0000","last_became_peered":"2024-09-21T07:22:48.740377+0000","last_unstale":"2024-09-21T07:22:53.764663+0000","last_undegraded":"2024-09-21T07:22:53.764663+0000","last_fullsized":"2024-09-21T07:22:53.764663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:17.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764017+0000","last_change":"2024-09-21T07:22:53.073187+0000","last_active":"2024-09-21T07:22:53.764017+0000","last_peered":"2024-09-21T07:22:53.764017+0000","last_clean":"2024-09-21T07:22:53.764017+0000","last_became_active":"2024-09-21T07:22:53.072636+0000","last_became_peered":"2024-09-21T07:22:53.072636+0000","last_unstale":"2024-09-21T07:22:53.764017+0000","last_undegraded":"2024-09-21T07:22:53.764017+0000","last_fullsized":"2024-09-21T07:22:53.764017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:13.190959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764937+0000","last_change":"2024-09-21T07:22:47.736091+0000","last_active":"2024-09-21T07:22:53.764937+0000","last_peered":"2024-09-21T07:22:53.764937+0000","last_clean":"2024-09-21T07:22:53.764937+0000","last_became_active":"2024-09-21T07:22:47.735733+0000","last_became_peered":"2024-09-21T07:22:47.735733+0000","last_unstale":"2024-09-21T07:22:53.764937+0000","last_undegraded":"2024-09-21T07:22:53.764937+0000","last_fullsized":"2024-09-21T07:22:53.764937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:08.564048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027377+0000","last_change":"2024-09-21T07:22:48.751664+0000","last_active":"2024-09-21T07:22:54.027377+0000","last_peered":"2024-09-21T07:22:54.027377+0000","last_clean":"2024-09-21T07:22:54.027377+0000","last_became_active":"2024-09-21T07:22:48.751327+0000","last_became_peered":"2024-09-21T07:22:48.751327+0000","last_unstale":"2024-09-21T07:22:54.027377+0000","last_undegraded":"2024-09-21T07:22:54.027377+0000","last_fullsized":"2024-09-21T07:22:54.027377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024710+0000","last_change":"2024-09-21T07:22:52.783270+0000","last_active":"2024-09-21T07:22:54.024710+0000","last_peered":"2024-09-21T07:22:54.024710+0000","last_clean":"2024-09-21T07:22:54.024710+0000","last_became_active":"2024-09-21T07:22:52.782796+0000","last_became_peered":"2024-09-21T07:22:52.782796+0000","last_unstale":"2024-09-21T07:22:54.024710+0000","last_undegraded":"2024-09-21T07:22:54.024710+0000","last_fullsized":"2024-09-21T07:22:54.024710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:50:20.520920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893408+0000","last_change":"2024-09-21T07:22:47.744126+0000","last_active":"2024-09-21T07:22:53.893408+0000","last_peered":"2024-09-21T07:22:53.893408+0000","last_clean":"2024-09-21T07:22:53.893408+0000","last_became_active":"2024-09-21T07:22:47.743644+0000","last_became_peered":"2024-09-21T07:22:47.743644+0000","last_unstale":"2024-09-21T07:22:53.893408+0000","last_undegraded":"2024-09-21T07:22:53.893408+0000","last_fullsized":"2024-09-21T07:22:53.893408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:29.063190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766496+0000","last_change":"2024-09-21T07:22:48.734135+0000","last_active":"2024-09-21T07:22:53.766496+0000","last_peered":"2024-09-21T07:22:53.766496+0000","last_clean":"2024-09-21T07:22:53.766496+0000","last_became_active":"2024-09-21T07:22:48.733798+0000","last_became_peered":"2024-09-21T07:22:48.733798+0000","last_unstale":"2024-09-21T07:22:53.766496+0000","last_undegraded":"2024-09-21T07:22:53.766496+0000","last_fullsized":"2024-09-21T07:22:53.766496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:34.239566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025181+0000","last_change":"2024-09-21T07:22:52.783122+0000","last_active":"2024-09-21T07:22:54.025181+0000","last_peered":"2024-09-21T07:22:54.025181+0000","last_clean":"2024-09-21T07:22:54.025181+0000","last_became_active":"2024-09-21T07:22:52.782549+0000","last_became_peered":"2024-09-21T07:22:52.782549+0000","last_unstale":"2024-09-21T07:22:54.025181+0000","last_undegraded":"2024-09-21T07:22:54.025181+0000","last_fullsized":"2024-09-21T07:22:54.025181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:34.419031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893397+0000","last_change":"2024-09-21T07:22:47.742860+0000","last_active":"2024-09-21T07:22:53.893397+0000","last_peered":"2024-09-21T07:22:53.893397+0000","last_clean":"2024-09-21T07:22:53.893397+0000","last_became_active":"2024-09-21T07:22:47.742543+0000","last_became_peered":"2024-09-21T07:22:47.742543+0000","last_unstale":"2024-09-21T07:22:53.893397+0000","last_undegraded":"2024-09-21T07:22:53.893397+0000","last_fullsized":"2024-09-21T07:22:53.893397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:11.203283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767084+0000","last_change":"2024-09-21T07:22:48.731433+0000","last_active":"2024-09-21T07:22:53.767084+0000","last_peered":"2024-09-21T07:22:53.767084+0000","last_clean":"2024-09-21T07:22:53.767084+0000","last_became_active":"2024-09-21T07:22:48.730230+0000","last_became_peered":"2024-09-21T07:22:48.730230+0000","last_unstale":"2024-09-21T07:22:53.767084+0000","last_undegraded":"2024-09-21T07:22:53.767084+0000","last_fullsized":"2024-09-21T07:22:53.767084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:35.738074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024779+0000","last_change":"2024-09-21T07:22:52.785170+0000","last_active":"2024-09-21T07:22:54.024779+0000","last_peered":"2024-09-21T07:22:54.024779+0000","last_clean":"2024-09-21T07:22:54.024779+0000","last_became_active":"2024-09-21T07:22:52.784767+0000","last_became_peered":"2024-09-21T07:22:52.784767+0000","last_unstale":"2024-09-21T07:22:54.024779+0000","last_undegraded":"2024-09-21T07:22:54.024779+0000","last_fullsized":"2024-09-21T07:22:54.024779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:48.957476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766904+0000","last_change":"2024-09-21T07:22:48.741283+0000","last_active":"2024-09-21T07:22:53.766904+0000","last_peered":"2024-09-21T07:22:53.766904+0000","last_clean":"2024-09-21T07:22:53.766904+0000","last_became_active":"2024-09-21T07:22:48.740907+0000","last_became_peered":"2024-09-21T07:22:48.740907+0000","last_unstale":"2024-09-21T07:22:53.766904+0000","last_undegraded":"2024-09-21T07:22:53.766904+0000","last_fullsized":"2024-09-21T07:22:53.766904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893462+0000","last_change":"2024-09-21T07:22:47.744642+0000","last_active":"2024-09-21T07:22:53.893462+0000","last_peered":"2024-09-21T07:22:53.893462+0000","last_clean":"2024-09-21T07:22:53.893462+0000","last_became_active":"2024-09-21T07:22:47.744170+0000","last_became_peered":"2024-09-21T07:22:47.744170+0000","last_unstale":"2024-09-21T07:22:53.893462+0000","last_undegraded":"2024-09-21T07:22:53.893462+0000","last_fullsized":"2024-09-21T07:22:53.893462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:22.987361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025596+0000","last_change":"2024-09-21T07:22:52.790836+0000","last_active":"2024-09-21T07:22:54.025596+0000","last_peered":"2024-09-21T07:22:54.025596+0000","last_clean":"2024-09-21T07:22:54.025596+0000","last_became_active":"2024-09-21T07:22:52.790363+0000","last_became_peered":"2024-09-21T07:22:52.790363+0000","last_unstale":"2024-09-21T07:22:54.025596+0000","last_undegraded":"2024-09-21T07:22:54.025596+0000","last_fullsized":"2024-09-21T07:22:54.025596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:37.910110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764396+0000","last_change":"2024-09-21T07:22:48.745313+0000","last_active":"2024-09-21T07:22:53.764396+0000","last_peered":"2024-09-21T07:22:53.764396+0000","last_clean":"2024-09-21T07:22:53.764396+0000","last_became_active":"2024-09-21T07:22:48.744930+0000","last_became_peered":"2024-09-21T07:22:48.744930+0000","last_unstale":"2024-09-21T07:22:53.764396+0000","last_undegraded":"2024-09-21T07:22:53.764396+0000","last_fullsized":"2024-09-21T07:22:53.764396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:10.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025330+0000","last_change":"2024-09-21T07:22:47.734173+0000","last_active":"2024-09-21T07:22:54.025330+0000","last_peered":"2024-09-21T07:22:54.025330+0000","last_clean":"2024-09-21T07:22:54.025330+0000","last_became_active":"2024-09-21T07:22:47.733708+0000","last_became_peered":"2024-09-21T07:22:47.733708+0000","last_unstale":"2024-09-21T07:22:54.025330+0000","last_undegraded":"2024-09-21T07:22:54.025330+0000","last_fullsized":"2024-09-21T07:22:54.025330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:30.464654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025043+0000","last_change":"2024-09-21T07:22:52.783224+0000","last_active":"2024-09-21T07:22:54.025043+0000","last_peered":"2024-09-21T07:22:54.025043+0000","last_clean":"2024-09-21T07:22:54.025043+0000","last_became_active":"2024-09-21T07:22:52.782848+0000","last_became_peered":"2024-09-21T07:22:52.782848+0000","last_unstale":"2024-09-21T07:22:54.025043+0000","last_undegraded":"2024-09-21T07:22:54.025043+0000","last_fullsized":"2024-09-21T07:22:54.025043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:05.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764138+0000","last_change":"2024-09-21T07:22:48.732990+0000","last_active":"2024-09-21T07:22:53.764138+0000","last_peered":"2024-09-21T07:22:53.764138+0000","last_clean":"2024-09-21T07:22:53.764138+0000","last_became_active":"2024-09-21T07:22:48.721772+0000","last_became_peered":"2024-09-21T07:22:48.721772+0000","last_unstale":"2024-09-21T07:22:53.764138+0000","last_undegraded":"2024-09-21T07:22:53.764138+0000","last_fullsized":"2024-09-21T07:22:53.764138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:12.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:47.735072+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:47.734618+0000","last_became_peered":"2024-09-21T07:22:47.734618+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:28.092443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025531+0000","last_change":"2024-09-21T07:22:53.066457+0000","last_active":"2024-09-21T07:22:54.025531+0000","last_peered":"2024-09-21T07:22:54.025531+0000","last_clean":"2024-09-21T07:22:54.025531+0000","last_became_active":"2024-09-21T07:22:53.065989+0000","last_became_peered":"2024-09-21T07:22:53.065989+0000","last_unstale":"2024-09-21T07:22:54.025531+0000","last_undegraded":"2024-09-21T07:22:54.025531+0000","last_fullsized":"2024-09-21T07:22:54.025531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:44.966857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025245+0000","last_change":"2024-09-21T07:22:48.737581+0000","last_active":"2024-09-21T07:22:54.025245+0000","last_peered":"2024-09-21T07:22:54.025245+0000","last_clean":"2024-09-21T07:22:54.025245+0000","last_became_active":"2024-09-21T07:22:48.737143+0000","last_became_peered":"2024-09-21T07:22:48.737143+0000","last_unstale":"2024-09-21T07:22:54.025245+0000","last_undegraded":"2024-09-21T07:22:54.025245+0000","last_fullsized":"2024-09-21T07:22:54.025245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:45.110572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892658+0000","last_change":"2024-09-21T07:22:47.748620+0000","last_active":"2024-09-21T07:22:53.892658+0000","last_peered":"2024-09-21T07:22:53.892658+0000","last_clean":"2024-09-21T07:22:53.892658+0000","last_became_active":"2024-09-21T07:22:47.744065+0000","last_became_peered":"2024-09-21T07:22:47.744065+0000","last_unstale":"2024-09-21T07:22:53.892658+0000","last_undegraded":"2024-09-21T07:22:53.892658+0000","last_fullsized":"2024-09-21T07:22:53.892658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:49.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025379+0000","last_change":"2024-09-21T07:22:52.784325+0000","last_active":"2024-09-21T07:22:54.025379+0000","last_peered":"2024-09-21T07:22:54.025379+0000","last_clean":"2024-09-21T07:22:54.025379+0000","last_became_active":"2024-09-21T07:22:52.783906+0000","last_became_peered":"2024-09-21T07:22:52.783906+0000","last_unstale":"2024-09-21T07:22:54.025379+0000","last_undegraded":"2024-09-21T07:22:54.025379+0000","last_fullsized":"2024-09-21T07:22:54.025379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:39.780829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027640+0000","last_change":"2024-09-21T07:22:48.740991+0000","last_active":"2024-09-21T07:22:54.027640+0000","last_peered":"2024-09-21T07:22:54.027640+0000","last_clean":"2024-09-21T07:22:54.027640+0000","last_became_active":"2024-09-21T07:22:48.738376+0000","last_became_peered":"2024-09-21T07:22:48.738376+0000","last_unstale":"2024-09-21T07:22:54.027640+0000","last_undegraded":"2024-09-21T07:22:54.027640+0000","last_fullsized":"2024-09-21T07:22:54.027640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.768082+0000","last_change":"2024-09-21T07:22:47.733080+0000","last_active":"2024-09-21T07:22:53.768082+0000","last_peered":"2024-09-21T07:22:53.768082+0000","last_clean":"2024-09-21T07:22:53.768082+0000","last_became_active":"2024-09-21T07:22:47.731545+0000","last_became_peered":"2024-09-21T07:22:47.731545+0000","last_unstale":"2024-09-21T07:22:53.768082+0000","last_undegraded":"2024-09-21T07:22:53.768082+0000","last_fullsized":"2024-09-21T07:22:53.768082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:55.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:53.070212+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:53.069615+0000","last_became_peered":"2024-09-21T07:22:53.069615+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:37.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765003+0000","last_change":"2024-09-21T07:22:48.733662+0000","last_active":"2024-09-21T07:22:53.765003+0000","last_peered":"2024-09-21T07:22:53.765003+0000","last_clean":"2024-09-21T07:22:53.765003+0000","last_became_active":"2024-09-21T07:22:48.733358+0000","last_became_peered":"2024-09-21T07:22:48.733358+0000","last_unstale":"2024-09-21T07:22:53.765003+0000","last_undegraded":"2024-09-21T07:22:53.765003+0000","last_fullsized":"2024-09-21T07:22:53.765003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025409+0000","last_change":"2024-09-21T07:22:47.737459+0000","last_active":"2024-09-21T07:22:54.025409+0000","last_peered":"2024-09-21T07:22:54.025409+0000","last_clean":"2024-09-21T07:22:54.025409+0000","last_became_active":"2024-09-21T07:22:47.737043+0000","last_became_peered":"2024-09-21T07:22:47.737043+0000","last_unstale":"2024-09-21T07:22:54.025409+0000","last_undegraded":"2024-09-21T07:22:54.025409+0000","last_fullsized":"2024-09-21T07:22:54.025409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:49.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763838+0000","last_change":"2024-09-21T07:22:53.070153+0000","last_active":"2024-09-21T07:22:53.763838+0000","last_peered":"2024-09-21T07:22:53.763838+0000","last_clean":"2024-09-21T07:22:53.763838+0000","last_became_active":"2024-09-21T07:22:53.066002+0000","last_became_peered":"2024-09-21T07:22:53.066002+0000","last_unstale":"2024-09-21T07:22:53.763838+0000","last_undegraded":"2024-09-21T07:22:53.763838+0000","last_fullsized":"2024-09-21T07:22:53.763838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:49.615596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024993+0000","last_change":"2024-09-21T07:22:48.730184+0000","last_active":"2024-09-21T07:22:54.024993+0000","last_peered":"2024-09-21T07:22:54.024993+0000","last_clean":"2024-09-21T07:22:54.024993+0000","last_became_active":"2024-09-21T07:22:48.729821+0000","last_became_peered":"2024-09-21T07:22:48.729821+0000","last_unstale":"2024-09-21T07:22:54.024993+0000","last_undegraded":"2024-09-21T07:22:54.024993+0000","last_fullsized":"2024-09-21T07:22:54.024993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:54.261987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893561+0000","last_change":"2024-09-21T07:22:47.745201+0000","last_active":"2024-09-21T07:22:53.893561+0000","last_peered":"2024-09-21T07:22:53.893561+0000","last_clean":"2024-09-21T07:22:53.893561+0000","last_became_active":"2024-09-21T07:22:47.744914+0000","last_became_peered":"2024-09-21T07:22:47.744914+0000","last_unstale":"2024-09-21T07:22:53.893561+0000","last_undegraded":"2024-09-21T07:22:53.893561+0000","last_fullsized":"2024-09-21T07:22:53.893561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.942934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026739+0000","last_change":"2024-09-21T07:22:53.063753+0000","last_active":"2024-09-21T07:22:54.026739+0000","last_peered":"2024-09-21T07:22:54.026739+0000","last_clean":"2024-09-21T07:22:54.026739+0000","last_became_active":"2024-09-21T07:22:53.063293+0000","last_became_peered":"2024-09-21T07:22:53.063293+0000","last_unstale":"2024-09-21T07:22:54.026739+0000","last_undegraded":"2024-09-21T07:22:54.026739+0000","last_fullsized":"2024-09-21T07:22:54.026739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767116+0000","last_change":"2024-09-21T07:22:48.753861+0000","last_active":"2024-09-21T07:22:53.767116+0000","last_peered":"2024-09-21T07:22:53.767116+0000","last_clean":"2024-09-21T07:22:53.767116+0000","last_became_active":"2024-09-21T07:22:48.753511+0000","last_became_peered":"2024-09-21T07:22:48.753511+0000","last_unstale":"2024-09-21T07:22:53.767116+0000","last_undegraded":"2024-09-21T07:22:53.767116+0000","last_fullsized":"2024-09-21T07:22:53.767116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:01.976003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025525+0000","last_change":"2024-09-21T07:22:47.737833+0000","last_active":"2024-09-21T07:22:54.025525+0000","last_peered":"2024-09-21T07:22:54.025525+0000","last_clean":"2024-09-21T07:22:54.025525+0000","last_became_active":"2024-09-21T07:22:47.736895+0000","last_became_peered":"2024-09-21T07:22:47.736895+0000","last_unstale":"2024-09-21T07:22:54.025525+0000","last_undegraded":"2024-09-21T07:22:54.025525+0000","last_fullsized":"2024-09-21T07:22:54.025525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:17.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024946+0000","last_change":"2024-09-21T07:22:52.781483+0000","last_active":"2024-09-21T07:22:54.024946+0000","last_peered":"2024-09-21T07:22:54.024946+0000","last_clean":"2024-09-21T07:22:54.024946+0000","last_became_active":"2024-09-21T07:22:52.778544+0000","last_became_peered":"2024-09-21T07:22:52.778544+0000","last_unstale":"2024-09-21T07:22:54.024946+0000","last_undegraded":"2024-09-21T07:22:54.024946+0000","last_fullsized":"2024-09-21T07:22:54.024946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:58.932426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025560+0000","last_change":"2024-09-21T07:22:48.751678+0000","last_active":"2024-09-21T07:22:54.025560+0000","last_peered":"2024-09-21T07:22:54.025560+0000","last_clean":"2024-09-21T07:22:54.025560+0000","last_became_active":"2024-09-21T07:22:48.744782+0000","last_became_peered":"2024-09-21T07:22:48.744782+0000","last_unstale":"2024-09-21T07:22:54.025560+0000","last_undegraded":"2024-09-21T07:22:54.025560+0000","last_fullsized":"2024-09-21T07:22:54.025560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:56.871086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766106+0000","last_change":"2024-09-21T07:22:47.727167+0000","last_active":"2024-09-21T07:22:53.766106+0000","last_peered":"2024-09-21T07:22:53.766106+0000","last_clean":"2024-09-21T07:22:53.766106+0000","last_became_active":"2024-09-21T07:22:47.726894+0000","last_became_peered":"2024-09-21T07:22:47.726894+0000","last_unstale":"2024-09-21T07:22:53.766106+0000","last_undegraded":"2024-09-21T07:22:53.766106+0000","last_fullsized":"2024-09-21T07:22:53.766106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:31.716302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024795+0000","last_change":"2024-09-21T07:22:52.783725+0000","last_active":"2024-09-21T07:22:54.024795+0000","last_peered":"2024-09-21T07:22:54.024795+0000","last_clean":"2024-09-21T07:22:54.024795+0000","last_became_active":"2024-09-21T07:22:52.778895+0000","last_became_peered":"2024-09-21T07:22:52.778895+0000","last_unstale":"2024-09-21T07:22:54.024795+0000","last_undegraded":"2024-09-21T07:22:54.024795+0000","last_fullsized":"2024-09-21T07:22:54.024795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:19.056150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024676+0000","last_change":"2024-09-21T07:22:48.737222+0000","last_active":"2024-09-21T07:22:54.024676+0000","last_peered":"2024-09-21T07:22:54.024676+0000","last_clean":"2024-09-21T07:22:54.024676+0000","last_became_active":"2024-09-21T07:22:48.736340+0000","last_became_peered":"2024-09-21T07:22:48.736340+0000","last_unstale":"2024-09-21T07:22:54.024676+0000","last_undegraded":"2024-09-21T07:22:54.024676+0000","last_fullsized":"2024-09-21T07:22:54.024676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:37.469062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024338+0000","last_change":"2024-09-21T07:22:47.713035+0000","last_active":"2024-09-21T07:22:54.024338+0000","last_peered":"2024-09-21T07:22:54.024338+0000","last_clean":"2024-09-21T07:22:54.024338+0000","last_became_active":"2024-09-21T07:22:47.711447+0000","last_became_peered":"2024-09-21T07:22:47.711447+0000","last_unstale":"2024-09-21T07:22:54.024338+0000","last_undegraded":"2024-09-21T07:22:54.024338+0000","last_fullsized":"2024-09-21T07:22:54.024338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:21.821706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025552+0000","last_change":"2024-09-21T07:22:52.783218+0000","last_active":"2024-09-21T07:22:54.025552+0000","last_peered":"2024-09-21T07:22:54.025552+0000","last_clean":"2024-09-21T07:22:54.025552+0000","last_became_active":"2024-09-21T07:22:52.778288+0000","last_became_peered":"2024-09-21T07:22:52.778288+0000","last_unstale":"2024-09-21T07:22:54.025552+0000","last_undegraded":"2024-09-21T07:22:54.025552+0000","last_fullsized":"2024-09-21T07:22:54.025552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:50.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026221+0000","last_change":"2024-09-21T07:22:48.748027+0000","last_active":"2024-09-21T07:22:54.026221+0000","last_peered":"2024-09-21T07:22:54.026221+0000","last_clean":"2024-09-21T07:22:54.026221+0000","last_became_active":"2024-09-21T07:22:48.747687+0000","last_became_peered":"2024-09-21T07:22:48.747687+0000","last_unstale":"2024-09-21T07:22:54.026221+0000","last_undegraded":"2024-09-21T07:22:54.026221+0000","last_fullsized":"2024-09-21T07:22:54.026221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:55.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893031+0000","last_change":"2024-09-21T07:22:47.744531+0000","last_active":"2024-09-21T07:22:53.893031+0000","last_peered":"2024-09-21T07:22:53.893031+0000","last_clean":"2024-09-21T07:22:53.893031+0000","last_became_active":"2024-09-21T07:22:47.744113+0000","last_became_peered":"2024-09-21T07:22:47.744113+0000","last_unstale":"2024-09-21T07:22:53.893031+0000","last_undegraded":"2024-09-21T07:22:53.893031+0000","last_fullsized":"2024-09-21T07:22:53.893031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:16.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027637+0000","last_change":"2024-09-21T07:22:53.068210+0000","last_active":"2024-09-21T07:22:54.027637+0000","last_peered":"2024-09-21T07:22:54.027637+0000","last_clean":"2024-09-21T07:22:54.027637+0000","last_became_active":"2024-09-21T07:22:53.067263+0000","last_became_peered":"2024-09-21T07:22:53.067263+0000","last_unstale":"2024-09-21T07:22:54.027637+0000","last_undegraded":"2024-09-21T07:22:54.027637+0000","last_fullsized":"2024-09-21T07:22:54.027637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:27.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764606+0000","last_change":"2024-09-21T07:22:48.738259+0000","last_active":"2024-09-21T07:22:53.764606+0000","last_peered":"2024-09-21T07:22:53.764606+0000","last_clean":"2024-09-21T07:22:53.764606+0000","last_became_active":"2024-09-21T07:22:48.737926+0000","last_became_peered":"2024-09-21T07:22:48.737926+0000","last_unstale":"2024-09-21T07:22:53.764606+0000","last_undegraded":"2024-09-21T07:22:53.764606+0000","last_fullsized":"2024-09-21T07:22:53.764606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:55.324437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766223+0000","last_change":"2024-09-21T07:22:47.719687+0000","last_active":"2024-09-21T07:22:53.766223+0000","last_peered":"2024-09-21T07:22:53.766223+0000","last_clean":"2024-09-21T07:22:53.766223+0000","last_became_active":"2024-09-21T07:22:47.719298+0000","last_became_peered":"2024-09-21T07:22:47.719298+0000","last_unstale":"2024-09-21T07:22:53.766223+0000","last_undegraded":"2024-09-21T07:22:53.766223+0000","last_fullsized":"2024-09-21T07:22:53.766223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:44.103579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892817+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:22:53.892817+0000","last_peered":"2024-09-21T07:22:53.892817+0000","last_clean":"2024-09-21T07:22:53.892817+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:22:53.892817+0000","last_undegraded":"2024-09-21T07:22:53.892817+0000","last_fullsized":"2024-09-21T07:22:53.892817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767042+0000","last_change":"2024-09-21T07:22:53.066672+0000","last_active":"2024-09-21T07:22:53.767042+0000","last_peered":"2024-09-21T07:22:53.767042+0000","last_clean":"2024-09-21T07:22:53.767042+0000","last_became_active":"2024-09-21T07:22:53.066192+0000","last_became_peered":"2024-09-21T07:22:53.066192+0000","last_unstale":"2024-09-21T07:22:53.767042+0000","last_undegraded":"2024-09-21T07:22:53.767042+0000","last_fullsized":"2024-09-21T07:22:53.767042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.796201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893182+0000","last_change":"2024-09-21T07:22:48.734582+0000","last_active":"2024-09-21T07:22:53.893182+0000","last_peered":"2024-09-21T07:22:53.893182+0000","last_clean":"2024-09-21T07:22:53.893182+0000","last_became_active":"2024-09-21T07:22:48.734240+0000","last_became_peered":"2024-09-21T07:22:48.734240+0000","last_unstale":"2024-09-21T07:22:53.893182+0000","last_undegraded":"2024-09-21T07:22:53.893182+0000","last_fullsized":"2024-09-21T07:22:53.893182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:09.879302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025524+0000","last_change":"2024-09-21T07:22:47.733880+0000","last_active":"2024-09-21T07:22:54.025524+0000","last_peered":"2024-09-21T07:22:54.025524+0000","last_clean":"2024-09-21T07:22:54.025524+0000","last_became_active":"2024-09-21T07:22:47.733393+0000","last_became_peered":"2024-09-21T07:22:47.733393+0000","last_unstale":"2024-09-21T07:22:54.025524+0000","last_undegraded":"2024-09-21T07:22:54.025524+0000","last_fullsized":"2024-09-21T07:22:54.025524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766698+0000","last_change":"2024-09-21T07:22:53.063609+0000","last_active":"2024-09-21T07:22:53.766698+0000","last_peered":"2024-09-21T07:22:53.766698+0000","last_clean":"2024-09-21T07:22:53.766698+0000","last_became_active":"2024-09-21T07:22:53.062759+0000","last_became_peered":"2024-09-21T07:22:53.062759+0000","last_unstale":"2024-09-21T07:22:53.766698+0000","last_undegraded":"2024-09-21T07:22:53.766698+0000","last_fullsized":"2024-09-21T07:22:53.766698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:30.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766569+0000","last_change":"2024-09-21T07:22:48.749460+0000","last_active":"2024-09-21T07:22:53.766569+0000","last_peered":"2024-09-21T07:22:53.766569+0000","last_clean":"2024-09-21T07:22:53.766569+0000","last_became_active":"2024-09-21T07:22:48.748693+0000","last_became_peered":"2024-09-21T07:22:48.748693+0000","last_unstale":"2024-09-21T07:22:53.766569+0000","last_undegraded":"2024-09-21T07:22:53.766569+0000","last_fullsized":"2024-09-21T07:22:53.766569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.090779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025285+0000","last_change":"2024-09-21T07:22:47.733842+0000","last_active":"2024-09-21T07:22:54.025285+0000","last_peered":"2024-09-21T07:22:54.025285+0000","last_clean":"2024-09-21T07:22:54.025285+0000","last_became_active":"2024-09-21T07:22:47.733469+0000","last_became_peered":"2024-09-21T07:22:47.733469+0000","last_unstale":"2024-09-21T07:22:54.025285+0000","last_undegraded":"2024-09-21T07:22:54.025285+0000","last_fullsized":"2024-09-21T07:22:54.025285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:51.768208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026922+0000","last_change":"2024-09-21T07:22:52.788401+0000","last_active":"2024-09-21T07:22:54.026922+0000","last_peered":"2024-09-21T07:22:54.026922+0000","last_clean":"2024-09-21T07:22:54.026922+0000","last_became_active":"2024-09-21T07:22:52.787726+0000","last_became_peered":"2024-09-21T07:22:52.787726+0000","last_unstale":"2024-09-21T07:22:54.026922+0000","last_undegraded":"2024-09-21T07:22:54.026922+0000","last_fullsized":"2024-09-21T07:22:54.026922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:50.336899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893535+0000","last_change":"2024-09-21T07:22:48.741294+0000","last_active":"2024-09-21T07:22:53.893535+0000","last_peered":"2024-09-21T07:22:53.893535+0000","last_clean":"2024-09-21T07:22:53.893535+0000","last_became_active":"2024-09-21T07:22:48.739470+0000","last_became_peered":"2024-09-21T07:22:48.739470+0000","last_unstale":"2024-09-21T07:22:53.893535+0000","last_undegraded":"2024-09-21T07:22:53.893535+0000","last_fullsized":"2024-09-21T07:22:53.893535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:45.572840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026041+0000","last_change":"2024-09-21T07:22:47.712265+0000","last_active":"2024-09-21T07:22:54.026041+0000","last_peered":"2024-09-21T07:22:54.026041+0000","last_clean":"2024-09-21T07:22:54.026041+0000","last_became_active":"2024-09-21T07:22:47.711366+0000","last_became_peered":"2024-09-21T07:22:47.711366+0000","last_unstale":"2024-09-21T07:22:54.026041+0000","last_undegraded":"2024-09-21T07:22:54.026041+0000","last_fullsized":"2024-09-21T07:22:54.026041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765294+0000","last_change":"2024-09-21T07:22:53.064301+0000","last_active":"2024-09-21T07:22:53.765294+0000","last_peered":"2024-09-21T07:22:53.765294+0000","last_clean":"2024-09-21T07:22:53.765294+0000","last_became_active":"2024-09-21T07:22:53.062833+0000","last_became_peered":"2024-09-21T07:22:53.062833+0000","last_unstale":"2024-09-21T07:22:53.765294+0000","last_undegraded":"2024-09-21T07:22:53.765294+0000","last_fullsized":"2024-09-21T07:22:53.765294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:27.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893385+0000","last_change":"2024-09-21T07:22:48.739480+0000","last_active":"2024-09-21T07:22:53.893385+0000","last_peered":"2024-09-21T07:22:53.893385+0000","last_clean":"2024-09-21T07:22:53.893385+0000","last_became_active":"2024-09-21T07:22:48.735630+0000","last_became_peered":"2024-09-21T07:22:48.735630+0000","last_unstale":"2024-09-21T07:22:53.893385+0000","last_undegraded":"2024-09-21T07:22:53.893385+0000","last_fullsized":"2024-09-21T07:22:53.893385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:46.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025673+0000","last_change":"2024-09-21T07:22:47.730814+0000","last_active":"2024-09-21T07:22:54.025673+0000","last_peered":"2024-09-21T07:22:54.025673+0000","last_clean":"2024-09-21T07:22:54.025673+0000","last_became_active":"2024-09-21T07:22:47.730342+0000","last_became_peered":"2024-09-21T07:22:47.730342+0000","last_unstale":"2024-09-21T07:22:54.025673+0000","last_undegraded":"2024-09-21T07:22:54.025673+0000","last_fullsized":"2024-09-21T07:22:54.025673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024615+0000","last_change":"2024-09-21T07:22:52.784700+0000","last_active":"2024-09-21T07:22:54.024615+0000","last_peered":"2024-09-21T07:22:54.024615+0000","last_clean":"2024-09-21T07:22:54.024615+0000","last_became_active":"2024-09-21T07:22:52.784177+0000","last_became_peered":"2024-09-21T07:22:52.784177+0000","last_unstale":"2024-09-21T07:22:54.024615+0000","last_undegraded":"2024-09-21T07:22:54.024615+0000","last_fullsized":"2024-09-21T07:22:54.024615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.035862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740423+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.739493+0000","last_became_peered":"2024-09-21T07:22:48.739493+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024092+0000","last_change":"2024-09-21T07:22:47.726109+0000","last_active":"2024-09-21T07:22:54.024092+0000","last_peered":"2024-09-21T07:22:54.024092+0000","last_clean":"2024-09-21T07:22:54.024092+0000","last_became_active":"2024-09-21T07:22:47.725696+0000","last_became_peered":"2024-09-21T07:22:47.725696+0000","last_unstale":"2024-09-21T07:22:54.024092+0000","last_undegraded":"2024-09-21T07:22:54.024092+0000","last_fullsized":"2024-09-21T07:22:54.024092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027353+0000","last_change":"2024-09-21T07:22:52.781696+0000","last_active":"2024-09-21T07:22:54.027353+0000","last_peered":"2024-09-21T07:22:54.027353+0000","last_clean":"2024-09-21T07:22:54.027353+0000","last_became_active":"2024-09-21T07:22:52.781211+0000","last_became_peered":"2024-09-21T07:22:52.781211+0000","last_unstale":"2024-09-21T07:22:54.027353+0000","last_undegraded":"2024-09-21T07:22:54.027353+0000","last_fullsized":"2024-09-21T07:22:54.027353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:51.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765137+0000","last_change":"2024-09-21T07:22:48.746169+0000","last_active":"2024-09-21T07:22:53.765137+0000","last_peered":"2024-09-21T07:22:53.765137+0000","last_clean":"2024-09-21T07:22:53.765137+0000","last_became_active":"2024-09-21T07:22:48.745804+0000","last_became_peered":"2024-09-21T07:22:48.745804+0000","last_unstale":"2024-09-21T07:22:53.765137+0000","last_undegraded":"2024-09-21T07:22:53.765137+0000","last_fullsized":"2024-09-21T07:22:53.765137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766637+0000","last_change":"2024-09-21T07:22:47.723745+0000","last_active":"2024-09-21T07:22:53.766637+0000","last_peered":"2024-09-21T07:22:53.766637+0000","last_clean":"2024-09-21T07:22:53.766637+0000","last_became_active":"2024-09-21T07:22:47.723299+0000","last_became_peered":"2024-09-21T07:22:47.723299+0000","last_unstale":"2024-09-21T07:22:53.766637+0000","last_undegraded":"2024-09-21T07:22:53.766637+0000","last_fullsized":"2024-09-21T07:22:53.766637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764852+0000","last_change":"2024-09-21T07:22:53.067494+0000","last_active":"2024-09-21T07:22:53.764852+0000","last_peered":"2024-09-21T07:22:53.764852+0000","last_clean":"2024-09-21T07:22:53.764852+0000","last_became_active":"2024-09-21T07:22:53.066168+0000","last_became_peered":"2024-09-21T07:22:53.066168+0000","last_unstale":"2024-09-21T07:22:53.764852+0000","last_undegraded":"2024-09-21T07:22:53.764852+0000","last_fullsized":"2024-09-21T07:22:53.764852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740397+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.736271+0000","last_became_peered":"2024-09-21T07:22:48.736271+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:50.369048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765981+0000","last_change":"2024-09-21T07:22:47.742213+0000","last_active":"2024-09-21T07:22:53.765981+0000","last_peered":"2024-09-21T07:22:53.765981+0000","last_clean":"2024-09-21T07:22:53.765981+0000","last_became_active":"2024-09-21T07:22:47.741132+0000","last_became_peered":"2024-09-21T07:22:47.741132+0000","last_unstale":"2024-09-21T07:22:53.765981+0000","last_undegraded":"2024-09-21T07:22:53.765981+0000","last_fullsized":"2024-09-21T07:22:53.765981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:09.749747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765129+0000","last_change":"2024-09-21T07:22:53.066418+0000","last_active":"2024-09-21T07:22:53.765129+0000","last_peered":"2024-09-21T07:22:53.765129+0000","last_clean":"2024-09-21T07:22:53.765129+0000","last_became_active":"2024-09-21T07:22:53.065948+0000","last_became_peered":"2024-09-21T07:22:53.065948+0000","last_unstale":"2024-09-21T07:22:53.765129+0000","last_undegraded":"2024-09-21T07:22:53.765129+0000","last_fullsized":"2024-09-21T07:22:53.765129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:44.474322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026570+0000","last_change":"2024-09-21T07:22:48.737346+0000","last_active":"2024-09-21T07:22:54.026570+0000","last_peered":"2024-09-21T07:22:54.026570+0000","last_clean":"2024-09-21T07:22:54.026570+0000","last_became_active":"2024-09-21T07:22:48.736875+0000","last_became_peered":"2024-09-21T07:22:48.736875+0000","last_unstale":"2024-09-21T07:22:54.026570+0000","last_undegraded":"2024-09-21T07:22:54.026570+0000","last_fullsized":"2024-09-21T07:22:54.026570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:22.528204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027111+0000","last_change":"2024-09-21T07:22:47.730642+0000","last_active":"2024-09-21T07:22:54.027111+0000","last_peered":"2024-09-21T07:22:54.027111+0000","last_clean":"2024-09-21T07:22:54.027111+0000","last_became_active":"2024-09-21T07:22:47.730256+0000","last_became_peered":"2024-09-21T07:22:47.730256+0000","last_unstale":"2024-09-21T07:22:54.027111+0000","last_undegraded":"2024-09-21T07:22:54.027111+0000","last_fullsized":"2024-09-21T07:22:54.027111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766769+0000","last_change":"2024-09-21T07:22:53.067757+0000","last_active":"2024-09-21T07:22:53.766769+0000","last_peered":"2024-09-21T07:22:53.766769+0000","last_clean":"2024-09-21T07:22:53.766769+0000","last_became_active":"2024-09-21T07:22:53.067310+0000","last_became_peered":"2024-09-21T07:22:53.067310+0000","last_unstale":"2024-09-21T07:22:53.766769+0000","last_undegraded":"2024-09-21T07:22:53.766769+0000","last_fullsized":"2024-09-21T07:22:53.766769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:51.644247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893021+0000","last_change":"2024-09-21T07:22:48.748135+0000","last_active":"2024-09-21T07:22:53.893021+0000","last_peered":"2024-09-21T07:22:53.893021+0000","last_clean":"2024-09-21T07:22:53.893021+0000","last_became_active":"2024-09-21T07:22:48.747791+0000","last_became_peered":"2024-09-21T07:22:48.747791+0000","last_unstale":"2024-09-21T07:22:53.893021+0000","last_undegraded":"2024-09-21T07:22:53.893021+0000","last_fullsized":"2024-09-21T07:22:53.893021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:50.042620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:23:00.072821+0000","last_change":"2024-09-21T07:22:47.731720+0000","last_active":"2024-09-21T07:23:00.072821+0000","last_peered":"2024-09-21T07:23:00.072821+0000","last_clean":"2024-09-21T07:23:00.072821+0000","last_became_active":"2024-09-21T07:22:47.731257+0000","last_became_peered":"2024-09-21T07:22:47.731257+0000","last_unstale":"2024-09-21T07:23:00.072821+0000","last_undegraded":"2024-09-21T07:23:00.072821+0000","last_fullsized":"2024-09-21T07:23:00.072821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025005+0000","last_change":"2024-09-21T07:22:52.777427+0000","last_active":"2024-09-21T07:22:54.025005+0000","last_peered":"2024-09-21T07:22:54.025005+0000","last_clean":"2024-09-21T07:22:54.025005+0000","last_became_active":"2024-09-21T07:22:52.776894+0000","last_became_peered":"2024-09-21T07:22:52.776894+0000","last_unstale":"2024-09-21T07:22:54.025005+0000","last_undegraded":"2024-09-21T07:22:54.025005+0000","last_fullsized":"2024-09-21T07:22:54.025005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:10.994515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025528+0000","last_change":"2024-09-21T07:22:48.751759+0000","last_active":"2024-09-21T07:22:54.025528+0000","last_peered":"2024-09-21T07:22:54.025528+0000","last_clean":"2024-09-21T07:22:54.025528+0000","last_became_active":"2024-09-21T07:22:48.751434+0000","last_became_peered":"2024-09-21T07:22:48.751434+0000","last_unstale":"2024-09-21T07:22:54.025528+0000","last_undegraded":"2024-09-21T07:22:54.025528+0000","last_fullsized":"2024-09-21T07:22:54.025528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025150+0000","last_change":"2024-09-21T07:22:47.724152+0000","last_active":"2024-09-21T07:22:54.025150+0000","last_peered":"2024-09-21T07:22:54.025150+0000","last_clean":"2024-09-21T07:22:54.025150+0000","last_became_active":"2024-09-21T07:22:47.723668+0000","last_became_peered":"2024-09-21T07:22:47.723668+0000","last_unstale":"2024-09-21T07:22:54.025150+0000","last_undegraded":"2024-09-21T07:22:54.025150+0000","last_fullsized":"2024-09-21T07:22:54.025150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:38.422165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025008+0000","last_change":"2024-09-21T07:22:52.790871+0000","last_active":"2024-09-21T07:22:54.025008+0000","last_peered":"2024-09-21T07:22:54.025008+0000","last_clean":"2024-09-21T07:22:54.025008+0000","last_became_active":"2024-09-21T07:22:52.790349+0000","last_became_peered":"2024-09-21T07:22:52.790349+0000","last_unstale":"2024-09-21T07:22:54.025008+0000","last_undegraded":"2024-09-21T07:22:54.025008+0000","last_fullsized":"2024-09-21T07:22:54.025008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:08.100330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027512+0000","last_change":"2024-09-21T07:22:48.749463+0000","last_active":"2024-09-21T07:22:54.027512+0000","last_peered":"2024-09-21T07:22:54.027512+0000","last_clean":"2024-09-21T07:22:54.027512+0000","last_became_active":"2024-09-21T07:22:48.747781+0000","last_became_peered":"2024-09-21T07:22:48.747781+0000","last_unstale":"2024-09-21T07:22:54.027512+0000","last_undegraded":"2024-09-21T07:22:54.027512+0000","last_fullsized":"2024-09-21T07:22:54.027512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767422+0000","last_change":"2024-09-21T07:22:47.737032+0000","last_active":"2024-09-21T07:22:53.767422+0000","last_peered":"2024-09-21T07:22:53.767422+0000","last_clean":"2024-09-21T07:22:53.767422+0000","last_became_active":"2024-09-21T07:22:47.736616+0000","last_became_peered":"2024-09-21T07:22:47.736616+0000","last_unstale":"2024-09-21T07:22:53.767422+0000","last_undegraded":"2024-09-21T07:22:53.767422+0000","last_fullsized":"2024-09-21T07:22:53.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:53.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764281+0000","last_change":"2024-09-21T07:22:52.774334+0000","last_active":"2024-09-21T07:22:53.764281+0000","last_peered":"2024-09-21T07:22:53.764281+0000","last_clean":"2024-09-21T07:22:53.764281+0000","last_became_active":"2024-09-21T07:22:52.773910+0000","last_became_peered":"2024-09-21T07:22:52.773910+0000","last_unstale":"2024-09-21T07:22:53.764281+0000","last_undegraded":"2024-09-21T07:22:53.764281+0000","last_fullsized":"2024-09-21T07:22:53.764281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:08.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767415+0000","last_change":"2024-09-21T07:22:48.751082+0000","last_active":"2024-09-21T07:22:53.767415+0000","last_peered":"2024-09-21T07:22:53.767415+0000","last_clean":"2024-09-21T07:22:53.767415+0000","last_became_active":"2024-09-21T07:22:48.750721+0000","last_became_peered":"2024-09-21T07:22:48.750721+0000","last_unstale":"2024-09-21T07:22:53.767415+0000","last_undegraded":"2024-09-21T07:22:53.767415+0000","last_fullsized":"2024-09-21T07:22:53.767415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:46.294144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767956+0000","last_change":"2024-09-21T07:22:47.732653+0000","last_active":"2024-09-21T07:22:53.767956+0000","last_peered":"2024-09-21T07:22:53.767956+0000","last_clean":"2024-09-21T07:22:53.767956+0000","last_became_active":"2024-09-21T07:22:47.731145+0000","last_became_peered":"2024-09-21T07:22:47.731145+0000","last_unstale":"2024-09-21T07:22:53.767956+0000","last_undegraded":"2024-09-21T07:22:53.767956+0000","last_fullsized":"2024-09-21T07:22:53.767956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764072+0000","last_change":"2024-09-21T07:22:53.068578+0000","last_active":"2024-09-21T07:22:53.764072+0000","last_peered":"2024-09-21T07:22:53.764072+0000","last_clean":"2024-09-21T07:22:53.764072+0000","last_became_active":"2024-09-21T07:22:53.068094+0000","last_became_peered":"2024-09-21T07:22:53.068094+0000","last_unstale":"2024-09-21T07:22:53.764072+0000","last_undegraded":"2024-09-21T07:22:53.764072+0000","last_fullsized":"2024-09-21T07:22:53.764072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:48.304004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027350+0000","last_change":"2024-09-21T07:22:53.067719+0000","last_active":"2024-09-21T07:22:54.027350+0000","last_peered":"2024-09-21T07:22:54.027350+0000","last_clean":"2024-09-21T07:22:54.027350+0000","last_became_active":"2024-09-21T07:22:53.066586+0000","last_became_peered":"2024-09-21T07:22:53.066586+0000","last_unstale":"2024-09-21T07:22:54.027350+0000","last_undegraded":"2024-09-21T07:22:54.027350+0000","last_fullsized":"2024-09-21T07:22:54.027350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:08.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024581+0000","last_change":"2024-09-21T07:22:48.721331+0000","last_active":"2024-09-21T07:22:54.024581+0000","last_peered":"2024-09-21T07:22:54.024581+0000","last_clean":"2024-09-21T07:22:54.024581+0000","last_became_active":"2024-09-21T07:22:48.721004+0000","last_became_peered":"2024-09-21T07:22:48.721004+0000","last_unstale":"2024-09-21T07:22:54.024581+0000","last_undegraded":"2024-09-21T07:22:54.024581+0000","last_fullsized":"2024-09-21T07:22:54.024581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765811+0000","last_change":"2024-09-21T07:22:47.725525+0000","last_active":"2024-09-21T07:22:53.765811+0000","last_peered":"2024-09-21T07:22:53.765811+0000","last_clean":"2024-09-21T07:22:53.765811+0000","last_became_active":"2024-09-21T07:22:47.724955+0000","last_became_peered":"2024-09-21T07:22:47.724955+0000","last_unstale":"2024-09-21T07:22:53.765811+0000","last_undegraded":"2024-09-21T07:22:53.765811+0000","last_fullsized":"2024-09-21T07:22:53.765811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:57.216986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767880+0000","last_change":"2024-09-21T07:22:52.775953+0000","last_active":"2024-09-21T07:22:53.767880+0000","last_peered":"2024-09-21T07:22:53.767880+0000","last_clean":"2024-09-21T07:22:53.767880+0000","last_became_active":"2024-09-21T07:22:52.775495+0000","last_became_peered":"2024-09-21T07:22:52.775495+0000","last_unstale":"2024-09-21T07:22:53.767880+0000","last_undegraded":"2024-09-21T07:22:53.767880+0000","last_fullsized":"2024-09-21T07:22:53.767880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763992+0000","last_change":"2024-09-21T07:22:48.753975+0000","last_active":"2024-09-21T07:22:53.763992+0000","last_peered":"2024-09-21T07:22:53.763992+0000","last_clean":"2024-09-21T07:22:53.763992+0000","last_became_active":"2024-09-21T07:22:48.753724+0000","last_became_peered":"2024-09-21T07:22:48.753724+0000","last_unstale":"2024-09-21T07:22:53.763992+0000","last_undegraded":"2024-09-21T07:22:53.763992+0000","last_fullsized":"2024-09-21T07:22:53.763992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:22.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764342+0000","last_change":"2024-09-21T07:22:47.730250+0000","last_active":"2024-09-21T07:22:53.764342+0000","last_peered":"2024-09-21T07:22:53.764342+0000","last_clean":"2024-09-21T07:22:53.764342+0000","last_became_active":"2024-09-21T07:22:47.729848+0000","last_became_peered":"2024-09-21T07:22:47.729848+0000","last_unstale":"2024-09-21T07:22:53.764342+0000","last_undegraded":"2024-09-21T07:22:53.764342+0000","last_fullsized":"2024-09-21T07:22:53.764342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:55.323370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767164+0000","last_change":"2024-09-21T07:22:47.725746+0000","last_active":"2024-09-21T07:22:53.767164+0000","last_peered":"2024-09-21T07:22:53.767164+0000","last_clean":"2024-09-21T07:22:53.767164+0000","last_became_active":"2024-09-21T07:22:47.725422+0000","last_became_peered":"2024-09-21T07:22:47.725422+0000","last_unstale":"2024-09-21T07:22:53.767164+0000","last_undegraded":"2024-09-21T07:22:53.767164+0000","last_fullsized":"2024-09-21T07:22:53.767164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:00.603887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027060+0000","last_change":"2024-09-21T07:22:48.744596+0000","last_active":"2024-09-21T07:22:54.027060+0000","last_peered":"2024-09-21T07:22:54.027060+0000","last_clean":"2024-09-21T07:22:54.027060+0000","last_became_active":"2024-09-21T07:22:48.744299+0000","last_became_peered":"2024-09-21T07:22:48.744299+0000","last_unstale":"2024-09-21T07:22:54.027060+0000","last_undegraded":"2024-09-21T07:22:54.027060+0000","last_fullsized":"2024-09-21T07:22:54.027060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024935+0000","last_change":"2024-09-21T07:22:52.787834+0000","last_active":"2024-09-21T07:22:54.024935+0000","last_peered":"2024-09-21T07:22:54.024935+0000","last_clean":"2024-09-21T07:22:54.024935+0000","last_became_active":"2024-09-21T07:22:52.786824+0000","last_became_peered":"2024-09-21T07:22:52.786824+0000","last_unstale":"2024-09-21T07:22:54.024935+0000","last_undegraded":"2024-09-21T07:22:54.024935+0000","last_fullsized":"2024-09-21T07:22:54.024935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:57.435599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764323+0000","last_change":"2024-09-21T07:22:47.741714+0000","last_active":"2024-09-21T07:22:53.764323+0000","last_peered":"2024-09-21T07:22:53.764323+0000","last_clean":"2024-09-21T07:22:53.764323+0000","last_became_active":"2024-09-21T07:22:47.741389+0000","last_became_peered":"2024-09-21T07:22:47.741389+0000","last_unstale":"2024-09-21T07:22:53.764323+0000","last_undegraded":"2024-09-21T07:22:53.764323+0000","last_fullsized":"2024-09-21T07:22:53.764323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:45.062537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025167+0000","last_change":"2024-09-21T07:22:48.734053+0000","last_active":"2024-09-21T07:22:54.025167+0000","last_peered":"2024-09-21T07:22:54.025167+0000","last_clean":"2024-09-21T07:22:54.025167+0000","last_became_active":"2024-09-21T07:22:48.733585+0000","last_became_peered":"2024-09-21T07:22:48.733585+0000","last_unstale":"2024-09-21T07:22:54.025167+0000","last_undegraded":"2024-09-21T07:22:54.025167+0000","last_fullsized":"2024-09-21T07:22:54.025167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:42.987988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764844+0000","last_change":"2024-09-21T07:22:52.783230+0000","last_active":"2024-09-21T07:22:53.764844+0000","last_peered":"2024-09-21T07:22:53.764844+0000","last_clean":"2024-09-21T07:22:53.764844+0000","last_became_active":"2024-09-21T07:22:52.782669+0000","last_became_peered":"2024-09-21T07:22:52.782669+0000","last_unstale":"2024-09-21T07:22:53.764844+0000","last_undegraded":"2024-09-21T07:22:53.764844+0000","last_fullsized":"2024-09-21T07:22:53.764844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:10.593769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764996+0000","last_change":"2024-09-21T07:22:48.746272+0000","last_active":"2024-09-21T07:22:53.764996+0000","last_peered":"2024-09-21T07:22:53.764996+0000","last_clean":"2024-09-21T07:22:53.764996+0000","last_became_active":"2024-09-21T07:22:48.745859+0000","last_became_peered":"2024-09-21T07:22:48.745859+0000","last_unstale":"2024-09-21T07:22:53.764996+0000","last_undegraded":"2024-09-21T07:22:53.764996+0000","last_fullsized":"2024-09-21T07:22:53.764996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024230+0000","last_change":"2024-09-21T07:22:48.735624+0000","last_active":"2024-09-21T07:22:54.024230+0000","last_peered":"2024-09-21T07:22:54.024230+0000","last_clean":"2024-09-21T07:22:54.024230+0000","last_became_active":"2024-09-21T07:22:48.735299+0000","last_became_peered":"2024-09-21T07:22:48.735299+0000","last_unstale":"2024-09-21T07:22:54.024230+0000","last_undegraded":"2024-09-21T07:22:54.024230+0000","last_fullsized":"2024-09-21T07:22:54.024230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765809+0000","last_change":"2024-09-21T07:22:48.754562+0000","last_active":"2024-09-21T07:22:53.765809+0000","last_peered":"2024-09-21T07:22:53.765809+0000","last_clean":"2024-09-21T07:22:53.765809+0000","last_became_active":"2024-09-21T07:22:48.753457+0000","last_became_peered":"2024-09-21T07:22:48.753457+0000","last_unstale":"2024-09-21T07:22:53.765809+0000","last_undegraded":"2024-09-21T07:22:53.765809+0000","last_fullsized":"2024-09-21T07:22:53.765809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:41.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027009+0000","last_change":"2024-09-21T07:22:48.751689+0000","last_active":"2024-09-21T07:22:54.027009+0000","last_peered":"2024-09-21T07:22:54.027009+0000","last_clean":"2024-09-21T07:22:54.027009+0000","last_became_active":"2024-09-21T07:22:48.751361+0000","last_became_peered":"2024-09-21T07:22:48.751361+0000","last_unstale":"2024-09-21T07:22:54.027009+0000","last_undegraded":"2024-09-21T07:22:54.027009+0000","last_fullsized":"2024-09-21T07:22:54.027009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764765+0000","last_change":"2024-09-21T07:22:48.759019+0000","last_active":"2024-09-21T07:22:53.764765+0000","last_peered":"2024-09-21T07:22:53.764765+0000","last_clean":"2024-09-21T07:22:53.764765+0000","last_became_active":"2024-09-21T07:22:48.758694+0000","last_became_peered":"2024-09-21T07:22:48.758694+0000","last_unstale":"2024-09-21T07:22:53.764765+0000","last_undegraded":"2024-09-21T07:22:53.764765+0000","last_fullsized":"2024-09-21T07:22:53.764765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024926+0000","last_change":"2024-09-21T07:22:48.723104+0000","last_active":"2024-09-21T07:22:54.024926+0000","last_peered":"2024-09-21T07:22:54.024926+0000","last_clean":"2024-09-21T07:22:54.024926+0000","last_became_active":"2024-09-21T07:22:48.722764+0000","last_became_peered":"2024-09-21T07:22:48.722764+0000","last_unstale":"2024-09-21T07:22:54.024926+0000","last_undegraded":"2024-09-21T07:22:54.024926+0000","last_fullsized":"2024-09-21T07:22:54.024926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:01.478325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767699+0000","last_change":"2024-09-21T07:22:48.742610+0000","last_active":"2024-09-21T07:22:53.767699+0000","last_peered":"2024-09-21T07:22:53.767699+0000","last_clean":"2024-09-21T07:22:53.767699+0000","last_became_active":"2024-09-21T07:22:48.737384+0000","last_became_peered":"2024-09-21T07:22:48.737384+0000","last_unstale":"2024-09-21T07:22:53.767699+0000","last_undegraded":"2024-09-21T07:22:53.767699+0000","last_fullsized":"2024-09-21T07:22:53.767699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764922+0000","last_change":"2024-09-21T07:22:48.738148+0000","last_active":"2024-09-21T07:22:53.764922+0000","last_peered":"2024-09-21T07:22:53.764922+0000","last_clean":"2024-09-21T07:22:53.764922+0000","last_became_active":"2024-09-21T07:22:48.737843+0000","last_became_peered":"2024-09-21T07:22:48.737843+0000","last_unstale":"2024-09-21T07:22:53.764922+0000","last_undegraded":"2024-09-21T07:22:53.764922+0000","last_fullsized":"2024-09-21T07:22:53.764922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:17.737322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765676+0000","last_change":"2024-09-21T07:22:48.740105+0000","last_active":"2024-09-21T07:22:53.765676+0000","last_peered":"2024-09-21T07:22:53.765676+0000","last_clean":"2024-09-21T07:22:53.765676+0000","last_became_active":"2024-09-21T07:22:48.739816+0000","last_became_peered":"2024-09-21T07:22:48.739816+0000","last_unstale":"2024-09-21T07:22:53.765676+0000","last_undegraded":"2024-09-21T07:22:53.765676+0000","last_fullsized":"2024-09-21T07:22:53.765676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764141+0000","last_change":"2024-09-21T07:22:48.741924+0000","last_active":"2024-09-21T07:22:53.764141+0000","last_peered":"2024-09-21T07:22:53.764141+0000","last_clean":"2024-09-21T07:22:53.764141+0000","last_became_active":"2024-09-21T07:22:48.741567+0000","last_became_peered":"2024-09-21T07:22:48.741567+0000","last_unstale":"2024-09-21T07:22:53.764141+0000","last_undegraded":"2024-09-21T07:22:53.764141+0000","last_fullsized":"2024-09-21T07:22:53.764141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:33.518751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765851+0000","last_change":"2024-09-21T07:22:48.729429+0000","last_active":"2024-09-21T07:22:53.765851+0000","last_peered":"2024-09-21T07:22:53.765851+0000","last_clean":"2024-09-21T07:22:53.765851+0000","last_became_active":"2024-09-21T07:22:48.729115+0000","last_became_peered":"2024-09-21T07:22:48.729115+0000","last_unstale":"2024-09-21T07:22:53.765851+0000","last_undegraded":"2024-09-21T07:22:53.765851+0000","last_fullsized":"2024-09-21T07:22:53.765851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:45.792793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026833+0000","last_change":"2024-09-21T07:22:48.739366+0000","last_active":"2024-09-21T07:22:54.026833+0000","last_peered":"2024-09-21T07:22:54.026833+0000","last_clean":"2024-09-21T07:22:54.026833+0000","last_became_active":"2024-09-21T07:22:48.738848+0000","last_became_peered":"2024-09-21T07:22:48.738848+0000","last_unstale":"2024-09-21T07:22:54.026833+0000","last_undegraded":"2024-09-21T07:22:54.026833+0000","last_fullsized":"2024-09-21T07:22:54.026833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742010+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.741123+0000","last_became_peered":"2024-09-21T07:22:48.741123+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893554+0000","last_change":"2024-09-21T07:22:48.733725+0000","last_active":"2024-09-21T07:22:53.893554+0000","last_peered":"2024-09-21T07:22:53.893554+0000","last_clean":"2024-09-21T07:22:53.893554+0000","last_became_active":"2024-09-21T07:22:48.733408+0000","last_became_peered":"2024-09-21T07:22:48.733408+0000","last_unstale":"2024-09-21T07:22:53.893554+0000","last_undegraded":"2024-09-21T07:22:53.893554+0000","last_fullsized":"2024-09-21T07:22:53.893554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:56.573091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025995+0000","last_change":"2024-09-21T07:22:48.733307+0000","last_active":"2024-09-21T07:22:54.025995+0000","last_peered":"2024-09-21T07:22:54.025995+0000","last_clean":"2024-09-21T07:22:54.025995+0000","last_became_active":"2024-09-21T07:22:48.732920+0000","last_became_peered":"2024-09-21T07:22:48.732920+0000","last_unstale":"2024-09-21T07:22:54.025995+0000","last_undegraded":"2024-09-21T07:22:54.025995+0000","last_fullsized":"2024-09-21T07:22:54.025995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.733360+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.733032+0000","last_became_peered":"2024-09-21T07:22:48.733032+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:34.232644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765534+0000","last_change":"2024-09-21T07:22:48.746150+0000","last_active":"2024-09-21T07:22:53.765534+0000","last_peered":"2024-09-21T07:22:53.765534+0000","last_clean":"2024-09-21T07:22:53.765534+0000","last_became_active":"2024-09-21T07:22:48.745814+0000","last_became_peered":"2024-09-21T07:22:48.745814+0000","last_unstale":"2024-09-21T07:22:53.765534+0000","last_undegraded":"2024-09-21T07:22:53.765534+0000","last_fullsized":"2024-09-21T07:22:53.765534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024701+0000","last_change":"2024-09-21T07:22:48.739733+0000","last_active":"2024-09-21T07:22:54.024701+0000","last_peered":"2024-09-21T07:22:54.024701+0000","last_clean":"2024-09-21T07:22:54.024701+0000","last_became_active":"2024-09-21T07:22:48.739428+0000","last_became_peered":"2024-09-21T07:22:48.739428+0000","last_unstale":"2024-09-21T07:22:54.024701+0000","last_undegraded":"2024-09-21T07:22:54.024701+0000","last_fullsized":"2024-09-21T07:22:54.024701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:08.474202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026517+0000","last_change":"2024-09-21T07:22:48.737610+0000","last_active":"2024-09-21T07:22:54.026517+0000","last_peered":"2024-09-21T07:22:54.026517+0000","last_clean":"2024-09-21T07:22:54.026517+0000","last_became_active":"2024-09-21T07:22:48.737248+0000","last_became_peered":"2024-09-21T07:22:48.737248+0000","last_unstale":"2024-09-21T07:22:54.026517+0000","last_undegraded":"2024-09-21T07:22:54.026517+0000","last_fullsized":"2024-09-21T07:22:54.026517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:12.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764170+0000","last_change":"2024-09-21T07:22:48.740790+0000","last_active":"2024-09-21T07:22:53.764170+0000","last_peered":"2024-09-21T07:22:53.764170+0000","last_clean":"2024-09-21T07:22:53.764170+0000","last_became_active":"2024-09-21T07:22:48.740145+0000","last_became_peered":"2024-09-21T07:22:48.740145+0000","last_unstale":"2024-09-21T07:22:53.764170+0000","last_undegraded":"2024-09-21T07:22:53.764170+0000","last_fullsized":"2024-09-21T07:22:53.764170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:31.562981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025501+0000","last_change":"2024-09-21T07:22:48.751370+0000","last_active":"2024-09-21T07:22:54.025501+0000","last_peered":"2024-09-21T07:22:54.025501+0000","last_clean":"2024-09-21T07:22:54.025501+0000","last_became_active":"2024-09-21T07:22:48.746516+0000","last_became_peered":"2024-09-21T07:22:48.746516+0000","last_unstale":"2024-09-21T07:22:54.025501+0000","last_undegraded":"2024-09-21T07:22:54.025501+0000","last_fullsized":"2024-09-21T07:22:54.025501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742862+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.736975+0000","last_became_peered":"2024-09-21T07:22:48.736975+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.732301+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.731301+0000","last_became_peered":"2024-09-21T07:22:48.731301+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893478+0000","last_change":"2024-09-21T07:22:48.736203+0000","last_active":"2024-09-21T07:22:53.893478+0000","last_peered":"2024-09-21T07:22:53.893478+0000","last_clean":"2024-09-21T07:22:53.893478+0000","last_became_active":"2024-09-21T07:22:48.735217+0000","last_became_peered":"2024-09-21T07:22:48.735217+0000","last_unstale":"2024-09-21T07:22:53.893478+0000","last_undegraded":"2024-09-21T07:22:53.893478+0000","last_fullsized":"2024-09-21T07:22:53.893478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:10.751312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763848+0000","last_change":"2024-09-21T07:22:48.739850+0000","last_active":"2024-09-21T07:22:53.763848+0000","last_peered":"2024-09-21T07:22:53.763848+0000","last_clean":"2024-09-21T07:22:53.763848+0000","last_became_active":"2024-09-21T07:22:48.738820+0000","last_became_peered":"2024-09-21T07:22:48.738820+0000","last_unstale":"2024-09-21T07:22:53.763848+0000","last_undegraded":"2024-09-21T07:22:53.763848+0000","last_fullsized":"2024-09-21T07:22:53.763848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:11.644683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892810+0000","last_change":"2024-09-21T07:22:48.749899+0000","last_active":"2024-09-21T07:22:53.892810+0000","last_peered":"2024-09-21T07:22:53.892810+0000","last_clean":"2024-09-21T07:22:53.892810+0000","last_became_active":"2024-09-21T07:22:48.748269+0000","last_became_peered":"2024-09-21T07:22:48.748269+0000","last_unstale":"2024-09-21T07:22:53.892810+0000","last_undegraded":"2024-09-21T07:22:53.892810+0000","last_fullsized":"2024-09-21T07:22:53.892810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:54.034703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765685+0000","last_change":"2024-09-21T07:22:48.750088+0000","last_active":"2024-09-21T07:22:53.765685+0000","last_peered":"2024-09-21T07:22:53.765685+0000","last_clean":"2024-09-21T07:22:53.765685+0000","last_became_active":"2024-09-21T07:22:48.749780+0000","last_became_peered":"2024-09-21T07:22:48.749780+0000","last_unstale":"2024-09-21T07:22:53.765685+0000","last_undegraded":"2024-09-21T07:22:53.765685+0000","last_fullsized":"2024-09-21T07:22:53.765685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:23.057892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892813+0000","last_change":"2024-09-21T07:22:48.741748+0000","last_active":"2024-09-21T07:22:53.892813+0000","last_peered":"2024-09-21T07:22:53.892813+0000","last_clean":"2024-09-21T07:22:53.892813+0000","last_became_active":"2024-09-21T07:22:48.739240+0000","last_became_peered":"2024-09-21T07:22:48.739240+0000","last_unstale":"2024-09-21T07:22:53.892813+0000","last_undegraded":"2024-09-21T07:22:53.892813+0000","last_fullsized":"2024-09-21T07:22:53.892813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766446+0000","last_change":"2024-09-21T07:22:48.749807+0000","last_active":"2024-09-21T07:22:53.766446+0000","last_peered":"2024-09-21T07:22:53.766446+0000","last_clean":"2024-09-21T07:22:53.766446+0000","last_became_active":"2024-09-21T07:22:48.749133+0000","last_became_peered":"2024-09-21T07:22:48.749133+0000","last_unstale":"2024-09-21T07:22:53.766446+0000","last_undegraded":"2024-09-21T07:22:53.766446+0000","last_fullsized":"2024-09-21T07:22:53.766446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:04.259181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027319+0000","last_change":"2024-09-21T07:22:48.747149+0000","last_active":"2024-09-21T07:22:54.027319+0000","last_peered":"2024-09-21T07:22:54.027319+0000","last_clean":"2024-09-21T07:22:54.027319+0000","last_became_active":"2024-09-21T07:22:48.745587+0000","last_became_peered":"2024-09-21T07:22:48.745587+0000","last_unstale":"2024-09-21T07:22:54.027319+0000","last_undegraded":"2024-09-21T07:22:54.027319+0000","last_fullsized":"2024-09-21T07:22:54.027319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025332+0000","last_change":"2024-09-21T07:22:48.738773+0000","last_active":"2024-09-21T07:22:54.025332+0000","last_peered":"2024-09-21T07:22:54.025332+0000","last_clean":"2024-09-21T07:22:54.025332+0000","last_became_active":"2024-09-21T07:22:48.738521+0000","last_became_peered":"2024-09-21T07:22:48.738521+0000","last_unstale":"2024-09-21T07:22:54.025332+0000","last_undegraded":"2024-09-21T07:22:54.025332+0000","last_fullsized":"2024-09-21T07:22:54.025332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:42.041043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893340+0000","last_change":"2024-09-21T07:22:48.750274+0000","last_active":"2024-09-21T07:22:53.893340+0000","last_peered":"2024-09-21T07:22:53.893340+0000","last_clean":"2024-09-21T07:22:53.893340+0000","last_became_active":"2024-09-21T07:22:48.748751+0000","last_became_peered":"2024-09-21T07:22:48.748751+0000","last_unstale":"2024-09-21T07:22:53.893340+0000","last_undegraded":"2024-09-21T07:22:53.893340+0000","last_fullsized":"2024-09-21T07:22:53.893340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:28.162100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":107492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":698282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:08.619 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 -- 172.21.15.64:0/3608297231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232406f620 msgr2=0x7f232406fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 --2- 172.21.15.64:0/3608297231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232406f620 0x7f232406fa30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2324072af0 tx=0x7f231c01cd50 comp rx=0 tx=0).stop 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 -- 172.21.15.64:0/3608297231 shutdown_connections 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 --2- 172.21.15.64:0/3608297231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232406f620 0x7f232406fa30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 --2- 172.21.15.64:0/3608297231 >> v2:172.21.15.90:3300/0 conn(0x7f232406d020 0x7f232406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 -- 172.21.15.64:0/3608297231 >> 172.21.15.64:0/3608297231 conn(0x7f23240d0de0 msgr2=0x7f23240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 -- 172.21.15.64:0/3608297231 shutdown_connections 2024-09-21T07:23:08.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.841+0000 7f232c200640 1 -- 172.21.15.64:0/3608297231 wait complete. 2024-09-21T07:23:08.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 Processor -- start 2024-09-21T07:23:08.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 -- start start 2024-09-21T07:23:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232406d020 0x7f2324157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f232406f620 0x7f232414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2324168b40 con 0x7f232415b810 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23241689c0 con 0x7f232406d020 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232c200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2324168cc0 con 0x7f232406f620 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39980/0 (socket says 172.21.15.64:39980) 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 -- 172.21.15.64:0/3732192095 learned_addr learned my addr 172.21.15.64:0/3732192095 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f2328e00640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f232406f620 0x7f232414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f2329800640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232406d020 0x7f2324157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 -- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f232406f620 msgr2=0x7f232414db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f232406f620 0x7f232414db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 -- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232406d020 msgr2=0x7f2324157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232406d020 0x7f2324157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.845+0000 7f232a200640 1 -- 172.21.15.64:0/3732192095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324151ff0 con 0x7f232415b810 2024-09-21T07:23:08.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f232a200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f231c098940 tx=0x7f231c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:08.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c0b2040 con 0x7f232415b810 2024-09-21T07:23:08.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f231c0bb070 con 0x7f232415b810 2024-09-21T07:23:08.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23240b0210 con 0x7f232415b810 2024-09-21T07:23:08.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c004460 con 0x7f232415b810 2024-09-21T07:23:08.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2324151d10 con 0x7f232415b810 2024-09-21T07:23:08.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2324151a80 con 0x7f232415b810 2024-09-21T07:23:08.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f231c004600 con 0x7f232415b810 2024-09-21T07:23:08.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 0x7f2304075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:08.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.849+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f231c12ee70 con 0x7f232415b810 2024-09-21T07:23:08.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.853+0000 7f2329800640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 0x7f2304075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:08.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.853+0000 7f2329800640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 0x7f2304075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2318007fd0 tx=0x7f2318009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:08.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:08.857+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2324151ff0 con 0x7f232415b810 2024-09-21T07:23:09.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.029+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23241f9970 con 0x7f2304073200 2024-09-21T07:23:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.033+0000 7f2321600640 1 -- 172.21.15.64:0/3732192095 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f2318001470 con 0x7f2304073200 2024-09-21T07:23:09.041 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:09.043 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:09.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 msgr2=0x7f2304075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 0x7f2304075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2318007fd0 tx=0x7f2318009040 comp rx=0 tx=0).stop 2024-09-21T07:23:09.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 msgr2=0x7f23241f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f231c098940 tx=0x7f231c005c90 comp rx=0 tx=0).stop 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 shutdown_connections 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2304073200 0x7f2304075710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232415b810 0x7f23241f8a80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f232406f620 0x7f232414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 --2- 172.21.15.64:0/3732192095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232406d020 0x7f2324157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 >> 172.21.15.64:0/3732192095 conn(0x7f23240d0de0 msgr2=0x7f2324158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 shutdown_connections 2024-09-21T07:23:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.037+0000 7f232c200640 1 -- 172.21.15.64:0/3732192095 wait complete. 2024-09-21T07:23:09.063 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-21T07:23:07.421137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2048672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003979"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027628+0000","last_change":"2024-09-21T07:22:47.742250+0000","last_active":"2024-09-21T07:22:54.027628+0000","last_peered":"2024-09-21T07:22:54.027628+0000","last_clean":"2024-09-21T07:22:54.027628+0000","last_became_active":"2024-09-21T07:22:47.741257+0000","last_became_peered":"2024-09-21T07:22:47.741257+0000","last_unstale":"2024-09-21T07:22:54.027628+0000","last_undegraded":"2024-09-21T07:22:54.027628+0000","last_fullsized":"2024-09-21T07:22:54.027628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764663+0000","last_change":"2024-09-21T07:22:48.740833+0000","last_active":"2024-09-21T07:22:53.764663+0000","last_peered":"2024-09-21T07:22:53.764663+0000","last_clean":"2024-09-21T07:22:53.764663+0000","last_became_active":"2024-09-21T07:22:48.740377+0000","last_became_peered":"2024-09-21T07:22:48.740377+0000","last_unstale":"2024-09-21T07:22:53.764663+0000","last_undegraded":"2024-09-21T07:22:53.764663+0000","last_fullsized":"2024-09-21T07:22:53.764663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:17.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764017+0000","last_change":"2024-09-21T07:22:53.073187+0000","last_active":"2024-09-21T07:22:53.764017+0000","last_peered":"2024-09-21T07:22:53.764017+0000","last_clean":"2024-09-21T07:22:53.764017+0000","last_became_active":"2024-09-21T07:22:53.072636+0000","last_became_peered":"2024-09-21T07:22:53.072636+0000","last_unstale":"2024-09-21T07:22:53.764017+0000","last_undegraded":"2024-09-21T07:22:53.764017+0000","last_fullsized":"2024-09-21T07:22:53.764017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:13.190959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764937+0000","last_change":"2024-09-21T07:22:47.736091+0000","last_active":"2024-09-21T07:22:53.764937+0000","last_peered":"2024-09-21T07:22:53.764937+0000","last_clean":"2024-09-21T07:22:53.764937+0000","last_became_active":"2024-09-21T07:22:47.735733+0000","last_became_peered":"2024-09-21T07:22:47.735733+0000","last_unstale":"2024-09-21T07:22:53.764937+0000","last_undegraded":"2024-09-21T07:22:53.764937+0000","last_fullsized":"2024-09-21T07:22:53.764937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:08.564048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027377+0000","last_change":"2024-09-21T07:22:48.751664+0000","last_active":"2024-09-21T07:22:54.027377+0000","last_peered":"2024-09-21T07:22:54.027377+0000","last_clean":"2024-09-21T07:22:54.027377+0000","last_became_active":"2024-09-21T07:22:48.751327+0000","last_became_peered":"2024-09-21T07:22:48.751327+0000","last_unstale":"2024-09-21T07:22:54.027377+0000","last_undegraded":"2024-09-21T07:22:54.027377+0000","last_fullsized":"2024-09-21T07:22:54.027377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024710+0000","last_change":"2024-09-21T07:22:52.783270+0000","last_active":"2024-09-21T07:22:54.024710+0000","last_peered":"2024-09-21T07:22:54.024710+0000","last_clean":"2024-09-21T07:22:54.024710+0000","last_became_active":"2024-09-21T07:22:52.782796+0000","last_became_peered":"2024-09-21T07:22:52.782796+0000","last_unstale":"2024-09-21T07:22:54.024710+0000","last_undegraded":"2024-09-21T07:22:54.024710+0000","last_fullsized":"2024-09-21T07:22:54.024710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:50:20.520920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893408+0000","last_change":"2024-09-21T07:22:47.744126+0000","last_active":"2024-09-21T07:22:53.893408+0000","last_peered":"2024-09-21T07:22:53.893408+0000","last_clean":"2024-09-21T07:22:53.893408+0000","last_became_active":"2024-09-21T07:22:47.743644+0000","last_became_peered":"2024-09-21T07:22:47.743644+0000","last_unstale":"2024-09-21T07:22:53.893408+0000","last_undegraded":"2024-09-21T07:22:53.893408+0000","last_fullsized":"2024-09-21T07:22:53.893408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:29.063190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766496+0000","last_change":"2024-09-21T07:22:48.734135+0000","last_active":"2024-09-21T07:22:53.766496+0000","last_peered":"2024-09-21T07:22:53.766496+0000","last_clean":"2024-09-21T07:22:53.766496+0000","last_became_active":"2024-09-21T07:22:48.733798+0000","last_became_peered":"2024-09-21T07:22:48.733798+0000","last_unstale":"2024-09-21T07:22:53.766496+0000","last_undegraded":"2024-09-21T07:22:53.766496+0000","last_fullsized":"2024-09-21T07:22:53.766496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:34.239566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025181+0000","last_change":"2024-09-21T07:22:52.783122+0000","last_active":"2024-09-21T07:22:54.025181+0000","last_peered":"2024-09-21T07:22:54.025181+0000","last_clean":"2024-09-21T07:22:54.025181+0000","last_became_active":"2024-09-21T07:22:52.782549+0000","last_became_peered":"2024-09-21T07:22:52.782549+0000","last_unstale":"2024-09-21T07:22:54.025181+0000","last_undegraded":"2024-09-21T07:22:54.025181+0000","last_fullsized":"2024-09-21T07:22:54.025181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:34.419031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893397+0000","last_change":"2024-09-21T07:22:47.742860+0000","last_active":"2024-09-21T07:22:53.893397+0000","last_peered":"2024-09-21T07:22:53.893397+0000","last_clean":"2024-09-21T07:22:53.893397+0000","last_became_active":"2024-09-21T07:22:47.742543+0000","last_became_peered":"2024-09-21T07:22:47.742543+0000","last_unstale":"2024-09-21T07:22:53.893397+0000","last_undegraded":"2024-09-21T07:22:53.893397+0000","last_fullsized":"2024-09-21T07:22:53.893397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:11.203283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767084+0000","last_change":"2024-09-21T07:22:48.731433+0000","last_active":"2024-09-21T07:22:53.767084+0000","last_peered":"2024-09-21T07:22:53.767084+0000","last_clean":"2024-09-21T07:22:53.767084+0000","last_became_active":"2024-09-21T07:22:48.730230+0000","last_became_peered":"2024-09-21T07:22:48.730230+0000","last_unstale":"2024-09-21T07:22:53.767084+0000","last_undegraded":"2024-09-21T07:22:53.767084+0000","last_fullsized":"2024-09-21T07:22:53.767084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:35.738074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024779+0000","last_change":"2024-09-21T07:22:52.785170+0000","last_active":"2024-09-21T07:22:54.024779+0000","last_peered":"2024-09-21T07:22:54.024779+0000","last_clean":"2024-09-21T07:22:54.024779+0000","last_became_active":"2024-09-21T07:22:52.784767+0000","last_became_peered":"2024-09-21T07:22:52.784767+0000","last_unstale":"2024-09-21T07:22:54.024779+0000","last_undegraded":"2024-09-21T07:22:54.024779+0000","last_fullsized":"2024-09-21T07:22:54.024779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:48.957476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766904+0000","last_change":"2024-09-21T07:22:48.741283+0000","last_active":"2024-09-21T07:22:53.766904+0000","last_peered":"2024-09-21T07:22:53.766904+0000","last_clean":"2024-09-21T07:22:53.766904+0000","last_became_active":"2024-09-21T07:22:48.740907+0000","last_became_peered":"2024-09-21T07:22:48.740907+0000","last_unstale":"2024-09-21T07:22:53.766904+0000","last_undegraded":"2024-09-21T07:22:53.766904+0000","last_fullsized":"2024-09-21T07:22:53.766904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893462+0000","last_change":"2024-09-21T07:22:47.744642+0000","last_active":"2024-09-21T07:22:53.893462+0000","last_peered":"2024-09-21T07:22:53.893462+0000","last_clean":"2024-09-21T07:22:53.893462+0000","last_became_active":"2024-09-21T07:22:47.744170+0000","last_became_peered":"2024-09-21T07:22:47.744170+0000","last_unstale":"2024-09-21T07:22:53.893462+0000","last_undegraded":"2024-09-21T07:22:53.893462+0000","last_fullsized":"2024-09-21T07:22:53.893462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:22.987361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025596+0000","last_change":"2024-09-21T07:22:52.790836+0000","last_active":"2024-09-21T07:22:54.025596+0000","last_peered":"2024-09-21T07:22:54.025596+0000","last_clean":"2024-09-21T07:22:54.025596+0000","last_became_active":"2024-09-21T07:22:52.790363+0000","last_became_peered":"2024-09-21T07:22:52.790363+0000","last_unstale":"2024-09-21T07:22:54.025596+0000","last_undegraded":"2024-09-21T07:22:54.025596+0000","last_fullsized":"2024-09-21T07:22:54.025596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:37.910110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764396+0000","last_change":"2024-09-21T07:22:48.745313+0000","last_active":"2024-09-21T07:22:53.764396+0000","last_peered":"2024-09-21T07:22:53.764396+0000","last_clean":"2024-09-21T07:22:53.764396+0000","last_became_active":"2024-09-21T07:22:48.744930+0000","last_became_peered":"2024-09-21T07:22:48.744930+0000","last_unstale":"2024-09-21T07:22:53.764396+0000","last_undegraded":"2024-09-21T07:22:53.764396+0000","last_fullsized":"2024-09-21T07:22:53.764396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:10.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025330+0000","last_change":"2024-09-21T07:22:47.734173+0000","last_active":"2024-09-21T07:22:54.025330+0000","last_peered":"2024-09-21T07:22:54.025330+0000","last_clean":"2024-09-21T07:22:54.025330+0000","last_became_active":"2024-09-21T07:22:47.733708+0000","last_became_peered":"2024-09-21T07:22:47.733708+0000","last_unstale":"2024-09-21T07:22:54.025330+0000","last_undegraded":"2024-09-21T07:22:54.025330+0000","last_fullsized":"2024-09-21T07:22:54.025330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:30.464654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025043+0000","last_change":"2024-09-21T07:22:52.783224+0000","last_active":"2024-09-21T07:22:54.025043+0000","last_peered":"2024-09-21T07:22:54.025043+0000","last_clean":"2024-09-21T07:22:54.025043+0000","last_became_active":"2024-09-21T07:22:52.782848+0000","last_became_peered":"2024-09-21T07:22:52.782848+0000","last_unstale":"2024-09-21T07:22:54.025043+0000","last_undegraded":"2024-09-21T07:22:54.025043+0000","last_fullsized":"2024-09-21T07:22:54.025043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:05.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764138+0000","last_change":"2024-09-21T07:22:48.732990+0000","last_active":"2024-09-21T07:22:53.764138+0000","last_peered":"2024-09-21T07:22:53.764138+0000","last_clean":"2024-09-21T07:22:53.764138+0000","last_became_active":"2024-09-21T07:22:48.721772+0000","last_became_peered":"2024-09-21T07:22:48.721772+0000","last_unstale":"2024-09-21T07:22:53.764138+0000","last_undegraded":"2024-09-21T07:22:53.764138+0000","last_fullsized":"2024-09-21T07:22:53.764138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:12.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:47.735072+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:47.734618+0000","last_became_peered":"2024-09-21T07:22:47.734618+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:28.092443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025531+0000","last_change":"2024-09-21T07:22:53.066457+0000","last_active":"2024-09-21T07:22:54.025531+0000","last_peered":"2024-09-21T07:22:54.025531+0000","last_clean":"2024-09-21T07:22:54.025531+0000","last_became_active":"2024-09-21T07:22:53.065989+0000","last_became_peered":"2024-09-21T07:22:53.065989+0000","last_unstale":"2024-09-21T07:22:54.025531+0000","last_undegraded":"2024-09-21T07:22:54.025531+0000","last_fullsized":"2024-09-21T07:22:54.025531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:44.966857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025245+0000","last_change":"2024-09-21T07:22:48.737581+0000","last_active":"2024-09-21T07:22:54.025245+0000","last_peered":"2024-09-21T07:22:54.025245+0000","last_clean":"2024-09-21T07:22:54.025245+0000","last_became_active":"2024-09-21T07:22:48.737143+0000","last_became_peered":"2024-09-21T07:22:48.737143+0000","last_unstale":"2024-09-21T07:22:54.025245+0000","last_undegraded":"2024-09-21T07:22:54.025245+0000","last_fullsized":"2024-09-21T07:22:54.025245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:45.110572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892658+0000","last_change":"2024-09-21T07:22:47.748620+0000","last_active":"2024-09-21T07:22:53.892658+0000","last_peered":"2024-09-21T07:22:53.892658+0000","last_clean":"2024-09-21T07:22:53.892658+0000","last_became_active":"2024-09-21T07:22:47.744065+0000","last_became_peered":"2024-09-21T07:22:47.744065+0000","last_unstale":"2024-09-21T07:22:53.892658+0000","last_undegraded":"2024-09-21T07:22:53.892658+0000","last_fullsized":"2024-09-21T07:22:53.892658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:49.915777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025379+0000","last_change":"2024-09-21T07:22:52.784325+0000","last_active":"2024-09-21T07:22:54.025379+0000","last_peered":"2024-09-21T07:22:54.025379+0000","last_clean":"2024-09-21T07:22:54.025379+0000","last_became_active":"2024-09-21T07:22:52.783906+0000","last_became_peered":"2024-09-21T07:22:52.783906+0000","last_unstale":"2024-09-21T07:22:54.025379+0000","last_undegraded":"2024-09-21T07:22:54.025379+0000","last_fullsized":"2024-09-21T07:22:54.025379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:39.780829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027640+0000","last_change":"2024-09-21T07:22:48.740991+0000","last_active":"2024-09-21T07:22:54.027640+0000","last_peered":"2024-09-21T07:22:54.027640+0000","last_clean":"2024-09-21T07:22:54.027640+0000","last_became_active":"2024-09-21T07:22:48.738376+0000","last_became_peered":"2024-09-21T07:22:48.738376+0000","last_unstale":"2024-09-21T07:22:54.027640+0000","last_undegraded":"2024-09-21T07:22:54.027640+0000","last_fullsized":"2024-09-21T07:22:54.027640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.768082+0000","last_change":"2024-09-21T07:22:47.733080+0000","last_active":"2024-09-21T07:22:53.768082+0000","last_peered":"2024-09-21T07:22:53.768082+0000","last_clean":"2024-09-21T07:22:53.768082+0000","last_became_active":"2024-09-21T07:22:47.731545+0000","last_became_peered":"2024-09-21T07:22:47.731545+0000","last_unstale":"2024-09-21T07:22:53.768082+0000","last_undegraded":"2024-09-21T07:22:53.768082+0000","last_fullsized":"2024-09-21T07:22:53.768082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:55.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024810+0000","last_change":"2024-09-21T07:22:53.070212+0000","last_active":"2024-09-21T07:22:54.024810+0000","last_peered":"2024-09-21T07:22:54.024810+0000","last_clean":"2024-09-21T07:22:54.024810+0000","last_became_active":"2024-09-21T07:22:53.069615+0000","last_became_peered":"2024-09-21T07:22:53.069615+0000","last_unstale":"2024-09-21T07:22:54.024810+0000","last_undegraded":"2024-09-21T07:22:54.024810+0000","last_fullsized":"2024-09-21T07:22:54.024810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:37.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765003+0000","last_change":"2024-09-21T07:22:48.733662+0000","last_active":"2024-09-21T07:22:53.765003+0000","last_peered":"2024-09-21T07:22:53.765003+0000","last_clean":"2024-09-21T07:22:53.765003+0000","last_became_active":"2024-09-21T07:22:48.733358+0000","last_became_peered":"2024-09-21T07:22:48.733358+0000","last_unstale":"2024-09-21T07:22:53.765003+0000","last_undegraded":"2024-09-21T07:22:53.765003+0000","last_fullsized":"2024-09-21T07:22:53.765003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025409+0000","last_change":"2024-09-21T07:22:47.737459+0000","last_active":"2024-09-21T07:22:54.025409+0000","last_peered":"2024-09-21T07:22:54.025409+0000","last_clean":"2024-09-21T07:22:54.025409+0000","last_became_active":"2024-09-21T07:22:47.737043+0000","last_became_peered":"2024-09-21T07:22:47.737043+0000","last_unstale":"2024-09-21T07:22:54.025409+0000","last_undegraded":"2024-09-21T07:22:54.025409+0000","last_fullsized":"2024-09-21T07:22:54.025409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:49.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763838+0000","last_change":"2024-09-21T07:22:53.070153+0000","last_active":"2024-09-21T07:22:53.763838+0000","last_peered":"2024-09-21T07:22:53.763838+0000","last_clean":"2024-09-21T07:22:53.763838+0000","last_became_active":"2024-09-21T07:22:53.066002+0000","last_became_peered":"2024-09-21T07:22:53.066002+0000","last_unstale":"2024-09-21T07:22:53.763838+0000","last_undegraded":"2024-09-21T07:22:53.763838+0000","last_fullsized":"2024-09-21T07:22:53.763838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:49.615596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024993+0000","last_change":"2024-09-21T07:22:48.730184+0000","last_active":"2024-09-21T07:22:54.024993+0000","last_peered":"2024-09-21T07:22:54.024993+0000","last_clean":"2024-09-21T07:22:54.024993+0000","last_became_active":"2024-09-21T07:22:48.729821+0000","last_became_peered":"2024-09-21T07:22:48.729821+0000","last_unstale":"2024-09-21T07:22:54.024993+0000","last_undegraded":"2024-09-21T07:22:54.024993+0000","last_fullsized":"2024-09-21T07:22:54.024993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:54.261987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893561+0000","last_change":"2024-09-21T07:22:47.745201+0000","last_active":"2024-09-21T07:22:53.893561+0000","last_peered":"2024-09-21T07:22:53.893561+0000","last_clean":"2024-09-21T07:22:53.893561+0000","last_became_active":"2024-09-21T07:22:47.744914+0000","last_became_peered":"2024-09-21T07:22:47.744914+0000","last_unstale":"2024-09-21T07:22:53.893561+0000","last_undegraded":"2024-09-21T07:22:53.893561+0000","last_fullsized":"2024-09-21T07:22:53.893561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.942934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026739+0000","last_change":"2024-09-21T07:22:53.063753+0000","last_active":"2024-09-21T07:22:54.026739+0000","last_peered":"2024-09-21T07:22:54.026739+0000","last_clean":"2024-09-21T07:22:54.026739+0000","last_became_active":"2024-09-21T07:22:53.063293+0000","last_became_peered":"2024-09-21T07:22:53.063293+0000","last_unstale":"2024-09-21T07:22:54.026739+0000","last_undegraded":"2024-09-21T07:22:54.026739+0000","last_fullsized":"2024-09-21T07:22:54.026739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767116+0000","last_change":"2024-09-21T07:22:48.753861+0000","last_active":"2024-09-21T07:22:53.767116+0000","last_peered":"2024-09-21T07:22:53.767116+0000","last_clean":"2024-09-21T07:22:53.767116+0000","last_became_active":"2024-09-21T07:22:48.753511+0000","last_became_peered":"2024-09-21T07:22:48.753511+0000","last_unstale":"2024-09-21T07:22:53.767116+0000","last_undegraded":"2024-09-21T07:22:53.767116+0000","last_fullsized":"2024-09-21T07:22:53.767116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:01.976003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025525+0000","last_change":"2024-09-21T07:22:47.737833+0000","last_active":"2024-09-21T07:22:54.025525+0000","last_peered":"2024-09-21T07:22:54.025525+0000","last_clean":"2024-09-21T07:22:54.025525+0000","last_became_active":"2024-09-21T07:22:47.736895+0000","last_became_peered":"2024-09-21T07:22:47.736895+0000","last_unstale":"2024-09-21T07:22:54.025525+0000","last_undegraded":"2024-09-21T07:22:54.025525+0000","last_fullsized":"2024-09-21T07:22:54.025525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:17.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024946+0000","last_change":"2024-09-21T07:22:52.781483+0000","last_active":"2024-09-21T07:22:54.024946+0000","last_peered":"2024-09-21T07:22:54.024946+0000","last_clean":"2024-09-21T07:22:54.024946+0000","last_became_active":"2024-09-21T07:22:52.778544+0000","last_became_peered":"2024-09-21T07:22:52.778544+0000","last_unstale":"2024-09-21T07:22:54.024946+0000","last_undegraded":"2024-09-21T07:22:54.024946+0000","last_fullsized":"2024-09-21T07:22:54.024946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:58.932426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025560+0000","last_change":"2024-09-21T07:22:48.751678+0000","last_active":"2024-09-21T07:22:54.025560+0000","last_peered":"2024-09-21T07:22:54.025560+0000","last_clean":"2024-09-21T07:22:54.025560+0000","last_became_active":"2024-09-21T07:22:48.744782+0000","last_became_peered":"2024-09-21T07:22:48.744782+0000","last_unstale":"2024-09-21T07:22:54.025560+0000","last_undegraded":"2024-09-21T07:22:54.025560+0000","last_fullsized":"2024-09-21T07:22:54.025560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:56.871086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766106+0000","last_change":"2024-09-21T07:22:47.727167+0000","last_active":"2024-09-21T07:22:53.766106+0000","last_peered":"2024-09-21T07:22:53.766106+0000","last_clean":"2024-09-21T07:22:53.766106+0000","last_became_active":"2024-09-21T07:22:47.726894+0000","last_became_peered":"2024-09-21T07:22:47.726894+0000","last_unstale":"2024-09-21T07:22:53.766106+0000","last_undegraded":"2024-09-21T07:22:53.766106+0000","last_fullsized":"2024-09-21T07:22:53.766106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:31.716302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024795+0000","last_change":"2024-09-21T07:22:52.783725+0000","last_active":"2024-09-21T07:22:54.024795+0000","last_peered":"2024-09-21T07:22:54.024795+0000","last_clean":"2024-09-21T07:22:54.024795+0000","last_became_active":"2024-09-21T07:22:52.778895+0000","last_became_peered":"2024-09-21T07:22:52.778895+0000","last_unstale":"2024-09-21T07:22:54.024795+0000","last_undegraded":"2024-09-21T07:22:54.024795+0000","last_fullsized":"2024-09-21T07:22:54.024795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:19.056150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024676+0000","last_change":"2024-09-21T07:22:48.737222+0000","last_active":"2024-09-21T07:22:54.024676+0000","last_peered":"2024-09-21T07:22:54.024676+0000","last_clean":"2024-09-21T07:22:54.024676+0000","last_became_active":"2024-09-21T07:22:48.736340+0000","last_became_peered":"2024-09-21T07:22:48.736340+0000","last_unstale":"2024-09-21T07:22:54.024676+0000","last_undegraded":"2024-09-21T07:22:54.024676+0000","last_fullsized":"2024-09-21T07:22:54.024676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:37.469062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024338+0000","last_change":"2024-09-21T07:22:47.713035+0000","last_active":"2024-09-21T07:22:54.024338+0000","last_peered":"2024-09-21T07:22:54.024338+0000","last_clean":"2024-09-21T07:22:54.024338+0000","last_became_active":"2024-09-21T07:22:47.711447+0000","last_became_peered":"2024-09-21T07:22:47.711447+0000","last_unstale":"2024-09-21T07:22:54.024338+0000","last_undegraded":"2024-09-21T07:22:54.024338+0000","last_fullsized":"2024-09-21T07:22:54.024338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:21.821706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025552+0000","last_change":"2024-09-21T07:22:52.783218+0000","last_active":"2024-09-21T07:22:54.025552+0000","last_peered":"2024-09-21T07:22:54.025552+0000","last_clean":"2024-09-21T07:22:54.025552+0000","last_became_active":"2024-09-21T07:22:52.778288+0000","last_became_peered":"2024-09-21T07:22:52.778288+0000","last_unstale":"2024-09-21T07:22:54.025552+0000","last_undegraded":"2024-09-21T07:22:54.025552+0000","last_fullsized":"2024-09-21T07:22:54.025552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:50.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026221+0000","last_change":"2024-09-21T07:22:48.748027+0000","last_active":"2024-09-21T07:22:54.026221+0000","last_peered":"2024-09-21T07:22:54.026221+0000","last_clean":"2024-09-21T07:22:54.026221+0000","last_became_active":"2024-09-21T07:22:48.747687+0000","last_became_peered":"2024-09-21T07:22:48.747687+0000","last_unstale":"2024-09-21T07:22:54.026221+0000","last_undegraded":"2024-09-21T07:22:54.026221+0000","last_fullsized":"2024-09-21T07:22:54.026221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:55.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893031+0000","last_change":"2024-09-21T07:22:47.744531+0000","last_active":"2024-09-21T07:22:53.893031+0000","last_peered":"2024-09-21T07:22:53.893031+0000","last_clean":"2024-09-21T07:22:53.893031+0000","last_became_active":"2024-09-21T07:22:47.744113+0000","last_became_peered":"2024-09-21T07:22:47.744113+0000","last_unstale":"2024-09-21T07:22:53.893031+0000","last_undegraded":"2024-09-21T07:22:53.893031+0000","last_fullsized":"2024-09-21T07:22:53.893031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:16.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027637+0000","last_change":"2024-09-21T07:22:53.068210+0000","last_active":"2024-09-21T07:22:54.027637+0000","last_peered":"2024-09-21T07:22:54.027637+0000","last_clean":"2024-09-21T07:22:54.027637+0000","last_became_active":"2024-09-21T07:22:53.067263+0000","last_became_peered":"2024-09-21T07:22:53.067263+0000","last_unstale":"2024-09-21T07:22:54.027637+0000","last_undegraded":"2024-09-21T07:22:54.027637+0000","last_fullsized":"2024-09-21T07:22:54.027637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:27.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764606+0000","last_change":"2024-09-21T07:22:48.738259+0000","last_active":"2024-09-21T07:22:53.764606+0000","last_peered":"2024-09-21T07:22:53.764606+0000","last_clean":"2024-09-21T07:22:53.764606+0000","last_became_active":"2024-09-21T07:22:48.737926+0000","last_became_peered":"2024-09-21T07:22:48.737926+0000","last_unstale":"2024-09-21T07:22:53.764606+0000","last_undegraded":"2024-09-21T07:22:53.764606+0000","last_fullsized":"2024-09-21T07:22:53.764606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:55.324437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766223+0000","last_change":"2024-09-21T07:22:47.719687+0000","last_active":"2024-09-21T07:22:53.766223+0000","last_peered":"2024-09-21T07:22:53.766223+0000","last_clean":"2024-09-21T07:22:53.766223+0000","last_became_active":"2024-09-21T07:22:47.719298+0000","last_became_peered":"2024-09-21T07:22:47.719298+0000","last_unstale":"2024-09-21T07:22:53.766223+0000","last_undegraded":"2024-09-21T07:22:53.766223+0000","last_fullsized":"2024-09-21T07:22:53.766223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:44.103579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892817+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:22:53.892817+0000","last_peered":"2024-09-21T07:22:53.892817+0000","last_clean":"2024-09-21T07:22:53.892817+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:22:53.892817+0000","last_undegraded":"2024-09-21T07:22:53.892817+0000","last_fullsized":"2024-09-21T07:22:53.892817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767042+0000","last_change":"2024-09-21T07:22:53.066672+0000","last_active":"2024-09-21T07:22:53.767042+0000","last_peered":"2024-09-21T07:22:53.767042+0000","last_clean":"2024-09-21T07:22:53.767042+0000","last_became_active":"2024-09-21T07:22:53.066192+0000","last_became_peered":"2024-09-21T07:22:53.066192+0000","last_unstale":"2024-09-21T07:22:53.767042+0000","last_undegraded":"2024-09-21T07:22:53.767042+0000","last_fullsized":"2024-09-21T07:22:53.767042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.796201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893182+0000","last_change":"2024-09-21T07:22:48.734582+0000","last_active":"2024-09-21T07:22:53.893182+0000","last_peered":"2024-09-21T07:22:53.893182+0000","last_clean":"2024-09-21T07:22:53.893182+0000","last_became_active":"2024-09-21T07:22:48.734240+0000","last_became_peered":"2024-09-21T07:22:48.734240+0000","last_unstale":"2024-09-21T07:22:53.893182+0000","last_undegraded":"2024-09-21T07:22:53.893182+0000","last_fullsized":"2024-09-21T07:22:53.893182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:09.879302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025524+0000","last_change":"2024-09-21T07:22:47.733880+0000","last_active":"2024-09-21T07:22:54.025524+0000","last_peered":"2024-09-21T07:22:54.025524+0000","last_clean":"2024-09-21T07:22:54.025524+0000","last_became_active":"2024-09-21T07:22:47.733393+0000","last_became_peered":"2024-09-21T07:22:47.733393+0000","last_unstale":"2024-09-21T07:22:54.025524+0000","last_undegraded":"2024-09-21T07:22:54.025524+0000","last_fullsized":"2024-09-21T07:22:54.025524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766698+0000","last_change":"2024-09-21T07:22:53.063609+0000","last_active":"2024-09-21T07:22:53.766698+0000","last_peered":"2024-09-21T07:22:53.766698+0000","last_clean":"2024-09-21T07:22:53.766698+0000","last_became_active":"2024-09-21T07:22:53.062759+0000","last_became_peered":"2024-09-21T07:22:53.062759+0000","last_unstale":"2024-09-21T07:22:53.766698+0000","last_undegraded":"2024-09-21T07:22:53.766698+0000","last_fullsized":"2024-09-21T07:22:53.766698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:30.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766569+0000","last_change":"2024-09-21T07:22:48.749460+0000","last_active":"2024-09-21T07:22:53.766569+0000","last_peered":"2024-09-21T07:22:53.766569+0000","last_clean":"2024-09-21T07:22:53.766569+0000","last_became_active":"2024-09-21T07:22:48.748693+0000","last_became_peered":"2024-09-21T07:22:48.748693+0000","last_unstale":"2024-09-21T07:22:53.766569+0000","last_undegraded":"2024-09-21T07:22:53.766569+0000","last_fullsized":"2024-09-21T07:22:53.766569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.090779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025285+0000","last_change":"2024-09-21T07:22:47.733842+0000","last_active":"2024-09-21T07:22:54.025285+0000","last_peered":"2024-09-21T07:22:54.025285+0000","last_clean":"2024-09-21T07:22:54.025285+0000","last_became_active":"2024-09-21T07:22:47.733469+0000","last_became_peered":"2024-09-21T07:22:47.733469+0000","last_unstale":"2024-09-21T07:22:54.025285+0000","last_undegraded":"2024-09-21T07:22:54.025285+0000","last_fullsized":"2024-09-21T07:22:54.025285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:51.768208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026922+0000","last_change":"2024-09-21T07:22:52.788401+0000","last_active":"2024-09-21T07:22:54.026922+0000","last_peered":"2024-09-21T07:22:54.026922+0000","last_clean":"2024-09-21T07:22:54.026922+0000","last_became_active":"2024-09-21T07:22:52.787726+0000","last_became_peered":"2024-09-21T07:22:52.787726+0000","last_unstale":"2024-09-21T07:22:54.026922+0000","last_undegraded":"2024-09-21T07:22:54.026922+0000","last_fullsized":"2024-09-21T07:22:54.026922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:50.336899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893535+0000","last_change":"2024-09-21T07:22:48.741294+0000","last_active":"2024-09-21T07:22:53.893535+0000","last_peered":"2024-09-21T07:22:53.893535+0000","last_clean":"2024-09-21T07:22:53.893535+0000","last_became_active":"2024-09-21T07:22:48.739470+0000","last_became_peered":"2024-09-21T07:22:48.739470+0000","last_unstale":"2024-09-21T07:22:53.893535+0000","last_undegraded":"2024-09-21T07:22:53.893535+0000","last_fullsized":"2024-09-21T07:22:53.893535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:45.572840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026041+0000","last_change":"2024-09-21T07:22:47.712265+0000","last_active":"2024-09-21T07:22:54.026041+0000","last_peered":"2024-09-21T07:22:54.026041+0000","last_clean":"2024-09-21T07:22:54.026041+0000","last_became_active":"2024-09-21T07:22:47.711366+0000","last_became_peered":"2024-09-21T07:22:47.711366+0000","last_unstale":"2024-09-21T07:22:54.026041+0000","last_undegraded":"2024-09-21T07:22:54.026041+0000","last_fullsized":"2024-09-21T07:22:54.026041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765294+0000","last_change":"2024-09-21T07:22:53.064301+0000","last_active":"2024-09-21T07:22:53.765294+0000","last_peered":"2024-09-21T07:22:53.765294+0000","last_clean":"2024-09-21T07:22:53.765294+0000","last_became_active":"2024-09-21T07:22:53.062833+0000","last_became_peered":"2024-09-21T07:22:53.062833+0000","last_unstale":"2024-09-21T07:22:53.765294+0000","last_undegraded":"2024-09-21T07:22:53.765294+0000","last_fullsized":"2024-09-21T07:22:53.765294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:27.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893385+0000","last_change":"2024-09-21T07:22:48.739480+0000","last_active":"2024-09-21T07:22:53.893385+0000","last_peered":"2024-09-21T07:22:53.893385+0000","last_clean":"2024-09-21T07:22:53.893385+0000","last_became_active":"2024-09-21T07:22:48.735630+0000","last_became_peered":"2024-09-21T07:22:48.735630+0000","last_unstale":"2024-09-21T07:22:53.893385+0000","last_undegraded":"2024-09-21T07:22:53.893385+0000","last_fullsized":"2024-09-21T07:22:53.893385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:46.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025673+0000","last_change":"2024-09-21T07:22:47.730814+0000","last_active":"2024-09-21T07:22:54.025673+0000","last_peered":"2024-09-21T07:22:54.025673+0000","last_clean":"2024-09-21T07:22:54.025673+0000","last_became_active":"2024-09-21T07:22:47.730342+0000","last_became_peered":"2024-09-21T07:22:47.730342+0000","last_unstale":"2024-09-21T07:22:54.025673+0000","last_undegraded":"2024-09-21T07:22:54.025673+0000","last_fullsized":"2024-09-21T07:22:54.025673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024615+0000","last_change":"2024-09-21T07:22:52.784700+0000","last_active":"2024-09-21T07:22:54.024615+0000","last_peered":"2024-09-21T07:22:54.024615+0000","last_clean":"2024-09-21T07:22:54.024615+0000","last_became_active":"2024-09-21T07:22:52.784177+0000","last_became_peered":"2024-09-21T07:22:52.784177+0000","last_unstale":"2024-09-21T07:22:54.024615+0000","last_undegraded":"2024-09-21T07:22:54.024615+0000","last_fullsized":"2024-09-21T07:22:54.024615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.035862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740423+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.739493+0000","last_became_peered":"2024-09-21T07:22:48.739493+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024092+0000","last_change":"2024-09-21T07:22:47.726109+0000","last_active":"2024-09-21T07:22:54.024092+0000","last_peered":"2024-09-21T07:22:54.024092+0000","last_clean":"2024-09-21T07:22:54.024092+0000","last_became_active":"2024-09-21T07:22:47.725696+0000","last_became_peered":"2024-09-21T07:22:47.725696+0000","last_unstale":"2024-09-21T07:22:54.024092+0000","last_undegraded":"2024-09-21T07:22:54.024092+0000","last_fullsized":"2024-09-21T07:22:54.024092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027353+0000","last_change":"2024-09-21T07:22:52.781696+0000","last_active":"2024-09-21T07:22:54.027353+0000","last_peered":"2024-09-21T07:22:54.027353+0000","last_clean":"2024-09-21T07:22:54.027353+0000","last_became_active":"2024-09-21T07:22:52.781211+0000","last_became_peered":"2024-09-21T07:22:52.781211+0000","last_unstale":"2024-09-21T07:22:54.027353+0000","last_undegraded":"2024-09-21T07:22:54.027353+0000","last_fullsized":"2024-09-21T07:22:54.027353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:51.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765137+0000","last_change":"2024-09-21T07:22:48.746169+0000","last_active":"2024-09-21T07:22:53.765137+0000","last_peered":"2024-09-21T07:22:53.765137+0000","last_clean":"2024-09-21T07:22:53.765137+0000","last_became_active":"2024-09-21T07:22:48.745804+0000","last_became_peered":"2024-09-21T07:22:48.745804+0000","last_unstale":"2024-09-21T07:22:53.765137+0000","last_undegraded":"2024-09-21T07:22:53.765137+0000","last_fullsized":"2024-09-21T07:22:53.765137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766637+0000","last_change":"2024-09-21T07:22:47.723745+0000","last_active":"2024-09-21T07:22:53.766637+0000","last_peered":"2024-09-21T07:22:53.766637+0000","last_clean":"2024-09-21T07:22:53.766637+0000","last_became_active":"2024-09-21T07:22:47.723299+0000","last_became_peered":"2024-09-21T07:22:47.723299+0000","last_unstale":"2024-09-21T07:22:53.766637+0000","last_undegraded":"2024-09-21T07:22:53.766637+0000","last_fullsized":"2024-09-21T07:22:53.766637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:13.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764852+0000","last_change":"2024-09-21T07:22:53.067494+0000","last_active":"2024-09-21T07:22:53.764852+0000","last_peered":"2024-09-21T07:22:53.764852+0000","last_clean":"2024-09-21T07:22:53.764852+0000","last_became_active":"2024-09-21T07:22:53.066168+0000","last_became_peered":"2024-09-21T07:22:53.066168+0000","last_unstale":"2024-09-21T07:22:53.764852+0000","last_undegraded":"2024-09-21T07:22:53.764852+0000","last_fullsized":"2024-09-21T07:22:53.764852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893181+0000","last_change":"2024-09-21T07:22:48.740397+0000","last_active":"2024-09-21T07:22:53.893181+0000","last_peered":"2024-09-21T07:22:53.893181+0000","last_clean":"2024-09-21T07:22:53.893181+0000","last_became_active":"2024-09-21T07:22:48.736271+0000","last_became_peered":"2024-09-21T07:22:48.736271+0000","last_unstale":"2024-09-21T07:22:53.893181+0000","last_undegraded":"2024-09-21T07:22:53.893181+0000","last_fullsized":"2024-09-21T07:22:53.893181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:50.369048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765981+0000","last_change":"2024-09-21T07:22:47.742213+0000","last_active":"2024-09-21T07:22:53.765981+0000","last_peered":"2024-09-21T07:22:53.765981+0000","last_clean":"2024-09-21T07:22:53.765981+0000","last_became_active":"2024-09-21T07:22:47.741132+0000","last_became_peered":"2024-09-21T07:22:47.741132+0000","last_unstale":"2024-09-21T07:22:53.765981+0000","last_undegraded":"2024-09-21T07:22:53.765981+0000","last_fullsized":"2024-09-21T07:22:53.765981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:09.749747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765129+0000","last_change":"2024-09-21T07:22:53.066418+0000","last_active":"2024-09-21T07:22:53.765129+0000","last_peered":"2024-09-21T07:22:53.765129+0000","last_clean":"2024-09-21T07:22:53.765129+0000","last_became_active":"2024-09-21T07:22:53.065948+0000","last_became_peered":"2024-09-21T07:22:53.065948+0000","last_unstale":"2024-09-21T07:22:53.765129+0000","last_undegraded":"2024-09-21T07:22:53.765129+0000","last_fullsized":"2024-09-21T07:22:53.765129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:44.474322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026570+0000","last_change":"2024-09-21T07:22:48.737346+0000","last_active":"2024-09-21T07:22:54.026570+0000","last_peered":"2024-09-21T07:22:54.026570+0000","last_clean":"2024-09-21T07:22:54.026570+0000","last_became_active":"2024-09-21T07:22:48.736875+0000","last_became_peered":"2024-09-21T07:22:48.736875+0000","last_unstale":"2024-09-21T07:22:54.026570+0000","last_undegraded":"2024-09-21T07:22:54.026570+0000","last_fullsized":"2024-09-21T07:22:54.026570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:22.528204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027111+0000","last_change":"2024-09-21T07:22:47.730642+0000","last_active":"2024-09-21T07:22:54.027111+0000","last_peered":"2024-09-21T07:22:54.027111+0000","last_clean":"2024-09-21T07:22:54.027111+0000","last_became_active":"2024-09-21T07:22:47.730256+0000","last_became_peered":"2024-09-21T07:22:47.730256+0000","last_unstale":"2024-09-21T07:22:54.027111+0000","last_undegraded":"2024-09-21T07:22:54.027111+0000","last_fullsized":"2024-09-21T07:22:54.027111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:09.284199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766769+0000","last_change":"2024-09-21T07:22:53.067757+0000","last_active":"2024-09-21T07:22:53.766769+0000","last_peered":"2024-09-21T07:22:53.766769+0000","last_clean":"2024-09-21T07:22:53.766769+0000","last_became_active":"2024-09-21T07:22:53.067310+0000","last_became_peered":"2024-09-21T07:22:53.067310+0000","last_unstale":"2024-09-21T07:22:53.766769+0000","last_undegraded":"2024-09-21T07:22:53.766769+0000","last_fullsized":"2024-09-21T07:22:53.766769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:51.644247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893021+0000","last_change":"2024-09-21T07:22:48.748135+0000","last_active":"2024-09-21T07:22:53.893021+0000","last_peered":"2024-09-21T07:22:53.893021+0000","last_clean":"2024-09-21T07:22:53.893021+0000","last_became_active":"2024-09-21T07:22:48.747791+0000","last_became_peered":"2024-09-21T07:22:48.747791+0000","last_unstale":"2024-09-21T07:22:53.893021+0000","last_undegraded":"2024-09-21T07:22:53.893021+0000","last_fullsized":"2024-09-21T07:22:53.893021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:50.042620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:23:00.072821+0000","last_change":"2024-09-21T07:22:47.731720+0000","last_active":"2024-09-21T07:23:00.072821+0000","last_peered":"2024-09-21T07:23:00.072821+0000","last_clean":"2024-09-21T07:23:00.072821+0000","last_became_active":"2024-09-21T07:22:47.731257+0000","last_became_peered":"2024-09-21T07:22:47.731257+0000","last_unstale":"2024-09-21T07:23:00.072821+0000","last_undegraded":"2024-09-21T07:23:00.072821+0000","last_fullsized":"2024-09-21T07:23:00.072821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:39.740094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025005+0000","last_change":"2024-09-21T07:22:52.777427+0000","last_active":"2024-09-21T07:22:54.025005+0000","last_peered":"2024-09-21T07:22:54.025005+0000","last_clean":"2024-09-21T07:22:54.025005+0000","last_became_active":"2024-09-21T07:22:52.776894+0000","last_became_peered":"2024-09-21T07:22:52.776894+0000","last_unstale":"2024-09-21T07:22:54.025005+0000","last_undegraded":"2024-09-21T07:22:54.025005+0000","last_fullsized":"2024-09-21T07:22:54.025005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:10.994515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025528+0000","last_change":"2024-09-21T07:22:48.751759+0000","last_active":"2024-09-21T07:22:54.025528+0000","last_peered":"2024-09-21T07:22:54.025528+0000","last_clean":"2024-09-21T07:22:54.025528+0000","last_became_active":"2024-09-21T07:22:48.751434+0000","last_became_peered":"2024-09-21T07:22:48.751434+0000","last_unstale":"2024-09-21T07:22:54.025528+0000","last_undegraded":"2024-09-21T07:22:54.025528+0000","last_fullsized":"2024-09-21T07:22:54.025528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025150+0000","last_change":"2024-09-21T07:22:47.724152+0000","last_active":"2024-09-21T07:22:54.025150+0000","last_peered":"2024-09-21T07:22:54.025150+0000","last_clean":"2024-09-21T07:22:54.025150+0000","last_became_active":"2024-09-21T07:22:47.723668+0000","last_became_peered":"2024-09-21T07:22:47.723668+0000","last_unstale":"2024-09-21T07:22:54.025150+0000","last_undegraded":"2024-09-21T07:22:54.025150+0000","last_fullsized":"2024-09-21T07:22:54.025150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:38.422165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025008+0000","last_change":"2024-09-21T07:22:52.790871+0000","last_active":"2024-09-21T07:22:54.025008+0000","last_peered":"2024-09-21T07:22:54.025008+0000","last_clean":"2024-09-21T07:22:54.025008+0000","last_became_active":"2024-09-21T07:22:52.790349+0000","last_became_peered":"2024-09-21T07:22:52.790349+0000","last_unstale":"2024-09-21T07:22:54.025008+0000","last_undegraded":"2024-09-21T07:22:54.025008+0000","last_fullsized":"2024-09-21T07:22:54.025008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:08.100330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027512+0000","last_change":"2024-09-21T07:22:48.749463+0000","last_active":"2024-09-21T07:22:54.027512+0000","last_peered":"2024-09-21T07:22:54.027512+0000","last_clean":"2024-09-21T07:22:54.027512+0000","last_became_active":"2024-09-21T07:22:48.747781+0000","last_became_peered":"2024-09-21T07:22:48.747781+0000","last_unstale":"2024-09-21T07:22:54.027512+0000","last_undegraded":"2024-09-21T07:22:54.027512+0000","last_fullsized":"2024-09-21T07:22:54.027512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767422+0000","last_change":"2024-09-21T07:22:47.737032+0000","last_active":"2024-09-21T07:22:53.767422+0000","last_peered":"2024-09-21T07:22:53.767422+0000","last_clean":"2024-09-21T07:22:53.767422+0000","last_became_active":"2024-09-21T07:22:47.736616+0000","last_became_peered":"2024-09-21T07:22:47.736616+0000","last_unstale":"2024-09-21T07:22:53.767422+0000","last_undegraded":"2024-09-21T07:22:53.767422+0000","last_fullsized":"2024-09-21T07:22:53.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:53.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764281+0000","last_change":"2024-09-21T07:22:52.774334+0000","last_active":"2024-09-21T07:22:53.764281+0000","last_peered":"2024-09-21T07:22:53.764281+0000","last_clean":"2024-09-21T07:22:53.764281+0000","last_became_active":"2024-09-21T07:22:52.773910+0000","last_became_peered":"2024-09-21T07:22:52.773910+0000","last_unstale":"2024-09-21T07:22:53.764281+0000","last_undegraded":"2024-09-21T07:22:53.764281+0000","last_fullsized":"2024-09-21T07:22:53.764281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:08.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767415+0000","last_change":"2024-09-21T07:22:48.751082+0000","last_active":"2024-09-21T07:22:53.767415+0000","last_peered":"2024-09-21T07:22:53.767415+0000","last_clean":"2024-09-21T07:22:53.767415+0000","last_became_active":"2024-09-21T07:22:48.750721+0000","last_became_peered":"2024-09-21T07:22:48.750721+0000","last_unstale":"2024-09-21T07:22:53.767415+0000","last_undegraded":"2024-09-21T07:22:53.767415+0000","last_fullsized":"2024-09-21T07:22:53.767415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:46.294144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767956+0000","last_change":"2024-09-21T07:22:47.732653+0000","last_active":"2024-09-21T07:22:53.767956+0000","last_peered":"2024-09-21T07:22:53.767956+0000","last_clean":"2024-09-21T07:22:53.767956+0000","last_became_active":"2024-09-21T07:22:47.731145+0000","last_became_peered":"2024-09-21T07:22:47.731145+0000","last_unstale":"2024-09-21T07:22:53.767956+0000","last_undegraded":"2024-09-21T07:22:53.767956+0000","last_fullsized":"2024-09-21T07:22:53.767956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:41.980995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764072+0000","last_change":"2024-09-21T07:22:53.068578+0000","last_active":"2024-09-21T07:22:53.764072+0000","last_peered":"2024-09-21T07:22:53.764072+0000","last_clean":"2024-09-21T07:22:53.764072+0000","last_became_active":"2024-09-21T07:22:53.068094+0000","last_became_peered":"2024-09-21T07:22:53.068094+0000","last_unstale":"2024-09-21T07:22:53.764072+0000","last_undegraded":"2024-09-21T07:22:53.764072+0000","last_fullsized":"2024-09-21T07:22:53.764072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:48.304004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027350+0000","last_change":"2024-09-21T07:22:53.067719+0000","last_active":"2024-09-21T07:22:54.027350+0000","last_peered":"2024-09-21T07:22:54.027350+0000","last_clean":"2024-09-21T07:22:54.027350+0000","last_became_active":"2024-09-21T07:22:53.066586+0000","last_became_peered":"2024-09-21T07:22:53.066586+0000","last_unstale":"2024-09-21T07:22:54.027350+0000","last_undegraded":"2024-09-21T07:22:54.027350+0000","last_fullsized":"2024-09-21T07:22:54.027350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:08.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024581+0000","last_change":"2024-09-21T07:22:48.721331+0000","last_active":"2024-09-21T07:22:54.024581+0000","last_peered":"2024-09-21T07:22:54.024581+0000","last_clean":"2024-09-21T07:22:54.024581+0000","last_became_active":"2024-09-21T07:22:48.721004+0000","last_became_peered":"2024-09-21T07:22:48.721004+0000","last_unstale":"2024-09-21T07:22:54.024581+0000","last_undegraded":"2024-09-21T07:22:54.024581+0000","last_fullsized":"2024-09-21T07:22:54.024581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.830129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765811+0000","last_change":"2024-09-21T07:22:47.725525+0000","last_active":"2024-09-21T07:22:53.765811+0000","last_peered":"2024-09-21T07:22:53.765811+0000","last_clean":"2024-09-21T07:22:53.765811+0000","last_became_active":"2024-09-21T07:22:47.724955+0000","last_became_peered":"2024-09-21T07:22:47.724955+0000","last_unstale":"2024-09-21T07:22:53.765811+0000","last_undegraded":"2024-09-21T07:22:53.765811+0000","last_fullsized":"2024-09-21T07:22:53.765811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:57.216986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767880+0000","last_change":"2024-09-21T07:22:52.775953+0000","last_active":"2024-09-21T07:22:53.767880+0000","last_peered":"2024-09-21T07:22:53.767880+0000","last_clean":"2024-09-21T07:22:53.767880+0000","last_became_active":"2024-09-21T07:22:52.775495+0000","last_became_peered":"2024-09-21T07:22:52.775495+0000","last_unstale":"2024-09-21T07:22:53.767880+0000","last_undegraded":"2024-09-21T07:22:53.767880+0000","last_fullsized":"2024-09-21T07:22:53.767880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:06.018758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763992+0000","last_change":"2024-09-21T07:22:48.753975+0000","last_active":"2024-09-21T07:22:53.763992+0000","last_peered":"2024-09-21T07:22:53.763992+0000","last_clean":"2024-09-21T07:22:53.763992+0000","last_became_active":"2024-09-21T07:22:48.753724+0000","last_became_peered":"2024-09-21T07:22:48.753724+0000","last_unstale":"2024-09-21T07:22:53.763992+0000","last_undegraded":"2024-09-21T07:22:53.763992+0000","last_fullsized":"2024-09-21T07:22:53.763992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:22.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764342+0000","last_change":"2024-09-21T07:22:47.730250+0000","last_active":"2024-09-21T07:22:53.764342+0000","last_peered":"2024-09-21T07:22:53.764342+0000","last_clean":"2024-09-21T07:22:53.764342+0000","last_became_active":"2024-09-21T07:22:47.729848+0000","last_became_peered":"2024-09-21T07:22:47.729848+0000","last_unstale":"2024-09-21T07:22:53.764342+0000","last_undegraded":"2024-09-21T07:22:53.764342+0000","last_fullsized":"2024-09-21T07:22:53.764342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:55.323370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767164+0000","last_change":"2024-09-21T07:22:47.725746+0000","last_active":"2024-09-21T07:22:53.767164+0000","last_peered":"2024-09-21T07:22:53.767164+0000","last_clean":"2024-09-21T07:22:53.767164+0000","last_became_active":"2024-09-21T07:22:47.725422+0000","last_became_peered":"2024-09-21T07:22:47.725422+0000","last_unstale":"2024-09-21T07:22:53.767164+0000","last_undegraded":"2024-09-21T07:22:53.767164+0000","last_fullsized":"2024-09-21T07:22:53.767164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:00.603887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027060+0000","last_change":"2024-09-21T07:22:48.744596+0000","last_active":"2024-09-21T07:22:54.027060+0000","last_peered":"2024-09-21T07:22:54.027060+0000","last_clean":"2024-09-21T07:22:54.027060+0000","last_became_active":"2024-09-21T07:22:48.744299+0000","last_became_peered":"2024-09-21T07:22:48.744299+0000","last_unstale":"2024-09-21T07:22:54.027060+0000","last_undegraded":"2024-09-21T07:22:54.027060+0000","last_fullsized":"2024-09-21T07:22:54.027060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024935+0000","last_change":"2024-09-21T07:22:52.787834+0000","last_active":"2024-09-21T07:22:54.024935+0000","last_peered":"2024-09-21T07:22:54.024935+0000","last_clean":"2024-09-21T07:22:54.024935+0000","last_became_active":"2024-09-21T07:22:52.786824+0000","last_became_peered":"2024-09-21T07:22:52.786824+0000","last_unstale":"2024-09-21T07:22:54.024935+0000","last_undegraded":"2024-09-21T07:22:54.024935+0000","last_fullsized":"2024-09-21T07:22:54.024935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:57.435599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764323+0000","last_change":"2024-09-21T07:22:47.741714+0000","last_active":"2024-09-21T07:22:53.764323+0000","last_peered":"2024-09-21T07:22:53.764323+0000","last_clean":"2024-09-21T07:22:53.764323+0000","last_became_active":"2024-09-21T07:22:47.741389+0000","last_became_peered":"2024-09-21T07:22:47.741389+0000","last_unstale":"2024-09-21T07:22:53.764323+0000","last_undegraded":"2024-09-21T07:22:53.764323+0000","last_fullsized":"2024-09-21T07:22:53.764323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:46.689980+0000","last_clean_scrub_stamp":"2024-09-21T07:22:46.689980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:45.062537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025167+0000","last_change":"2024-09-21T07:22:48.734053+0000","last_active":"2024-09-21T07:22:54.025167+0000","last_peered":"2024-09-21T07:22:54.025167+0000","last_clean":"2024-09-21T07:22:54.025167+0000","last_became_active":"2024-09-21T07:22:48.733585+0000","last_became_peered":"2024-09-21T07:22:48.733585+0000","last_unstale":"2024-09-21T07:22:54.025167+0000","last_undegraded":"2024-09-21T07:22:54.025167+0000","last_fullsized":"2024-09-21T07:22:54.025167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:42.987988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764844+0000","last_change":"2024-09-21T07:22:52.783230+0000","last_active":"2024-09-21T07:22:53.764844+0000","last_peered":"2024-09-21T07:22:53.764844+0000","last_clean":"2024-09-21T07:22:53.764844+0000","last_became_active":"2024-09-21T07:22:52.782669+0000","last_became_peered":"2024-09-21T07:22:52.782669+0000","last_unstale":"2024-09-21T07:22:53.764844+0000","last_undegraded":"2024-09-21T07:22:53.764844+0000","last_fullsized":"2024-09-21T07:22:53.764844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:51.739728+0000","last_clean_scrub_stamp":"2024-09-21T07:22:51.739728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:10.593769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764996+0000","last_change":"2024-09-21T07:22:48.746272+0000","last_active":"2024-09-21T07:22:53.764996+0000","last_peered":"2024-09-21T07:22:53.764996+0000","last_clean":"2024-09-21T07:22:53.764996+0000","last_became_active":"2024-09-21T07:22:48.745859+0000","last_became_peered":"2024-09-21T07:22:48.745859+0000","last_unstale":"2024-09-21T07:22:53.764996+0000","last_undegraded":"2024-09-21T07:22:53.764996+0000","last_fullsized":"2024-09-21T07:22:53.764996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024230+0000","last_change":"2024-09-21T07:22:48.735624+0000","last_active":"2024-09-21T07:22:54.024230+0000","last_peered":"2024-09-21T07:22:54.024230+0000","last_clean":"2024-09-21T07:22:54.024230+0000","last_became_active":"2024-09-21T07:22:48.735299+0000","last_became_peered":"2024-09-21T07:22:48.735299+0000","last_unstale":"2024-09-21T07:22:54.024230+0000","last_undegraded":"2024-09-21T07:22:54.024230+0000","last_fullsized":"2024-09-21T07:22:54.024230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765809+0000","last_change":"2024-09-21T07:22:48.754562+0000","last_active":"2024-09-21T07:22:53.765809+0000","last_peered":"2024-09-21T07:22:53.765809+0000","last_clean":"2024-09-21T07:22:53.765809+0000","last_became_active":"2024-09-21T07:22:48.753457+0000","last_became_peered":"2024-09-21T07:22:48.753457+0000","last_unstale":"2024-09-21T07:22:53.765809+0000","last_undegraded":"2024-09-21T07:22:53.765809+0000","last_fullsized":"2024-09-21T07:22:53.765809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:41.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027009+0000","last_change":"2024-09-21T07:22:48.751689+0000","last_active":"2024-09-21T07:22:54.027009+0000","last_peered":"2024-09-21T07:22:54.027009+0000","last_clean":"2024-09-21T07:22:54.027009+0000","last_became_active":"2024-09-21T07:22:48.751361+0000","last_became_peered":"2024-09-21T07:22:48.751361+0000","last_unstale":"2024-09-21T07:22:54.027009+0000","last_undegraded":"2024-09-21T07:22:54.027009+0000","last_fullsized":"2024-09-21T07:22:54.027009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:22.995656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764765+0000","last_change":"2024-09-21T07:22:48.759019+0000","last_active":"2024-09-21T07:22:53.764765+0000","last_peered":"2024-09-21T07:22:53.764765+0000","last_clean":"2024-09-21T07:22:53.764765+0000","last_became_active":"2024-09-21T07:22:48.758694+0000","last_became_peered":"2024-09-21T07:22:48.758694+0000","last_unstale":"2024-09-21T07:22:53.764765+0000","last_undegraded":"2024-09-21T07:22:53.764765+0000","last_fullsized":"2024-09-21T07:22:53.764765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:57.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024926+0000","last_change":"2024-09-21T07:22:48.723104+0000","last_active":"2024-09-21T07:22:54.024926+0000","last_peered":"2024-09-21T07:22:54.024926+0000","last_clean":"2024-09-21T07:22:54.024926+0000","last_became_active":"2024-09-21T07:22:48.722764+0000","last_became_peered":"2024-09-21T07:22:48.722764+0000","last_unstale":"2024-09-21T07:22:54.024926+0000","last_undegraded":"2024-09-21T07:22:54.024926+0000","last_fullsized":"2024-09-21T07:22:54.024926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:01.478325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767699+0000","last_change":"2024-09-21T07:22:48.742610+0000","last_active":"2024-09-21T07:22:53.767699+0000","last_peered":"2024-09-21T07:22:53.767699+0000","last_clean":"2024-09-21T07:22:53.767699+0000","last_became_active":"2024-09-21T07:22:48.737384+0000","last_became_peered":"2024-09-21T07:22:48.737384+0000","last_unstale":"2024-09-21T07:22:53.767699+0000","last_undegraded":"2024-09-21T07:22:53.767699+0000","last_fullsized":"2024-09-21T07:22:53.767699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764922+0000","last_change":"2024-09-21T07:22:48.738148+0000","last_active":"2024-09-21T07:22:53.764922+0000","last_peered":"2024-09-21T07:22:53.764922+0000","last_clean":"2024-09-21T07:22:53.764922+0000","last_became_active":"2024-09-21T07:22:48.737843+0000","last_became_peered":"2024-09-21T07:22:48.737843+0000","last_unstale":"2024-09-21T07:22:53.764922+0000","last_undegraded":"2024-09-21T07:22:53.764922+0000","last_fullsized":"2024-09-21T07:22:53.764922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:17.737322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765676+0000","last_change":"2024-09-21T07:22:48.740105+0000","last_active":"2024-09-21T07:22:53.765676+0000","last_peered":"2024-09-21T07:22:53.765676+0000","last_clean":"2024-09-21T07:22:53.765676+0000","last_became_active":"2024-09-21T07:22:48.739816+0000","last_became_peered":"2024-09-21T07:22:48.739816+0000","last_unstale":"2024-09-21T07:22:53.765676+0000","last_undegraded":"2024-09-21T07:22:53.765676+0000","last_fullsized":"2024-09-21T07:22:53.765676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:24.406686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764141+0000","last_change":"2024-09-21T07:22:48.741924+0000","last_active":"2024-09-21T07:22:53.764141+0000","last_peered":"2024-09-21T07:22:53.764141+0000","last_clean":"2024-09-21T07:22:53.764141+0000","last_became_active":"2024-09-21T07:22:48.741567+0000","last_became_peered":"2024-09-21T07:22:48.741567+0000","last_unstale":"2024-09-21T07:22:53.764141+0000","last_undegraded":"2024-09-21T07:22:53.764141+0000","last_fullsized":"2024-09-21T07:22:53.764141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:33.518751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765851+0000","last_change":"2024-09-21T07:22:48.729429+0000","last_active":"2024-09-21T07:22:53.765851+0000","last_peered":"2024-09-21T07:22:53.765851+0000","last_clean":"2024-09-21T07:22:53.765851+0000","last_became_active":"2024-09-21T07:22:48.729115+0000","last_became_peered":"2024-09-21T07:22:48.729115+0000","last_unstale":"2024-09-21T07:22:53.765851+0000","last_undegraded":"2024-09-21T07:22:53.765851+0000","last_fullsized":"2024-09-21T07:22:53.765851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:45.792793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026833+0000","last_change":"2024-09-21T07:22:48.739366+0000","last_active":"2024-09-21T07:22:54.026833+0000","last_peered":"2024-09-21T07:22:54.026833+0000","last_clean":"2024-09-21T07:22:54.026833+0000","last_became_active":"2024-09-21T07:22:48.738848+0000","last_became_peered":"2024-09-21T07:22:48.738848+0000","last_unstale":"2024-09-21T07:22:54.026833+0000","last_undegraded":"2024-09-21T07:22:54.026833+0000","last_fullsized":"2024-09-21T07:22:54.026833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:49.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742010+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.741123+0000","last_became_peered":"2024-09-21T07:22:48.741123+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893554+0000","last_change":"2024-09-21T07:22:48.733725+0000","last_active":"2024-09-21T07:22:53.893554+0000","last_peered":"2024-09-21T07:22:53.893554+0000","last_clean":"2024-09-21T07:22:53.893554+0000","last_became_active":"2024-09-21T07:22:48.733408+0000","last_became_peered":"2024-09-21T07:22:48.733408+0000","last_unstale":"2024-09-21T07:22:53.893554+0000","last_undegraded":"2024-09-21T07:22:53.893554+0000","last_fullsized":"2024-09-21T07:22:53.893554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:56.573091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025995+0000","last_change":"2024-09-21T07:22:48.733307+0000","last_active":"2024-09-21T07:22:54.025995+0000","last_peered":"2024-09-21T07:22:54.025995+0000","last_clean":"2024-09-21T07:22:54.025995+0000","last_became_active":"2024-09-21T07:22:48.732920+0000","last_became_peered":"2024-09-21T07:22:48.732920+0000","last_unstale":"2024-09-21T07:22:54.025995+0000","last_undegraded":"2024-09-21T07:22:54.025995+0000","last_fullsized":"2024-09-21T07:22:54.025995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:32.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.733360+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.733032+0000","last_became_peered":"2024-09-21T07:22:48.733032+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:34.232644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765534+0000","last_change":"2024-09-21T07:22:48.746150+0000","last_active":"2024-09-21T07:22:53.765534+0000","last_peered":"2024-09-21T07:22:53.765534+0000","last_clean":"2024-09-21T07:22:53.765534+0000","last_became_active":"2024-09-21T07:22:48.745814+0000","last_became_peered":"2024-09-21T07:22:48.745814+0000","last_unstale":"2024-09-21T07:22:53.765534+0000","last_undegraded":"2024-09-21T07:22:53.765534+0000","last_fullsized":"2024-09-21T07:22:53.765534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.024701+0000","last_change":"2024-09-21T07:22:48.739733+0000","last_active":"2024-09-21T07:22:54.024701+0000","last_peered":"2024-09-21T07:22:54.024701+0000","last_clean":"2024-09-21T07:22:54.024701+0000","last_became_active":"2024-09-21T07:22:48.739428+0000","last_became_peered":"2024-09-21T07:22:48.739428+0000","last_unstale":"2024-09-21T07:22:54.024701+0000","last_undegraded":"2024-09-21T07:22:54.024701+0000","last_fullsized":"2024-09-21T07:22:54.024701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:08.474202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.026517+0000","last_change":"2024-09-21T07:22:48.737610+0000","last_active":"2024-09-21T07:22:54.026517+0000","last_peered":"2024-09-21T07:22:54.026517+0000","last_clean":"2024-09-21T07:22:54.026517+0000","last_became_active":"2024-09-21T07:22:48.737248+0000","last_became_peered":"2024-09-21T07:22:48.737248+0000","last_unstale":"2024-09-21T07:22:54.026517+0000","last_undegraded":"2024-09-21T07:22:54.026517+0000","last_fullsized":"2024-09-21T07:22:54.026517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:12.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.764170+0000","last_change":"2024-09-21T07:22:48.740790+0000","last_active":"2024-09-21T07:22:53.764170+0000","last_peered":"2024-09-21T07:22:53.764170+0000","last_clean":"2024-09-21T07:22:53.764170+0000","last_became_active":"2024-09-21T07:22:48.740145+0000","last_became_peered":"2024-09-21T07:22:48.740145+0000","last_unstale":"2024-09-21T07:22:53.764170+0000","last_undegraded":"2024-09-21T07:22:53.764170+0000","last_fullsized":"2024-09-21T07:22:53.764170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:31.562981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025501+0000","last_change":"2024-09-21T07:22:48.751370+0000","last_active":"2024-09-21T07:22:54.025501+0000","last_peered":"2024-09-21T07:22:54.025501+0000","last_clean":"2024-09-21T07:22:54.025501+0000","last_became_active":"2024-09-21T07:22:48.746516+0000","last_became_peered":"2024-09-21T07:22:48.746516+0000","last_unstale":"2024-09-21T07:22:54.025501+0000","last_undegraded":"2024-09-21T07:22:54.025501+0000","last_fullsized":"2024-09-21T07:22:54.025501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:26.012815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767168+0000","last_change":"2024-09-21T07:22:48.742862+0000","last_active":"2024-09-21T07:22:53.767168+0000","last_peered":"2024-09-21T07:22:53.767168+0000","last_clean":"2024-09-21T07:22:53.767168+0000","last_became_active":"2024-09-21T07:22:48.736975+0000","last_became_peered":"2024-09-21T07:22:48.736975+0000","last_unstale":"2024-09-21T07:22:53.767168+0000","last_undegraded":"2024-09-21T07:22:53.767168+0000","last_fullsized":"2024-09-21T07:22:53.767168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.767640+0000","last_change":"2024-09-21T07:22:48.732301+0000","last_active":"2024-09-21T07:22:53.767640+0000","last_peered":"2024-09-21T07:22:53.767640+0000","last_clean":"2024-09-21T07:22:53.767640+0000","last_became_active":"2024-09-21T07:22:48.731301+0000","last_became_peered":"2024-09-21T07:22:48.731301+0000","last_unstale":"2024-09-21T07:22:53.767640+0000","last_undegraded":"2024-09-21T07:22:53.767640+0000","last_fullsized":"2024-09-21T07:22:53.767640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:31.000834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893478+0000","last_change":"2024-09-21T07:22:48.736203+0000","last_active":"2024-09-21T07:22:53.893478+0000","last_peered":"2024-09-21T07:22:53.893478+0000","last_clean":"2024-09-21T07:22:53.893478+0000","last_became_active":"2024-09-21T07:22:48.735217+0000","last_became_peered":"2024-09-21T07:22:48.735217+0000","last_unstale":"2024-09-21T07:22:53.893478+0000","last_undegraded":"2024-09-21T07:22:53.893478+0000","last_fullsized":"2024-09-21T07:22:53.893478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:10.751312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.763848+0000","last_change":"2024-09-21T07:22:48.739850+0000","last_active":"2024-09-21T07:22:53.763848+0000","last_peered":"2024-09-21T07:22:53.763848+0000","last_clean":"2024-09-21T07:22:53.763848+0000","last_became_active":"2024-09-21T07:22:48.738820+0000","last_became_peered":"2024-09-21T07:22:48.738820+0000","last_unstale":"2024-09-21T07:22:53.763848+0000","last_undegraded":"2024-09-21T07:22:53.763848+0000","last_fullsized":"2024-09-21T07:22:53.763848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:11.644683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892810+0000","last_change":"2024-09-21T07:22:48.749899+0000","last_active":"2024-09-21T07:22:53.892810+0000","last_peered":"2024-09-21T07:22:53.892810+0000","last_clean":"2024-09-21T07:22:53.892810+0000","last_became_active":"2024-09-21T07:22:48.748269+0000","last_became_peered":"2024-09-21T07:22:48.748269+0000","last_unstale":"2024-09-21T07:22:53.892810+0000","last_undegraded":"2024-09-21T07:22:53.892810+0000","last_fullsized":"2024-09-21T07:22:53.892810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:54.034703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.765685+0000","last_change":"2024-09-21T07:22:48.750088+0000","last_active":"2024-09-21T07:22:53.765685+0000","last_peered":"2024-09-21T07:22:53.765685+0000","last_clean":"2024-09-21T07:22:53.765685+0000","last_became_active":"2024-09-21T07:22:48.749780+0000","last_became_peered":"2024-09-21T07:22:48.749780+0000","last_unstale":"2024-09-21T07:22:53.765685+0000","last_undegraded":"2024-09-21T07:22:53.765685+0000","last_fullsized":"2024-09-21T07:22:53.765685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:23.057892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.892813+0000","last_change":"2024-09-21T07:22:48.741748+0000","last_active":"2024-09-21T07:22:53.892813+0000","last_peered":"2024-09-21T07:22:53.892813+0000","last_clean":"2024-09-21T07:22:53.892813+0000","last_became_active":"2024-09-21T07:22:48.739240+0000","last_became_peered":"2024-09-21T07:22:48.739240+0000","last_unstale":"2024-09-21T07:22:53.892813+0000","last_undegraded":"2024-09-21T07:22:53.892813+0000","last_fullsized":"2024-09-21T07:22:53.892813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:56.733965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.766446+0000","last_change":"2024-09-21T07:22:48.749807+0000","last_active":"2024-09-21T07:22:53.766446+0000","last_peered":"2024-09-21T07:22:53.766446+0000","last_clean":"2024-09-21T07:22:53.766446+0000","last_became_active":"2024-09-21T07:22:48.749133+0000","last_became_peered":"2024-09-21T07:22:48.749133+0000","last_unstale":"2024-09-21T07:22:53.766446+0000","last_undegraded":"2024-09-21T07:22:53.766446+0000","last_fullsized":"2024-09-21T07:22:53.766446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:04.259181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.027319+0000","last_change":"2024-09-21T07:22:48.747149+0000","last_active":"2024-09-21T07:22:54.027319+0000","last_peered":"2024-09-21T07:22:54.027319+0000","last_clean":"2024-09-21T07:22:54.027319+0000","last_became_active":"2024-09-21T07:22:48.745587+0000","last_became_peered":"2024-09-21T07:22:48.745587+0000","last_unstale":"2024-09-21T07:22:54.027319+0000","last_undegraded":"2024-09-21T07:22:54.027319+0000","last_fullsized":"2024-09-21T07:22:54.027319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:33.943013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:54.025332+0000","last_change":"2024-09-21T07:22:48.738773+0000","last_active":"2024-09-21T07:22:54.025332+0000","last_peered":"2024-09-21T07:22:54.025332+0000","last_clean":"2024-09-21T07:22:54.025332+0000","last_became_active":"2024-09-21T07:22:48.738521+0000","last_became_peered":"2024-09-21T07:22:48.738521+0000","last_unstale":"2024-09-21T07:22:54.025332+0000","last_undegraded":"2024-09-21T07:22:54.025332+0000","last_fullsized":"2024-09-21T07:22:54.025332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:42.041043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T07:22:53.893340+0000","last_change":"2024-09-21T07:22:48.750274+0000","last_active":"2024-09-21T07:22:53.893340+0000","last_peered":"2024-09-21T07:22:53.893340+0000","last_clean":"2024-09-21T07:22:53.893340+0000","last_became_active":"2024-09-21T07:22:48.748751+0000","last_became_peered":"2024-09-21T07:22:48.748751+0000","last_unstale":"2024-09-21T07:22:53.893340+0000","last_undegraded":"2024-09-21T07:22:53.893340+0000","last_fullsized":"2024-09-21T07:22:53.893340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:47.696972+0000","last_clean_scrub_stamp":"2024-09-21T07:22:47.696972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:28.162100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":107492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":698282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:09.068 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:23:09.068 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:23:09.068 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:23:09.068 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T07:23:09.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 -- 172.21.15.64:0/1598963381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c15fca0 msgr2=0x7f685c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 --2- 172.21.15.64:0/1598963381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c15fca0 0x7f685c0705b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f684c009900 tx=0x7f684c01c640 comp rx=0 tx=0).stop 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 -- 172.21.15.64:0/1598963381 shutdown_connections 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 --2- 172.21.15.64:0/1598963381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c164200 0x7f685c166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 --2- 172.21.15.64:0/1598963381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c15fca0 0x7f685c0705b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 -- 172.21.15.64:0/1598963381 >> 172.21.15.64:0/1598963381 conn(0x7f685c0b2ca0 msgr2=0x7f685c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 -- 172.21.15.64:0/1598963381 shutdown_connections 2024-09-21T07:23:09.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.257+0000 7f6863a00640 1 -- 172.21.15.64:0/1598963381 wait complete. 2024-09-21T07:23:09.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 Processor -- start 2024-09-21T07:23:09.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 -- start start 2024-09-21T07:23:09.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c0cba10 0x7f685c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f685c15fca0 0x7f685c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f685c169a80 con 0x7f685c164200 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f685c169900 con 0x7f685c15fca0 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6863a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f685c169c00 con 0x7f685c0cba10 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6861a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6861a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39992/0 (socket says 172.21.15.64:39992) 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.261+0000 7f6861a00640 1 -- 172.21.15.64:0/2935408563 learned_addr learned my addr 172.21.15.64:0/2935408563 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6853e00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f685c15fca0 0x7f685c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861000640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c0cba10 0x7f685c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 -- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c0cba10 msgr2=0x7f685c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c0cba10 0x7f685c158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 -- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f685c15fca0 msgr2=0x7f685c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f685c15fca0 0x7f685c157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 -- 172.21.15.64:0/2935408563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c159000 con 0x7f685c164200 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6861a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f685400cab0 tx=0x7f685400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:09.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400ae20 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f685400f560 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400f9b0 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c0cf9c0 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c1f9610 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685c0705b0 con 0x7f685c164200 2024-09-21T07:23:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.265+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f685400fb50 con 0x7f685c164200 2024-09-21T07:23:09.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.269+0000 7f6859600640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 0x7f6838075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.269+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6854095060 con 0x7f685c164200 2024-09-21T07:23:09.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.269+0000 7f6861000640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 0x7f6838075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.269+0000 7f6861000640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 0x7f6838075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f684c0ae000 tx=0x7f684c01ae80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:09.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.273+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6854014030 con 0x7f685c164200 2024-09-21T07:23:09.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f685c0b6cc0 con 0x7f685c164200 2024-09-21T07:23:09.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6859600640 1 -- 172.21.15.64:0/2935408563 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f685405f650 con 0x7f685c164200 2024-09-21T07:23:09.489 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:09.489 INFO:teuthology.orchestra.run.smithi064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 msgr2=0x7f6838075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 0x7f6838075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f684c0ae000 tx=0x7f684c01ae80 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 msgr2=0x7f685c1f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f685400cab0 tx=0x7f685400cf70 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 shutdown_connections 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6838073200 0x7f6838075710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f685c164200 0x7f685c1f8a30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f685c15fca0 0x7f685c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 --2- 172.21.15.64:0/2935408563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f685c0cba10 0x7f685c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 >> 172.21.15.64:0/2935408563 conn(0x7f685c0b2ca0 msgr2=0x7f685c0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:09.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 shutdown_connections 2024-09-21T07:23:09.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.485+0000 7f6863a00640 1 -- 172.21.15.64:0/2935408563 wait complete. 2024-09-21T07:23:09.512 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:23:09.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 -- 172.21.15.64:0/26775804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 msgr2=0x7f3d88071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 --2- 172.21.15.64:0/26775804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88071690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009840 tx=0x7f3d7001c820 comp rx=0 tx=0).stop 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 -- 172.21.15.64:0/26775804 shutdown_connections 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 --2- 172.21.15.64:0/26775804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88071690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 --2- 172.21.15.64:0/26775804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 0x7f3d8815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.665+0000 7f3d8e600640 1 -- 172.21.15.64:0/26775804 >> 172.21.15.64:0/26775804 conn(0x7f3d880b2dc0 msgr2=0x7f3d880b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- 172.21.15.64:0/26775804 shutdown_connections 2024-09-21T07:23:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- 172.21.15.64:0/26775804 wait complete. 2024-09-21T07:23:09.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 Processor -- start 2024-09-21T07:23:09.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- start start 2024-09-21T07:23:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 0x7f3d880b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88074930 con 0x7f3d880d0480 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880747b0 con 0x7f3d88071280 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d8e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3d88074ab0 con 0x7f3d8815f1e0 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.669+0000 7f3d7fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d87400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40000/0 (socket says 172.21.15.64:40000) 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 -- 172.21.15.64:0/2642316397 learned_addr learned my addr 172.21.15.64:0/2642316397 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d87e00640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 0x7f3d880b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 -- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 msgr2=0x7f3d880b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 0x7f3d880b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 -- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 msgr2=0x7f3d88154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 -- 172.21.15.64:0/2642316397 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d881fa430 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7fe00640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d7001aed0 tx=0x7f3d700a6760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700a7d00 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d70004040 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d881fa710 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70004470 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d881509a0 con 0x7f3d880d0480 2024-09-21T07:23:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88071690 con 0x7f3d880d0480 2024-09-21T07:23:09.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.673+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3d700c0020 con 0x7f3d880d0480 2024-09-21T07:23:09.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.677+0000 7f3d7f400640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 0x7f3d64075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:09.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.677+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3d7012e970 con 0x7f3d880d0480 2024-09-21T07:23:09.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.677+0000 7f3d87400640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 0x7f3d64075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.677+0000 7f3d87400640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 0x7f3d64075740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009b40 tx=0x7f3d780091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.681+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3d700c7020 con 0x7f3d880d0480 2024-09-21T07:23:09.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d8815b720 con 0x7f3d880d0480 2024-09-21T07:23:09.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d7f400640 1 -- 172.21.15.64:0/2642316397 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f3d70016410 con 0x7f3d880d0480 2024-09-21T07:23:09.901 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:09.901 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:09.901 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:09.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 msgr2=0x7f3d64075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 0x7f3d64075740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009b40 tx=0x7f3d780091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 msgr2=0x7f3d88150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:09.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d7001aed0 tx=0x7f3d700a6760 comp rx=0 tx=0).stop 2024-09-21T07:23:09.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 shutdown_connections 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d64073230 0x7f3d64075740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d8815f1e0 0x7f3d880b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d880d0480 0x7f3d88150460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 --2- 172.21.15.64:0/2642316397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d88071280 0x7f3d88154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 >> 172.21.15.64:0/2642316397 conn(0x7f3d880b2dc0 msgr2=0x7f3d880b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 shutdown_connections 2024-09-21T07:23:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:09.897+0000 7f3d8e600640 1 -- 172.21.15.64:0/2642316397 wait complete. 2024-09-21T07:23:09.923 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:10.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 -- 172.21.15.64:0/4129099790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb174003ab0 msgr2=0x7fb174003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 --2- 172.21.15.64:0/4129099790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb174003ab0 0x7fb174003f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb180009b40 tx=0x7fb18001d270 comp rx=0 tx=0).stop 2024-09-21T07:23:10.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb18fe00640 1 -- 172.21.15.64:0/4129099790 reap_dead start 2024-09-21T07:23:10.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 -- 172.21.15.64:0/4129099790 shutdown_connections 2024-09-21T07:23:10.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 -- 172.21.15.64:0/4129099790 >> 172.21.15.64:0/4129099790 conn(0x7fb19006d530 msgr2=0x7fb1900d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:10.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 -- 172.21.15.64:0/4129099790 shutdown_connections 2024-09-21T07:23:10.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.077+0000 7fb196600640 1 -- 172.21.15.64:0/4129099790 wait complete. 2024-09-21T07:23:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 Processor -- start 2024-09-21T07:23:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- start start 2024-09-21T07:23:10.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 0x7fb1901513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1901519b0 0x7fb1900c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901691c0 con 0x7fb190156e90 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb190169040 con 0x7fb174003ab0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb190169340 con 0x7fb1901519b0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40010/0 (socket says 172.21.15.64:40010) 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 -- 172.21.15.64:0/281599908 learned_addr learned my addr 172.21.15.64:0/281599908 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb187e00640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1901519b0 0x7fb1900c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18f400640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 0x7fb1901513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 -- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1901519b0 msgr2=0x7fb1900c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1901519b0 0x7fb1900c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 -- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 msgr2=0x7fb1901513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 0x7fb1901513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 -- 172.21.15.64:0/281599908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1901577e0 con 0x7fb190156e90 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18f400640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 0x7fb1901513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb18fe00640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1900ce250 tx=0x7fb18800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18800ca10 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb188017070 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1900c9bb0 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188011460 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.081+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1900cb880 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.085+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1900c98d0 con 0x7fb190156e90 2024-09-21T07:23:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.085+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb188011600 con 0x7fb190156e90 2024-09-21T07:23:10.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.085+0000 7fb187400640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 0x7fb16c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.085+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb188094a40 con 0x7fb190156e90 2024-09-21T07:23:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.085+0000 7fb18f400640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 0x7fb16c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.089+0000 7fb18f400640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 0x7fb16c075710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ad000 tx=0x7fb18001a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.089+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb1901577e0 con 0x7fb190156e90 2024-09-21T07:23:10.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.301+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1900cc5b0 con 0x7fb190156e90 2024-09-21T07:23:10.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.301+0000 7fb187400640 1 -- 172.21.15.64:0/281599908 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fb18805f680 con 0x7fb190156e90 2024-09-21T07:23:10.307 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:10.307 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:10.308 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 msgr2=0x7fb16c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 0x7fb16c075710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ad000 tx=0x7fb18001a010 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 msgr2=0x7fb1901572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1900ce250 tx=0x7fb18800eb60 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 shutdown_connections 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb16c073200 0x7fb16c075710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb190156e90 0x7fb1901572a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1901519b0 0x7fb1900c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 --2- 172.21.15.64:0/281599908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb174003ab0 0x7fb1901513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 >> 172.21.15.64:0/281599908 conn(0x7fb19006d530 msgr2=0x7fb19015af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 shutdown_connections 2024-09-21T07:23:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.305+0000 7fb196600640 1 -- 172.21.15.64:0/281599908 wait complete. 2024-09-21T07:23:10.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- 172.21.15.64:0/3546472954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cf3b0 msgr2=0x7f4e84071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 --2- 172.21.15.64:0/3546472954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cf3b0 0x7f4e84071080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009bc0 tx=0x7f4e7c01cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- 172.21.15.64:0/3546472954 shutdown_connections 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 --2- 172.21.15.64:0/3546472954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cf3b0 0x7f4e84071080 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 --2- 172.21.15.64:0/3546472954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e840cefa0 0x7f4e84070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- 172.21.15.64:0/3546472954 >> 172.21.15.64:0/3546472954 conn(0x7f4e840d10a0 msgr2=0x7f4e840d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- 172.21.15.64:0/3546472954 shutdown_connections 2024-09-21T07:23:10.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- 172.21.15.64:0/3546472954 wait complete. 2024-09-21T07:23:10.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 Processor -- start 2024-09-21T07:23:10.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.484+0000 7f4e83200640 1 -- start start 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e840cf3b0 0x7f4e840b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 0x7f4e84153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4e841696c0 con 0x7f4e840cefa0 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e84169540 con 0x7f4e840cf3b0 2024-09-21T07:23:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4e84169840 con 0x7f4e84159280 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40014/0 (socket says 172.21.15.64:40014) 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 -- 172.21.15.64:0/1565647489 learned_addr learned my addr 172.21.15.64:0/1565647489 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e82800640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 0x7f4e84153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e7be00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e840cf3b0 0x7f4e840b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 -- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 msgr2=0x7f4e84153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 0x7f4e84153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 -- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e840cf3b0 msgr2=0x7f4e840b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e840cf3b0 0x7f4e840b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 -- 172.21.15.64:0/1565647489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e84152be0 con 0x7f4e840cefa0 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e82800640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 0x7f4e84153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e81e00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c410 tx=0x7f4e7400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011790 con 0x7f4e840cefa0 2024-09-21T07:23:10.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e74017070 con 0x7f4e840cefa0 2024-09-21T07:23:10.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011ca0 con 0x7f4e840cefa0 2024-09-21T07:23:10.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e841f9f30 con 0x7f4e840cefa0 2024-09-21T07:23:10.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e84152fa0 con 0x7f4e840cefa0 2024-09-21T07:23:10.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.488+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e840d08b0 con 0x7f4e840cefa0 2024-09-21T07:23:10.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.492+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4e7401c460 con 0x7f4e840cefa0 2024-09-21T07:23:10.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.492+0000 7f4e7a000640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 0x7f4e60075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.492+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4e74094300 con 0x7f4e840cefa0 2024-09-21T07:23:10.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.492+0000 7f4e7be00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 0x7f4e60075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.492+0000 7f4e7be00640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 0x7f4e60075740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e840cb640 tx=0x7f4e6c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.496+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4e84152be0 con 0x7f4e840cefa0 2024-09-21T07:23:10.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.672+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e840b3980 con 0x7f4e840cefa0 2024-09-21T07:23:10.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.672+0000 7f4e7a000640 1 -- 172.21.15.64:0/1565647489 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f4e7405efd0 con 0x7f4e840cefa0 2024-09-21T07:23:10.679 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:10.679 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:10.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 msgr2=0x7f4e60075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 0x7f4e60075740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e840cb640 tx=0x7f4e6c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 msgr2=0x7f4e841520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c410 tx=0x7f4e7400c8d0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 shutdown_connections 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e60073230 0x7f4e60075740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159280 0x7f4e84153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e840cf3b0 0x7f4e840b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 --2- 172.21.15.64:0/1565647489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840cefa0 0x7f4e841520f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 >> 172.21.15.64:0/1565647489 conn(0x7f4e840d10a0 msgr2=0x7f4e840cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 shutdown_connections 2024-09-21T07:23:10.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.676+0000 7f4e83200640 1 -- 172.21.15.64:0/1565647489 wait complete. 2024-09-21T07:23:10.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:10.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 -- 172.21.15.64:0/1917826919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d415f100 msgr2=0x7f01d415f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 --2- 172.21.15.64:0/1917826919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d415f100 0x7f01d415f510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009840 tx=0x7f01c001c6d0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 -- 172.21.15.64:0/1917826919 shutdown_connections 2024-09-21T07:23:10.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 --2- 172.21.15.64:0/1917826919 >> v2:172.21.15.90:3300/0 conn(0x7f01d406fba0 0x7f01d406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 --2- 172.21.15.64:0/1917826919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d415f100 0x7f01d415f510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 -- 172.21.15.64:0/1917826919 >> 172.21.15.64:0/1917826919 conn(0x7f01d40b2ca0 msgr2=0x7f01d40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:10.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 -- 172.21.15.64:0/1917826919 shutdown_connections 2024-09-21T07:23:10.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 -- 172.21.15.64:0/1917826919 wait complete. 2024-09-21T07:23:10.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.856+0000 7f01da800640 1 Processor -- start 2024-09-21T07:23:10.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- start start 2024-09-21T07:23:10.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 0x7f01d4159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d40cd790 0x7f01d41584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40b6940 con 0x7f01d415f100 2024-09-21T07:23:10.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40b67c0 con 0x7f01d40cd790 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f01d40b6ac0 con 0x7f01d406fba0 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40024/0 (socket says 172.21.15.64:40024) 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 -- 172.21.15.64:0/3771122251 learned_addr learned my addr 172.21.15.64:0/3771122251 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d2a00640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d40cd790 0x7f01d41584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3400640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 0x7f01d4159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 -- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 msgr2=0x7f01d4159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 0x7f01d4159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 -- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d40cd790 msgr2=0x7f01d41584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d40cd790 0x7f01d41584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 -- 172.21.15.64:0/3771122251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d415d610 con 0x7f01d415f100 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3400640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 0x7f01d4159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:10.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01d3e00640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00eae0 tx=0x7f01cc009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00ce40 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01cc004c20 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc005020 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d415d8f0 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.860+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d415deb0 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d406ffb0 con 0x7f01d415f100 2024-09-21T07:23:10.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f01cc0051c0 con 0x7f01d415f100 2024-09-21T07:23:10.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01cb400640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 0x7f01b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:10.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f01cc095390 con 0x7f01d415f100 2024-09-21T07:23:10.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01d3400640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 0x7f01b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:10.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.864+0000 7f01d3400640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 0x7f01b4075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01c40016b0 tx=0x7f01c4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:10.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:10.868+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f01cc05ffd0 con 0x7f01d415f100 2024-09-21T07:23:11.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01d40b3bb0 con 0x7f01d415f100 2024-09-21T07:23:11.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01cb400640 1 -- 172.21.15.64:0/3771122251 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f01cc05f8d0 con 0x7f01d415f100 2024-09-21T07:23:11.097 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:11.097 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:11.097 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:11.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 msgr2=0x7f01b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 0x7f01b4075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01c40016b0 tx=0x7f01c4009040 comp rx=0 tx=0).stop 2024-09-21T07:23:11.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 msgr2=0x7f01d406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00eae0 tx=0x7f01cc009f70 comp rx=0 tx=0).stop 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 shutdown_connections 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01b4073200 0x7f01b4075710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d415f100 0x7f01d406cdf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d40cd790 0x7f01d41584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 --2- 172.21.15.64:0/3771122251 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d406fba0 0x7f01d4159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 >> 172.21.15.64:0/3771122251 conn(0x7f01d40b2ca0 msgr2=0x7f01d415b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 shutdown_connections 2024-09-21T07:23:11.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.092+0000 7f01da800640 1 -- 172.21.15.64:0/3771122251 wait complete. 2024-09-21T07:23:11.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:22:48.142974+0000', 'modified': '2024-09-21T07:23:03.218842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/310445642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 310445642}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 310445642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4365, 'qdb_cluster': [4365]} 2024-09-21T07:23:11.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:23:11.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:23:11.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 -- 172.21.15.64:0/1902851270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 msgr2=0x7f249015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 --2- 172.21.15.64:0/1902851270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f249015c7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24900cc8e0 tx=0x7f248001c830 comp rx=0 tx=0).stop 2024-09-21T07:23:11.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 -- 172.21.15.64:0/1902851270 shutdown_connections 2024-09-21T07:23:11.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 --2- 172.21.15.64:0/1902851270 >> v2:172.21.15.90:3300/0 conn(0x7f24900b3d60 0x7f24900b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 --2- 172.21.15.64:0/1902851270 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900cecb0 0x7f24900cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 --2- 172.21.15.64:0/1902851270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f249015c7f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 -- 172.21.15.64:0/1902851270 >> 172.21.15.64:0/1902851270 conn(0x7f249006d3f0 msgr2=0x7f24900710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 -- 172.21.15.64:0/1902851270 shutdown_connections 2024-09-21T07:23:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.676+0000 7f2495c00640 1 -- 172.21.15.64:0/1902851270 wait complete. 2024-09-21T07:23:11.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 Processor -- start 2024-09-21T07:23:11.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- start start 2024-09-21T07:23:11.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900b3d60 0x7f24900cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 0x7f24901fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f24900d1490 con 0x7f24900cd320 2024-09-21T07:23:11.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24900d1310 con 0x7f24900cecb0 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f24900d1610 con 0x7f24900b3d60 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40036/0 (socket says 172.21.15.64:40036) 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 -- 172.21.15.64:0/555346230 learned_addr learned my addr 172.21.15.64:0/555346230 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248ea00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900b3d60 0x7f24900cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248f400640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 0x7f24901fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 -- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900b3d60 msgr2=0x7f24900cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900b3d60 0x7f24900cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 -- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 msgr2=0x7f24901fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 0x7f24901fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 -- 172.21.15.64:0/555346230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249015d890 con 0x7f24900cd320 2024-09-21T07:23:11.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248f400640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 0x7f24901fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:11.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f248e000640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d6a0 tx=0x7f247c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2486a00640 1 -- 172.21.15.64:0/555346230 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c017070 con 0x7f24900cd320 2024-09-21T07:23:11.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2486a00640 1 -- 172.21.15.64:0/555346230 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f247c005310 con 0x7f24900cd320 2024-09-21T07:23:11.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249015db50 con 0x7f24900cd320 2024-09-21T07:23:11.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2486a00640 1 -- 172.21.15.64:0/555346230 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c009820 con 0x7f24900cd320 2024-09-21T07:23:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.680+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249015e110 con 0x7f24900cd320 2024-09-21T07:23:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f2486a00640 1 -- 172.21.15.64:0/555346230 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f247c0099c0 con 0x7f24900cd320 2024-09-21T07:23:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f2486a00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 0x7f2470075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f2486a00640 1 -- 172.21.15.64:0/555346230 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f247c094600 con 0x7f24900cd320 2024-09-21T07:23:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f249d16c000 1 Processor -- start 2024-09-21T07:23:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f249d16c000 1 -- start start 2024-09-21T07:23:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.684+0000 7f248ea00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 0x7f2470075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 0x7f2470075710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24800af000 tx=0x7f24800a8040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f069120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556c7ef3d410 con 0x556c7eb27460 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c7ee7ab40 con 0x556c7ef17950 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556c7ee69f70 con 0x556c7ef00ca0 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40052/0 (socket says 172.21.15.64:40052) 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 -- 172.21.15.64:0/2345572737 learned_addr learned my addr 172.21.15.64:0/2345572737 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248f400640 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248e000640 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 -- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 msgr2=0x556c7f069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f069120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 -- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 msgr2=0x556c7f068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 -- 172.21.15.64:0/2345572737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7ee315b0 con 0x556c7eb27460 2024-09-21T07:23:11.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f248ea00640 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f248001d0d0 tx=0x7f248001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c32ebad9569ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f247b400640 1 -- 172.21.15.64:0/2345572737 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480003800 con 0x556c7eb27460 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f247b400640 1 -- 172.21.15.64:0/2345572737 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24800c9070 con 0x556c7eb27460 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f247b400640 1 -- 172.21.15.64:0/2345572737 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480003d10 con 0x556c7eb27460 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- 172.21.15.64:0/2345572737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 msgr2=0x556c7f0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f248001d0d0 tx=0x7f248001c830 comp rx=0 tx=0).stop 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- 172.21.15.64:0/2345572737 shutdown_connections 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f069120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 --2- 172.21.15.64:0/2345572737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0686a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- 172.21.15.64:0/2345572737 >> 172.21.15.64:0/2345572737 conn(0x556c7efedd90 msgr2=0x556c7f01d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- 172.21.15.64:0/2345572737 shutdown_connections 2024-09-21T07:23:11.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- 172.21.15.64:0/2345572737 wait complete. 2024-09-21T07:23:11.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 -- start start 2024-09-21T07:23:11.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.688+0000 7f249d16c000 1 Processor -- start 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7eb27460 0x556c7f06f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556c7ee045f0 con 0x556c7ef17950 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c7ee6dd80 con 0x556c7eb27460 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556c7ee10520 con 0x556c7ef00ca0 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 10 client.0 _ll_register_callbacks cb 0x556c7ee14830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40056/0 (socket says 172.21.15.64:40056) 2024-09-21T07:23:11.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 -- 172.21.15.64:0/2349983682 learned_addr learned my addr 172.21.15.64:0/2349983682 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:11.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7eb27460 0x556c7f06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248e000640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 -- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 msgr2=0x556c7f06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 -- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7eb27460 msgr2=0x556c7f06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7eb27460 0x556c7f06f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 -- 172.21.15.64:0/2349983682 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7ee08190 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248f400640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24880116e0 tx=0x7f2488011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266d0434e4ac07b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800fb40 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f248800fce0 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c7ee02110 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2488025050 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 10 client.4704 fetch_fsmap learned FSMap version 9 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556c7eeeef10 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556c7ee02110 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f2488028020 con 0x556c7ef17950 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 10 client.4704 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 10 client.4704 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 20 client.4704 populate_metadata read hostname 'smithi064' 2024-09-21T07:23:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eb0c7d0 0x556c7f079d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 4 client.4704 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:11.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 --> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c7ee7ca90 con 0x556c7eb0c7d0 2024-09-21T07:23:11.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.692+0000 7f248ea00640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eb0c7d0 0x556c7f079d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f248ea00640 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eb0c7d0 0x556c7f079d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0e4cab575e9d97 server_cookie=23e5d1837aa582a2 in_seq=0 out_seq=0 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f246fe00640 10 client.4704 ms_handle_connect on v2:172.21.15.64:6834/310445642 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f246fe00640 1 -- 172.21.15.64:0/2349983682 <== mds.0 v2:172.21.15.64:6834/310445642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c7ee7ca90 con 0x556c7eb0c7d0 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f246fe00640 10 client.4704 handle_command_reply: tid=0 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 client.4704 shutdown 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 msgr2=0x556c7f0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24880116e0 tx=0x7f2488011ba0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 shutdown_connections 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eb0c7d0 0x556c7f079d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0703a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 --2- 172.21.15.64:0/2349983682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7eb27460 0x556c7f06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f246fe00640 0 client.4704 ms_handle_reset on v2:172.21.15.64:6834/310445642 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 >> 172.21.15.64:0/2349983682 conn(0x556c7efedd90 msgr2=0x556c7f024440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 shutdown_connections 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 1 -- 172.21.15.64:0/2349983682 wait complete. 2024-09-21T07:23:11.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.696+0000 7f249d16c000 20 client.4704 trim_cache size 0 max 16384 2024-09-21T07:23:11.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 Processor -- start 2024-09-21T07:23:11.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 -- start start 2024-09-21T07:23:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7eb27460 0x556c7f0dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef00ca0 0x556c7f0def70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2490204b70 con 0x556c7ef17950 2024-09-21T07:23:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2490203c10 con 0x556c7ef00ca0 2024-09-21T07:23:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f249015f6b0 con 0x556c7eb27460 2024-09-21T07:23:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40064/0 (socket says 172.21.15.64:40064) 2024-09-21T07:23:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 -- 172.21.15.64:0/1059669182 learned_addr learned my addr 172.21.15.64:0/1059669182 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 -- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7eb27460 msgr2=0x556c7f0dea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7eb27460 0x556c7f0dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 -- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef00ca0 msgr2=0x556c7f0def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef00ca0 0x556c7f0def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 -- 172.21.15.64:0/1059669182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7eec5db0 con 0x556c7ef17950 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f248f400640 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f248800bd30 tx=0x7f248800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c7ce362247f3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f247aa00640 1 -- 172.21.15.64:0/1059669182 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248802d070 con 0x556c7ef17950 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f247aa00640 1 -- 172.21.15.64:0/1059669182 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2488004e20 con 0x556c7ef17950 2024-09-21T07:23:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.716+0000 7f247aa00640 1 -- 172.21.15.64:0/1059669182 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488022070 con 0x556c7ef17950 2024-09-21T07:23:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- 172.21.15.64:0/1059669182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 msgr2=0x556c7f0df4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f248800bd30 tx=0x7f248800bd60 comp rx=0 tx=0).stop 2024-09-21T07:23:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- 172.21.15.64:0/1059669182 shutdown_connections 2024-09-21T07:23:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7ef17950 0x556c7f0df4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef00ca0 0x556c7f0def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- 172.21.15.64:0/1059669182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7eb27460 0x556c7f0dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- 172.21.15.64:0/1059669182 >> 172.21.15.64:0/1059669182 conn(0x556c7efedd90 msgr2=0x556c7f066620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- 172.21.15.64:0/1059669182 shutdown_connections 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- 172.21.15.64:0/1059669182 wait complete. 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- start start 2024-09-21T07:23:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 Processor -- start 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f0e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f0e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556c7ee79910 con 0x556c7eb27460 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c7ee723b0 con 0x556c7ef17950 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556c7ef29750 con 0x556c7ef00ca0 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f249d16c000 10 client.0 _ll_register_callbacks cb 0x7f248800b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f248ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f248ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40068/0 (socket says 172.21.15.64:40068) 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.720+0000 7f248ea00640 1 -- 172.21.15.64:0/4053201910 learned_addr learned my addr 172.21.15.64:0/4053201910 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248f400640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f0e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248e000640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f0e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 -- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 msgr2=0x556c7f0e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f0e2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 -- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 msgr2=0x556c7f0e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f0e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 -- 172.21.15.64:0/4053201910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7ee30ab0 con 0x556c7eb27460 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248e000640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f0e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248ea00640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f248001cd10 tx=0x7f248001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45f5631acada923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480005230 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f24800053d0 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2488004e20 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f24800046d0 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 10 client.4710 fetch_fsmap learned FSMap version 9 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556c7ee0f070 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2488004e20 con 0x556c7eb27460 2024-09-21T07:23:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f2480004870 con 0x556c7eb27460 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 10 client.4710 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 10 client.4710 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 20 client.4710 populate_metadata read hostname 'smithi064' 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eafa830 0x556c7f09eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 4 client.4710 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 --> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] -- command(tid 0: {"prefix": "status"}) -- 0x556c7ee78540 con 0x556c7eafa830 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248e000640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eafa830 0x556c7f09eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f248e000640 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eafa830 0x556c7f09eab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d06b01c304bdbb server_cookie=676aff7c25ac002b in_seq=0 out_seq=0 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 10 client.4710 ms_handle_connect on v2:172.21.15.64:6834/310445642 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 1 -- 172.21.15.64:0/4053201910 <== mds.0 v2:172.21.15.64:6834/310445642 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x556c7ee78540 con 0x556c7eafa830 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 10 client.4710 handle_command_reply: tid=0 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 client.4710 shutdown 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 msgr2=0x556c7f0e27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f248001cd10 tx=0x7f248001ca80 comp rx=0 tx=0).stop 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 shutdown_connections 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:6834/310445642,v1:172.21.15.64:6835/310445642] conn(0x556c7eafa830 0x556c7f09eab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c7ef17950 0x556c7f0e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556c7ef00ca0 0x556c7f0e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 --2- 172.21.15.64:0/4053201910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556c7eb27460 0x556c7f0e27a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f246fe00640 0 client.4710 ms_handle_reset on v2:172.21.15.64:6834/310445642 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 >> 172.21.15.64:0/4053201910 conn(0x556c7efedd90 msgr2=0x556c7f066fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 shutdown_connections 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 1 -- 172.21.15.64:0/4053201910 wait complete. 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.724+0000 7f249d16c000 20 client.4710 trim_cache size 0 max 16384 2024-09-21T07:23:11.733 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4365, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 23.024021483999999, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 9, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 26, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 26, 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 29.062261879000001 2024-09-21T07:23:11.734 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 msgr2=0x7f2470075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 0x7f2470075710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24800af000 tx=0x7f24800a8040 comp rx=0 tx=0).stop 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 msgr2=0x7f24901f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d6a0 tx=0x7f247c00db60 comp rx=0 tx=0).stop 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 shutdown_connections 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2470073200 0x7f2470075710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24900cecb0 0x7f24901fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24900cd320 0x7f24901f9c60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 --2- 172.21.15.64:0/555346230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24900b3d60 0x7f24900cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 >> 172.21.15.64:0/555346230 conn(0x7f249006d3f0 msgr2=0x7f2490151030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 shutdown_connections 2024-09-21T07:23:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:11.728+0000 7f2495c00640 1 -- 172.21.15.64:0/555346230 wait complete. 2024-09-21T07:23:11.752 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:23:11.765 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:23:11.765 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T07:23:11.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:11.765 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:23:11.774 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T07:23:11.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:11.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:23:11.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:11.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-09-21T07:23:12.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.422 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:23:12.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-09-21T07:23:12.499 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-09-21T07:23:12.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:23:12.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.501 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:23:12.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T07:23:12.576 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-21T07:23:12.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:23:12.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.579 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:23:12.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:12.629 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T07:23:12.696 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-21T07:23:12.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:23:12.698 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T07:23:12.698 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:23:12.699 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:12.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:23:12.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 -- 172.21.15.64:0/2660987139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 msgr2=0x7f35400b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:12.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 --2- 172.21.15.64:0/2660987139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f35400b1ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35400cb9c0 tx=0x7f352c01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:23:12.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 -- 172.21.15.64:0/2660987139 shutdown_connections 2024-09-21T07:23:12.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 --2- 172.21.15.64:0/2660987139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f35400b1ff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:12.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 -- 172.21.15.64:0/2660987139 >> 172.21.15.64:0/2660987139 conn(0x7f35400ccbe0 msgr2=0x7f35400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:12.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 -- 172.21.15.64:0/2660987139 shutdown_connections 2024-09-21T07:23:12.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.860+0000 7f3546000640 1 -- 172.21.15.64:0/2660987139 wait complete. 2024-09-21T07:23:12.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 Processor -- start 2024-09-21T07:23:12.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 -- start start 2024-09-21T07:23:12.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f354015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:12.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35400cbcd0 0x7f35400b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:12.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:12.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f354016b210 con 0x7f354015cbd0 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f354016b090 con 0x7f35400b1be0 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f3546000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f354016b390 con 0x7f35400cbcd0 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f353fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f353fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40072/0 (socket says 172.21.15.64:40072) 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f353fe00640 1 -- 172.21.15.64:0/2548751362 learned_addr learned my addr 172.21.15.64:0/2548751362 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:12.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f353ea00640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35400cbcd0 0x7f35400b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.864+0000 7f353f400640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f354015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 -- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35400cbcd0 msgr2=0x7f35400b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35400cbcd0 0x7f35400b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 -- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 msgr2=0x7f354015bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f354015bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 -- 172.21.15.64:0/2548751362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401590b0 con 0x7f354015cbd0 2024-09-21T07:23:12.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f353fe00640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f353800cab0 tx=0x7f353800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:12.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538016020 con 0x7f354015cbd0 2024-09-21T07:23:12.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f353800a930 con 0x7f354015cbd0 2024-09-21T07:23:12.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3540156f40 con 0x7f354015cbd0 2024-09-21T07:23:12.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353800ad60 con 0x7f354015cbd0 2024-09-21T07:23:12.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3540158b90 con 0x7f354015cbd0 2024-09-21T07:23:12.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35400b1ff0 con 0x7f354015cbd0 2024-09-21T07:23:12.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.868+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3538019020 con 0x7f354015cbd0 2024-09-21T07:23:12.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.872+0000 7f3537400640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 0x7f3520075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:12.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.872+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3538094300 con 0x7f354015cbd0 2024-09-21T07:23:12.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.872+0000 7f353f400640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 0x7f3520075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:12.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.872+0000 7f353f400640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 0x7f3520075710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3530007fd0 tx=0x7f3530009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:12.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:12.876+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3538020030 con 0x7f354015cbd0 2024-09-21T07:23:13.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.088+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f354006de00 con 0x7f354015cbd0 2024-09-21T07:23:13.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.088+0000 7f3537400640 1 -- 172.21.15.64:0/2548751362 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f35400b2530 con 0x7f354015cbd0 2024-09-21T07:23:13.095 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 msgr2=0x7f3520075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 0x7f3520075710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3530007fd0 tx=0x7f3530009040 comp rx=0 tx=0).stop 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 msgr2=0x7f35401fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f353800cab0 tx=0x7f353800cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 shutdown_connections 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3520073200 0x7f3520075710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f354015cbd0 0x7f35401fc5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35400cbcd0 0x7f35400b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:13.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 --2- 172.21.15.64:0/2548751362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35400b1be0 0x7f354015bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:13.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 >> 172.21.15.64:0/2548751362 conn(0x7f35400ccbe0 msgr2=0x7f3540073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:13.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 shutdown_connections 2024-09-21T07:23:13.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13.092+0000 7f3546000640 1 -- 172.21.15.64:0/2548751362 wait complete. 2024-09-21T07:23:13.117 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:23:13.117 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:23:13.117 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:23:13.117 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:23:13.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:13.118 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:23:13.118 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:23:13.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:23:13.118 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:23:13.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.118 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:23:13.127 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:13.127 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:13.127 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:13.127 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:23:13.128 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42390sec preferred_lft 42390sec 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:23:13.129 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:13.130 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:23:13.130 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:13.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:13.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:13.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.284 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:23:13.304 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:23:13.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.306 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:23:13.362 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:13.363 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:23:13.363 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:13.364 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:13.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:23:13.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:23:13.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:23:13.364 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:13.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:13.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:13.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.500 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:23:13.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.510 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-09-21T07:23:13.559 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:13.560 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:13.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:23:13.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:23:13.560 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:13.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:13.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:13.691 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:23:13.692 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:13.692 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:13.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:23:13.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:23:13.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:23:13.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:23:13.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:23:13.693 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:13.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:13.836 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:13.836 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:13.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:23:13.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:23:13.836 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:13.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:13.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:13.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:13.922 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:13.930 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:23:13.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:13.931 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:13.982 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:23:13.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:13.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:14.088 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:14.088 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:23:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:23:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:23:14.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:23:14.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:14.723 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:14.743 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:14.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:14.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:14.846 INFO:teuthology.orchestra.run.smithi064.stdout:client4601 2024-09-21T07:23:14.846 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:14.846 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:14.855 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:14.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:14.955 INFO:teuthology.orchestra.run.smithi064.stdout:client4601 2024-09-21T07:23:14.956 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:15.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:15.013 INFO:teuthology.orchestra.run.smithi064.stdout:client4601 2024-09-21T07:23:15.013 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/be0ccda5-3d1a-4615-9c09-c8d9d4461231.client4601/status') 2024-09-21T07:23:15.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:15.074 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4601 (3)172.21.15.64:0/1488537502 2024-09-21T07:23:15.074 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2024-09-21T07:23:15.074 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2024-09-21T07:23:15.074 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2024-09-21T07:23:15.074 INFO:teuthology.orchestra.run.smithi064.stderr:70 bytes copied, 6.522e-05 s, 1.1 MB/s 2024-09-21T07:23:15.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:15.082 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T07:23:15.082 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:23:15.082 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:23:15.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:23:15.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 -- 172.21.15.64:0/4192319080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314806d020 msgr2=0x7f314806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:15.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 --2- 172.21.15.64:0/4192319080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314806d020 0x7f314806d430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3130009840 tx=0x7f313001c7f0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 -- 172.21.15.64:0/4192319080 shutdown_connections 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 --2- 172.21.15.64:0/4192319080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314806d020 0x7f314806d430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 -- 172.21.15.64:0/4192319080 >> 172.21.15.64:0/4192319080 conn(0x7f31480d0de0 msgr2=0x7f31480d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 -- 172.21.15.64:0/4192319080 shutdown_connections 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.276+0000 7f314de00640 1 -- 172.21.15.64:0/4192319080 wait complete. 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 Processor -- start 2024-09-21T07:23:15.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- start start 2024-09-21T07:23:15.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f314806d020 0x7f314814d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:15.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f314806f620 0x7f314814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:15.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:15.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3148169c20 con 0x7f314815b810 2024-09-21T07:23:15.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3148169aa0 con 0x7f314806d020 2024-09-21T07:23:15.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3148169da0 con 0x7f314806f620 2024-09-21T07:23:15.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:15.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57790/0 (socket says 172.21.15.64:57790) 2024-09-21T07:23:15.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 -- 172.21.15.64:0/2406301418 learned_addr learned my addr 172.21.15.64:0/2406301418 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 -- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f314806f620 msgr2=0x7f314814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f314806f620 0x7f314814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 -- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f314806d020 msgr2=0x7f314814d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f314806d020 0x7f314814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 -- 172.21.15.64:0/2406301418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3148075820 con 0x7f314815b810 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f3147400640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f314000c760 tx=0x7f314000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140003b80 con 0x7f314815b810 2024-09-21T07:23:15.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3140003d20 con 0x7f314815b810 2024-09-21T07:23:15.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000aab0 con 0x7f314815b810 2024-09-21T07:23:15.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314814d040 con 0x7f314815b810 2024-09-21T07:23:15.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314814ddb0 con 0x7f314815b810 2024-09-21T07:23:15.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.280+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314814d820 con 0x7f314815b810 2024-09-21T07:23:15.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.284+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f314000ac50 con 0x7f314815b810 2024-09-21T07:23:15.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.284+0000 7f313fe00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 0x7f3124075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:15.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.284+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3140094e60 con 0x7f314815b810 2024-09-21T07:23:15.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.284+0000 7f3146a00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 0x7f3124075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:15.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.284+0000 7f3146a00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 0x7f3124075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3138000f70 tx=0x7f31380079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:15.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.288+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f314806d970 con 0x7f314815b810 2024-09-21T07:23:15.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.500+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f314806d430 con 0x7f314815b810 2024-09-21T07:23:15.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.500+0000 7f313fe00640 1 -- 172.21.15.64:0/2406301418 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f314005fb20 con 0x7f314815b810 2024-09-21T07:23:15.507 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:23:15.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 msgr2=0x7f3124075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 0x7f3124075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3138000f70 tx=0x7f31380079c0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 msgr2=0x7f31480cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f314000c760 tx=0x7f314000cc20 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 shutdown_connections 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3124073200 0x7f3124075710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f314815b810 0x7f31480cd440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f314806f620 0x7f314814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 --2- 172.21.15.64:0/2406301418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f314806d020 0x7f314814d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 >> 172.21.15.64:0/2406301418 conn(0x7f31480d0de0 msgr2=0x7f31480ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 shutdown_connections 2024-09-21T07:23:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15.504+0000 7f314de00640 1 -- 172.21.15.64:0/2406301418 wait complete. 2024-09-21T07:23:15.529 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:23:15.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:23:15.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:23:15.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:15.530 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:23:15.539 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.540 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.541 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-21T07:23:15.542 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.542 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:23:15.542 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:23:15.542 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-21T07:23:15.542 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:15.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:15.543 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:23:15.601 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:23:15.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:15.603 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:23:15.662 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:23:15.662 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:23:15.662 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:23:15.662 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:23:15.662 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:15.663 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:23:15.663 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:15.663 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:15.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:23:15.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:23:15.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:23:15.664 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:15.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:15.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:15.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:15.802 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:23:15.852 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:23:15.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:15.853 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-09-21T07:23:15.909 INFO:teuthology.orchestra.run.smithi064.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T07:23:15.909 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:15.909 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:15.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:23:15.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T07:23:15.910 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:15.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:16.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:16.036 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 3a:4a:0e:7f:be:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:23:16.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.101 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::384a:eff:fe7f:be65/64 scope link 2024-09-21T07:23:16.101 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:16.102 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:23:16.167 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 3a:4a:0e:7f:be:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::384a:eff:fe7f:be65/64 scope link 2024-09-21T07:23:16.168 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:16.169 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T07:23:16.170 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:16.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:16.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.352 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:16.352 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:16.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.1 up 2024-09-21T07:23:16.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:23:16.352 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:16.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:16.438 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T07:23:16.487 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:23:16.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:16.488 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:23:16.538 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T07:23:16.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:16.539 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:16.645 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:16.645 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:23:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 2@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:23:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:23:16.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:23:16.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:16.664 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:23:16.683 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:16.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:16.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.791 INFO:teuthology.orchestra.run.smithi064.stdout:client4725 2024-09-21T07:23:16.791 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:16.792 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:16.801 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:16.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:16.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.902 INFO:teuthology.orchestra.run.smithi064.stdout:client4725 2024-09-21T07:23:16.902 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:16.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:16.960 INFO:teuthology.orchestra.run.smithi064.stdout:client4725 2024-09-21T07:23:16.961 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/be0ccda5-3d1a-4615-9c09-c8d9d4461231.client4725/status') 2024-09-21T07:23:17.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:17.021 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4725 (3)192.168.0.2:0/3741986151 2024-09-21T07:23:17.021 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2024-09-21T07:23:17.021 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2024-09-21T07:23:17.021 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2024-09-21T07:23:17.021 INFO:teuthology.orchestra.run.smithi064.stderr:69 bytes copied, 5.2798e-05 s, 1.3 MB/s 2024-09-21T07:23:17.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:17.029 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T07:23:17.029 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:23:17.029 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:23:17.029 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:23:17.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 -- 172.21.15.64:0/729387873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc170004d50 msgr2=0x7fc170005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:17.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 --2- 172.21.15.64:0/729387873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc170004d50 0x7fc170005160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0735b0 tx=0x7fc18401d250 comp rx=0 tx=0).stop 2024-09-21T07:23:17.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc18a800640 1 -- 172.21.15.64:0/729387873 reap_dead start 2024-09-21T07:23:17.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 -- 172.21.15.64:0/729387873 shutdown_connections 2024-09-21T07:23:17.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 -- 172.21.15.64:0/729387873 >> 172.21.15.64:0/729387873 conn(0x7fc18c0d0de0 msgr2=0x7fc18c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:17.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 -- 172.21.15.64:0/729387873 shutdown_connections 2024-09-21T07:23:17.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.184+0000 7fc190c00640 1 -- 172.21.15.64:0/729387873 wait complete. 2024-09-21T07:23:17.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 Processor -- start 2024-09-21T07:23:17.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 -- start start 2024-09-21T07:23:17.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc170004d50 0x7fc18c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc18c158a70 0x7fc18c1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0700f0 con 0x7fc18c1f3af0 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c06ff70 con 0x7fc18c158a70 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc190c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c070270 con 0x7fc170004d50 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57814/0 (socket says 172.21.15.64:57814) 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 -- 172.21.15.64:0/2158840340 learned_addr learned my addr 172.21.15.64:0/2158840340 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc189e00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc170004d50 0x7fc18c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc181400640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc18c158a70 0x7fc18c1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 -- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc170004d50 msgr2=0x7fc18c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc170004d50 0x7fc18c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 -- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc18c158a70 msgr2=0x7fc18c1f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:17.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc18c158a70 0x7fc18c1f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 -- 172.21.15.64:0/2158840340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c158e80 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc18a800640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc18401d080 tx=0x7fc1840addc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.188+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840b1040 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1840bb070 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0c4af0 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184009730 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c0c50b0 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c070800 con 0x7fc18c1f3af0 2024-09-21T07:23:17.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc184004290 con 0x7fc18c1f3af0 2024-09-21T07:23:17.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc182a00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 0x7fc168075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:17.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc18412f450 con 0x7fc18c1f3af0 2024-09-21T07:23:17.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.192+0000 7fc189e00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 0x7fc168075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:17.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.196+0000 7fc189e00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 0x7fc168075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc17c001250 tx=0x7fc17c001120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:17.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.196+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc18c158e80 con 0x7fc18c1f3af0 2024-09-21T07:23:17.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.412+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc18c15df50 con 0x7fc18c1f3af0 2024-09-21T07:23:17.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.412+0000 7fc182a00640 1 -- 172.21.15.64:0/2158840340 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc184016f60 con 0x7fc18c1f3af0 2024-09-21T07:23:17.419 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:23:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 msgr2=0x7fc168075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 0x7fc168075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc17c001250 tx=0x7fc17c001120 comp rx=0 tx=0).stop 2024-09-21T07:23:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 msgr2=0x7fc18c1f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc18401d080 tx=0x7fc1840addc0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 shutdown_connections 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc168073200 0x7fc168075710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc18c1f3af0 0x7fc18c1f3f00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc18c158a70 0x7fc18c1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 --2- 172.21.15.64:0/2158840340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc170004d50 0x7fc18c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 >> 172.21.15.64:0/2158840340 conn(0x7fc18c0d0de0 msgr2=0x7fc18c0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 shutdown_connections 2024-09-21T07:23:17.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:17.416+0000 7fc190c00640 1 -- 172.21.15.64:0/2158840340 wait complete. 2024-09-21T07:23:17.441 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:23:17.441 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:23:17.441 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-21T07:23:17.441 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T07:23:17.441 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:23:17.442 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:23:17.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:23:17.442 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:23:17.442 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:23:17.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:17.442 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:17.452 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:23:17.453 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:42:2b:63:a2 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:17.454 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:23:17.454 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:17.454 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:23:17.455 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:17.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:17.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:17.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:17.619 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:23:17.637 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-21T07:23:17.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:17.639 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:23:17.708 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:23:17.709 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:23:17.709 INFO:teuthology.orchestra.run.smithi090.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:17.709 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:17.709 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:17.709 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:23:17.709 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:17.709 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:17.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:23:17.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:23:17.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:23:17.710 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:17.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:17.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:17.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:17.847 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:23:17.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:17.901 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-09-21T07:23:17.956 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:17.956 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:17.956 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:23:17.957 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T07:23:17.957 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:18.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:18.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:18.083 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T07:23:18.083 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:18.083 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:18.083 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T07:23:18.083 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:23:18.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T07:23:18.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T07:23:18.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T07:23:18.084 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:18.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:18.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:18.254 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:18.254 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:18.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-21T07:23:18.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:23:18.255 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:18.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:18.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:18.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:18.338 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T07:23:18.346 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:23:18.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:18.346 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:23:18.400 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T07:23:18.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:18.400 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:18.504 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:18.504 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:19.179 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:19.180 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:19.180 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:23:19.180 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 1@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:23:19.180 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:23:19.183 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:23:19.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:19.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:23:19.202 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:19.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:19.313 INFO:teuthology.orchestra.run.smithi090.stdout:client4774 2024-09-21T07:23:19.313 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:19.313 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:19.368 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:19.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:19.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:19.469 INFO:teuthology.orchestra.run.smithi090.stdout:client4774 2024-09-21T07:23:19.469 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:19.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:19.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:19.526 INFO:teuthology.orchestra.run.smithi090.stdout:client4774 2024-09-21T07:23:19.526 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/be0ccda5-3d1a-4615-9c09-c8d9d4461231.client4774/status') 2024-09-21T07:23:19.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:19.626 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4774 (3)192.168.0.1:0/788954247 2024-09-21T07:23:19.626 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-09-21T07:23:19.626 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-09-21T07:23:19.626 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-09-21T07:23:19.626 INFO:teuthology.orchestra.run.smithi090.stderr:68 bytes copied, 5.2841e-05 s, 1.3 MB/s 2024-09-21T07:23:19.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:19.634 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T07:23:19.634 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:23:19.634 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:23:19.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:23:19.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 -- 172.21.15.64:0/246073489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 msgr2=0x7f469015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 --2- 172.21.15.64:0/246073489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f469015f510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4690070d40 tx=0x7f467801c6d0 comp rx=0 tx=0).stop 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 -- 172.21.15.64:0/246073489 shutdown_connections 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 --2- 172.21.15.64:0/246073489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f469015f510 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 -- 172.21.15.64:0/246073489 >> 172.21.15.64:0/246073489 conn(0x7f46900b2ca0 msgr2=0x7f46900b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 -- 172.21.15.64:0/246073489 shutdown_connections 2024-09-21T07:23:19.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.800+0000 7f4696c00640 1 -- 172.21.15.64:0/246073489 wait complete. 2024-09-21T07:23:19.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 Processor -- start 2024-09-21T07:23:19.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 -- start start 2024-09-21T07:23:19.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f469006fba0 0x7f4690150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46900cd790 0x7f4690155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46900b6ab0 con 0x7f469015f100 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46900b6930 con 0x7f469006fba0 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4696c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f46900b6c30 con 0x7f46900cd790 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4694c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4694c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57830/0 (socket says 172.21.15.64:57830) 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4694c00640 1 -- 172.21.15.64:0/2446097840 learned_addr learned my addr 172.21.15.64:0/2446097840 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f468fe00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f469006fba0 0x7f4690150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.804+0000 7f4687e00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46900cd790 0x7f4690155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 -- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46900cd790 msgr2=0x7f4690155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46900cd790 0x7f4690155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 -- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f469006fba0 msgr2=0x7f4690150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:19.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f469006fba0 0x7f4690150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:19.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 -- 172.21.15.64:0/2446097840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469015dd90 con 0x7f469015f100 2024-09-21T07:23:19.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4694c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f468800c730 tx=0x7f468800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:19.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688003b80 con 0x7f469015f100 2024-09-21T07:23:19.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4688003d40 con 0x7f469015f100 2024-09-21T07:23:19.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880052d0 con 0x7f469015f100 2024-09-21T07:23:19.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469015ccf0 con 0x7f469015f100 2024-09-21T07:23:19.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469015d2b0 con 0x7f469015f100 2024-09-21T07:23:19.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469015ca60 con 0x7f469015f100 2024-09-21T07:23:19.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.808+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4688005680 con 0x7f469015f100 2024-09-21T07:23:19.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.812+0000 7f468cc00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 0x7f466c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:19.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.812+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4688094400 con 0x7f469015f100 2024-09-21T07:23:19.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.812+0000 7f468fe00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 0x7f466c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:19.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.812+0000 7f468fe00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 0x7f466c075710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46800098e0 tx=0x7f4680009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:19.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:19.816+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f468805eb20 con 0x7f469015f100 2024-09-21T07:23:20.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.032+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f469015f510 con 0x7f469015f100 2024-09-21T07:23:20.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.032+0000 7f468cc00640 1 -- 172.21.15.64:0/2446097840 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f4688063550 con 0x7f469015f100 2024-09-21T07:23:20.038 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:23:20.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 msgr2=0x7f466c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:20.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 0x7f466c075710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46800098e0 tx=0x7f4680009060 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 msgr2=0x7f4690155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f468800c730 tx=0x7f468800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 shutdown_connections 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f466c073200 0x7f466c075710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f469015f100 0x7f4690155950 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46900cd790 0x7f4690155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 --2- 172.21.15.64:0/2446097840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f469006fba0 0x7f4690150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 >> 172.21.15.64:0/2446097840 conn(0x7f46900b2ca0 msgr2=0x7f4690158170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 shutdown_connections 2024-09-21T07:23:20.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:20.036+0000 7f4696c00640 1 -- 172.21.15.64:0/2446097840 wait complete. 2024-09-21T07:23:20.060 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:23:20.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:23:20.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:23:20.061 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:23:20.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.061 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-21T07:23:20.070 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:20.070 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:20.071 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:42:2b:63:a2 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:23:20.072 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:23:20.073 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.074 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:23:20.138 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-21T07:23:20.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.140 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-21T07:23:20.194 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-21T07:23:20.194 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:20.195 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:23:20.195 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:20.196 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:20.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:23:20.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:23:20.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:23:20.196 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:20.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:20.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:20.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.330 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:23:20.339 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:23:20.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.340 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-09-21T07:23:20.388 INFO:teuthology.orchestra.run.smithi090.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T07:23:20.388 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:20.388 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:20.388 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:23:20.388 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T07:23:20.388 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:20.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:20.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:23:20.529 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 1a:9d:c8:ea:d7:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::189d:c8ff:feea:d7ba/64 scope link 2024-09-21T07:23:20.530 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:23:20.592 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:20.592 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:20.592 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:20.592 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 1a:9d:c8:ea:d7:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::189d:c8ff:feea:d7ba/64 scope link 2024-09-21T07:23:20.593 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:20.595 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T07:23:20.595 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:20.595 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:20.595 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T07:23:20.595 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:23:20.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T07:23:20.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T07:23:20.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T07:23:20.596 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:20.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:20.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:20.779 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:20.779 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T07:23:20.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.1 up 2024-09-21T07:23:20.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:23:20.779 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T07:23:20.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:20.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:20.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:20.903 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T07:23:20.911 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:23:20.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:20.912 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:23:20.963 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T07:23:20.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:20.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:21.062 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:21.063 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:21.078 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:21.078 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:21.078 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:23:21.078 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 3@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:23:21.078 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:23:21.081 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:23:21.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:21.082 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:23:21.100 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:21.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:21.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:21.200 INFO:teuthology.orchestra.run.smithi090.stdout:client4613 2024-09-21T07:23:21.200 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:21.200 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:21.256 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:21.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:21.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:21.355 INFO:teuthology.orchestra.run.smithi090.stdout:client4613 2024-09-21T07:23:21.355 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:21.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:21.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:21.452 INFO:teuthology.orchestra.run.smithi090.stdout:client4613 2024-09-21T07:23:21.452 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/be0ccda5-3d1a-4615-9c09-c8d9d4461231.client4613/status') 2024-09-21T07:23:21.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:21.557 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4613 (3)192.168.0.2:0/2391054191 2024-09-21T07:23:21.557 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-09-21T07:23:21.557 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-09-21T07:23:21.557 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-09-21T07:23:21.557 INFO:teuthology.orchestra.run.smithi090.stderr:69 bytes copied, 4.8813e-05 s, 1.4 MB/s 2024-09-21T07:23:21.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T07:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:21.565 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T07:23:21.652 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-21T07:23:21.653 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:23:21.653 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 -- 172.21.15.64:0/542249369 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d4c0052a0 msgr2=0x7f9d4c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 --2- 172.21.15.64:0/542249369 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d4c0052a0 0x7f9d4c00b9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d68072dd0 tx=0x7f9d6001d5d0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6d800640 1 -- 172.21.15.64:0/542249369 reap_dead start 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 -- 172.21.15.64:0/542249369 shutdown_connections 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 -- 172.21.15.64:0/542249369 >> 172.21.15.64:0/542249369 conn(0x7f9d680ccbe0 msgr2=0x7f9d680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 -- 172.21.15.64:0/542249369 shutdown_connections 2024-09-21T07:23:21.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.820+0000 7f9d6f800640 1 -- 172.21.15.64:0/542249369 wait complete. 2024-09-21T07:23:21.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 Processor -- start 2024-09-21T07:23:21.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 -- start start 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c0052a0 0x7f9d680cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d681fa0f0 0x7f9d6814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680731b0 con 0x7f9d681f94a0 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68073030 con 0x7f9d4c0052a0 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d68073330 con 0x7f9d681fa0f0 2024-09-21T07:23:21.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57842/0 (socket says 172.21.15.64:57842) 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 -- 172.21.15.64:0/3949691937 learned_addr learned my addr 172.21.15.64:0/3949691937 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d681fa0f0 0x7f9d6814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6ce00640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c0052a0 0x7f9d680cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 -- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d681fa0f0 msgr2=0x7f9d6814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d681fa0f0 0x7f9d6814c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 -- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c0052a0 msgr2=0x7f9d680cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c0052a0 0x7f9d680cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 -- 172.21.15.64:0/3949691937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d681f9df0 con 0x7f9d681f94a0 2024-09-21T07:23:21.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d6d800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d60002240 tx=0x7f9d600aae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.824+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600a9450 con 0x7f9d681f94a0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d60004b40 con 0x7f9d681f94a0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d680cba30 con 0x7f9d681f94a0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60005070 con 0x7f9d681f94a0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d680cbff0 con 0x7f9d681f94a0 2024-09-21T07:23:21.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d68073890 con 0x7f9d681f94a0 2024-09-21T07:23:21.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d600a7040 con 0x7f9d681f94a0 2024-09-21T07:23:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d65600640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 0x7f9d44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9d6012f7f0 con 0x7f9d681f94a0 2024-09-21T07:23:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.828+0000 7f9d6ce00640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 0x7f9d44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.832+0000 7f9d6ce00640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 0x7f9d44075710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d580068e0 tx=0x7f9d58006ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:21.832+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9d681f9df0 con 0x7f9d681f94a0 2024-09-21T07:23:22.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.012+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d6809da20 con 0x7f9d681f94a0 2024-09-21T07:23:22.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d65600640 1 -- 172.21.15.64:0/3949691937 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f9d600ad030 con 0x7f9d681f94a0 2024-09-21T07:23:22.021 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:22.021 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:22:53.193330+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:22.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 msgr2=0x7f9d44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 0x7f9d44075710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d580068e0 tx=0x7f9d58006ac0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 msgr2=0x7f9d681f98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d60002240 tx=0x7f9d600aae70 comp rx=0 tx=0).stop 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 shutdown_connections 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d44073200 0x7f9d44075710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f94a0 0x7f9d681f98b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d681fa0f0 0x7f9d6814c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 --2- 172.21.15.64:0/3949691937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c0052a0 0x7f9d680cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 >> 172.21.15.64:0/3949691937 conn(0x7f9d680ccbe0 msgr2=0x7f9d68069020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 shutdown_connections 2024-09-21T07:23:22.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.016+0000 7f9d6f800640 1 -- 172.21.15.64:0/3949691937 wait complete. 2024-09-21T07:23:22.045 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:22:46.127713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:22:47.103471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:22:50.750858+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T07:23:22.045 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:23:22.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1718942199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd00b59e0 msgr2=0x7f9bd015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1718942199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd00b59e0 0x7f9bd015aee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009840 tx=0x7f9bc801c790 comp rx=0 tx=0).stop 2024-09-21T07:23:22.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1718942199 shutdown_connections 2024-09-21T07:23:22.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1718942199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd00b59e0 0x7f9bd015aee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1718942199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00cf8a0 0x7f9bd0073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1718942199 >> 172.21.15.64:0/1718942199 conn(0x7f9bd00cdd10 msgr2=0x7f9bd00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1718942199 shutdown_connections 2024-09-21T07:23:22.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.200+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1718942199 wait complete. 2024-09-21T07:23:22.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 Processor -- start 2024-09-21T07:23:22.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- start start 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00b59e0 0x7f9bd0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 0x7f9bd00703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd0169790 con 0x7f9bd006ff90 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd0169610 con 0x7f9bd0156590 2024-09-21T07:23:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd0169910 con 0x7f9bd00b59e0 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57854/0 (socket says 172.21.15.64:57854) 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 -- 172.21.15.64:0/1217397222 learned_addr learned my addr 172.21.15.64:0/1217397222 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bc7400640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00b59e0 0x7f9bd0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd4e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 0x7f9bd00703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 -- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00b59e0 msgr2=0x7f9bd0150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00b59e0 0x7f9bd0150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 -- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 msgr2=0x7f9bd00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 0x7f9bd00703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 -- 172.21.15.64:0/1217397222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd00c5720 con 0x7f9bd006ff90 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd4e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 0x7f9bd00703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bcfe00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0001700 tx=0x7f9bc000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0017070 con 0x7f9bd006ff90 2024-09-21T07:23:22.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bc0005070 con 0x7f9bd006ff90 2024-09-21T07:23:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd00c5a00 con 0x7f9bd006ff90 2024-09-21T07:23:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0005460 con 0x7f9bd006ff90 2024-09-21T07:23:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.204+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd00c5fc0 con 0x7f9bd006ff90 2024-09-21T07:23:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd00c5480 con 0x7f9bd006ff90 2024-09-21T07:23:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9bc001a070 con 0x7f9bd006ff90 2024-09-21T07:23:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bccc00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 0x7f9bac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9bc0093b00 con 0x7f9bd006ff90 2024-09-21T07:23:22.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bc7400640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 0x7f9bac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.208+0000 7f9bc7400640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 0x7f9bac075710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0156460 tx=0x7f9bb80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.212+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9bd00c5480 con 0x7f9bd006ff90 2024-09-21T07:23:22.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.388+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9bd015aee0 con 0x7f9bd006ff90 2024-09-21T07:23:22.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.388+0000 7f9bccc00640 1 -- 172.21.15.64:0/1217397222 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f9bc0093e20 con 0x7f9bd006ff90 2024-09-21T07:23:22.395 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 msgr2=0x7f9bac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 0x7f9bac075710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0156460 tx=0x7f9bb80091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 msgr2=0x7f9bd0155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0001700 tx=0x7f9bc000cc20 comp rx=0 tx=0).stop 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 shutdown_connections 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bac073200 0x7f9bac075710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd0156590 0x7f9bd00703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bd00b59e0 0x7f9bd0150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 --2- 172.21.15.64:0/1217397222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bd006ff90 0x7f9bd0155590 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 >> 172.21.15.64:0/1217397222 conn(0x7f9bd00cdd10 msgr2=0x7f9bd00b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 shutdown_connections 2024-09-21T07:23:22.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.392+0000 7f9bd6e00640 1 -- 172.21.15.64:0/1217397222 wait complete. 2024-09-21T07:23:22.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.572+0000 7fb8ee600640 1 -- 172.21.15.64:0/1420439457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80ce900 msgr2=0x7fb8e806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.572+0000 7fb8ee600640 1 --2- 172.21.15.64:0/1420439457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80ce900 0x7fb8e806f890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009bc0 tx=0x7fb8e001cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.572+0000 7fb8ee600640 1 -- 172.21.15.64:0/1420439457 shutdown_connections 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.572+0000 7fb8ee600640 1 --2- 172.21.15.64:0/1420439457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80ce900 0x7fb8e806f890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.572+0000 7fb8ee600640 1 --2- 172.21.15.64:0/1420439457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e809df30 0x7fb8e80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- 172.21.15.64:0/1420439457 >> 172.21.15.64:0/1420439457 conn(0x7fb8e806d450 msgr2=0x7fb8e80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- 172.21.15.64:0/1420439457 shutdown_connections 2024-09-21T07:23:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- 172.21.15.64:0/1420439457 wait complete. 2024-09-21T07:23:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 Processor -- start 2024-09-21T07:23:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- start start 2024-09-21T07:23:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8e809df30 0x7fb8e80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e80ce900 0x7fb8e814c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8169000 con 0x7fb8e80b3910 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8168e80 con 0x7fb8e809df30 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.576+0000 7fb8ee600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e8169180 con 0x7fb8e80ce900 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57870/0 (socket says 172.21.15.64:57870) 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 -- 172.21.15.64:0/2214895555 learned_addr learned my addr 172.21.15.64:0/2214895555 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8e7400640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8e809df30 0x7fb8e80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8e7e00640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e80ce900 0x7fb8e814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 -- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e80ce900 msgr2=0x7fb8e814c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e80ce900 0x7fb8e814c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 -- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8e809df30 msgr2=0x7fb8e80c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8e809df30 0x7fb8e80c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 -- 172.21.15.64:0/2214895555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80ca420 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8dfe00640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c400 tx=0x7fb8d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011790 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8d0017070 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011cc0 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e815cfe0 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e815d5a0 con 0x7fb8e80b3910 2024-09-21T07:23:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e80b33d0 con 0x7fb8e80b3910 2024-09-21T07:23:22.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.580+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb8d001c460 con 0x7fb8e80b3910 2024-09-21T07:23:22.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.584+0000 7fb8df400640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 0x7fb8c4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.584+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb8d0094290 con 0x7fb8e80b3910 2024-09-21T07:23:22.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.584+0000 7fb8e7400640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 0x7fb8c4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.584+0000 7fb8e7400640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 0x7fb8c4075740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80095b0 tx=0x7fb8d8005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.588+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb8d005e880 con 0x7fb8e80b3910 2024-09-21T07:23:22.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb8e80cd8d0 con 0x7fb8e80b3910 2024-09-21T07:23:22.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8df400640 1 -- 172.21.15.64:0/2214895555 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fb8d00632b0 con 0x7fb8e80b3910 2024-09-21T07:23:22.770 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 msgr2=0x7fb8c4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 0x7fb8c4075740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80095b0 tx=0x7fb8d8005f40 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 msgr2=0x7fb8e815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.764+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c400 tx=0x7fb8d000c8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 shutdown_connections 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8c4073230 0x7fb8c4075740 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8e80ce900 0x7fb8e814c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e80b3910 0x7fb8e815e450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 --2- 172.21.15.64:0/2214895555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8e809df30 0x7fb8e80c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 >> 172.21.15.64:0/2214895555 conn(0x7fb8e806d450 msgr2=0x7fb8e809ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 shutdown_connections 2024-09-21T07:23:22.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.768+0000 7fb8ee600640 1 -- 172.21.15.64:0/2214895555 wait complete. 2024-09-21T07:23:22.792 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- 172.21.15.64:0/3352762187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9015f9a0 msgr2=0x7f8a9015fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 --2- 172.21.15.64:0/3352762187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9015f9a0 0x7f8a9015fdb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a900cfc10 tx=0x7f8a7801c800 comp rx=0 tx=0).stop 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- 172.21.15.64:0/3352762187 shutdown_connections 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 --2- 172.21.15.64:0/3352762187 >> v2:172.21.15.90:3300/0 conn(0x7f8a901602f0 0x7f8a9006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 --2- 172.21.15.64:0/3352762187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9015f9a0 0x7f8a9015fdb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- 172.21.15.64:0/3352762187 >> 172.21.15.64:0/3352762187 conn(0x7f8a9006d450 msgr2=0x7f8a900d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:22.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- 172.21.15.64:0/3352762187 shutdown_connections 2024-09-21T07:23:22.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- 172.21.15.64:0/3352762187 wait complete. 2024-09-21T07:23:22.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 Processor -- start 2024-09-21T07:23:22.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.948+0000 7f8a95800640 1 -- start start 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a9009df30 0x7f8a9009b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a9015f9a0 0x7f8a90148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90168df0 con 0x7f8a901602f0 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90168c70 con 0x7f8a9015f9a0 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8a90168f70 con 0x7f8a9009df30 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57880/0 (socket says 172.21.15.64:57880) 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 -- 172.21.15.64:0/563117438 learned_addr learned my addr 172.21.15.64:0/563117438 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8ea00640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a9009df30 0x7f8a9009b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a86000640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a9015f9a0 0x7f8a90148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 -- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a9009df30 msgr2=0x7f8a9009b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a9009df30 0x7f8a9009b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 -- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a9015f9a0 msgr2=0x7f8a90148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:22.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a9015f9a0 0x7f8a90148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:22.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 -- 172.21.15.64:0/563117438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9014efb0 con 0x7f8a901602f0 2024-09-21T07:23:22.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a8f400640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800e970 tx=0x7f8a8800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88004d30 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a900afcb0 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a8800cb20 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88005020 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a90148940 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.952+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9015fdb0 con 0x7f8a901602f0 2024-09-21T07:23:22.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.956+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a880051c0 con 0x7f8a901602f0 2024-09-21T07:23:22.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.956+0000 7f8a87400640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 0x7f8a6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:22.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.956+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8a88094eb0 con 0x7f8a901602f0 2024-09-21T07:23:22.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.956+0000 7f8a8ea00640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 0x7f8a6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:22.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.956+0000 7f8a8ea00640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 0x7f8a6c075740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a80007fd0 tx=0x7f8a80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:22.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:22.960+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8a88016030 con 0x7f8a901602f0 2024-09-21T07:23:23.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a900cd510 con 0x7f8a901602f0 2024-09-21T07:23:23.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a87400640 1 -- 172.21.15.64:0/563117438 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f8a8805f420 con 0x7f8a901602f0 2024-09-21T07:23:23.141 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 msgr2=0x7f8a6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 0x7f8a6c075740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a80007fd0 tx=0x7f8a80009040 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 msgr2=0x7f8a900b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800e970 tx=0x7f8a8800ee30 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 shutdown_connections 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a6c073230 0x7f8a6c075740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a901602f0 0x7f8a900b25c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a9015f9a0 0x7f8a90148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 --2- 172.21.15.64:0/563117438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a9009df30 0x7f8a9009b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 >> 172.21.15.64:0/563117438 conn(0x7f8a9006d450 msgr2=0x7f8a9015b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:23.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 shutdown_connections 2024-09-21T07:23:23.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.136+0000 7f8a95800640 1 -- 172.21.15.64:0/563117438 wait complete. 2024-09-21T07:23:23.163 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T07:23:23.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.316+0000 7efda6200640 1 -- 172.21.15.64:0/1604893290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 msgr2=0x7efda00b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.316+0000 7efda6200640 1 --2- 172.21.15.64:0/1604893290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00b44a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efda00d2280 tx=0x7efd9801caf0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 -- 172.21.15.64:0/1604893290 shutdown_connections 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 --2- 172.21.15.64:0/1604893290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00b44a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 --2- 172.21.15.64:0/1604893290 >> v2:172.21.15.90:3300/0 conn(0x7efda00ce7e0 0x7efda00cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 -- 172.21.15.64:0/1604893290 >> 172.21.15.64:0/1604893290 conn(0x7efda00cdcc0 msgr2=0x7efda00ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 -- 172.21.15.64:0/1604893290 shutdown_connections 2024-09-21T07:23:23.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 -- 172.21.15.64:0/1604893290 wait complete. 2024-09-21T07:23:23.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 Processor -- start 2024-09-21T07:23:23.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 -- start start 2024-09-21T07:23:23.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.320+0000 7efda6200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efda00b2cc0 0x7efda01578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efda00ce7e0 0x7efda00ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efda0168d00 con 0x7efda00b4090 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efda0168b80 con 0x7efda00ce7e0 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efda0168e80 con 0x7efda00b2cc0 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57888/0 (socket says 172.21.15.64:57888) 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 -- 172.21.15.64:0/835570588 learned_addr learned my addr 172.21.15.64:0/835570588 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd9fe00640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efda00ce7e0 0x7efda00ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd9f400640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efda00b2cc0 0x7efda01578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 -- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efda00b2cc0 msgr2=0x7efda01578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efda00b2cc0 0x7efda01578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 -- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efda00ce7e0 msgr2=0x7efda00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efda00ce7e0 0x7efda00ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 -- 172.21.15.64:0/835570588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda0069570 con 0x7efda00b4090 2024-09-21T07:23:23.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97e00640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c400 tx=0x7efd8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88011790 con 0x7efda00b4090 2024-09-21T07:23:23.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd88017070 con 0x7efda00b4090 2024-09-21T07:23:23.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda009e9e0 con 0x7efda00b4090 2024-09-21T07:23:23.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88011cc0 con 0x7efda00b4090 2024-09-21T07:23:23.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda00cabe0 con 0x7efda00b4090 2024-09-21T07:23:23.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda00b2620 con 0x7efda00b4090 2024-09-21T07:23:23.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.324+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd8801c460 con 0x7efda00b4090 2024-09-21T07:23:23.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.328+0000 7efd97400640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.328+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd88094410 con 0x7efda00b4090 2024-09-21T07:23:23.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.328+0000 7efd9f400640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.328+0000 7efd9f400640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 0x7efd7c075710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efda00d1210 tx=0x7efd90005dd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.332+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efd8805f070 con 0x7efda00b4090 2024-09-21T07:23:23.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efda00b44a0 con 0x7efda00b4090 2024-09-21T07:23:23.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efd97400640 1 -- 172.21.15.64:0/835570588 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7efd8805e970 con 0x7efda00b4090 2024-09-21T07:23:23.514 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 msgr2=0x7efd7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 0x7efd7c075710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efda00d1210 tx=0x7efd90005dd0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 msgr2=0x7efda00cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.508+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c400 tx=0x7efd8800c8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 shutdown_connections 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efda00ce7e0 0x7efda00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda00b4090 0x7efda00cc750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 --2- 172.21.15.64:0/835570588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efda00b2cc0 0x7efda01578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 >> 172.21.15.64:0/835570588 conn(0x7efda00cdcc0 msgr2=0x7efda00af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:23.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 shutdown_connections 2024-09-21T07:23:23.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.512+0000 7efda6200640 1 -- 172.21.15.64:0/835570588 wait complete. 2024-09-21T07:23:23.536 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-21T07:23:23.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 -- 172.21.15.64:0/550763312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c0709b0 msgr2=0x7f018c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 --2- 172.21.15.64:0/550763312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c0709b0 0x7f018c0b41c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f018c0af810 tx=0x7f017801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 -- 172.21.15.64:0/550763312 shutdown_connections 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 --2- 172.21.15.64:0/550763312 >> v2:172.21.15.90:3300/0 conn(0x7f018c0b4700 0x7f018c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 --2- 172.21.15.64:0/550763312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c0709b0 0x7f018c0b41c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 -- 172.21.15.64:0/550763312 >> 172.21.15.64:0/550763312 conn(0x7f018c0ccbe0 msgr2=0x7f018c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 -- 172.21.15.64:0/550763312 shutdown_connections 2024-09-21T07:23:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.688+0000 7f0193800640 1 -- 172.21.15.64:0/550763312 wait complete. 2024-09-21T07:23:23.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 Processor -- start 2024-09-21T07:23:23.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- start start 2024-09-21T07:23:23.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c0709b0 0x7f018c146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 0x7f018c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f018c168c30 con 0x7f018c15edb0 2024-09-21T07:23:23.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f018c168ab0 con 0x7f018c0709b0 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f018c168db0 con 0x7f018c0b4700 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57910/0 (socket says 172.21.15.64:57910) 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 -- 172.21.15.64:0/608450144 learned_addr learned my addr 172.21.15.64:0/608450144 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0190e00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c0709b0 0x7f018c146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f018be00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 0x7f018c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 -- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 msgr2=0x7f018c155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 0x7f018c155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 -- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c0709b0 msgr2=0x7f018c146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c0709b0 0x7f018c146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 -- 172.21.15.64:0/608450144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c156aa0 con 0x7f018c15edb0 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f018be00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 0x7f018c155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0191800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f018400e940 tx=0x7f018400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184004d30 con 0x7f018c15edb0 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f018400cb20 con 0x7f018c15edb0 2024-09-21T07:23:23.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184005020 con 0x7f018c15edb0 2024-09-21T07:23:23.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c0cb320 con 0x7f018c15edb0 2024-09-21T07:23:23.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.692+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c163ab0 con 0x7f018c15edb0 2024-09-21T07:23:23.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.696+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c156810 con 0x7f018c15edb0 2024-09-21T07:23:23.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.696+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f01840051c0 con 0x7f018c15edb0 2024-09-21T07:23:23.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.696+0000 7f0188c00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 0x7f016c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.696+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0184094d70 con 0x7f018c15edb0 2024-09-21T07:23:23.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.696+0000 7f0190e00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 0x7f016c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.700+0000 7f0190e00640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 0x7f016c075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0180007fd0 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.700+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0184016030 con 0x7f018c15edb0 2024-09-21T07:23:23.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:23.944+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f018c0b41c0 con 0x7f018c15edb0 2024-09-21T07:23:24.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.892+0000 7f0188c00640 1 -- 172.21.15.64:0/608450144 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v58) ==== 151+0+0 (secure 0 0 0) 0x7f018405f360 con 0x7f018c15edb0 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 msgr2=0x7f016c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 0x7f016c075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0180007fd0 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 msgr2=0x7f018c0ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f018400e940 tx=0x7f018400ee00 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 shutdown_connections 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f016c073200 0x7f016c075710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f018c15edb0 0x7f018c0ad4d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f018c0b4700 0x7f018c155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 --2- 172.21.15.64:0/608450144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c0709b0 0x7f018c146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 >> 172.21.15.64:0/608450144 conn(0x7f018c0ccbe0 msgr2=0x7f018c15e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 shutdown_connections 2024-09-21T07:23:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:24.896+0000 7f0193800640 1 -- 172.21.15.64:0/608450144 wait complete. 2024-09-21T07:23:24.927 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:23:25.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- 172.21.15.64:0/3727618652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00704c0 msgr2=0x7feff0151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 --2- 172.21.15.64:0/3727618652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00704c0 0x7feff0151d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009bc0 tx=0x7fefe801cb70 comp rx=0 tx=0).stop 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- 172.21.15.64:0/3727618652 shutdown_connections 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 --2- 172.21.15.64:0/3727618652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00704c0 0x7feff0151d20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 --2- 172.21.15.64:0/3727618652 >> v2:172.21.15.90:3300/0 conn(0x7feff00d0860 0x7feff006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- 172.21.15.64:0/3727618652 >> 172.21.15.64:0/3727618652 conn(0x7feff00d1330 msgr2=0x7feff00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- 172.21.15.64:0/3727618652 shutdown_connections 2024-09-21T07:23:25.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- 172.21.15.64:0/3727618652 wait complete. 2024-09-21T07:23:25.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 Processor -- start 2024-09-21T07:23:25.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.088+0000 7feff5c00640 1 -- start start 2024-09-21T07:23:25.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff00d0450 0x7feff00b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00d0860 0x7feff0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feff00ccca0 con 0x7feff00704c0 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feff00ccb20 con 0x7feff00d0450 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feff00cce20 con 0x7feff00d0860 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60574/0 (socket says 172.21.15.64:60574) 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 -- 172.21.15.64:0/639648361 learned_addr learned my addr 172.21.15.64:0/639648361 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefe7e00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff00d0450 0x7feff00b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5200640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00d0860 0x7feff0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 -- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00d0860 msgr2=0x7feff0156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00d0860 0x7feff0156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 -- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff00d0450 msgr2=0x7feff00b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff00d0450 0x7feff00b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 -- 172.21.15.64:0/639648361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff0158190 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefefe00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c760 tx=0x7fefe000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0016020 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefe000a950 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff0159430 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe000ada0 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff0158410 con 0x7feff00704c0 2024-09-21T07:23:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff00cd2d0 con 0x7feff00704c0 2024-09-21T07:23:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.092+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fefe0019020 con 0x7feff00704c0 2024-09-21T07:23:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.096+0000 7fefecc00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 0x7fefcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.096+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fefe0094400 con 0x7feff00704c0 2024-09-21T07:23:25.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.096+0000 7fefe7e00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 0x7fefcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.096+0000 7fefe7e00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 0x7fefcc075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feff01f4510 tx=0x7fefd800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.100+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fefe0020020 con 0x7feff00704c0 2024-09-21T07:23:25.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.276+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7feff00750d0 con 0x7feff00704c0 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.276+0000 7fefecc00640 1 -- 172.21.15.64:0/639648361 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7feff0158190 con 0x7feff00704c0 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:23:25.283 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:23:25.284 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:23:25.285 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 msgr2=0x7fefcc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 0x7fefcc075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feff01f4510 tx=0x7fefd800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 msgr2=0x7feff0158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c760 tx=0x7fefe000cc20 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 shutdown_connections 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fefcc073200 0x7fefcc075710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feff00d0860 0x7feff0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff00d0450 0x7feff00b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 --2- 172.21.15.64:0/639648361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feff00704c0 0x7feff0158ef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 >> 172.21.15.64:0/639648361 conn(0x7feff00d1330 msgr2=0x7feff00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 shutdown_connections 2024-09-21T07:23:25.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.280+0000 7feff5c00640 1 -- 172.21.15.64:0/639648361 wait complete. 2024-09-21T07:23:25.305 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 -- 172.21.15.64:0/909930019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 msgr2=0x7fa0e4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 --2- 172.21.15.64:0/909930019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa0e4003ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009b50 tx=0x7fa0f001d270 comp rx=0 tx=0).stop 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa0ffe00640 1 -- 172.21.15.64:0/909930019 reap_dead start 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 -- 172.21.15.64:0/909930019 shutdown_connections 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 -- 172.21.15.64:0/909930019 >> 172.21.15.64:0/909930019 conn(0x7fa10006d450 msgr2=0x7fa1000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 -- 172.21.15.64:0/909930019 shutdown_connections 2024-09-21T07:23:25.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.460+0000 7fa106400640 1 -- 172.21.15.64:0/909930019 wait complete. 2024-09-21T07:23:25.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 Processor -- start 2024-09-21T07:23:25.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 -- start start 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 0x7fa1000b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1000b2890 0x7fa1000c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1000cd100 con 0x7fa0e4003a80 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1000ccf80 con 0x7fa10009cb50 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa106400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa1000cd280 con 0x7fa1000b2890 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa0ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa0ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60590/0 (socket says 172.21.15.64:60590) 2024-09-21T07:23:25.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.464+0000 7fa0ff400640 1 -- 172.21.15.64:0/3538614484 learned_addr learned my addr 172.21.15.64:0/3538614484 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0fea00640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 0x7fa1000b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ffe00640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1000b2890 0x7fa1000c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 -- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1000b2890 msgr2=0x7fa1000c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1000b2890 0x7fa1000c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 -- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 msgr2=0x7fa1000b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 0x7fa1000b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 -- 172.21.15.64:0/3538614484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1001557e0 con 0x7fa0e4003a80 2024-09-21T07:23:25.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0fea00640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 0x7fa1000b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0ff400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009aa0 tx=0x7fa0f0004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0004c40 con 0x7fa0e4003a80 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f00bc070 con 0x7fa0e4003a80 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1000b2ca0 con 0x7fa0e4003a80 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0005030 con 0x7fa0e4003a80 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10015ea80 con 0x7fa0e4003a80 2024-09-21T07:23:25.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10006f890 con 0x7fa0e4003a80 2024-09-21T07:23:25.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.468+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa0f00b5070 con 0x7fa0e4003a80 2024-09-21T07:23:25.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.472+0000 7fa0f7400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 0x7fa0e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.472+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa0f012f350 con 0x7fa0e4003a80 2024-09-21T07:23:25.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.472+0000 7fa0fea00640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 0x7fa0e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.472+0000 7fa0fea00640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 0x7fa0e0075710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa100074a10 tx=0x7fa0ec006c60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.476+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa1000b2ca0 con 0x7fa0e4003a80 2024-09-21T07:23:25.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.652+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa1000691d0 con 0x7fa0e4003a80 2024-09-21T07:23:25.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.656+0000 7fa0f7400640 1 -- 172.21.15.64:0/3538614484 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fa0f0016f80 con 0x7fa0e4003a80 2024-09-21T07:23:25.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 msgr2=0x7fa0e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 0x7fa0e0075710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa100074a10 tx=0x7fa0ec006c60 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 msgr2=0x7fa1001552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009aa0 tx=0x7fa0f0004890 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 shutdown_connections 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0e0073200 0x7fa0e0075710 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1000b2890 0x7fa1000c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10009cb50 0x7fa1000b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 --2- 172.21.15.64:0/3538614484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0e4003a80 0x7fa1001552a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 >> 172.21.15.64:0/3538614484 conn(0x7fa10006d450 msgr2=0x7fa100073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 shutdown_connections 2024-09-21T07:23:25.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:25.660+0000 7fa106400640 1 -- 172.21.15.64:0/3538614484 wait complete. 2024-09-21T07:23:25.686 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:23:25.686 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:23:25.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:23:25.855 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:23:25.855 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:25.855 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:25.864 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:25.864 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:25.920 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:25.920 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:25.976 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 -- 172.21.15.64:0/2587344469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200ce900 msgr2=0x7f042006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 --2- 172.21.15.64:0/2587344469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200ce900 0x7f042006f890 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0418009bc0 tx=0x7f041801cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 -- 172.21.15.64:0/2587344469 shutdown_connections 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 --2- 172.21.15.64:0/2587344469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200ce900 0x7f042006f890 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 --2- 172.21.15.64:0/2587344469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 0x7f04200b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 -- 172.21.15.64:0/2587344469 >> 172.21.15.64:0/2587344469 conn(0x7f042006d450 msgr2=0x7f04200d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 -- 172.21.15.64:0/2587344469 shutdown_connections 2024-09-21T07:23:26.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.176+0000 7f0426000640 1 -- 172.21.15.64:0/2587344469 wait complete. 2024-09-21T07:23:26.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 Processor -- start 2024-09-21T07:23:26.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- start start 2024-09-21T07:23:26.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 0x7f042015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 0x7f04200b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0420169000 con 0x7f04200b3910 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0420168e80 con 0x7f04200ce900 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0420169180 con 0x7f042009df30 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60598/0 (socket says 172.21.15.64:60598) 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 -- 172.21.15.64:0/3949318873 learned_addr learned my addr 172.21.15.64:0/3949318873 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f041f400640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 0x7f042015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f041fe00640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 0x7f04200b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 -- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 msgr2=0x7f042015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 0x7f042015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 -- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 msgr2=0x7f04200b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 0x7f04200b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 -- 172.21.15.64:0/3949318873 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04200cc0b0 con 0x7f04200b3910 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f041fe00640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 0x7f04200b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:26.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417e00640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f040800c3d0 tx=0x7f040800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408017070 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0408003600 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04201f7c10 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408003a50 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.180+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04201f7930 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.184+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04200b33d0 con 0x7f04200b3910 2024-09-21T07:23:26.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.184+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f040801a070 con 0x7f04200b3910 2024-09-21T07:23:26.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.184+0000 7f0417400640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 0x7f03fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.184+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0408093810 con 0x7f04200b3910 2024-09-21T07:23:26.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.184+0000 7f041f400640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 0x7f03fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.188+0000 7f041f400640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 0x7f03fc075710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0410005fd0 tx=0x7f0410005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:26.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.188+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f040805dea0 con 0x7f04200b3910 2024-09-21T07:23:26.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.380+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f042015bbb0 con 0x7f04200b3910 2024-09-21T07:23:26.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.380+0000 7f0417400640 1 -- 172.21.15.64:0/3949318873 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f04080628d0 con 0x7f04200b3910 2024-09-21T07:23:26.388 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 msgr2=0x7f03fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 0x7f03fc075710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0410005fd0 tx=0x7f0410005f40 comp rx=0 tx=0).stop 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 msgr2=0x7f042015b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f040800c3d0 tx=0x7f040800c890 comp rx=0 tx=0).stop 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 shutdown_connections 2024-09-21T07:23:26.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f03fc073200 0x7f03fc075710 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04200ce900 0x7f04200b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04200b3910 0x7f042015b4f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 --2- 172.21.15.64:0/3949318873 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f042009df30 0x7f042015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 >> 172.21.15.64:0/3949318873 conn(0x7f042006d450 msgr2=0x7f04200ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 shutdown_connections 2024-09-21T07:23:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.384+0000 7f0426000640 1 -- 172.21.15.64:0/3949318873 wait complete. 2024-09-21T07:23:26.410 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:23:26.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:26.411 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T07:23:26.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:23:26.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:26.445 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:23:26.500 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:26.501 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:26.510 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:26.510 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:26.561 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:26.561 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:26.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 -- 172.21.15.64:0/155972509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c90004d50 msgr2=0x7f9c90005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 --2- 172.21.15.64:0/155972509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c90004d50 0x7f9c90005160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009ee0 tx=0x7f9ca001d610 comp rx=0 tx=0).stop 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cae000640 1 -- 172.21.15.64:0/155972509 reap_dead start 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 -- 172.21.15.64:0/155972509 shutdown_connections 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 -- 172.21.15.64:0/155972509 >> 172.21.15.64:0/155972509 conn(0x7f9ca806d450 msgr2=0x7f9ca80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 -- 172.21.15.64:0/155972509 shutdown_connections 2024-09-21T07:23:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.768+0000 7f9cb0000640 1 -- 172.21.15.64:0/155972509 wait complete. 2024-09-21T07:23:26.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 Processor -- start 2024-09-21T07:23:26.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 -- start start 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c90004d50 0x7f9ca80b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 0x7f9ca80acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca806f890 con 0x7f9ca814efe0 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca80cef20 con 0x7f9c90004d50 2024-09-21T07:23:26.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cb0000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca806fa10 con 0x7f9ca814ebd0 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60624/0 (socket says 172.21.15.64:60624) 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 -- 172.21.15.64:0/868662145 learned_addr learned my addr 172.21.15.64:0/868662145 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cad600640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c90004d50 0x7f9ca80b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cacc00640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 0x7f9ca80acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 -- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 msgr2=0x7f9ca80acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 0x7f9ca80acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 -- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c90004d50 msgr2=0x7f9ca80b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c90004d50 0x7f9ca80b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 -- 172.21.15.64:0/868662145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca80b28a0 con 0x7f9ca814efe0 2024-09-21T07:23:26.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cacc00640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 0x7f9ca80acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.772+0000 7f9cae000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ca001d440 tx=0x7f9ca0004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00ad050 con 0x7f9ca814efe0 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca00a7ab0 con 0x7f9ca814efe0 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00a7e60 con 0x7f9ca814efe0 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca8155430 con 0x7f9ca814efe0 2024-09-21T07:23:26.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca81559f0 con 0x7f9ca814efe0 2024-09-21T07:23:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca80b33d0 con 0x7f9ca814efe0 2024-09-21T07:23:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ca00b0070 con 0x7f9ca814efe0 2024-09-21T07:23:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9ca012f380 con 0x7f9ca814efe0 2024-09-21T07:23:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.776+0000 7f9cad600640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.780+0000 7f9cad600640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c005fd0 tx=0x7f9c9c005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:26.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.784+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9ca0017320 con 0x7f9ca814efe0 2024-09-21T07:23:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.972+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ca80ccfc0 con 0x7f9ca814efe0 2024-09-21T07:23:26.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.972+0000 7f9ca5600640 1 -- 172.21.15.64:0/868662145 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f9ca00f9b30 con 0x7f9ca814efe0 2024-09-21T07:23:26.979 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:26.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 msgr2=0x7f9c88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c005fd0 tx=0x7f9c9c005f40 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 msgr2=0x7f9ca80ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ca001d440 tx=0x7f9ca0004f50 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 shutdown_connections 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ca814efe0 0x7f9ca80ad500 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ca814ebd0 0x7f9ca80acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 --2- 172.21.15.64:0/868662145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c90004d50 0x7f9ca80b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 >> 172.21.15.64:0/868662145 conn(0x7f9ca806d450 msgr2=0x7f9ca80cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 shutdown_connections 2024-09-21T07:23:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:26.976+0000 7f9cb0000640 1 -- 172.21.15.64:0/868662145 wait complete. 2024-09-21T07:23:27.002 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T07:23:27.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:27.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T07:23:27.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:23:27.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:27.036 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T07:23:27.093 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:27.093 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.102 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:27.102 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.152 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:27.152 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:27.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 -- 172.21.15.64:0/2088679153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62280cd410 msgr2=0x7f62280b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 --2- 172.21.15.64:0/2088679153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62280cd410 0x7f62280b4de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6210009840 tx=0x7f621001c820 comp rx=0 tx=0).stop 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 -- 172.21.15.64:0/2088679153 shutdown_connections 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 --2- 172.21.15.64:0/2088679153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62280cd410 0x7f62280b4de0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 -- 172.21.15.64:0/2088679153 >> 172.21.15.64:0/2088679153 conn(0x7f622806d450 msgr2=0x7f62280d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 -- 172.21.15.64:0/2088679153 shutdown_connections 2024-09-21T07:23:27.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.404+0000 7f622f800640 1 -- 172.21.15.64:0/2088679153 wait complete. 2024-09-21T07:23:27.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 Processor -- start 2024-09-21T07:23:27.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- start start 2024-09-21T07:23:27.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622806ee80 0x7f6228159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62280d0e60 0x7f62281f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f622816aff0 con 0x7f6228167b10 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f622816ae70 con 0x7f622806ee80 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f622816b170 con 0x7f62280d0e60 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60646/0 (socket says 172.21.15.64:60646) 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 -- 172.21.15.64:0/2261204856 learned_addr learned my addr 172.21.15.64:0/2261204856 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f621fe00640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62280d0e60 0x7f62281f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622ce00640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622806ee80 0x7f6228159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 -- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62280d0e60 msgr2=0x7f62281f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62280d0e60 0x7f62281f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 -- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622806ee80 msgr2=0x7f6228159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622806ee80 0x7f6228159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 -- 172.21.15.64:0/2261204856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62281fab40 con 0x7f6228167b10 2024-09-21T07:23:27.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622d800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f622000c730 tx=0x7f622000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220003b80 con 0x7f6228167b10 2024-09-21T07:23:27.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6220003d40 con 0x7f6228167b10 2024-09-21T07:23:27.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622815d770 con 0x7f6228167b10 2024-09-21T07:23:27.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62200052d0 con 0x7f6228167b10 2024-09-21T07:23:27.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.408+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622815dd30 con 0x7f6228167b10 2024-09-21T07:23:27.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62280b4de0 con 0x7f6228167b10 2024-09-21T07:23:27.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6220005680 con 0x7f6228167b10 2024-09-21T07:23:27.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f6225600640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 0x7f6204075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62200944d0 con 0x7f6228167b10 2024-09-21T07:23:27.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f622ce00640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 0x7f6204075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.412+0000 7f622ce00640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 0x7f6204075710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6218000fc0 tx=0x7f6218009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.416+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f62280b4360 con 0x7f6228167b10 2024-09-21T07:23:27.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f622806f4e0 con 0x7f6228167b10 2024-09-21T07:23:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f6225600640 1 -- 172.21.15.64:0/2261204856 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f622005eac0 con 0x7f6228167b10 2024-09-21T07:23:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:27.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 msgr2=0x7f6204075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 0x7f6204075710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6218000fc0 tx=0x7f6218009040 comp rx=0 tx=0).stop 2024-09-21T07:23:27.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 msgr2=0x7f62281fa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f622000c730 tx=0x7f622000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 shutdown_connections 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6204073200 0x7f6204075710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6228167b10 0x7f62281fa140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62280d0e60 0x7f62281f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 --2- 172.21.15.64:0/2261204856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622806ee80 0x7f6228159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 >> 172.21.15.64:0/2261204856 conn(0x7f622806d450 msgr2=0x7f6228072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 shutdown_connections 2024-09-21T07:23:27.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.608+0000 7f622f800640 1 -- 172.21.15.64:0/2261204856 wait complete. 2024-09-21T07:23:27.635 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T07:23:27.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:27.635 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T07:23:27.659 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:23:27.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:27.659 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T07:23:27.712 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:27.712 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.721 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:27.721 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.772 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:23:27.772 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:27.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:23:27.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- 172.21.15.64:0/2786851568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cd320 msgr2=0x7f18e815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 --2- 172.21.15.64:0/2786851568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cd320 0x7f18e815c7f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009840 tx=0x7f18dc01c790 comp rx=0 tx=0).stop 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- 172.21.15.64:0/2786851568 shutdown_connections 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 --2- 172.21.15.64:0/2786851568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80cecb0 0x7f18e80cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 --2- 172.21.15.64:0/2786851568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cd320 0x7f18e815c7f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- 172.21.15.64:0/2786851568 >> 172.21.15.64:0/2786851568 conn(0x7f18e806d3f0 msgr2=0x7f18e80710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- 172.21.15.64:0/2786851568 shutdown_connections 2024-09-21T07:23:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- 172.21.15.64:0/2786851568 wait complete. 2024-09-21T07:23:27.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 Processor -- start 2024-09-21T07:23:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.988+0000 7f18efc00640 1 -- start start 2024-09-21T07:23:27.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80b3d60 0x7f18e8152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18e80cd320 0x7f18e814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f18e816a540 con 0x7f18e80cecb0 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18e816a3c0 con 0x7f18e80cd320 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f18e816a6c0 con 0x7f18e80b3d60 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60664/0 (socket says 172.21.15.64:60664) 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 -- 172.21.15.64:0/1892168645 learned_addr learned my addr 172.21.15.64:0/1892168645 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18ed200640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80b3d60 0x7f18e8152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18e7e00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18e80cd320 0x7f18e814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 -- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80b3d60 msgr2=0x7f18e8152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80b3d60 0x7f18e8152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 -- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18e80cd320 msgr2=0x7f18e814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18e80cd320 0x7f18e814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 -- 172.21.15.64:0/1892168645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e80b7b30 con 0x7f18e80cecb0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18edc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c730 tx=0x7f18e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0003b80 con 0x7f18e80cecb0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18e0003d40 con 0x7f18e80cecb0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e8151f20 con 0x7f18e80cecb0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e00052d0 con 0x7f18e80cecb0 2024-09-21T07:23:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e8152c40 con 0x7f18e80cecb0 2024-09-21T07:23:28.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.992+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e815c7f0 con 0x7f18e80cecb0 2024-09-21T07:23:28.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.996+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f18e0005680 con 0x7f18e80cecb0 2024-09-21T07:23:28.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.996+0000 7f18e4c00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 0x7f18c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.996+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f18e0094550 con 0x7f18e80cecb0 2024-09-21T07:23:28.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.996+0000 7f18ed200640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 0x7f18c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:27.996+0000 7f18ed200640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 0x7f18c8075710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0ae000 tx=0x7f18dc0b3040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.000+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f18e80cf600 con 0x7f18e80cecb0 2024-09-21T07:23:28.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18e80b4610 con 0x7f18e80cecb0 2024-09-21T07:23:28.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18e4c00640 1 -- 172.21.15.64:0/1892168645 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f18e005eb10 con 0x7f18e80cecb0 2024-09-21T07:23:28.197 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:23:28.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 msgr2=0x7f18c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 0x7f18c8075710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0ae000 tx=0x7f18dc0b3040 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 msgr2=0x7f18e80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c730 tx=0x7f18e000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 shutdown_connections 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18c8073200 0x7f18c8075710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18e80cecb0 0x7f18e80b5b70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18e80cd320 0x7f18e814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 --2- 172.21.15.64:0/1892168645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18e80b3d60 0x7f18e8152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 >> 172.21.15.64:0/1892168645 conn(0x7f18e806d3f0 msgr2=0x7f18e815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 shutdown_connections 2024-09-21T07:23:28.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.192+0000 7f18efc00640 1 -- 172.21.15.64:0/1892168645 wait complete. 2024-09-21T07:23:28.218 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T07:23:28.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:28.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T07:23:28.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:23:28.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:28.244 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T07:23:28.301 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:23:28.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- 172.21.15.64:0/668201127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220003ad0 msgr2=0x7f9220003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 --2- 172.21.15.64:0/668201127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220003ad0 0x7f9220003f60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c310 tx=0x7f922c01cf30 comp rx=0 tx=0).stop 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- 172.21.15.64:0/668201127 shutdown_connections 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 --2- 172.21.15.64:0/668201127 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220003ad0 0x7f9220003f60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- 172.21.15.64:0/668201127 >> 172.21.15.64:0/668201127 conn(0x7f923c06d1c0 msgr2=0x7f923c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- 172.21.15.64:0/668201127 shutdown_connections 2024-09-21T07:23:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- 172.21.15.64:0/668201127 wait complete. 2024-09-21T07:23:28.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 Processor -- start 2024-09-21T07:23:28.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.456+0000 7f9243000640 1 -- start start 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9220003ad0 0x7f923c0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f923c157420 0x7f923c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0d0b60 con 0x7f923c147900 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0d09e0 con 0x7f923c157420 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f923c0d0ce0 con 0x7f9220003ad0 2024-09-21T07:23:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60684/0 (socket says 172.21.15.64:60684) 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 -- 172.21.15.64:0/600103164 learned_addr learned my addr 172.21.15.64:0/600103164 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9233400640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f923c157420 0x7f923c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f923be00640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9220003ad0 0x7f923c0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 -- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9220003ad0 msgr2=0x7f923c0b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9220003ad0 0x7f923c0b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 -- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f923c157420 msgr2=0x7f923c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f923c157420 0x7f923c1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 -- 172.21.15.64:0/600103164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0b31c0 con 0x7f923c147900 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9241000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f923c1634c0 tx=0x7f92340019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234011870 con 0x7f923c147900 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9234017070 con 0x7f923c147900 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234011da0 con 0x7f923c147900 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923c0c6150 con 0x7f923c147900 2024-09-21T07:23:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923c0c63f0 con 0x7f923c147900 2024-09-21T07:23:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.460+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923c0b40e0 con 0x7f923c147900 2024-09-21T07:23:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.464+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f923401c460 con 0x7f923c147900 2024-09-21T07:23:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.464+0000 7f9238c00640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 0x7f9218075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.464+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9234094df0 con 0x7f923c147900 2024-09-21T07:23:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.464+0000 7f923be00640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 0x7f9218075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.464+0000 7f923be00640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 0x7f9218075740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f922c0ab000 tx=0x7f922c019d70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.468+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f923405f970 con 0x7f923c147900 2024-09-21T07:23:28.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.680+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f923c0b8260 con 0x7f923c147900 2024-09-21T07:23:28.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.680+0000 7f9238c00640 1 -- 172.21.15.64:0/600103164 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f923405f270 con 0x7f923c147900 2024-09-21T07:23:28.687 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:28.687 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:28.688 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 msgr2=0x7f9218075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 0x7f9218075740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f922c0ab000 tx=0x7f922c019d70 comp rx=0 tx=0).stop 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 msgr2=0x7f923c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f923c1634c0 tx=0x7f92340019c0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 shutdown_connections 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9218073230 0x7f9218075740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f923c147900 0x7f923c0b6160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f923c157420 0x7f923c1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 --2- 172.21.15.64:0/600103164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9220003ad0 0x7f923c0b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 >> 172.21.15.64:0/600103164 conn(0x7f923c06d1c0 msgr2=0x7f923c1585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 shutdown_connections 2024-09-21T07:23:28.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.684+0000 7f9243000640 1 -- 172.21.15.64:0/600103164 wait complete. 2024-09-21T07:23:28.709 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:28.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 -- 172.21.15.64:0/2518291065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66000709b0 msgr2=0x7f66000b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 --2- 172.21.15.64:0/2518291065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66000709b0 0x7f66000b41c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66000af810 tx=0x7f65e801c6e0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 -- 172.21.15.64:0/2518291065 shutdown_connections 2024-09-21T07:23:28.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 --2- 172.21.15.64:0/2518291065 >> v2:172.21.15.90:3300/0 conn(0x7f66000b4700 0x7f6600072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 --2- 172.21.15.64:0/2518291065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66000709b0 0x7f66000b41c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 -- 172.21.15.64:0/2518291065 >> 172.21.15.64:0/2518291065 conn(0x7f66000ccbe0 msgr2=0x7f66000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 -- 172.21.15.64:0/2518291065 shutdown_connections 2024-09-21T07:23:28.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.864+0000 7f6607c00640 1 -- 172.21.15.64:0/2518291065 wait complete. 2024-09-21T07:23:28.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 Processor -- start 2024-09-21T07:23:28.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 -- start start 2024-09-21T07:23:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66000709b0 0x7f66000c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66000b4700 0x7f66000b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6600168be0 con 0x7f660015edb0 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6600168a60 con 0x7f66000b4700 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6607c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6600168d60 con 0x7f66000709b0 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60706/0 (socket says 172.21.15.64:60706) 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 -- 172.21.15.64:0/512260375 learned_addr learned my addr 172.21.15.64:0/512260375 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f65f7e00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66000b4700 0x7f66000b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605200640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66000709b0 0x7f66000c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 -- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66000709b0 msgr2=0x7f66000c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66000709b0 0x7f66000c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 -- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66000b4700 msgr2=0x7f66000b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66000b4700 0x7f66000b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 -- 172.21.15.64:0/512260375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000b1030 con 0x7f660015edb0 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.868+0000 7f6605c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65f800e940 tx=0x7f65f800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8004d30 con 0x7f660015edb0 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f800cb20 con 0x7f660015edb0 2024-09-21T07:23:28.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66000c72f0 con 0x7f660015edb0 2024-09-21T07:23:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8005020 con 0x7f660015edb0 2024-09-21T07:23:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66000c9300 con 0x7f660015edb0 2024-09-21T07:23:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66000b41c0 con 0x7f660015edb0 2024-09-21T07:23:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f65f80051c0 con 0x7f660015edb0 2024-09-21T07:23:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 0x7f65dc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f65f8094d60 con 0x7f660015edb0 2024-09-21T07:23:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.872+0000 7f6605200640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 0x7f65dc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.876+0000 7f6605200640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 0x7f65dc075740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:28.876+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f65f8016030 con 0x7f660015edb0 2024-09-21T07:23:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.100+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66000ad1f0 con 0x7f660015edb0 2024-09-21T07:23:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.100+0000 7f65fd600640 1 -- 172.21.15.64:0/512260375 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f65f805f3b0 con 0x7f660015edb0 2024-09-21T07:23:29.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:29.107 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:29.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 msgr2=0x7f65dc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 0x7f65dc075740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0009040 comp rx=0 tx=0).stop 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 msgr2=0x7f66000c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65f800e940 tx=0x7f65f800ee00 comp rx=0 tx=0).stop 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 shutdown_connections 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65dc073230 0x7f65dc075740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660015edb0 0x7f66000c88a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66000b4700 0x7f66000b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 --2- 172.21.15.64:0/512260375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66000709b0 0x7f66000c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 >> 172.21.15.64:0/512260375 conn(0x7f66000ccbe0 msgr2=0x7f66000af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:29.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 shutdown_connections 2024-09-21T07:23:29.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.104+0000 7f6607c00640 1 -- 172.21.15.64:0/512260375 wait complete. 2024-09-21T07:23:29.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:29.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 -- 172.21.15.64:0/3000440397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c40004810 msgr2=0x7f8c40004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 --2- 172.21.15.64:0/3000440397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c40004810 0x7f8c40004c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8c44001770 tx=0x7f8c4401c840 comp rx=0 tx=0).stop 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 -- 172.21.15.64:0/3000440397 shutdown_connections 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 --2- 172.21.15.64:0/3000440397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c40004810 0x7f8c40004c20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 -- 172.21.15.64:0/3000440397 >> 172.21.15.64:0/3000440397 conn(0x7f8c580ccbe0 msgr2=0x7f8c580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 -- 172.21.15.64:0/3000440397 shutdown_connections 2024-09-21T07:23:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.280+0000 7f8c5f600640 1 -- 172.21.15.64:0/3000440397 wait complete. 2024-09-21T07:23:29.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 Processor -- start 2024-09-21T07:23:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 -- start start 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 0x7f8c581f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c580c5730 0x7f8c580c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c58073530 con 0x7f8c580c6520 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580733b0 con 0x7f8c580c5730 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5f600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8c580736b0 con 0x7f8c40004810 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60722/0 (socket says 172.21.15.64:60722) 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c57e00640 1 -- 172.21.15.64:0/1288901672 learned_addr learned my addr 172.21.15.64:0/1288901672 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5d600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c580c5730 0x7f8c580c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.284+0000 7f8c5cc00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 0x7f8c581f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 -- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 msgr2=0x7f8c581f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 0x7f8c581f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 -- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c580c5730 msgr2=0x7f8c580c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c580c5730 0x7f8c580c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 -- 172.21.15.64:0/1288901672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c580c7340 con 0x7f8c580c6520 2024-09-21T07:23:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c5cc00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 0x7f8c581f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c57e00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c44000fc0 tx=0x7f8c44006620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004650 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c440048e0 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c580c7620 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004cf0 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c580c7be0 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c580b1c30 con 0x7f8c580c6520 2024-09-21T07:23:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c440a5530 con 0x7f8c580c6520 2024-09-21T07:23:29.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.288+0000 7f8c54c00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 0x7f8c38075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.292+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8c4412dac0 con 0x7f8c580c6520 2024-09-21T07:23:29.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.292+0000 7f8c5cc00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 0x7f8c38075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.292+0000 7f8c5cc00640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 0x7f8c38075740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009ce0 tx=0x7f8c4c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:29.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.296+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8c440bd070 con 0x7f8c580c6520 2024-09-21T07:23:29.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.476+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c5809da20 con 0x7f8c580c6520 2024-09-21T07:23:29.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.476+0000 7f8c54c00640 1 -- 172.21.15.64:0/1288901672 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18938 (secure 0 0 0) 0x7f8c44016550 con 0x7f8c580c6520 2024-09-21T07:23:29.482 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:29.482 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":28,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:23:28.912445+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:29.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 msgr2=0x7f8c38075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 0x7f8c38075740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009ce0 tx=0x7f8c4c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 msgr2=0x7f8c580c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c44000fc0 tx=0x7f8c44006620 comp rx=0 tx=0).stop 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 shutdown_connections 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c38073230 0x7f8c38075740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c580c5730 0x7f8c580c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c580c6520 0x7f8c580c51f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 --2- 172.21.15.64:0/1288901672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c40004810 0x7f8c581f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 >> 172.21.15.64:0/1288901672 conn(0x7f8c580ccbe0 msgr2=0x7f8c580b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 shutdown_connections 2024-09-21T07:23:29.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.480+0000 7f8c5f600640 1 -- 172.21.15.64:0/1288901672 wait complete. 2024-09-21T07:23:29.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:23:29.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 -- 172.21.15.64:0/2977091113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 msgr2=0x7f31dc0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 --2- 172.21.15.64:0/2977091113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc0b1ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009900 tx=0x7f31c801c8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 -- 172.21.15.64:0/2977091113 shutdown_connections 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 --2- 172.21.15.64:0/2977091113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc0cbcd0 0x7f31dc0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 --2- 172.21.15.64:0/2977091113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc0b1ff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 -- 172.21.15.64:0/2977091113 >> 172.21.15.64:0/2977091113 conn(0x7f31dc0ccbe0 msgr2=0x7f31dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 -- 172.21.15.64:0/2977091113 shutdown_connections 2024-09-21T07:23:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.656+0000 7f31e4000640 1 -- 172.21.15.64:0/2977091113 wait complete. 2024-09-21T07:23:29.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 Processor -- start 2024-09-21T07:23:29.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- start start 2024-09-21T07:23:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 0x7f31dc1fc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 0x7f31dc1fc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0b41f0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0b4070 con 0x7f31dc0cbcd0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0b4370 con 0x7f31dc15cbd0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60734/0 (socket says 172.21.15.64:60734) 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 -- 172.21.15.64:0/233438225 learned_addr learned my addr 172.21.15.64:0/233438225 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e0c00640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 0x7f31dc1fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e2000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 0x7f31dc1fc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 -- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 msgr2=0x7f31dc1fc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 0x7f31dc1fc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 -- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 msgr2=0x7f31dc1fc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 0x7f31dc1fc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 -- 172.21.15.64:0/233438225 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc15fdc0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e0c00640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 0x7f31dc1fc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e2000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 0x7f31dc1fc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e1600640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c3f0 tx=0x7f31d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0017070 con 0x7f31dc0b1be0 2024-09-21T07:23:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31d00053c0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003860 con 0x7f31dc0b1be0 2024-09-21T07:23:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc071830 con 0x7f31dc0b1be0 2024-09-21T07:23:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.660+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc0c8960 con 0x7f31dc0b1be0 2024-09-21T07:23:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.664+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc0b1ff0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.664+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f31d001a070 con 0x7f31dc0b1be0 2024-09-21T07:23:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.664+0000 7f31d9600640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 0x7f31bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.664+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f31d00939d0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.664+0000 7f31e0c00640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 0x7f31bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:29.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.668+0000 7f31e0c00640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 0x7f31bc075710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31c80af000 tx=0x7f31c801b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:29.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.668+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f31dc0b2530 con 0x7f31dc0b1be0 2024-09-21T07:23:29.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31dc151880 con 0x7f31dc0b1be0 2024-09-21T07:23:29.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31d9600640 1 -- 172.21.15.64:0/233438225 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f31d005e5e0 con 0x7f31dc0b1be0 2024-09-21T07:23:29.890 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:29.890 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:29.890 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 msgr2=0x7f31bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 0x7f31bc075710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31c80af000 tx=0x7f31c801b0f0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 msgr2=0x7f31dc151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.884+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c3f0 tx=0x7f31d000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 shutdown_connections 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073200 0x7f31bc075710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc15cbd0 0x7f31dc1fc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0cbcd0 0x7f31dc1fc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 --2- 172.21.15.64:0/233438225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0b1be0 0x7f31dc151340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 >> 172.21.15.64:0/233438225 conn(0x7f31dc0ccbe0 msgr2=0x7f31dc157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:29.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 shutdown_connections 2024-09-21T07:23:29.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:29.888+0000 7f31e4000640 1 -- 172.21.15.64:0/233438225 wait complete. 2024-09-21T07:23:29.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:30.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.064+0000 7f9a98200640 1 -- 172.21.15.64:0/2706182587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 msgr2=0x7f9a900d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.064+0000 7f9a98200640 1 --2- 172.21.15.64:0/2706182587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a900d0490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009c80 tx=0x7f9a8801cd10 comp rx=0 tx=0).stop 2024-09-21T07:23:30.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 -- 172.21.15.64:0/2706182587 shutdown_connections 2024-09-21T07:23:30.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 --2- 172.21.15.64:0/2706182587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a900d0490 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 --2- 172.21.15.64:0/2706182587 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 0x7f9a900cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 -- 172.21.15.64:0/2706182587 >> 172.21.15.64:0/2706182587 conn(0x7f9a9006d480 msgr2=0x7f9a900d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 -- 172.21.15.64:0/2706182587 shutdown_connections 2024-09-21T07:23:30.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 -- 172.21.15.64:0/2706182587 wait complete. 2024-09-21T07:23:30.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 Processor -- start 2024-09-21T07:23:30.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.068+0000 7f9a98200640 1 -- start start 2024-09-21T07:23:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 0x7f9a90156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 0x7f9a901f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9a90169c60 con 0x7f9a900d0080 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a90169ae0 con 0x7f9a900b3ce0 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9a90169de0 con 0x7f9a900b7a60 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a95800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 0x7f9a90156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60756/0 (socket says 172.21.15.64:60756) 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 -- 172.21.15.64:0/2795825228 learned_addr learned my addr 172.21.15.64:0/2795825228 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a95800640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 0x7f9a90156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:51258/0 (socket says 172.21.15.64:51258) 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a94e00640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 0x7f9a901f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 -- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 msgr2=0x7f9a901f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 0x7f9a901f9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 -- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 msgr2=0x7f9a90156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 0x7f9a90156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 -- 172.21.15.64:0/2795825228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a90157380 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a96200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009bd0 tx=0x7f9a88009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a880bb070 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a88004d40 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a900c87f0 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a880b2040 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a900b6ff0 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a900cd1c0 con 0x7f9a900d0080 2024-09-21T07:23:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.072+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9a880be070 con 0x7f9a900d0080 2024-09-21T07:23:30.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.076+0000 7f9a8d600640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 0x7f9a70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.076+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9a8812e2f0 con 0x7f9a900d0080 2024-09-21T07:23:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.076+0000 7f9a95800640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 0x7f9a70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.076+0000 7f9a95800640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 0x7f9a70075710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a84004040 tx=0x7f9a8400f6f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.080+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9a88016990 con 0x7f9a900d0080 2024-09-21T07:23:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a900b3860 con 0x7f9a900d0080 2024-09-21T07:23:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a8d600640 1 -- 172.21.15.64:0/2795825228 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f9a880f88b0 con 0x7f9a900d0080 2024-09-21T07:23:30.298 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"btime":"2024-09-21T07:23:03:799048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1775159065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1775159065},{"type":"v1","addr":"172.21.15.90:6835","nonce":1775159065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4023022939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4023022939},{"type":"v1","addr":"172.21.15.90:6837","nonce":4023022939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2497307546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2497307546},{"type":"v1","addr":"172.21.15.64:6833","nonce":2497307546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:22:48.142974+0000","modified":"2024-09-21T07:23:03.218842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/310445642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":310445642},{"type":"v1","addr":"172.21.15.64:6835","nonce":310445642}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-21T07:23:30.298 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 msgr2=0x7f9a70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 0x7f9a70075710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a84004040 tx=0x7f9a8400f6f0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 msgr2=0x7f9a901fa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009bd0 tx=0x7f9a88009350 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 shutdown_connections 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a70073200 0x7f9a70075710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a900d0080 0x7f9a901fa090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a900b7a60 0x7f9a901f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 --2- 172.21.15.64:0/2795825228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a900b3ce0 0x7f9a90156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.292+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 >> 172.21.15.64:0/2795825228 conn(0x7f9a9006d480 msgr2=0x7f9a90159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.296+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 shutdown_connections 2024-09-21T07:23:30.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.296+0000 7f9a98200640 1 -- 172.21.15.64:0/2795825228 wait complete. 2024-09-21T07:23:30.320 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 -- 172.21.15.64:0/2041933786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604071250 msgr2=0x7f860415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 --2- 172.21.15.64:0/2041933786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604071250 0x7f860415c1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86040754c0 tx=0x7f85fc01cda0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 -- 172.21.15.64:0/2041933786 shutdown_connections 2024-09-21T07:23:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 --2- 172.21.15.64:0/2041933786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604071250 0x7f860415c1d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 --2- 172.21.15.64:0/2041933786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604159280 0x7f86040d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 -- 172.21.15.64:0/2041933786 >> 172.21.15.64:0/2041933786 conn(0x7f86040d10a0 msgr2=0x7f86040d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 -- 172.21.15.64:0/2041933786 shutdown_connections 2024-09-21T07:23:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.472+0000 7f860ae00640 1 -- 172.21.15.64:0/2041933786 wait complete. 2024-09-21T07:23:30.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 Processor -- start 2024-09-21T07:23:30.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 -- start start 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040cefa0 0x7f86040cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604154220 0x7f86040b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86041696c0 con 0x7f8604159280 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8604169540 con 0x7f86040cefa0 2024-09-21T07:23:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860ae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8604169840 con 0x7f8604154220 2024-09-21T07:23:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60784/0 (socket says 172.21.15.64:60784) 2024-09-21T07:23:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 -- 172.21.15.64:0/4208628769 learned_addr learned my addr 172.21.15.64:0/4208628769 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f860a400640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604154220 0x7f86040b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609a00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040cefa0 0x7f86040cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 -- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604154220 msgr2=0x7f86040b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604154220 0x7f86040b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 -- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040cefa0 msgr2=0x7f86040cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040cefa0 0x7f86040cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.476+0000 7f8609000640 1 -- 172.21.15.64:0/4208628769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86041f8e10 con 0x7f8604159280 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8609000640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b410 tx=0x7f85f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0015030 con 0x7f8604159280 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85f0004020 con 0x7f8604159280 2024-09-21T07:23:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86040b34e0 con 0x7f8604159280 2024-09-21T07:23:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0004470 con 0x7f8604159280 2024-09-21T07:23:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86040b5c20 con 0x7f8604159280 2024-09-21T07:23:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860415c1d0 con 0x7f8604159280 2024-09-21T07:23:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85f0018070 con 0x7f8604159280 2024-09-21T07:23:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 0x7f85e4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.480+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f85f00940f0 con 0x7f8604159280 2024-09-21T07:23:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.484+0000 7f8609a00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 0x7f85e4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.484+0000 7f8609a00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 0x7f85e4075740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004630 tx=0x7f85f800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.484+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f85f005e620 con 0x7f8604159280 2024-09-21T07:23:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.668+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86040cb070 con 0x7f8604159280 2024-09-21T07:23:30.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.668+0000 7f8601600640 1 -- 172.21.15.64:0/4208628769 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18938 (secure 0 0 0) 0x7f85f0063050 con 0x7f8604159280 2024-09-21T07:23:30.675 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:30.675 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":28,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:23:28.912445+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:22:46.127713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:22:47.103471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:22:50.750858+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:30.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 msgr2=0x7f85e4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 0x7f85e4075740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004630 tx=0x7f85f800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 msgr2=0x7f8604153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b410 tx=0x7f85f000b8d0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 shutdown_connections 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e4073230 0x7f85e4075740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604154220 0x7f86040b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604159280 0x7f8604153a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 --2- 172.21.15.64:0/4208628769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040cefa0 0x7f86040cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 >> 172.21.15.64:0/4208628769 conn(0x7f86040d10a0 msgr2=0x7f860406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 shutdown_connections 2024-09-21T07:23:30.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.672+0000 7f860ae00640 1 -- 172.21.15.64:0/4208628769 wait complete. 2024-09-21T07:23:30.698 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 -- 172.21.15.64:0/339466502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c4809df30 msgr2=0x7f8c480b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/339466502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c4809df30 0x7f8c480b33d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c4806dda0 tx=0x7f8c3801c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 -- 172.21.15.64:0/339466502 shutdown_connections 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/339466502 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 0x7f8c480ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/339466502 >> v2:172.21.15.90:3300/0 conn(0x7f8c480b3910 0x7f8c480ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/339466502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c4809df30 0x7f8c480b33d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 -- 172.21.15.64:0/339466502 >> 172.21.15.64:0/339466502 conn(0x7f8c4806d450 msgr2=0x7f8c480d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 -- 172.21.15.64:0/339466502 shutdown_connections 2024-09-21T07:23:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.848+0000 7f8c4ce00640 1 -- 172.21.15.64:0/339466502 wait complete. 2024-09-21T07:23:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 Processor -- start 2024-09-21T07:23:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 -- start start 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c4809df30 0x7f8c481fc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 0x7f8c48158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480ccef0 con 0x7f8c480b3910 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480ccd70 con 0x7f8c4809df30 2024-09-21T07:23:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c4ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480cd070 con 0x7f8c480ce730 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c45400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c45e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c4809df30 0x7f8c481fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c45400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60800/0 (socket says 172.21.15.64:60800) 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.852+0000 7f8c45400640 1 -- 172.21.15.64:0/1755960868 learned_addr learned my addr 172.21.15.64:0/1755960868 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c46800640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 0x7f8c48158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 -- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 msgr2=0x7f8c48158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 0x7f8c48158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 -- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c4809df30 msgr2=0x7f8c481fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c4809df30 0x7f8c481fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 -- 172.21.15.64:0/1755960868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48158c60 con 0x7f8c480b3910 2024-09-21T07:23:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c45400640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400b3f0 tx=0x7f8c3400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34015020 con 0x7f8c480b3910 2024-09-21T07:23:30.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c34011920 con 0x7f8c480b3910 2024-09-21T07:23:30.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011d70 con 0x7f8c480b3910 2024-09-21T07:23:30.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4815ce30 con 0x7f8c480b3910 2024-09-21T07:23:30.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f8a20 con 0x7f8c480b3910 2024-09-21T07:23:30.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c480ce1f0 con 0x7f8c480b3910 2024-09-21T07:23:30.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.856+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c34018020 con 0x7f8c480b3910 2024-09-21T07:23:30.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.860+0000 7f8c3e000640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 0x7f8c28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.860+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8c34094440 con 0x7f8c480b3910 2024-09-21T07:23:30.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.860+0000 7f8c45e00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 0x7f8c28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.860+0000 7f8c45e00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 0x7f8c28075710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c380af000 tx=0x7f8c3801b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:30.864+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8c3401f020 con 0x7f8c480b3910 2024-09-21T07:23:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.076+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8c48168c50 con 0x7f8c480b3910 2024-09-21T07:23:31.082 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:23:31.076+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:23:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.080+0000 7f8c3e000640 1 -- 172.21.15.64:0/1755960868 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f8c3405e970 con 0x7f8c480b3910 2024-09-21T07:23:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:23:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.080+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 msgr2=0x7f8c28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.080+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 0x7f8c28075710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c380af000 tx=0x7f8c3801b0e0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.080+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 msgr2=0x7f8c481f9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.080+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400b3f0 tx=0x7f8c3400b8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 shutdown_connections 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c28073200 0x7f8c28075710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c480ce730 0x7f8c48158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c480b3910 0x7f8c481f9220 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 --2- 172.21.15.64:0/1755960868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c4809df30 0x7f8c481fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 >> 172.21.15.64:0/1755960868 conn(0x7f8c4806d450 msgr2=0x7f8c48068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:31.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 shutdown_connections 2024-09-21T07:23:31.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.084+0000 7f8c4ce00640 1 -- 172.21.15.64:0/1755960868 wait complete. 2024-09-21T07:23:31.099 INFO:tasks.ceph.mds.a.smithi064.stderr: -4519> 2024-09-21T07:22:53.685+0000 7ff9de200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:23:31.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:23:31.220 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:23:31.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 -- 172.21.15.64:0/3162793711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 msgr2=0x7f73600cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 --2- 172.21.15.64:0/3162793711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73600cbe20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7348009900 tx=0x7f734801c820 comp rx=0 tx=0).stop 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 -- 172.21.15.64:0/3162793711 shutdown_connections 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 --2- 172.21.15.64:0/3162793711 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 0x7f7360166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 --2- 172.21.15.64:0/3162793711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73600cbe20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 -- 172.21.15.64:0/3162793711 >> 172.21.15.64:0/3162793711 conn(0x7f73600b2ca0 msgr2=0x7f73600b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 -- 172.21.15.64:0/3162793711 shutdown_connections 2024-09-21T07:23:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.268+0000 7f7365a00640 1 -- 172.21.15.64:0/3162793711 wait complete. 2024-09-21T07:23:31.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 Processor -- start 2024-09-21T07:23:31.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 -- start start 2024-09-21T07:23:31.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f736015fca0 0x7f73601fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 0x7f73601fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7360169a70 con 0x7f73600cba10 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73601698f0 con 0x7f736015fca0 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7365a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7360169bf0 con 0x7f7360164200 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60832/0 (socket says 172.21.15.64:60832) 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 -- 172.21.15.64:0/3688194297 learned_addr learned my addr 172.21.15.64:0/3688194297 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f7357e00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f736015fca0 0x7f73601fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735f400640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 0x7f73601fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 -- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 msgr2=0x7f73601fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 0x7f73601fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 -- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f736015fca0 msgr2=0x7f73601fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f736015fca0 0x7f73601fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.272+0000 7f735ea00640 1 -- 172.21.15.64:0/3688194297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73600ade00 con 0x7f73600cba10 2024-09-21T07:23:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f735ea00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f735000c3f0 tx=0x7f735000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350017070 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73500053c0 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350003860 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7360164e80 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7360165440 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73600cbe20 con 0x7f73600cba10 2024-09-21T07:23:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.276+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f735001a070 con 0x7f73600cba10 2024-09-21T07:23:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.280+0000 7f7356a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 0x7f733c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.280+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f73500939d0 con 0x7f73600cba10 2024-09-21T07:23:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.280+0000 7f7357e00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 0x7f733c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:31.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.280+0000 7f7357e00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 0x7f733c075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f73480af000 tx=0x7f734801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:31.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.284+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f73600b4000 con 0x7f73600cba10 2024-09-21T07:23:31.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:31.496+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f73600b5d30 con 0x7f73600cba10 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.080+0000 7f7356a00640 1 -- 172.21.15.64:0/3688194297 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f7350091e20 con 0x7f73600cba10 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 msgr2=0x7f733c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 0x7f733c075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f73480af000 tx=0x7f734801b060 comp rx=0 tx=0).stop 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 msgr2=0x7f73601592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f735000c3f0 tx=0x7f735000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 shutdown_connections 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f733c073200 0x7f733c075710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7360164200 0x7f73601fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f736015fca0 0x7f73601fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 --2- 172.21.15.64:0/3688194297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73600cba10 0x7f73601592e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 >> 172.21.15.64:0/3688194297 conn(0x7f73600b2ca0 msgr2=0x7f7360074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 shutdown_connections 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.084+0000 7f7365a00640 1 -- 172.21.15.64:0/3688194297 wait complete. 2024-09-21T07:23:32.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:23:32.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 -- 172.21.15.64:0/4238082797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca541594c0 msgr2=0x7fca540aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 --2- 172.21.15.64:0/4238082797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca541594c0 0x7fca540aee20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009840 tx=0x7fca3c01c740 comp rx=0 tx=0).stop 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 -- 172.21.15.64:0/4238082797 shutdown_connections 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 --2- 172.21.15.64:0/4238082797 >> v2:172.21.15.90:3300/0 conn(0x7fca540af360 0x7fca5415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 --2- 172.21.15.64:0/4238082797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca541594c0 0x7fca540aee20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 -- 172.21.15.64:0/4238082797 >> 172.21.15.64:0/4238082797 conn(0x7fca540d0170 msgr2=0x7fca540d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 -- 172.21.15.64:0/4238082797 shutdown_connections 2024-09-21T07:23:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.272+0000 7fca59200640 1 -- 172.21.15.64:0/4238082797 wait complete. 2024-09-21T07:23:32.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 Processor -- start 2024-09-21T07:23:32.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- start start 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca5406ec70 0x7fca54156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 0x7fca5415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fca5415c410 con 0x7fca541571b0 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca5415c290 con 0x7fca540af360 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fca5415c590 con 0x7fca5406ec70 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60836/0 (socket says 172.21.15.64:60836) 2024-09-21T07:23:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 -- 172.21.15.64:0/2730675830 learned_addr learned my addr 172.21.15.64:0/2730675830 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca49400640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 0x7fca5415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca51e00640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca5406ec70 0x7fca54156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 -- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca5406ec70 msgr2=0x7fca54156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca5406ec70 0x7fca54156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 -- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 msgr2=0x7fca5415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 0x7fca5415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 -- 172.21.15.64:0/2730675830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca540aed10 con 0x7fca541571b0 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca49400640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 0x7fca5415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca52800640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00ec70 tx=0x7fca4c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c003b80 con 0x7fca541571b0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca4c003d20 con 0x7fca541571b0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca540b03b0 con 0x7fca541571b0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c004280 con 0x7fca541571b0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.276+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541579c0 con 0x7fca541571b0 2024-09-21T07:23:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.280+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5415caf0 con 0x7fca541571b0 2024-09-21T07:23:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.280+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fca4c004420 con 0x7fca541571b0 2024-09-21T07:23:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.280+0000 7fca4aa00640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 0x7fca30075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.280+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fca4c095360 con 0x7fca541571b0 2024-09-21T07:23:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.280+0000 7fca51e00640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 0x7fca30075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.284+0000 7fca51e00640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 0x7fca30075740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca540cc8f0 tx=0x7fca44009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.284+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fca4c05ffa0 con 0x7fca541571b0 2024-09-21T07:23:32.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:32.464+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fca541faa00 con 0x7fca541571b0 2024-09-21T07:23:33.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.088+0000 7fca4aa00640 1 -- 172.21.15.64:0/2730675830 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fca4c05f8a0 con 0x7fca541571b0 2024-09-21T07:23:33.095 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 msgr2=0x7fca30075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 0x7fca30075740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca540cc8f0 tx=0x7fca44009040 comp rx=0 tx=0).stop 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 msgr2=0x7fca5415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00ec70 tx=0x7fca4c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 shutdown_connections 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca30073230 0x7fca30075740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca541571b0 0x7fca5415abd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca540af360 0x7fca5415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 --2- 172.21.15.64:0/2730675830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca5406ec70 0x7fca54156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 >> 172.21.15.64:0/2730675830 conn(0x7fca540d0170 msgr2=0x7fca540b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 shutdown_connections 2024-09-21T07:23:33.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.092+0000 7fca59200640 1 -- 172.21.15.64:0/2730675830 wait complete. 2024-09-21T07:23:33.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:23:33.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- 172.21.15.64:0/1764497593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800ace00 msgr2=0x7f5e800ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 --2- 172.21.15.64:0/1764497593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800ace00 0x7f5e800ad210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5e80072880 tx=0x7f5e6c01c650 comp rx=0 tx=0).stop 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- 172.21.15.64:0/1764497593 shutdown_connections 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 --2- 172.21.15.64:0/1764497593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800ace00 0x7f5e800ad210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 --2- 172.21.15.64:0/1764497593 >> v2:172.21.15.90:3300/0 conn(0x7f5e800ca7c0 0x7f5e8015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- 172.21.15.64:0/1764497593 >> 172.21.15.64:0/1764497593 conn(0x7f5e800d0170 msgr2=0x7f5e800d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- 172.21.15.64:0/1764497593 shutdown_connections 2024-09-21T07:23:33.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- 172.21.15.64:0/1764497593 wait complete. 2024-09-21T07:23:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 Processor -- start 2024-09-21T07:23:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.284+0000 7f5e88200640 1 -- start start 2024-09-21T07:23:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e800ace00 0x7f5e800c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e800ca7c0 0x7f5e800c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80169b90 con 0x7f5e800cc080 2024-09-21T07:23:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e800cc890 con 0x7f5e800ace00 2024-09-21T07:23:33.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5e80169d10 con 0x7f5e800ca7c0 2024-09-21T07:23:33.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60854/0 (socket says 172.21.15.64:60854) 2024-09-21T07:23:33.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 -- 172.21.15.64:0/2108589178 learned_addr learned my addr 172.21.15.64:0/2108589178 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e85800640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e800ace00 0x7f5e800c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e84e00640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e800ca7c0 0x7f5e800c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 -- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e800ca7c0 msgr2=0x7f5e800c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e800ca7c0 0x7f5e800c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 -- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e800ace00 msgr2=0x7f5e800c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e800ace00 0x7f5e800c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 -- 172.21.15.64:0/2108589178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e800adfe0 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e86200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b9a0 tx=0x7f5e7800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78019070 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e7800cc90 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801fcc40 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780146a0 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e800cdd40 con 0x7f5e800cc080 2024-09-21T07:23:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.288+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e800ad210 con 0x7f5e800cc080 2024-09-21T07:23:33.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.292+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5e7801c070 con 0x7f5e800cc080 2024-09-21T07:23:33.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.292+0000 7f5e7d600640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 0x7f5e60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.292+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6383+0+0 (secure 0 0 0) 0x7f5e78094370 con 0x7f5e800cc080 2024-09-21T07:23:33.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.292+0000 7f5e85800640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 0x7f5e60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.292+0000 7f5e85800640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 0x7f5e60075710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e740058d0 tx=0x7f5e74005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.296+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5e7805f050 con 0x7f5e800cc080 2024-09-21T07:23:33.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:33.476+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e8009db90 con 0x7f5e800cc080 2024-09-21T07:23:34.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.092+0000 7f5e7d600640 1 -- 172.21.15.64:0/2108589178 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f5e7805e950 con 0x7f5e800cc080 2024-09-21T07:23:34.097 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.092+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 msgr2=0x7f5e60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.092+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 0x7f5e60075710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e740058d0 tx=0x7f5e74005860 comp rx=0 tx=0).stop 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.092+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 msgr2=0x7f5e800c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.092+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b9a0 tx=0x7f5e7800be60 comp rx=0 tx=0).stop 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 shutdown_connections 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e60073200 0x7f5e60075710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e800cc080 0x7f5e800c6310 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e800ca7c0 0x7f5e800c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 --2- 172.21.15.64:0/2108589178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e800ace00 0x7f5e800c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 >> 172.21.15.64:0/2108589178 conn(0x7f5e800d0170 msgr2=0x7f5e8009cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 shutdown_connections 2024-09-21T07:23:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.096+0000 7f5e88200640 1 -- 172.21.15.64:0/2108589178 wait complete. 2024-09-21T07:23:34.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 -- 172.21.15.64:0/2504591219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 msgr2=0x7fd9a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 --2- 172.21.15.64:0/2504591219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9a8003e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009b10 tx=0x7fd9b401d250 comp rx=0 tx=0).stop 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c6800640 1 -- 172.21.15.64:0/2504591219 reap_dead start 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 -- 172.21.15.64:0/2504591219 shutdown_connections 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 -- 172.21.15.64:0/2504591219 >> 172.21.15.64:0/2504591219 conn(0x7fd9c00d0170 msgr2=0x7fd9c00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 -- 172.21.15.64:0/2504591219 shutdown_connections 2024-09-21T07:23:34.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.292+0000 7fd9c8800640 1 -- 172.21.15.64:0/2504591219 wait complete. 2024-09-21T07:23:34.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 Processor -- start 2024-09-21T07:23:34.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- start start 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9c00b57d0 0x7fd9c0157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 0x7fd9c015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0159140 con 0x7fd9a80039f0 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0158fc0 con 0x7fd9c015bab0 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c015fb90 con 0x7fd9c00b57d0 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60884/0 (socket says 172.21.15.64:60884) 2024-09-21T07:23:34.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 -- 172.21.15.64:0/1855504593 learned_addr learned my addr 172.21.15.64:0/1855504593 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5400640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9c00b57d0 0x7fd9c0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c6800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 0x7fd9c015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 -- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9c00b57d0 msgr2=0x7fd9c0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9c00b57d0 0x7fd9c0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 -- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 msgr2=0x7fd9c015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 0x7fd9c015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 -- 172.21.15.64:0/1855504593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c015c400 con 0x7fd9a80039f0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c6800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 0x7fd9c015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c5e00640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b401ccc0 tx=0x7fd9b4005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40b1070 con 0x7fd9a80039f0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9b40b2040 con 0x7fd9a80039f0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c01f5e30 con 0x7fd9a80039f0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40acb40 con 0x7fd9a80039f0 2024-09-21T07:23:34.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.296+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01f63f0 con 0x7fd9a80039f0 2024-09-21T07:23:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.300+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c015f480 con 0x7fd9a80039f0 2024-09-21T07:23:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.300+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd9b40c1060 con 0x7fd9a80039f0 2024-09-21T07:23:34.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.300+0000 7fd9ba000640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 0x7fd9a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.300+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5853+0+0 (secure 0 0 0) 0x7fd9b412ead0 con 0x7fd9a80039f0 2024-09-21T07:23:34.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.300+0000 7fd9c5400640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 0x7fd9a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.304+0000 7fd9c5400640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 0x7fd9a4075710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b3270 tx=0x7fd9b0003f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.304+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd9c015c400 con 0x7fd9a80039f0 2024-09-21T07:23:34.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:34.484+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd9c015e870 con 0x7fd9a80039f0 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.108+0000 7fd9ba000640 1 -- 172.21.15.64:0/1855504593 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fd9b4016f60 con 0x7fd9a80039f0 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data_ec' removed 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 msgr2=0x7fd9a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 0x7fd9a4075710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b3270 tx=0x7fd9b0003f40 comp rx=0 tx=0).stop 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 msgr2=0x7fd9c01f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b401ccc0 tx=0x7fd9b4005600 comp rx=0 tx=0).stop 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 shutdown_connections 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd9a4073200 0x7fd9a4075710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9c015bab0 0x7fd9c015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9c00b57d0 0x7fd9c0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 --2- 172.21.15.64:0/1855504593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9a80039f0 0x7fd9c01f9c40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 >> 172.21.15.64:0/1855504593 conn(0x7fd9c00d0170 msgr2=0x7fd9c00ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 shutdown_connections 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.112+0000 7fd9c8800640 1 -- 172.21.15.64:0/1855504593 wait complete. 2024-09-21T07:23:35.147 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:23:35.147 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:23:35.148 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:35.148 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:23:35.148 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:23:35.148 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:35.148 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:23:35.148 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:23:35.149 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:35.149 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:23:35.149 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:23:35.149 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:35.162 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:23:35.162 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:23:35.164 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:23:35.164 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:23:35.165 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:23:35.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:23:35.172 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:23:35.172 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:23:35.215 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:23:35.215 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:35.217 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:23:35.217 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:35.217 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:23:35.218 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:35.220 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:23:35.220 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:35.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:23:35.312 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:23:35.315 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:23:35.322 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:23:35.323 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- 172.21.15.64:0/2397837146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00cfed0 msgr2=0x7f2ef00b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 --2- 172.21.15.64:0/2397837146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00cfed0 0x7f2ef00b11e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00ce5b0 tx=0x7f2ee001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- 172.21.15.64:0/2397837146 shutdown_connections 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 --2- 172.21.15.64:0/2397837146 >> v2:172.21.15.90:3300/0 conn(0x7f2ef00b1af0 0x7f2ef00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 --2- 172.21.15.64:0/2397837146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00cfed0 0x7f2ef00b11e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- 172.21.15.64:0/2397837146 >> 172.21.15.64:0/2397837146 conn(0x7f2ef009b3b0 msgr2=0x7f2ef00d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- 172.21.15.64:0/2397837146 shutdown_connections 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- 172.21.15.64:0/2397837146 wait complete. 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 Processor -- start 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.384+0000 7f2eef200640 1 -- start start 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ef00b1af0 0x7f2ef01520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ef00cfed0 0x7f2ef0159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0169e40 con 0x7f2ef00ceab0 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0169cc0 con 0x7f2ef00b1af0 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef0169fc0 con 0x7f2ef00cfed0 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47658/0 (socket says 172.21.15.64:47658) 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 -- 172.21.15.64:0/3392936006 learned_addr learned my addr 172.21.15.64:0/3392936006 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eede00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ef00b1af0 0x7f2ef01520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eee800640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ef00cfed0 0x7f2ef0159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 -- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ef00cfed0 msgr2=0x7f2ef0159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ef00cfed0 0x7f2ef0159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 -- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ef00b1af0 msgr2=0x7f2ef01520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ef00b1af0 0x7f2ef01520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 -- 172.21.15.64:0/3392936006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef01f6cb0 con 0x7f2ef00ceab0 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee7e00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b3e0 tx=0x7f2ed800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8015020 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ed8011920 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef015c410 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011db0 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef00b6470 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.388+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef00b1f00 con 0x7f2ef00ceab0 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.392+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2ed8018020 con 0x7f2ef00ceab0 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.392+0000 7f2ee6000640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 0x7f2ecc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.392+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f2ed8093b70 con 0x7f2ef00ceab0 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.392+0000 7f2eede00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 0x7f2ecc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.392+0000 7f2eede00640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 0x7f2ecc075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00af000 tx=0x7f2ee001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.396+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2ed801f030 con 0x7f2ef00ceab0 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:35.588+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2ef00d0b50 con 0x7f2ef00ceab0 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.128+0000 7f2ee6000640 1 -- 172.21.15.64:0/3392936006 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f2ed805e6a0 con 0x7f2ef00ceab0 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.128+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 msgr2=0x7f2ecc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.128+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 0x7f2ecc075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00af000 tx=0x7f2ee001b100 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.128+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 msgr2=0x7f2ef0159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.128+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b3e0 tx=0x7f2ed800b8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 shutdown_connections 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ecc073230 0x7f2ecc075740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ef00cfed0 0x7f2ef0159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ef00ceab0 0x7f2ef0159580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 --2- 172.21.15.64:0/3392936006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ef00b1af0 0x7f2ef01520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 >> 172.21.15.64:0/3392936006 conn(0x7f2ef009b3b0 msgr2=0x7f2ef0068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 shutdown_connections 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.132+0000 7f2eef200640 1 -- 172.21.15.64:0/3392936006 wait complete. 2024-09-21T07:23:36.159 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- 172.21.15.64:0/338123805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e40c6410 msgr2=0x7f86e40c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 --2- 172.21.15.64:0/338123805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e40c6410 0x7f86e40c6820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009bc0 tx=0x7f86dc01cac0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- 172.21.15.64:0/338123805 shutdown_connections 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 --2- 172.21.15.64:0/338123805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e40c6410 0x7f86e40c6820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 --2- 172.21.15.64:0/338123805 >> v2:172.21.15.90:3300/0 conn(0x7f86e40b4460 0x7f86e40c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- 172.21.15.64:0/338123805 >> 172.21.15.64:0/338123805 conn(0x7f86e406d220 msgr2=0x7f86e406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- 172.21.15.64:0/338123805 shutdown_connections 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- 172.21.15.64:0/338123805 wait complete. 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 Processor -- start 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.312+0000 7f86e8c00640 1 -- start start 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86e415c7e0 0x7f86e4147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e415b480 0x7f86e415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4169ff0 con 0x7f86e40c6410 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4169e70 con 0x7f86e415c7e0 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f86e416a170 con 0x7f86e415b480 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47664/0 (socket says 172.21.15.64:47664) 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 -- 172.21.15.64:0/2378606453 learned_addr learned my addr 172.21.15.64:0/2378606453 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e2800640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e415b480 0x7f86e415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86dbe00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86e415c7e0 0x7f86e4147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 -- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e415b480 msgr2=0x7f86e415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e415b480 0x7f86e415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 -- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86e415c7e0 msgr2=0x7f86e4147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86e415c7e0 0x7f86e4147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 -- 172.21.15.64:0/2378606453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e415bdd0 con 0x7f86e40c6410 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e1e00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c500 tx=0x7f86d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4016020 con 0x7f86e40c6410 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86d4012940 con 0x7f86e40c6410 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e4147bc0 con 0x7f86e40c6410 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4012d90 con 0x7f86e40c6410 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e4148180 con 0x7f86e40c6410 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.316+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e40c5ed0 con 0x7f86e40c6410 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.320+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f86d4019020 con 0x7f86e40c6410 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.320+0000 7f86da000640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 0x7f86c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.320+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f86d4094230 con 0x7f86e40c6410 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.320+0000 7f86dbe00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 0x7f86c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.320+0000 7f86dbe00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 0x7f86c0075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ad0 tx=0x7f86cc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.324+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f86d4020020 con 0x7f86e40c6410 2024-09-21T07:23:36.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.560+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f86e4071dc0 con 0x7f86e40c6410 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.560+0000 7f86da000640 1 -- 172.21.15.64:0/2378606453 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+6645 (secure 0 0 0) 0x7f86e415bdd0 con 0x7f86e40c6410 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:23:36.568 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.569 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:23:36.570 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:23:36.571 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.574 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.575 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:23:36.576 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:23:36.577 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:23:36.578 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-mds", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5mnASQORAAZfmY2qwDw8moeV5UC00O5Q==", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T07:23:36.579 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5muhCQORAA4fsIPyGgtXeVDi5DfXMN1A==", 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-osd", 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5m+RqQORAAoEP23KXQhBOa8n0VHgVLdQ==", 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5mDyWQORAAsAQSo9oUUucXWkLRnM6nTA==", 2024-09-21T07:23:36.580 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5msC6QORAAZ5GyJ81zLT/UtCN3vGWMFQ==", 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAtdO5m+TeQORAAFGr4+RAVCL4Jo8WAjr9/+A==", 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:23:36.582 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:23:36.583 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 msgr2=0x7f86c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 0x7f86c0075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ad0 tx=0x7f86cc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 msgr2=0x7f86e415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c500 tx=0x7f86d400c9c0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 shutdown_connections 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f86c0073200 0x7f86c0075710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86e415b480 0x7f86e415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86e415c7e0 0x7f86e4147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 --2- 172.21.15.64:0/2378606453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86e40c6410 0x7f86e415f9c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 >> 172.21.15.64:0/2378606453 conn(0x7f86e406d220 msgr2=0x7f86e40b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:36.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 shutdown_connections 2024-09-21T07:23:36.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.564+0000 7f86e8c00640 1 -- 172.21.15.64:0/2378606453 wait complete. 2024-09-21T07:23:36.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 -- 172.21.15.64:0/4082155897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 msgr2=0x7fe8e40b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/4082155897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40b3910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40cfce0 tx=0x7fe8dc01cb80 comp rx=0 tx=0).stop 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 -- 172.21.15.64:0/4082155897 shutdown_connections 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/4082155897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40b3910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/4082155897 >> v2:172.21.15.90:3300/0 conn(0x7fe8e40cb9d0 0x7fe8e40cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 -- 172.21.15.64:0/4082155897 >> 172.21.15.64:0/4082155897 conn(0x7fe8e40b1c60 msgr2=0x7fe8e40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:36.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 -- 172.21.15.64:0/4082155897 shutdown_connections 2024-09-21T07:23:36.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 -- 172.21.15.64:0/4082155897 wait complete. 2024-09-21T07:23:36.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.744+0000 7fe8e3e00640 1 Processor -- start 2024-09-21T07:23:36.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- start start 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e40730b0 0x7fe8e41535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e40cb9d0 0x7fe8e40cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4169da0 con 0x7fe8e40b3500 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4169c20 con 0x7fe8e40cb9d0 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e4169f20 con 0x7fe8e40730b0 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47688/0 (socket says 172.21.15.64:47688) 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 -- 172.21.15.64:0/1007084026 learned_addr learned my addr 172.21.15.64:0/1007084026 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2a00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e40730b0 0x7fe8e41535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3400640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e40cb9d0 0x7fe8e40cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 -- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e40730b0 msgr2=0x7fe8e41535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e40730b0 0x7fe8e41535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 -- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e40cb9d0 msgr2=0x7fe8e40cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e40cb9d0 0x7fe8e40cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 -- 172.21.15.64:0/1007084026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41fca80 con 0x7fe8e40b3500 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e2000640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c3a0 tx=0x7fe8d000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0017070 con 0x7fe8e40b3500 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8d0003600 con 0x7fe8e40b3500 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e4158800 con 0x7fe8e40b3500 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0003a50 con 0x7fe8e40b3500 2024-09-21T07:23:36.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.748+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e40ce730 con 0x7fe8e40b3500 2024-09-21T07:23:36.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.752+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e40b3910 con 0x7fe8e40b3500 2024-09-21T07:23:36.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.752+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8d001a070 con 0x7fe8e40b3500 2024-09-21T07:23:36.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.752+0000 7fe8daa00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 0x7fe8c4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:36.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.752+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fe8d0093240 con 0x7fe8e40b3500 2024-09-21T07:23:36.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.752+0000 7fe8e2a00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 0x7fe8c4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:36.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.756+0000 7fe8e2a00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 0x7fe8c4075740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004630 tx=0x7fe8d400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:36.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.756+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe8d005de00 con 0x7fe8e40b3500 2024-09-21T07:23:37.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:36.996+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fe8e415b300 con 0x7fe8e40b3500 2024-09-21T07:23:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8daa00640 1 -- 172.21.15.64:0/1007084026 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v17) ==== 90+0+0 (secure 0 0 0) 0x7fe8d0062830 con 0x7fe8e40b3500 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 msgr2=0x7fe8c4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 0x7fe8c4075740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004630 tx=0x7fe8d400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 msgr2=0x7fe8e40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c3a0 tx=0x7fe8d000c860 comp rx=0 tx=0).stop 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 shutdown_connections 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8c4073230 0x7fe8c4075740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e40cb9d0 0x7fe8e40cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e40b3500 0x7fe8e40c2d30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 --2- 172.21.15.64:0/1007084026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e40730b0 0x7fe8e41535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 >> 172.21.15.64:0/1007084026 conn(0x7fe8e40b1c60 msgr2=0x7fe8e40b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 shutdown_connections 2024-09-21T07:23:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.000+0000 7fe8e3e00640 1 -- 172.21.15.64:0/1007084026 wait complete. 2024-09-21T07:23:37.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T07:23:37.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 -- 172.21.15.64:0/1412667044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700cd410 msgr2=0x7f26700b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 --2- 172.21.15.64:0/1412667044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700cd410 0x7f26700b4de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2658009870 tx=0x7f265801c860 comp rx=0 tx=0).stop 2024-09-21T07:23:37.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 -- 172.21.15.64:0/1412667044 shutdown_connections 2024-09-21T07:23:37.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 --2- 172.21.15.64:0/1412667044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700cd410 0x7f26700b4de0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 -- 172.21.15.64:0/1412667044 >> 172.21.15.64:0/1412667044 conn(0x7f267006d450 msgr2=0x7f26700d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:37.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 -- 172.21.15.64:0/1412667044 shutdown_connections 2024-09-21T07:23:37.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.184+0000 7f2675400640 1 -- 172.21.15.64:0/1412667044 wait complete. 2024-09-21T07:23:37.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 Processor -- start 2024-09-21T07:23:37.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- start start 2024-09-21T07:23:37.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700d0e60 0x7f26700adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26700ae4b0 0x7f2670153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f267016b100 con 0x7f267006ee80 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f267016af80 con 0x7f26700ae4b0 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f267016b280 con 0x7f26700d0e60 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47702/0 (socket says 172.21.15.64:47702) 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 -- 172.21.15.64:0/3488086055 learned_addr learned my addr 172.21.15.64:0/3488086055 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266f200640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26700ae4b0 0x7f2670153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2665e00640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700d0e60 0x7f26700adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 -- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700d0e60 msgr2=0x7f26700adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700d0e60 0x7f26700adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 -- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26700ae4b0 msgr2=0x7f2670153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26700ae4b0 0x7f2670153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 -- 172.21.15.64:0/3488086055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26700b07d0 con 0x7f267006ee80 2024-09-21T07:23:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f266e800640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f266000c4c0 tx=0x7f266000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660007030 con 0x7f267006ee80 2024-09-21T07:23:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26600071d0 con 0x7f267006ee80 2024-09-21T07:23:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26700b0ab0 con 0x7f267006ee80 2024-09-21T07:23:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660007600 con 0x7f267006ee80 2024-09-21T07:23:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.188+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701634e0 con 0x7f267006ee80 2024-09-21T07:23:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.192+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26700b4de0 con 0x7f267006ee80 2024-09-21T07:23:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.192+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2660011070 con 0x7f267006ee80 2024-09-21T07:23:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.192+0000 7f2667400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 0x7f264c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.192+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f2660093970 con 0x7f267006ee80 2024-09-21T07:23:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.192+0000 7f2665e00640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 0x7f264c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.196+0000 7f2665e00640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 0x7f264c075740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26580af000 tx=0x7f265801b0a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:37.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.196+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f26700b4360 con 0x7f267006ee80 2024-09-21T07:23:37.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.435+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f26700b0290 con 0x7f267006ee80 2024-09-21T07:23:37.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.435+0000 7f2667400640 1 -- 172.21.15.64:0/3488086055 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v18) ==== 90+0+0 (secure 0 0 0) 0x7f266005e470 con 0x7f267006ee80 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 msgr2=0x7f264c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 0x7f264c075740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26580af000 tx=0x7f265801b0a0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 msgr2=0x7f26700afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f266000c4c0 tx=0x7f266000c980 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 shutdown_connections 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f264c073230 0x7f264c075740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26700ae4b0 0x7f2670153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26700d0e60 0x7f26700adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 --2- 172.21.15.64:0/3488086055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f267006ee80 0x7f26700afd50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 >> 172.21.15.64:0/3488086055 conn(0x7f267006d450 msgr2=0x7f26700ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:37.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 shutdown_connections 2024-09-21T07:23:37.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.439+0000 7f2675400640 1 -- 172.21.15.64:0/3488086055 wait complete. 2024-09-21T07:23:37.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- 172.21.15.64:0/62577482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 msgr2=0x7f920406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 --2- 172.21.15.64:0/62577482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f920406f290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9204074380 tx=0x7f91fc01cba0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- 172.21.15.64:0/62577482 shutdown_connections 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 --2- 172.21.15.64:0/62577482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f920406f290 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 --2- 172.21.15.64:0/62577482 >> v2:172.21.15.90:3300/0 conn(0x7f92040cd410 0x7f92040b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- 172.21.15.64:0/62577482 >> 172.21.15.64:0/62577482 conn(0x7f920406d450 msgr2=0x7f92040d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- 172.21.15.64:0/62577482 shutdown_connections 2024-09-21T07:23:37.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- 172.21.15.64:0/62577482 wait complete. 2024-09-21T07:23:37.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 Processor -- start 2024-09-21T07:23:37.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.619+0000 7f9209e00640 1 -- start start 2024-09-21T07:23:37.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d0e60 0x7f92041608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92040cbf80 0x7f92040cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f920416a1f0 con 0x7f920406ee80 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f920416a070 con 0x7f92040d0e60 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f920416a370 con 0x7f92040cbf80 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47718/0 (socket says 172.21.15.64:47718) 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 -- 172.21.15.64:0/1344098655 learned_addr learned my addr 172.21.15.64:0/1344098655 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f91fbe00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d0e60 0x7f92041608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9203400640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92040cbf80 0x7f92040cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 -- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92040cbf80 msgr2=0x7f92040cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92040cbf80 0x7f92040cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 -- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d0e60 msgr2=0x7f92041608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d0e60 0x7f92041608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 -- 172.21.15.64:0/1344098655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040cc8d0 con 0x7f920406ee80 2024-09-21T07:23:37.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9202a00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91f400b3f0 tx=0x7f91f400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:37.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4015020 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91f4011940 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4011d90 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92040b1c40 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92040b2200 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.623+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040c73a0 con 0x7f920406ee80 2024-09-21T07:23:37.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.627+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91f4018020 con 0x7f920406ee80 2024-09-21T07:23:37.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.627+0000 7f91fb400640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 0x7f91e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:37.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.627+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f91f4093c80 con 0x7f920406ee80 2024-09-21T07:23:37.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.627+0000 7f91fbe00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 0x7f91e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:37.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.627+0000 7f91fbe00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 0x7f91e0075740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92040ad170 tx=0x7f91ec00a250 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.631+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f92040cc8d0 con 0x7f920406ee80 2024-09-21T07:23:37.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.867+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f920406f290 con 0x7f920406ee80 2024-09-21T07:23:37.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.871+0000 7f91fb400640 1 -- 172.21.15.64:0/1344098655 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v19) ==== 90+0+0 (secure 0 0 0) 0x7f91f405e770 con 0x7f920406ee80 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 msgr2=0x7f91e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 0x7f91e0075740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92040ad170 tx=0x7f91ec00a250 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 msgr2=0x7f92040cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91f400b3f0 tx=0x7f91f400b8b0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 shutdown_connections 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073230 0x7f91e0075740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92040cbf80 0x7f92040cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d0e60 0x7f92041608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 --2- 172.21.15.64:0/1344098655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f920406ee80 0x7f92040cb280 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 >> 172.21.15.64:0/1344098655 conn(0x7f920406d450 msgr2=0x7f9204073210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 shutdown_connections 2024-09-21T07:23:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:37.875+0000 7f9209e00640 1 -- 172.21.15.64:0/1344098655 wait complete. 2024-09-21T07:23:37.901 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T07:23:38.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- 172.21.15.64:0/2986663799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813409df30 msgr2=0x7f81340b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 --2- 172.21.15.64:0/2986663799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813409df30 0x7f81340b33d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f812401c740 comp rx=0 tx=0).stop 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- 172.21.15.64:0/2986663799 shutdown_connections 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 --2- 172.21.15.64:0/2986663799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813409df30 0x7f81340b33d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- 172.21.15.64:0/2986663799 >> 172.21.15.64:0/2986663799 conn(0x7f813406d450 msgr2=0x7f81340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- 172.21.15.64:0/2986663799 shutdown_connections 2024-09-21T07:23:38.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- 172.21.15.64:0/2986663799 wait complete. 2024-09-21T07:23:38.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 Processor -- start 2024-09-21T07:23:38.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.055+0000 7f8139a00640 1 -- start start 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81340b3910 0x7f8134144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81340ce900 0x7f81341580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f813416a490 con 0x7f813409df30 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f813416a310 con 0x7f81340b3910 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f813416a610 con 0x7f81340ce900 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47728/0 (socket says 172.21.15.64:47728) 2024-09-21T07:23:38.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 -- 172.21.15.64:0/3383540312 learned_addr learned my addr 172.21.15.64:0/3383540312 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f812be00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81340b3910 0x7f8134144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8133400640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81340ce900 0x7f81341580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 -- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81340ce900 msgr2=0x7f81341580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81340ce900 0x7f81341580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 -- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81340b3910 msgr2=0x7f8134144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81340b3910 0x7f8134144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 -- 172.21.15.64:0/3383540312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8134151de0 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8132a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8124019350 tx=0x7f8124005170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240b0070 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81240b1040 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8134144d50 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124004910 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.059+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341fd380 con 0x7f813409df30 2024-09-21T07:23:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81340b33d0 con 0x7f813409df30 2024-09-21T07:23:38.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f81240bd020 con 0x7f813409df30 2024-09-21T07:23:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f812aa00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 0x7f8110075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f812412dad0 con 0x7f813409df30 2024-09-21T07:23:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f812be00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 0x7f8110075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.063+0000 7f812be00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 0x7f8110075740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81340c87a0 tx=0x7f811c0017a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.067+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f81240c4020 con 0x7f813409df30 2024-09-21T07:23:38.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.311+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f81340cd1c0 con 0x7f813409df30 2024-09-21T07:23:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f812aa00640 1 -- 172.21.15.64:0/3383540312 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v20) ==== 90+0+0 (secure 0 0 0) 0x7f8134151de0 con 0x7f813409df30 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 msgr2=0x7f8110075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 0x7f8110075740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81340c87a0 tx=0x7f811c0017a0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 msgr2=0x7f81340b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8124019350 tx=0x7f8124005170 comp rx=0 tx=0).stop 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 shutdown_connections 2024-09-21T07:23:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8110073230 0x7f8110075740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81340ce900 0x7f81341580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81340b3910 0x7f8134144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 --2- 172.21.15.64:0/3383540312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f813409df30 0x7f81340b2950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 >> 172.21.15.64:0/3383540312 conn(0x7f813406d450 msgr2=0x7f8134154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 shutdown_connections 2024-09-21T07:23:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.315+0000 7f8139a00640 1 -- 172.21.15.64:0/3383540312 wait complete. 2024-09-21T07:23:38.343 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 -- 172.21.15.64:0/1642325974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a0073ea0 msgr2=0x7f04a00742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 --2- 172.21.15.64:0/1642325974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a0073ea0 0x7f04a00742b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0498009c80 tx=0x7f049801cc50 comp rx=0 tx=0).stop 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 -- 172.21.15.64:0/1642325974 shutdown_connections 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 --2- 172.21.15.64:0/1642325974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a0073ea0 0x7f04a00742b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 --2- 172.21.15.64:0/1642325974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a00cc910 0x7f04a00ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 -- 172.21.15.64:0/1642325974 >> 172.21.15.64:0/1642325974 conn(0x7f04a00b1c60 msgr2=0x7f04a00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:38.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 -- 172.21.15.64:0/1642325974 shutdown_connections 2024-09-21T07:23:38.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 -- 172.21.15.64:0/1642325974 wait complete. 2024-09-21T07:23:38.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.499+0000 7f04a5e00640 1 Processor -- start 2024-09-21T07:23:38.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- start start 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a0073ea0 0x7f04a0157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00cc910 0x7f04a0158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0074970 con 0x7f04a015fa60 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00747f0 con 0x7f04a00cc910 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f04a01689f0 con 0x7f04a0073ea0 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47744/0 (socket says 172.21.15.64:47744) 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 -- 172.21.15.64:0/477452447 learned_addr learned my addr 172.21.15.64:0/477452447 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f0497e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00cc910 0x7f04a0158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a4a00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a0073ea0 0x7f04a0157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 -- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a0073ea0 msgr2=0x7f04a0157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a0073ea0 0x7f04a0157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 -- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00cc910 msgr2=0x7f04a0158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00cc910 0x7f04a0158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 -- 172.21.15.64:0/477452447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a0050f70 con 0x7f04a015fa60 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5400640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0498009bd0 tx=0x7f04980093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980b2040 con 0x7f04a015fa60 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0498004200 con 0x7f04a015fa60 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a01656c0 con 0x7f04a015fa60 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498004630 con 0x7f04a015fa60 2024-09-21T07:23:38.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.503+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a0160b50 con 0x7f04a015fa60 2024-09-21T07:23:38.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a0165140 con 0x7f04a015fa60 2024-09-21T07:23:38.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f04980ad440 con 0x7f04a015fa60 2024-09-21T07:23:38.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f049d600640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f049812e740 con 0x7f04a015fa60 2024-09-21T07:23:38.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f04a4a00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.507+0000 7f04a4a00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0490007fd0 tx=0x7f0490009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.511+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f04a0165140 con 0x7f04a015fa60 2024-09-21T07:23:38.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:23:38.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:23:38.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.751+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f04a00742b0 con 0x7f04a015fa60 2024-09-21T07:23:38.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.755+0000 7f049d600640 1 -- 172.21.15.64:0/477452447 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v21) ==== 97+0+0 (secure 0 0 0) 0x7f0498016990 con 0x7f04a015fa60 2024-09-21T07:23:38.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 msgr2=0x7f047c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0490007fd0 tx=0x7f0490009040 comp rx=0 tx=0).stop 2024-09-21T07:23:38.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 msgr2=0x7f04a01fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0498009bd0 tx=0x7f04980093d0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 shutdown_connections 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a015fa60 0x7f04a01fbde0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00cc910 0x7f04a0158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 --2- 172.21.15.64:0/477452447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a0073ea0 0x7f04a0157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 >> 172.21.15.64:0/477452447 conn(0x7f04a00b1c60 msgr2=0x7f04a01658b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 shutdown_connections 2024-09-21T07:23:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.759+0000 7f04a5e00640 1 -- 172.21.15.64:0/477452447 wait complete. 2024-09-21T07:23:38.783 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 -- 172.21.15.64:0/2211868662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc0b3910 msgr2=0x7f56bc0ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 --2- 172.21.15.64:0/2211868662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc0b3910 0x7f56bc0ce1f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009840 tx=0x7f56a401c820 comp rx=0 tx=0).stop 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 -- 172.21.15.64:0/2211868662 shutdown_connections 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 --2- 172.21.15.64:0/2211868662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc0b3910 0x7f56bc0ce1f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 --2- 172.21.15.64:0/2211868662 >> v2:172.21.15.90:3300/0 conn(0x7f56bc09df30 0x7f56bc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 -- 172.21.15.64:0/2211868662 >> 172.21.15.64:0/2211868662 conn(0x7f56bc06d450 msgr2=0x7f56bc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 -- 172.21.15.64:0/2211868662 shutdown_connections 2024-09-21T07:23:38.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.939+0000 7f56c1c00640 1 -- 172.21.15.64:0/2211868662 wait complete. 2024-09-21T07:23:38.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 Processor -- start 2024-09-21T07:23:38.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- start start 2024-09-21T07:23:38.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 0x7f56bc0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 0x7f56bc1fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc169160 con 0x7f56bc0b3910 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc168fe0 con 0x7f56bc0ce730 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc1692e0 con 0x7f56bc09df30 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47752/0 (socket says 172.21.15.64:47752) 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 -- 172.21.15.64:0/1057413230 learned_addr learned my addr 172.21.15.64:0/1057413230 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:38.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56baa00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 0x7f56bc0b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56bb400640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 0x7f56bc1fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 -- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 msgr2=0x7f56bc0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 0x7f56bc0b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 -- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 msgr2=0x7f56bc1fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 0x7f56bc1fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 -- 172.21.15.64:0/1057413230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1f99b0 con 0x7f56bc0b3910 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56baa00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 0x7f56bc0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56bb400640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 0x7f56bc1fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b2000640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009790 tx=0x7f56a40a6570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a40be070 con 0x7f56bc0b3910 2024-09-21T07:23:38.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1f9c90 con 0x7f56bc0b3910 2024-09-21T07:23:38.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56a4004330 con 0x7f56bc0b3910 2024-09-21T07:23:38.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a40052d0 con 0x7f56bc0b3910 2024-09-21T07:23:38.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.943+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc0b0000 con 0x7f56bc0b3910 2024-09-21T07:23:38.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.947+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc0b33d0 con 0x7f56bc0b3910 2024-09-21T07:23:38.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.947+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f56a4005470 con 0x7f56bc0b3910 2024-09-21T07:23:38.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.947+0000 7f56b3400640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 0x7f5698075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:38.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.947+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f56a412e360 con 0x7f56bc0b3910 2024-09-21T07:23:38.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.947+0000 7f56baa00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 0x7f5698075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:38.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.951+0000 7f56baa00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 0x7f5698075710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005fd0 tx=0x7f56ac005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:38.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:38.951+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f56a4016410 con 0x7f56bc0b3910 2024-09-21T07:23:39.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.191+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f56bc0cbe70 con 0x7f56bc0b3910 2024-09-21T07:23:39.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.195+0000 7f56b3400640 1 -- 172.21.15.64:0/1057413230 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v22) ==== 90+0+0 (secure 0 0 0) 0x7f56a40f94b0 con 0x7f56bc0b3910 2024-09-21T07:23:39.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 msgr2=0x7f5698075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 0x7f5698075710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005fd0 tx=0x7f56ac005f40 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 msgr2=0x7f56bc1487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009790 tx=0x7f56a40a6570 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 shutdown_connections 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5698073200 0x7f5698075710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56bc0ce730 0x7f56bc1fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56bc0b3910 0x7f56bc1487e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 --2- 172.21.15.64:0/1057413230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56bc09df30 0x7f56bc0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 >> 172.21.15.64:0/1057413230 conn(0x7f56bc06d450 msgr2=0x7f56bc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 shutdown_connections 2024-09-21T07:23:39.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.199+0000 7f56c1c00640 1 -- 172.21.15.64:0/1057413230 wait complete. 2024-09-21T07:23:39.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:23:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- 172.21.15.64:0/110661758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f377015edb0 msgr2=0x7f37700700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 --2- 172.21.15.64:0/110661758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f377015edb0 0x7f37700700b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3764009840 tx=0x7f376401c820 comp rx=0 tx=0).stop 2024-09-21T07:23:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- 172.21.15.64:0/110661758 shutdown_connections 2024-09-21T07:23:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 --2- 172.21.15.64:0/110661758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37700b48d0 0x7f3770072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 --2- 172.21.15.64:0/110661758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f377015edb0 0x7f37700700b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- 172.21.15.64:0/110661758 >> 172.21.15.64:0/110661758 conn(0x7f37700ccbe0 msgr2=0x7f37700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- 172.21.15.64:0/110661758 shutdown_connections 2024-09-21T07:23:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- 172.21.15.64:0/110661758 wait complete. 2024-09-21T07:23:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 Processor -- start 2024-09-21T07:23:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.379+0000 7f3778000640 1 -- start start 2024-09-21T07:23:39.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f377015edb0 0x7f37701527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 0x7f3770158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3770168bb0 con 0x7f37700709b0 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3770168a30 con 0x7f3770158850 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3770168d30 con 0x7f377015edb0 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47774/0 (socket says 172.21.15.64:47774) 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 -- 172.21.15.64:0/3799245702 learned_addr learned my addr 172.21.15.64:0/3799245702 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3774c00640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f377015edb0 0x7f37701527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3776000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 0x7f3770158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 -- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f377015edb0 msgr2=0x7f37701527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f377015edb0 0x7f37701527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 -- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 msgr2=0x7f3770158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 0x7f3770158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 -- 172.21.15.64:0/3799245702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37701591a0 con 0x7f37700709b0 2024-09-21T07:23:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3776000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 0x7f3770158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3775600640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37640981c0 tx=0x7f37640a6620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37640be070 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3764004040 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377009cab0 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37640043f0 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377009b2b0 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.383+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770072e20 con 0x7f37700709b0 2024-09-21T07:23:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.387+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f37640c1070 con 0x7f37700709b0 2024-09-21T07:23:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.387+0000 7f376d600640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 0x7f3750075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.387+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f376412e1d0 con 0x7f37700709b0 2024-09-21T07:23:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.387+0000 7f3774c00640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 0x7f3750075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.387+0000 7f3774c00640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 0x7f3750075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f377009c070 tx=0x7f375c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.391+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f37701591a0 con 0x7f37700709b0 2024-09-21T07:23:39.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.571+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f37700b3530 con 0x7f37700709b0 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.571+0000 7f376d600640 1 -- 172.21.15.64:0/3799245702 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f3764016410 con 0x7f37700709b0 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:23:39.575 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:23:39.576 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 msgr2=0x7f3750075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 0x7f3750075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f377009c070 tx=0x7f375c009040 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 msgr2=0x7f37700aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37640981c0 tx=0x7f37640a6620 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 shutdown_connections 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3750073230 0x7f3750075740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3770158850 0x7f3770158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f377015edb0 0x7f37701527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 --2- 172.21.15.64:0/3799245702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37700709b0 0x7f37700aebf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 >> 172.21.15.64:0/3799245702 conn(0x7f37700ccbe0 msgr2=0x7f377015e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 shutdown_connections 2024-09-21T07:23:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.575+0000 7f3778000640 1 -- 172.21.15.64:0/3799245702 wait complete. 2024-09-21T07:23:39.598 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:23:39.598 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- 172.21.15.64:0/404267590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a41594c0 msgr2=0x7f11a40aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 --2- 172.21.15.64:0/404267590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a41594c0 0x7f11a40aee20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f118c009840 tx=0x7f118c01c820 comp rx=0 tx=0).stop 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- 172.21.15.64:0/404267590 shutdown_connections 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 --2- 172.21.15.64:0/404267590 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 0x7f11a415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 --2- 172.21.15.64:0/404267590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a41594c0 0x7f11a40aee20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- 172.21.15.64:0/404267590 >> 172.21.15.64:0/404267590 conn(0x7f11a40d0170 msgr2=0x7f11a40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:39.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- 172.21.15.64:0/404267590 shutdown_connections 2024-09-21T07:23:39.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- 172.21.15.64:0/404267590 wait complete. 2024-09-21T07:23:39.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 Processor -- start 2024-09-21T07:23:39.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.759+0000 7f11ab400640 1 -- start start 2024-09-21T07:23:39.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 0x7f11a4165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11a4152420 0x7f11a4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415c490 con 0x7f11a406ec70 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415c310 con 0x7f11a4152420 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f11a415c610 con 0x7f11a40af360 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47784/0 (socket says 172.21.15.64:47784) 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 -- 172.21.15.64:0/2804017371 learned_addr learned my addr 172.21.15.64:0/2804017371 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f119be00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 0x7f11a4165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 -- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 msgr2=0x7f11a4165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 0x7f11a4165ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a9400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11a4152420 0x7f11a4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 -- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11a4152420 msgr2=0x7f11a4151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11a4152420 0x7f11a4151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 -- 172.21.15.64:0/2804017371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a40b4da0 con 0x7f11a406ec70 2024-09-21T07:23:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a8a00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f119400c3a0 tx=0x7f119400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194017070 con 0x7f11a406ec70 2024-09-21T07:23:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1194003600 con 0x7f11a406ec70 2024-09-21T07:23:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194003a50 con 0x7f11a406ec70 2024-09-21T07:23:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a40b5080 con 0x7f11a406ec70 2024-09-21T07:23:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a40b0630 con 0x7f11a406ec70 2024-09-21T07:23:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.763+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a40b0890 con 0x7f11a406ec70 2024-09-21T07:23:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.767+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f119401a070 con 0x7f11a406ec70 2024-09-21T07:23:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.767+0000 7f11a1600640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 0x7f1180075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.767+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f11940932d0 con 0x7f11a406ec70 2024-09-21T07:23:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.767+0000 7f119be00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 0x7f1180075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:39.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.767+0000 7f119be00640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 0x7f1180075710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f118c0af000 tx=0x7f118c01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.771+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f119405e540 con 0x7f11a406ec70 2024-09-21T07:23:39.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:39.947+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f11a415f480 con 0x7f11a406ec70 2024-09-21T07:23:40.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11a1600640 1 -- 172.21.15.64:0/2804017371 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7f119405de40 con 0x7f11a406ec70 2024-09-21T07:23:40.208 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 msgr2=0x7f1180075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 0x7f1180075710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f118c0af000 tx=0x7f118c01b060 comp rx=0 tx=0).stop 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 msgr2=0x7f11a4166e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f119400c3a0 tx=0x7f119400c860 comp rx=0 tx=0).stop 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 shutdown_connections 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1180073200 0x7f1180075710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11a4152420 0x7f11a4151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11a40af360 0x7f11a4165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 --2- 172.21.15.64:0/2804017371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11a406ec70 0x7f11a4166e70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.207+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 >> 172.21.15.64:0/2804017371 conn(0x7f11a40d0170 msgr2=0x7f11a415b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:40.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.211+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 shutdown_connections 2024-09-21T07:23:40.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.211+0000 7f11ab400640 1 -- 172.21.15.64:0/2804017371 wait complete. 2024-09-21T07:23:40.237 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:23:40.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- 172.21.15.64:0/925149741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea1806d500 msgr2=0x7fea1815ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:40.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 --2- 172.21.15.64:0/925149741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea1806d500 0x7fea1815ef50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea10009bf0 tx=0x7fea1001cbe0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- 172.21.15.64:0/925149741 shutdown_connections 2024-09-21T07:23:40.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 --2- 172.21.15.64:0/925149741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea1806d500 0x7fea1815ef50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- 172.21.15.64:0/925149741 >> 172.21.15.64:0/925149741 conn(0x7fea180cdcf0 msgr2=0x7fea180ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:40.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- 172.21.15.64:0/925149741 shutdown_connections 2024-09-21T07:23:40.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- 172.21.15.64:0/925149741 wait complete. 2024-09-21T07:23:40.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 Processor -- start 2024-09-21T07:23:40.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.403+0000 7fea1d000640 1 -- start start 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea18162f30 0x7fea18161830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 0x7fea18161d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea1816d1d0 con 0x7fea1815c580 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea1816d050 con 0x7fea18153470 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea1816d350 con 0x7fea18162f30 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47790/0 (socket says 172.21.15.64:47790) 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 -- 172.21.15.64:0/2676650560 learned_addr learned my addr 172.21.15.64:0/2676650560 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:40.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea0d400640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea18162f30 0x7fea18161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea16800640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 0x7fea18161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 -- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea18162f30 msgr2=0x7fea18161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea18162f30 0x7fea18161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 -- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 msgr2=0x7fea18161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 0x7fea18161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 -- 172.21.15.64:0/2676650560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea180b39e0 con 0x7fea1815c580 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea16800640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 0x7fea18161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea15e00640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea0800c3e0 tx=0x7fea0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:40.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08017070 con 0x7fea1815c580 2024-09-21T07:23:40.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea080053c0 con 0x7fea1815c580 2024-09-21T07:23:40.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea18151080 con 0x7fea1815c580 2024-09-21T07:23:40.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea080038b0 con 0x7fea1815c580 2024-09-21T07:23:40.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea18152be0 con 0x7fea1815c580 2024-09-21T07:23:40.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.407+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea18152e40 con 0x7fea1815c580 2024-09-21T07:23:40.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.411+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea0801a070 con 0x7fea1815c580 2024-09-21T07:23:40.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.411+0000 7fea0ea00640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 0x7fe9f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:40.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.411+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7fea080937c0 con 0x7fea1815c580 2024-09-21T07:23:40.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.411+0000 7fea0d400640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 0x7fe9f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:40.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.411+0000 7fea0d400640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 0x7fe9f4075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea00007fd0 tx=0x7fea00009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:40.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.415+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fea08021080 con 0x7fea1815c580 2024-09-21T07:23:40.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:40.595+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fea1815ef50 con 0x7fea1815c580 2024-09-21T07:23:41.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.207+0000 7fea0ea00640 1 -- 172.21.15.64:0/2676650560 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7fea0805e8a0 con 0x7fea1815c580 2024-09-21T07:23:41.212 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:23:41.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 msgr2=0x7fe9f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:41.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 0x7fe9f4075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea00007fd0 tx=0x7fea00009040 comp rx=0 tx=0).stop 2024-09-21T07:23:41.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 msgr2=0x7fea181507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:41.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea0800c3e0 tx=0x7fea0800c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 shutdown_connections 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe9f4073200 0x7fe9f4075710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea18153470 0x7fea18161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea18162f30 0x7fea18161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 --2- 172.21.15.64:0/2676650560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea1815c580 0x7fea181507f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 >> 172.21.15.64:0/2676650560 conn(0x7fea180cdcf0 msgr2=0x7fea180d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 shutdown_connections 2024-09-21T07:23:41.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.211+0000 7fea1d000640 1 -- 172.21.15.64:0/2676650560 wait complete. 2024-09-21T07:23:41.261 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 -- 172.21.15.64:0/151296141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 msgr2=0x7ffa380040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 --2- 172.21.15.64:0/151296141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa380040e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa44001800 tx=0x7ffa4401c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa55a00640 1 -- 172.21.15.64:0/151296141 reap_dead start 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 -- 172.21.15.64:0/151296141 shutdown_connections 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 -- 172.21.15.64:0/151296141 >> 172.21.15.64:0/151296141 conn(0x7ffa500b2510 msgr2=0x7ffa500b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 -- 172.21.15.64:0/151296141 shutdown_connections 2024-09-21T07:23:41.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.423+0000 7ffa57a00640 1 -- 172.21.15.64:0/151296141 wait complete. 2024-09-21T07:23:41.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 Processor -- start 2024-09-21T07:23:41.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 -- start start 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa501fc500 0x7ffa500b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa501fb8f0 0x7ffa501fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50168730 con 0x7ffa38003c90 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501685b0 con 0x7ffa501fc500 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa57a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffa501688b0 con 0x7ffa501fb8f0 2024-09-21T07:23:41.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:41.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47802/0 (socket says 172.21.15.64:47802) 2024-09-21T07:23:41.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 -- 172.21.15.64:0/3364510473 learned_addr learned my addr 172.21.15.64:0/3364510473 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:41.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa4fe00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa501fc500 0x7ffa500b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:41.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa501fb8f0 0x7ffa501fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 -- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa501fb8f0 msgr2=0x7ffa501fbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa501fb8f0 0x7ffa501fbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 -- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa501fc500 msgr2=0x7ffa500b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa501fc500 0x7ffa500b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 -- 172.21.15.64:0/3364510473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa501fc240 con 0x7ffa38003c90 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.427+0000 7ffa55000640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005040 tx=0x7ffa440a5d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44001420 con 0x7ffa38003c90 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa440b4030 con 0x7ffa38003c90 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440068d0 con 0x7ffa38003c90 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa500ca200 con 0x7ffa38003c90 2024-09-21T07:23:41.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa500ca7c0 con 0x7ffa38003c90 2024-09-21T07:23:41.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa500c4ed0 con 0x7ffa38003c90 2024-09-21T07:23:41.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffa44003bb0 con 0x7ffa38003c90 2024-09-21T07:23:41.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 0x7ffa30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:41.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.431+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7ffa4412e940 con 0x7ffa38003c90 2024-09-21T07:23:41.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.435+0000 7ffa4fe00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 0x7ffa30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:41.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.435+0000 7ffa4fe00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 0x7ffa30075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa500cadd0 tx=0x7ffa3c001050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:41.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.435+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffa501fc240 con 0x7ffa38003c90 2024-09-21T07:23:41.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:41.651+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ffa500d05e0 con 0x7ffa38003c90 2024-09-21T07:23:42.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.219+0000 7ffa4cc00640 1 -- 172.21.15.64:0/3364510473 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7ffa44016630 con 0x7ffa38003c90 2024-09-21T07:23:42.223 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 5 and data pool 6 2024-09-21T07:23:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.223+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 msgr2=0x7ffa30075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.223+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 0x7ffa30075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa500cadd0 tx=0x7ffa3c001050 comp rx=0 tx=0).stop 2024-09-21T07:23:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.223+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 msgr2=0x7ffa500c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.223+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005040 tx=0x7ffa440a5d60 comp rx=0 tx=0).stop 2024-09-21T07:23:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 shutdown_connections 2024-09-21T07:23:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa30073200 0x7ffa30075710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa501fb8f0 0x7ffa501fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa501fc500 0x7ffa500b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 --2- 172.21.15.64:0/3364510473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa38003c90 0x7ffa500c7aa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 >> 172.21.15.64:0/3364510473 conn(0x7ffa500b2510 msgr2=0x7ffa500b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 shutdown_connections 2024-09-21T07:23:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.227+0000 7ffa57a00640 1 -- 172.21.15.64:0/3364510473 wait complete. 2024-09-21T07:23:42.289 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 -- 172.21.15.64:0/4086322681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40c5ea0 msgr2=0x7f7bf40c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 --2- 172.21.15.64:0/4086322681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40c5ea0 0x7f7bf40c62b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40b1cf0 tx=0x7f7bec01cac0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 -- 172.21.15.64:0/4086322681 shutdown_connections 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 --2- 172.21.15.64:0/4086322681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40c5ea0 0x7f7bf40c62b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 --2- 172.21.15.64:0/4086322681 >> v2:172.21.15.90:3300/0 conn(0x7f7bf40b3d60 0x7f7bf40b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 -- 172.21.15.64:0/4086322681 >> 172.21.15.64:0/4086322681 conn(0x7f7bf406d1c0 msgr2=0x7f7bf406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 -- 172.21.15.64:0/4086322681 shutdown_connections 2024-09-21T07:23:42.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.443+0000 7f7bfb800640 1 -- 172.21.15.64:0/4086322681 wait complete. 2024-09-21T07:23:42.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 Processor -- start 2024-09-21T07:23:42.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 -- start start 2024-09-21T07:23:42.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b3d60 0x7f7bf40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf40c5ea0 0x7f7bf40b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf4169e10 con 0x7f7bf40d1d00 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf4169c90 con 0x7f7bf40b3d60 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bfb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf4169f90 con 0x7f7bf40c5ea0 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bf9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bf9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47828/0 (socket says 172.21.15.64:47828) 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bf9800640 1 -- 172.21.15.64:0/3512847637 learned_addr learned my addr 172.21.15.64:0/3512847637 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bebe00640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf40c5ea0 0x7f7bf40b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.447+0000 7f7bf8e00640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b3d60 0x7f7bf40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 -- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf40c5ea0 msgr2=0x7f7bf40b7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf40c5ea0 0x7f7bf40b7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 -- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b3d60 msgr2=0x7f7bf40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b3d60 0x7f7bf40c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 -- 172.21.15.64:0/3512847637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf415d040 con 0x7f7bf40d1d00 2024-09-21T07:23:42.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf9800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7bec01c530 tx=0x7f7bec005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:42.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0b2040 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bec0bb070 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf415f520 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec004530 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf415f800 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf40b4170 con 0x7f7bf40d1d00 2024-09-21T07:23:42.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.451+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7bec0046d0 con 0x7f7bf40d1d00 2024-09-21T07:23:42.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.455+0000 7f7bf1600640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 0x7f7bd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.455+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7bec12ece0 con 0x7f7bf40d1d00 2024-09-21T07:23:42.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.455+0000 7f7bf8e00640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 0x7f7bd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.455+0000 7f7bf8e00640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 0x7f7bd0075740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007fd0 tx=0x7f7be4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:42.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.459+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7bec016770 con 0x7f7bf40d1d00 2024-09-21T07:23:42.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.639+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bf415f290 con 0x7f7bf40d1d00 2024-09-21T07:23:42.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bf1600640 1 -- 172.21.15.64:0/3512847637 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16967 (secure 0 0 0) 0x7f7bec0f95b0 con 0x7f7bf40d1d00 2024-09-21T07:23:42.644 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:42.644 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":39,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:23:41.654256+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:23:39.958485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T07:23:40.606295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 msgr2=0x7f7bd0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 0x7f7bd0075740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007fd0 tx=0x7f7be4009040 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 msgr2=0x7f7bf4158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7bec01c530 tx=0x7f7bec005a60 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 shutdown_connections 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7bd0073230 0x7f7bd0075740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf40d1d00 0x7f7bf4158a60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf40c5ea0 0x7f7bf40b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 --2- 172.21.15.64:0/3512847637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b3d60 0x7f7bf40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 >> 172.21.15.64:0/3512847637 conn(0x7f7bf406d1c0 msgr2=0x7f7bf40d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 shutdown_connections 2024-09-21T07:23:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.643+0000 7f7bfb800640 1 -- 172.21.15.64:0/3512847637 wait complete. 2024-09-21T07:23:42.667 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:42.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 -- 172.21.15.64:0/4284468597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415d500 msgr2=0x7f5a340b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 --2- 172.21.15.64:0/4284468597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415d500 0x7f5a340b3cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009900 tx=0x7f5a2001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 -- 172.21.15.64:0/4284468597 shutdown_connections 2024-09-21T07:23:42.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 --2- 172.21.15.64:0/4284468597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415d500 0x7f5a340b3cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 --2- 172.21.15.64:0/4284468597 >> v2:172.21.15.90:3300/0 conn(0x7f5a3415a330 0x7f5a34160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 -- 172.21.15.64:0/4284468597 >> 172.21.15.64:0/4284468597 conn(0x7f5a3406d530 msgr2=0x7f5a340d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:42.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 -- 172.21.15.64:0/4284468597 shutdown_connections 2024-09-21T07:23:42.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 -- 172.21.15.64:0/4284468597 wait complete. 2024-09-21T07:23:42.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.823+0000 7f5a3be00640 1 Processor -- start 2024-09-21T07:23:42.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- start start 2024-09-21T07:23:42.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415a330 0x7f5a340b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3415d910 0x7f5a341f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3416a490 con 0x7f5a3415d500 2024-09-21T07:23:42.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3416a310 con 0x7f5a3415d910 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3416a610 con 0x7f5a3415a330 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47840/0 (socket says 172.21.15.64:47840) 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 -- 172.21.15.64:0/3164342741 learned_addr learned my addr 172.21.15.64:0/3164342741 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a39400640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415a330 0x7f5a340b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a39e00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3415d910 0x7f5a341f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 -- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415a330 msgr2=0x7f5a340b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415a330 0x7f5a340b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 -- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3415d910 msgr2=0x7f5a341f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3415d910 0x7f5a341f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 -- 172.21.15.64:0/3164342741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a34154840 con 0x7f5a3415d500 2024-09-21T07:23:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a38a00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009850 tx=0x7f5a20005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a200b2040 con 0x7f5a3415d500 2024-09-21T07:23:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a34154b20 con 0x7f5a3415d500 2024-09-21T07:23:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a20004330 con 0x7f5a3415d500 2024-09-21T07:23:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20005290 con 0x7f5a3415d500 2024-09-21T07:23:42.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a340c7680 con 0x7f5a3415d500 2024-09-21T07:23:42.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.827+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a34160280 con 0x7f5a3415d500 2024-09-21T07:23:42.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.831+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a200bd060 con 0x7f5a3415d500 2024-09-21T07:23:42.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.831+0000 7f5a31600640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 0x7f5a14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:42.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.831+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5a2012db90 con 0x7f5a3415d500 2024-09-21T07:23:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.831+0000 7f5a39400640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 0x7f5a14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.831+0000 7f5a39400640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 0x7f5a14075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009b40 tx=0x7f5a280091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:42.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:42.835+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5a200164d0 con 0x7f5a3415d500 2024-09-21T07:23:43.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.015+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a341545d0 con 0x7f5a3415d500 2024-09-21T07:23:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.015+0000 7f5a31600640 1 -- 172.21.15.64:0/3164342741 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16967 (secure 0 0 0) 0x7f5a200f82b0 con 0x7f5a3415d500 2024-09-21T07:23:43.019 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:43.020 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":39,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:23:41.654256+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:23:39.958485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T07:23:40.606295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 msgr2=0x7f5a14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 0x7f5a14075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009b40 tx=0x7f5a280091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 msgr2=0x7f5a34153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009850 tx=0x7f5a20005760 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 shutdown_connections 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a14073200 0x7f5a14075710 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3415d910 0x7f5a341f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3415d500 0x7f5a34153b60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 --2- 172.21.15.64:0/3164342741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3415a330 0x7f5a340b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 >> 172.21.15.64:0/3164342741 conn(0x7f5a3406d530 msgr2=0x7f5a3415a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 shutdown_connections 2024-09-21T07:23:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.019+0000 7f5a3be00640 1 -- 172.21.15.64:0/3164342741 wait complete. 2024-09-21T07:23:43.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:23:43.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 -- 172.21.15.64:0/3953499812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f5006ef80 msgr2=0x7f3f5006f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:43.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 --2- 172.21.15.64:0/3953499812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f5006ef80 0x7f3f5006f390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009c80 tx=0x7f3f4801cda0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 -- 172.21.15.64:0/3953499812 shutdown_connections 2024-09-21T07:23:43.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 --2- 172.21.15.64:0/3953499812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f5006ef80 0x7f3f5006f390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 --2- 172.21.15.64:0/3953499812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f500cca80 0x7f3f500cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 -- 172.21.15.64:0/3953499812 >> 172.21.15.64:0/3953499812 conn(0x7f3f5006d450 msgr2=0x7f3f500d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:43.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 -- 172.21.15.64:0/3953499812 shutdown_connections 2024-09-21T07:23:43.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.199+0000 7f3f57800640 1 -- 172.21.15.64:0/3953499812 wait complete. 2024-09-21T07:23:43.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 Processor -- start 2024-09-21T07:23:43.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 -- start start 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 0x7f3f500c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 0x7f3f5015d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f50168050 con 0x7f3f500b4d40 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f50167ed0 con 0x7f3f500cca80 2024-09-21T07:23:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f57800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f501681d0 con 0x7f3f5006ef80 2024-09-21T07:23:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47850/0 (socket says 172.21.15.64:47850) 2024-09-21T07:23:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 -- 172.21.15.64:0/2479437681 learned_addr learned my addr 172.21.15.64:0/2479437681 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f54e00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 0x7f3f500c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f55800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 0x7f3f5015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 -- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 msgr2=0x7f3f500c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 0x7f3f500c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 -- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 msgr2=0x7f3f5015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 0x7f3f5015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f4fe00640 1 -- 172.21.15.64:0/2479437681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f501fb200 con 0x7f3f500b4d40 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f54e00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 0x7f3f500c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.203+0000 7f3f55800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 0x7f3f5015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4fe00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00daa0 tx=0x7f3f3c00df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00adf0 con 0x7f3f500b4d40 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c005110 con 0x7f3f500b4d40 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c005560 con 0x7f3f500b4d40 2024-09-21T07:23:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5009e120 con 0x7f3f500b4d40 2024-09-21T07:23:43.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f501fa720 con 0x7f3f500b4d40 2024-09-21T07:23:43.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5009de90 con 0x7f3f500b4d40 2024-09-21T07:23:43.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f3c0047b0 con 0x7f3f500b4d40 2024-09-21T07:23:43.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 0x7f3f30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:43.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.207+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3f3c094a30 con 0x7f3f500b4d40 2024-09-21T07:23:43.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.211+0000 7f3f54e00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 0x7f3f30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:43.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.211+0000 7f3f54e00640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 0x7f3f30075710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f5015ea90 tx=0x7f3f44009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.215+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f3c05f8b0 con 0x7f3f500b4d40 2024-09-21T07:23:43.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:43.431+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3f5006f390 con 0x7f3f500b4d40 2024-09-21T07:23:44.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.251+0000 7f3f4cc00640 1 -- 172.21.15.64:0/2479437681 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f3f3c064e20 con 0x7f3f500b4d40 2024-09-21T07:23:44.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.251+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 msgr2=0x7f3f30075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:44.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.251+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 0x7f3f30075710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f5015ea90 tx=0x7f3f44009040 comp rx=0 tx=0).stop 2024-09-21T07:23:44.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.251+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 msgr2=0x7f3f5015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:44.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.251+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00daa0 tx=0x7f3f3c00df60 comp rx=0 tx=0).stop 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 shutdown_connections 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f30073200 0x7f3f30075710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f500cca80 0x7f3f5015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f500b4d40 0x7f3f5015d310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 --2- 172.21.15.64:0/2479437681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f5006ef80 0x7f3f500c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 >> 172.21.15.64:0/2479437681 conn(0x7f3f5006d450 msgr2=0x7f3f5015a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 shutdown_connections 2024-09-21T07:23:44.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.255+0000 7f3f57800640 1 -- 172.21.15.64:0/2479437681 wait complete. 2024-09-21T07:23:44.281 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:23:44.281 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 -- 172.21.15.64:0/68446739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc406ee80 msgr2=0x7f9bc406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/68446739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc406ee80 0x7f9bc406f290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009c80 tx=0x7f9bbc01cda0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 -- 172.21.15.64:0/68446739 shutdown_connections 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/68446739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc406ee80 0x7f9bc406f290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/68446739 >> v2:172.21.15.90:3300/0 conn(0x7f9bc40cd410 0x7f9bc40b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 -- 172.21.15.64:0/68446739 >> 172.21.15.64:0/68446739 conn(0x7f9bc406d450 msgr2=0x7f9bc40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:44.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 -- 172.21.15.64:0/68446739 shutdown_connections 2024-09-21T07:23:44.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.447+0000 7f9bcbc00640 1 -- 172.21.15.64:0/68446739 wait complete. 2024-09-21T07:23:44.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 Processor -- start 2024-09-21T07:23:44.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- start start 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc40d0e60 0x7f9bc40cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bc409bc90 0x7f9bc409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc416a2e0 con 0x7f9bc406ee80 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc416a160 con 0x7f9bc409bc90 2024-09-21T07:23:44.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc416a460 con 0x7f9bc40d0e60 2024-09-21T07:23:44.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:44.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47862/0 (socket says 172.21.15.64:47862) 2024-09-21T07:23:44.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 -- 172.21.15.64:0/3119059282 learned_addr learned my addr 172.21.15.64:0/3119059282 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:44.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc3e00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc40d0e60 0x7f9bc40cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:44.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9c00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bc409bc90 0x7f9bc409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 -- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc40d0e60 msgr2=0x7f9bc40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc40d0e60 0x7f9bc40cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 -- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bc409bc90 msgr2=0x7f9bc409c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bc409bc90 0x7f9bc409c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 -- 172.21.15.64:0/3119059282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc409c5e0 con 0x7f9bc406ee80 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc9200640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c3c0 tx=0x7f9bb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8017070 con 0x7f9bc406ee80 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bb80054e0 con 0x7f9bc406ee80 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc415f210 con 0x7f9bc406ee80 2024-09-21T07:23:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80038b0 con 0x7f9bc406ee80 2024-09-21T07:23:44.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.451+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc40c8740 con 0x7f9bc406ee80 2024-09-21T07:23:44.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc406f290 con 0x7f9bc406ee80 2024-09-21T07:23:44.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9bb801a070 con 0x7f9bc406ee80 2024-09-21T07:23:44.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bc0c00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 0x7f9ba4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:44.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9bb8093690 con 0x7f9bc406ee80 2024-09-21T07:23:44.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bc3e00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 0x7f9ba4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:44.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.455+0000 7f9bc3e00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 0x7f9ba4075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9bc41fc040 tx=0x7f9bb00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.459+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9bc409c5e0 con 0x7f9bc406ee80 2024-09-21T07:23:44.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:44.679+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9bc4163a00 con 0x7f9bc406ee80 2024-09-21T07:23:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.251+0000 7f9bc0c00640 1 -- 172.21.15.64:0/3119059282 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f9bc40b4360 con 0x7f9bc406ee80 2024-09-21T07:23:45.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 msgr2=0x7f9ba4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 0x7f9ba4075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9bc41fc040 tx=0x7f9bb00091e0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 msgr2=0x7f9bc415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c3c0 tx=0x7f9bb800c880 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 shutdown_connections 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ba4073230 0x7f9ba4075740 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bc409bc90 0x7f9bc409c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bc40d0e60 0x7f9bc40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 --2- 172.21.15.64:0/3119059282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bc406ee80 0x7f9bc415ecd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 >> 172.21.15.64:0/3119059282 conn(0x7f9bc406d450 msgr2=0x7f9bc40ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 shutdown_connections 2024-09-21T07:23:45.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.255+0000 7f9bcbc00640 1 -- 172.21.15.64:0/3119059282 wait complete. 2024-09-21T07:23:45.284 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:23:45.284 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3369030875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ea8004810 msgr2=0x7f0ea8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3369030875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ea8004810 0x7f0ea8004c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c310 tx=0x7f0eac01cf60 comp rx=0 tx=0).stop 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3369030875 shutdown_connections 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3369030875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ea8004810 0x7f0ea8004c20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3369030875 >> 172.21.15.64:0/3369030875 conn(0x7f0ec40d42b0 msgr2=0x7f0ec40d46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3369030875 shutdown_connections 2024-09-21T07:23:45.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3369030875 wait complete. 2024-09-21T07:23:45.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 Processor -- start 2024-09-21T07:23:45.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.447+0000 7f0ec9e00640 1 -- start start 2024-09-21T07:23:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea8004810 0x7f0ec414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 0x7f0ec414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40cf830 con 0x7f0ec414ee40 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40cf6b0 con 0x7f0ea8004810 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec40cf9b0 con 0x7f0ec414d110 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38812/0 (socket says 172.21.15.64:38812) 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 -- 172.21.15.64:0/3650087756 learned_addr learned my addr 172.21.15.64:0/3650087756 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec8a00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea8004810 0x7f0ec414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9400640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 0x7f0ec414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 -- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 msgr2=0x7f0ec414d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 0x7f0ec414d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 -- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea8004810 msgr2=0x7f0ec414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea8004810 0x7f0ec414e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 -- 172.21.15.64:0/3650087756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec414da60 con 0x7f0ec414ee40 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9400640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 0x7f0ec414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ebbe00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01b830 tx=0x7f0eac001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0060d0 con 0x7f0ec414ee40 2024-09-21T07:23:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eac0036f0 con 0x7f0ec414ee40 2024-09-21T07:23:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac003b00 con 0x7f0ec414ee40 2024-09-21T07:23:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec414f250 con 0x7f0ec414ee40 2024-09-21T07:23:45.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec40a1170 con 0x7f0ec414ee40 2024-09-21T07:23:45.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.451+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec40b4350 con 0x7f0ec414ee40 2024-09-21T07:23:45.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.455+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0eac003ca0 con 0x7f0ec414ee40 2024-09-21T07:23:45.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.455+0000 7f0ec1600640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 0x7f0ea0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.455+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f0eac12eb70 con 0x7f0ec414ee40 2024-09-21T07:23:45.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.455+0000 7f0ec8a00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 0x7f0ea0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.455+0000 7f0ec8a00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 0x7f0ea0075710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40037f0 tx=0x7f0eb4005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:45.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.459+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0eac016d10 con 0x7f0ec414ee40 2024-09-21T07:23:45.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ec406d5d0 con 0x7f0ec414ee40 2024-09-21T07:23:45.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec1600640 1 -- 172.21.15.64:0/3650087756 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f0eac0f93a0 con 0x7f0ec414ee40 2024-09-21T07:23:45.674 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:45.674 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"btime":"2024-09-21T07:23:45:252778+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:44.682343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:23:45.674 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 msgr2=0x7f0ea0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 0x7f0ea0075710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40037f0 tx=0x7f0eb4005f90 comp rx=0 tx=0).stop 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 msgr2=0x7f0ec414cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01b830 tx=0x7f0eac001e10 comp rx=0 tx=0).stop 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 shutdown_connections 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0ea0073200 0x7f0ea0075710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ec414d110 0x7f0ec414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ec414ee40 0x7f0ec414cbd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 --2- 172.21.15.64:0/3650087756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea8004810 0x7f0ec414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 >> 172.21.15.64:0/3650087756 conn(0x7f0ec40d42b0 msgr2=0x7f0ec40b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:45.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 shutdown_connections 2024-09-21T07:23:45.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.671+0000 7f0ec9e00640 1 -- 172.21.15.64:0/3650087756 wait complete. 2024-09-21T07:23:45.696 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:45.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 -- 172.21.15.64:0/1642060067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be015edb0 msgr2=0x7f2be00700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 --2- 172.21.15.64:0/1642060067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be015edb0 0x7f2be00700b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2be00728d0 tx=0x7f2bd401c860 comp rx=0 tx=0).stop 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 -- 172.21.15.64:0/1642060067 shutdown_connections 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 --2- 172.21.15.64:0/1642060067 >> v2:172.21.15.90:3300/0 conn(0x7f2be00b4700 0x7f2be0072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 --2- 172.21.15.64:0/1642060067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00709b0 0x7f2be00b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 --2- 172.21.15.64:0/1642060067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be015edb0 0x7f2be00700b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 -- 172.21.15.64:0/1642060067 >> 172.21.15.64:0/1642060067 conn(0x7f2be00ccbe0 msgr2=0x7f2be00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 -- 172.21.15.64:0/1642060067 shutdown_connections 2024-09-21T07:23:45.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.851+0000 7f2be7e00640 1 -- 172.21.15.64:0/1642060067 wait complete. 2024-09-21T07:23:45.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 Processor -- start 2024-09-21T07:23:45.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- start start 2024-09-21T07:23:45.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b4700 0x7f2be01fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 0x7f2be01fc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2be00b2380 con 0x7f2be00709b0 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2be00b2200 con 0x7f2be015edb0 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2be00b2500 con 0x7f2be00b4700 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38830/0 (socket says 172.21.15.64:38830) 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 -- 172.21.15.64:0/3698647342 learned_addr learned my addr 172.21.15.64:0/3698647342 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be4a00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b4700 0x7f2be01fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 0x7f2be01fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 -- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b4700 msgr2=0x7f2be01fc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b4700 0x7f2be01fc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 -- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 msgr2=0x7f2be01fc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 0x7f2be01fc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 -- 172.21.15.64:0/3698647342 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be00c7d70 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 0x7f2be01fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be5400640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2bd401af70 tx=0x7f2bd4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40bd070 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd40044b0 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be015cba0 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4005290 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.855+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be00c8010 con 0x7f2be00709b0 2024-09-21T07:23:45.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.859+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be0072e20 con 0x7f2be00709b0 2024-09-21T07:23:45.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.859+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2bd40c0070 con 0x7f2be00709b0 2024-09-21T07:23:45.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.859+0000 7f2bdd600640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 0x7f2bc0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.859+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2bd412e5a0 con 0x7f2be00709b0 2024-09-21T07:23:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.859+0000 7f2be4a00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 0x7f2bc0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.863+0000 7f2be4a00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 0x7f2bc0075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be0168480 tx=0x7f2bcc005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:45.863+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2bd40164b0 con 0x7f2be00709b0 2024-09-21T07:23:46.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2be009da20 con 0x7f2be00709b0 2024-09-21T07:23:46.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2bdd600640 1 -- 172.21.15.64:0/3698647342 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16954 (secure 0 0 0) 0x7f2bd40f8dd0 con 0x7f2be00709b0 2024-09-21T07:23:46.050 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:46.050 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":40,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:23:43.222636+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:23:39.958485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T07:23:40.606295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 msgr2=0x7f2bc0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 0x7f2bc0075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be0168480 tx=0x7f2bcc005f90 comp rx=0 tx=0).stop 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 msgr2=0x7f2be009cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2bd401af70 tx=0x7f2bd4005760 comp rx=0 tx=0).stop 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 shutdown_connections 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.047+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bc0073200 0x7f2bc0075710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be015edb0 0x7f2be01fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b4700 0x7f2be01fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 --2- 172.21.15.64:0/3698647342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00709b0 0x7f2be009cea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 >> 172.21.15.64:0/3698647342 conn(0x7f2be00ccbe0 msgr2=0x7f2be0167930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:46.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 shutdown_connections 2024-09-21T07:23:46.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.051+0000 7f2be7e00640 1 -- 172.21.15.64:0/3698647342 wait complete. 2024-09-21T07:23:46.073 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:23:46.073 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- 172.21.15.64:0/653914338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b0005920 msgr2=0x7fd1b0005db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 --2- 172.21.15.64:0/653914338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b0005920 0x7fd1b0005db0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4006f80 tx=0x7fd1b401cc20 comp rx=0 tx=0).stop 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- 172.21.15.64:0/653914338 shutdown_connections 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 --2- 172.21.15.64:0/653914338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b0005920 0x7fd1b0005db0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- 172.21.15.64:0/653914338 >> 172.21.15.64:0/653914338 conn(0x7fd1cc0cd5d0 msgr2=0x7fd1cc0cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- 172.21.15.64:0/653914338 shutdown_connections 2024-09-21T07:23:46.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- 172.21.15.64:0/653914338 wait complete. 2024-09-21T07:23:46.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 Processor -- start 2024-09-21T07:23:46.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.231+0000 7fd1d2400640 1 -- start start 2024-09-21T07:23:46.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b0005920 0x7fd1cc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1cc0b46a0 0x7fd1cc14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0b2bf0 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0b2a70 con 0x7fd1b0005920 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc0b2d70 con 0x7fd1cc0b46a0 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38856/0 (socket says 172.21.15.64:38856) 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 -- 172.21.15.64:0/3261619494 learned_addr learned my addr 172.21.15.64:0/3261619494 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cb400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b0005920 0x7fd1cc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1c2a00640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1cc0b46a0 0x7fd1cc14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 -- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1cc0b46a0 msgr2=0x7fd1cc14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1cc0b46a0 0x7fd1cc14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 -- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b0005920 msgr2=0x7fd1cc0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b0005920 0x7fd1cc0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 -- 172.21.15.64:0/3261619494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc0cc120 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1cbe00640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0d0950 tx=0x7fd1c40119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:46.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4005220 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1c40054d0 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4012a40 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc0b57b0 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc0b3bc0 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.235+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc15b640 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.239+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd1c4012be0 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.239+0000 7fd1c3e00640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 0x7fd1a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.239+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd1c4094c50 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.239+0000 7fd1cb400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 0x7fd1a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.239+0000 7fd1cb400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 0x7fd1a8075710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001b70 tx=0x7fd1bc006ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:46.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.243+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd1cc0cc120 con 0x7fd1cc0cb7d0 2024-09-21T07:23:46.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.415+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1cc0cd170 con 0x7fd1a8073200 2024-09-21T07:23:46.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.423+0000 7fd1c3e00640 1 -- 172.21.15.64:0/3261619494 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249397 (secure 0 0 0) 0x7fd1cc0cd170 con 0x7fd1a8073200 2024-09-21T07:23:46.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:46.429 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 msgr2=0x7fd1a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 0x7fd1a8075710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001b70 tx=0x7fd1bc006ea0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 msgr2=0x7fd1cc0cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0d0950 tx=0x7fd1c40119e0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 shutdown_connections 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd1a8073200 0x7fd1a8075710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1cc0cb7d0 0x7fd1cc0cbbe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1cc0b46a0 0x7fd1cc14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 --2- 172.21.15.64:0/3261619494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b0005920 0x7fd1cc0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 >> 172.21.15.64:0/3261619494 conn(0x7fd1cc0cd5d0 msgr2=0x7fd1cc0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:46.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 shutdown_connections 2024-09-21T07:23:46.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.427+0000 7fd1d2400640 1 -- 172.21.15.64:0/3261619494 wait complete. 2024-09-21T07:23:46.449 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-21T07:23:45.431521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220764,"kb_used_data":4524,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753956,"statfs":{"total":773094113280,"available":772868050944,"internally_reserved":0,"allocated":4632576,"data_stored":2647266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221848"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270977+0000","last_change":"2024-09-21T07:23:42.262669+0000","last_active":"2024-09-21T07:23:42.270977+0000","last_peered":"2024-09-21T07:23:42.270977+0000","last_clean":"2024-09-21T07:23:42.270977+0000","last_became_active":"2024-09-21T07:23:42.262389+0000","last_became_peered":"2024-09-21T07:23:42.262389+0000","last_unstale":"2024-09-21T07:23:42.270977+0000","last_undegraded":"2024-09-21T07:23:42.270977+0000","last_fullsized":"2024-09-21T07:23:42.270977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264343+0000","last_change":"2024-09-21T07:23:42.261715+0000","last_active":"2024-09-21T07:23:42.264343+0000","last_peered":"2024-09-21T07:23:42.264343+0000","last_clean":"2024-09-21T07:23:42.264343+0000","last_became_active":"2024-09-21T07:23:42.261340+0000","last_became_peered":"2024-09-21T07:23:42.261340+0000","last_unstale":"2024-09-21T07:23:42.264343+0000","last_undegraded":"2024-09-21T07:23:42.264343+0000","last_fullsized":"2024-09-21T07:23:42.264343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:03.153945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267003+0000","last_change":"2024-09-21T07:23:42.262249+0000","last_active":"2024-09-21T07:23:42.267003+0000","last_peered":"2024-09-21T07:23:42.267003+0000","last_clean":"2024-09-21T07:23:42.267003+0000","last_became_active":"2024-09-21T07:23:42.261907+0000","last_became_peered":"2024-09-21T07:23:42.261907+0000","last_unstale":"2024-09-21T07:23:42.267003+0000","last_undegraded":"2024-09-21T07:23:42.267003+0000","last_fullsized":"2024-09-21T07:23:42.267003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:17.323588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244499+0000","last_change":"2024-09-21T07:23:42.235503+0000","last_active":"2024-09-21T07:23:42.244499+0000","last_peered":"2024-09-21T07:23:42.244499+0000","last_clean":"2024-09-21T07:23:42.244499+0000","last_became_active":"2024-09-21T07:23:42.235177+0000","last_became_peered":"2024-09-21T07:23:42.235177+0000","last_unstale":"2024-09-21T07:23:42.244499+0000","last_undegraded":"2024-09-21T07:23:42.244499+0000","last_fullsized":"2024-09-21T07:23:42.244499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:14.486415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260702+0000","last_change":"2024-09-21T07:23:42.252188+0000","last_active":"2024-09-21T07:23:42.260702+0000","last_peered":"2024-09-21T07:23:42.260702+0000","last_clean":"2024-09-21T07:23:42.260702+0000","last_became_active":"2024-09-21T07:23:42.251894+0000","last_became_peered":"2024-09-21T07:23:42.251894+0000","last_unstale":"2024-09-21T07:23:42.260702+0000","last_undegraded":"2024-09-21T07:23:42.260702+0000","last_fullsized":"2024-09-21T07:23:42.260702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272159+0000","last_change":"2024-09-21T07:23:42.264397+0000","last_active":"2024-09-21T07:23:42.272159+0000","last_peered":"2024-09-21T07:23:42.272159+0000","last_clean":"2024-09-21T07:23:42.272159+0000","last_became_active":"2024-09-21T07:23:42.264043+0000","last_became_peered":"2024-09-21T07:23:42.264043+0000","last_unstale":"2024-09-21T07:23:42.272159+0000","last_undegraded":"2024-09-21T07:23:42.272159+0000","last_fullsized":"2024-09-21T07:23:42.272159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273751+0000","last_change":"2024-09-21T07:23:42.268132+0000","last_active":"2024-09-21T07:23:42.273751+0000","last_peered":"2024-09-21T07:23:42.273751+0000","last_clean":"2024-09-21T07:23:42.273751+0000","last_became_active":"2024-09-21T07:23:42.267741+0000","last_became_peered":"2024-09-21T07:23:42.267741+0000","last_unstale":"2024-09-21T07:23:42.273751+0000","last_undegraded":"2024-09-21T07:23:42.273751+0000","last_fullsized":"2024-09-21T07:23:42.273751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:31.858647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272935+0000","last_change":"2024-09-21T07:23:42.264152+0000","last_active":"2024-09-21T07:23:42.272935+0000","last_peered":"2024-09-21T07:23:42.272935+0000","last_clean":"2024-09-21T07:23:42.272935+0000","last_became_active":"2024-09-21T07:23:42.263622+0000","last_became_peered":"2024-09-21T07:23:42.263622+0000","last_unstale":"2024-09-21T07:23:42.272935+0000","last_undegraded":"2024-09-21T07:23:42.272935+0000","last_fullsized":"2024-09-21T07:23:42.272935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:31.773982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270838+0000","last_change":"2024-09-21T07:23:42.260967+0000","last_active":"2024-09-21T07:23:42.270838+0000","last_peered":"2024-09-21T07:23:42.270838+0000","last_clean":"2024-09-21T07:23:42.270838+0000","last_became_active":"2024-09-21T07:23:42.260623+0000","last_became_peered":"2024-09-21T07:23:42.260623+0000","last_unstale":"2024-09-21T07:23:42.270838+0000","last_undegraded":"2024-09-21T07:23:42.270838+0000","last_fullsized":"2024-09-21T07:23:42.270838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273838+0000","last_change":"2024-09-21T07:23:42.269480+0000","last_active":"2024-09-21T07:23:42.273838+0000","last_peered":"2024-09-21T07:23:42.273838+0000","last_clean":"2024-09-21T07:23:42.273838+0000","last_became_active":"2024-09-21T07:23:42.269068+0000","last_became_peered":"2024-09-21T07:23:42.269068+0000","last_unstale":"2024-09-21T07:23:42.273838+0000","last_undegraded":"2024-09-21T07:23:42.273838+0000","last_fullsized":"2024-09-21T07:23:42.273838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:09.553859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257689+0000","last_change":"2024-09-21T07:23:42.243029+0000","last_active":"2024-09-21T07:23:42.257689+0000","last_peered":"2024-09-21T07:23:42.257689+0000","last_clean":"2024-09-21T07:23:42.257689+0000","last_became_active":"2024-09-21T07:23:42.242668+0000","last_became_peered":"2024-09-21T07:23:42.242668+0000","last_unstale":"2024-09-21T07:23:42.257689+0000","last_undegraded":"2024-09-21T07:23:42.257689+0000","last_fullsized":"2024-09-21T07:23:42.257689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273363+0000","last_change":"2024-09-21T07:23:42.265930+0000","last_active":"2024-09-21T07:23:42.273363+0000","last_peered":"2024-09-21T07:23:42.273363+0000","last_clean":"2024-09-21T07:23:42.273363+0000","last_became_active":"2024-09-21T07:23:42.265524+0000","last_became_peered":"2024-09-21T07:23:42.265524+0000","last_unstale":"2024-09-21T07:23:42.273363+0000","last_undegraded":"2024-09-21T07:23:42.273363+0000","last_fullsized":"2024-09-21T07:23:42.273363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:06.508104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223620+0000","last_change":"2024-09-21T07:23:41.223620+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223620+0000","last_undegraded":"2024-09-21T07:23:41.223620+0000","last_fullsized":"2024-09-21T07:23:41.223620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224983+0000","last_change":"2024-09-21T07:23:41.224983+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224983+0000","last_undegraded":"2024-09-21T07:23:41.224983+0000","last_fullsized":"2024-09-21T07:23:41.224983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259279+0000","last_change":"2024-09-21T07:23:42.244851+0000","last_active":"2024-09-21T07:23:42.259279+0000","last_peered":"2024-09-21T07:23:42.259279+0000","last_clean":"2024-09-21T07:23:42.259279+0000","last_became_active":"2024-09-21T07:23:42.244491+0000","last_became_peered":"2024-09-21T07:23:42.244491+0000","last_unstale":"2024-09-21T07:23:42.259279+0000","last_undegraded":"2024-09-21T07:23:42.259279+0000","last_fullsized":"2024-09-21T07:23:42.259279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263127+0000","last_change":"2024-09-21T07:23:42.254476+0000","last_active":"2024-09-21T07:23:42.263127+0000","last_peered":"2024-09-21T07:23:42.263127+0000","last_clean":"2024-09-21T07:23:42.263127+0000","last_became_active":"2024-09-21T07:23:42.253980+0000","last_became_peered":"2024-09-21T07:23:42.253980+0000","last_unstale":"2024-09-21T07:23:42.263127+0000","last_undegraded":"2024-09-21T07:23:42.263127+0000","last_fullsized":"2024-09-21T07:23:42.263127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:27.378166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259220+0000","last_change":"2024-09-21T07:23:42.244122+0000","last_active":"2024-09-21T07:23:42.259220+0000","last_peered":"2024-09-21T07:23:42.259220+0000","last_clean":"2024-09-21T07:23:42.259220+0000","last_became_active":"2024-09-21T07:23:42.243673+0000","last_became_peered":"2024-09-21T07:23:42.243673+0000","last_unstale":"2024-09-21T07:23:42.259220+0000","last_undegraded":"2024-09-21T07:23:42.259220+0000","last_fullsized":"2024-09-21T07:23:42.259220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262576+0000","last_change":"2024-09-21T07:23:42.253068+0000","last_active":"2024-09-21T07:23:42.262576+0000","last_peered":"2024-09-21T07:23:42.262576+0000","last_clean":"2024-09-21T07:23:42.262576+0000","last_became_active":"2024-09-21T07:23:42.252729+0000","last_became_peered":"2024-09-21T07:23:42.252729+0000","last_unstale":"2024-09-21T07:23:42.262576+0000","last_undegraded":"2024-09-21T07:23:42.262576+0000","last_fullsized":"2024-09-21T07:23:42.262576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257736+0000","last_change":"2024-09-21T07:23:42.251107+0000","last_active":"2024-09-21T07:23:42.257736+0000","last_peered":"2024-09-21T07:23:42.257736+0000","last_clean":"2024-09-21T07:23:42.257736+0000","last_became_active":"2024-09-21T07:23:42.248543+0000","last_became_peered":"2024-09-21T07:23:42.248543+0000","last_unstale":"2024-09-21T07:23:42.257736+0000","last_undegraded":"2024-09-21T07:23:42.257736+0000","last_fullsized":"2024-09-21T07:23:42.257736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223840+0000","last_change":"2024-09-21T07:23:41.223840+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223840+0000","last_undegraded":"2024-09-21T07:23:41.223840+0000","last_fullsized":"2024-09-21T07:23:41.223840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266136+0000","last_change":"2024-09-21T07:23:42.263299+0000","last_active":"2024-09-21T07:23:42.266136+0000","last_peered":"2024-09-21T07:23:42.266136+0000","last_clean":"2024-09-21T07:23:42.266136+0000","last_became_active":"2024-09-21T07:23:42.259857+0000","last_became_peered":"2024-09-21T07:23:42.259857+0000","last_unstale":"2024-09-21T07:23:42.266136+0000","last_undegraded":"2024-09-21T07:23:42.266136+0000","last_fullsized":"2024-09-21T07:23:42.266136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:41.112303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259393+0000","last_change":"2024-09-21T07:23:42.255686+0000","last_active":"2024-09-21T07:23:42.259393+0000","last_peered":"2024-09-21T07:23:42.259393+0000","last_clean":"2024-09-21T07:23:42.259393+0000","last_became_active":"2024-09-21T07:23:42.255269+0000","last_became_peered":"2024-09-21T07:23:42.255269+0000","last_unstale":"2024-09-21T07:23:42.259393+0000","last_undegraded":"2024-09-21T07:23:42.259393+0000","last_fullsized":"2024-09-21T07:23:42.259393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263033+0000","last_change":"2024-09-21T07:23:42.260742+0000","last_active":"2024-09-21T07:23:42.263033+0000","last_peered":"2024-09-21T07:23:42.263033+0000","last_clean":"2024-09-21T07:23:42.263033+0000","last_became_active":"2024-09-21T07:23:42.260474+0000","last_became_peered":"2024-09-21T07:23:42.260474+0000","last_unstale":"2024-09-21T07:23:42.263033+0000","last_undegraded":"2024-09-21T07:23:42.263033+0000","last_fullsized":"2024-09-21T07:23:42.263033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:01.499156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270409+0000","last_change":"2024-09-21T07:23:42.265850+0000","last_active":"2024-09-21T07:23:42.270409+0000","last_peered":"2024-09-21T07:23:42.270409+0000","last_clean":"2024-09-21T07:23:42.270409+0000","last_became_active":"2024-09-21T07:23:42.265462+0000","last_became_peered":"2024-09-21T07:23:42.265462+0000","last_unstale":"2024-09-21T07:23:42.270409+0000","last_undegraded":"2024-09-21T07:23:42.270409+0000","last_fullsized":"2024-09-21T07:23:42.270409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264217+0000","last_change":"2024-09-21T07:23:42.258580+0000","last_active":"2024-09-21T07:23:42.264217+0000","last_peered":"2024-09-21T07:23:42.264217+0000","last_clean":"2024-09-21T07:23:42.264217+0000","last_became_active":"2024-09-21T07:23:42.258317+0000","last_became_peered":"2024-09-21T07:23:42.258317+0000","last_unstale":"2024-09-21T07:23:42.264217+0000","last_undegraded":"2024-09-21T07:23:42.264217+0000","last_fullsized":"2024-09-21T07:23:42.264217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248249+0000","last_change":"2024-09-21T07:23:42.240018+0000","last_active":"2024-09-21T07:23:42.248249+0000","last_peered":"2024-09-21T07:23:42.248249+0000","last_clean":"2024-09-21T07:23:42.248249+0000","last_became_active":"2024-09-21T07:23:42.239526+0000","last_became_peered":"2024-09-21T07:23:42.239526+0000","last_unstale":"2024-09-21T07:23:42.248249+0000","last_undegraded":"2024-09-21T07:23:42.248249+0000","last_fullsized":"2024-09-21T07:23:42.248249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:31.250437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.241461+0000","last_change":"2024-09-21T07:23:42.236369+0000","last_active":"2024-09-21T07:23:42.241461+0000","last_peered":"2024-09-21T07:23:42.241461+0000","last_clean":"2024-09-21T07:23:42.241461+0000","last_became_active":"2024-09-21T07:23:42.235993+0000","last_became_peered":"2024-09-21T07:23:42.235993+0000","last_unstale":"2024-09-21T07:23:42.241461+0000","last_undegraded":"2024-09-21T07:23:42.241461+0000","last_fullsized":"2024-09-21T07:23:42.241461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:00.022946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223010+0000","last_change":"2024-09-21T07:23:41.223010+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223010+0000","last_undegraded":"2024-09-21T07:23:41.223010+0000","last_fullsized":"2024-09-21T07:23:41.223010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.251171+0000","last_change":"2024-09-21T07:23:42.248019+0000","last_active":"2024-09-21T07:23:42.251171+0000","last_peered":"2024-09-21T07:23:42.251171+0000","last_clean":"2024-09-21T07:23:42.251171+0000","last_became_active":"2024-09-21T07:23:42.247618+0000","last_became_peered":"2024-09-21T07:23:42.247618+0000","last_unstale":"2024-09-21T07:23:42.251171+0000","last_undegraded":"2024-09-21T07:23:42.251171+0000","last_fullsized":"2024-09-21T07:23:42.251171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:45.479102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225243+0000","last_change":"2024-09-21T07:23:41.225243+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225243+0000","last_undegraded":"2024-09-21T07:23:41.225243+0000","last_fullsized":"2024-09-21T07:23:41.225243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258886+0000","last_change":"2024-09-21T07:23:41.229683+0000","last_active":"2024-09-21T07:23:42.258886+0000","last_peered":"2024-09-21T07:23:42.258886+0000","last_clean":"2024-09-21T07:23:42.258886+0000","last_became_active":"2024-09-21T07:23:41.229300+0000","last_became_peered":"2024-09-21T07:23:41.229300+0000","last_unstale":"2024-09-21T07:23:42.258886+0000","last_undegraded":"2024-09-21T07:23:42.258886+0000","last_fullsized":"2024-09-21T07:23:42.258886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.269288+0000","last_change":"2024-09-21T07:23:42.265994+0000","last_active":"2024-09-21T07:23:42.269288+0000","last_peered":"2024-09-21T07:23:42.269288+0000","last_clean":"2024-09-21T07:23:42.269288+0000","last_became_active":"2024-09-21T07:23:42.265634+0000","last_became_peered":"2024-09-21T07:23:42.265634+0000","last_unstale":"2024-09-21T07:23:42.269288+0000","last_undegraded":"2024-09-21T07:23:42.269288+0000","last_fullsized":"2024-09-21T07:23:42.269288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:35.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263151+0000","last_change":"2024-09-21T07:23:41.247293+0000","last_active":"2024-09-21T07:23:42.263151+0000","last_peered":"2024-09-21T07:23:42.263151+0000","last_clean":"2024-09-21T07:23:42.263151+0000","last_became_active":"2024-09-21T07:23:41.246932+0000","last_became_peered":"2024-09-21T07:23:41.246932+0000","last_unstale":"2024-09-21T07:23:42.263151+0000","last_undegraded":"2024-09-21T07:23:42.263151+0000","last_fullsized":"2024-09-21T07:23:42.263151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250765+0000","last_change":"2024-09-21T07:23:42.243789+0000","last_active":"2024-09-21T07:23:42.250765+0000","last_peered":"2024-09-21T07:23:42.250765+0000","last_clean":"2024-09-21T07:23:42.250765+0000","last_became_active":"2024-09-21T07:23:42.243092+0000","last_became_peered":"2024-09-21T07:23:42.243092+0000","last_unstale":"2024-09-21T07:23:42.250765+0000","last_undegraded":"2024-09-21T07:23:42.250765+0000","last_fullsized":"2024-09-21T07:23:42.250765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258710+0000","last_change":"2024-09-21T07:23:41.231067+0000","last_active":"2024-09-21T07:23:42.258710+0000","last_peered":"2024-09-21T07:23:42.258710+0000","last_clean":"2024-09-21T07:23:42.258710+0000","last_became_active":"2024-09-21T07:23:41.230264+0000","last_became_peered":"2024-09-21T07:23:41.230264+0000","last_unstale":"2024-09-21T07:23:42.258710+0000","last_undegraded":"2024-09-21T07:23:42.258710+0000","last_fullsized":"2024-09-21T07:23:42.258710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.104337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259779+0000","last_change":"2024-09-21T07:23:41.227352+0000","last_active":"2024-09-21T07:23:42.259779+0000","last_peered":"2024-09-21T07:23:42.259779+0000","last_clean":"2024-09-21T07:23:42.259779+0000","last_became_active":"2024-09-21T07:23:41.226996+0000","last_became_peered":"2024-09-21T07:23:41.226996+0000","last_unstale":"2024-09-21T07:23:42.259779+0000","last_undegraded":"2024-09-21T07:23:42.259779+0000","last_fullsized":"2024-09-21T07:23:42.259779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:41.257887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255905+0000","last_change":"2024-09-21T07:23:42.249480+0000","last_active":"2024-09-21T07:23:42.255905+0000","last_peered":"2024-09-21T07:23:42.255905+0000","last_clean":"2024-09-21T07:23:42.255905+0000","last_became_active":"2024-09-21T07:23:42.247629+0000","last_became_peered":"2024-09-21T07:23:42.247629+0000","last_unstale":"2024-09-21T07:23:42.255905+0000","last_undegraded":"2024-09-21T07:23:42.255905+0000","last_fullsized":"2024-09-21T07:23:42.255905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273876+0000","last_change":"2024-09-21T07:23:41.247247+0000","last_active":"2024-09-21T07:23:42.273876+0000","last_peered":"2024-09-21T07:23:42.273876+0000","last_clean":"2024-09-21T07:23:42.273876+0000","last_became_active":"2024-09-21T07:23:41.246933+0000","last_became_peered":"2024-09-21T07:23:41.246933+0000","last_unstale":"2024-09-21T07:23:42.273876+0000","last_undegraded":"2024-09-21T07:23:42.273876+0000","last_fullsized":"2024-09-21T07:23:42.273876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:24.210839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262611+0000","last_change":"2024-09-21T07:23:42.257399+0000","last_active":"2024-09-21T07:23:42.262611+0000","last_peered":"2024-09-21T07:23:42.262611+0000","last_clean":"2024-09-21T07:23:42.262611+0000","last_became_active":"2024-09-21T07:23:42.253176+0000","last_became_peered":"2024-09-21T07:23:42.253176+0000","last_unstale":"2024-09-21T07:23:42.262611+0000","last_undegraded":"2024-09-21T07:23:42.262611+0000","last_fullsized":"2024-09-21T07:23:42.262611+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246291+0000","last_change":"2024-09-21T07:23:41.241248+0000","last_active":"2024-09-21T07:23:41.246291+0000","last_peered":"2024-09-21T07:23:41.246291+0000","last_clean":"2024-09-21T07:23:41.246291+0000","last_became_active":"2024-09-21T07:23:41.239401+0000","last_became_peered":"2024-09-21T07:23:41.239401+0000","last_unstale":"2024-09-21T07:23:41.246291+0000","last_undegraded":"2024-09-21T07:23:41.246291+0000","last_fullsized":"2024-09-21T07:23:41.246291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:26.534321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262884+0000","last_change":"2024-09-21T07:23:42.257444+0000","last_active":"2024-09-21T07:23:42.262884+0000","last_peered":"2024-09-21T07:23:42.262884+0000","last_clean":"2024-09-21T07:23:42.262884+0000","last_became_active":"2024-09-21T07:23:42.257148+0000","last_became_peered":"2024-09-21T07:23:42.257148+0000","last_unstale":"2024-09-21T07:23:42.262884+0000","last_undegraded":"2024-09-21T07:23:42.262884+0000","last_fullsized":"2024-09-21T07:23:42.262884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229192+0000","last_change":"2024-09-21T07:23:41.241097+0000","last_active":"2024-09-21T07:23:42.229192+0000","last_peered":"2024-09-21T07:23:42.229192+0000","last_clean":"2024-09-21T07:23:42.229192+0000","last_became_active":"2024-09-21T07:23:41.240725+0000","last_became_peered":"2024-09-21T07:23:41.240725+0000","last_unstale":"2024-09-21T07:23:42.229192+0000","last_undegraded":"2024-09-21T07:23:42.229192+0000","last_fullsized":"2024-09-21T07:23:42.229192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:55.998354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.232757+0000","last_change":"2024-09-21T07:23:41.224843+0000","last_active":"2024-09-21T07:23:42.232757+0000","last_peered":"2024-09-21T07:23:42.232757+0000","last_clean":"2024-09-21T07:23:42.232757+0000","last_became_active":"2024-09-21T07:23:41.224463+0000","last_became_peered":"2024-09-21T07:23:41.224463+0000","last_unstale":"2024-09-21T07:23:42.232757+0000","last_undegraded":"2024-09-21T07:23:42.232757+0000","last_fullsized":"2024-09-21T07:23:42.232757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264316+0000","last_change":"2024-09-21T07:23:42.259678+0000","last_active":"2024-09-21T07:23:42.264316+0000","last_peered":"2024-09-21T07:23:42.264316+0000","last_clean":"2024-09-21T07:23:42.264316+0000","last_became_active":"2024-09-21T07:23:42.259361+0000","last_became_peered":"2024-09-21T07:23:42.259361+0000","last_unstale":"2024-09-21T07:23:42.264316+0000","last_undegraded":"2024-09-21T07:23:42.264316+0000","last_fullsized":"2024-09-21T07:23:42.264316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:41.188911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212636+0000","last_change":"2024-09-21T07:23:40.212636+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212636+0000","last_undegraded":"2024-09-21T07:23:40.212636+0000","last_fullsized":"2024-09-21T07:23:40.212636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.226421+0000","last_change":"2024-09-21T07:23:41.226421+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.226421+0000","last_undegraded":"2024-09-21T07:23:41.226421+0000","last_fullsized":"2024-09-21T07:23:41.226421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248668+0000","last_change":"2024-09-21T07:23:41.245321+0000","last_active":"2024-09-21T07:23:42.248668+0000","last_peered":"2024-09-21T07:23:42.248668+0000","last_clean":"2024-09-21T07:23:42.248668+0000","last_became_active":"2024-09-21T07:23:41.244908+0000","last_became_peered":"2024-09-21T07:23:41.244908+0000","last_unstale":"2024-09-21T07:23:42.248668+0000","last_undegraded":"2024-09-21T07:23:42.248668+0000","last_fullsized":"2024-09-21T07:23:42.248668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:18.079641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271330+0000","last_change":"2024-09-21T07:23:42.255482+0000","last_active":"2024-09-21T07:23:42.271330+0000","last_peered":"2024-09-21T07:23:42.271330+0000","last_clean":"2024-09-21T07:23:42.271330+0000","last_became_active":"2024-09-21T07:23:42.255181+0000","last_became_peered":"2024-09-21T07:23:42.255181+0000","last_unstale":"2024-09-21T07:23:42.271330+0000","last_undegraded":"2024-09-21T07:23:42.271330+0000","last_fullsized":"2024-09-21T07:23:42.271330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275341+0000","last_change":"2024-09-21T07:23:41.241070+0000","last_active":"2024-09-21T07:23:42.275341+0000","last_peered":"2024-09-21T07:23:42.275341+0000","last_clean":"2024-09-21T07:23:42.275341+0000","last_became_active":"2024-09-21T07:23:41.240700+0000","last_became_peered":"2024-09-21T07:23:41.240700+0000","last_unstale":"2024-09-21T07:23:42.275341+0000","last_undegraded":"2024-09-21T07:23:42.275341+0000","last_fullsized":"2024-09-21T07:23:42.275341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:38.885316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270159+0000","last_change":"2024-09-21T07:23:42.267128+0000","last_active":"2024-09-21T07:23:42.270159+0000","last_peered":"2024-09-21T07:23:42.270159+0000","last_clean":"2024-09-21T07:23:42.270159+0000","last_became_active":"2024-09-21T07:23:42.266152+0000","last_became_peered":"2024-09-21T07:23:42.266152+0000","last_unstale":"2024-09-21T07:23:42.270159+0000","last_undegraded":"2024-09-21T07:23:42.270159+0000","last_fullsized":"2024-09-21T07:23:42.270159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212213+0000","last_change":"2024-09-21T07:23:40.212213+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212213+0000","last_undegraded":"2024-09-21T07:23:40.212213+0000","last_fullsized":"2024-09-21T07:23:40.212213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271104+0000","last_change":"2024-09-21T07:23:42.264392+0000","last_active":"2024-09-21T07:23:42.271104+0000","last_peered":"2024-09-21T07:23:42.271104+0000","last_clean":"2024-09-21T07:23:42.271104+0000","last_became_active":"2024-09-21T07:23:42.264071+0000","last_became_peered":"2024-09-21T07:23:42.264071+0000","last_unstale":"2024-09-21T07:23:42.271104+0000","last_undegraded":"2024-09-21T07:23:42.271104+0000","last_fullsized":"2024-09-21T07:23:42.271104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212240+0000","last_change":"2024-09-21T07:23:40.212240+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212240+0000","last_undegraded":"2024-09-21T07:23:40.212240+0000","last_fullsized":"2024-09-21T07:23:40.212240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229859+0000","last_change":"2024-09-21T07:23:41.237332+0000","last_active":"2024-09-21T07:23:42.229859+0000","last_peered":"2024-09-21T07:23:42.229859+0000","last_clean":"2024-09-21T07:23:42.229859+0000","last_became_active":"2024-09-21T07:23:41.236953+0000","last_became_peered":"2024-09-21T07:23:41.236953+0000","last_unstale":"2024-09-21T07:23:42.229859+0000","last_undegraded":"2024-09-21T07:23:42.229859+0000","last_fullsized":"2024-09-21T07:23:42.229859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:43.800815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224255+0000","last_change":"2024-09-21T07:23:41.224255+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224255+0000","last_undegraded":"2024-09-21T07:23:41.224255+0000","last_fullsized":"2024-09-21T07:23:41.224255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227550+0000","last_change":"2024-09-21T07:23:41.228019+0000","last_active":"2024-09-21T07:23:42.227550+0000","last_peered":"2024-09-21T07:23:42.227550+0000","last_clean":"2024-09-21T07:23:42.227550+0000","last_became_active":"2024-09-21T07:23:41.227689+0000","last_became_peered":"2024-09-21T07:23:41.227689+0000","last_unstale":"2024-09-21T07:23:42.227550+0000","last_undegraded":"2024-09-21T07:23:42.227550+0000","last_fullsized":"2024-09-21T07:23:42.227550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:20.597221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247129+0000","last_change":"2024-09-21T07:23:41.242205+0000","last_active":"2024-09-21T07:23:41.247129+0000","last_peered":"2024-09-21T07:23:41.247129+0000","last_clean":"2024-09-21T07:23:41.247129+0000","last_became_active":"2024-09-21T07:23:41.240901+0000","last_became_peered":"2024-09-21T07:23:41.240901+0000","last_unstale":"2024-09-21T07:23:41.247129+0000","last_undegraded":"2024-09-21T07:23:41.247129+0000","last_fullsized":"2024-09-21T07:23:41.247129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:58.235388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273926+0000","last_change":"2024-09-21T07:23:41.241933+0000","last_active":"2024-09-21T07:23:42.273926+0000","last_peered":"2024-09-21T07:23:42.273926+0000","last_clean":"2024-09-21T07:23:42.273926+0000","last_became_active":"2024-09-21T07:23:41.241652+0000","last_became_peered":"2024-09-21T07:23:41.241652+0000","last_unstale":"2024-09-21T07:23:42.273926+0000","last_undegraded":"2024-09-21T07:23:42.273926+0000","last_fullsized":"2024-09-21T07:23:42.273926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:33.390195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267929+0000","last_change":"2024-09-21T07:23:42.261384+0000","last_active":"2024-09-21T07:23:42.267929+0000","last_peered":"2024-09-21T07:23:42.267929+0000","last_clean":"2024-09-21T07:23:42.267929+0000","last_became_active":"2024-09-21T07:23:42.260641+0000","last_became_peered":"2024-09-21T07:23:42.260641+0000","last_unstale":"2024-09-21T07:23:42.267929+0000","last_undegraded":"2024-09-21T07:23:42.267929+0000","last_fullsized":"2024-09-21T07:23:42.267929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266558+0000","last_change":"2024-09-21T07:23:41.238947+0000","last_active":"2024-09-21T07:23:42.266558+0000","last_peered":"2024-09-21T07:23:42.266558+0000","last_clean":"2024-09-21T07:23:42.266558+0000","last_became_active":"2024-09-21T07:23:41.238569+0000","last_became_peered":"2024-09-21T07:23:41.238569+0000","last_unstale":"2024-09-21T07:23:42.266558+0000","last_undegraded":"2024-09-21T07:23:42.266558+0000","last_fullsized":"2024-09-21T07:23:42.266558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250792+0000","last_change":"2024-09-21T07:23:42.244113+0000","last_active":"2024-09-21T07:23:42.250792+0000","last_peered":"2024-09-21T07:23:42.250792+0000","last_clean":"2024-09-21T07:23:42.250792+0000","last_became_active":"2024-09-21T07:23:42.243505+0000","last_became_peered":"2024-09-21T07:23:42.243505+0000","last_unstale":"2024-09-21T07:23:42.250792+0000","last_undegraded":"2024-09-21T07:23:42.250792+0000","last_fullsized":"2024-09-21T07:23:42.250792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271049+0000","last_change":"2024-09-21T07:23:41.239340+0000","last_active":"2024-09-21T07:23:42.271049+0000","last_peered":"2024-09-21T07:23:42.271049+0000","last_clean":"2024-09-21T07:23:42.271049+0000","last_became_active":"2024-09-21T07:23:41.238977+0000","last_became_peered":"2024-09-21T07:23:41.238977+0000","last_unstale":"2024-09-21T07:23:42.271049+0000","last_undegraded":"2024-09-21T07:23:42.271049+0000","last_fullsized":"2024-09-21T07:23:42.271049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.265190+0000","last_change":"2024-09-21T07:23:42.258030+0000","last_active":"2024-09-21T07:23:42.265190+0000","last_peered":"2024-09-21T07:23:42.265190+0000","last_clean":"2024-09-21T07:23:42.265190+0000","last_became_active":"2024-09-21T07:23:42.256792+0000","last_became_peered":"2024-09-21T07:23:42.256792+0000","last_unstale":"2024-09-21T07:23:42.265190+0000","last_undegraded":"2024-09-21T07:23:42.265190+0000","last_fullsized":"2024-09-21T07:23:42.265190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:27.750378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.230439+0000","last_change":"2024-09-21T07:23:41.244419+0000","last_active":"2024-09-21T07:23:42.230439+0000","last_peered":"2024-09-21T07:23:42.230439+0000","last_clean":"2024-09-21T07:23:42.230439+0000","last_became_active":"2024-09-21T07:23:41.242477+0000","last_became_peered":"2024-09-21T07:23:41.242477+0000","last_unstale":"2024-09-21T07:23:42.230439+0000","last_undegraded":"2024-09-21T07:23:42.230439+0000","last_fullsized":"2024-09-21T07:23:42.230439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.513475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223011+0000","last_change":"2024-09-21T07:23:41.223011+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223011+0000","last_undegraded":"2024-09-21T07:23:41.223011+0000","last_fullsized":"2024-09-21T07:23:41.223011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272824+0000","last_change":"2024-09-21T07:23:41.249080+0000","last_active":"2024-09-21T07:23:42.272824+0000","last_peered":"2024-09-21T07:23:42.272824+0000","last_clean":"2024-09-21T07:23:42.272824+0000","last_became_active":"2024-09-21T07:23:41.247666+0000","last_became_peered":"2024-09-21T07:23:41.247666+0000","last_unstale":"2024-09-21T07:23:42.272824+0000","last_undegraded":"2024-09-21T07:23:42.272824+0000","last_fullsized":"2024-09-21T07:23:42.272824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.522254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255013+0000","last_change":"2024-09-21T07:23:42.248515+0000","last_active":"2024-09-21T07:23:42.255013+0000","last_peered":"2024-09-21T07:23:42.255013+0000","last_clean":"2024-09-21T07:23:42.255013+0000","last_became_active":"2024-09-21T07:23:42.248201+0000","last_became_peered":"2024-09-21T07:23:42.248201+0000","last_unstale":"2024-09-21T07:23:42.255013+0000","last_undegraded":"2024-09-21T07:23:42.255013+0000","last_fullsized":"2024-09-21T07:23:42.255013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260553+0000","last_change":"2024-09-21T07:23:41.238957+0000","last_active":"2024-09-21T07:23:42.260553+0000","last_peered":"2024-09-21T07:23:42.260553+0000","last_clean":"2024-09-21T07:23:42.260553+0000","last_became_active":"2024-09-21T07:23:41.237652+0000","last_became_peered":"2024-09-21T07:23:41.237652+0000","last_unstale":"2024-09-21T07:23:42.260553+0000","last_undegraded":"2024-09-21T07:23:42.260553+0000","last_fullsized":"2024-09-21T07:23:42.260553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:32.394414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260093+0000","last_change":"2024-09-21T07:23:42.250508+0000","last_active":"2024-09-21T07:23:42.260093+0000","last_peered":"2024-09-21T07:23:42.260093+0000","last_clean":"2024-09-21T07:23:42.260093+0000","last_became_active":"2024-09-21T07:23:42.249128+0000","last_became_peered":"2024-09-21T07:23:42.249128+0000","last_unstale":"2024-09-21T07:23:42.260093+0000","last_undegraded":"2024-09-21T07:23:42.260093+0000","last_fullsized":"2024-09-21T07:23:42.260093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247367+0000","last_change":"2024-09-21T07:23:41.242637+0000","last_active":"2024-09-21T07:23:41.247367+0000","last_peered":"2024-09-21T07:23:41.247367+0000","last_clean":"2024-09-21T07:23:41.247367+0000","last_became_active":"2024-09-21T07:23:41.242213+0000","last_became_peered":"2024-09-21T07:23:41.242213+0000","last_unstale":"2024-09-21T07:23:41.247367+0000","last_undegraded":"2024-09-21T07:23:41.247367+0000","last_fullsized":"2024-09-21T07:23:41.247367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:53.092717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259605+0000","last_change":"2024-09-21T07:23:41.234226+0000","last_active":"2024-09-21T07:23:42.259605+0000","last_peered":"2024-09-21T07:23:42.259605+0000","last_clean":"2024-09-21T07:23:42.259605+0000","last_became_active":"2024-09-21T07:23:41.233924+0000","last_became_peered":"2024-09-21T07:23:41.233924+0000","last_unstale":"2024-09-21T07:23:42.259605+0000","last_undegraded":"2024-09-21T07:23:42.259605+0000","last_fullsized":"2024-09-21T07:23:42.259605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:29.309397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.261026+0000","last_change":"2024-09-21T07:23:42.259554+0000","last_active":"2024-09-21T07:23:42.261026+0000","last_peered":"2024-09-21T07:23:42.261026+0000","last_clean":"2024-09-21T07:23:42.261026+0000","last_became_active":"2024-09-21T07:23:42.259038+0000","last_became_peered":"2024-09-21T07:23:42.259038+0000","last_unstale":"2024-09-21T07:23:42.261026+0000","last_undegraded":"2024-09-21T07:23:42.261026+0000","last_fullsized":"2024-09-21T07:23:42.261026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:47.530038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275084+0000","last_change":"2024-09-21T07:23:41.240831+0000","last_active":"2024-09-21T07:23:42.275084+0000","last_peered":"2024-09-21T07:23:42.275084+0000","last_clean":"2024-09-21T07:23:42.275084+0000","last_became_active":"2024-09-21T07:23:41.240462+0000","last_became_peered":"2024-09-21T07:23:41.240462+0000","last_unstale":"2024-09-21T07:23:42.275084+0000","last_undegraded":"2024-09-21T07:23:42.275084+0000","last_fullsized":"2024-09-21T07:23:42.275084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225825+0000","last_change":"2024-09-21T07:23:41.225825+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225825+0000","last_undegraded":"2024-09-21T07:23:41.225825+0000","last_fullsized":"2024-09-21T07:23:41.225825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263649+0000","last_change":"2024-09-21T07:23:41.238080+0000","last_active":"2024-09-21T07:23:42.263649+0000","last_peered":"2024-09-21T07:23:42.263649+0000","last_clean":"2024-09-21T07:23:42.263649+0000","last_became_active":"2024-09-21T07:23:41.237839+0000","last_became_peered":"2024-09-21T07:23:41.237839+0000","last_unstale":"2024-09-21T07:23:42.263649+0000","last_undegraded":"2024-09-21T07:23:42.263649+0000","last_fullsized":"2024-09-21T07:23:42.263649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:20.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.245885+0000","last_change":"2024-09-21T07:23:41.242064+0000","last_active":"2024-09-21T07:23:42.245885+0000","last_peered":"2024-09-21T07:23:42.245885+0000","last_clean":"2024-09-21T07:23:42.245885+0000","last_became_active":"2024-09-21T07:23:41.241745+0000","last_became_peered":"2024-09-21T07:23:41.241745+0000","last_unstale":"2024-09-21T07:23:42.245885+0000","last_undegraded":"2024-09-21T07:23:42.245885+0000","last_fullsized":"2024-09-21T07:23:42.245885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255934+0000","last_change":"2024-09-21T07:23:42.249809+0000","last_active":"2024-09-21T07:23:42.255934+0000","last_peered":"2024-09-21T07:23:42.255934+0000","last_clean":"2024-09-21T07:23:42.255934+0000","last_became_active":"2024-09-21T07:23:42.249220+0000","last_became_peered":"2024-09-21T07:23:42.249220+0000","last_unstale":"2024-09-21T07:23:42.255934+0000","last_undegraded":"2024-09-21T07:23:42.255934+0000","last_fullsized":"2024-09-21T07:23:42.255934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.242562+0000","last_change":"2024-09-21T07:23:41.246426+0000","last_active":"2024-09-21T07:23:42.242562+0000","last_peered":"2024-09-21T07:23:42.242562+0000","last_clean":"2024-09-21T07:23:42.242562+0000","last_became_active":"2024-09-21T07:23:41.246065+0000","last_became_peered":"2024-09-21T07:23:41.246065+0000","last_unstale":"2024-09-21T07:23:42.242562+0000","last_undegraded":"2024-09-21T07:23:42.242562+0000","last_fullsized":"2024-09-21T07:23:42.242562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244404+0000","last_change":"2024-09-21T07:23:42.235716+0000","last_active":"2024-09-21T07:23:42.244404+0000","last_peered":"2024-09-21T07:23:42.244404+0000","last_clean":"2024-09-21T07:23:42.244404+0000","last_became_active":"2024-09-21T07:23:42.235427+0000","last_became_peered":"2024-09-21T07:23:42.235427+0000","last_unstale":"2024-09-21T07:23:42.244404+0000","last_undegraded":"2024-09-21T07:23:42.244404+0000","last_fullsized":"2024-09-21T07:23:42.244404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.239587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227834+0000","last_change":"2024-09-21T07:23:41.247133+0000","last_active":"2024-09-21T07:23:42.227834+0000","last_peered":"2024-09-21T07:23:42.227834+0000","last_clean":"2024-09-21T07:23:42.227834+0000","last_became_active":"2024-09-21T07:23:41.246822+0000","last_became_peered":"2024-09-21T07:23:41.246822+0000","last_unstale":"2024-09-21T07:23:42.227834+0000","last_undegraded":"2024-09-21T07:23:42.227834+0000","last_fullsized":"2024-09-21T07:23:42.227834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:27.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257714+0000","last_change":"2024-09-21T07:23:42.245651+0000","last_active":"2024-09-21T07:23:42.257714+0000","last_peered":"2024-09-21T07:23:42.257714+0000","last_clean":"2024-09-21T07:23:42.257714+0000","last_became_active":"2024-09-21T07:23:42.245299+0000","last_became_peered":"2024-09-21T07:23:42.245299+0000","last_unstale":"2024-09-21T07:23:42.257714+0000","last_undegraded":"2024-09-21T07:23:42.257714+0000","last_fullsized":"2024-09-21T07:23:42.257714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.233440+0000","last_change":"2024-09-21T07:23:41.227126+0000","last_active":"2024-09-21T07:23:42.233440+0000","last_peered":"2024-09-21T07:23:42.233440+0000","last_clean":"2024-09-21T07:23:42.233440+0000","last_became_active":"2024-09-21T07:23:41.226786+0000","last_became_peered":"2024-09-21T07:23:41.226786+0000","last_unstale":"2024-09-21T07:23:42.233440+0000","last_undegraded":"2024-09-21T07:23:42.233440+0000","last_fullsized":"2024-09-21T07:23:42.233440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225876+0000","last_change":"2024-09-21T07:23:41.225876+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225876+0000","last_undegraded":"2024-09-21T07:23:41.225876+0000","last_fullsized":"2024-09-21T07:23:41.225876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212196+0000","last_change":"2024-09-21T07:23:40.212196+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212196+0000","last_undegraded":"2024-09-21T07:23:40.212196+0000","last_fullsized":"2024-09-21T07:23:40.212196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267870+0000","last_change":"2024-09-21T07:23:42.260141+0000","last_active":"2024-09-21T07:23:42.267870+0000","last_peered":"2024-09-21T07:23:42.267870+0000","last_clean":"2024-09-21T07:23:42.267870+0000","last_became_active":"2024-09-21T07:23:42.259782+0000","last_became_peered":"2024-09-21T07:23:42.259782+0000","last_unstale":"2024-09-21T07:23:42.267870+0000","last_undegraded":"2024-09-21T07:23:42.267870+0000","last_fullsized":"2024-09-21T07:23:42.267870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246426+0000","last_change":"2024-09-21T07:23:41.241484+0000","last_active":"2024-09-21T07:23:41.246426+0000","last_peered":"2024-09-21T07:23:41.246426+0000","last_clean":"2024-09-21T07:23:41.246426+0000","last_became_active":"2024-09-21T07:23:41.241073+0000","last_became_peered":"2024-09-21T07:23:41.241073+0000","last_unstale":"2024-09-21T07:23:41.246426+0000","last_undegraded":"2024-09-21T07:23:41.246426+0000","last_fullsized":"2024-09-21T07:23:41.246426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:44.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.229988+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:23:41.229988+0000","last_peered":"2024-09-21T07:23:41.229988+0000","last_clean":"2024-09-21T07:23:41.229988+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:23:41.229988+0000","last_undegraded":"2024-09-21T07:23:41.229988+0000","last_fullsized":"2024-09-21T07:23:41.229988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:46.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- 172.21.15.64:0/2703620534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c0709b0 msgr2=0x7f4c8c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 --2- 172.21.15.64:0/2703620534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c0b41c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0b5130 tx=0x7f4c7801c860 comp rx=0 tx=0).stop 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- 172.21.15.64:0/2703620534 shutdown_connections 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 --2- 172.21.15.64:0/2703620534 >> v2:172.21.15.90:3300/0 conn(0x7f4c8c0b4700 0x7f4c8c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 --2- 172.21.15.64:0/2703620534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c0b41c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 --2- 172.21.15.64:0/2703620534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c15edb0 0x7f4c8c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- 172.21.15.64:0/2703620534 >> 172.21.15.64:0/2703620534 conn(0x7f4c8c0ccbe0 msgr2=0x7f4c8c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:46.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- 172.21.15.64:0/2703620534 shutdown_connections 2024-09-21T07:23:46.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- 172.21.15.64:0/2703620534 wait complete. 2024-09-21T07:23:46.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 Processor -- start 2024-09-21T07:23:46.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.647+0000 7f4c93800640 1 -- start start 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c0b4700 0x7f4c8c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c0b23d0 con 0x7f4c8c15edb0 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c0b2250 con 0x7f4c8c0709b0 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c0b2550 con 0x7f4c8c0b4700 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38882/0 (socket says 172.21.15.64:38882) 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 -- 172.21.15.64:0/2903608255 learned_addr learned my addr 172.21.15.64:0/2903608255 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c8be00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c0b4700 0x7f4c8c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c90e00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 -- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c0b4700 msgr2=0x7f4c8c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c0b4700 0x7f4c8c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 -- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 msgr2=0x7f4c8c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 -- 172.21.15.64:0/2903608255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c0cbef0 con 0x7f4c8c15edb0 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c90e00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c91800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e990 tx=0x7f4c8400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84004d30 con 0x7f4c8c15edb0 2024-09-21T07:23:46.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8400caa0 con 0x7f4c8c15edb0 2024-09-21T07:23:46.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84005020 con 0x7f4c8c15edb0 2024-09-21T07:23:46.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8c0cb920 con 0x7f4c8c15edb0 2024-09-21T07:23:46.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8c1fc160 con 0x7f4c8c15edb0 2024-09-21T07:23:46.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.651+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8c075820 con 0x7f4c8c15edb0 2024-09-21T07:23:46.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.655+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4c840051c0 con 0x7f4c8c15edb0 2024-09-21T07:23:46.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.655+0000 7f4c88c00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 0x7f4c6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:46.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.655+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4c840949c0 con 0x7f4c8c15edb0 2024-09-21T07:23:46.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.655+0000 7f4c90e00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 0x7f4c6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:46.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.655+0000 7f4c90e00640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 0x7f4c6c075740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000bbd0 tx=0x7f4c8000b5b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:46.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.659+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4c84096e20 con 0x7f4c8c15edb0 2024-09-21T07:23:46.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.835+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c8c09da20 con 0x7f4c6c073230 2024-09-21T07:23:46.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.839+0000 7f4c88c00640 1 -- 172.21.15.64:0/2903608255 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249397 (secure 0 0 0) 0x7f4c8c09da20 con 0x7f4c6c073230 2024-09-21T07:23:46.845 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:46.847 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 msgr2=0x7f4c6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 0x7f4c6c075740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000bbd0 tx=0x7f4c8000b5b0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 msgr2=0x7f4c8c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e990 tx=0x7f4c8400ee50 comp rx=0 tx=0).stop 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 shutdown_connections 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c6c073230 0x7f4c6c075740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c8c15edb0 0x7f4c8c0c9db0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c8c0b4700 0x7f4c8c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 --2- 172.21.15.64:0/2903608255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c8c0709b0 0x7f4c8c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:46.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 >> 172.21.15.64:0/2903608255 conn(0x7f4c8c0ccbe0 msgr2=0x7f4c8c0b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:46.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 shutdown_connections 2024-09-21T07:23:46.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:46.843+0000 7f4c93800640 1 -- 172.21.15.64:0/2903608255 wait complete. 2024-09-21T07:23:46.867 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-21T07:23:45.431521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220764,"kb_used_data":4524,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753956,"statfs":{"total":773094113280,"available":772868050944,"internally_reserved":0,"allocated":4632576,"data_stored":2647266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221848"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270977+0000","last_change":"2024-09-21T07:23:42.262669+0000","last_active":"2024-09-21T07:23:42.270977+0000","last_peered":"2024-09-21T07:23:42.270977+0000","last_clean":"2024-09-21T07:23:42.270977+0000","last_became_active":"2024-09-21T07:23:42.262389+0000","last_became_peered":"2024-09-21T07:23:42.262389+0000","last_unstale":"2024-09-21T07:23:42.270977+0000","last_undegraded":"2024-09-21T07:23:42.270977+0000","last_fullsized":"2024-09-21T07:23:42.270977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264343+0000","last_change":"2024-09-21T07:23:42.261715+0000","last_active":"2024-09-21T07:23:42.264343+0000","last_peered":"2024-09-21T07:23:42.264343+0000","last_clean":"2024-09-21T07:23:42.264343+0000","last_became_active":"2024-09-21T07:23:42.261340+0000","last_became_peered":"2024-09-21T07:23:42.261340+0000","last_unstale":"2024-09-21T07:23:42.264343+0000","last_undegraded":"2024-09-21T07:23:42.264343+0000","last_fullsized":"2024-09-21T07:23:42.264343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:03.153945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267003+0000","last_change":"2024-09-21T07:23:42.262249+0000","last_active":"2024-09-21T07:23:42.267003+0000","last_peered":"2024-09-21T07:23:42.267003+0000","last_clean":"2024-09-21T07:23:42.267003+0000","last_became_active":"2024-09-21T07:23:42.261907+0000","last_became_peered":"2024-09-21T07:23:42.261907+0000","last_unstale":"2024-09-21T07:23:42.267003+0000","last_undegraded":"2024-09-21T07:23:42.267003+0000","last_fullsized":"2024-09-21T07:23:42.267003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:17.323588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244499+0000","last_change":"2024-09-21T07:23:42.235503+0000","last_active":"2024-09-21T07:23:42.244499+0000","last_peered":"2024-09-21T07:23:42.244499+0000","last_clean":"2024-09-21T07:23:42.244499+0000","last_became_active":"2024-09-21T07:23:42.235177+0000","last_became_peered":"2024-09-21T07:23:42.235177+0000","last_unstale":"2024-09-21T07:23:42.244499+0000","last_undegraded":"2024-09-21T07:23:42.244499+0000","last_fullsized":"2024-09-21T07:23:42.244499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:14.486415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260702+0000","last_change":"2024-09-21T07:23:42.252188+0000","last_active":"2024-09-21T07:23:42.260702+0000","last_peered":"2024-09-21T07:23:42.260702+0000","last_clean":"2024-09-21T07:23:42.260702+0000","last_became_active":"2024-09-21T07:23:42.251894+0000","last_became_peered":"2024-09-21T07:23:42.251894+0000","last_unstale":"2024-09-21T07:23:42.260702+0000","last_undegraded":"2024-09-21T07:23:42.260702+0000","last_fullsized":"2024-09-21T07:23:42.260702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272159+0000","last_change":"2024-09-21T07:23:42.264397+0000","last_active":"2024-09-21T07:23:42.272159+0000","last_peered":"2024-09-21T07:23:42.272159+0000","last_clean":"2024-09-21T07:23:42.272159+0000","last_became_active":"2024-09-21T07:23:42.264043+0000","last_became_peered":"2024-09-21T07:23:42.264043+0000","last_unstale":"2024-09-21T07:23:42.272159+0000","last_undegraded":"2024-09-21T07:23:42.272159+0000","last_fullsized":"2024-09-21T07:23:42.272159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273751+0000","last_change":"2024-09-21T07:23:42.268132+0000","last_active":"2024-09-21T07:23:42.273751+0000","last_peered":"2024-09-21T07:23:42.273751+0000","last_clean":"2024-09-21T07:23:42.273751+0000","last_became_active":"2024-09-21T07:23:42.267741+0000","last_became_peered":"2024-09-21T07:23:42.267741+0000","last_unstale":"2024-09-21T07:23:42.273751+0000","last_undegraded":"2024-09-21T07:23:42.273751+0000","last_fullsized":"2024-09-21T07:23:42.273751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:31.858647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272935+0000","last_change":"2024-09-21T07:23:42.264152+0000","last_active":"2024-09-21T07:23:42.272935+0000","last_peered":"2024-09-21T07:23:42.272935+0000","last_clean":"2024-09-21T07:23:42.272935+0000","last_became_active":"2024-09-21T07:23:42.263622+0000","last_became_peered":"2024-09-21T07:23:42.263622+0000","last_unstale":"2024-09-21T07:23:42.272935+0000","last_undegraded":"2024-09-21T07:23:42.272935+0000","last_fullsized":"2024-09-21T07:23:42.272935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:31.773982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270838+0000","last_change":"2024-09-21T07:23:42.260967+0000","last_active":"2024-09-21T07:23:42.270838+0000","last_peered":"2024-09-21T07:23:42.270838+0000","last_clean":"2024-09-21T07:23:42.270838+0000","last_became_active":"2024-09-21T07:23:42.260623+0000","last_became_peered":"2024-09-21T07:23:42.260623+0000","last_unstale":"2024-09-21T07:23:42.270838+0000","last_undegraded":"2024-09-21T07:23:42.270838+0000","last_fullsized":"2024-09-21T07:23:42.270838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273838+0000","last_change":"2024-09-21T07:23:42.269480+0000","last_active":"2024-09-21T07:23:42.273838+0000","last_peered":"2024-09-21T07:23:42.273838+0000","last_clean":"2024-09-21T07:23:42.273838+0000","last_became_active":"2024-09-21T07:23:42.269068+0000","last_became_peered":"2024-09-21T07:23:42.269068+0000","last_unstale":"2024-09-21T07:23:42.273838+0000","last_undegraded":"2024-09-21T07:23:42.273838+0000","last_fullsized":"2024-09-21T07:23:42.273838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:09.553859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257689+0000","last_change":"2024-09-21T07:23:42.243029+0000","last_active":"2024-09-21T07:23:42.257689+0000","last_peered":"2024-09-21T07:23:42.257689+0000","last_clean":"2024-09-21T07:23:42.257689+0000","last_became_active":"2024-09-21T07:23:42.242668+0000","last_became_peered":"2024-09-21T07:23:42.242668+0000","last_unstale":"2024-09-21T07:23:42.257689+0000","last_undegraded":"2024-09-21T07:23:42.257689+0000","last_fullsized":"2024-09-21T07:23:42.257689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273363+0000","last_change":"2024-09-21T07:23:42.265930+0000","last_active":"2024-09-21T07:23:42.273363+0000","last_peered":"2024-09-21T07:23:42.273363+0000","last_clean":"2024-09-21T07:23:42.273363+0000","last_became_active":"2024-09-21T07:23:42.265524+0000","last_became_peered":"2024-09-21T07:23:42.265524+0000","last_unstale":"2024-09-21T07:23:42.273363+0000","last_undegraded":"2024-09-21T07:23:42.273363+0000","last_fullsized":"2024-09-21T07:23:42.273363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:06.508104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223620+0000","last_change":"2024-09-21T07:23:41.223620+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223620+0000","last_undegraded":"2024-09-21T07:23:41.223620+0000","last_fullsized":"2024-09-21T07:23:41.223620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224983+0000","last_change":"2024-09-21T07:23:41.224983+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224983+0000","last_undegraded":"2024-09-21T07:23:41.224983+0000","last_fullsized":"2024-09-21T07:23:41.224983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259279+0000","last_change":"2024-09-21T07:23:42.244851+0000","last_active":"2024-09-21T07:23:42.259279+0000","last_peered":"2024-09-21T07:23:42.259279+0000","last_clean":"2024-09-21T07:23:42.259279+0000","last_became_active":"2024-09-21T07:23:42.244491+0000","last_became_peered":"2024-09-21T07:23:42.244491+0000","last_unstale":"2024-09-21T07:23:42.259279+0000","last_undegraded":"2024-09-21T07:23:42.259279+0000","last_fullsized":"2024-09-21T07:23:42.259279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263127+0000","last_change":"2024-09-21T07:23:42.254476+0000","last_active":"2024-09-21T07:23:42.263127+0000","last_peered":"2024-09-21T07:23:42.263127+0000","last_clean":"2024-09-21T07:23:42.263127+0000","last_became_active":"2024-09-21T07:23:42.253980+0000","last_became_peered":"2024-09-21T07:23:42.253980+0000","last_unstale":"2024-09-21T07:23:42.263127+0000","last_undegraded":"2024-09-21T07:23:42.263127+0000","last_fullsized":"2024-09-21T07:23:42.263127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:27.378166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259220+0000","last_change":"2024-09-21T07:23:42.244122+0000","last_active":"2024-09-21T07:23:42.259220+0000","last_peered":"2024-09-21T07:23:42.259220+0000","last_clean":"2024-09-21T07:23:42.259220+0000","last_became_active":"2024-09-21T07:23:42.243673+0000","last_became_peered":"2024-09-21T07:23:42.243673+0000","last_unstale":"2024-09-21T07:23:42.259220+0000","last_undegraded":"2024-09-21T07:23:42.259220+0000","last_fullsized":"2024-09-21T07:23:42.259220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262576+0000","last_change":"2024-09-21T07:23:42.253068+0000","last_active":"2024-09-21T07:23:42.262576+0000","last_peered":"2024-09-21T07:23:42.262576+0000","last_clean":"2024-09-21T07:23:42.262576+0000","last_became_active":"2024-09-21T07:23:42.252729+0000","last_became_peered":"2024-09-21T07:23:42.252729+0000","last_unstale":"2024-09-21T07:23:42.262576+0000","last_undegraded":"2024-09-21T07:23:42.262576+0000","last_fullsized":"2024-09-21T07:23:42.262576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257736+0000","last_change":"2024-09-21T07:23:42.251107+0000","last_active":"2024-09-21T07:23:42.257736+0000","last_peered":"2024-09-21T07:23:42.257736+0000","last_clean":"2024-09-21T07:23:42.257736+0000","last_became_active":"2024-09-21T07:23:42.248543+0000","last_became_peered":"2024-09-21T07:23:42.248543+0000","last_unstale":"2024-09-21T07:23:42.257736+0000","last_undegraded":"2024-09-21T07:23:42.257736+0000","last_fullsized":"2024-09-21T07:23:42.257736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223840+0000","last_change":"2024-09-21T07:23:41.223840+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223840+0000","last_undegraded":"2024-09-21T07:23:41.223840+0000","last_fullsized":"2024-09-21T07:23:41.223840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266136+0000","last_change":"2024-09-21T07:23:42.263299+0000","last_active":"2024-09-21T07:23:42.266136+0000","last_peered":"2024-09-21T07:23:42.266136+0000","last_clean":"2024-09-21T07:23:42.266136+0000","last_became_active":"2024-09-21T07:23:42.259857+0000","last_became_peered":"2024-09-21T07:23:42.259857+0000","last_unstale":"2024-09-21T07:23:42.266136+0000","last_undegraded":"2024-09-21T07:23:42.266136+0000","last_fullsized":"2024-09-21T07:23:42.266136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:41.112303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259393+0000","last_change":"2024-09-21T07:23:42.255686+0000","last_active":"2024-09-21T07:23:42.259393+0000","last_peered":"2024-09-21T07:23:42.259393+0000","last_clean":"2024-09-21T07:23:42.259393+0000","last_became_active":"2024-09-21T07:23:42.255269+0000","last_became_peered":"2024-09-21T07:23:42.255269+0000","last_unstale":"2024-09-21T07:23:42.259393+0000","last_undegraded":"2024-09-21T07:23:42.259393+0000","last_fullsized":"2024-09-21T07:23:42.259393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263033+0000","last_change":"2024-09-21T07:23:42.260742+0000","last_active":"2024-09-21T07:23:42.263033+0000","last_peered":"2024-09-21T07:23:42.263033+0000","last_clean":"2024-09-21T07:23:42.263033+0000","last_became_active":"2024-09-21T07:23:42.260474+0000","last_became_peered":"2024-09-21T07:23:42.260474+0000","last_unstale":"2024-09-21T07:23:42.263033+0000","last_undegraded":"2024-09-21T07:23:42.263033+0000","last_fullsized":"2024-09-21T07:23:42.263033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:01.499156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270409+0000","last_change":"2024-09-21T07:23:42.265850+0000","last_active":"2024-09-21T07:23:42.270409+0000","last_peered":"2024-09-21T07:23:42.270409+0000","last_clean":"2024-09-21T07:23:42.270409+0000","last_became_active":"2024-09-21T07:23:42.265462+0000","last_became_peered":"2024-09-21T07:23:42.265462+0000","last_unstale":"2024-09-21T07:23:42.270409+0000","last_undegraded":"2024-09-21T07:23:42.270409+0000","last_fullsized":"2024-09-21T07:23:42.270409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264217+0000","last_change":"2024-09-21T07:23:42.258580+0000","last_active":"2024-09-21T07:23:42.264217+0000","last_peered":"2024-09-21T07:23:42.264217+0000","last_clean":"2024-09-21T07:23:42.264217+0000","last_became_active":"2024-09-21T07:23:42.258317+0000","last_became_peered":"2024-09-21T07:23:42.258317+0000","last_unstale":"2024-09-21T07:23:42.264217+0000","last_undegraded":"2024-09-21T07:23:42.264217+0000","last_fullsized":"2024-09-21T07:23:42.264217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248249+0000","last_change":"2024-09-21T07:23:42.240018+0000","last_active":"2024-09-21T07:23:42.248249+0000","last_peered":"2024-09-21T07:23:42.248249+0000","last_clean":"2024-09-21T07:23:42.248249+0000","last_became_active":"2024-09-21T07:23:42.239526+0000","last_became_peered":"2024-09-21T07:23:42.239526+0000","last_unstale":"2024-09-21T07:23:42.248249+0000","last_undegraded":"2024-09-21T07:23:42.248249+0000","last_fullsized":"2024-09-21T07:23:42.248249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:31.250437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.241461+0000","last_change":"2024-09-21T07:23:42.236369+0000","last_active":"2024-09-21T07:23:42.241461+0000","last_peered":"2024-09-21T07:23:42.241461+0000","last_clean":"2024-09-21T07:23:42.241461+0000","last_became_active":"2024-09-21T07:23:42.235993+0000","last_became_peered":"2024-09-21T07:23:42.235993+0000","last_unstale":"2024-09-21T07:23:42.241461+0000","last_undegraded":"2024-09-21T07:23:42.241461+0000","last_fullsized":"2024-09-21T07:23:42.241461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:00.022946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223010+0000","last_change":"2024-09-21T07:23:41.223010+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223010+0000","last_undegraded":"2024-09-21T07:23:41.223010+0000","last_fullsized":"2024-09-21T07:23:41.223010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.251171+0000","last_change":"2024-09-21T07:23:42.248019+0000","last_active":"2024-09-21T07:23:42.251171+0000","last_peered":"2024-09-21T07:23:42.251171+0000","last_clean":"2024-09-21T07:23:42.251171+0000","last_became_active":"2024-09-21T07:23:42.247618+0000","last_became_peered":"2024-09-21T07:23:42.247618+0000","last_unstale":"2024-09-21T07:23:42.251171+0000","last_undegraded":"2024-09-21T07:23:42.251171+0000","last_fullsized":"2024-09-21T07:23:42.251171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:45.479102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225243+0000","last_change":"2024-09-21T07:23:41.225243+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225243+0000","last_undegraded":"2024-09-21T07:23:41.225243+0000","last_fullsized":"2024-09-21T07:23:41.225243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258886+0000","last_change":"2024-09-21T07:23:41.229683+0000","last_active":"2024-09-21T07:23:42.258886+0000","last_peered":"2024-09-21T07:23:42.258886+0000","last_clean":"2024-09-21T07:23:42.258886+0000","last_became_active":"2024-09-21T07:23:41.229300+0000","last_became_peered":"2024-09-21T07:23:41.229300+0000","last_unstale":"2024-09-21T07:23:42.258886+0000","last_undegraded":"2024-09-21T07:23:42.258886+0000","last_fullsized":"2024-09-21T07:23:42.258886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.269288+0000","last_change":"2024-09-21T07:23:42.265994+0000","last_active":"2024-09-21T07:23:42.269288+0000","last_peered":"2024-09-21T07:23:42.269288+0000","last_clean":"2024-09-21T07:23:42.269288+0000","last_became_active":"2024-09-21T07:23:42.265634+0000","last_became_peered":"2024-09-21T07:23:42.265634+0000","last_unstale":"2024-09-21T07:23:42.269288+0000","last_undegraded":"2024-09-21T07:23:42.269288+0000","last_fullsized":"2024-09-21T07:23:42.269288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:35.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263151+0000","last_change":"2024-09-21T07:23:41.247293+0000","last_active":"2024-09-21T07:23:42.263151+0000","last_peered":"2024-09-21T07:23:42.263151+0000","last_clean":"2024-09-21T07:23:42.263151+0000","last_became_active":"2024-09-21T07:23:41.246932+0000","last_became_peered":"2024-09-21T07:23:41.246932+0000","last_unstale":"2024-09-21T07:23:42.263151+0000","last_undegraded":"2024-09-21T07:23:42.263151+0000","last_fullsized":"2024-09-21T07:23:42.263151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250765+0000","last_change":"2024-09-21T07:23:42.243789+0000","last_active":"2024-09-21T07:23:42.250765+0000","last_peered":"2024-09-21T07:23:42.250765+0000","last_clean":"2024-09-21T07:23:42.250765+0000","last_became_active":"2024-09-21T07:23:42.243092+0000","last_became_peered":"2024-09-21T07:23:42.243092+0000","last_unstale":"2024-09-21T07:23:42.250765+0000","last_undegraded":"2024-09-21T07:23:42.250765+0000","last_fullsized":"2024-09-21T07:23:42.250765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258710+0000","last_change":"2024-09-21T07:23:41.231067+0000","last_active":"2024-09-21T07:23:42.258710+0000","last_peered":"2024-09-21T07:23:42.258710+0000","last_clean":"2024-09-21T07:23:42.258710+0000","last_became_active":"2024-09-21T07:23:41.230264+0000","last_became_peered":"2024-09-21T07:23:41.230264+0000","last_unstale":"2024-09-21T07:23:42.258710+0000","last_undegraded":"2024-09-21T07:23:42.258710+0000","last_fullsized":"2024-09-21T07:23:42.258710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.104337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259779+0000","last_change":"2024-09-21T07:23:41.227352+0000","last_active":"2024-09-21T07:23:42.259779+0000","last_peered":"2024-09-21T07:23:42.259779+0000","last_clean":"2024-09-21T07:23:42.259779+0000","last_became_active":"2024-09-21T07:23:41.226996+0000","last_became_peered":"2024-09-21T07:23:41.226996+0000","last_unstale":"2024-09-21T07:23:42.259779+0000","last_undegraded":"2024-09-21T07:23:42.259779+0000","last_fullsized":"2024-09-21T07:23:42.259779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:41.257887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255905+0000","last_change":"2024-09-21T07:23:42.249480+0000","last_active":"2024-09-21T07:23:42.255905+0000","last_peered":"2024-09-21T07:23:42.255905+0000","last_clean":"2024-09-21T07:23:42.255905+0000","last_became_active":"2024-09-21T07:23:42.247629+0000","last_became_peered":"2024-09-21T07:23:42.247629+0000","last_unstale":"2024-09-21T07:23:42.255905+0000","last_undegraded":"2024-09-21T07:23:42.255905+0000","last_fullsized":"2024-09-21T07:23:42.255905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273876+0000","last_change":"2024-09-21T07:23:41.247247+0000","last_active":"2024-09-21T07:23:42.273876+0000","last_peered":"2024-09-21T07:23:42.273876+0000","last_clean":"2024-09-21T07:23:42.273876+0000","last_became_active":"2024-09-21T07:23:41.246933+0000","last_became_peered":"2024-09-21T07:23:41.246933+0000","last_unstale":"2024-09-21T07:23:42.273876+0000","last_undegraded":"2024-09-21T07:23:42.273876+0000","last_fullsized":"2024-09-21T07:23:42.273876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:24.210839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262611+0000","last_change":"2024-09-21T07:23:42.257399+0000","last_active":"2024-09-21T07:23:42.262611+0000","last_peered":"2024-09-21T07:23:42.262611+0000","last_clean":"2024-09-21T07:23:42.262611+0000","last_became_active":"2024-09-21T07:23:42.253176+0000","last_became_peered":"2024-09-21T07:23:42.253176+0000","last_unstale":"2024-09-21T07:23:42.262611+0000","last_undegraded":"2024-09-21T07:23:42.262611+0000","last_fullsized":"2024-09-21T07:23:42.262611+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246291+0000","last_change":"2024-09-21T07:23:41.241248+0000","last_active":"2024-09-21T07:23:41.246291+0000","last_peered":"2024-09-21T07:23:41.246291+0000","last_clean":"2024-09-21T07:23:41.246291+0000","last_became_active":"2024-09-21T07:23:41.239401+0000","last_became_peered":"2024-09-21T07:23:41.239401+0000","last_unstale":"2024-09-21T07:23:41.246291+0000","last_undegraded":"2024-09-21T07:23:41.246291+0000","last_fullsized":"2024-09-21T07:23:41.246291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:26.534321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262884+0000","last_change":"2024-09-21T07:23:42.257444+0000","last_active":"2024-09-21T07:23:42.262884+0000","last_peered":"2024-09-21T07:23:42.262884+0000","last_clean":"2024-09-21T07:23:42.262884+0000","last_became_active":"2024-09-21T07:23:42.257148+0000","last_became_peered":"2024-09-21T07:23:42.257148+0000","last_unstale":"2024-09-21T07:23:42.262884+0000","last_undegraded":"2024-09-21T07:23:42.262884+0000","last_fullsized":"2024-09-21T07:23:42.262884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229192+0000","last_change":"2024-09-21T07:23:41.241097+0000","last_active":"2024-09-21T07:23:42.229192+0000","last_peered":"2024-09-21T07:23:42.229192+0000","last_clean":"2024-09-21T07:23:42.229192+0000","last_became_active":"2024-09-21T07:23:41.240725+0000","last_became_peered":"2024-09-21T07:23:41.240725+0000","last_unstale":"2024-09-21T07:23:42.229192+0000","last_undegraded":"2024-09-21T07:23:42.229192+0000","last_fullsized":"2024-09-21T07:23:42.229192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:55.998354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.232757+0000","last_change":"2024-09-21T07:23:41.224843+0000","last_active":"2024-09-21T07:23:42.232757+0000","last_peered":"2024-09-21T07:23:42.232757+0000","last_clean":"2024-09-21T07:23:42.232757+0000","last_became_active":"2024-09-21T07:23:41.224463+0000","last_became_peered":"2024-09-21T07:23:41.224463+0000","last_unstale":"2024-09-21T07:23:42.232757+0000","last_undegraded":"2024-09-21T07:23:42.232757+0000","last_fullsized":"2024-09-21T07:23:42.232757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264316+0000","last_change":"2024-09-21T07:23:42.259678+0000","last_active":"2024-09-21T07:23:42.264316+0000","last_peered":"2024-09-21T07:23:42.264316+0000","last_clean":"2024-09-21T07:23:42.264316+0000","last_became_active":"2024-09-21T07:23:42.259361+0000","last_became_peered":"2024-09-21T07:23:42.259361+0000","last_unstale":"2024-09-21T07:23:42.264316+0000","last_undegraded":"2024-09-21T07:23:42.264316+0000","last_fullsized":"2024-09-21T07:23:42.264316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:41.188911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212636+0000","last_change":"2024-09-21T07:23:40.212636+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212636+0000","last_undegraded":"2024-09-21T07:23:40.212636+0000","last_fullsized":"2024-09-21T07:23:40.212636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.226421+0000","last_change":"2024-09-21T07:23:41.226421+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.226421+0000","last_undegraded":"2024-09-21T07:23:41.226421+0000","last_fullsized":"2024-09-21T07:23:41.226421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248668+0000","last_change":"2024-09-21T07:23:41.245321+0000","last_active":"2024-09-21T07:23:42.248668+0000","last_peered":"2024-09-21T07:23:42.248668+0000","last_clean":"2024-09-21T07:23:42.248668+0000","last_became_active":"2024-09-21T07:23:41.244908+0000","last_became_peered":"2024-09-21T07:23:41.244908+0000","last_unstale":"2024-09-21T07:23:42.248668+0000","last_undegraded":"2024-09-21T07:23:42.248668+0000","last_fullsized":"2024-09-21T07:23:42.248668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:18.079641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271330+0000","last_change":"2024-09-21T07:23:42.255482+0000","last_active":"2024-09-21T07:23:42.271330+0000","last_peered":"2024-09-21T07:23:42.271330+0000","last_clean":"2024-09-21T07:23:42.271330+0000","last_became_active":"2024-09-21T07:23:42.255181+0000","last_became_peered":"2024-09-21T07:23:42.255181+0000","last_unstale":"2024-09-21T07:23:42.271330+0000","last_undegraded":"2024-09-21T07:23:42.271330+0000","last_fullsized":"2024-09-21T07:23:42.271330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275341+0000","last_change":"2024-09-21T07:23:41.241070+0000","last_active":"2024-09-21T07:23:42.275341+0000","last_peered":"2024-09-21T07:23:42.275341+0000","last_clean":"2024-09-21T07:23:42.275341+0000","last_became_active":"2024-09-21T07:23:41.240700+0000","last_became_peered":"2024-09-21T07:23:41.240700+0000","last_unstale":"2024-09-21T07:23:42.275341+0000","last_undegraded":"2024-09-21T07:23:42.275341+0000","last_fullsized":"2024-09-21T07:23:42.275341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:38.885316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270159+0000","last_change":"2024-09-21T07:23:42.267128+0000","last_active":"2024-09-21T07:23:42.270159+0000","last_peered":"2024-09-21T07:23:42.270159+0000","last_clean":"2024-09-21T07:23:42.270159+0000","last_became_active":"2024-09-21T07:23:42.266152+0000","last_became_peered":"2024-09-21T07:23:42.266152+0000","last_unstale":"2024-09-21T07:23:42.270159+0000","last_undegraded":"2024-09-21T07:23:42.270159+0000","last_fullsized":"2024-09-21T07:23:42.270159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212213+0000","last_change":"2024-09-21T07:23:40.212213+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212213+0000","last_undegraded":"2024-09-21T07:23:40.212213+0000","last_fullsized":"2024-09-21T07:23:40.212213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271104+0000","last_change":"2024-09-21T07:23:42.264392+0000","last_active":"2024-09-21T07:23:42.271104+0000","last_peered":"2024-09-21T07:23:42.271104+0000","last_clean":"2024-09-21T07:23:42.271104+0000","last_became_active":"2024-09-21T07:23:42.264071+0000","last_became_peered":"2024-09-21T07:23:42.264071+0000","last_unstale":"2024-09-21T07:23:42.271104+0000","last_undegraded":"2024-09-21T07:23:42.271104+0000","last_fullsized":"2024-09-21T07:23:42.271104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212240+0000","last_change":"2024-09-21T07:23:40.212240+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212240+0000","last_undegraded":"2024-09-21T07:23:40.212240+0000","last_fullsized":"2024-09-21T07:23:40.212240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229859+0000","last_change":"2024-09-21T07:23:41.237332+0000","last_active":"2024-09-21T07:23:42.229859+0000","last_peered":"2024-09-21T07:23:42.229859+0000","last_clean":"2024-09-21T07:23:42.229859+0000","last_became_active":"2024-09-21T07:23:41.236953+0000","last_became_peered":"2024-09-21T07:23:41.236953+0000","last_unstale":"2024-09-21T07:23:42.229859+0000","last_undegraded":"2024-09-21T07:23:42.229859+0000","last_fullsized":"2024-09-21T07:23:42.229859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:43.800815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224255+0000","last_change":"2024-09-21T07:23:41.224255+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224255+0000","last_undegraded":"2024-09-21T07:23:41.224255+0000","last_fullsized":"2024-09-21T07:23:41.224255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227550+0000","last_change":"2024-09-21T07:23:41.228019+0000","last_active":"2024-09-21T07:23:42.227550+0000","last_peered":"2024-09-21T07:23:42.227550+0000","last_clean":"2024-09-21T07:23:42.227550+0000","last_became_active":"2024-09-21T07:23:41.227689+0000","last_became_peered":"2024-09-21T07:23:41.227689+0000","last_unstale":"2024-09-21T07:23:42.227550+0000","last_undegraded":"2024-09-21T07:23:42.227550+0000","last_fullsized":"2024-09-21T07:23:42.227550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:20.597221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247129+0000","last_change":"2024-09-21T07:23:41.242205+0000","last_active":"2024-09-21T07:23:41.247129+0000","last_peered":"2024-09-21T07:23:41.247129+0000","last_clean":"2024-09-21T07:23:41.247129+0000","last_became_active":"2024-09-21T07:23:41.240901+0000","last_became_peered":"2024-09-21T07:23:41.240901+0000","last_unstale":"2024-09-21T07:23:41.247129+0000","last_undegraded":"2024-09-21T07:23:41.247129+0000","last_fullsized":"2024-09-21T07:23:41.247129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:58.235388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273926+0000","last_change":"2024-09-21T07:23:41.241933+0000","last_active":"2024-09-21T07:23:42.273926+0000","last_peered":"2024-09-21T07:23:42.273926+0000","last_clean":"2024-09-21T07:23:42.273926+0000","last_became_active":"2024-09-21T07:23:41.241652+0000","last_became_peered":"2024-09-21T07:23:41.241652+0000","last_unstale":"2024-09-21T07:23:42.273926+0000","last_undegraded":"2024-09-21T07:23:42.273926+0000","last_fullsized":"2024-09-21T07:23:42.273926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:33.390195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267929+0000","last_change":"2024-09-21T07:23:42.261384+0000","last_active":"2024-09-21T07:23:42.267929+0000","last_peered":"2024-09-21T07:23:42.267929+0000","last_clean":"2024-09-21T07:23:42.267929+0000","last_became_active":"2024-09-21T07:23:42.260641+0000","last_became_peered":"2024-09-21T07:23:42.260641+0000","last_unstale":"2024-09-21T07:23:42.267929+0000","last_undegraded":"2024-09-21T07:23:42.267929+0000","last_fullsized":"2024-09-21T07:23:42.267929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266558+0000","last_change":"2024-09-21T07:23:41.238947+0000","last_active":"2024-09-21T07:23:42.266558+0000","last_peered":"2024-09-21T07:23:42.266558+0000","last_clean":"2024-09-21T07:23:42.266558+0000","last_became_active":"2024-09-21T07:23:41.238569+0000","last_became_peered":"2024-09-21T07:23:41.238569+0000","last_unstale":"2024-09-21T07:23:42.266558+0000","last_undegraded":"2024-09-21T07:23:42.266558+0000","last_fullsized":"2024-09-21T07:23:42.266558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250792+0000","last_change":"2024-09-21T07:23:42.244113+0000","last_active":"2024-09-21T07:23:42.250792+0000","last_peered":"2024-09-21T07:23:42.250792+0000","last_clean":"2024-09-21T07:23:42.250792+0000","last_became_active":"2024-09-21T07:23:42.243505+0000","last_became_peered":"2024-09-21T07:23:42.243505+0000","last_unstale":"2024-09-21T07:23:42.250792+0000","last_undegraded":"2024-09-21T07:23:42.250792+0000","last_fullsized":"2024-09-21T07:23:42.250792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271049+0000","last_change":"2024-09-21T07:23:41.239340+0000","last_active":"2024-09-21T07:23:42.271049+0000","last_peered":"2024-09-21T07:23:42.271049+0000","last_clean":"2024-09-21T07:23:42.271049+0000","last_became_active":"2024-09-21T07:23:41.238977+0000","last_became_peered":"2024-09-21T07:23:41.238977+0000","last_unstale":"2024-09-21T07:23:42.271049+0000","last_undegraded":"2024-09-21T07:23:42.271049+0000","last_fullsized":"2024-09-21T07:23:42.271049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.265190+0000","last_change":"2024-09-21T07:23:42.258030+0000","last_active":"2024-09-21T07:23:42.265190+0000","last_peered":"2024-09-21T07:23:42.265190+0000","last_clean":"2024-09-21T07:23:42.265190+0000","last_became_active":"2024-09-21T07:23:42.256792+0000","last_became_peered":"2024-09-21T07:23:42.256792+0000","last_unstale":"2024-09-21T07:23:42.265190+0000","last_undegraded":"2024-09-21T07:23:42.265190+0000","last_fullsized":"2024-09-21T07:23:42.265190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:27.750378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.230439+0000","last_change":"2024-09-21T07:23:41.244419+0000","last_active":"2024-09-21T07:23:42.230439+0000","last_peered":"2024-09-21T07:23:42.230439+0000","last_clean":"2024-09-21T07:23:42.230439+0000","last_became_active":"2024-09-21T07:23:41.242477+0000","last_became_peered":"2024-09-21T07:23:41.242477+0000","last_unstale":"2024-09-21T07:23:42.230439+0000","last_undegraded":"2024-09-21T07:23:42.230439+0000","last_fullsized":"2024-09-21T07:23:42.230439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.513475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223011+0000","last_change":"2024-09-21T07:23:41.223011+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223011+0000","last_undegraded":"2024-09-21T07:23:41.223011+0000","last_fullsized":"2024-09-21T07:23:41.223011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272824+0000","last_change":"2024-09-21T07:23:41.249080+0000","last_active":"2024-09-21T07:23:42.272824+0000","last_peered":"2024-09-21T07:23:42.272824+0000","last_clean":"2024-09-21T07:23:42.272824+0000","last_became_active":"2024-09-21T07:23:41.247666+0000","last_became_peered":"2024-09-21T07:23:41.247666+0000","last_unstale":"2024-09-21T07:23:42.272824+0000","last_undegraded":"2024-09-21T07:23:42.272824+0000","last_fullsized":"2024-09-21T07:23:42.272824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.522254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255013+0000","last_change":"2024-09-21T07:23:42.248515+0000","last_active":"2024-09-21T07:23:42.255013+0000","last_peered":"2024-09-21T07:23:42.255013+0000","last_clean":"2024-09-21T07:23:42.255013+0000","last_became_active":"2024-09-21T07:23:42.248201+0000","last_became_peered":"2024-09-21T07:23:42.248201+0000","last_unstale":"2024-09-21T07:23:42.255013+0000","last_undegraded":"2024-09-21T07:23:42.255013+0000","last_fullsized":"2024-09-21T07:23:42.255013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260553+0000","last_change":"2024-09-21T07:23:41.238957+0000","last_active":"2024-09-21T07:23:42.260553+0000","last_peered":"2024-09-21T07:23:42.260553+0000","last_clean":"2024-09-21T07:23:42.260553+0000","last_became_active":"2024-09-21T07:23:41.237652+0000","last_became_peered":"2024-09-21T07:23:41.237652+0000","last_unstale":"2024-09-21T07:23:42.260553+0000","last_undegraded":"2024-09-21T07:23:42.260553+0000","last_fullsized":"2024-09-21T07:23:42.260553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:32.394414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260093+0000","last_change":"2024-09-21T07:23:42.250508+0000","last_active":"2024-09-21T07:23:42.260093+0000","last_peered":"2024-09-21T07:23:42.260093+0000","last_clean":"2024-09-21T07:23:42.260093+0000","last_became_active":"2024-09-21T07:23:42.249128+0000","last_became_peered":"2024-09-21T07:23:42.249128+0000","last_unstale":"2024-09-21T07:23:42.260093+0000","last_undegraded":"2024-09-21T07:23:42.260093+0000","last_fullsized":"2024-09-21T07:23:42.260093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247367+0000","last_change":"2024-09-21T07:23:41.242637+0000","last_active":"2024-09-21T07:23:41.247367+0000","last_peered":"2024-09-21T07:23:41.247367+0000","last_clean":"2024-09-21T07:23:41.247367+0000","last_became_active":"2024-09-21T07:23:41.242213+0000","last_became_peered":"2024-09-21T07:23:41.242213+0000","last_unstale":"2024-09-21T07:23:41.247367+0000","last_undegraded":"2024-09-21T07:23:41.247367+0000","last_fullsized":"2024-09-21T07:23:41.247367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:53.092717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259605+0000","last_change":"2024-09-21T07:23:41.234226+0000","last_active":"2024-09-21T07:23:42.259605+0000","last_peered":"2024-09-21T07:23:42.259605+0000","last_clean":"2024-09-21T07:23:42.259605+0000","last_became_active":"2024-09-21T07:23:41.233924+0000","last_became_peered":"2024-09-21T07:23:41.233924+0000","last_unstale":"2024-09-21T07:23:42.259605+0000","last_undegraded":"2024-09-21T07:23:42.259605+0000","last_fullsized":"2024-09-21T07:23:42.259605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:29.309397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.261026+0000","last_change":"2024-09-21T07:23:42.259554+0000","last_active":"2024-09-21T07:23:42.261026+0000","last_peered":"2024-09-21T07:23:42.261026+0000","last_clean":"2024-09-21T07:23:42.261026+0000","last_became_active":"2024-09-21T07:23:42.259038+0000","last_became_peered":"2024-09-21T07:23:42.259038+0000","last_unstale":"2024-09-21T07:23:42.261026+0000","last_undegraded":"2024-09-21T07:23:42.261026+0000","last_fullsized":"2024-09-21T07:23:42.261026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:47.530038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275084+0000","last_change":"2024-09-21T07:23:41.240831+0000","last_active":"2024-09-21T07:23:42.275084+0000","last_peered":"2024-09-21T07:23:42.275084+0000","last_clean":"2024-09-21T07:23:42.275084+0000","last_became_active":"2024-09-21T07:23:41.240462+0000","last_became_peered":"2024-09-21T07:23:41.240462+0000","last_unstale":"2024-09-21T07:23:42.275084+0000","last_undegraded":"2024-09-21T07:23:42.275084+0000","last_fullsized":"2024-09-21T07:23:42.275084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225825+0000","last_change":"2024-09-21T07:23:41.225825+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225825+0000","last_undegraded":"2024-09-21T07:23:41.225825+0000","last_fullsized":"2024-09-21T07:23:41.225825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263649+0000","last_change":"2024-09-21T07:23:41.238080+0000","last_active":"2024-09-21T07:23:42.263649+0000","last_peered":"2024-09-21T07:23:42.263649+0000","last_clean":"2024-09-21T07:23:42.263649+0000","last_became_active":"2024-09-21T07:23:41.237839+0000","last_became_peered":"2024-09-21T07:23:41.237839+0000","last_unstale":"2024-09-21T07:23:42.263649+0000","last_undegraded":"2024-09-21T07:23:42.263649+0000","last_fullsized":"2024-09-21T07:23:42.263649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:20.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.245885+0000","last_change":"2024-09-21T07:23:41.242064+0000","last_active":"2024-09-21T07:23:42.245885+0000","last_peered":"2024-09-21T07:23:42.245885+0000","last_clean":"2024-09-21T07:23:42.245885+0000","last_became_active":"2024-09-21T07:23:41.241745+0000","last_became_peered":"2024-09-21T07:23:41.241745+0000","last_unstale":"2024-09-21T07:23:42.245885+0000","last_undegraded":"2024-09-21T07:23:42.245885+0000","last_fullsized":"2024-09-21T07:23:42.245885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255934+0000","last_change":"2024-09-21T07:23:42.249809+0000","last_active":"2024-09-21T07:23:42.255934+0000","last_peered":"2024-09-21T07:23:42.255934+0000","last_clean":"2024-09-21T07:23:42.255934+0000","last_became_active":"2024-09-21T07:23:42.249220+0000","last_became_peered":"2024-09-21T07:23:42.249220+0000","last_unstale":"2024-09-21T07:23:42.255934+0000","last_undegraded":"2024-09-21T07:23:42.255934+0000","last_fullsized":"2024-09-21T07:23:42.255934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.242562+0000","last_change":"2024-09-21T07:23:41.246426+0000","last_active":"2024-09-21T07:23:42.242562+0000","last_peered":"2024-09-21T07:23:42.242562+0000","last_clean":"2024-09-21T07:23:42.242562+0000","last_became_active":"2024-09-21T07:23:41.246065+0000","last_became_peered":"2024-09-21T07:23:41.246065+0000","last_unstale":"2024-09-21T07:23:42.242562+0000","last_undegraded":"2024-09-21T07:23:42.242562+0000","last_fullsized":"2024-09-21T07:23:42.242562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244404+0000","last_change":"2024-09-21T07:23:42.235716+0000","last_active":"2024-09-21T07:23:42.244404+0000","last_peered":"2024-09-21T07:23:42.244404+0000","last_clean":"2024-09-21T07:23:42.244404+0000","last_became_active":"2024-09-21T07:23:42.235427+0000","last_became_peered":"2024-09-21T07:23:42.235427+0000","last_unstale":"2024-09-21T07:23:42.244404+0000","last_undegraded":"2024-09-21T07:23:42.244404+0000","last_fullsized":"2024-09-21T07:23:42.244404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.239587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227834+0000","last_change":"2024-09-21T07:23:41.247133+0000","last_active":"2024-09-21T07:23:42.227834+0000","last_peered":"2024-09-21T07:23:42.227834+0000","last_clean":"2024-09-21T07:23:42.227834+0000","last_became_active":"2024-09-21T07:23:41.246822+0000","last_became_peered":"2024-09-21T07:23:41.246822+0000","last_unstale":"2024-09-21T07:23:42.227834+0000","last_undegraded":"2024-09-21T07:23:42.227834+0000","last_fullsized":"2024-09-21T07:23:42.227834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:27.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257714+0000","last_change":"2024-09-21T07:23:42.245651+0000","last_active":"2024-09-21T07:23:42.257714+0000","last_peered":"2024-09-21T07:23:42.257714+0000","last_clean":"2024-09-21T07:23:42.257714+0000","last_became_active":"2024-09-21T07:23:42.245299+0000","last_became_peered":"2024-09-21T07:23:42.245299+0000","last_unstale":"2024-09-21T07:23:42.257714+0000","last_undegraded":"2024-09-21T07:23:42.257714+0000","last_fullsized":"2024-09-21T07:23:42.257714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.233440+0000","last_change":"2024-09-21T07:23:41.227126+0000","last_active":"2024-09-21T07:23:42.233440+0000","last_peered":"2024-09-21T07:23:42.233440+0000","last_clean":"2024-09-21T07:23:42.233440+0000","last_became_active":"2024-09-21T07:23:41.226786+0000","last_became_peered":"2024-09-21T07:23:41.226786+0000","last_unstale":"2024-09-21T07:23:42.233440+0000","last_undegraded":"2024-09-21T07:23:42.233440+0000","last_fullsized":"2024-09-21T07:23:42.233440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225876+0000","last_change":"2024-09-21T07:23:41.225876+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225876+0000","last_undegraded":"2024-09-21T07:23:41.225876+0000","last_fullsized":"2024-09-21T07:23:41.225876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212196+0000","last_change":"2024-09-21T07:23:40.212196+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212196+0000","last_undegraded":"2024-09-21T07:23:40.212196+0000","last_fullsized":"2024-09-21T07:23:40.212196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267870+0000","last_change":"2024-09-21T07:23:42.260141+0000","last_active":"2024-09-21T07:23:42.267870+0000","last_peered":"2024-09-21T07:23:42.267870+0000","last_clean":"2024-09-21T07:23:42.267870+0000","last_became_active":"2024-09-21T07:23:42.259782+0000","last_became_peered":"2024-09-21T07:23:42.259782+0000","last_unstale":"2024-09-21T07:23:42.267870+0000","last_undegraded":"2024-09-21T07:23:42.267870+0000","last_fullsized":"2024-09-21T07:23:42.267870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246426+0000","last_change":"2024-09-21T07:23:41.241484+0000","last_active":"2024-09-21T07:23:41.246426+0000","last_peered":"2024-09-21T07:23:41.246426+0000","last_clean":"2024-09-21T07:23:41.246426+0000","last_became_active":"2024-09-21T07:23:41.241073+0000","last_became_peered":"2024-09-21T07:23:41.241073+0000","last_unstale":"2024-09-21T07:23:41.246426+0000","last_undegraded":"2024-09-21T07:23:41.246426+0000","last_fullsized":"2024-09-21T07:23:41.246426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:44.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.229988+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:23:41.229988+0000","last_peered":"2024-09-21T07:23:41.229988+0000","last_clean":"2024-09-21T07:23:41.229988+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:23:41.229988+0000","last_undegraded":"2024-09-21T07:23:41.229988+0000","last_fullsized":"2024-09-21T07:23:41.229988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:46.870 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 -- 172.21.15.64:0/531882136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 msgr2=0x7f077806fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 --2- 172.21.15.64:0/531882136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f077806fa30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0778072af0 tx=0x7f077001cd50 comp rx=0 tx=0).stop 2024-09-21T07:23:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 -- 172.21.15.64:0/531882136 shutdown_connections 2024-09-21T07:23:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 --2- 172.21.15.64:0/531882136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f077806fa30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 --2- 172.21.15.64:0/531882136 >> v2:172.21.15.90:3300/0 conn(0x7f077806d020 0x7f077806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 -- 172.21.15.64:0/531882136 >> 172.21.15.64:0/531882136 conn(0x7f07780d0de0 msgr2=0x7f07780d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 -- 172.21.15.64:0/531882136 shutdown_connections 2024-09-21T07:23:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.063+0000 7f0780600640 1 -- 172.21.15.64:0/531882136 wait complete. 2024-09-21T07:23:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 Processor -- start 2024-09-21T07:23:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- start start 2024-09-21T07:23:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 0x7f077814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f077815b810 0x7f0778156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0778168be0 con 0x7f077806f620 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0778168a60 con 0x7f077815b810 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0778168d60 con 0x7f077806d020 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38904/0 (socket says 172.21.15.64:38904) 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 -- 172.21.15.64:0/3119918417 learned_addr learned my addr 172.21.15.64:0/3119918417 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077e600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f077815b810 0x7f0778156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077dc00640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 0x7f077814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 -- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 msgr2=0x7f077814f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 0x7f077814f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 -- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f077815b810 msgr2=0x7f0778156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f077815b810 0x7f0778156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 -- 172.21.15.64:0/3119918417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07780ca960 con 0x7f077806f620 2024-09-21T07:23:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077dc00640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 0x7f077814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f077d200640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07640058d0 tx=0x7f076400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764017070 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0764009d20 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640106c0 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0778156e10 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.067+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077814f9e0 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.071+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0778154b10 con 0x7f077806f620 2024-09-21T07:23:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.071+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f076401a070 con 0x7f077806f620 2024-09-21T07:23:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.071+0000 7f0775600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 0x7f0758075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.071+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f0764094440 con 0x7f077806f620 2024-09-21T07:23:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.071+0000 7f077dc00640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 0x7f0758075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.075+0000 7f077dc00640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 0x7f0758075710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f076c0016b0 tx=0x7f076c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.075+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f076405ed10 con 0x7f077806f620 2024-09-21T07:23:47.140 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:23:47.139+0000 7f764f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:23:47.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.251+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07780ca710 con 0x7f0758073200 2024-09-21T07:23:47.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.255+0000 7f0775600640 1 -- 172.21.15.64:0/3119918417 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249397 (secure 0 0 0) 0x7f07780ca710 con 0x7f0758073200 2024-09-21T07:23:47.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:47.262 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:47.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 msgr2=0x7f0758075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 0x7f0758075710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f076c0016b0 tx=0x7f076c009040 comp rx=0 tx=0).stop 2024-09-21T07:23:47.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 msgr2=0x7f0778156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07640058d0 tx=0x7f076400dde0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 shutdown_connections 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0758073200 0x7f0758075710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f077815b810 0x7f0778156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f077806f620 0x7f0778156140 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 --2- 172.21.15.64:0/3119918417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f077806d020 0x7f077814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 >> 172.21.15.64:0/3119918417 conn(0x7f07780d0de0 msgr2=0x7f07780cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 shutdown_connections 2024-09-21T07:23:47.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.259+0000 7f0780600640 1 -- 172.21.15.64:0/3119918417 wait complete. 2024-09-21T07:23:47.283 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-21T07:23:45.431521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220764,"kb_used_data":4524,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753956,"statfs":{"total":773094113280,"available":772868050944,"internally_reserved":0,"allocated":4632576,"data_stored":2647266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221848"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270977+0000","last_change":"2024-09-21T07:23:42.262669+0000","last_active":"2024-09-21T07:23:42.270977+0000","last_peered":"2024-09-21T07:23:42.270977+0000","last_clean":"2024-09-21T07:23:42.270977+0000","last_became_active":"2024-09-21T07:23:42.262389+0000","last_became_peered":"2024-09-21T07:23:42.262389+0000","last_unstale":"2024-09-21T07:23:42.270977+0000","last_undegraded":"2024-09-21T07:23:42.270977+0000","last_fullsized":"2024-09-21T07:23:42.270977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264343+0000","last_change":"2024-09-21T07:23:42.261715+0000","last_active":"2024-09-21T07:23:42.264343+0000","last_peered":"2024-09-21T07:23:42.264343+0000","last_clean":"2024-09-21T07:23:42.264343+0000","last_became_active":"2024-09-21T07:23:42.261340+0000","last_became_peered":"2024-09-21T07:23:42.261340+0000","last_unstale":"2024-09-21T07:23:42.264343+0000","last_undegraded":"2024-09-21T07:23:42.264343+0000","last_fullsized":"2024-09-21T07:23:42.264343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:03.153945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267003+0000","last_change":"2024-09-21T07:23:42.262249+0000","last_active":"2024-09-21T07:23:42.267003+0000","last_peered":"2024-09-21T07:23:42.267003+0000","last_clean":"2024-09-21T07:23:42.267003+0000","last_became_active":"2024-09-21T07:23:42.261907+0000","last_became_peered":"2024-09-21T07:23:42.261907+0000","last_unstale":"2024-09-21T07:23:42.267003+0000","last_undegraded":"2024-09-21T07:23:42.267003+0000","last_fullsized":"2024-09-21T07:23:42.267003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:17.323588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244499+0000","last_change":"2024-09-21T07:23:42.235503+0000","last_active":"2024-09-21T07:23:42.244499+0000","last_peered":"2024-09-21T07:23:42.244499+0000","last_clean":"2024-09-21T07:23:42.244499+0000","last_became_active":"2024-09-21T07:23:42.235177+0000","last_became_peered":"2024-09-21T07:23:42.235177+0000","last_unstale":"2024-09-21T07:23:42.244499+0000","last_undegraded":"2024-09-21T07:23:42.244499+0000","last_fullsized":"2024-09-21T07:23:42.244499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:14.486415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260702+0000","last_change":"2024-09-21T07:23:42.252188+0000","last_active":"2024-09-21T07:23:42.260702+0000","last_peered":"2024-09-21T07:23:42.260702+0000","last_clean":"2024-09-21T07:23:42.260702+0000","last_became_active":"2024-09-21T07:23:42.251894+0000","last_became_peered":"2024-09-21T07:23:42.251894+0000","last_unstale":"2024-09-21T07:23:42.260702+0000","last_undegraded":"2024-09-21T07:23:42.260702+0000","last_fullsized":"2024-09-21T07:23:42.260702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272159+0000","last_change":"2024-09-21T07:23:42.264397+0000","last_active":"2024-09-21T07:23:42.272159+0000","last_peered":"2024-09-21T07:23:42.272159+0000","last_clean":"2024-09-21T07:23:42.272159+0000","last_became_active":"2024-09-21T07:23:42.264043+0000","last_became_peered":"2024-09-21T07:23:42.264043+0000","last_unstale":"2024-09-21T07:23:42.272159+0000","last_undegraded":"2024-09-21T07:23:42.272159+0000","last_fullsized":"2024-09-21T07:23:42.272159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273751+0000","last_change":"2024-09-21T07:23:42.268132+0000","last_active":"2024-09-21T07:23:42.273751+0000","last_peered":"2024-09-21T07:23:42.273751+0000","last_clean":"2024-09-21T07:23:42.273751+0000","last_became_active":"2024-09-21T07:23:42.267741+0000","last_became_peered":"2024-09-21T07:23:42.267741+0000","last_unstale":"2024-09-21T07:23:42.273751+0000","last_undegraded":"2024-09-21T07:23:42.273751+0000","last_fullsized":"2024-09-21T07:23:42.273751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:31.858647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272935+0000","last_change":"2024-09-21T07:23:42.264152+0000","last_active":"2024-09-21T07:23:42.272935+0000","last_peered":"2024-09-21T07:23:42.272935+0000","last_clean":"2024-09-21T07:23:42.272935+0000","last_became_active":"2024-09-21T07:23:42.263622+0000","last_became_peered":"2024-09-21T07:23:42.263622+0000","last_unstale":"2024-09-21T07:23:42.272935+0000","last_undegraded":"2024-09-21T07:23:42.272935+0000","last_fullsized":"2024-09-21T07:23:42.272935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:31.773982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270838+0000","last_change":"2024-09-21T07:23:42.260967+0000","last_active":"2024-09-21T07:23:42.270838+0000","last_peered":"2024-09-21T07:23:42.270838+0000","last_clean":"2024-09-21T07:23:42.270838+0000","last_became_active":"2024-09-21T07:23:42.260623+0000","last_became_peered":"2024-09-21T07:23:42.260623+0000","last_unstale":"2024-09-21T07:23:42.270838+0000","last_undegraded":"2024-09-21T07:23:42.270838+0000","last_fullsized":"2024-09-21T07:23:42.270838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273838+0000","last_change":"2024-09-21T07:23:42.269480+0000","last_active":"2024-09-21T07:23:42.273838+0000","last_peered":"2024-09-21T07:23:42.273838+0000","last_clean":"2024-09-21T07:23:42.273838+0000","last_became_active":"2024-09-21T07:23:42.269068+0000","last_became_peered":"2024-09-21T07:23:42.269068+0000","last_unstale":"2024-09-21T07:23:42.273838+0000","last_undegraded":"2024-09-21T07:23:42.273838+0000","last_fullsized":"2024-09-21T07:23:42.273838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:09.553859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257689+0000","last_change":"2024-09-21T07:23:42.243029+0000","last_active":"2024-09-21T07:23:42.257689+0000","last_peered":"2024-09-21T07:23:42.257689+0000","last_clean":"2024-09-21T07:23:42.257689+0000","last_became_active":"2024-09-21T07:23:42.242668+0000","last_became_peered":"2024-09-21T07:23:42.242668+0000","last_unstale":"2024-09-21T07:23:42.257689+0000","last_undegraded":"2024-09-21T07:23:42.257689+0000","last_fullsized":"2024-09-21T07:23:42.257689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273363+0000","last_change":"2024-09-21T07:23:42.265930+0000","last_active":"2024-09-21T07:23:42.273363+0000","last_peered":"2024-09-21T07:23:42.273363+0000","last_clean":"2024-09-21T07:23:42.273363+0000","last_became_active":"2024-09-21T07:23:42.265524+0000","last_became_peered":"2024-09-21T07:23:42.265524+0000","last_unstale":"2024-09-21T07:23:42.273363+0000","last_undegraded":"2024-09-21T07:23:42.273363+0000","last_fullsized":"2024-09-21T07:23:42.273363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:06.508104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223620+0000","last_change":"2024-09-21T07:23:41.223620+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223620+0000","last_undegraded":"2024-09-21T07:23:41.223620+0000","last_fullsized":"2024-09-21T07:23:41.223620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224983+0000","last_change":"2024-09-21T07:23:41.224983+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224983+0000","last_undegraded":"2024-09-21T07:23:41.224983+0000","last_fullsized":"2024-09-21T07:23:41.224983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259279+0000","last_change":"2024-09-21T07:23:42.244851+0000","last_active":"2024-09-21T07:23:42.259279+0000","last_peered":"2024-09-21T07:23:42.259279+0000","last_clean":"2024-09-21T07:23:42.259279+0000","last_became_active":"2024-09-21T07:23:42.244491+0000","last_became_peered":"2024-09-21T07:23:42.244491+0000","last_unstale":"2024-09-21T07:23:42.259279+0000","last_undegraded":"2024-09-21T07:23:42.259279+0000","last_fullsized":"2024-09-21T07:23:42.259279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263127+0000","last_change":"2024-09-21T07:23:42.254476+0000","last_active":"2024-09-21T07:23:42.263127+0000","last_peered":"2024-09-21T07:23:42.263127+0000","last_clean":"2024-09-21T07:23:42.263127+0000","last_became_active":"2024-09-21T07:23:42.253980+0000","last_became_peered":"2024-09-21T07:23:42.253980+0000","last_unstale":"2024-09-21T07:23:42.263127+0000","last_undegraded":"2024-09-21T07:23:42.263127+0000","last_fullsized":"2024-09-21T07:23:42.263127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:27.378166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259220+0000","last_change":"2024-09-21T07:23:42.244122+0000","last_active":"2024-09-21T07:23:42.259220+0000","last_peered":"2024-09-21T07:23:42.259220+0000","last_clean":"2024-09-21T07:23:42.259220+0000","last_became_active":"2024-09-21T07:23:42.243673+0000","last_became_peered":"2024-09-21T07:23:42.243673+0000","last_unstale":"2024-09-21T07:23:42.259220+0000","last_undegraded":"2024-09-21T07:23:42.259220+0000","last_fullsized":"2024-09-21T07:23:42.259220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262576+0000","last_change":"2024-09-21T07:23:42.253068+0000","last_active":"2024-09-21T07:23:42.262576+0000","last_peered":"2024-09-21T07:23:42.262576+0000","last_clean":"2024-09-21T07:23:42.262576+0000","last_became_active":"2024-09-21T07:23:42.252729+0000","last_became_peered":"2024-09-21T07:23:42.252729+0000","last_unstale":"2024-09-21T07:23:42.262576+0000","last_undegraded":"2024-09-21T07:23:42.262576+0000","last_fullsized":"2024-09-21T07:23:42.262576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257736+0000","last_change":"2024-09-21T07:23:42.251107+0000","last_active":"2024-09-21T07:23:42.257736+0000","last_peered":"2024-09-21T07:23:42.257736+0000","last_clean":"2024-09-21T07:23:42.257736+0000","last_became_active":"2024-09-21T07:23:42.248543+0000","last_became_peered":"2024-09-21T07:23:42.248543+0000","last_unstale":"2024-09-21T07:23:42.257736+0000","last_undegraded":"2024-09-21T07:23:42.257736+0000","last_fullsized":"2024-09-21T07:23:42.257736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223840+0000","last_change":"2024-09-21T07:23:41.223840+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223840+0000","last_undegraded":"2024-09-21T07:23:41.223840+0000","last_fullsized":"2024-09-21T07:23:41.223840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266136+0000","last_change":"2024-09-21T07:23:42.263299+0000","last_active":"2024-09-21T07:23:42.266136+0000","last_peered":"2024-09-21T07:23:42.266136+0000","last_clean":"2024-09-21T07:23:42.266136+0000","last_became_active":"2024-09-21T07:23:42.259857+0000","last_became_peered":"2024-09-21T07:23:42.259857+0000","last_unstale":"2024-09-21T07:23:42.266136+0000","last_undegraded":"2024-09-21T07:23:42.266136+0000","last_fullsized":"2024-09-21T07:23:42.266136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:41.112303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259393+0000","last_change":"2024-09-21T07:23:42.255686+0000","last_active":"2024-09-21T07:23:42.259393+0000","last_peered":"2024-09-21T07:23:42.259393+0000","last_clean":"2024-09-21T07:23:42.259393+0000","last_became_active":"2024-09-21T07:23:42.255269+0000","last_became_peered":"2024-09-21T07:23:42.255269+0000","last_unstale":"2024-09-21T07:23:42.259393+0000","last_undegraded":"2024-09-21T07:23:42.259393+0000","last_fullsized":"2024-09-21T07:23:42.259393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263033+0000","last_change":"2024-09-21T07:23:42.260742+0000","last_active":"2024-09-21T07:23:42.263033+0000","last_peered":"2024-09-21T07:23:42.263033+0000","last_clean":"2024-09-21T07:23:42.263033+0000","last_became_active":"2024-09-21T07:23:42.260474+0000","last_became_peered":"2024-09-21T07:23:42.260474+0000","last_unstale":"2024-09-21T07:23:42.263033+0000","last_undegraded":"2024-09-21T07:23:42.263033+0000","last_fullsized":"2024-09-21T07:23:42.263033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:01.499156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270409+0000","last_change":"2024-09-21T07:23:42.265850+0000","last_active":"2024-09-21T07:23:42.270409+0000","last_peered":"2024-09-21T07:23:42.270409+0000","last_clean":"2024-09-21T07:23:42.270409+0000","last_became_active":"2024-09-21T07:23:42.265462+0000","last_became_peered":"2024-09-21T07:23:42.265462+0000","last_unstale":"2024-09-21T07:23:42.270409+0000","last_undegraded":"2024-09-21T07:23:42.270409+0000","last_fullsized":"2024-09-21T07:23:42.270409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264217+0000","last_change":"2024-09-21T07:23:42.258580+0000","last_active":"2024-09-21T07:23:42.264217+0000","last_peered":"2024-09-21T07:23:42.264217+0000","last_clean":"2024-09-21T07:23:42.264217+0000","last_became_active":"2024-09-21T07:23:42.258317+0000","last_became_peered":"2024-09-21T07:23:42.258317+0000","last_unstale":"2024-09-21T07:23:42.264217+0000","last_undegraded":"2024-09-21T07:23:42.264217+0000","last_fullsized":"2024-09-21T07:23:42.264217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248249+0000","last_change":"2024-09-21T07:23:42.240018+0000","last_active":"2024-09-21T07:23:42.248249+0000","last_peered":"2024-09-21T07:23:42.248249+0000","last_clean":"2024-09-21T07:23:42.248249+0000","last_became_active":"2024-09-21T07:23:42.239526+0000","last_became_peered":"2024-09-21T07:23:42.239526+0000","last_unstale":"2024-09-21T07:23:42.248249+0000","last_undegraded":"2024-09-21T07:23:42.248249+0000","last_fullsized":"2024-09-21T07:23:42.248249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:31.250437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.241461+0000","last_change":"2024-09-21T07:23:42.236369+0000","last_active":"2024-09-21T07:23:42.241461+0000","last_peered":"2024-09-21T07:23:42.241461+0000","last_clean":"2024-09-21T07:23:42.241461+0000","last_became_active":"2024-09-21T07:23:42.235993+0000","last_became_peered":"2024-09-21T07:23:42.235993+0000","last_unstale":"2024-09-21T07:23:42.241461+0000","last_undegraded":"2024-09-21T07:23:42.241461+0000","last_fullsized":"2024-09-21T07:23:42.241461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:00.022946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223010+0000","last_change":"2024-09-21T07:23:41.223010+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223010+0000","last_undegraded":"2024-09-21T07:23:41.223010+0000","last_fullsized":"2024-09-21T07:23:41.223010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.251171+0000","last_change":"2024-09-21T07:23:42.248019+0000","last_active":"2024-09-21T07:23:42.251171+0000","last_peered":"2024-09-21T07:23:42.251171+0000","last_clean":"2024-09-21T07:23:42.251171+0000","last_became_active":"2024-09-21T07:23:42.247618+0000","last_became_peered":"2024-09-21T07:23:42.247618+0000","last_unstale":"2024-09-21T07:23:42.251171+0000","last_undegraded":"2024-09-21T07:23:42.251171+0000","last_fullsized":"2024-09-21T07:23:42.251171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:45.479102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225243+0000","last_change":"2024-09-21T07:23:41.225243+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225243+0000","last_undegraded":"2024-09-21T07:23:41.225243+0000","last_fullsized":"2024-09-21T07:23:41.225243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258886+0000","last_change":"2024-09-21T07:23:41.229683+0000","last_active":"2024-09-21T07:23:42.258886+0000","last_peered":"2024-09-21T07:23:42.258886+0000","last_clean":"2024-09-21T07:23:42.258886+0000","last_became_active":"2024-09-21T07:23:41.229300+0000","last_became_peered":"2024-09-21T07:23:41.229300+0000","last_unstale":"2024-09-21T07:23:42.258886+0000","last_undegraded":"2024-09-21T07:23:42.258886+0000","last_fullsized":"2024-09-21T07:23:42.258886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.269288+0000","last_change":"2024-09-21T07:23:42.265994+0000","last_active":"2024-09-21T07:23:42.269288+0000","last_peered":"2024-09-21T07:23:42.269288+0000","last_clean":"2024-09-21T07:23:42.269288+0000","last_became_active":"2024-09-21T07:23:42.265634+0000","last_became_peered":"2024-09-21T07:23:42.265634+0000","last_unstale":"2024-09-21T07:23:42.269288+0000","last_undegraded":"2024-09-21T07:23:42.269288+0000","last_fullsized":"2024-09-21T07:23:42.269288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:35.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263151+0000","last_change":"2024-09-21T07:23:41.247293+0000","last_active":"2024-09-21T07:23:42.263151+0000","last_peered":"2024-09-21T07:23:42.263151+0000","last_clean":"2024-09-21T07:23:42.263151+0000","last_became_active":"2024-09-21T07:23:41.246932+0000","last_became_peered":"2024-09-21T07:23:41.246932+0000","last_unstale":"2024-09-21T07:23:42.263151+0000","last_undegraded":"2024-09-21T07:23:42.263151+0000","last_fullsized":"2024-09-21T07:23:42.263151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250765+0000","last_change":"2024-09-21T07:23:42.243789+0000","last_active":"2024-09-21T07:23:42.250765+0000","last_peered":"2024-09-21T07:23:42.250765+0000","last_clean":"2024-09-21T07:23:42.250765+0000","last_became_active":"2024-09-21T07:23:42.243092+0000","last_became_peered":"2024-09-21T07:23:42.243092+0000","last_unstale":"2024-09-21T07:23:42.250765+0000","last_undegraded":"2024-09-21T07:23:42.250765+0000","last_fullsized":"2024-09-21T07:23:42.250765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258710+0000","last_change":"2024-09-21T07:23:41.231067+0000","last_active":"2024-09-21T07:23:42.258710+0000","last_peered":"2024-09-21T07:23:42.258710+0000","last_clean":"2024-09-21T07:23:42.258710+0000","last_became_active":"2024-09-21T07:23:41.230264+0000","last_became_peered":"2024-09-21T07:23:41.230264+0000","last_unstale":"2024-09-21T07:23:42.258710+0000","last_undegraded":"2024-09-21T07:23:42.258710+0000","last_fullsized":"2024-09-21T07:23:42.258710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.104337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259779+0000","last_change":"2024-09-21T07:23:41.227352+0000","last_active":"2024-09-21T07:23:42.259779+0000","last_peered":"2024-09-21T07:23:42.259779+0000","last_clean":"2024-09-21T07:23:42.259779+0000","last_became_active":"2024-09-21T07:23:41.226996+0000","last_became_peered":"2024-09-21T07:23:41.226996+0000","last_unstale":"2024-09-21T07:23:42.259779+0000","last_undegraded":"2024-09-21T07:23:42.259779+0000","last_fullsized":"2024-09-21T07:23:42.259779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:41.257887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255905+0000","last_change":"2024-09-21T07:23:42.249480+0000","last_active":"2024-09-21T07:23:42.255905+0000","last_peered":"2024-09-21T07:23:42.255905+0000","last_clean":"2024-09-21T07:23:42.255905+0000","last_became_active":"2024-09-21T07:23:42.247629+0000","last_became_peered":"2024-09-21T07:23:42.247629+0000","last_unstale":"2024-09-21T07:23:42.255905+0000","last_undegraded":"2024-09-21T07:23:42.255905+0000","last_fullsized":"2024-09-21T07:23:42.255905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273876+0000","last_change":"2024-09-21T07:23:41.247247+0000","last_active":"2024-09-21T07:23:42.273876+0000","last_peered":"2024-09-21T07:23:42.273876+0000","last_clean":"2024-09-21T07:23:42.273876+0000","last_became_active":"2024-09-21T07:23:41.246933+0000","last_became_peered":"2024-09-21T07:23:41.246933+0000","last_unstale":"2024-09-21T07:23:42.273876+0000","last_undegraded":"2024-09-21T07:23:42.273876+0000","last_fullsized":"2024-09-21T07:23:42.273876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:24.210839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262611+0000","last_change":"2024-09-21T07:23:42.257399+0000","last_active":"2024-09-21T07:23:42.262611+0000","last_peered":"2024-09-21T07:23:42.262611+0000","last_clean":"2024-09-21T07:23:42.262611+0000","last_became_active":"2024-09-21T07:23:42.253176+0000","last_became_peered":"2024-09-21T07:23:42.253176+0000","last_unstale":"2024-09-21T07:23:42.262611+0000","last_undegraded":"2024-09-21T07:23:42.262611+0000","last_fullsized":"2024-09-21T07:23:42.262611+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246291+0000","last_change":"2024-09-21T07:23:41.241248+0000","last_active":"2024-09-21T07:23:41.246291+0000","last_peered":"2024-09-21T07:23:41.246291+0000","last_clean":"2024-09-21T07:23:41.246291+0000","last_became_active":"2024-09-21T07:23:41.239401+0000","last_became_peered":"2024-09-21T07:23:41.239401+0000","last_unstale":"2024-09-21T07:23:41.246291+0000","last_undegraded":"2024-09-21T07:23:41.246291+0000","last_fullsized":"2024-09-21T07:23:41.246291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:26.534321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262884+0000","last_change":"2024-09-21T07:23:42.257444+0000","last_active":"2024-09-21T07:23:42.262884+0000","last_peered":"2024-09-21T07:23:42.262884+0000","last_clean":"2024-09-21T07:23:42.262884+0000","last_became_active":"2024-09-21T07:23:42.257148+0000","last_became_peered":"2024-09-21T07:23:42.257148+0000","last_unstale":"2024-09-21T07:23:42.262884+0000","last_undegraded":"2024-09-21T07:23:42.262884+0000","last_fullsized":"2024-09-21T07:23:42.262884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229192+0000","last_change":"2024-09-21T07:23:41.241097+0000","last_active":"2024-09-21T07:23:42.229192+0000","last_peered":"2024-09-21T07:23:42.229192+0000","last_clean":"2024-09-21T07:23:42.229192+0000","last_became_active":"2024-09-21T07:23:41.240725+0000","last_became_peered":"2024-09-21T07:23:41.240725+0000","last_unstale":"2024-09-21T07:23:42.229192+0000","last_undegraded":"2024-09-21T07:23:42.229192+0000","last_fullsized":"2024-09-21T07:23:42.229192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:55.998354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.232757+0000","last_change":"2024-09-21T07:23:41.224843+0000","last_active":"2024-09-21T07:23:42.232757+0000","last_peered":"2024-09-21T07:23:42.232757+0000","last_clean":"2024-09-21T07:23:42.232757+0000","last_became_active":"2024-09-21T07:23:41.224463+0000","last_became_peered":"2024-09-21T07:23:41.224463+0000","last_unstale":"2024-09-21T07:23:42.232757+0000","last_undegraded":"2024-09-21T07:23:42.232757+0000","last_fullsized":"2024-09-21T07:23:42.232757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264316+0000","last_change":"2024-09-21T07:23:42.259678+0000","last_active":"2024-09-21T07:23:42.264316+0000","last_peered":"2024-09-21T07:23:42.264316+0000","last_clean":"2024-09-21T07:23:42.264316+0000","last_became_active":"2024-09-21T07:23:42.259361+0000","last_became_peered":"2024-09-21T07:23:42.259361+0000","last_unstale":"2024-09-21T07:23:42.264316+0000","last_undegraded":"2024-09-21T07:23:42.264316+0000","last_fullsized":"2024-09-21T07:23:42.264316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:41.188911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212636+0000","last_change":"2024-09-21T07:23:40.212636+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212636+0000","last_undegraded":"2024-09-21T07:23:40.212636+0000","last_fullsized":"2024-09-21T07:23:40.212636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.226421+0000","last_change":"2024-09-21T07:23:41.226421+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.226421+0000","last_undegraded":"2024-09-21T07:23:41.226421+0000","last_fullsized":"2024-09-21T07:23:41.226421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248668+0000","last_change":"2024-09-21T07:23:41.245321+0000","last_active":"2024-09-21T07:23:42.248668+0000","last_peered":"2024-09-21T07:23:42.248668+0000","last_clean":"2024-09-21T07:23:42.248668+0000","last_became_active":"2024-09-21T07:23:41.244908+0000","last_became_peered":"2024-09-21T07:23:41.244908+0000","last_unstale":"2024-09-21T07:23:42.248668+0000","last_undegraded":"2024-09-21T07:23:42.248668+0000","last_fullsized":"2024-09-21T07:23:42.248668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:18.079641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271330+0000","last_change":"2024-09-21T07:23:42.255482+0000","last_active":"2024-09-21T07:23:42.271330+0000","last_peered":"2024-09-21T07:23:42.271330+0000","last_clean":"2024-09-21T07:23:42.271330+0000","last_became_active":"2024-09-21T07:23:42.255181+0000","last_became_peered":"2024-09-21T07:23:42.255181+0000","last_unstale":"2024-09-21T07:23:42.271330+0000","last_undegraded":"2024-09-21T07:23:42.271330+0000","last_fullsized":"2024-09-21T07:23:42.271330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275341+0000","last_change":"2024-09-21T07:23:41.241070+0000","last_active":"2024-09-21T07:23:42.275341+0000","last_peered":"2024-09-21T07:23:42.275341+0000","last_clean":"2024-09-21T07:23:42.275341+0000","last_became_active":"2024-09-21T07:23:41.240700+0000","last_became_peered":"2024-09-21T07:23:41.240700+0000","last_unstale":"2024-09-21T07:23:42.275341+0000","last_undegraded":"2024-09-21T07:23:42.275341+0000","last_fullsized":"2024-09-21T07:23:42.275341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:38.885316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270159+0000","last_change":"2024-09-21T07:23:42.267128+0000","last_active":"2024-09-21T07:23:42.270159+0000","last_peered":"2024-09-21T07:23:42.270159+0000","last_clean":"2024-09-21T07:23:42.270159+0000","last_became_active":"2024-09-21T07:23:42.266152+0000","last_became_peered":"2024-09-21T07:23:42.266152+0000","last_unstale":"2024-09-21T07:23:42.270159+0000","last_undegraded":"2024-09-21T07:23:42.270159+0000","last_fullsized":"2024-09-21T07:23:42.270159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212213+0000","last_change":"2024-09-21T07:23:40.212213+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212213+0000","last_undegraded":"2024-09-21T07:23:40.212213+0000","last_fullsized":"2024-09-21T07:23:40.212213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271104+0000","last_change":"2024-09-21T07:23:42.264392+0000","last_active":"2024-09-21T07:23:42.271104+0000","last_peered":"2024-09-21T07:23:42.271104+0000","last_clean":"2024-09-21T07:23:42.271104+0000","last_became_active":"2024-09-21T07:23:42.264071+0000","last_became_peered":"2024-09-21T07:23:42.264071+0000","last_unstale":"2024-09-21T07:23:42.271104+0000","last_undegraded":"2024-09-21T07:23:42.271104+0000","last_fullsized":"2024-09-21T07:23:42.271104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212240+0000","last_change":"2024-09-21T07:23:40.212240+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212240+0000","last_undegraded":"2024-09-21T07:23:40.212240+0000","last_fullsized":"2024-09-21T07:23:40.212240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229859+0000","last_change":"2024-09-21T07:23:41.237332+0000","last_active":"2024-09-21T07:23:42.229859+0000","last_peered":"2024-09-21T07:23:42.229859+0000","last_clean":"2024-09-21T07:23:42.229859+0000","last_became_active":"2024-09-21T07:23:41.236953+0000","last_became_peered":"2024-09-21T07:23:41.236953+0000","last_unstale":"2024-09-21T07:23:42.229859+0000","last_undegraded":"2024-09-21T07:23:42.229859+0000","last_fullsized":"2024-09-21T07:23:42.229859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:43.800815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.224255+0000","last_change":"2024-09-21T07:23:41.224255+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.224255+0000","last_undegraded":"2024-09-21T07:23:41.224255+0000","last_fullsized":"2024-09-21T07:23:41.224255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227550+0000","last_change":"2024-09-21T07:23:41.228019+0000","last_active":"2024-09-21T07:23:42.227550+0000","last_peered":"2024-09-21T07:23:42.227550+0000","last_clean":"2024-09-21T07:23:42.227550+0000","last_became_active":"2024-09-21T07:23:41.227689+0000","last_became_peered":"2024-09-21T07:23:41.227689+0000","last_unstale":"2024-09-21T07:23:42.227550+0000","last_undegraded":"2024-09-21T07:23:42.227550+0000","last_fullsized":"2024-09-21T07:23:42.227550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:20.597221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247129+0000","last_change":"2024-09-21T07:23:41.242205+0000","last_active":"2024-09-21T07:23:41.247129+0000","last_peered":"2024-09-21T07:23:41.247129+0000","last_clean":"2024-09-21T07:23:41.247129+0000","last_became_active":"2024-09-21T07:23:41.240901+0000","last_became_peered":"2024-09-21T07:23:41.240901+0000","last_unstale":"2024-09-21T07:23:41.247129+0000","last_undegraded":"2024-09-21T07:23:41.247129+0000","last_fullsized":"2024-09-21T07:23:41.247129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:58.235388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273926+0000","last_change":"2024-09-21T07:23:41.241933+0000","last_active":"2024-09-21T07:23:42.273926+0000","last_peered":"2024-09-21T07:23:42.273926+0000","last_clean":"2024-09-21T07:23:42.273926+0000","last_became_active":"2024-09-21T07:23:41.241652+0000","last_became_peered":"2024-09-21T07:23:41.241652+0000","last_unstale":"2024-09-21T07:23:42.273926+0000","last_undegraded":"2024-09-21T07:23:42.273926+0000","last_fullsized":"2024-09-21T07:23:42.273926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:33.390195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267929+0000","last_change":"2024-09-21T07:23:42.261384+0000","last_active":"2024-09-21T07:23:42.267929+0000","last_peered":"2024-09-21T07:23:42.267929+0000","last_clean":"2024-09-21T07:23:42.267929+0000","last_became_active":"2024-09-21T07:23:42.260641+0000","last_became_peered":"2024-09-21T07:23:42.260641+0000","last_unstale":"2024-09-21T07:23:42.267929+0000","last_undegraded":"2024-09-21T07:23:42.267929+0000","last_fullsized":"2024-09-21T07:23:42.267929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266558+0000","last_change":"2024-09-21T07:23:41.238947+0000","last_active":"2024-09-21T07:23:42.266558+0000","last_peered":"2024-09-21T07:23:42.266558+0000","last_clean":"2024-09-21T07:23:42.266558+0000","last_became_active":"2024-09-21T07:23:41.238569+0000","last_became_peered":"2024-09-21T07:23:41.238569+0000","last_unstale":"2024-09-21T07:23:42.266558+0000","last_undegraded":"2024-09-21T07:23:42.266558+0000","last_fullsized":"2024-09-21T07:23:42.266558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250792+0000","last_change":"2024-09-21T07:23:42.244113+0000","last_active":"2024-09-21T07:23:42.250792+0000","last_peered":"2024-09-21T07:23:42.250792+0000","last_clean":"2024-09-21T07:23:42.250792+0000","last_became_active":"2024-09-21T07:23:42.243505+0000","last_became_peered":"2024-09-21T07:23:42.243505+0000","last_unstale":"2024-09-21T07:23:42.250792+0000","last_undegraded":"2024-09-21T07:23:42.250792+0000","last_fullsized":"2024-09-21T07:23:42.250792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271049+0000","last_change":"2024-09-21T07:23:41.239340+0000","last_active":"2024-09-21T07:23:42.271049+0000","last_peered":"2024-09-21T07:23:42.271049+0000","last_clean":"2024-09-21T07:23:42.271049+0000","last_became_active":"2024-09-21T07:23:41.238977+0000","last_became_peered":"2024-09-21T07:23:41.238977+0000","last_unstale":"2024-09-21T07:23:42.271049+0000","last_undegraded":"2024-09-21T07:23:42.271049+0000","last_fullsized":"2024-09-21T07:23:42.271049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.265190+0000","last_change":"2024-09-21T07:23:42.258030+0000","last_active":"2024-09-21T07:23:42.265190+0000","last_peered":"2024-09-21T07:23:42.265190+0000","last_clean":"2024-09-21T07:23:42.265190+0000","last_became_active":"2024-09-21T07:23:42.256792+0000","last_became_peered":"2024-09-21T07:23:42.256792+0000","last_unstale":"2024-09-21T07:23:42.265190+0000","last_undegraded":"2024-09-21T07:23:42.265190+0000","last_fullsized":"2024-09-21T07:23:42.265190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:27.750378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.230439+0000","last_change":"2024-09-21T07:23:41.244419+0000","last_active":"2024-09-21T07:23:42.230439+0000","last_peered":"2024-09-21T07:23:42.230439+0000","last_clean":"2024-09-21T07:23:42.230439+0000","last_became_active":"2024-09-21T07:23:41.242477+0000","last_became_peered":"2024-09-21T07:23:41.242477+0000","last_unstale":"2024-09-21T07:23:42.230439+0000","last_undegraded":"2024-09-21T07:23:42.230439+0000","last_fullsized":"2024-09-21T07:23:42.230439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.513475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.223011+0000","last_change":"2024-09-21T07:23:41.223011+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.223011+0000","last_undegraded":"2024-09-21T07:23:41.223011+0000","last_fullsized":"2024-09-21T07:23:41.223011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272824+0000","last_change":"2024-09-21T07:23:41.249080+0000","last_active":"2024-09-21T07:23:42.272824+0000","last_peered":"2024-09-21T07:23:42.272824+0000","last_clean":"2024-09-21T07:23:42.272824+0000","last_became_active":"2024-09-21T07:23:41.247666+0000","last_became_peered":"2024-09-21T07:23:41.247666+0000","last_unstale":"2024-09-21T07:23:42.272824+0000","last_undegraded":"2024-09-21T07:23:42.272824+0000","last_fullsized":"2024-09-21T07:23:42.272824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.522254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255013+0000","last_change":"2024-09-21T07:23:42.248515+0000","last_active":"2024-09-21T07:23:42.255013+0000","last_peered":"2024-09-21T07:23:42.255013+0000","last_clean":"2024-09-21T07:23:42.255013+0000","last_became_active":"2024-09-21T07:23:42.248201+0000","last_became_peered":"2024-09-21T07:23:42.248201+0000","last_unstale":"2024-09-21T07:23:42.255013+0000","last_undegraded":"2024-09-21T07:23:42.255013+0000","last_fullsized":"2024-09-21T07:23:42.255013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260553+0000","last_change":"2024-09-21T07:23:41.238957+0000","last_active":"2024-09-21T07:23:42.260553+0000","last_peered":"2024-09-21T07:23:42.260553+0000","last_clean":"2024-09-21T07:23:42.260553+0000","last_became_active":"2024-09-21T07:23:41.237652+0000","last_became_peered":"2024-09-21T07:23:41.237652+0000","last_unstale":"2024-09-21T07:23:42.260553+0000","last_undegraded":"2024-09-21T07:23:42.260553+0000","last_fullsized":"2024-09-21T07:23:42.260553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:32.394414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260093+0000","last_change":"2024-09-21T07:23:42.250508+0000","last_active":"2024-09-21T07:23:42.260093+0000","last_peered":"2024-09-21T07:23:42.260093+0000","last_clean":"2024-09-21T07:23:42.260093+0000","last_became_active":"2024-09-21T07:23:42.249128+0000","last_became_peered":"2024-09-21T07:23:42.249128+0000","last_unstale":"2024-09-21T07:23:42.260093+0000","last_undegraded":"2024-09-21T07:23:42.260093+0000","last_fullsized":"2024-09-21T07:23:42.260093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.247367+0000","last_change":"2024-09-21T07:23:41.242637+0000","last_active":"2024-09-21T07:23:41.247367+0000","last_peered":"2024-09-21T07:23:41.247367+0000","last_clean":"2024-09-21T07:23:41.247367+0000","last_became_active":"2024-09-21T07:23:41.242213+0000","last_became_peered":"2024-09-21T07:23:41.242213+0000","last_unstale":"2024-09-21T07:23:41.247367+0000","last_undegraded":"2024-09-21T07:23:41.247367+0000","last_fullsized":"2024-09-21T07:23:41.247367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:53.092717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259605+0000","last_change":"2024-09-21T07:23:41.234226+0000","last_active":"2024-09-21T07:23:42.259605+0000","last_peered":"2024-09-21T07:23:42.259605+0000","last_clean":"2024-09-21T07:23:42.259605+0000","last_became_active":"2024-09-21T07:23:41.233924+0000","last_became_peered":"2024-09-21T07:23:41.233924+0000","last_unstale":"2024-09-21T07:23:42.259605+0000","last_undegraded":"2024-09-21T07:23:42.259605+0000","last_fullsized":"2024-09-21T07:23:42.259605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:29.309397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.261026+0000","last_change":"2024-09-21T07:23:42.259554+0000","last_active":"2024-09-21T07:23:42.261026+0000","last_peered":"2024-09-21T07:23:42.261026+0000","last_clean":"2024-09-21T07:23:42.261026+0000","last_became_active":"2024-09-21T07:23:42.259038+0000","last_became_peered":"2024-09-21T07:23:42.259038+0000","last_unstale":"2024-09-21T07:23:42.261026+0000","last_undegraded":"2024-09-21T07:23:42.261026+0000","last_fullsized":"2024-09-21T07:23:42.261026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:47.530038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275084+0000","last_change":"2024-09-21T07:23:41.240831+0000","last_active":"2024-09-21T07:23:42.275084+0000","last_peered":"2024-09-21T07:23:42.275084+0000","last_clean":"2024-09-21T07:23:42.275084+0000","last_became_active":"2024-09-21T07:23:41.240462+0000","last_became_peered":"2024-09-21T07:23:41.240462+0000","last_unstale":"2024-09-21T07:23:42.275084+0000","last_undegraded":"2024-09-21T07:23:42.275084+0000","last_fullsized":"2024-09-21T07:23:42.275084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225825+0000","last_change":"2024-09-21T07:23:41.225825+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225825+0000","last_undegraded":"2024-09-21T07:23:41.225825+0000","last_fullsized":"2024-09-21T07:23:41.225825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263649+0000","last_change":"2024-09-21T07:23:41.238080+0000","last_active":"2024-09-21T07:23:42.263649+0000","last_peered":"2024-09-21T07:23:42.263649+0000","last_clean":"2024-09-21T07:23:42.263649+0000","last_became_active":"2024-09-21T07:23:41.237839+0000","last_became_peered":"2024-09-21T07:23:41.237839+0000","last_unstale":"2024-09-21T07:23:42.263649+0000","last_undegraded":"2024-09-21T07:23:42.263649+0000","last_fullsized":"2024-09-21T07:23:42.263649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:20.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:23:41.207784+0000","last_change":"2024-09-21T07:23:41.207784+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.207784+0000","last_undegraded":"2024-09-21T07:23:41.207784+0000","last_fullsized":"2024-09-21T07:23:41.207784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.245885+0000","last_change":"2024-09-21T07:23:41.242064+0000","last_active":"2024-09-21T07:23:42.245885+0000","last_peered":"2024-09-21T07:23:42.245885+0000","last_clean":"2024-09-21T07:23:42.245885+0000","last_became_active":"2024-09-21T07:23:41.241745+0000","last_became_peered":"2024-09-21T07:23:41.241745+0000","last_unstale":"2024-09-21T07:23:42.245885+0000","last_undegraded":"2024-09-21T07:23:42.245885+0000","last_fullsized":"2024-09-21T07:23:42.245885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255934+0000","last_change":"2024-09-21T07:23:42.249809+0000","last_active":"2024-09-21T07:23:42.255934+0000","last_peered":"2024-09-21T07:23:42.255934+0000","last_clean":"2024-09-21T07:23:42.255934+0000","last_became_active":"2024-09-21T07:23:42.249220+0000","last_became_peered":"2024-09-21T07:23:42.249220+0000","last_unstale":"2024-09-21T07:23:42.255934+0000","last_undegraded":"2024-09-21T07:23:42.255934+0000","last_fullsized":"2024-09-21T07:23:42.255934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.242562+0000","last_change":"2024-09-21T07:23:41.246426+0000","last_active":"2024-09-21T07:23:42.242562+0000","last_peered":"2024-09-21T07:23:42.242562+0000","last_clean":"2024-09-21T07:23:42.242562+0000","last_became_active":"2024-09-21T07:23:41.246065+0000","last_became_peered":"2024-09-21T07:23:41.246065+0000","last_unstale":"2024-09-21T07:23:42.242562+0000","last_undegraded":"2024-09-21T07:23:42.242562+0000","last_fullsized":"2024-09-21T07:23:42.242562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244404+0000","last_change":"2024-09-21T07:23:42.235716+0000","last_active":"2024-09-21T07:23:42.244404+0000","last_peered":"2024-09-21T07:23:42.244404+0000","last_clean":"2024-09-21T07:23:42.244404+0000","last_became_active":"2024-09-21T07:23:42.235427+0000","last_became_peered":"2024-09-21T07:23:42.235427+0000","last_unstale":"2024-09-21T07:23:42.244404+0000","last_undegraded":"2024-09-21T07:23:42.244404+0000","last_fullsized":"2024-09-21T07:23:42.244404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.239587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227834+0000","last_change":"2024-09-21T07:23:41.247133+0000","last_active":"2024-09-21T07:23:42.227834+0000","last_peered":"2024-09-21T07:23:42.227834+0000","last_clean":"2024-09-21T07:23:42.227834+0000","last_became_active":"2024-09-21T07:23:41.246822+0000","last_became_peered":"2024-09-21T07:23:41.246822+0000","last_unstale":"2024-09-21T07:23:42.227834+0000","last_undegraded":"2024-09-21T07:23:42.227834+0000","last_fullsized":"2024-09-21T07:23:42.227834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:27.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257714+0000","last_change":"2024-09-21T07:23:42.245651+0000","last_active":"2024-09-21T07:23:42.257714+0000","last_peered":"2024-09-21T07:23:42.257714+0000","last_clean":"2024-09-21T07:23:42.257714+0000","last_became_active":"2024-09-21T07:23:42.245299+0000","last_became_peered":"2024-09-21T07:23:42.245299+0000","last_unstale":"2024-09-21T07:23:42.257714+0000","last_undegraded":"2024-09-21T07:23:42.257714+0000","last_fullsized":"2024-09-21T07:23:42.257714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.233440+0000","last_change":"2024-09-21T07:23:41.227126+0000","last_active":"2024-09-21T07:23:42.233440+0000","last_peered":"2024-09-21T07:23:42.233440+0000","last_clean":"2024-09-21T07:23:42.233440+0000","last_became_active":"2024-09-21T07:23:41.226786+0000","last_became_peered":"2024-09-21T07:23:41.226786+0000","last_unstale":"2024-09-21T07:23:42.233440+0000","last_undegraded":"2024-09-21T07:23:42.233440+0000","last_fullsized":"2024-09-21T07:23:42.233440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-21T07:23:41.225876+0000","last_change":"2024-09-21T07:23:41.225876+0000","last_active":"2024-09-21T07:23:41.207784+0000","last_peered":"2024-09-21T07:23:41.207784+0000","last_clean":"2024-09-21T07:23:41.207784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:41.225876+0000","last_undegraded":"2024-09-21T07:23:41.225876+0000","last_fullsized":"2024-09-21T07:23:41.225876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-21T07:23:40.212196+0000","last_change":"2024-09-21T07:23:40.212196+0000","last_active":"2024-09-21T07:23:40.199136+0000","last_peered":"2024-09-21T07:23:40.199136+0000","last_clean":"2024-09-21T07:23:40.199136+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:23:40.212196+0000","last_undegraded":"2024-09-21T07:23:40.212196+0000","last_fullsized":"2024-09-21T07:23:40.212196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267870+0000","last_change":"2024-09-21T07:23:42.260141+0000","last_active":"2024-09-21T07:23:42.267870+0000","last_peered":"2024-09-21T07:23:42.267870+0000","last_clean":"2024-09-21T07:23:42.267870+0000","last_became_active":"2024-09-21T07:23:42.259782+0000","last_became_peered":"2024-09-21T07:23:42.259782+0000","last_unstale":"2024-09-21T07:23:42.267870+0000","last_undegraded":"2024-09-21T07:23:42.267870+0000","last_fullsized":"2024-09-21T07:23:42.267870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.246426+0000","last_change":"2024-09-21T07:23:41.241484+0000","last_active":"2024-09-21T07:23:41.246426+0000","last_peered":"2024-09-21T07:23:41.246426+0000","last_clean":"2024-09-21T07:23:41.246426+0000","last_became_active":"2024-09-21T07:23:41.241073+0000","last_became_peered":"2024-09-21T07:23:41.241073+0000","last_unstale":"2024-09-21T07:23:41.246426+0000","last_undegraded":"2024-09-21T07:23:41.246426+0000","last_fullsized":"2024-09-21T07:23:41.246426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:44.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:23:41.229988+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:23:41.229988+0000","last_peered":"2024-09-21T07:23:41.229988+0000","last_clean":"2024-09-21T07:23:41.229988+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:23:41.229988+0000","last_undegraded":"2024-09-21T07:23:41.229988+0000","last_fullsized":"2024-09-21T07:23:41.229988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:47.286 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.223620+0000', 'last_change': '2024-09-21T07:23:41.223620+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.223620+0000', 'last_undegraded': '2024-09-21T07:23:41.223620+0000', 'last_fullsized': '2024-09-21T07:23:41.223620+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.224983+0000', 'last_change': '2024-09-21T07:23:41.224983+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.224983+0000', 'last_undegraded': '2024-09-21T07:23:41.224983+0000', 'last_fullsized': '2024-09-21T07:23:41.224983+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.287 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.223840+0000', 'last_change': '2024-09-21T07:23:41.223840+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.223840+0000', 'last_undegraded': '2024-09-21T07:23:41.223840+0000', 'last_fullsized': '2024-09-21T07:23:41.223840+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.223010+0000', 'last_change': '2024-09-21T07:23:41.223010+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.223010+0000', 'last_undegraded': '2024-09-21T07:23:41.223010+0000', 'last_fullsized': '2024-09-21T07:23:41.223010+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.225243+0000', 'last_change': '2024-09-21T07:23:41.225243+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.225243+0000', 'last_undegraded': '2024-09-21T07:23:41.225243+0000', 'last_fullsized': '2024-09-21T07:23:41.225243+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.288 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:40.212636+0000', 'last_change': '2024-09-21T07:23:40.212636+0000', 'last_active': '2024-09-21T07:23:40.199136+0000', 'last_peered': '2024-09-21T07:23:40.199136+0000', 'last_clean': '2024-09-21T07:23:40.199136+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:40.212636+0000', 'last_undegraded': '2024-09-21T07:23:40.212636+0000', 'last_fullsized': '2024-09-21T07:23:40.212636+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.226421+0000', 'last_change': '2024-09-21T07:23:41.226421+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.226421+0000', 'last_undegraded': '2024-09-21T07:23:41.226421+0000', 'last_fullsized': '2024-09-21T07:23:41.226421+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:40.212213+0000', 'last_change': '2024-09-21T07:23:40.212213+0000', 'last_active': '2024-09-21T07:23:40.199136+0000', 'last_peered': '2024-09-21T07:23:40.199136+0000', 'last_clean': '2024-09-21T07:23:40.199136+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:40.212213+0000', 'last_undegraded': '2024-09-21T07:23:40.212213+0000', 'last_fullsized': '2024-09-21T07:23:40.212213+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-21T07:23:47.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:40.212240+0000', 'last_change': '2024-09-21T07:23:40.212240+0000', 'last_active': '2024-09-21T07:23:40.199136+0000', 'last_peered': '2024-09-21T07:23:40.199136+0000', 'last_clean': '2024-09-21T07:23:40.199136+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:40.212240+0000', 'last_undegraded': '2024-09-21T07:23:40.212240+0000', 'last_fullsized': '2024-09-21T07:23:40.212240+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.224255+0000', 'last_change': '2024-09-21T07:23:41.224255+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.224255+0000', 'last_undegraded': '2024-09-21T07:23:41.224255+0000', 'last_fullsized': '2024-09-21T07:23:41.224255+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.223011+0000', 'last_change': '2024-09-21T07:23:41.223011+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.223011+0000', 'last_undegraded': '2024-09-21T07:23:41.223011+0000', 'last_fullsized': '2024-09-21T07:23:41.223011+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-21T07:23:47.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.225825+0000', 'last_change': '2024-09-21T07:23:41.225825+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.225825+0000', 'last_undegraded': '2024-09-21T07:23:41.225825+0000', 'last_fullsized': '2024-09-21T07:23:41.225825+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:23:41.207784+0000', 'last_change': '2024-09-21T07:23:41.207784+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.207784+0000', 'last_undegraded': '2024-09-21T07:23:41.207784+0000', 'last_fullsized': '2024-09-21T07:23:41.207784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:41.225876+0000', 'last_change': '2024-09-21T07:23:41.225876+0000', 'last_active': '2024-09-21T07:23:41.207784+0000', 'last_peered': '2024-09-21T07:23:41.207784+0000', 'last_clean': '2024-09-21T07:23:41.207784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:41.225876+0000', 'last_undegraded': '2024-09-21T07:23:41.225876+0000', 'last_fullsized': '2024-09-21T07:23:41.225876+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:41.207784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-21T07:23:47.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:23:40.212196+0000', 'last_change': '2024-09-21T07:23:40.212196+0000', 'last_active': '2024-09-21T07:23:40.199136+0000', 'last_peered': '2024-09-21T07:23:40.199136+0000', 'last_clean': '2024-09-21T07:23:40.199136+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:23:40.212196+0000', 'last_undegraded': '2024-09-21T07:23:40.212196+0000', 'last_fullsized': '2024-09-21T07:23:40.212196+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'last_clean_scrub_stamp': '2024-09-21T07:23:40.199136+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:23:47.292 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:23:47.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 -- 172.21.15.64:0/890486665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a8003cb0 msgr2=0x7fe2a8004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 --2- 172.21.15.64:0/890486665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a8003cb0 0x7fe2a8004100 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009b40 tx=0x7fe2b401d220 comp rx=0 tx=0).stop 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 -- 172.21.15.64:0/890486665 shutdown_connections 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 --2- 172.21.15.64:0/890486665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a8003cb0 0x7fe2a8004100 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 -- 172.21.15.64:0/890486665 >> 172.21.15.64:0/890486665 conn(0x7fe2c00ccbe0 msgr2=0x7fe2c00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 -- 172.21.15.64:0/890486665 shutdown_connections 2024-09-21T07:23:47.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.479+0000 7fe2c8600640 1 -- 172.21.15.64:0/890486665 wait complete. 2024-09-21T07:23:47.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 Processor -- start 2024-09-21T07:23:47.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- start start 2024-09-21T07:23:47.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2a8003cb0 0x7fe2c015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00c94a0 0x7fe2c00c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00cc790 con 0x7fe2c015ee30 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00cc610 con 0x7fe2c00c94a0 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c00cc910 con 0x7fe2a8003cb0 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38926/0 (socket says 172.21.15.64:38926) 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 -- 172.21.15.64:0/3949718742 learned_addr learned my addr 172.21.15.64:0/3949718742 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5c00640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2a8003cb0 0x7fe2c015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c6600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00c94a0 0x7fe2c00c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 -- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2a8003cb0 msgr2=0x7fe2c015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2a8003cb0 0x7fe2c015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 -- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00c94a0 msgr2=0x7fe2c00c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00c94a0 0x7fe2c00c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 -- 172.21.15.64:0/3949718742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c00c9df0 con 0x7fe2c015ee30 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c5200640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac003e20 tx=0x7fe2ac001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac015070 con 0x7fe2c015ee30 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2ac011900 con 0x7fe2c015ee30 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac011d50 con 0x7fe2c015ee30 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c015f580 con 0x7fe2c015ee30 2024-09-21T07:23:47.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.483+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c00cf360 con 0x7fe2c015ee30 2024-09-21T07:23:47.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.487+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c006f040 con 0x7fe2c015ee30 2024-09-21T07:23:47.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.487+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe2ac018070 con 0x7fe2c015ee30 2024-09-21T07:23:47.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.487+0000 7fe2bd600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.487+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe2ac094ff0 con 0x7fe2c015ee30 2024-09-21T07:23:47.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.487+0000 7fe2c5c00640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.491+0000 7fe2c5c00640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ad000 tx=0x7fe2b4019fc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.491+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe2c00c9df0 con 0x7fe2c015ee30 2024-09-21T07:23:47.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.731+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe2c00b2990 con 0x7fe2c015ee30 2024-09-21T07:23:47.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.731+0000 7fe2bd600640 1 -- 172.21.15.64:0/3949718742 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1763 (secure 0 0 0) 0x7fe2ac05f860 con 0x7fe2c015ee30 2024-09-21T07:23:47.734 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:47.735 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":85,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":14},{"state_name":"unknown","count":10}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591132,"bytes_used":226062336,"bytes_avail":772868050944,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":784,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":18,"btime":"2024-09-21T07:23:45:252778+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4932}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-21T07:23:39.430027+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 msgr2=0x7fe2a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ad000 tx=0x7fe2b4019fc0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 msgr2=0x7fe2c0155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac003e20 tx=0x7fe2ac001810 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 shutdown_connections 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00c94a0 0x7fe2c00c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c015ee30 0x7fe2c0155160 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 --2- 172.21.15.64:0/3949718742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2a8003cb0 0x7fe2c015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 >> 172.21.15.64:0/3949718742 conn(0x7fe2c00ccbe0 msgr2=0x7fe2c0072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 shutdown_connections 2024-09-21T07:23:47.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.735+0000 7fe2c8600640 1 -- 172.21.15.64:0/3949718742 wait complete. 2024-09-21T07:23:47.757 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:23:47.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:47.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 -- 172.21.15.64:0/3131432785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0c5ea0 msgr2=0x7ff6ec0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 --2- 172.21.15.64:0/3131432785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec0c62b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec06dda0 tx=0x7ff6e401ccc0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 -- 172.21.15.64:0/3131432785 shutdown_connections 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 --2- 172.21.15.64:0/3131432785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec0c62b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 --2- 172.21.15.64:0/3131432785 >> v2:172.21.15.90:3300/0 conn(0x7ff6ec0d1d00 0x7ff6ec0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 -- 172.21.15.64:0/3131432785 >> 172.21.15.64:0/3131432785 conn(0x7ff6ec06d1c0 msgr2=0x7ff6ec06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 -- 172.21.15.64:0/3131432785 shutdown_connections 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.911+0000 7ff6f2000640 1 -- 172.21.15.64:0/3131432785 wait complete. 2024-09-21T07:23:47.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 Processor -- start 2024-09-21T07:23:47.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 -- start start 2024-09-21T07:23:47.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6ec0b3d60 0x7ff6ec0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec1f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec169e60 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec169ce0 con 0x7ff6ec0c5ea0 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6f2000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec169fe0 con 0x7ff6ec0b3d60 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38944/0 (socket says 172.21.15.64:38944) 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 -- 172.21.15.64:0/2523721167 learned_addr learned my addr 172.21.15.64:0/2523721167 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6e2a00640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec1f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6eb400640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6ec0b3d60 0x7ff6ec0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 -- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6ec0b3d60 msgr2=0x7ff6ec0b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6ec0b3d60 0x7ff6ec0b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 -- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6ec0c5ea0 msgr2=0x7ff6ec1f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec1f84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.915+0000 7ff6ebe00640 1 -- 172.21.15.64:0/2523721167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0b82b0 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6ebe00640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40198d0 tx=0x7ff6e4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40bc070 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e4004330 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40b2040 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec06e9b0 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec06ef30 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec0c62b0 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff6e40ad440 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 0x7ff6c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:47.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff6e412e390 con 0x7ff6ec0d1d00 2024-09-21T07:23:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.919+0000 7ff6eb400640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 0x7ff6c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.923+0000 7ff6eb400640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 0x7ff6c8075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc004630 tx=0x7ff6dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:47.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:47.923+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff6ec06e9b0 con 0x7ff6ec0d1d00 2024-09-21T07:23:48.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.099+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6ec0c5b20 con 0x7ff6c8073200 2024-09-21T07:23:48.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.103+0000 7ff6e3e00640 1 -- 172.21.15.64:0/2523721167 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7ff6ec0c5b20 con 0x7ff6c8073200 2024-09-21T07:23:48.109 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 msgr2=0x7ff6c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 0x7ff6c8075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc004630 tx=0x7ff6dc00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 msgr2=0x7ff6ec15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40198d0 tx=0x7ff6e4005b10 comp rx=0 tx=0).stop 2024-09-21T07:23:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 shutdown_connections 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6c8073200 0x7ff6c8075710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6ec0d1d00 0x7ff6ec15b790 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6ec0c5ea0 0x7ff6ec1f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 --2- 172.21.15.64:0/2523721167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6ec0b3d60 0x7ff6ec0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 >> 172.21.15.64:0/2523721167 conn(0x7ff6ec06d1c0 msgr2=0x7ff6ec0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 shutdown_connections 2024-09-21T07:23:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:48.107+0000 7ff6f2000640 1 -- 172.21.15.64:0/2523721167 wait complete. 2024-09-21T07:23:48.130 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-21T07:23:47.432105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220864,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753856,"statfs":{"total":773094113280,"available":772867948544,"internally_reserved":0,"allocated":4726784,"data_stored":2684979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.219708"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228197+0000","last_change":"2024-09-21T07:23:42.255554+0000","last_active":"2024-09-21T07:23:43.228197+0000","last_peered":"2024-09-21T07:23:43.228197+0000","last_clean":"2024-09-21T07:23:43.228197+0000","last_became_active":"2024-09-21T07:23:42.255261+0000","last_became_peered":"2024-09-21T07:23:42.255261+0000","last_unstale":"2024-09-21T07:23:43.228197+0000","last_undegraded":"2024-09-21T07:23:43.228197+0000","last_fullsized":"2024-09-21T07:23:43.228197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:27.273473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228061+0000","last_change":"2024-09-21T07:23:42.268617+0000","last_active":"2024-09-21T07:23:43.228061+0000","last_peered":"2024-09-21T07:23:43.228061+0000","last_clean":"2024-09-21T07:23:43.228061+0000","last_became_active":"2024-09-21T07:23:42.266588+0000","last_became_peered":"2024-09-21T07:23:42.266588+0000","last_unstale":"2024-09-21T07:23:43.228061+0000","last_undegraded":"2024-09-21T07:23:43.228061+0000","last_fullsized":"2024-09-21T07:23:43.228061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:10.872544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270977+0000","last_change":"2024-09-21T07:23:42.262669+0000","last_active":"2024-09-21T07:23:42.270977+0000","last_peered":"2024-09-21T07:23:42.270977+0000","last_clean":"2024-09-21T07:23:42.270977+0000","last_became_active":"2024-09-21T07:23:42.262389+0000","last_became_peered":"2024-09-21T07:23:42.262389+0000","last_unstale":"2024-09-21T07:23:42.270977+0000","last_undegraded":"2024-09-21T07:23:42.270977+0000","last_fullsized":"2024-09-21T07:23:42.270977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264343+0000","last_change":"2024-09-21T07:23:42.261715+0000","last_active":"2024-09-21T07:23:42.264343+0000","last_peered":"2024-09-21T07:23:42.264343+0000","last_clean":"2024-09-21T07:23:42.264343+0000","last_became_active":"2024-09-21T07:23:42.261340+0000","last_became_peered":"2024-09-21T07:23:42.261340+0000","last_unstale":"2024-09-21T07:23:42.264343+0000","last_undegraded":"2024-09-21T07:23:42.264343+0000","last_fullsized":"2024-09-21T07:23:42.264343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:03.153945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267003+0000","last_change":"2024-09-21T07:23:42.262249+0000","last_active":"2024-09-21T07:23:42.267003+0000","last_peered":"2024-09-21T07:23:42.267003+0000","last_clean":"2024-09-21T07:23:42.267003+0000","last_became_active":"2024-09-21T07:23:42.261907+0000","last_became_peered":"2024-09-21T07:23:42.261907+0000","last_unstale":"2024-09-21T07:23:42.267003+0000","last_undegraded":"2024-09-21T07:23:42.267003+0000","last_fullsized":"2024-09-21T07:23:42.267003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:17.323588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244499+0000","last_change":"2024-09-21T07:23:42.235503+0000","last_active":"2024-09-21T07:23:42.244499+0000","last_peered":"2024-09-21T07:23:42.244499+0000","last_clean":"2024-09-21T07:23:42.244499+0000","last_became_active":"2024-09-21T07:23:42.235177+0000","last_became_peered":"2024-09-21T07:23:42.235177+0000","last_unstale":"2024-09-21T07:23:42.244499+0000","last_undegraded":"2024-09-21T07:23:42.244499+0000","last_fullsized":"2024-09-21T07:23:42.244499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:14.486415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260702+0000","last_change":"2024-09-21T07:23:42.252188+0000","last_active":"2024-09-21T07:23:42.260702+0000","last_peered":"2024-09-21T07:23:42.260702+0000","last_clean":"2024-09-21T07:23:42.260702+0000","last_became_active":"2024-09-21T07:23:42.251894+0000","last_became_peered":"2024-09-21T07:23:42.251894+0000","last_unstale":"2024-09-21T07:23:42.260702+0000","last_undegraded":"2024-09-21T07:23:42.260702+0000","last_fullsized":"2024-09-21T07:23:42.260702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227008+0000","last_change":"2024-09-21T07:23:42.266853+0000","last_active":"2024-09-21T07:23:43.227008+0000","last_peered":"2024-09-21T07:23:43.227008+0000","last_clean":"2024-09-21T07:23:43.227008+0000","last_became_active":"2024-09-21T07:23:42.266522+0000","last_became_peered":"2024-09-21T07:23:42.266522+0000","last_unstale":"2024-09-21T07:23:43.227008+0000","last_undegraded":"2024-09-21T07:23:43.227008+0000","last_fullsized":"2024-09-21T07:23:43.227008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:11.159426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272159+0000","last_change":"2024-09-21T07:23:42.264397+0000","last_active":"2024-09-21T07:23:42.272159+0000","last_peered":"2024-09-21T07:23:42.272159+0000","last_clean":"2024-09-21T07:23:42.272159+0000","last_became_active":"2024-09-21T07:23:42.264043+0000","last_became_peered":"2024-09-21T07:23:42.264043+0000","last_unstale":"2024-09-21T07:23:42.272159+0000","last_undegraded":"2024-09-21T07:23:42.272159+0000","last_fullsized":"2024-09-21T07:23:42.272159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273751+0000","last_change":"2024-09-21T07:23:42.268132+0000","last_active":"2024-09-21T07:23:42.273751+0000","last_peered":"2024-09-21T07:23:42.273751+0000","last_clean":"2024-09-21T07:23:42.273751+0000","last_became_active":"2024-09-21T07:23:42.267741+0000","last_became_peered":"2024-09-21T07:23:42.267741+0000","last_unstale":"2024-09-21T07:23:42.273751+0000","last_undegraded":"2024-09-21T07:23:42.273751+0000","last_fullsized":"2024-09-21T07:23:42.273751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:31.858647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272935+0000","last_change":"2024-09-21T07:23:42.264152+0000","last_active":"2024-09-21T07:23:42.272935+0000","last_peered":"2024-09-21T07:23:42.272935+0000","last_clean":"2024-09-21T07:23:42.272935+0000","last_became_active":"2024-09-21T07:23:42.263622+0000","last_became_peered":"2024-09-21T07:23:42.263622+0000","last_unstale":"2024-09-21T07:23:42.272935+0000","last_undegraded":"2024-09-21T07:23:42.272935+0000","last_fullsized":"2024-09-21T07:23:42.272935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:31.773982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270838+0000","last_change":"2024-09-21T07:23:42.260967+0000","last_active":"2024-09-21T07:23:42.270838+0000","last_peered":"2024-09-21T07:23:42.270838+0000","last_clean":"2024-09-21T07:23:42.270838+0000","last_became_active":"2024-09-21T07:23:42.260623+0000","last_became_peered":"2024-09-21T07:23:42.260623+0000","last_unstale":"2024-09-21T07:23:42.270838+0000","last_undegraded":"2024-09-21T07:23:42.270838+0000","last_fullsized":"2024-09-21T07:23:42.270838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273838+0000","last_change":"2024-09-21T07:23:42.269480+0000","last_active":"2024-09-21T07:23:42.273838+0000","last_peered":"2024-09-21T07:23:42.273838+0000","last_clean":"2024-09-21T07:23:42.273838+0000","last_became_active":"2024-09-21T07:23:42.269068+0000","last_became_peered":"2024-09-21T07:23:42.269068+0000","last_unstale":"2024-09-21T07:23:42.273838+0000","last_undegraded":"2024-09-21T07:23:42.273838+0000","last_fullsized":"2024-09-21T07:23:42.273838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:09.553859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257689+0000","last_change":"2024-09-21T07:23:42.243029+0000","last_active":"2024-09-21T07:23:42.257689+0000","last_peered":"2024-09-21T07:23:42.257689+0000","last_clean":"2024-09-21T07:23:42.257689+0000","last_became_active":"2024-09-21T07:23:42.242668+0000","last_became_peered":"2024-09-21T07:23:42.242668+0000","last_unstale":"2024-09-21T07:23:42.257689+0000","last_undegraded":"2024-09-21T07:23:42.257689+0000","last_fullsized":"2024-09-21T07:23:42.257689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273363+0000","last_change":"2024-09-21T07:23:42.265930+0000","last_active":"2024-09-21T07:23:42.273363+0000","last_peered":"2024-09-21T07:23:42.273363+0000","last_clean":"2024-09-21T07:23:42.273363+0000","last_became_active":"2024-09-21T07:23:42.265524+0000","last_became_peered":"2024-09-21T07:23:42.265524+0000","last_unstale":"2024-09-21T07:23:42.273363+0000","last_undegraded":"2024-09-21T07:23:42.273363+0000","last_fullsized":"2024-09-21T07:23:42.273363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:06.508104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932048+0000","last_change":"2024-09-21T07:23:42.264002+0000","last_active":"2024-09-21T07:23:43.932048+0000","last_peered":"2024-09-21T07:23:43.932048+0000","last_clean":"2024-09-21T07:23:43.932048+0000","last_became_active":"2024-09-21T07:23:42.263697+0000","last_became_peered":"2024-09-21T07:23:42.263697+0000","last_unstale":"2024-09-21T07:23:43.932048+0000","last_undegraded":"2024-09-21T07:23:43.932048+0000","last_fullsized":"2024-09-21T07:23:43.932048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:53.085465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933756+0000","last_change":"2024-09-21T07:23:42.263842+0000","last_active":"2024-09-21T07:23:43.933756+0000","last_peered":"2024-09-21T07:23:43.933756+0000","last_clean":"2024-09-21T07:23:43.933756+0000","last_became_active":"2024-09-21T07:23:42.263582+0000","last_became_peered":"2024-09-21T07:23:42.263582+0000","last_unstale":"2024-09-21T07:23:43.933756+0000","last_undegraded":"2024-09-21T07:23:43.933756+0000","last_fullsized":"2024-09-21T07:23:43.933756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:05.233687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259279+0000","last_change":"2024-09-21T07:23:42.244851+0000","last_active":"2024-09-21T07:23:42.259279+0000","last_peered":"2024-09-21T07:23:42.259279+0000","last_clean":"2024-09-21T07:23:42.259279+0000","last_became_active":"2024-09-21T07:23:42.244491+0000","last_became_peered":"2024-09-21T07:23:42.244491+0000","last_unstale":"2024-09-21T07:23:42.259279+0000","last_undegraded":"2024-09-21T07:23:42.259279+0000","last_fullsized":"2024-09-21T07:23:42.259279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263127+0000","last_change":"2024-09-21T07:23:42.254476+0000","last_active":"2024-09-21T07:23:42.263127+0000","last_peered":"2024-09-21T07:23:42.263127+0000","last_clean":"2024-09-21T07:23:42.263127+0000","last_became_active":"2024-09-21T07:23:42.253980+0000","last_became_peered":"2024-09-21T07:23:42.253980+0000","last_unstale":"2024-09-21T07:23:42.263127+0000","last_undegraded":"2024-09-21T07:23:42.263127+0000","last_fullsized":"2024-09-21T07:23:42.263127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:27.378166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259220+0000","last_change":"2024-09-21T07:23:42.244122+0000","last_active":"2024-09-21T07:23:42.259220+0000","last_peered":"2024-09-21T07:23:42.259220+0000","last_clean":"2024-09-21T07:23:42.259220+0000","last_became_active":"2024-09-21T07:23:42.243673+0000","last_became_peered":"2024-09-21T07:23:42.243673+0000","last_unstale":"2024-09-21T07:23:42.259220+0000","last_undegraded":"2024-09-21T07:23:42.259220+0000","last_fullsized":"2024-09-21T07:23:42.259220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262576+0000","last_change":"2024-09-21T07:23:42.253068+0000","last_active":"2024-09-21T07:23:42.262576+0000","last_peered":"2024-09-21T07:23:42.262576+0000","last_clean":"2024-09-21T07:23:42.262576+0000","last_became_active":"2024-09-21T07:23:42.252729+0000","last_became_peered":"2024-09-21T07:23:42.252729+0000","last_unstale":"2024-09-21T07:23:42.262576+0000","last_undegraded":"2024-09-21T07:23:42.262576+0000","last_fullsized":"2024-09-21T07:23:42.262576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257736+0000","last_change":"2024-09-21T07:23:42.251107+0000","last_active":"2024-09-21T07:23:42.257736+0000","last_peered":"2024-09-21T07:23:42.257736+0000","last_clean":"2024-09-21T07:23:42.257736+0000","last_became_active":"2024-09-21T07:23:42.248543+0000","last_became_peered":"2024-09-21T07:23:42.248543+0000","last_unstale":"2024-09-21T07:23:42.257736+0000","last_undegraded":"2024-09-21T07:23:42.257736+0000","last_fullsized":"2024-09-21T07:23:42.257736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931919+0000","last_change":"2024-09-21T07:23:42.252833+0000","last_active":"2024-09-21T07:23:43.931919+0000","last_peered":"2024-09-21T07:23:43.931919+0000","last_clean":"2024-09-21T07:23:43.931919+0000","last_became_active":"2024-09-21T07:23:42.252311+0000","last_became_peered":"2024-09-21T07:23:42.252311+0000","last_unstale":"2024-09-21T07:23:43.931919+0000","last_undegraded":"2024-09-21T07:23:43.931919+0000","last_fullsized":"2024-09-21T07:23:43.931919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:17.561151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266136+0000","last_change":"2024-09-21T07:23:42.263299+0000","last_active":"2024-09-21T07:23:42.266136+0000","last_peered":"2024-09-21T07:23:42.266136+0000","last_clean":"2024-09-21T07:23:42.266136+0000","last_became_active":"2024-09-21T07:23:42.259857+0000","last_became_peered":"2024-09-21T07:23:42.259857+0000","last_unstale":"2024-09-21T07:23:42.266136+0000","last_undegraded":"2024-09-21T07:23:42.266136+0000","last_fullsized":"2024-09-21T07:23:42.266136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:41.112303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259393+0000","last_change":"2024-09-21T07:23:42.255686+0000","last_active":"2024-09-21T07:23:42.259393+0000","last_peered":"2024-09-21T07:23:42.259393+0000","last_clean":"2024-09-21T07:23:42.259393+0000","last_became_active":"2024-09-21T07:23:42.255269+0000","last_became_peered":"2024-09-21T07:23:42.255269+0000","last_unstale":"2024-09-21T07:23:42.259393+0000","last_undegraded":"2024-09-21T07:23:42.259393+0000","last_fullsized":"2024-09-21T07:23:42.259393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263033+0000","last_change":"2024-09-21T07:23:42.260742+0000","last_active":"2024-09-21T07:23:42.263033+0000","last_peered":"2024-09-21T07:23:42.263033+0000","last_clean":"2024-09-21T07:23:42.263033+0000","last_became_active":"2024-09-21T07:23:42.260474+0000","last_became_peered":"2024-09-21T07:23:42.260474+0000","last_unstale":"2024-09-21T07:23:42.263033+0000","last_undegraded":"2024-09-21T07:23:42.263033+0000","last_fullsized":"2024-09-21T07:23:42.263033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:01.499156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270409+0000","last_change":"2024-09-21T07:23:42.265850+0000","last_active":"2024-09-21T07:23:42.270409+0000","last_peered":"2024-09-21T07:23:42.270409+0000","last_clean":"2024-09-21T07:23:42.270409+0000","last_became_active":"2024-09-21T07:23:42.265462+0000","last_became_peered":"2024-09-21T07:23:42.265462+0000","last_unstale":"2024-09-21T07:23:42.270409+0000","last_undegraded":"2024-09-21T07:23:42.270409+0000","last_fullsized":"2024-09-21T07:23:42.270409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264217+0000","last_change":"2024-09-21T07:23:42.258580+0000","last_active":"2024-09-21T07:23:42.264217+0000","last_peered":"2024-09-21T07:23:42.264217+0000","last_clean":"2024-09-21T07:23:42.264217+0000","last_became_active":"2024-09-21T07:23:42.258317+0000","last_became_peered":"2024-09-21T07:23:42.258317+0000","last_unstale":"2024-09-21T07:23:42.264217+0000","last_undegraded":"2024-09-21T07:23:42.264217+0000","last_fullsized":"2024-09-21T07:23:42.264217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248249+0000","last_change":"2024-09-21T07:23:42.240018+0000","last_active":"2024-09-21T07:23:42.248249+0000","last_peered":"2024-09-21T07:23:42.248249+0000","last_clean":"2024-09-21T07:23:42.248249+0000","last_became_active":"2024-09-21T07:23:42.239526+0000","last_became_peered":"2024-09-21T07:23:42.239526+0000","last_unstale":"2024-09-21T07:23:42.248249+0000","last_undegraded":"2024-09-21T07:23:42.248249+0000","last_fullsized":"2024-09-21T07:23:42.248249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:31.250437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.241461+0000","last_change":"2024-09-21T07:23:42.236369+0000","last_active":"2024-09-21T07:23:42.241461+0000","last_peered":"2024-09-21T07:23:42.241461+0000","last_clean":"2024-09-21T07:23:42.241461+0000","last_became_active":"2024-09-21T07:23:42.235993+0000","last_became_peered":"2024-09-21T07:23:42.235993+0000","last_unstale":"2024-09-21T07:23:42.241461+0000","last_undegraded":"2024-09-21T07:23:42.241461+0000","last_fullsized":"2024-09-21T07:23:42.241461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:00.022946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931942+0000","last_change":"2024-09-21T07:23:42.253118+0000","last_active":"2024-09-21T07:23:43.931942+0000","last_peered":"2024-09-21T07:23:43.931942+0000","last_clean":"2024-09-21T07:23:43.931942+0000","last_became_active":"2024-09-21T07:23:42.252424+0000","last_became_peered":"2024-09-21T07:23:42.252424+0000","last_unstale":"2024-09-21T07:23:43.931942+0000","last_undegraded":"2024-09-21T07:23:43.931942+0000","last_fullsized":"2024-09-21T07:23:43.931942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:25.901649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.251171+0000","last_change":"2024-09-21T07:23:42.248019+0000","last_active":"2024-09-21T07:23:42.251171+0000","last_peered":"2024-09-21T07:23:42.251171+0000","last_clean":"2024-09-21T07:23:42.251171+0000","last_became_active":"2024-09-21T07:23:42.247618+0000","last_became_peered":"2024-09-21T07:23:42.247618+0000","last_unstale":"2024-09-21T07:23:42.251171+0000","last_undegraded":"2024-09-21T07:23:42.251171+0000","last_fullsized":"2024-09-21T07:23:42.251171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:45.479102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933783+0000","last_change":"2024-09-21T07:23:42.263935+0000","last_active":"2024-09-21T07:23:43.933783+0000","last_peered":"2024-09-21T07:23:43.933783+0000","last_clean":"2024-09-21T07:23:43.933783+0000","last_became_active":"2024-09-21T07:23:42.263578+0000","last_became_peered":"2024-09-21T07:23:42.263578+0000","last_unstale":"2024-09-21T07:23:43.933783+0000","last_undegraded":"2024-09-21T07:23:43.933783+0000","last_fullsized":"2024-09-21T07:23:43.933783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:38.708823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258886+0000","last_change":"2024-09-21T07:23:41.229683+0000","last_active":"2024-09-21T07:23:42.258886+0000","last_peered":"2024-09-21T07:23:42.258886+0000","last_clean":"2024-09-21T07:23:42.258886+0000","last_became_active":"2024-09-21T07:23:41.229300+0000","last_became_peered":"2024-09-21T07:23:41.229300+0000","last_unstale":"2024-09-21T07:23:42.258886+0000","last_undegraded":"2024-09-21T07:23:42.258886+0000","last_fullsized":"2024-09-21T07:23:42.258886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.269288+0000","last_change":"2024-09-21T07:23:42.265994+0000","last_active":"2024-09-21T07:23:42.269288+0000","last_peered":"2024-09-21T07:23:42.269288+0000","last_clean":"2024-09-21T07:23:42.269288+0000","last_became_active":"2024-09-21T07:23:42.265634+0000","last_became_peered":"2024-09-21T07:23:42.265634+0000","last_unstale":"2024-09-21T07:23:42.269288+0000","last_undegraded":"2024-09-21T07:23:42.269288+0000","last_fullsized":"2024-09-21T07:23:42.269288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:35.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263151+0000","last_change":"2024-09-21T07:23:41.247293+0000","last_active":"2024-09-21T07:23:42.263151+0000","last_peered":"2024-09-21T07:23:42.263151+0000","last_clean":"2024-09-21T07:23:42.263151+0000","last_became_active":"2024-09-21T07:23:41.246932+0000","last_became_peered":"2024-09-21T07:23:41.246932+0000","last_unstale":"2024-09-21T07:23:42.263151+0000","last_undegraded":"2024-09-21T07:23:42.263151+0000","last_fullsized":"2024-09-21T07:23:42.263151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250765+0000","last_change":"2024-09-21T07:23:42.243789+0000","last_active":"2024-09-21T07:23:42.250765+0000","last_peered":"2024-09-21T07:23:42.250765+0000","last_clean":"2024-09-21T07:23:42.250765+0000","last_became_active":"2024-09-21T07:23:42.243092+0000","last_became_peered":"2024-09-21T07:23:42.243092+0000","last_unstale":"2024-09-21T07:23:42.250765+0000","last_undegraded":"2024-09-21T07:23:42.250765+0000","last_fullsized":"2024-09-21T07:23:42.250765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.258710+0000","last_change":"2024-09-21T07:23:41.231067+0000","last_active":"2024-09-21T07:23:42.258710+0000","last_peered":"2024-09-21T07:23:42.258710+0000","last_clean":"2024-09-21T07:23:42.258710+0000","last_became_active":"2024-09-21T07:23:41.230264+0000","last_became_peered":"2024-09-21T07:23:41.230264+0000","last_unstale":"2024-09-21T07:23:42.258710+0000","last_undegraded":"2024-09-21T07:23:42.258710+0000","last_fullsized":"2024-09-21T07:23:42.258710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.104337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228515+0000","last_change":"2024-09-21T07:23:42.234322+0000","last_active":"2024-09-21T07:23:43.228515+0000","last_peered":"2024-09-21T07:23:43.228515+0000","last_clean":"2024-09-21T07:23:43.228515+0000","last_became_active":"2024-09-21T07:23:42.233980+0000","last_became_peered":"2024-09-21T07:23:42.233980+0000","last_unstale":"2024-09-21T07:23:43.228515+0000","last_undegraded":"2024-09-21T07:23:43.228515+0000","last_fullsized":"2024-09-21T07:23:43.228515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:16.938026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259779+0000","last_change":"2024-09-21T07:23:41.227352+0000","last_active":"2024-09-21T07:23:42.259779+0000","last_peered":"2024-09-21T07:23:42.259779+0000","last_clean":"2024-09-21T07:23:42.259779+0000","last_became_active":"2024-09-21T07:23:41.226996+0000","last_became_peered":"2024-09-21T07:23:41.226996+0000","last_unstale":"2024-09-21T07:23:42.259779+0000","last_undegraded":"2024-09-21T07:23:42.259779+0000","last_fullsized":"2024-09-21T07:23:42.259779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:41.257887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255905+0000","last_change":"2024-09-21T07:23:42.249480+0000","last_active":"2024-09-21T07:23:42.255905+0000","last_peered":"2024-09-21T07:23:42.255905+0000","last_clean":"2024-09-21T07:23:42.255905+0000","last_became_active":"2024-09-21T07:23:42.247629+0000","last_became_peered":"2024-09-21T07:23:42.247629+0000","last_unstale":"2024-09-21T07:23:42.255905+0000","last_undegraded":"2024-09-21T07:23:42.255905+0000","last_fullsized":"2024-09-21T07:23:42.255905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:03.462093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273876+0000","last_change":"2024-09-21T07:23:41.247247+0000","last_active":"2024-09-21T07:23:42.273876+0000","last_peered":"2024-09-21T07:23:42.273876+0000","last_clean":"2024-09-21T07:23:42.273876+0000","last_became_active":"2024-09-21T07:23:41.246933+0000","last_became_peered":"2024-09-21T07:23:41.246933+0000","last_unstale":"2024-09-21T07:23:42.273876+0000","last_undegraded":"2024-09-21T07:23:42.273876+0000","last_fullsized":"2024-09-21T07:23:42.273876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:24.210839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262611+0000","last_change":"2024-09-21T07:23:42.257399+0000","last_active":"2024-09-21T07:23:42.262611+0000","last_peered":"2024-09-21T07:23:42.262611+0000","last_clean":"2024-09-21T07:23:42.262611+0000","last_became_active":"2024-09-21T07:23:42.253176+0000","last_became_peered":"2024-09-21T07:23:42.253176+0000","last_unstale":"2024-09-21T07:23:42.262611+0000","last_undegraded":"2024-09-21T07:23:42.262611+0000","last_fullsized":"2024-09-21T07:23:42.262611+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933501+0000","last_change":"2024-09-21T07:23:41.241248+0000","last_active":"2024-09-21T07:23:43.933501+0000","last_peered":"2024-09-21T07:23:43.933501+0000","last_clean":"2024-09-21T07:23:43.933501+0000","last_became_active":"2024-09-21T07:23:41.239401+0000","last_became_peered":"2024-09-21T07:23:41.239401+0000","last_unstale":"2024-09-21T07:23:43.933501+0000","last_undegraded":"2024-09-21T07:23:43.933501+0000","last_fullsized":"2024-09-21T07:23:43.933501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:54.164229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.262884+0000","last_change":"2024-09-21T07:23:42.257444+0000","last_active":"2024-09-21T07:23:42.262884+0000","last_peered":"2024-09-21T07:23:42.262884+0000","last_clean":"2024-09-21T07:23:42.262884+0000","last_became_active":"2024-09-21T07:23:42.257148+0000","last_became_peered":"2024-09-21T07:23:42.257148+0000","last_unstale":"2024-09-21T07:23:42.262884+0000","last_undegraded":"2024-09-21T07:23:42.262884+0000","last_fullsized":"2024-09-21T07:23:42.262884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229192+0000","last_change":"2024-09-21T07:23:41.241097+0000","last_active":"2024-09-21T07:23:42.229192+0000","last_peered":"2024-09-21T07:23:42.229192+0000","last_clean":"2024-09-21T07:23:42.229192+0000","last_became_active":"2024-09-21T07:23:41.240725+0000","last_became_peered":"2024-09-21T07:23:41.240725+0000","last_unstale":"2024-09-21T07:23:42.229192+0000","last_undegraded":"2024-09-21T07:23:42.229192+0000","last_fullsized":"2024-09-21T07:23:42.229192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:55.998354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227350+0000","last_change":"2024-09-21T07:23:42.244204+0000","last_active":"2024-09-21T07:23:43.227350+0000","last_peered":"2024-09-21T07:23:43.227350+0000","last_clean":"2024-09-21T07:23:43.227350+0000","last_became_active":"2024-09-21T07:23:42.243508+0000","last_became_peered":"2024-09-21T07:23:42.243508+0000","last_unstale":"2024-09-21T07:23:43.227350+0000","last_undegraded":"2024-09-21T07:23:43.227350+0000","last_fullsized":"2024-09-21T07:23:43.227350+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:47.620741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.232757+0000","last_change":"2024-09-21T07:23:41.224843+0000","last_active":"2024-09-21T07:23:42.232757+0000","last_peered":"2024-09-21T07:23:42.232757+0000","last_clean":"2024-09-21T07:23:42.232757+0000","last_became_active":"2024-09-21T07:23:41.224463+0000","last_became_peered":"2024-09-21T07:23:41.224463+0000","last_unstale":"2024-09-21T07:23:42.232757+0000","last_undegraded":"2024-09-21T07:23:42.232757+0000","last_fullsized":"2024-09-21T07:23:42.232757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.264316+0000","last_change":"2024-09-21T07:23:42.259678+0000","last_active":"2024-09-21T07:23:42.264316+0000","last_peered":"2024-09-21T07:23:42.264316+0000","last_clean":"2024-09-21T07:23:42.264316+0000","last_became_active":"2024-09-21T07:23:42.259361+0000","last_became_peered":"2024-09-21T07:23:42.259361+0000","last_unstale":"2024-09-21T07:23:42.264316+0000","last_undegraded":"2024-09-21T07:23:42.264316+0000","last_fullsized":"2024-09-21T07:23:42.264316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:41.188911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228267+0000","last_change":"2024-09-21T07:23:41.235950+0000","last_active":"2024-09-21T07:23:43.228267+0000","last_peered":"2024-09-21T07:23:43.228267+0000","last_clean":"2024-09-21T07:23:43.228267+0000","last_became_active":"2024-09-21T07:23:41.235394+0000","last_became_peered":"2024-09-21T07:23:41.235394+0000","last_unstale":"2024-09-21T07:23:43.228267+0000","last_undegraded":"2024-09-21T07:23:43.228267+0000","last_fullsized":"2024-09-21T07:23:43.228267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:17.728100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934254+0000","last_change":"2024-09-21T07:23:42.263933+0000","last_active":"2024-09-21T07:23:43.934254+0000","last_peered":"2024-09-21T07:23:43.934254+0000","last_clean":"2024-09-21T07:23:43.934254+0000","last_became_active":"2024-09-21T07:23:42.262617+0000","last_became_peered":"2024-09-21T07:23:42.262617+0000","last_unstale":"2024-09-21T07:23:43.934254+0000","last_undegraded":"2024-09-21T07:23:43.934254+0000","last_fullsized":"2024-09-21T07:23:43.934254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:11.159426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.248668+0000","last_change":"2024-09-21T07:23:41.245321+0000","last_active":"2024-09-21T07:23:42.248668+0000","last_peered":"2024-09-21T07:23:42.248668+0000","last_clean":"2024-09-21T07:23:42.248668+0000","last_became_active":"2024-09-21T07:23:41.244908+0000","last_became_peered":"2024-09-21T07:23:41.244908+0000","last_unstale":"2024-09-21T07:23:42.248668+0000","last_undegraded":"2024-09-21T07:23:42.248668+0000","last_fullsized":"2024-09-21T07:23:42.248668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:18.079641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271330+0000","last_change":"2024-09-21T07:23:42.255482+0000","last_active":"2024-09-21T07:23:42.271330+0000","last_peered":"2024-09-21T07:23:42.271330+0000","last_clean":"2024-09-21T07:23:42.271330+0000","last_became_active":"2024-09-21T07:23:42.255181+0000","last_became_peered":"2024-09-21T07:23:42.255181+0000","last_unstale":"2024-09-21T07:23:42.271330+0000","last_undegraded":"2024-09-21T07:23:42.271330+0000","last_fullsized":"2024-09-21T07:23:42.271330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275341+0000","last_change":"2024-09-21T07:23:41.241070+0000","last_active":"2024-09-21T07:23:42.275341+0000","last_peered":"2024-09-21T07:23:42.275341+0000","last_clean":"2024-09-21T07:23:42.275341+0000","last_became_active":"2024-09-21T07:23:41.240700+0000","last_became_peered":"2024-09-21T07:23:41.240700+0000","last_unstale":"2024-09-21T07:23:42.275341+0000","last_undegraded":"2024-09-21T07:23:42.275341+0000","last_fullsized":"2024-09-21T07:23:42.275341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:38.885316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.270159+0000","last_change":"2024-09-21T07:23:42.267128+0000","last_active":"2024-09-21T07:23:42.270159+0000","last_peered":"2024-09-21T07:23:42.270159+0000","last_clean":"2024-09-21T07:23:42.270159+0000","last_became_active":"2024-09-21T07:23:42.266152+0000","last_became_peered":"2024-09-21T07:23:42.266152+0000","last_unstale":"2024-09-21T07:23:42.270159+0000","last_undegraded":"2024-09-21T07:23:42.270159+0000","last_fullsized":"2024-09-21T07:23:42.270159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227921+0000","last_change":"2024-09-21T07:23:41.243511+0000","last_active":"2024-09-21T07:23:43.227921+0000","last_peered":"2024-09-21T07:23:43.227921+0000","last_clean":"2024-09-21T07:23:43.227921+0000","last_became_active":"2024-09-21T07:23:41.242856+0000","last_became_peered":"2024-09-21T07:23:41.242856+0000","last_unstale":"2024-09-21T07:23:43.227921+0000","last_undegraded":"2024-09-21T07:23:43.227921+0000","last_fullsized":"2024-09-21T07:23:43.227921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:47.278861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271104+0000","last_change":"2024-09-21T07:23:42.264392+0000","last_active":"2024-09-21T07:23:42.271104+0000","last_peered":"2024-09-21T07:23:42.271104+0000","last_clean":"2024-09-21T07:23:42.271104+0000","last_became_active":"2024-09-21T07:23:42.264071+0000","last_became_peered":"2024-09-21T07:23:42.264071+0000","last_unstale":"2024-09-21T07:23:42.271104+0000","last_undegraded":"2024-09-21T07:23:42.271104+0000","last_fullsized":"2024-09-21T07:23:42.271104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227530+0000","last_change":"2024-09-21T07:23:41.247444+0000","last_active":"2024-09-21T07:23:43.227530+0000","last_peered":"2024-09-21T07:23:43.227530+0000","last_clean":"2024-09-21T07:23:43.227530+0000","last_became_active":"2024-09-21T07:23:41.246981+0000","last_became_peered":"2024-09-21T07:23:41.246981+0000","last_unstale":"2024-09-21T07:23:43.227530+0000","last_undegraded":"2024-09-21T07:23:43.227530+0000","last_fullsized":"2024-09-21T07:23:43.227530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.315666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227062+0000","last_change":"2024-09-21T07:23:42.250954+0000","last_active":"2024-09-21T07:23:43.227062+0000","last_peered":"2024-09-21T07:23:43.227062+0000","last_clean":"2024-09-21T07:23:43.227062+0000","last_became_active":"2024-09-21T07:23:42.250645+0000","last_became_peered":"2024-09-21T07:23:42.250645+0000","last_unstale":"2024-09-21T07:23:43.227062+0000","last_undegraded":"2024-09-21T07:23:43.227062+0000","last_fullsized":"2024-09-21T07:23:43.227062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:19.105860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.229859+0000","last_change":"2024-09-21T07:23:41.237332+0000","last_active":"2024-09-21T07:23:42.229859+0000","last_peered":"2024-09-21T07:23:42.229859+0000","last_clean":"2024-09-21T07:23:42.229859+0000","last_became_active":"2024-09-21T07:23:41.236953+0000","last_became_peered":"2024-09-21T07:23:41.236953+0000","last_unstale":"2024-09-21T07:23:42.229859+0000","last_undegraded":"2024-09-21T07:23:42.229859+0000","last_fullsized":"2024-09-21T07:23:42.229859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:43.800815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932425+0000","last_change":"2024-09-21T07:23:42.253616+0000","last_active":"2024-09-21T07:23:43.932425+0000","last_peered":"2024-09-21T07:23:43.932425+0000","last_clean":"2024-09-21T07:23:43.932425+0000","last_became_active":"2024-09-21T07:23:42.253285+0000","last_became_peered":"2024-09-21T07:23:42.253285+0000","last_unstale":"2024-09-21T07:23:43.932425+0000","last_undegraded":"2024-09-21T07:23:43.932425+0000","last_fullsized":"2024-09-21T07:23:43.932425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:19.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227550+0000","last_change":"2024-09-21T07:23:41.228019+0000","last_active":"2024-09-21T07:23:42.227550+0000","last_peered":"2024-09-21T07:23:42.227550+0000","last_clean":"2024-09-21T07:23:42.227550+0000","last_became_active":"2024-09-21T07:23:41.227689+0000","last_became_peered":"2024-09-21T07:23:41.227689+0000","last_unstale":"2024-09-21T07:23:42.227550+0000","last_undegraded":"2024-09-21T07:23:42.227550+0000","last_fullsized":"2024-09-21T07:23:42.227550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:20.597221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227374+0000","last_change":"2024-09-21T07:23:42.254634+0000","last_active":"2024-09-21T07:23:43.227374+0000","last_peered":"2024-09-21T07:23:43.227374+0000","last_clean":"2024-09-21T07:23:43.227374+0000","last_became_active":"2024-09-21T07:23:42.254323+0000","last_became_peered":"2024-09-21T07:23:42.254323+0000","last_unstale":"2024-09-21T07:23:43.227374+0000","last_undegraded":"2024-09-21T07:23:43.227374+0000","last_fullsized":"2024-09-21T07:23:43.227374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:09.883815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932128+0000","last_change":"2024-09-21T07:23:41.242205+0000","last_active":"2024-09-21T07:23:43.932128+0000","last_peered":"2024-09-21T07:23:43.932128+0000","last_clean":"2024-09-21T07:23:43.932128+0000","last_became_active":"2024-09-21T07:23:41.240901+0000","last_became_peered":"2024-09-21T07:23:41.240901+0000","last_unstale":"2024-09-21T07:23:43.932128+0000","last_undegraded":"2024-09-21T07:23:43.932128+0000","last_fullsized":"2024-09-21T07:23:43.932128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:45.624931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227943+0000","last_change":"2024-09-21T07:23:42.234158+0000","last_active":"2024-09-21T07:23:43.227943+0000","last_peered":"2024-09-21T07:23:43.227943+0000","last_clean":"2024-09-21T07:23:43.227943+0000","last_became_active":"2024-09-21T07:23:42.233834+0000","last_became_peered":"2024-09-21T07:23:42.233834+0000","last_unstale":"2024-09-21T07:23:43.227943+0000","last_undegraded":"2024-09-21T07:23:43.227943+0000","last_fullsized":"2024-09-21T07:23:43.227943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:34.238598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.273926+0000","last_change":"2024-09-21T07:23:41.241933+0000","last_active":"2024-09-21T07:23:42.273926+0000","last_peered":"2024-09-21T07:23:42.273926+0000","last_clean":"2024-09-21T07:23:42.273926+0000","last_became_active":"2024-09-21T07:23:41.241652+0000","last_became_peered":"2024-09-21T07:23:41.241652+0000","last_unstale":"2024-09-21T07:23:42.273926+0000","last_undegraded":"2024-09-21T07:23:42.273926+0000","last_fullsized":"2024-09-21T07:23:42.273926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:33.390195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267929+0000","last_change":"2024-09-21T07:23:42.261384+0000","last_active":"2024-09-21T07:23:42.267929+0000","last_peered":"2024-09-21T07:23:42.267929+0000","last_clean":"2024-09-21T07:23:42.267929+0000","last_became_active":"2024-09-21T07:23:42.260641+0000","last_became_peered":"2024-09-21T07:23:42.260641+0000","last_unstale":"2024-09-21T07:23:42.267929+0000","last_undegraded":"2024-09-21T07:23:42.267929+0000","last_fullsized":"2024-09-21T07:23:42.267929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.266558+0000","last_change":"2024-09-21T07:23:41.238947+0000","last_active":"2024-09-21T07:23:42.266558+0000","last_peered":"2024-09-21T07:23:42.266558+0000","last_clean":"2024-09-21T07:23:42.266558+0000","last_became_active":"2024-09-21T07:23:41.238569+0000","last_became_peered":"2024-09-21T07:23:41.238569+0000","last_unstale":"2024-09-21T07:23:42.266558+0000","last_undegraded":"2024-09-21T07:23:42.266558+0000","last_fullsized":"2024-09-21T07:23:42.266558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.250792+0000","last_change":"2024-09-21T07:23:42.244113+0000","last_active":"2024-09-21T07:23:42.250792+0000","last_peered":"2024-09-21T07:23:42.250792+0000","last_clean":"2024-09-21T07:23:42.250792+0000","last_became_active":"2024-09-21T07:23:42.243505+0000","last_became_peered":"2024-09-21T07:23:42.243505+0000","last_unstale":"2024-09-21T07:23:42.250792+0000","last_undegraded":"2024-09-21T07:23:42.250792+0000","last_fullsized":"2024-09-21T07:23:42.250792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:17.947783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.271049+0000","last_change":"2024-09-21T07:23:41.239340+0000","last_active":"2024-09-21T07:23:42.271049+0000","last_peered":"2024-09-21T07:23:42.271049+0000","last_clean":"2024-09-21T07:23:42.271049+0000","last_became_active":"2024-09-21T07:23:41.238977+0000","last_became_peered":"2024-09-21T07:23:41.238977+0000","last_unstale":"2024-09-21T07:23:42.271049+0000","last_undegraded":"2024-09-21T07:23:42.271049+0000","last_fullsized":"2024-09-21T07:23:42.271049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.265190+0000","last_change":"2024-09-21T07:23:42.258030+0000","last_active":"2024-09-21T07:23:42.265190+0000","last_peered":"2024-09-21T07:23:42.265190+0000","last_clean":"2024-09-21T07:23:42.265190+0000","last_became_active":"2024-09-21T07:23:42.256792+0000","last_became_peered":"2024-09-21T07:23:42.256792+0000","last_unstale":"2024-09-21T07:23:42.265190+0000","last_undegraded":"2024-09-21T07:23:42.265190+0000","last_fullsized":"2024-09-21T07:23:42.265190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:27.750378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.230439+0000","last_change":"2024-09-21T07:23:41.244419+0000","last_active":"2024-09-21T07:23:42.230439+0000","last_peered":"2024-09-21T07:23:42.230439+0000","last_clean":"2024-09-21T07:23:42.230439+0000","last_became_active":"2024-09-21T07:23:41.242477+0000","last_became_peered":"2024-09-21T07:23:41.242477+0000","last_unstale":"2024-09-21T07:23:42.230439+0000","last_undegraded":"2024-09-21T07:23:42.230439+0000","last_fullsized":"2024-09-21T07:23:42.230439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.513475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932301+0000","last_change":"2024-09-21T07:23:42.247642+0000","last_active":"2024-09-21T07:23:43.932301+0000","last_peered":"2024-09-21T07:23:43.932301+0000","last_clean":"2024-09-21T07:23:43.932301+0000","last_became_active":"2024-09-21T07:23:42.247295+0000","last_became_peered":"2024-09-21T07:23:42.247295+0000","last_unstale":"2024-09-21T07:23:43.932301+0000","last_undegraded":"2024-09-21T07:23:43.932301+0000","last_fullsized":"2024-09-21T07:23:43.932301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:03.292519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.272824+0000","last_change":"2024-09-21T07:23:41.249080+0000","last_active":"2024-09-21T07:23:42.272824+0000","last_peered":"2024-09-21T07:23:42.272824+0000","last_clean":"2024-09-21T07:23:42.272824+0000","last_became_active":"2024-09-21T07:23:41.247666+0000","last_became_peered":"2024-09-21T07:23:41.247666+0000","last_unstale":"2024-09-21T07:23:42.272824+0000","last_undegraded":"2024-09-21T07:23:42.272824+0000","last_fullsized":"2024-09-21T07:23:42.272824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.522254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255013+0000","last_change":"2024-09-21T07:23:42.248515+0000","last_active":"2024-09-21T07:23:42.255013+0000","last_peered":"2024-09-21T07:23:42.255013+0000","last_clean":"2024-09-21T07:23:42.255013+0000","last_became_active":"2024-09-21T07:23:42.248201+0000","last_became_peered":"2024-09-21T07:23:42.248201+0000","last_unstale":"2024-09-21T07:23:42.255013+0000","last_undegraded":"2024-09-21T07:23:42.255013+0000","last_fullsized":"2024-09-21T07:23:42.255013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:42.266536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260553+0000","last_change":"2024-09-21T07:23:41.238957+0000","last_active":"2024-09-21T07:23:42.260553+0000","last_peered":"2024-09-21T07:23:42.260553+0000","last_clean":"2024-09-21T07:23:42.260553+0000","last_became_active":"2024-09-21T07:23:41.237652+0000","last_became_peered":"2024-09-21T07:23:41.237652+0000","last_unstale":"2024-09-21T07:23:42.260553+0000","last_undegraded":"2024-09-21T07:23:42.260553+0000","last_fullsized":"2024-09-21T07:23:42.260553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:32.394414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.260093+0000","last_change":"2024-09-21T07:23:42.250508+0000","last_active":"2024-09-21T07:23:42.260093+0000","last_peered":"2024-09-21T07:23:42.260093+0000","last_clean":"2024-09-21T07:23:42.260093+0000","last_became_active":"2024-09-21T07:23:42.249128+0000","last_became_peered":"2024-09-21T07:23:42.249128+0000","last_unstale":"2024-09-21T07:23:42.260093+0000","last_undegraded":"2024-09-21T07:23:42.260093+0000","last_fullsized":"2024-09-21T07:23:42.260093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932858+0000","last_change":"2024-09-21T07:23:41.242637+0000","last_active":"2024-09-21T07:23:43.932858+0000","last_peered":"2024-09-21T07:23:43.932858+0000","last_clean":"2024-09-21T07:23:43.932858+0000","last_became_active":"2024-09-21T07:23:41.242213+0000","last_became_peered":"2024-09-21T07:23:41.242213+0000","last_unstale":"2024-09-21T07:23:43.932858+0000","last_undegraded":"2024-09-21T07:23:43.932858+0000","last_fullsized":"2024-09-21T07:23:43.932858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:20.396376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227692+0000","last_change":"2024-09-21T07:23:42.243807+0000","last_active":"2024-09-21T07:23:43.227692+0000","last_peered":"2024-09-21T07:23:43.227692+0000","last_clean":"2024-09-21T07:23:43.227692+0000","last_became_active":"2024-09-21T07:23:42.243110+0000","last_became_peered":"2024-09-21T07:23:42.243110+0000","last_unstale":"2024-09-21T07:23:43.227692+0000","last_undegraded":"2024-09-21T07:23:43.227692+0000","last_fullsized":"2024-09-21T07:23:43.227692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:35.036877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.259605+0000","last_change":"2024-09-21T07:23:41.234226+0000","last_active":"2024-09-21T07:23:42.259605+0000","last_peered":"2024-09-21T07:23:42.259605+0000","last_clean":"2024-09-21T07:23:42.259605+0000","last_became_active":"2024-09-21T07:23:41.233924+0000","last_became_peered":"2024-09-21T07:23:41.233924+0000","last_unstale":"2024-09-21T07:23:42.259605+0000","last_undegraded":"2024-09-21T07:23:42.259605+0000","last_fullsized":"2024-09-21T07:23:42.259605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:29.309397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.261026+0000","last_change":"2024-09-21T07:23:42.259554+0000","last_active":"2024-09-21T07:23:42.261026+0000","last_peered":"2024-09-21T07:23:42.261026+0000","last_clean":"2024-09-21T07:23:42.261026+0000","last_became_active":"2024-09-21T07:23:42.259038+0000","last_became_peered":"2024-09-21T07:23:42.259038+0000","last_unstale":"2024-09-21T07:23:42.261026+0000","last_undegraded":"2024-09-21T07:23:42.261026+0000","last_fullsized":"2024-09-21T07:23:42.261026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:47.530038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.275084+0000","last_change":"2024-09-21T07:23:41.240831+0000","last_active":"2024-09-21T07:23:42.275084+0000","last_peered":"2024-09-21T07:23:42.275084+0000","last_clean":"2024-09-21T07:23:42.275084+0000","last_became_active":"2024-09-21T07:23:41.240462+0000","last_became_peered":"2024-09-21T07:23:41.240462+0000","last_unstale":"2024-09-21T07:23:42.275084+0000","last_undegraded":"2024-09-21T07:23:42.275084+0000","last_fullsized":"2024-09-21T07:23:42.275084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934493+0000","last_change":"2024-09-21T07:23:42.261968+0000","last_active":"2024-09-21T07:23:43.934493+0000","last_peered":"2024-09-21T07:23:43.934493+0000","last_clean":"2024-09-21T07:23:43.934493+0000","last_became_active":"2024-09-21T07:23:42.261646+0000","last_became_peered":"2024-09-21T07:23:42.261646+0000","last_unstale":"2024-09-21T07:23:43.934493+0000","last_undegraded":"2024-09-21T07:23:43.934493+0000","last_fullsized":"2024-09-21T07:23:43.934493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:19.105860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.263649+0000","last_change":"2024-09-21T07:23:41.238080+0000","last_active":"2024-09-21T07:23:42.263649+0000","last_peered":"2024-09-21T07:23:42.263649+0000","last_clean":"2024-09-21T07:23:42.263649+0000","last_became_active":"2024-09-21T07:23:41.237839+0000","last_became_peered":"2024-09-21T07:23:41.237839+0000","last_unstale":"2024-09-21T07:23:42.263649+0000","last_undegraded":"2024-09-21T07:23:42.263649+0000","last_fullsized":"2024-09-21T07:23:42.263649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:20.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228287+0000","last_change":"2024-09-21T07:23:42.245852+0000","last_active":"2024-09-21T07:23:43.228287+0000","last_peered":"2024-09-21T07:23:43.228287+0000","last_clean":"2024-09-21T07:23:43.228287+0000","last_became_active":"2024-09-21T07:23:42.245536+0000","last_became_peered":"2024-09-21T07:23:42.245536+0000","last_unstale":"2024-09-21T07:23:43.228287+0000","last_undegraded":"2024-09-21T07:23:43.228287+0000","last_fullsized":"2024-09-21T07:23:43.228287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:20.456618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.245885+0000","last_change":"2024-09-21T07:23:41.242064+0000","last_active":"2024-09-21T07:23:42.245885+0000","last_peered":"2024-09-21T07:23:42.245885+0000","last_clean":"2024-09-21T07:23:42.245885+0000","last_became_active":"2024-09-21T07:23:41.241745+0000","last_became_peered":"2024-09-21T07:23:41.241745+0000","last_unstale":"2024-09-21T07:23:42.245885+0000","last_undegraded":"2024-09-21T07:23:42.245885+0000","last_fullsized":"2024-09-21T07:23:42.245885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.255934+0000","last_change":"2024-09-21T07:23:42.249809+0000","last_active":"2024-09-21T07:23:42.255934+0000","last_peered":"2024-09-21T07:23:42.255934+0000","last_clean":"2024-09-21T07:23:42.255934+0000","last_became_active":"2024-09-21T07:23:42.249220+0000","last_became_peered":"2024-09-21T07:23:42.249220+0000","last_unstale":"2024-09-21T07:23:42.255934+0000","last_undegraded":"2024-09-21T07:23:42.255934+0000","last_fullsized":"2024-09-21T07:23:42.255934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:06.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.242562+0000","last_change":"2024-09-21T07:23:41.246426+0000","last_active":"2024-09-21T07:23:42.242562+0000","last_peered":"2024-09-21T07:23:42.242562+0000","last_clean":"2024-09-21T07:23:42.242562+0000","last_became_active":"2024-09-21T07:23:41.246065+0000","last_became_peered":"2024-09-21T07:23:41.246065+0000","last_unstale":"2024-09-21T07:23:42.242562+0000","last_undegraded":"2024-09-21T07:23:42.242562+0000","last_fullsized":"2024-09-21T07:23:42.242562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.244404+0000","last_change":"2024-09-21T07:23:42.235716+0000","last_active":"2024-09-21T07:23:42.244404+0000","last_peered":"2024-09-21T07:23:42.244404+0000","last_clean":"2024-09-21T07:23:42.244404+0000","last_became_active":"2024-09-21T07:23:42.235427+0000","last_became_peered":"2024-09-21T07:23:42.235427+0000","last_unstale":"2024-09-21T07:23:42.244404+0000","last_undegraded":"2024-09-21T07:23:42.244404+0000","last_fullsized":"2024-09-21T07:23:42.244404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.239587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.227834+0000","last_change":"2024-09-21T07:23:41.247133+0000","last_active":"2024-09-21T07:23:42.227834+0000","last_peered":"2024-09-21T07:23:42.227834+0000","last_clean":"2024-09-21T07:23:42.227834+0000","last_became_active":"2024-09-21T07:23:41.246822+0000","last_became_peered":"2024-09-21T07:23:41.246822+0000","last_unstale":"2024-09-21T07:23:42.227834+0000","last_undegraded":"2024-09-21T07:23:42.227834+0000","last_fullsized":"2024-09-21T07:23:42.227834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:27.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.257714+0000","last_change":"2024-09-21T07:23:42.245651+0000","last_active":"2024-09-21T07:23:42.257714+0000","last_peered":"2024-09-21T07:23:42.257714+0000","last_clean":"2024-09-21T07:23:42.257714+0000","last_became_active":"2024-09-21T07:23:42.245299+0000","last_became_peered":"2024-09-21T07:23:42.245299+0000","last_unstale":"2024-09-21T07:23:42.257714+0000","last_undegraded":"2024-09-21T07:23:42.257714+0000","last_fullsized":"2024-09-21T07:23:42.257714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.233440+0000","last_change":"2024-09-21T07:23:41.227126+0000","last_active":"2024-09-21T07:23:42.233440+0000","last_peered":"2024-09-21T07:23:42.233440+0000","last_clean":"2024-09-21T07:23:42.233440+0000","last_became_active":"2024-09-21T07:23:41.226786+0000","last_became_peered":"2024-09-21T07:23:41.226786+0000","last_unstale":"2024-09-21T07:23:42.233440+0000","last_undegraded":"2024-09-21T07:23:42.233440+0000","last_fullsized":"2024-09-21T07:23:42.233440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933798+0000","last_change":"2024-09-21T07:23:42.261691+0000","last_active":"2024-09-21T07:23:43.933798+0000","last_peered":"2024-09-21T07:23:43.933798+0000","last_clean":"2024-09-21T07:23:43.933798+0000","last_became_active":"2024-09-21T07:23:42.261363+0000","last_became_peered":"2024-09-21T07:23:42.261363+0000","last_unstale":"2024-09-21T07:23:43.933798+0000","last_undegraded":"2024-09-21T07:23:43.933798+0000","last_fullsized":"2024-09-21T07:23:43.933798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:19.442346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.226909+0000","last_change":"2024-09-21T07:23:41.236957+0000","last_active":"2024-09-21T07:23:43.226909+0000","last_peered":"2024-09-21T07:23:43.226909+0000","last_clean":"2024-09-21T07:23:43.226909+0000","last_became_active":"2024-09-21T07:23:41.236430+0000","last_became_peered":"2024-09-21T07:23:41.236430+0000","last_unstale":"2024-09-21T07:23:43.226909+0000","last_undegraded":"2024-09-21T07:23:43.226909+0000","last_fullsized":"2024-09-21T07:23:43.226909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:47.729765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T07:23:42.267870+0000","last_change":"2024-09-21T07:23:42.260141+0000","last_active":"2024-09-21T07:23:42.267870+0000","last_peered":"2024-09-21T07:23:42.267870+0000","last_clean":"2024-09-21T07:23:42.267870+0000","last_became_active":"2024-09-21T07:23:42.259782+0000","last_became_peered":"2024-09-21T07:23:42.259782+0000","last_unstale":"2024-09-21T07:23:42.267870+0000","last_undegraded":"2024-09-21T07:23:42.267870+0000","last_fullsized":"2024-09-21T07:23:42.267870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934047+0000","last_change":"2024-09-21T07:23:41.241484+0000","last_active":"2024-09-21T07:23:43.934047+0000","last_peered":"2024-09-21T07:23:43.934047+0000","last_clean":"2024-09-21T07:23:43.934047+0000","last_became_active":"2024-09-21T07:23:41.241073+0000","last_became_peered":"2024-09-21T07:23:41.241073+0000","last_unstale":"2024-09-21T07:23:43.934047+0000","last_undegraded":"2024-09-21T07:23:43.934047+0000","last_fullsized":"2024-09-21T07:23:43.934047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.411667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932277+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:23:43.932277+0000","last_peered":"2024-09-21T07:23:43.932277+0000","last_clean":"2024-09-21T07:23:43.932277+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:23:43.932277+0000","last_undegraded":"2024-09-21T07:23:43.932277+0000","last_fullsized":"2024-09-21T07:23:43.932277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":183245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":789154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":198750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:51.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 -- 172.21.15.64:0/2825914521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5690005160 msgr2=0x7f569000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2825914521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5690005160 0x7f569000b9d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0c6e40 tx=0x7f56a401d2a0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b0a00640 1 -- 172.21.15.64:0/2825914521 reap_dead start 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 -- 172.21.15.64:0/2825914521 shutdown_connections 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 -- 172.21.15.64:0/2825914521 >> 172.21.15.64:0/2825914521 conn(0x7f56ac0ccbe0 msgr2=0x7f56ac0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 -- 172.21.15.64:0/2825914521 shutdown_connections 2024-09-21T07:23:51.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.303+0000 7f56b2a00640 1 -- 172.21.15.64:0/2825914521 wait complete. 2024-09-21T07:23:51.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 Processor -- start 2024-09-21T07:23:51.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 -- start start 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5690005160 0x7f56ac0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56ac14f5c0 0x7f56ac160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0cb100 con 0x7f56ac15a4f0 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0b4420 con 0x7f56ac14f5c0 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.307+0000 7f56b2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac0cb280 con 0x7f5690005160 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38956/0 (socket says 172.21.15.64:38956) 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 -- 172.21.15.64:0/2270667912 learned_addr learned my addr 172.21.15.64:0/2270667912 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56abe00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5690005160 0x7f56ac0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56b0a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56ac14f5c0 0x7f56ac160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 -- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5690005160 msgr2=0x7f56ac0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5690005160 0x7f56ac0b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 -- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56ac14f5c0 msgr2=0x7f56ac160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56ac14f5c0 0x7f56ac160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 -- 172.21.15.64:0/2270667912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac0b0f70 con 0x7f56ac15a4f0 2024-09-21T07:23:51.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56ab400640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0cef00 tx=0x7f5698011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569801f070 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f569800fe40 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac0b1250 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698012690 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac14f9d0 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac1607c0 con 0x7f56ac15a4f0 2024-09-21T07:23:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.311+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5698022070 con 0x7f56ac15a4f0 2024-09-21T07:23:51.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.315+0000 7f56a3e00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 0x7f568c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.315+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5698094e60 con 0x7f56ac15a4f0 2024-09-21T07:23:51.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.315+0000 7f56abe00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 0x7f568c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.315+0000 7f56abe00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 0x7f568c075740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ad90 tx=0x7f569c00a2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:51.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.319+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f569805f600 con 0x7f56ac15a4f0 2024-09-21T07:23:51.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.495+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56ac0b0d00 con 0x7f568c073230 2024-09-21T07:23:51.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.499+0000 7f56a3e00640 1 -- 172.21.15.64:0/2270667912 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f56ac0b0d00 con 0x7f568c073230 2024-09-21T07:23:51.504 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:51.506 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 msgr2=0x7f568c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 0x7f568c075740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ad90 tx=0x7f569c00a2f0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 msgr2=0x7f56ac0c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0cef00 tx=0x7f5698011e10 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 shutdown_connections 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f568c073230 0x7f568c075740 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56ac14f5c0 0x7f56ac160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56ac15a4f0 0x7f56ac0c7c60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 --2- 172.21.15.64:0/2270667912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5690005160 0x7f56ac0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 >> 172.21.15.64:0/2270667912 conn(0x7f56ac0ccbe0 msgr2=0x7f56ac068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:51.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 shutdown_connections 2024-09-21T07:23:51.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.503+0000 7f56b2a00640 1 -- 172.21.15.64:0/2270667912 wait complete. 2024-09-21T07:23:51.526 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-09-21T07:23:51.433354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221032,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753688,"statfs":{"total":773094113280,"available":772867776512,"internally_reserved":0,"allocated":4890624,"data_stored":2762388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.208762"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228197+0000","last_change":"2024-09-21T07:23:42.255554+0000","last_active":"2024-09-21T07:23:43.228197+0000","last_peered":"2024-09-21T07:23:43.228197+0000","last_clean":"2024-09-21T07:23:43.228197+0000","last_became_active":"2024-09-21T07:23:42.255261+0000","last_became_peered":"2024-09-21T07:23:42.255261+0000","last_unstale":"2024-09-21T07:23:43.228197+0000","last_undegraded":"2024-09-21T07:23:43.228197+0000","last_fullsized":"2024-09-21T07:23:43.228197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:27.273473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228061+0000","last_change":"2024-09-21T07:23:42.268617+0000","last_active":"2024-09-21T07:23:43.228061+0000","last_peered":"2024-09-21T07:23:43.228061+0000","last_clean":"2024-09-21T07:23:43.228061+0000","last_became_active":"2024-09-21T07:23:42.266588+0000","last_became_peered":"2024-09-21T07:23:42.266588+0000","last_unstale":"2024-09-21T07:23:43.228061+0000","last_undegraded":"2024-09-21T07:23:43.228061+0000","last_fullsized":"2024-09-21T07:23:43.228061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:10.872544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932811+0000","last_change":"2024-09-21T07:23:42.262669+0000","last_active":"2024-09-21T07:23:43.932811+0000","last_peered":"2024-09-21T07:23:43.932811+0000","last_clean":"2024-09-21T07:23:43.932811+0000","last_became_active":"2024-09-21T07:23:42.262389+0000","last_became_peered":"2024-09-21T07:23:42.262389+0000","last_unstale":"2024-09-21T07:23:43.932811+0000","last_undegraded":"2024-09-21T07:23:43.932811+0000","last_fullsized":"2024-09-21T07:23:43.932811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:31.773982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932486+0000","last_change":"2024-09-21T07:23:42.261715+0000","last_active":"2024-09-21T07:23:43.932486+0000","last_peered":"2024-09-21T07:23:43.932486+0000","last_clean":"2024-09-21T07:23:43.932486+0000","last_became_active":"2024-09-21T07:23:42.261340+0000","last_became_peered":"2024-09-21T07:23:42.261340+0000","last_unstale":"2024-09-21T07:23:43.932486+0000","last_undegraded":"2024-09-21T07:23:43.932486+0000","last_fullsized":"2024-09-21T07:23:43.932486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:16.971426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932096+0000","last_change":"2024-09-21T07:23:42.262249+0000","last_active":"2024-09-21T07:23:43.932096+0000","last_peered":"2024-09-21T07:23:43.932096+0000","last_clean":"2024-09-21T07:23:43.932096+0000","last_became_active":"2024-09-21T07:23:42.261907+0000","last_became_peered":"2024-09-21T07:23:42.261907+0000","last_unstale":"2024-09-21T07:23:43.932096+0000","last_undegraded":"2024-09-21T07:23:43.932096+0000","last_fullsized":"2024-09-21T07:23:43.932096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:37.966472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227992+0000","last_change":"2024-09-21T07:23:42.235503+0000","last_active":"2024-09-21T07:23:43.227992+0000","last_peered":"2024-09-21T07:23:43.227992+0000","last_clean":"2024-09-21T07:23:43.227992+0000","last_became_active":"2024-09-21T07:23:42.235177+0000","last_became_peered":"2024-09-21T07:23:42.235177+0000","last_unstale":"2024-09-21T07:23:43.227992+0000","last_undegraded":"2024-09-21T07:23:43.227992+0000","last_fullsized":"2024-09-21T07:23:43.227992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:56.590062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932247+0000","last_change":"2024-09-21T07:23:42.252188+0000","last_active":"2024-09-21T07:23:43.932247+0000","last_peered":"2024-09-21T07:23:43.932247+0000","last_clean":"2024-09-21T07:23:43.932247+0000","last_became_active":"2024-09-21T07:23:42.251894+0000","last_became_peered":"2024-09-21T07:23:42.251894+0000","last_unstale":"2024-09-21T07:23:43.932247+0000","last_undegraded":"2024-09-21T07:23:43.932247+0000","last_fullsized":"2024-09-21T07:23:43.932247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:08.240039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227008+0000","last_change":"2024-09-21T07:23:42.266853+0000","last_active":"2024-09-21T07:23:43.227008+0000","last_peered":"2024-09-21T07:23:43.227008+0000","last_clean":"2024-09-21T07:23:43.227008+0000","last_became_active":"2024-09-21T07:23:42.266522+0000","last_became_peered":"2024-09-21T07:23:42.266522+0000","last_unstale":"2024-09-21T07:23:43.227008+0000","last_undegraded":"2024-09-21T07:23:43.227008+0000","last_fullsized":"2024-09-21T07:23:43.227008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:11.159426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932503+0000","last_change":"2024-09-21T07:23:42.264397+0000","last_active":"2024-09-21T07:23:43.932503+0000","last_peered":"2024-09-21T07:23:43.932503+0000","last_clean":"2024-09-21T07:23:43.932503+0000","last_became_active":"2024-09-21T07:23:42.264043+0000","last_became_peered":"2024-09-21T07:23:42.264043+0000","last_unstale":"2024-09-21T07:23:43.932503+0000","last_undegraded":"2024-09-21T07:23:43.932503+0000","last_fullsized":"2024-09-21T07:23:43.932503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933646+0000","last_change":"2024-09-21T07:23:42.268132+0000","last_active":"2024-09-21T07:23:43.933646+0000","last_peered":"2024-09-21T07:23:43.933646+0000","last_clean":"2024-09-21T07:23:43.933646+0000","last_became_active":"2024-09-21T07:23:42.267741+0000","last_became_peered":"2024-09-21T07:23:42.267741+0000","last_unstale":"2024-09-21T07:23:43.933646+0000","last_undegraded":"2024-09-21T07:23:43.933646+0000","last_fullsized":"2024-09-21T07:23:43.933646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:06.441178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932694+0000","last_change":"2024-09-21T07:23:42.264152+0000","last_active":"2024-09-21T07:23:43.932694+0000","last_peered":"2024-09-21T07:23:43.932694+0000","last_clean":"2024-09-21T07:23:43.932694+0000","last_became_active":"2024-09-21T07:23:42.263622+0000","last_became_peered":"2024-09-21T07:23:42.263622+0000","last_unstale":"2024-09-21T07:23:43.932694+0000","last_undegraded":"2024-09-21T07:23:43.932694+0000","last_fullsized":"2024-09-21T07:23:43.932694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:14.638760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932757+0000","last_change":"2024-09-21T07:23:42.260967+0000","last_active":"2024-09-21T07:23:43.932757+0000","last_peered":"2024-09-21T07:23:43.932757+0000","last_clean":"2024-09-21T07:23:43.932757+0000","last_became_active":"2024-09-21T07:23:42.260623+0000","last_became_peered":"2024-09-21T07:23:42.260623+0000","last_unstale":"2024-09-21T07:23:43.932757+0000","last_undegraded":"2024-09-21T07:23:43.932757+0000","last_fullsized":"2024-09-21T07:23:43.932757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932573+0000","last_change":"2024-09-21T07:23:42.269480+0000","last_active":"2024-09-21T07:23:43.932573+0000","last_peered":"2024-09-21T07:23:43.932573+0000","last_clean":"2024-09-21T07:23:43.932573+0000","last_became_active":"2024-09-21T07:23:42.269068+0000","last_became_peered":"2024-09-21T07:23:42.269068+0000","last_unstale":"2024-09-21T07:23:43.932573+0000","last_undegraded":"2024-09-21T07:23:43.932573+0000","last_fullsized":"2024-09-21T07:23:43.932573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:31.223965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931866+0000","last_change":"2024-09-21T07:23:42.243029+0000","last_active":"2024-09-21T07:23:43.931866+0000","last_peered":"2024-09-21T07:23:43.931866+0000","last_clean":"2024-09-21T07:23:43.931866+0000","last_became_active":"2024-09-21T07:23:42.242668+0000","last_became_peered":"2024-09-21T07:23:42.242668+0000","last_unstale":"2024-09-21T07:23:43.931866+0000","last_undegraded":"2024-09-21T07:23:43.931866+0000","last_fullsized":"2024-09-21T07:23:43.931866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932581+0000","last_change":"2024-09-21T07:23:42.265930+0000","last_active":"2024-09-21T07:23:43.932581+0000","last_peered":"2024-09-21T07:23:43.932581+0000","last_clean":"2024-09-21T07:23:43.932581+0000","last_became_active":"2024-09-21T07:23:42.265524+0000","last_became_peered":"2024-09-21T07:23:42.265524+0000","last_unstale":"2024-09-21T07:23:43.932581+0000","last_undegraded":"2024-09-21T07:23:43.932581+0000","last_fullsized":"2024-09-21T07:23:43.932581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:08.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932048+0000","last_change":"2024-09-21T07:23:42.264002+0000","last_active":"2024-09-21T07:23:43.932048+0000","last_peered":"2024-09-21T07:23:43.932048+0000","last_clean":"2024-09-21T07:23:43.932048+0000","last_became_active":"2024-09-21T07:23:42.263697+0000","last_became_peered":"2024-09-21T07:23:42.263697+0000","last_unstale":"2024-09-21T07:23:43.932048+0000","last_undegraded":"2024-09-21T07:23:43.932048+0000","last_fullsized":"2024-09-21T07:23:43.932048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:53.085465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933756+0000","last_change":"2024-09-21T07:23:42.263842+0000","last_active":"2024-09-21T07:23:43.933756+0000","last_peered":"2024-09-21T07:23:43.933756+0000","last_clean":"2024-09-21T07:23:43.933756+0000","last_became_active":"2024-09-21T07:23:42.263582+0000","last_became_peered":"2024-09-21T07:23:42.263582+0000","last_unstale":"2024-09-21T07:23:43.933756+0000","last_undegraded":"2024-09-21T07:23:43.933756+0000","last_fullsized":"2024-09-21T07:23:43.933756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:05.233687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228625+0000","last_change":"2024-09-21T07:23:42.244851+0000","last_active":"2024-09-21T07:23:43.228625+0000","last_peered":"2024-09-21T07:23:43.228625+0000","last_clean":"2024-09-21T07:23:43.228625+0000","last_became_active":"2024-09-21T07:23:42.244491+0000","last_became_peered":"2024-09-21T07:23:42.244491+0000","last_unstale":"2024-09-21T07:23:43.228625+0000","last_undegraded":"2024-09-21T07:23:43.228625+0000","last_fullsized":"2024-09-21T07:23:43.228625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:38.846952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931876+0000","last_change":"2024-09-21T07:23:42.254476+0000","last_active":"2024-09-21T07:23:43.931876+0000","last_peered":"2024-09-21T07:23:43.931876+0000","last_clean":"2024-09-21T07:23:43.931876+0000","last_became_active":"2024-09-21T07:23:42.253980+0000","last_became_peered":"2024-09-21T07:23:42.253980+0000","last_unstale":"2024-09-21T07:23:43.931876+0000","last_undegraded":"2024-09-21T07:23:43.931876+0000","last_fullsized":"2024-09-21T07:23:43.931876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:19.105176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228087+0000","last_change":"2024-09-21T07:23:42.244122+0000","last_active":"2024-09-21T07:23:43.228087+0000","last_peered":"2024-09-21T07:23:43.228087+0000","last_clean":"2024-09-21T07:23:43.228087+0000","last_became_active":"2024-09-21T07:23:42.243673+0000","last_became_peered":"2024-09-21T07:23:42.243673+0000","last_unstale":"2024-09-21T07:23:43.228087+0000","last_undegraded":"2024-09-21T07:23:43.228087+0000","last_fullsized":"2024-09-21T07:23:43.228087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:41.136260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932907+0000","last_change":"2024-09-21T07:23:42.253068+0000","last_active":"2024-09-21T07:23:43.932907+0000","last_peered":"2024-09-21T07:23:43.932907+0000","last_clean":"2024-09-21T07:23:43.932907+0000","last_became_active":"2024-09-21T07:23:42.252729+0000","last_became_peered":"2024-09-21T07:23:42.252729+0000","last_unstale":"2024-09-21T07:23:43.932907+0000","last_undegraded":"2024-09-21T07:23:43.932907+0000","last_fullsized":"2024-09-21T07:23:43.932907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:07.496037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933362+0000","last_change":"2024-09-21T07:23:42.251107+0000","last_active":"2024-09-21T07:23:43.933362+0000","last_peered":"2024-09-21T07:23:43.933362+0000","last_clean":"2024-09-21T07:23:43.933362+0000","last_became_active":"2024-09-21T07:23:42.248543+0000","last_became_peered":"2024-09-21T07:23:42.248543+0000","last_unstale":"2024-09-21T07:23:43.933362+0000","last_undegraded":"2024-09-21T07:23:43.933362+0000","last_fullsized":"2024-09-21T07:23:43.933362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931919+0000","last_change":"2024-09-21T07:23:42.252833+0000","last_active":"2024-09-21T07:23:43.931919+0000","last_peered":"2024-09-21T07:23:43.931919+0000","last_clean":"2024-09-21T07:23:43.931919+0000","last_became_active":"2024-09-21T07:23:42.252311+0000","last_became_peered":"2024-09-21T07:23:42.252311+0000","last_unstale":"2024-09-21T07:23:43.931919+0000","last_undegraded":"2024-09-21T07:23:43.931919+0000","last_fullsized":"2024-09-21T07:23:43.931919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:17.561151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931713+0000","last_change":"2024-09-21T07:23:42.263299+0000","last_active":"2024-09-21T07:23:43.931713+0000","last_peered":"2024-09-21T07:23:43.931713+0000","last_clean":"2024-09-21T07:23:43.931713+0000","last_became_active":"2024-09-21T07:23:42.259857+0000","last_became_peered":"2024-09-21T07:23:42.259857+0000","last_unstale":"2024-09-21T07:23:43.931713+0000","last_undegraded":"2024-09-21T07:23:43.931713+0000","last_fullsized":"2024-09-21T07:23:43.931713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:35.142463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228684+0000","last_change":"2024-09-21T07:23:42.255686+0000","last_active":"2024-09-21T07:23:43.228684+0000","last_peered":"2024-09-21T07:23:43.228684+0000","last_clean":"2024-09-21T07:23:43.228684+0000","last_became_active":"2024-09-21T07:23:42.255269+0000","last_became_peered":"2024-09-21T07:23:42.255269+0000","last_unstale":"2024-09-21T07:23:43.228684+0000","last_undegraded":"2024-09-21T07:23:43.228684+0000","last_fullsized":"2024-09-21T07:23:43.228684+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:42.924146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.229289+0000","last_change":"2024-09-21T07:23:42.260742+0000","last_active":"2024-09-21T07:23:43.229289+0000","last_peered":"2024-09-21T07:23:43.229289+0000","last_clean":"2024-09-21T07:23:43.229289+0000","last_became_active":"2024-09-21T07:23:42.260474+0000","last_became_peered":"2024-09-21T07:23:42.260474+0000","last_unstale":"2024-09-21T07:23:43.229289+0000","last_undegraded":"2024-09-21T07:23:43.229289+0000","last_fullsized":"2024-09-21T07:23:43.229289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:32.356129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228301+0000","last_change":"2024-09-21T07:23:42.265850+0000","last_active":"2024-09-21T07:23:43.228301+0000","last_peered":"2024-09-21T07:23:43.228301+0000","last_clean":"2024-09-21T07:23:43.228301+0000","last_became_active":"2024-09-21T07:23:42.265462+0000","last_became_peered":"2024-09-21T07:23:42.265462+0000","last_unstale":"2024-09-21T07:23:43.228301+0000","last_undegraded":"2024-09-21T07:23:43.228301+0000","last_fullsized":"2024-09-21T07:23:43.228301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:39.295799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933391+0000","last_change":"2024-09-21T07:23:42.258580+0000","last_active":"2024-09-21T07:23:43.933391+0000","last_peered":"2024-09-21T07:23:43.933391+0000","last_clean":"2024-09-21T07:23:43.933391+0000","last_became_active":"2024-09-21T07:23:42.258317+0000","last_became_peered":"2024-09-21T07:23:42.258317+0000","last_unstale":"2024-09-21T07:23:43.933391+0000","last_undegraded":"2024-09-21T07:23:43.933391+0000","last_fullsized":"2024-09-21T07:23:43.933391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:25.296531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227991+0000","last_change":"2024-09-21T07:23:42.240018+0000","last_active":"2024-09-21T07:23:43.227991+0000","last_peered":"2024-09-21T07:23:43.227991+0000","last_clean":"2024-09-21T07:23:43.227991+0000","last_became_active":"2024-09-21T07:23:42.239526+0000","last_became_peered":"2024-09-21T07:23:42.239526+0000","last_unstale":"2024-09-21T07:23:43.227991+0000","last_undegraded":"2024-09-21T07:23:43.227991+0000","last_fullsized":"2024-09-21T07:23:43.227991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:58.283019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227877+0000","last_change":"2024-09-21T07:23:42.236369+0000","last_active":"2024-09-21T07:23:43.227877+0000","last_peered":"2024-09-21T07:23:43.227877+0000","last_clean":"2024-09-21T07:23:43.227877+0000","last_became_active":"2024-09-21T07:23:42.235993+0000","last_became_peered":"2024-09-21T07:23:42.235993+0000","last_unstale":"2024-09-21T07:23:43.227877+0000","last_undegraded":"2024-09-21T07:23:43.227877+0000","last_fullsized":"2024-09-21T07:23:43.227877+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:41.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931942+0000","last_change":"2024-09-21T07:23:42.253118+0000","last_active":"2024-09-21T07:23:43.931942+0000","last_peered":"2024-09-21T07:23:43.931942+0000","last_clean":"2024-09-21T07:23:43.931942+0000","last_became_active":"2024-09-21T07:23:42.252424+0000","last_became_peered":"2024-09-21T07:23:42.252424+0000","last_unstale":"2024-09-21T07:23:43.931942+0000","last_undegraded":"2024-09-21T07:23:43.931942+0000","last_fullsized":"2024-09-21T07:23:43.931942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:25.901649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228071+0000","last_change":"2024-09-21T07:23:42.248019+0000","last_active":"2024-09-21T07:23:43.228071+0000","last_peered":"2024-09-21T07:23:43.228071+0000","last_clean":"2024-09-21T07:23:43.228071+0000","last_became_active":"2024-09-21T07:23:42.247618+0000","last_became_peered":"2024-09-21T07:23:42.247618+0000","last_unstale":"2024-09-21T07:23:43.228071+0000","last_undegraded":"2024-09-21T07:23:43.228071+0000","last_fullsized":"2024-09-21T07:23:43.228071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:52.956884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933783+0000","last_change":"2024-09-21T07:23:42.263935+0000","last_active":"2024-09-21T07:23:43.933783+0000","last_peered":"2024-09-21T07:23:43.933783+0000","last_clean":"2024-09-21T07:23:43.933783+0000","last_became_active":"2024-09-21T07:23:42.263578+0000","last_became_peered":"2024-09-21T07:23:42.263578+0000","last_unstale":"2024-09-21T07:23:43.933783+0000","last_undegraded":"2024-09-21T07:23:43.933783+0000","last_fullsized":"2024-09-21T07:23:43.933783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:38.708823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228688+0000","last_change":"2024-09-21T07:23:41.229683+0000","last_active":"2024-09-21T07:23:43.228688+0000","last_peered":"2024-09-21T07:23:43.228688+0000","last_clean":"2024-09-21T07:23:43.228688+0000","last_became_active":"2024-09-21T07:23:41.229300+0000","last_became_peered":"2024-09-21T07:23:41.229300+0000","last_unstale":"2024-09-21T07:23:43.228688+0000","last_undegraded":"2024-09-21T07:23:43.228688+0000","last_fullsized":"2024-09-21T07:23:43.228688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.229229+0000","last_change":"2024-09-21T07:23:42.265994+0000","last_active":"2024-09-21T07:23:43.229229+0000","last_peered":"2024-09-21T07:23:43.229229+0000","last_clean":"2024-09-21T07:23:43.229229+0000","last_became_active":"2024-09-21T07:23:42.265634+0000","last_became_peered":"2024-09-21T07:23:42.265634+0000","last_unstale":"2024-09-21T07:23:43.229229+0000","last_undegraded":"2024-09-21T07:23:43.229229+0000","last_fullsized":"2024-09-21T07:23:43.229229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:58.868537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932599+0000","last_change":"2024-09-21T07:23:41.247293+0000","last_active":"2024-09-21T07:23:43.932599+0000","last_peered":"2024-09-21T07:23:43.932599+0000","last_clean":"2024-09-21T07:23:43.932599+0000","last_became_active":"2024-09-21T07:23:41.246932+0000","last_became_peered":"2024-09-21T07:23:41.246932+0000","last_unstale":"2024-09-21T07:23:43.932599+0000","last_undegraded":"2024-09-21T07:23:43.932599+0000","last_fullsized":"2024-09-21T07:23:43.932599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933576+0000","last_change":"2024-09-21T07:23:42.243789+0000","last_active":"2024-09-21T07:23:43.933576+0000","last_peered":"2024-09-21T07:23:43.933576+0000","last_clean":"2024-09-21T07:23:43.933576+0000","last_became_active":"2024-09-21T07:23:42.243092+0000","last_became_peered":"2024-09-21T07:23:42.243092+0000","last_unstale":"2024-09-21T07:23:43.933576+0000","last_undegraded":"2024-09-21T07:23:43.933576+0000","last_fullsized":"2024-09-21T07:23:43.933576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:38.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.229331+0000","last_change":"2024-09-21T07:23:41.231067+0000","last_active":"2024-09-21T07:23:43.229331+0000","last_peered":"2024-09-21T07:23:43.229331+0000","last_clean":"2024-09-21T07:23:43.229331+0000","last_became_active":"2024-09-21T07:23:41.230264+0000","last_became_peered":"2024-09-21T07:23:41.230264+0000","last_unstale":"2024-09-21T07:23:43.229331+0000","last_undegraded":"2024-09-21T07:23:43.229331+0000","last_fullsized":"2024-09-21T07:23:43.229331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.104337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228515+0000","last_change":"2024-09-21T07:23:42.234322+0000","last_active":"2024-09-21T07:23:43.228515+0000","last_peered":"2024-09-21T07:23:43.228515+0000","last_clean":"2024-09-21T07:23:43.228515+0000","last_became_active":"2024-09-21T07:23:42.233980+0000","last_became_peered":"2024-09-21T07:23:42.233980+0000","last_unstale":"2024-09-21T07:23:43.228515+0000","last_undegraded":"2024-09-21T07:23:43.228515+0000","last_fullsized":"2024-09-21T07:23:43.228515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:16.938026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933044+0000","last_change":"2024-09-21T07:23:41.227352+0000","last_active":"2024-09-21T07:23:43.933044+0000","last_peered":"2024-09-21T07:23:43.933044+0000","last_clean":"2024-09-21T07:23:43.933044+0000","last_became_active":"2024-09-21T07:23:41.226996+0000","last_became_peered":"2024-09-21T07:23:41.226996+0000","last_unstale":"2024-09-21T07:23:43.933044+0000","last_undegraded":"2024-09-21T07:23:43.933044+0000","last_fullsized":"2024-09-21T07:23:43.933044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:41.257887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931591+0000","last_change":"2024-09-21T07:23:42.249480+0000","last_active":"2024-09-21T07:23:43.931591+0000","last_peered":"2024-09-21T07:23:43.931591+0000","last_clean":"2024-09-21T07:23:43.931591+0000","last_became_active":"2024-09-21T07:23:42.247629+0000","last_became_peered":"2024-09-21T07:23:42.247629+0000","last_unstale":"2024-09-21T07:23:43.931591+0000","last_undegraded":"2024-09-21T07:23:43.931591+0000","last_fullsized":"2024-09-21T07:23:43.931591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933145+0000","last_change":"2024-09-21T07:23:41.247247+0000","last_active":"2024-09-21T07:23:43.933145+0000","last_peered":"2024-09-21T07:23:43.933145+0000","last_clean":"2024-09-21T07:23:43.933145+0000","last_became_active":"2024-09-21T07:23:41.246933+0000","last_became_peered":"2024-09-21T07:23:41.246933+0000","last_unstale":"2024-09-21T07:23:43.933145+0000","last_undegraded":"2024-09-21T07:23:43.933145+0000","last_fullsized":"2024-09-21T07:23:43.933145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:24.210839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934808+0000","last_change":"2024-09-21T07:23:42.257399+0000","last_active":"2024-09-21T07:23:43.934808+0000","last_peered":"2024-09-21T07:23:43.934808+0000","last_clean":"2024-09-21T07:23:43.934808+0000","last_became_active":"2024-09-21T07:23:42.253176+0000","last_became_peered":"2024-09-21T07:23:42.253176+0000","last_unstale":"2024-09-21T07:23:43.934808+0000","last_undegraded":"2024-09-21T07:23:43.934808+0000","last_fullsized":"2024-09-21T07:23:43.934808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:41.517704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933501+0000","last_change":"2024-09-21T07:23:41.241248+0000","last_active":"2024-09-21T07:23:43.933501+0000","last_peered":"2024-09-21T07:23:43.933501+0000","last_clean":"2024-09-21T07:23:43.933501+0000","last_became_active":"2024-09-21T07:23:41.239401+0000","last_became_peered":"2024-09-21T07:23:41.239401+0000","last_unstale":"2024-09-21T07:23:43.933501+0000","last_undegraded":"2024-09-21T07:23:43.933501+0000","last_fullsized":"2024-09-21T07:23:43.933501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:54.164229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933703+0000","last_change":"2024-09-21T07:23:42.257444+0000","last_active":"2024-09-21T07:23:43.933703+0000","last_peered":"2024-09-21T07:23:43.933703+0000","last_clean":"2024-09-21T07:23:43.933703+0000","last_became_active":"2024-09-21T07:23:42.257148+0000","last_became_peered":"2024-09-21T07:23:42.257148+0000","last_unstale":"2024-09-21T07:23:43.933703+0000","last_undegraded":"2024-09-21T07:23:43.933703+0000","last_fullsized":"2024-09-21T07:23:43.933703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:27.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228407+0000","last_change":"2024-09-21T07:23:41.241097+0000","last_active":"2024-09-21T07:23:43.228407+0000","last_peered":"2024-09-21T07:23:43.228407+0000","last_clean":"2024-09-21T07:23:43.228407+0000","last_became_active":"2024-09-21T07:23:41.240725+0000","last_became_peered":"2024-09-21T07:23:41.240725+0000","last_unstale":"2024-09-21T07:23:43.228407+0000","last_undegraded":"2024-09-21T07:23:43.228407+0000","last_fullsized":"2024-09-21T07:23:43.228407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:55.998354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227350+0000","last_change":"2024-09-21T07:23:42.244204+0000","last_active":"2024-09-21T07:23:43.227350+0000","last_peered":"2024-09-21T07:23:43.227350+0000","last_clean":"2024-09-21T07:23:43.227350+0000","last_became_active":"2024-09-21T07:23:42.243508+0000","last_became_peered":"2024-09-21T07:23:42.243508+0000","last_unstale":"2024-09-21T07:23:43.227350+0000","last_undegraded":"2024-09-21T07:23:43.227350+0000","last_fullsized":"2024-09-21T07:23:43.227350+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:47.620741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931724+0000","last_change":"2024-09-21T07:23:41.224843+0000","last_active":"2024-09-21T07:23:43.931724+0000","last_peered":"2024-09-21T07:23:43.931724+0000","last_clean":"2024-09-21T07:23:43.931724+0000","last_became_active":"2024-09-21T07:23:41.224463+0000","last_became_peered":"2024-09-21T07:23:41.224463+0000","last_unstale":"2024-09-21T07:23:43.931724+0000","last_undegraded":"2024-09-21T07:23:43.931724+0000","last_fullsized":"2024-09-21T07:23:43.931724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932752+0000","last_change":"2024-09-21T07:23:42.259678+0000","last_active":"2024-09-21T07:23:43.932752+0000","last_peered":"2024-09-21T07:23:43.932752+0000","last_clean":"2024-09-21T07:23:43.932752+0000","last_became_active":"2024-09-21T07:23:42.259361+0000","last_became_peered":"2024-09-21T07:23:42.259361+0000","last_unstale":"2024-09-21T07:23:43.932752+0000","last_undegraded":"2024-09-21T07:23:43.932752+0000","last_fullsized":"2024-09-21T07:23:43.932752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:46.565519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228267+0000","last_change":"2024-09-21T07:23:41.235950+0000","last_active":"2024-09-21T07:23:43.228267+0000","last_peered":"2024-09-21T07:23:43.228267+0000","last_clean":"2024-09-21T07:23:43.228267+0000","last_became_active":"2024-09-21T07:23:41.235394+0000","last_became_peered":"2024-09-21T07:23:41.235394+0000","last_unstale":"2024-09-21T07:23:43.228267+0000","last_undegraded":"2024-09-21T07:23:43.228267+0000","last_fullsized":"2024-09-21T07:23:43.228267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:17.728100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934254+0000","last_change":"2024-09-21T07:23:42.263933+0000","last_active":"2024-09-21T07:23:43.934254+0000","last_peered":"2024-09-21T07:23:43.934254+0000","last_clean":"2024-09-21T07:23:43.934254+0000","last_became_active":"2024-09-21T07:23:42.262617+0000","last_became_peered":"2024-09-21T07:23:42.262617+0000","last_unstale":"2024-09-21T07:23:43.934254+0000","last_undegraded":"2024-09-21T07:23:43.934254+0000","last_fullsized":"2024-09-21T07:23:43.934254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:11.159426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934035+0000","last_change":"2024-09-21T07:23:41.245321+0000","last_active":"2024-09-21T07:23:43.934035+0000","last_peered":"2024-09-21T07:23:43.934035+0000","last_clean":"2024-09-21T07:23:43.934035+0000","last_became_active":"2024-09-21T07:23:41.244908+0000","last_became_peered":"2024-09-21T07:23:41.244908+0000","last_unstale":"2024-09-21T07:23:43.934035+0000","last_undegraded":"2024-09-21T07:23:43.934035+0000","last_fullsized":"2024-09-21T07:23:43.934035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:18.079641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932395+0000","last_change":"2024-09-21T07:23:42.255482+0000","last_active":"2024-09-21T07:23:43.932395+0000","last_peered":"2024-09-21T07:23:43.932395+0000","last_clean":"2024-09-21T07:23:43.932395+0000","last_became_active":"2024-09-21T07:23:42.255181+0000","last_became_peered":"2024-09-21T07:23:42.255181+0000","last_unstale":"2024-09-21T07:23:43.932395+0000","last_undegraded":"2024-09-21T07:23:43.932395+0000","last_fullsized":"2024-09-21T07:23:43.932395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:20.080918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932938+0000","last_change":"2024-09-21T07:23:41.241070+0000","last_active":"2024-09-21T07:23:43.932938+0000","last_peered":"2024-09-21T07:23:43.932938+0000","last_clean":"2024-09-21T07:23:43.932938+0000","last_became_active":"2024-09-21T07:23:41.240700+0000","last_became_peered":"2024-09-21T07:23:41.240700+0000","last_unstale":"2024-09-21T07:23:43.932938+0000","last_undegraded":"2024-09-21T07:23:43.932938+0000","last_fullsized":"2024-09-21T07:23:43.932938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:38.885316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932951+0000","last_change":"2024-09-21T07:23:42.267128+0000","last_active":"2024-09-21T07:23:43.932951+0000","last_peered":"2024-09-21T07:23:43.932951+0000","last_clean":"2024-09-21T07:23:43.932951+0000","last_became_active":"2024-09-21T07:23:42.266152+0000","last_became_peered":"2024-09-21T07:23:42.266152+0000","last_unstale":"2024-09-21T07:23:43.932951+0000","last_undegraded":"2024-09-21T07:23:43.932951+0000","last_fullsized":"2024-09-21T07:23:43.932951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227921+0000","last_change":"2024-09-21T07:23:41.243511+0000","last_active":"2024-09-21T07:23:43.227921+0000","last_peered":"2024-09-21T07:23:43.227921+0000","last_clean":"2024-09-21T07:23:43.227921+0000","last_became_active":"2024-09-21T07:23:41.242856+0000","last_became_peered":"2024-09-21T07:23:41.242856+0000","last_unstale":"2024-09-21T07:23:43.227921+0000","last_undegraded":"2024-09-21T07:23:43.227921+0000","last_fullsized":"2024-09-21T07:23:43.227921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:47.278861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931590+0000","last_change":"2024-09-21T07:23:42.264392+0000","last_active":"2024-09-21T07:23:43.931590+0000","last_peered":"2024-09-21T07:23:43.931590+0000","last_clean":"2024-09-21T07:23:43.931590+0000","last_became_active":"2024-09-21T07:23:42.264071+0000","last_became_peered":"2024-09-21T07:23:42.264071+0000","last_unstale":"2024-09-21T07:23:43.931590+0000","last_undegraded":"2024-09-21T07:23:43.931590+0000","last_fullsized":"2024-09-21T07:23:43.931590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:19.553715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227530+0000","last_change":"2024-09-21T07:23:41.247444+0000","last_active":"2024-09-21T07:23:43.227530+0000","last_peered":"2024-09-21T07:23:43.227530+0000","last_clean":"2024-09-21T07:23:43.227530+0000","last_became_active":"2024-09-21T07:23:41.246981+0000","last_became_peered":"2024-09-21T07:23:41.246981+0000","last_unstale":"2024-09-21T07:23:43.227530+0000","last_undegraded":"2024-09-21T07:23:43.227530+0000","last_fullsized":"2024-09-21T07:23:43.227530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.315666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227062+0000","last_change":"2024-09-21T07:23:42.250954+0000","last_active":"2024-09-21T07:23:43.227062+0000","last_peered":"2024-09-21T07:23:43.227062+0000","last_clean":"2024-09-21T07:23:43.227062+0000","last_became_active":"2024-09-21T07:23:42.250645+0000","last_became_peered":"2024-09-21T07:23:42.250645+0000","last_unstale":"2024-09-21T07:23:43.227062+0000","last_undegraded":"2024-09-21T07:23:43.227062+0000","last_fullsized":"2024-09-21T07:23:43.227062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:19.105860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228201+0000","last_change":"2024-09-21T07:23:41.237332+0000","last_active":"2024-09-21T07:23:43.228201+0000","last_peered":"2024-09-21T07:23:43.228201+0000","last_clean":"2024-09-21T07:23:43.228201+0000","last_became_active":"2024-09-21T07:23:41.236953+0000","last_became_peered":"2024-09-21T07:23:41.236953+0000","last_unstale":"2024-09-21T07:23:43.228201+0000","last_undegraded":"2024-09-21T07:23:43.228201+0000","last_fullsized":"2024-09-21T07:23:43.228201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:43.800815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932425+0000","last_change":"2024-09-21T07:23:42.253616+0000","last_active":"2024-09-21T07:23:43.932425+0000","last_peered":"2024-09-21T07:23:43.932425+0000","last_clean":"2024-09-21T07:23:43.932425+0000","last_became_active":"2024-09-21T07:23:42.253285+0000","last_became_peered":"2024-09-21T07:23:42.253285+0000","last_unstale":"2024-09-21T07:23:43.932425+0000","last_undegraded":"2024-09-21T07:23:43.932425+0000","last_fullsized":"2024-09-21T07:23:43.932425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:19.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227819+0000","last_change":"2024-09-21T07:23:41.228019+0000","last_active":"2024-09-21T07:23:43.227819+0000","last_peered":"2024-09-21T07:23:43.227819+0000","last_clean":"2024-09-21T07:23:43.227819+0000","last_became_active":"2024-09-21T07:23:41.227689+0000","last_became_peered":"2024-09-21T07:23:41.227689+0000","last_unstale":"2024-09-21T07:23:43.227819+0000","last_undegraded":"2024-09-21T07:23:43.227819+0000","last_fullsized":"2024-09-21T07:23:43.227819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:20.597221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227374+0000","last_change":"2024-09-21T07:23:42.254634+0000","last_active":"2024-09-21T07:23:43.227374+0000","last_peered":"2024-09-21T07:23:43.227374+0000","last_clean":"2024-09-21T07:23:43.227374+0000","last_became_active":"2024-09-21T07:23:42.254323+0000","last_became_peered":"2024-09-21T07:23:42.254323+0000","last_unstale":"2024-09-21T07:23:43.227374+0000","last_undegraded":"2024-09-21T07:23:43.227374+0000","last_fullsized":"2024-09-21T07:23:43.227374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:09.883815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932128+0000","last_change":"2024-09-21T07:23:41.242205+0000","last_active":"2024-09-21T07:23:43.932128+0000","last_peered":"2024-09-21T07:23:43.932128+0000","last_clean":"2024-09-21T07:23:43.932128+0000","last_became_active":"2024-09-21T07:23:41.240901+0000","last_became_peered":"2024-09-21T07:23:41.240901+0000","last_unstale":"2024-09-21T07:23:43.932128+0000","last_undegraded":"2024-09-21T07:23:43.932128+0000","last_fullsized":"2024-09-21T07:23:43.932128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:45.624931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227943+0000","last_change":"2024-09-21T07:23:42.234158+0000","last_active":"2024-09-21T07:23:43.227943+0000","last_peered":"2024-09-21T07:23:43.227943+0000","last_clean":"2024-09-21T07:23:43.227943+0000","last_became_active":"2024-09-21T07:23:42.233834+0000","last_became_peered":"2024-09-21T07:23:42.233834+0000","last_unstale":"2024-09-21T07:23:43.227943+0000","last_undegraded":"2024-09-21T07:23:43.227943+0000","last_fullsized":"2024-09-21T07:23:43.227943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:34.238598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933300+0000","last_change":"2024-09-21T07:23:41.241933+0000","last_active":"2024-09-21T07:23:43.933300+0000","last_peered":"2024-09-21T07:23:43.933300+0000","last_clean":"2024-09-21T07:23:43.933300+0000","last_became_active":"2024-09-21T07:23:41.241652+0000","last_became_peered":"2024-09-21T07:23:41.241652+0000","last_unstale":"2024-09-21T07:23:43.933300+0000","last_undegraded":"2024-09-21T07:23:43.933300+0000","last_fullsized":"2024-09-21T07:23:43.933300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:33.390195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932983+0000","last_change":"2024-09-21T07:23:42.261384+0000","last_active":"2024-09-21T07:23:43.932983+0000","last_peered":"2024-09-21T07:23:43.932983+0000","last_clean":"2024-09-21T07:23:43.932983+0000","last_became_active":"2024-09-21T07:23:42.260641+0000","last_became_peered":"2024-09-21T07:23:42.260641+0000","last_unstale":"2024-09-21T07:23:43.932983+0000","last_undegraded":"2024-09-21T07:23:43.932983+0000","last_fullsized":"2024-09-21T07:23:43.932983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:59.941589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933759+0000","last_change":"2024-09-21T07:23:41.238947+0000","last_active":"2024-09-21T07:23:43.933759+0000","last_peered":"2024-09-21T07:23:43.933759+0000","last_clean":"2024-09-21T07:23:43.933759+0000","last_became_active":"2024-09-21T07:23:41.238569+0000","last_became_peered":"2024-09-21T07:23:41.238569+0000","last_unstale":"2024-09-21T07:23:43.933759+0000","last_undegraded":"2024-09-21T07:23:43.933759+0000","last_fullsized":"2024-09-21T07:23:43.933759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:30.241788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933320+0000","last_change":"2024-09-21T07:23:42.244113+0000","last_active":"2024-09-21T07:23:43.933320+0000","last_peered":"2024-09-21T07:23:43.933320+0000","last_clean":"2024-09-21T07:23:43.933320+0000","last_became_active":"2024-09-21T07:23:42.243505+0000","last_became_peered":"2024-09-21T07:23:42.243505+0000","last_unstale":"2024-09-21T07:23:43.933320+0000","last_undegraded":"2024-09-21T07:23:43.933320+0000","last_fullsized":"2024-09-21T07:23:43.933320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:01.210894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932121+0000","last_change":"2024-09-21T07:23:41.239340+0000","last_active":"2024-09-21T07:23:43.932121+0000","last_peered":"2024-09-21T07:23:43.932121+0000","last_clean":"2024-09-21T07:23:43.932121+0000","last_became_active":"2024-09-21T07:23:41.238977+0000","last_became_peered":"2024-09-21T07:23:41.238977+0000","last_unstale":"2024-09-21T07:23:43.932121+0000","last_undegraded":"2024-09-21T07:23:43.932121+0000","last_fullsized":"2024-09-21T07:23:43.932121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932666+0000","last_change":"2024-09-21T07:23:42.258030+0000","last_active":"2024-09-21T07:23:43.932666+0000","last_peered":"2024-09-21T07:23:43.932666+0000","last_clean":"2024-09-21T07:23:43.932666+0000","last_became_active":"2024-09-21T07:23:42.256792+0000","last_became_peered":"2024-09-21T07:23:42.256792+0000","last_unstale":"2024-09-21T07:23:43.932666+0000","last_undegraded":"2024-09-21T07:23:43.932666+0000","last_fullsized":"2024-09-21T07:23:43.932666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.669384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.229031+0000","last_change":"2024-09-21T07:23:41.244419+0000","last_active":"2024-09-21T07:23:43.229031+0000","last_peered":"2024-09-21T07:23:43.229031+0000","last_clean":"2024-09-21T07:23:43.229031+0000","last_became_active":"2024-09-21T07:23:41.242477+0000","last_became_peered":"2024-09-21T07:23:41.242477+0000","last_unstale":"2024-09-21T07:23:43.229031+0000","last_undegraded":"2024-09-21T07:23:43.229031+0000","last_fullsized":"2024-09-21T07:23:43.229031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.513475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932301+0000","last_change":"2024-09-21T07:23:42.247642+0000","last_active":"2024-09-21T07:23:43.932301+0000","last_peered":"2024-09-21T07:23:43.932301+0000","last_clean":"2024-09-21T07:23:43.932301+0000","last_became_active":"2024-09-21T07:23:42.247295+0000","last_became_peered":"2024-09-21T07:23:42.247295+0000","last_unstale":"2024-09-21T07:23:43.932301+0000","last_undegraded":"2024-09-21T07:23:43.932301+0000","last_fullsized":"2024-09-21T07:23:43.932301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:03.292519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932284+0000","last_change":"2024-09-21T07:23:41.249080+0000","last_active":"2024-09-21T07:23:43.932284+0000","last_peered":"2024-09-21T07:23:43.932284+0000","last_clean":"2024-09-21T07:23:43.932284+0000","last_became_active":"2024-09-21T07:23:41.247666+0000","last_became_peered":"2024-09-21T07:23:41.247666+0000","last_unstale":"2024-09-21T07:23:43.932284+0000","last_undegraded":"2024-09-21T07:23:43.932284+0000","last_fullsized":"2024-09-21T07:23:43.932284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.522254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931762+0000","last_change":"2024-09-21T07:23:42.248515+0000","last_active":"2024-09-21T07:23:43.931762+0000","last_peered":"2024-09-21T07:23:43.931762+0000","last_clean":"2024-09-21T07:23:43.931762+0000","last_became_active":"2024-09-21T07:23:42.248201+0000","last_became_peered":"2024-09-21T07:23:42.248201+0000","last_unstale":"2024-09-21T07:23:43.931762+0000","last_undegraded":"2024-09-21T07:23:43.931762+0000","last_fullsized":"2024-09-21T07:23:43.931762+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931867+0000","last_change":"2024-09-21T07:23:41.238957+0000","last_active":"2024-09-21T07:23:43.931867+0000","last_peered":"2024-09-21T07:23:43.931867+0000","last_clean":"2024-09-21T07:23:43.931867+0000","last_became_active":"2024-09-21T07:23:41.237652+0000","last_became_peered":"2024-09-21T07:23:41.237652+0000","last_unstale":"2024-09-21T07:23:43.931867+0000","last_undegraded":"2024-09-21T07:23:43.931867+0000","last_fullsized":"2024-09-21T07:23:43.931867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:32.394414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932706+0000","last_change":"2024-09-21T07:23:42.250508+0000","last_active":"2024-09-21T07:23:43.932706+0000","last_peered":"2024-09-21T07:23:43.932706+0000","last_clean":"2024-09-21T07:23:43.932706+0000","last_became_active":"2024-09-21T07:23:42.249128+0000","last_became_peered":"2024-09-21T07:23:42.249128+0000","last_unstale":"2024-09-21T07:23:43.932706+0000","last_undegraded":"2024-09-21T07:23:43.932706+0000","last_fullsized":"2024-09-21T07:23:43.932706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:46.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932858+0000","last_change":"2024-09-21T07:23:41.242637+0000","last_active":"2024-09-21T07:23:43.932858+0000","last_peered":"2024-09-21T07:23:43.932858+0000","last_clean":"2024-09-21T07:23:43.932858+0000","last_became_active":"2024-09-21T07:23:41.242213+0000","last_became_peered":"2024-09-21T07:23:41.242213+0000","last_unstale":"2024-09-21T07:23:43.932858+0000","last_undegraded":"2024-09-21T07:23:43.932858+0000","last_fullsized":"2024-09-21T07:23:43.932858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:20.396376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.227692+0000","last_change":"2024-09-21T07:23:42.243807+0000","last_active":"2024-09-21T07:23:43.227692+0000","last_peered":"2024-09-21T07:23:43.227692+0000","last_clean":"2024-09-21T07:23:43.227692+0000","last_became_active":"2024-09-21T07:23:42.243110+0000","last_became_peered":"2024-09-21T07:23:42.243110+0000","last_unstale":"2024-09-21T07:23:43.227692+0000","last_undegraded":"2024-09-21T07:23:43.227692+0000","last_fullsized":"2024-09-21T07:23:43.227692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:35.036877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931931+0000","last_change":"2024-09-21T07:23:41.234226+0000","last_active":"2024-09-21T07:23:43.931931+0000","last_peered":"2024-09-21T07:23:43.931931+0000","last_clean":"2024-09-21T07:23:43.931931+0000","last_became_active":"2024-09-21T07:23:41.233924+0000","last_became_peered":"2024-09-21T07:23:41.233924+0000","last_unstale":"2024-09-21T07:23:43.931931+0000","last_undegraded":"2024-09-21T07:23:43.931931+0000","last_fullsized":"2024-09-21T07:23:43.931931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:29.309397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.229042+0000","last_change":"2024-09-21T07:23:42.259554+0000","last_active":"2024-09-21T07:23:43.229042+0000","last_peered":"2024-09-21T07:23:43.229042+0000","last_clean":"2024-09-21T07:23:43.229042+0000","last_became_active":"2024-09-21T07:23:42.259038+0000","last_became_peered":"2024-09-21T07:23:42.259038+0000","last_unstale":"2024-09-21T07:23:43.229042+0000","last_undegraded":"2024-09-21T07:23:43.229042+0000","last_fullsized":"2024-09-21T07:23:43.229042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:40.765420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933548+0000","last_change":"2024-09-21T07:23:41.240831+0000","last_active":"2024-09-21T07:23:43.933548+0000","last_peered":"2024-09-21T07:23:43.933548+0000","last_clean":"2024-09-21T07:23:43.933548+0000","last_became_active":"2024-09-21T07:23:41.240462+0000","last_became_peered":"2024-09-21T07:23:41.240462+0000","last_unstale":"2024-09-21T07:23:43.933548+0000","last_undegraded":"2024-09-21T07:23:43.933548+0000","last_fullsized":"2024-09-21T07:23:43.933548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934493+0000","last_change":"2024-09-21T07:23:42.261968+0000","last_active":"2024-09-21T07:23:43.934493+0000","last_peered":"2024-09-21T07:23:43.934493+0000","last_clean":"2024-09-21T07:23:43.934493+0000","last_became_active":"2024-09-21T07:23:42.261646+0000","last_became_peered":"2024-09-21T07:23:42.261646+0000","last_unstale":"2024-09-21T07:23:43.934493+0000","last_undegraded":"2024-09-21T07:23:43.934493+0000","last_fullsized":"2024-09-21T07:23:43.934493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:19.105860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932409+0000","last_change":"2024-09-21T07:23:41.238080+0000","last_active":"2024-09-21T07:23:43.932409+0000","last_peered":"2024-09-21T07:23:43.932409+0000","last_clean":"2024-09-21T07:23:43.932409+0000","last_became_active":"2024-09-21T07:23:41.237839+0000","last_became_peered":"2024-09-21T07:23:41.237839+0000","last_unstale":"2024-09-21T07:23:43.932409+0000","last_undegraded":"2024-09-21T07:23:43.932409+0000","last_fullsized":"2024-09-21T07:23:43.932409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:20.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228287+0000","last_change":"2024-09-21T07:23:42.245852+0000","last_active":"2024-09-21T07:23:43.228287+0000","last_peered":"2024-09-21T07:23:43.228287+0000","last_clean":"2024-09-21T07:23:43.228287+0000","last_became_active":"2024-09-21T07:23:42.245536+0000","last_became_peered":"2024-09-21T07:23:42.245536+0000","last_unstale":"2024-09-21T07:23:43.228287+0000","last_undegraded":"2024-09-21T07:23:43.228287+0000","last_fullsized":"2024-09-21T07:23:43.228287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:20.456618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932764+0000","last_change":"2024-09-21T07:23:41.242064+0000","last_active":"2024-09-21T07:23:43.932764+0000","last_peered":"2024-09-21T07:23:43.932764+0000","last_clean":"2024-09-21T07:23:43.932764+0000","last_became_active":"2024-09-21T07:23:41.241745+0000","last_became_peered":"2024-09-21T07:23:41.241745+0000","last_unstale":"2024-09-21T07:23:43.932764+0000","last_undegraded":"2024-09-21T07:23:43.932764+0000","last_fullsized":"2024-09-21T07:23:43.932764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931876+0000","last_change":"2024-09-21T07:23:42.249809+0000","last_active":"2024-09-21T07:23:43.931876+0000","last_peered":"2024-09-21T07:23:43.931876+0000","last_clean":"2024-09-21T07:23:43.931876+0000","last_became_active":"2024-09-21T07:23:42.249220+0000","last_became_peered":"2024-09-21T07:23:42.249220+0000","last_unstale":"2024-09-21T07:23:43.931876+0000","last_undegraded":"2024-09-21T07:23:43.931876+0000","last_fullsized":"2024-09-21T07:23:43.931876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:23.322231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932540+0000","last_change":"2024-09-21T07:23:41.246426+0000","last_active":"2024-09-21T07:23:43.932540+0000","last_peered":"2024-09-21T07:23:43.932540+0000","last_clean":"2024-09-21T07:23:43.932540+0000","last_became_active":"2024-09-21T07:23:41.246065+0000","last_became_peered":"2024-09-21T07:23:41.246065+0000","last_unstale":"2024-09-21T07:23:43.932540+0000","last_undegraded":"2024-09-21T07:23:43.932540+0000","last_fullsized":"2024-09-21T07:23:43.932540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:56.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228229+0000","last_change":"2024-09-21T07:23:42.235716+0000","last_active":"2024-09-21T07:23:43.228229+0000","last_peered":"2024-09-21T07:23:43.228229+0000","last_clean":"2024-09-21T07:23:43.228229+0000","last_became_active":"2024-09-21T07:23:42.235427+0000","last_became_peered":"2024-09-21T07:23:42.235427+0000","last_unstale":"2024-09-21T07:23:43.228229+0000","last_undegraded":"2024-09-21T07:23:43.228229+0000","last_fullsized":"2024-09-21T07:23:43.228229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.944022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.228000+0000","last_change":"2024-09-21T07:23:41.247133+0000","last_active":"2024-09-21T07:23:43.228000+0000","last_peered":"2024-09-21T07:23:43.228000+0000","last_clean":"2024-09-21T07:23:43.228000+0000","last_became_active":"2024-09-21T07:23:41.246822+0000","last_became_peered":"2024-09-21T07:23:41.246822+0000","last_unstale":"2024-09-21T07:23:43.228000+0000","last_undegraded":"2024-09-21T07:23:43.228000+0000","last_fullsized":"2024-09-21T07:23:43.228000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:27.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932145+0000","last_change":"2024-09-21T07:23:42.245651+0000","last_active":"2024-09-21T07:23:43.932145+0000","last_peered":"2024-09-21T07:23:43.932145+0000","last_clean":"2024-09-21T07:23:43.932145+0000","last_became_active":"2024-09-21T07:23:42.245299+0000","last_became_peered":"2024-09-21T07:23:42.245299+0000","last_unstale":"2024-09-21T07:23:43.932145+0000","last_undegraded":"2024-09-21T07:23:43.932145+0000","last_fullsized":"2024-09-21T07:23:43.932145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:34.065061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.931856+0000","last_change":"2024-09-21T07:23:41.227126+0000","last_active":"2024-09-21T07:23:43.931856+0000","last_peered":"2024-09-21T07:23:43.931856+0000","last_clean":"2024-09-21T07:23:43.931856+0000","last_became_active":"2024-09-21T07:23:41.226786+0000","last_became_peered":"2024-09-21T07:23:41.226786+0000","last_unstale":"2024-09-21T07:23:43.931856+0000","last_undegraded":"2024-09-21T07:23:43.931856+0000","last_fullsized":"2024-09-21T07:23:43.931856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:59.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.933798+0000","last_change":"2024-09-21T07:23:42.261691+0000","last_active":"2024-09-21T07:23:43.933798+0000","last_peered":"2024-09-21T07:23:43.933798+0000","last_clean":"2024-09-21T07:23:43.933798+0000","last_became_active":"2024-09-21T07:23:42.261363+0000","last_became_peered":"2024-09-21T07:23:42.261363+0000","last_unstale":"2024-09-21T07:23:43.933798+0000","last_undegraded":"2024-09-21T07:23:43.933798+0000","last_fullsized":"2024-09-21T07:23:43.933798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:19.442346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.226909+0000","last_change":"2024-09-21T07:23:41.236957+0000","last_active":"2024-09-21T07:23:43.226909+0000","last_peered":"2024-09-21T07:23:43.226909+0000","last_clean":"2024-09-21T07:23:43.226909+0000","last_became_active":"2024-09-21T07:23:41.236430+0000","last_became_peered":"2024-09-21T07:23:41.236430+0000","last_unstale":"2024-09-21T07:23:43.226909+0000","last_undegraded":"2024-09-21T07:23:43.226909+0000","last_fullsized":"2024-09-21T07:23:43.226909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:47.729765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932912+0000","last_change":"2024-09-21T07:23:42.260141+0000","last_active":"2024-09-21T07:23:43.932912+0000","last_peered":"2024-09-21T07:23:43.932912+0000","last_clean":"2024-09-21T07:23:43.932912+0000","last_became_active":"2024-09-21T07:23:42.259782+0000","last_became_peered":"2024-09-21T07:23:42.259782+0000","last_unstale":"2024-09-21T07:23:43.932912+0000","last_undegraded":"2024-09-21T07:23:43.932912+0000","last_fullsized":"2024-09-21T07:23:43.932912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:41.207784+0000","last_clean_scrub_stamp":"2024-09-21T07:23:41.207784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:39.938480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.934047+0000","last_change":"2024-09-21T07:23:41.241484+0000","last_active":"2024-09-21T07:23:43.934047+0000","last_peered":"2024-09-21T07:23:43.934047+0000","last_clean":"2024-09-21T07:23:43.934047+0000","last_became_active":"2024-09-21T07:23:41.241073+0000","last_became_peered":"2024-09-21T07:23:41.241073+0000","last_unstale":"2024-09-21T07:23:43.934047+0000","last_undegraded":"2024-09-21T07:23:43.934047+0000","last_fullsized":"2024-09-21T07:23:43.934047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:23:40.199136+0000","last_clean_scrub_stamp":"2024-09-21T07:23:40.199136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.411667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T07:23:43.932277+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:23:43.932277+0000","last_peered":"2024-09-21T07:23:43.932277+0000","last_clean":"2024-09-21T07:23:43.932277+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:23:43.932277+0000","last_undegraded":"2024-09-21T07:23:43.932277+0000","last_fullsized":"2024-09-21T07:23:43.932277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":197686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":197216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":197708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":197174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":197194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":787506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":789154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":198750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:23:51.530 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:23:51.530 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 -- 172.21.15.64:0/3636745780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb80ca520 msgr2=0x7fdfb80ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 --2- 172.21.15.64:0/3636745780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb80ca520 0x7fdfb80ca930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdfb815ccc0 tx=0x7fdfa001c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 -- 172.21.15.64:0/3636745780 shutdown_connections 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 --2- 172.21.15.64:0/3636745780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb80ca520 0x7fdfb80ca930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 --2- 172.21.15.64:0/3636745780 >> v2:172.21.15.90:3300/0 conn(0x7fdfb80cc3b0 0x7fdfb815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 -- 172.21.15.64:0/3636745780 >> 172.21.15.64:0/3636745780 conn(0x7fdfb80b1bf0 msgr2=0x7fdfb80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 -- 172.21.15.64:0/3636745780 shutdown_connections 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.731+0000 7fdfbd800640 1 -- 172.21.15.64:0/3636745780 wait complete. 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 Processor -- start 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 -- start start 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfb80ca520 0x7fdfb80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb80cc3b0 0x7fdfb8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8169ed0 con 0x7fdfb815cfd0 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8169d50 con 0x7fdfb80cc3b0 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb816a050 con 0x7fdfb80ca520 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38970/0 (socket says 172.21.15.64:38970) 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 -- 172.21.15.64:0/654328589 learned_addr learned my addr 172.21.15.64:0/654328589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfaf400640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb80cc3b0 0x7fdfb8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfb7e00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfb80ca520 0x7fdfb80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 -- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfb80ca520 msgr2=0x7fdfb80b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfb80ca520 0x7fdfb80b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 -- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb80cc3b0 msgr2=0x7fdfb8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb80cc3b0 0x7fdfb8152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 -- 172.21.15.64:0/654328589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb80c6140 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbce00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c740 tx=0x7fdfb000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0003b80 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfb000ce50 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000a850 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.735+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb80c6420 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81526d0 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb80ca930 con 0x7fdfb815cfd0 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdfb000a9f0 con 0x7fdfb815cfd0 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfb4c00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 0x7fdf94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdfb00940c0 con 0x7fdfb815cfd0 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.739+0000 7fdfb7e00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 0x7fdf94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.743+0000 7fdfb7e00640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 0x7fdf94075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8004630 tx=0x7fdfa800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.743+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdfb005e8f0 con 0x7fdfb815cfd0 2024-09-21T07:23:51.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.987+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdfb8152900 con 0x7fdfb815cfd0 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfb4c00640 1 -- 172.21.15.64:0/654328589 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fdfb0063320 con 0x7fdfb815cfd0 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:23:51.992 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:23:51.993 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 msgr2=0x7fdf94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 0x7fdf94075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8004630 tx=0x7fdfa800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 msgr2=0x7fdfb81fa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c740 tx=0x7fdfb000cc00 comp rx=0 tx=0).stop 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 shutdown_connections 2024-09-21T07:23:51.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf94073200 0x7fdf94075710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfb815cfd0 0x7fdfb81fa140 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb80cc3b0 0x7fdfb8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 --2- 172.21.15.64:0/654328589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfb80ca520 0x7fdfb80b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 >> 172.21.15.64:0/654328589 conn(0x7fdfb80b1bf0 msgr2=0x7fdfb81590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 shutdown_connections 2024-09-21T07:23:51.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:51.991+0000 7fdfbd800640 1 -- 172.21.15.64:0/654328589 wait complete. 2024-09-21T07:23:52.015 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:23:52.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- 172.21.15.64:0/827704435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 msgr2=0x7fc5040cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 --2- 172.21.15.64:0/827704435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc5040cb100 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009840 tx=0x7fc4ec01c820 comp rx=0 tx=0).stop 2024-09-21T07:23:52.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- 172.21.15.64:0/827704435 shutdown_connections 2024-09-21T07:23:52.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 --2- 172.21.15.64:0/827704435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc5040cb100 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 --2- 172.21.15.64:0/827704435 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5040b24e0 0x7fc5040ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- 172.21.15.64:0/827704435 >> 172.21.15.64:0/827704435 conn(0x7fc5040ccbe0 msgr2=0x7fc5040ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:52.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- 172.21.15.64:0/827704435 shutdown_connections 2024-09-21T07:23:52.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- 172.21.15.64:0/827704435 wait complete. 2024-09-21T07:23:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 Processor -- start 2024-09-21T07:23:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.171+0000 7fc509c00640 1 -- start start 2024-09-21T07:23:52.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5040b24e0 0x7fc50415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 0x7fc5040c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc504168350 con 0x7fc5040cacf0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041681d0 con 0x7fc5040b24e0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc5041684d0 con 0x7fc50415e9b0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38994/0 (socket says 172.21.15.64:38994) 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 -- 172.21.15.64:0/2497987155 learned_addr learned my addr 172.21.15.64:0/2497987155 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc503400640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 0x7fc5040c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc502a00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5040b24e0 0x7fc50415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 -- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 msgr2=0x7fc5040c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 0x7fc5040c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 -- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5040b24e0 msgr2=0x7fc50415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5040b24e0 0x7fc50415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 -- 172.21.15.64:0/2497987155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50414caf0 con 0x7fc5040cacf0 2024-09-21T07:23:52.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc503400640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 0x7fc5040c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fa000640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec01aed0 tx=0x7fc4ec005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec005430 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4ec0bd070 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec004930 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50415d6c0 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50415dc80 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.175+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5040ca7b0 con 0x7fc5040cacf0 2024-09-21T07:23:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.179+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4ec004ad0 con 0x7fc5040cacf0 2024-09-21T07:23:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.179+0000 7fc4fb400640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 0x7fc4e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.179+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc4ec12f460 con 0x7fc5040cacf0 2024-09-21T07:23:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.179+0000 7fc502a00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 0x7fc4e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.179+0000 7fc502a00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 0x7fc4e0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005fd0 tx=0x7fc4f4005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:52.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.183+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc4ec016410 con 0x7fc5040cacf0 2024-09-21T07:23:52.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.395+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc50415d450 con 0x7fc5040cacf0 2024-09-21T07:23:52.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.395+0000 7fc4fb400640 1 -- 172.21.15.64:0/2497987155 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7fc4ec0fa370 con 0x7fc5040cacf0 2024-09-21T07:23:52.399 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:23:52.399 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"btime":"2024-09-21T07:23:45:252778+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:44.682343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:23:52.399 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 msgr2=0x7fc4e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 0x7fc4e0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005fd0 tx=0x7fc4f4005e40 comp rx=0 tx=0).stop 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 msgr2=0x7fc50414c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec01aed0 tx=0x7fc4ec005040 comp rx=0 tx=0).stop 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 shutdown_connections 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4e0073200 0x7fc4e0075710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc50415e9b0 0x7fc5040c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5040cacf0 0x7fc50414c5b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 --2- 172.21.15.64:0/2497987155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5040b24e0 0x7fc50415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 >> 172.21.15.64:0/2497987155 conn(0x7fc5040ccbe0 msgr2=0x7fc50415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 shutdown_connections 2024-09-21T07:23:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.399+0000 7fc509c00640 1 -- 172.21.15.64:0/2497987155 wait complete. 2024-09-21T07:23:52.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:23:41.654216+0000', 'modified': '2024-09-21T07:23:44.682343+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4932': {'gid': 4932, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/4120447613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 4120447613}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 4120447613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4932, 'qdb_cluster': [4932]} 2024-09-21T07:23:52.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:23:52.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:23:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- 172.21.15.64:0/2384154438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00009df30 msgr2=0x7fe0000b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 --2- 172.21.15.64:0/2384154438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00009df30 0x7fe0000b33d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe00006dda0 tx=0x7fdff401c8a0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- 172.21.15.64:0/2384154438 shutdown_connections 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 --2- 172.21.15.64:0/2384154438 >> v2:172.21.15.90:3300/0 conn(0x7fe0000b3910 0x7fe0000ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 --2- 172.21.15.64:0/2384154438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00009df30 0x7fe0000b33d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- 172.21.15.64:0/2384154438 >> 172.21.15.64:0/2384154438 conn(0x7fe00006d450 msgr2=0x7fe0000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- 172.21.15.64:0/2384154438 shutdown_connections 2024-09-21T07:23:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- 172.21.15.64:0/2384154438 wait complete. 2024-09-21T07:23:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 Processor -- start 2024-09-21T07:23:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.983+0000 7fe008800640 1 -- start start 2024-09-21T07:23:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00009df30 0x7fe0001fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0000ce730 0x7fe0000b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe000169140 con 0x7fe0000b3910 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe000168fc0 con 0x7fe0000ce730 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0001692c0 con 0x7fe00009df30 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39020/0 (socket says 172.21.15.64:39020) 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 -- 172.21.15.64:0/2192349744 learned_addr learned my addr 172.21.15.64:0/2192349744 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005e00640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00009df30 0x7fe0001fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe006800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0000ce730 0x7fe0000b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 -- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00009df30 msgr2=0x7fe0001fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00009df30 0x7fe0001fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 -- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0000ce730 msgr2=0x7fe0000b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0000ce730 0x7fe0000b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 -- 172.21.15.64:0/2192349744 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0001fa970 con 0x7fe0000b3910 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe005400640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdff000d720 tx=0x7fdff000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fdffa000640 1 -- 172.21.15.64:0/2192349744 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0017070 con 0x7fe0000b3910 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fdffa000640 1 -- 172.21.15.64:0/2192349744 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff0005310 con 0x7fe0000b3910 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0001fac50 con 0x7fe0000b3910 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fdffa000640 1 -- 172.21.15.64:0/2192349744 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0009820 con 0x7fe0000b3910 2024-09-21T07:23:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.987+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001f7d00 con 0x7fe0000b3910 2024-09-21T07:23:52.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fdffa000640 1 -- 172.21.15.64:0/2192349744 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdff00099c0 con 0x7fe0000b3910 2024-09-21T07:23:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fdffa000640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 0x7fdfe4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fdffa000640 1 -- 172.21.15.64:0/2192349744 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdff0094460 con 0x7fe0000b3910 2024-09-21T07:23:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 Processor -- start 2024-09-21T07:23:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe005e00640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 0x7fdfe4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 -- start start 2024-09-21T07:23:52.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe005e00640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 0x7fdfe4075710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdff40af000 tx=0x7fdff401b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435fc4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e58ca0 0x563435fc56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563435e95410 con 0x563435e6f950 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563435dd2b40 con 0x563435e58ca0 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563435dc1f70 con 0x563435a7f460 2024-09-21T07:23:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.991+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39036/0 (socket says 172.21.15.64:39036) 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 -- 172.21.15.64:0/577919543 learned_addr learned my addr 172.21.15.64:0/577919543 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005e00640 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435fc4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe006800640 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e58ca0 0x563435fc56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 -- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 msgr2=0x563435fc4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435fc4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 -- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e58ca0 msgr2=0x563435fc56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e58ca0 0x563435fc56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 -- 172.21.15.64:0/577919543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563435d895b0 con 0x563435e6f950 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe005400640 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdff005eca0 tx=0x7fdff005ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24c41a1cfb533e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fdfee600640 1 -- 172.21.15.64:0/577919543 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0020040 con 0x563435e6f950 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fdfee600640 1 -- 172.21.15.64:0/577919543 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff00636c0 con 0x563435e6f950 2024-09-21T07:23:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fdfee600640 1 -- 172.21.15.64:0/577919543 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0068570 con 0x563435e6f950 2024-09-21T07:23:52.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- 172.21.15.64:0/577919543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 msgr2=0x563435fc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdff005eca0 tx=0x7fdff005ec10 comp rx=0 tx=0).stop 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- 172.21.15.64:0/577919543 shutdown_connections 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e58ca0 0x563435fc56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e6f950 0x563435fc5180 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/577919543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435fc4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- 172.21.15.64:0/577919543 >> 172.21.15.64:0/577919543 conn(0x563435f45d90 msgr2=0x563435fa80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- 172.21.15.64:0/577919543 shutdown_connections 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- 172.21.15.64:0/577919543 wait complete. 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 -- start start 2024-09-21T07:23:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.995+0000 7fe00fdd6000 1 Processor -- start 2024-09-21T07:23:53.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435faa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563435d5c5f0 con 0x563435e58ca0 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563435dc5d80 con 0x563435e6f950 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563435d68520 con 0x563435a7f460 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 10 client.0 _ll_register_callbacks cb 0x563435d6c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39042/0 (socket says 172.21.15.64:39042) 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 -- 172.21.15.64:0/2581455959 learned_addr learned my addr 172.21.15.64:0/2581455959 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005e00640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435faa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe006800640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 -- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 msgr2=0x563435faa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435faa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 -- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 msgr2=0x563435fab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 -- 172.21.15.64:0/2581455959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563435d60190 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005400640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdff005b4d0 tx=0x7fdff005b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d453a5842df3b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0020070 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdff004c120 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563435d5a110 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fdff00636c0 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 10 client.5115 fetch_fsmap learned FSMap version 18 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563435e46f10 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563435d5a110 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fdff0092bc0 con 0x563435e58ca0 2024-09-21T07:23:53.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 10 client.5115 fetch_fsmap finished waiting for FSMap version 18 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 10 client.5115 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 20 client.5115 populate_metadata read hostname 'smithi064' 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a647d0 0x563435fabb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 4 client.5115 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563435dd4a90 con 0x563435a647d0 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005e00640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a647d0 0x563435fabb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fe005e00640 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a647d0 0x563435fabb40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe923ae3ea9bbf2 server_cookie=9c775d96cf67beb0 in_seq=0 out_seq=0 2024-09-21T07:23:53.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:52.999+0000 7fdfe2a00640 10 client.5115 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:23:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fdfe2a00640 1 -- 172.21.15.64:0/2581455959 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563435dd4a90 con 0x563435a647d0 2024-09-21T07:23:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fdfe2a00640 10 client.5115 handle_command_reply: tid=0 2024-09-21T07:23:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 client.5115 shutdown 2024-09-21T07:23:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 msgr2=0x563435faabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdff005b4d0 tx=0x7fdff005b230 comp rx=0 tx=0).stop 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 shutdown_connections 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x563435faabf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a647d0 0x563435fabb40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2581455959 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435a7f460 0x563435faa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fdfe2a00640 0 client.5115 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 >> 172.21.15.64:0/2581455959 conn(0x563435f45d90 msgr2=0x563435f7a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 shutdown_connections 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2581455959 wait complete. 2024-09-21T07:23:53.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.003+0000 7fe00fdd6000 20 client.5115 trim_cache size 0 max 16384 2024-09-21T07:23:53.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 Processor -- start 2024-09-21T07:23:53.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- start start 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e58ca0 0x563435fd4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fd4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe0002019d0 con 0x563435a7f460 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000745f0 con 0x563435e6f950 2024-09-21T07:23:53.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0001f9050 con 0x563435e58ca0 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39056/0 (socket says 172.21.15.64:39056) 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 -- 172.21.15.64:0/2932748666 learned_addr learned my addr 172.21.15.64:0/2932748666 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005400640 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e58ca0 0x563435fd4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe006800640 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fd4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 -- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e58ca0 msgr2=0x563435fd4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e58ca0 0x563435fd4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 -- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 msgr2=0x563435fd4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fd4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 -- 172.21.15.64:0/2932748666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563435e1ddb0 con 0x563435a7f460 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe005e00640 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000c10 tx=0x7fdff40a7050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d623d1b63ab6e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fdfedc00640 1 -- 172.21.15.64:0/2932748666 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff40d3070 con 0x563435a7f460 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fdfedc00640 1 -- 172.21.15.64:0/2932748666 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff40bd050 con 0x563435a7f460 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fdfedc00640 1 -- 172.21.15.64:0/2932748666 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff40b2040 con 0x563435a7f460 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2932748666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 msgr2=0x563435fd41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000c10 tx=0x7fdff40a7050 comp rx=0 tx=0).stop 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2932748666 shutdown_connections 2024-09-21T07:23:53.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435e6f950 0x563435fd4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e58ca0 0x563435fd4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/2932748666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435a7f460 0x563435fd41f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2932748666 >> 172.21.15.64:0/2932748666 conn(0x563435f45d90 msgr2=0x563435fa3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2932748666 shutdown_connections 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.023+0000 7fe00fdd6000 1 -- 172.21.15.64:0/2932748666 wait complete. 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 -- start start 2024-09-21T07:23:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 Processor -- start 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435a7f460 0x56343603a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e6f950 0x56343603b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563435dc5d80 con 0x563435e58ca0 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe000073fa0 con 0x563435a7f460 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563435d5c5f0 con 0x563435e6f950 2024-09-21T07:23:53.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 10 client.0 _ll_register_callbacks cb 0x7fdff0083070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39060/0 (socket says 172.21.15.64:39060) 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 -- 172.21.15.64:0/3581063422 learned_addr learned my addr 172.21.15.64:0/3581063422 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe006800640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e6f950 0x56343603b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005e00640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435a7f460 0x56343603a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 -- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e6f950 msgr2=0x56343603b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e6f950 0x56343603b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 -- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435a7f460 msgr2=0x56343603a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435a7f460 0x56343603a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 -- 172.21.15.64:0/3581063422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563435d88ab0 con 0x563435e58ca0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe005400640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdff0063880 tx=0x7fdff0009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb3d65d92b0dfed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fdfe2a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:23:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0020040 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdff005e170 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdff40bd050 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.027+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fdff004c370 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 10 client.5121 fetch_fsmap learned FSMap version 18 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563435d67070 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff40bd050 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fdff005a660 con 0x563435e58ca0 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 10 client.5121 fetch_fsmap finished waiting for FSMap version 18 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 10 client.5121 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 20 client.5121 populate_metadata read hostname 'smithi064' 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a52830 0x563435fd7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 4 client.5121 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:23:53.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "status"}) -- 0x563435dd0540 con 0x563435a52830 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe005e00640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a52830 0x563435fd7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe005e00640 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a52830 0x563435fd7b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b364eeca01612998 server_cookie=63bdb219e6fa366c in_seq=0 out_seq=0 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 10 client.5121 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 1 -- 172.21.15.64:0/3581063422 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563435dd0540 con 0x563435a52830 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 10 client.5121 handle_command_reply: tid=0 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 client.5121 shutdown 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 msgr2=0x56343603ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdff0063880 tx=0x7fdff0009740 comp rx=0 tx=0).stop 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 shutdown_connections 2024-09-21T07:23:53.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563435a52830 0x563435fd7b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563435e6f950 0x56343603b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563435e58ca0 0x56343603ab40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fdfe2a00640 0 client.5121 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 --2- 172.21.15.64:0/3581063422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563435a7f460 0x56343603a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 >> 172.21.15.64:0/3581063422 conn(0x563435f45d90 msgr2=0x563435fd1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 shutdown_connections 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 1 -- 172.21.15.64:0/3581063422 wait complete. 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe00fdd6000 20 client.5121 trim_cache size 0 max 16384 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:23:53.039 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4932, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.809469247999999, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 18, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 40, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 40, 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 17.705694364999999 2024-09-21T07:23:53.040 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 msgr2=0x7fdfe4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 0x7fdfe4075710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdff40af000 tx=0x7fdff401b0e0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 msgr2=0x7fe00015a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdff000d720 tx=0x7fdff000dbe0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 shutdown_connections 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe4073200 0x7fdfe4075710 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0000ce730 0x7fe0000b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0000b3910 0x7fe00015a120 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 --2- 172.21.15.64:0/2192349744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00009df30 0x7fe0001fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 >> 172.21.15.64:0/2192349744 conn(0x7fe00006d450 msgr2=0x7fe0000ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 shutdown_connections 2024-09-21T07:23:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.031+0000 7fe008800640 1 -- 172.21.15.64:0/2192349744 wait complete. 2024-09-21T07:23:53.055 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- 172.21.15.64:0/1699843415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 msgr2=0x7f3b100cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 --2- 172.21.15.64:0/1699843415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b100cdd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009900 tx=0x7f3afc01c850 comp rx=0 tx=0).stop 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- 172.21.15.64:0/1699843415 shutdown_connections 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 --2- 172.21.15.64:0/1699843415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b100cdd00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- 172.21.15.64:0/1699843415 >> 172.21.15.64:0/1699843415 conn(0x7f3b1006e890 msgr2=0x7f3b100b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- 172.21.15.64:0/1699843415 shutdown_connections 2024-09-21T07:23:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- 172.21.15.64:0/1699843415 wait complete. 2024-09-21T07:23:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 Processor -- start 2024-09-21T07:23:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.211+0000 7f3b17c00640 1 -- start start 2024-09-21T07:23:53.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b100ce240 0x7f3b1014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 0x7f3b100c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1016a260 con 0x7f3b1006ff90 2024-09-21T07:23:53.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1016a0e0 con 0x7f3b100ce240 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1016a3e0 con 0x7f3b1015b700 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39090/0 (socket says 172.21.15.64:39090) 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 -- 172.21.15.64:0/11520415 learned_addr learned my addr 172.21.15.64:0/11520415 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b0fe00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b100ce240 0x7f3b1014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 0x7f3b100c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 -- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 msgr2=0x7f3b100c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 0x7f3b100c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 -- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b100ce240 msgr2=0x7f3b1014c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b100ce240 0x7f3b1014c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 -- 172.21.15.64:0/11520415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1014ce00 con 0x7f3b1006ff90 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 0x7f3b100c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b15200640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c450 tx=0x7f3b0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:53.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040052d0 con 0x7f3b1006ff90 2024-09-21T07:23:53.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b04005470 con 0x7f3b1006ff90 2024-09-21T07:23:53.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04012870 con 0x7f3b1006ff90 2024-09-21T07:23:53.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b100c4e20 con 0x7f3b1006ff90 2024-09-21T07:23:53.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b100c50c0 con 0x7f3b1006ff90 2024-09-21T07:23:53.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.215+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b100cdd00 con 0x7f3b1006ff90 2024-09-21T07:23:53.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.219+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b04003600 con 0x7f3b1006ff90 2024-09-21T07:23:53.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.219+0000 7f3b0cc00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 0x7f3af0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:53.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.219+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3b04094900 con 0x7f3b1006ff90 2024-09-21T07:23:53.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.219+0000 7f3b0fe00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 0x7f3af0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:53.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.219+0000 7f3b0fe00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 0x7f3af0075710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc01b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:53.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.223+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3b0405f870 con 0x7f3b1006ff90 2024-09-21T07:23:53.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.439+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3b100b0700 con 0x7f3b1006ff90 2024-09-21T07:23:53.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.439+0000 7f3b0cc00640 1 -- 172.21.15.64:0/11520415 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f3b0405f170 con 0x7f3b1006ff90 2024-09-21T07:23:53.444 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:23:53.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 msgr2=0x7f3af0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 0x7f3af0075710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc01b090 comp rx=0 tx=0).stop 2024-09-21T07:23:53.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 msgr2=0x7f3b1006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c450 tx=0x7f3b0400c910 comp rx=0 tx=0).stop 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 shutdown_connections 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3af0073200 0x7f3af0075710 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b1015b700 0x7f3b100c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b100ce240 0x7f3b1014c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 --2- 172.21.15.64:0/11520415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1006ff90 0x7f3b1006d8a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 >> 172.21.15.64:0/11520415 conn(0x7f3b1006e890 msgr2=0x7f3b100b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 shutdown_connections 2024-09-21T07:23:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53.443+0000 7f3b17c00640 1 -- 172.21.15.64:0/11520415 wait complete. 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:53.467 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:23:53.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:23:53.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:23:53.468 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:23:53.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.468 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:23:53.478 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:23:53.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42350sec preferred_lft 42350sec 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.480 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:23:53.481 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:23:53.482 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:23:53.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.484 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:23:53.549 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:23:53.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.552 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:23:53.611 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:23:53.612 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:23:53.612 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:53.612 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:53.612 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:23:53.612 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:23:53.612 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:23:53.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:23:53.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:53.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.752 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:23:53.808 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:23:53.808 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:23:53.809 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:23:53.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:23:53.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:53.876 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:53.929 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:23:53.929 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:23:53.929 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:53.983 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:23:53.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:53.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:54.088 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:54.088 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:54.104 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:23:54.104 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:23:54.104 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:23:54.104 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:23:54.104 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:23:54.107 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:23:54.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:54.108 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:54.128 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:23:54.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:23:54.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:23:54.236 INFO:teuthology.orchestra.run.smithi064.stdout:client5133 2024-09-21T07:23:54.236 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:54.236 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:54.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-21T07:23:54.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 -- 172.21.15.64:0/952686752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b9015c850 msgr2=0x7f4b900cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:54.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 --2- 172.21.15.64:0/952686752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b9015c850 0x7f4b900cc080 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b900c71b0 tx=0x7f4b7801c830 comp rx=0 tx=0).stop 2024-09-21T07:23:54.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 -- 172.21.15.64:0/952686752 shutdown_connections 2024-09-21T07:23:54.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 --2- 172.21.15.64:0/952686752 >> v2:172.21.15.90:3300/0 conn(0x7f4b900cc5c0 0x7f4b90072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:54.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 --2- 172.21.15.64:0/952686752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b9015c850 0x7f4b900cc080 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:54.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 -- 172.21.15.64:0/952686752 >> 172.21.15.64:0/952686752 conn(0x7f4b900d0170 msgr2=0x7f4b900d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:54.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 -- 172.21.15.64:0/952686752 shutdown_connections 2024-09-21T07:23:54.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.451+0000 7f4b95000640 1 -- 172.21.15.64:0/952686752 wait complete. 2024-09-21T07:23:54.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 Processor -- start 2024-09-21T07:23:54.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 -- start start 2024-09-21T07:23:54.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b900ca7c0 0x7f4b901f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:54.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:54.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9015c850 0x7f4b900adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:54.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90169f20 con 0x7f4b900cc5c0 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90169da0 con 0x7f4b9015c850 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b95000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9016a0a0 con 0x7f4b900ca7c0 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39110/0 (socket says 172.21.15.64:39110) 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.455+0000 7f4b87e00640 1 -- 172.21.15.64:0/3521543539 learned_addr learned my addr 172.21.15.64:0/3521543539 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b8e800640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9015c850 0x7f4b900adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b8de00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b900ca7c0 0x7f4b901f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 -- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b900ca7c0 msgr2=0x7f4b901f98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b900ca7c0 0x7f4b901f98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 -- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9015c850 msgr2=0x7f4b900adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9015c850 0x7f4b900adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:54.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 -- 172.21.15.64:0/3521543539 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b901f8fb0 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b87e00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b0040 tx=0x7f4b780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780042b0 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b78005030 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b901566b0 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78005420 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b90156c70 con 0x7f4b900cc5c0 2024-09-21T07:23:54.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90072dd0 con 0x7f4b900cc5c0 2024-09-21T07:23:54.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.459+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4b780bf030 con 0x7f4b900cc5c0 2024-09-21T07:23:54.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.463+0000 7f4b86000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 0x7f4b6c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:54.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.463+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4b7812e840 con 0x7f4b900cc5c0 2024-09-21T07:23:54.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.463+0000 7f4b8de00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 0x7f4b6c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:54.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.463+0000 7f4b8de00640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 0x7f4b6c075710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b80007fd0 tx=0x7f4b80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:54.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.467+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4b780164b0 con 0x7f4b900cc5c0 2024-09-21T07:23:54.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:54.679+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4b90157b70 con 0x7f4b900cc5c0 2024-09-21T07:23:55.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b86000640 1 -- 172.21.15.64:0/3521543539 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v19) ==== 167+0+0 (secure 0 0 0) 0x7f4b780f9070 con 0x7f4b900cc5c0 2024-09-21T07:23:55.505 INFO:teuthology.orchestra.run.smithi064.stderr:enabled new snapshots 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 msgr2=0x7f4b6c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 0x7f4b6c075710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b80007fd0 tx=0x7f4b80009040 comp rx=0 tx=0).stop 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 msgr2=0x7f4b900ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b0040 tx=0x7f4b780040c0 comp rx=0 tx=0).stop 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 shutdown_connections 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4b6c073200 0x7f4b6c075710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9015c850 0x7f4b900adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:55.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b900cc5c0 0x7f4b900ada20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:55.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 --2- 172.21.15.64:0/3521543539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b900ca7c0 0x7f4b901f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:55.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 >> 172.21.15.64:0/3521543539 conn(0x7f4b900d0170 msgr2=0x7f4b9009d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:55.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.503+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 shutdown_connections 2024-09-21T07:23:55.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:23:55.507+0000 7f4b95000640 1 -- 172.21.15.64:0/3521543539 wait complete. 2024-09-21T07:23:55.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:55.533 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-21T07:23:55.549 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:23:55.549 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:55.602 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:23:55.602 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> import uuid 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> n = 2000 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = False 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> if 3 > 0: 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = True 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> dpath = os.path.dirname(path) 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> fnameprefix = os.path.basename(path) 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:23:55.603 DEBUG:teuthology.orchestra.run.smithi064:> for i in range(n): 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> f.write(f"{i}") 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> f.flush() 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(f.fileno()) 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> os.unlink(fpath) 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> if create_hard_links: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> for j in range(3): 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:23:55.604 DEBUG:teuthology.orchestra.run.smithi064:> finally: 2024-09-21T07:23:55.605 DEBUG:teuthology.orchestra.run.smithi064:> os.close(dirfd) 2024-09-21T07:23:55.605 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:24:08.867 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:24:08.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:24:20.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:24:20.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:20.053 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-21T07:24:20.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:20.344 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-21T07:24:38.921 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:24:38.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:24:53.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:53.506 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-21T07:24:53.547 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-21T07:24:53.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 -- 172.21.15.64:0/4247731178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4880003a80 msgr2=0x7f4880003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 --2- 172.21.15.64:0/4247731178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4880003a80 0x7f4880003ef0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f488c009b30 tx=0x7f488c01d270 comp rx=0 tx=0).stop 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f489a800640 1 -- 172.21.15.64:0/4247731178 reap_dead start 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 -- 172.21.15.64:0/4247731178 shutdown_connections 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 -- 172.21.15.64:0/4247731178 >> 172.21.15.64:0/4247731178 conn(0x7f489c0ccbe0 msgr2=0x7f489c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 -- 172.21.15.64:0/4247731178 shutdown_connections 2024-09-21T07:24:53.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.746+0000 7f48a0e00640 1 -- 172.21.15.64:0/4247731178 wait complete. 2024-09-21T07:24:53.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 Processor -- start 2024-09-21T07:24:53.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 -- start start 2024-09-21T07:24:53.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 0x7f489c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 0x7f489c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f489c0ae020 0x7f489c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f489c166dd0 con 0x7f489c15f370 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f489c166c50 con 0x7f489c0ae020 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f48a0e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f489c166f50 con 0x7f4880003a80 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4893e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 0x7f489c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 0x7f489c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4893e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 0x7f489c159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52134/0 (socket says 172.21.15.64:52134) 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4893e00640 1 -- 172.21.15.64:0/2182913279 learned_addr learned my addr 172.21.15.64:0/2182913279 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:53.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f489a800640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f489c0ae020 0x7f489c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 -- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f489c0ae020 msgr2=0x7f489c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f489c0ae020 0x7f489c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 -- 172.21.15.64:0/2182913279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 msgr2=0x7f489c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 0x7f489c159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.750+0000 7f4899e00640 1 -- 172.21.15.64:0/2182913279 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c0acf80 con 0x7f4880003a80 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4899e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 0x7f489c0b0390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f488000bae0 tx=0x7f488c0aca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4892000640 1 -- 172.21.15.64:0/2182913279 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0b1040 con 0x7f4880003a80 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4892000640 1 -- 172.21.15.64:0/2182913279 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f488c0acbb0 con 0x7f4880003a80 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4892000640 1 -- 172.21.15.64:0/2182913279 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c009730 con 0x7f4880003a80 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c0ad260 con 0x7f4880003a80 2024-09-21T07:24:53.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c0ad820 con 0x7f4880003a80 2024-09-21T07:24:53.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4892000640 1 -- 172.21.15.64:0/2182913279 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f488c0bd020 con 0x7f4880003a80 2024-09-21T07:24:53.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.754+0000 7f4892000640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 0x7f4878075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4892000640 1 -- 172.21.15.64:0/2182913279 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f488c12e810 con 0x7f4880003a80 2024-09-21T07:24:53.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4893e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 0x7f4878075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 Processor -- start 2024-09-21T07:24:53.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- start start 2024-09-21T07:24:53.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4893e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 0x7f4878075710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f489c15e2b0 tx=0x7f48840091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda67cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda67d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55deda4312e0 con 0x55deda50a170 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55deda48ebb0 con 0x55deda51dab0 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55deda47dfe0 con 0x55deda52c630 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f489a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f489a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52146/0 (socket says 172.21.15.64:52146) 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f489a800640 1 -- 172.21.15.64:0/4021881879 learned_addr learned my addr 172.21.15.64:0/4021881879 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda67cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4893e00640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda67d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 -- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 msgr2=0x55deda67d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda67d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 -- 172.21.15.64:0/4021881879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 msgr2=0x55deda67d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 -- 172.21.15.64:0/4021881879 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deda41c1c0 con 0x55deda52c630 2024-09-21T07:24:53.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f489a800640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:24:53.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f4899e00640 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda67cca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f488c12caf0 tx=0x7f488c0f8b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced987b51b5951d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f488aa00640 1 -- 172.21.15.64:0/4021881879 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c102900 con 0x55deda52c630 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f488aa00640 1 -- 172.21.15.64:0/4021881879 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f488c0f52f0 con 0x55deda52c630 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f488aa00640 1 -- 172.21.15.64:0/4021881879 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c1026d0 con 0x55deda52c630 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 msgr2=0x55deda67cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda67cca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f488c12caf0 tx=0x7f488c0f8b60 comp rx=0 tx=0).stop 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- 172.21.15.64:0/4021881879 shutdown_connections 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda67d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda67d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4021881879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda67cca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.758+0000 7f48a84b9000 1 -- 172.21.15.64:0/4021881879 >> 172.21.15.64:0/4021881879 conn(0x55deda13bd20 msgr2=0x55deda631c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- 172.21.15.64:0/4021881879 shutdown_connections 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- 172.21.15.64:0/4021881879 wait complete. 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- start start 2024-09-21T07:24:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 Processor -- start 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 0x55deda66b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55deda4234f0 con 0x55deda52c630 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55deda481df0 con 0x55deda50a170 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55deda143620 con 0x55deda51dab0 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f48a84b9000 10 client.0 _ll_register_callbacks cb 0x55deda454cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4893e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4899e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 0x55deda66b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4893e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:39360/0 (socket says 172.21.15.64:39360) 2024-09-21T07:24:53.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4893e00640 1 -- 172.21.15.64:0/3177604491 learned_addr learned my addr 172.21.15.64:0/3177604491 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52154/0 (socket says 172.21.15.64:52154) 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 -- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 msgr2=0x55deda66b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 -- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 msgr2=0x55deda66b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 0x55deda66b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 -- 172.21.15.64:0/3177604491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deda54d740 con 0x55deda52c630 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4893e00640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f4899e00640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 0x55deda66b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f489a800640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4894001340 tx=0x7f4894006780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd34c1a4505a8a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.762+0000 7f487f400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:53.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894006970 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f4894011af0 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55deda416300 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4894011cf0 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 10 client.5151 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55deda503440 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55deda416300 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f489401b420 con 0x55deda52c630 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 10 client.5151 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 10 client.5151 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 20 client.5151 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda1208d0 0x55deda66c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 4 client.5151 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deda490b00 con 0x55deda1208d0 2024-09-21T07:24:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f4899e00640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda1208d0 0x55deda66c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f4899e00640 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda1208d0 0x55deda66c930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45cc6b8e48220f3d server_cookie=46991136bc0f2c44 in_seq=0 out_seq=0 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 10 client.5151 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 1 -- 172.21.15.64:0/3177604491 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55deda490b00 con 0x55deda1208d0 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 10 client.5151 handle_command_reply: tid=0 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 client.5151 shutdown 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 msgr2=0x55deda66bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4894001340 tx=0x7f4894006780 comp rx=0 tx=0).stop 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 shutdown_connections 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda52c630 0x55deda66bf20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda1208d0 0x55deda66c930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda51dab0 0x55deda66b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3177604491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda50a170 0x55deda66b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f487f400640 0 client.5151 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:53.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 >> 172.21.15.64:0/3177604491 conn(0x55deda13bd20 msgr2=0x55deda631c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 shutdown_connections 2024-09-21T07:24:53.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 1 -- 172.21.15.64:0/3177604491 wait complete. 2024-09-21T07:24:53.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.766+0000 7f48a84b9000 20 client.5151 trim_cache size 0 max 16384 2024-09-21T07:24:53.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 Processor -- start 2024-09-21T07:24:53.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- start start 2024-09-21T07:24:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda631280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55deda637690 con 0x55deda50a170 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f489c206750 con 0x55deda51dab0 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f489c205750 con 0x55deda52c630 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52162/0 (socket says 172.21.15.64:52162) 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 -- 172.21.15.64:0/4120550859 learned_addr learned my addr 172.21.15.64:0/4120550859 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4893e00640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda631280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f489a800640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 -- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 msgr2=0x55deda6317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 -- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 msgr2=0x55deda631280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda631280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 -- 172.21.15.64:0/4120550859 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deda4dab00 con 0x55deda50a170 2024-09-21T07:24:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4893e00640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda631280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:24:53.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f489a800640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:24:53.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f4899e00640 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f488c01d750 tx=0x7f488c0c1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cd064f0b7efc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f488a000640 1 -- 172.21.15.64:0/4120550859 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c119070 con 0x55deda50a170 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f488a000640 1 -- 172.21.15.64:0/4120550859 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f488c117070 con 0x55deda50a170 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f488a000640 1 -- 172.21.15.64:0/4120550859 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c112040 con 0x55deda50a170 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- 172.21.15.64:0/4120550859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 msgr2=0x55deda635200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f488c01d750 tx=0x7f488c0c1040 comp rx=0 tx=0).stop 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- 172.21.15.64:0/4120550859 shutdown_connections 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda631280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 --2- 172.21.15.64:0/4120550859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda635200 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- 172.21.15.64:0/4120550859 >> 172.21.15.64:0/4120550859 conn(0x55deda13bd20 msgr2=0x55deda66b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- 172.21.15.64:0/4120550859 shutdown_connections 2024-09-21T07:24:53.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.786+0000 7f48a84b9000 1 -- 172.21.15.64:0/4120550859 wait complete. 2024-09-21T07:24:53.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- start start 2024-09-21T07:24:53.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 Processor -- start 2024-09-21T07:24:53.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda634d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55deda429040 con 0x55deda50a170 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55deda481100 con 0x55deda51dab0 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55deda47dfe0 con 0x55deda52c630 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 10 client.0 _ll_register_callbacks cb 0x7f4894001700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52168/0 (socket says 172.21.15.64:52168) 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 -- 172.21.15.64:0/3035027141 learned_addr learned my addr 172.21.15.64:0/3035027141 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f489a800640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4893e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda634d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 -- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 msgr2=0x55deda6ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 -- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 msgr2=0x55deda634d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda634d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 -- 172.21.15.64:0/3035027141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deda448060 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f4899e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f488c01cce0 tx=0x7f488c12cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e16acc28cf782f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f487f400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c112040 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f488c102670 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f488c117070 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f488c119040 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 10 client.5157 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.790+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55deda414640 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f488c117070 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f488c102b50 con 0x55deda50a170 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 10 client.5157 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 10 client.5157 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 20 client.5157 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda10e930 0x55deda6aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 4 client.5157 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-21T07:24:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55deda48c5b0 con 0x55deda10e930 2024-09-21T07:24:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f4893e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda10e930 0x55deda6aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f4893e00640 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda10e930 0x55deda6aeba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6683466ad0cdba server_cookie=a40d29f62849b893 in_seq=0 out_seq=0 2024-09-21T07:24:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 10 client.5157 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 1 -- 172.21.15.64:0/3035027141 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18085 (crc 0 0 0) 0x55deda48c5b0 con 0x55deda10e930 2024-09-21T07:24:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 10 client.5157 handle_command_reply: tid=0 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 client.5157 shutdown 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 msgr2=0x55deda634820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f488c01cce0 tx=0x7f488c12cb70 comp rx=0 tx=0).stop 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 shutdown_connections 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55deda10e930 0x55deda6aeba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55deda52c630 0x55deda6ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55deda51dab0 0x55deda634d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f487f400640 0 client.5157 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 --2- 172.21.15.64:0/3035027141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55deda50a170 0x55deda634820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 >> 172.21.15.64:0/3035027141 conn(0x55deda13bd20 msgr2=0x55deda68c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 shutdown_connections 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 1 -- 172.21.15.64:0/3035027141 wait complete. 2024-09-21T07:24:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a84b9000 20 client.5157 trim_cache size 0 max 16384 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 2127, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 2128, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 533016, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 36075270, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 9, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 3, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.335821769, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.187258403, 2024-09-21T07:24:53.802 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.055567575, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.072936221, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2127, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.398392052, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000187302 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000263, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000131 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:24:53.803 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1046, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1062, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 264146, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 15602106, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 6, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.192089380, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.101504553, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.033493927, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.045730118, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1061, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.521001940, 2024-09-21T07:24:53.804 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000491048 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 2032, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 82544 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 28475, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 50763, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 10619252, 2024-09-21T07:24:53.805 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 52482115, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 7, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 6.396417256, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 3.561665034, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 2.707104143, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.859091407, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 50762, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.589822440, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000031319 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 72415, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.018484203, 2024-09-21T07:24:53.806 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000255 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 127104, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 21040 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1348, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 19.091774781, 2024-09-21T07:24:53.807 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.014163037 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1985, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.869972777, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000438273 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 25576, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 25576, 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-21T07:24:53.808 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 25576, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 450.766711737, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.017624597 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 12, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 19924, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 19924, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-21T07:24:53.809 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 19923, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 36, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 36, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 46518, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 45960, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 103, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-21T07:24:53.810 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:24:53.811 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 1124, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 4036, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 3420, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 2660, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 52, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 14088 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-21T07:24:53.812 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 2000, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 163, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 4189, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 1803, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 2241, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:24:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.814 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 24979, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 24979, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 36, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 36, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 4, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-21T07:24:53.815 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 90345730, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2635, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 130.861679213, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.049662876 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 2014, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 2014, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 0, 2024-09-21T07:24:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 13, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 13, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 0, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 19924, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 19925, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 1, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 36, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 7416, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 7380, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 180628, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 408842240 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 28536, 2024-09-21T07:24:53.817 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 25576, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 4, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2000, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.715969319, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000857984 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 24, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003904063, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000162669 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.818 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6000, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 7.793513827, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001298918 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7297, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 5.375319983, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000736647 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.820 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000080957, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000080957 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.821 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003448636, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.003448636 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.822 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.273233005, 2024-09-21T07:24:53.823 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.273233005 2024-09-21T07:24:53.823 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.823 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000107603, 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000107603 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8, 2024-09-21T07:24:53.825 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.775353569, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.096919196 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2241, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 411.915046883, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.183808588 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.029665813, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.029665813 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.827 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000306263, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000306263 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-21T07:24:53.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-21T07:24:53.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8000, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 22.880761816, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002860095 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 1, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 0, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 1, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 17519, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 17519, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 56, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.831 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:24:53.832 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:24:53.833 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 16286117, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 4098, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-21T07:24:53.834 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 5520, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 78, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 20010365, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 829679, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-21T07:24:53.835 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 4694, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 86625994, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 37, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 4694, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4694, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 37.539299512, 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.007997294 2024-09-21T07:24:53.836 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4694, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 4800 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 4694, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 54, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 4640, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 11, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 54, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 2689, 2024-09-21T07:24:53.837 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 35, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 1803, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 32, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 22, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:24:53.838 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-21T07:24:53.839 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 42, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 3, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 8, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 8, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-21T07:24:53.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 120, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 34 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 32, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-21T07:24:53.841 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 32, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 1803, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 1803, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 31644, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 8563023, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 31644, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:24:53.842 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 31644, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 8563023, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:24:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4694, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 86822521, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4694, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 86822521, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-21T07:24:53.844 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4694, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 4694, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4694, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 4694, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.845 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 1803, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 196527, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 1803, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 54, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 196527, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x555caf9e35f0": { 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 84, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 24979, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 86151426, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 24979, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2635, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 86151342, 2024-09-21T07:24:53.847 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:53.848 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:24:53.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 msgr2=0x7f4878075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 0x7f4878075710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f489c15e2b0 tx=0x7f48840091e0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 msgr2=0x7f489c0b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 0x7f489c0b0390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f488000bae0 tx=0x7f488c0aca40 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 shutdown_connections 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4878073200 0x7f4878075710 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f489c0ae020 0x7f489c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f489c15f370 0x7f489c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 --2- 172.21.15.64:0/2182913279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4880003a80 0x7f489c0b0390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 >> 172.21.15.64:0/2182913279 conn(0x7f489c0ccbe0 msgr2=0x7f489c0cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 shutdown_connections 2024-09-21T07:24:53.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:53.794+0000 7f48a0e00640 1 -- 172.21.15.64:0/2182913279 wait complete. 2024-09-21T07:24:53.851 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-21T07:24:53.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:53.851 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 -- 172.21.15.64:0/867855832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 msgr2=0x7fd62015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 --2- 172.21.15.64:0/867855832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015f480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd618009bc0 tx=0x7fd61801cba0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 -- 172.21.15.64:0/867855832 shutdown_connections 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 --2- 172.21.15.64:0/867855832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015f480 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 --2- 172.21.15.64:0/867855832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6201594c0 0x7fd6200aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 -- 172.21.15.64:0/867855832 >> 172.21.15.64:0/867855832 conn(0x7fd6200d0170 msgr2=0x7fd6200d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 -- 172.21.15.64:0/867855832 shutdown_connections 2024-09-21T07:24:54.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.010+0000 7fd625000640 1 -- 172.21.15.64:0/867855832 wait complete. 2024-09-21T07:24:54.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 Processor -- start 2024-09-21T07:24:54.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- start start 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd62006ec70 0x7fd620157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd62015c410 con 0x7fd620158030 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd62015c290 con 0x7fd6200af360 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd62015c590 con 0x7fd62006ec70 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52170/0 (socket says 172.21.15.64:52170) 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 -- 172.21.15.64:0/1673259171 learned_addr learned my addr 172.21.15.64:0/1673259171 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61d400640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61de00640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd62006ec70 0x7fd620157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 -- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd62006ec70 msgr2=0x7fd620157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd62006ec70 0x7fd620157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 -- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 msgr2=0x7fd62015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 -- 172.21.15.64:0/1673259171 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6201fa4a0 con 0x7fd620158030 2024-09-21T07:24:54.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd61e800640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd61801c610 tx=0x7fd618005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd616000640 1 -- 172.21.15.64:0/1673259171 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6180b2040 con 0x7fd620158030 2024-09-21T07:24:54.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd616000640 1 -- 172.21.15.64:0/1673259171 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6180bb070 con 0x7fd620158030 2024-09-21T07:24:54.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6201fa780 con 0x7fd620158030 2024-09-21T07:24:54.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd616000640 1 -- 172.21.15.64:0/1673259171 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618004590 con 0x7fd620158030 2024-09-21T07:24:54.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.014+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62009bfa0 con 0x7fd620158030 2024-09-21T07:24:54.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd616000640 1 -- 172.21.15.64:0/1673259171 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd6180c0460 con 0x7fd620158030 2024-09-21T07:24:54.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd616000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 0x7fd600075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd616000640 1 -- 172.21.15.64:0/1673259171 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fd61812ec70 con 0x7fd620158030 2024-09-21T07:24:54.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd61de00640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 0x7fd600075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd62c746000 1 Processor -- start 2024-09-21T07:24:54.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd62c746000 1 -- start start 2024-09-21T07:24:54.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.018+0000 7fd61de00640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 0x7fd600075740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd610007fd0 tx=0x7fd610009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bc2e20 0x563ad0d28c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563ad0b3b8b0 con 0x563ad0baf6e0 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563ad0b2ace0 con 0x563ad0bafef0 2024-09-21T07:24:54.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563ad0b2eaf0 con 0x563ad0bc2e20 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bc2e20 0x563ad0d28c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52184/0 (socket says 172.21.15.64:52184) 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 -- 172.21.15.64:0/2020341302 learned_addr learned my addr 172.21.15.64:0/2020341302 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61e800640 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:38730/0 (socket says 172.21.15.64:38730) 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 -- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bc2e20 msgr2=0x563ad0d28c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bc2e20 0x563ad0d28c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 -- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 msgr2=0x563ad0d296e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 -- 172.21.15.64:0/2020341302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad0ade4e0 con 0x563ad0baf6e0 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61e800640 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:24:54.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd61d400640 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009bd0 tx=0x7fd60c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b7d366f654a208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd60aa00640 1 -- 172.21.15.64:0/2020341302 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004310 con 0x563ad0baf6e0 2024-09-21T07:24:54.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd60aa00640 1 -- 172.21.15.64:0/2020341302 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd60c0044b0 con 0x563ad0baf6e0 2024-09-21T07:24:54.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd60aa00640 1 -- 172.21.15.64:0/2020341302 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c005280 con 0x563ad0baf6e0 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- 172.21.15.64:0/2020341302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 msgr2=0x563ad0d291a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009bd0 tx=0x7fd60c011440 comp rx=0 tx=0).stop 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- 172.21.15.64:0/2020341302 shutdown_connections 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0d296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0baf6e0 0x563ad0d291a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 --2- 172.21.15.64:0/2020341302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bc2e20 0x563ad0d28c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- 172.21.15.64:0/2020341302 >> 172.21.15.64:0/2020341302 conn(0x563ad0be6980 msgr2=0x563ad0cddee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- 172.21.15.64:0/2020341302 shutdown_connections 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.022+0000 7fd62c746000 1 -- 172.21.15.64:0/2020341302 wait complete. 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- start start 2024-09-21T07:24:54.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 Processor -- start 2024-09-21T07:24:54.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0d2f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bc2e20 0x563ad0d2fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563ad0aeaa20 con 0x563ad0bafef0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563ad0ad4cc0 con 0x563ad0bc2e20 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563ad0ae2f70 con 0x563ad0baf6e0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 10 client.0 _ll_register_callbacks cb 0x563ad0ccab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52194/0 (socket says 172.21.15.64:52194) 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 -- 172.21.15.64:0/4049273066 learned_addr learned my addr 172.21.15.64:0/4049273066 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61de00640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0d2f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61e800640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bc2e20 0x563ad0d2fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 -- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 msgr2=0x563ad0d2f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0d2f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 -- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bc2e20 msgr2=0x563ad0d2fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bc2e20 0x563ad0d2fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 -- 172.21.15.64:0/4049273066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad0ad3ea0 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd61d400640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009fd0 tx=0x7fd60c003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a819be89c4936a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c003be0 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ad0ac33d0 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fd60c003d80 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd60c02c050 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 10 client.5166 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563ad0ad0500 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563ad0ac33d0 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fd60c02f020 con 0x563ad0bafef0 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 10 client.5166 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 10 client.5166 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 20 client.5166 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07cd860 0x563ad0d394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 4 client.5166 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.026+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ad0b3d800 con 0x563ad07cd860 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd61de00640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07cd860 0x563ad0d394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd61de00640 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07cd860 0x563ad0d394c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309e314b80f4977e server_cookie=bff1bd772fd7bd1f in_seq=0 out_seq=0 2024-09-21T07:24:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd5ff400640 10 client.5166 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd5ff400640 1 -- 172.21.15.64:0/4049273066 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ad0b3d800 con 0x563ad07cd860 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd5ff400640 10 client.5166 handle_command_reply: tid=0 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 client.5166 shutdown 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 msgr2=0x563ad0d2f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009fd0 tx=0x7fd60c003830 comp rx=0 tx=0).stop 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 shutdown_connections 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bc2e20 0x563ad0d2fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bafef0 0x563ad0d2f620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07cd860 0x563ad0d394c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 --2- 172.21.15.64:0/4049273066 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0d2f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 >> 172.21.15.64:0/4049273066 conn(0x563ad0be6980 msgr2=0x563ad0cde670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd5ff400640 0 client.5166 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 shutdown_connections 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 1 -- 172.21.15.64:0/4049273066 wait complete. 2024-09-21T07:24:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.030+0000 7fd62c746000 20 client.5166 trim_cache size 0 max 16384 2024-09-21T07:24:54.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 Processor -- start 2024-09-21T07:24:54.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 -- start start 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0ce5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0d33110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd620202660 con 0x563ad0bc2e20 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd62009d6b0 con 0x563ad0bafef0 2024-09-21T07:24:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd6202020a0 con 0x563ad0baf6e0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0d33110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0ce5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:39418/0 (socket says 172.21.15.64:39418) 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 -- 172.21.15.64:0/3009403690 learned_addr learned my addr 172.21.15.64:0/3009403690 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0d33110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52200/0 (socket says 172.21.15.64:52200) 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 -- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 msgr2=0x563ad0ce5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0ce5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 -- 172.21.15.64:0/3009403690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 msgr2=0x563ad0d33110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0d33110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 -- 172.21.15.64:0/3009403690 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad0ce3590 con 0x563ad0baf6e0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd61de00640 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6200cc8f0 tx=0x7fd610012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8201de0c092ca45e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd60a000640 1 -- 172.21.15.64:0/3009403690 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610016d80 con 0x563ad0baf6e0 2024-09-21T07:24:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd60a000640 1 -- 172.21.15.64:0/3009403690 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd61001b040 con 0x563ad0baf6e0 2024-09-21T07:24:54.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.050+0000 7fd60a000640 1 -- 172.21.15.64:0/3009403690 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61000fd90 con 0x563ad0baf6e0 2024-09-21T07:24:54.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 msgr2=0x563ad0ce4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6200cc8f0 tx=0x7fd610012000 comp rx=0 tx=0).stop 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- 172.21.15.64:0/3009403690 shutdown_connections 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0d33110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0bafef0 0x563ad0ce5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- 172.21.15.64:0/3009403690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0baf6e0 0x563ad0ce4e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- 172.21.15.64:0/3009403690 >> 172.21.15.64:0/3009403690 conn(0x563ad0be6980 msgr2=0x563ad0cdcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- 172.21.15.64:0/3009403690 shutdown_connections 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- 172.21.15.64:0/3009403690 wait complete. 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- start start 2024-09-21T07:24:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 Processor -- start 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0baf6e0 0x563ad0da35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bafef0 0x563ad0da3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563ad0af7ea0 con 0x563ad0bc2e20 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563ad0b3a680 con 0x563ad0baf6e0 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563ad0b2de00 con 0x563ad0bafef0 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd62c746000 10 client.0 _ll_register_callbacks cb 0x7fd610017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52204/0 (socket says 172.21.15.64:52204) 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 -- 172.21.15.64:0/3694846083 learned_addr learned my addr 172.21.15.64:0/3694846083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61de00640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0baf6e0 0x563ad0da35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61d400640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bafef0 0x563ad0da3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 -- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bafef0 msgr2=0x563ad0da3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bafef0 0x563ad0da3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 -- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0baf6e0 msgr2=0x563ad0da35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0baf6e0 0x563ad0da35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.054+0000 7fd61e800640 1 -- 172.21.15.64:0/3694846083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad0af8df0 con 0x563ad0bc2e20 2024-09-21T07:24:54.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd61e800640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6180985a0 tx=0x7fd6180f8d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4679bc882aab6633 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618102ad0 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fd6180f8770 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd61001b040 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd6180f9510 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 10 client.5172 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563ad0ac9290 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd61001b040 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fd6180b5070 con 0x563ad0bc2e20 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 10 client.5172 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 10 client.5172 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 20 client.5172 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07bb8c0 0x563ad0d5f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 4 client.5172 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x563ad0b392b0 con 0x563ad07bb8c0 2024-09-21T07:24:54.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd61de00640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07bb8c0 0x563ad0d5f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd61de00640 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07bb8c0 0x563ad0d5f2f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cb382bb47ca2c34 server_cookie=f389d494eda37e04 in_seq=0 out_seq=0 2024-09-21T07:24:54.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.058+0000 7fd5ff400640 10 client.5172 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd5ff400640 1 -- 172.21.15.64:0/3694846083 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563ad0b392b0 con 0x563ad07bb8c0 2024-09-21T07:24:54.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd5ff400640 10 client.5172 handle_command_reply: tid=0 2024-09-21T07:24:54.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 client.5172 shutdown 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 msgr2=0x563ad0da4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6180985a0 tx=0x7fd6180f8d40 comp rx=0 tx=0).stop 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 shutdown_connections 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563ad0bc2e20 0x563ad0da4060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x563ad07bb8c0 0x563ad0d5f2f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563ad0bafef0 0x563ad0da3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 --2- 172.21.15.64:0/3694846083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ad0baf6e0 0x563ad0da35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd5ff400640 0 client.5172 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 >> 172.21.15.64:0/3694846083 conn(0x563ad0be6980 msgr2=0x563ad0ce4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.062+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 shutdown_connections 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd62c746000 1 -- 172.21.15.64:0/3694846083 wait complete. 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd62c746000 20 client.5172 trim_cache size 0 max 16384 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "2a850bf5-72b1-4c22-82a9-038897602863", 2024-09-21T07:24:54.069 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:24:54.070 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:24:54.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 msgr2=0x7fd600075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 0x7fd600075740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd610007fd0 tx=0x7fd610009040 comp rx=0 tx=0).stop 2024-09-21T07:24:54.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 msgr2=0x7fd62015a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd61801c610 tx=0x7fd618005a60 comp rx=0 tx=0).stop 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 shutdown_connections 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd600073230 0x7fd600075740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd620158030 0x7fd62015a5b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6200af360 0x7fd62015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 --2- 172.21.15.64:0/1673259171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd62006ec70 0x7fd620157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 >> 172.21.15.64:0/1673259171 conn(0x7fd6200d0170 msgr2=0x7fd6200b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 shutdown_connections 2024-09-21T07:24:54.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.066+0000 7fd625000640 1 -- 172.21.15.64:0/1673259171 wait complete. 2024-09-21T07:24:54.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:54.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 -- 172.21.15.64:0/2902037244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0ceab0 msgr2=0x7fe94c0ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 --2- 172.21.15.64:0/2902037244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0ceab0 0x7fe94c0ceec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe938009840 tx=0x7fe93801c820 comp rx=0 tx=0).stop 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 -- 172.21.15.64:0/2902037244 shutdown_connections 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 --2- 172.21.15.64:0/2902037244 >> v2:172.21.15.64:3300/0 conn(0x7fe94c0b1af0 0x7fe94c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 --2- 172.21.15.64:0/2902037244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0ceab0 0x7fe94c0ceec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 -- 172.21.15.64:0/2902037244 >> 172.21.15.64:0/2902037244 conn(0x7fe94c09b3b0 msgr2=0x7fe94c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 -- 172.21.15.64:0/2902037244 shutdown_connections 2024-09-21T07:24:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.274+0000 7fe94be00640 1 -- 172.21.15.64:0/2902037244 wait complete. 2024-09-21T07:24:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 Processor -- start 2024-09-21T07:24:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 -- start start 2024-09-21T07:24:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0b1af0 0x7fe94c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 0x7fe94c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c169e40 con 0x7fe94c0ceab0 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c169cc0 con 0x7fe94c0cfed0 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c169fc0 con 0x7fe94c0b1af0 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.278+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52234/0 (socket says 172.21.15.64:52234) 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 -- 172.21.15.64:0/3762788578 learned_addr learned my addr 172.21.15.64:0/3762788578 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94b400640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 0x7fe94c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 -- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0b1af0 msgr2=0x7fe94c153340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0b1af0 0x7fe94c153340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 -- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 msgr2=0x7fe94c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 0x7fe94c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 -- 172.21.15.64:0/3762788578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c06fab0 con 0x7fe94c0ceab0 2024-09-21T07:24:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94b400640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 0x7fe94c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:24:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94a000640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe938009790 tx=0x7fe9380a6620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe942a00640 1 -- 172.21.15.64:0/3762788578 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9380be070 con 0x7fe94c0ceab0 2024-09-21T07:24:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe942a00640 1 -- 172.21.15.64:0/3762788578 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe938004320 con 0x7fe94c0ceab0 2024-09-21T07:24:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c06fd90 con 0x7fe94c0ceab0 2024-09-21T07:24:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe942a00640 1 -- 172.21.15.64:0/3762788578 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938003860 con 0x7fe94c0ceab0 2024-09-21T07:24:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.282+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c1f90d0 con 0x7fe94c0ceab0 2024-09-21T07:24:54.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe942a00640 1 -- 172.21.15.64:0/3762788578 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe938003a00 con 0x7fe94c0ceab0 2024-09-21T07:24:54.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 Processor -- start 2024-09-21T07:24:54.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 -- start start 2024-09-21T07:24:54.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe942a00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 0x7fe92c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe942a00640 1 -- 172.21.15.64:0/3762788578 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fe93812e970 con 0x7fe94c0ceab0 2024-09-21T07:24:54.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe94b400640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 0x7fe92c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe94b400640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 0x7fe92c075710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe94c15cd90 tx=0x7fe9440095c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a361170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a361bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d18a1f7cd0 con 0x55d189e43890 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d18a10d330 con 0x55d189f07aa0 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.286+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d18a16abb0 con 0x55d18a1ec6d0 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52238/0 (socket says 172.21.15.64:52238) 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 -- 172.21.15.64:0/1049167268 learned_addr learned my addr 172.21.15.64:0/1049167268 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94b400640 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a361bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 -- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 msgr2=0x55d18a361170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a361170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 -- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 msgr2=0x55d18a361bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a361bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 -- 172.21.15.64:0/1049167268 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d18a10ec80 con 0x55d189e43890 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe94a000640 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9380f8fe0 tx=0x7fe9380f8880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b323d1cf1cbce85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe937400640 1 -- 172.21.15.64:0/1049167268 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938100070 con 0x55d189e43890 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe937400640 1 -- 172.21.15.64:0/1049167268 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9380f9750 con 0x55d189e43890 2024-09-21T07:24:54.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe937400640 1 -- 172.21.15.64:0/1049167268 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9380f9050 con 0x55d189e43890 2024-09-21T07:24:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 -- 172.21.15.64:0/1049167268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 msgr2=0x55d18a3616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9380f8fe0 tx=0x7fe9380f8880 comp rx=0 tx=0).stop 2024-09-21T07:24:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 -- 172.21.15.64:0/1049167268 shutdown_connections 2024-09-21T07:24:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a361bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3616b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 --2- 172.21.15.64:0/1049167268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a361170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 -- 172.21.15.64:0/1049167268 >> 172.21.15.64:0/1049167268 conn(0x55d189e175c0 msgr2=0x55d18a314520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 -- 172.21.15.64:0/1049167268 shutdown_connections 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.290+0000 7fe959247000 1 -- 172.21.15.64:0/1049167268 wait complete. 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 -- start start 2024-09-21T07:24:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 Processor -- start 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a34c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d18a1ec6d0 0x55d18a34d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d18a15ddf0 con 0x55d189f07aa0 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d18a159fe0 con 0x55d18a1ec6d0 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d18a0ff4d0 con 0x55d189e43890 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 10 client.0 _ll_register_callbacks cb 0x55d18a0dd7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52250/0 (socket says 172.21.15.64:52250) 2024-09-21T07:24:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 -- 172.21.15.64:0/37730328 learned_addr learned my addr 172.21.15.64:0/37730328 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94b400640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d18a1ec6d0 0x55d18a34d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 -- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 msgr2=0x55d18a34c620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a34c620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 -- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d18a1ec6d0 msgr2=0x55d18a34d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d18a1ec6d0 0x55d18a34d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 -- 172.21.15.64:0/37730328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d18a0f8210 con 0x55d189f07aa0 2024-09-21T07:24:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe94a000640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe9380f5060 tx=0x7fe9380f54d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26f74e11d0ab6da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe92be00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9380f9750 con 0x55d189f07aa0 2024-09-21T07:24:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fe9380f49a0 con 0x55d189f07aa0 2024-09-21T07:24:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.294+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d18a0f2350 con 0x55d189f07aa0 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe9380fdb30 con 0x55d189f07aa0 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 10 client.5184 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d18a0defc0 con 0x55d189f07aa0 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d18a0f2350 con 0x55d189f07aa0 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fe9380f4ba0 con 0x55d189f07aa0 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 10 client.5184 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 10 client.5184 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 20 client.5184 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dfc930 0x55d18a34e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 4 client.5184 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:24:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d18a16cb00 con 0x55d189dfc930 2024-09-21T07:24:54.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe94aa00640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dfc930 0x55d18a34e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe94aa00640 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dfc930 0x55d18a34e030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d030b5e11dff52 server_cookie=2d235c56a479a61a in_seq=0 out_seq=0 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 10 client.5184 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 1 -- 172.21.15.64:0/37730328 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d18a16cb00 con 0x55d189dfc930 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe92be00640 10 client.5184 handle_command_reply: tid=0 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.298+0000 7fe959247000 1 client.5184 shutdown 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 msgr2=0x55d18a34d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe9380f5060 tx=0x7fe9380f54d0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 shutdown_connections 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d18a1ec6d0 0x55d18a34d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189f07aa0 0x55d18a34d0e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dfc930 0x55d18a34e030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 --2- 172.21.15.64:0/37730328 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a34c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 >> 172.21.15.64:0/37730328 conn(0x55d189e175c0 msgr2=0x55d18a314ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe92be00640 0 client.5184 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 shutdown_connections 2024-09-21T07:24:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 1 -- 172.21.15.64:0/37730328 wait complete. 2024-09-21T07:24:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.302+0000 7fe959247000 20 client.5184 trim_cache size 0 max 16384 2024-09-21T07:24:54.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.322+0000 7fe959247000 1 Processor -- start 2024-09-21T07:24:54.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.322+0000 7fe959247000 1 -- start start 2024-09-21T07:24:54.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a315530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d18a1ec6d0 0x55d18a315a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c15f660 con 0x55d18a1ec6d0 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c15e6a0 con 0x55d189f07aa0 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c15c6c0 con 0x55d189e43890 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a315530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a315530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:38798/0 (socket says 172.21.15.64:38798) 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94a000640 1 -- 172.21.15.64:0/287233763 learned_addr learned my addr 172.21.15.64:0/287233763 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:39464/0 (socket says 172.21.15.64:39464) 2024-09-21T07:24:54.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94b400640 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d18a1ec6d0 0x55d18a315a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 -- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 msgr2=0x55d18a315530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a315530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 -- 172.21.15.64:0/287233763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d18a1ec6d0 msgr2=0x55d18a315a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d18a1ec6d0 0x55d18a315a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 -- 172.21.15.64:0/287233763 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d18a31e1e0 con 0x55d189e43890 2024-09-21T07:24:54.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe94aa00640 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55d18a0ff720 tx=0x7fe93c006db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42c3e2040948ac3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe936a00640 1 -- 172.21.15.64:0/287233763 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c005110 con 0x55d189e43890 2024-09-21T07:24:54.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe936a00640 1 -- 172.21.15.64:0/287233763 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe93c0052d0 con 0x55d189e43890 2024-09-21T07:24:54.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.326+0000 7fe936a00640 1 -- 172.21.15.64:0/287233763 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0054c0 con 0x55d189e43890 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 msgr2=0x55d18a377fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55d18a0ff720 tx=0x7fe93c006db0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- 172.21.15.64:0/287233763 shutdown_connections 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d18a1ec6d0 0x55d18a315a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a315530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 --2- 172.21.15.64:0/287233763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d189e43890 0x55d18a377fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- 172.21.15.64:0/287233763 >> 172.21.15.64:0/287233763 conn(0x55d189e175c0 msgr2=0x55d18a35e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- 172.21.15.64:0/287233763 shutdown_connections 2024-09-21T07:24:54.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- 172.21.15.64:0/287233763 wait complete. 2024-09-21T07:24:54.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 -- start start 2024-09-21T07:24:54.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.330+0000 7fe959247000 1 Processor -- start 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a3d6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a3d7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d18a10d330 con 0x55d189e43890 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d18a15ddf0 con 0x55d189f07aa0 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d18a159fe0 con 0x55d18a1ec6d0 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 10 client.0 _ll_register_callbacks cb 0x7fe94400fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:24:54.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52262/0 (socket says 172.21.15.64:52262) 2024-09-21T07:24:54.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 -- 172.21.15.64:0/2313568697 learned_addr learned my addr 172.21.15.64:0/2313568697 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:24:54.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94b400640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a3d7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94a000640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a3d6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 -- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 msgr2=0x55d18a3d7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a3d7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 -- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 msgr2=0x55d18a3d6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a3d6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 -- 172.21.15.64:0/2313568697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d18a1b7680 con 0x55d189e43890 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe94aa00640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55d18a18d030 tx=0x7fe93c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa441d6632bfc5fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe92be00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c003a10 con 0x55d189e43890 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fe93c003bb0 con 0x55d189e43890 2024-09-21T07:24:54.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe93c0052d0 con 0x55d189e43890 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe93c02d050 con 0x55d189e43890 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 10 client.5190 fetch_fsmap learned FSMap version 19 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d18a1240b0 con 0x55d189e43890 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.334+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe93c0052d0 con 0x55d189e43890 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fe93c030020 con 0x55d189e43890 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 10 client.5190 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 10 client.5190 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 20 client.5190 populate_metadata read hostname 'smithi064' 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dea990 0x55d18a375f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 4 client.5190 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:24:54.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d18a1685b0 con 0x55d189dea990 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe94a000640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dea990 0x55d18a375f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe94a000640 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dea990 0x55d18a375f00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b77480e7a5caab4 server_cookie=f9abdae79cb5d14d in_seq=0 out_seq=0 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe92be00640 10 client.5190 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe92be00640 1 -- 172.21.15.64:0/2313568697 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55d18a1685b0 con 0x55d189dea990 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe92be00640 10 client.5190 handle_command_reply: tid=0 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 client.5190 shutdown 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 msgr2=0x55d18a3d6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55d18a18d030 tx=0x7fe93c0077a0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 shutdown_connections 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55d189dea990 0x55d18a375f00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d18a1ec6d0 0x55d18a3d7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d189f07aa0 0x55d18a3d6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe92be00640 0 client.5190 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 --2- 172.21.15.64:0/2313568697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d189e43890 0x55d18a3d6580 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 >> 172.21.15.64:0/2313568697 conn(0x55d189e175c0 msgr2=0x55d18a35e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 shutdown_connections 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.338+0000 7fe959247000 1 -- 172.21.15.64:0/2313568697 wait complete. 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe959247000 20 client.5190 trim_cache size 0 max 16384 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:24:54.347 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "scrub active (1630 inodes in the stack)", 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "2a850bf5-72b1-4c22-82a9-038897602863": { 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "2a850bf5-72b1-4c22-82a9-038897602863", 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive,scrub_mdsdir" 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "2a850bf5-72b1-4c22-82a9-038897602863": { 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:24:54.058347+0000", 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:24:54.348 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:24:54.349 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:24:54.349 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:54.349 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:24:54.349 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:24:54.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 msgr2=0x7fe92c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 0x7fe92c075710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe94c15cd90 tx=0x7fe9440095c0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 msgr2=0x7fe94c1fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe938009790 tx=0x7fe9380a6620 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 shutdown_connections 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe92c073200 0x7fe92c075710 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cfed0 0x7fe94c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe94c0ceab0 0x7fe94c1fccb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 --2- 172.21.15.64:0/3762788578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94c0b1af0 0x7fe94c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 >> 172.21.15.64:0/3762788578 conn(0x7fe94c09b3b0 msgr2=0x7fe94c0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 shutdown_connections 2024-09-21T07:24:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:24:54.342+0000 7fe94be00640 1 -- 172.21.15.64:0/3762788578 wait complete. 2024-09-21T07:24:54.368 INFO:tasks.cephfs.filesystem:scrub status for tag:2a850bf5-72b1-4c22-82a9-038897602863 - {'path': '/', 'tag': '2a850bf5-72b1-4c22-82a9-038897602863', 'options': 'recursive,scrub_mdsdir'} 2024-09-21T07:25:08.974 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:08.978 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:24.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:24.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-21T07:25:24.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- 172.21.15.64:0/3654433561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03740b1be0 msgr2=0x7f03740b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 --2- 172.21.15.64:0/3654433561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03740b1be0 0x7f03740b1ff0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03740d1210 tx=0x7f036c01ccf0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- 172.21.15.64:0/3654433561 shutdown_connections 2024-09-21T07:25:24.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 --2- 172.21.15.64:0/3654433561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03740b1be0 0x7f03740b1ff0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 --2- 172.21.15.64:0/3654433561 >> v2:172.21.15.90:3300/0 conn(0x7f037415cca0 0x7f037415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 --2- 172.21.15.64:0/3654433561 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 0x7f037415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- 172.21.15.64:0/3654433561 >> 172.21.15.64:0/3654433561 conn(0x7f03740ccbe0 msgr2=0x7f03740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- 172.21.15.64:0/3654433561 shutdown_connections 2024-09-21T07:25:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- 172.21.15.64:0/3654433561 wait complete. 2024-09-21T07:25:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 Processor -- start 2024-09-21T07:25:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.541+0000 7f037b800640 1 -- start start 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 0x7f03740ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 0x7f0374153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f037406f3f0 con 0x7f037415cca0 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f037406f270 con 0x7f03740b1be0 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f037406f570 con 0x7f0374159db0 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39676/0 (socket says 172.21.15.64:39676) 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0378e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 0x7f03740ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 -- 172.21.15.64:0/4221239428 learned_addr learned my addr 172.21.15.64:0/4221239428 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0373e00640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 0x7f0374153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 -- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 msgr2=0x7f0374153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 0x7f0374153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 -- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 msgr2=0x7f03740ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 0x7f03740ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 -- 172.21.15.64:0/4221239428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0374158130 con 0x7f037415cca0 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0378e00640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 0x7f03740ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0379800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f036c01b3a0 tx=0x7f036c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0370c00640 1 -- 172.21.15.64:0/4221239428 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0bb070 con 0x7f037415cca0 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0370c00640 1 -- 172.21.15.64:0/4221239428 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f036c004d40 con 0x7f037415cca0 2024-09-21T07:25:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f0370c00640 1 -- 172.21.15.64:0/4221239428 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0b2040 con 0x7f037415cca0 2024-09-21T07:25:24.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03741583f0 con 0x7f037415cca0 2024-09-21T07:25:24.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.545+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03741589b0 con 0x7f037415cca0 2024-09-21T07:25:24.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0370c00640 1 -- 172.21.15.64:0/4221239428 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f036c004240 con 0x7f037415cca0 2024-09-21T07:25:24.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0370c00640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 0x7f0354075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0370c00640 1 -- 172.21.15.64:0/4221239428 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f036c12e220 con 0x7f037415cca0 2024-09-21T07:25:24.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 Processor -- start 2024-09-21T07:25:24.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0378e00640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 0x7f0354075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 -- start start 2024-09-21T07:25:24.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0378e00640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 0x7f0354075740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f036800ce10 tx=0x7f0368005f00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173bbaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173bbb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563173a59cd0 con 0x563173a4e6d0 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56317396f330 con 0x5631736a5890 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5631739ccbb0 con 0x563173769aa0 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0378e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0378e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39686/0 (socket says 172.21.15.64:39686) 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0378e00640 1 -- 172.21.15.64:0/4236492980 learned_addr learned my addr 172.21.15.64:0/4236492980 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.549+0000 7f0373e00640 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173bbaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0379800640 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173bbb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 -- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 msgr2=0x563173bbb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173bbb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 -- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 msgr2=0x563173bbaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173bbaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 -- 172.21.15.64:0/4236492980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563173970c80 con 0x563173a4e6d0 2024-09-21T07:25:24.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0378e00640 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0368011790 tx=0x7f0368013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959a40892da0f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0365600640 1 -- 172.21.15.64:0/4236492980 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368011e60 con 0x563173a4e6d0 2024-09-21T07:25:24.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0365600640 1 -- 172.21.15.64:0/4236492980 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f036800ec30 con 0x563173a4e6d0 2024-09-21T07:25:24.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0365600640 1 -- 172.21.15.64:0/4236492980 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036801e420 con 0x563173a4e6d0 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- 172.21.15.64:0/4236492980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 msgr2=0x563173bba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0368011790 tx=0x7f0368013000 comp rx=0 tx=0).stop 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- 172.21.15.64:0/4236492980 shutdown_connections 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173bbb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173bbaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 --2- 172.21.15.64:0/4236492980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173bba9f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- 172.21.15.64:0/4236492980 >> 172.21.15.64:0/4236492980 conn(0x5631736795c0 msgr2=0x563173b77ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- 172.21.15.64:0/4236492980 shutdown_connections 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- 172.21.15.64:0/4236492980 wait complete. 2024-09-21T07:25:24.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 -- start start 2024-09-21T07:25:24.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.553+0000 7f0382f47000 1 Processor -- start 2024-09-21T07:25:24.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173b76f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173a4e6d0 0x563173b7d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5631739bfdf0 con 0x5631736a5890 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5631739bbfe0 con 0x563173a4e6d0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5631739614d0 con 0x563173769aa0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 10 client.0 _ll_register_callbacks cb 0x56317393f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39702/0 (socket says 172.21.15.64:39702) 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 -- 172.21.15.64:0/2378284821 learned_addr learned my addr 172.21.15.64:0/2378284821 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0379800640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173a4e6d0 0x563173b7d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0373e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173b76f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 -- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 msgr2=0x563173b76f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173b76f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 -- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173a4e6d0 msgr2=0x563173b7d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173a4e6d0 0x563173b7d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 -- 172.21.15.64:0/2378284821 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317395a210 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0378e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x563173a6f760 tx=0x7f036800efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f9ed1326924e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368034060 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f036801e830 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563173954350 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f036803a050 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 10 client.5202 fetch_fsmap learned FSMap version 19 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563173940fc0 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563173954350 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f036803d020 con 0x5631736a5890 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 10 client.5202 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 10 client.5202 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:25:24.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 20 client.5202 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317365e930 0x563173bc1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 4 client.5202 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631739ceb00 con 0x56317365e930 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0373e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317365e930 0x563173bc1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f035a000640 10 client.5202 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.557+0000 7f0373e00640 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317365e930 0x563173bc1e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71ab915d26fc58b9 server_cookie=653eb9225cdf99ec in_seq=0 out_seq=0 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f035a000640 1 -- 172.21.15.64:0/2378284821 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631739ceb00 con 0x56317365e930 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f035a000640 10 client.5202 handle_command_reply: tid=0 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 client.5202 shutdown 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 msgr2=0x563173b769d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x563173a6f760 tx=0x7f036800efb0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 shutdown_connections 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173a4e6d0 0x563173b7d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317365e930 0x563173bc1e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173769aa0 0x563173b76f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 --2- 172.21.15.64:0/2378284821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631736a5890 0x563173b769d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 >> 172.21.15.64:0/2378284821 conn(0x5631736795c0 msgr2=0x563173b6fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f035a000640 0 client.5202 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 shutdown_connections 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 1 -- 172.21.15.64:0/2378284821 wait complete. 2024-09-21T07:25:24.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.561+0000 7f0382f47000 20 client.5202 trim_cache size 0 max 16384 2024-09-21T07:25:24.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.577+0000 7f0382f47000 1 Processor -- start 2024-09-21T07:25:24.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.577+0000 7f0382f47000 1 -- start start 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5631736a5890 0x563173c2c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173769aa0 0x563173c2c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563173b75af0 con 0x563173a4e6d0 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0374205830 con 0x563173769aa0 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0374204870 con 0x5631736a5890 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39710/0 (socket says 172.21.15.64:39710) 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 -- 172.21.15.64:0/4100899184 learned_addr learned my addr 172.21.15.64:0/4100899184 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0373e00640 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173769aa0 0x563173c2c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0378e00640 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5631736a5890 0x563173c2c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 -- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5631736a5890 msgr2=0x563173c2c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5631736a5890 0x563173c2c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 -- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173769aa0 msgr2=0x563173c2c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173769aa0 0x563173c2c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 -- 172.21.15.64:0/4100899184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563173a19680 con 0x563173a4e6d0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0379800640 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f036c01d1d0 tx=0x7f036c12e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeea0e20d4e5b926 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0364c00640 1 -- 172.21.15.64:0/4100899184 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0f84a0 con 0x563173a4e6d0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0364c00640 1 -- 172.21.15.64:0/4100899184 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f036c0f8990 con 0x563173a4e6d0 2024-09-21T07:25:24.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0364c00640 1 -- 172.21.15.64:0/4100899184 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0fd3c0 con 0x563173a4e6d0 2024-09-21T07:25:24.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- 172.21.15.64:0/4100899184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 msgr2=0x563173c2cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f036c01d1d0 tx=0x7f036c12e040 comp rx=0 tx=0).stop 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- 172.21.15.64:0/4100899184 shutdown_connections 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173a4e6d0 0x563173c2cc70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563173769aa0 0x563173c2c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 --2- 172.21.15.64:0/4100899184 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5631736a5890 0x563173c2c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- 172.21.15.64:0/4100899184 >> 172.21.15.64:0/4100899184 conn(0x5631736795c0 msgr2=0x563173b7c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- 172.21.15.64:0/4100899184 shutdown_connections 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.581+0000 7f0382f47000 1 -- 172.21.15.64:0/4100899184 wait complete. 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- start start 2024-09-21T07:25:24.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 Processor -- start 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173c30650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173a4e6d0 0x563173c310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0374204220 con 0x563173769aa0 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0374203d40 con 0x5631736a5890 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563173681680 con 0x563173a4e6d0 2024-09-21T07:25:24.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 10 client.0 _ll_register_callbacks cb 0x7f036000b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0378e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173c30650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39720/0 (socket says 172.21.15.64:39720) 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 -- 172.21.15.64:0/4185129702 learned_addr learned my addr 172.21.15.64:0/4185129702 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0379800640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173a4e6d0 0x563173c310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 -- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173a4e6d0 msgr2=0x563173c310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173a4e6d0 0x563173c310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 -- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 msgr2=0x563173c30650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173c30650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 -- 172.21.15.64:0/4185129702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631739860b0 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0373e00640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f036000baa0 tx=0x7f036000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7bc3583abdd583 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360005220 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f03600053c0 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f036c0f8990 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f036002e050 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 10 client.5208 fetch_fsmap learned FSMap version 19 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563173952610 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f036c0f8990 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f0360031020 con 0x563173769aa0 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 10 client.5208 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 10 client.5208 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 20 client.5208 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:24.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317364c990 0x563173b71db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 4 client.5208 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.585+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631739ca5b0 con 0x56317364c990 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0378e00640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317364c990 0x563173b71db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f035a000640 10 client.5208 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0378e00640 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317364c990 0x563173b71db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89543c45cd32d1c server_cookie=8c27492c9dcf47ab in_seq=0 out_seq=0 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f035a000640 1 -- 172.21.15.64:0/4185129702 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5631739ca5b0 con 0x56317364c990 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f035a000640 10 client.5208 handle_command_reply: tid=0 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 client.5208 shutdown 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 msgr2=0x563173c30b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f036000baa0 tx=0x7f036000bf60 comp rx=0 tx=0).stop 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 shutdown_connections 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x56317364c990 0x563173b71db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563173a4e6d0 0x563173c310d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563173769aa0 0x563173c30b90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 --2- 172.21.15.64:0/4185129702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631736a5890 0x563173c30650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f035a000640 0 client.5208 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 >> 172.21.15.64:0/4185129702 conn(0x5631736795c0 msgr2=0x563173bccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 shutdown_connections 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 1 -- 172.21.15.64:0/4185129702 wait complete. 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f0382f47000 20 client.5208 trim_cache size 0 max 16384 2024-09-21T07:25:24.597 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "2a850bf5-72b1-4c22-82a9-038897602863": { 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:24:54.058347+0000", 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.598 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:24.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 msgr2=0x7f0354075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 0x7f0354075740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f036800ce10 tx=0x7f0368005f00 comp rx=0 tx=0).stop 2024-09-21T07:25:24.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 msgr2=0x7f03741fb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f036c01b3a0 tx=0x7f036c005b00 comp rx=0 tx=0).stop 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 shutdown_connections 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0354073230 0x7f0354075740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f037415cca0 0x7f03741fb9b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0374159db0 0x7f0374153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 --2- 172.21.15.64:0/4221239428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03740b1be0 0x7f03740ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 >> 172.21.15.64:0/4221239428 conn(0x7f03740ccbe0 msgr2=0x7f03740afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 shutdown_connections 2024-09-21T07:25:24.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.589+0000 7f037b800640 1 -- 172.21.15.64:0/4221239428 wait complete. 2024-09-21T07:25:24.613 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:25:24.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-21T07:25:24.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 -- 172.21.15.64:0/893886066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80ca990 msgr2=0x7f88f806ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 --2- 172.21.15.64:0/893886066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80ca990 0x7f88f806ffb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88f8070eb0 tx=0x7f88e401c7d0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 -- 172.21.15.64:0/893886066 shutdown_connections 2024-09-21T07:25:24.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 --2- 172.21.15.64:0/893886066 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80704f0 0x7f88f80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 --2- 172.21.15.64:0/893886066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80ca990 0x7f88f806ffb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 --2- 172.21.15.64:0/893886066 >> v2:172.21.15.90:3300/0 conn(0x7f88f815ec20 0x7f88f80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 -- 172.21.15.64:0/893886066 >> 172.21.15.64:0/893886066 conn(0x7f88f80ccbe0 msgr2=0x7f88f80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 -- 172.21.15.64:0/893886066 shutdown_connections 2024-09-21T07:25:24.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.769+0000 7f8900400640 1 -- 172.21.15.64:0/893886066 wait complete. 2024-09-21T07:25:24.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 Processor -- start 2024-09-21T07:25:24.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- start start 2024-09-21T07:25:24.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80ca990 0x7f88f809b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 0x7f88f815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80b2540 con 0x7f88f80704f0 2024-09-21T07:25:24.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80b23c0 con 0x7f88f815ec20 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f88f80b26c0 con 0x7f88f80ca990 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39726/0 (socket says 172.21.15.64:39726) 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 -- 172.21.15.64:0/225771060 learned_addr learned my addr 172.21.15.64:0/225771060 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fd000640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80ca990 0x7f88f809b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fe400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 0x7f88f815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 -- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80ca990 msgr2=0x7f88f809b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80ca990 0x7f88f809b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 -- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 msgr2=0x7f88f815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 0x7f88f815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 -- 172.21.15.64:0/225771060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80c5230 con 0x7f88f80704f0 2024-09-21T07:25:24.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fe400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 0x7f88f815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:24.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88fda00640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e7a0 tx=0x7f88ec00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88f5600640 1 -- 172.21.15.64:0/225771060 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00ccc0 con 0x7f88f80704f0 2024-09-21T07:25:24.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88f5600640 1 -- 172.21.15.64:0/225771060 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec00ce60 con 0x7f88f80704f0 2024-09-21T07:25:24.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f80c5510 con 0x7f88f80704f0 2024-09-21T07:25:24.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f88f5600640 1 -- 172.21.15.64:0/225771060 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec004280 con 0x7f88f80704f0 2024-09-21T07:25:24.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.773+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f80c5ad0 con 0x7f88f80704f0 2024-09-21T07:25:24.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f88f5600640 1 -- 172.21.15.64:0/225771060 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f88ec003600 con 0x7f88f80704f0 2024-09-21T07:25:24.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f88f5600640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 0x7f88d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f88f5600640 1 -- 172.21.15.64:0/225771060 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f88ec094e50 con 0x7f88f80704f0 2024-09-21T07:25:24.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f89079d9000 1 Processor -- start 2024-09-21T07:25:24.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f89079d9000 1 -- start start 2024-09-21T07:25:24.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.777+0000 7f88fd000640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 0x7f88d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fd000640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 0x7f88d8075710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af000 tx=0x7f88e40a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c7607c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c7607c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c76057a2e0 con 0x55c760653170 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c7605d7bb0 con 0x55c760666ab0 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c7605c6fe0 con 0x55c760675630 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fe400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c7607c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c7607c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:60670/0 (socket says 172.21.15.64:60670) 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 -- 172.21.15.64:0/641685604 learned_addr learned my addr 172.21.15.64:0/641685604 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 -- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 msgr2=0x55c7607c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c7607c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 -- 172.21.15.64:0/641685604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 msgr2=0x55c7607c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c7607c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 -- 172.21.15.64:0/641685604 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7605651c0 con 0x55c760675630 2024-09-21T07:25:24.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88fda00640 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88ec05f420 tx=0x7f88ec05eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98feac6e8bdccbeb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88ea000640 1 -- 172.21.15.64:0/641685604 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec05fb90 con 0x55c760675630 2024-09-21T07:25:24.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88ea000640 1 -- 172.21.15.64:0/641685604 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec05f490 con 0x55c760675630 2024-09-21T07:25:24.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f88ea000640 1 -- 172.21.15.64:0/641685604 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec063f70 con 0x55c760675630 2024-09-21T07:25:24.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 msgr2=0x55c7607c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88ec05f420 tx=0x7f88ec05eea0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- 172.21.15.64:0/641685604 shutdown_connections 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c7607c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c7607c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 --2- 172.21.15.64:0/641685604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607c5ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- 172.21.15.64:0/641685604 >> 172.21.15.64:0/641685604 conn(0x55c760284d20 msgr2=0x55c76077ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- 172.21.15.64:0/641685604 shutdown_connections 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.781+0000 7f89079d9000 1 -- 172.21.15.64:0/641685604 wait complete. 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- start start 2024-09-21T07:25:24.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 Processor -- start 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 0x55c7607b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c76056c4f0 con 0x55c760666ab0 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c7605cadf0 con 0x55c760653170 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c76028c620 con 0x55c760675630 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 10 client.0 _ll_register_callbacks cb 0x55c76059dcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39740/0 (socket says 172.21.15.64:39740) 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 -- 172.21.15.64:0/2582492615 learned_addr learned my addr 172.21.15.64:0/2582492615 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fda00640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 0x55c7607b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fe400640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 -- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 msgr2=0x55c7607b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 -- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 msgr2=0x55c7607b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 0x55c7607b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 -- 172.21.15.64:0/2582492615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c760696740 con 0x55c760666ab0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fda00640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 0x55c7607b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88fd000640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b0040 tx=0x7f88e401b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2df9ea782f9691 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88dea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4003600 con 0x55c760666ab0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c76055f300 con 0x55c760666ab0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f88e40037a0 con 0x55c760666ab0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f88e40d1050 con 0x55c760666ab0 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 10 client.5220 fetch_fsmap learned FSMap version 19 2024-09-21T07:25:24.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.785+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c76064c440 con 0x55c760666ab0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c76055f300 con 0x55c760666ab0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f88e40d4020 con 0x55c760666ab0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 10 client.5220 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 10 client.5220 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 20 client.5220 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c7602698d0 0x55c7607b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 4 client.5220 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7605d9b00 con 0x55c7602698d0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88fda00640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c7602698d0 0x55c7607b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88fda00640 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c7602698d0 0x55c7607b5930 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44d550aa0df19c58 server_cookie=6dafddfeb3711fd2 in_seq=0 out_seq=0 2024-09-21T07:25:24.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 10 client.5220 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 1 -- 172.21.15.64:0/2582492615 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7605d9b00 con 0x55c7602698d0 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 10 client.5220 handle_command_reply: tid=0 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 client.5220 shutdown 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 msgr2=0x55c7607b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b0040 tx=0x7f88e401b070 comp rx=0 tx=0).stop 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 shutdown_connections 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c7602698d0 0x55c7607b5930 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760675630 0x55c7607b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760666ab0 0x55c7607b49e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 --2- 172.21.15.64:0/2582492615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760653170 0x55c7607b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f88dea00640 0 client.5220 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 >> 172.21.15.64:0/2582492615 conn(0x55c760284d20 msgr2=0x55c76077ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 shutdown_connections 2024-09-21T07:25:24.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 1 -- 172.21.15.64:0/2582492615 wait complete. 2024-09-21T07:25:24.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.789+0000 7f89079d9000 20 client.5220 trim_cache size 0 max 16384 2024-09-21T07:25:24.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.805+0000 7f89079d9000 1 Processor -- start 2024-09-21T07:25:24.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.805+0000 7f89079d9000 1 -- start start 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760666ab0 0x55c76077a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 0x55c76077a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c760780610 con 0x55c760653170 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8201710 con 0x55c760675630 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f88f80b1220 con 0x55c760666ab0 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39756/0 (socket says 172.21.15.64:39756) 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 -- 172.21.15.64:0/191746811 learned_addr learned my addr 172.21.15.64:0/191746811 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fd000640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760666ab0 0x55c76077a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fe400640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 0x55c76077a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 -- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760666ab0 msgr2=0x55c76077a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760666ab0 0x55c76077a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 -- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 msgr2=0x55c76077a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 0x55c76077a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 -- 172.21.15.64:0/191746811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c760623b00 con 0x55c760653170 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fe400640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 0x55c76077a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88fda00640 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f88ec05f190 tx=0x7f88ec063040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1293dcbf0943be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88e9600640 1 -- 172.21.15.64:0/191746811 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec05f490 con 0x55c760653170 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88e9600640 1 -- 172.21.15.64:0/191746811 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec063f70 con 0x55c760653170 2024-09-21T07:25:24.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f88e9600640 1 -- 172.21.15.64:0/191746811 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec05b700 con 0x55c760653170 2024-09-21T07:25:24.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- 172.21.15.64:0/191746811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 msgr2=0x55c76077e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f88ec05f190 tx=0x7f88ec063040 comp rx=0 tx=0).stop 2024-09-21T07:25:24.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- 172.21.15.64:0/191746811 shutdown_connections 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760675630 0x55c76077a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760666ab0 0x55c76077a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 --2- 172.21.15.64:0/191746811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760653170 0x55c76077e410 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- 172.21.15.64:0/191746811 >> 172.21.15.64:0/191746811 conn(0x55c760284d20 msgr2=0x55c7607b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- 172.21.15.64:0/191746811 shutdown_connections 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.809+0000 7f89079d9000 1 -- 172.21.15.64:0/191746811 wait complete. 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- start start 2024-09-21T07:25:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 Processor -- start 2024-09-21T07:25:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760653170 0x55c76077dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c76077e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c7605cadf0 con 0x55c760675630 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c760572040 con 0x55c760666ab0 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c760592c70 con 0x55c760653170 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 10 client.0 _ll_register_callbacks cb 0x7f88e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39762/0 (socket says 172.21.15.64:39762) 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 -- 172.21.15.64:0/85378325 learned_addr learned my addr 172.21.15.64:0/85378325 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fd000640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c76077e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fda00640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760653170 0x55c76077dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 -- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760653170 msgr2=0x55c76077dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760653170 0x55c76077dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 -- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 msgr2=0x55c76077e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c76077e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 -- 172.21.15.64:0/85378325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c760591060 con 0x55c760675630 2024-09-21T07:25:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fd000640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c76077e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88fe400640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009b70 tx=0x7f88f0018610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c7f7e6ebabf570 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0020070 con 0x55c760675630 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f88f0003980 con 0x55c760675630 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88ec063f70 con 0x55c760675630 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f88f002a050 con 0x55c760675630 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 10 client.5226 fetch_fsmap learned FSMap version 19 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c76055d640 con 0x55c760675630 2024-09-21T07:25:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec063f70 con 0x55c760675630 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7f88f002d020 con 0x55c760675630 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 10 client.5226 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 10 client.5226 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 20 client.5226 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c760257930 0x55c76083b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 4 client.5226 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.813+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 --> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55c7605d55b0 con 0x55c760257930 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88fda00640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c760257930 0x55c76083b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88dea00640 10 client.5226 ms_handle_connect on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88fda00640 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c760257930 0x55c76083b2d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4590923b198f22 server_cookie=48d426e59d3c0024 in_seq=0 out_seq=0 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88dea00640 1 -- 172.21.15.64:0/85378325 <== mds.0 v2:172.21.15.64:6833/4120447613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18096 (crc 0 0 0) 0x55c7605d55b0 con 0x55c760257930 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88dea00640 10 client.5226 handle_command_reply: tid=0 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 client.5226 shutdown 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 msgr2=0x55c7607f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009b70 tx=0x7f88f0018610 comp rx=0 tx=0).stop 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 shutdown_connections 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c760675630 0x55c7607f7240 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c760666ab0 0x55c76077e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.64:6833/4120447613,v1:172.21.15.64:6835/4120447613] conn(0x55c760257930 0x55c76083b2d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 --2- 172.21.15.64:0/85378325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c760653170 0x55c76077dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f88dea00640 0 client.5226 ms_handle_reset on v2:172.21.15.64:6833/4120447613 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 >> 172.21.15.64:0/85378325 conn(0x55c760284d20 msgr2=0x55c7607b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 shutdown_connections 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 1 -- 172.21.15.64:0/85378325 wait complete. 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f89079d9000 20 client.5226 trim_cache size 0 max 16384 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 3744, 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 3745, 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 943860, 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 36722761, 2024-09-21T07:25:24.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 17, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 6, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.516540698, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.269446223, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.092503300, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.121636428, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 3744, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.724248854, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000193442 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 10, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000001429, 2024-09-21T07:25:24.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000142 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 2653, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 2675, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 672438, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 17352544, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 6, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.371367365, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.185617506, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.066211703, 2024-09-21T07:25:24.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.094432587, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2674, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.885194222, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000331037 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 2032, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 93584 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.828 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 29371, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 51630, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 11051830, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 52972196, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 7, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 6.499840620, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 3.608479038, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 2.731926100, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.885478804, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 51629, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.732834722, 2024-09-21T07:25:24.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000033563 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 72482, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.018498000, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000255 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 131248, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 28016 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-21T07:25:24.830 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2051, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 20.223118259, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.009860125 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 3682, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.133127548, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000307747 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.831 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 25576, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 25576, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 25576, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 450.766711737, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.017624597 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 12, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-21T07:25:24.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 17924, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 17924, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 17923, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 2, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 2, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-09-21T07:25:24.833 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 48519, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 47961, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 103, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-21T07:25:24.834 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 2013, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 2013, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 13, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 2, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 11, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 2000, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 1158, 2024-09-21T07:25:24.835 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 4036, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 3420, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 2660, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 84, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 14088 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-21T07:25:24.836 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 4189, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 3803, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 2241, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:25:24.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 1, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-21T07:25:24.838 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 26986, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 26986, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 38, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 38, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 4, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 91556242, 2024-09-21T07:25:24.839 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2639, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 130.926255799, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.049612071 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 14, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 2016, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 2002, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 13, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 13, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 0, 2024-09-21T07:25:24.840 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 17924, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 19925, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 2001, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 2, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 7416, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 7414, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 167608, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 408842240 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 28536, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 25576, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 6, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-21T07:25:24.841 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2000, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.715969319, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000857984 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 24, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003904063, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000162669 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-21T07:25:24.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6000, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 7.793513827, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001298918 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7297, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 5.375319983, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000736647 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000080957, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000080957 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.845 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003448636, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.003448636 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.273233005, 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.273233005 2024-09-21T07:25:24.846 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000107603, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000107603 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.775353569, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.096919196 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2241, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 411.915046883, 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.183808588 2024-09-21T07:25:24.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.029665813, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.029665813 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:25:24.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000306263, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000306263 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-21T07:25:24.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-21T07:25:24.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8000, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 22.880761816, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002860095 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-21T07:25:24.852 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 1, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 1, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 17519, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 17519, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 86, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:25:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:25:24.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-21T07:25:24.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 250468, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 86, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-21T07:25:24.856 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 5624, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 80, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-21T07:25:24.857 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 13072412, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 661967, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 8727, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 88051231, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 37, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 8727, 2024-09-21T07:25:24.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8727, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 54.955038286, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.006297128 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8727, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 8836 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 8727, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 2074, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 6653, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-21T07:25:24.859 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 11, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 59, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 2696, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 38, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 1803, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 2032, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 2015, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 22, 2024-09-21T07:25:24.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-21T07:25:24.861 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 44, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-21T07:25:24.862 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 5, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 8, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 8, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 124, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 36 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.863 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 32, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 32, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 3803, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 3803, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 35764, 2024-09-21T07:25:24.864 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 9443264, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 35764, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 35764, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 9443264, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:25:24.865 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 8727, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 88449758, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 8727, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 88449758, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.866 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 8727, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 8727, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 8727, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 8727, 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:25:24.867 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 3803, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 398527, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 3803, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:25:24.868 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 57, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 398527, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x555caf9e35f0": { 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 26986, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 87361938, 2024-09-21T07:25:24.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 26986, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2639, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 87361938, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:24.870 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 msgr2=0x7f88d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 0x7f88d8075710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af000 tx=0x7f88e40a7040 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 msgr2=0x7f88f81f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e7a0 tx=0x7f88ec00ec60 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 shutdown_connections 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f88d8073200 0x7f88d8075710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f815ec20 0x7f88f815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88f80ca990 0x7f88f809b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 --2- 172.21.15.64:0/225771060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f80704f0 0x7f88f81f9a20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 >> 172.21.15.64:0/225771060 conn(0x7f88f80ccbe0 msgr2=0x7f88f80cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:24.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 shutdown_connections 2024-09-21T07:25:24.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:24.817+0000 7f8900400640 1 -- 172.21.15.64:0/225771060 wait complete. 2024-09-21T07:25:24.873 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:25:24.873 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:25:24.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:25:25.059 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:25:25.059 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:25:25.059 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:25.059 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:25.069 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:25.069 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:25.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- 172.21.15.64:0/974874393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f9009df30 msgr2=0x7f3f900b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 --2- 172.21.15.64:0/974874393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f9009df30 0x7f3f900b33d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005fd0 tx=0x7f3f8001c740 comp rx=0 tx=0).stop 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- 172.21.15.64:0/974874393 shutdown_connections 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 --2- 172.21.15.64:0/974874393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f9006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 --2- 172.21.15.64:0/974874393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f9009df30 0x7f3f900b33d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- 172.21.15.64:0/974874393 >> 172.21.15.64:0/974874393 conn(0x7f3f9006d450 msgr2=0x7f3f900d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:25.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- 172.21.15.64:0/974874393 shutdown_connections 2024-09-21T07:25:25.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- 172.21.15.64:0/974874393 wait complete. 2024-09-21T07:25:25.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 Processor -- start 2024-09-21T07:25:25.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.321+0000 7f3f95e00640 1 -- start start 2024-09-21T07:25:25.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f900b3910 0x7f3f901534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f900b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90169000 con 0x7f3f9009df30 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90168e80 con 0x7f3f900b3910 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f90169180 con 0x7f3f900ce900 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45284/0 (socket says 172.21.15.64:45284) 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 -- 172.21.15.64:0/620237336 learned_addr learned my addr 172.21.15.64:0/620237336 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8f400640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f900b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f87e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f900b3910 0x7f3f901534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 -- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 msgr2=0x7f3f900b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f900b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 -- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f900b3910 msgr2=0x7f3f901534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f900b3910 0x7f3f901534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 -- 172.21.15.64:0/620237336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90072c70 con 0x7f3f9009df30 2024-09-21T07:25:25.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8f400640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f900b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:25.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f8ea00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3f8001c570 tx=0x7f3f80003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:25.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80003c00 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f80003da0 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80005290 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f90072f50 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f90073510 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.325+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f900b33d0 con 0x7f3f9009df30 2024-09-21T07:25:25.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.329+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f80005430 con 0x7f3f9009df30 2024-09-21T07:25:25.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.329+0000 7f3f87400640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 0x7f3f6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.329+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f3f8012ea30 con 0x7f3f9009df30 2024-09-21T07:25:25.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.329+0000 7f3f87e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 0x7f3f6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.329+0000 7f3f87e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 0x7f3f6c075740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f9015bd40 tx=0x7f3f78009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:25.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.333+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f800ad020 con 0x7f3f9009df30 2024-09-21T07:25:25.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f9015c050 con 0x7f3f9009df30 2024-09-21T07:25:25.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f87400640 1 -- 172.21.15.64:0/620237336 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) ==== 80+0+0 (secure 0 0 0) 0x7f3f80016330 con 0x7f3f9009df30 2024-09-21T07:25:25.529 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:25:25.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 msgr2=0x7f3f6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 0x7f3f6c075740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f9015bd40 tx=0x7f3f78009040 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 msgr2=0x7f3f900c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3f8001c570 tx=0x7f3f80003740 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 shutdown_connections 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f6c073230 0x7f3f6c075740 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f900ce900 0x7f3f900b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f900b3910 0x7f3f901534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 --2- 172.21.15.64:0/620237336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9009df30 0x7f3f900c82e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 >> 172.21.15.64:0/620237336 conn(0x7f3f9006d450 msgr2=0x7f3f901565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 shutdown_connections 2024-09-21T07:25:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.525+0000 7f3f95e00640 1 -- 172.21.15.64:0/620237336 wait complete. 2024-09-21T07:25:25.551 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:25:25.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:25.552 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:25.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:25:25.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:25.602 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:25:25.619 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:25:25.619 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:25:25.619 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:25.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:25:25.635 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:25:25.635 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:25.635 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:25.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:25:25.668 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:25:25.668 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:25:25.668 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:25.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:25:25.685 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:25.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 -- 172.21.15.64:0/1295274202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 msgr2=0x7efea806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 --2- 172.21.15.64:0/1295274202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea806d430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe94009870 tx=0x7efe9401c830 comp rx=0 tx=0).stop 2024-09-21T07:25:25.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 -- 172.21.15.64:0/1295274202 shutdown_connections 2024-09-21T07:25:25.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 --2- 172.21.15.64:0/1295274202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea806d430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 -- 172.21.15.64:0/1295274202 >> 172.21.15.64:0/1295274202 conn(0x7efea80d0de0 msgr2=0x7efea80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:25.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 -- 172.21.15.64:0/1295274202 shutdown_connections 2024-09-21T07:25:25.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.865+0000 7efeb0000640 1 -- 172.21.15.64:0/1295274202 wait complete. 2024-09-21T07:25:25.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 Processor -- start 2024-09-21T07:25:25.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- start start 2024-09-21T07:25:25.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea80ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 0x7efea8158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efea8169cd0 con 0x7efea806f620 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efea8169b50 con 0x7efea815b810 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efea8169e50 con 0x7efea806d020 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45298/0 (socket says 172.21.15.64:45298) 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 -- 172.21.15.64:0/2527741447 learned_addr learned my addr 172.21.15.64:0/2527741447 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efead600640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea80ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeae000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 0x7efea8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 -- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 msgr2=0x7efea80ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea80ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 -- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 msgr2=0x7efea8158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 0x7efea8158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:25.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 -- 172.21.15.64:0/2527741447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea80aeb00 con 0x7efea806f620 2024-09-21T07:25:25.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeae000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 0x7efea8158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:25:25.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeacc00640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c10 tx=0x7efe940a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:25.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe940bb070 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe94004470 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe940b2040 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea81f8d00 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.869+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea81f8fa0 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea806d430 con 0x7efea806f620 2024-09-21T07:25:25.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe94005290 con 0x7efea806f620 2024-09-21T07:25:25.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efea5600640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 0x7efe88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:25.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7efe9412de70 con 0x7efea806f620 2024-09-21T07:25:25.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efead600640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 0x7efe88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:25.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.873+0000 7efead600640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 0x7efe88075740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001660 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:25.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:25.877+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efea81f8d00 con 0x7efea806f620 2024-09-21T07:25:26.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efea80b5c10 con 0x7efea806f620 2024-09-21T07:25:26.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efea5600640 1 -- 172.21.15.64:0/2527741447 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5223 (secure 0 0 0) 0x7efe940ff030 con 0x7efea806f620 2024-09-21T07:25:26.097 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:26.097 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":19,"btime":"2024-09-21T07:23:55:496708+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:54.682623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:25:26.097 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 19 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 msgr2=0x7efe88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 0x7efe88075740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001660 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 msgr2=0x7efea815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c10 tx=0x7efe940a5770 comp rx=0 tx=0).stop 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 shutdown_connections 2024-09-21T07:25:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe88073230 0x7efe88075740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815b810 0x7efea8158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea806f620 0x7efea815e460 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 --2- 172.21.15.64:0/2527741447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efea806d020 0x7efea80ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 >> 172.21.15.64:0/2527741447 conn(0x7efea80d0de0 msgr2=0x7efea806fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 shutdown_connections 2024-09-21T07:25:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.093+0000 7efeb0000640 1 -- 172.21.15.64:0/2527741447 wait complete. 2024-09-21T07:25:26.119 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:26.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 -- 172.21.15.64:0/965375477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 msgr2=0x7f636c0b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 --2- 172.21.15.64:0/965375477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c0b2790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f636c08c750 tx=0x7f636401cc60 comp rx=0 tx=0).stop 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 -- 172.21.15.64:0/965375477 shutdown_connections 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 --2- 172.21.15.64:0/965375477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c0b2790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 --2- 172.21.15.64:0/965375477 >> v2:172.21.15.90:3300/0 conn(0x7f636c0b1a30 0x7f636c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 --2- 172.21.15.64:0/965375477 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0ceaa0 0x7f636c0ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 -- 172.21.15.64:0/965375477 >> 172.21.15.64:0/965375477 conn(0x7f636c09b340 msgr2=0x7f636c0d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 -- 172.21.15.64:0/965375477 shutdown_connections 2024-09-21T07:25:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.273+0000 7f636be00640 1 -- 172.21.15.64:0/965375477 wait complete. 2024-09-21T07:25:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 Processor -- start 2024-09-21T07:25:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 -- start start 2024-09-21T07:25:26.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0b1a30 0x7f636c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f636c0ceaa0 0x7f636c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0d0c50 con 0x7f636c0b2380 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0d0ad0 con 0x7f636c0ceaa0 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0d0dd0 con 0x7f636c0b1a30 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45324/0 (socket says 172.21.15.64:45324) 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636a000640 1 -- 172.21.15.64:0/1726870972 learned_addr learned my addr 172.21.15.64:0/1726870972 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636aa00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0b1a30 0x7f636c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.277+0000 7f636b400640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f636c0ceaa0 0x7f636c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 -- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0b1a30 msgr2=0x7f636c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0b1a30 0x7f636c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 -- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f636c0ceaa0 msgr2=0x7f636c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f636c0ceaa0 0x7f636c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 -- 172.21.15.64:0/1726870972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c15d860 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636a000640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f635800e7c0 tx=0x7f635800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635800cc60 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f635800ce00 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358005280 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c15db40 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c15e100 con 0x7f636c0b2380 2024-09-21T07:25:26.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c0b2790 con 0x7f636c0b2380 2024-09-21T07:25:26.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6358005420 con 0x7f636c0b2380 2024-09-21T07:25:26.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.281+0000 7f6362a00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 0x7f634c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.285+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f6358094b60 con 0x7f636c0b2380 2024-09-21T07:25:26.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.285+0000 7f636aa00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 0x7f634c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.285+0000 7f636aa00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 0x7f634c075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f635c009b40 tx=0x7f635c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:26.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.289+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f635805f2d0 con 0x7f636c0b2380 2024-09-21T07:25:26.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.497+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f636c076e60 con 0x7f636c0b2380 2024-09-21T07:25:26.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.497+0000 7f6362a00640 1 -- 172.21.15.64:0/1726870972 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5223 (secure 0 0 0) 0x7f6358063d00 con 0x7f636c0b2380 2024-09-21T07:25:26.503 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":19,"btime":"2024-09-21T07:23:55:496708+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:54.682623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:25:26.504 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 19 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 msgr2=0x7f634c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 0x7f634c075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f635c009b40 tx=0x7f635c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 msgr2=0x7f636c159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f635800e7c0 tx=0x7f635800ec80 comp rx=0 tx=0).stop 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 shutdown_connections 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f634c073230 0x7f634c075740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f636c0ceaa0 0x7f636c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f636c0b2380 0x7f636c159770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 --2- 172.21.15.64:0/1726870972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f636c0b1a30 0x7f636c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 >> 172.21.15.64:0/1726870972 conn(0x7f636c09b340 msgr2=0x7f636c15ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:26.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 shutdown_connections 2024-09-21T07:25:26.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.501+0000 7f636be00640 1 -- 172.21.15.64:0/1726870972 wait complete. 2024-09-21T07:25:26.525 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:26.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- 172.21.15.64:0/2529270397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 msgr2=0x7fa29c004ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 --2- 172.21.15.64:0/2529270397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa29c004ca0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0001860 tx=0x7fa2a001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- 172.21.15.64:0/2529270397 shutdown_connections 2024-09-21T07:25:26.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 --2- 172.21.15.64:0/2529270397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa29c004ca0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- 172.21.15.64:0/2529270397 >> 172.21.15.64:0/2529270397 conn(0x7fa2b806d480 msgr2=0x7fa2b80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:26.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- 172.21.15.64:0/2529270397 shutdown_connections 2024-09-21T07:25:26.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- 172.21.15.64:0/2529270397 wait complete. 2024-09-21T07:25:26.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 Processor -- start 2024-09-21T07:25:26.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.681+0000 7fa2be200640 1 -- start start 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 0x7fa2b806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2b81f8e90 0x7fa2b81f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80d0f60 con 0x7fa29c004810 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80710f0 con 0x7fa2b81f8e90 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b81fbe60 con 0x7fa2b806e910 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45346/0 (socket says 172.21.15.64:45346) 2024-09-21T07:25:26.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 -- 172.21.15.64:0/1611467709 learned_addr learned my addr 172.21.15.64:0/1611467709 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7e00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2b81f8e90 0x7fa2b81f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2aea00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 0x7fa2b806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 -- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 msgr2=0x7fa2b806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 0x7fa2b806ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 -- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2b81f8e90 msgr2=0x7fa2b81f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2b81f8e90 0x7fa2b81f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 -- 172.21.15.64:0/1611467709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b806f820 con 0x7fa29c004810 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2aea00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 0x7fa2b806ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:26.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2b7400640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8011a10 tx=0x7fa2a8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a801e070 con 0x7fa29c004810 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2a8004460 con 0x7fa29c004810 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800fb80 con 0x7fa29c004810 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b806f540 con 0x7fa29c004810 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b81fa320 con 0x7fa29c004810 2024-09-21T07:25:26.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.685+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b8071650 con 0x7fa29c004810 2024-09-21T07:25:26.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.689+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa2a8021070 con 0x7fa29c004810 2024-09-21T07:25:26.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.689+0000 7fa2afe00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 0x7fa294075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:26.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.689+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7fa2a8094c00 con 0x7fa29c004810 2024-09-21T07:25:26.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.689+0000 7fa2aea00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 0x7fa294075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:26.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.689+0000 7fa2aea00640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 0x7fa294075710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0001830 tx=0x7fa2a0019700 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:26.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.693+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa2a809b080 con 0x7fa29c004810 2024-09-21T07:25:26.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.869+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2b80d13f0 con 0x7fa29c004810 2024-09-21T07:25:26.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2afe00640 1 -- 172.21.15.64:0/1611467709 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17011 (secure 0 0 0) 0x7fa2a805f4a0 con 0x7fa29c004810 2024-09-21T07:25:26.876 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:26.877 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:01.937965+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:23:39.958485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T07:23:40.606295+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 msgr2=0x7fa294075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 0x7fa294075710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0001830 tx=0x7fa2a0019700 comp rx=0 tx=0).stop 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 msgr2=0x7fa2b80b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8011a10 tx=0x7fa2a8011ed0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 shutdown_connections 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa294073200 0x7fa294075710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2b81f8e90 0x7fa2b81f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2b806e910 0x7fa2b806ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 --2- 172.21.15.64:0/1611467709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa29c004810 0x7fa2b80b3140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:26.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 >> 172.21.15.64:0/1611467709 conn(0x7fa2b806d480 msgr2=0x7fa2b815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:26.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 shutdown_connections 2024-09-21T07:25:26.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:26.873+0000 7fa2be200640 1 -- 172.21.15.64:0/1611467709 wait complete. 2024-09-21T07:25:26.899 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:25:26.899 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 -- 172.21.15.64:0/460008491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52e0004810 msgr2=0x7f52e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 --2- 172.21.15.64:0/460008491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52e0004810 0x7f52e0004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b50c0 tx=0x7f52e401ce60 comp rx=0 tx=0).stop 2024-09-21T07:25:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f52fa800640 1 -- 172.21.15.64:0/460008491 reap_dead start 2024-09-21T07:25:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 -- 172.21.15.64:0/460008491 shutdown_connections 2024-09-21T07:25:27.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 -- 172.21.15.64:0/460008491 >> 172.21.15.64:0/460008491 conn(0x7f52fc0ccbe0 msgr2=0x7f52fc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:27.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 -- 172.21.15.64:0/460008491 shutdown_connections 2024-09-21T07:25:27.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.053+0000 7f5301200640 1 -- 172.21.15.64:0/460008491 wait complete. 2024-09-21T07:25:27.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 Processor -- start 2024-09-21T07:25:27.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 -- start start 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52e0004810 0x7f52fc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52fc153350 0x7f52fc0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc0cc560 con 0x7f52fc0b03c0 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc0cc3e0 con 0x7f52fc153350 2024-09-21T07:25:27.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f5301200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f52fc0cc6e0 con 0x7f52e0004810 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45364/0 (socket says 172.21.15.64:45364) 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 -- 172.21.15.64:0/21982979 learned_addr learned my addr 172.21.15.64:0/21982979 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52f9e00640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52e0004810 0x7f52fc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52f3e00640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52fc153350 0x7f52fc0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 -- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52e0004810 msgr2=0x7f52fc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52e0004810 0x7f52fc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 -- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52fc153350 msgr2=0x7f52fc0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52fc153350 0x7f52fc0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 -- 172.21.15.64:0/21982979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52fc0b0d10 con 0x7f52fc0b03c0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.057+0000 7f52fa800640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f52fc072dd0 tx=0x7f52f400e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4003b80 con 0x7f52fc0b03c0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f4003e30 con 0x7f52fc0b03c0 2024-09-21T07:25:27.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40062b0 con 0x7f52fc0b03c0 2024-09-21T07:25:27.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52fc0c9d20 con 0x7f52fc0b03c0 2024-09-21T07:25:27.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52fc0c8320 con 0x7f52fc0b03c0 2024-09-21T07:25:27.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52fc0c9a90 con 0x7f52fc0b03c0 2024-09-21T07:25:27.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f52f400d070 con 0x7f52fc0b03c0 2024-09-21T07:25:27.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 0x7f52d8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.061+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f52f4098430 con 0x7f52fc0b03c0 2024-09-21T07:25:27.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.065+0000 7f52f9e00640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 0x7f52d8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.065+0000 7f52f9e00640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 0x7f52d8075740 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009bc0 tx=0x7f52ec0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.065+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f52fc0b0d10 con 0x7f52fc0b03c0 2024-09-21T07:25:27.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.281+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52fc0cbcd0 con 0x7f52fc0b03c0 2024-09-21T07:25:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f52f2000640 1 -- 172.21.15.64:0/21982979 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5223 (secure 0 0 0) 0x7f52f4063300 con 0x7f52fc0b03c0 2024-09-21T07:25:27.288 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:27.288 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":19,"btime":"2024-09-21T07:23:55:496708+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:54.682623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:25:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 19 2024-09-21T07:25:27.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 msgr2=0x7f52d8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 0x7f52d8075740 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009bc0 tx=0x7f52ec0091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 msgr2=0x7f52fc0b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f52fc072dd0 tx=0x7f52f400e6b0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 shutdown_connections 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52d8073230 0x7f52d8075740 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0b03c0 0x7f52fc0b07d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52fc153350 0x7f52fc0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 --2- 172.21.15.64:0/21982979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52e0004810 0x7f52fc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 >> 172.21.15.64:0/21982979 conn(0x7f52fc0ccbe0 msgr2=0x7f52fc074470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 shutdown_connections 2024-09-21T07:25:27.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.285+0000 7f5301200640 1 -- 172.21.15.64:0/21982979 wait complete. 2024-09-21T07:25:27.311 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- 172.21.15.64:0/3523910582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40702b0 msgr2=0x7f67b415f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 --2- 172.21.15.64:0/3523910582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40702b0 0x7f67b415f510 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67b4070d40 tx=0x7f67ac01ca50 comp rx=0 tx=0).stop 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- 172.21.15.64:0/3523910582 shutdown_connections 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 --2- 172.21.15.64:0/3523910582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40702b0 0x7f67b415f510 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- 172.21.15.64:0/3523910582 >> 172.21.15.64:0/3523910582 conn(0x7f67b40b2ca0 msgr2=0x7f67b40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- 172.21.15.64:0/3523910582 shutdown_connections 2024-09-21T07:25:27.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- 172.21.15.64:0/3523910582 wait complete. 2024-09-21T07:25:27.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 Processor -- start 2024-09-21T07:25:27.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.465+0000 7f67ba600640 1 -- start start 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67b415f100 0x7f67b414dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f67b41fd310 0x7f67b4151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b6b30 con 0x7f67b40cd790 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b69b0 con 0x7f67b415f100 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40b6cb0 con 0x7f67b41fd310 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45378/0 (socket says 172.21.15.64:45378) 2024-09-21T07:25:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 -- 172.21.15.64:0/879093483 learned_addr learned my addr 172.21.15.64:0/879093483 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67abe00640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67b415f100 0x7f67b414dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3e00640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f67b41fd310 0x7f67b4151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 -- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f67b41fd310 msgr2=0x7f67b4151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f67b41fd310 0x7f67b4151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 -- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67b415f100 msgr2=0x7f67b414dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67b415f100 0x7f67b414dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 -- 172.21.15.64:0/879093483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b4156eb0 con 0x7f67b40cd790 2024-09-21T07:25:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67b3400640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c420 tx=0x7f67a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4011790 con 0x7f67b40cd790 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67a4017070 con 0x7f67b40cd790 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b41fc830 con 0x7f67b40cd790 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4011ce0 con 0x7f67b40cd790 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b41fcdf0 con 0x7f67b40cd790 2024-09-21T07:25:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.469+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b415f510 con 0x7f67b40cd790 2024-09-21T07:25:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.473+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f67a401c460 con 0x7f67b40cd790 2024-09-21T07:25:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.473+0000 7f67ab400640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 0x7f6790075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.473+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f67a40941b0 con 0x7f67b40cd790 2024-09-21T07:25:27.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.473+0000 7f67abe00640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 0x7f6790075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.473+0000 7f67abe00640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 0x7f6790075710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67b4156290 tx=0x7f679c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.477+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f67a405e920 con 0x7f67b40cd790 2024-09-21T07:25:27.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.689+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67b40b3bb0 con 0x7f67b40cd790 2024-09-21T07:25:27.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.689+0000 7f67ab400640 1 -- 172.21.15.64:0/879093483 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5223 (secure 0 0 0) 0x7f67a4063350 con 0x7f67b40cd790 2024-09-21T07:25:27.695 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:27.695 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":19,"btime":"2024-09-21T07:23:55:496708+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:23:41.654216+0000","modified":"2024-09-21T07:23:54.682623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/4120447613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":4120447613},{"type":"v1","addr":"172.21.15.64:6835","nonce":4120447613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-09-21T07:25:27.695 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 19 2024-09-21T07:25:27.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 msgr2=0x7f6790075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 0x7f6790075710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67b4156290 tx=0x7f679c009040 comp rx=0 tx=0).stop 2024-09-21T07:25:27.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 msgr2=0x7f67b41564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c420 tx=0x7f67a400c8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 shutdown_connections 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6790073200 0x7f6790075710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f67b41fd310 0x7f67b4151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67b415f100 0x7f67b414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 --2- 172.21.15.64:0/879093483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67b40cd790 0x7f67b41564d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 >> 172.21.15.64:0/879093483 conn(0x7f67b40b2ca0 msgr2=0x7f67b415b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 shutdown_connections 2024-09-21T07:25:27.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.693+0000 7f67ba600640 1 -- 172.21.15.64:0/879093483 wait complete. 2024-09-21T07:25:27.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:27.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 -- 172.21.15.64:0/2414737611 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900d1d00 msgr2=0x7f2c900d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 --2- 172.21.15.64:0/2414737611 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900d1d00 0x7f2c900d03f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009840 tx=0x7f2c8001c760 comp rx=0 tx=0).stop 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 -- 172.21.15.64:0/2414737611 shutdown_connections 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 --2- 172.21.15.64:0/2414737611 >> v2:172.21.15.90:3300/0 conn(0x7f2c900b3d60 0x7f2c900b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 --2- 172.21.15.64:0/2414737611 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900d1d00 0x7f2c900d03f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 -- 172.21.15.64:0/2414737611 >> 172.21.15.64:0/2414737611 conn(0x7f2c9006d1c0 msgr2=0x7f2c9006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 -- 172.21.15.64:0/2414737611 shutdown_connections 2024-09-21T07:25:27.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.869+0000 7f2c96600640 1 -- 172.21.15.64:0/2414737611 wait complete. 2024-09-21T07:25:27.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 Processor -- start 2024-09-21T07:25:27.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 -- start start 2024-09-21T07:25:27.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 0x7f2c901594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900b3d60 0x7f2c9014e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9016a460 con 0x7f2c900d1d00 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9016a2e0 con 0x7f2c90071190 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c96600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9016a5e0 con 0x7f2c900b3d60 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45392/0 (socket says 172.21.15.64:45392) 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 0x7f2c901594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8fe00640 1 -- 172.21.15.64:0/2667260553 learned_addr learned my addr 172.21.15.64:0/2667260553 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:27.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900b3d60 0x7f2c9014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8f400640 1 -- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900b3d60 msgr2=0x7f2c9014e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.873+0000 7f2c8f400640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900b3d60 0x7f2c9014e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c8f400640 1 -- 172.21.15.64:0/2667260553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 msgr2=0x7f2c9014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c8f400640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c8f400640 1 -- 172.21.15.64:0/2667260553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c90166df0 con 0x7f2c90071190 2024-09-21T07:25:27.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c8fe00640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c8f400640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 0x7f2c901594d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2c900d10f0 tx=0x7f2c800a56a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800bb070 con 0x7f2c90071190 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c80004470 con 0x7f2c90071190 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800b2040 con 0x7f2c90071190 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c901670d0 con 0x7f2c90071190 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901f9bc0 con 0x7f2c90071190 2024-09-21T07:25:27.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c900b4170 con 0x7f2c90071190 2024-09-21T07:25:27.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.877+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2c80005290 con 0x7f2c90071190 2024-09-21T07:25:27.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.881+0000 7f2c87400640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:27.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.881+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f2c8012e0f0 con 0x7f2c90071190 2024-09-21T07:25:27.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.881+0000 7f2c87e00640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:27.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.881+0000 7f2c87e00640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 0x7f2c6c075710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c90154e00 tx=0x7f2c780091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:27.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:27.885+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2c800c4020 con 0x7f2c90071190 2024-09-21T07:25:28.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.061+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c900719b0 con 0x7f2c90071190 2024-09-21T07:25:28.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.061+0000 7f2c87400640 1 -- 172.21.15.64:0/2667260553 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17011 (secure 0 0 0) 0x7f2c80016410 con 0x7f2c90071190 2024-09-21T07:25:28.066 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:28.067 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:01.937965+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:23:39.958485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T07:23:40.606295+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 msgr2=0x7f2c6c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 0x7f2c6c075710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c90154e00 tx=0x7f2c780091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 msgr2=0x7f2c901594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 0x7f2c901594d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2c900d10f0 tx=0x7f2c800a56a0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 shutdown_connections 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c900d1d00 0x7f2c9014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c900b3d60 0x7f2c9014e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 --2- 172.21.15.64:0/2667260553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c90071190 0x7f2c901594d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 >> 172.21.15.64:0/2667260553 conn(0x7f2c9006d1c0 msgr2=0x7f2c901503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 shutdown_connections 2024-09-21T07:25:28.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.065+0000 7f2c96600640 1 -- 172.21.15.64:0/2667260553 wait complete. 2024-09-21T07:25:28.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- 172.21.15.64:0/4186502332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53940b3140 msgr2=0x7f53940b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 --2- 172.21.15.64:0/4186502332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53940b3140 0x7f53940b3550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5394070f10 tx=0x7f537c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- 172.21.15.64:0/4186502332 shutdown_connections 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 --2- 172.21.15.64:0/4186502332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53940b3140 0x7f53940b3550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 --2- 172.21.15.64:0/4186502332 >> v2:172.21.15.90:3300/0 conn(0x7f53940cc960 0x7f539415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- 172.21.15.64:0/4186502332 >> 172.21.15.64:0/4186502332 conn(0x7f539406d450 msgr2=0x7f53940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- 172.21.15.64:0/4186502332 shutdown_connections 2024-09-21T07:25:28.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- 172.21.15.64:0/4186502332 wait complete. 2024-09-21T07:25:28.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 Processor -- start 2024-09-21T07:25:28.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.245+0000 7f5399600640 1 -- start start 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940b3140 0x7f5394164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53940cc960 0x7f539415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5394169150 con 0x7f539406f890 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5394168fd0 con 0x7f53940b3140 2024-09-21T07:25:28.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f53941692d0 con 0x7f53940cc960 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45406/0 (socket says 172.21.15.64:45406) 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 -- 172.21.15.64:0/899144279 learned_addr learned my addr 172.21.15.64:0/899144279 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f538a000640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940b3140 0x7f5394164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5393400640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53940cc960 0x7f539415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 -- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53940cc960 msgr2=0x7f539415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53940cc960 0x7f539415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 -- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940b3140 msgr2=0x7f5394164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940b3140 0x7f5394164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 -- 172.21.15.64:0/899144279 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53941fd5d0 con 0x7f539406f890 2024-09-21T07:25:28.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5392a00640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f538400e9c0 tx=0x7f538400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538400cc60 con 0x7f539406f890 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5384010430 con 0x7f539406f890 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384010880 con 0x7f539406f890 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539409d6d0 con 0x7f539406f890 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53940aff20 con 0x7f539406f890 2024-09-21T07:25:28.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.249+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53940b3550 con 0x7f539406f890 2024-09-21T07:25:28.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.253+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5384010a20 con 0x7f539406f890 2024-09-21T07:25:28.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.253+0000 7f538b400640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.253+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6158+0+0 (secure 0 0 0) 0x7f5384094e50 con 0x7f539406f890 2024-09-21T07:25:28.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.253+0000 7f538a000640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.253+0000 7f538a000640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 0x7f5370075710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f537c0af000 tx=0x7f537c0a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:28.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.257+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f53941fd5d0 con 0x7f539406f890 2024-09-21T07:25:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.469+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f53940b2bb0 con 0x7f539406f890 2024-09-21T07:25:28.474 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:25:28.469+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:25:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.469+0000 7f538b400640 1 -- 172.21.15.64:0/899144279 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f538405f650 con 0x7f539406f890 2024-09-21T07:25:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:25:28.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 msgr2=0x7f5370075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 0x7f5370075710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f537c0af000 tx=0x7f537c0a7040 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 msgr2=0x7f53941fd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f538400e9c0 tx=0x7f538400ee80 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 shutdown_connections 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53940cc960 0x7f539415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940b3140 0x7f5394164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 --2- 172.21.15.64:0/899144279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f539406f890 0x7f53941fd090 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f538400e9c0 tx=0x7f538400ee80 comp rx=0 tx=0).stop 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 >> 172.21.15.64:0/899144279 conn(0x7f539406d450 msgr2=0x7f539415b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 shutdown_connections 2024-09-21T07:25:28.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.477+0000 7f5399600640 1 -- 172.21.15.64:0/899144279 wait complete. 2024-09-21T07:25:28.503 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:25:28.624 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:25:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.661+0000 7f2e3ac00640 1 -- 172.21.15.64:0/410641012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 msgr2=0x7f2e340b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.661+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/410641012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e340b33c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2e340c3c60 tx=0x7f2e2c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:25:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 -- 172.21.15.64:0/410641012 shutdown_connections 2024-09-21T07:25:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/410641012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e340b33c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/410641012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 0x7f2e340af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/410641012 >> v2:172.21.15.90:3300/0 conn(0x7f2e3406efa0 0x7f2e340aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 -- 172.21.15.64:0/410641012 >> 172.21.15.64:0/410641012 conn(0x7f2e340ccbe0 msgr2=0x7f2e340ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:28.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 -- 172.21.15.64:0/410641012 shutdown_connections 2024-09-21T07:25:28.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 -- 172.21.15.64:0/410641012 wait complete. 2024-09-21T07:25:28.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 Processor -- start 2024-09-21T07:25:28.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 -- start start 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.665+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 0x7f2e341f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e341f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3415b660 con 0x7f2e340b2fb0 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3415b4e0 con 0x7f2e3406efa0 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3415b7e0 con 0x7f2e3406f3b0 2024-09-21T07:25:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e341f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:46860/0 (socket says 172.21.15.64:46860) 2024-09-21T07:25:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 -- 172.21.15.64:0/1862074400 learned_addr learned my addr 172.21.15.64:0/1862074400 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e2be00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 0x7f2e341f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 -- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 msgr2=0x7f2e341f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 0x7f2e341f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 -- 172.21.15.64:0/1862074400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 msgr2=0x7f2e341f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e341f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 -- 172.21.15.64:0/1862074400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3414d030 con 0x7f2e3406efa0 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e38c00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e341f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e33e00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d780 tx=0x7f2e2400dc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24017070 con 0x7f2e3406efa0 2024-09-21T07:25:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e2400de90 con 0x7f2e3406efa0 2024-09-21T07:25:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3414d310 con 0x7f2e3406efa0 2024-09-21T07:25:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004020 con 0x7f2e3406efa0 2024-09-21T07:25:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3414d8d0 con 0x7f2e3406efa0 2024-09-21T07:25:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e340b33c0 con 0x7f2e3406efa0 2024-09-21T07:25:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.669+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e240041c0 con 0x7f2e3406efa0 2024-09-21T07:25:28.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.673+0000 7f2e30c00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 0x7f2e10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:28.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.673+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f2e24094a70 con 0x7f2e3406efa0 2024-09-21T07:25:28.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.673+0000 7f2e2be00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 0x7f2e10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:28.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.673+0000 7f2e2be00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 0x7f2e10075710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e340b0980 tx=0x7f2e1c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:28.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.677+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2e24020020 con 0x7f2e3406efa0 2024-09-21T07:25:28.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:28.885+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2e340b09b0 con 0x7f2e3406efa0 2024-09-21T07:25:29.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.477+0000 7f2e30c00640 1 -- 172.21.15.64:0/1862074400 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f2e2405f220 con 0x7f2e3406efa0 2024-09-21T07:25:29.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 msgr2=0x7f2e10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:29.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 0x7f2e10075710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e340b0980 tx=0x7f2e1c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 msgr2=0x7f2e3414acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d780 tx=0x7f2e2400dc40 comp rx=0 tx=0).stop 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 shutdown_connections 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e10073200 0x7f2e10075710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e340b2fb0 0x7f2e341f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e3406f3b0 0x7f2e341f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 --2- 172.21.15.64:0/1862074400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e3406efa0 0x7f2e3414acc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 >> 172.21.15.64:0/1862074400 conn(0x7f2e340ccbe0 msgr2=0x7f2e340b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 shutdown_connections 2024-09-21T07:25:29.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.481+0000 7f2e3ac00640 1 -- 172.21.15.64:0/1862074400 wait complete. 2024-09-21T07:25:29.513 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- 172.21.15.64:0/881187336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc00af360 msgr2=0x7fadc015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 --2- 172.21.15.64:0/881187336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc00af360 0x7fadc015f480 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fadc0072880 tx=0x7fadb801cd80 comp rx=0 tx=0).stop 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- 172.21.15.64:0/881187336 shutdown_connections 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 --2- 172.21.15.64:0/881187336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc00af360 0x7fadc015f480 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 --2- 172.21.15.64:0/881187336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc01592f0 0x7fadc00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 --2- 172.21.15.64:0/881187336 >> v2:172.21.15.90:3300/0 conn(0x7fadc006ec70 0x7fadc0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- 172.21.15.64:0/881187336 >> 172.21.15.64:0/881187336 conn(0x7fadc00d0170 msgr2=0x7fadc00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:29.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- 172.21.15.64:0/881187336 shutdown_connections 2024-09-21T07:25:29.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- 172.21.15.64:0/881187336 wait complete. 2024-09-21T07:25:29.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 Processor -- start 2024-09-21T07:25:29.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.677+0000 7fadc7e00640 1 -- start start 2024-09-21T07:25:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 0x7fadc014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 0x7fadc00c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00cae20 con 0x7fadc01592f0 2024-09-21T07:25:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00caca0 con 0x7fadc00af360 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fadc00cafa0 con 0x7fadc006ec70 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 0x7fadc014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 0x7fadc00c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 0x7fadc014c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:39468/0 (socket says 172.21.15.64:39468) 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 0x7fadc00c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:46882/0 (socket says 172.21.15.64:46882) 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5400640 1 -- 172.21.15.64:0/237386490 learned_addr learned my addr 172.21.15.64:0/237386490 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45446/0 (socket says 172.21.15.64:45446) 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 -- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 msgr2=0x7fadc014c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 0x7fadc014c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 -- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 msgr2=0x7fadc00c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:29.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 0x7fadc00c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:29.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 -- 172.21.15.64:0/237386490 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc009d820 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc5e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fadb80ac000 tx=0x7fadb8005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80b2040 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadb8004b40 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8004000 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc009db00 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc00c3cd0 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.681+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc01f9830 con 0x7fadc01592f0 2024-09-21T07:25:29.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.685+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fadb80be060 con 0x7fadc01592f0 2024-09-21T07:25:29.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.685+0000 7fadbd600640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 0x7fada0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:29.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.685+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7fadb812df80 con 0x7fadc01592f0 2024-09-21T07:25:29.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.685+0000 7fadc5400640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 0x7fada0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:29.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.685+0000 7fadc5400640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 0x7fada0075740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadb400bb80 tx=0x7fadb400b310 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:29.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.689+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fadb8016970 con 0x7fadc01592f0 2024-09-21T07:25:29.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:29.869+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fadc00cb4c0 con 0x7fadc01592f0 2024-09-21T07:25:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.477+0000 7fadbd600640 1 -- 172.21.15.64:0/237386490 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) ==== 181+0+0 (secure 0 0 0) 0x7fadb80f8e10 con 0x7fadc01592f0 2024-09-21T07:25:30.481 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:25:30.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.477+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 msgr2=0x7fada0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.477+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 0x7fada0075740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadb400bb80 tx=0x7fadb400b310 comp rx=0 tx=0).stop 2024-09-21T07:25:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.477+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 msgr2=0x7fadc00c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.477+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fadb80ac000 tx=0x7fadb8005b10 comp rx=0 tx=0).stop 2024-09-21T07:25:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 shutdown_connections 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada0073230 0x7fada0075740 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc01592f0 0x7fadc00c5e00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc00af360 0x7fadc00c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 --2- 172.21.15.64:0/237386490 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc006ec70 0x7fadc014c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 >> 172.21.15.64:0/237386490 conn(0x7fadc00d0170 msgr2=0x7fadc00cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 shutdown_connections 2024-09-21T07:25:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.481+0000 7fadc7e00640 1 -- 172.21.15.64:0/237386490 wait complete. 2024-09-21T07:25:30.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:25:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- 172.21.15.64:0/3770543410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 msgr2=0x7f19e415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 --2- 172.21.15.64:0/3770543410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e415f480 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f19e4073fa0 tx=0x7f19dc01cda0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- 172.21.15.64:0/3770543410 shutdown_connections 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 --2- 172.21.15.64:0/3770543410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e415f480 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- 172.21.15.64:0/3770543410 >> 172.21.15.64:0/3770543410 conn(0x7f19e40d0170 msgr2=0x7f19e40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- 172.21.15.64:0/3770543410 shutdown_connections 2024-09-21T07:25:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- 172.21.15.64:0/3770543410 wait complete. 2024-09-21T07:25:30.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 Processor -- start 2024-09-21T07:25:30.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.669+0000 7f19e9800640 1 -- start start 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 0x7f19e40b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19e4200b90 0x7f19e40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f19e416a140 con 0x7f19e40af530 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f19e4169fc0 con 0x7f19e406ec70 2024-09-21T07:25:30.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f19e416a2c0 con 0x7f19e4200b90 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45458/0 (socket says 172.21.15.64:45458) 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 -- 172.21.15.64:0/4072903110 learned_addr learned my addr 172.21.15.64:0/4072903110 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e3400640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19e4200b90 0x7f19e40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e2a00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 0x7f19e40b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 -- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19e4200b90 msgr2=0x7f19e40b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19e4200b90 0x7f19e40b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 -- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 msgr2=0x7f19e40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 0x7f19e40b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:30.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 -- 172.21.15.64:0/4072903110 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e40b1160 con 0x7f19e40af530 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e2a00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 0x7f19e40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19dbe00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c3c0 tx=0x7f19cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc017070 con 0x7f19e40af530 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19cc0053c0 con 0x7f19e40af530 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc003860 con 0x7f19e40af530 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e40b57c0 con 0x7f19e40af530 2024-09-21T07:25:30.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e40b5d80 con 0x7f19e40af530 2024-09-21T07:25:30.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.673+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e415f480 con 0x7f19e40af530 2024-09-21T07:25:30.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.677+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19cc01a070 con 0x7f19e40af530 2024-09-21T07:25:30.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.677+0000 7f19daa00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 0x7f19c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:30.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.677+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5778+0+0 (secure 0 0 0) 0x7f19cc093550 con 0x7f19e40af530 2024-09-21T07:25:30.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.677+0000 7f19e2a00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 0x7f19c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:30.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.677+0000 7f19e2a00640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 0x7f19c0075710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cc8f0 tx=0x7f19d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:30.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.681+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f19cc05e590 con 0x7f19e40af530 2024-09-21T07:25:30.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:30.869+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f19e40b5520 con 0x7f19e40af530 2024-09-21T07:25:31.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19daa00640 1 -- 172.21.15.64:0/4072903110 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) ==== 169+0+0 (secure 0 0 0) 0x7f19cc05de90 con 0x7f19e40af530 2024-09-21T07:25:31.484 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 msgr2=0x7f19c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 0x7f19c0075710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cc8f0 tx=0x7f19d4009040 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 msgr2=0x7f19e41576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c3c0 tx=0x7f19cc00c880 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 shutdown_connections 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f19c0073200 0x7f19c0075710 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19e4200b90 0x7f19e40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19e40af530 0x7f19e41576e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 --2- 172.21.15.64:0/4072903110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19e406ec70 0x7f19e40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 >> 172.21.15.64:0/4072903110 conn(0x7f19e40d0170 msgr2=0x7f19e40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 shutdown_connections 2024-09-21T07:25:31.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.481+0000 7f19e9800640 1 -- 172.21.15.64:0/4072903110 wait complete. 2024-09-21T07:25:31.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:25:31.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 -- 172.21.15.64:0/117623481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 msgr2=0x7f3b7806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/117623481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7806f890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009c80 tx=0x7f3b7001cda0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 -- 172.21.15.64:0/117623481 shutdown_connections 2024-09-21T07:25:31.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/117623481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7806f890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/117623481 >> v2:172.21.15.90:3300/0 conn(0x7f3b7815f9a0 0x7f3b7815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.793+0000 7f3b7fa00640 1 -- 172.21.15.64:0/117623481 >> 172.21.15.64:0/117623481 conn(0x7f3b7806d450 msgr2=0x7f3b780d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:31.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- 172.21.15.64:0/117623481 shutdown_connections 2024-09-21T07:25:31.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- 172.21.15.64:0/117623481 wait complete. 2024-09-21T07:25:31.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 Processor -- start 2024-09-21T07:25:31.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- start start 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7815f9a0 0x7f3b78164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b780ccef0 con 0x7f3b7809df30 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b780ccd70 con 0x7f3b7815f9a0 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7fa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3b780cd070 con 0x7f3b781602f0 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45468/0 (socket says 172.21.15.64:45468) 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.797+0000 7f3b7d000640 1 -- 172.21.15.64:0/3704569148 learned_addr learned my addr 172.21.15.64:0/3704569148 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:31.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b77e00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7815f9a0 0x7f3b78164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7da00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 -- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 msgr2=0x7f3b7809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 -- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7815f9a0 msgr2=0x7f3b78164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7815f9a0 0x7f3b78164dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 -- 172.21.15.64:0/3704569148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b781655f0 con 0x7f3b7809df30 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7d000640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c460 tx=0x7f3b6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0052d0 con 0x7f3b7809df30 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b6c005490 con 0x7f3b7809df30 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b781658d0 con 0x7f3b7809df30 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0038b0 con 0x7f3b7809df30 2024-09-21T07:25:31.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b78165e90 con 0x7f3b7809df30 2024-09-21T07:25:31.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7815fdb0 con 0x7f3b7809df30 2024-09-21T07:25:31.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.801+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b6c003a50 con 0x7f3b7809df30 2024-09-21T07:25:31.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.805+0000 7f3b74c00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 0x7f3b58075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:31.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.805+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f3b6c093a60 con 0x7f3b7809df30 2024-09-21T07:25:31.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.805+0000 7f3b77e00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 0x7f3b58075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:31.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.805+0000 7f3b77e00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 0x7f3b58075740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b780aef40 tx=0x7f3b640091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:31.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.809+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3b6c05e5b0 con 0x7f3b7809df30 2024-09-21T07:25:31.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.985+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f3b780adf90 con 0x7f3b7809df30 2024-09-21T07:25:31.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b74c00640 1 -- 172.21.15.64:0/3704569148 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f3b6c062fe0 con 0x7f3b7809df30 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 msgr2=0x7f3b58075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 0x7f3b58075740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b780aef40 tx=0x7f3b640091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 msgr2=0x7f3b780b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c460 tx=0x7f3b6c00c920 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 shutdown_connections 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b58073230 0x7f3b58075740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b781602f0 0x7f3b7809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7815f9a0 0x7f3b78164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 --2- 172.21.15.64:0/3704569148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7809df30 0x7f3b780b2590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 >> 172.21.15.64:0/3704569148 conn(0x7f3b7806d450 msgr2=0x7f3b780acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 shutdown_connections 2024-09-21T07:25:31.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:31.989+0000 7f3b7fa00640 1 -- 172.21.15.64:0/3704569148 wait complete. 2024-09-21T07:25:32.016 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 -- 172.21.15.64:0/1685408975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc0b48d0 msgr2=0x7f66bc072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 --2- 172.21.15.64:0/1685408975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc0b48d0 0x7f66bc072e20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0c3c60 tx=0x7f66b401cd80 comp rx=0 tx=0).stop 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 -- 172.21.15.64:0/1685408975 shutdown_connections 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 --2- 172.21.15.64:0/1685408975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc0b48d0 0x7f66bc072e20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 --2- 172.21.15.64:0/1685408975 >> v2:172.21.15.90:3300/0 conn(0x7f66bc15edb0 0x7f66bc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 -- 172.21.15.64:0/1685408975 >> 172.21.15.64:0/1685408975 conn(0x7f66bc0ccbe0 msgr2=0x7f66bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 -- 172.21.15.64:0/1685408975 shutdown_connections 2024-09-21T07:25:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.169+0000 7f66c2a00640 1 -- 172.21.15.64:0/1685408975 wait complete. 2024-09-21T07:25:32.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 Processor -- start 2024-09-21T07:25:32.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- start start 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66bc0709b0 0x7f66bc152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66bc15edb0 0x7f66bc1fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc168c00 con 0x7f66bc09bd10 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc168a80 con 0x7f66bc15edb0 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f66bc168d80 con 0x7f66bc0709b0 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45486/0 (socket says 172.21.15.64:45486) 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 -- 172.21.15.64:0/2686922678 learned_addr learned my addr 172.21.15.64:0/2686922678 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66b3e00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66bc15edb0 0x7f66bc1fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66bbe00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66bc0709b0 0x7f66bc152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 -- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66bc0709b0 msgr2=0x7f66bc152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66bc0709b0 0x7f66bc152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 -- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66bc15edb0 msgr2=0x7f66bc1fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66bc15edb0 0x7f66bc1fa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 -- 172.21.15.64:0/2686922678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc15d230 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c0a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66b401a9b0 tx=0x7f66b4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40bb070 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b4004d40 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40b2040 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc152d80 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.173+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc1fa120 con 0x7f66bc09bd10 2024-09-21T07:25:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.177+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66bc072e20 con 0x7f66bc09bd10 2024-09-21T07:25:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.177+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f66b40be070 con 0x7f66bc09bd10 2024-09-21T07:25:32.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.177+0000 7f66b8c00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 0x7f6698075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.177+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f66b412db20 con 0x7f66bc09bd10 2024-09-21T07:25:32.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.177+0000 7f66bbe00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 0x7f6698075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.181+0000 7f66bbe00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 0x7f6698075710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66ac004630 tx=0x7f66ac00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:32.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.181+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f66b4016970 con 0x7f66bc09bd10 2024-09-21T07:25:32.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.421+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f66bc09da20 con 0x7f66bc09bd10 2024-09-21T07:25:32.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.481+0000 7f66b8c00640 1 -- 172.21.15.64:0/2686922678 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v141) ==== 148+0+0 (secure 0 0 0) 0x7f66b40f8870 con 0x7f66bc09bd10 2024-09-21T07:25:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.481+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 msgr2=0x7f6698075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.481+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 0x7f6698075710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66ac004630 tx=0x7f66ac00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.481+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 msgr2=0x7f66bc1504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.481+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66b401a9b0 tx=0x7f66b4005b00 comp rx=0 tx=0).stop 2024-09-21T07:25:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 shutdown_connections 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6698073200 0x7f6698075710 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66bc09bd10 0x7f66bc1504f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66bc15edb0 0x7f66bc1fa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 --2- 172.21.15.64:0/2686922678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66bc0709b0 0x7f66bc152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 >> 172.21.15.64:0/2686922678 conn(0x7f66bc0ccbe0 msgr2=0x7f66bc0af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 shutdown_connections 2024-09-21T07:25:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.485+0000 7f66c2a00640 1 -- 172.21.15.64:0/2686922678 wait complete. 2024-09-21T07:25:32.508 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-21T07:25:32.508 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:25:32.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 -- 172.21.15.64:0/1869347833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 msgr2=0x7f3c7015f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 --2- 172.21.15.64:0/1869347833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c7015f800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3c700b4de0 tx=0x7f3c6001c890 comp rx=0 tx=0).stop 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 -- 172.21.15.64:0/1869347833 shutdown_connections 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 --2- 172.21.15.64:0/1869347833 >> v2:172.21.15.90:3300/0 conn(0x7f3c70162450 0x7f3c700cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 --2- 172.21.15.64:0/1869347833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c7015f800 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 -- 172.21.15.64:0/1869347833 >> 172.21.15.64:0/1869347833 conn(0x7f3c7006d1c0 msgr2=0x7f3c7006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 -- 172.21.15.64:0/1869347833 shutdown_connections 2024-09-21T07:25:32.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.661+0000 7f3c75800640 1 -- 172.21.15.64:0/1869347833 wait complete. 2024-09-21T07:25:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 Processor -- start 2024-09-21T07:25:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 -- start start 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 0x7f3c70156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c70162860 0x7f3c701562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7016c6e0 con 0x7f3c7006e8d0 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7016c560 con 0x7f3c70162450 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c75800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7016c860 con 0x7f3c70162860 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c6ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c6ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45490/0 (socket says 172.21.15.64:45490) 2024-09-21T07:25:32.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.665+0000 7f3c6ea00640 1 -- 172.21.15.64:0/2967255905 learned_addr learned my addr 172.21.15.64:0/2967255905 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c67e00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 0x7f3c70156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6f400640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c70162860 0x7f3c701562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 -- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c70162860 msgr2=0x7f3c701562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c70162860 0x7f3c701562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 -- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 msgr2=0x7f3c70156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 0x7f3c70156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 -- 172.21.15.64:0/2967255905 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c70157260 con 0x7f3c7006e8d0 2024-09-21T07:25:32.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c67e00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 0x7f3c70156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c6ea00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3c6001af40 tx=0x7f3c600a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c600b2040 con 0x7f3c7006e8d0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c600044b0 con 0x7f3c7006e8d0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c70157540 con 0x7f3c7006e8d0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60003840 con 0x7f3c7006e8d0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c70157b00 con 0x7f3c7006e8d0 2024-09-21T07:25:32.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7015f800 con 0x7f3c7006e8d0 2024-09-21T07:25:32.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.669+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3c600bf060 con 0x7f3c7006e8d0 2024-09-21T07:25:32.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.673+0000 7f3c66a00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 0x7f3c4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:32.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.673+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f3c6012ddf0 con 0x7f3c7006e8d0 2024-09-21T07:25:32.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.673+0000 7f3c67e00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 0x7f3c4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:32.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.673+0000 7f3c67e00640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 0x7f3c4c075740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c58006fd0 tx=0x7f3c58008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:32.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.673+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3c600164b0 con 0x7f3c7006e8d0 2024-09-21T07:25:32.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c700b6bb0 con 0x7f3c7006e8d0 2024-09-21T07:25:32.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c66a00640 1 -- 172.21.15.64:0/2967255905 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+13257 (secure 0 0 0) 0x7f3c600f8f60 con 0x7f3c7006e8d0 2024-09-21T07:25:32.857 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:32.857 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":47,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:31.480232+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/4120447613":"2024-09-22T07:25:28.473649+0000","172.21.15.64:6833/4120447613":"2024-09-22T07:25:28.473649+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 msgr2=0x7f3c4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 0x7f3c4c075740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c58006fd0 tx=0x7f3c58008040 comp rx=0 tx=0).stop 2024-09-21T07:25:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 msgr2=0x7f3c701fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3c6001af40 tx=0x7f3c600a5750 comp rx=0 tx=0).stop 2024-09-21T07:25:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 shutdown_connections 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c4c073230 0x7f3c4c075740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c70162860 0x7f3c701562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c70162450 0x7f3c70156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 --2- 172.21.15.64:0/2967255905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c7006e8d0 0x7f3c701fd570 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 >> 172.21.15.64:0/2967255905 conn(0x7f3c7006d1c0 msgr2=0x7f3c7015ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 shutdown_connections 2024-09-21T07:25:32.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:32.853+0000 7f3c75800640 1 -- 172.21.15.64:0/2967255905 wait complete. 2024-09-21T07:25:32.880 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:25:32.881 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:25:33.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 -- 172.21.15.64:0/3729988081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 msgr2=0x7f633015ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 --2- 172.21.15.64:0/3729988081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f633015ee70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f63200098f0 tx=0x7f632001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 -- 172.21.15.64:0/3729988081 shutdown_connections 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 --2- 172.21.15.64:0/3729988081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f633015ee70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 -- 172.21.15.64:0/3729988081 >> 172.21.15.64:0/3729988081 conn(0x7f633006d450 msgr2=0x7f63300d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 -- 172.21.15.64:0/3729988081 shutdown_connections 2024-09-21T07:25:33.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.037+0000 7f6334a00640 1 -- 172.21.15.64:0/3729988081 wait complete. 2024-09-21T07:25:33.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 Processor -- start 2024-09-21T07:25:33.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- start start 2024-09-21T07:25:33.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f633006f890 0x7f63300c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63300b3140 0x7f633015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f633016a2c0 con 0x7f63300cc960 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f633016a140 con 0x7f63300b3140 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f633016a440 con 0x7f633006f890 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45518/0 (socket says 172.21.15.64:45518) 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63300b3140 0x7f633015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 -- 172.21.15.64:0/3040794232 learned_addr learned my addr 172.21.15.64:0/3040794232 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:33.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632de00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f633006f890 0x7f63300c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 -- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f633006f890 msgr2=0x7f63300c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f633006f890 0x7f63300c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 -- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63300b3140 msgr2=0x7f633015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63300b3140 0x7f633015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 -- 172.21.15.64:0/3040794232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63300cd7d0 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f632e800640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f632800c760 tx=0x7f632800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328003b80 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6328003d20 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800aab0 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633015d950 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.041+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633015c630 con 0x7f63300cc960 2024-09-21T07:25:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.045+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633015ee70 con 0x7f63300cc960 2024-09-21T07:25:33.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.045+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f632800ac50 con 0x7f63300cc960 2024-09-21T07:25:33.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.045+0000 7f6326000640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 0x7f6310075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.045+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f6328093cb0 con 0x7f63300cc960 2024-09-21T07:25:33.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.045+0000 7f632de00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 0x7f6310075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.049+0000 7f632de00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 0x7f6310075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63200af000 tx=0x7f632001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:33.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.049+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f632805e880 con 0x7f63300cc960 2024-09-21T07:25:33.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.225+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63300cc6d0 con 0x7f63300cc960 2024-09-21T07:25:33.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.225+0000 7f6326000640 1 -- 172.21.15.64:0/3040794232 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f63280632b0 con 0x7f63300cc960 2024-09-21T07:25:33.231 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:25:33.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 msgr2=0x7f6310075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 0x7f6310075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63200af000 tx=0x7f632001b120 comp rx=0 tx=0).stop 2024-09-21T07:25:33.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 msgr2=0x7f63300c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f632800c760 tx=0x7f632800cc20 comp rx=0 tx=0).stop 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 shutdown_connections 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6310073200 0x7f6310075710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63300cc960 0x7f63300c7f00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63300b3140 0x7f633015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 --2- 172.21.15.64:0/3040794232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f633006f890 0x7f63300c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 >> 172.21.15.64:0/3040794232 conn(0x7f633006d450 msgr2=0x7f63300ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 shutdown_connections 2024-09-21T07:25:33.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.229+0000 7f6334a00640 1 -- 172.21.15.64:0/3040794232 wait complete. 2024-09-21T07:25:33.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-21T07:25:33.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 -- 172.21.15.64:0/663495865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c0cdd90 msgr2=0x7f331c0ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 --2- 172.21.15.64:0/663495865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c0cdd90 0x7f331c0ce1a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f331c073780 tx=0x7f331401cd80 comp rx=0 tx=0).stop 2024-09-21T07:25:33.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 -- 172.21.15.64:0/663495865 shutdown_connections 2024-09-21T07:25:33.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 --2- 172.21.15.64:0/663495865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c0cdd90 0x7f331c0ce1a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 --2- 172.21.15.64:0/663495865 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c06ff20 0x7f331c070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 --2- 172.21.15.64:0/663495865 >> v2:172.21.15.90:3300/0 conn(0x7f331c152250 0x7f331c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 -- 172.21.15.64:0/663495865 >> 172.21.15.64:0/663495865 conn(0x7f331c0b2b80 msgr2=0x7f331c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:33.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 -- 172.21.15.64:0/663495865 shutdown_connections 2024-09-21T07:25:33.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.405+0000 7f3322400640 1 -- 172.21.15.64:0/663495865 wait complete. 2024-09-21T07:25:33.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 Processor -- start 2024-09-21T07:25:33.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 -- start start 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f331c06ff20 0x7f331c145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c0cdd90 0x7f331c0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f331c15fa80 con 0x7f331c152250 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f331c15f900 con 0x7f331c06ff20 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3322400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f331c15fc00 con 0x7f331c0cdd90 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3321a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3321a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45538/0 (socket says 172.21.15.64:45538) 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.409+0000 7f3321a00640 1 -- 172.21.15.64:0/2871586417 learned_addr learned my addr 172.21.15.64:0/2871586417 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f331be00640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c0cdd90 0x7f331c0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321000640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f331c06ff20 0x7f331c145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 -- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c0cdd90 msgr2=0x7f331c0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c0cdd90 0x7f331c0b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 -- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f331c06ff20 msgr2=0x7f331c145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f331c06ff20 0x7f331c145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 -- 172.21.15.64:0/2871586417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c0b6050 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3321a00640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3314009bd0 tx=0x7f3314003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33140bb070 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3314004b40 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c155370 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33140b2040 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c0b62f0 con 0x7f331c152250 2024-09-21T07:25:33.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c0ce1a0 con 0x7f331c152250 2024-09-21T07:25:33.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.413+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f33140be070 con 0x7f331c152250 2024-09-21T07:25:33.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.417+0000 7f3318c00640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 0x7f32fc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:33.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.417+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f331412de10 con 0x7f331c152250 2024-09-21T07:25:33.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.417+0000 7f3321000640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 0x7f32fc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:33.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.417+0000 7f3321000640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 0x7f32fc075740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3310009b40 tx=0x7f33100091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:33.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.421+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3314131030 con 0x7f331c152250 2024-09-21T07:25:33.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:33.661+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f331c1550f0 con 0x7f331c152250 2024-09-21T07:25:34.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.489+0000 7f3318c00640 1 -- 172.21.15.64:0/2871586417 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v143) ==== 146+0+0 (secure 0 0 0) 0x7f331c1550f0 con 0x7f331c152250 2024-09-21T07:25:34.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 msgr2=0x7f32fc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 0x7f32fc075740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3310009b40 tx=0x7f33100091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 msgr2=0x7f331c0b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3314009bd0 tx=0x7f3314003f60 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 shutdown_connections 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32fc073230 0x7f32fc075740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f331c152250 0x7f331c0b58c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f331c0cdd90 0x7f331c0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 --2- 172.21.15.64:0/2871586417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f331c06ff20 0x7f331c145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 >> 172.21.15.64:0/2871586417 conn(0x7f331c0b2b80 msgr2=0x7f331c0cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 shutdown_connections 2024-09-21T07:25:34.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.493+0000 7f3322400640 1 -- 172.21.15.64:0/2871586417 wait complete. 2024-09-21T07:25:34.521 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:25:34.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 -- 172.21.15.64:0/1736106944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa900b48d0 msgr2=0x7ffa90072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736106944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa900b48d0 0x7ffa90072e20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009c80 tx=0x7ffa8801cda0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 -- 172.21.15.64:0/1736106944 shutdown_connections 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736106944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa900b48d0 0x7ffa90072e20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 -- 172.21.15.64:0/1736106944 >> 172.21.15.64:0/1736106944 conn(0x7ffa900ccbe0 msgr2=0x7ffa900ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 -- 172.21.15.64:0/1736106944 shutdown_connections 2024-09-21T07:25:34.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.681+0000 7ffa95400640 1 -- 172.21.15.64:0/1736106944 wait complete. 2024-09-21T07:25:34.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 Processor -- start 2024-09-21T07:25:34.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- start start 2024-09-21T07:25:34.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa900709b0 0x7ffa9009d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa9015edb0 0x7ffa901fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9016a420 con 0x7ffa90152130 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9016a2a0 con 0x7ffa900709b0 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9016a5a0 con 0x7ffa9015edb0 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45554/0 (socket says 172.21.15.64:45554) 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 -- 172.21.15.64:0/1736588134 learned_addr learned my addr 172.21.15.64:0/1736588134 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8e800640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa900709b0 0x7ffa9009d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa85e00640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa9015edb0 0x7ffa901fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 -- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa9015edb0 msgr2=0x7ffa901fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa9015edb0 0x7ffa901fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 -- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa900709b0 msgr2=0x7ffa9009d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa900709b0 0x7ffa9009d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 -- 172.21.15.64:0/1736588134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa90152900 con 0x7ffa90152130 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa8f200640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009bd0 tx=0x7ffa880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880bb070 con 0x7ffa90152130 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa880045d0 con 0x7ffa90152130 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa900aec90 con 0x7ffa90152130 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880b2040 con 0x7ffa90152130 2024-09-21T07:25:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.685+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa900ae9b0 con 0x7ffa90152130 2024-09-21T07:25:34.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.689+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa90072e20 con 0x7ffa90152130 2024-09-21T07:25:34.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.689+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffa880be070 con 0x7ffa90152130 2024-09-21T07:25:34.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.689+0000 7ffa87400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 0x7ffa6c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:34.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.689+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7ffa8812e3f0 con 0x7ffa90152130 2024-09-21T07:25:34.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.689+0000 7ffa8e800640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 0x7ffa6c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:34.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.693+0000 7ffa8e800640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 0x7ffa6c075710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000b810 tx=0x7ffa80008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:34.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.693+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffa88016990 con 0x7ffa90152130 2024-09-21T07:25:34.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.869+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ffa9009da20 con 0x7ffa90152130 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa87400640 1 -- 172.21.15.64:0/1736588134 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7ffa880f9600 con 0x7ffa90152130 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:25:34.876 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:25:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:25:34.878 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:25:34.879 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:25:34.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 msgr2=0x7ffa6c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 0x7ffa6c075710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000b810 tx=0x7ffa80008040 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 msgr2=0x7ffa901fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009bd0 tx=0x7ffa880042f0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 shutdown_connections 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffa6c073200 0x7ffa6c075710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa90152130 0x7ffa901fc900 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa9015edb0 0x7ffa901fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 --2- 172.21.15.64:0/1736588134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa900709b0 0x7ffa9009d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 >> 172.21.15.64:0/1736588134 conn(0x7ffa900ccbe0 msgr2=0x7ffa900cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 shutdown_connections 2024-09-21T07:25:34.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:34.873+0000 7ffa95400640 1 -- 172.21.15.64:0/1736588134 wait complete. 2024-09-21T07:25:34.897 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:25:35.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 -- 172.21.15.64:0/161847859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80adfd0 msgr2=0x7fbbc80ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 --2- 172.21.15.64:0/161847859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80adfd0 0x7fbbc80ae3e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80d09c0 tx=0x7fbbb401c830 comp rx=0 tx=0).stop 2024-09-21T07:25:35.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 -- 172.21.15.64:0/161847859 shutdown_connections 2024-09-21T07:25:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 --2- 172.21.15.64:0/161847859 >> v2:172.21.15.90:3300/0 conn(0x7fbbc80ae920 0x7fbbc80cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 --2- 172.21.15.64:0/161847859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80adfd0 0x7fbbc80ae3e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 -- 172.21.15.64:0/161847859 >> 172.21.15.64:0/161847859 conn(0x7fbbc80b2510 msgr2=0x7fbbc80b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 -- 172.21.15.64:0/161847859 shutdown_connections 2024-09-21T07:25:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.053+0000 7fbbce000640 1 -- 172.21.15.64:0/161847859 wait complete. 2024-09-21T07:25:35.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 Processor -- start 2024-09-21T07:25:35.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 -- start start 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbc80adfd0 0x7fbbc8154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbc80cf980 0x7fbbc8157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc816c190 con 0x7fbbc80ae920 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc816c010 con 0x7fbbc80cf980 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbce000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc816c310 con 0x7fbbc80adfd0 2024-09-21T07:25:35.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52922/0 (socket says 172.21.15.64:52922) 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 -- 172.21.15.64:0/193741866 learned_addr learned my addr 172.21.15.64:0/193741866 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc7400640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbc80adfd0 0x7fbbc8154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc7e00640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbc80cf980 0x7fbbc8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 -- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbc80adfd0 msgr2=0x7fbbc8154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbc80adfd0 0x7fbbc8154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 -- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbc80cf980 msgr2=0x7fbbc8157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbc80cf980 0x7fbbc8157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.057+0000 7fbbc6a00640 1 -- 172.21.15.64:0/193741866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc80b62c0 con 0x7fbbc80ae920 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbc6a00640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40b0040 tx=0x7fbbb40a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40bb070 con 0x7fbbc80ae920 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc8169570 con 0x7fbbc80ae920 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbb40043b0 con 0x7fbbc80ae920 2024-09-21T07:25:35.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40b2040 con 0x7fbbc80ae920 2024-09-21T07:25:35.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc81567e0 con 0x7fbbc80ae920 2024-09-21T07:25:35.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc80ae3e0 con 0x7fbbc80ae920 2024-09-21T07:25:35.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbbb4005290 con 0x7fbbc80ae920 2024-09-21T07:25:35.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 0x7fbba8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7fbbb412dd60 con 0x7fbbc80ae920 2024-09-21T07:25:35.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.061+0000 7fbbc7400640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 0x7fbba8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.065+0000 7fbbc7400640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 0x7fbba8075710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8007fd0 tx=0x7fbbb8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:35.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.065+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbbc80b62c0 con 0x7fbbc80ae920 2024-09-21T07:25:35.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.241+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbbc80af890 con 0x7fbbc80ae920 2024-09-21T07:25:35.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.245+0000 7fbbbf400640 1 -- 172.21.15.64:0/193741866 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fbbb40164b0 con 0x7fbbc80ae920 2024-09-21T07:25:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 msgr2=0x7fbba8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 0x7fbba8075710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8007fd0 tx=0x7fbbb8009040 comp rx=0 tx=0).stop 2024-09-21T07:25:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 msgr2=0x7fbbc81572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40b0040 tx=0x7fbbb40a5660 comp rx=0 tx=0).stop 2024-09-21T07:25:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 shutdown_connections 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbba8073200 0x7fbba8075710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbc80cf980 0x7fbbc8157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbc80ae920 0x7fbbc81572c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 --2- 172.21.15.64:0/193741866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbc80adfd0 0x7fbbc8154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 >> 172.21.15.64:0/193741866 conn(0x7fbbc80b2510 msgr2=0x7fbbc8071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 shutdown_connections 2024-09-21T07:25:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.249+0000 7fbbce000640 1 -- 172.21.15.64:0/193741866 wait complete. 2024-09-21T07:25:35.274 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:25:35.274 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:25:35.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:25:35.487 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:25:35.487 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:35.487 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:35.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:25:35.497 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:25:35.497 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:35.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:25:35.506 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:35.506 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:35.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:25:35.548 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:25:35.548 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:35.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:25:35.560 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:25:35.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 -- 172.21.15.64:0/2408340180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ca0004810 msgr2=0x7f5ca0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/2408340180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ca0004810 0x7f5ca0004c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400c640 tx=0x7f5ca401cf10 comp rx=0 tx=0).stop 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbb400640 1 -- 172.21.15.64:0/2408340180 reap_dead start 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 -- 172.21.15.64:0/2408340180 shutdown_connections 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 -- 172.21.15.64:0/2408340180 >> 172.21.15.64:0/2408340180 conn(0x7f5cbc0cd3a0 msgr2=0x7f5cbc0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 -- 172.21.15.64:0/2408340180 shutdown_connections 2024-09-21T07:25:35.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.745+0000 7f5cbbe00640 1 -- 172.21.15.64:0/2408340180 wait complete. 2024-09-21T07:25:35.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 Processor -- start 2024-09-21T07:25:35.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- start start 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca0004810 0x7f5cbc0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc0b3690 0x7f5cbc0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc1678f0 con 0x7f5cbc158df0 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc167770 con 0x7f5cbc0b3690 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5cbc167a70 con 0x7f5ca0004810 2024-09-21T07:25:35.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52946/0 (socket says 172.21.15.64:52946) 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 -- 172.21.15.64:0/708808097 learned_addr learned my addr 172.21.15.64:0/708808097 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cb2000640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc0b3690 0x7f5cbc0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbaa00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca0004810 0x7f5cbc0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 -- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca0004810 msgr2=0x7f5cbc0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca0004810 0x7f5cbc0b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 -- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc0b3690 msgr2=0x7f5cbc0b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc0b3690 0x7f5cbc0b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 -- 172.21.15.64:0/708808097 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc159740 con 0x7f5cbc158df0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbb400640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc070be0 tx=0x7f5cb400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4004b30 con 0x7f5cbc158df0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cb4004cd0 con 0x7f5cbc158df0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4003be0 con 0x7f5cbc158df0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc0b5bc0 con 0x7f5cbc158df0 2024-09-21T07:25:35.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.749+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc1fa5f0 con 0x7f5cbc158df0 2024-09-21T07:25:35.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc0b50b0 con 0x7f5cbc158df0 2024-09-21T07:25:35.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5cb4004030 con 0x7f5cbc158df0 2024-09-21T07:25:35.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cb3400640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 0x7f5c98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:35.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f5cb40946c0 con 0x7f5cbc158df0 2024-09-21T07:25:35.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cbaa00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 0x7f5c98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:35.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.753+0000 7f5cbaa00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 0x7f5c98075710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c10 tx=0x7f5cac006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:35.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.757+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5cbc159740 con 0x7f5cbc158df0 2024-09-21T07:25:35.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.969+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cbc0ce8c0 con 0x7f5cbc158df0 2024-09-21T07:25:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.969+0000 7f5cb3400640 1 -- 172.21.15.64:0/708808097 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3908 (secure 0 0 0) 0x7f5cb405f170 con 0x7f5cbc158df0 2024-09-21T07:25:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:35.975 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":21,"btime":"2024-09-21T07:25:29:475940+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1635421692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1635421692},{"type":"v1","addr":"172.21.15.90:6837","nonce":1635421692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4213462850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4213462850},{"type":"v1","addr":"172.21.15.90:6835","nonce":4213462850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1552820761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1552820761},{"type":"v1","addr":"172.21.15.64:6834","nonce":1552820761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/393774246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":393774246},{"type":"v1","addr":"172.21.15.64:6835","nonce":393774246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-09-21T07:25:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 21 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 msgr2=0x7f5c98075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 0x7f5c98075710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c10 tx=0x7f5cac006b80 comp rx=0 tx=0).stop 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 msgr2=0x7f5cbc159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc070be0 tx=0x7f5cb400f3c0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 shutdown_connections 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c98073200 0x7f5c98075710 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cbc158df0 0x7f5cbc159200 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc0b3690 0x7f5cbc0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 --2- 172.21.15.64:0/708808097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca0004810 0x7f5cbc0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:35.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 >> 172.21.15.64:0/708808097 conn(0x7f5cbc0cd3a0 msgr2=0x7f5cbc0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:35.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 shutdown_connections 2024-09-21T07:25:35.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:35.973+0000 7f5cbbe00640 1 -- 172.21.15.64:0/708808097 wait complete. 2024-09-21T07:25:35.998 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:25:35.998 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:25:35.998 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:25:35.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:25:35.998 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:25:35.999 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:25:35.999 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:25:35.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:25:35.999 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:25:35.999 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:25:35.999 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:25:35.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:25:36.000 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:25:36.000 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:25:36.000 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:25:36.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:25:36.011 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:25:36.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:25:36.016 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:25:36.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:25:36.017 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:25:36.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:25:36.023 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:25:36.023 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:25:36.063 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:25:36.063 DEBUG:teuthology.parallel:result is None 2024-09-21T07:25:36.064 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:25:36.065 DEBUG:teuthology.parallel:result is None 2024-09-21T07:25:36.065 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:25:36.066 DEBUG:teuthology.parallel:result is None 2024-09-21T07:25:36.068 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:25:36.068 DEBUG:teuthology.parallel:result is None 2024-09-21T07:25:36.068 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:25:36.164 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:25:36.166 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:25:36.166 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:25:36.170 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:25:36.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 -- 172.21.15.64:0/2165690739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f638806df00 msgr2=0x7f638806e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:36.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 --2- 172.21.15.64:0/2165690739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f638806df00 0x7f638806e310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6388074260 tx=0x7f638001ccc0 comp rx=0 tx=0).stop 2024-09-21T07:25:36.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 -- 172.21.15.64:0/2165690739 shutdown_connections 2024-09-21T07:25:36.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 --2- 172.21.15.64:0/2165690739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f638806df00 0x7f638806e310 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 --2- 172.21.15.64:0/2165690739 >> v2:172.21.15.90:3300/0 conn(0x7f6388162860 0x7f6388162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 -- 172.21.15.64:0/2165690739 >> 172.21.15.64:0/2165690739 conn(0x7f63880d2400 msgr2=0x7f63880d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 -- 172.21.15.64:0/2165690739 shutdown_connections 2024-09-21T07:25:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.229+0000 7f638e000640 1 -- 172.21.15.64:0/2165690739 wait complete. 2024-09-21T07:25:36.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 Processor -- start 2024-09-21T07:25:36.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 -- start start 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f638806df00 0x7f6388153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 0x7f6388161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f638816c240 con 0x7f63880710e0 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f638816c0c0 con 0x7f6388162860 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f638e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f638816c3c0 con 0x7f638806df00 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52998/0 (socket says 172.21.15.64:52998) 2024-09-21T07:25:36.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 -- 172.21.15.64:0/2374438250 learned_addr learned my addr 172.21.15.64:0/2374438250 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:36.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f6387400640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f638806df00 0x7f6388153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:36.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f6387e00640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 0x7f6388161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 -- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f638806df00 msgr2=0x7f6388153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f638806df00 0x7f6388153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 -- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 msgr2=0x7f6388161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 0x7f6388161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f637fe00640 1 -- 172.21.15.64:0/2374438250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63881fc730 con 0x7f63880710e0 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.233+0000 7f6387e00640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 0x7f6388161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637fe00640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f637000b420 tx=0x7f637000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370011830 con 0x7f63880710e0 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6370016070 con 0x7f63880710e0 2024-09-21T07:25:36.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370011d80 con 0x7f63880710e0 2024-09-21T07:25:36.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63880b8110 con 0x7f63880710e0 2024-09-21T07:25:36.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63881fccf0 con 0x7f63880710e0 2024-09-21T07:25:36.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63880b1e40 con 0x7f63880710e0 2024-09-21T07:25:36.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f637001b460 con 0x7f63880710e0 2024-09-21T07:25:36.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 0x7f6364075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:36.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5335+0+0 (secure 0 0 0) 0x7f6370093d30 con 0x7f63880710e0 2024-09-21T07:25:36.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.237+0000 7f6387400640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 0x7f6364075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:36.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.241+0000 7f6387400640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 0x7f6364075710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f63780098e0 tx=0x7f6378009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:36.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.241+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f63880b1e40 con 0x7f63880710e0 2024-09-21T07:25:36.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:36.433+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f638806e310 con 0x7f63880710e0 2024-09-21T07:25:37.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.265+0000 7f637f400640 1 -- 172.21.15.64:0/2374438250 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) ==== 97+0+0 (secure 0 0 0) 0x7f637005e7d0 con 0x7f63880710e0 2024-09-21T07:25:37.271 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:25:37.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 msgr2=0x7f6364075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 0x7f6364075710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f63780098e0 tx=0x7f6378009060 comp rx=0 tx=0).stop 2024-09-21T07:25:37.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 msgr2=0x7f63880b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f637000b420 tx=0x7f637000b8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 shutdown_connections 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6364073200 0x7f6364075710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6388162860 0x7f6388161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63880710e0 0x7f63880b7bd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 --2- 172.21.15.64:0/2374438250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f638806df00 0x7f6388153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 >> 172.21.15.64:0/2374438250 conn(0x7f63880d2400 msgr2=0x7f6388158860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 shutdown_connections 2024-09-21T07:25:37.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.269+0000 7f638e000640 1 -- 172.21.15.64:0/2374438250 wait complete. 2024-09-21T07:25:37.297 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:25:37.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- 172.21.15.64:0/1812681131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 msgr2=0x7f7b1c169740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 --2- 172.21.15.64:0/1812681131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c169740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009bc0 tx=0x7f7b1401ca80 comp rx=0 tx=0).stop 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- 172.21.15.64:0/1812681131 shutdown_connections 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 --2- 172.21.15.64:0/1812681131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c169740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- 172.21.15.64:0/1812681131 >> 172.21.15.64:0/1812681131 conn(0x7f7b1c06e890 msgr2=0x7f7b1c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- 172.21.15.64:0/1812681131 shutdown_connections 2024-09-21T07:25:37.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- 172.21.15.64:0/1812681131 wait complete. 2024-09-21T07:25:37.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 Processor -- start 2024-09-21T07:25:37.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.453+0000 7f7b23600640 1 -- start start 2024-09-21T07:25:37.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b1c06cdf0 0x7f7b1c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b1c15ebe0 0x7f7b1c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c16d4a0 con 0x7f7b1c0aff70 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c16d320 con 0x7f7b1c06cdf0 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c16d620 con 0x7f7b1c15ebe0 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53018/0 (socket says 172.21.15.64:53018) 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 -- 172.21.15.64:0/3860796226 learned_addr learned my addr 172.21.15.64:0/3860796226 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b20c00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b1c06cdf0 0x7f7b1c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b21600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b1c15ebe0 0x7f7b1c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 -- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b1c15ebe0 msgr2=0x7f7b1c0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b1c15ebe0 0x7f7b1c0b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 -- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b1c06cdf0 msgr2=0x7f7b1c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b1c06cdf0 0x7f7b1c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 -- 172.21.15.64:0/3860796226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0b8510 con 0x7f7b1c0aff70 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b13e00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c420 tx=0x7f7b0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04017070 con 0x7f7b1c0aff70 2024-09-21T07:25:37.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b040053c0 con 0x7f7b1c0aff70 2024-09-21T07:25:37.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04003860 con 0x7f7b1c0aff70 2024-09-21T07:25:37.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c15ba00 con 0x7f7b1c0aff70 2024-09-21T07:25:37.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c158bc0 con 0x7f7b1c0aff70 2024-09-21T07:25:37.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.457+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c15f8a0 con 0x7f7b1c0aff70 2024-09-21T07:25:37.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.461+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7b0401a070 con 0x7f7b1c0aff70 2024-09-21T07:25:37.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.461+0000 7f7b19600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.461+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5249+0+0 (secure 0 0 0) 0x7f7b04093410 con 0x7f7b1c0aff70 2024-09-21T07:25:37.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.461+0000 7f7b20c00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.461+0000 7f7b20c00640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007fd0 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:37.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.465+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7b1c15ba00 con 0x7f7b1c0aff70 2024-09-21T07:25:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.705+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7b1c06d200 con 0x7f7b1c0aff70 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b19600640 1 -- 172.21.15.64:0/3860796226 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7f7b1c0b8510 con 0x7f7b1c0aff70 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.712 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.713 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.714 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.715 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:25:37.716 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.717 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.718 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:25:37.719 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.720 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:25:37.721 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:25:37.722 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:25:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:37.724 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:25:37.725 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:37.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 msgr2=0x7f7af8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007fd0 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-09-21T07:25:37.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 msgr2=0x7f7b1c151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c420 tx=0x7f7b0400c8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 shutdown_connections 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b1c15ebe0 0x7f7b1c0b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1c0aff70 0x7f7b1c151f20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 --2- 172.21.15.64:0/3860796226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b1c06cdf0 0x7f7b1c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 >> 172.21.15.64:0/3860796226 conn(0x7f7b1c06e890 msgr2=0x7f7b1c15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 shutdown_connections 2024-09-21T07:25:37.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.709+0000 7f7b23600640 1 -- 172.21.15.64:0/3860796226 wait complete. 2024-09-21T07:25:37.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:25:37.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- 172.21.15.64:0/690690453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed40b48d0 msgr2=0x7f2ed4072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 --2- 172.21.15.64:0/690690453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed40b48d0 0x7f2ed4072e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009bc0 tx=0x7f2ecc01cba0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- 172.21.15.64:0/690690453 shutdown_connections 2024-09-21T07:25:37.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 --2- 172.21.15.64:0/690690453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed40b48d0 0x7f2ed4072e20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- 172.21.15.64:0/690690453 >> 172.21.15.64:0/690690453 conn(0x7f2ed40ccbe0 msgr2=0x7f2ed40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:37.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- 172.21.15.64:0/690690453 shutdown_connections 2024-09-21T07:25:37.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- 172.21.15.64:0/690690453 wait complete. 2024-09-21T07:25:37.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 Processor -- start 2024-09-21T07:25:37.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.889+0000 7f2eda000640 1 -- start start 2024-09-21T07:25:37.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ed40709b0 0x7f2ed41f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed415edb0 0x7f2ed41fa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed416a470 con 0x7f2ed40b0d80 2024-09-21T07:25:37.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed416a2f0 con 0x7f2ed415edb0 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed416a5f0 con 0x7f2ed40709b0 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53030/0 (socket says 172.21.15.64:53030) 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 -- 172.21.15.64:0/3645619673 learned_addr learned my addr 172.21.15.64:0/3645619673 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ecbe00640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed415edb0 0x7f2ed41fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3400640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ed40709b0 0x7f2ed41f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 -- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ed40709b0 msgr2=0x7f2ed41f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ed40709b0 0x7f2ed41f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 -- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed415edb0 msgr2=0x7f2ed41fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed415edb0 0x7f2ed41fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 -- 172.21.15.64:0/3645619673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed41fb280 con 0x7f2ed40b0d80 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ed3e00640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009b10 tx=0x7f2ecc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0bb070 con 0x7f2ed40b0d80 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ecc004d40 con 0x7f2ed40b0d80 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0b2040 con 0x7f2ed40b0d80 2024-09-21T07:25:37.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed41fb560 con 0x7f2ed40b0d80 2024-09-21T07:25:37.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed41fad40 con 0x7f2ed40b0d80 2024-09-21T07:25:37.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.893+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed41faff0 con 0x7f2ed40b0d80 2024-09-21T07:25:37.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.897+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2ecc0a5d10 con 0x7f2ed40b0d80 2024-09-21T07:25:37.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.897+0000 7f2ecb400640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 0x7f2eb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:37.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.897+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5249+0+0 (secure 0 0 0) 0x7f2ecc12dff0 con 0x7f2ed40b0d80 2024-09-21T07:25:37.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.897+0000 7f2ed3400640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 0x7f2eb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:37.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.897+0000 7f2ed3400640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 0x7f2eb0075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40046c0 tx=0x7f2ec4007cd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:37.901+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2ecc0c4020 con 0x7f2ed40b0d80 2024-09-21T07:25:38.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2ed4072e20 con 0x7f2ed40b0d80 2024-09-21T07:25:38.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2ecb400640 1 -- 172.21.15.64:0/3645619673 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) ==== 84+0+65 (secure 0 0 0) 0x7f2ecc016790 con 0x7f2ed40b0d80 2024-09-21T07:25:38.085 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:38.085 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:25:38.085 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:25:38.085 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:25:38.086 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:25:38.086 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:25:38.086 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 msgr2=0x7f2eb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 0x7f2eb0075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40046c0 tx=0x7f2ec4007cd0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 msgr2=0x7f2ed40c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009b10 tx=0x7f2ecc009260 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 shutdown_connections 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2eb0073200 0x7f2eb0075710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ed40b0d80 0x7f2ed40c3c90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed415edb0 0x7f2ed41fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 --2- 172.21.15.64:0/3645619673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ed40709b0 0x7f2ed41f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 >> 172.21.15.64:0/3645619673 conn(0x7f2ed40ccbe0 msgr2=0x7f2ed4070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 shutdown_connections 2024-09-21T07:25:38.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.081+0000 7f2eda000640 1 -- 172.21.15.64:0/3645619673 wait complete. 2024-09-21T07:25:38.108 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:25:38.109 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:25:38.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 -- 172.21.15.64:0/361983241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d406ec70 msgr2=0x7f16d4158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:38.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 --2- 172.21.15.64:0/361983241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d406ec70 0x7f16d4158db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009840 tx=0x7f16c401c820 comp rx=0 tx=0).stop 2024-09-21T07:25:38.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 -- 172.21.15.64:0/361983241 shutdown_connections 2024-09-21T07:25:38.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 --2- 172.21.15.64:0/361983241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d40af530 0x7f16d415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 --2- 172.21.15.64:0/361983241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d406ec70 0x7f16d4158db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.265+0000 7f16da600640 1 -- 172.21.15.64:0/361983241 >> 172.21.15.64:0/361983241 conn(0x7f16d40d0170 msgr2=0x7f16d40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.269+0000 7f16da600640 1 -- 172.21.15.64:0/361983241 shutdown_connections 2024-09-21T07:25:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.269+0000 7f16da600640 1 -- 172.21.15.64:0/361983241 wait complete. 2024-09-21T07:25:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.269+0000 7f16da600640 1 Processor -- start 2024-09-21T07:25:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.269+0000 7f16da600640 1 -- start start 2024-09-21T07:25:38.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d406ec70 0x7f16d4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:38.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d41592f0 0x7f16d406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f16d415c500 con 0x7f16d40af530 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16d415c380 con 0x7f16d41592f0 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f16d415c680 con 0x7f16d406ec70 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53040/0 (socket says 172.21.15.64:53040) 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 -- 172.21.15.64:0/3531664567 learned_addr learned my addr 172.21.15.64:0/3531664567 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16d3400640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d406ec70 0x7f16d4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16d3e00640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d41592f0 0x7f16d406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 -- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d406ec70 msgr2=0x7f16d4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d406ec70 0x7f16d4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 -- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d41592f0 msgr2=0x7f16d406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d41592f0 0x7f16d406fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:38.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 -- 172.21.15.64:0/3531664567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d40acea0 con 0x7f16d40af530 2024-09-21T07:25:38.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cbe00640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c3c0 tx=0x7f16bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011790 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16bc017070 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d41fc570 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011ce0 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d41fcb30 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d4158db0 con 0x7f16d40af530 2024-09-21T07:25:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.277+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f16bc01c460 con 0x7f16d40af530 2024-09-21T07:25:38.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.277+0000 7f16cb400640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 0x7f16b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:38.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.277+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5249+0+0 (secure 0 0 0) 0x7f16bc093ce0 con 0x7f16d40af530 2024-09-21T07:25:38.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.277+0000 7f16d3400640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 0x7f16b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:38.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.277+0000 7f16d3400640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 0x7f16b0075740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16c40ae000 tx=0x7f16c401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.281+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f16bc05e7d0 con 0x7f16d40af530 2024-09-21T07:25:38.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:38.461+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f16d40b60f0 con 0x7f16d40af530 2024-09-21T07:25:39.058 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:39.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:39.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.269+0000 7f16cb400640 1 -- 172.21.15.64:0/3531664567 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) ==== 138+0+0 (secure 0 0 0) 0x7f16bc063200 con 0x7f16d40af530 2024-09-21T07:25:39.275 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:25:39.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 msgr2=0x7f16b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:39.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 0x7f16b0075740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16c40ae000 tx=0x7f16c401b060 comp rx=0 tx=0).stop 2024-09-21T07:25:39.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 msgr2=0x7f16d406f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c3c0 tx=0x7f16bc00c880 comp rx=0 tx=0).stop 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 shutdown_connections 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16b0073230 0x7f16b0075740 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d41592f0 0x7f16d406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16d40af530 0x7f16d406f500 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 --2- 172.21.15.64:0/3531664567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16d406ec70 0x7f16d4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 >> 172.21.15.64:0/3531664567 conn(0x7f16d40d0170 msgr2=0x7f16d415b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:39.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 shutdown_connections 2024-09-21T07:25:39.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.273+0000 7f16da600640 1 -- 172.21.15.64:0/3531664567 wait complete. 2024-09-21T07:25:39.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 -- 172.21.15.64:0/766166993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c004010 msgr2=0x7f804c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 --2- 172.21.15.64:0/766166993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f804c004010 0x7f804c004810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f805000c3c0 tx=0x7f805001cec0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806a400640 1 -- 172.21.15.64:0/766166993 reap_dead start 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 -- 172.21.15.64:0/766166993 shutdown_connections 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 -- 172.21.15.64:0/766166993 >> 172.21.15.64:0/766166993 conn(0x7f80640ccbe0 msgr2=0x7f80640ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 -- 172.21.15.64:0/766166993 shutdown_connections 2024-09-21T07:25:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.473+0000 7f806c400640 1 -- 172.21.15.64:0/766166993 wait complete. 2024-09-21T07:25:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 Processor -- start 2024-09-21T07:25:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 -- start start 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f804c004010 0x7f806409c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80641e4700 0x7f80641e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80640b1dd0 con 0x7f80641f5230 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80640b1c50 con 0x7f804c004010 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f806c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f80640b1f50 con 0x7f80641e4700 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f8069000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f8069000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53060/0 (socket says 172.21.15.64:53060) 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.477+0000 7f8069000640 1 -- 172.21.15.64:0/3866580540 learned_addr learned my addr 172.21.15.64:0/3866580540 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069a00640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f804c004010 0x7f806409c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f806a400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80641e4700 0x7f80641e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 -- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80641e4700 msgr2=0x7f80641e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80641e4700 0x7f80641e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 -- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f804c004010 msgr2=0x7f806409c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f804c004010 0x7f806409c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 -- 172.21.15.64:0/3866580540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80641f5640 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8069000640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f805001b5c0 tx=0x7f8050006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050001890 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8050006420 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806409d630 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050003600 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806409bec0 con 0x7f80641f5230 2024-09-21T07:25:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806409d3a0 con 0x7f80641f5230 2024-09-21T07:25:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.481+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f80500c0060 con 0x7f80641f5230 2024-09-21T07:25:39.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.485+0000 7f8061600640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 0x7f8044075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:39.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.485+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5619+0+0 (secure 0 0 0) 0x7f805012e340 con 0x7f80641f5230 2024-09-21T07:25:39.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.485+0000 7f8069a00640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 0x7f8044075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:39.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.485+0000 7f8069a00640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 0x7f8044075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8058006fd0 tx=0x7f8058006660 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:39.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.489+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f80640ce150 con 0x7f80641f5230 2024-09-21T07:25:39.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:39.665+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f80640af9b0 con 0x7f80641f5230 2024-09-21T07:25:40.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.277+0000 7f8061600640 1 -- 172.21.15.64:0/3866580540 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) ==== 170+0+0 (secure 0 0 0) 0x7f80500f8cd0 con 0x7f80641f5230 2024-09-21T07:25:40.283 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:25:40.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 msgr2=0x7f8044075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:40.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 0x7f8044075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8058006fd0 tx=0x7f8058006660 comp rx=0 tx=0).stop 2024-09-21T07:25:40.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 msgr2=0x7f8064150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:40.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f805001b5c0 tx=0x7f8050006190 comp rx=0 tx=0).stop 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 shutdown_connections 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8044073200 0x7f8044075710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80641e4700 0x7f80641e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80641f5230 0x7f8064150330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 --2- 172.21.15.64:0/3866580540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f804c004010 0x7f806409c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 >> 172.21.15.64:0/3866580540 conn(0x7f80640ccbe0 msgr2=0x7f80640d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:40.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 shutdown_connections 2024-09-21T07:25:40.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.281+0000 7f806c400640 1 -- 172.21.15.64:0/3866580540 wait complete. 2024-09-21T07:25:40.329 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:25:40.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- 172.21.15.64:0/3173497386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 msgr2=0x7fc7280aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:40.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 --2- 172.21.15.64:0/3173497386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc7280aefe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc720009bc0 tx=0x7fc72001caf0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- 172.21.15.64:0/3173497386 shutdown_connections 2024-09-21T07:25:40.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 --2- 172.21.15.64:0/3173497386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc7280aefe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- 172.21.15.64:0/3173497386 >> 172.21.15.64:0/3173497386 conn(0x7fc72806d450 msgr2=0x7fc7280d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:40.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- 172.21.15.64:0/3173497386 shutdown_connections 2024-09-21T07:25:40.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- 172.21.15.64:0/3173497386 wait complete. 2024-09-21T07:25:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 Processor -- start 2024-09-21T07:25:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.489+0000 7fc72d800640 1 -- start start 2024-09-21T07:25:40.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc728155560 0x7fc72815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc72815eb80 0x7fc72815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc728169920 con 0x7fc7280cf5a0 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281697a0 con 0x7fc728155560 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc728169aa0 con 0x7fc72815eb80 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53076/0 (socket says 172.21.15.64:53076) 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 -- 172.21.15.64:0/1120916008 learned_addr learned my addr 172.21.15.64:0/1120916008 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc727400640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc72815eb80 0x7fc72815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc71fe00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc728155560 0x7fc72815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 -- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc72815eb80 msgr2=0x7fc72815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc72815eb80 0x7fc72815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 -- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc728155560 msgr2=0x7fc72815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc728155560 0x7fc72815dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 -- 172.21.15.64:0/1120916008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7280b2b90 con 0x7fc7280cf5a0 2024-09-21T07:25:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc726a00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c390 tx=0x7fc718001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718017070 con 0x7fc7280cf5a0 2024-09-21T07:25:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc718003600 con 0x7fc7280cf5a0 2024-09-21T07:25:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7280c53b0 con 0x7fc7280cf5a0 2024-09-21T07:25:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718003ad0 con 0x7fc7280cf5a0 2024-09-21T07:25:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7280c5970 con 0x7fc7280cf5a0 2024-09-21T07:25:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.493+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7280aefe0 con 0x7fc7280cf5a0 2024-09-21T07:25:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.497+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc71801a070 con 0x7fc7280cf5a0 2024-09-21T07:25:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.497+0000 7fc71ea00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 0x7fc704075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.497+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6001+0+0 (secure 0 0 0) 0x7fc7180939b0 con 0x7fc7280cf5a0 2024-09-21T07:25:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.497+0000 7fc71fe00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 0x7fc704075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.497+0000 7fc71fe00640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 0x7fc704075740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc72815c070 tx=0x7fc710009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:40.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.501+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc718021020 con 0x7fc7280cf5a0 2024-09-21T07:25:40.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:40.717+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc7280704c0 con 0x7fc7280cf5a0 2024-09-21T07:25:41.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc71ea00640 1 -- 172.21.15.64:0/1120916008 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) ==== 172+0+0 (secure 0 0 0) 0x7fc71805e910 con 0x7fc7280cf5a0 2024-09-21T07:25:41.286 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 7 and data pool 8 2024-09-21T07:25:41.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 msgr2=0x7fc704075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 0x7fc704075740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc72815c070 tx=0x7fc710009040 comp rx=0 tx=0).stop 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 msgr2=0x7fc728074510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c390 tx=0x7fc718001e80 comp rx=0 tx=0).stop 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 shutdown_connections 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc704073230 0x7fc704075740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc72815eb80 0x7fc72815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc728155560 0x7fc72815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.281+0000 7fc72d800640 1 --2- 172.21.15.64:0/1120916008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7280cf5a0 0x7fc728074510 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.285+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 >> 172.21.15.64:0/1120916008 conn(0x7fc72806d450 msgr2=0x7fc728068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:41.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.285+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 shutdown_connections 2024-09-21T07:25:41.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.285+0000 7fc72d800640 1 -- 172.21.15.64:0/1120916008 wait complete. 2024-09-21T07:25:41.347 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 -- 172.21.15.64:0/3114696168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040b3d60 msgr2=0x7f69040b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 --2- 172.21.15.64:0/3114696168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040b3d60 0x7f69040b4170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f69040d2290 tx=0x7f68ec01c740 comp rx=0 tx=0).stop 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 -- 172.21.15.64:0/3114696168 shutdown_connections 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 --2- 172.21.15.64:0/3114696168 >> v2:172.21.15.90:3300/0 conn(0x7f69040c5ea0 0x7f69040c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 --2- 172.21.15.64:0/3114696168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040b3d60 0x7f69040b4170 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 -- 172.21.15.64:0/3114696168 >> 172.21.15.64:0/3114696168 conn(0x7f690406d1c0 msgr2=0x7f690406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 -- 172.21.15.64:0/3114696168 shutdown_connections 2024-09-21T07:25:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.501+0000 7f6909000640 1 -- 172.21.15.64:0/3114696168 wait complete. 2024-09-21T07:25:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 Processor -- start 2024-09-21T07:25:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 -- start start 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69040b3d60 0x7f690414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69040d1d00 0x7f69041503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6904169e10 con 0x7f69040c5ea0 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6904169c90 con 0x7f69040b3d60 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.505+0000 7f6909000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6904169f90 con 0x7f69040d1d00 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53084/0 (socket says 172.21.15.64:53084) 2024-09-21T07:25:41.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 -- 172.21.15.64:0/2025485315 learned_addr learned my addr 172.21.15.64:0/2025485315 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:41.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f6901e00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69040b3d60 0x7f690414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f6902800640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69040d1d00 0x7f69041503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 -- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69040d1d00 msgr2=0x7f69041503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69040d1d00 0x7f69041503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 -- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69040b3d60 msgr2=0x7f690414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69040b3d60 0x7f690414d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 -- 172.21.15.64:0/2025485315 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690414db40 con 0x7f69040c5ea0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fbe00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f68ec098320 tx=0x7f68ec005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0b2040 con 0x7f69040c5ea0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68ec0bb070 con 0x7f69040c5ea0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6904159d00 con 0x7f69040c5ea0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec003600 con 0x7f69040c5ea0 2024-09-21T07:25:41.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6904159220 con 0x7f69040c5ea0 2024-09-21T07:25:41.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.509+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69040b4170 con 0x7f69040c5ea0 2024-09-21T07:25:41.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.513+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f68ec0037a0 con 0x7f69040c5ea0 2024-09-21T07:25:41.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.513+0000 7f68fa000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 0x7f68e0075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.513+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f68ec12eb20 con 0x7f69040c5ea0 2024-09-21T07:25:41.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.513+0000 7f6901e00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 0x7f68e0075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.513+0000 7f6901e00640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 0x7f68e0075770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007d70 tx=0x7f68f4007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:41.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.517+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f68ec0163f0 con 0x7f69040c5ea0 2024-09-21T07:25:41.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.693+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f690406fbe0 con 0x7f69040c5ea0 2024-09-21T07:25:41.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.693+0000 7f68fa000640 1 -- 172.21.15.64:0/2025485315 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16967 (secure 0 0 0) 0x7f68ec0f93d0 con 0x7f69040c5ea0 2024-09-21T07:25:41.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":55,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:40.723772+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:25:38.477150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-21T07:25:39.678833+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:41.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 msgr2=0x7f68e0075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 0x7f68e0075770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007d70 tx=0x7f68f4007d00 comp rx=0 tx=0).stop 2024-09-21T07:25:41.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 msgr2=0x7f690406f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f68ec098320 tx=0x7f68ec005ca0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 shutdown_connections 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68e0073260 0x7f68e0075770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69040d1d00 0x7f69041503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69040c5ea0 0x7f690406f200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 --2- 172.21.15.64:0/2025485315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69040b3d60 0x7f690414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 >> 172.21.15.64:0/2025485315 conn(0x7f690406d1c0 msgr2=0x7f69041527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 shutdown_connections 2024-09-21T07:25:41.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.697+0000 7f6909000640 1 -- 172.21.15.64:0/2025485315 wait complete. 2024-09-21T07:25:41.721 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 -- 172.21.15.64:0/3020453749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 msgr2=0x7f90a00700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 --2- 172.21.15.64:0/3020453749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00700b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9094009840 tx=0x7f909401c820 comp rx=0 tx=0).stop 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 -- 172.21.15.64:0/3020453749 shutdown_connections 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 --2- 172.21.15.64:0/3020453749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00b48d0 0x7f90a0072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 --2- 172.21.15.64:0/3020453749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00700b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 -- 172.21.15.64:0/3020453749 >> 172.21.15.64:0/3020453749 conn(0x7f90a00ccbe0 msgr2=0x7f90a00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:41.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 -- 172.21.15.64:0/3020453749 shutdown_connections 2024-09-21T07:25:41.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.873+0000 7f90a8600640 1 -- 172.21.15.64:0/3020453749 wait complete. 2024-09-21T07:25:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 Processor -- start 2024-09-21T07:25:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 -- start start 2024-09-21T07:25:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00709b0 0x7f90a00ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90a009a9f0 0x7f90a01fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90a0168bb0 con 0x7f90a015edb0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90a0168a30 con 0x7f90a009a9f0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a8600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f90a0168d30 con 0x7f90a00709b0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53112/0 (socket says 172.21.15.64:53112) 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 -- 172.21.15.64:0/3601610067 learned_addr learned my addr 172.21.15.64:0/3601610067 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5c00640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00709b0 0x7f90a00ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a6600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90a009a9f0 0x7f90a01fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 -- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00709b0 msgr2=0x7f90a00ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00709b0 0x7f90a00ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 -- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90a009a9f0 msgr2=0x7f90a01fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:41.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90a009a9f0 0x7f90a01fbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:41.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 -- 172.21.15.64:0/3601610067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a00b3150 con 0x7f90a015edb0 2024-09-21T07:25:41.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.877+0000 7f90a5200640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f908c001ec0 tx=0x7f908c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c017070 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f908c003600 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a0157570 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c003a50 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a0157b30 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a0072e20 con 0x7f90a015edb0 2024-09-21T07:25:41.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f908c01a070 con 0x7f90a015edb0 2024-09-21T07:25:41.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 0x7f9080075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:41.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f908c093b20 con 0x7f90a015edb0 2024-09-21T07:25:41.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.881+0000 7f90a5c00640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 0x7f9080075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:41.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.885+0000 7f90a5c00640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 0x7f9080075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f909401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:41.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:41.885+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f908c021020 con 0x7f90a015edb0 2024-09-21T07:25:42.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.065+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90a009da20 con 0x7f90a015edb0 2024-09-21T07:25:42.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.065+0000 7f909d600640 1 -- 172.21.15.64:0/3601610067 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16967 (secure 0 0 0) 0x7f908c05ea20 con 0x7f90a015edb0 2024-09-21T07:25:42.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:42.070 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":55,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:40.723772+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:25:38.477150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-21T07:25:39.678833+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 msgr2=0x7f9080075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 0x7f9080075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f909401b060 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 msgr2=0x7f90a00c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f908c001ec0 tx=0x7f908c00c890 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 shutdown_connections 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9080073200 0x7f9080075710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90a009a9f0 0x7f90a01fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90a015edb0 0x7f90a00c6610 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 --2- 172.21.15.64:0/3601610067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90a00709b0 0x7f90a00ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 >> 172.21.15.64:0/3601610067 conn(0x7f90a00ccbe0 msgr2=0x7f90a0156710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 shutdown_connections 2024-09-21T07:25:42.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.069+0000 7f90a8600640 1 -- 172.21.15.64:0/3601610067 wait complete. 2024-09-21T07:25:42.093 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- 172.21.15.64:0/973564512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 msgr2=0x7fd8b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 --2- 172.21.15.64:0/973564512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8b0004c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009b40 tx=0x7fd8b401d270 comp rx=0 tx=0).stop 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8cb400640 1 -- 172.21.15.64:0/973564512 reap_dead start 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- 172.21.15.64:0/973564512 shutdown_connections 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- 172.21.15.64:0/973564512 >> 172.21.15.64:0/973564512 conn(0x7fd8cc06d450 msgr2=0x7fd8cc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- 172.21.15.64:0/973564512 shutdown_connections 2024-09-21T07:25:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- 172.21.15.64:0/973564512 wait complete. 2024-09-21T07:25:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 Processor -- start 2024-09-21T07:25:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.253+0000 7fd8d1800640 1 -- start start 2024-09-21T07:25:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8cc1477b0 0x7fd8cc0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8cc0cbd70 0x7fd8cc0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc168380 con 0x7fd8b0004810 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc168200 con 0x7fd8cc0cbd70 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc168500 con 0x7fd8cc1477b0 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53126/0 (socket says 172.21.15.64:53126) 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 -- 172.21.15.64:0/1026868793 learned_addr learned my addr 172.21.15.64:0/1026868793 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8cb400640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8cc0cbd70 0x7fd8cc0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8c3e00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8cc1477b0 0x7fd8cc0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 -- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8cc1477b0 msgr2=0x7fd8cc0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8cc1477b0 0x7fd8cc0cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 -- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8cc0cbd70 msgr2=0x7fd8cc0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8cc0cbd70 0x7fd8cc0cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 -- 172.21.15.64:0/1026868793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc072d10 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8caa00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc003e70 tx=0x7fd8bc001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc011700 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8bc016020 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc011b80 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc1f78b0 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc0caa50 con 0x7fd8b0004810 2024-09-21T07:25:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8cc0aefe0 con 0x7fd8b0004810 2024-09-21T07:25:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.257+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd8bc0103c0 con 0x7fd8b0004810 2024-09-21T07:25:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.261+0000 7fd8c2a00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 0x7fd8a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.261+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fd8bc094d80 con 0x7fd8b0004810 2024-09-21T07:25:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.261+0000 7fd8c3e00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 0x7fd8a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.261+0000 7fd8c3e00640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 0x7fd8a8075740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40ad000 tx=0x7fd8b401a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.265+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd8bc020030 con 0x7fd8b0004810 2024-09-21T07:25:42.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:42.481+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd8cc0704c0 con 0x7fd8b0004810 2024-09-21T07:25:43.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8c2a00640 1 -- 172.21.15.64:0/1026868793 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fd8bc05fc00 con 0x7fd8b0004810 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 msgr2=0x7fd8a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 0x7fd8a8075740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40ad000 tx=0x7fd8b401a010 comp rx=0 tx=0).stop 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 msgr2=0x7fd8cc1f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc003e70 tx=0x7fd8bc001800 comp rx=0 tx=0).stop 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 shutdown_connections 2024-09-21T07:25:43.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd8a8073230 0x7fd8a8075740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8cc0cbd70 0x7fd8cc0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8cc1477b0 0x7fd8cc0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 --2- 172.21.15.64:0/1026868793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8b0004810 0x7fd8cc1f6ed0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 >> 172.21.15.64:0/1026868793 conn(0x7fd8cc06d450 msgr2=0x7fd8cc167130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 shutdown_connections 2024-09-21T07:25:43.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.313+0000 7fd8d1800640 1 -- 172.21.15.64:0/1026868793 wait complete. 2024-09-21T07:25:43.344 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:25:43.345 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 -- 172.21.15.64:0/1621106253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f973406ff90 msgr2=0x7f9734073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 --2- 172.21.15.64:0/1621106253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f973406ff90 0x7f9734073f30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f97340b4420 tx=0x7f972401c810 comp rx=0 tx=0).stop 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 -- 172.21.15.64:0/1621106253 shutdown_connections 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 --2- 172.21.15.64:0/1621106253 >> v2:172.21.15.90:3300/0 conn(0x7f97340cf6d0 0x7f973415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 --2- 172.21.15.64:0/1621106253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 0x7f97340cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 --2- 172.21.15.64:0/1621106253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f973406ff90 0x7f9734073f30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 -- 172.21.15.64:0/1621106253 >> 172.21.15.64:0/1621106253 conn(0x7f97340cdd10 msgr2=0x7f97340ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 -- 172.21.15.64:0/1621106253 shutdown_connections 2024-09-21T07:25:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.505+0000 7f9738e00640 1 -- 172.21.15.64:0/1621106253 wait complete. 2024-09-21T07:25:43.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 Processor -- start 2024-09-21T07:25:43.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 -- start start 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973406ff90 0x7f973415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 0x7f97341f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f973415fc20 con 0x7f97340cf6d0 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f973415faa0 con 0x7f973406ff90 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9738e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f973415fda0 con 0x7f97340b59e0 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9732800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9732800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53134/0 (socket says 172.21.15.64:53134) 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.509+0000 7f9732800640 1 -- 172.21.15.64:0/1738644433 learned_addr learned my addr 172.21.15.64:0/1738644433 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9731e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973406ff90 0x7f973415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:43.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9729400640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 0x7f97341f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:43.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 -- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 msgr2=0x7f97341f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:43.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 0x7f97341f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 -- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973406ff90 msgr2=0x7f973415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973406ff90 0x7f973415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 -- 172.21.15.64:0/1738644433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973415d680 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9732800640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f972c00ea80 tx=0x7f972c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c00cea0 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f972c004b30 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c005020 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973415d960 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973415df20 con 0x7f97340cf6d0 2024-09-21T07:25:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97340cf190 con 0x7f97340cf6d0 2024-09-21T07:25:43.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.513+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f972c0051c0 con 0x7f97340cf6d0 2024-09-21T07:25:43.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.517+0000 7f972aa00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 0x7f9710075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:43.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.517+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f972c094e90 con 0x7f97340cf6d0 2024-09-21T07:25:43.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.517+0000 7f9731e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 0x7f9710075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:43.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.517+0000 7f9731e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 0x7f9710075710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97240af000 tx=0x7f972401b050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:43.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.521+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f972c05f6c0 con 0x7f97340cf6d0 2024-09-21T07:25:43.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:43.733+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f97340b60c0 con 0x7f97340cf6d0 2024-09-21T07:25:44.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.313+0000 7f972aa00640 1 -- 172.21.15.64:0/1738644433 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f972c0960c0 con 0x7f97340cf6d0 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 msgr2=0x7f9710075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 0x7f9710075710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97240af000 tx=0x7f972401b050 comp rx=0 tx=0).stop 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 msgr2=0x7f97340b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f972c00ea80 tx=0x7f972c00ef40 comp rx=0 tx=0).stop 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 shutdown_connections 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9710073200 0x7f9710075710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97340cf6d0 0x7f97340b19b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97340b59e0 0x7f97341f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 --2- 172.21.15.64:0/1738644433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973406ff90 0x7f973415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 >> 172.21.15.64:0/1738644433 conn(0x7f97340cdd10 msgr2=0x7f9734154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:44.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 shutdown_connections 2024-09-21T07:25:44.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.317+0000 7f9738e00640 1 -- 172.21.15.64:0/1738644433 wait complete. 2024-09-21T07:25:44.344 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:25:44.344 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:44.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- 172.21.15.64:0/144559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff4815f040 msgr2=0x7eff4815f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 --2- 172.21.15.64:0/144559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff4815f040 0x7eff4815f450 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff40009c80 tx=0x7eff4001cc80 comp rx=0 tx=0).stop 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- 172.21.15.64:0/144559901 shutdown_connections 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 --2- 172.21.15.64:0/144559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff4815f040 0x7eff4815f450 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 --2- 172.21.15.64:0/144559901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ca550 0x7eff4815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- 172.21.15.64:0/144559901 >> 172.21.15.64:0/144559901 conn(0x7eff480cd3a0 msgr2=0x7eff480cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- 172.21.15.64:0/144559901 shutdown_connections 2024-09-21T07:25:44.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- 172.21.15.64:0/144559901 wait complete. 2024-09-21T07:25:44.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 Processor -- start 2024-09-21T07:25:44.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.501+0000 7eff47e00640 1 -- start start 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ce8c0 0x7eff481541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4815f040 0x7eff480cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff48168dc0 con 0x7eff480ca550 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff480cf600 con 0x7eff4815f040 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7eff48168f40 con 0x7eff480ce8c0 2024-09-21T07:25:44.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53146/0 (socket says 172.21.15.64:53146) 2024-09-21T07:25:44.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 -- 172.21.15.64:0/3076292858 learned_addr learned my addr 172.21.15.64:0/3076292858 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:44.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47400640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4815f040 0x7eff480cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff3fe00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ce8c0 0x7eff481541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 -- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ce8c0 msgr2=0x7eff481541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ce8c0 0x7eff481541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 -- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4815f040 msgr2=0x7eff480cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4815f040 0x7eff480cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 -- 172.21.15.64:0/3076292858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff481546e0 con 0x7eff480ca550 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff46a00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d980 tx=0x7eff3800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38017070 con 0x7eff480ca550 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff38009d20 con 0x7eff480ca550 2024-09-21T07:25:44.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff480b0d90 con 0x7eff480ca550 2024-09-21T07:25:44.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38004280 con 0x7eff480ca550 2024-09-21T07:25:44.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff480b1350 con 0x7eff480ca550 2024-09-21T07:25:44.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.505+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4815b540 con 0x7eff480ca550 2024-09-21T07:25:44.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.509+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7eff38005020 con 0x7eff480ca550 2024-09-21T07:25:44.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.509+0000 7eff3ea00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 0x7eff24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.509+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7eff38094450 con 0x7eff480ca550 2024-09-21T07:25:44.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.509+0000 7eff3fe00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 0x7eff24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.509+0000 7eff3fe00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 0x7eff24075710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff480b2950 tx=0x7eff30009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:44.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.513+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7eff38020030 con 0x7eff480ca550 2024-09-21T07:25:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.725+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff480b5e80 con 0x7eff480ca550 2024-09-21T07:25:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.725+0000 7eff3ea00640 1 -- 172.21.15.64:0/3076292858 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7eff481546e0 con 0x7eff480ca550 2024-09-21T07:25:44.731 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:44.732 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"btime":"2024-09-21T07:25:44:316261+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:25:43.738974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:25:44.732 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 26 2024-09-21T07:25:44.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 msgr2=0x7eff24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 0x7eff24075710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff480b2950 tx=0x7eff30009040 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 msgr2=0x7eff4815e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d980 tx=0x7eff3800de40 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 shutdown_connections 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7eff24073200 0x7eff24075710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4815f040 0x7eff480cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff480ce8c0 0x7eff481541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 --2- 172.21.15.64:0/3076292858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff480ca550 0x7eff4815e540 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 >> 172.21.15.64:0/3076292858 conn(0x7eff480cd3a0 msgr2=0x7eff480cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 shutdown_connections 2024-09-21T07:25:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.729+0000 7eff47e00640 1 -- 172.21.15.64:0/3076292858 wait complete. 2024-09-21T07:25:44.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 -- 172.21.15.64:0/68230569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb3415fca0 msgr2=0x7feb340705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 --2- 172.21.15.64:0/68230569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb3415fca0 0x7feb340705b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feb28009840 tx=0x7feb2801c760 comp rx=0 tx=0).stop 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 -- 172.21.15.64:0/68230569 shutdown_connections 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 --2- 172.21.15.64:0/68230569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb34164200 0x7feb34166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 --2- 172.21.15.64:0/68230569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb3415fca0 0x7feb340705b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 -- 172.21.15.64:0/68230569 >> 172.21.15.64:0/68230569 conn(0x7feb340b2ca0 msgr2=0x7feb340b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 -- 172.21.15.64:0/68230569 shutdown_connections 2024-09-21T07:25:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.905+0000 7feb3c000640 1 -- 172.21.15.64:0/68230569 wait complete. 2024-09-21T07:25:44.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 Processor -- start 2024-09-21T07:25:44.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 -- start start 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb340cba10 0x7feb34158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb3415fca0 0x7feb340b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb34169a10 con 0x7feb34164200 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb34169890 con 0x7feb340cba10 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feb34169b90 con 0x7feb3415fca0 2024-09-21T07:25:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53168/0 (socket says 172.21.15.64:53168) 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.909+0000 7feb3a000640 1 -- 172.21.15.64:0/3760273493 learned_addr learned my addr 172.21.15.64:0/3760273493 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb39600640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb340cba10 0x7feb34158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb38c00640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb3415fca0 0x7feb340b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 -- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb3415fca0 msgr2=0x7feb340b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb3415fca0 0x7feb340b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 -- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb340cba10 msgr2=0x7feb34158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb340cba10 0x7feb34158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 -- 172.21.15.64:0/3760273493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb34154b80 con 0x7feb34164200 2024-09-21T07:25:44.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3a000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009fd0 tx=0x7feb2c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00cdc0 con 0x7feb34164200 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb2c004b30 con 0x7feb34164200 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c005020 con 0x7feb34164200 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb340cabe0 con 0x7feb34164200 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb340ca2d0 con 0x7feb34164200 2024-09-21T07:25:44.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb340705b0 con 0x7feb34164200 2024-09-21T07:25:44.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feb2c0051c0 con 0x7feb34164200 2024-09-21T07:25:44.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.913+0000 7feb31600640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 0x7feb14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:44.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.917+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7feb2c094ff0 con 0x7feb34164200 2024-09-21T07:25:44.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.917+0000 7feb39600640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 0x7feb14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:44.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.917+0000 7feb39600640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 0x7feb14075710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb280af000 tx=0x7feb2801afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:44.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:44.921+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7feb2c05fef0 con 0x7feb34164200 2024-09-21T07:25:45.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.097+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb3406fd40 con 0x7feb34164200 2024-09-21T07:25:45.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.097+0000 7feb31600640 1 -- 172.21.15.64:0/3760273493 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16954 (secure 0 0 0) 0x7feb2c05f7f0 con 0x7feb34164200 2024-09-21T07:25:45.104 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:45.104 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":56,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:42.285032+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:25:38.477150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-21T07:25:39.678833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 msgr2=0x7feb14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 0x7feb14075710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb280af000 tx=0x7feb2801afa0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 msgr2=0x7feb340b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009fd0 tx=0x7feb2c00ef10 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 shutdown_connections 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb14073200 0x7feb14075710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34164200 0x7feb340b4720 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb3415fca0 0x7feb340b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 --2- 172.21.15.64:0/3760273493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb340cba10 0x7feb34158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 >> 172.21.15.64:0/3760273493 conn(0x7feb340b2ca0 msgr2=0x7feb3415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:45.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 shutdown_connections 2024-09-21T07:25:45.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.101+0000 7feb3c000640 1 -- 172.21.15.64:0/3760273493 wait complete. 2024-09-21T07:25:45.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:25:45.127 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:25:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- 172.21.15.64:0/202291309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f146815edb0 msgr2=0x7f14680700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 --2- 172.21.15.64:0/202291309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f146815edb0 0x7f14680700b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1458009900 tx=0x7f145801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- 172.21.15.64:0/202291309 shutdown_connections 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 --2- 172.21.15.64:0/202291309 >> v2:172.21.15.90:3300/0 conn(0x7f14680709b0 0x7f14680b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 --2- 172.21.15.64:0/202291309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f146815edb0 0x7f14680700b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- 172.21.15.64:0/202291309 >> 172.21.15.64:0/202291309 conn(0x7f14680ccbe0 msgr2=0x7f14680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- 172.21.15.64:0/202291309 shutdown_connections 2024-09-21T07:25:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- 172.21.15.64:0/202291309 wait complete. 2024-09-21T07:25:45.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 Processor -- start 2024-09-21T07:25:45.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.281+0000 7f146ec00640 1 -- start start 2024-09-21T07:25:45.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 0x7f146809c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f146815edb0 0x7f1468157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1468169060 con 0x7f14680b4700 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1468168ee0 con 0x7f146815edb0 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f14681691e0 con 0x7f14680709b0 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f1467e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 0x7f146809c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35778/0 (socket says 172.21.15.64:35778) 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 -- 172.21.15.64:0/2058566462 learned_addr learned my addr 172.21.15.64:0/2058566462 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146cc00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f146815edb0 0x7f1468157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 -- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 msgr2=0x7f146809c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 0x7f146809c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 -- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f146815edb0 msgr2=0x7f1468157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f146815edb0 0x7f1468157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 -- 172.21.15.64:0/2058566462 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146809cc40 con 0x7f14680b4700 2024-09-21T07:25:45.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f1467e00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 0x7f146809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:45.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f145fe00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f145000e740 tx=0x7f145000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145000ccc0 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f145000ce60 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1468156db0 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450004280 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14680cb100 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.285+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14680cab90 con 0x7f14680b4700 2024-09-21T07:25:45.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.289+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1450003600 con 0x7f14680b4700 2024-09-21T07:25:45.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.289+0000 7f1464c00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 0x7f1444075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.289+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f1450094c10 con 0x7f14680b4700 2024-09-21T07:25:45.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.289+0000 7f1467e00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 0x7f1444075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.289+0000 7f1467e00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 0x7f1444075710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14580af000 tx=0x7f145801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:45.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.293+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f145005f3c0 con 0x7f14680b4700 2024-09-21T07:25:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.469+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14680b41c0 con 0x7f1444073200 2024-09-21T07:25:45.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.473+0000 7f1464c00640 1 -- 172.21.15.64:0/2058566462 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251030 (secure 0 0 0) 0x7f14680b41c0 con 0x7f1444073200 2024-09-21T07:25:45.482 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:45.484 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 msgr2=0x7f1444075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 0x7f1444075710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14580af000 tx=0x7f145801b120 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 msgr2=0x7f1468156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f145000e740 tx=0x7f145000ec00 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 shutdown_connections 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1444073200 0x7f1444075710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f146815edb0 0x7f1468157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14680b4700 0x7f1468156870 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 --2- 172.21.15.64:0/2058566462 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14680709b0 0x7f146809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 >> 172.21.15.64:0/2058566462 conn(0x7f14680ccbe0 msgr2=0x7f1468072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:45.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 shutdown_connections 2024-09-21T07:25:45.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.477+0000 7f146ec00640 1 -- 172.21.15.64:0/2058566462 wait complete. 2024-09-21T07:25:45.504 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-21T07:25:45.464932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":128,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289064,"kb_used_data":6256,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685656,"statfs":{"total":773094113280,"available":772798111744,"internally_reserved":0,"allocated":6406144,"data_stored":3499600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":289394227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001744"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329360+0000","last_change":"2024-09-21T07:25:41.321256+0000","last_active":"2024-09-21T07:25:41.329360+0000","last_peered":"2024-09-21T07:25:41.329360+0000","last_clean":"2024-09-21T07:25:41.329360+0000","last_became_active":"2024-09-21T07:25:41.320849+0000","last_became_peered":"2024-09-21T07:25:41.320849+0000","last_unstale":"2024-09-21T07:25:41.329360+0000","last_undegraded":"2024-09-21T07:25:41.329360+0000","last_fullsized":"2024-09-21T07:25:41.329360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:00.666556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317664+0000","last_change":"2024-09-21T07:25:41.308998+0000","last_active":"2024-09-21T07:25:41.317664+0000","last_peered":"2024-09-21T07:25:41.317664+0000","last_clean":"2024-09-21T07:25:41.317664+0000","last_became_active":"2024-09-21T07:25:41.304931+0000","last_became_peered":"2024-09-21T07:25:41.304931+0000","last_unstale":"2024-09-21T07:25:41.317664+0000","last_undegraded":"2024-09-21T07:25:41.317664+0000","last_fullsized":"2024-09-21T07:25:41.317664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:11.226663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290754+0000","last_change":"2024-09-21T07:25:41.332498+0000","last_active":"2024-09-21T07:25:42.290754+0000","last_peered":"2024-09-21T07:25:42.290754+0000","last_clean":"2024-09-21T07:25:42.290754+0000","last_became_active":"2024-09-21T07:25:41.332144+0000","last_became_peered":"2024-09-21T07:25:41.332144+0000","last_unstale":"2024-09-21T07:25:42.290754+0000","last_undegraded":"2024-09-21T07:25:42.290754+0000","last_fullsized":"2024-09-21T07:25:42.290754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:53.495422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317350+0000","last_change":"2024-09-21T07:25:41.311763+0000","last_active":"2024-09-21T07:25:41.317350+0000","last_peered":"2024-09-21T07:25:41.317350+0000","last_clean":"2024-09-21T07:25:41.317350+0000","last_became_active":"2024-09-21T07:25:41.311364+0000","last_became_peered":"2024-09-21T07:25:41.311364+0000","last_unstale":"2024-09-21T07:25:41.317350+0000","last_undegraded":"2024-09-21T07:25:41.317350+0000","last_fullsized":"2024-09-21T07:25:41.317350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:54.558607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290340+0000","last_change":"2024-09-21T07:25:41.320818+0000","last_active":"2024-09-21T07:25:42.290340+0000","last_peered":"2024-09-21T07:25:42.290340+0000","last_clean":"2024-09-21T07:25:42.290340+0000","last_became_active":"2024-09-21T07:25:41.320501+0000","last_became_peered":"2024-09-21T07:25:41.320501+0000","last_unstale":"2024-09-21T07:25:42.290340+0000","last_undegraded":"2024-09-21T07:25:42.290340+0000","last_fullsized":"2024-09-21T07:25:42.290340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328607+0000","last_change":"2024-09-21T07:25:41.313826+0000","last_active":"2024-09-21T07:25:41.328607+0000","last_peered":"2024-09-21T07:25:41.328607+0000","last_clean":"2024-09-21T07:25:41.328607+0000","last_became_active":"2024-09-21T07:25:41.313523+0000","last_became_peered":"2024-09-21T07:25:41.313523+0000","last_unstale":"2024-09-21T07:25:41.328607+0000","last_undegraded":"2024-09-21T07:25:41.328607+0000","last_fullsized":"2024-09-21T07:25:41.328607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:00.288283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289414+0000","last_change":"2024-09-21T07:25:41.323024+0000","last_active":"2024-09-21T07:25:42.289414+0000","last_peered":"2024-09-21T07:25:42.289414+0000","last_clean":"2024-09-21T07:25:42.289414+0000","last_became_active":"2024-09-21T07:25:41.321726+0000","last_became_peered":"2024-09-21T07:25:41.321726+0000","last_unstale":"2024-09-21T07:25:42.289414+0000","last_undegraded":"2024-09-21T07:25:42.289414+0000","last_fullsized":"2024-09-21T07:25:42.289414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:58.224710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296701+0000","last_change":"2024-09-21T07:25:40.296701+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296701+0000","last_undegraded":"2024-09-21T07:25:40.296701+0000","last_fullsized":"2024-09-21T07:25:40.296701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296336+0000","last_change":"2024-09-21T07:25:40.296336+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296336+0000","last_undegraded":"2024-09-21T07:25:40.296336+0000","last_fullsized":"2024-09-21T07:25:40.296336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329438+0000","last_change":"2024-09-21T07:25:41.323561+0000","last_active":"2024-09-21T07:25:41.329438+0000","last_peered":"2024-09-21T07:25:41.329438+0000","last_clean":"2024-09-21T07:25:41.329438+0000","last_became_active":"2024-09-21T07:25:41.323254+0000","last_became_peered":"2024-09-21T07:25:41.323254+0000","last_unstale":"2024-09-21T07:25:41.329438+0000","last_undegraded":"2024-09-21T07:25:41.329438+0000","last_fullsized":"2024-09-21T07:25:41.329438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.562192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290637+0000","last_change":"2024-09-21T07:25:41.307219+0000","last_active":"2024-09-21T07:25:42.290637+0000","last_peered":"2024-09-21T07:25:42.290637+0000","last_clean":"2024-09-21T07:25:42.290637+0000","last_became_active":"2024-09-21T07:25:41.306872+0000","last_became_peered":"2024-09-21T07:25:41.306872+0000","last_unstale":"2024-09-21T07:25:42.290637+0000","last_undegraded":"2024-09-21T07:25:42.290637+0000","last_fullsized":"2024-09-21T07:25:42.290637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:04.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299360+0000","last_change":"2024-09-21T07:25:40.299360+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299360+0000","last_undegraded":"2024-09-21T07:25:40.299360+0000","last_fullsized":"2024-09-21T07:25:40.299360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328727+0000","last_change":"2024-09-21T07:25:41.321933+0000","last_active":"2024-09-21T07:25:41.328727+0000","last_peered":"2024-09-21T07:25:41.328727+0000","last_clean":"2024-09-21T07:25:41.328727+0000","last_became_active":"2024-09-21T07:25:41.321587+0000","last_became_peered":"2024-09-21T07:25:41.321587+0000","last_unstale":"2024-09-21T07:25:41.328727+0000","last_undegraded":"2024-09-21T07:25:41.328727+0000","last_fullsized":"2024-09-21T07:25:41.328727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:51.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289995+0000","last_change":"2024-09-21T07:25:41.331684+0000","last_active":"2024-09-21T07:25:42.289995+0000","last_peered":"2024-09-21T07:25:42.289995+0000","last_clean":"2024-09-21T07:25:42.289995+0000","last_became_active":"2024-09-21T07:25:41.331336+0000","last_became_peered":"2024-09-21T07:25:41.331336+0000","last_unstale":"2024-09-21T07:25:42.289995+0000","last_undegraded":"2024-09-21T07:25:42.289995+0000","last_fullsized":"2024-09-21T07:25:42.289995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.318009+0000","last_change":"2024-09-21T07:25:41.307391+0000","last_active":"2024-09-21T07:25:41.318009+0000","last_peered":"2024-09-21T07:25:41.318009+0000","last_clean":"2024-09-21T07:25:41.318009+0000","last_became_active":"2024-09-21T07:25:41.307053+0000","last_became_peered":"2024-09-21T07:25:41.307053+0000","last_unstale":"2024-09-21T07:25:41.318009+0000","last_undegraded":"2024-09-21T07:25:41.318009+0000","last_fullsized":"2024-09-21T07:25:41.318009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:43.295840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328963+0000","last_change":"2024-09-21T07:25:41.322745+0000","last_active":"2024-09-21T07:25:41.328963+0000","last_peered":"2024-09-21T07:25:41.328963+0000","last_clean":"2024-09-21T07:25:41.328963+0000","last_became_active":"2024-09-21T07:25:41.322403+0000","last_became_peered":"2024-09-21T07:25:41.322403+0000","last_unstale":"2024-09-21T07:25:41.328963+0000","last_undegraded":"2024-09-21T07:25:41.328963+0000","last_fullsized":"2024-09-21T07:25:41.328963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291554+0000","last_change":"2024-09-21T07:25:41.318017+0000","last_active":"2024-09-21T07:25:42.291554+0000","last_peered":"2024-09-21T07:25:42.291554+0000","last_clean":"2024-09-21T07:25:42.291554+0000","last_became_active":"2024-09-21T07:25:41.317536+0000","last_became_peered":"2024-09-21T07:25:41.317536+0000","last_unstale":"2024-09-21T07:25:42.291554+0000","last_undegraded":"2024-09-21T07:25:42.291554+0000","last_fullsized":"2024-09-21T07:25:42.291554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.914124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317633+0000","last_change":"2024-09-21T07:25:41.307572+0000","last_active":"2024-09-21T07:25:41.317633+0000","last_peered":"2024-09-21T07:25:41.317633+0000","last_clean":"2024-09-21T07:25:41.317633+0000","last_became_active":"2024-09-21T07:25:41.305007+0000","last_became_peered":"2024-09-21T07:25:41.305007+0000","last_unstale":"2024-09-21T07:25:41.317633+0000","last_undegraded":"2024-09-21T07:25:41.317633+0000","last_fullsized":"2024-09-21T07:25:41.317633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:09.870174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291167+0000","last_change":"2024-09-21T07:25:41.327304+0000","last_active":"2024-09-21T07:25:42.291167+0000","last_peered":"2024-09-21T07:25:42.291167+0000","last_clean":"2024-09-21T07:25:42.291167+0000","last_became_active":"2024-09-21T07:25:41.326612+0000","last_became_peered":"2024-09-21T07:25:41.326612+0000","last_unstale":"2024-09-21T07:25:42.291167+0000","last_undegraded":"2024-09-21T07:25:42.291167+0000","last_fullsized":"2024-09-21T07:25:42.291167+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:57.777429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324732+0000","last_change":"2024-09-21T07:25:41.320645+0000","last_active":"2024-09-21T07:25:41.324732+0000","last_peered":"2024-09-21T07:25:41.324732+0000","last_clean":"2024-09-21T07:25:41.324732+0000","last_became_active":"2024-09-21T07:25:41.320160+0000","last_became_peered":"2024-09-21T07:25:41.320160+0000","last_unstale":"2024-09-21T07:25:41.324732+0000","last_undegraded":"2024-09-21T07:25:41.324732+0000","last_fullsized":"2024-09-21T07:25:41.324732+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:19.056585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320639+0000","last_change":"2024-09-21T07:25:41.312932+0000","last_active":"2024-09-21T07:25:41.320639+0000","last_peered":"2024-09-21T07:25:41.320639+0000","last_clean":"2024-09-21T07:25:41.320639+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.320639+0000","last_undegraded":"2024-09-21T07:25:41.320639+0000","last_fullsized":"2024-09-21T07:25:41.320639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:36.305857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299892+0000","last_change":"2024-09-21T07:25:40.299892+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299892+0000","last_undegraded":"2024-09-21T07:25:40.299892+0000","last_fullsized":"2024-09-21T07:25:40.299892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290648+0000","last_change":"2024-09-21T07:25:41.313770+0000","last_active":"2024-09-21T07:25:42.290648+0000","last_peered":"2024-09-21T07:25:42.290648+0000","last_clean":"2024-09-21T07:25:42.290648+0000","last_became_active":"2024-09-21T07:25:41.313227+0000","last_became_peered":"2024-09-21T07:25:41.313227+0000","last_unstale":"2024-09-21T07:25:42.290648+0000","last_undegraded":"2024-09-21T07:25:42.290648+0000","last_fullsized":"2024-09-21T07:25:42.290648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:33.855213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289330+0000","last_change":"2024-09-21T07:25:41.309859+0000","last_active":"2024-09-21T07:25:42.289330+0000","last_peered":"2024-09-21T07:25:42.289330+0000","last_clean":"2024-09-21T07:25:42.289330+0000","last_became_active":"2024-09-21T07:25:41.309517+0000","last_became_peered":"2024-09-21T07:25:41.309517+0000","last_unstale":"2024-09-21T07:25:42.289330+0000","last_undegraded":"2024-09-21T07:25:42.289330+0000","last_fullsized":"2024-09-21T07:25:42.289330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291690+0000","last_change":"2024-09-21T07:25:41.336710+0000","last_active":"2024-09-21T07:25:42.291690+0000","last_peered":"2024-09-21T07:25:42.291690+0000","last_clean":"2024-09-21T07:25:42.291690+0000","last_became_active":"2024-09-21T07:25:41.335110+0000","last_became_peered":"2024-09-21T07:25:41.335110+0000","last_unstale":"2024-09-21T07:25:42.291690+0000","last_undegraded":"2024-09-21T07:25:42.291690+0000","last_fullsized":"2024-09-21T07:25:42.291690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:04.420434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.295949+0000","last_change":"2024-09-21T07:25:40.295949+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.295949+0000","last_undegraded":"2024-09-21T07:25:40.295949+0000","last_fullsized":"2024-09-21T07:25:40.295949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.326514+0000","last_change":"2024-09-21T07:25:41.318845+0000","last_active":"2024-09-21T07:25:41.326514+0000","last_peered":"2024-09-21T07:25:41.326514+0000","last_clean":"2024-09-21T07:25:41.326514+0000","last_became_active":"2024-09-21T07:25:41.318551+0000","last_became_peered":"2024-09-21T07:25:41.318551+0000","last_unstale":"2024-09-21T07:25:41.326514+0000","last_undegraded":"2024-09-21T07:25:41.326514+0000","last_fullsized":"2024-09-21T07:25:41.326514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:17.260581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333059+0000","last_change":"2024-09-21T07:25:41.329282+0000","last_active":"2024-09-21T07:25:41.333059+0000","last_peered":"2024-09-21T07:25:41.333059+0000","last_clean":"2024-09-21T07:25:41.333059+0000","last_became_active":"2024-09-21T07:25:41.328876+0000","last_became_peered":"2024-09-21T07:25:41.328876+0000","last_unstale":"2024-09-21T07:25:41.333059+0000","last_undegraded":"2024-09-21T07:25:41.333059+0000","last_fullsized":"2024-09-21T07:25:41.333059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:31.567156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290693+0000","last_change":"2024-09-21T07:25:41.321849+0000","last_active":"2024-09-21T07:25:42.290693+0000","last_peered":"2024-09-21T07:25:42.290693+0000","last_clean":"2024-09-21T07:25:42.290693+0000","last_became_active":"2024-09-21T07:25:41.321476+0000","last_became_peered":"2024-09-21T07:25:41.321476+0000","last_unstale":"2024-09-21T07:25:42.290693+0000","last_undegraded":"2024-09-21T07:25:42.290693+0000","last_fullsized":"2024-09-21T07:25:42.290693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:14.078446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317264+0000","last_change":"2024-09-21T07:25:41.312897+0000","last_active":"2024-09-21T07:25:41.317264+0000","last_peered":"2024-09-21T07:25:41.317264+0000","last_clean":"2024-09-21T07:25:41.317264+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.317264+0000","last_undegraded":"2024-09-21T07:25:41.317264+0000","last_fullsized":"2024-09-21T07:25:41.317264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:43.056026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289405+0000","last_change":"2024-09-21T07:25:41.311045+0000","last_active":"2024-09-21T07:25:42.289405+0000","last_peered":"2024-09-21T07:25:42.289405+0000","last_clean":"2024-09-21T07:25:42.289405+0000","last_became_active":"2024-09-21T07:25:41.310726+0000","last_became_peered":"2024-09-21T07:25:41.310726+0000","last_unstale":"2024-09-21T07:25:42.289405+0000","last_undegraded":"2024-09-21T07:25:42.289405+0000","last_fullsized":"2024-09-21T07:25:42.289405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.305218+0000","last_change":"2024-09-21T07:25:41.300265+0000","last_active":"2024-09-21T07:25:41.305218+0000","last_peered":"2024-09-21T07:25:41.305218+0000","last_clean":"2024-09-21T07:25:41.305218+0000","last_became_active":"2024-09-21T07:25:41.299766+0000","last_became_peered":"2024-09-21T07:25:41.299766+0000","last_unstale":"2024-09-21T07:25:41.305218+0000","last_undegraded":"2024-09-21T07:25:41.305218+0000","last_fullsized":"2024-09-21T07:25:41.305218+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.310719+0000","last_change":"2024-09-21T07:25:41.305860+0000","last_active":"2024-09-21T07:25:41.310719+0000","last_peered":"2024-09-21T07:25:41.310719+0000","last_clean":"2024-09-21T07:25:41.310719+0000","last_became_active":"2024-09-21T07:25:41.305479+0000","last_became_peered":"2024-09-21T07:25:41.305479+0000","last_unstale":"2024-09-21T07:25:41.310719+0000","last_undegraded":"2024-09-21T07:25:41.310719+0000","last_fullsized":"2024-09-21T07:25:41.310719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:55.851412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.327948+0000","last_change":"2024-09-21T07:25:40.300521+0000","last_active":"2024-09-21T07:25:41.327948+0000","last_peered":"2024-09-21T07:25:41.327948+0000","last_clean":"2024-09-21T07:25:41.327948+0000","last_became_active":"2024-09-21T07:25:40.300196+0000","last_became_peered":"2024-09-21T07:25:40.300196+0000","last_unstale":"2024-09-21T07:25:41.327948+0000","last_undegraded":"2024-09-21T07:25:41.327948+0000","last_fullsized":"2024-09-21T07:25:41.327948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:12.727958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304725+0000","last_change":"2024-09-21T07:25:41.300373+0000","last_active":"2024-09-21T07:25:41.304725+0000","last_peered":"2024-09-21T07:25:41.304725+0000","last_clean":"2024-09-21T07:25:41.304725+0000","last_became_active":"2024-09-21T07:25:41.299865+0000","last_became_peered":"2024-09-21T07:25:41.299865+0000","last_unstale":"2024-09-21T07:25:41.304725+0000","last_undegraded":"2024-09-21T07:25:41.304725+0000","last_fullsized":"2024-09-21T07:25:41.304725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:27.770804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.334237+0000","last_change":"2024-09-21T07:25:40.308163+0000","last_active":"2024-09-21T07:25:41.334237+0000","last_peered":"2024-09-21T07:25:41.334237+0000","last_clean":"2024-09-21T07:25:41.334237+0000","last_became_active":"2024-09-21T07:25:40.307798+0000","last_became_peered":"2024-09-21T07:25:40.307798+0000","last_unstale":"2024-09-21T07:25:41.334237+0000","last_undegraded":"2024-09-21T07:25:41.334237+0000","last_fullsized":"2024-09-21T07:25:41.334237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:12.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.319334+0000","last_change":"2024-09-21T07:25:41.307900+0000","last_active":"2024-09-21T07:25:41.319334+0000","last_peered":"2024-09-21T07:25:41.319334+0000","last_clean":"2024-09-21T07:25:41.319334+0000","last_became_active":"2024-09-21T07:25:41.307573+0000","last_became_peered":"2024-09-21T07:25:41.307573+0000","last_unstale":"2024-09-21T07:25:41.319334+0000","last_undegraded":"2024-09-21T07:25:41.319334+0000","last_fullsized":"2024-09-21T07:25:41.319334+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:12.547817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.331023+0000","last_change":"2024-09-21T07:25:40.310055+0000","last_active":"2024-09-21T07:25:41.331023+0000","last_peered":"2024-09-21T07:25:41.331023+0000","last_clean":"2024-09-21T07:25:41.331023+0000","last_became_active":"2024-09-21T07:25:40.309774+0000","last_became_peered":"2024-09-21T07:25:40.309774+0000","last_unstale":"2024-09-21T07:25:41.331023+0000","last_undegraded":"2024-09-21T07:25:41.331023+0000","last_fullsized":"2024-09-21T07:25:41.331023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:26.643644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291251+0000","last_change":"2024-09-21T07:25:40.291251+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291251+0000","last_undegraded":"2024-09-21T07:25:40.291251+0000","last_fullsized":"2024-09-21T07:25:40.291251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333281+0000","last_change":"2024-09-21T07:25:40.308143+0000","last_active":"2024-09-21T07:25:41.333281+0000","last_peered":"2024-09-21T07:25:41.333281+0000","last_clean":"2024-09-21T07:25:41.333281+0000","last_became_active":"2024-09-21T07:25:40.307813+0000","last_became_peered":"2024-09-21T07:25:40.307813+0000","last_unstale":"2024-09-21T07:25:41.333281+0000","last_undegraded":"2024-09-21T07:25:41.333281+0000","last_fullsized":"2024-09-21T07:25:41.333281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:48.036611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290628+0000","last_change":"2024-09-21T07:25:41.318110+0000","last_active":"2024-09-21T07:25:42.290628+0000","last_peered":"2024-09-21T07:25:42.290628+0000","last_clean":"2024-09-21T07:25:42.290628+0000","last_became_active":"2024-09-21T07:25:41.317724+0000","last_became_peered":"2024-09-21T07:25:41.317724+0000","last_unstale":"2024-09-21T07:25:42.290628+0000","last_undegraded":"2024-09-21T07:25:42.290628+0000","last_fullsized":"2024-09-21T07:25:42.290628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290816+0000","last_change":"2024-09-21T07:25:40.314377+0000","last_active":"2024-09-21T07:25:42.290816+0000","last_peered":"2024-09-21T07:25:42.290816+0000","last_clean":"2024-09-21T07:25:42.290816+0000","last_became_active":"2024-09-21T07:25:40.313997+0000","last_became_peered":"2024-09-21T07:25:40.313997+0000","last_unstale":"2024-09-21T07:25:42.290816+0000","last_undegraded":"2024-09-21T07:25:42.290816+0000","last_fullsized":"2024-09-21T07:25:42.290816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.566202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.330540+0000","last_change":"2024-09-21T07:25:41.327857+0000","last_active":"2024-09-21T07:25:41.330540+0000","last_peered":"2024-09-21T07:25:41.330540+0000","last_clean":"2024-09-21T07:25:41.330540+0000","last_became_active":"2024-09-21T07:25:41.327330+0000","last_became_peered":"2024-09-21T07:25:41.327330+0000","last_unstale":"2024-09-21T07:25:41.330540+0000","last_undegraded":"2024-09-21T07:25:41.330540+0000","last_fullsized":"2024-09-21T07:25:41.330540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:06.529185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290510+0000","last_change":"2024-09-21T07:25:40.300775+0000","last_active":"2024-09-21T07:25:42.290510+0000","last_peered":"2024-09-21T07:25:42.290510+0000","last_clean":"2024-09-21T07:25:42.290510+0000","last_became_active":"2024-09-21T07:25:40.300245+0000","last_became_peered":"2024-09-21T07:25:40.300245+0000","last_unstale":"2024-09-21T07:25:42.290510+0000","last_undegraded":"2024-09-21T07:25:42.290510+0000","last_fullsized":"2024-09-21T07:25:42.290510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291277+0000","last_change":"2024-09-21T07:25:40.291277+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291277+0000","last_undegraded":"2024-09-21T07:25:40.291277+0000","last_fullsized":"2024-09-21T07:25:40.291277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299023+0000","last_change":"2024-09-21T07:25:40.304077+0000","last_active":"2024-09-21T07:25:41.299023+0000","last_peered":"2024-09-21T07:25:41.299023+0000","last_clean":"2024-09-21T07:25:41.299023+0000","last_became_active":"2024-09-21T07:25:40.303202+0000","last_became_peered":"2024-09-21T07:25:40.303202+0000","last_unstale":"2024-09-21T07:25:41.299023+0000","last_undegraded":"2024-09-21T07:25:41.299023+0000","last_fullsized":"2024-09-21T07:25:41.299023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.778348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324540+0000","last_change":"2024-09-21T07:25:41.314683+0000","last_active":"2024-09-21T07:25:41.324540+0000","last_peered":"2024-09-21T07:25:41.324540+0000","last_clean":"2024-09-21T07:25:41.324540+0000","last_became_active":"2024-09-21T07:25:41.314189+0000","last_became_peered":"2024-09-21T07:25:41.314189+0000","last_unstale":"2024-09-21T07:25:41.324540+0000","last_undegraded":"2024-09-21T07:25:41.324540+0000","last_fullsized":"2024-09-21T07:25:41.324540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:40.181308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289294+0000","last_change":"2024-09-21T07:25:40.316177+0000","last_active":"2024-09-21T07:25:42.289294+0000","last_peered":"2024-09-21T07:25:42.289294+0000","last_clean":"2024-09-21T07:25:42.289294+0000","last_became_active":"2024-09-21T07:25:40.314401+0000","last_became_peered":"2024-09-21T07:25:40.314401+0000","last_unstale":"2024-09-21T07:25:42.289294+0000","last_undegraded":"2024-09-21T07:25:42.289294+0000","last_fullsized":"2024-09-21T07:25:42.289294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:30.563754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290724+0000","last_change":"2024-09-21T07:25:41.325783+0000","last_active":"2024-09-21T07:25:42.290724+0000","last_peered":"2024-09-21T07:25:42.290724+0000","last_clean":"2024-09-21T07:25:42.290724+0000","last_became_active":"2024-09-21T07:25:41.325386+0000","last_became_peered":"2024-09-21T07:25:41.325386+0000","last_unstale":"2024-09-21T07:25:42.290724+0000","last_undegraded":"2024-09-21T07:25:42.290724+0000","last_fullsized":"2024-09-21T07:25:42.290724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296655+0000","last_change":"2024-09-21T07:25:40.306950+0000","last_active":"2024-09-21T07:25:41.296655+0000","last_peered":"2024-09-21T07:25:41.296655+0000","last_clean":"2024-09-21T07:25:41.296655+0000","last_became_active":"2024-09-21T07:25:40.306701+0000","last_became_peered":"2024-09-21T07:25:40.306701+0000","last_unstale":"2024-09-21T07:25:41.296655+0000","last_undegraded":"2024-09-21T07:25:41.296655+0000","last_fullsized":"2024-09-21T07:25:41.296655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.144853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320737+0000","last_change":"2024-09-21T07:25:41.317786+0000","last_active":"2024-09-21T07:25:41.320737+0000","last_peered":"2024-09-21T07:25:41.320737+0000","last_clean":"2024-09-21T07:25:41.320737+0000","last_became_active":"2024-09-21T07:25:41.317476+0000","last_became_peered":"2024-09-21T07:25:41.317476+0000","last_unstale":"2024-09-21T07:25:41.320737+0000","last_undegraded":"2024-09-21T07:25:41.320737+0000","last_fullsized":"2024-09-21T07:25:41.320737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:10.644829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290547+0000","last_change":"2024-09-21T07:25:40.314159+0000","last_active":"2024-09-21T07:25:42.290547+0000","last_peered":"2024-09-21T07:25:42.290547+0000","last_clean":"2024-09-21T07:25:42.290547+0000","last_became_active":"2024-09-21T07:25:40.313757+0000","last_became_peered":"2024-09-21T07:25:40.313757+0000","last_unstale":"2024-09-21T07:25:42.290547+0000","last_undegraded":"2024-09-21T07:25:42.290547+0000","last_fullsized":"2024-09-21T07:25:42.290547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289951+0000","last_change":"2024-09-21T07:25:41.325786+0000","last_active":"2024-09-21T07:25:42.289951+0000","last_peered":"2024-09-21T07:25:42.289951+0000","last_clean":"2024-09-21T07:25:42.289951+0000","last_became_active":"2024-09-21T07:25:41.321038+0000","last_became_peered":"2024-09-21T07:25:41.321038+0000","last_unstale":"2024-09-21T07:25:42.289951+0000","last_undegraded":"2024-09-21T07:25:42.289951+0000","last_fullsized":"2024-09-21T07:25:42.289951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:37.991238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329854+0000","last_change":"2024-09-21T07:25:40.310416+0000","last_active":"2024-09-21T07:25:41.329854+0000","last_peered":"2024-09-21T07:25:41.329854+0000","last_clean":"2024-09-21T07:25:41.329854+0000","last_became_active":"2024-09-21T07:25:40.310117+0000","last_became_peered":"2024-09-21T07:25:40.310117+0000","last_unstale":"2024-09-21T07:25:41.329854+0000","last_undegraded":"2024-09-21T07:25:41.329854+0000","last_fullsized":"2024-09-21T07:25:41.329854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:26.889094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290666+0000","last_change":"2024-09-21T07:25:41.318224+0000","last_active":"2024-09-21T07:25:42.290666+0000","last_peered":"2024-09-21T07:25:42.290666+0000","last_clean":"2024-09-21T07:25:42.290666+0000","last_became_active":"2024-09-21T07:25:41.317846+0000","last_became_peered":"2024-09-21T07:25:41.317846+0000","last_unstale":"2024-09-21T07:25:42.290666+0000","last_undegraded":"2024-09-21T07:25:42.290666+0000","last_fullsized":"2024-09-21T07:25:42.290666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:39.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324365+0000","last_change":"2024-09-21T07:25:40.320385+0000","last_active":"2024-09-21T07:25:40.324365+0000","last_peered":"2024-09-21T07:25:40.324365+0000","last_clean":"2024-09-21T07:25:40.324365+0000","last_became_active":"2024-09-21T07:25:40.320042+0000","last_became_peered":"2024-09-21T07:25:40.320042+0000","last_unstale":"2024-09-21T07:25:40.324365+0000","last_undegraded":"2024-09-21T07:25:40.324365+0000","last_fullsized":"2024-09-21T07:25:40.324365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:06.020101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304847+0000","last_change":"2024-09-21T07:25:41.300184+0000","last_active":"2024-09-21T07:25:41.304847+0000","last_peered":"2024-09-21T07:25:41.304847+0000","last_clean":"2024-09-21T07:25:41.304847+0000","last_became_active":"2024-09-21T07:25:41.299829+0000","last_became_peered":"2024-09-21T07:25:41.299829+0000","last_unstale":"2024-09-21T07:25:41.304847+0000","last_undegraded":"2024-09-21T07:25:41.304847+0000","last_fullsized":"2024-09-21T07:25:41.304847+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:36.479157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290966+0000","last_change":"2024-09-21T07:25:40.302488+0000","last_active":"2024-09-21T07:25:42.290966+0000","last_peered":"2024-09-21T07:25:42.290966+0000","last_clean":"2024-09-21T07:25:42.290966+0000","last_became_active":"2024-09-21T07:25:40.302167+0000","last_became_peered":"2024-09-21T07:25:40.302167+0000","last_unstale":"2024-09-21T07:25:42.290966+0000","last_undegraded":"2024-09-21T07:25:42.290966+0000","last_fullsized":"2024-09-21T07:25:42.290966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:51.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291230+0000","last_change":"2024-09-21T07:25:41.327602+0000","last_active":"2024-09-21T07:25:42.291230+0000","last_peered":"2024-09-21T07:25:42.291230+0000","last_clean":"2024-09-21T07:25:42.291230+0000","last_became_active":"2024-09-21T07:25:41.327019+0000","last_became_peered":"2024-09-21T07:25:41.327019+0000","last_unstale":"2024-09-21T07:25:42.291230+0000","last_undegraded":"2024-09-21T07:25:42.291230+0000","last_fullsized":"2024-09-21T07:25:42.291230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:12.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299874+0000","last_change":"2024-09-21T07:25:40.317734+0000","last_active":"2024-09-21T07:25:41.299874+0000","last_peered":"2024-09-21T07:25:41.299874+0000","last_clean":"2024-09-21T07:25:41.299874+0000","last_became_active":"2024-09-21T07:25:40.317367+0000","last_became_peered":"2024-09-21T07:25:40.317367+0000","last_unstale":"2024-09-21T07:25:41.299874+0000","last_undegraded":"2024-09-21T07:25:41.299874+0000","last_fullsized":"2024-09-21T07:25:41.299874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:44.995490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.294143+0000","last_change":"2024-09-21T07:25:40.294143+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.294143+0000","last_undegraded":"2024-09-21T07:25:40.294143+0000","last_fullsized":"2024-09-21T07:25:40.294143+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295401+0000","last_change":"2024-09-21T07:25:40.306199+0000","last_active":"2024-09-21T07:25:41.295401+0000","last_peered":"2024-09-21T07:25:41.295401+0000","last_clean":"2024-09-21T07:25:41.295401+0000","last_became_active":"2024-09-21T07:25:40.305769+0000","last_became_peered":"2024-09-21T07:25:40.305769+0000","last_unstale":"2024-09-21T07:25:41.295401+0000","last_undegraded":"2024-09-21T07:25:41.295401+0000","last_fullsized":"2024-09-21T07:25:41.295401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:48.912974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291644+0000","last_change":"2024-09-21T07:25:41.319773+0000","last_active":"2024-09-21T07:25:42.291644+0000","last_peered":"2024-09-21T07:25:42.291644+0000","last_clean":"2024-09-21T07:25:42.291644+0000","last_became_active":"2024-09-21T07:25:41.319373+0000","last_became_peered":"2024-09-21T07:25:41.319373+0000","last_unstale":"2024-09-21T07:25:42.291644+0000","last_undegraded":"2024-09-21T07:25:42.291644+0000","last_fullsized":"2024-09-21T07:25:42.291644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.713156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324299+0000","last_change":"2024-09-21T07:25:40.320257+0000","last_active":"2024-09-21T07:25:40.324299+0000","last_peered":"2024-09-21T07:25:40.324299+0000","last_clean":"2024-09-21T07:25:40.324299+0000","last_became_active":"2024-09-21T07:25:40.319892+0000","last_became_peered":"2024-09-21T07:25:40.319892+0000","last_unstale":"2024-09-21T07:25:40.324299+0000","last_undegraded":"2024-09-21T07:25:40.324299+0000","last_fullsized":"2024-09-21T07:25:40.324299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:12.911219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290769+0000","last_change":"2024-09-21T07:25:40.290769+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290769+0000","last_undegraded":"2024-09-21T07:25:40.290769+0000","last_fullsized":"2024-09-21T07:25:40.290769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291715+0000","last_change":"2024-09-21T07:25:40.319267+0000","last_active":"2024-09-21T07:25:42.291715+0000","last_peered":"2024-09-21T07:25:42.291715+0000","last_clean":"2024-09-21T07:25:42.291715+0000","last_became_active":"2024-09-21T07:25:40.318983+0000","last_became_peered":"2024-09-21T07:25:40.318983+0000","last_unstale":"2024-09-21T07:25:42.291715+0000","last_undegraded":"2024-09-21T07:25:42.291715+0000","last_fullsized":"2024-09-21T07:25:42.291715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.322153+0000","last_change":"2024-09-21T07:25:41.308091+0000","last_active":"2024-09-21T07:25:41.322153+0000","last_peered":"2024-09-21T07:25:41.322153+0000","last_clean":"2024-09-21T07:25:41.322153+0000","last_became_active":"2024-09-21T07:25:41.306860+0000","last_became_peered":"2024-09-21T07:25:41.306860+0000","last_unstale":"2024-09-21T07:25:41.322153+0000","last_undegraded":"2024-09-21T07:25:41.322153+0000","last_fullsized":"2024-09-21T07:25:41.322153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290782+0000","last_change":"2024-09-21T07:25:40.312155+0000","last_active":"2024-09-21T07:25:42.290782+0000","last_peered":"2024-09-21T07:25:42.290782+0000","last_clean":"2024-09-21T07:25:42.290782+0000","last_became_active":"2024-09-21T07:25:40.311878+0000","last_became_peered":"2024-09-21T07:25:40.311878+0000","last_unstale":"2024-09-21T07:25:42.290782+0000","last_undegraded":"2024-09-21T07:25:42.290782+0000","last_fullsized":"2024-09-21T07:25:42.290782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290206+0000","last_change":"2024-09-21T07:25:41.317327+0000","last_active":"2024-09-21T07:25:42.290206+0000","last_peered":"2024-09-21T07:25:42.290206+0000","last_clean":"2024-09-21T07:25:42.290206+0000","last_became_active":"2024-09-21T07:25:41.316941+0000","last_became_peered":"2024-09-21T07:25:41.316941+0000","last_unstale":"2024-09-21T07:25:42.290206+0000","last_undegraded":"2024-09-21T07:25:42.290206+0000","last_fullsized":"2024-09-21T07:25:42.290206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:56.746588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329918+0000","last_change":"2024-09-21T07:25:40.310464+0000","last_active":"2024-09-21T07:25:41.329918+0000","last_peered":"2024-09-21T07:25:41.329918+0000","last_clean":"2024-09-21T07:25:41.329918+0000","last_became_active":"2024-09-21T07:25:40.310137+0000","last_became_peered":"2024-09-21T07:25:40.310137+0000","last_unstale":"2024-09-21T07:25:41.329918+0000","last_undegraded":"2024-09-21T07:25:41.329918+0000","last_fullsized":"2024-09-21T07:25:41.329918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.325952+0000","last_change":"2024-09-21T07:25:41.317689+0000","last_active":"2024-09-21T07:25:41.325952+0000","last_peered":"2024-09-21T07:25:41.325952+0000","last_clean":"2024-09-21T07:25:41.325952+0000","last_became_active":"2024-09-21T07:25:41.317350+0000","last_became_peered":"2024-09-21T07:25:41.317350+0000","last_unstale":"2024-09-21T07:25:41.325952+0000","last_undegraded":"2024-09-21T07:25:41.325952+0000","last_fullsized":"2024-09-21T07:25:41.325952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:26.445844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.302580+0000","last_change":"2024-09-21T07:25:40.297950+0000","last_active":"2024-09-21T07:25:41.302580+0000","last_peered":"2024-09-21T07:25:41.302580+0000","last_clean":"2024-09-21T07:25:41.302580+0000","last_became_active":"2024-09-21T07:25:40.297646+0000","last_became_peered":"2024-09-21T07:25:40.297646+0000","last_unstale":"2024-09-21T07:25:41.302580+0000","last_undegraded":"2024-09-21T07:25:41.302580+0000","last_fullsized":"2024-09-21T07:25:41.302580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.321829+0000","last_change":"2024-09-21T07:25:41.318730+0000","last_active":"2024-09-21T07:25:41.321829+0000","last_peered":"2024-09-21T07:25:41.321829+0000","last_clean":"2024-09-21T07:25:41.321829+0000","last_became_active":"2024-09-21T07:25:41.318385+0000","last_became_peered":"2024-09-21T07:25:41.318385+0000","last_unstale":"2024-09-21T07:25:41.321829+0000","last_undegraded":"2024-09-21T07:25:41.321829+0000","last_fullsized":"2024-09-21T07:25:41.321829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.371793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333026+0000","last_change":"2024-09-21T07:25:40.303959+0000","last_active":"2024-09-21T07:25:41.333026+0000","last_peered":"2024-09-21T07:25:41.333026+0000","last_clean":"2024-09-21T07:25:41.333026+0000","last_became_active":"2024-09-21T07:25:40.303536+0000","last_became_peered":"2024-09-21T07:25:40.303536+0000","last_unstale":"2024-09-21T07:25:41.333026+0000","last_undegraded":"2024-09-21T07:25:41.333026+0000","last_fullsized":"2024-09-21T07:25:41.333026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.849393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320809+0000","last_change":"2024-09-21T07:25:41.317374+0000","last_active":"2024-09-21T07:25:41.320809+0000","last_peered":"2024-09-21T07:25:41.320809+0000","last_clean":"2024-09-21T07:25:41.320809+0000","last_became_active":"2024-09-21T07:25:41.317069+0000","last_became_peered":"2024-09-21T07:25:41.317069+0000","last_unstale":"2024-09-21T07:25:41.320809+0000","last_undegraded":"2024-09-21T07:25:41.320809+0000","last_fullsized":"2024-09-21T07:25:41.320809+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:06.420983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324403+0000","last_change":"2024-09-21T07:25:40.320288+0000","last_active":"2024-09-21T07:25:40.324403+0000","last_peered":"2024-09-21T07:25:40.324403+0000","last_clean":"2024-09-21T07:25:40.324403+0000","last_became_active":"2024-09-21T07:25:40.319933+0000","last_became_peered":"2024-09-21T07:25:40.319933+0000","last_unstale":"2024-09-21T07:25:40.324403+0000","last_undegraded":"2024-09-21T07:25:40.324403+0000","last_fullsized":"2024-09-21T07:25:40.324403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:00.058702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291482+0000","last_change":"2024-09-21T07:25:41.321249+0000","last_active":"2024-09-21T07:25:42.291482+0000","last_peered":"2024-09-21T07:25:42.291482+0000","last_clean":"2024-09-21T07:25:42.291482+0000","last_became_active":"2024-09-21T07:25:41.320883+0000","last_became_peered":"2024-09-21T07:25:41.320883+0000","last_unstale":"2024-09-21T07:25:42.291482+0000","last_undegraded":"2024-09-21T07:25:42.291482+0000","last_fullsized":"2024-09-21T07:25:42.291482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:20.932587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289545+0000","last_change":"2024-09-21T07:25:40.314157+0000","last_active":"2024-09-21T07:25:42.289545+0000","last_peered":"2024-09-21T07:25:42.289545+0000","last_clean":"2024-09-21T07:25:42.289545+0000","last_became_active":"2024-09-21T07:25:40.313354+0000","last_became_peered":"2024-09-21T07:25:40.313354+0000","last_unstale":"2024-09-21T07:25:42.289545+0000","last_undegraded":"2024-09-21T07:25:42.289545+0000","last_fullsized":"2024-09-21T07:25:42.289545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:38.743430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328444+0000","last_change":"2024-09-21T07:25:41.320071+0000","last_active":"2024-09-21T07:25:41.328444+0000","last_peered":"2024-09-21T07:25:41.328444+0000","last_clean":"2024-09-21T07:25:41.328444+0000","last_became_active":"2024-09-21T07:25:41.319671+0000","last_became_peered":"2024-09-21T07:25:41.319671+0000","last_unstale":"2024-09-21T07:25:41.328444+0000","last_undegraded":"2024-09-21T07:25:41.328444+0000","last_fullsized":"2024-09-21T07:25:41.328444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:48.351611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290034+0000","last_change":"2024-09-21T07:25:40.312679+0000","last_active":"2024-09-21T07:25:42.290034+0000","last_peered":"2024-09-21T07:25:42.290034+0000","last_clean":"2024-09-21T07:25:42.290034+0000","last_became_active":"2024-09-21T07:25:40.312297+0000","last_became_peered":"2024-09-21T07:25:40.312297+0000","last_unstale":"2024-09-21T07:25:42.290034+0000","last_undegraded":"2024-09-21T07:25:42.290034+0000","last_fullsized":"2024-09-21T07:25:42.290034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.313616+0000","last_change":"2024-09-21T07:25:41.308574+0000","last_active":"2024-09-21T07:25:41.313616+0000","last_peered":"2024-09-21T07:25:41.313616+0000","last_clean":"2024-09-21T07:25:41.313616+0000","last_became_active":"2024-09-21T07:25:41.307890+0000","last_became_peered":"2024-09-21T07:25:41.307890+0000","last_unstale":"2024-09-21T07:25:41.313616+0000","last_undegraded":"2024-09-21T07:25:41.313616+0000","last_fullsized":"2024-09-21T07:25:41.313616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:52.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333494+0000","last_change":"2024-09-21T07:25:40.317705+0000","last_active":"2024-09-21T07:25:41.333494+0000","last_peered":"2024-09-21T07:25:41.333494+0000","last_clean":"2024-09-21T07:25:41.333494+0000","last_became_active":"2024-09-21T07:25:40.317305+0000","last_became_peered":"2024-09-21T07:25:40.317305+0000","last_unstale":"2024-09-21T07:25:41.333494+0000","last_undegraded":"2024-09-21T07:25:41.333494+0000","last_fullsized":"2024-09-21T07:25:41.333494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:37.686640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.338369+0000","last_change":"2024-09-21T07:25:41.336080+0000","last_active":"2024-09-21T07:25:41.338369+0000","last_peered":"2024-09-21T07:25:41.338369+0000","last_clean":"2024-09-21T07:25:41.338369+0000","last_became_active":"2024-09-21T07:25:41.333501+0000","last_became_peered":"2024-09-21T07:25:41.333501+0000","last_unstale":"2024-09-21T07:25:41.338369+0000","last_undegraded":"2024-09-21T07:25:41.338369+0000","last_fullsized":"2024-09-21T07:25:41.338369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:51.951671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296126+0000","last_change":"2024-09-21T07:25:40.316378+0000","last_active":"2024-09-21T07:25:41.296126+0000","last_peered":"2024-09-21T07:25:41.296126+0000","last_clean":"2024-09-21T07:25:41.296126+0000","last_became_active":"2024-09-21T07:25:40.316066+0000","last_became_peered":"2024-09-21T07:25:40.316066+0000","last_unstale":"2024-09-21T07:25:41.296126+0000","last_undegraded":"2024-09-21T07:25:41.296126+0000","last_fullsized":"2024-09-21T07:25:41.296126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:48.460925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290705+0000","last_change":"2024-09-21T07:25:40.290705+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290705+0000","last_undegraded":"2024-09-21T07:25:40.290705+0000","last_fullsized":"2024-09-21T07:25:40.290705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290436+0000","last_change":"2024-09-21T07:25:40.313910+0000","last_active":"2024-09-21T07:25:42.290436+0000","last_peered":"2024-09-21T07:25:42.290436+0000","last_clean":"2024-09-21T07:25:42.290436+0000","last_became_active":"2024-09-21T07:25:40.313570+0000","last_became_peered":"2024-09-21T07:25:40.313570+0000","last_unstale":"2024-09-21T07:25:42.290436+0000","last_undegraded":"2024-09-21T07:25:42.290436+0000","last_fullsized":"2024-09-21T07:25:42.290436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290319+0000","last_change":"2024-09-21T07:25:41.325207+0000","last_active":"2024-09-21T07:25:42.290319+0000","last_peered":"2024-09-21T07:25:42.290319+0000","last_clean":"2024-09-21T07:25:42.290319+0000","last_became_active":"2024-09-21T07:25:41.324878+0000","last_became_peered":"2024-09-21T07:25:41.324878+0000","last_unstale":"2024-09-21T07:25:42.290319+0000","last_undegraded":"2024-09-21T07:25:42.290319+0000","last_fullsized":"2024-09-21T07:25:42.290319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.912084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324368+0000","last_change":"2024-09-21T07:25:40.320634+0000","last_active":"2024-09-21T07:25:40.324368+0000","last_peered":"2024-09-21T07:25:40.324368+0000","last_clean":"2024-09-21T07:25:40.324368+0000","last_became_active":"2024-09-21T07:25:40.320142+0000","last_became_peered":"2024-09-21T07:25:40.320142+0000","last_unstale":"2024-09-21T07:25:40.324368+0000","last_undegraded":"2024-09-21T07:25:40.324368+0000","last_fullsized":"2024-09-21T07:25:40.324368+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:58.661817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304718+0000","last_change":"2024-09-21T07:25:41.300389+0000","last_active":"2024-09-21T07:25:41.304718+0000","last_peered":"2024-09-21T07:25:41.304718+0000","last_clean":"2024-09-21T07:25:41.304718+0000","last_became_active":"2024-09-21T07:25:41.300063+0000","last_became_peered":"2024-09-21T07:25:41.300063+0000","last_unstale":"2024-09-21T07:25:41.304718+0000","last_undegraded":"2024-09-21T07:25:41.304718+0000","last_fullsized":"2024-09-21T07:25:41.304718+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:11.485694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.309145+0000","last_change":"2024-09-21T07:25:40.305976+0000","last_active":"2024-09-21T07:25:40.309145+0000","last_peered":"2024-09-21T07:25:40.309145+0000","last_clean":"2024-09-21T07:25:40.309145+0000","last_became_active":"2024-09-21T07:25:40.305647+0000","last_became_peered":"2024-09-21T07:25:40.305647+0000","last_unstale":"2024-09-21T07:25:40.309145+0000","last_undegraded":"2024-09-21T07:25:40.309145+0000","last_fullsized":"2024-09-21T07:25:40.309145+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:42.472958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291020+0000","last_change":"2024-09-21T07:25:41.331719+0000","last_active":"2024-09-21T07:25:42.291020+0000","last_peered":"2024-09-21T07:25:42.291020+0000","last_clean":"2024-09-21T07:25:42.291020+0000","last_became_active":"2024-09-21T07:25:41.331422+0000","last_became_peered":"2024-09-21T07:25:41.331422+0000","last_unstale":"2024-09-21T07:25:42.291020+0000","last_undegraded":"2024-09-21T07:25:42.291020+0000","last_fullsized":"2024-09-21T07:25:42.291020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290086+0000","last_change":"2024-09-21T07:25:40.307486+0000","last_active":"2024-09-21T07:25:42.290086+0000","last_peered":"2024-09-21T07:25:42.290086+0000","last_clean":"2024-09-21T07:25:42.290086+0000","last_became_active":"2024-09-21T07:25:40.307093+0000","last_became_peered":"2024-09-21T07:25:40.307093+0000","last_unstale":"2024-09-21T07:25:42.290086+0000","last_undegraded":"2024-09-21T07:25:42.290086+0000","last_fullsized":"2024-09-21T07:25:42.290086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:38.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291012+0000","last_change":"2024-09-21T07:25:40.291012+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291012+0000","last_undegraded":"2024-09-21T07:25:40.291012+0000","last_fullsized":"2024-09-21T07:25:40.291012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.292824+0000","last_change":"2024-09-21T07:25:40.305212+0000","last_active":"2024-09-21T07:25:41.292824+0000","last_peered":"2024-09-21T07:25:41.292824+0000","last_clean":"2024-09-21T07:25:41.292824+0000","last_became_active":"2024-09-21T07:25:40.304548+0000","last_became_peered":"2024-09-21T07:25:40.304548+0000","last_unstale":"2024-09-21T07:25:41.292824+0000","last_undegraded":"2024-09-21T07:25:41.292824+0000","last_fullsized":"2024-09-21T07:25:41.292824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:38.547032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.316448+0000","last_change":"2024-09-21T07:25:41.306132+0000","last_active":"2024-09-21T07:25:41.316448+0000","last_peered":"2024-09-21T07:25:41.316448+0000","last_clean":"2024-09-21T07:25:41.316448+0000","last_became_active":"2024-09-21T07:25:41.305750+0000","last_became_peered":"2024-09-21T07:25:41.305750+0000","last_unstale":"2024-09-21T07:25:41.316448+0000","last_undegraded":"2024-09-21T07:25:41.316448+0000","last_fullsized":"2024-09-21T07:25:41.316448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.511649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293055+0000","last_change":"2024-09-21T07:25:40.313563+0000","last_active":"2024-09-21T07:25:42.293055+0000","last_peered":"2024-09-21T07:25:42.293055+0000","last_clean":"2024-09-21T07:25:42.293055+0000","last_became_active":"2024-09-21T07:25:40.313179+0000","last_became_peered":"2024-09-21T07:25:40.313179+0000","last_unstale":"2024-09-21T07:25:42.293055+0000","last_undegraded":"2024-09-21T07:25:42.293055+0000","last_fullsized":"2024-09-21T07:25:42.293055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:22.021254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295066+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:25:41.295066+0000","last_peered":"2024-09-21T07:25:41.295066+0000","last_clean":"2024-09-21T07:25:41.295066+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:25:41.295066+0000","last_undegraded":"2024-09-21T07:25:41.295066+0000","last_fullsized":"2024-09-21T07:25:41.295066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":655360,"data_stored":290246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":647168,"data_stored":289594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":651264,"data_stored":290176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":671744,"data_stored":297898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":655360,"data_stored":289754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1228800,"data_stored":872795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":634880,"data_stored":282427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:25:45.508 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:25:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 -- 172.21.15.64:0/628496943 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40709b0 msgr2=0x7f1ac40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/628496943 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40709b0 0x7f1ac40b41c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009900 tx=0x7f1aac01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 -- 172.21.15.64:0/628496943 shutdown_connections 2024-09-21T07:25:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/628496943 >> v2:172.21.15.90:3300/0 conn(0x7f1ac40b4700 0x7f1ac4072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/628496943 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40709b0 0x7f1ac40b41c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 -- 172.21.15.64:0/628496943 >> 172.21.15.64:0/628496943 conn(0x7f1ac40ccbe0 msgr2=0x7f1ac40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 -- 172.21.15.64:0/628496943 shutdown_connections 2024-09-21T07:25:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.701+0000 7f1ac8e00640 1 -- 172.21.15.64:0/628496943 wait complete. 2024-09-21T07:25:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 Processor -- start 2024-09-21T07:25:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- start start 2024-09-21T07:25:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40b4700 0x7f1ac41fc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 0x7f1ac40d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4168b60 con 0x7f1ac40709b0 2024-09-21T07:25:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41689e0 con 0x7f1ac415edb0 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac4168ce0 con 0x7f1ac40b4700 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 0x7f1ac40d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35780/0 (socket says 172.21.15.64:35780) 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac1e00640 1 -- 172.21.15.64:0/1198414450 learned_addr learned my addr 172.21.15.64:0/1198414450 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1abbe00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40b4700 0x7f1ac41fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 -- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40b4700 msgr2=0x7f1ac41fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40b4700 0x7f1ac41fc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 -- 172.21.15.64:0/1198414450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 msgr2=0x7f1ac41635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 -- 172.21.15.64:0/1198414450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac41fd0a0 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac1e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac2800640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 0x7f1ac40d00e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00ebc0 tx=0x7f1abc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc003b80 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1abc003d20 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac4147040 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004280 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.705+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac41f9a20 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac40b41c0 con 0x7f1ac415edb0 2024-09-21T07:25:45.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1abc004b50 con 0x7f1ac415edb0 2024-09-21T07:25:45.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1aba000640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 0x7f1aa0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:45.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f1abc0953b0 con 0x7f1ac415edb0 2024-09-21T07:25:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1ac1e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 0x7f1aa0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.709+0000 7f1ac1e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 0x7f1aa0075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001c60 tx=0x7f1ab4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.713+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1abc05fbd0 con 0x7f1ac415edb0 2024-09-21T07:25:45.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.889+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ac409da20 con 0x7f1aa0073200 2024-09-21T07:25:45.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.893+0000 7f1aba000640 1 -- 172.21.15.64:0/1198414450 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251030 (secure 0 0 0) 0x7f1ac409da20 con 0x7f1aa0073200 2024-09-21T07:25:45.901 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:45.902 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:25:45.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 msgr2=0x7f1aa0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 0x7f1aa0075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001c60 tx=0x7f1ab4009040 comp rx=0 tx=0).stop 2024-09-21T07:25:45.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 msgr2=0x7f1ac40d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:45.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 0x7f1ac40d00e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00ebc0 tx=0x7f1abc00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 shutdown_connections 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1aa0073200 0x7f1aa0075710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac415edb0 0x7f1ac40d00e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ac40b4700 0x7f1ac41fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 --2- 172.21.15.64:0/1198414450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40709b0 0x7f1ac41635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 >> 172.21.15.64:0/1198414450 conn(0x7f1ac40ccbe0 msgr2=0x7f1ac4068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 shutdown_connections 2024-09-21T07:25:45.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:45.897+0000 7f1ac8e00640 1 -- 172.21.15.64:0/1198414450 wait complete. 2024-09-21T07:25:45.924 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-21T07:25:45.464932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":128,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289064,"kb_used_data":6256,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685656,"statfs":{"total":773094113280,"available":772798111744,"internally_reserved":0,"allocated":6406144,"data_stored":3499600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":289394227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001744"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329360+0000","last_change":"2024-09-21T07:25:41.321256+0000","last_active":"2024-09-21T07:25:41.329360+0000","last_peered":"2024-09-21T07:25:41.329360+0000","last_clean":"2024-09-21T07:25:41.329360+0000","last_became_active":"2024-09-21T07:25:41.320849+0000","last_became_peered":"2024-09-21T07:25:41.320849+0000","last_unstale":"2024-09-21T07:25:41.329360+0000","last_undegraded":"2024-09-21T07:25:41.329360+0000","last_fullsized":"2024-09-21T07:25:41.329360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:00.666556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317664+0000","last_change":"2024-09-21T07:25:41.308998+0000","last_active":"2024-09-21T07:25:41.317664+0000","last_peered":"2024-09-21T07:25:41.317664+0000","last_clean":"2024-09-21T07:25:41.317664+0000","last_became_active":"2024-09-21T07:25:41.304931+0000","last_became_peered":"2024-09-21T07:25:41.304931+0000","last_unstale":"2024-09-21T07:25:41.317664+0000","last_undegraded":"2024-09-21T07:25:41.317664+0000","last_fullsized":"2024-09-21T07:25:41.317664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:11.226663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290754+0000","last_change":"2024-09-21T07:25:41.332498+0000","last_active":"2024-09-21T07:25:42.290754+0000","last_peered":"2024-09-21T07:25:42.290754+0000","last_clean":"2024-09-21T07:25:42.290754+0000","last_became_active":"2024-09-21T07:25:41.332144+0000","last_became_peered":"2024-09-21T07:25:41.332144+0000","last_unstale":"2024-09-21T07:25:42.290754+0000","last_undegraded":"2024-09-21T07:25:42.290754+0000","last_fullsized":"2024-09-21T07:25:42.290754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:53.495422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317350+0000","last_change":"2024-09-21T07:25:41.311763+0000","last_active":"2024-09-21T07:25:41.317350+0000","last_peered":"2024-09-21T07:25:41.317350+0000","last_clean":"2024-09-21T07:25:41.317350+0000","last_became_active":"2024-09-21T07:25:41.311364+0000","last_became_peered":"2024-09-21T07:25:41.311364+0000","last_unstale":"2024-09-21T07:25:41.317350+0000","last_undegraded":"2024-09-21T07:25:41.317350+0000","last_fullsized":"2024-09-21T07:25:41.317350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:54.558607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290340+0000","last_change":"2024-09-21T07:25:41.320818+0000","last_active":"2024-09-21T07:25:42.290340+0000","last_peered":"2024-09-21T07:25:42.290340+0000","last_clean":"2024-09-21T07:25:42.290340+0000","last_became_active":"2024-09-21T07:25:41.320501+0000","last_became_peered":"2024-09-21T07:25:41.320501+0000","last_unstale":"2024-09-21T07:25:42.290340+0000","last_undegraded":"2024-09-21T07:25:42.290340+0000","last_fullsized":"2024-09-21T07:25:42.290340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328607+0000","last_change":"2024-09-21T07:25:41.313826+0000","last_active":"2024-09-21T07:25:41.328607+0000","last_peered":"2024-09-21T07:25:41.328607+0000","last_clean":"2024-09-21T07:25:41.328607+0000","last_became_active":"2024-09-21T07:25:41.313523+0000","last_became_peered":"2024-09-21T07:25:41.313523+0000","last_unstale":"2024-09-21T07:25:41.328607+0000","last_undegraded":"2024-09-21T07:25:41.328607+0000","last_fullsized":"2024-09-21T07:25:41.328607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:00.288283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289414+0000","last_change":"2024-09-21T07:25:41.323024+0000","last_active":"2024-09-21T07:25:42.289414+0000","last_peered":"2024-09-21T07:25:42.289414+0000","last_clean":"2024-09-21T07:25:42.289414+0000","last_became_active":"2024-09-21T07:25:41.321726+0000","last_became_peered":"2024-09-21T07:25:41.321726+0000","last_unstale":"2024-09-21T07:25:42.289414+0000","last_undegraded":"2024-09-21T07:25:42.289414+0000","last_fullsized":"2024-09-21T07:25:42.289414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:58.224710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296701+0000","last_change":"2024-09-21T07:25:40.296701+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296701+0000","last_undegraded":"2024-09-21T07:25:40.296701+0000","last_fullsized":"2024-09-21T07:25:40.296701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296336+0000","last_change":"2024-09-21T07:25:40.296336+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296336+0000","last_undegraded":"2024-09-21T07:25:40.296336+0000","last_fullsized":"2024-09-21T07:25:40.296336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329438+0000","last_change":"2024-09-21T07:25:41.323561+0000","last_active":"2024-09-21T07:25:41.329438+0000","last_peered":"2024-09-21T07:25:41.329438+0000","last_clean":"2024-09-21T07:25:41.329438+0000","last_became_active":"2024-09-21T07:25:41.323254+0000","last_became_peered":"2024-09-21T07:25:41.323254+0000","last_unstale":"2024-09-21T07:25:41.329438+0000","last_undegraded":"2024-09-21T07:25:41.329438+0000","last_fullsized":"2024-09-21T07:25:41.329438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.562192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290637+0000","last_change":"2024-09-21T07:25:41.307219+0000","last_active":"2024-09-21T07:25:42.290637+0000","last_peered":"2024-09-21T07:25:42.290637+0000","last_clean":"2024-09-21T07:25:42.290637+0000","last_became_active":"2024-09-21T07:25:41.306872+0000","last_became_peered":"2024-09-21T07:25:41.306872+0000","last_unstale":"2024-09-21T07:25:42.290637+0000","last_undegraded":"2024-09-21T07:25:42.290637+0000","last_fullsized":"2024-09-21T07:25:42.290637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:04.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299360+0000","last_change":"2024-09-21T07:25:40.299360+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299360+0000","last_undegraded":"2024-09-21T07:25:40.299360+0000","last_fullsized":"2024-09-21T07:25:40.299360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328727+0000","last_change":"2024-09-21T07:25:41.321933+0000","last_active":"2024-09-21T07:25:41.328727+0000","last_peered":"2024-09-21T07:25:41.328727+0000","last_clean":"2024-09-21T07:25:41.328727+0000","last_became_active":"2024-09-21T07:25:41.321587+0000","last_became_peered":"2024-09-21T07:25:41.321587+0000","last_unstale":"2024-09-21T07:25:41.328727+0000","last_undegraded":"2024-09-21T07:25:41.328727+0000","last_fullsized":"2024-09-21T07:25:41.328727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:51.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289995+0000","last_change":"2024-09-21T07:25:41.331684+0000","last_active":"2024-09-21T07:25:42.289995+0000","last_peered":"2024-09-21T07:25:42.289995+0000","last_clean":"2024-09-21T07:25:42.289995+0000","last_became_active":"2024-09-21T07:25:41.331336+0000","last_became_peered":"2024-09-21T07:25:41.331336+0000","last_unstale":"2024-09-21T07:25:42.289995+0000","last_undegraded":"2024-09-21T07:25:42.289995+0000","last_fullsized":"2024-09-21T07:25:42.289995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.318009+0000","last_change":"2024-09-21T07:25:41.307391+0000","last_active":"2024-09-21T07:25:41.318009+0000","last_peered":"2024-09-21T07:25:41.318009+0000","last_clean":"2024-09-21T07:25:41.318009+0000","last_became_active":"2024-09-21T07:25:41.307053+0000","last_became_peered":"2024-09-21T07:25:41.307053+0000","last_unstale":"2024-09-21T07:25:41.318009+0000","last_undegraded":"2024-09-21T07:25:41.318009+0000","last_fullsized":"2024-09-21T07:25:41.318009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:43.295840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328963+0000","last_change":"2024-09-21T07:25:41.322745+0000","last_active":"2024-09-21T07:25:41.328963+0000","last_peered":"2024-09-21T07:25:41.328963+0000","last_clean":"2024-09-21T07:25:41.328963+0000","last_became_active":"2024-09-21T07:25:41.322403+0000","last_became_peered":"2024-09-21T07:25:41.322403+0000","last_unstale":"2024-09-21T07:25:41.328963+0000","last_undegraded":"2024-09-21T07:25:41.328963+0000","last_fullsized":"2024-09-21T07:25:41.328963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291554+0000","last_change":"2024-09-21T07:25:41.318017+0000","last_active":"2024-09-21T07:25:42.291554+0000","last_peered":"2024-09-21T07:25:42.291554+0000","last_clean":"2024-09-21T07:25:42.291554+0000","last_became_active":"2024-09-21T07:25:41.317536+0000","last_became_peered":"2024-09-21T07:25:41.317536+0000","last_unstale":"2024-09-21T07:25:42.291554+0000","last_undegraded":"2024-09-21T07:25:42.291554+0000","last_fullsized":"2024-09-21T07:25:42.291554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.914124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317633+0000","last_change":"2024-09-21T07:25:41.307572+0000","last_active":"2024-09-21T07:25:41.317633+0000","last_peered":"2024-09-21T07:25:41.317633+0000","last_clean":"2024-09-21T07:25:41.317633+0000","last_became_active":"2024-09-21T07:25:41.305007+0000","last_became_peered":"2024-09-21T07:25:41.305007+0000","last_unstale":"2024-09-21T07:25:41.317633+0000","last_undegraded":"2024-09-21T07:25:41.317633+0000","last_fullsized":"2024-09-21T07:25:41.317633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:09.870174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291167+0000","last_change":"2024-09-21T07:25:41.327304+0000","last_active":"2024-09-21T07:25:42.291167+0000","last_peered":"2024-09-21T07:25:42.291167+0000","last_clean":"2024-09-21T07:25:42.291167+0000","last_became_active":"2024-09-21T07:25:41.326612+0000","last_became_peered":"2024-09-21T07:25:41.326612+0000","last_unstale":"2024-09-21T07:25:42.291167+0000","last_undegraded":"2024-09-21T07:25:42.291167+0000","last_fullsized":"2024-09-21T07:25:42.291167+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:57.777429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324732+0000","last_change":"2024-09-21T07:25:41.320645+0000","last_active":"2024-09-21T07:25:41.324732+0000","last_peered":"2024-09-21T07:25:41.324732+0000","last_clean":"2024-09-21T07:25:41.324732+0000","last_became_active":"2024-09-21T07:25:41.320160+0000","last_became_peered":"2024-09-21T07:25:41.320160+0000","last_unstale":"2024-09-21T07:25:41.324732+0000","last_undegraded":"2024-09-21T07:25:41.324732+0000","last_fullsized":"2024-09-21T07:25:41.324732+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:19.056585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320639+0000","last_change":"2024-09-21T07:25:41.312932+0000","last_active":"2024-09-21T07:25:41.320639+0000","last_peered":"2024-09-21T07:25:41.320639+0000","last_clean":"2024-09-21T07:25:41.320639+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.320639+0000","last_undegraded":"2024-09-21T07:25:41.320639+0000","last_fullsized":"2024-09-21T07:25:41.320639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:36.305857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299892+0000","last_change":"2024-09-21T07:25:40.299892+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299892+0000","last_undegraded":"2024-09-21T07:25:40.299892+0000","last_fullsized":"2024-09-21T07:25:40.299892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290648+0000","last_change":"2024-09-21T07:25:41.313770+0000","last_active":"2024-09-21T07:25:42.290648+0000","last_peered":"2024-09-21T07:25:42.290648+0000","last_clean":"2024-09-21T07:25:42.290648+0000","last_became_active":"2024-09-21T07:25:41.313227+0000","last_became_peered":"2024-09-21T07:25:41.313227+0000","last_unstale":"2024-09-21T07:25:42.290648+0000","last_undegraded":"2024-09-21T07:25:42.290648+0000","last_fullsized":"2024-09-21T07:25:42.290648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:33.855213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289330+0000","last_change":"2024-09-21T07:25:41.309859+0000","last_active":"2024-09-21T07:25:42.289330+0000","last_peered":"2024-09-21T07:25:42.289330+0000","last_clean":"2024-09-21T07:25:42.289330+0000","last_became_active":"2024-09-21T07:25:41.309517+0000","last_became_peered":"2024-09-21T07:25:41.309517+0000","last_unstale":"2024-09-21T07:25:42.289330+0000","last_undegraded":"2024-09-21T07:25:42.289330+0000","last_fullsized":"2024-09-21T07:25:42.289330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291690+0000","last_change":"2024-09-21T07:25:41.336710+0000","last_active":"2024-09-21T07:25:42.291690+0000","last_peered":"2024-09-21T07:25:42.291690+0000","last_clean":"2024-09-21T07:25:42.291690+0000","last_became_active":"2024-09-21T07:25:41.335110+0000","last_became_peered":"2024-09-21T07:25:41.335110+0000","last_unstale":"2024-09-21T07:25:42.291690+0000","last_undegraded":"2024-09-21T07:25:42.291690+0000","last_fullsized":"2024-09-21T07:25:42.291690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:04.420434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.295949+0000","last_change":"2024-09-21T07:25:40.295949+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.295949+0000","last_undegraded":"2024-09-21T07:25:40.295949+0000","last_fullsized":"2024-09-21T07:25:40.295949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.326514+0000","last_change":"2024-09-21T07:25:41.318845+0000","last_active":"2024-09-21T07:25:41.326514+0000","last_peered":"2024-09-21T07:25:41.326514+0000","last_clean":"2024-09-21T07:25:41.326514+0000","last_became_active":"2024-09-21T07:25:41.318551+0000","last_became_peered":"2024-09-21T07:25:41.318551+0000","last_unstale":"2024-09-21T07:25:41.326514+0000","last_undegraded":"2024-09-21T07:25:41.326514+0000","last_fullsized":"2024-09-21T07:25:41.326514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:17.260581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333059+0000","last_change":"2024-09-21T07:25:41.329282+0000","last_active":"2024-09-21T07:25:41.333059+0000","last_peered":"2024-09-21T07:25:41.333059+0000","last_clean":"2024-09-21T07:25:41.333059+0000","last_became_active":"2024-09-21T07:25:41.328876+0000","last_became_peered":"2024-09-21T07:25:41.328876+0000","last_unstale":"2024-09-21T07:25:41.333059+0000","last_undegraded":"2024-09-21T07:25:41.333059+0000","last_fullsized":"2024-09-21T07:25:41.333059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:31.567156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290693+0000","last_change":"2024-09-21T07:25:41.321849+0000","last_active":"2024-09-21T07:25:42.290693+0000","last_peered":"2024-09-21T07:25:42.290693+0000","last_clean":"2024-09-21T07:25:42.290693+0000","last_became_active":"2024-09-21T07:25:41.321476+0000","last_became_peered":"2024-09-21T07:25:41.321476+0000","last_unstale":"2024-09-21T07:25:42.290693+0000","last_undegraded":"2024-09-21T07:25:42.290693+0000","last_fullsized":"2024-09-21T07:25:42.290693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:14.078446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317264+0000","last_change":"2024-09-21T07:25:41.312897+0000","last_active":"2024-09-21T07:25:41.317264+0000","last_peered":"2024-09-21T07:25:41.317264+0000","last_clean":"2024-09-21T07:25:41.317264+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.317264+0000","last_undegraded":"2024-09-21T07:25:41.317264+0000","last_fullsized":"2024-09-21T07:25:41.317264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:43.056026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289405+0000","last_change":"2024-09-21T07:25:41.311045+0000","last_active":"2024-09-21T07:25:42.289405+0000","last_peered":"2024-09-21T07:25:42.289405+0000","last_clean":"2024-09-21T07:25:42.289405+0000","last_became_active":"2024-09-21T07:25:41.310726+0000","last_became_peered":"2024-09-21T07:25:41.310726+0000","last_unstale":"2024-09-21T07:25:42.289405+0000","last_undegraded":"2024-09-21T07:25:42.289405+0000","last_fullsized":"2024-09-21T07:25:42.289405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.305218+0000","last_change":"2024-09-21T07:25:41.300265+0000","last_active":"2024-09-21T07:25:41.305218+0000","last_peered":"2024-09-21T07:25:41.305218+0000","last_clean":"2024-09-21T07:25:41.305218+0000","last_became_active":"2024-09-21T07:25:41.299766+0000","last_became_peered":"2024-09-21T07:25:41.299766+0000","last_unstale":"2024-09-21T07:25:41.305218+0000","last_undegraded":"2024-09-21T07:25:41.305218+0000","last_fullsized":"2024-09-21T07:25:41.305218+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.310719+0000","last_change":"2024-09-21T07:25:41.305860+0000","last_active":"2024-09-21T07:25:41.310719+0000","last_peered":"2024-09-21T07:25:41.310719+0000","last_clean":"2024-09-21T07:25:41.310719+0000","last_became_active":"2024-09-21T07:25:41.305479+0000","last_became_peered":"2024-09-21T07:25:41.305479+0000","last_unstale":"2024-09-21T07:25:41.310719+0000","last_undegraded":"2024-09-21T07:25:41.310719+0000","last_fullsized":"2024-09-21T07:25:41.310719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:55.851412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.327948+0000","last_change":"2024-09-21T07:25:40.300521+0000","last_active":"2024-09-21T07:25:41.327948+0000","last_peered":"2024-09-21T07:25:41.327948+0000","last_clean":"2024-09-21T07:25:41.327948+0000","last_became_active":"2024-09-21T07:25:40.300196+0000","last_became_peered":"2024-09-21T07:25:40.300196+0000","last_unstale":"2024-09-21T07:25:41.327948+0000","last_undegraded":"2024-09-21T07:25:41.327948+0000","last_fullsized":"2024-09-21T07:25:41.327948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:12.727958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304725+0000","last_change":"2024-09-21T07:25:41.300373+0000","last_active":"2024-09-21T07:25:41.304725+0000","last_peered":"2024-09-21T07:25:41.304725+0000","last_clean":"2024-09-21T07:25:41.304725+0000","last_became_active":"2024-09-21T07:25:41.299865+0000","last_became_peered":"2024-09-21T07:25:41.299865+0000","last_unstale":"2024-09-21T07:25:41.304725+0000","last_undegraded":"2024-09-21T07:25:41.304725+0000","last_fullsized":"2024-09-21T07:25:41.304725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:27.770804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.334237+0000","last_change":"2024-09-21T07:25:40.308163+0000","last_active":"2024-09-21T07:25:41.334237+0000","last_peered":"2024-09-21T07:25:41.334237+0000","last_clean":"2024-09-21T07:25:41.334237+0000","last_became_active":"2024-09-21T07:25:40.307798+0000","last_became_peered":"2024-09-21T07:25:40.307798+0000","last_unstale":"2024-09-21T07:25:41.334237+0000","last_undegraded":"2024-09-21T07:25:41.334237+0000","last_fullsized":"2024-09-21T07:25:41.334237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:12.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.319334+0000","last_change":"2024-09-21T07:25:41.307900+0000","last_active":"2024-09-21T07:25:41.319334+0000","last_peered":"2024-09-21T07:25:41.319334+0000","last_clean":"2024-09-21T07:25:41.319334+0000","last_became_active":"2024-09-21T07:25:41.307573+0000","last_became_peered":"2024-09-21T07:25:41.307573+0000","last_unstale":"2024-09-21T07:25:41.319334+0000","last_undegraded":"2024-09-21T07:25:41.319334+0000","last_fullsized":"2024-09-21T07:25:41.319334+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:12.547817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.331023+0000","last_change":"2024-09-21T07:25:40.310055+0000","last_active":"2024-09-21T07:25:41.331023+0000","last_peered":"2024-09-21T07:25:41.331023+0000","last_clean":"2024-09-21T07:25:41.331023+0000","last_became_active":"2024-09-21T07:25:40.309774+0000","last_became_peered":"2024-09-21T07:25:40.309774+0000","last_unstale":"2024-09-21T07:25:41.331023+0000","last_undegraded":"2024-09-21T07:25:41.331023+0000","last_fullsized":"2024-09-21T07:25:41.331023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:26.643644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291251+0000","last_change":"2024-09-21T07:25:40.291251+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291251+0000","last_undegraded":"2024-09-21T07:25:40.291251+0000","last_fullsized":"2024-09-21T07:25:40.291251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333281+0000","last_change":"2024-09-21T07:25:40.308143+0000","last_active":"2024-09-21T07:25:41.333281+0000","last_peered":"2024-09-21T07:25:41.333281+0000","last_clean":"2024-09-21T07:25:41.333281+0000","last_became_active":"2024-09-21T07:25:40.307813+0000","last_became_peered":"2024-09-21T07:25:40.307813+0000","last_unstale":"2024-09-21T07:25:41.333281+0000","last_undegraded":"2024-09-21T07:25:41.333281+0000","last_fullsized":"2024-09-21T07:25:41.333281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:48.036611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290628+0000","last_change":"2024-09-21T07:25:41.318110+0000","last_active":"2024-09-21T07:25:42.290628+0000","last_peered":"2024-09-21T07:25:42.290628+0000","last_clean":"2024-09-21T07:25:42.290628+0000","last_became_active":"2024-09-21T07:25:41.317724+0000","last_became_peered":"2024-09-21T07:25:41.317724+0000","last_unstale":"2024-09-21T07:25:42.290628+0000","last_undegraded":"2024-09-21T07:25:42.290628+0000","last_fullsized":"2024-09-21T07:25:42.290628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290816+0000","last_change":"2024-09-21T07:25:40.314377+0000","last_active":"2024-09-21T07:25:42.290816+0000","last_peered":"2024-09-21T07:25:42.290816+0000","last_clean":"2024-09-21T07:25:42.290816+0000","last_became_active":"2024-09-21T07:25:40.313997+0000","last_became_peered":"2024-09-21T07:25:40.313997+0000","last_unstale":"2024-09-21T07:25:42.290816+0000","last_undegraded":"2024-09-21T07:25:42.290816+0000","last_fullsized":"2024-09-21T07:25:42.290816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.566202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.330540+0000","last_change":"2024-09-21T07:25:41.327857+0000","last_active":"2024-09-21T07:25:41.330540+0000","last_peered":"2024-09-21T07:25:41.330540+0000","last_clean":"2024-09-21T07:25:41.330540+0000","last_became_active":"2024-09-21T07:25:41.327330+0000","last_became_peered":"2024-09-21T07:25:41.327330+0000","last_unstale":"2024-09-21T07:25:41.330540+0000","last_undegraded":"2024-09-21T07:25:41.330540+0000","last_fullsized":"2024-09-21T07:25:41.330540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:06.529185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290510+0000","last_change":"2024-09-21T07:25:40.300775+0000","last_active":"2024-09-21T07:25:42.290510+0000","last_peered":"2024-09-21T07:25:42.290510+0000","last_clean":"2024-09-21T07:25:42.290510+0000","last_became_active":"2024-09-21T07:25:40.300245+0000","last_became_peered":"2024-09-21T07:25:40.300245+0000","last_unstale":"2024-09-21T07:25:42.290510+0000","last_undegraded":"2024-09-21T07:25:42.290510+0000","last_fullsized":"2024-09-21T07:25:42.290510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291277+0000","last_change":"2024-09-21T07:25:40.291277+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291277+0000","last_undegraded":"2024-09-21T07:25:40.291277+0000","last_fullsized":"2024-09-21T07:25:40.291277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299023+0000","last_change":"2024-09-21T07:25:40.304077+0000","last_active":"2024-09-21T07:25:41.299023+0000","last_peered":"2024-09-21T07:25:41.299023+0000","last_clean":"2024-09-21T07:25:41.299023+0000","last_became_active":"2024-09-21T07:25:40.303202+0000","last_became_peered":"2024-09-21T07:25:40.303202+0000","last_unstale":"2024-09-21T07:25:41.299023+0000","last_undegraded":"2024-09-21T07:25:41.299023+0000","last_fullsized":"2024-09-21T07:25:41.299023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.778348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324540+0000","last_change":"2024-09-21T07:25:41.314683+0000","last_active":"2024-09-21T07:25:41.324540+0000","last_peered":"2024-09-21T07:25:41.324540+0000","last_clean":"2024-09-21T07:25:41.324540+0000","last_became_active":"2024-09-21T07:25:41.314189+0000","last_became_peered":"2024-09-21T07:25:41.314189+0000","last_unstale":"2024-09-21T07:25:41.324540+0000","last_undegraded":"2024-09-21T07:25:41.324540+0000","last_fullsized":"2024-09-21T07:25:41.324540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:40.181308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289294+0000","last_change":"2024-09-21T07:25:40.316177+0000","last_active":"2024-09-21T07:25:42.289294+0000","last_peered":"2024-09-21T07:25:42.289294+0000","last_clean":"2024-09-21T07:25:42.289294+0000","last_became_active":"2024-09-21T07:25:40.314401+0000","last_became_peered":"2024-09-21T07:25:40.314401+0000","last_unstale":"2024-09-21T07:25:42.289294+0000","last_undegraded":"2024-09-21T07:25:42.289294+0000","last_fullsized":"2024-09-21T07:25:42.289294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:30.563754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290724+0000","last_change":"2024-09-21T07:25:41.325783+0000","last_active":"2024-09-21T07:25:42.290724+0000","last_peered":"2024-09-21T07:25:42.290724+0000","last_clean":"2024-09-21T07:25:42.290724+0000","last_became_active":"2024-09-21T07:25:41.325386+0000","last_became_peered":"2024-09-21T07:25:41.325386+0000","last_unstale":"2024-09-21T07:25:42.290724+0000","last_undegraded":"2024-09-21T07:25:42.290724+0000","last_fullsized":"2024-09-21T07:25:42.290724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296655+0000","last_change":"2024-09-21T07:25:40.306950+0000","last_active":"2024-09-21T07:25:41.296655+0000","last_peered":"2024-09-21T07:25:41.296655+0000","last_clean":"2024-09-21T07:25:41.296655+0000","last_became_active":"2024-09-21T07:25:40.306701+0000","last_became_peered":"2024-09-21T07:25:40.306701+0000","last_unstale":"2024-09-21T07:25:41.296655+0000","last_undegraded":"2024-09-21T07:25:41.296655+0000","last_fullsized":"2024-09-21T07:25:41.296655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.144853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320737+0000","last_change":"2024-09-21T07:25:41.317786+0000","last_active":"2024-09-21T07:25:41.320737+0000","last_peered":"2024-09-21T07:25:41.320737+0000","last_clean":"2024-09-21T07:25:41.320737+0000","last_became_active":"2024-09-21T07:25:41.317476+0000","last_became_peered":"2024-09-21T07:25:41.317476+0000","last_unstale":"2024-09-21T07:25:41.320737+0000","last_undegraded":"2024-09-21T07:25:41.320737+0000","last_fullsized":"2024-09-21T07:25:41.320737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:10.644829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290547+0000","last_change":"2024-09-21T07:25:40.314159+0000","last_active":"2024-09-21T07:25:42.290547+0000","last_peered":"2024-09-21T07:25:42.290547+0000","last_clean":"2024-09-21T07:25:42.290547+0000","last_became_active":"2024-09-21T07:25:40.313757+0000","last_became_peered":"2024-09-21T07:25:40.313757+0000","last_unstale":"2024-09-21T07:25:42.290547+0000","last_undegraded":"2024-09-21T07:25:42.290547+0000","last_fullsized":"2024-09-21T07:25:42.290547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289951+0000","last_change":"2024-09-21T07:25:41.325786+0000","last_active":"2024-09-21T07:25:42.289951+0000","last_peered":"2024-09-21T07:25:42.289951+0000","last_clean":"2024-09-21T07:25:42.289951+0000","last_became_active":"2024-09-21T07:25:41.321038+0000","last_became_peered":"2024-09-21T07:25:41.321038+0000","last_unstale":"2024-09-21T07:25:42.289951+0000","last_undegraded":"2024-09-21T07:25:42.289951+0000","last_fullsized":"2024-09-21T07:25:42.289951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:37.991238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329854+0000","last_change":"2024-09-21T07:25:40.310416+0000","last_active":"2024-09-21T07:25:41.329854+0000","last_peered":"2024-09-21T07:25:41.329854+0000","last_clean":"2024-09-21T07:25:41.329854+0000","last_became_active":"2024-09-21T07:25:40.310117+0000","last_became_peered":"2024-09-21T07:25:40.310117+0000","last_unstale":"2024-09-21T07:25:41.329854+0000","last_undegraded":"2024-09-21T07:25:41.329854+0000","last_fullsized":"2024-09-21T07:25:41.329854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:26.889094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290666+0000","last_change":"2024-09-21T07:25:41.318224+0000","last_active":"2024-09-21T07:25:42.290666+0000","last_peered":"2024-09-21T07:25:42.290666+0000","last_clean":"2024-09-21T07:25:42.290666+0000","last_became_active":"2024-09-21T07:25:41.317846+0000","last_became_peered":"2024-09-21T07:25:41.317846+0000","last_unstale":"2024-09-21T07:25:42.290666+0000","last_undegraded":"2024-09-21T07:25:42.290666+0000","last_fullsized":"2024-09-21T07:25:42.290666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:39.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324365+0000","last_change":"2024-09-21T07:25:40.320385+0000","last_active":"2024-09-21T07:25:40.324365+0000","last_peered":"2024-09-21T07:25:40.324365+0000","last_clean":"2024-09-21T07:25:40.324365+0000","last_became_active":"2024-09-21T07:25:40.320042+0000","last_became_peered":"2024-09-21T07:25:40.320042+0000","last_unstale":"2024-09-21T07:25:40.324365+0000","last_undegraded":"2024-09-21T07:25:40.324365+0000","last_fullsized":"2024-09-21T07:25:40.324365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:06.020101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304847+0000","last_change":"2024-09-21T07:25:41.300184+0000","last_active":"2024-09-21T07:25:41.304847+0000","last_peered":"2024-09-21T07:25:41.304847+0000","last_clean":"2024-09-21T07:25:41.304847+0000","last_became_active":"2024-09-21T07:25:41.299829+0000","last_became_peered":"2024-09-21T07:25:41.299829+0000","last_unstale":"2024-09-21T07:25:41.304847+0000","last_undegraded":"2024-09-21T07:25:41.304847+0000","last_fullsized":"2024-09-21T07:25:41.304847+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:36.479157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290966+0000","last_change":"2024-09-21T07:25:40.302488+0000","last_active":"2024-09-21T07:25:42.290966+0000","last_peered":"2024-09-21T07:25:42.290966+0000","last_clean":"2024-09-21T07:25:42.290966+0000","last_became_active":"2024-09-21T07:25:40.302167+0000","last_became_peered":"2024-09-21T07:25:40.302167+0000","last_unstale":"2024-09-21T07:25:42.290966+0000","last_undegraded":"2024-09-21T07:25:42.290966+0000","last_fullsized":"2024-09-21T07:25:42.290966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:51.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291230+0000","last_change":"2024-09-21T07:25:41.327602+0000","last_active":"2024-09-21T07:25:42.291230+0000","last_peered":"2024-09-21T07:25:42.291230+0000","last_clean":"2024-09-21T07:25:42.291230+0000","last_became_active":"2024-09-21T07:25:41.327019+0000","last_became_peered":"2024-09-21T07:25:41.327019+0000","last_unstale":"2024-09-21T07:25:42.291230+0000","last_undegraded":"2024-09-21T07:25:42.291230+0000","last_fullsized":"2024-09-21T07:25:42.291230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:12.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299874+0000","last_change":"2024-09-21T07:25:40.317734+0000","last_active":"2024-09-21T07:25:41.299874+0000","last_peered":"2024-09-21T07:25:41.299874+0000","last_clean":"2024-09-21T07:25:41.299874+0000","last_became_active":"2024-09-21T07:25:40.317367+0000","last_became_peered":"2024-09-21T07:25:40.317367+0000","last_unstale":"2024-09-21T07:25:41.299874+0000","last_undegraded":"2024-09-21T07:25:41.299874+0000","last_fullsized":"2024-09-21T07:25:41.299874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:44.995490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.294143+0000","last_change":"2024-09-21T07:25:40.294143+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.294143+0000","last_undegraded":"2024-09-21T07:25:40.294143+0000","last_fullsized":"2024-09-21T07:25:40.294143+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295401+0000","last_change":"2024-09-21T07:25:40.306199+0000","last_active":"2024-09-21T07:25:41.295401+0000","last_peered":"2024-09-21T07:25:41.295401+0000","last_clean":"2024-09-21T07:25:41.295401+0000","last_became_active":"2024-09-21T07:25:40.305769+0000","last_became_peered":"2024-09-21T07:25:40.305769+0000","last_unstale":"2024-09-21T07:25:41.295401+0000","last_undegraded":"2024-09-21T07:25:41.295401+0000","last_fullsized":"2024-09-21T07:25:41.295401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:48.912974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291644+0000","last_change":"2024-09-21T07:25:41.319773+0000","last_active":"2024-09-21T07:25:42.291644+0000","last_peered":"2024-09-21T07:25:42.291644+0000","last_clean":"2024-09-21T07:25:42.291644+0000","last_became_active":"2024-09-21T07:25:41.319373+0000","last_became_peered":"2024-09-21T07:25:41.319373+0000","last_unstale":"2024-09-21T07:25:42.291644+0000","last_undegraded":"2024-09-21T07:25:42.291644+0000","last_fullsized":"2024-09-21T07:25:42.291644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.713156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324299+0000","last_change":"2024-09-21T07:25:40.320257+0000","last_active":"2024-09-21T07:25:40.324299+0000","last_peered":"2024-09-21T07:25:40.324299+0000","last_clean":"2024-09-21T07:25:40.324299+0000","last_became_active":"2024-09-21T07:25:40.319892+0000","last_became_peered":"2024-09-21T07:25:40.319892+0000","last_unstale":"2024-09-21T07:25:40.324299+0000","last_undegraded":"2024-09-21T07:25:40.324299+0000","last_fullsized":"2024-09-21T07:25:40.324299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:12.911219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290769+0000","last_change":"2024-09-21T07:25:40.290769+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290769+0000","last_undegraded":"2024-09-21T07:25:40.290769+0000","last_fullsized":"2024-09-21T07:25:40.290769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291715+0000","last_change":"2024-09-21T07:25:40.319267+0000","last_active":"2024-09-21T07:25:42.291715+0000","last_peered":"2024-09-21T07:25:42.291715+0000","last_clean":"2024-09-21T07:25:42.291715+0000","last_became_active":"2024-09-21T07:25:40.318983+0000","last_became_peered":"2024-09-21T07:25:40.318983+0000","last_unstale":"2024-09-21T07:25:42.291715+0000","last_undegraded":"2024-09-21T07:25:42.291715+0000","last_fullsized":"2024-09-21T07:25:42.291715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.322153+0000","last_change":"2024-09-21T07:25:41.308091+0000","last_active":"2024-09-21T07:25:41.322153+0000","last_peered":"2024-09-21T07:25:41.322153+0000","last_clean":"2024-09-21T07:25:41.322153+0000","last_became_active":"2024-09-21T07:25:41.306860+0000","last_became_peered":"2024-09-21T07:25:41.306860+0000","last_unstale":"2024-09-21T07:25:41.322153+0000","last_undegraded":"2024-09-21T07:25:41.322153+0000","last_fullsized":"2024-09-21T07:25:41.322153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290782+0000","last_change":"2024-09-21T07:25:40.312155+0000","last_active":"2024-09-21T07:25:42.290782+0000","last_peered":"2024-09-21T07:25:42.290782+0000","last_clean":"2024-09-21T07:25:42.290782+0000","last_became_active":"2024-09-21T07:25:40.311878+0000","last_became_peered":"2024-09-21T07:25:40.311878+0000","last_unstale":"2024-09-21T07:25:42.290782+0000","last_undegraded":"2024-09-21T07:25:42.290782+0000","last_fullsized":"2024-09-21T07:25:42.290782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290206+0000","last_change":"2024-09-21T07:25:41.317327+0000","last_active":"2024-09-21T07:25:42.290206+0000","last_peered":"2024-09-21T07:25:42.290206+0000","last_clean":"2024-09-21T07:25:42.290206+0000","last_became_active":"2024-09-21T07:25:41.316941+0000","last_became_peered":"2024-09-21T07:25:41.316941+0000","last_unstale":"2024-09-21T07:25:42.290206+0000","last_undegraded":"2024-09-21T07:25:42.290206+0000","last_fullsized":"2024-09-21T07:25:42.290206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:56.746588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329918+0000","last_change":"2024-09-21T07:25:40.310464+0000","last_active":"2024-09-21T07:25:41.329918+0000","last_peered":"2024-09-21T07:25:41.329918+0000","last_clean":"2024-09-21T07:25:41.329918+0000","last_became_active":"2024-09-21T07:25:40.310137+0000","last_became_peered":"2024-09-21T07:25:40.310137+0000","last_unstale":"2024-09-21T07:25:41.329918+0000","last_undegraded":"2024-09-21T07:25:41.329918+0000","last_fullsized":"2024-09-21T07:25:41.329918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.325952+0000","last_change":"2024-09-21T07:25:41.317689+0000","last_active":"2024-09-21T07:25:41.325952+0000","last_peered":"2024-09-21T07:25:41.325952+0000","last_clean":"2024-09-21T07:25:41.325952+0000","last_became_active":"2024-09-21T07:25:41.317350+0000","last_became_peered":"2024-09-21T07:25:41.317350+0000","last_unstale":"2024-09-21T07:25:41.325952+0000","last_undegraded":"2024-09-21T07:25:41.325952+0000","last_fullsized":"2024-09-21T07:25:41.325952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:26.445844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.302580+0000","last_change":"2024-09-21T07:25:40.297950+0000","last_active":"2024-09-21T07:25:41.302580+0000","last_peered":"2024-09-21T07:25:41.302580+0000","last_clean":"2024-09-21T07:25:41.302580+0000","last_became_active":"2024-09-21T07:25:40.297646+0000","last_became_peered":"2024-09-21T07:25:40.297646+0000","last_unstale":"2024-09-21T07:25:41.302580+0000","last_undegraded":"2024-09-21T07:25:41.302580+0000","last_fullsized":"2024-09-21T07:25:41.302580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.321829+0000","last_change":"2024-09-21T07:25:41.318730+0000","last_active":"2024-09-21T07:25:41.321829+0000","last_peered":"2024-09-21T07:25:41.321829+0000","last_clean":"2024-09-21T07:25:41.321829+0000","last_became_active":"2024-09-21T07:25:41.318385+0000","last_became_peered":"2024-09-21T07:25:41.318385+0000","last_unstale":"2024-09-21T07:25:41.321829+0000","last_undegraded":"2024-09-21T07:25:41.321829+0000","last_fullsized":"2024-09-21T07:25:41.321829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.371793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333026+0000","last_change":"2024-09-21T07:25:40.303959+0000","last_active":"2024-09-21T07:25:41.333026+0000","last_peered":"2024-09-21T07:25:41.333026+0000","last_clean":"2024-09-21T07:25:41.333026+0000","last_became_active":"2024-09-21T07:25:40.303536+0000","last_became_peered":"2024-09-21T07:25:40.303536+0000","last_unstale":"2024-09-21T07:25:41.333026+0000","last_undegraded":"2024-09-21T07:25:41.333026+0000","last_fullsized":"2024-09-21T07:25:41.333026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.849393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320809+0000","last_change":"2024-09-21T07:25:41.317374+0000","last_active":"2024-09-21T07:25:41.320809+0000","last_peered":"2024-09-21T07:25:41.320809+0000","last_clean":"2024-09-21T07:25:41.320809+0000","last_became_active":"2024-09-21T07:25:41.317069+0000","last_became_peered":"2024-09-21T07:25:41.317069+0000","last_unstale":"2024-09-21T07:25:41.320809+0000","last_undegraded":"2024-09-21T07:25:41.320809+0000","last_fullsized":"2024-09-21T07:25:41.320809+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:06.420983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324403+0000","last_change":"2024-09-21T07:25:40.320288+0000","last_active":"2024-09-21T07:25:40.324403+0000","last_peered":"2024-09-21T07:25:40.324403+0000","last_clean":"2024-09-21T07:25:40.324403+0000","last_became_active":"2024-09-21T07:25:40.319933+0000","last_became_peered":"2024-09-21T07:25:40.319933+0000","last_unstale":"2024-09-21T07:25:40.324403+0000","last_undegraded":"2024-09-21T07:25:40.324403+0000","last_fullsized":"2024-09-21T07:25:40.324403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:00.058702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291482+0000","last_change":"2024-09-21T07:25:41.321249+0000","last_active":"2024-09-21T07:25:42.291482+0000","last_peered":"2024-09-21T07:25:42.291482+0000","last_clean":"2024-09-21T07:25:42.291482+0000","last_became_active":"2024-09-21T07:25:41.320883+0000","last_became_peered":"2024-09-21T07:25:41.320883+0000","last_unstale":"2024-09-21T07:25:42.291482+0000","last_undegraded":"2024-09-21T07:25:42.291482+0000","last_fullsized":"2024-09-21T07:25:42.291482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:20.932587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289545+0000","last_change":"2024-09-21T07:25:40.314157+0000","last_active":"2024-09-21T07:25:42.289545+0000","last_peered":"2024-09-21T07:25:42.289545+0000","last_clean":"2024-09-21T07:25:42.289545+0000","last_became_active":"2024-09-21T07:25:40.313354+0000","last_became_peered":"2024-09-21T07:25:40.313354+0000","last_unstale":"2024-09-21T07:25:42.289545+0000","last_undegraded":"2024-09-21T07:25:42.289545+0000","last_fullsized":"2024-09-21T07:25:42.289545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:38.743430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328444+0000","last_change":"2024-09-21T07:25:41.320071+0000","last_active":"2024-09-21T07:25:41.328444+0000","last_peered":"2024-09-21T07:25:41.328444+0000","last_clean":"2024-09-21T07:25:41.328444+0000","last_became_active":"2024-09-21T07:25:41.319671+0000","last_became_peered":"2024-09-21T07:25:41.319671+0000","last_unstale":"2024-09-21T07:25:41.328444+0000","last_undegraded":"2024-09-21T07:25:41.328444+0000","last_fullsized":"2024-09-21T07:25:41.328444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:48.351611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290034+0000","last_change":"2024-09-21T07:25:40.312679+0000","last_active":"2024-09-21T07:25:42.290034+0000","last_peered":"2024-09-21T07:25:42.290034+0000","last_clean":"2024-09-21T07:25:42.290034+0000","last_became_active":"2024-09-21T07:25:40.312297+0000","last_became_peered":"2024-09-21T07:25:40.312297+0000","last_unstale":"2024-09-21T07:25:42.290034+0000","last_undegraded":"2024-09-21T07:25:42.290034+0000","last_fullsized":"2024-09-21T07:25:42.290034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.313616+0000","last_change":"2024-09-21T07:25:41.308574+0000","last_active":"2024-09-21T07:25:41.313616+0000","last_peered":"2024-09-21T07:25:41.313616+0000","last_clean":"2024-09-21T07:25:41.313616+0000","last_became_active":"2024-09-21T07:25:41.307890+0000","last_became_peered":"2024-09-21T07:25:41.307890+0000","last_unstale":"2024-09-21T07:25:41.313616+0000","last_undegraded":"2024-09-21T07:25:41.313616+0000","last_fullsized":"2024-09-21T07:25:41.313616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:52.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333494+0000","last_change":"2024-09-21T07:25:40.317705+0000","last_active":"2024-09-21T07:25:41.333494+0000","last_peered":"2024-09-21T07:25:41.333494+0000","last_clean":"2024-09-21T07:25:41.333494+0000","last_became_active":"2024-09-21T07:25:40.317305+0000","last_became_peered":"2024-09-21T07:25:40.317305+0000","last_unstale":"2024-09-21T07:25:41.333494+0000","last_undegraded":"2024-09-21T07:25:41.333494+0000","last_fullsized":"2024-09-21T07:25:41.333494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:37.686640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.338369+0000","last_change":"2024-09-21T07:25:41.336080+0000","last_active":"2024-09-21T07:25:41.338369+0000","last_peered":"2024-09-21T07:25:41.338369+0000","last_clean":"2024-09-21T07:25:41.338369+0000","last_became_active":"2024-09-21T07:25:41.333501+0000","last_became_peered":"2024-09-21T07:25:41.333501+0000","last_unstale":"2024-09-21T07:25:41.338369+0000","last_undegraded":"2024-09-21T07:25:41.338369+0000","last_fullsized":"2024-09-21T07:25:41.338369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:51.951671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296126+0000","last_change":"2024-09-21T07:25:40.316378+0000","last_active":"2024-09-21T07:25:41.296126+0000","last_peered":"2024-09-21T07:25:41.296126+0000","last_clean":"2024-09-21T07:25:41.296126+0000","last_became_active":"2024-09-21T07:25:40.316066+0000","last_became_peered":"2024-09-21T07:25:40.316066+0000","last_unstale":"2024-09-21T07:25:41.296126+0000","last_undegraded":"2024-09-21T07:25:41.296126+0000","last_fullsized":"2024-09-21T07:25:41.296126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:48.460925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290705+0000","last_change":"2024-09-21T07:25:40.290705+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290705+0000","last_undegraded":"2024-09-21T07:25:40.290705+0000","last_fullsized":"2024-09-21T07:25:40.290705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290436+0000","last_change":"2024-09-21T07:25:40.313910+0000","last_active":"2024-09-21T07:25:42.290436+0000","last_peered":"2024-09-21T07:25:42.290436+0000","last_clean":"2024-09-21T07:25:42.290436+0000","last_became_active":"2024-09-21T07:25:40.313570+0000","last_became_peered":"2024-09-21T07:25:40.313570+0000","last_unstale":"2024-09-21T07:25:42.290436+0000","last_undegraded":"2024-09-21T07:25:42.290436+0000","last_fullsized":"2024-09-21T07:25:42.290436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290319+0000","last_change":"2024-09-21T07:25:41.325207+0000","last_active":"2024-09-21T07:25:42.290319+0000","last_peered":"2024-09-21T07:25:42.290319+0000","last_clean":"2024-09-21T07:25:42.290319+0000","last_became_active":"2024-09-21T07:25:41.324878+0000","last_became_peered":"2024-09-21T07:25:41.324878+0000","last_unstale":"2024-09-21T07:25:42.290319+0000","last_undegraded":"2024-09-21T07:25:42.290319+0000","last_fullsized":"2024-09-21T07:25:42.290319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.912084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324368+0000","last_change":"2024-09-21T07:25:40.320634+0000","last_active":"2024-09-21T07:25:40.324368+0000","last_peered":"2024-09-21T07:25:40.324368+0000","last_clean":"2024-09-21T07:25:40.324368+0000","last_became_active":"2024-09-21T07:25:40.320142+0000","last_became_peered":"2024-09-21T07:25:40.320142+0000","last_unstale":"2024-09-21T07:25:40.324368+0000","last_undegraded":"2024-09-21T07:25:40.324368+0000","last_fullsized":"2024-09-21T07:25:40.324368+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:58.661817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304718+0000","last_change":"2024-09-21T07:25:41.300389+0000","last_active":"2024-09-21T07:25:41.304718+0000","last_peered":"2024-09-21T07:25:41.304718+0000","last_clean":"2024-09-21T07:25:41.304718+0000","last_became_active":"2024-09-21T07:25:41.300063+0000","last_became_peered":"2024-09-21T07:25:41.300063+0000","last_unstale":"2024-09-21T07:25:41.304718+0000","last_undegraded":"2024-09-21T07:25:41.304718+0000","last_fullsized":"2024-09-21T07:25:41.304718+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:11.485694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.309145+0000","last_change":"2024-09-21T07:25:40.305976+0000","last_active":"2024-09-21T07:25:40.309145+0000","last_peered":"2024-09-21T07:25:40.309145+0000","last_clean":"2024-09-21T07:25:40.309145+0000","last_became_active":"2024-09-21T07:25:40.305647+0000","last_became_peered":"2024-09-21T07:25:40.305647+0000","last_unstale":"2024-09-21T07:25:40.309145+0000","last_undegraded":"2024-09-21T07:25:40.309145+0000","last_fullsized":"2024-09-21T07:25:40.309145+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:42.472958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291020+0000","last_change":"2024-09-21T07:25:41.331719+0000","last_active":"2024-09-21T07:25:42.291020+0000","last_peered":"2024-09-21T07:25:42.291020+0000","last_clean":"2024-09-21T07:25:42.291020+0000","last_became_active":"2024-09-21T07:25:41.331422+0000","last_became_peered":"2024-09-21T07:25:41.331422+0000","last_unstale":"2024-09-21T07:25:42.291020+0000","last_undegraded":"2024-09-21T07:25:42.291020+0000","last_fullsized":"2024-09-21T07:25:42.291020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290086+0000","last_change":"2024-09-21T07:25:40.307486+0000","last_active":"2024-09-21T07:25:42.290086+0000","last_peered":"2024-09-21T07:25:42.290086+0000","last_clean":"2024-09-21T07:25:42.290086+0000","last_became_active":"2024-09-21T07:25:40.307093+0000","last_became_peered":"2024-09-21T07:25:40.307093+0000","last_unstale":"2024-09-21T07:25:42.290086+0000","last_undegraded":"2024-09-21T07:25:42.290086+0000","last_fullsized":"2024-09-21T07:25:42.290086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:38.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291012+0000","last_change":"2024-09-21T07:25:40.291012+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291012+0000","last_undegraded":"2024-09-21T07:25:40.291012+0000","last_fullsized":"2024-09-21T07:25:40.291012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.292824+0000","last_change":"2024-09-21T07:25:40.305212+0000","last_active":"2024-09-21T07:25:41.292824+0000","last_peered":"2024-09-21T07:25:41.292824+0000","last_clean":"2024-09-21T07:25:41.292824+0000","last_became_active":"2024-09-21T07:25:40.304548+0000","last_became_peered":"2024-09-21T07:25:40.304548+0000","last_unstale":"2024-09-21T07:25:41.292824+0000","last_undegraded":"2024-09-21T07:25:41.292824+0000","last_fullsized":"2024-09-21T07:25:41.292824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:38.547032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.316448+0000","last_change":"2024-09-21T07:25:41.306132+0000","last_active":"2024-09-21T07:25:41.316448+0000","last_peered":"2024-09-21T07:25:41.316448+0000","last_clean":"2024-09-21T07:25:41.316448+0000","last_became_active":"2024-09-21T07:25:41.305750+0000","last_became_peered":"2024-09-21T07:25:41.305750+0000","last_unstale":"2024-09-21T07:25:41.316448+0000","last_undegraded":"2024-09-21T07:25:41.316448+0000","last_fullsized":"2024-09-21T07:25:41.316448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.511649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293055+0000","last_change":"2024-09-21T07:25:40.313563+0000","last_active":"2024-09-21T07:25:42.293055+0000","last_peered":"2024-09-21T07:25:42.293055+0000","last_clean":"2024-09-21T07:25:42.293055+0000","last_became_active":"2024-09-21T07:25:40.313179+0000","last_became_peered":"2024-09-21T07:25:40.313179+0000","last_unstale":"2024-09-21T07:25:42.293055+0000","last_undegraded":"2024-09-21T07:25:42.293055+0000","last_fullsized":"2024-09-21T07:25:42.293055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:22.021254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295066+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:25:41.295066+0000","last_peered":"2024-09-21T07:25:41.295066+0000","last_clean":"2024-09-21T07:25:41.295066+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:25:41.295066+0000","last_undegraded":"2024-09-21T07:25:41.295066+0000","last_fullsized":"2024-09-21T07:25:41.295066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":655360,"data_stored":290246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":647168,"data_stored":289594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":651264,"data_stored":290176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":671744,"data_stored":297898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":655360,"data_stored":289754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1228800,"data_stored":872795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":634880,"data_stored":282427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:25:45.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:25:46.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- 172.21.15.64:0/3717802697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e406ff90 msgr2=0x7f96e40cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3717802697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e406ff90 0x7f96e40cdd00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009840 tx=0x7f96cc01c760 comp rx=0 tx=0).stop 2024-09-21T07:25:46.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- 172.21.15.64:0/3717802697 shutdown_connections 2024-09-21T07:25:46.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3717802697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e406ff90 0x7f96e40cdd00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3717802697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e415b700 0x7f96e40cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- 172.21.15.64:0/3717802697 >> 172.21.15.64:0/3717802697 conn(0x7f96e406e890 msgr2=0x7f96e40b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:46.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- 172.21.15.64:0/3717802697 shutdown_connections 2024-09-21T07:25:46.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- 172.21.15.64:0/3717802697 wait complete. 2024-09-21T07:25:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 Processor -- start 2024-09-21T07:25:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.121+0000 7f96e8e00640 1 -- start start 2024-09-21T07:25:46.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e406ff90 0x7f96e415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96e40ce240 0x7f96e415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4168f80 con 0x7f96e415b700 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4168e00 con 0x7f96e40ce240 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f96e4169100 con 0x7f96e406ff90 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35788/0 (socket says 172.21.15.64:35788) 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 -- 172.21.15.64:0/3558347394 learned_addr learned my addr 172.21.15.64:0/3558347394 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e1e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e406ff90 0x7f96e415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96dbe00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96e40ce240 0x7f96e415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 -- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e406ff90 msgr2=0x7f96e415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e406ff90 0x7f96e415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 -- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96e40ce240 msgr2=0x7f96e415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96e40ce240 0x7f96e415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 -- 172.21.15.64:0/3558347394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e40c4e20 con 0x7f96e415b700 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e2800640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c730 tx=0x7f96dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc003b80 con 0x7f96e415b700 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96dc003d40 con 0x7f96e415b700 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0052d0 con 0x7f96e415b700 2024-09-21T07:25:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e40c5320 con 0x7f96e415b700 2024-09-21T07:25:46.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e40c58e0 con 0x7f96e415b700 2024-09-21T07:25:46.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.125+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e40c5090 con 0x7f96e415b700 2024-09-21T07:25:46.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.129+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f96dc005680 con 0x7f96e415b700 2024-09-21T07:25:46.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.129+0000 7f96da000640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 0x7f96c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.129+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f96dc094240 con 0x7f96e415b700 2024-09-21T07:25:46.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.129+0000 7f96e1e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 0x7f96c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.129+0000 7f96e1e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 0x7f96c0075740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009b40 tx=0x7f96d40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.133+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f96e40ce650 con 0x7f96e415b700 2024-09-21T07:25:46.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.309+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96e40b0be0 con 0x7f96c0073230 2024-09-21T07:25:46.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.313+0000 7f96da000640 1 -- 172.21.15.64:0/3558347394 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251030 (secure 0 0 0) 0x7f96e40b0be0 con 0x7f96c0073230 2024-09-21T07:25:46.323 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:46.325 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:25:46.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 msgr2=0x7f96c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 0x7f96c0075740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009b40 tx=0x7f96d40091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 msgr2=0x7f96e41fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c730 tx=0x7f96dc00cbf0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 shutdown_connections 2024-09-21T07:25:46.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96c0073230 0x7f96c0075740 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e415b700 0x7f96e41fc960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96e40ce240 0x7f96e415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 --2- 172.21.15.64:0/3558347394 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96e406ff90 0x7f96e415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 >> 172.21.15.64:0/3558347394 conn(0x7f96e406e890 msgr2=0x7f96e40b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 shutdown_connections 2024-09-21T07:25:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.317+0000 7f96e8e00640 1 -- 172.21.15.64:0/3558347394 wait complete. 2024-09-21T07:25:46.346 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-21T07:25:45.464932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":128,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289064,"kb_used_data":6256,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685656,"statfs":{"total":773094113280,"available":772798111744,"internally_reserved":0,"allocated":6406144,"data_stored":3499600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":289394227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001744"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329360+0000","last_change":"2024-09-21T07:25:41.321256+0000","last_active":"2024-09-21T07:25:41.329360+0000","last_peered":"2024-09-21T07:25:41.329360+0000","last_clean":"2024-09-21T07:25:41.329360+0000","last_became_active":"2024-09-21T07:25:41.320849+0000","last_became_peered":"2024-09-21T07:25:41.320849+0000","last_unstale":"2024-09-21T07:25:41.329360+0000","last_undegraded":"2024-09-21T07:25:41.329360+0000","last_fullsized":"2024-09-21T07:25:41.329360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:00.666556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317664+0000","last_change":"2024-09-21T07:25:41.308998+0000","last_active":"2024-09-21T07:25:41.317664+0000","last_peered":"2024-09-21T07:25:41.317664+0000","last_clean":"2024-09-21T07:25:41.317664+0000","last_became_active":"2024-09-21T07:25:41.304931+0000","last_became_peered":"2024-09-21T07:25:41.304931+0000","last_unstale":"2024-09-21T07:25:41.317664+0000","last_undegraded":"2024-09-21T07:25:41.317664+0000","last_fullsized":"2024-09-21T07:25:41.317664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:11.226663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290754+0000","last_change":"2024-09-21T07:25:41.332498+0000","last_active":"2024-09-21T07:25:42.290754+0000","last_peered":"2024-09-21T07:25:42.290754+0000","last_clean":"2024-09-21T07:25:42.290754+0000","last_became_active":"2024-09-21T07:25:41.332144+0000","last_became_peered":"2024-09-21T07:25:41.332144+0000","last_unstale":"2024-09-21T07:25:42.290754+0000","last_undegraded":"2024-09-21T07:25:42.290754+0000","last_fullsized":"2024-09-21T07:25:42.290754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:53.495422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317350+0000","last_change":"2024-09-21T07:25:41.311763+0000","last_active":"2024-09-21T07:25:41.317350+0000","last_peered":"2024-09-21T07:25:41.317350+0000","last_clean":"2024-09-21T07:25:41.317350+0000","last_became_active":"2024-09-21T07:25:41.311364+0000","last_became_peered":"2024-09-21T07:25:41.311364+0000","last_unstale":"2024-09-21T07:25:41.317350+0000","last_undegraded":"2024-09-21T07:25:41.317350+0000","last_fullsized":"2024-09-21T07:25:41.317350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:54.558607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290340+0000","last_change":"2024-09-21T07:25:41.320818+0000","last_active":"2024-09-21T07:25:42.290340+0000","last_peered":"2024-09-21T07:25:42.290340+0000","last_clean":"2024-09-21T07:25:42.290340+0000","last_became_active":"2024-09-21T07:25:41.320501+0000","last_became_peered":"2024-09-21T07:25:41.320501+0000","last_unstale":"2024-09-21T07:25:42.290340+0000","last_undegraded":"2024-09-21T07:25:42.290340+0000","last_fullsized":"2024-09-21T07:25:42.290340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328607+0000","last_change":"2024-09-21T07:25:41.313826+0000","last_active":"2024-09-21T07:25:41.328607+0000","last_peered":"2024-09-21T07:25:41.328607+0000","last_clean":"2024-09-21T07:25:41.328607+0000","last_became_active":"2024-09-21T07:25:41.313523+0000","last_became_peered":"2024-09-21T07:25:41.313523+0000","last_unstale":"2024-09-21T07:25:41.328607+0000","last_undegraded":"2024-09-21T07:25:41.328607+0000","last_fullsized":"2024-09-21T07:25:41.328607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:00.288283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289414+0000","last_change":"2024-09-21T07:25:41.323024+0000","last_active":"2024-09-21T07:25:42.289414+0000","last_peered":"2024-09-21T07:25:42.289414+0000","last_clean":"2024-09-21T07:25:42.289414+0000","last_became_active":"2024-09-21T07:25:41.321726+0000","last_became_peered":"2024-09-21T07:25:41.321726+0000","last_unstale":"2024-09-21T07:25:42.289414+0000","last_undegraded":"2024-09-21T07:25:42.289414+0000","last_fullsized":"2024-09-21T07:25:42.289414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:58.224710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296701+0000","last_change":"2024-09-21T07:25:40.296701+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296701+0000","last_undegraded":"2024-09-21T07:25:40.296701+0000","last_fullsized":"2024-09-21T07:25:40.296701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296336+0000","last_change":"2024-09-21T07:25:40.296336+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296336+0000","last_undegraded":"2024-09-21T07:25:40.296336+0000","last_fullsized":"2024-09-21T07:25:40.296336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329438+0000","last_change":"2024-09-21T07:25:41.323561+0000","last_active":"2024-09-21T07:25:41.329438+0000","last_peered":"2024-09-21T07:25:41.329438+0000","last_clean":"2024-09-21T07:25:41.329438+0000","last_became_active":"2024-09-21T07:25:41.323254+0000","last_became_peered":"2024-09-21T07:25:41.323254+0000","last_unstale":"2024-09-21T07:25:41.329438+0000","last_undegraded":"2024-09-21T07:25:41.329438+0000","last_fullsized":"2024-09-21T07:25:41.329438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.562192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290637+0000","last_change":"2024-09-21T07:25:41.307219+0000","last_active":"2024-09-21T07:25:42.290637+0000","last_peered":"2024-09-21T07:25:42.290637+0000","last_clean":"2024-09-21T07:25:42.290637+0000","last_became_active":"2024-09-21T07:25:41.306872+0000","last_became_peered":"2024-09-21T07:25:41.306872+0000","last_unstale":"2024-09-21T07:25:42.290637+0000","last_undegraded":"2024-09-21T07:25:42.290637+0000","last_fullsized":"2024-09-21T07:25:42.290637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:04.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299360+0000","last_change":"2024-09-21T07:25:40.299360+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299360+0000","last_undegraded":"2024-09-21T07:25:40.299360+0000","last_fullsized":"2024-09-21T07:25:40.299360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328727+0000","last_change":"2024-09-21T07:25:41.321933+0000","last_active":"2024-09-21T07:25:41.328727+0000","last_peered":"2024-09-21T07:25:41.328727+0000","last_clean":"2024-09-21T07:25:41.328727+0000","last_became_active":"2024-09-21T07:25:41.321587+0000","last_became_peered":"2024-09-21T07:25:41.321587+0000","last_unstale":"2024-09-21T07:25:41.328727+0000","last_undegraded":"2024-09-21T07:25:41.328727+0000","last_fullsized":"2024-09-21T07:25:41.328727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:51.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289995+0000","last_change":"2024-09-21T07:25:41.331684+0000","last_active":"2024-09-21T07:25:42.289995+0000","last_peered":"2024-09-21T07:25:42.289995+0000","last_clean":"2024-09-21T07:25:42.289995+0000","last_became_active":"2024-09-21T07:25:41.331336+0000","last_became_peered":"2024-09-21T07:25:41.331336+0000","last_unstale":"2024-09-21T07:25:42.289995+0000","last_undegraded":"2024-09-21T07:25:42.289995+0000","last_fullsized":"2024-09-21T07:25:42.289995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.318009+0000","last_change":"2024-09-21T07:25:41.307391+0000","last_active":"2024-09-21T07:25:41.318009+0000","last_peered":"2024-09-21T07:25:41.318009+0000","last_clean":"2024-09-21T07:25:41.318009+0000","last_became_active":"2024-09-21T07:25:41.307053+0000","last_became_peered":"2024-09-21T07:25:41.307053+0000","last_unstale":"2024-09-21T07:25:41.318009+0000","last_undegraded":"2024-09-21T07:25:41.318009+0000","last_fullsized":"2024-09-21T07:25:41.318009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:43.295840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328963+0000","last_change":"2024-09-21T07:25:41.322745+0000","last_active":"2024-09-21T07:25:41.328963+0000","last_peered":"2024-09-21T07:25:41.328963+0000","last_clean":"2024-09-21T07:25:41.328963+0000","last_became_active":"2024-09-21T07:25:41.322403+0000","last_became_peered":"2024-09-21T07:25:41.322403+0000","last_unstale":"2024-09-21T07:25:41.328963+0000","last_undegraded":"2024-09-21T07:25:41.328963+0000","last_fullsized":"2024-09-21T07:25:41.328963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291554+0000","last_change":"2024-09-21T07:25:41.318017+0000","last_active":"2024-09-21T07:25:42.291554+0000","last_peered":"2024-09-21T07:25:42.291554+0000","last_clean":"2024-09-21T07:25:42.291554+0000","last_became_active":"2024-09-21T07:25:41.317536+0000","last_became_peered":"2024-09-21T07:25:41.317536+0000","last_unstale":"2024-09-21T07:25:42.291554+0000","last_undegraded":"2024-09-21T07:25:42.291554+0000","last_fullsized":"2024-09-21T07:25:42.291554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.914124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317633+0000","last_change":"2024-09-21T07:25:41.307572+0000","last_active":"2024-09-21T07:25:41.317633+0000","last_peered":"2024-09-21T07:25:41.317633+0000","last_clean":"2024-09-21T07:25:41.317633+0000","last_became_active":"2024-09-21T07:25:41.305007+0000","last_became_peered":"2024-09-21T07:25:41.305007+0000","last_unstale":"2024-09-21T07:25:41.317633+0000","last_undegraded":"2024-09-21T07:25:41.317633+0000","last_fullsized":"2024-09-21T07:25:41.317633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:09.870174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291167+0000","last_change":"2024-09-21T07:25:41.327304+0000","last_active":"2024-09-21T07:25:42.291167+0000","last_peered":"2024-09-21T07:25:42.291167+0000","last_clean":"2024-09-21T07:25:42.291167+0000","last_became_active":"2024-09-21T07:25:41.326612+0000","last_became_peered":"2024-09-21T07:25:41.326612+0000","last_unstale":"2024-09-21T07:25:42.291167+0000","last_undegraded":"2024-09-21T07:25:42.291167+0000","last_fullsized":"2024-09-21T07:25:42.291167+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:57.777429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324732+0000","last_change":"2024-09-21T07:25:41.320645+0000","last_active":"2024-09-21T07:25:41.324732+0000","last_peered":"2024-09-21T07:25:41.324732+0000","last_clean":"2024-09-21T07:25:41.324732+0000","last_became_active":"2024-09-21T07:25:41.320160+0000","last_became_peered":"2024-09-21T07:25:41.320160+0000","last_unstale":"2024-09-21T07:25:41.324732+0000","last_undegraded":"2024-09-21T07:25:41.324732+0000","last_fullsized":"2024-09-21T07:25:41.324732+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:19.056585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320639+0000","last_change":"2024-09-21T07:25:41.312932+0000","last_active":"2024-09-21T07:25:41.320639+0000","last_peered":"2024-09-21T07:25:41.320639+0000","last_clean":"2024-09-21T07:25:41.320639+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.320639+0000","last_undegraded":"2024-09-21T07:25:41.320639+0000","last_fullsized":"2024-09-21T07:25:41.320639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:36.305857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299892+0000","last_change":"2024-09-21T07:25:40.299892+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299892+0000","last_undegraded":"2024-09-21T07:25:40.299892+0000","last_fullsized":"2024-09-21T07:25:40.299892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290648+0000","last_change":"2024-09-21T07:25:41.313770+0000","last_active":"2024-09-21T07:25:42.290648+0000","last_peered":"2024-09-21T07:25:42.290648+0000","last_clean":"2024-09-21T07:25:42.290648+0000","last_became_active":"2024-09-21T07:25:41.313227+0000","last_became_peered":"2024-09-21T07:25:41.313227+0000","last_unstale":"2024-09-21T07:25:42.290648+0000","last_undegraded":"2024-09-21T07:25:42.290648+0000","last_fullsized":"2024-09-21T07:25:42.290648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:33.855213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289330+0000","last_change":"2024-09-21T07:25:41.309859+0000","last_active":"2024-09-21T07:25:42.289330+0000","last_peered":"2024-09-21T07:25:42.289330+0000","last_clean":"2024-09-21T07:25:42.289330+0000","last_became_active":"2024-09-21T07:25:41.309517+0000","last_became_peered":"2024-09-21T07:25:41.309517+0000","last_unstale":"2024-09-21T07:25:42.289330+0000","last_undegraded":"2024-09-21T07:25:42.289330+0000","last_fullsized":"2024-09-21T07:25:42.289330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291690+0000","last_change":"2024-09-21T07:25:41.336710+0000","last_active":"2024-09-21T07:25:42.291690+0000","last_peered":"2024-09-21T07:25:42.291690+0000","last_clean":"2024-09-21T07:25:42.291690+0000","last_became_active":"2024-09-21T07:25:41.335110+0000","last_became_peered":"2024-09-21T07:25:41.335110+0000","last_unstale":"2024-09-21T07:25:42.291690+0000","last_undegraded":"2024-09-21T07:25:42.291690+0000","last_fullsized":"2024-09-21T07:25:42.291690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:04.420434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.295949+0000","last_change":"2024-09-21T07:25:40.295949+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.295949+0000","last_undegraded":"2024-09-21T07:25:40.295949+0000","last_fullsized":"2024-09-21T07:25:40.295949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.326514+0000","last_change":"2024-09-21T07:25:41.318845+0000","last_active":"2024-09-21T07:25:41.326514+0000","last_peered":"2024-09-21T07:25:41.326514+0000","last_clean":"2024-09-21T07:25:41.326514+0000","last_became_active":"2024-09-21T07:25:41.318551+0000","last_became_peered":"2024-09-21T07:25:41.318551+0000","last_unstale":"2024-09-21T07:25:41.326514+0000","last_undegraded":"2024-09-21T07:25:41.326514+0000","last_fullsized":"2024-09-21T07:25:41.326514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:17.260581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333059+0000","last_change":"2024-09-21T07:25:41.329282+0000","last_active":"2024-09-21T07:25:41.333059+0000","last_peered":"2024-09-21T07:25:41.333059+0000","last_clean":"2024-09-21T07:25:41.333059+0000","last_became_active":"2024-09-21T07:25:41.328876+0000","last_became_peered":"2024-09-21T07:25:41.328876+0000","last_unstale":"2024-09-21T07:25:41.333059+0000","last_undegraded":"2024-09-21T07:25:41.333059+0000","last_fullsized":"2024-09-21T07:25:41.333059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:31.567156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290693+0000","last_change":"2024-09-21T07:25:41.321849+0000","last_active":"2024-09-21T07:25:42.290693+0000","last_peered":"2024-09-21T07:25:42.290693+0000","last_clean":"2024-09-21T07:25:42.290693+0000","last_became_active":"2024-09-21T07:25:41.321476+0000","last_became_peered":"2024-09-21T07:25:41.321476+0000","last_unstale":"2024-09-21T07:25:42.290693+0000","last_undegraded":"2024-09-21T07:25:42.290693+0000","last_fullsized":"2024-09-21T07:25:42.290693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:14.078446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317264+0000","last_change":"2024-09-21T07:25:41.312897+0000","last_active":"2024-09-21T07:25:41.317264+0000","last_peered":"2024-09-21T07:25:41.317264+0000","last_clean":"2024-09-21T07:25:41.317264+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.317264+0000","last_undegraded":"2024-09-21T07:25:41.317264+0000","last_fullsized":"2024-09-21T07:25:41.317264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:43.056026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289405+0000","last_change":"2024-09-21T07:25:41.311045+0000","last_active":"2024-09-21T07:25:42.289405+0000","last_peered":"2024-09-21T07:25:42.289405+0000","last_clean":"2024-09-21T07:25:42.289405+0000","last_became_active":"2024-09-21T07:25:41.310726+0000","last_became_peered":"2024-09-21T07:25:41.310726+0000","last_unstale":"2024-09-21T07:25:42.289405+0000","last_undegraded":"2024-09-21T07:25:42.289405+0000","last_fullsized":"2024-09-21T07:25:42.289405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.305218+0000","last_change":"2024-09-21T07:25:41.300265+0000","last_active":"2024-09-21T07:25:41.305218+0000","last_peered":"2024-09-21T07:25:41.305218+0000","last_clean":"2024-09-21T07:25:41.305218+0000","last_became_active":"2024-09-21T07:25:41.299766+0000","last_became_peered":"2024-09-21T07:25:41.299766+0000","last_unstale":"2024-09-21T07:25:41.305218+0000","last_undegraded":"2024-09-21T07:25:41.305218+0000","last_fullsized":"2024-09-21T07:25:41.305218+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.310719+0000","last_change":"2024-09-21T07:25:41.305860+0000","last_active":"2024-09-21T07:25:41.310719+0000","last_peered":"2024-09-21T07:25:41.310719+0000","last_clean":"2024-09-21T07:25:41.310719+0000","last_became_active":"2024-09-21T07:25:41.305479+0000","last_became_peered":"2024-09-21T07:25:41.305479+0000","last_unstale":"2024-09-21T07:25:41.310719+0000","last_undegraded":"2024-09-21T07:25:41.310719+0000","last_fullsized":"2024-09-21T07:25:41.310719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:55.851412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.327948+0000","last_change":"2024-09-21T07:25:40.300521+0000","last_active":"2024-09-21T07:25:41.327948+0000","last_peered":"2024-09-21T07:25:41.327948+0000","last_clean":"2024-09-21T07:25:41.327948+0000","last_became_active":"2024-09-21T07:25:40.300196+0000","last_became_peered":"2024-09-21T07:25:40.300196+0000","last_unstale":"2024-09-21T07:25:41.327948+0000","last_undegraded":"2024-09-21T07:25:41.327948+0000","last_fullsized":"2024-09-21T07:25:41.327948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:12.727958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304725+0000","last_change":"2024-09-21T07:25:41.300373+0000","last_active":"2024-09-21T07:25:41.304725+0000","last_peered":"2024-09-21T07:25:41.304725+0000","last_clean":"2024-09-21T07:25:41.304725+0000","last_became_active":"2024-09-21T07:25:41.299865+0000","last_became_peered":"2024-09-21T07:25:41.299865+0000","last_unstale":"2024-09-21T07:25:41.304725+0000","last_undegraded":"2024-09-21T07:25:41.304725+0000","last_fullsized":"2024-09-21T07:25:41.304725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:27.770804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.334237+0000","last_change":"2024-09-21T07:25:40.308163+0000","last_active":"2024-09-21T07:25:41.334237+0000","last_peered":"2024-09-21T07:25:41.334237+0000","last_clean":"2024-09-21T07:25:41.334237+0000","last_became_active":"2024-09-21T07:25:40.307798+0000","last_became_peered":"2024-09-21T07:25:40.307798+0000","last_unstale":"2024-09-21T07:25:41.334237+0000","last_undegraded":"2024-09-21T07:25:41.334237+0000","last_fullsized":"2024-09-21T07:25:41.334237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:12.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.319334+0000","last_change":"2024-09-21T07:25:41.307900+0000","last_active":"2024-09-21T07:25:41.319334+0000","last_peered":"2024-09-21T07:25:41.319334+0000","last_clean":"2024-09-21T07:25:41.319334+0000","last_became_active":"2024-09-21T07:25:41.307573+0000","last_became_peered":"2024-09-21T07:25:41.307573+0000","last_unstale":"2024-09-21T07:25:41.319334+0000","last_undegraded":"2024-09-21T07:25:41.319334+0000","last_fullsized":"2024-09-21T07:25:41.319334+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:12.547817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.331023+0000","last_change":"2024-09-21T07:25:40.310055+0000","last_active":"2024-09-21T07:25:41.331023+0000","last_peered":"2024-09-21T07:25:41.331023+0000","last_clean":"2024-09-21T07:25:41.331023+0000","last_became_active":"2024-09-21T07:25:40.309774+0000","last_became_peered":"2024-09-21T07:25:40.309774+0000","last_unstale":"2024-09-21T07:25:41.331023+0000","last_undegraded":"2024-09-21T07:25:41.331023+0000","last_fullsized":"2024-09-21T07:25:41.331023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:26.643644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291251+0000","last_change":"2024-09-21T07:25:40.291251+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291251+0000","last_undegraded":"2024-09-21T07:25:40.291251+0000","last_fullsized":"2024-09-21T07:25:40.291251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333281+0000","last_change":"2024-09-21T07:25:40.308143+0000","last_active":"2024-09-21T07:25:41.333281+0000","last_peered":"2024-09-21T07:25:41.333281+0000","last_clean":"2024-09-21T07:25:41.333281+0000","last_became_active":"2024-09-21T07:25:40.307813+0000","last_became_peered":"2024-09-21T07:25:40.307813+0000","last_unstale":"2024-09-21T07:25:41.333281+0000","last_undegraded":"2024-09-21T07:25:41.333281+0000","last_fullsized":"2024-09-21T07:25:41.333281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:48.036611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290628+0000","last_change":"2024-09-21T07:25:41.318110+0000","last_active":"2024-09-21T07:25:42.290628+0000","last_peered":"2024-09-21T07:25:42.290628+0000","last_clean":"2024-09-21T07:25:42.290628+0000","last_became_active":"2024-09-21T07:25:41.317724+0000","last_became_peered":"2024-09-21T07:25:41.317724+0000","last_unstale":"2024-09-21T07:25:42.290628+0000","last_undegraded":"2024-09-21T07:25:42.290628+0000","last_fullsized":"2024-09-21T07:25:42.290628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290816+0000","last_change":"2024-09-21T07:25:40.314377+0000","last_active":"2024-09-21T07:25:42.290816+0000","last_peered":"2024-09-21T07:25:42.290816+0000","last_clean":"2024-09-21T07:25:42.290816+0000","last_became_active":"2024-09-21T07:25:40.313997+0000","last_became_peered":"2024-09-21T07:25:40.313997+0000","last_unstale":"2024-09-21T07:25:42.290816+0000","last_undegraded":"2024-09-21T07:25:42.290816+0000","last_fullsized":"2024-09-21T07:25:42.290816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.566202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.330540+0000","last_change":"2024-09-21T07:25:41.327857+0000","last_active":"2024-09-21T07:25:41.330540+0000","last_peered":"2024-09-21T07:25:41.330540+0000","last_clean":"2024-09-21T07:25:41.330540+0000","last_became_active":"2024-09-21T07:25:41.327330+0000","last_became_peered":"2024-09-21T07:25:41.327330+0000","last_unstale":"2024-09-21T07:25:41.330540+0000","last_undegraded":"2024-09-21T07:25:41.330540+0000","last_fullsized":"2024-09-21T07:25:41.330540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:06.529185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290510+0000","last_change":"2024-09-21T07:25:40.300775+0000","last_active":"2024-09-21T07:25:42.290510+0000","last_peered":"2024-09-21T07:25:42.290510+0000","last_clean":"2024-09-21T07:25:42.290510+0000","last_became_active":"2024-09-21T07:25:40.300245+0000","last_became_peered":"2024-09-21T07:25:40.300245+0000","last_unstale":"2024-09-21T07:25:42.290510+0000","last_undegraded":"2024-09-21T07:25:42.290510+0000","last_fullsized":"2024-09-21T07:25:42.290510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291277+0000","last_change":"2024-09-21T07:25:40.291277+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291277+0000","last_undegraded":"2024-09-21T07:25:40.291277+0000","last_fullsized":"2024-09-21T07:25:40.291277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299023+0000","last_change":"2024-09-21T07:25:40.304077+0000","last_active":"2024-09-21T07:25:41.299023+0000","last_peered":"2024-09-21T07:25:41.299023+0000","last_clean":"2024-09-21T07:25:41.299023+0000","last_became_active":"2024-09-21T07:25:40.303202+0000","last_became_peered":"2024-09-21T07:25:40.303202+0000","last_unstale":"2024-09-21T07:25:41.299023+0000","last_undegraded":"2024-09-21T07:25:41.299023+0000","last_fullsized":"2024-09-21T07:25:41.299023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.778348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324540+0000","last_change":"2024-09-21T07:25:41.314683+0000","last_active":"2024-09-21T07:25:41.324540+0000","last_peered":"2024-09-21T07:25:41.324540+0000","last_clean":"2024-09-21T07:25:41.324540+0000","last_became_active":"2024-09-21T07:25:41.314189+0000","last_became_peered":"2024-09-21T07:25:41.314189+0000","last_unstale":"2024-09-21T07:25:41.324540+0000","last_undegraded":"2024-09-21T07:25:41.324540+0000","last_fullsized":"2024-09-21T07:25:41.324540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:40.181308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289294+0000","last_change":"2024-09-21T07:25:40.316177+0000","last_active":"2024-09-21T07:25:42.289294+0000","last_peered":"2024-09-21T07:25:42.289294+0000","last_clean":"2024-09-21T07:25:42.289294+0000","last_became_active":"2024-09-21T07:25:40.314401+0000","last_became_peered":"2024-09-21T07:25:40.314401+0000","last_unstale":"2024-09-21T07:25:42.289294+0000","last_undegraded":"2024-09-21T07:25:42.289294+0000","last_fullsized":"2024-09-21T07:25:42.289294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:30.563754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290724+0000","last_change":"2024-09-21T07:25:41.325783+0000","last_active":"2024-09-21T07:25:42.290724+0000","last_peered":"2024-09-21T07:25:42.290724+0000","last_clean":"2024-09-21T07:25:42.290724+0000","last_became_active":"2024-09-21T07:25:41.325386+0000","last_became_peered":"2024-09-21T07:25:41.325386+0000","last_unstale":"2024-09-21T07:25:42.290724+0000","last_undegraded":"2024-09-21T07:25:42.290724+0000","last_fullsized":"2024-09-21T07:25:42.290724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296655+0000","last_change":"2024-09-21T07:25:40.306950+0000","last_active":"2024-09-21T07:25:41.296655+0000","last_peered":"2024-09-21T07:25:41.296655+0000","last_clean":"2024-09-21T07:25:41.296655+0000","last_became_active":"2024-09-21T07:25:40.306701+0000","last_became_peered":"2024-09-21T07:25:40.306701+0000","last_unstale":"2024-09-21T07:25:41.296655+0000","last_undegraded":"2024-09-21T07:25:41.296655+0000","last_fullsized":"2024-09-21T07:25:41.296655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.144853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320737+0000","last_change":"2024-09-21T07:25:41.317786+0000","last_active":"2024-09-21T07:25:41.320737+0000","last_peered":"2024-09-21T07:25:41.320737+0000","last_clean":"2024-09-21T07:25:41.320737+0000","last_became_active":"2024-09-21T07:25:41.317476+0000","last_became_peered":"2024-09-21T07:25:41.317476+0000","last_unstale":"2024-09-21T07:25:41.320737+0000","last_undegraded":"2024-09-21T07:25:41.320737+0000","last_fullsized":"2024-09-21T07:25:41.320737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:10.644829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290547+0000","last_change":"2024-09-21T07:25:40.314159+0000","last_active":"2024-09-21T07:25:42.290547+0000","last_peered":"2024-09-21T07:25:42.290547+0000","last_clean":"2024-09-21T07:25:42.290547+0000","last_became_active":"2024-09-21T07:25:40.313757+0000","last_became_peered":"2024-09-21T07:25:40.313757+0000","last_unstale":"2024-09-21T07:25:42.290547+0000","last_undegraded":"2024-09-21T07:25:42.290547+0000","last_fullsized":"2024-09-21T07:25:42.290547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289951+0000","last_change":"2024-09-21T07:25:41.325786+0000","last_active":"2024-09-21T07:25:42.289951+0000","last_peered":"2024-09-21T07:25:42.289951+0000","last_clean":"2024-09-21T07:25:42.289951+0000","last_became_active":"2024-09-21T07:25:41.321038+0000","last_became_peered":"2024-09-21T07:25:41.321038+0000","last_unstale":"2024-09-21T07:25:42.289951+0000","last_undegraded":"2024-09-21T07:25:42.289951+0000","last_fullsized":"2024-09-21T07:25:42.289951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:37.991238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329854+0000","last_change":"2024-09-21T07:25:40.310416+0000","last_active":"2024-09-21T07:25:41.329854+0000","last_peered":"2024-09-21T07:25:41.329854+0000","last_clean":"2024-09-21T07:25:41.329854+0000","last_became_active":"2024-09-21T07:25:40.310117+0000","last_became_peered":"2024-09-21T07:25:40.310117+0000","last_unstale":"2024-09-21T07:25:41.329854+0000","last_undegraded":"2024-09-21T07:25:41.329854+0000","last_fullsized":"2024-09-21T07:25:41.329854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:26.889094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290666+0000","last_change":"2024-09-21T07:25:41.318224+0000","last_active":"2024-09-21T07:25:42.290666+0000","last_peered":"2024-09-21T07:25:42.290666+0000","last_clean":"2024-09-21T07:25:42.290666+0000","last_became_active":"2024-09-21T07:25:41.317846+0000","last_became_peered":"2024-09-21T07:25:41.317846+0000","last_unstale":"2024-09-21T07:25:42.290666+0000","last_undegraded":"2024-09-21T07:25:42.290666+0000","last_fullsized":"2024-09-21T07:25:42.290666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:39.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324365+0000","last_change":"2024-09-21T07:25:40.320385+0000","last_active":"2024-09-21T07:25:40.324365+0000","last_peered":"2024-09-21T07:25:40.324365+0000","last_clean":"2024-09-21T07:25:40.324365+0000","last_became_active":"2024-09-21T07:25:40.320042+0000","last_became_peered":"2024-09-21T07:25:40.320042+0000","last_unstale":"2024-09-21T07:25:40.324365+0000","last_undegraded":"2024-09-21T07:25:40.324365+0000","last_fullsized":"2024-09-21T07:25:40.324365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:06.020101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304847+0000","last_change":"2024-09-21T07:25:41.300184+0000","last_active":"2024-09-21T07:25:41.304847+0000","last_peered":"2024-09-21T07:25:41.304847+0000","last_clean":"2024-09-21T07:25:41.304847+0000","last_became_active":"2024-09-21T07:25:41.299829+0000","last_became_peered":"2024-09-21T07:25:41.299829+0000","last_unstale":"2024-09-21T07:25:41.304847+0000","last_undegraded":"2024-09-21T07:25:41.304847+0000","last_fullsized":"2024-09-21T07:25:41.304847+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:36.479157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290966+0000","last_change":"2024-09-21T07:25:40.302488+0000","last_active":"2024-09-21T07:25:42.290966+0000","last_peered":"2024-09-21T07:25:42.290966+0000","last_clean":"2024-09-21T07:25:42.290966+0000","last_became_active":"2024-09-21T07:25:40.302167+0000","last_became_peered":"2024-09-21T07:25:40.302167+0000","last_unstale":"2024-09-21T07:25:42.290966+0000","last_undegraded":"2024-09-21T07:25:42.290966+0000","last_fullsized":"2024-09-21T07:25:42.290966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:51.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291230+0000","last_change":"2024-09-21T07:25:41.327602+0000","last_active":"2024-09-21T07:25:42.291230+0000","last_peered":"2024-09-21T07:25:42.291230+0000","last_clean":"2024-09-21T07:25:42.291230+0000","last_became_active":"2024-09-21T07:25:41.327019+0000","last_became_peered":"2024-09-21T07:25:41.327019+0000","last_unstale":"2024-09-21T07:25:42.291230+0000","last_undegraded":"2024-09-21T07:25:42.291230+0000","last_fullsized":"2024-09-21T07:25:42.291230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:12.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299874+0000","last_change":"2024-09-21T07:25:40.317734+0000","last_active":"2024-09-21T07:25:41.299874+0000","last_peered":"2024-09-21T07:25:41.299874+0000","last_clean":"2024-09-21T07:25:41.299874+0000","last_became_active":"2024-09-21T07:25:40.317367+0000","last_became_peered":"2024-09-21T07:25:40.317367+0000","last_unstale":"2024-09-21T07:25:41.299874+0000","last_undegraded":"2024-09-21T07:25:41.299874+0000","last_fullsized":"2024-09-21T07:25:41.299874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:44.995490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.294143+0000","last_change":"2024-09-21T07:25:40.294143+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.294143+0000","last_undegraded":"2024-09-21T07:25:40.294143+0000","last_fullsized":"2024-09-21T07:25:40.294143+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295401+0000","last_change":"2024-09-21T07:25:40.306199+0000","last_active":"2024-09-21T07:25:41.295401+0000","last_peered":"2024-09-21T07:25:41.295401+0000","last_clean":"2024-09-21T07:25:41.295401+0000","last_became_active":"2024-09-21T07:25:40.305769+0000","last_became_peered":"2024-09-21T07:25:40.305769+0000","last_unstale":"2024-09-21T07:25:41.295401+0000","last_undegraded":"2024-09-21T07:25:41.295401+0000","last_fullsized":"2024-09-21T07:25:41.295401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:48.912974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291644+0000","last_change":"2024-09-21T07:25:41.319773+0000","last_active":"2024-09-21T07:25:42.291644+0000","last_peered":"2024-09-21T07:25:42.291644+0000","last_clean":"2024-09-21T07:25:42.291644+0000","last_became_active":"2024-09-21T07:25:41.319373+0000","last_became_peered":"2024-09-21T07:25:41.319373+0000","last_unstale":"2024-09-21T07:25:42.291644+0000","last_undegraded":"2024-09-21T07:25:42.291644+0000","last_fullsized":"2024-09-21T07:25:42.291644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.713156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324299+0000","last_change":"2024-09-21T07:25:40.320257+0000","last_active":"2024-09-21T07:25:40.324299+0000","last_peered":"2024-09-21T07:25:40.324299+0000","last_clean":"2024-09-21T07:25:40.324299+0000","last_became_active":"2024-09-21T07:25:40.319892+0000","last_became_peered":"2024-09-21T07:25:40.319892+0000","last_unstale":"2024-09-21T07:25:40.324299+0000","last_undegraded":"2024-09-21T07:25:40.324299+0000","last_fullsized":"2024-09-21T07:25:40.324299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:12.911219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290769+0000","last_change":"2024-09-21T07:25:40.290769+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290769+0000","last_undegraded":"2024-09-21T07:25:40.290769+0000","last_fullsized":"2024-09-21T07:25:40.290769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291715+0000","last_change":"2024-09-21T07:25:40.319267+0000","last_active":"2024-09-21T07:25:42.291715+0000","last_peered":"2024-09-21T07:25:42.291715+0000","last_clean":"2024-09-21T07:25:42.291715+0000","last_became_active":"2024-09-21T07:25:40.318983+0000","last_became_peered":"2024-09-21T07:25:40.318983+0000","last_unstale":"2024-09-21T07:25:42.291715+0000","last_undegraded":"2024-09-21T07:25:42.291715+0000","last_fullsized":"2024-09-21T07:25:42.291715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.322153+0000","last_change":"2024-09-21T07:25:41.308091+0000","last_active":"2024-09-21T07:25:41.322153+0000","last_peered":"2024-09-21T07:25:41.322153+0000","last_clean":"2024-09-21T07:25:41.322153+0000","last_became_active":"2024-09-21T07:25:41.306860+0000","last_became_peered":"2024-09-21T07:25:41.306860+0000","last_unstale":"2024-09-21T07:25:41.322153+0000","last_undegraded":"2024-09-21T07:25:41.322153+0000","last_fullsized":"2024-09-21T07:25:41.322153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290782+0000","last_change":"2024-09-21T07:25:40.312155+0000","last_active":"2024-09-21T07:25:42.290782+0000","last_peered":"2024-09-21T07:25:42.290782+0000","last_clean":"2024-09-21T07:25:42.290782+0000","last_became_active":"2024-09-21T07:25:40.311878+0000","last_became_peered":"2024-09-21T07:25:40.311878+0000","last_unstale":"2024-09-21T07:25:42.290782+0000","last_undegraded":"2024-09-21T07:25:42.290782+0000","last_fullsized":"2024-09-21T07:25:42.290782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290206+0000","last_change":"2024-09-21T07:25:41.317327+0000","last_active":"2024-09-21T07:25:42.290206+0000","last_peered":"2024-09-21T07:25:42.290206+0000","last_clean":"2024-09-21T07:25:42.290206+0000","last_became_active":"2024-09-21T07:25:41.316941+0000","last_became_peered":"2024-09-21T07:25:41.316941+0000","last_unstale":"2024-09-21T07:25:42.290206+0000","last_undegraded":"2024-09-21T07:25:42.290206+0000","last_fullsized":"2024-09-21T07:25:42.290206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:56.746588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329918+0000","last_change":"2024-09-21T07:25:40.310464+0000","last_active":"2024-09-21T07:25:41.329918+0000","last_peered":"2024-09-21T07:25:41.329918+0000","last_clean":"2024-09-21T07:25:41.329918+0000","last_became_active":"2024-09-21T07:25:40.310137+0000","last_became_peered":"2024-09-21T07:25:40.310137+0000","last_unstale":"2024-09-21T07:25:41.329918+0000","last_undegraded":"2024-09-21T07:25:41.329918+0000","last_fullsized":"2024-09-21T07:25:41.329918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.325952+0000","last_change":"2024-09-21T07:25:41.317689+0000","last_active":"2024-09-21T07:25:41.325952+0000","last_peered":"2024-09-21T07:25:41.325952+0000","last_clean":"2024-09-21T07:25:41.325952+0000","last_became_active":"2024-09-21T07:25:41.317350+0000","last_became_peered":"2024-09-21T07:25:41.317350+0000","last_unstale":"2024-09-21T07:25:41.325952+0000","last_undegraded":"2024-09-21T07:25:41.325952+0000","last_fullsized":"2024-09-21T07:25:41.325952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:26.445844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.302580+0000","last_change":"2024-09-21T07:25:40.297950+0000","last_active":"2024-09-21T07:25:41.302580+0000","last_peered":"2024-09-21T07:25:41.302580+0000","last_clean":"2024-09-21T07:25:41.302580+0000","last_became_active":"2024-09-21T07:25:40.297646+0000","last_became_peered":"2024-09-21T07:25:40.297646+0000","last_unstale":"2024-09-21T07:25:41.302580+0000","last_undegraded":"2024-09-21T07:25:41.302580+0000","last_fullsized":"2024-09-21T07:25:41.302580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.321829+0000","last_change":"2024-09-21T07:25:41.318730+0000","last_active":"2024-09-21T07:25:41.321829+0000","last_peered":"2024-09-21T07:25:41.321829+0000","last_clean":"2024-09-21T07:25:41.321829+0000","last_became_active":"2024-09-21T07:25:41.318385+0000","last_became_peered":"2024-09-21T07:25:41.318385+0000","last_unstale":"2024-09-21T07:25:41.321829+0000","last_undegraded":"2024-09-21T07:25:41.321829+0000","last_fullsized":"2024-09-21T07:25:41.321829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.371793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333026+0000","last_change":"2024-09-21T07:25:40.303959+0000","last_active":"2024-09-21T07:25:41.333026+0000","last_peered":"2024-09-21T07:25:41.333026+0000","last_clean":"2024-09-21T07:25:41.333026+0000","last_became_active":"2024-09-21T07:25:40.303536+0000","last_became_peered":"2024-09-21T07:25:40.303536+0000","last_unstale":"2024-09-21T07:25:41.333026+0000","last_undegraded":"2024-09-21T07:25:41.333026+0000","last_fullsized":"2024-09-21T07:25:41.333026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.849393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320809+0000","last_change":"2024-09-21T07:25:41.317374+0000","last_active":"2024-09-21T07:25:41.320809+0000","last_peered":"2024-09-21T07:25:41.320809+0000","last_clean":"2024-09-21T07:25:41.320809+0000","last_became_active":"2024-09-21T07:25:41.317069+0000","last_became_peered":"2024-09-21T07:25:41.317069+0000","last_unstale":"2024-09-21T07:25:41.320809+0000","last_undegraded":"2024-09-21T07:25:41.320809+0000","last_fullsized":"2024-09-21T07:25:41.320809+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:06.420983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324403+0000","last_change":"2024-09-21T07:25:40.320288+0000","last_active":"2024-09-21T07:25:40.324403+0000","last_peered":"2024-09-21T07:25:40.324403+0000","last_clean":"2024-09-21T07:25:40.324403+0000","last_became_active":"2024-09-21T07:25:40.319933+0000","last_became_peered":"2024-09-21T07:25:40.319933+0000","last_unstale":"2024-09-21T07:25:40.324403+0000","last_undegraded":"2024-09-21T07:25:40.324403+0000","last_fullsized":"2024-09-21T07:25:40.324403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:00.058702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291482+0000","last_change":"2024-09-21T07:25:41.321249+0000","last_active":"2024-09-21T07:25:42.291482+0000","last_peered":"2024-09-21T07:25:42.291482+0000","last_clean":"2024-09-21T07:25:42.291482+0000","last_became_active":"2024-09-21T07:25:41.320883+0000","last_became_peered":"2024-09-21T07:25:41.320883+0000","last_unstale":"2024-09-21T07:25:42.291482+0000","last_undegraded":"2024-09-21T07:25:42.291482+0000","last_fullsized":"2024-09-21T07:25:42.291482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:20.932587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289545+0000","last_change":"2024-09-21T07:25:40.314157+0000","last_active":"2024-09-21T07:25:42.289545+0000","last_peered":"2024-09-21T07:25:42.289545+0000","last_clean":"2024-09-21T07:25:42.289545+0000","last_became_active":"2024-09-21T07:25:40.313354+0000","last_became_peered":"2024-09-21T07:25:40.313354+0000","last_unstale":"2024-09-21T07:25:42.289545+0000","last_undegraded":"2024-09-21T07:25:42.289545+0000","last_fullsized":"2024-09-21T07:25:42.289545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:38.743430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328444+0000","last_change":"2024-09-21T07:25:41.320071+0000","last_active":"2024-09-21T07:25:41.328444+0000","last_peered":"2024-09-21T07:25:41.328444+0000","last_clean":"2024-09-21T07:25:41.328444+0000","last_became_active":"2024-09-21T07:25:41.319671+0000","last_became_peered":"2024-09-21T07:25:41.319671+0000","last_unstale":"2024-09-21T07:25:41.328444+0000","last_undegraded":"2024-09-21T07:25:41.328444+0000","last_fullsized":"2024-09-21T07:25:41.328444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:48.351611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290034+0000","last_change":"2024-09-21T07:25:40.312679+0000","last_active":"2024-09-21T07:25:42.290034+0000","last_peered":"2024-09-21T07:25:42.290034+0000","last_clean":"2024-09-21T07:25:42.290034+0000","last_became_active":"2024-09-21T07:25:40.312297+0000","last_became_peered":"2024-09-21T07:25:40.312297+0000","last_unstale":"2024-09-21T07:25:42.290034+0000","last_undegraded":"2024-09-21T07:25:42.290034+0000","last_fullsized":"2024-09-21T07:25:42.290034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.313616+0000","last_change":"2024-09-21T07:25:41.308574+0000","last_active":"2024-09-21T07:25:41.313616+0000","last_peered":"2024-09-21T07:25:41.313616+0000","last_clean":"2024-09-21T07:25:41.313616+0000","last_became_active":"2024-09-21T07:25:41.307890+0000","last_became_peered":"2024-09-21T07:25:41.307890+0000","last_unstale":"2024-09-21T07:25:41.313616+0000","last_undegraded":"2024-09-21T07:25:41.313616+0000","last_fullsized":"2024-09-21T07:25:41.313616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:52.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333494+0000","last_change":"2024-09-21T07:25:40.317705+0000","last_active":"2024-09-21T07:25:41.333494+0000","last_peered":"2024-09-21T07:25:41.333494+0000","last_clean":"2024-09-21T07:25:41.333494+0000","last_became_active":"2024-09-21T07:25:40.317305+0000","last_became_peered":"2024-09-21T07:25:40.317305+0000","last_unstale":"2024-09-21T07:25:41.333494+0000","last_undegraded":"2024-09-21T07:25:41.333494+0000","last_fullsized":"2024-09-21T07:25:41.333494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:37.686640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.338369+0000","last_change":"2024-09-21T07:25:41.336080+0000","last_active":"2024-09-21T07:25:41.338369+0000","last_peered":"2024-09-21T07:25:41.338369+0000","last_clean":"2024-09-21T07:25:41.338369+0000","last_became_active":"2024-09-21T07:25:41.333501+0000","last_became_peered":"2024-09-21T07:25:41.333501+0000","last_unstale":"2024-09-21T07:25:41.338369+0000","last_undegraded":"2024-09-21T07:25:41.338369+0000","last_fullsized":"2024-09-21T07:25:41.338369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:51.951671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296126+0000","last_change":"2024-09-21T07:25:40.316378+0000","last_active":"2024-09-21T07:25:41.296126+0000","last_peered":"2024-09-21T07:25:41.296126+0000","last_clean":"2024-09-21T07:25:41.296126+0000","last_became_active":"2024-09-21T07:25:40.316066+0000","last_became_peered":"2024-09-21T07:25:40.316066+0000","last_unstale":"2024-09-21T07:25:41.296126+0000","last_undegraded":"2024-09-21T07:25:41.296126+0000","last_fullsized":"2024-09-21T07:25:41.296126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:48.460925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290705+0000","last_change":"2024-09-21T07:25:40.290705+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290705+0000","last_undegraded":"2024-09-21T07:25:40.290705+0000","last_fullsized":"2024-09-21T07:25:40.290705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290436+0000","last_change":"2024-09-21T07:25:40.313910+0000","last_active":"2024-09-21T07:25:42.290436+0000","last_peered":"2024-09-21T07:25:42.290436+0000","last_clean":"2024-09-21T07:25:42.290436+0000","last_became_active":"2024-09-21T07:25:40.313570+0000","last_became_peered":"2024-09-21T07:25:40.313570+0000","last_unstale":"2024-09-21T07:25:42.290436+0000","last_undegraded":"2024-09-21T07:25:42.290436+0000","last_fullsized":"2024-09-21T07:25:42.290436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290319+0000","last_change":"2024-09-21T07:25:41.325207+0000","last_active":"2024-09-21T07:25:42.290319+0000","last_peered":"2024-09-21T07:25:42.290319+0000","last_clean":"2024-09-21T07:25:42.290319+0000","last_became_active":"2024-09-21T07:25:41.324878+0000","last_became_peered":"2024-09-21T07:25:41.324878+0000","last_unstale":"2024-09-21T07:25:42.290319+0000","last_undegraded":"2024-09-21T07:25:42.290319+0000","last_fullsized":"2024-09-21T07:25:42.290319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.912084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324368+0000","last_change":"2024-09-21T07:25:40.320634+0000","last_active":"2024-09-21T07:25:40.324368+0000","last_peered":"2024-09-21T07:25:40.324368+0000","last_clean":"2024-09-21T07:25:40.324368+0000","last_became_active":"2024-09-21T07:25:40.320142+0000","last_became_peered":"2024-09-21T07:25:40.320142+0000","last_unstale":"2024-09-21T07:25:40.324368+0000","last_undegraded":"2024-09-21T07:25:40.324368+0000","last_fullsized":"2024-09-21T07:25:40.324368+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:58.661817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304718+0000","last_change":"2024-09-21T07:25:41.300389+0000","last_active":"2024-09-21T07:25:41.304718+0000","last_peered":"2024-09-21T07:25:41.304718+0000","last_clean":"2024-09-21T07:25:41.304718+0000","last_became_active":"2024-09-21T07:25:41.300063+0000","last_became_peered":"2024-09-21T07:25:41.300063+0000","last_unstale":"2024-09-21T07:25:41.304718+0000","last_undegraded":"2024-09-21T07:25:41.304718+0000","last_fullsized":"2024-09-21T07:25:41.304718+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:11.485694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.309145+0000","last_change":"2024-09-21T07:25:40.305976+0000","last_active":"2024-09-21T07:25:40.309145+0000","last_peered":"2024-09-21T07:25:40.309145+0000","last_clean":"2024-09-21T07:25:40.309145+0000","last_became_active":"2024-09-21T07:25:40.305647+0000","last_became_peered":"2024-09-21T07:25:40.305647+0000","last_unstale":"2024-09-21T07:25:40.309145+0000","last_undegraded":"2024-09-21T07:25:40.309145+0000","last_fullsized":"2024-09-21T07:25:40.309145+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:42.472958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291020+0000","last_change":"2024-09-21T07:25:41.331719+0000","last_active":"2024-09-21T07:25:42.291020+0000","last_peered":"2024-09-21T07:25:42.291020+0000","last_clean":"2024-09-21T07:25:42.291020+0000","last_became_active":"2024-09-21T07:25:41.331422+0000","last_became_peered":"2024-09-21T07:25:41.331422+0000","last_unstale":"2024-09-21T07:25:42.291020+0000","last_undegraded":"2024-09-21T07:25:42.291020+0000","last_fullsized":"2024-09-21T07:25:42.291020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290086+0000","last_change":"2024-09-21T07:25:40.307486+0000","last_active":"2024-09-21T07:25:42.290086+0000","last_peered":"2024-09-21T07:25:42.290086+0000","last_clean":"2024-09-21T07:25:42.290086+0000","last_became_active":"2024-09-21T07:25:40.307093+0000","last_became_peered":"2024-09-21T07:25:40.307093+0000","last_unstale":"2024-09-21T07:25:42.290086+0000","last_undegraded":"2024-09-21T07:25:42.290086+0000","last_fullsized":"2024-09-21T07:25:42.290086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:38.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291012+0000","last_change":"2024-09-21T07:25:40.291012+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291012+0000","last_undegraded":"2024-09-21T07:25:40.291012+0000","last_fullsized":"2024-09-21T07:25:40.291012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.292824+0000","last_change":"2024-09-21T07:25:40.305212+0000","last_active":"2024-09-21T07:25:41.292824+0000","last_peered":"2024-09-21T07:25:41.292824+0000","last_clean":"2024-09-21T07:25:41.292824+0000","last_became_active":"2024-09-21T07:25:40.304548+0000","last_became_peered":"2024-09-21T07:25:40.304548+0000","last_unstale":"2024-09-21T07:25:41.292824+0000","last_undegraded":"2024-09-21T07:25:41.292824+0000","last_fullsized":"2024-09-21T07:25:41.292824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:38.547032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.316448+0000","last_change":"2024-09-21T07:25:41.306132+0000","last_active":"2024-09-21T07:25:41.316448+0000","last_peered":"2024-09-21T07:25:41.316448+0000","last_clean":"2024-09-21T07:25:41.316448+0000","last_became_active":"2024-09-21T07:25:41.305750+0000","last_became_peered":"2024-09-21T07:25:41.305750+0000","last_unstale":"2024-09-21T07:25:41.316448+0000","last_undegraded":"2024-09-21T07:25:41.316448+0000","last_fullsized":"2024-09-21T07:25:41.316448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.511649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293055+0000","last_change":"2024-09-21T07:25:40.313563+0000","last_active":"2024-09-21T07:25:42.293055+0000","last_peered":"2024-09-21T07:25:42.293055+0000","last_clean":"2024-09-21T07:25:42.293055+0000","last_became_active":"2024-09-21T07:25:40.313179+0000","last_became_peered":"2024-09-21T07:25:40.313179+0000","last_unstale":"2024-09-21T07:25:42.293055+0000","last_undegraded":"2024-09-21T07:25:42.293055+0000","last_fullsized":"2024-09-21T07:25:42.293055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:22.021254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295066+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:25:41.295066+0000","last_peered":"2024-09-21T07:25:41.295066+0000","last_clean":"2024-09-21T07:25:41.295066+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:25:41.295066+0000","last_undegraded":"2024-09-21T07:25:41.295066+0000","last_fullsized":"2024-09-21T07:25:41.295066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":655360,"data_stored":290246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":647168,"data_stored":289594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":651264,"data_stored":290176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":671744,"data_stored":297898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":655360,"data_stored":289754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1228800,"data_stored":872795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":634880,"data_stored":282427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:25:46.353 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-21T07:25:46.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.296701+0000', 'last_change': '2024-09-21T07:25:40.296701+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.296701+0000', 'last_undegraded': '2024-09-21T07:25:40.296701+0000', 'last_fullsized': '2024-09-21T07:25:40.296701+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.353 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-21T07:25:46.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.296336+0000', 'last_change': '2024-09-21T07:25:40.296336+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.296336+0000', 'last_undegraded': '2024-09-21T07:25:40.296336+0000', 'last_fullsized': '2024-09-21T07:25:40.296336+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.354 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-21T07:25:46.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.299360+0000', 'last_change': '2024-09-21T07:25:40.299360+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.299360+0000', 'last_undegraded': '2024-09-21T07:25:40.299360+0000', 'last_fullsized': '2024-09-21T07:25:40.299360+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.354 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-21T07:25:46.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.299892+0000', 'last_change': '2024-09-21T07:25:40.299892+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.299892+0000', 'last_undegraded': '2024-09-21T07:25:40.299892+0000', 'last_fullsized': '2024-09-21T07:25:40.299892+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.354 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-21T07:25:46.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.295949+0000', 'last_change': '2024-09-21T07:25:40.295949+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.295949+0000', 'last_undegraded': '2024-09-21T07:25:40.295949+0000', 'last_fullsized': '2024-09-21T07:25:40.295949+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.355 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-21T07:25:46.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.291251+0000', 'last_change': '2024-09-21T07:25:40.291251+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.291251+0000', 'last_undegraded': '2024-09-21T07:25:40.291251+0000', 'last_fullsized': '2024-09-21T07:25:40.291251+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.355 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-21T07:25:46.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.291277+0000', 'last_change': '2024-09-21T07:25:40.291277+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.291277+0000', 'last_undegraded': '2024-09-21T07:25:40.291277+0000', 'last_fullsized': '2024-09-21T07:25:40.291277+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.356 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-21T07:25:46.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.294143+0000', 'last_change': '2024-09-21T07:25:40.294143+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.294143+0000', 'last_undegraded': '2024-09-21T07:25:40.294143+0000', 'last_fullsized': '2024-09-21T07:25:40.294143+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.356 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-21T07:25:46.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.290769+0000', 'last_change': '2024-09-21T07:25:40.290769+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.290769+0000', 'last_undegraded': '2024-09-21T07:25:40.290769+0000', 'last_fullsized': '2024-09-21T07:25:40.290769+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.356 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-21T07:25:46.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.290705+0000', 'last_change': '2024-09-21T07:25:40.290705+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.290705+0000', 'last_undegraded': '2024-09-21T07:25:40.290705+0000', 'last_fullsized': '2024-09-21T07:25:40.290705+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.357 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-21T07:25:46.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 54, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:25:40.291012+0000', 'last_change': '2024-09-21T07:25:40.291012+0000', 'last_active': '2024-09-21T07:25:40.275489+0000', 'last_peered': '2024-09-21T07:25:40.275489+0000', 'last_clean': '2024-09-21T07:25:40.275489+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:25:40.291012+0000', 'last_undegraded': '2024-09-21T07:25:40.291012+0000', 'last_fullsized': '2024-09-21T07:25:40.291012+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'last_clean_scrub_stamp': '2024-09-21T07:25:40.275489+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:25:46.358 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:25:46.511 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:25:46.505+0000 7fe8d2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:25:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 -- 172.21.15.64:0/3905899159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89bc004d50 msgr2=0x7f89bc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3905899159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89bc004d50 0x7f89bc005160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009eb0 tx=0x7f89d001d590 comp rx=0 tx=0).stop 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89ddc00640 1 -- 172.21.15.64:0/3905899159 reap_dead start 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 -- 172.21.15.64:0/3905899159 shutdown_connections 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 -- 172.21.15.64:0/3905899159 >> 172.21.15.64:0/3905899159 conn(0x7f89d806d1c0 msgr2=0x7f89d806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 -- 172.21.15.64:0/3905899159 shutdown_connections 2024-09-21T07:25:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 -- 172.21.15.64:0/3905899159 wait complete. 2024-09-21T07:25:46.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.541+0000 7f89dfc00640 1 Processor -- start 2024-09-21T07:25:46.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- start start 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89bc004d50 0x7f89d80ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89d80afbb0 0x7f89d8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80c6800 con 0x7f89d806f200 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80c6680 con 0x7f89bc004d50 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f89d80c6980 con 0x7f89d80afbb0 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35802/0 (socket says 172.21.15.64:35802) 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 -- 172.21.15.64:0/3167716686 learned_addr learned my addr 172.21.15.64:0/3167716686 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dd200640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89bc004d50 0x7f89d80ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89cfe00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89d80afbb0 0x7f89d8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 -- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89d80afbb0 msgr2=0x7f89d8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89d80afbb0 0x7f89d8157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 -- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89bc004d50 msgr2=0x7f89d80ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89bc004d50 0x7f89d80ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 -- 172.21.15.64:0/3167716686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d8075460 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89ddc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009eb0 tx=0x7f89d00abb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0009ab0 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89d00b9070 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d806fb50 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0009200 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.545+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d815e6f0 con 0x7f89d806f200 2024-09-21T07:25:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d80c6f10 con 0x7f89d806f200 2024-09-21T07:25:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89d00bb020 con 0x7f89d806f200 2024-09-21T07:25:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89d5600640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 0x7f89b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f89d012f6e0 con 0x7f89d806f200 2024-09-21T07:25:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89dd200640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 0x7f89b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.549+0000 7f89dd200640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 0x7f89b4075740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89c8001340 tx=0x7f89c8006960 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.553+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f89d806fb50 con 0x7f89d806f200 2024-09-21T07:25:46.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f89d815e1a0 con 0x7f89d806f200 2024-09-21T07:25:46.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89d5600640 1 -- 172.21.15.64:0/3167716686 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f89d00c2060 con 0x7f89d806f200 2024-09-21T07:25:46.798 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:46.798 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":204,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":591166,"bytes_used":296001536,"bytes_avail":772798111744,"bytes_total":773094113280,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":26,"btime":"2024-09-21T07:25:44:316261+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5376}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-21T07:25:29.461075+0000","services":{}},"progress_events":{}} 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 msgr2=0x7f89b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 0x7f89b4075740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89c8001340 tx=0x7f89c8006960 comp rx=0 tx=0).stop 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 msgr2=0x7f89d806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009eb0 tx=0x7f89d00abb00 comp rx=0 tx=0).stop 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 shutdown_connections 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89b4073230 0x7f89b4075740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d806f200 0x7f89d806f610 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89d80afbb0 0x7f89d8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 --2- 172.21.15.64:0/3167716686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89bc004d50 0x7f89d80ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.793+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 >> 172.21.15.64:0/3167716686 conn(0x7f89d806d1c0 msgr2=0x7f89d8159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:46.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.797+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 shutdown_connections 2024-09-21T07:25:46.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.797+0000 7f89dfc00640 1 -- 172.21.15.64:0/3167716686 wait complete. 2024-09-21T07:25:46.821 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:25:46.821 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 -- 172.21.15.64:0/4196719551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d400cf220 msgr2=0x7f1d40167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 --2- 172.21.15.64:0/4196719551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d400cf220 0x7f1d40167e60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009c80 tx=0x7f1d3801cda0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 -- 172.21.15.64:0/4196719551 shutdown_connections 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 --2- 172.21.15.64:0/4196719551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d400cf220 0x7f1d40167e60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 -- 172.21.15.64:0/4196719551 >> 172.21.15.64:0/4196719551 conn(0x7f1d4009b3e0 msgr2=0x7f1d400d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:46.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 -- 172.21.15.64:0/4196719551 shutdown_connections 2024-09-21T07:25:46.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.973+0000 7f1d3f200640 1 -- 172.21.15.64:0/4196719551 wait complete. 2024-09-21T07:25:46.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 Processor -- start 2024-09-21T07:25:46.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 -- start start 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d400cd9d0 0x7f1d4006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d400cdde0 0x7f1d4015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4016af50 con 0x7f1d401604e0 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4016add0 con 0x7f1d400cdde0 2024-09-21T07:25:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4016b0d0 con 0x7f1d400cd9d0 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35822/0 (socket says 172.21.15.64:35822) 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 -- 172.21.15.64:0/443053633 learned_addr learned my addr 172.21.15.64:0/443053633 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3de00640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d400cd9d0 0x7f1d4006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3d400640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d400cdde0 0x7f1d4015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 -- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d400cd9d0 msgr2=0x7f1d4006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d400cd9d0 0x7f1d4006fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 -- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d400cdde0 msgr2=0x7f1d4015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d400cdde0 0x7f1d4015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 -- 172.21.15.64:0/443053633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4006e910 con 0x7f1d401604e0 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3e800640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d3801a9d0 tx=0x7f1d380093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380bc070 con 0x7f1d401604e0 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d380ad8e0 con 0x7f1d401604e0 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.977+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4006ec40 con 0x7f1d401604e0 2024-09-21T07:25:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b2040 con 0x7f1d401604e0 2024-09-21T07:25:46.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4006f200 con 0x7f1d401604e0 2024-09-21T07:25:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d400cfd50 con 0x7f1d401604e0 2024-09-21T07:25:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1d380bf070 con 0x7f1d401604e0 2024-09-21T07:25:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d36000640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 0x7f1d20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f1d3812e370 con 0x7f1d401604e0 2024-09-21T07:25:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.981+0000 7f1d3de00640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 0x7f1d20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.985+0000 7f1d3de00640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 0x7f1d20075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000f70 tx=0x7f1d30009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:46.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:46.985+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1d38016990 con 0x7f1d401604e0 2024-09-21T07:25:47.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.161+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d4006e6a0 con 0x7f1d20073200 2024-09-21T07:25:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.165+0000 7f1d36000640 1 -- 172.21.15.64:0/443053633 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251030 (secure 0 0 0) 0x7f1d4006e6a0 con 0x7f1d20073200 2024-09-21T07:25:47.172 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 msgr2=0x7f1d20075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 0x7f1d20075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000f70 tx=0x7f1d30009040 comp rx=0 tx=0).stop 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 msgr2=0x7f1d401f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d3801a9d0 tx=0x7f1d380093d0 comp rx=0 tx=0).stop 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 shutdown_connections 2024-09-21T07:25:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1d20073200 0x7f1d20075710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d401604e0 0x7f1d401f86b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d400cdde0 0x7f1d4015fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 --2- 172.21.15.64:0/443053633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d400cd9d0 0x7f1d4006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 >> 172.21.15.64:0/443053633 conn(0x7f1d4009b3e0 msgr2=0x7f1d400b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 shutdown_connections 2024-09-21T07:25:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:47.169+0000 7f1d3f200640 1 -- 172.21.15.64:0/443053633 wait complete. 2024-09-21T07:25:47.193 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-21T07:25:45.464932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":128,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289064,"kb_used_data":6256,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685656,"statfs":{"total":773094113280,"available":772798111744,"internally_reserved":0,"allocated":6406144,"data_stored":3499600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":289394227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001744"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329360+0000","last_change":"2024-09-21T07:25:41.321256+0000","last_active":"2024-09-21T07:25:41.329360+0000","last_peered":"2024-09-21T07:25:41.329360+0000","last_clean":"2024-09-21T07:25:41.329360+0000","last_became_active":"2024-09-21T07:25:41.320849+0000","last_became_peered":"2024-09-21T07:25:41.320849+0000","last_unstale":"2024-09-21T07:25:41.329360+0000","last_undegraded":"2024-09-21T07:25:41.329360+0000","last_fullsized":"2024-09-21T07:25:41.329360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:00.666556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317664+0000","last_change":"2024-09-21T07:25:41.308998+0000","last_active":"2024-09-21T07:25:41.317664+0000","last_peered":"2024-09-21T07:25:41.317664+0000","last_clean":"2024-09-21T07:25:41.317664+0000","last_became_active":"2024-09-21T07:25:41.304931+0000","last_became_peered":"2024-09-21T07:25:41.304931+0000","last_unstale":"2024-09-21T07:25:41.317664+0000","last_undegraded":"2024-09-21T07:25:41.317664+0000","last_fullsized":"2024-09-21T07:25:41.317664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:11.226663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290754+0000","last_change":"2024-09-21T07:25:41.332498+0000","last_active":"2024-09-21T07:25:42.290754+0000","last_peered":"2024-09-21T07:25:42.290754+0000","last_clean":"2024-09-21T07:25:42.290754+0000","last_became_active":"2024-09-21T07:25:41.332144+0000","last_became_peered":"2024-09-21T07:25:41.332144+0000","last_unstale":"2024-09-21T07:25:42.290754+0000","last_undegraded":"2024-09-21T07:25:42.290754+0000","last_fullsized":"2024-09-21T07:25:42.290754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:53.495422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317350+0000","last_change":"2024-09-21T07:25:41.311763+0000","last_active":"2024-09-21T07:25:41.317350+0000","last_peered":"2024-09-21T07:25:41.317350+0000","last_clean":"2024-09-21T07:25:41.317350+0000","last_became_active":"2024-09-21T07:25:41.311364+0000","last_became_peered":"2024-09-21T07:25:41.311364+0000","last_unstale":"2024-09-21T07:25:41.317350+0000","last_undegraded":"2024-09-21T07:25:41.317350+0000","last_fullsized":"2024-09-21T07:25:41.317350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:54.558607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290340+0000","last_change":"2024-09-21T07:25:41.320818+0000","last_active":"2024-09-21T07:25:42.290340+0000","last_peered":"2024-09-21T07:25:42.290340+0000","last_clean":"2024-09-21T07:25:42.290340+0000","last_became_active":"2024-09-21T07:25:41.320501+0000","last_became_peered":"2024-09-21T07:25:41.320501+0000","last_unstale":"2024-09-21T07:25:42.290340+0000","last_undegraded":"2024-09-21T07:25:42.290340+0000","last_fullsized":"2024-09-21T07:25:42.290340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328607+0000","last_change":"2024-09-21T07:25:41.313826+0000","last_active":"2024-09-21T07:25:41.328607+0000","last_peered":"2024-09-21T07:25:41.328607+0000","last_clean":"2024-09-21T07:25:41.328607+0000","last_became_active":"2024-09-21T07:25:41.313523+0000","last_became_peered":"2024-09-21T07:25:41.313523+0000","last_unstale":"2024-09-21T07:25:41.328607+0000","last_undegraded":"2024-09-21T07:25:41.328607+0000","last_fullsized":"2024-09-21T07:25:41.328607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:00.288283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289414+0000","last_change":"2024-09-21T07:25:41.323024+0000","last_active":"2024-09-21T07:25:42.289414+0000","last_peered":"2024-09-21T07:25:42.289414+0000","last_clean":"2024-09-21T07:25:42.289414+0000","last_became_active":"2024-09-21T07:25:41.321726+0000","last_became_peered":"2024-09-21T07:25:41.321726+0000","last_unstale":"2024-09-21T07:25:42.289414+0000","last_undegraded":"2024-09-21T07:25:42.289414+0000","last_fullsized":"2024-09-21T07:25:42.289414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:58.224710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296701+0000","last_change":"2024-09-21T07:25:40.296701+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296701+0000","last_undegraded":"2024-09-21T07:25:40.296701+0000","last_fullsized":"2024-09-21T07:25:40.296701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.296336+0000","last_change":"2024-09-21T07:25:40.296336+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.296336+0000","last_undegraded":"2024-09-21T07:25:40.296336+0000","last_fullsized":"2024-09-21T07:25:40.296336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329438+0000","last_change":"2024-09-21T07:25:41.323561+0000","last_active":"2024-09-21T07:25:41.329438+0000","last_peered":"2024-09-21T07:25:41.329438+0000","last_clean":"2024-09-21T07:25:41.329438+0000","last_became_active":"2024-09-21T07:25:41.323254+0000","last_became_peered":"2024-09-21T07:25:41.323254+0000","last_unstale":"2024-09-21T07:25:41.329438+0000","last_undegraded":"2024-09-21T07:25:41.329438+0000","last_fullsized":"2024-09-21T07:25:41.329438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.562192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290637+0000","last_change":"2024-09-21T07:25:41.307219+0000","last_active":"2024-09-21T07:25:42.290637+0000","last_peered":"2024-09-21T07:25:42.290637+0000","last_clean":"2024-09-21T07:25:42.290637+0000","last_became_active":"2024-09-21T07:25:41.306872+0000","last_became_peered":"2024-09-21T07:25:41.306872+0000","last_unstale":"2024-09-21T07:25:42.290637+0000","last_undegraded":"2024-09-21T07:25:42.290637+0000","last_fullsized":"2024-09-21T07:25:42.290637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:04.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299360+0000","last_change":"2024-09-21T07:25:40.299360+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299360+0000","last_undegraded":"2024-09-21T07:25:40.299360+0000","last_fullsized":"2024-09-21T07:25:40.299360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328727+0000","last_change":"2024-09-21T07:25:41.321933+0000","last_active":"2024-09-21T07:25:41.328727+0000","last_peered":"2024-09-21T07:25:41.328727+0000","last_clean":"2024-09-21T07:25:41.328727+0000","last_became_active":"2024-09-21T07:25:41.321587+0000","last_became_peered":"2024-09-21T07:25:41.321587+0000","last_unstale":"2024-09-21T07:25:41.328727+0000","last_undegraded":"2024-09-21T07:25:41.328727+0000","last_fullsized":"2024-09-21T07:25:41.328727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:51.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289995+0000","last_change":"2024-09-21T07:25:41.331684+0000","last_active":"2024-09-21T07:25:42.289995+0000","last_peered":"2024-09-21T07:25:42.289995+0000","last_clean":"2024-09-21T07:25:42.289995+0000","last_became_active":"2024-09-21T07:25:41.331336+0000","last_became_peered":"2024-09-21T07:25:41.331336+0000","last_unstale":"2024-09-21T07:25:42.289995+0000","last_undegraded":"2024-09-21T07:25:42.289995+0000","last_fullsized":"2024-09-21T07:25:42.289995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.318009+0000","last_change":"2024-09-21T07:25:41.307391+0000","last_active":"2024-09-21T07:25:41.318009+0000","last_peered":"2024-09-21T07:25:41.318009+0000","last_clean":"2024-09-21T07:25:41.318009+0000","last_became_active":"2024-09-21T07:25:41.307053+0000","last_became_peered":"2024-09-21T07:25:41.307053+0000","last_unstale":"2024-09-21T07:25:41.318009+0000","last_undegraded":"2024-09-21T07:25:41.318009+0000","last_fullsized":"2024-09-21T07:25:41.318009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:43.295840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328963+0000","last_change":"2024-09-21T07:25:41.322745+0000","last_active":"2024-09-21T07:25:41.328963+0000","last_peered":"2024-09-21T07:25:41.328963+0000","last_clean":"2024-09-21T07:25:41.328963+0000","last_became_active":"2024-09-21T07:25:41.322403+0000","last_became_peered":"2024-09-21T07:25:41.322403+0000","last_unstale":"2024-09-21T07:25:41.328963+0000","last_undegraded":"2024-09-21T07:25:41.328963+0000","last_fullsized":"2024-09-21T07:25:41.328963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291554+0000","last_change":"2024-09-21T07:25:41.318017+0000","last_active":"2024-09-21T07:25:42.291554+0000","last_peered":"2024-09-21T07:25:42.291554+0000","last_clean":"2024-09-21T07:25:42.291554+0000","last_became_active":"2024-09-21T07:25:41.317536+0000","last_became_peered":"2024-09-21T07:25:41.317536+0000","last_unstale":"2024-09-21T07:25:42.291554+0000","last_undegraded":"2024-09-21T07:25:42.291554+0000","last_fullsized":"2024-09-21T07:25:42.291554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.914124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317633+0000","last_change":"2024-09-21T07:25:41.307572+0000","last_active":"2024-09-21T07:25:41.317633+0000","last_peered":"2024-09-21T07:25:41.317633+0000","last_clean":"2024-09-21T07:25:41.317633+0000","last_became_active":"2024-09-21T07:25:41.305007+0000","last_became_peered":"2024-09-21T07:25:41.305007+0000","last_unstale":"2024-09-21T07:25:41.317633+0000","last_undegraded":"2024-09-21T07:25:41.317633+0000","last_fullsized":"2024-09-21T07:25:41.317633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:09.870174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291167+0000","last_change":"2024-09-21T07:25:41.327304+0000","last_active":"2024-09-21T07:25:42.291167+0000","last_peered":"2024-09-21T07:25:42.291167+0000","last_clean":"2024-09-21T07:25:42.291167+0000","last_became_active":"2024-09-21T07:25:41.326612+0000","last_became_peered":"2024-09-21T07:25:41.326612+0000","last_unstale":"2024-09-21T07:25:42.291167+0000","last_undegraded":"2024-09-21T07:25:42.291167+0000","last_fullsized":"2024-09-21T07:25:42.291167+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:57.777429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324732+0000","last_change":"2024-09-21T07:25:41.320645+0000","last_active":"2024-09-21T07:25:41.324732+0000","last_peered":"2024-09-21T07:25:41.324732+0000","last_clean":"2024-09-21T07:25:41.324732+0000","last_became_active":"2024-09-21T07:25:41.320160+0000","last_became_peered":"2024-09-21T07:25:41.320160+0000","last_unstale":"2024-09-21T07:25:41.324732+0000","last_undegraded":"2024-09-21T07:25:41.324732+0000","last_fullsized":"2024-09-21T07:25:41.324732+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:19.056585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320639+0000","last_change":"2024-09-21T07:25:41.312932+0000","last_active":"2024-09-21T07:25:41.320639+0000","last_peered":"2024-09-21T07:25:41.320639+0000","last_clean":"2024-09-21T07:25:41.320639+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.320639+0000","last_undegraded":"2024-09-21T07:25:41.320639+0000","last_fullsized":"2024-09-21T07:25:41.320639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:36.305857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.299892+0000","last_change":"2024-09-21T07:25:40.299892+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.299892+0000","last_undegraded":"2024-09-21T07:25:40.299892+0000","last_fullsized":"2024-09-21T07:25:40.299892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290648+0000","last_change":"2024-09-21T07:25:41.313770+0000","last_active":"2024-09-21T07:25:42.290648+0000","last_peered":"2024-09-21T07:25:42.290648+0000","last_clean":"2024-09-21T07:25:42.290648+0000","last_became_active":"2024-09-21T07:25:41.313227+0000","last_became_peered":"2024-09-21T07:25:41.313227+0000","last_unstale":"2024-09-21T07:25:42.290648+0000","last_undegraded":"2024-09-21T07:25:42.290648+0000","last_fullsized":"2024-09-21T07:25:42.290648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:33.855213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289330+0000","last_change":"2024-09-21T07:25:41.309859+0000","last_active":"2024-09-21T07:25:42.289330+0000","last_peered":"2024-09-21T07:25:42.289330+0000","last_clean":"2024-09-21T07:25:42.289330+0000","last_became_active":"2024-09-21T07:25:41.309517+0000","last_became_peered":"2024-09-21T07:25:41.309517+0000","last_unstale":"2024-09-21T07:25:42.289330+0000","last_undegraded":"2024-09-21T07:25:42.289330+0000","last_fullsized":"2024-09-21T07:25:42.289330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291690+0000","last_change":"2024-09-21T07:25:41.336710+0000","last_active":"2024-09-21T07:25:42.291690+0000","last_peered":"2024-09-21T07:25:42.291690+0000","last_clean":"2024-09-21T07:25:42.291690+0000","last_became_active":"2024-09-21T07:25:41.335110+0000","last_became_peered":"2024-09-21T07:25:41.335110+0000","last_unstale":"2024-09-21T07:25:42.291690+0000","last_undegraded":"2024-09-21T07:25:42.291690+0000","last_fullsized":"2024-09-21T07:25:42.291690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:04.420434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.295949+0000","last_change":"2024-09-21T07:25:40.295949+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.295949+0000","last_undegraded":"2024-09-21T07:25:40.295949+0000","last_fullsized":"2024-09-21T07:25:40.295949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.326514+0000","last_change":"2024-09-21T07:25:41.318845+0000","last_active":"2024-09-21T07:25:41.326514+0000","last_peered":"2024-09-21T07:25:41.326514+0000","last_clean":"2024-09-21T07:25:41.326514+0000","last_became_active":"2024-09-21T07:25:41.318551+0000","last_became_peered":"2024-09-21T07:25:41.318551+0000","last_unstale":"2024-09-21T07:25:41.326514+0000","last_undegraded":"2024-09-21T07:25:41.326514+0000","last_fullsized":"2024-09-21T07:25:41.326514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:17.260581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333059+0000","last_change":"2024-09-21T07:25:41.329282+0000","last_active":"2024-09-21T07:25:41.333059+0000","last_peered":"2024-09-21T07:25:41.333059+0000","last_clean":"2024-09-21T07:25:41.333059+0000","last_became_active":"2024-09-21T07:25:41.328876+0000","last_became_peered":"2024-09-21T07:25:41.328876+0000","last_unstale":"2024-09-21T07:25:41.333059+0000","last_undegraded":"2024-09-21T07:25:41.333059+0000","last_fullsized":"2024-09-21T07:25:41.333059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:31.567156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290693+0000","last_change":"2024-09-21T07:25:41.321849+0000","last_active":"2024-09-21T07:25:42.290693+0000","last_peered":"2024-09-21T07:25:42.290693+0000","last_clean":"2024-09-21T07:25:42.290693+0000","last_became_active":"2024-09-21T07:25:41.321476+0000","last_became_peered":"2024-09-21T07:25:41.321476+0000","last_unstale":"2024-09-21T07:25:42.290693+0000","last_undegraded":"2024-09-21T07:25:42.290693+0000","last_fullsized":"2024-09-21T07:25:42.290693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:14.078446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.317264+0000","last_change":"2024-09-21T07:25:41.312897+0000","last_active":"2024-09-21T07:25:41.317264+0000","last_peered":"2024-09-21T07:25:41.317264+0000","last_clean":"2024-09-21T07:25:41.317264+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:41.317264+0000","last_undegraded":"2024-09-21T07:25:41.317264+0000","last_fullsized":"2024-09-21T07:25:41.317264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:43.056026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289405+0000","last_change":"2024-09-21T07:25:41.311045+0000","last_active":"2024-09-21T07:25:42.289405+0000","last_peered":"2024-09-21T07:25:42.289405+0000","last_clean":"2024-09-21T07:25:42.289405+0000","last_became_active":"2024-09-21T07:25:41.310726+0000","last_became_peered":"2024-09-21T07:25:41.310726+0000","last_unstale":"2024-09-21T07:25:42.289405+0000","last_undegraded":"2024-09-21T07:25:42.289405+0000","last_fullsized":"2024-09-21T07:25:42.289405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.305218+0000","last_change":"2024-09-21T07:25:41.300265+0000","last_active":"2024-09-21T07:25:41.305218+0000","last_peered":"2024-09-21T07:25:41.305218+0000","last_clean":"2024-09-21T07:25:41.305218+0000","last_became_active":"2024-09-21T07:25:41.299766+0000","last_became_peered":"2024-09-21T07:25:41.299766+0000","last_unstale":"2024-09-21T07:25:41.305218+0000","last_undegraded":"2024-09-21T07:25:41.305218+0000","last_fullsized":"2024-09-21T07:25:41.305218+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.310719+0000","last_change":"2024-09-21T07:25:41.305860+0000","last_active":"2024-09-21T07:25:41.310719+0000","last_peered":"2024-09-21T07:25:41.310719+0000","last_clean":"2024-09-21T07:25:41.310719+0000","last_became_active":"2024-09-21T07:25:41.305479+0000","last_became_peered":"2024-09-21T07:25:41.305479+0000","last_unstale":"2024-09-21T07:25:41.310719+0000","last_undegraded":"2024-09-21T07:25:41.310719+0000","last_fullsized":"2024-09-21T07:25:41.310719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:55.851412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.327948+0000","last_change":"2024-09-21T07:25:40.300521+0000","last_active":"2024-09-21T07:25:41.327948+0000","last_peered":"2024-09-21T07:25:41.327948+0000","last_clean":"2024-09-21T07:25:41.327948+0000","last_became_active":"2024-09-21T07:25:40.300196+0000","last_became_peered":"2024-09-21T07:25:40.300196+0000","last_unstale":"2024-09-21T07:25:41.327948+0000","last_undegraded":"2024-09-21T07:25:41.327948+0000","last_fullsized":"2024-09-21T07:25:41.327948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:12.727958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304725+0000","last_change":"2024-09-21T07:25:41.300373+0000","last_active":"2024-09-21T07:25:41.304725+0000","last_peered":"2024-09-21T07:25:41.304725+0000","last_clean":"2024-09-21T07:25:41.304725+0000","last_became_active":"2024-09-21T07:25:41.299865+0000","last_became_peered":"2024-09-21T07:25:41.299865+0000","last_unstale":"2024-09-21T07:25:41.304725+0000","last_undegraded":"2024-09-21T07:25:41.304725+0000","last_fullsized":"2024-09-21T07:25:41.304725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:27.770804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.334237+0000","last_change":"2024-09-21T07:25:40.308163+0000","last_active":"2024-09-21T07:25:41.334237+0000","last_peered":"2024-09-21T07:25:41.334237+0000","last_clean":"2024-09-21T07:25:41.334237+0000","last_became_active":"2024-09-21T07:25:40.307798+0000","last_became_peered":"2024-09-21T07:25:40.307798+0000","last_unstale":"2024-09-21T07:25:41.334237+0000","last_undegraded":"2024-09-21T07:25:41.334237+0000","last_fullsized":"2024-09-21T07:25:41.334237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:12.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.319334+0000","last_change":"2024-09-21T07:25:41.307900+0000","last_active":"2024-09-21T07:25:41.319334+0000","last_peered":"2024-09-21T07:25:41.319334+0000","last_clean":"2024-09-21T07:25:41.319334+0000","last_became_active":"2024-09-21T07:25:41.307573+0000","last_became_peered":"2024-09-21T07:25:41.307573+0000","last_unstale":"2024-09-21T07:25:41.319334+0000","last_undegraded":"2024-09-21T07:25:41.319334+0000","last_fullsized":"2024-09-21T07:25:41.319334+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:12.547817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.331023+0000","last_change":"2024-09-21T07:25:40.310055+0000","last_active":"2024-09-21T07:25:41.331023+0000","last_peered":"2024-09-21T07:25:41.331023+0000","last_clean":"2024-09-21T07:25:41.331023+0000","last_became_active":"2024-09-21T07:25:40.309774+0000","last_became_peered":"2024-09-21T07:25:40.309774+0000","last_unstale":"2024-09-21T07:25:41.331023+0000","last_undegraded":"2024-09-21T07:25:41.331023+0000","last_fullsized":"2024-09-21T07:25:41.331023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:26.643644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291251+0000","last_change":"2024-09-21T07:25:40.291251+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291251+0000","last_undegraded":"2024-09-21T07:25:40.291251+0000","last_fullsized":"2024-09-21T07:25:40.291251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333281+0000","last_change":"2024-09-21T07:25:40.308143+0000","last_active":"2024-09-21T07:25:41.333281+0000","last_peered":"2024-09-21T07:25:41.333281+0000","last_clean":"2024-09-21T07:25:41.333281+0000","last_became_active":"2024-09-21T07:25:40.307813+0000","last_became_peered":"2024-09-21T07:25:40.307813+0000","last_unstale":"2024-09-21T07:25:41.333281+0000","last_undegraded":"2024-09-21T07:25:41.333281+0000","last_fullsized":"2024-09-21T07:25:41.333281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:48.036611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290628+0000","last_change":"2024-09-21T07:25:41.318110+0000","last_active":"2024-09-21T07:25:42.290628+0000","last_peered":"2024-09-21T07:25:42.290628+0000","last_clean":"2024-09-21T07:25:42.290628+0000","last_became_active":"2024-09-21T07:25:41.317724+0000","last_became_peered":"2024-09-21T07:25:41.317724+0000","last_unstale":"2024-09-21T07:25:42.290628+0000","last_undegraded":"2024-09-21T07:25:42.290628+0000","last_fullsized":"2024-09-21T07:25:42.290628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290816+0000","last_change":"2024-09-21T07:25:40.314377+0000","last_active":"2024-09-21T07:25:42.290816+0000","last_peered":"2024-09-21T07:25:42.290816+0000","last_clean":"2024-09-21T07:25:42.290816+0000","last_became_active":"2024-09-21T07:25:40.313997+0000","last_became_peered":"2024-09-21T07:25:40.313997+0000","last_unstale":"2024-09-21T07:25:42.290816+0000","last_undegraded":"2024-09-21T07:25:42.290816+0000","last_fullsized":"2024-09-21T07:25:42.290816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.566202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.330540+0000","last_change":"2024-09-21T07:25:41.327857+0000","last_active":"2024-09-21T07:25:41.330540+0000","last_peered":"2024-09-21T07:25:41.330540+0000","last_clean":"2024-09-21T07:25:41.330540+0000","last_became_active":"2024-09-21T07:25:41.327330+0000","last_became_peered":"2024-09-21T07:25:41.327330+0000","last_unstale":"2024-09-21T07:25:41.330540+0000","last_undegraded":"2024-09-21T07:25:41.330540+0000","last_fullsized":"2024-09-21T07:25:41.330540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:06.529185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290510+0000","last_change":"2024-09-21T07:25:40.300775+0000","last_active":"2024-09-21T07:25:42.290510+0000","last_peered":"2024-09-21T07:25:42.290510+0000","last_clean":"2024-09-21T07:25:42.290510+0000","last_became_active":"2024-09-21T07:25:40.300245+0000","last_became_peered":"2024-09-21T07:25:40.300245+0000","last_unstale":"2024-09-21T07:25:42.290510+0000","last_undegraded":"2024-09-21T07:25:42.290510+0000","last_fullsized":"2024-09-21T07:25:42.290510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291277+0000","last_change":"2024-09-21T07:25:40.291277+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291277+0000","last_undegraded":"2024-09-21T07:25:40.291277+0000","last_fullsized":"2024-09-21T07:25:40.291277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299023+0000","last_change":"2024-09-21T07:25:40.304077+0000","last_active":"2024-09-21T07:25:41.299023+0000","last_peered":"2024-09-21T07:25:41.299023+0000","last_clean":"2024-09-21T07:25:41.299023+0000","last_became_active":"2024-09-21T07:25:40.303202+0000","last_became_peered":"2024-09-21T07:25:40.303202+0000","last_unstale":"2024-09-21T07:25:41.299023+0000","last_undegraded":"2024-09-21T07:25:41.299023+0000","last_fullsized":"2024-09-21T07:25:41.299023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.778348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.324540+0000","last_change":"2024-09-21T07:25:41.314683+0000","last_active":"2024-09-21T07:25:41.324540+0000","last_peered":"2024-09-21T07:25:41.324540+0000","last_clean":"2024-09-21T07:25:41.324540+0000","last_became_active":"2024-09-21T07:25:41.314189+0000","last_became_peered":"2024-09-21T07:25:41.314189+0000","last_unstale":"2024-09-21T07:25:41.324540+0000","last_undegraded":"2024-09-21T07:25:41.324540+0000","last_fullsized":"2024-09-21T07:25:41.324540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:40.181308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289294+0000","last_change":"2024-09-21T07:25:40.316177+0000","last_active":"2024-09-21T07:25:42.289294+0000","last_peered":"2024-09-21T07:25:42.289294+0000","last_clean":"2024-09-21T07:25:42.289294+0000","last_became_active":"2024-09-21T07:25:40.314401+0000","last_became_peered":"2024-09-21T07:25:40.314401+0000","last_unstale":"2024-09-21T07:25:42.289294+0000","last_undegraded":"2024-09-21T07:25:42.289294+0000","last_fullsized":"2024-09-21T07:25:42.289294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:30.563754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290724+0000","last_change":"2024-09-21T07:25:41.325783+0000","last_active":"2024-09-21T07:25:42.290724+0000","last_peered":"2024-09-21T07:25:42.290724+0000","last_clean":"2024-09-21T07:25:42.290724+0000","last_became_active":"2024-09-21T07:25:41.325386+0000","last_became_peered":"2024-09-21T07:25:41.325386+0000","last_unstale":"2024-09-21T07:25:42.290724+0000","last_undegraded":"2024-09-21T07:25:42.290724+0000","last_fullsized":"2024-09-21T07:25:42.290724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296655+0000","last_change":"2024-09-21T07:25:40.306950+0000","last_active":"2024-09-21T07:25:41.296655+0000","last_peered":"2024-09-21T07:25:41.296655+0000","last_clean":"2024-09-21T07:25:41.296655+0000","last_became_active":"2024-09-21T07:25:40.306701+0000","last_became_peered":"2024-09-21T07:25:40.306701+0000","last_unstale":"2024-09-21T07:25:41.296655+0000","last_undegraded":"2024-09-21T07:25:41.296655+0000","last_fullsized":"2024-09-21T07:25:41.296655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.144853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320737+0000","last_change":"2024-09-21T07:25:41.317786+0000","last_active":"2024-09-21T07:25:41.320737+0000","last_peered":"2024-09-21T07:25:41.320737+0000","last_clean":"2024-09-21T07:25:41.320737+0000","last_became_active":"2024-09-21T07:25:41.317476+0000","last_became_peered":"2024-09-21T07:25:41.317476+0000","last_unstale":"2024-09-21T07:25:41.320737+0000","last_undegraded":"2024-09-21T07:25:41.320737+0000","last_fullsized":"2024-09-21T07:25:41.320737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:10.644829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290547+0000","last_change":"2024-09-21T07:25:40.314159+0000","last_active":"2024-09-21T07:25:42.290547+0000","last_peered":"2024-09-21T07:25:42.290547+0000","last_clean":"2024-09-21T07:25:42.290547+0000","last_became_active":"2024-09-21T07:25:40.313757+0000","last_became_peered":"2024-09-21T07:25:40.313757+0000","last_unstale":"2024-09-21T07:25:42.290547+0000","last_undegraded":"2024-09-21T07:25:42.290547+0000","last_fullsized":"2024-09-21T07:25:42.290547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289951+0000","last_change":"2024-09-21T07:25:41.325786+0000","last_active":"2024-09-21T07:25:42.289951+0000","last_peered":"2024-09-21T07:25:42.289951+0000","last_clean":"2024-09-21T07:25:42.289951+0000","last_became_active":"2024-09-21T07:25:41.321038+0000","last_became_peered":"2024-09-21T07:25:41.321038+0000","last_unstale":"2024-09-21T07:25:42.289951+0000","last_undegraded":"2024-09-21T07:25:42.289951+0000","last_fullsized":"2024-09-21T07:25:42.289951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:37.991238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329854+0000","last_change":"2024-09-21T07:25:40.310416+0000","last_active":"2024-09-21T07:25:41.329854+0000","last_peered":"2024-09-21T07:25:41.329854+0000","last_clean":"2024-09-21T07:25:41.329854+0000","last_became_active":"2024-09-21T07:25:40.310117+0000","last_became_peered":"2024-09-21T07:25:40.310117+0000","last_unstale":"2024-09-21T07:25:41.329854+0000","last_undegraded":"2024-09-21T07:25:41.329854+0000","last_fullsized":"2024-09-21T07:25:41.329854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:26.889094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290666+0000","last_change":"2024-09-21T07:25:41.318224+0000","last_active":"2024-09-21T07:25:42.290666+0000","last_peered":"2024-09-21T07:25:42.290666+0000","last_clean":"2024-09-21T07:25:42.290666+0000","last_became_active":"2024-09-21T07:25:41.317846+0000","last_became_peered":"2024-09-21T07:25:41.317846+0000","last_unstale":"2024-09-21T07:25:42.290666+0000","last_undegraded":"2024-09-21T07:25:42.290666+0000","last_fullsized":"2024-09-21T07:25:42.290666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:39.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324365+0000","last_change":"2024-09-21T07:25:40.320385+0000","last_active":"2024-09-21T07:25:40.324365+0000","last_peered":"2024-09-21T07:25:40.324365+0000","last_clean":"2024-09-21T07:25:40.324365+0000","last_became_active":"2024-09-21T07:25:40.320042+0000","last_became_peered":"2024-09-21T07:25:40.320042+0000","last_unstale":"2024-09-21T07:25:40.324365+0000","last_undegraded":"2024-09-21T07:25:40.324365+0000","last_fullsized":"2024-09-21T07:25:40.324365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:06.020101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304847+0000","last_change":"2024-09-21T07:25:41.300184+0000","last_active":"2024-09-21T07:25:41.304847+0000","last_peered":"2024-09-21T07:25:41.304847+0000","last_clean":"2024-09-21T07:25:41.304847+0000","last_became_active":"2024-09-21T07:25:41.299829+0000","last_became_peered":"2024-09-21T07:25:41.299829+0000","last_unstale":"2024-09-21T07:25:41.304847+0000","last_undegraded":"2024-09-21T07:25:41.304847+0000","last_fullsized":"2024-09-21T07:25:41.304847+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:36.479157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290966+0000","last_change":"2024-09-21T07:25:40.302488+0000","last_active":"2024-09-21T07:25:42.290966+0000","last_peered":"2024-09-21T07:25:42.290966+0000","last_clean":"2024-09-21T07:25:42.290966+0000","last_became_active":"2024-09-21T07:25:40.302167+0000","last_became_peered":"2024-09-21T07:25:40.302167+0000","last_unstale":"2024-09-21T07:25:42.290966+0000","last_undegraded":"2024-09-21T07:25:42.290966+0000","last_fullsized":"2024-09-21T07:25:42.290966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:51.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291230+0000","last_change":"2024-09-21T07:25:41.327602+0000","last_active":"2024-09-21T07:25:42.291230+0000","last_peered":"2024-09-21T07:25:42.291230+0000","last_clean":"2024-09-21T07:25:42.291230+0000","last_became_active":"2024-09-21T07:25:41.327019+0000","last_became_peered":"2024-09-21T07:25:41.327019+0000","last_unstale":"2024-09-21T07:25:42.291230+0000","last_undegraded":"2024-09-21T07:25:42.291230+0000","last_fullsized":"2024-09-21T07:25:42.291230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:12.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.299874+0000","last_change":"2024-09-21T07:25:40.317734+0000","last_active":"2024-09-21T07:25:41.299874+0000","last_peered":"2024-09-21T07:25:41.299874+0000","last_clean":"2024-09-21T07:25:41.299874+0000","last_became_active":"2024-09-21T07:25:40.317367+0000","last_became_peered":"2024-09-21T07:25:40.317367+0000","last_unstale":"2024-09-21T07:25:41.299874+0000","last_undegraded":"2024-09-21T07:25:41.299874+0000","last_fullsized":"2024-09-21T07:25:41.299874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:44.995490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.294143+0000","last_change":"2024-09-21T07:25:40.294143+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.294143+0000","last_undegraded":"2024-09-21T07:25:40.294143+0000","last_fullsized":"2024-09-21T07:25:40.294143+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295401+0000","last_change":"2024-09-21T07:25:40.306199+0000","last_active":"2024-09-21T07:25:41.295401+0000","last_peered":"2024-09-21T07:25:41.295401+0000","last_clean":"2024-09-21T07:25:41.295401+0000","last_became_active":"2024-09-21T07:25:40.305769+0000","last_became_peered":"2024-09-21T07:25:40.305769+0000","last_unstale":"2024-09-21T07:25:41.295401+0000","last_undegraded":"2024-09-21T07:25:41.295401+0000","last_fullsized":"2024-09-21T07:25:41.295401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:48.912974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291644+0000","last_change":"2024-09-21T07:25:41.319773+0000","last_active":"2024-09-21T07:25:42.291644+0000","last_peered":"2024-09-21T07:25:42.291644+0000","last_clean":"2024-09-21T07:25:42.291644+0000","last_became_active":"2024-09-21T07:25:41.319373+0000","last_became_peered":"2024-09-21T07:25:41.319373+0000","last_unstale":"2024-09-21T07:25:42.291644+0000","last_undegraded":"2024-09-21T07:25:42.291644+0000","last_fullsized":"2024-09-21T07:25:42.291644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.713156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324299+0000","last_change":"2024-09-21T07:25:40.320257+0000","last_active":"2024-09-21T07:25:40.324299+0000","last_peered":"2024-09-21T07:25:40.324299+0000","last_clean":"2024-09-21T07:25:40.324299+0000","last_became_active":"2024-09-21T07:25:40.319892+0000","last_became_peered":"2024-09-21T07:25:40.319892+0000","last_unstale":"2024-09-21T07:25:40.324299+0000","last_undegraded":"2024-09-21T07:25:40.324299+0000","last_fullsized":"2024-09-21T07:25:40.324299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:12.911219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290769+0000","last_change":"2024-09-21T07:25:40.290769+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290769+0000","last_undegraded":"2024-09-21T07:25:40.290769+0000","last_fullsized":"2024-09-21T07:25:40.290769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291715+0000","last_change":"2024-09-21T07:25:40.319267+0000","last_active":"2024-09-21T07:25:42.291715+0000","last_peered":"2024-09-21T07:25:42.291715+0000","last_clean":"2024-09-21T07:25:42.291715+0000","last_became_active":"2024-09-21T07:25:40.318983+0000","last_became_peered":"2024-09-21T07:25:40.318983+0000","last_unstale":"2024-09-21T07:25:42.291715+0000","last_undegraded":"2024-09-21T07:25:42.291715+0000","last_fullsized":"2024-09-21T07:25:42.291715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.322153+0000","last_change":"2024-09-21T07:25:41.308091+0000","last_active":"2024-09-21T07:25:41.322153+0000","last_peered":"2024-09-21T07:25:41.322153+0000","last_clean":"2024-09-21T07:25:41.322153+0000","last_became_active":"2024-09-21T07:25:41.306860+0000","last_became_peered":"2024-09-21T07:25:41.306860+0000","last_unstale":"2024-09-21T07:25:41.322153+0000","last_undegraded":"2024-09-21T07:25:41.322153+0000","last_fullsized":"2024-09-21T07:25:41.322153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290782+0000","last_change":"2024-09-21T07:25:40.312155+0000","last_active":"2024-09-21T07:25:42.290782+0000","last_peered":"2024-09-21T07:25:42.290782+0000","last_clean":"2024-09-21T07:25:42.290782+0000","last_became_active":"2024-09-21T07:25:40.311878+0000","last_became_peered":"2024-09-21T07:25:40.311878+0000","last_unstale":"2024-09-21T07:25:42.290782+0000","last_undegraded":"2024-09-21T07:25:42.290782+0000","last_fullsized":"2024-09-21T07:25:42.290782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290206+0000","last_change":"2024-09-21T07:25:41.317327+0000","last_active":"2024-09-21T07:25:42.290206+0000","last_peered":"2024-09-21T07:25:42.290206+0000","last_clean":"2024-09-21T07:25:42.290206+0000","last_became_active":"2024-09-21T07:25:41.316941+0000","last_became_peered":"2024-09-21T07:25:41.316941+0000","last_unstale":"2024-09-21T07:25:42.290206+0000","last_undegraded":"2024-09-21T07:25:42.290206+0000","last_fullsized":"2024-09-21T07:25:42.290206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:56.746588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.329918+0000","last_change":"2024-09-21T07:25:40.310464+0000","last_active":"2024-09-21T07:25:41.329918+0000","last_peered":"2024-09-21T07:25:41.329918+0000","last_clean":"2024-09-21T07:25:41.329918+0000","last_became_active":"2024-09-21T07:25:40.310137+0000","last_became_peered":"2024-09-21T07:25:40.310137+0000","last_unstale":"2024-09-21T07:25:41.329918+0000","last_undegraded":"2024-09-21T07:25:41.329918+0000","last_fullsized":"2024-09-21T07:25:41.329918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.325952+0000","last_change":"2024-09-21T07:25:41.317689+0000","last_active":"2024-09-21T07:25:41.325952+0000","last_peered":"2024-09-21T07:25:41.325952+0000","last_clean":"2024-09-21T07:25:41.325952+0000","last_became_active":"2024-09-21T07:25:41.317350+0000","last_became_peered":"2024-09-21T07:25:41.317350+0000","last_unstale":"2024-09-21T07:25:41.325952+0000","last_undegraded":"2024-09-21T07:25:41.325952+0000","last_fullsized":"2024-09-21T07:25:41.325952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:26.445844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.302580+0000","last_change":"2024-09-21T07:25:40.297950+0000","last_active":"2024-09-21T07:25:41.302580+0000","last_peered":"2024-09-21T07:25:41.302580+0000","last_clean":"2024-09-21T07:25:41.302580+0000","last_became_active":"2024-09-21T07:25:40.297646+0000","last_became_peered":"2024-09-21T07:25:40.297646+0000","last_unstale":"2024-09-21T07:25:41.302580+0000","last_undegraded":"2024-09-21T07:25:41.302580+0000","last_fullsized":"2024-09-21T07:25:41.302580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.321829+0000","last_change":"2024-09-21T07:25:41.318730+0000","last_active":"2024-09-21T07:25:41.321829+0000","last_peered":"2024-09-21T07:25:41.321829+0000","last_clean":"2024-09-21T07:25:41.321829+0000","last_became_active":"2024-09-21T07:25:41.318385+0000","last_became_peered":"2024-09-21T07:25:41.318385+0000","last_unstale":"2024-09-21T07:25:41.321829+0000","last_undegraded":"2024-09-21T07:25:41.321829+0000","last_fullsized":"2024-09-21T07:25:41.321829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.371793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333026+0000","last_change":"2024-09-21T07:25:40.303959+0000","last_active":"2024-09-21T07:25:41.333026+0000","last_peered":"2024-09-21T07:25:41.333026+0000","last_clean":"2024-09-21T07:25:41.333026+0000","last_became_active":"2024-09-21T07:25:40.303536+0000","last_became_peered":"2024-09-21T07:25:40.303536+0000","last_unstale":"2024-09-21T07:25:41.333026+0000","last_undegraded":"2024-09-21T07:25:41.333026+0000","last_fullsized":"2024-09-21T07:25:41.333026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.849393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.320809+0000","last_change":"2024-09-21T07:25:41.317374+0000","last_active":"2024-09-21T07:25:41.320809+0000","last_peered":"2024-09-21T07:25:41.320809+0000","last_clean":"2024-09-21T07:25:41.320809+0000","last_became_active":"2024-09-21T07:25:41.317069+0000","last_became_peered":"2024-09-21T07:25:41.317069+0000","last_unstale":"2024-09-21T07:25:41.320809+0000","last_undegraded":"2024-09-21T07:25:41.320809+0000","last_fullsized":"2024-09-21T07:25:41.320809+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:06.420983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324403+0000","last_change":"2024-09-21T07:25:40.320288+0000","last_active":"2024-09-21T07:25:40.324403+0000","last_peered":"2024-09-21T07:25:40.324403+0000","last_clean":"2024-09-21T07:25:40.324403+0000","last_became_active":"2024-09-21T07:25:40.319933+0000","last_became_peered":"2024-09-21T07:25:40.319933+0000","last_unstale":"2024-09-21T07:25:40.324403+0000","last_undegraded":"2024-09-21T07:25:40.324403+0000","last_fullsized":"2024-09-21T07:25:40.324403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:00.058702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291482+0000","last_change":"2024-09-21T07:25:41.321249+0000","last_active":"2024-09-21T07:25:42.291482+0000","last_peered":"2024-09-21T07:25:42.291482+0000","last_clean":"2024-09-21T07:25:42.291482+0000","last_became_active":"2024-09-21T07:25:41.320883+0000","last_became_peered":"2024-09-21T07:25:41.320883+0000","last_unstale":"2024-09-21T07:25:42.291482+0000","last_undegraded":"2024-09-21T07:25:42.291482+0000","last_fullsized":"2024-09-21T07:25:42.291482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:20.932587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289545+0000","last_change":"2024-09-21T07:25:40.314157+0000","last_active":"2024-09-21T07:25:42.289545+0000","last_peered":"2024-09-21T07:25:42.289545+0000","last_clean":"2024-09-21T07:25:42.289545+0000","last_became_active":"2024-09-21T07:25:40.313354+0000","last_became_peered":"2024-09-21T07:25:40.313354+0000","last_unstale":"2024-09-21T07:25:42.289545+0000","last_undegraded":"2024-09-21T07:25:42.289545+0000","last_fullsized":"2024-09-21T07:25:42.289545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:38.743430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.328444+0000","last_change":"2024-09-21T07:25:41.320071+0000","last_active":"2024-09-21T07:25:41.328444+0000","last_peered":"2024-09-21T07:25:41.328444+0000","last_clean":"2024-09-21T07:25:41.328444+0000","last_became_active":"2024-09-21T07:25:41.319671+0000","last_became_peered":"2024-09-21T07:25:41.319671+0000","last_unstale":"2024-09-21T07:25:41.328444+0000","last_undegraded":"2024-09-21T07:25:41.328444+0000","last_fullsized":"2024-09-21T07:25:41.328444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:48.351611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290034+0000","last_change":"2024-09-21T07:25:40.312679+0000","last_active":"2024-09-21T07:25:42.290034+0000","last_peered":"2024-09-21T07:25:42.290034+0000","last_clean":"2024-09-21T07:25:42.290034+0000","last_became_active":"2024-09-21T07:25:40.312297+0000","last_became_peered":"2024-09-21T07:25:40.312297+0000","last_unstale":"2024-09-21T07:25:42.290034+0000","last_undegraded":"2024-09-21T07:25:42.290034+0000","last_fullsized":"2024-09-21T07:25:42.290034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.313616+0000","last_change":"2024-09-21T07:25:41.308574+0000","last_active":"2024-09-21T07:25:41.313616+0000","last_peered":"2024-09-21T07:25:41.313616+0000","last_clean":"2024-09-21T07:25:41.313616+0000","last_became_active":"2024-09-21T07:25:41.307890+0000","last_became_peered":"2024-09-21T07:25:41.307890+0000","last_unstale":"2024-09-21T07:25:41.313616+0000","last_undegraded":"2024-09-21T07:25:41.313616+0000","last_fullsized":"2024-09-21T07:25:41.313616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:52.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.333494+0000","last_change":"2024-09-21T07:25:40.317705+0000","last_active":"2024-09-21T07:25:41.333494+0000","last_peered":"2024-09-21T07:25:41.333494+0000","last_clean":"2024-09-21T07:25:41.333494+0000","last_became_active":"2024-09-21T07:25:40.317305+0000","last_became_peered":"2024-09-21T07:25:40.317305+0000","last_unstale":"2024-09-21T07:25:41.333494+0000","last_undegraded":"2024-09-21T07:25:41.333494+0000","last_fullsized":"2024-09-21T07:25:41.333494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:37.686640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.338369+0000","last_change":"2024-09-21T07:25:41.336080+0000","last_active":"2024-09-21T07:25:41.338369+0000","last_peered":"2024-09-21T07:25:41.338369+0000","last_clean":"2024-09-21T07:25:41.338369+0000","last_became_active":"2024-09-21T07:25:41.333501+0000","last_became_peered":"2024-09-21T07:25:41.333501+0000","last_unstale":"2024-09-21T07:25:41.338369+0000","last_undegraded":"2024-09-21T07:25:41.338369+0000","last_fullsized":"2024-09-21T07:25:41.338369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:51.951671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.296126+0000","last_change":"2024-09-21T07:25:40.316378+0000","last_active":"2024-09-21T07:25:41.296126+0000","last_peered":"2024-09-21T07:25:41.296126+0000","last_clean":"2024-09-21T07:25:41.296126+0000","last_became_active":"2024-09-21T07:25:40.316066+0000","last_became_peered":"2024-09-21T07:25:40.316066+0000","last_unstale":"2024-09-21T07:25:41.296126+0000","last_undegraded":"2024-09-21T07:25:41.296126+0000","last_fullsized":"2024-09-21T07:25:41.296126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:48.460925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.290705+0000","last_change":"2024-09-21T07:25:40.290705+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.290705+0000","last_undegraded":"2024-09-21T07:25:40.290705+0000","last_fullsized":"2024-09-21T07:25:40.290705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290436+0000","last_change":"2024-09-21T07:25:40.313910+0000","last_active":"2024-09-21T07:25:42.290436+0000","last_peered":"2024-09-21T07:25:42.290436+0000","last_clean":"2024-09-21T07:25:42.290436+0000","last_became_active":"2024-09-21T07:25:40.313570+0000","last_became_peered":"2024-09-21T07:25:40.313570+0000","last_unstale":"2024-09-21T07:25:42.290436+0000","last_undegraded":"2024-09-21T07:25:42.290436+0000","last_fullsized":"2024-09-21T07:25:42.290436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290319+0000","last_change":"2024-09-21T07:25:41.325207+0000","last_active":"2024-09-21T07:25:42.290319+0000","last_peered":"2024-09-21T07:25:42.290319+0000","last_clean":"2024-09-21T07:25:42.290319+0000","last_became_active":"2024-09-21T07:25:41.324878+0000","last_became_peered":"2024-09-21T07:25:41.324878+0000","last_unstale":"2024-09-21T07:25:42.290319+0000","last_undegraded":"2024-09-21T07:25:42.290319+0000","last_fullsized":"2024-09-21T07:25:42.290319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.912084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.324368+0000","last_change":"2024-09-21T07:25:40.320634+0000","last_active":"2024-09-21T07:25:40.324368+0000","last_peered":"2024-09-21T07:25:40.324368+0000","last_clean":"2024-09-21T07:25:40.324368+0000","last_became_active":"2024-09-21T07:25:40.320142+0000","last_became_peered":"2024-09-21T07:25:40.320142+0000","last_unstale":"2024-09-21T07:25:40.324368+0000","last_undegraded":"2024-09-21T07:25:40.324368+0000","last_fullsized":"2024-09-21T07:25:40.324368+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:58.661817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.304718+0000","last_change":"2024-09-21T07:25:41.300389+0000","last_active":"2024-09-21T07:25:41.304718+0000","last_peered":"2024-09-21T07:25:41.304718+0000","last_clean":"2024-09-21T07:25:41.304718+0000","last_became_active":"2024-09-21T07:25:41.300063+0000","last_became_peered":"2024-09-21T07:25:41.300063+0000","last_unstale":"2024-09-21T07:25:41.304718+0000","last_undegraded":"2024-09-21T07:25:41.304718+0000","last_fullsized":"2024-09-21T07:25:41.304718+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:11.485694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-21T07:25:40.309145+0000","last_change":"2024-09-21T07:25:40.305976+0000","last_active":"2024-09-21T07:25:40.309145+0000","last_peered":"2024-09-21T07:25:40.309145+0000","last_clean":"2024-09-21T07:25:40.309145+0000","last_became_active":"2024-09-21T07:25:40.305647+0000","last_became_peered":"2024-09-21T07:25:40.305647+0000","last_unstale":"2024-09-21T07:25:40.309145+0000","last_undegraded":"2024-09-21T07:25:40.309145+0000","last_fullsized":"2024-09-21T07:25:40.309145+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:42.472958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291020+0000","last_change":"2024-09-21T07:25:41.331719+0000","last_active":"2024-09-21T07:25:42.291020+0000","last_peered":"2024-09-21T07:25:42.291020+0000","last_clean":"2024-09-21T07:25:42.291020+0000","last_became_active":"2024-09-21T07:25:41.331422+0000","last_became_peered":"2024-09-21T07:25:41.331422+0000","last_unstale":"2024-09-21T07:25:42.291020+0000","last_undegraded":"2024-09-21T07:25:42.291020+0000","last_fullsized":"2024-09-21T07:25:42.291020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290086+0000","last_change":"2024-09-21T07:25:40.307486+0000","last_active":"2024-09-21T07:25:42.290086+0000","last_peered":"2024-09-21T07:25:42.290086+0000","last_clean":"2024-09-21T07:25:42.290086+0000","last_became_active":"2024-09-21T07:25:40.307093+0000","last_became_peered":"2024-09-21T07:25:40.307093+0000","last_unstale":"2024-09-21T07:25:42.290086+0000","last_undegraded":"2024-09-21T07:25:42.290086+0000","last_fullsized":"2024-09-21T07:25:42.290086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:38.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-21T07:25:40.291012+0000","last_change":"2024-09-21T07:25:40.291012+0000","last_active":"2024-09-21T07:25:40.275489+0000","last_peered":"2024-09-21T07:25:40.275489+0000","last_clean":"2024-09-21T07:25:40.275489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:25:40.291012+0000","last_undegraded":"2024-09-21T07:25:40.291012+0000","last_fullsized":"2024-09-21T07:25:40.291012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.292824+0000","last_change":"2024-09-21T07:25:40.305212+0000","last_active":"2024-09-21T07:25:41.292824+0000","last_peered":"2024-09-21T07:25:41.292824+0000","last_clean":"2024-09-21T07:25:41.292824+0000","last_became_active":"2024-09-21T07:25:40.304548+0000","last_became_peered":"2024-09-21T07:25:40.304548+0000","last_unstale":"2024-09-21T07:25:41.292824+0000","last_undegraded":"2024-09-21T07:25:41.292824+0000","last_fullsized":"2024-09-21T07:25:41.292824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:38.547032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.316448+0000","last_change":"2024-09-21T07:25:41.306132+0000","last_active":"2024-09-21T07:25:41.316448+0000","last_peered":"2024-09-21T07:25:41.316448+0000","last_clean":"2024-09-21T07:25:41.316448+0000","last_became_active":"2024-09-21T07:25:41.305750+0000","last_became_peered":"2024-09-21T07:25:41.305750+0000","last_unstale":"2024-09-21T07:25:41.316448+0000","last_undegraded":"2024-09-21T07:25:41.316448+0000","last_fullsized":"2024-09-21T07:25:41.316448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.511649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293055+0000","last_change":"2024-09-21T07:25:40.313563+0000","last_active":"2024-09-21T07:25:42.293055+0000","last_peered":"2024-09-21T07:25:42.293055+0000","last_clean":"2024-09-21T07:25:42.293055+0000","last_became_active":"2024-09-21T07:25:40.313179+0000","last_became_peered":"2024-09-21T07:25:40.313179+0000","last_unstale":"2024-09-21T07:25:42.293055+0000","last_undegraded":"2024-09-21T07:25:42.293055+0000","last_fullsized":"2024-09-21T07:25:42.293055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:22.021254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-21T07:25:41.295066+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:25:41.295066+0000","last_peered":"2024-09-21T07:25:41.295066+0000","last_clean":"2024-09-21T07:25:41.295066+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:25:41.295066+0000","last_undegraded":"2024-09-21T07:25:41.295066+0000","last_fullsized":"2024-09-21T07:25:41.295066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":655360,"data_stored":290246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":647168,"data_stored":289594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":651264,"data_stored":290176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":671744,"data_stored":297898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":655360,"data_stored":289754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1228800,"data_stored":872795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":634880,"data_stored":282427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:25:50.200 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:25:50.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.353+0000 7fda32a00640 1 -- 172.21.15.64:0/1175717567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 msgr2=0x7fda2c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.353+0000 7fda32a00640 1 --2- 172.21.15.64:0/1175717567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c070310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009870 tx=0x7fda1c01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- 172.21.15.64:0/1175717567 shutdown_connections 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 --2- 172.21.15.64:0/1175717567 >> v2:172.21.15.90:3300/0 conn(0x7fda2c070850 0x7fda2c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 --2- 172.21.15.64:0/1175717567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c070310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- 172.21.15.64:0/1175717567 >> 172.21.15.64:0/1175717567 conn(0x7fda2c0ccbe0 msgr2=0x7fda2c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- 172.21.15.64:0/1175717567 shutdown_connections 2024-09-21T07:25:50.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- 172.21.15.64:0/1175717567 wait complete. 2024-09-21T07:25:50.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 Processor -- start 2024-09-21T07:25:50.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- start start 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 0x7fda2c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c0b4150 con 0x7fda2c0b2120 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c0b3fd0 con 0x7fda2c070850 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.357+0000 7fda32a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fda2c0b42d0 con 0x7fda2c15cbd0 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda23e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda23e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35838/0 (socket says 172.21.15.64:35838) 2024-09-21T07:25:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda23e00640 1 -- 172.21.15.64:0/3186244652 learned_addr learned my addr 172.21.15.64:0/3186244652 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:50.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 0x7fda2c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda30a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 -- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 msgr2=0x7fda2c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 -- 172.21.15.64:0/3186244652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 msgr2=0x7fda2c14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 -- 172.21.15.64:0/3186244652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c14e400 con 0x7fda2c070850 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda23e00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda2be00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 0x7fda2c0ace70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ac000 tx=0x7fda1c005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b2040 con 0x7fda2c070850 2024-09-21T07:25:50.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda1c004330 con 0x7fda2c070850 2024-09-21T07:25:50.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c003860 con 0x7fda2c070850 2024-09-21T07:25:50.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2c0c9b40 con 0x7fda2c070850 2024-09-21T07:25:50.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2c0c7e90 con 0x7fda2c070850 2024-09-21T07:25:50.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2c0b1be0 con 0x7fda2c070850 2024-09-21T07:25:50.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.361+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fda1c0bd060 con 0x7fda2c070850 2024-09-21T07:25:50.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.365+0000 7fda28c00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 0x7fda08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.365+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fda1c12dbf0 con 0x7fda2c070850 2024-09-21T07:25:50.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.365+0000 7fda23e00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 0x7fda08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.365+0000 7fda23e00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 0x7fda08075710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda2c1fc170 tx=0x7fda140091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:50.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.369+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fda1c016410 con 0x7fda2c070850 2024-09-21T07:25:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.541+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda2c0b4880 con 0x7fda08073200 2024-09-21T07:25:50.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.549+0000 7fda28c00640 1 -- 172.21.15.64:0/3186244652 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7fda2c0b4880 con 0x7fda08073200 2024-09-21T07:25:50.556 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:50.557 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 msgr2=0x7fda08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 0x7fda08075710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda2c1fc170 tx=0x7fda140091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 msgr2=0x7fda2c0ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 0x7fda2c0ace70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ac000 tx=0x7fda1c005d20 comp rx=0 tx=0).stop 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 shutdown_connections 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fda08073200 0x7fda08075710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda2c15cbd0 0x7fda2c0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda2c0b2120 0x7fda2c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 --2- 172.21.15.64:0/3186244652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c070850 0x7fda2c0ace70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 >> 172.21.15.64:0/3186244652 conn(0x7fda2c0ccbe0 msgr2=0x7fda2c15b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:50.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 shutdown_connections 2024-09-21T07:25:50.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.553+0000 7fda32a00640 1 -- 172.21.15.64:0/3186244652 wait complete. 2024-09-21T07:25:50.578 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-21T07:25:49.466009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289180,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685540,"statfs":{"total":773094113280,"available":772797992960,"internally_reserved":0,"allocated":6529024,"data_stored":3555844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":289394227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.177180"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584313+0000","last_change":"2024-09-21T07:25:41.321256+0000","last_active":"2024-09-21T07:25:43.584313+0000","last_peered":"2024-09-21T07:25:43.584313+0000","last_clean":"2024-09-21T07:25:43.584313+0000","last_became_active":"2024-09-21T07:25:41.320849+0000","last_became_peered":"2024-09-21T07:25:41.320849+0000","last_unstale":"2024-09-21T07:25:43.584313+0000","last_undegraded":"2024-09-21T07:25:43.584313+0000","last_fullsized":"2024-09-21T07:25:43.584313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:54.084241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294557+0000","last_change":"2024-09-21T07:25:41.308998+0000","last_active":"2024-09-21T07:25:42.294557+0000","last_peered":"2024-09-21T07:25:42.294557+0000","last_clean":"2024-09-21T07:25:42.294557+0000","last_became_active":"2024-09-21T07:25:41.304931+0000","last_became_peered":"2024-09-21T07:25:41.304931+0000","last_unstale":"2024-09-21T07:25:42.294557+0000","last_undegraded":"2024-09-21T07:25:42.294557+0000","last_fullsized":"2024-09-21T07:25:42.294557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:18.521403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290754+0000","last_change":"2024-09-21T07:25:41.332498+0000","last_active":"2024-09-21T07:25:42.290754+0000","last_peered":"2024-09-21T07:25:42.290754+0000","last_clean":"2024-09-21T07:25:42.290754+0000","last_became_active":"2024-09-21T07:25:41.332144+0000","last_became_peered":"2024-09-21T07:25:41.332144+0000","last_unstale":"2024-09-21T07:25:42.290754+0000","last_undegraded":"2024-09-21T07:25:42.290754+0000","last_fullsized":"2024-09-21T07:25:42.290754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:53.495422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294280+0000","last_change":"2024-09-21T07:25:41.311763+0000","last_active":"2024-09-21T07:25:42.294280+0000","last_peered":"2024-09-21T07:25:42.294280+0000","last_clean":"2024-09-21T07:25:42.294280+0000","last_became_active":"2024-09-21T07:25:41.311364+0000","last_became_peered":"2024-09-21T07:25:41.311364+0000","last_unstale":"2024-09-21T07:25:42.294280+0000","last_undegraded":"2024-09-21T07:25:42.294280+0000","last_fullsized":"2024-09-21T07:25:42.294280+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:34.357070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290340+0000","last_change":"2024-09-21T07:25:41.320818+0000","last_active":"2024-09-21T07:25:42.290340+0000","last_peered":"2024-09-21T07:25:42.290340+0000","last_clean":"2024-09-21T07:25:42.290340+0000","last_became_active":"2024-09-21T07:25:41.320501+0000","last_became_peered":"2024-09-21T07:25:41.320501+0000","last_unstale":"2024-09-21T07:25:42.290340+0000","last_undegraded":"2024-09-21T07:25:42.290340+0000","last_fullsized":"2024-09-21T07:25:42.290340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583566+0000","last_change":"2024-09-21T07:25:41.313826+0000","last_active":"2024-09-21T07:25:43.583566+0000","last_peered":"2024-09-21T07:25:43.583566+0000","last_clean":"2024-09-21T07:25:43.583566+0000","last_became_active":"2024-09-21T07:25:41.313523+0000","last_became_peered":"2024-09-21T07:25:41.313523+0000","last_unstale":"2024-09-21T07:25:43.583566+0000","last_undegraded":"2024-09-21T07:25:43.583566+0000","last_fullsized":"2024-09-21T07:25:43.583566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:59.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289414+0000","last_change":"2024-09-21T07:25:41.323024+0000","last_active":"2024-09-21T07:25:42.289414+0000","last_peered":"2024-09-21T07:25:42.289414+0000","last_clean":"2024-09-21T07:25:42.289414+0000","last_became_active":"2024-09-21T07:25:41.321726+0000","last_became_peered":"2024-09-21T07:25:41.321726+0000","last_unstale":"2024-09-21T07:25:42.289414+0000","last_undegraded":"2024-09-21T07:25:42.289414+0000","last_fullsized":"2024-09-21T07:25:42.289414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:58.224710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583636+0000","last_change":"2024-09-21T07:25:41.300596+0000","last_active":"2024-09-21T07:25:43.583636+0000","last_peered":"2024-09-21T07:25:43.583636+0000","last_clean":"2024-09-21T07:25:43.583636+0000","last_became_active":"2024-09-21T07:25:41.300299+0000","last_became_peered":"2024-09-21T07:25:41.300299+0000","last_unstale":"2024-09-21T07:25:43.583636+0000","last_undegraded":"2024-09-21T07:25:43.583636+0000","last_fullsized":"2024-09-21T07:25:43.583636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:03.042227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.585006+0000","last_change":"2024-09-21T07:25:41.317985+0000","last_active":"2024-09-21T07:25:43.585006+0000","last_peered":"2024-09-21T07:25:43.585006+0000","last_clean":"2024-09-21T07:25:43.585006+0000","last_became_active":"2024-09-21T07:25:41.317052+0000","last_became_peered":"2024-09-21T07:25:41.317052+0000","last_unstale":"2024-09-21T07:25:43.585006+0000","last_undegraded":"2024-09-21T07:25:43.585006+0000","last_fullsized":"2024-09-21T07:25:43.585006+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:08.829602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584280+0000","last_change":"2024-09-21T07:25:41.323561+0000","last_active":"2024-09-21T07:25:43.584280+0000","last_peered":"2024-09-21T07:25:43.584280+0000","last_clean":"2024-09-21T07:25:43.584280+0000","last_became_active":"2024-09-21T07:25:41.323254+0000","last_became_peered":"2024-09-21T07:25:41.323254+0000","last_unstale":"2024-09-21T07:25:43.584280+0000","last_undegraded":"2024-09-21T07:25:43.584280+0000","last_fullsized":"2024-09-21T07:25:43.584280+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:30.273755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290637+0000","last_change":"2024-09-21T07:25:41.307219+0000","last_active":"2024-09-21T07:25:42.290637+0000","last_peered":"2024-09-21T07:25:42.290637+0000","last_clean":"2024-09-21T07:25:42.290637+0000","last_became_active":"2024-09-21T07:25:41.306872+0000","last_became_peered":"2024-09-21T07:25:41.306872+0000","last_unstale":"2024-09-21T07:25:42.290637+0000","last_undegraded":"2024-09-21T07:25:42.290637+0000","last_fullsized":"2024-09-21T07:25:42.290637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:04.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584888+0000","last_change":"2024-09-21T07:25:41.305387+0000","last_active":"2024-09-21T07:25:43.584888+0000","last_peered":"2024-09-21T07:25:43.584888+0000","last_clean":"2024-09-21T07:25:43.584888+0000","last_became_active":"2024-09-21T07:25:41.305071+0000","last_became_peered":"2024-09-21T07:25:41.305071+0000","last_unstale":"2024-09-21T07:25:43.584888+0000","last_undegraded":"2024-09-21T07:25:43.584888+0000","last_fullsized":"2024-09-21T07:25:43.584888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:41.912799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.582883+0000","last_change":"2024-09-21T07:25:41.321933+0000","last_active":"2024-09-21T07:25:43.582883+0000","last_peered":"2024-09-21T07:25:43.582883+0000","last_clean":"2024-09-21T07:25:43.582883+0000","last_became_active":"2024-09-21T07:25:41.321587+0000","last_became_peered":"2024-09-21T07:25:41.321587+0000","last_unstale":"2024-09-21T07:25:43.582883+0000","last_undegraded":"2024-09-21T07:25:43.582883+0000","last_fullsized":"2024-09-21T07:25:43.582883+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289995+0000","last_change":"2024-09-21T07:25:41.331684+0000","last_active":"2024-09-21T07:25:42.289995+0000","last_peered":"2024-09-21T07:25:42.289995+0000","last_clean":"2024-09-21T07:25:42.289995+0000","last_became_active":"2024-09-21T07:25:41.331336+0000","last_became_peered":"2024-09-21T07:25:41.331336+0000","last_unstale":"2024-09-21T07:25:42.289995+0000","last_undegraded":"2024-09-21T07:25:42.289995+0000","last_fullsized":"2024-09-21T07:25:42.289995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293994+0000","last_change":"2024-09-21T07:25:41.307391+0000","last_active":"2024-09-21T07:25:42.293994+0000","last_peered":"2024-09-21T07:25:42.293994+0000","last_clean":"2024-09-21T07:25:42.293994+0000","last_became_active":"2024-09-21T07:25:41.307053+0000","last_became_peered":"2024-09-21T07:25:41.307053+0000","last_unstale":"2024-09-21T07:25:42.293994+0000","last_undegraded":"2024-09-21T07:25:42.293994+0000","last_fullsized":"2024-09-21T07:25:42.293994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:33.188838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.582759+0000","last_change":"2024-09-21T07:25:41.322745+0000","last_active":"2024-09-21T07:25:43.582759+0000","last_peered":"2024-09-21T07:25:43.582759+0000","last_clean":"2024-09-21T07:25:43.582759+0000","last_became_active":"2024-09-21T07:25:41.322403+0000","last_became_peered":"2024-09-21T07:25:41.322403+0000","last_unstale":"2024-09-21T07:25:43.582759+0000","last_undegraded":"2024-09-21T07:25:43.582759+0000","last_fullsized":"2024-09-21T07:25:43.582759+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:52.837939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291554+0000","last_change":"2024-09-21T07:25:41.318017+0000","last_active":"2024-09-21T07:25:42.291554+0000","last_peered":"2024-09-21T07:25:42.291554+0000","last_clean":"2024-09-21T07:25:42.291554+0000","last_became_active":"2024-09-21T07:25:41.317536+0000","last_became_peered":"2024-09-21T07:25:41.317536+0000","last_unstale":"2024-09-21T07:25:42.291554+0000","last_undegraded":"2024-09-21T07:25:42.291554+0000","last_fullsized":"2024-09-21T07:25:42.291554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.914124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294640+0000","last_change":"2024-09-21T07:25:41.307572+0000","last_active":"2024-09-21T07:25:42.294640+0000","last_peered":"2024-09-21T07:25:42.294640+0000","last_clean":"2024-09-21T07:25:42.294640+0000","last_became_active":"2024-09-21T07:25:41.305007+0000","last_became_peered":"2024-09-21T07:25:41.305007+0000","last_unstale":"2024-09-21T07:25:42.294640+0000","last_undegraded":"2024-09-21T07:25:42.294640+0000","last_fullsized":"2024-09-21T07:25:42.294640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.068430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291167+0000","last_change":"2024-09-21T07:25:41.327304+0000","last_active":"2024-09-21T07:25:42.291167+0000","last_peered":"2024-09-21T07:25:42.291167+0000","last_clean":"2024-09-21T07:25:42.291167+0000","last_became_active":"2024-09-21T07:25:41.326612+0000","last_became_peered":"2024-09-21T07:25:41.326612+0000","last_unstale":"2024-09-21T07:25:42.291167+0000","last_undegraded":"2024-09-21T07:25:42.291167+0000","last_fullsized":"2024-09-21T07:25:42.291167+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:57.777429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849598+0000","last_change":"2024-09-21T07:25:41.320645+0000","last_active":"2024-09-21T07:25:42.849598+0000","last_peered":"2024-09-21T07:25:42.849598+0000","last_clean":"2024-09-21T07:25:42.849598+0000","last_became_active":"2024-09-21T07:25:41.320160+0000","last_became_peered":"2024-09-21T07:25:41.320160+0000","last_unstale":"2024-09-21T07:25:42.849598+0000","last_undegraded":"2024-09-21T07:25:42.849598+0000","last_fullsized":"2024-09-21T07:25:42.849598+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.392356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849232+0000","last_change":"2024-09-21T07:25:41.312932+0000","last_active":"2024-09-21T07:25:42.849232+0000","last_peered":"2024-09-21T07:25:42.849232+0000","last_clean":"2024-09-21T07:25:42.849232+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:42.849232+0000","last_undegraded":"2024-09-21T07:25:42.849232+0000","last_fullsized":"2024-09-21T07:25:42.849232+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583150+0000","last_change":"2024-09-21T07:25:41.305960+0000","last_active":"2024-09-21T07:25:43.583150+0000","last_peered":"2024-09-21T07:25:43.583150+0000","last_clean":"2024-09-21T07:25:43.583150+0000","last_became_active":"2024-09-21T07:25:41.303981+0000","last_became_peered":"2024-09-21T07:25:41.303981+0000","last_unstale":"2024-09-21T07:25:43.583150+0000","last_undegraded":"2024-09-21T07:25:43.583150+0000","last_fullsized":"2024-09-21T07:25:43.583150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:23.495246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290648+0000","last_change":"2024-09-21T07:25:41.313770+0000","last_active":"2024-09-21T07:25:42.290648+0000","last_peered":"2024-09-21T07:25:42.290648+0000","last_clean":"2024-09-21T07:25:42.290648+0000","last_became_active":"2024-09-21T07:25:41.313227+0000","last_became_peered":"2024-09-21T07:25:41.313227+0000","last_unstale":"2024-09-21T07:25:42.290648+0000","last_undegraded":"2024-09-21T07:25:42.290648+0000","last_fullsized":"2024-09-21T07:25:42.290648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:33.855213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289330+0000","last_change":"2024-09-21T07:25:41.309859+0000","last_active":"2024-09-21T07:25:42.289330+0000","last_peered":"2024-09-21T07:25:42.289330+0000","last_clean":"2024-09-21T07:25:42.289330+0000","last_became_active":"2024-09-21T07:25:41.309517+0000","last_became_peered":"2024-09-21T07:25:41.309517+0000","last_unstale":"2024-09-21T07:25:42.289330+0000","last_undegraded":"2024-09-21T07:25:42.289330+0000","last_fullsized":"2024-09-21T07:25:42.289330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291690+0000","last_change":"2024-09-21T07:25:41.336710+0000","last_active":"2024-09-21T07:25:42.291690+0000","last_peered":"2024-09-21T07:25:42.291690+0000","last_clean":"2024-09-21T07:25:42.291690+0000","last_became_active":"2024-09-21T07:25:41.335110+0000","last_became_peered":"2024-09-21T07:25:41.335110+0000","last_unstale":"2024-09-21T07:25:42.291690+0000","last_undegraded":"2024-09-21T07:25:42.291690+0000","last_fullsized":"2024-09-21T07:25:42.291690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:04.420434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584850+0000","last_change":"2024-09-21T07:25:41.332610+0000","last_active":"2024-09-21T07:25:43.584850+0000","last_peered":"2024-09-21T07:25:43.584850+0000","last_clean":"2024-09-21T07:25:43.584850+0000","last_became_active":"2024-09-21T07:25:41.329223+0000","last_became_peered":"2024-09-21T07:25:41.329223+0000","last_unstale":"2024-09-21T07:25:43.584850+0000","last_undegraded":"2024-09-21T07:25:43.584850+0000","last_fullsized":"2024-09-21T07:25:43.584850+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:51.358537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584446+0000","last_change":"2024-09-21T07:25:41.318845+0000","last_active":"2024-09-21T07:25:43.584446+0000","last_peered":"2024-09-21T07:25:43.584446+0000","last_clean":"2024-09-21T07:25:43.584446+0000","last_became_active":"2024-09-21T07:25:41.318551+0000","last_became_peered":"2024-09-21T07:25:41.318551+0000","last_unstale":"2024-09-21T07:25:43.584446+0000","last_undegraded":"2024-09-21T07:25:43.584446+0000","last_fullsized":"2024-09-21T07:25:43.584446+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:05.714342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849488+0000","last_change":"2024-09-21T07:25:41.329282+0000","last_active":"2024-09-21T07:25:42.849488+0000","last_peered":"2024-09-21T07:25:42.849488+0000","last_clean":"2024-09-21T07:25:42.849488+0000","last_became_active":"2024-09-21T07:25:41.328876+0000","last_became_peered":"2024-09-21T07:25:41.328876+0000","last_unstale":"2024-09-21T07:25:42.849488+0000","last_undegraded":"2024-09-21T07:25:42.849488+0000","last_fullsized":"2024-09-21T07:25:42.849488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:20.307791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290693+0000","last_change":"2024-09-21T07:25:41.321849+0000","last_active":"2024-09-21T07:25:42.290693+0000","last_peered":"2024-09-21T07:25:42.290693+0000","last_clean":"2024-09-21T07:25:42.290693+0000","last_became_active":"2024-09-21T07:25:41.321476+0000","last_became_peered":"2024-09-21T07:25:41.321476+0000","last_unstale":"2024-09-21T07:25:42.290693+0000","last_undegraded":"2024-09-21T07:25:42.290693+0000","last_fullsized":"2024-09-21T07:25:42.290693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:14.078446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294441+0000","last_change":"2024-09-21T07:25:41.312897+0000","last_active":"2024-09-21T07:25:42.294441+0000","last_peered":"2024-09-21T07:25:42.294441+0000","last_clean":"2024-09-21T07:25:42.294441+0000","last_became_active":"2024-09-21T07:25:41.312593+0000","last_became_peered":"2024-09-21T07:25:41.312593+0000","last_unstale":"2024-09-21T07:25:42.294441+0000","last_undegraded":"2024-09-21T07:25:42.294441+0000","last_fullsized":"2024-09-21T07:25:42.294441+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:32.607377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289405+0000","last_change":"2024-09-21T07:25:41.311045+0000","last_active":"2024-09-21T07:25:42.289405+0000","last_peered":"2024-09-21T07:25:42.289405+0000","last_clean":"2024-09-21T07:25:42.289405+0000","last_became_active":"2024-09-21T07:25:41.310726+0000","last_became_peered":"2024-09-21T07:25:41.310726+0000","last_unstale":"2024-09-21T07:25:42.289405+0000","last_undegraded":"2024-09-21T07:25:42.289405+0000","last_fullsized":"2024-09-21T07:25:42.289405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584003+0000","last_change":"2024-09-21T07:25:41.300265+0000","last_active":"2024-09-21T07:25:43.584003+0000","last_peered":"2024-09-21T07:25:43.584003+0000","last_clean":"2024-09-21T07:25:43.584003+0000","last_became_active":"2024-09-21T07:25:41.299766+0000","last_became_peered":"2024-09-21T07:25:41.299766+0000","last_unstale":"2024-09-21T07:25:43.584003+0000","last_undegraded":"2024-09-21T07:25:43.584003+0000","last_fullsized":"2024-09-21T07:25:43.584003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:34.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293847+0000","last_change":"2024-09-21T07:25:41.305860+0000","last_active":"2024-09-21T07:25:42.293847+0000","last_peered":"2024-09-21T07:25:42.293847+0000","last_clean":"2024-09-21T07:25:42.293847+0000","last_became_active":"2024-09-21T07:25:41.305479+0000","last_became_peered":"2024-09-21T07:25:41.305479+0000","last_unstale":"2024-09-21T07:25:42.293847+0000","last_undegraded":"2024-09-21T07:25:42.293847+0000","last_fullsized":"2024-09-21T07:25:42.293847+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:55.513804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849465+0000","last_change":"2024-09-21T07:25:40.300521+0000","last_active":"2024-09-21T07:25:42.849465+0000","last_peered":"2024-09-21T07:25:42.849465+0000","last_clean":"2024-09-21T07:25:42.849465+0000","last_became_active":"2024-09-21T07:25:40.300196+0000","last_became_peered":"2024-09-21T07:25:40.300196+0000","last_unstale":"2024-09-21T07:25:42.849465+0000","last_undegraded":"2024-09-21T07:25:42.849465+0000","last_fullsized":"2024-09-21T07:25:42.849465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:12.727958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584025+0000","last_change":"2024-09-21T07:25:41.300373+0000","last_active":"2024-09-21T07:25:43.584025+0000","last_peered":"2024-09-21T07:25:43.584025+0000","last_clean":"2024-09-21T07:25:43.584025+0000","last_became_active":"2024-09-21T07:25:41.299865+0000","last_became_peered":"2024-09-21T07:25:41.299865+0000","last_unstale":"2024-09-21T07:25:43.584025+0000","last_undegraded":"2024-09-21T07:25:43.584025+0000","last_fullsized":"2024-09-21T07:25:43.584025+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:50.218342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584208+0000","last_change":"2024-09-21T07:25:40.308163+0000","last_active":"2024-09-21T07:25:43.584208+0000","last_peered":"2024-09-21T07:25:43.584208+0000","last_clean":"2024-09-21T07:25:43.584208+0000","last_became_active":"2024-09-21T07:25:40.307798+0000","last_became_peered":"2024-09-21T07:25:40.307798+0000","last_unstale":"2024-09-21T07:25:43.584208+0000","last_undegraded":"2024-09-21T07:25:43.584208+0000","last_fullsized":"2024-09-21T07:25:43.584208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:12.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849407+0000","last_change":"2024-09-21T07:25:41.307900+0000","last_active":"2024-09-21T07:25:42.849407+0000","last_peered":"2024-09-21T07:25:42.849407+0000","last_clean":"2024-09-21T07:25:42.849407+0000","last_became_active":"2024-09-21T07:25:41.307573+0000","last_became_peered":"2024-09-21T07:25:41.307573+0000","last_unstale":"2024-09-21T07:25:42.849407+0000","last_undegraded":"2024-09-21T07:25:42.849407+0000","last_fullsized":"2024-09-21T07:25:42.849407+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584484+0000","last_change":"2024-09-21T07:25:40.310055+0000","last_active":"2024-09-21T07:25:43.584484+0000","last_peered":"2024-09-21T07:25:43.584484+0000","last_clean":"2024-09-21T07:25:43.584484+0000","last_became_active":"2024-09-21T07:25:40.309774+0000","last_became_peered":"2024-09-21T07:25:40.309774+0000","last_unstale":"2024-09-21T07:25:43.584484+0000","last_undegraded":"2024-09-21T07:25:43.584484+0000","last_fullsized":"2024-09-21T07:25:43.584484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:26.643644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584362+0000","last_change":"2024-09-21T07:25:41.310763+0000","last_active":"2024-09-21T07:25:43.584362+0000","last_peered":"2024-09-21T07:25:43.584362+0000","last_clean":"2024-09-21T07:25:43.584362+0000","last_became_active":"2024-09-21T07:25:41.310304+0000","last_became_peered":"2024-09-21T07:25:41.310304+0000","last_unstale":"2024-09-21T07:25:43.584362+0000","last_undegraded":"2024-09-21T07:25:43.584362+0000","last_fullsized":"2024-09-21T07:25:43.584362+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:06.132670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584297+0000","last_change":"2024-09-21T07:25:40.308143+0000","last_active":"2024-09-21T07:25:43.584297+0000","last_peered":"2024-09-21T07:25:43.584297+0000","last_clean":"2024-09-21T07:25:43.584297+0000","last_became_active":"2024-09-21T07:25:40.307813+0000","last_became_peered":"2024-09-21T07:25:40.307813+0000","last_unstale":"2024-09-21T07:25:43.584297+0000","last_undegraded":"2024-09-21T07:25:43.584297+0000","last_fullsized":"2024-09-21T07:25:43.584297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:48.036611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290628+0000","last_change":"2024-09-21T07:25:41.318110+0000","last_active":"2024-09-21T07:25:42.290628+0000","last_peered":"2024-09-21T07:25:42.290628+0000","last_clean":"2024-09-21T07:25:42.290628+0000","last_became_active":"2024-09-21T07:25:41.317724+0000","last_became_peered":"2024-09-21T07:25:41.317724+0000","last_unstale":"2024-09-21T07:25:42.290628+0000","last_undegraded":"2024-09-21T07:25:42.290628+0000","last_fullsized":"2024-09-21T07:25:42.290628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:52.623306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290816+0000","last_change":"2024-09-21T07:25:40.314377+0000","last_active":"2024-09-21T07:25:42.290816+0000","last_peered":"2024-09-21T07:25:42.290816+0000","last_clean":"2024-09-21T07:25:42.290816+0000","last_became_active":"2024-09-21T07:25:40.313997+0000","last_became_peered":"2024-09-21T07:25:40.313997+0000","last_unstale":"2024-09-21T07:25:42.290816+0000","last_undegraded":"2024-09-21T07:25:42.290816+0000","last_fullsized":"2024-09-21T07:25:42.290816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.566202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294230+0000","last_change":"2024-09-21T07:25:41.327857+0000","last_active":"2024-09-21T07:25:42.294230+0000","last_peered":"2024-09-21T07:25:42.294230+0000","last_clean":"2024-09-21T07:25:42.294230+0000","last_became_active":"2024-09-21T07:25:41.327330+0000","last_became_peered":"2024-09-21T07:25:41.327330+0000","last_unstale":"2024-09-21T07:25:42.294230+0000","last_undegraded":"2024-09-21T07:25:42.294230+0000","last_fullsized":"2024-09-21T07:25:42.294230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:19.538237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290510+0000","last_change":"2024-09-21T07:25:40.300775+0000","last_active":"2024-09-21T07:25:42.290510+0000","last_peered":"2024-09-21T07:25:42.290510+0000","last_clean":"2024-09-21T07:25:42.290510+0000","last_became_active":"2024-09-21T07:25:40.300245+0000","last_became_peered":"2024-09-21T07:25:40.300245+0000","last_unstale":"2024-09-21T07:25:42.290510+0000","last_undegraded":"2024-09-21T07:25:42.290510+0000","last_fullsized":"2024-09-21T07:25:42.290510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.585136+0000","last_change":"2024-09-21T07:25:41.310743+0000","last_active":"2024-09-21T07:25:43.585136+0000","last_peered":"2024-09-21T07:25:43.585136+0000","last_clean":"2024-09-21T07:25:43.585136+0000","last_became_active":"2024-09-21T07:25:41.310390+0000","last_became_peered":"2024-09-21T07:25:41.310390+0000","last_unstale":"2024-09-21T07:25:43.585136+0000","last_undegraded":"2024-09-21T07:25:43.585136+0000","last_fullsized":"2024-09-21T07:25:43.585136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.047953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849059+0000","last_change":"2024-09-21T07:25:40.304077+0000","last_active":"2024-09-21T07:25:42.849059+0000","last_peered":"2024-09-21T07:25:42.849059+0000","last_clean":"2024-09-21T07:25:42.849059+0000","last_became_active":"2024-09-21T07:25:40.303202+0000","last_became_peered":"2024-09-21T07:25:40.303202+0000","last_unstale":"2024-09-21T07:25:42.849059+0000","last_undegraded":"2024-09-21T07:25:42.849059+0000","last_fullsized":"2024-09-21T07:25:42.849059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.778348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294440+0000","last_change":"2024-09-21T07:25:41.314683+0000","last_active":"2024-09-21T07:25:42.294440+0000","last_peered":"2024-09-21T07:25:42.294440+0000","last_clean":"2024-09-21T07:25:42.294440+0000","last_became_active":"2024-09-21T07:25:41.314189+0000","last_became_peered":"2024-09-21T07:25:41.314189+0000","last_unstale":"2024-09-21T07:25:42.294440+0000","last_undegraded":"2024-09-21T07:25:42.294440+0000","last_fullsized":"2024-09-21T07:25:42.294440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:27.055105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289294+0000","last_change":"2024-09-21T07:25:40.316177+0000","last_active":"2024-09-21T07:25:42.289294+0000","last_peered":"2024-09-21T07:25:42.289294+0000","last_clean":"2024-09-21T07:25:42.289294+0000","last_became_active":"2024-09-21T07:25:40.314401+0000","last_became_peered":"2024-09-21T07:25:40.314401+0000","last_unstale":"2024-09-21T07:25:42.289294+0000","last_undegraded":"2024-09-21T07:25:42.289294+0000","last_fullsized":"2024-09-21T07:25:42.289294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:30.563754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290724+0000","last_change":"2024-09-21T07:25:41.325783+0000","last_active":"2024-09-21T07:25:42.290724+0000","last_peered":"2024-09-21T07:25:42.290724+0000","last_clean":"2024-09-21T07:25:42.290724+0000","last_became_active":"2024-09-21T07:25:41.325386+0000","last_became_peered":"2024-09-21T07:25:41.325386+0000","last_unstale":"2024-09-21T07:25:42.290724+0000","last_undegraded":"2024-09-21T07:25:42.290724+0000","last_fullsized":"2024-09-21T07:25:42.290724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:23.024655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294366+0000","last_change":"2024-09-21T07:25:40.306950+0000","last_active":"2024-09-21T07:25:42.294366+0000","last_peered":"2024-09-21T07:25:42.294366+0000","last_clean":"2024-09-21T07:25:42.294366+0000","last_became_active":"2024-09-21T07:25:40.306701+0000","last_became_peered":"2024-09-21T07:25:40.306701+0000","last_unstale":"2024-09-21T07:25:42.294366+0000","last_undegraded":"2024-09-21T07:25:42.294366+0000","last_fullsized":"2024-09-21T07:25:42.294366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.144853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583890+0000","last_change":"2024-09-21T07:25:41.317786+0000","last_active":"2024-09-21T07:25:43.583890+0000","last_peered":"2024-09-21T07:25:43.583890+0000","last_clean":"2024-09-21T07:25:43.583890+0000","last_became_active":"2024-09-21T07:25:41.317476+0000","last_became_peered":"2024-09-21T07:25:41.317476+0000","last_unstale":"2024-09-21T07:25:43.583890+0000","last_undegraded":"2024-09-21T07:25:43.583890+0000","last_fullsized":"2024-09-21T07:25:43.583890+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:25.101475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290547+0000","last_change":"2024-09-21T07:25:40.314159+0000","last_active":"2024-09-21T07:25:42.290547+0000","last_peered":"2024-09-21T07:25:42.290547+0000","last_clean":"2024-09-21T07:25:42.290547+0000","last_became_active":"2024-09-21T07:25:40.313757+0000","last_became_peered":"2024-09-21T07:25:40.313757+0000","last_unstale":"2024-09-21T07:25:42.290547+0000","last_undegraded":"2024-09-21T07:25:42.290547+0000","last_fullsized":"2024-09-21T07:25:42.290547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289951+0000","last_change":"2024-09-21T07:25:41.325786+0000","last_active":"2024-09-21T07:25:42.289951+0000","last_peered":"2024-09-21T07:25:42.289951+0000","last_clean":"2024-09-21T07:25:42.289951+0000","last_became_active":"2024-09-21T07:25:41.321038+0000","last_became_peered":"2024-09-21T07:25:41.321038+0000","last_unstale":"2024-09-21T07:25:42.289951+0000","last_undegraded":"2024-09-21T07:25:42.289951+0000","last_fullsized":"2024-09-21T07:25:42.289951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:37.991238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294404+0000","last_change":"2024-09-21T07:25:40.310416+0000","last_active":"2024-09-21T07:25:42.294404+0000","last_peered":"2024-09-21T07:25:42.294404+0000","last_clean":"2024-09-21T07:25:42.294404+0000","last_became_active":"2024-09-21T07:25:40.310117+0000","last_became_peered":"2024-09-21T07:25:40.310117+0000","last_unstale":"2024-09-21T07:25:42.294404+0000","last_undegraded":"2024-09-21T07:25:42.294404+0000","last_fullsized":"2024-09-21T07:25:42.294404+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:26.889094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290666+0000","last_change":"2024-09-21T07:25:41.318224+0000","last_active":"2024-09-21T07:25:42.290666+0000","last_peered":"2024-09-21T07:25:42.290666+0000","last_clean":"2024-09-21T07:25:42.290666+0000","last_became_active":"2024-09-21T07:25:41.317846+0000","last_became_peered":"2024-09-21T07:25:41.317846+0000","last_unstale":"2024-09-21T07:25:42.290666+0000","last_undegraded":"2024-09-21T07:25:42.290666+0000","last_fullsized":"2024-09-21T07:25:42.290666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:39.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"55'6","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584901+0000","last_change":"2024-09-21T07:25:40.320385+0000","last_active":"2024-09-21T07:25:43.584901+0000","last_peered":"2024-09-21T07:25:43.584901+0000","last_clean":"2024-09-21T07:25:43.584901+0000","last_became_active":"2024-09-21T07:25:40.320042+0000","last_became_peered":"2024-09-21T07:25:40.320042+0000","last_unstale":"2024-09-21T07:25:43.584901+0000","last_undegraded":"2024-09-21T07:25:43.584901+0000","last_fullsized":"2024-09-21T07:25:43.584901+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:18.534836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583936+0000","last_change":"2024-09-21T07:25:41.300184+0000","last_active":"2024-09-21T07:25:43.583936+0000","last_peered":"2024-09-21T07:25:43.583936+0000","last_clean":"2024-09-21T07:25:43.583936+0000","last_became_active":"2024-09-21T07:25:41.299829+0000","last_became_peered":"2024-09-21T07:25:41.299829+0000","last_unstale":"2024-09-21T07:25:43.583936+0000","last_undegraded":"2024-09-21T07:25:43.583936+0000","last_fullsized":"2024-09-21T07:25:43.583936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:22.025400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290966+0000","last_change":"2024-09-21T07:25:40.302488+0000","last_active":"2024-09-21T07:25:42.290966+0000","last_peered":"2024-09-21T07:25:42.290966+0000","last_clean":"2024-09-21T07:25:42.290966+0000","last_became_active":"2024-09-21T07:25:40.302167+0000","last_became_peered":"2024-09-21T07:25:40.302167+0000","last_unstale":"2024-09-21T07:25:42.290966+0000","last_undegraded":"2024-09-21T07:25:42.290966+0000","last_fullsized":"2024-09-21T07:25:42.290966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:51.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291230+0000","last_change":"2024-09-21T07:25:41.327602+0000","last_active":"2024-09-21T07:25:42.291230+0000","last_peered":"2024-09-21T07:25:42.291230+0000","last_clean":"2024-09-21T07:25:42.291230+0000","last_became_active":"2024-09-21T07:25:41.327019+0000","last_became_peered":"2024-09-21T07:25:41.327019+0000","last_unstale":"2024-09-21T07:25:42.291230+0000","last_undegraded":"2024-09-21T07:25:42.291230+0000","last_fullsized":"2024-09-21T07:25:42.291230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:12.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849210+0000","last_change":"2024-09-21T07:25:40.317734+0000","last_active":"2024-09-21T07:25:42.849210+0000","last_peered":"2024-09-21T07:25:42.849210+0000","last_clean":"2024-09-21T07:25:42.849210+0000","last_became_active":"2024-09-21T07:25:40.317367+0000","last_became_peered":"2024-09-21T07:25:40.317367+0000","last_unstale":"2024-09-21T07:25:42.849210+0000","last_undegraded":"2024-09-21T07:25:42.849210+0000","last_fullsized":"2024-09-21T07:25:42.849210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:44.995490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.585093+0000","last_change":"2024-09-21T07:25:41.302944+0000","last_active":"2024-09-21T07:25:43.585093+0000","last_peered":"2024-09-21T07:25:43.585093+0000","last_clean":"2024-09-21T07:25:43.585093+0000","last_became_active":"2024-09-21T07:25:41.302615+0000","last_became_peered":"2024-09-21T07:25:41.302615+0000","last_unstale":"2024-09-21T07:25:43.585093+0000","last_undegraded":"2024-09-21T07:25:43.585093+0000","last_fullsized":"2024-09-21T07:25:43.585093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:30.723109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294161+0000","last_change":"2024-09-21T07:25:40.306199+0000","last_active":"2024-09-21T07:25:42.294161+0000","last_peered":"2024-09-21T07:25:42.294161+0000","last_clean":"2024-09-21T07:25:42.294161+0000","last_became_active":"2024-09-21T07:25:40.305769+0000","last_became_peered":"2024-09-21T07:25:40.305769+0000","last_unstale":"2024-09-21T07:25:42.294161+0000","last_undegraded":"2024-09-21T07:25:42.294161+0000","last_fullsized":"2024-09-21T07:25:42.294161+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:48.912974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291644+0000","last_change":"2024-09-21T07:25:41.319773+0000","last_active":"2024-09-21T07:25:42.291644+0000","last_peered":"2024-09-21T07:25:42.291644+0000","last_clean":"2024-09-21T07:25:42.291644+0000","last_became_active":"2024-09-21T07:25:41.319373+0000","last_became_peered":"2024-09-21T07:25:41.319373+0000","last_unstale":"2024-09-21T07:25:42.291644+0000","last_undegraded":"2024-09-21T07:25:42.291644+0000","last_fullsized":"2024-09-21T07:25:42.291644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.713156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"55'8","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583936+0000","last_change":"2024-09-21T07:25:40.320257+0000","last_active":"2024-09-21T07:25:43.583936+0000","last_peered":"2024-09-21T07:25:43.583936+0000","last_clean":"2024-09-21T07:25:43.583936+0000","last_became_active":"2024-09-21T07:25:40.319892+0000","last_became_peered":"2024-09-21T07:25:40.319892+0000","last_unstale":"2024-09-21T07:25:43.583936+0000","last_undegraded":"2024-09-21T07:25:43.583936+0000","last_fullsized":"2024-09-21T07:25:43.583936+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:05.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583786+0000","last_change":"2024-09-21T07:25:41.305211+0000","last_active":"2024-09-21T07:25:43.583786+0000","last_peered":"2024-09-21T07:25:43.583786+0000","last_clean":"2024-09-21T07:25:43.583786+0000","last_became_active":"2024-09-21T07:25:41.303761+0000","last_became_peered":"2024-09-21T07:25:41.303761+0000","last_unstale":"2024-09-21T07:25:43.583786+0000","last_undegraded":"2024-09-21T07:25:43.583786+0000","last_fullsized":"2024-09-21T07:25:43.583786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:23.192154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291715+0000","last_change":"2024-09-21T07:25:40.319267+0000","last_active":"2024-09-21T07:25:42.291715+0000","last_peered":"2024-09-21T07:25:42.291715+0000","last_clean":"2024-09-21T07:25:42.291715+0000","last_became_active":"2024-09-21T07:25:40.318983+0000","last_became_peered":"2024-09-21T07:25:40.318983+0000","last_unstale":"2024-09-21T07:25:42.291715+0000","last_undegraded":"2024-09-21T07:25:42.291715+0000","last_fullsized":"2024-09-21T07:25:42.291715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.582929+0000","last_change":"2024-09-21T07:25:41.308091+0000","last_active":"2024-09-21T07:25:43.582929+0000","last_peered":"2024-09-21T07:25:43.582929+0000","last_clean":"2024-09-21T07:25:43.582929+0000","last_became_active":"2024-09-21T07:25:41.306860+0000","last_became_peered":"2024-09-21T07:25:41.306860+0000","last_unstale":"2024-09-21T07:25:43.582929+0000","last_undegraded":"2024-09-21T07:25:43.582929+0000","last_fullsized":"2024-09-21T07:25:43.582929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:22.967647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290782+0000","last_change":"2024-09-21T07:25:40.312155+0000","last_active":"2024-09-21T07:25:42.290782+0000","last_peered":"2024-09-21T07:25:42.290782+0000","last_clean":"2024-09-21T07:25:42.290782+0000","last_became_active":"2024-09-21T07:25:40.311878+0000","last_became_peered":"2024-09-21T07:25:40.311878+0000","last_unstale":"2024-09-21T07:25:42.290782+0000","last_undegraded":"2024-09-21T07:25:42.290782+0000","last_fullsized":"2024-09-21T07:25:42.290782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290206+0000","last_change":"2024-09-21T07:25:41.317327+0000","last_active":"2024-09-21T07:25:42.290206+0000","last_peered":"2024-09-21T07:25:42.290206+0000","last_clean":"2024-09-21T07:25:42.290206+0000","last_became_active":"2024-09-21T07:25:41.316941+0000","last_became_peered":"2024-09-21T07:25:41.316941+0000","last_unstale":"2024-09-21T07:25:42.290206+0000","last_undegraded":"2024-09-21T07:25:42.290206+0000","last_fullsized":"2024-09-21T07:25:42.290206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:56.746588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849311+0000","last_change":"2024-09-21T07:25:40.310464+0000","last_active":"2024-09-21T07:25:42.849311+0000","last_peered":"2024-09-21T07:25:42.849311+0000","last_clean":"2024-09-21T07:25:42.849311+0000","last_became_active":"2024-09-21T07:25:40.310137+0000","last_became_peered":"2024-09-21T07:25:40.310137+0000","last_unstale":"2024-09-21T07:25:42.849311+0000","last_undegraded":"2024-09-21T07:25:42.849311+0000","last_fullsized":"2024-09-21T07:25:42.849311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:45.962278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583942+0000","last_change":"2024-09-21T07:25:41.317689+0000","last_active":"2024-09-21T07:25:43.583942+0000","last_peered":"2024-09-21T07:25:43.583942+0000","last_clean":"2024-09-21T07:25:43.583942+0000","last_became_active":"2024-09-21T07:25:41.317350+0000","last_became_peered":"2024-09-21T07:25:41.317350+0000","last_unstale":"2024-09-21T07:25:43.583942+0000","last_undegraded":"2024-09-21T07:25:43.583942+0000","last_fullsized":"2024-09-21T07:25:43.583942+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:52.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849686+0000","last_change":"2024-09-21T07:25:40.297950+0000","last_active":"2024-09-21T07:25:42.849686+0000","last_peered":"2024-09-21T07:25:42.849686+0000","last_clean":"2024-09-21T07:25:42.849686+0000","last_became_active":"2024-09-21T07:25:40.297646+0000","last_became_peered":"2024-09-21T07:25:40.297646+0000","last_unstale":"2024-09-21T07:25:42.849686+0000","last_undegraded":"2024-09-21T07:25:42.849686+0000","last_fullsized":"2024-09-21T07:25:42.849686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:55.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584168+0000","last_change":"2024-09-21T07:25:41.318730+0000","last_active":"2024-09-21T07:25:43.584168+0000","last_peered":"2024-09-21T07:25:43.584168+0000","last_clean":"2024-09-21T07:25:43.584168+0000","last_became_active":"2024-09-21T07:25:41.318385+0000","last_became_peered":"2024-09-21T07:25:41.318385+0000","last_unstale":"2024-09-21T07:25:43.584168+0000","last_undegraded":"2024-09-21T07:25:43.584168+0000","last_fullsized":"2024-09-21T07:25:43.584168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:58.019648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584126+0000","last_change":"2024-09-21T07:25:40.303959+0000","last_active":"2024-09-21T07:25:43.584126+0000","last_peered":"2024-09-21T07:25:43.584126+0000","last_clean":"2024-09-21T07:25:43.584126+0000","last_became_active":"2024-09-21T07:25:40.303536+0000","last_became_peered":"2024-09-21T07:25:40.303536+0000","last_unstale":"2024-09-21T07:25:43.584126+0000","last_undegraded":"2024-09-21T07:25:43.584126+0000","last_fullsized":"2024-09-21T07:25:43.584126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.849393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849330+0000","last_change":"2024-09-21T07:25:41.317374+0000","last_active":"2024-09-21T07:25:42.849330+0000","last_peered":"2024-09-21T07:25:42.849330+0000","last_clean":"2024-09-21T07:25:42.849330+0000","last_became_active":"2024-09-21T07:25:41.317069+0000","last_became_peered":"2024-09-21T07:25:41.317069+0000","last_unstale":"2024-09-21T07:25:42.849330+0000","last_undegraded":"2024-09-21T07:25:42.849330+0000","last_fullsized":"2024-09-21T07:25:42.849330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:21.653003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583934+0000","last_change":"2024-09-21T07:25:40.320288+0000","last_active":"2024-09-21T07:25:43.583934+0000","last_peered":"2024-09-21T07:25:43.583934+0000","last_clean":"2024-09-21T07:25:43.583934+0000","last_became_active":"2024-09-21T07:25:40.319933+0000","last_became_peered":"2024-09-21T07:25:40.319933+0000","last_unstale":"2024-09-21T07:25:43.583934+0000","last_undegraded":"2024-09-21T07:25:43.583934+0000","last_fullsized":"2024-09-21T07:25:43.583934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.177907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291482+0000","last_change":"2024-09-21T07:25:41.321249+0000","last_active":"2024-09-21T07:25:42.291482+0000","last_peered":"2024-09-21T07:25:42.291482+0000","last_clean":"2024-09-21T07:25:42.291482+0000","last_became_active":"2024-09-21T07:25:41.320883+0000","last_became_peered":"2024-09-21T07:25:41.320883+0000","last_unstale":"2024-09-21T07:25:42.291482+0000","last_undegraded":"2024-09-21T07:25:42.291482+0000","last_fullsized":"2024-09-21T07:25:42.291482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:20.932587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.289545+0000","last_change":"2024-09-21T07:25:40.314157+0000","last_active":"2024-09-21T07:25:42.289545+0000","last_peered":"2024-09-21T07:25:42.289545+0000","last_clean":"2024-09-21T07:25:42.289545+0000","last_became_active":"2024-09-21T07:25:40.313354+0000","last_became_peered":"2024-09-21T07:25:40.313354+0000","last_unstale":"2024-09-21T07:25:42.289545+0000","last_undegraded":"2024-09-21T07:25:42.289545+0000","last_fullsized":"2024-09-21T07:25:42.289545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:38.743430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584464+0000","last_change":"2024-09-21T07:25:41.320071+0000","last_active":"2024-09-21T07:25:43.584464+0000","last_peered":"2024-09-21T07:25:43.584464+0000","last_clean":"2024-09-21T07:25:43.584464+0000","last_became_active":"2024-09-21T07:25:41.319671+0000","last_became_peered":"2024-09-21T07:25:41.319671+0000","last_unstale":"2024-09-21T07:25:43.584464+0000","last_undegraded":"2024-09-21T07:25:43.584464+0000","last_fullsized":"2024-09-21T07:25:43.584464+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:29.842400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290034+0000","last_change":"2024-09-21T07:25:40.312679+0000","last_active":"2024-09-21T07:25:42.290034+0000","last_peered":"2024-09-21T07:25:42.290034+0000","last_clean":"2024-09-21T07:25:42.290034+0000","last_became_active":"2024-09-21T07:25:40.312297+0000","last_became_peered":"2024-09-21T07:25:40.312297+0000","last_unstale":"2024-09-21T07:25:42.290034+0000","last_undegraded":"2024-09-21T07:25:42.290034+0000","last_fullsized":"2024-09-21T07:25:42.290034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:58.005893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584173+0000","last_change":"2024-09-21T07:25:41.308574+0000","last_active":"2024-09-21T07:25:43.584173+0000","last_peered":"2024-09-21T07:25:43.584173+0000","last_clean":"2024-09-21T07:25:43.584173+0000","last_became_active":"2024-09-21T07:25:41.307890+0000","last_became_peered":"2024-09-21T07:25:41.307890+0000","last_unstale":"2024-09-21T07:25:43.584173+0000","last_undegraded":"2024-09-21T07:25:43.584173+0000","last_fullsized":"2024-09-21T07:25:43.584173+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:09.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849469+0000","last_change":"2024-09-21T07:25:40.317705+0000","last_active":"2024-09-21T07:25:42.849469+0000","last_peered":"2024-09-21T07:25:42.849469+0000","last_clean":"2024-09-21T07:25:42.849469+0000","last_became_active":"2024-09-21T07:25:40.317305+0000","last_became_peered":"2024-09-21T07:25:40.317305+0000","last_unstale":"2024-09-21T07:25:42.849469+0000","last_undegraded":"2024-09-21T07:25:42.849469+0000","last_fullsized":"2024-09-21T07:25:42.849469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:37.686640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.583520+0000","last_change":"2024-09-21T07:25:41.336080+0000","last_active":"2024-09-21T07:25:43.583520+0000","last_peered":"2024-09-21T07:25:43.583520+0000","last_clean":"2024-09-21T07:25:43.583520+0000","last_became_active":"2024-09-21T07:25:41.333501+0000","last_became_peered":"2024-09-21T07:25:41.333501+0000","last_unstale":"2024-09-21T07:25:43.583520+0000","last_undegraded":"2024-09-21T07:25:43.583520+0000","last_fullsized":"2024-09-21T07:25:43.583520+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:53.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.294436+0000","last_change":"2024-09-21T07:25:40.316378+0000","last_active":"2024-09-21T07:25:42.294436+0000","last_peered":"2024-09-21T07:25:42.294436+0000","last_clean":"2024-09-21T07:25:42.294436+0000","last_became_active":"2024-09-21T07:25:40.316066+0000","last_became_peered":"2024-09-21T07:25:40.316066+0000","last_unstale":"2024-09-21T07:25:42.294436+0000","last_undegraded":"2024-09-21T07:25:42.294436+0000","last_fullsized":"2024-09-21T07:25:42.294436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:48.460925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584654+0000","last_change":"2024-09-21T07:25:41.319527+0000","last_active":"2024-09-21T07:25:43.584654+0000","last_peered":"2024-09-21T07:25:43.584654+0000","last_clean":"2024-09-21T07:25:43.584654+0000","last_became_active":"2024-09-21T07:25:41.318014+0000","last_became_peered":"2024-09-21T07:25:41.318014+0000","last_unstale":"2024-09-21T07:25:43.584654+0000","last_undegraded":"2024-09-21T07:25:43.584654+0000","last_fullsized":"2024-09-21T07:25:43.584654+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:14.977008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290436+0000","last_change":"2024-09-21T07:25:40.313910+0000","last_active":"2024-09-21T07:25:42.290436+0000","last_peered":"2024-09-21T07:25:42.290436+0000","last_clean":"2024-09-21T07:25:42.290436+0000","last_became_active":"2024-09-21T07:25:40.313570+0000","last_became_peered":"2024-09-21T07:25:40.313570+0000","last_unstale":"2024-09-21T07:25:42.290436+0000","last_undegraded":"2024-09-21T07:25:42.290436+0000","last_fullsized":"2024-09-21T07:25:42.290436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290319+0000","last_change":"2024-09-21T07:25:41.325207+0000","last_active":"2024-09-21T07:25:42.290319+0000","last_peered":"2024-09-21T07:25:42.290319+0000","last_clean":"2024-09-21T07:25:42.290319+0000","last_became_active":"2024-09-21T07:25:41.324878+0000","last_became_peered":"2024-09-21T07:25:41.324878+0000","last_unstale":"2024-09-21T07:25:42.290319+0000","last_undegraded":"2024-09-21T07:25:42.290319+0000","last_fullsized":"2024-09-21T07:25:42.290319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:11.912084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584616+0000","last_change":"2024-09-21T07:25:40.320634+0000","last_active":"2024-09-21T07:25:43.584616+0000","last_peered":"2024-09-21T07:25:43.584616+0000","last_clean":"2024-09-21T07:25:43.584616+0000","last_became_active":"2024-09-21T07:25:40.320142+0000","last_became_peered":"2024-09-21T07:25:40.320142+0000","last_unstale":"2024-09-21T07:25:43.584616+0000","last_undegraded":"2024-09-21T07:25:43.584616+0000","last_fullsized":"2024-09-21T07:25:43.584616+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.185436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584027+0000","last_change":"2024-09-21T07:25:41.300389+0000","last_active":"2024-09-21T07:25:43.584027+0000","last_peered":"2024-09-21T07:25:43.584027+0000","last_clean":"2024-09-21T07:25:43.584027+0000","last_became_active":"2024-09-21T07:25:41.300063+0000","last_became_peered":"2024-09-21T07:25:41.300063+0000","last_unstale":"2024-09-21T07:25:43.584027+0000","last_undegraded":"2024-09-21T07:25:43.584027+0000","last_fullsized":"2024-09-21T07:25:43.584027+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:37.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584084+0000","last_change":"2024-09-21T07:25:40.305976+0000","last_active":"2024-09-21T07:25:43.584084+0000","last_peered":"2024-09-21T07:25:43.584084+0000","last_clean":"2024-09-21T07:25:43.584084+0000","last_became_active":"2024-09-21T07:25:40.305647+0000","last_became_peered":"2024-09-21T07:25:40.305647+0000","last_unstale":"2024-09-21T07:25:43.584084+0000","last_undegraded":"2024-09-21T07:25:43.584084+0000","last_fullsized":"2024-09-21T07:25:43.584084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:54.510403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.291020+0000","last_change":"2024-09-21T07:25:41.331719+0000","last_active":"2024-09-21T07:25:42.291020+0000","last_peered":"2024-09-21T07:25:42.291020+0000","last_clean":"2024-09-21T07:25:42.291020+0000","last_became_active":"2024-09-21T07:25:41.331422+0000","last_became_peered":"2024-09-21T07:25:41.331422+0000","last_unstale":"2024-09-21T07:25:42.291020+0000","last_undegraded":"2024-09-21T07:25:42.291020+0000","last_fullsized":"2024-09-21T07:25:42.291020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.290086+0000","last_change":"2024-09-21T07:25:40.307486+0000","last_active":"2024-09-21T07:25:42.290086+0000","last_peered":"2024-09-21T07:25:42.290086+0000","last_clean":"2024-09-21T07:25:42.290086+0000","last_became_active":"2024-09-21T07:25:40.307093+0000","last_became_peered":"2024-09-21T07:25:40.307093+0000","last_unstale":"2024-09-21T07:25:42.290086+0000","last_undegraded":"2024-09-21T07:25:42.290086+0000","last_fullsized":"2024-09-21T07:25:42.290086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:38.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.585178+0000","last_change":"2024-09-21T07:25:41.311221+0000","last_active":"2024-09-21T07:25:43.585178+0000","last_peered":"2024-09-21T07:25:43.585178+0000","last_clean":"2024-09-21T07:25:43.585178+0000","last_became_active":"2024-09-21T07:25:41.310599+0000","last_became_peered":"2024-09-21T07:25:41.310599+0000","last_unstale":"2024-09-21T07:25:43.585178+0000","last_undegraded":"2024-09-21T07:25:43.585178+0000","last_fullsized":"2024-09-21T07:25:43.585178+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:35.042659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:43.584293+0000","last_change":"2024-09-21T07:25:40.305212+0000","last_active":"2024-09-21T07:25:43.584293+0000","last_peered":"2024-09-21T07:25:43.584293+0000","last_clean":"2024-09-21T07:25:43.584293+0000","last_became_active":"2024-09-21T07:25:40.304548+0000","last_became_peered":"2024-09-21T07:25:40.304548+0000","last_unstale":"2024-09-21T07:25:43.584293+0000","last_undegraded":"2024-09-21T07:25:43.584293+0000","last_fullsized":"2024-09-21T07:25:43.584293+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:38.547032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.849150+0000","last_change":"2024-09-21T07:25:41.306132+0000","last_active":"2024-09-21T07:25:42.849150+0000","last_peered":"2024-09-21T07:25:42.849150+0000","last_clean":"2024-09-21T07:25:42.849150+0000","last_became_active":"2024-09-21T07:25:41.305750+0000","last_became_peered":"2024-09-21T07:25:41.305750+0000","last_unstale":"2024-09-21T07:25:42.849150+0000","last_undegraded":"2024-09-21T07:25:42.849150+0000","last_fullsized":"2024-09-21T07:25:42.849150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:40.275489+0000","last_clean_scrub_stamp":"2024-09-21T07:25:40.275489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:46.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293055+0000","last_change":"2024-09-21T07:25:40.313563+0000","last_active":"2024-09-21T07:25:42.293055+0000","last_peered":"2024-09-21T07:25:42.293055+0000","last_clean":"2024-09-21T07:25:42.293055+0000","last_became_active":"2024-09-21T07:25:40.313179+0000","last_became_peered":"2024-09-21T07:25:40.313179+0000","last_unstale":"2024-09-21T07:25:42.293055+0000","last_undegraded":"2024-09-21T07:25:42.293055+0000","last_fullsized":"2024-09-21T07:25:42.293055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:25:39.272088+0000","last_clean_scrub_stamp":"2024-09-21T07:25:39.272088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:22.021254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":175,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T07:25:42.293868+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:25:42.293868+0000","last_peered":"2024-09-21T07:25:42.293868+0000","last_clean":"2024-09-21T07:25:42.293868+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:25:42.293868+0000","last_undegraded":"2024-09-21T07:25:42.293868+0000","last_fullsized":"2024-09-21T07:25:42.293868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":667648,"data_stored":296938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":659456,"data_stored":296286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":663552,"data_stored":296868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":671744,"data_stored":297898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":667648,"data_stored":296446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":1261568,"data_stored":886778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":675840,"data_stored":297920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:25:50.581 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:25:50.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- 172.21.15.64:0/3434328192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71640ca990 msgr2=0x7f71640b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 --2- 172.21.15.64:0/3434328192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71640ca990 0x7f71640b3ce0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f71640c7180 tx=0x7f715c01cd10 comp rx=0 tx=0).stop 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- 172.21.15.64:0/3434328192 shutdown_connections 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 --2- 172.21.15.64:0/3434328192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71640ca990 0x7f71640b3ce0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 --2- 172.21.15.64:0/3434328192 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640706c0 0x7f71640ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- 172.21.15.64:0/3434328192 >> 172.21.15.64:0/3434328192 conn(0x7f71640ccbe0 msgr2=0x7f71640ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:50.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- 172.21.15.64:0/3434328192 shutdown_connections 2024-09-21T07:25:50.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- 172.21.15.64:0/3434328192 wait complete. 2024-09-21T07:25:50.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 Processor -- start 2024-09-21T07:25:50.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.781+0000 7f716a600640 1 -- start start 2024-09-21T07:25:50.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640ca990 0x7f7164159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f716409d0e0 0x7f71640b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7164168d20 con 0x7f716415ec20 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7164168ba0 con 0x7f716409d0e0 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7164168ea0 con 0x7f71640ca990 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35862/0 (socket says 172.21.15.64:35862) 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 -- 172.21.15.64:0/1563341019 learned_addr learned my addr 172.21.15.64:0/1563341019 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f7163400640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640ca990 0x7f7164159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f7163e00640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f716409d0e0 0x7f71640b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 -- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640ca990 msgr2=0x7f7164159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640ca990 0x7f7164159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 -- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f716409d0e0 msgr2=0x7f71640b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:50.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f716409d0e0 0x7f71640b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:50.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 -- 172.21.15.64:0/1563341019 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716409d950 con 0x7f716415ec20 2024-09-21T07:25:50.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715be00640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f714c00ca20 tx=0x7f714c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:50.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c007c70 con 0x7f716415ec20 2024-09-21T07:25:50.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c00f450 con 0x7f716415ec20 2024-09-21T07:25:50.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c00f8a0 con 0x7f716415ec20 2024-09-21T07:25:50.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716415aba0 con 0x7f716415ec20 2024-09-21T07:25:50.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716415a0f0 con 0x7f716415ec20 2024-09-21T07:25:50.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.785+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71640ce740 con 0x7f716415ec20 2024-09-21T07:25:50.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.789+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f714c00fa40 con 0x7f716415ec20 2024-09-21T07:25:50.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.789+0000 7f715b400640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 0x7f7140075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:50.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.789+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f714c094ad0 con 0x7f716415ec20 2024-09-21T07:25:50.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.789+0000 7f7163400640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 0x7f7140075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:50.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.789+0000 7f7163400640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 0x7f7140075710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7164072330 tx=0x7f7154009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:50.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:50.793+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f714c014030 con 0x7f716415ec20 2024-09-21T07:25:51.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.033+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f71640ca250 con 0x7f716415ec20 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f715b400640 1 -- 172.21.15.64:0/1563341019 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f714c05f300 con 0x7f716415ec20 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:25:51.041 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:25:51.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 msgr2=0x7f7140075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 0x7f7140075710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7164072330 tx=0x7f7154009060 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 msgr2=0x7f71640b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f714c00ca20 tx=0x7f714c00cee0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 shutdown_connections 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7140073200 0x7f7140075710 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f716409d0e0 0x7f71640b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f716415ec20 0x7f71640b19d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 --2- 172.21.15.64:0/1563341019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71640ca990 0x7f7164159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 >> 172.21.15.64:0/1563341019 conn(0x7f71640ccbe0 msgr2=0x7f716415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 shutdown_connections 2024-09-21T07:25:51.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.037+0000 7f716a600640 1 -- 172.21.15.64:0/1563341019 wait complete. 2024-09-21T07:25:51.064 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:25:51.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 -- 172.21.15.64:0/3455609518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd098003cb0 msgr2=0x7fd098004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 --2- 172.21.15.64:0/3455609518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd098003cb0 0x7fd098004100 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4001860 tx=0x7fd0a401c880 comp rx=0 tx=0).stop 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 -- 172.21.15.64:0/3455609518 shutdown_connections 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 --2- 172.21.15.64:0/3455609518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd098003cb0 0x7fd098004100 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 -- 172.21.15.64:0/3455609518 >> 172.21.15.64:0/3455609518 conn(0x7fd0b40ccbe0 msgr2=0x7fd0b40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 -- 172.21.15.64:0/3455609518 shutdown_connections 2024-09-21T07:25:51.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.217+0000 7fd0bb600640 1 -- 172.21.15.64:0/3455609518 wait complete. 2024-09-21T07:25:51.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 Processor -- start 2024-09-21T07:25:51.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 -- start start 2024-09-21T07:25:51.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 0x7fd0b41fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:51.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 0x7fd0b415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 0x7fd0b41eb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b40b1be0 con 0x7fd0b40cab00 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4073950 con 0x7fd098003cb0 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0bb600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b40b1d60 con 0x7fd0b41fa370 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 0x7fd0b41fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0abe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 0x7fd0b415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0b9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 0x7fd0b41eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 0x7fd0b41fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:49268/0 (socket says 172.21.15.64:49268) 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0b8c00640 1 -- 172.21.15.64:0/2017295075 learned_addr learned my addr 172.21.15.64:0/2017295075 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:51.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.221+0000 7fd0abe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 0x7fd0b415c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:58808/0 (socket says 172.21.15.64:58808) 2024-09-21T07:25:51.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 -- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 msgr2=0x7fd0b415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 0x7fd0b415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 -- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 msgr2=0x7fd0b41fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 0x7fd0b41fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 -- 172.21.15.64:0/2017295075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b40cb530 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b9600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 0x7fd0b41eb140 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b5130 tx=0x7fd0ac004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac010890 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0ac017070 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b41f98d0 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac010e00 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b41f9b70 con 0x7fd0b40cab00 2024-09-21T07:25:51.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b40b2250 con 0x7fd0b40cab00 2024-09-21T07:25:51.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd0ac01c460 con 0x7fd0b40cab00 2024-09-21T07:25:51.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.225+0000 7fd0b1600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 0x7fd090075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:51.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.229+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fd0ac094e40 con 0x7fd0b40cab00 2024-09-21T07:25:51.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.229+0000 7fd0b8c00640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 0x7fd090075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:51.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.229+0000 7fd0b8c00640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 0x7fd090075710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0a401b150 tx=0x7fd0a40b1040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:51.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.233+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd0b40b4b10 con 0x7fd0b40cab00 2024-09-21T07:25:51.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0b40b35a0 con 0x7fd0b40cab00 2024-09-21T07:25:51.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0b1600640 1 -- 172.21.15.64:0/2017295075 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7fd0ac05fc30 con 0x7fd0b40cab00 2024-09-21T07:25:51.449 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:25:51.450 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":26,"btime":"2024-09-21T07:25:44:316261+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:25:43.738974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:25:51.450 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 26 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 msgr2=0x7fd090075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 0x7fd090075710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0a401b150 tx=0x7fd0a40b1040 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 msgr2=0x7fd0b41eb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 0x7fd0b41eb140 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b5130 tx=0x7fd0ac004f90 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 shutdown_connections 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd090073200 0x7fd090075710 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b40cab00 0x7fd0b41eb140 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0b41fa370 0x7fd0b415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 --2- 172.21.15.64:0/2017295075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd098003cb0 0x7fd0b41fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 >> 172.21.15.64:0/2017295075 conn(0x7fd0b40ccbe0 msgr2=0x7fd0b40aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 shutdown_connections 2024-09-21T07:25:51.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:51.445+0000 7fd0bb600640 1 -- 172.21.15.64:0/2017295075 wait complete. 2024-09-21T07:25:51.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:25:40.723732+0000', 'modified': '2024-09-21T07:25:43.738974+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5376}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5376': {'gid': 5376, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6833/3183811965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 3183811965}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 3183811965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5376, 'qdb_cluster': [5376]} 2024-09-21T07:25:51.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:25:51.875 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 -- 172.21.15.64:0/2354692709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b88004e50 msgr2=0x7f6b8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 --2- 172.21.15.64:0/2354692709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b88004e50 0x7f6b8800b9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b4ba0 tx=0x7f6b9c01caf0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6ba3e00640 1 -- 172.21.15.64:0/2354692709 reap_dead start 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 -- 172.21.15.64:0/2354692709 shutdown_connections 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 -- 172.21.15.64:0/2354692709 >> 172.21.15.64:0/2354692709 conn(0x7f6ba40d23b0 msgr2=0x7f6ba40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 -- 172.21.15.64:0/2354692709 shutdown_connections 2024-09-21T07:25:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.033+0000 7f6baa000640 1 -- 172.21.15.64:0/2354692709 wait complete. 2024-09-21T07:25:52.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 Processor -- start 2024-09-21T07:25:52.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- start start 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b88004e50 0x7f6ba41f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ba40ca440 0x7f6ba41f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba415d590 con 0x7f6ba40b5b70 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba415d410 con 0x7f6ba40ca440 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba415d710 con 0x7f6b88004e50 2024-09-21T07:25:52.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35898/0 (socket says 172.21.15.64:35898) 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1594682863 learned_addr learned my addr 172.21.15.64:0/1594682863 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ba40ca440 0x7f6ba41f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b88004e50 0x7f6ba41f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b88004e50 msgr2=0x7f6ba41f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b88004e50 0x7f6ba41f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ba40ca440 msgr2=0x7f6ba41f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ba40ca440 0x7f6ba41f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1594682863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba40b5310 con 0x7f6ba40b5b70 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ab040 tx=0x7f6b9c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6b9be00640 1 -- 172.21.15.64:0/1594682863 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c006cb0 con 0x7f6ba40b5b70 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6b9be00640 1 -- 172.21.15.64:0/1594682863 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b9c0019f0 con 0x7f6ba40b5b70 2024-09-21T07:25:52.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6b9be00640 1 -- 172.21.15.64:0/1594682863 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0a5e60 con 0x7f6ba40b5b70 2024-09-21T07:25:52.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba40b55f0 con 0x7f6ba40b5b70 2024-09-21T07:25:52.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.037+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba40c6f60 con 0x7f6ba40b5b70 2024-09-21T07:25:52.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.041+0000 7f6b9be00640 1 -- 172.21.15.64:0/1594682863 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6b9c006330 con 0x7f6ba40b5b70 2024-09-21T07:25:52.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.041+0000 7f6b9be00640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 0x7f6b80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.041+0000 7f6b9be00640 1 -- 172.21.15.64:0/1594682863 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b9c12dae0 con 0x7f6ba40b5b70 2024-09-21T07:25:52.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.041+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 0x7f6b80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 0x7f6b80075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006c20 tx=0x7f6b940067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 Processor -- start 2024-09-21T07:25:52.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- start start 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc3c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc3d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55749fb11410 con 0x55749faeb950 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55749fa4eb40 con 0x55749f6fb460 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55749fa3df70 con 0x55749fad4ca0 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35900/0 (socket says 172.21.15.64:35900) 2024-09-21T07:25:52.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 -- 172.21.15.64:0/784964731 learned_addr learned my addr 172.21.15.64:0/784964731 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6ba3400640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc3c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc3d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 -- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 msgr2=0x55749fc3d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc3d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 -- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 msgr2=0x55749fc3c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc3c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 -- 172.21.15.64:0/784964731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749fa055b0 con 0x55749faeb950 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc3d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6ba3400640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc3c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c003730 tx=0x7f6b8c003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597df483d2899c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b93400640 1 -- 172.21.15.64:0/784964731 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c003ea0 con 0x55749faeb950 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b93400640 1 -- 172.21.15.64:0/784964731 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c00bbd0 con 0x55749faeb950 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6b93400640 1 -- 172.21.15.64:0/784964731 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c005020 con 0x55749faeb950 2024-09-21T07:25:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- 172.21.15.64:0/784964731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 msgr2=0x55749fc3cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c003730 tx=0x7f6b8c003bf0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- 172.21.15.64:0/784964731 shutdown_connections 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc3d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc3cbe0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/784964731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc3c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- 172.21.15.64:0/784964731 >> 172.21.15.64:0/784964731 conn(0x55749fbc1d90 msgr2=0x55749fbf1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.045+0000 7f6bb15c0000 1 -- 172.21.15.64:0/784964731 shutdown_connections 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 -- 172.21.15.64:0/784964731 wait complete. 2024-09-21T07:25:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 -- start start 2024-09-21T07:25:52.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 Processor -- start 2024-09-21T07:25:52.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc43920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc43e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55749f9d85f0 con 0x55749faeb950 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55749fa41d80 con 0x55749f6fb460 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55749f9e4520 con 0x55749fad4ca0 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6bb15c0000 10 client.0 _ll_register_callbacks cb 0x55749f9e8830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35906/0 (socket says 172.21.15.64:35906) 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc43e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1981997202 learned_addr learned my addr 172.21.15.64:0/1981997202 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc43920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 msgr2=0x55749fc43e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc43e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 msgr2=0x55749fc43920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc43920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 -- 172.21.15.64:0/1981997202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55749f9dc190 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0060a0 tx=0x7f6b9c0f7a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d526e1660297c49d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6b87e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.049+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c101960 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55749f9d6110 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b9c0f7570 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b9c0ff280 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 10 client.5526 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55749fac2f10 con 0x55749faeb950 2024-09-21T07:25:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55749f9d6110 con 0x55749faeb950 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f6b9c0b6020 con 0x55749faeb950 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 10 client.5526 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 10 client.5526 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 20 client.5526 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6e07d0 0x55749fc4dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 4 client.5526 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55749fa50a90 con 0x55749f6e07d0 2024-09-21T07:25:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6e07d0 0x55749fc4dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6e07d0 0x55749fc4dd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba078872a1031641 server_cookie=4b6820e814f18f02 in_seq=0 out_seq=0 2024-09-21T07:25:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 10 client.5526 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 1 -- 172.21.15.64:0/1981997202 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55749fa50a90 con 0x55749f6e07d0 2024-09-21T07:25:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 10 client.5526 handle_command_reply: tid=0 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 client.5526 shutdown 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 msgr2=0x55749fc443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0060a0 tx=0x7f6b9c0f7a80 comp rx=0 tx=0).stop 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 shutdown_connections 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6e07d0 0x55749fc4dd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749faeb950 0x55749fc443a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fc43e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1981997202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fc43920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6b87e00640 0 client.5526 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 >> 172.21.15.64:0/1981997202 conn(0x55749fbc1d90 msgr2=0x55749fbf8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 shutdown_connections 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1981997202 wait complete. 2024-09-21T07:25:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.053+0000 7f6bb15c0000 20 client.5526 trim_cache size 0 max 16384 2024-09-21T07:25:52.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 Processor -- start 2024-09-21T07:25:52.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 -- start start 2024-09-21T07:25:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fcaeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749faeb950 0x55749fcaf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4202ef0 con 0x55749f6fb460 2024-09-21T07:25:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4201ef0 con 0x55749faeb950 2024-09-21T07:25:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba4201250 con 0x55749fad4ca0 2024-09-21T07:25:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6ba3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6ba3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35922/0 (socket says 172.21.15.64:35922) 2024-09-21T07:25:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.073+0000 7f6ba3400640 1 -- 172.21.15.64:0/3449753082 learned_addr learned my addr 172.21.15.64:0/3449753082 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749faeb950 0x55749fcaf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fcaeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 -- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 msgr2=0x55749fcaeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fcaeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 -- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749faeb950 msgr2=0x55749fcaf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749faeb950 0x55749fcaf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 -- 172.21.15.64:0/3449753082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749fa99db0 con 0x55749f6fb460 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6ba3400640 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001250 tx=0x7f6b94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20284bd9eaa0aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6b92a00640 1 -- 172.21.15.64:0/3449753082 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94013b60 con 0x55749f6fb460 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6b92a00640 1 -- 172.21.15.64:0/3449753082 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b94013d00 con 0x55749f6fb460 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6b92a00640 1 -- 172.21.15.64:0/3449753082 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9402f610 con 0x55749f6fb460 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- 172.21.15.64:0/3449753082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 msgr2=0x55749fcae620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001250 tx=0x7f6b94015000 comp rx=0 tx=0).stop 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- 172.21.15.64:0/3449753082 shutdown_connections 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749faeb950 0x55749fcaf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749fad4ca0 0x55749fcaeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/3449753082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749f6fb460 0x55749fcae620 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- 172.21.15.64:0/3449753082 >> 172.21.15.64:0/3449753082 conn(0x55749fbc1d90 msgr2=0x55749fc3a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- 172.21.15.64:0/3449753082 shutdown_connections 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- 172.21.15.64:0/3449753082 wait complete. 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 -- start start 2024-09-21T07:25:52.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.077+0000 7f6bb15c0000 1 Processor -- start 2024-09-21T07:25:52.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fcb2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749faeb950 0x55749fcb2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55749f9e4520 con 0x55749fad4ca0 2024-09-21T07:25:52.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba42018a0 con 0x55749f6fb460 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55749f9d85f0 con 0x55749faeb950 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 10 client.0 _ll_register_callbacks cb 0x7f6b9c0f7c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6ba3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fcb2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35924/0 (socket says 172.21.15.64:35924) 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1468533186 learned_addr learned my addr 172.21.15.64:0/1468533186 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6ba3e00640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749faeb950 0x55749fcb2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749faeb950 msgr2=0x55749fcb2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749faeb950 0x55749fcb2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 msgr2=0x55749fcb2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fcb2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1468533186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55749fa04ab0 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0043b0 tx=0x7f6b8c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cec37befcfbf93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c005020 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b8c027c70 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b94013d00 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c027e70 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 10 client.5532 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55749f9e3070 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b94013d00 con 0x55749fad4ca0 2024-09-21T07:25:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8c025070 con 0x55749fad4ca0 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 10 client.5532 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 10 client.5532 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 20 client.5532 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6ce830 0x55749fc6e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 4 client.5532 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "status"}) -- 0x55749fa4c540 con 0x55749f6ce830 2024-09-21T07:25:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6ce830 0x55749fc6e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 10 client.5532 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6ba3400640 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6ce830 0x55749fc6e680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d9bd68a8e1688 server_cookie=21a16bbbd2cabc7e in_seq=0 out_seq=0 2024-09-21T07:25:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 1 -- 172.21.15.64:0/1468533186 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55749fa4c540 con 0x55749f6ce830 2024-09-21T07:25:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 10 client.5532 handle_command_reply: tid=0 2024-09-21T07:25:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 client.5532 shutdown 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 msgr2=0x55749fcb28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0043b0 tx=0x7f6b8c00be50 comp rx=0 tx=0).stop 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 shutdown_connections 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55749f6ce830 0x55749fc6e680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55749faeb950 0x55749fcb2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55749fad4ca0 0x55749fcb28d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 --2- 172.21.15.64:0/1468533186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55749f6fb460 0x55749fcb2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6b87e00640 0 client.5532 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 >> 172.21.15.64:0/1468533186 conn(0x55749fbc1d90 msgr2=0x55749fc3afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 shutdown_connections 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.081+0000 7f6bb15c0000 1 -- 172.21.15.64:0/1468533186 wait complete. 2024-09-21T07:25:52.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6bb15c0000 20 client.5532 trim_cache size 0 max 16384 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 5376, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.801263929999999, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 26, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 56, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 56, 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.917021516 2024-09-21T07:25:52.091 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 msgr2=0x7f6b80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 0x7f6b80075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006c20 tx=0x7f6b940067b0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 msgr2=0x7f6ba40b7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ab040 tx=0x7f6b9c003f20 comp rx=0 tx=0).stop 2024-09-21T07:25:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 shutdown_connections 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b80073200 0x7f6b80075710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba40b5b70 0x7f6ba40b7630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ba40ca440 0x7f6ba41f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 --2- 172.21.15.64:0/1594682863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b88004e50 0x7f6ba41f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 >> 172.21.15.64:0/1594682863 conn(0x7f6ba40d23b0 msgr2=0x7f6ba406e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 shutdown_connections 2024-09-21T07:25:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.085+0000 7f6baa000640 1 -- 172.21.15.64:0/1594682863 wait complete. 2024-09-21T07:25:52.108 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 -- 172.21.15.64:0/4047873736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c0b43f0 msgr2=0x7ff30c0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 --2- 172.21.15.64:0/4047873736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c0b43f0 0x7ff30c0cd1c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0cc7d0 tx=0x7ff2f801c2b0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 -- 172.21.15.64:0/4047873736 shutdown_connections 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 --2- 172.21.15.64:0/4047873736 >> v2:172.21.15.90:3300/0 conn(0x7ff30c0d0080 0x7ff30c0d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 --2- 172.21.15.64:0/4047873736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c0b43f0 0x7ff30c0cd1c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 -- 172.21.15.64:0/4047873736 >> 172.21.15.64:0/4047873736 conn(0x7ff30c06d480 msgr2=0x7ff30c0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 -- 172.21.15.64:0/4047873736 shutdown_connections 2024-09-21T07:25:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.261+0000 7ff314200640 1 -- 172.21.15.64:0/4047873736 wait complete. 2024-09-21T07:25:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 Processor -- start 2024-09-21T07:25:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 -- start start 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff30c0b7a60 0x7ff30c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff30c0d0080 0x7ff30c1fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c16a7a0 con 0x7ff30c1598a0 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c16a620 con 0x7ff30c0d0080 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff314200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c16a920 con 0x7ff30c0b7a60 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff312200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff312200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35950/0 (socket says 172.21.15.64:35950) 2024-09-21T07:25:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff312200640 1 -- 172.21.15.64:0/3066239447 learned_addr learned my addr 172.21.15.64:0/3066239447 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff310e00640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff30c0d0080 0x7ff30c1fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.265+0000 7ff311800640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff30c0b7a60 0x7ff30c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 -- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff30c0b7a60 msgr2=0x7ff30c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff30c0b7a60 0x7ff30c14c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 -- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff30c0d0080 msgr2=0x7ff30c1fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff30c0d0080 0x7ff30c1fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 -- 172.21.15.64:0/3066239447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c0cbc30 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff312200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff30400eae0 tx=0x7ff304009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30400ce40 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff304004c20 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304005020 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c0cbf10 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c14cc60 con 0x7ff30c1598a0 2024-09-21T07:25:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c0cc150 con 0x7ff30c1598a0 2024-09-21T07:25:52.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.269+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3040051c0 con 0x7ff30c1598a0 2024-09-21T07:25:52.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.273+0000 7ff309600640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 0x7ff2ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:52.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.273+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7ff3040950f0 con 0x7ff30c1598a0 2024-09-21T07:25:52.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.273+0000 7ff311800640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 0x7ff2ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:52.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.273+0000 7ff311800640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 0x7ff2ec075710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff300007fd0 tx=0x7ff300009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:52.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.277+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff30c0cc150 con 0x7ff30c1598a0 2024-09-21T07:25:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff30c0cb9b0 con 0x7ff30c1598a0 2024-09-21T07:25:52.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff309600640 1 -- 172.21.15.64:0/3066239447 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7ff30c0cb9b0 con 0x7ff30c1598a0 2024-09-21T07:25:52.493 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 msgr2=0x7ff2ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 0x7ff2ec075710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff300007fd0 tx=0x7ff300009040 comp rx=0 tx=0).stop 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 msgr2=0x7ff30c1fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff30400eae0 tx=0x7ff304009f70 comp rx=0 tx=0).stop 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 shutdown_connections 2024-09-21T07:25:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff2ec073200 0x7ff2ec075710 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff30c1598a0 0x7ff30c1fce00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff30c0d0080 0x7ff30c1fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 --2- 172.21.15.64:0/3066239447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff30c0b7a60 0x7ff30c14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 >> 172.21.15.64:0/3066239447 conn(0x7ff30c06d480 msgr2=0x7ff30c06ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 shutdown_connections 2024-09-21T07:25:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52.489+0000 7ff314200640 1 -- 172.21.15.64:0/3066239447 wait complete. 2024-09-21T07:25:52.515 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:25:52.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:25:52.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:25:52.516 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:25:52.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.516 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:25:52.525 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:25:52.526 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42231sec preferred_lft 42231sec 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:25:52.527 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:25:52.530 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:25:52.531 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:25:52.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.532 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:25:52.593 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:25:52.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.596 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:25:52.650 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:25:52.651 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:25:52.652 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:25:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:25:52.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:25:52.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.788 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:25:52.798 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:25:52.798 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:25:52.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:25:52.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.800 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:25:52.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:25:52.863 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:52.912 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:25:52.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:25:52.912 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:52.963 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:25:52.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:52.963 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:25:53.065 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:25:53.065 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:25:53.078 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:25:53.078 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:25:53.078 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:25:53.078 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:25:53.079 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:25:53.082 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:25:53.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:53.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:53.102 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:25:53.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:25:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:25:53.208 INFO:teuthology.orchestra.run.smithi064.stdout:client5491 2024-09-21T07:25:53.209 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:53.209 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:53.218 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:25:53.218 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-21T07:25:53.218 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-21T07:25:53.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:53.219 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> import json 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> import sys 2024-09-21T07:25:53.275 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> except OSError as e: 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> sys.exit(e.errno) 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> print(json.dumps( 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> indent=2)) 2024-09-21T07:25:53.276 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:25:53.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:53 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-21T07:25:53.396 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T07:25:53.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:53.396 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-21T07:25:53.451 INFO:teuthology.orchestra.run.smithi064.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-21T07:25:53.637 INFO:teuthology.orchestra.run.smithi064.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-21T07:25:57.418 INFO:teuthology.orchestra.run.smithi064.stderr:Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 68% (956/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-21T07:25:57.423 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-21T07:25:57.423 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-21T07:25:57.424 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-21T07:25:57.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- 172.21.15.64:0/778969283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940706c0 msgr2=0x7f6b940b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 --2- 172.21.15.64:0/778969283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940706c0 0x7f6b940b3ce0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009bc0 tx=0x7f6b8c01cb10 comp rx=0 tx=0).stop 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- 172.21.15.64:0/778969283 shutdown_connections 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 --2- 172.21.15.64:0/778969283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940706c0 0x7f6b940b3ce0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 --2- 172.21.15.64:0/778969283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9415ec20 0x7f6b940ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- 172.21.15.64:0/778969283 >> 172.21.15.64:0/778969283 conn(0x7f6b940ccbe0 msgr2=0x7f6b940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- 172.21.15.64:0/778969283 shutdown_connections 2024-09-21T07:25:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- 172.21.15.64:0/778969283 wait complete. 2024-09-21T07:25:57.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 Processor -- start 2024-09-21T07:25:57.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.625+0000 7f6b99400640 1 -- start start 2024-09-21T07:25:57.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940ca990 0x7f6b9415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9415ec20 0x7f6b940cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b940c67c0 0x7f6b940cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94168d20 con 0x7f6b940c67c0 2024-09-21T07:25:57.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94168ba0 con 0x7f6b940ca990 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b94168ea0 con 0x7f6b9415ec20 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b940c67c0 0x7f6b940cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b940c67c0 0x7f6b940cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37496/0 (socket says 172.21.15.64:37496) 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 -- 172.21.15.64:0/2755699152 learned_addr learned my addr 172.21.15.64:0/2755699152 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b92800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940ca990 0x7f6b9415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b8be00640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9415ec20 0x7f6b940cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 -- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9415ec20 msgr2=0x7f6b940cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9415ec20 0x7f6b940cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 -- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940ca990 msgr2=0x7f6b9415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b940ca990 0x7f6b9415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 -- 172.21.15.64:0/2755699152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940c5720 con 0x7f6b940c67c0 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b93200640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b940c67c0 0x7f6b940cbe60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009b10 tx=0x7f6b8c0a5980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b8aa00640 1 -- 172.21.15.64:0/2755699152 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0bb070 con 0x7f6b940c67c0 2024-09-21T07:25:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b8aa00640 1 -- 172.21.15.64:0/2755699152 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c004d40 con 0x7f6b940c67c0 2024-09-21T07:25:57.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 -- 172.21.15.64:0/2755699152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b940c5a00 con 0x7f6b940c67c0 2024-09-21T07:25:57.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b8aa00640 1 -- 172.21.15.64:0/2755699152 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0b2040 con 0x7f6b940c67c0 2024-09-21T07:25:57.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.629+0000 7f6b99400640 1 -- 172.21.15.64:0/2755699152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b940c5fc0 con 0x7f6b940c67c0 2024-09-21T07:25:57.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6b8aa00640 1 -- 172.21.15.64:0/2755699152 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6b8c005290 con 0x7f6b940c67c0 2024-09-21T07:25:57.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6b8aa00640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b70073200 0x7f6b70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6b8aa00640 1 -- 172.21.15.64:0/2755699152 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b8c12def0 con 0x7f6b940c67c0 2024-09-21T07:25:57.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6b92800640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b70073200 0x7f6b70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6ba0b54000 1 Processor -- start 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6ba0b54000 1 -- start start 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.633+0000 7f6b92800640 1 --2- 172.21.15.64:0/2755699152 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b70073200 0x7f6b70075710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b840096c0 tx=0x7f6b84009260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x564448018830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x5644480192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564447ee7bf0 con 0x564447b35b30 2024-09-21T07:25:57.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564447e5cd60 con 0x564447ed7930 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564447e4c190 con 0x564447bf9d40 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37502/0 (socket says 172.21.15.64:37502) 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 -- 172.21.15.64:0/3107134727 learned_addr learned my addr 172.21.15.64:0/3107134727 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b93200640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x5644480192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b92800640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x564448018830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 -- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 msgr2=0x5644480192b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x5644480192b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 -- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 msgr2=0x564448018830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x564448018830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 -- 172.21.15.64:0/3107134727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564447dff440 con 0x564447b35b30 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b92800640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x564448018830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001790 tx=0x7f6b7c001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18f18c18d0bf659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b83000640 1 -- 172.21.15.64:0/3107134727 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0052e0 con 0x564447b35b30 2024-09-21T07:25:57.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b83000640 1 -- 172.21.15.64:0/3107134727 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b7c018070 con 0x564447b35b30 2024-09-21T07:25:57.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6b83000640 1 -- 172.21.15.64:0/3107134727 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00fa10 con 0x564447b35b30 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3107134727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 msgr2=0x564448018d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001790 tx=0x7f6b7c001c50 comp rx=0 tx=0).stop 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3107134727 shutdown_connections 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x5644480192b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448018d70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3107134727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x564448018830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3107134727 >> 172.21.15.64:0/3107134727 conn(0x564447f1ce10 msgr2=0x56444802d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3107134727 shutdown_connections 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.637+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3107134727 wait complete. 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- start start 2024-09-21T07:25:57.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 Processor -- start 2024-09-21T07:25:57.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x564448051c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x5644480521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564447df1710 con 0x564447b35b30 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564447e4ffa0 con 0x564447ed7930 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564447b11920 con 0x564447bf9d40 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 10 client.0 _ll_register_callbacks cb 0x564447ed3d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37508/0 (socket says 172.21.15.64:37508) 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 -- 172.21.15.64:0/3121086240 learned_addr learned my addr 172.21.15.64:0/3121086240 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x564448051c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b93200640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x5644480521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 -- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 msgr2=0x564448051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x564448051c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 -- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 msgr2=0x5644480521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x5644480521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 -- 172.21.15.64:0/3121086240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564447e1a5b0 con 0x564447b35b30 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b93200640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x5644480521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x564448051c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b92800640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b8401e8e0 tx=0x7f6b84004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be39dc8098a58aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b77400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8402b060 con 0x564447b35b30 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b8400e880 con 0x564447b35b30 2024-09-21T07:25:57.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564447de44b0 con 0x564447b35b30 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b84031050 con 0x564447b35b30 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 10 client.5550 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.641+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564447dea370 con 0x564447b35b30 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564447de44b0 con 0x564447b35b30 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f6b84034020 con 0x564447b35b30 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 10 client.5550 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 20 client.5550 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447aeebd0 0x56444805bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 4 client.5550 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564447e5ecb0 con 0x564447aeebd0 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447aeebd0 0x56444805bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b8be00640 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447aeebd0 0x56444805bb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73b8a809715f2e31 server_cookie=d9ee098acdb45336 in_seq=0 out_seq=0 2024-09-21T07:25:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 10 client.5550 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 1 -- 172.21.15.64:0/3121086240 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564447e5ecb0 con 0x564447aeebd0 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 10 client.5550 handle_command_reply: tid=0 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 client.5550 shutdown 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 msgr2=0x564448051740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b8401e8e0 tx=0x7f6b84004740 comp rx=0 tx=0).stop 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 shutdown_connections 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447aeebd0 0x56444805bb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447ed7930 0x5644480521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447bf9d40 0x564448051c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/3121086240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x564448051740 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6b77400640 0 client.5550 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 >> 172.21.15.64:0/3121086240 conn(0x564447f1ce10 msgr2=0x56444802bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 shutdown_connections 2024-09-21T07:25:57.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 1 -- 172.21.15.64:0/3121086240 wait complete. 2024-09-21T07:25:57.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.645+0000 7f6ba0b54000 20 client.5550 trim_cache size 0 max 16384 2024-09-21T07:25:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 Processor -- start 2024-09-21T07:25:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 -- start start 2024-09-21T07:25:57.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x56444805bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x56444805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56444801dc30 con 0x564447b35b30 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b942056e0 con 0x564447bf9d40 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b94204720 con 0x564447f1ce10 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6b8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6b8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37516/0 (socket says 172.21.15.64:37516) 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.661+0000 7f6b8be00640 1 -- 172.21.15.64:0/4045858436 learned_addr learned my addr 172.21.15.64:0/4045858436 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b92800640 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x56444805bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b93200640 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x56444805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 -- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 msgr2=0x56444805bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x56444805bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 -- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 msgr2=0x56444805c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x56444805c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 -- 172.21.15.64:0/4045858436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564447ea7880 con 0x564447b35b30 2024-09-21T07:25:57.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b8be00640 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001ec0 tx=0x7f6b7c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fc1891c973de68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b82600640 1 -- 172.21.15.64:0/4045858436 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c02f070 con 0x564447b35b30 2024-09-21T07:25:57.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b82600640 1 -- 172.21.15.64:0/4045858436 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b7c018040 con 0x564447b35b30 2024-09-21T07:25:57.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6b82600640 1 -- 172.21.15.64:0/4045858436 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00fda0 con 0x564447b35b30 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- 172.21.15.64:0/4045858436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 msgr2=0x56444805c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001ec0 tx=0x7f6b7c009040 comp rx=0 tx=0).stop 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- 172.21.15.64:0/4045858436 shutdown_connections 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x56444805c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x56444805c060 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/4045858436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x56444805bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- 172.21.15.64:0/4045858436 >> 172.21.15.64:0/4045858436 conn(0x564448016860 msgr2=0x564448029520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- 172.21.15.64:0/4045858436 shutdown_connections 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- 172.21.15.64:0/4045858436 wait complete. 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 -- start start 2024-09-21T07:25:57.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.665+0000 7f6ba0b54000 1 Processor -- start 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x5644480c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x5644480c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564447e0add0 con 0x564447b35b30 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564447b11920 con 0x564447bf9d40 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564447e4ffa0 con 0x564447f1ce10 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 10 client.0 _ll_register_callbacks cb 0x7f6b840098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37522/0 (socket says 172.21.15.64:37522) 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 -- 172.21.15.64:0/143563442 learned_addr learned my addr 172.21.15.64:0/143563442 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b93200640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x5644480c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b8be00640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x5644480c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 -- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 msgr2=0x5644480c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x5644480c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 -- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 msgr2=0x5644480c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x5644480c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 -- 172.21.15.64:0/143563442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564447dd8600 con 0x564447b35b30 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b92800640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6b8401e8e0 tx=0x7f6b8400e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0c0007497fae5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:57.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84039070 con 0x564447b35b30 2024-09-21T07:25:57.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6b84004040 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b7c018040 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b84041050 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 10 client.5556 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564447de27e0 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b7c018040 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f6b84044020 con 0x564447b35b30 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 10 client.5556 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 10 client.5556 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 20 client.5556 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447b08280 0x56444807c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 4 client.5556 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x564447e5a760 con 0x564447b08280 2024-09-21T07:25:57.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b8be00640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447b08280 0x56444807c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 10 client.5556 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b8be00640 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447b08280 0x56444807c9f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d6ce68a3bb37c3 server_cookie=e3ce1ad151506f38 in_seq=0 out_seq=0 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 1 -- 172.21.15.64:0/143563442 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x564447e5a760 con 0x564447b08280 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 10 client.5556 handle_command_reply: tid=0 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 client.5556 shutdown 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 msgr2=0x5644480c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6b8401e8e0 tx=0x7f6b8400e930 comp rx=0 tx=0).stop 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 shutdown_connections 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564447b08280 0x56444807c9f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564447f1ce10 0x5644480c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564447bf9d40 0x5644480c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 --2- 172.21.15.64:0/143563442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564447b35b30 0x5644480c05d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6b77400640 0 client.5556 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.669+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 >> 172.21.15.64:0/143563442 conn(0x564448016860 msgr2=0x564448029ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.673+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 shutdown_connections 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.673+0000 7f6ba0b54000 1 -- 172.21.15.64:0/143563442 wait complete. 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.673+0000 7f6ba0b54000 20 client.5556 trim_cache size 0 max 16384 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": -2 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:Error ENOENT: 2024-09-21T07:25:57.683 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T07:25:57.683 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-21T07:25:57.683 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-21T07:25:57.684 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-21T07:25:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- 172.21.15.64:0/883587294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00cca90 msgr2=0x7f62b0073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 --2- 172.21.15.64:0/883587294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00cca90 0x7f62b0073690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009840 tx=0x7f62a001c6d0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- 172.21.15.64:0/883587294 shutdown_connections 2024-09-21T07:25:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 --2- 172.21.15.64:0/883587294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00cca90 0x7f62b0073690 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- 172.21.15.64:0/883587294 >> 172.21.15.64:0/883587294 conn(0x7f62b00b2510 msgr2=0x7f62b00b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- 172.21.15.64:0/883587294 shutdown_connections 2024-09-21T07:25:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- 172.21.15.64:0/883587294 wait complete. 2024-09-21T07:25:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 Processor -- start 2024-09-21T07:25:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.841+0000 7f62b6e00640 1 -- start start 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62b00c5ee0 0x7f62b014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 0x7f62b01536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f62b016b120 con 0x7f62b00ccea0 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62b016afa0 con 0x7f62b00cca90 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f62b016b2a0 con 0x7f62b00c5ee0 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37528/0 (socket says 172.21.15.64:37528) 2024-09-21T07:25:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 -- 172.21.15.64:0/2371051584 learned_addr learned my addr 172.21.15.64:0/2371051584 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62afe00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62b00c5ee0 0x7f62b014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62a7400640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 0x7f62b01536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 -- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62b00c5ee0 msgr2=0x7f62b014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62b00c5ee0 0x7f62b014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 -- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 msgr2=0x7f62b01536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 0x7f62b01536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 -- 172.21.15.64:0/2371051584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b00cfa30 con 0x7f62b00ccea0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62a7400640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 0x7f62b01536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b4e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c710 tx=0x7f62a800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62acc00640 1 -- 172.21.15.64:0/2371051584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8003bd0 con 0x7f62b00ccea0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62acc00640 1 -- 172.21.15.64:0/2371051584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a8003d70 con 0x7f62b00ccea0 2024-09-21T07:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b00cfd10 con 0x7f62b00ccea0 2024-09-21T07:25:57.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62acc00640 1 -- 172.21.15.64:0/2371051584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8005330 con 0x7f62b00ccea0 2024-09-21T07:25:57.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.845+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b00b4ce0 con 0x7f62b00ccea0 2024-09-21T07:25:57.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62acc00640 1 -- 172.21.15.64:0/2371051584 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f62a80054d0 con 0x7f62b00ccea0 2024-09-21T07:25:57.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62acc00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 0x7f628c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62acc00640 1 -- 172.21.15.64:0/2371051584 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f62a8094070 con 0x7f62b00ccea0 2024-09-21T07:25:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62afe00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 0x7f628c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62be68a000 1 Processor -- start 2024-09-21T07:25:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62be68a000 1 -- start start 2024-09-21T07:25:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.849+0000 7f62afe00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 0x7f628c075740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62a00af000 tx=0x7f62a001af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b51720 0x55e4c0ca1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0ca24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0ab3980 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0aa2db0 con 0x55e4c0b51720 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e4c0aa6bc0 con 0x55e4c0850d60 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37530/0 (socket says 172.21.15.64:37530) 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 -- 172.21.15.64:0/3352915120 learned_addr learned my addr 172.21.15.64:0/3352915120 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62b4e00640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0ca24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62afe00640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b51720 0x55e4c0ca1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 -- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 msgr2=0x55e4c0ca24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0ca24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 -- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b51720 msgr2=0x55e4c0ca1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b51720 0x55e4c0ca1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 -- 172.21.15.64:0/3352915120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c0a57cc0 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62b4e00640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0ca24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:57.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a7400640 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6298001680 tx=0x7f6298001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660cfe5e25ed5218 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a4c00640 1 -- 172.21.15.64:0/3352915120 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298018070 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a4c00640 1 -- 172.21.15.64:0/3352915120 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f629800d730 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62a4c00640 1 -- 172.21.15.64:0/3352915120 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629800db60 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- 172.21.15.64:0/3352915120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 msgr2=0x55e4c0ca1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6298001680 tx=0x7f6298001b40 comp rx=0 tx=0).stop 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- 172.21.15.64:0/3352915120 shutdown_connections 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0ca24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0ca1f80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 --2- 172.21.15.64:0/3352915120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b51720 0x55e4c0ca1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- 172.21.15.64:0/3352915120 >> 172.21.15.64:0/3352915120 conn(0x55e4c0760400 msgr2=0x55e4c0c84ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- 172.21.15.64:0/3352915120 shutdown_connections 2024-09-21T07:25:57.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- 172.21.15.64:0/3352915120 wait complete. 2024-09-21T07:25:57.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 -- start start 2024-09-21T07:25:57.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.853+0000 7f62be68a000 1 Processor -- start 2024-09-21T07:25:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0850d60 0x55e4c0c5d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0c62ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0a46f70 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0a4e0d0 con 0x55e4c0850d60 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e4c0a4fb50 con 0x55e4c0b51720 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 10 client.0 _ll_register_callbacks cb 0x55e4c0a4d770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37532/0 (socket says 172.21.15.64:37532) 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 -- 172.21.15.64:0/538935162 learned_addr learned my addr 172.21.15.64:0/538935162 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62b4e00640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0c62ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62afe00640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0850d60 0x55e4c0c5d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 -- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 msgr2=0x55e4c0c62ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0c62ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 -- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0850d60 msgr2=0x55e4c0c5d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0850d60 0x55e4c0c5d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 -- 172.21.15.64:0/538935162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4c0a410d0 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62a7400640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f629800d520 tx=0x7f6298007250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726f9e5bb24e5693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:57.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298018040 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4c0a3b210 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f6298007640 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f629802a050 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 10 client.5571 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e4c0a676a0 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e4c0a3b210 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f629802d020 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 10 client.5571 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 10 client.5571 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 20 client.5571 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0745bf0 0x55e4c0ca82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 4 client.5571 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4c0ab58d0 con 0x55e4c0745bf0 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.857+0000 7f62afe00640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0745bf0 0x55e4c0ca82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f629d600640 10 client.5571 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62afe00640 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0745bf0 0x55e4c0ca82e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f90de9161fad59 server_cookie=9f33d6390b9dc7f8 in_seq=0 out_seq=0 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f629d600640 1 -- 172.21.15.64:0/538935162 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4c0ab58d0 con 0x55e4c0745bf0 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f629d600640 10 client.5571 handle_command_reply: tid=0 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 client.5571 shutdown 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 msgr2=0x55e4c0c5dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f629800d520 tx=0x7f6298007250 comp rx=0 tx=0).stop 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 shutdown_connections 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0745bf0 0x55e4c0ca82e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0c62ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0c5dcc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 --2- 172.21.15.64:0/538935162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0850d60 0x55e4c0c5d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f629d600640 0 client.5571 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 >> 172.21.15.64:0/538935162 conn(0x55e4c0760400 msgr2=0x55e4c0c55f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 shutdown_connections 2024-09-21T07:25:57.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 1 -- 172.21.15.64:0/538935162 wait complete. 2024-09-21T07:25:57.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.861+0000 7f62be68a000 20 client.5571 trim_cache size 0 max 16384 2024-09-21T07:25:57.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 Processor -- start 2024-09-21T07:25:57.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- start start 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0d13460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d139a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0204d20 con 0x55e4c0b51720 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01f98b0 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f62b02046d0 con 0x55e4c0850d60 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37536/0 (socket says 172.21.15.64:37536) 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 -- 172.21.15.64:0/4229763487 learned_addr learned my addr 172.21.15.64:0/4229763487 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62afe00640 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0d13460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62a7400640 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 -- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 msgr2=0x55e4c0d13460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0d13460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 -- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 msgr2=0x55e4c0d139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 -- 172.21.15.64:0/4229763487 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c0c62e40 con 0x55e4c0b51720 2024-09-21T07:25:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62b4e00640 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62a800a430 tx=0x7f62a80012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee3c2e7fa96842e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f629fe00640 1 -- 172.21.15.64:0/4229763487 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a805e880 con 0x55e4c0b51720 2024-09-21T07:25:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f629fe00640 1 -- 172.21.15.64:0/4229763487 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a8063360 con 0x55e4c0b51720 2024-09-21T07:25:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f629fe00640 1 -- 172.21.15.64:0/4229763487 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8068210 con 0x55e4c0b51720 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- 172.21.15.64:0/4229763487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 msgr2=0x55e4c0d13ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62a800a430 tx=0x7f62a80012b0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- 172.21.15.64:0/4229763487 shutdown_connections 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0b51720 0x55e4c0d13ee0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 --2- 172.21.15.64:0/4229763487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0850d60 0x55e4c0d13460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.881+0000 7f62be68a000 1 -- 172.21.15.64:0/4229763487 >> 172.21.15.64:0/4229763487 conn(0x55e4c0760400 msgr2=0x55e4c0cb4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- 172.21.15.64:0/4229763487 shutdown_connections 2024-09-21T07:25:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- 172.21.15.64:0/4229763487 wait complete. 2024-09-21T07:25:57.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- start start 2024-09-21T07:25:57.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 Processor -- start 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0d180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0a627e0 con 0x55e4c0850d60 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e4c0ab2750 con 0x55e4c0b3b1f0 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e4c0aa5ed0 con 0x55e4c0b51720 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 10 client.0 _ll_register_callbacks cb 0x7f6298016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:57.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37546/0 (socket says 172.21.15.64:37546) 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 -- 172.21.15.64:0/2869378262 learned_addr learned my addr 172.21.15.64:0/2869378262 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62b4e00640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0d180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62a7400640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 -- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 msgr2=0x55e4c0d180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0d180b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 -- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 msgr2=0x55e4c0d17b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d17b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 -- 172.21.15.64:0/2869378262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4c0b29be0 con 0x55e4c0850d60 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62afe00640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009840 tx=0x7f62a00091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13158c188aeb5dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f629d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00c1040 con 0x55e4c0850d60 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f62a0003600 con 0x55e4c0850d60 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.885+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a8063360 con 0x55e4c0850d60 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62a00de050 con 0x55e4c0850d60 2024-09-21T07:25:57.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 10 client.5577 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e4c0afff10 con 0x55e4c0850d60 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a8063360 con 0x55e4c0850d60 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f62a00e1020 con 0x55e4c0850d60 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 10 client.5577 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 10 client.5577 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 20 client.5577 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0733c50 0x55e4c0cd31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 4 client.5577 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55e4c0ab1380 con 0x55e4c0733c50 2024-09-21T07:25:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62a7400640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0733c50 0x55e4c0cd31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62a7400640 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0733c50 0x55e4c0cd31d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb5250e26532aa05 server_cookie=84c7e9772e43b524 in_seq=0 out_seq=0 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 10 client.5577 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 1 -- 172.21.15.64:0/2869378262 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x55e4c0ab1380 con 0x55e4c0733c50 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 10 client.5577 handle_command_reply: tid=0 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 client.5577 shutdown 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 msgr2=0x55e4c0d17630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009840 tx=0x7f62a00091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 shutdown_connections 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e4c0733c50 0x55e4c0cd31d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e4c0b51720 0x55e4c0d180b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e4c0b3b1f0 0x55e4c0d17b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 --2- 172.21.15.64:0/2869378262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4c0850d60 0x55e4c0d17630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f629d600640 0 client.5577 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 >> 172.21.15.64:0/2869378262 conn(0x55e4c0760400 msgr2=0x55e4c0cb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 shutdown_connections 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 1 -- 172.21.15.64:0/2869378262 wait complete. 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62be68a000 20 client.5577 trim_cache size 0 max 16384 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": -2 2024-09-21T07:25:57.897 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 msgr2=0x7f628c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 0x7f628c075740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62a00af000 tx=0x7f62a001af10 comp rx=0 tx=0).stop 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 msgr2=0x7f62b0153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c710 tx=0x7f62a800cbd0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 shutdown_connections 2024-09-21T07:25:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f628c073230 0x7f628c075740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62b00ccea0 0x7f62b0153c20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b00cca90 0x7f62b01536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 --2- 172.21.15.64:0/2371051584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62b00c5ee0 0x7f62b014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 >> 172.21.15.64:0/2371051584 conn(0x7f62b00b2510 msgr2=0x7f62b00b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 shutdown_connections 2024-09-21T07:25:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:57.889+0000 7f62b6e00640 1 -- 172.21.15.64:0/2371051584 wait complete. 2024-09-21T07:25:57.914 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-21T07:25:57.914 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-21T07:25:57.914 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-21T07:25:57.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 -- 172.21.15.64:0/2505435145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0b3d60 msgr2=0x7f200c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 --2- 172.21.15.64:0/2505435145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0b3d60 0x7f200c0b4170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009840 tx=0x7f1ff401c760 comp rx=0 tx=0).stop 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 -- 172.21.15.64:0/2505435145 shutdown_connections 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 --2- 172.21.15.64:0/2505435145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0b3d60 0x7f200c0b4170 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 -- 172.21.15.64:0/2505435145 >> 172.21.15.64:0/2505435145 conn(0x7f200c06d1c0 msgr2=0x7f200c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.069+0000 7f2011c00640 1 -- 172.21.15.64:0/2505435145 shutdown_connections 2024-09-21T07:25:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 -- 172.21.15.64:0/2505435145 wait complete. 2024-09-21T07:25:58.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 Processor -- start 2024-09-21T07:25:58.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 -- start start 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c0b3d60 0x7f200c158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f200c0c5ea0 0x7f200c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f200c16af90 con 0x7f200c0d1d00 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f200c16ae10 con 0x7f200c0b3d60 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.073+0000 7f2011c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f200c16b110 con 0x7f200c0c5ea0 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37552/0 (socket says 172.21.15.64:37552) 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 -- 172.21.15.64:0/3986949433 learned_addr learned my addr 172.21.15.64:0/3986949433 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200aa00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c0b3d60 0x7f200c158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2002000640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f200c0c5ea0 0x7f200c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 -- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f200c0c5ea0 msgr2=0x7f200c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f200c0c5ea0 0x7f200c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 -- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c0b3d60 msgr2=0x7f200c158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c0b3d60 0x7f200c158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 -- 172.21.15.64:0/3986949433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c0b5340 con 0x7f200c0d1d00 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f200b400640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f200400c7b0 tx=0x7f200400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2003400640 1 -- 172.21.15.64:0/3986949433 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004016020 con 0x7f200c0d1d00 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2003400640 1 -- 172.21.15.64:0/3986949433 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f200400ab60 con 0x7f200c0d1d00 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2003400640 1 -- 172.21.15.64:0/3986949433 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200400ce60 con 0x7f200c0d1d00 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c0c7d70 con 0x7f200c0d1d00 2024-09-21T07:25:58.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c0b7960 con 0x7f200c0d1d00 2024-09-21T07:25:58.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.077+0000 7f2003400640 1 -- 172.21.15.64:0/3986949433 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2004019020 con 0x7f200c0d1d00 2024-09-21T07:25:58.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2003400640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 0x7f1fe8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2003400640 1 -- 172.21.15.64:0/3986949433 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f2004094520 con 0x7f200c0d1d00 2024-09-21T07:25:58.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 Processor -- start 2024-09-21T07:25:58.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f200aa00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 0x7f1fe8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 -- start start 2024-09-21T07:25:58.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f200aa00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 0x7f1fe8075710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0046c0 tx=0x7f1ffc007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850892440 0x55e8509dc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850874580 0x55e8509dca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e850879090 con 0x55e85088a9f0 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8507efe10 con 0x55e850874580 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e8507df240 con 0x55e850892440 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37568/0 (socket says 172.21.15.64:37568) 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 -- 172.21.15.64:0/2251773130 learned_addr learned my addr 172.21.15.64:0/2251773130 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f200aa00640 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850892440 0x55e8509dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f200b400640 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850874580 0x55e8509dca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 -- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850892440 msgr2=0x55e8509dc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850892440 0x55e8509dc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 -- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850874580 msgr2=0x55e8509dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850874580 0x55e8509dca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 -- 172.21.15.64:0/2251773130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e850826c30 con 0x55e85088a9f0 2024-09-21T07:25:58.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.081+0000 7f2002000640 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009790 tx=0x7f1ff4019500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cba8967a257f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f1ffb400640 1 -- 172.21.15.64:0/2251773130 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40b2040 con 0x55e85088a9f0 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f1ffb400640 1 -- 172.21.15.64:0/2251773130 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ff40042f0 con 0x55e85088a9f0 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f1ffb400640 1 -- 172.21.15.64:0/2251773130 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40a5b70 con 0x55e85088a9f0 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- 172.21.15.64:0/2251773130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 msgr2=0x55e8509dc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009790 tx=0x7f1ff4019500 comp rx=0 tx=0).stop 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- 172.21.15.64:0/2251773130 shutdown_connections 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850874580 0x55e8509dca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e8509dc550 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- 172.21.15.64:0/2251773130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850892440 0x55e8509dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- 172.21.15.64:0/2251773130 >> 172.21.15.64:0/2251773130 conn(0x55e850897690 msgr2=0x55e850990d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- 172.21.15.64:0/2251773130 shutdown_connections 2024-09-21T07:25:58.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- 172.21.15.64:0/2251773130 wait complete. 2024-09-21T07:25:58.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 -- start start 2024-09-21T07:25:58.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 Processor -- start 2024-09-21T07:25:58.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e85088a9f0 0x55e8509983a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.085+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e850784770 con 0x55e850874580 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8507e3050 con 0x55e850892440 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e8504a49e0 con 0x55e85088a9f0 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 10 client.0 _ll_register_callbacks cb 0x55e850894000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37576/0 (socket says 172.21.15.64:37576) 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 -- 172.21.15.64:0/2441586851 learned_addr learned my addr 172.21.15.64:0/2441586851 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200b400640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2002000640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e85088a9f0 0x55e8509983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 -- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e85088a9f0 msgr2=0x55e8509983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e85088a9f0 0x55e8509983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 -- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 msgr2=0x55e8509c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 -- 172.21.15.64:0/2441586851 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e850793e70 con 0x55e850874580 2024-09-21T07:25:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200b400640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f200aa00640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0146d0 tx=0x7f1ffc004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6805fb79216d9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc025070 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f1ffc015850 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e850777540 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1ffc030050 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 10 client.5592 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e85079e370 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e850777540 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f1ffc033020 con 0x55e850874580 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 10 client.5592 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 10 client.5592 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 20 client.5592 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e850481c90 0x55e8509c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 4 client.5592 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8507f1d60 con 0x55e850481c90 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2002000640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e850481c90 0x55e8509c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 10 client.5592 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2002000640 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e850481c90 0x55e8509c82f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35d6cf957c523c3d server_cookie=d9392f0a0d9d2632 in_seq=0 out_seq=0 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 1 -- 172.21.15.64:0/2441586851 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8507f1d60 con 0x55e850481c90 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 10 client.5592 handle_command_reply: tid=0 2024-09-21T07:25:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 client.5592 shutdown 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 msgr2=0x55e850997e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0146d0 tx=0x7f1ffc004630 comp rx=0 tx=0).stop 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 shutdown_connections 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e850481c90 0x55e8509c82f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e85088a9f0 0x55e8509983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 --2- 172.21.15.64:0/2441586851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850874580 0x55e850997e60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f1fefe00640 0 client.5592 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.089+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 >> 172.21.15.64:0/2441586851 conn(0x55e850897690 msgr2=0x55e8509914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.093+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 shutdown_connections 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.093+0000 7f2019345000 1 -- 172.21.15.64:0/2441586851 wait complete. 2024-09-21T07:25:58.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.093+0000 7f2019345000 20 client.5592 trim_cache size 0 max 16384 2024-09-21T07:25:58.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 Processor -- start 2024-09-21T07:25:58.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 -- start start 2024-09-21T07:25:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e8509f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 0x55e8509f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e850995ac0 con 0x55e850892440 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f200c205a30 con 0x55e85088a9f0 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f200c204a50 con 0x55e850874580 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37592/0 (socket says 172.21.15.64:37592) 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 -- 172.21.15.64:0/1467546629 learned_addr learned my addr 172.21.15.64:0/1467546629 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200aa00640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e8509f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2002000640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 0x55e8509f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 -- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 msgr2=0x55e8509f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e8509f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 -- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 msgr2=0x55e8509f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 0x55e8509f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 -- 172.21.15.64:0/1467546629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e850998710 con 0x55e850892440 2024-09-21T07:25:58.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f2002000640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 0x55e8509f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f200b400640 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f200405bf30 tx=0x7f200405e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388e072986b90bce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f1ffaa00640 1 -- 172.21.15.64:0/1467546629 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004068630 con 0x55e850892440 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f1ffaa00640 1 -- 172.21.15.64:0/1467546629 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20040940c0 con 0x55e850892440 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.109+0000 7f1ffaa00640 1 -- 172.21.15.64:0/1467546629 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004084380 con 0x55e850892440 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- 172.21.15.64:0/1467546629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 msgr2=0x55e8509c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f200405bf30 tx=0x7f200405e820 comp rx=0 tx=0).stop 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- 172.21.15.64:0/1467546629 shutdown_connections 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e850892440 0x55e8509c5530 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e85088a9f0 0x55e8509f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- 172.21.15.64:0/1467546629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e8509f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- 172.21.15.64:0/1467546629 >> 172.21.15.64:0/1467546629 conn(0x55e850897690 msgr2=0x55e8509e9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- 172.21.15.64:0/1467546629 shutdown_connections 2024-09-21T07:25:58.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- 172.21.15.64:0/1467546629 wait complete. 2024-09-21T07:25:58.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- start start 2024-09-21T07:25:58.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 Processor -- start 2024-09-21T07:25:58.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e850991870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509922f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f200c2043e0 con 0x55e85088a9f0 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f200c166b70 con 0x55e850892440 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e850784770 con 0x55e850874580 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2019345000 10 client.0 _ll_register_callbacks cb 0x7f1ffc001570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37596/0 (socket says 172.21.15.64:37596) 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 -- 172.21.15.64:0/4145865899 learned_addr learned my addr 172.21.15.64:0/4145865899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f200aa00640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e850991870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f200b400640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 -- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 msgr2=0x55e850991870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e850991870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 -- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 msgr2=0x55e8509922f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509922f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 -- 172.21.15.64:0/4145865899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85077d400 con 0x55e85088a9f0 2024-09-21T07:25:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f200b400640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f2002000640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4019370 tx=0x7f1ff40a5420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9b6bc8971876e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.113+0000 7f1fefe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40b2040 con 0x55e85088a9f0 2024-09-21T07:25:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f1ff4004440 con 0x55e85088a9f0 2024-09-21T07:25:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20040940c0 con 0x55e85088a9f0 2024-09-21T07:25:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1ff40cd050 con 0x55e85088a9f0 2024-09-21T07:25:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 10 client.5598 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e850862740 con 0x55e85088a9f0 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20040940c0 con 0x55e85088a9f0 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f1ff40d0020 con 0x55e85088a9f0 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 10 client.5598 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 10 client.5598 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 20 client.5598 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e85046fcf0 0x55e850992830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 4 client.5598 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55e8507ed810 con 0x55e85046fcf0 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f200aa00640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e85046fcf0 0x55e850992830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f1fefe00640 10 client.5598 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.117+0000 7f200aa00640 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e85046fcf0 0x55e850992830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee84890ac4842ce server_cookie=74f290166ddaea35 in_seq=0 out_seq=0 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f1fefe00640 1 -- 172.21.15.64:0/4145865899 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8507ed810 con 0x55e85046fcf0 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f1fefe00640 10 client.5598 handle_command_reply: tid=0 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 client.5598 shutdown 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 msgr2=0x55e850991db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4019370 tx=0x7f1ff40a5420 comp rx=0 tx=0).stop 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 shutdown_connections 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55e85046fcf0 0x55e850992830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e850892440 0x55e8509922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e85088a9f0 0x55e850991db0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f1fefe00640 0 client.5598 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 --2- 172.21.15.64:0/4145865899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e850874580 0x55e850991870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 >> 172.21.15.64:0/4145865899 conn(0x55e850897690 msgr2=0x55e8509e9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 shutdown_connections 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 1 -- 172.21.15.64:0/4145865899 wait complete. 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2019345000 20 client.5598 trim_cache size 0 max 16384 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:25:58.127 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 msgr2=0x7f1fe8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 0x7f1fe8075710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0046c0 tx=0x7f1ffc007ea0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 msgr2=0x7f200c0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f200400c7b0 tx=0x7f200400cc70 comp rx=0 tx=0).stop 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 shutdown_connections 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fe8073200 0x7f1fe8075710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f200c0d1d00 0x7f200c0b5af0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f200c0c5ea0 0x7f200c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 --2- 172.21.15.64:0/3986949433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c0b3d60 0x7f200c158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 >> 172.21.15.64:0/3986949433 conn(0x7f200c06d1c0 msgr2=0x7f200c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 shutdown_connections 2024-09-21T07:25:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.121+0000 7f2011c00640 1 -- 172.21.15.64:0/3986949433 wait complete. 2024-09-21T07:25:58.146 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:25:58.146 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-21T07:25:58.146 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-21T07:25:58.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 -- 172.21.15.64:0/985459365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3381602f0 msgr2=0x7fe33806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 --2- 172.21.15.64:0/985459365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3381602f0 0x7fe33806f890 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe33806dda0 tx=0x7fe33001cd80 comp rx=0 tx=0).stop 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 -- 172.21.15.64:0/985459365 shutdown_connections 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 --2- 172.21.15.64:0/985459365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3381602f0 0x7fe33806f890 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 --2- 172.21.15.64:0/985459365 >> v2:172.21.15.90:3300/0 conn(0x7fe33815f9a0 0x7fe33815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 -- 172.21.15.64:0/985459365 >> 172.21.15.64:0/985459365 conn(0x7fe33806d450 msgr2=0x7fe3380d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 -- 172.21.15.64:0/985459365 shutdown_connections 2024-09-21T07:25:58.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.301+0000 7fe33d200640 1 -- 172.21.15.64:0/985459365 wait complete. 2024-09-21T07:25:58.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.305+0000 7fe33d200640 1 Processor -- start 2024-09-21T07:25:58.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.305+0000 7fe33d200640 1 -- start start 2024-09-21T07:25:58.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33809df30 0x7fe338164b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3381602f0 0x7fe33809b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe338168df0 con 0x7fe33815f9a0 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe338168c70 con 0x7fe3381602f0 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe338168f70 con 0x7fe33809df30 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37614/0 (socket says 172.21.15.64:37614) 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 -- 172.21.15.64:0/2626181899 learned_addr learned my addr 172.21.15.64:0/2626181899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe335e00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33809df30 0x7fe338164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe336800640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3381602f0 0x7fe33809b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 -- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33809df30 msgr2=0x7fe338164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33809df30 0x7fe338164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 -- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3381602f0 msgr2=0x7fe33809b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3381602f0 0x7fe33809b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 -- 172.21.15.64:0/2626181899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33815f360 con 0x7fe33815f9a0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32fe00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e770 tx=0x7fe32000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32e000640 1 -- 172.21.15.64:0/2626181899 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000ccc0 con 0x7fe33815f9a0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32e000640 1 -- 172.21.15.64:0/2626181899 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe32000ee80 con 0x7fe33815f9a0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe32e000640 1 -- 172.21.15.64:0/2626181899 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000ce60 con 0x7fe33815f9a0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33809ab20 con 0x7fe33815f9a0 2024-09-21T07:25:58.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.309+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33809b0e0 con 0x7fe33815f9a0 2024-09-21T07:25:58.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.313+0000 7fe32e000640 1 -- 172.21.15.64:0/2626181899 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe320005280 con 0x7fe33815f9a0 2024-09-21T07:25:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.313+0000 7fe32e000640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 0x7fe314075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe32e000640 1 -- 172.21.15.64:0/2626181899 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fe320094b60 con 0x7fe33815f9a0 2024-09-21T07:25:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 Processor -- start 2024-09-21T07:25:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 -- start start 2024-09-21T07:25:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 0x7fe314075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 0x7fe314075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe328001780 tx=0x7fe328009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec44435700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec44435c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ec44246a70 con 0x55ec442d6410 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ec44235ea0 con 0x55ec442bcc00 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ec44239cb0 con 0x55ec442c2f40 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37620/0 (socket says 172.21.15.64:37620) 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 -- 172.21.15.64:0/3499815955 learned_addr learned my addr 172.21.15.64:0/3499815955 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe32fe00640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec44435700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe336800640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec44435c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 -- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 msgr2=0x55ec44435700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec44435700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 -- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 msgr2=0x55ec44435c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec44435c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 -- 172.21.15.64:0/3499815955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec442e26b0 con 0x55ec442d6410 2024-09-21T07:25:58.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe336800640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec44435c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe335e00640 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe32800f970 tx=0x7fe328012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bd078e6f85845f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe326a00640 1 -- 172.21.15.64:0/3499815955 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328025070 con 0x55ec442d6410 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe326a00640 1 -- 172.21.15.64:0/3499815955 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe32801b050 con 0x55ec442d6410 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.317+0000 7fe326a00640 1 -- 172.21.15.64:0/3499815955 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328014e40 con 0x55ec442d6410 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- 172.21.15.64:0/3499815955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 msgr2=0x55ec444351c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe32800f970 tx=0x7fe328012000 comp rx=0 tx=0).stop 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- 172.21.15.64:0/3499815955 shutdown_connections 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec44435c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec44435700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- 172.21.15.64:0/3499815955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec444351c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- 172.21.15.64:0/3499815955 >> 172.21.15.64:0/3499815955 conn(0x55ec43ef3f60 msgr2=0x55ec443ea170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- 172.21.15.64:0/3499815955 shutdown_connections 2024-09-21T07:25:58.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- 172.21.15.64:0/3499815955 wait complete. 2024-09-21T07:25:58.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- start start 2024-09-21T07:25:58.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 Processor -- start 2024-09-21T07:25:58.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec443f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec443f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ec441fd600 con 0x55ec442d6410 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ec441f5860 con 0x55ec442bcc00 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ec44202150 con 0x55ec442c2f40 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe344926000 10 client.0 _ll_register_callbacks cb 0x55ec441e07f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37632/0 (socket says 172.21.15.64:37632) 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 -- 172.21.15.64:0/1428750515 learned_addr learned my addr 172.21.15.64:0/1428750515 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe335e00640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec443f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe32fe00640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec443f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 -- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 msgr2=0x55ec443f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec443f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 -- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 msgr2=0x55ec443f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec443f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.321+0000 7fe336800640 1 -- 172.21.15.64:0/1428750515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec44280590 con 0x55ec442d6410 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe336800640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe330009bd0 tx=0x7fe330003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47da05a355e95a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300b2040 con 0x55ec442d6410 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec441ce290 con 0x55ec442d6410 2024-09-21T07:25:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fe3300092c0 con 0x55ec442d6410 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe3300c5050 con 0x55ec442d6410 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 10 client.5610 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ec441e93a0 con 0x55ec442d6410 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ec441ce290 con 0x55ec442d6410 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe3300c8020 con 0x55ec442d6410 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 10 client.5610 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 10 client.5610 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 20 client.5610 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ed8cb0 0x55ec44446570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 4 client.5610 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec442489c0 con 0x55ec43ed8cb0 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe335e00640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ed8cb0 0x55ec44446570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe335e00640 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ed8cb0 0x55ec44446570 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c0a1e22687128f server_cookie=94a9adf5cd138f25 in_seq=0 out_seq=0 2024-09-21T07:25:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 10 client.5610 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 1 -- 172.21.15.64:0/1428750515 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec442489c0 con 0x55ec43ed8cb0 2024-09-21T07:25:58.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 10 client.5610 handle_command_reply: tid=0 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 client.5610 shutdown 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 msgr2=0x55ec44420880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe330009bd0 tx=0x7fe330003e10 comp rx=0 tx=0).stop 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 shutdown_connections 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ed8cb0 0x55ec44446570 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442d6410 0x55ec44420880 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec443f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe31b400640 0 client.5610 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 --2- 172.21.15.64:0/1428750515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442bcc00 0x55ec443f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 >> 172.21.15.64:0/1428750515 conn(0x55ec43ef3f60 msgr2=0x55ec443ea900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 shutdown_connections 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 1 -- 172.21.15.64:0/1428750515 wait complete. 2024-09-21T07:25:58.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.325+0000 7fe344926000 20 client.5610 trim_cache size 0 max 16384 2024-09-21T07:25:58.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 Processor -- start 2024-09-21T07:25:58.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 -- start start 2024-09-21T07:25:58.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444a7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe338208d40 con 0x55ec442bcc00 2024-09-21T07:25:58.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381fd7a0 con 0x55ec442d6410 2024-09-21T07:25:58.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe338208790 con 0x55ec442c2f40 2024-09-21T07:25:58.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37634/0 (socket says 172.21.15.64:37634) 2024-09-21T07:25:58.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.345+0000 7fe335e00640 1 -- 172.21.15.64:0/3579514732 learned_addr learned my addr 172.21.15.64:0/3579514732 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 -- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 msgr2=0x55ec444a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 -- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 msgr2=0x55ec444a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 -- 172.21.15.64:0/3579514732 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec442bc040 con 0x55ec442bcc00 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe335e00640 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe328023040 tx=0x7fe328000f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681cd161577adc13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe326000640 1 -- 172.21.15.64:0/3579514732 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328039070 con 0x55ec442bcc00 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe326000640 1 -- 172.21.15.64:0/3579514732 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe32801b040 con 0x55ec442bcc00 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe326000640 1 -- 172.21.15.64:0/3579514732 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328025040 con 0x55ec442bcc00 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- 172.21.15.64:0/3579514732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 msgr2=0x55ec444a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe328023040 tx=0x7fe328000f30 comp rx=0 tx=0).stop 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- 172.21.15.64:0/3579514732 shutdown_connections 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 --2- 172.21.15.64:0/3579514732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444a68e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- 172.21.15.64:0/3579514732 >> 172.21.15.64:0/3579514732 conn(0x55ec43ef3f60 msgr2=0x55ec443e97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- 172.21.15.64:0/3579514732 shutdown_connections 2024-09-21T07:25:58.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- 172.21.15.64:0/3579514732 wait complete. 2024-09-21T07:25:58.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 -- start start 2024-09-21T07:25:58.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.349+0000 7fe344926000 1 Processor -- start 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ec4423e2e0 con 0x55ec442bcc00 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ec44238fc0 con 0x55ec442d6410 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ec441eba80 con 0x55ec442c2f40 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 10 client.0 _ll_register_callbacks cb 0x7fe320005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37636/0 (socket says 172.21.15.64:37636) 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 -- 172.21.15.64:0/87291318 learned_addr learned my addr 172.21.15.64:0/87291318 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe336800640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe32fe00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 -- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 msgr2=0x55ec444ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 -- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 msgr2=0x55ec444ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 -- 172.21.15.64:0/87291318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec442932f0 con 0x55ec442bcc00 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe335e00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ffd0 tx=0x7fe3280148e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f331d102cdb0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328039030 con 0x55ec442bcc00 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fe3280208e0 con 0x55ec442bcc00 2024-09-21T07:25:58.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32801b040 con 0x55ec442bcc00 2024-09-21T07:25:58.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe328045050 con 0x55ec442bcc00 2024-09-21T07:25:58.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 10 client.5616 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ec441fca70 con 0x55ec442bcc00 2024-09-21T07:25:58.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe32801b040 con 0x55ec442bcc00 2024-09-21T07:25:58.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe328048020 con 0x55ec442bcc00 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 10 client.5616 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 10 client.5616 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 20 client.5616 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ec6d10 0x55ec44465fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 4 client.5616 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55ec44244470 con 0x55ec43ec6d10 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe32fe00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ec6d10 0x55ec44465fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 10 client.5616 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe32fe00640 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ec6d10 0x55ec44465fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b48756f770c6b8e server_cookie=ab7d15b114449542 in_seq=0 out_seq=0 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 1 -- 172.21.15.64:0/87291318 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ec44244470 con 0x55ec43ec6d10 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 10 client.5616 handle_command_reply: tid=0 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 client.5616 shutdown 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 msgr2=0x55ec444aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ffd0 tx=0x7fe3280148e0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 shutdown_connections 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55ec43ec6d10 0x55ec44465fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ec442d6410 0x55ec444ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ec442c2f40 0x55ec444ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 --2- 172.21.15.64:0/87291318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ec442bcc00 0x55ec444aab30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe31b400640 0 client.5616 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.353+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 >> 172.21.15.64:0/87291318 conn(0x55ec43ef3f60 msgr2=0x55ec443e97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 shutdown_connections 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe344926000 1 -- 172.21.15.64:0/87291318 wait complete. 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe344926000 20 client.5616 trim_cache size 0 max 16384 2024-09-21T07:25:58.362 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7", 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 msgr2=0x7fe314075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 0x7fe314075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe328001780 tx=0x7fe328009040 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 msgr2=0x7fe33815c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e770 tx=0x7fe32000ec30 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 shutdown_connections 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe314073200 0x7fe314075710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3381602f0 0x7fe33809b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33815f9a0 0x7fe33815c430 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 --2- 172.21.15.64:0/2626181899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33809df30 0x7fe338164b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 >> 172.21.15.64:0/2626181899 conn(0x7fe33806d450 msgr2=0x7fe3380ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 shutdown_connections 2024-09-21T07:25:58.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.357+0000 7fe33d200640 1 -- 172.21.15.64:0/2626181899 wait complete. 2024-09-21T07:25:58.380 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'd2ddf1e4-2b04-4e69-b1f6-dbb2098598f7', 'mode': 'asynchronous'}' 2024-09-21T07:25:58.380 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-21T07:25:58.380 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-21T07:25:58.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-21T07:25:58.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- 172.21.15.64:0/3629153642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240706c0 msgr2=0x7fc8240b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 --2- 172.21.15.64:0/3629153642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240706c0 0x7fc8240b3ce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc8240b3130 tx=0x7fc81c01cc40 comp rx=0 tx=0).stop 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- 172.21.15.64:0/3629153642 shutdown_connections 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 --2- 172.21.15.64:0/3629153642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240706c0 0x7fc8240b3ce0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 --2- 172.21.15.64:0/3629153642 >> v2:172.21.15.90:3300/0 conn(0x7fc82415ec20 0x7fc8240ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- 172.21.15.64:0/3629153642 >> 172.21.15.64:0/3629153642 conn(0x7fc8240ccbe0 msgr2=0x7fc8240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- 172.21.15.64:0/3629153642 shutdown_connections 2024-09-21T07:25:58.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- 172.21.15.64:0/3629153642 wait complete. 2024-09-21T07:25:58.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 Processor -- start 2024-09-21T07:25:58.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.537+0000 7fc829000640 1 -- start start 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc82415ec20 0x7fc82415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 0x7fc8240b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc824168d70 con 0x7fc8240ca990 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc824168bf0 con 0x7fc82415ec20 2024-09-21T07:25:58.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc824168ef0 con 0x7fc8240af9c0 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37650/0 (socket says 172.21.15.64:37650) 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 -- 172.21.15.64:0/1437635109 learned_addr learned my addr 172.21.15.64:0/1437635109 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc822800640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 0x7fc8240b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc819400640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc82415ec20 0x7fc82415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 -- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 msgr2=0x7fc8240b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 0x7fc8240b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 -- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc82415ec20 msgr2=0x7fc82415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc82415ec20 0x7fc82415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 -- 172.21.15.64:0/1437635109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8240c7fc0 con 0x7fc8240ca990 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc822800640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 0x7fc8240b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:25:58.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc821e00640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e7c0 tx=0x7fc81400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc81aa00640 1 -- 172.21.15.64:0/1437635109 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81400ccc0 con 0x7fc8240ca990 2024-09-21T07:25:58.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc81aa00640 1 -- 172.21.15.64:0/1437635109 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc81400ce80 con 0x7fc8240ca990 2024-09-21T07:25:58.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc81aa00640 1 -- 172.21.15.64:0/1437635109 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814004290 con 0x7fc8240ca990 2024-09-21T07:25:58.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8240b01a0 con 0x7fc8240ca990 2024-09-21T07:25:58.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.541+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8240b0760 con 0x7fc8240ca990 2024-09-21T07:25:58.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc81aa00640 1 -- 172.21.15.64:0/1437635109 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc814003600 con 0x7fc8240ca990 2024-09-21T07:25:58.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc81aa00640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc81aa00640 1 -- 172.21.15.64:0/1437635109 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fc814094cb0 con 0x7fc8240ca990 2024-09-21T07:25:58.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc819400640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc83074c000 1 Processor -- start 2024-09-21T07:25:58.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc83074c000 1 -- start start 2024-09-21T07:25:58.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.545+0000 7fc819400640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 0x7fc800075740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c7180 tx=0x7fc80c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb3f1f50 0x55eebb905ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 0x55eebb9060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eebb718f30 con 0x55eebb78b730 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eebb708360 con 0x55eebb4b6160 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eebb70c170 con 0x55eebb3f1f50 2024-09-21T07:25:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37664/0 (socket says 172.21.15.64:37664) 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 -- 172.21.15.64:0/1747096584 learned_addr learned my addr 172.21.15.64:0/1747096584 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc819400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb3f1f50 0x55eebb905ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc822800640 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 0x55eebb9060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 -- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb3f1f50 msgr2=0x55eebb905ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb3f1f50 0x55eebb905ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 -- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 msgr2=0x55eebb9060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 0x55eebb9060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 -- 172.21.15.64:0/1747096584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eebb7502f0 con 0x55eebb78b730 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc822800640 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 0x55eebb9060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc821e00640 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc81405f3e0 tx=0x7fc81405ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c253fe372760f8b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc812a00640 1 -- 172.21.15.64:0/1747096584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814063e80 con 0x55eebb78b730 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc812a00640 1 -- 172.21.15.64:0/1747096584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc814068dc0 con 0x55eebb78b730 2024-09-21T07:25:58.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc812a00640 1 -- 172.21.15.64:0/1747096584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814068930 con 0x55eebb78b730 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- 172.21.15.64:0/1747096584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 msgr2=0x55eebb905660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc81405f3e0 tx=0x7fc81405ee60 comp rx=0 tx=0).stop 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- 172.21.15.64:0/1747096584 shutdown_connections 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb4b6160 0x55eebb9060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb3f1f50 0x55eebb905ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 --2- 172.21.15.64:0/1747096584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb905660 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- 172.21.15.64:0/1747096584 >> 172.21.15.64:0/1747096584 conn(0x55eebb7c2910 msgr2=0x55eebb8e8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- 172.21.15.64:0/1747096584 shutdown_connections 2024-09-21T07:25:58.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- 172.21.15.64:0/1747096584 wait complete. 2024-09-21T07:25:58.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 -- start start 2024-09-21T07:25:58.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.549+0000 7fc83074c000 1 Processor -- start 2024-09-21T07:25:58.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb90bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb90c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eebb6c16f0 con 0x55eebb78b730 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eebb7c6430 con 0x55eebb3f1f50 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eebb6b3680 con 0x55eebb4b6160 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 10 client.0 _ll_register_callbacks cb 0x55eebb8a7060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc819400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb90c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37668/0 (socket says 172.21.15.64:37668) 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 -- 172.21.15.64:0/4134082345 learned_addr learned my addr 172.21.15.64:0/4134082345 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc821e00640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb90bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 -- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 msgr2=0x55eebb90c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb90c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 -- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 msgr2=0x55eebb90bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb90bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 -- 172.21.15.64:0/4134082345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebb6c1ad0 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc822800640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc81c019850 tx=0x7fc81c0ad8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbdb07360238ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0bc070 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fc81c0092c0 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eebb6a0730 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc81c0c7050 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 10 client.5628 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55eebb6a67b0 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55eebb6a0730 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc81c0ca020 con 0x55eebb78b730 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 10 client.5628 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 10 client.5628 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 20 client.5628 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb3aaff0 0x55eebb9161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 4 client.5628 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:58.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.553+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eebb71ae80 con 0x55eebb3aaff0 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc821e00640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb3aaff0 0x55eebb9161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc821e00640 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb3aaff0 0x55eebb9161a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4f808cd3c40fe5 server_cookie=4d93e71b1c04f4fa in_seq=0 out_seq=0 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc807400640 10 client.5628 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc807400640 1 -- 172.21.15.64:0/4134082345 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eebb71ae80 con 0x55eebb3aaff0 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc807400640 10 client.5628 handle_command_reply: tid=0 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 client.5628 shutdown 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 msgr2=0x55eebb90c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc81c019850 tx=0x7fc81c0ad8b0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 shutdown_connections 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb3aaff0 0x55eebb9161a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb78b730 0x55eebb90c840 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb90c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc807400640 0 client.5628 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 --2- 172.21.15.64:0/4134082345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb90bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 >> 172.21.15.64:0/4134082345 conn(0x55eebb7c2910 msgr2=0x55eebb8c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 shutdown_connections 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 1 -- 172.21.15.64:0/4134082345 wait complete. 2024-09-21T07:25:58.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.557+0000 7fc83074c000 20 client.5628 trim_cache size 0 max 16384 2024-09-21T07:25:58.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 Processor -- start 2024-09-21T07:25:58.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 -- start start 2024-09-21T07:25:58.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb976e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb78b730 0x55eebb9773b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc824204a80 con 0x55eebb3f1f50 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241642b0 con 0x55eebb78b730 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc824204430 con 0x55eebb4b6160 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc821e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37684/0 (socket says 172.21.15.64:37684) 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc821e00640 1 -- 172.21.15.64:0/2544421005 learned_addr learned my addr 172.21.15.64:0/2544421005 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc822800640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb78b730 0x55eebb9773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.573+0000 7fc819400640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb976e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 -- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 msgr2=0x55eebb976e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb976e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 -- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb78b730 msgr2=0x55eebb9773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb78b730 0x55eebb9773b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 -- 172.21.15.64:0/2544421005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eebb8c0be0 con 0x55eebb3f1f50 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc819400640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb976e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc821e00640 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc81405f3e0 tx=0x7fc814082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2953cc1453a7e778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc812000640 1 -- 172.21.15.64:0/2544421005 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81405b6c0 con 0x55eebb3f1f50 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc812000640 1 -- 172.21.15.64:0/2544421005 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc814068930 con 0x55eebb3f1f50 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc812000640 1 -- 172.21.15.64:0/2544421005 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81405b860 con 0x55eebb3f1f50 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- 172.21.15.64:0/2544421005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 msgr2=0x55eebb976930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc81405f3e0 tx=0x7fc814082040 comp rx=0 tx=0).stop 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- 172.21.15.64:0/2544421005 shutdown_connections 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb78b730 0x55eebb9773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb4b6160 0x55eebb976e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 --2- 172.21.15.64:0/2544421005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb3f1f50 0x55eebb976930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- 172.21.15.64:0/2544421005 >> 172.21.15.64:0/2544421005 conn(0x55eebb7c2910 msgr2=0x55eebb8bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- 172.21.15.64:0/2544421005 shutdown_connections 2024-09-21T07:25:58.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- 172.21.15.64:0/2544421005 wait complete. 2024-09-21T07:25:58.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 -- start start 2024-09-21T07:25:58.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.577+0000 7fc83074c000 1 Processor -- start 2024-09-21T07:25:58.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb97aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb78b730 0x55eebb97b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eebb6c7e50 con 0x55eebb4b6160 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eebb717d00 con 0x55eebb3f1f50 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eebb70b480 con 0x55eebb78b730 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 10 client.0 _ll_register_callbacks cb 0x7fc814005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37694/0 (socket says 172.21.15.64:37694) 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 -- 172.21.15.64:0/4233069756 learned_addr learned my addr 172.21.15.64:0/4233069756 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc821e00640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb97aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc822800640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb78b730 0x55eebb97b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 -- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb78b730 msgr2=0x55eebb97b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb78b730 0x55eebb97b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 -- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 msgr2=0x55eebb97aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb97aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 -- 172.21.15.64:0/4233069756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebb8bee30 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc819400640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc80c014780 tx=0x7fc80c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552e8ff3f320d681 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c014e50 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fc80c02dcb0 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc814068930 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc80c022960 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 10 client.5634 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55eebb718800 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc814068930 con 0x55eebb4b6160 2024-09-21T07:25:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc80c020040 con 0x55eebb4b6160 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 10 client.5634 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 10 client.5634 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 20 client.5634 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb399050 0x55eebb936930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 4 client.5634 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55eebb716930 con 0x55eebb399050 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc821e00640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb399050 0x55eebb936930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc821e00640 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb399050 0x55eebb936930 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82cbdd992155aaef server_cookie=71ffa31e445f7f7f in_seq=0 out_seq=0 2024-09-21T07:25:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.581+0000 7fc807400640 10 client.5634 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc807400640 1 -- 172.21.15.64:0/4233069756 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eebb716930 con 0x55eebb399050 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc807400640 10 client.5634 handle_command_reply: tid=0 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 client.5634 shutdown 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 msgr2=0x55eebb97b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc80c014780 tx=0x7fc80c000ee0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 shutdown_connections 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55eebb399050 0x55eebb936930 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eebb78b730 0x55eebb97b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eebb4b6160 0x55eebb97b3e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 --2- 172.21.15.64:0/4233069756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eebb3f1f50 0x55eebb97aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc807400640 0 client.5634 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 >> 172.21.15.64:0/4233069756 conn(0x55eebb7c2910 msgr2=0x55eebb8b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 shutdown_connections 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 1 -- 172.21.15.64:0/4233069756 wait complete. 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc83074c000 20 client.5634 trim_cache size 0 max 16384 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:25:58.592 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 msgr2=0x7fc800075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 0x7fc800075740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c7180 tx=0x7fc80c009040 comp rx=0 tx=0).stop 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 msgr2=0x7fc8240c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.585+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e7c0 tx=0x7fc81400ec80 comp rx=0 tx=0).stop 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 shutdown_connections 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8240af9c0 0x7fc8240b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc82415ec20 0x7fc82415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 --2- 172.21.15.64:0/1437635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8240ca990 0x7fc8240c7a80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 >> 172.21.15.64:0/1437635109 conn(0x7fc8240ccbe0 msgr2=0x7fc824073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 shutdown_connections 2024-09-21T07:25:58.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.589+0000 7fc829000640 1 -- 172.21.15.64:0/1437635109 wait complete. 2024-09-21T07:25:58.611 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:25:58.611 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-21T07:25:58.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-21T07:25:58.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- 172.21.15.64:0/1219659959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 msgr2=0x7fdbf8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 --2- 172.21.15.64:0/1219659959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdbf8004c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009b10 tx=0x7fdbfc01d250 comp rx=0 tx=0).stop 2024-09-21T07:25:58.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc15800640 1 -- 172.21.15.64:0/1219659959 reap_dead start 2024-09-21T07:25:58.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- 172.21.15.64:0/1219659959 shutdown_connections 2024-09-21T07:25:58.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- 172.21.15.64:0/1219659959 >> 172.21.15.64:0/1219659959 conn(0x7fdc1006d450 msgr2=0x7fdc100d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- 172.21.15.64:0/1219659959 shutdown_connections 2024-09-21T07:25:58.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- 172.21.15.64:0/1219659959 wait complete. 2024-09-21T07:25:58.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 Processor -- start 2024-09-21T07:25:58.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.769+0000 7fdc17800640 1 -- start start 2024-09-21T07:25:58.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc101f9140 0x7fdc101f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100b1ce0 0x7fdc100b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100ce370 con 0x7fdbf8004810 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100ce1f0 con 0x7fdc101f9140 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100ce4f0 con 0x7fdc100b1ce0 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37714/0 (socket says 172.21.15.64:37714) 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 -- 172.21.15.64:0/3816863078 learned_addr learned my addr 172.21.15.64:0/3816863078 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc15800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100b1ce0 0x7fdc100b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc101f9140 0x7fdc101f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 -- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100b1ce0 msgr2=0x7fdc100b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100b1ce0 0x7fdc100b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 -- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc101f9140 msgr2=0x7fdc101f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc101f9140 0x7fdc101f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 -- 172.21.15.64:0/3816863078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc101e6890 con 0x7fdbf8004810 2024-09-21T07:25:58.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdc04011900 tx=0x7fdc04011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc0cc00640 1 -- 172.21.15.64:0/3816863078 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0401e070 con 0x7fdbf8004810 2024-09-21T07:25:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc0cc00640 1 -- 172.21.15.64:0/3816863078 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0400fe70 con 0x7fdbf8004810 2024-09-21T07:25:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc0cc00640 1 -- 172.21.15.64:0/3816863078 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04019670 con 0x7fdbf8004810 2024-09-21T07:25:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc101f9e70 con 0x7fdbf8004810 2024-09-21T07:25:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.773+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc100c8460 con 0x7fdbf8004810 2024-09-21T07:25:58.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc0cc00640 1 -- 172.21.15.64:0/3816863078 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdc04021070 con 0x7fdbf8004810 2024-09-21T07:25:58.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc0cc00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 0x7fdbf0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc0cc00640 1 -- 172.21.15.64:0/3816863078 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdc04094ec0 con 0x7fdbf8004810 2024-09-21T07:25:58.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 Processor -- start 2024-09-21T07:25:58.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 0x7fdbf0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 -- start start 2024-09-21T07:25:58.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 0x7fdbf0075710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0ae000 tx=0x7fdbfc019ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef283230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef283770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef095fc0 con 0x55b3ef109840 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef0853f0 con 0x55b3ef109030 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.777+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b3ef089200 con 0x55b3ef11c430 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37716/0 (socket says 172.21.15.64:37716) 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 -- 172.21.15.64:0/1311540208 learned_addr learned my addr 172.21.15.64:0/1311540208 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef283770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc14e00640 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef283230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 -- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 msgr2=0x55b3ef283230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef283230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 -- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 msgr2=0x55b3ef283770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef283770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 -- 172.21.15.64:0/1311540208 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ef045640 con 0x55b3ef109840 2024-09-21T07:25:58.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc15800640 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8004790 tx=0x7fdc08004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a405e1bc6dc622 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc01600640 1 -- 172.21.15.64:0/1311540208 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080148b0 con 0x55b3ef109840 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc01600640 1 -- 172.21.15.64:0/1311540208 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc08014a50 con 0x55b3ef109840 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc01600640 1 -- 172.21.15.64:0/1311540208 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08014e60 con 0x55b3ef109840 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- 172.21.15.64:0/1311540208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 msgr2=0x55b3ef283cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8004790 tx=0x7fdc08004640 comp rx=0 tx=0).stop 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- 172.21.15.64:0/1311540208 shutdown_connections 2024-09-21T07:25:58.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef283cb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef283770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 --2- 172.21.15.64:0/1311540208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef283230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- 172.21.15.64:0/1311540208 >> 172.21.15.64:0/1311540208 conn(0x55b3eed41f70 msgr2=0x55b3ef2666e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- 172.21.15.64:0/1311540208 shutdown_connections 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- 172.21.15.64:0/1311540208 wait complete. 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 -- start start 2024-09-21T07:25:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.781+0000 7fdc1f042000 1 Processor -- start 2024-09-21T07:25:58.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef289640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef289b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef02aad0 con 0x55b3ef11c430 2024-09-21T07:25:58.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef041e80 con 0x55b3ef109030 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b3ef030520 con 0x55b3ef109840 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 10 client.0 _ll_register_callbacks cb 0x55b3ef2245b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37722/0 (socket says 172.21.15.64:37722) 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 -- 172.21.15.64:0/3612015045 learned_addr learned my addr 172.21.15.64:0/3612015045 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef289b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef289640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 -- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 msgr2=0x55b3ef289b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef289b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 -- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 msgr2=0x55b3ef289640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef289640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 -- 172.21.15.64:0/3612015045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ef01ad70 con 0x55b3ef11c430 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc15800640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdc08002240 tx=0x7fdc08015f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5b67420e6402 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802a640 con 0x55b3ef11c430 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdc0802a7e0 con 0x55b3ef11c430 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3ef01d910 con 0x55b3ef11c430 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc08032050 con 0x55b3ef11c430 2024-09-21T07:25:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 10 client.5646 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b3ef0237d0 con 0x55b3ef11c430 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b3ef01d910 con 0x55b3ef11c430 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fdc08035020 con 0x55b3ef11c430 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 10 client.5646 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 10 client.5646 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 20 client.5646 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed28010 0x55b3ef293a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 4 client.5646 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ef097f10 con 0x55b3eed28010 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.785+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed28010 0x55b3ef293a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed28010 0x55b3ef293a20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6de152de1304f1 server_cookie=372fe0b073d2006d in_seq=0 out_seq=0 2024-09-21T07:25:58.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdbf6000640 10 client.5646 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdbf6000640 1 -- 172.21.15.64:0/3612015045 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3ef097f10 con 0x55b3eed28010 2024-09-21T07:25:58.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdbf6000640 10 client.5646 handle_command_reply: tid=0 2024-09-21T07:25:58.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 client.5646 shutdown 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 msgr2=0x55b3ef28a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdc08002240 tx=0x7fdc08015f30 comp rx=0 tx=0).stop 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 shutdown_connections 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed28010 0x55b3ef293a20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28a0c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef289b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3612015045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef289640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 >> 172.21.15.64:0/3612015045 conn(0x55b3eed41f70 msgr2=0x55b3ef265820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdbf6000640 0 client.5646 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 shutdown_connections 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 1 -- 172.21.15.64:0/3612015045 wait complete. 2024-09-21T07:25:58.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.789+0000 7fdc1f042000 20 client.5646 trim_cache size 0 max 16384 2024-09-21T07:25:58.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.805+0000 7fdc1f042000 1 Processor -- start 2024-09-21T07:25:58.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.805+0000 7fdc1f042000 1 -- start start 2024-09-21T07:25:58.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef28c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10202060 con 0x55b3ef11c430 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10201460 con 0x55b3ef109030 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdc10201a10 con 0x55b3ef109840 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37738/0 (socket says 172.21.15.64:37738) 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 -- 172.21.15.64:0/3352855886 learned_addr learned my addr 172.21.15.64:0/3352855886 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef28c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 -- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 msgr2=0x55b3ef28c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef28c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 -- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 msgr2=0x55b3ef28f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 -- 172.21.15.64:0/3352855886 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ef0e10d0 con 0x55b3ef11c430 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc15800640 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdc08006d10 tx=0x7fdc080019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97791d01c2dccf7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc00c00640 1 -- 172.21.15.64:0/3352855886 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802a640 con 0x55b3ef11c430 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc00c00640 1 -- 172.21.15.64:0/3352855886 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0802a8d0 con 0x55b3ef11c430 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc00c00640 1 -- 172.21.15.64:0/3352855886 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08014a90 con 0x55b3ef11c430 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- 172.21.15.64:0/3352855886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 msgr2=0x55b3ef28cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdc08006d10 tx=0x7fdc080019e0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- 172.21.15.64:0/3352855886 shutdown_connections 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef11c430 0x55b3ef28cba0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef109840 0x55b3ef28c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3352855886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- 172.21.15.64:0/3352855886 >> 172.21.15.64:0/3352855886 conn(0x55b3eed41f70 msgr2=0x55b3ef289ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- 172.21.15.64:0/3352855886 shutdown_connections 2024-09-21T07:25:58.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.809+0000 7fdc1f042000 1 -- 172.21.15.64:0/3352855886 wait complete. 2024-09-21T07:25:58.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- start start 2024-09-21T07:25:58.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 Processor -- start 2024-09-21T07:25:58.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef2b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef052000 con 0x55b3ef109840 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef094d90 con 0x55b3ef109030 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b3ef088510 con 0x55b3ef11c430 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 10 client.0 _ll_register_callbacks cb 0x7fdbfc0af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37746/0 (socket says 172.21.15.64:37746) 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 -- 172.21.15.64:0/3705067155 learned_addr learned my addr 172.21.15.64:0/3705067155 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc15800640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef2b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 -- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 msgr2=0x55b3ef2b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef2b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 -- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 msgr2=0x55b3ef28f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 -- 172.21.15.64:0/3705067155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ef04b440 con 0x55b3ef109840 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009b10 tx=0x7fdbfc0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a7f09c3ead0f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0b1050 con 0x55b3ef109840 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdbfc004e20 con 0x55b3ef109840 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc0802a8d0 con 0x55b3ef109840 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbfc0d7050 con 0x55b3ef109840 2024-09-21T07:25:58.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 10 client.5652 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b3ef01bf60 con 0x55b3ef109840 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0802a8d0 con 0x55b3ef109840 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.813+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fdbfc0cd020 con 0x55b3ef109840 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 10 client.5652 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 10 client.5652 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 20 client.5652 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed16070 0x55b3ef2f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 4 client.5652 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55b3ef0939c0 con 0x55b3eed16070 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed16070 0x55b3ef2f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdbf6000640 10 client.5652 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc14e00640 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed16070 0x55b3ef2f8e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4239423c71a0460 server_cookie=b2251f3c7db97f5 in_seq=0 out_seq=0 2024-09-21T07:25:58.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdbf6000640 1 -- 172.21.15.64:0/3705067155 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b3ef0939c0 con 0x55b3eed16070 2024-09-21T07:25:58.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdbf6000640 10 client.5652 handle_command_reply: tid=0 2024-09-21T07:25:58.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 client.5652 shutdown 2024-09-21T07:25:58.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 msgr2=0x55b3ef28fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009b10 tx=0x7fdbfc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 shutdown_connections 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b3eed16070 0x55b3ef2f8e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b3ef11c430 0x55b3ef2b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b3ef109840 0x55b3ef28fb60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 --2- 172.21.15.64:0/3705067155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3ef109030 0x55b3ef28f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 >> 172.21.15.64:0/3705067155 conn(0x55b3eed41f70 msgr2=0x55b3ef289110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdbf6000640 0 client.5652 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 shutdown_connections 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 1 -- 172.21.15.64:0/3705067155 wait complete. 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc1f042000 20 client.5652 trim_cache size 0 max 16384 2024-09-21T07:25:58.824 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:58.825 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:25:58.825 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "1e7b96c9-870a-401f-a0b0-a05420a615dc", 2024-09-21T07:25:58.825 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:25:58.825 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:58.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 msgr2=0x7fdbf0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 0x7fdbf0075710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0ae000 tx=0x7fdbfc019ff0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 msgr2=0x7fdc10153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdc04011900 tx=0x7fdc04011dc0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 shutdown_connections 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073200 0x7fdbf0075710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100b1ce0 0x7fdc100b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc101f9140 0x7fdc101f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 --2- 172.21.15.64:0/3816863078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8004810 0x7fdc10153c20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 >> 172.21.15.64:0/3816863078 conn(0x7fdc1006d450 msgr2=0x7fdc1009d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 shutdown_connections 2024-09-21T07:25:58.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:58.817+0000 7fdc17800640 1 -- 172.21.15.64:0/3816863078 wait complete. 2024-09-21T07:25:58.846 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '1e7b96c9-870a-401f-a0b0-a05420a615dc', 'mode': 'asynchronous'}' 2024-09-21T07:25:58.846 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-21T07:25:58.846 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-21T07:25:58.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 -- 172.21.15.64:0/3814631667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f849815e990 msgr2=0x7f84980d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 --2- 172.21.15.64:0/3814631667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f849815e990 0x7f84980d0870 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f848c009900 tx=0x7f848c01c670 comp rx=0 tx=0).stop 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 -- 172.21.15.64:0/3814631667 shutdown_connections 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 --2- 172.21.15.64:0/3814631667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84980b3d30 0x7f84980b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 --2- 172.21.15.64:0/3814631667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f849815e990 0x7f84980d0870 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.001+0000 7f84a0200640 1 -- 172.21.15.64:0/3814631667 >> 172.21.15.64:0/3814631667 conn(0x7f849806d510 msgr2=0x7f84980ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- 172.21.15.64:0/3814631667 shutdown_connections 2024-09-21T07:25:59.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- 172.21.15.64:0/3814631667 wait complete. 2024-09-21T07:25:59.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 Processor -- start 2024-09-21T07:25:59.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- start start 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8498071140 0x7f8498161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f849815e990 0x7f8498155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f849816c2f0 con 0x7f84980b3d30 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f849816c170 con 0x7f8498071140 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.005+0000 7f84a0200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f849816c470 con 0x7f849815e990 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37776/0 (socket says 172.21.15.64:37776) 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 -- 172.21.15.64:0/998218836 learned_addr learned my addr 172.21.15.64:0/998218836 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849d800640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8498071140 0x7f8498161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849e200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f849815e990 0x7f8498155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 -- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f849815e990 msgr2=0x7f8498155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f849815e990 0x7f8498155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 -- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8498071140 msgr2=0x7f8498161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8498071140 0x7f8498161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 -- 172.21.15.64:0/998218836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849815da70 con 0x7f84980b3d30 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f849ce00640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f848400d720 tx=0x7f848400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f8495600640 1 -- 172.21.15.64:0/998218836 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484017070 con 0x7f84980b3d30 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f8495600640 1 -- 172.21.15.64:0/998218836 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8484009b10 con 0x7f84980b3d30 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849815dd50 con 0x7f84980b3d30 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f8495600640 1 -- 172.21.15.64:0/998218836 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484010460 con 0x7f84980b3d30 2024-09-21T07:25:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8498160030 con 0x7f84980b3d30 2024-09-21T07:25:59.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.009+0000 7f8495600640 1 -- 172.21.15.64:0/998218836 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f848401a070 con 0x7f84980b3d30 2024-09-21T07:25:59.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f8495600640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 0x7f8478075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f8495600640 1 -- 172.21.15.64:0/998218836 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f84840943d0 con 0x7f84980b3d30 2024-09-21T07:25:59.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 0x7f8478075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 Processor -- start 2024-09-21T07:25:59.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 -- start start 2024-09-21T07:25:59.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 0x7f8478075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f848c0ae000 tx=0x7f848c01aeb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de96310 0x55f31dfe7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 0x55f31dfe7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f31ddf8c40 con 0x55f31de9d570 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f31dde8070 con 0x55f31de801a0 2024-09-21T07:25:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f31ddebe80 con 0x55f31de96310 2024-09-21T07:25:59.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37786/0 (socket says 172.21.15.64:37786) 2024-09-21T07:25:59.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 -- 172.21.15.64:0/278797674 learned_addr learned my addr 172.21.15.64:0/278797674 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849ce00640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de96310 0x55f31dfe7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849e200640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 0x55f31dfe7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 -- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de96310 msgr2=0x55f31dfe7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de96310 0x55f31dfe7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 -- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 msgr2=0x55f31dfe7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 0x55f31dfe7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849d800640 1 -- 172.21.15.64:0/278797674 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31dd68790 con 0x55f31de9d570 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.013+0000 7f849e200640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 0x55f31dfe7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f849d800640 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c10 tx=0x7f848c0b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be44f9a44bb22769 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f848a000640 1 -- 172.21.15.64:0/278797674 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c003800 con 0x55f31de9d570 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f848a000640 1 -- 172.21.15.64:0/278797674 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f848c0af040 con 0x55f31de9d570 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f848a000640 1 -- 172.21.15.64:0/278797674 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c003be0 con 0x55f31de9d570 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- 172.21.15.64:0/278797674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 msgr2=0x55f31dfe6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c10 tx=0x7f848c0b7040 comp rx=0 tx=0).stop 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- 172.21.15.64:0/278797674 shutdown_connections 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de801a0 0x55f31dfe7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de96310 0x55f31dfe7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/278797674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de9d570 0x55f31dfe6f00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- 172.21.15.64:0/278797674 >> 172.21.15.64:0/278797674 conn(0x55f31debab30 msgr2=0x55f31dfa4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- 172.21.15.64:0/278797674 shutdown_connections 2024-09-21T07:25:59.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- 172.21.15.64:0/278797674 wait complete. 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 -- start start 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.017+0000 7f84a7a0a000 1 Processor -- start 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31dfa3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31dfd5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f31dd8d580 con 0x55f31de801a0 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f31dd9da00 con 0x55f31de96310 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f31dea2a20 con 0x55f31de9d570 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 10 client.0 _ll_register_callbacks cb 0x55f31df89a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37802/0 (socket says 172.21.15.64:37802) 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 -- 172.21.15.64:0/1576129768 learned_addr learned my addr 172.21.15.64:0/1576129768 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849ce00640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31dfa3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849e200640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31dfd5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 -- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 msgr2=0x55f31dfd5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31dfd5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 -- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 msgr2=0x55f31dfa3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31dfa3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 -- 172.21.15.64:0/1576129768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31dda3f60 con 0x55f31de801a0 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849d800640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f848c01cb50 tx=0x7f848c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9418cfaf0174f90a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c003930 con 0x55f31de801a0 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f848c0d2c60 con 0x55f31de801a0 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f31dd80390 con 0x55f31de801a0 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f848c0d9050 con 0x55f31de801a0 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 10 client.5664 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f31dd86250 con 0x55f31de801a0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f31dd80390 con 0x55f31de801a0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f848c0dc020 con 0x55f31de801a0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 10 client.5664 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 10 client.5664 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 20 client.5664 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da8a990 0x55f31dfd5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 4 client.5664 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f31ddfab90 con 0x55f31da8a990 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849ce00640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da8a990 0x55f31dfd5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 10 client.5664 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f849ce00640 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da8a990 0x55f31dfd5ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5422b5ec9521f8c3 server_cookie=1cfd1f64683bdff0 in_seq=0 out_seq=0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 1 -- 172.21.15.64:0/1576129768 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f31ddfab90 con 0x55f31da8a990 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f847ea00640 10 client.5664 handle_command_reply: tid=0 2024-09-21T07:25:59.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.021+0000 7f84a7a0a000 1 client.5664 shutdown 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 msgr2=0x55f31dfa3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f848c01cb50 tx=0x7f848c003680 comp rx=0 tx=0).stop 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 shutdown_connections 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da8a990 0x55f31dfd5ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31dfd5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31dfa3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f847ea00640 0 client.5664 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1576129768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31dfa3100 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 >> 172.21.15.64:0/1576129768 conn(0x55f31debab30 msgr2=0x55f31df9c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 shutdown_connections 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1576129768 wait complete. 2024-09-21T07:25:59.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.025+0000 7f84a7a0a000 20 client.5664 trim_cache size 0 max 16384 2024-09-21T07:25:59.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 Processor -- start 2024-09-21T07:25:59.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- start start 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31df9b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84981fcc90 con 0x55f31de801a0 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8498154c60 con 0x55f31de96310 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f84981fc670 con 0x55f31de9d570 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37812/0 (socket says 172.21.15.64:37812) 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 -- 172.21.15.64:0/1416506695 learned_addr learned my addr 172.21.15.64:0/1416506695 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849ce00640 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849e200640 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31df9b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 -- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 msgr2=0x55f31df9b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31df9b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 -- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 msgr2=0x55f31df9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 -- 172.21.15.64:0/1416506695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31dfe6d30 con 0x55f31de801a0 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f849d800640 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f848c01cf10 tx=0x7f848c0aa640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dca02815be327f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f8489600640 1 -- 172.21.15.64:0/1416506695 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c003c10 con 0x55f31de801a0 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f8489600640 1 -- 172.21.15.64:0/1416506695 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f848c0af040 con 0x55f31de801a0 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f8489600640 1 -- 172.21.15.64:0/1416506695 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0c8430 con 0x55f31de801a0 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1416506695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 msgr2=0x55f31df9a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f848c01cf10 tx=0x7f848c0aa640 comp rx=0 tx=0).stop 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1416506695 shutdown_connections 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31df9b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/1416506695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9a8a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1416506695 >> 172.21.15.64:0/1416506695 conn(0x55f31debab30 msgr2=0x55f31dff74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1416506695 shutdown_connections 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.041+0000 7f84a7a0a000 1 -- 172.21.15.64:0/1416506695 wait complete. 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- start start 2024-09-21T07:25:59.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 Processor -- start 2024-09-21T07:25:59.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31e018ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f31dd9cd10 con 0x55f31de801a0 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f31dd930d0 con 0x55f31de96310 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f31ddeb190 con 0x55f31de9d570 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 10 client.0 _ll_register_callbacks cb 0x7f8490001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37814/0 (socket says 172.21.15.64:37814) 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 -- 172.21.15.64:0/737273662 learned_addr learned my addr 172.21.15.64:0/737273662 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849e200640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31e018ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849ce00640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 -- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 msgr2=0x55f31e018ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31e018ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 -- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 msgr2=0x55f31df9ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 -- 172.21.15.64:0/737273662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31dd9e450 con 0x55f31de801a0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f849d800640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f848c0aa6b0 tx=0x7f848c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6601c8e6e653b701 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f847ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0c8430 con 0x55f31de801a0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f848c0dec30 con 0x55f31de801a0 2024-09-21T07:25:59.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f848c0af040 con 0x55f31de801a0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f848c0dee30 con 0x55f31de801a0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 10 client.5670 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.045+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f31de6de60 con 0x55f31de801a0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f848c0af040 con 0x55f31de801a0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f848c0dc040 con 0x55f31de801a0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 10 client.5670 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 10 client.5670 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 20 client.5670 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da789f0 0x55f31e019460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 4 client.5670 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55f31ddf6640 con 0x55f31da789f0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f849ce00640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da789f0 0x55f31e019460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f849ce00640 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da789f0 0x55f31e019460 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60e5489f569d5d3 server_cookie=fc1df6c435f6cae in_seq=0 out_seq=0 2024-09-21T07:25:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 10 client.5670 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 1 -- 172.21.15.64:0/737273662 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f31ddf6640 con 0x55f31da789f0 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 10 client.5670 handle_command_reply: tid=0 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 client.5670 shutdown 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 msgr2=0x55f31df9e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f848c0aa6b0 tx=0x7f848c003f40 comp rx=0 tx=0).stop 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 shutdown_connections 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f31da789f0 0x55f31e019460 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f31de9d570 0x55f31e018ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f31de96310 0x55f31df9ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 --2- 172.21.15.64:0/737273662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f31de801a0 0x55f31df9e550 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f847ea00640 0 client.5670 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 >> 172.21.15.64:0/737273662 conn(0x55f31debab30 msgr2=0x55f31df99890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 shutdown_connections 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.049+0000 7f84a7a0a000 1 -- 172.21.15.64:0/737273662 wait complete. 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a7a0a000 20 client.5670 trim_cache size 0 max 16384 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:25:59.057 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 msgr2=0x7f8478075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 0x7f8478075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f848c0ae000 tx=0x7f848c01aeb0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 msgr2=0x7f8498151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f848400d720 tx=0x7f848400dbe0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 shutdown_connections 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8478073200 0x7f8478075710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f849815e990 0x7f8498155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84980b3d30 0x7f8498151250 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 --2- 172.21.15.64:0/998218836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8498071140 0x7f8498161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 >> 172.21.15.64:0/998218836 conn(0x7f849806d510 msgr2=0x7f8498071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 shutdown_connections 2024-09-21T07:25:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.053+0000 7f84a0200640 1 -- 172.21.15.64:0/998218836 wait complete. 2024-09-21T07:25:59.076 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:25:59.076 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-21T07:25:59.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 -- 172.21.15.64:0/2212970565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52000b4d40 msgr2=0x7f520015f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 --2- 172.21.15.64:0/2212970565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52000b4d40 0x7f520015f540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005fd0 tx=0x7f51f001c820 comp rx=0 tx=0).stop 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 -- 172.21.15.64:0/2212970565 shutdown_connections 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 --2- 172.21.15.64:0/2212970565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000cca80 0x7f52000cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 --2- 172.21.15.64:0/2212970565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52000b4d40 0x7f520015f540 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 -- 172.21.15.64:0/2212970565 >> 172.21.15.64:0/2212970565 conn(0x7f520006d450 msgr2=0x7f52000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 -- 172.21.15.64:0/2212970565 shutdown_connections 2024-09-21T07:25:59.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.233+0000 7f5206800640 1 -- 172.21.15.64:0/2212970565 wait complete. 2024-09-21T07:25:59.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 Processor -- start 2024-09-21T07:25:59.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 -- start start 2024-09-21T07:25:59.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 0x7f520009a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f520015b4f0 0x7f5200164070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5200168050 con 0x7f52000cca80 2024-09-21T07:25:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5200167ed0 con 0x7f520015b4f0 2024-09-21T07:25:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f5206800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f52001681d0 con 0x7f52000b4d40 2024-09-21T07:25:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f51fea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f51fea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37826/0 (socket says 172.21.15.64:37826) 2024-09-21T07:25:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f51fea00640 1 -- 172.21.15.64:0/2665709666 learned_addr learned my addr 172.21.15.64:0/2665709666 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.237+0000 7f51ff400640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 0x7f520009a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51ffe00640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f520015b4f0 0x7f5200164070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 -- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 msgr2=0x7f520009a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 0x7f520009a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 -- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f520015b4f0 msgr2=0x7f5200164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f520015b4f0 0x7f5200164070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 -- 172.21.15.64:0/2665709666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52001f8f50 con 0x7f52000cca80 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51ff400640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 0x7f520009a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51fea00640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e850 tx=0x7f51ec00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51f7400640 1 -- 172.21.15.64:0/2665709666 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00cd60 con 0x7f52000cca80 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51f7400640 1 -- 172.21.15.64:0/2665709666 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51ec005020 con 0x7f52000cca80 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001f91f0 con 0x7f52000cca80 2024-09-21T07:25:59.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51f7400640 1 -- 172.21.15.64:0/2665709666 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec005470 con 0x7f52000cca80 2024-09-21T07:25:59.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001f97b0 con 0x7f52000cca80 2024-09-21T07:25:59.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.241+0000 7f51f7400640 1 -- 172.21.15.64:0/2665709666 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f51ec0047b0 con 0x7f52000cca80 2024-09-21T07:25:59.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51f7400640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 0x7f51e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51f7400640 1 -- 172.21.15.64:0/2665709666 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f51ec094990 con 0x7f52000cca80 2024-09-21T07:25:59.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 Processor -- start 2024-09-21T07:25:59.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 0x7f51e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 -- start start 2024-09-21T07:25:59.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 0x7f51e0075740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ae000 tx=0x7f51f001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5594163042f0 0x559416455420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x559416455960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559416266c20 con 0x55941630b550 2024-09-21T07:25:59.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559416256050 con 0x5594163042f0 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559416259e60 con 0x5594162ee180 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37834/0 (socket says 172.21.15.64:37834) 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 -- 172.21.15.64:0/3292938258 learned_addr learned my addr 172.21.15.64:0/3292938258 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ffe00640 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x559416455960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51fea00640 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5594163042f0 0x559416455420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 -- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 msgr2=0x559416455960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x559416455960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 -- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5594163042f0 msgr2=0x559416455420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5594163042f0 0x559416455420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 -- 172.21.15.64:0/3292938258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594161d6770 con 0x55941630b550 2024-09-21T07:25:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ff400640 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f00b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ba4586636d4bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ebe00640 1 -- 172.21.15.64:0/3292938258 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00be070 con 0x55941630b550 2024-09-21T07:25:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ebe00640 1 -- 172.21.15.64:0/3292938258 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51f00ca070 con 0x55941630b550 2024-09-21T07:25:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.245+0000 7f51ebe00640 1 -- 172.21.15.64:0/3292938258 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0004910 con 0x55941630b550 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- 172.21.15.64:0/3292938258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 msgr2=0x559416454ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f00b8000 comp rx=0 tx=0).stop 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- 172.21.15.64:0/3292938258 shutdown_connections 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x559416455960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5594163042f0 0x559416455420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- 172.21.15.64:0/3292938258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55941630b550 0x559416454ee0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- 172.21.15.64:0/3292938258 >> 172.21.15.64:0/3292938258 conn(0x559416328b10 msgr2=0x559416412210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- 172.21.15.64:0/3292938258 shutdown_connections 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- 172.21.15.64:0/3292938258 wait complete. 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- start start 2024-09-21T07:25:59.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 Processor -- start 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416416ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5594161fb560 con 0x5594162ee180 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55941620b9e0 con 0x55941630b550 2024-09-21T07:25:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559416310a00 con 0x5594163042f0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f520ddd1000 10 client.0 _ll_register_callbacks cb 0x5594163f7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37840/0 (socket says 172.21.15.64:37840) 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 -- 172.21.15.64:0/2443032131 learned_addr learned my addr 172.21.15.64:0/2443032131 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51fea00640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ffe00640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416416ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 -- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 msgr2=0x559416410b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 -- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 msgr2=0x559416416ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416416ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51ff400640 1 -- 172.21.15.64:0/2443032131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559416211f40 con 0x5594162ee180 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.249+0000 7f51fea00640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51ff400640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f51f001cd00 tx=0x7f51f00045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ecf3cb9942f3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00be040 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f51f0004b10 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5594161ee370 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51f00dd050 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 10 client.5679 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5594161f4230 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5594161ee370 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f51f00e0020 con 0x5594162ee180 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 10 client.5679 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 20 client.5679 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ef89c0 0x5594164176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 4 client.5679 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:59.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559416268b70 con 0x559415ef89c0 2024-09-21T07:25:59.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51fea00640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ef89c0 0x5594164176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 10 client.5679 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51fea00640 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ef89c0 0x5594164176b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f82818a04286fb server_cookie=4046a3693a0b3fe1 in_seq=0 out_seq=0 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 1 -- 172.21.15.64:0/2443032131 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559416268b70 con 0x559415ef89c0 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 10 client.5679 handle_command_reply: tid=0 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 client.5679 shutdown 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 msgr2=0x5594164105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f51f001cd00 tx=0x7f51f00045f0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 shutdown_connections 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ef89c0 0x5594164176b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416416ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2443032131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164105d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f51e8c00640 0 client.5679 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 >> 172.21.15.64:0/2443032131 conn(0x559416328b10 msgr2=0x55941640a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 shutdown_connections 2024-09-21T07:25:59.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 1 -- 172.21.15.64:0/2443032131 wait complete. 2024-09-21T07:25:59.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.253+0000 7f520ddd1000 20 client.5679 trim_cache size 0 max 16384 2024-09-21T07:25:59.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 Processor -- start 2024-09-21T07:25:59.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 -- start start 2024-09-21T07:25:59.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416410750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f520009d1b0 con 0x5594162ee180 2024-09-21T07:25:59.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52000aea40 con 0x55941630b550 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f520009cb60 con 0x5594163042f0 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f51ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37850/0 (socket says 172.21.15.64:37850) 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.273+0000 7f51ff400640 1 -- 172.21.15.64:0/2026025610 learned_addr learned my addr 172.21.15.64:0/2026025610 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 -- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 msgr2=0x559416410210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 -- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 msgr2=0x559416410750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416410750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 -- 172.21.15.64:0/2026025610 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559416417a20 con 0x5594162ee180 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51ff400640 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404f4d7f2b95ac46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51eb400640 1 -- 172.21.15.64:0/2026025610 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00be070 con 0x5594162ee180 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51eb400640 1 -- 172.21.15.64:0/2026025610 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51f00d5070 con 0x5594162ee180 2024-09-21T07:25:59.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f51eb400640 1 -- 172.21.15.64:0/2026025610 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00a5aa0 con 0x5594162ee180 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- 172.21.15.64:0/2026025610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 msgr2=0x5594164c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f0009570 comp rx=0 tx=0).stop 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- 172.21.15.64:0/2026025610 shutdown_connections 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x559416410750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594163042f0 0x559416410210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2026025610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594162ee180 0x5594164c3080 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- 172.21.15.64:0/2026025610 >> 172.21.15.64:0/2026025610 conn(0x559416328b10 msgr2=0x55941640fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- 172.21.15.64:0/2026025610 shutdown_connections 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- 172.21.15.64:0/2026025610 wait complete. 2024-09-21T07:25:59.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 -- start start 2024-09-21T07:25:59.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.277+0000 7f520ddd1000 1 Processor -- start 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x5594164ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x5594164cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55941620acf0 con 0x5594163042f0 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5594162010b0 con 0x55941630b550 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559416259170 con 0x5594162ee180 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 10 client.0 _ll_register_callbacks cb 0x7f51ec05b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37852/0 (socket says 172.21.15.64:37852) 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51ff400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x5594164ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 -- 172.21.15.64:0/2713099733 learned_addr learned my addr 172.21.15.64:0/2713099733 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51ffe00640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x5594164cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 -- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 msgr2=0x5594164ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x5594164ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 -- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 msgr2=0x5594164cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x5594164cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 -- 172.21.15.64:0/2713099733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55941620c430 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51fea00640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f51ec092c90 tx=0x7f51ec066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc65d88dd34e744 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec05f110 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f51ec005610 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f00d5070 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51ec06f050 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 10 client.5685 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5594162dbe40 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51f00d5070 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f51ec015070 con 0x5594163042f0 2024-09-21T07:25:59.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 10 client.5685 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 10 client.5685 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 20 client.5685 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ee6a20 0x559416485ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 4 client.5685 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x559416264620 con 0x559415ee6a20 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51ff400640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ee6a20 0x559416485ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51ff400640 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ee6a20 0x559416485ba0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410f315d14a82537 server_cookie=53baa00a33d8ff05 in_seq=0 out_seq=0 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 10 client.5685 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 1 -- 172.21.15.64:0/2713099733 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559416264620 con 0x559415ee6a20 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 10 client.5685 handle_command_reply: tid=0 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 client.5685 shutdown 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 msgr2=0x5594164ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f51ec092c90 tx=0x7f51ec066040 comp rx=0 tx=0).stop 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 shutdown_connections 2024-09-21T07:25:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559415ee6a20 0x559416485ba0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55941630b550 0x5594164cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5594163042f0 0x5594164ca780 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f51e8c00640 0 client.5685 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 --2- 172.21.15.64:0/2713099733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5594162ee180 0x5594164ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.281+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 >> 172.21.15.64:0/2713099733 conn(0x559416328b10 msgr2=0x559416410290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 shutdown_connections 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f520ddd1000 1 -- 172.21.15.64:0/2713099733 wait complete. 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f520ddd1000 20 client.5685 trim_cache size 0 max 16384 2024-09-21T07:25:59.290 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:59.291 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:25:59.291 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1", 2024-09-21T07:25:59.291 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:25:59.291 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:59.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 msgr2=0x7f51e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 0x7f51e0075740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ae000 tx=0x7f51f001b060 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 msgr2=0x7f5200148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e850 tx=0x7f51ec00ed10 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 shutdown_connections 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51e0073230 0x7f51e0075740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f520015b4f0 0x7f5200164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52000cca80 0x7f5200148490 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 --2- 172.21.15.64:0/2665709666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52000b4d40 0x7f520009a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 >> 172.21.15.64:0/2665709666 conn(0x7f520006d450 msgr2=0x7f520015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 shutdown_connections 2024-09-21T07:25:59.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.285+0000 7f5206800640 1 -- 172.21.15.64:0/2665709666 wait complete. 2024-09-21T07:25:59.308 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '4f195809-ffb8-4d3c-ba03-c71e1ca40bd1', 'mode': 'asynchronous'}' 2024-09-21T07:25:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:59.309 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-21T07:25:59.319 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-21T07:25:59.319 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-21T07:25:59.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- 172.21.15.64:0/4203992286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c15cca0 msgr2=0x7fa17c15d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 --2- 172.21.15.64:0/4203992286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c15cca0 0x7fa17c15d0b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0ccb40 tx=0x7fa16801c830 comp rx=0 tx=0).stop 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- 172.21.15.64:0/4203992286 shutdown_connections 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 --2- 172.21.15.64:0/4203992286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c0b1be0 0x7fa17c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 --2- 172.21.15.64:0/4203992286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c15cca0 0x7fa17c15d0b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 --2- 172.21.15.64:0/4203992286 >> v2:172.21.15.90:3300/0 conn(0x7fa17c159db0 0x7fa17c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- 172.21.15.64:0/4203992286 >> 172.21.15.64:0/4203992286 conn(0x7fa17c0ccbe0 msgr2=0x7fa17c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- 172.21.15.64:0/4203992286 shutdown_connections 2024-09-21T07:25:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- 172.21.15.64:0/4203992286 wait complete. 2024-09-21T07:25:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 Processor -- start 2024-09-21T07:25:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.521+0000 7fa183800640 1 -- start start 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa17c0b1be0 0x7fa17c167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c15cca0 0x7fa17c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c06f2b0 con 0x7fa17c159db0 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c06f130 con 0x7fa17c0b1be0 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c06f430 con 0x7fa17c15cca0 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37860/0 (socket says 172.21.15.64:37860) 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 -- 172.21.15.64:0/1696542598 learned_addr learned my addr 172.21.15.64:0/1696542598 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa180e00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa17c0b1be0 0x7fa17c167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa181800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c15cca0 0x7fa17c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 -- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c15cca0 msgr2=0x7fa17c15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c15cca0 0x7fa17c15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 -- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa17c0b1be0 msgr2=0x7fa17c167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa17c0b1be0 0x7fa17c167710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 -- 172.21.15.64:0/1696542598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c167c50 con 0x7fa17c159db0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa17be00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa1680b0040 tx=0x7fa168005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa178c00640 1 -- 172.21.15.64:0/1696542598 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680b2040 con 0x7fa17c159db0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa178c00640 1 -- 172.21.15.64:0/1696542598 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa168004350 con 0x7fa17c159db0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa178c00640 1 -- 172.21.15.64:0/1696542598 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680052d0 con 0x7fa17c159db0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c09d920 con 0x7fa17c159db0 2024-09-21T07:25:59.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.525+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c09dbe0 con 0x7fa17c159db0 2024-09-21T07:25:59.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa178c00640 1 -- 172.21.15.64:0/1696542598 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa1680bd060 con 0x7fa17c159db0 2024-09-21T07:25:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa178c00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 0x7fa15c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa178c00640 1 -- 172.21.15.64:0/1696542598 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fa16812da70 con 0x7fa17c159db0 2024-09-21T07:25:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa180e00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 0x7fa15c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa180e00640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 0x7fa15c075710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa170009600 tx=0x7fa1700091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa18af1a000 1 Processor -- start 2024-09-21T07:25:59.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.529+0000 7fa18af1a000 1 -- start start 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 0x559f697d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559f695e9db0 con 0x559f69665e70 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559f695d91e0 con 0x559f69386e60 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559f695dcff0 con 0x559f6965eb70 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37866/0 (socket says 172.21.15.64:37866) 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 -- 172.21.15.64:0/277967899 learned_addr learned my addr 172.21.15.64:0/277967899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa181800640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa17be00640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 0x559f697d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 -- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 msgr2=0x559f697d7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 0x559f697d7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 -- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 msgr2=0x559f697d8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697d8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 -- 172.21.15.64:0/277967899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6958c4e0 con 0x559f69665e70 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa17be00640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 0x559f697d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa180e00640 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa170011e50 tx=0x7fa170014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7400755fc5a8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa16d600640 1 -- 172.21.15.64:0/277967899 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170004220 con 0x559f69665e70 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa16d600640 1 -- 172.21.15.64:0/277967899 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17000e930 con 0x559f69665e70 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa16d600640 1 -- 172.21.15.64:0/277967899 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700044b0 con 0x559f69665e70 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- 172.21.15.64:0/277967899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 msgr2=0x559f697d75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa170011e50 tx=0x7fa170014000 comp rx=0 tx=0).stop 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- 172.21.15.64:0/277967899 shutdown_connections 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697d8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f6965eb70 0x559f697d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 --2- 172.21.15.64:0/277967899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69665e70 0x559f697d75a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- 172.21.15.64:0/277967899 >> 172.21.15.64:0/277967899 conn(0x559f69695c30 msgr2=0x559f6978c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- 172.21.15.64:0/277967899 shutdown_connections 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.533+0000 7fa18af1a000 1 -- 172.21.15.64:0/277967899 wait complete. 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- start start 2024-09-21T07:25:59.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 Processor -- start 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697dda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f697de4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559f6957d2b0 con 0x559f6965eb70 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559f695a2cc0 con 0x559f69386e60 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559f695e8b80 con 0x559f69665e70 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 10 client.0 _ll_register_callbacks cb 0x559f69779500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37880/0 (socket says 172.21.15.64:37880) 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 -- 172.21.15.64:0/3098585809 learned_addr learned my addr 172.21.15.64:0/3098585809 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa180e00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa181800640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f697de4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 -- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 msgr2=0x559f697de4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f697de4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 -- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 msgr2=0x559f697dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697dda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 -- 172.21.15.64:0/3098585809 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f69559b00 con 0x559f6965eb70 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa17be00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa16801a460 tx=0x7fa1680f41a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df8a276e5027d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680f79f0 con 0x559f6965eb70 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fa1680ff070 con 0x559f6965eb70 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f69571550 con 0x559f6965eb70 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa1680f7d90 con 0x559f6965eb70 2024-09-21T07:25:59.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 10 client.5697 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x559f69595120 con 0x559f6965eb70 2024-09-21T07:25:59.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559f69571550 con 0x559f6965eb70 2024-09-21T07:25:59.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa168119ce0 con 0x559f6965eb70 2024-09-21T07:25:59.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 10 client.5697 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 20 client.5697 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f6927bcf0 0x559f697e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 4 client.5697 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.537+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f695ebd00 con 0x559f6927bcf0 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa180e00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f6927bcf0 0x559f697e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa180e00640 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f6927bcf0 0x559f697e7e00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f449819a3a9552e0 server_cookie=8e2e605654b679e4 in_seq=0 out_seq=0 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa162000640 10 client.5697 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa162000640 1 -- 172.21.15.64:0/3098585809 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f695ebd00 con 0x559f6927bcf0 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa162000640 10 client.5697 handle_command_reply: tid=0 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 client.5697 shutdown 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 msgr2=0x559f697ddf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa16801a460 tx=0x7fa1680f41a0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 shutdown_connections 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f6927bcf0 0x559f697e7e00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f697de4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f697ddf60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3098585809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69386e60 0x559f697dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa162000640 0 client.5697 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 >> 172.21.15.64:0/3098585809 conn(0x559f69695c30 msgr2=0x559f6978d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 shutdown_connections 2024-09-21T07:25:59.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 1 -- 172.21.15.64:0/3098585809 wait complete. 2024-09-21T07:25:59.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.541+0000 7fa18af1a000 20 client.5697 trim_cache size 0 max 16384 2024-09-21T07:25:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 Processor -- start 2024-09-21T07:25:59.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 -- start start 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f6965eb70 0x559f698496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f69849bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c208bd0 con 0x559f69386e60 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c167350 con 0x559f6965eb70 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c208580 con 0x559f69665e70 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37896/0 (socket says 172.21.15.64:37896) 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 -- 172.21.15.64:0/2104379747 learned_addr learned my addr 172.21.15.64:0/2104379747 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa17be00640 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f6965eb70 0x559f698496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa181800640 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f69849bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 -- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 msgr2=0x559f69849bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f69849bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 -- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f6965eb70 msgr2=0x559f698496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f6965eb70 0x559f698496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.557+0000 7fa180e00640 1 -- 172.21.15.64:0/2104379747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f69577410 con 0x559f69386e60 2024-09-21T07:25:59.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa180e00640 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa170011e20 tx=0x7fa170004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10cae512ae19fce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa16cc00640 1 -- 172.21.15.64:0/2104379747 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000e930 con 0x559f69386e60 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa16cc00640 1 -- 172.21.15.64:0/2104379747 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17000ebc0 con 0x559f69386e60 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa16cc00640 1 -- 172.21.15.64:0/2104379747 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170003600 con 0x559f69386e60 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- 172.21.15.64:0/2104379747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 msgr2=0x559f69849170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa170011e20 tx=0x7fa170004740 comp rx=0 tx=0).stop 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- 172.21.15.64:0/2104379747 shutdown_connections 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69665e70 0x559f69849bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f6965eb70 0x559f698496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- 172.21.15.64:0/2104379747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f69386e60 0x559f69849170 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- 172.21.15.64:0/2104379747 >> 172.21.15.64:0/2104379747 conn(0x559f69695c30 msgr2=0x559f697927b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- 172.21.15.64:0/2104379747 shutdown_connections 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- 172.21.15.64:0/2104379747 wait complete. 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- start start 2024-09-21T07:25:59.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 Processor -- start 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69665e70 0x559f6984d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69269d50 0x559f6984dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559f695a5290 con 0x559f6965eb70 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559f695989a0 con 0x559f69665e70 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.561+0000 7fa18af1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559f695dc300 con 0x559f69269d50 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 10 client.0 _ll_register_callbacks cb 0x7fa168005a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37898/0 (socket says 172.21.15.64:37898) 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 -- 172.21.15.64:0/3094478771 learned_addr learned my addr 172.21.15.64:0/3094478771 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa17be00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69665e70 0x559f6984d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa181800640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69269d50 0x559f6984dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 -- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69269d50 msgr2=0x559f6984dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69269d50 0x559f6984dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 -- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69665e70 msgr2=0x559f6984d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69665e70 0x559f6984d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 -- 172.21.15.64:0/3094478771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f69636090 con 0x559f6965eb70 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa180e00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa1700046a0 tx=0x7fa170011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2c8b4ece2b1a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000ed70 con 0x559f6965eb70 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fa17000e7b0 con 0x559f6965eb70 2024-09-21T07:25:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17000ebc0 con 0x559f6965eb70 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa17004d050 con 0x559f6965eb70 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 10 client.5703 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x559f6956f7d0 con 0x559f6965eb70 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17000ebc0 con 0x559f6965eb70 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa170050020 con 0x559f6965eb70 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 10 client.5703 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 10 client.5703 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 20 client.5703 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f698097c0 0x559f69809bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 4 client.5703 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x559f695e77b0 con 0x559f698097c0 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa17be00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f698097c0 0x559f69809bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa162000640 10 client.5703 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.565+0000 7fa17be00640 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f698097c0 0x559f69809bd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a2a8b7155c26b4 server_cookie=79d0f2d7a2ac7fa3 in_seq=0 out_seq=0 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa162000640 1 -- 172.21.15.64:0/3094478771 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f695e77b0 con 0x559f698097c0 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa162000640 10 client.5703 handle_command_reply: tid=0 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 client.5703 shutdown 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 msgr2=0x559f6984d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa1700046a0 tx=0x7fa170011980 comp rx=0 tx=0).stop 2024-09-21T07:25:59.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 shutdown_connections 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x559f698097c0 0x559f69809bd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559f69269d50 0x559f6984dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559f69665e70 0x559f6984d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 --2- 172.21.15.64:0/3094478771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559f6965eb70 0x559f6984d2d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa162000640 0 client.5703 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.569+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 >> 172.21.15.64:0/3094478771 conn(0x559f69695c30 msgr2=0x559f69793170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 shutdown_connections 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa18af1a000 1 -- 172.21.15.64:0/3094478771 wait complete. 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa18af1a000 20 client.5703 trim_cache size 0 max 16384 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:59.577 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:59.578 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:25:59.578 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:59.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 msgr2=0x7fa15c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 0x7fa15c075710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa170009600 tx=0x7fa1700091e0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 msgr2=0x7fa17c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa1680b0040 tx=0x7fa168005de0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 shutdown_connections 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa15c073200 0x7fa15c075710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa17c15cca0 0x7fa17c15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa17c159db0 0x7fa17c15b880 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 --2- 172.21.15.64:0/1696542598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa17c0b1be0 0x7fa17c167710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 >> 172.21.15.64:0/1696542598 conn(0x7fa17c0ccbe0 msgr2=0x7fa17c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 shutdown_connections 2024-09-21T07:25:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.573+0000 7fa183800640 1 -- 172.21.15.64:0/1696542598 wait complete. 2024-09-21T07:25:59.596 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:25:59.596 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:25:59.596 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:25:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:25:59.605 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-21T07:25:59.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:25:59.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:25:59.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013765 s, 76.2 MB/s 2024-09-21T07:25:59.671 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-21T07:25:59.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 -- 172.21.15.64:0/4054412383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0b40d0 msgr2=0x7f01bc0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 --2- 172.21.15.64:0/4054412383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0b40d0 0x7f01bc0b44e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009bc0 tx=0x7f01b801cba0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 -- 172.21.15.64:0/4054412383 shutdown_connections 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 --2- 172.21.15.64:0/4054412383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0b40d0 0x7f01bc0b44e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 -- 172.21.15.64:0/4054412383 >> 172.21.15.64:0/4054412383 conn(0x7f01bc0ccbe0 msgr2=0x7f01bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.865+0000 7f01c4800640 1 -- 172.21.15.64:0/4054412383 shutdown_connections 2024-09-21T07:25:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 -- 172.21.15.64:0/4054412383 wait complete. 2024-09-21T07:25:59.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 Processor -- start 2024-09-21T07:25:59.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 -- start start 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01bc0b40d0 0x7f01bc156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01bc0cdd30 0x7f01bc073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc166b20 con 0x7f01bc0c8920 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc1669a0 con 0x7f01bc0cdd30 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c4800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc1695a0 con 0x7f01bc0b40d0 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37926/0 (socket says 172.21.15.64:37926) 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.869+0000 7f01c2800640 1 -- 172.21.15.64:0/1458163307 learned_addr learned my addr 172.21.15.64:0/1458163307 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 -- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01bc0b40d0 msgr2=0x7f01bc156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01bc0b40d0 0x7f01bc156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 -- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01bc0cdd30 msgr2=0x7f01bc073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01bc0cdd30 0x7f01bc073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 -- 172.21.15.64:0/1458163307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc0b46f0 con 0x7f01bc0c8920 2024-09-21T07:25:59.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c2800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009b10 tx=0x7f01b80a5ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01b6000640 1 -- 172.21.15.64:0/1458163307 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80bb070 con 0x7f01bc0c8920 2024-09-21T07:25:59.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01b6000640 1 -- 172.21.15.64:0/1458163307 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b8004d40 con 0x7f01bc0c8920 2024-09-21T07:25:59.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc0c8e50 con 0x7f01bc0c8920 2024-09-21T07:25:59.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01b6000640 1 -- 172.21.15.64:0/1458163307 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b2040 con 0x7f01bc0c8920 2024-09-21T07:25:59.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc073270 con 0x7f01bc0c8920 2024-09-21T07:25:59.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.873+0000 7f01b6000640 1 -- 172.21.15.64:0/1458163307 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f01b80be070 con 0x7f01bc0c8920 2024-09-21T07:25:59.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01b6000640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 0x7f01a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01b6000640 1 -- 172.21.15.64:0/1458163307 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f01b812e100 con 0x7f01bc0c8920 2024-09-21T07:25:59.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 Processor -- start 2024-09-21T07:25:59.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c1e00640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 0x7f01a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 -- start start 2024-09-21T07:25:59.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c1e00640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 0x7f01a0075710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000f70 tx=0x7f01b00079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2305a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a230ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a51a042db0 con 0x55a519ddfe60 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a51a0321e0 con 0x55a51a0b7b70 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a51a035ff0 con 0x55a51a0bee70 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37932/0 (socket says 172.21.15.64:37932) 2024-09-21T07:25:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 -- 172.21.15.64:0/392264164 learned_addr learned my addr 172.21.15.64:0/392264164 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c1e00640 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c1400640 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a230ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 -- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 msgr2=0x55a51a2305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 -- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 msgr2=0x55a51a230ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a230ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 -- 172.21.15.64:0/392264164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a519fe54e0 con 0x55a519ddfe60 2024-09-21T07:25:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01c2800640 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f01b801d080 tx=0x7f01b80f82f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a2208d1586f145 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01aa600640 1 -- 172.21.15.64:0/392264164 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80f90a0 con 0x55a519ddfe60 2024-09-21T07:25:59.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01aa600640 1 -- 172.21.15.64:0/392264164 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b81022a0 con 0x55a519ddfe60 2024-09-21T07:25:59.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.877+0000 7f01aa600640 1 -- 172.21.15.64:0/392264164 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80f4c10 con 0x55a519ddfe60 2024-09-21T07:25:59.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- 172.21.15.64:0/392264164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 msgr2=0x55a51a231020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f01b801d080 tx=0x7f01b80f82f0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- 172.21.15.64:0/392264164 shutdown_connections 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a231020 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a230ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/392264164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- 172.21.15.64:0/392264164 >> 172.21.15.64:0/392264164 conn(0x55a51a0eec30 msgr2=0x55a51a1e5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- 172.21.15.64:0/392264164 shutdown_connections 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- 172.21.15.64:0/392264164 wait complete. 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- start start 2024-09-21T07:25:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 Processor -- start 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a519ddfe60 0x55a51a236a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a519fd62b0 con 0x55a51a0b7b70 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a519ffbcc0 con 0x55a519ddfe60 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a51a041b80 con 0x55a51a0bee70 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01cbf2f000 10 client.0 _ll_register_callbacks cb 0x55a51a1d2500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01c1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01c1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37934/0 (socket says 172.21.15.64:37934) 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01c1400640 1 -- 172.21.15.64:0/2052966479 learned_addr learned my addr 172.21.15.64:0/2052966479 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01c2800640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.881+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a519ddfe60 0x55a51a236a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 -- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 msgr2=0x55a51a2374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 -- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a519ddfe60 msgr2=0x55a51a236a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a519ddfe60 0x55a51a236a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 -- 172.21.15.64:0/2052966479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a519fb2b00 con 0x55a51a0b7b70 2024-09-21T07:25:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1400640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f01ac001da0 tx=0x7f01ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2ef30361f07ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac014480 con 0x55a51a0b7b70 2024-09-21T07:25:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f01ac014620 con 0x55a51a0b7b70 2024-09-21T07:25:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a519fca550 con 0x55a51a0b7b70 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01ac021050 con 0x55a51a0b7b70 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 10 client.5718 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55a519fee120 con 0x55a51a0b7b70 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a519fca550 con 0x55a51a0b7b70 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f01ac024020 con 0x55a51a0b7b70 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 10 client.5718 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 10 client.5718 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 20 client.5718 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cd4cf0 0x55a51a240e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 4 client.5718 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a51a044d00 con 0x55a519cd4cf0 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cd4cf0 0x55a51a240e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cd4cf0 0x55a51a240e00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ce0d68206edca9 server_cookie=1201b0d891fc3c34 in_seq=0 out_seq=0 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 10 client.5718 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 1 -- 172.21.15.64:0/2052966479 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a51a044d00 con 0x55a519cd4cf0 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 10 client.5718 handle_command_reply: tid=0 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 client.5718 shutdown 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 msgr2=0x55a51a236f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f01ac001da0 tx=0x7f01ac00e530 comp rx=0 tx=0).stop 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 shutdown_connections 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cd4cf0 0x55a51a240e00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a2374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a51a0b7b70 0x55a51a236f60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f019ea00640 0 client.5718 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2052966479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a519ddfe60 0x55a51a236a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 >> 172.21.15.64:0/2052966479 conn(0x55a51a0eec30 msgr2=0x55a51a1e6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 shutdown_connections 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2052966479 wait complete. 2024-09-21T07:25:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.885+0000 7f01cbf2f000 20 client.5718 trim_cache size 0 max 16384 2024-09-21T07:25:59.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.901+0000 7f01cbf2f000 1 Processor -- start 2024-09-21T07:25:59.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.901+0000 7f01cbf2f000 1 -- start start 2024-09-21T07:25:59.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a1ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a1e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc204ed0 con 0x55a519ddfe60 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc204230 con 0x55a51a0b7b70 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc204880 con 0x55a51a0bee70 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37948/0 (socket says 172.21.15.64:37948) 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 -- 172.21.15.64:0/3336291836 learned_addr learned my addr 172.21.15.64:0/3336291836 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1400640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a1ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 -- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 msgr2=0x55a51a1e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c2800640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a1e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a1e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 -- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 msgr2=0x55a51a1ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a1ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 -- 172.21.15.64:0/3336291836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a519fd0410 con 0x55a519ddfe60 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1400640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a1ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01c1e00640 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f01b0014d60 tx=0x7f01b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48067f5625373ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01a9c00640 1 -- 172.21.15.64:0/3336291836 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b002f070 con 0x55a519ddfe60 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01a9c00640 1 -- 172.21.15.64:0/3336291836 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b0014e50 con 0x55a519ddfe60 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01a9c00640 1 -- 172.21.15.64:0/3336291836 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0003a80 con 0x55a519ddfe60 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- 172.21.15.64:0/3336291836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 msgr2=0x55a51a1ec9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f01b0014d60 tx=0x7f01b0012000 comp rx=0 tx=0).stop 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- 172.21.15.64:0/3336291836 shutdown_connections 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0bee70 0x55a51a1e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0b7b70 0x55a51a1ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/3336291836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a1ec9f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- 172.21.15.64:0/3336291836 >> 172.21.15.64:0/3336291836 conn(0x55a51a0eec30 msgr2=0x55a51a1e9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- 172.21.15.64:0/3336291836 shutdown_connections 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- 172.21.15.64:0/3336291836 wait complete. 2024-09-21T07:25:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.905+0000 7f01cbf2f000 1 -- start start 2024-09-21T07:25:59.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 Processor -- start 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0b7b70 0x55a51a2a7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 0x55a51a2a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a519ffe290 con 0x55a519ddfe60 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a519ff19a0 con 0x55a51a0bee70 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a51a035300 con 0x55a51a0b7b70 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 10 client.0 _ll_register_callbacks cb 0x7f01ac007d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37964/0 (socket says 172.21.15.64:37964) 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 -- 172.21.15.64:0/2456306891 learned_addr learned my addr 172.21.15.64:0/2456306891 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c2800640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 0x55a51a2a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1400640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0b7b70 0x55a51a2a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 -- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0b7b70 msgr2=0x55a51a2a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0b7b70 0x55a51a2a7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 -- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 msgr2=0x55a51a2a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 0x55a51a2a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 -- 172.21.15.64:0/2456306891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a51a08f090 con 0x55a519ddfe60 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c2800640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 0x55a51a2a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1e00640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f01b0005630 tx=0x7f01b0004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3a7332e5d928df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0038060 con 0x55a519ddfe60 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f01b0004c30 con 0x55a519ddfe60 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01b0014e50 con 0x55a519ddfe60 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01b003e050 con 0x55a519ddfe60 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 10 client.5724 fetch_fsmap learned FSMap version 26 2024-09-21T07:25:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55a519fc87d0 con 0x55a519ddfe60 2024-09-21T07:25:59.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b0014e50 con 0x55a519ddfe60 2024-09-21T07:25:59.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f01b0041020 con 0x55a519ddfe60 2024-09-21T07:25:59.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 10 client.5724 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:25:59.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 10 client.5724 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 20 client.5724 populate_metadata read hostname 'smithi064' 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cc2d50 0x55a51a262940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 4 client.5724 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55a51a0407b0 con 0x55a519cc2d50 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.909+0000 7f01c1400640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cc2d50 0x55a51a262940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.913+0000 7f01c1400640 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cc2d50 0x55a51a262940 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c6f39504285325 server_cookie=2167d19ac8454bb9 in_seq=0 out_seq=0 2024-09-21T07:25:59.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.913+0000 7f019ea00640 10 client.5724 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f019ea00640 1 -- 172.21.15.64:0/2456306891 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a51a0407b0 con 0x55a519cc2d50 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f019ea00640 10 client.5724 handle_command_reply: tid=0 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 client.5724 shutdown 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 msgr2=0x55a51a2a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f01b0005630 tx=0x7f01b0004840 comp rx=0 tx=0).stop 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 shutdown_connections 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a519cc2d50 0x55a51a262940 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a51a0bee70 0x55a51a2a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a51a0b7b70 0x55a51a2a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 --2- 172.21.15.64:0/2456306891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a519ddfe60 0x55a51a2a6d20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f019ea00640 0 client.5724 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:25:59.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 >> 172.21.15.64:0/2456306891 conn(0x55a51a0eec30 msgr2=0x55a51a1e9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 shutdown_connections 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 1 -- 172.21.15.64:0/2456306891 wait complete. 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01cbf2f000 20 client.5724 trim_cache size 0 max 16384 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:25:59.923 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 msgr2=0x7f01a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 0x7f01a0075710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000f70 tx=0x7f01b00079c0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 msgr2=0x7f01bc073fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009b10 tx=0x7f01b80a5ae0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 shutdown_connections 2024-09-21T07:25:59.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01a0073200 0x7f01a0075710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01bc0c8920 0x7f01bc073fb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01bc0cdd30 0x7f01bc073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 --2- 172.21.15.64:0/1458163307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01bc0b40d0 0x7f01bc156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 >> 172.21.15.64:0/1458163307 conn(0x7f01bc0ccbe0 msgr2=0x7f01bc157ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 shutdown_connections 2024-09-21T07:25:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:25:59.917+0000 7f01c4800640 1 -- 172.21.15.64:0/1458163307 wait complete. 2024-09-21T07:25:59.942 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-21T07:25:59.942 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:26:00.008 INFO:teuthology.orchestra.run.smithi064.stdout:1099511630408 2024-09-21T07:26:00.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:00.018 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-21T07:26:00.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 -- 172.21.15.64:0/1661774763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff14c005920 msgr2=0x7ff14c005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 --2- 172.21.15.64:0/1661774763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff14c005920 0x7ff14c005d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c3c0 tx=0x7ff15001ce80 comp rx=0 tx=0).stop 2024-09-21T07:26:00.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff167e00640 1 -- 172.21.15.64:0/1661774763 reap_dead start 2024-09-21T07:26:00.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 -- 172.21.15.64:0/1661774763 shutdown_connections 2024-09-21T07:26:00.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 -- 172.21.15.64:0/1661774763 >> 172.21.15.64:0/1661774763 conn(0x7ff1680ccbe0 msgr2=0x7ff1680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 -- 172.21.15.64:0/1661774763 shutdown_connections 2024-09-21T07:26:00.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.217+0000 7ff16e800640 1 -- 172.21.15.64:0/1661774763 wait complete. 2024-09-21T07:26:00.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 Processor -- start 2024-09-21T07:26:00.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- start start 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff14c005920 0x7ff1681441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff168144720 0x7ff1681e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680b1dd0 con 0x7ff1681e7980 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680b1c50 con 0x7ff14c005920 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff1680b1f50 con 0x7ff168144720 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37990/0 (socket says 172.21.15.64:37990) 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 -- 172.21.15.64:0/3556526618 learned_addr learned my addr 172.21.15.64:0/3556526618 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff15ea00640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff168144720 0x7ff1681e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167400640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff14c005920 0x7ff1681441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 -- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff168144720 msgr2=0x7ff1681e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff168144720 0x7ff1681e7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 -- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff14c005920 msgr2=0x7ff1681441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff14c005920 0x7ff1681441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 -- 172.21.15.64:0/3556526618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1681e9250 con 0x7ff1681e7980 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff167e00640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff1680b5180 tx=0x7ff16000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff15fe00640 1 -- 172.21.15.64:0/3556526618 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160003d90 con 0x7ff1681e7980 2024-09-21T07:26:00.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff15fe00640 1 -- 172.21.15.64:0/3556526618 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff160004030 con 0x7ff1681e7980 2024-09-21T07:26:00.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff15fe00640 1 -- 172.21.15.64:0/3556526618 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160004440 con 0x7ff1681e7980 2024-09-21T07:26:00.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1681e81b0 con 0x7ff1681e7980 2024-09-21T07:26:00.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.221+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1681e8770 con 0x7ff1681e7980 2024-09-21T07:26:00.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.225+0000 7ff15fe00640 1 -- 172.21.15.64:0/3556526618 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1600045e0 con 0x7ff1681e7980 2024-09-21T07:26:00.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.225+0000 7ff15fe00640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 0x7ff144075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.225+0000 7ff15fe00640 1 -- 172.21.15.64:0/3556526618 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7ff160095440 con 0x7ff1681e7980 2024-09-21T07:26:00.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.225+0000 7ff175d5d000 1 Processor -- start 2024-09-21T07:26:00.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.225+0000 7ff167400640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 0x7ff144075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- start start 2024-09-21T07:26:00.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff167400640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 0x7ff144075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff158006fd0 tx=0x7ff158006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a4726320 0x5615a489cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a489d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5615a4736d50 con 0x5615a471f5a0 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5615a46aab10 con 0x5615a4726320 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5615a4699f40 con 0x5615a471fdb0 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38000/0 (socket says 172.21.15.64:38000) 2024-09-21T07:26:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 -- 172.21.15.64:0/1972025835 learned_addr learned my addr 172.21.15.64:0/1972025835 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff167400640 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a4726320 0x5615a489cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff167e00640 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a489d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 -- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 msgr2=0x5615a489d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a489d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 -- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a4726320 msgr2=0x5615a489cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a4726320 0x5615a489cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 -- 172.21.15.64:0/1972025835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a461b120 con 0x5615a471f5a0 2024-09-21T07:26:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff15ea00640 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c3c0 tx=0x7ff14c006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7541382bc49a813d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff157e00640 1 -- 172.21.15.64:0/1972025835 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500018d0 con 0x5615a471f5a0 2024-09-21T07:26:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff157e00640 1 -- 172.21.15.64:0/1972025835 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff150006090 con 0x5615a471f5a0 2024-09-21T07:26:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff157e00640 1 -- 172.21.15.64:0/1972025835 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150006440 con 0x5615a471f5a0 2024-09-21T07:26:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- 172.21.15.64:0/1972025835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 msgr2=0x5615a489d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c3c0 tx=0x7ff14c006950 comp rx=0 tx=0).stop 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- 172.21.15.64:0/1972025835 shutdown_connections 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a489d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471f5a0 0x5615a489d4a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1972025835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a4726320 0x5615a489cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- 172.21.15.64:0/1972025835 >> 172.21.15.64:0/1972025835 conn(0x5615a4357920 msgr2=0x5615a487be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- 172.21.15.64:0/1972025835 shutdown_connections 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.229+0000 7ff175d5d000 1 -- 172.21.15.64:0/1972025835 wait complete. 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 -- start start 2024-09-21T07:26:00.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 Processor -- start 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a485e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a4726320 0x5615a485f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5615a463f500 con 0x5615a471fdb0 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5615a469dd50 con 0x5615a471f5a0 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5615a435f680 con 0x5615a4726320 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 10 client.0 _ll_register_callbacks cb 0x5615a483a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38012/0 (socket says 172.21.15.64:38012) 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 -- 172.21.15.64:0/2357989887 learned_addr learned my addr 172.21.15.64:0/2357989887 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff167e00640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a4726320 0x5615a485f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff167400640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a485e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 -- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a4726320 msgr2=0x5615a485f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a4726320 0x5615a485f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 -- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 msgr2=0x5615a485e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a485e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 -- 172.21.15.64:0/2357989887 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a464ec60 con 0x5615a471fdb0 2024-09-21T07:26:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff15ea00640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff15001d720 tx=0x7ff150001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258f09160cff8c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff154c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150006290 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615a4632330 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.233+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7ff150006430 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff1500c8050 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 10 client.5736 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5615a4698be0 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5615a4632330 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ff150003600 con 0x5615a471fdb0 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 10 client.5736 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 10 client.5736 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 20 client.5736 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a433c930 0x5615a48ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 4 client.5736 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615a46aca60 con 0x5615a433c930 2024-09-21T07:26:00.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff167400640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a433c930 0x5615a48ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 10 client.5736 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff167400640 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a433c930 0x5615a48ae520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e149dae7ec7b7a server_cookie=d13b7387675122c7 in_seq=0 out_seq=0 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 1 -- 172.21.15.64:0/2357989887 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615a46aca60 con 0x5615a433c930 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 10 client.5736 handle_command_reply: tid=0 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 client.5736 shutdown 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 msgr2=0x5615a485ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff15001d720 tx=0x7ff150001830 comp rx=0 tx=0).stop 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 shutdown_connections 2024-09-21T07:26:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a433c930 0x5615a48ae520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a4726320 0x5615a485f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a471fdb0 0x5615a485ed00 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2357989887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a485e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff154c00640 0 client.5736 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 >> 172.21.15.64:0/2357989887 conn(0x5615a4357920 msgr2=0x5615a484b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 shutdown_connections 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 1 -- 172.21.15.64:0/2357989887 wait complete. 2024-09-21T07:26:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.237+0000 7ff175d5d000 20 client.5736 trim_cache size 0 max 16384 2024-09-21T07:26:00.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 Processor -- start 2024-09-21T07:26:00.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 -- start start 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a484aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a484b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5615a485c890 con 0x5615a4726320 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1681feb90 con 0x5615a471f5a0 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff1681fdc50 con 0x5615a471fdb0 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38026/0 (socket says 172.21.15.64:38026) 2024-09-21T07:26:00.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 -- 172.21.15.64:0/2072719359 learned_addr learned my addr 172.21.15.64:0/2072719359 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167400640 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a484aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff15ea00640 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a484b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 -- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 msgr2=0x5615a484b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a484b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 -- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 msgr2=0x5615a484aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a484aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.253+0000 7ff167e00640 1 -- 172.21.15.64:0/2072719359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a46381f0 con 0x5615a4726320 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff167e00640 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff16005cee0 tx=0x7ff160003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2c9e6039f4fe33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff157400640 1 -- 172.21.15.64:0/2072719359 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16005f780 con 0x5615a4726320 2024-09-21T07:26:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff157400640 1 -- 172.21.15.64:0/2072719359 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff16004d020 con 0x5615a4726320 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff157400640 1 -- 172.21.15.64:0/2072719359 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16005fc70 con 0x5615a4726320 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- 172.21.15.64:0/2072719359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 msgr2=0x5615a48ad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff16005cee0 tx=0x7ff160003f30 comp rx=0 tx=0).stop 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- 172.21.15.64:0/2072719359 shutdown_connections 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48ad520 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a484b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- 172.21.15.64:0/2072719359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a484aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- 172.21.15.64:0/2072719359 >> 172.21.15.64:0/2072719359 conn(0x5615a4357920 msgr2=0x5615a484a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- 172.21.15.64:0/2072719359 shutdown_connections 2024-09-21T07:26:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- 172.21.15.64:0/2072719359 wait complete. 2024-09-21T07:26:00.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- start start 2024-09-21T07:26:00.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 Processor -- start 2024-09-21T07:26:00.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a48b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a48b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5615a465c6b0 con 0x5615a4726320 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5615a475a010 con 0x5615a471f5a0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5615a46a2380 con 0x5615a471fdb0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.257+0000 7ff175d5d000 10 client.0 _ll_register_callbacks cb 0x7ff14c0049a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38032/0 (socket says 172.21.15.64:38032) 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 -- 172.21.15.64:0/1595575869 learned_addr learned my addr 172.21.15.64:0/1595575869 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167400640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a48b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff15ea00640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a48b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 -- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 msgr2=0x5615a48b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a48b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 -- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 msgr2=0x5615a48b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a48b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 -- 172.21.15.64:0/1595575869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a4660990 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167e00640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff16005cee0 tx=0x7ff16004d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9759df6f3d530b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160095240 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7ff1600690c0 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff16004d020 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff1600646a0 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 10 client.5742 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5615a4630580 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff16004d020 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ff160075ce0 con 0x5615a4726320 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 10 client.5742 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 10 client.5742 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 20 client.5742 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a432a990 0x5615a48cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 4 client.5742 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:26:00.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615a46a8510 con 0x5615a432a990 2024-09-21T07:26:00.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167400640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a432a990 0x5615a48cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff167400640 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a432a990 0x5615a48cf3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd6031eaf763294 server_cookie=f48fac4536b32996 in_seq=0 out_seq=0 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 10 client.5742 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 1 -- 172.21.15.64:0/1595575869 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615a46a8510 con 0x5615a432a990 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 10 client.5742 handle_command_reply: tid=0 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 client.5742 shutdown 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 msgr2=0x5615a48cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff16005cee0 tx=0x7ff16004d400 comp rx=0 tx=0).stop 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 shutdown_connections 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5615a432a990 0x5615a48cf3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615a4726320 0x5615a48cea40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5615a471fdb0 0x5615a48b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 --2- 172.21.15.64:0/1595575869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5615a471f5a0 0x5615a48b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff154c00640 0 client.5742 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 >> 172.21.15.64:0/1595575869 conn(0x5615a4357920 msgr2=0x5615a484b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 shutdown_connections 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 1 -- 172.21.15.64:0/1595575869 wait complete. 2024-09-21T07:26:00.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff175d5d000 20 client.5742 trim_cache size 0 max 16384 2024-09-21T07:26:00.271 INFO:teuthology.orchestra.run.smithi064.stdout:[] 2024-09-21T07:26:00.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 msgr2=0x7ff144075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 0x7ff144075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff158006fd0 tx=0x7ff158006b20 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 msgr2=0x7ff1681f36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.261+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff1680b5180 tx=0x7ff16000f790 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 shutdown_connections 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff144073200 0x7ff144075710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1681e7980 0x7ff1681f36a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff168144720 0x7ff1681e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 --2- 172.21.15.64:0/3556526618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff14c005920 0x7ff1681441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 >> 172.21.15.64:0/3556526618 conn(0x7ff1680ccbe0 msgr2=0x7ff1680b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 shutdown_connections 2024-09-21T07:26:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.265+0000 7ff16e800640 1 -- 172.21.15.64:0/3556526618 wait complete. 2024-09-21T07:26:00.287 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a48.00000000 parent 2024-09-21T07:26:00.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.341+0000 7fc69d648080 1 Processor -- start 2024-09-21T07:26:00.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.341+0000 7fc69d648080 1 -- start start 2024-09-21T07:26:00.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56d470 0x55a9ed4b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56db70 0x55a9ed585e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a9ed402a00 con 0x7fc67c003100 2024-09-21T07:26:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a9ed460f40 con 0x55a9ed56d470 2024-09-21T07:26:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a9ed4e3300 con 0x55a9ed56db70 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38046/0 (socket says 172.21.15.64:38046) 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 -- 172.21.15.64:0/406332479 learned_addr learned my addr 172.21.15.64:0/406332479 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695200640 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56d470 0x55a9ed4b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc696600640 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56db70 0x55a9ed585e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 -- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56db70 msgr2=0x55a9ed585e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56db70 0x55a9ed585e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 -- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56d470 msgr2=0x55a9ed4b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56d470 0x55a9ed4b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 -- 172.21.15.64:0/406332479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9ed3dbc10 con 0x7fc67c003100 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc695c00640 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc688001410 tx=0x7fc688009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af577030edb24236 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc68f400640 1 -- 172.21.15.64:0/406332479 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688013070 con 0x7fc67c003100 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc68f400640 1 -- 172.21.15.64:0/406332479 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc68800d960 con 0x7fc67c003100 2024-09-21T07:26:00.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc68f400640 1 -- 172.21.15.64:0/406332479 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68800dd50 con 0x7fc67c003100 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- 172.21.15.64:0/406332479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 msgr2=0x55a9ed587e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc688001410 tx=0x7fc688009ad0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- 172.21.15.64:0/406332479 shutdown_connections 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56db70 0x55a9ed585e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56d470 0x55a9ed4b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 --2- 172.21.15.64:0/406332479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed587e40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- 172.21.15.64:0/406332479 >> 172.21.15.64:0/406332479 conn(0x55a9ed4a0d60 msgr2=0x55a9ed4b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- 172.21.15.64:0/406332479 shutdown_connections 2024-09-21T07:26:00.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.345+0000 7fc69d648080 1 -- 172.21.15.64:0/406332479 wait complete. 2024-09-21T07:26:00.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 Processor -- start 2024-09-21T07:26:00.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- start start 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56d470 0x55a9ed4f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56db70 0x55a9ed624f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed625450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a9ed4b2ba0 con 0x7fc67c003100 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a9ed4e0f00 con 0x55a9ed56db70 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a9ed4b3a50 con 0x55a9ed56d470 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed625450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed625450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38054/0 (socket says 172.21.15.64:38054) 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 -- 172.21.15.64:0/2436593065 learned_addr learned my addr 172.21.15.64:0/2436593065 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc695200640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56db70 0x55a9ed624f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc695c00640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56d470 0x55a9ed4f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 -- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56d470 msgr2=0x55a9ed4f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56d470 0x55a9ed4f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 -- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56db70 msgr2=0x55a9ed624f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56db70 0x55a9ed624f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 -- 172.21.15.64:0/2436593065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9ed4f83b0 con 0x7fc67c003100 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc695200640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a9ed56db70 0x55a9ed624f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc695c00640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a9ed56d470 0x55a9ed4f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc696600640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed625450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc690004fd0 tx=0x7fc69000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc68e000640 1 -- 172.21.15.64:0/2436593065 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69000b7d0 con 0x7fc67c003100 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc68e000640 1 -- 172.21.15.64:0/2436593065 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc69000b970 con 0x7fc67c003100 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc68e000640 1 -- 172.21.15.64:0/2436593065 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69000bda0 con 0x7fc67c003100 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9ed4f8650 con 0x7fc67c003100 2024-09-21T07:26:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.349+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9ed4f8b90 con 0x7fc67c003100 2024-09-21T07:26:00.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc68e000640 1 -- 172.21.15.64:0/2436593065 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc690022390 con 0x7fc67c003100 2024-09-21T07:26:00.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc68e000640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc678071be0 0x7fc6780740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc68e000640 1 -- 172.21.15.64:0/2436593065 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fc690094250 con 0x7fc67c003100 2024-09-21T07:26:00.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc69d648080 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x55a9ed584f80 0x55a9ed585390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- osd_op(unknown.0.0:1 8.21 8:87acc59f:::10000000a48.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) -- 0x55a9ed5858d0 con 0x55a9ed584f80 2024-09-21T07:26:00.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc695c00640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc678071be0 0x7fc6780740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc695200640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x55a9ed584f80 0x55a9ed585390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc695c00640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc678071be0 0x7fc6780740f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6880013e0 tx=0x7fc6880092b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.353+0000 7fc695200640 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x55a9ed584f80 0x55a9ed585390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc695200640 1 -- 172.21.15.64:0/2436593065 <== osd.0 v2:172.21.15.64:6816/3519639794 1 ==== osd_op_reply(1 10000000a48.00000000 [rmxattr] v56'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc6840a4bb0 con 0x55a9ed584f80 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x55a9ed584f80 msgr2=0x55a9ed585390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x55a9ed584f80 0x55a9ed585390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc678071be0 msgr2=0x7fc6780740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc678071be0 0x7fc6780740f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6880013e0 tx=0x7fc6880092b0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 msgr2=0x55a9ed625450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 --2- 172.21.15.64:0/2436593065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc67c003100 0x55a9ed625450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc690004fd0 tx=0x7fc69000ea80 comp rx=0 tx=0).stop 2024-09-21T07:26:00.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc696600640 1 -- 172.21.15.64:0/2436593065 reap_dead start 2024-09-21T07:26:00.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 shutdown_connections 2024-09-21T07:26:00.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 >> 172.21.15.64:0/2436593065 conn(0x55a9ed4a0d60 msgr2=0x55a9ed4b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 shutdown_connections 2024-09-21T07:26:00.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.357+0000 7fc69d648080 1 -- 172.21.15.64:0/2436593065 wait complete. 2024-09-21T07:26:00.366 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-21T07:26:00.366 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-21T07:26:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 -- 172.21.15.64:0/2424975183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080cd320 msgr2=0x7f760815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 --2- 172.21.15.64:0/2424975183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080cd320 0x7f760815c7f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7608072190 tx=0x7f75fc01c830 comp rx=0 tx=0).stop 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 -- 172.21.15.64:0/2424975183 shutdown_connections 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 --2- 172.21.15.64:0/2424975183 >> v2:172.21.15.90:3300/0 conn(0x7f76080cecb0 0x7f76080cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 --2- 172.21.15.64:0/2424975183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080cd320 0x7f760815c7f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 -- 172.21.15.64:0/2424975183 >> 172.21.15.64:0/2424975183 conn(0x7f760806d3f0 msgr2=0x7f76080710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 -- 172.21.15.64:0/2424975183 shutdown_connections 2024-09-21T07:26:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.521+0000 7f760fe00640 1 -- 172.21.15.64:0/2424975183 wait complete. 2024-09-21T07:26:00.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 Processor -- start 2024-09-21T07:26:00.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 -- start start 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 0x7f76080c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 0x7f76080cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f760816a450 con 0x7f76080b3d60 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f760816a2d0 con 0x7f76080cecb0 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f760816a5d0 con 0x7f76080cd320 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38078/0 (socket says 172.21.15.64:38078) 2024-09-21T07:26:00.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 -- 172.21.15.64:0/330747096 learned_addr learned my addr 172.21.15.64:0/330747096 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 -- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 msgr2=0x7f76080c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760ca00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 0x7f76080c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760de00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 0x7f76080cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 0x7f76080c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 -- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 msgr2=0x7f76080cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 0x7f76080cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.525+0000 7f760d400640 1 -- 172.21.15.64:0/330747096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76080c76c0 con 0x7f76080b3d60 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f760ca00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 0x7f76080c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f760de00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 0x7f76080cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f760d400640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0b0040 tx=0x7f75fc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f7605600640 1 -- 172.21.15.64:0/330747096 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0044b0 con 0x7f76080b3d60 2024-09-21T07:26:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f7605600640 1 -- 172.21.15.64:0/330747096 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75fc0bd070 con 0x7f76080b3d60 2024-09-21T07:26:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76080c79a0 con 0x7f76080b3d60 2024-09-21T07:26:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f7605600640 1 -- 172.21.15.64:0/330747096 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc005360 con 0x7f76080b3d60 2024-09-21T07:26:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76080c71d0 con 0x7f76080b3d60 2024-09-21T07:26:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.529+0000 7f7605600640 1 -- 172.21.15.64:0/330747096 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f75fc005500 con 0x7f76080b3d60 2024-09-21T07:26:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f7605600640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 0x7f75e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f7605600640 1 -- 172.21.15.64:0/330747096 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f75fc12d010 con 0x7f76080b3d60 2024-09-21T07:26:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f760ca00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 0x7f75e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f760ca00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 0x7f75e8075710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75f4005fd0 tx=0x7f75f4005de0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f7617544000 1 Processor -- start 2024-09-21T07:26:00.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.533+0000 7f7617544000 1 -- start start 2024-09-21T07:26:00.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752813d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108840 0x556d75281e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556d75093a60 con 0x556d75108030 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556d75082e90 con 0x556d7511b720 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556d75086ca0 con 0x556d75108840 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38086/0 (socket says 172.21.15.64:38086) 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 -- 172.21.15.64:0/1353055073 learned_addr learned my addr 172.21.15.64:0/1353055073 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760d400640 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760de00640 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108840 0x556d75281e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 -- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108840 msgr2=0x556d75281e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108840 0x556d75281e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 -- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 msgr2=0x556d752813d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752813d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 -- 172.21.15.64:0/1353055073 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d750283d0 con 0x556d75108030 2024-09-21T07:26:00.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f760ca00640 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75f400eed0 tx=0x7f75f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ac78ab079cb403 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f75f9c00640 1 -- 172.21.15.64:0/1353055073 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f401e640 con 0x556d75108030 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f75f9c00640 1 -- 172.21.15.64:0/1353055073 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75f4023070 con 0x556d75108030 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f75f9c00640 1 -- 172.21.15.64:0/1353055073 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f401eb30 con 0x556d75108030 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- 172.21.15.64:0/1353055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 msgr2=0x556d75281910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75f400eed0 tx=0x7f75f4009f90 comp rx=0 tx=0).stop 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- 172.21.15.64:0/1353055073 shutdown_connections 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108840 0x556d75281e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108030 0x556d75281910 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 --2- 172.21.15.64:0/1353055073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- 172.21.15.64:0/1353055073 >> 172.21.15.64:0/1353055073 conn(0x556d7513f150 msgr2=0x556d752361b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- 172.21.15.64:0/1353055073 shutdown_connections 2024-09-21T07:26:00.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.537+0000 7f7617544000 1 -- 172.21.15.64:0/1353055073 wait complete. 2024-09-21T07:26:00.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 -- start start 2024-09-21T07:26:00.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 Processor -- start 2024-09-21T07:26:00.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752435f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 0x556d75243b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556d75028180 con 0x556d7511b720 2024-09-21T07:26:00.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556d7508b2d0 con 0x556d75108840 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556d7502e140 con 0x556d75108030 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 10 client.0 _ll_register_callbacks cb 0x556d75223120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38102/0 (socket says 172.21.15.64:38102) 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 -- 172.21.15.64:0/1725105180 learned_addr learned my addr 172.21.15.64:0/1725105180 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760ca00640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 0x556d75243b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760d400640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 -- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 msgr2=0x556d752435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 -- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 msgr2=0x556d75243b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 0x556d75243b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 -- 172.21.15.64:0/1725105180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d75021140 con 0x556d7511b720 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760ca00640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 0x556d75243b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760d400640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f760de00640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f76000105e0 tx=0x7f7600010aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fa4042d13aa1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f75ee000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600006d70 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7600003980 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d75062e10 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7600003b80 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.541+0000 7f7617544000 10 client.5766 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x556d750400b0 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556d75062e10 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f76000050d0 con 0x556d7511b720 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 10 client.5766 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 10 client.5766 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 20 client.5766 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d25d10 0x556d75292990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 4 client.5766 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d750959b0 con 0x556d74d25d10 2024-09-21T07:26:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f760d400640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d25d10 0x556d75292990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f760d400640 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d25d10 0x556d75292990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2152e52b0d75563 server_cookie=97f3206fd5e317c8 in_seq=0 out_seq=0 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 10 client.5766 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 1 -- 172.21.15.64:0/1725105180 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d750959b0 con 0x556d74d25d10 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 10 client.5766 handle_command_reply: tid=0 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 client.5766 shutdown 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 msgr2=0x556d75244070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f76000105e0 tx=0x7f7600010aa0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 shutdown_connections 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d25d10 0x556d75292990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d7511b720 0x556d75244070 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108840 0x556d75243b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 --2- 172.21.15.64:0/1725105180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f75ee000640 0 client.5766 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 >> 172.21.15.64:0/1725105180 conn(0x556d7513f150 msgr2=0x556d75236940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 shutdown_connections 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 1 -- 172.21.15.64:0/1725105180 wait complete. 2024-09-21T07:26:00.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.545+0000 7f7617544000 20 client.5766 trim_cache size 0 max 16384 2024-09-21T07:26:00.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 Processor -- start 2024-09-21T07:26:00.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 -- start start 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108030 0x556d752f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 0x556d752f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7608205240 con 0x556d75108840 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76082045a0 con 0x556d75108030 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7608204bf0 con 0x556d7511b720 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38110/0 (socket says 172.21.15.64:38110) 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 -- 172.21.15.64:0/1665902453 learned_addr learned my addr 172.21.15.64:0/1665902453 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760de00640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 0x556d752f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760d400640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108030 0x556d752f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 -- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 msgr2=0x556d752f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 0x556d752f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 -- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108030 msgr2=0x556d752f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108030 0x556d752f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 -- 172.21.15.64:0/1665902453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7523dcc0 con 0x556d75108840 2024-09-21T07:26:00.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760de00640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 0x556d752f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f760ca00640 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f75f4013040 tx=0x7f75f40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc369b24592f544d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f75f9200640 1 -- 172.21.15.64:0/1665902453 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f401e9d0 con 0x556d75108840 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f75f9200640 1 -- 172.21.15.64:0/1665902453 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75f4023040 con 0x556d75108840 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.565+0000 7f75f9200640 1 -- 172.21.15.64:0/1665902453 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4033480 con 0x556d75108840 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- 172.21.15.64:0/1665902453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 msgr2=0x556d752f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f75f4013040 tx=0x7f75f40046d0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- 172.21.15.64:0/1665902453 shutdown_connections 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d7511b720 0x556d752f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f3030 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- 172.21.15.64:0/1665902453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d75108030 0x556d752f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- 172.21.15.64:0/1665902453 >> 172.21.15.64:0/1665902453 conn(0x556d7513f150 msgr2=0x556d752357f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- 172.21.15.64:0/1665902453 shutdown_connections 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- 172.21.15.64:0/1665902453 wait complete. 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- start start 2024-09-21T07:26:00.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 Processor -- start 2024-09-21T07:26:00.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752f7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556d75046160 con 0x556d75108840 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556d75092830 con 0x556d7511b720 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556d750426e0 con 0x556d75108030 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f7617544000 10 client.0 _ll_register_callbacks cb 0x7f7600001980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f760ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38116/0 (socket says 172.21.15.64:38116) 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f760ca00640 1 -- 172.21.15.64:0/1025950081 learned_addr learned my addr 172.21.15.64:0/1025950081 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f760d400640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.569+0000 7f760de00640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 -- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 msgr2=0x556d752f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 -- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 msgr2=0x556d752f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 -- 172.21.15.64:0/1025950081 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556d750081a0 con 0x556d75108030 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760ca00640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760d400640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752f6cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f75fc098210 tx=0x7f75fc01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd7d9fe34f2afbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:26:00.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0f9490 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f75fc102ba0 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75f4023040 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f75fc108050 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 10 client.5369 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x556d750dfef0 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75f4023040 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f75fc10b020 con 0x556d75108030 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 10 client.5369 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 10 client.5369 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 20 client.5369 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d13d70 0x556d752b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 4 client.5369 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x556d75091460 con 0x556d74d13d70 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760ca00640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d13d70 0x556d752b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f760ca00640 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d13d70 0x556d752b2340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa2574d979c43c7 server_cookie=5c44ff04fa72abb0 in_seq=0 out_seq=0 2024-09-21T07:26:00.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 10 client.5369 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 1 -- 172.21.15.64:0/1025950081 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556d75091460 con 0x556d74d13d70 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 10 client.5369 handle_command_reply: tid=0 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 client.5369 shutdown 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 msgr2=0x556d752f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752f6cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f75fc098210 tx=0x7f75fc01c830 comp rx=0 tx=0).stop 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 shutdown_connections 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x556d74d13d70 0x556d752b2340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d7511b720 0x556d752f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d75108840 0x556d752f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 --2- 172.21.15.64:0/1025950081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556d75108030 0x556d752f6cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f75ee000640 0 client.5369 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 >> 172.21.15.64:0/1025950081 conn(0x556d7513f150 msgr2=0x556d75291110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 shutdown_connections 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 1 -- 172.21.15.64:0/1025950081 wait complete. 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.573+0000 7f7617544000 20 client.5369 trim_cache size 0 max 16384 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "b81e3d10-66ff-4d8a-9a88-8293f34f326b", 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:00.582 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:00.583 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:26:00.577+0000 7fe8cd600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a48 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v424 pv426 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-21T07:25:59.657300+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5491=0-4194304@1} caps={5491=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5491 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x559f05d9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a48:[<0x10000000001/new_file_0 v424>,<0x10000000000/ceph-qa-suite v42>,<0x1/scrub_test_path v12>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 msgr2=0x7f75e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 0x7f75e8075710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75f4005fd0 tx=0x7f75f4005de0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 msgr2=0x7f760814e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0b0040 tx=0x7f75fc0040c0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 shutdown_connections 2024-09-21T07:26:00.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75e8073200 0x7f75e8075710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76080cecb0 0x7f76080cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76080cd320 0x7f76080c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 --2- 172.21.15.64:0/330747096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76080b3d60 0x7f760814e830 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 >> 172.21.15.64:0/330747096 conn(0x7f760806d3f0 msgr2=0x7f76080b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 shutdown_connections 2024-09-21T07:26:00.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.577+0000 7f760fe00640 1 -- 172.21.15.64:0/330747096 wait complete. 2024-09-21T07:26:00.600 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'b81e3d10-66ff-4d8a-9a88-8293f34f326b', 'mode': 'asynchronous'}' 2024-09-21T07:26:00.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:26:00.600 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- 172.21.15.64:0/4123175170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa006d500 msgr2=0x7fafa015ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 --2- 172.21.15.64:0/4123175170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa006d500 0x7fafa015ef50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faf98009bc0 tx=0x7faf9801cba0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- 172.21.15.64:0/4123175170 shutdown_connections 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 --2- 172.21.15.64:0/4123175170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa006d500 0x7fafa015ef50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 --2- 172.21.15.64:0/4123175170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa015c580 0x7fafa0162f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- 172.21.15.64:0/4123175170 >> 172.21.15.64:0/4123175170 conn(0x7fafa00cdcf0 msgr2=0x7fafa00ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- 172.21.15.64:0/4123175170 shutdown_connections 2024-09-21T07:26:00.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- 172.21.15.64:0/4123175170 wait complete. 2024-09-21T07:26:00.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 Processor -- start 2024-09-21T07:26:00.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.757+0000 7fafa8000640 1 -- start start 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 0x7fafa014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 0x7fafa014a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fafa016c190 con 0x7fafa0074400 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafa016c010 con 0x7fafa015c580 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fafa016c310 con 0x7fafa0149db0 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38130/0 (socket says 172.21.15.64:38130) 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 -- 172.21.15.64:0/3757169365 learned_addr learned my addr 172.21.15.64:0/3757169365 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 -- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 msgr2=0x7fafa014a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa6000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 0x7fafa014a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 0x7fafa014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 0x7fafa014a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 -- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 msgr2=0x7fafa014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 0x7fafa014b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 -- 172.21.15.64:0/3757169365 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa00cfc30 con 0x7fafa0074400 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa6000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 0x7fafa014a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 0x7fafa014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa5600640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faf9400e9f0 tx=0x7faf9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7faf9d600640 1 -- 172.21.15.64:0/3757169365 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9400ccc0 con 0x7fafa0074400 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7faf9d600640 1 -- 172.21.15.64:0/3757169365 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf94010430 con 0x7fafa0074400 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7faf9d600640 1 -- 172.21.15.64:0/3757169365 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94010880 con 0x7fafa0074400 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa01f9b90 con 0x7fafa0074400 2024-09-21T07:26:00.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.761+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa014a8b0 con 0x7fafa0074400 2024-09-21T07:26:00.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7faf9d600640 1 -- 172.21.15.64:0/3757169365 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faf94010a20 con 0x7fafa0074400 2024-09-21T07:26:00.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7faf9d600640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 0x7faf80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7faf9d600640 1 -- 172.21.15.64:0/3757169365 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7faf94094fe0 con 0x7fafa0074400 2024-09-21T07:26:00.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 0x7faf80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 Processor -- start 2024-09-21T07:26:00.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 -- start start 2024-09-21T07:26:00.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 0x7faf80075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001230 tx=0x7faf8c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654fe9af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe9b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55654fd39cd0 con 0x55654fd2e6d0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55654fc4f330 con 0x55654f985890 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55654fcacbb0 con 0x55654fa49aa0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38136/0 (socket says 172.21.15.64:38136) 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa5600640 1 -- 172.21.15.64:0/1050807416 learned_addr learned my addr 172.21.15.64:0/1050807416 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.765+0000 7fafa4c00640 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654fe9af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa6000640 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe9b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 -- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 msgr2=0x55654fe9b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe9b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 -- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 msgr2=0x55654fe9af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654fe9af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 -- 172.21.15.64:0/1050807416 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654fc50c80 con 0x55654fd2e6d0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafa5600640 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c6a0 tx=0x7faf9405f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e697a8c6c3381b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7faf91c00640 1 -- 172.21.15.64:0/1050807416 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9405f710 con 0x55654fd2e6d0 2024-09-21T07:26:00.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7faf91c00640 1 -- 172.21.15.64:0/1050807416 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf940641f0 con 0x55654fd2e6d0 2024-09-21T07:26:00.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7faf91c00640 1 -- 172.21.15.64:0/1050807416 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94069130 con 0x55654fd2e6d0 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1050807416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 msgr2=0x55654fe9a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c6a0 tx=0x7faf9405f190 comp rx=0 tx=0).stop 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1050807416 shutdown_connections 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe9b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654fe9af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1050807416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654fe9a9f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1050807416 >> 172.21.15.64:0/1050807416 conn(0x55654f9595c0 msgr2=0x55654fe57ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1050807416 shutdown_connections 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1050807416 wait complete. 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 -- start start 2024-09-21T07:26:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.769+0000 7fafaf6e9000 1 Processor -- start 2024-09-21T07:26:00.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe56f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 0x55654fe5d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55654fc9fdf0 con 0x55654f985890 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55654fc9bfe0 con 0x55654fd2e6d0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55654fc414d0 con 0x55654fa49aa0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 10 client.0 _ll_register_callbacks cb 0x55654fc1f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38140/0 (socket says 172.21.15.64:38140) 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 -- 172.21.15.64:0/1284148808 learned_addr learned my addr 172.21.15.64:0/1284148808 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa4c00640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe56f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa6000640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 0x55654fe5d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 -- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 msgr2=0x55654fe56f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe56f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 -- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 msgr2=0x55654fe5d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 0x55654fe5d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 -- 172.21.15.64:0/1284148808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654fc3a210 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa6000640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 0x55654fe5d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa5600640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faf9405f3c0 tx=0x7faf9405fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426f292416309b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94069130 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7faf9405b060 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55654fc34350 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf9406f050 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 10 client.5787 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55654fc20fc0 con 0x55654f985890 2024-09-21T07:26:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55654fc34350 con 0x55654f985890 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7faf94072020 con 0x55654f985890 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 10 client.5787 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 10 client.5787 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 20 client.5787 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f93e930 0x55654fea1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 4 client.5787 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55654fcaeb00 con 0x55654f93e930 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa4c00640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f93e930 0x55654fea1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafa4c00640 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f93e930 0x55654fea1e80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3af218ccece4362 server_cookie=c58e076c48ddc459 in_seq=0 out_seq=0 2024-09-21T07:26:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 10 client.5787 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 1 -- 172.21.15.64:0/1284148808 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55654fcaeb00 con 0x55654f93e930 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7faf86000640 10 client.5787 handle_command_reply: tid=0 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.773+0000 7fafaf6e9000 1 client.5787 shutdown 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 msgr2=0x55654fe56a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faf9405f3c0 tx=0x7faf9405fed0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 shutdown_connections 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f93e930 0x55654fea1e80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654fd2e6d0 0x55654fe5d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654fe56f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1284148808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654f985890 0x55654fe56a00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7faf86000640 0 client.5787 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 >> 172.21.15.64:0/1284148808 conn(0x55654f9595c0 msgr2=0x55654fe4fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 shutdown_connections 2024-09-21T07:26:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1284148808 wait complete. 2024-09-21T07:26:00.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.777+0000 7fafaf6e9000 20 client.5787 trim_cache size 0 max 16384 2024-09-21T07:26:00.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.793+0000 7fafaf6e9000 1 Processor -- start 2024-09-21T07:26:00.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.793+0000 7fafaf6e9000 1 -- start start 2024-09-21T07:26:00.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff0bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 0x55654ff0c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55654fe55b20 con 0x55654fa49aa0 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0205af0 con 0x55654f985890 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fafa0204b50 con 0x55654fd2e6d0 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38148/0 (socket says 172.21.15.64:38148) 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 -- 172.21.15.64:0/3180698229 learned_addr learned my addr 172.21.15.64:0/3180698229 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa6000640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 0x55654ff0c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa5600640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff0bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 -- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 msgr2=0x55654ff0c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 0x55654ff0c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 -- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 msgr2=0x55654ff0bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff0bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 -- 172.21.15.64:0/3180698229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654fcf9680 con 0x55654fa49aa0 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa6000640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 0x55654ff0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafa4c00640 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001eb0 tx=0x7faf8c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732e336b6fac9df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7faf91200640 1 -- 172.21.15.64:0/3180698229 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c005020 con 0x55654fa49aa0 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7faf91200640 1 -- 172.21.15.64:0/3180698229 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf8c0051c0 con 0x55654fa49aa0 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7faf91200640 1 -- 172.21.15.64:0/3180698229 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c005430 con 0x55654fa49aa0 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- 172.21.15.64:0/3180698229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 msgr2=0x55654ff0c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001eb0 tx=0x7faf8c013000 comp rx=0 tx=0).stop 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- 172.21.15.64:0/3180698229 shutdown_connections 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fd2e6d0 0x55654ff0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fa49aa0 0x55654ff0c310 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/3180698229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff0bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- 172.21.15.64:0/3180698229 >> 172.21.15.64:0/3180698229 conn(0x55654f9595c0 msgr2=0x55654feacfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- 172.21.15.64:0/3180698229 shutdown_connections 2024-09-21T07:26:00.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- 172.21.15.64:0/3180698229 wait complete. 2024-09-21T07:26:00.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 -- start start 2024-09-21T07:26:00.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.797+0000 7fafaf6e9000 1 Processor -- start 2024-09-21T07:26:00.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff10020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654ff10560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0204560 con 0x55654fd2e6d0 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0161270 con 0x55654f985890 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55654f961680 con 0x55654fa49aa0 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 10 client.0 _ll_register_callbacks cb 0x7faf94064050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38162/0 (socket says 172.21.15.64:38162) 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 -- 172.21.15.64:0/1802768132 learned_addr learned my addr 172.21.15.64:0/1802768132 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff10020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa4c00640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654ff10560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 -- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 msgr2=0x55654ff10560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654ff10560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 -- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 msgr2=0x55654ff10020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff10020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 -- 172.21.15.64:0/1802768132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654fc660b0 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa6000640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faf98009bc0 tx=0x7faf98009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd45636fd7f701f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf980be070 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7faf980a5d60 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf8c0051c0 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf980ca050 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 10 client.5793 fetch_fsmap learned FSMap version 26 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55654fc32610 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf8c0051c0 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7faf980cd020 con 0x55654fd2e6d0 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 10 client.5793 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T07:26:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 10 client.5793 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 20 client.5793 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f92c990 0x55654fe51b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 4 client.5793 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55654fcaa5b0 con 0x55654f92c990 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.801+0000 7fafa5600640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f92c990 0x55654fe51b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa5600640 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f92c990 0x55654fe51b60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd8a62549a64a17 server_cookie=29713c31ec89aa43 in_seq=0 out_seq=0 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7faf86000640 10 client.5793 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7faf86000640 1 -- 172.21.15.64:0/1802768132 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2212 (crc 0 0 0) 0x55654fcaa5b0 con 0x55654f92c990 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7faf86000640 10 client.5793 handle_command_reply: tid=0 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 client.5793 shutdown 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 msgr2=0x55654ff10aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faf98009bc0 tx=0x7faf98009200 comp rx=0 tx=0).stop 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 shutdown_connections 2024-09-21T07:26:00.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55654f92c990 0x55654fe51b60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55654fd2e6d0 0x55654ff10aa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55654fa49aa0 0x55654ff10560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 --2- 172.21.15.64:0/1802768132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55654f985890 0x55654ff10020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7faf86000640 0 client.5793 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 >> 172.21.15.64:0/1802768132 conn(0x55654f9595c0 msgr2=0x55654fe5c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 shutdown_connections 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 1 -- 172.21.15.64:0/1802768132 wait complete. 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafaf6e9000 20 client.5793 trim_cache size 0 max 16384 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "1e7b96c9-870a-401f-a0b0-a05420a615dc": { 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "1e7b96c9-870a-401f-a0b0-a05420a615dc", 2024-09-21T07:26:00.812 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1": { 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "b81e3d10-66ff-4d8a-9a88-8293f34f326b": { 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "b81e3d10-66ff-4d8a-9a88-8293f34f326b", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7": { 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7", 2024-09-21T07:26:00.813 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "b81e3d10-66ff-4d8a-9a88-8293f34f326b": { 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:00.573287+0000", 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1": { 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:59.281306+0000", 2024-09-21T07:26:00.814 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "1e7b96c9-870a-401f-a0b0-a05420a615dc": { 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.817313+0000", 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7": { 2024-09-21T07:26:00.815 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.353320+0000", 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:00.816 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 msgr2=0x7faf80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 0x7faf80075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001230 tx=0x7faf8c009040 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 msgr2=0x7fafa01f9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faf9400e9f0 tx=0x7faf9400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 shutdown_connections 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf80073200 0x7faf80075710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafa0149db0 0x7fafa014a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafa015c580 0x7fafa014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 --2- 172.21.15.64:0/3757169365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafa0074400 0x7fafa01f9650 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 >> 172.21.15.64:0/3757169365 conn(0x7fafa00cdcf0 msgr2=0x7fafa015b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:00.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 shutdown_connections 2024-09-21T07:26:00.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:00.805+0000 7fafa8000640 1 -- 172.21.15.64:0/3757169365 wait complete. 2024-09-21T07:26:01.534 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:26:01.529+0000 7fae91800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-21T07:26:05.829 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:26:05.829 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 -- 172.21.15.64:0/570268991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe9c003a80 msgr2=0x7efe9c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 --2- 172.21.15.64:0/570268991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe9c003a80 0x7efe9c003ef0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c610 tx=0x7efeb001d2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efeb7e00640 1 -- 172.21.15.64:0/570268991 reap_dead start 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 -- 172.21.15.64:0/570268991 shutdown_connections 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 -- 172.21.15.64:0/570268991 >> 172.21.15.64:0/570268991 conn(0x7efeb80ccbe0 msgr2=0x7efeb80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 -- 172.21.15.64:0/570268991 shutdown_connections 2024-09-21T07:26:06.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.001+0000 7efebe400640 1 -- 172.21.15.64:0/570268991 wait complete. 2024-09-21T07:26:06.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 Processor -- start 2024-09-21T07:26:06.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- start start 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe9c003a80 0x7efeb81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb815db30 0x7efeb81f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8165b70 con 0x7efeb80ad7a0 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81659f0 con 0x7efe9c003a80 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8165cf0 con 0x7efeb815db30 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe9c003a80 0x7efeb81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36588/0 (socket says 172.21.15.64:36588) 2024-09-21T07:26:06.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 -- 172.21.15.64:0/892441677 learned_addr learned my addr 172.21.15.64:0/892441677 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb6a00640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb815db30 0x7efeb81f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 -- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb815db30 msgr2=0x7efeb81f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb815db30 0x7efeb81f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 -- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe9c003a80 msgr2=0x7efeb81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe9c003a80 0x7efeb81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 -- 172.21.15.64:0/892441677 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb8076e80 con 0x7efeb80ad7a0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeb7e00640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b2870 tx=0x7efea4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeaf400640 1 -- 172.21.15.64:0/892441677 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea400f8c0 con 0x7efeb80ad7a0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeaf400640 1 -- 172.21.15.64:0/892441677 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea400fa60 con 0x7efeb80ad7a0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efeaf400640 1 -- 172.21.15.64:0/892441677 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea400fe70 con 0x7efeb80ad7a0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81f8da0 con 0x7efeb80ad7a0 2024-09-21T07:26:06.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.005+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81f91f0 con 0x7efeb80ad7a0 2024-09-21T07:26:06.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.009+0000 7efeaf400640 1 -- 172.21.15.64:0/892441677 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efea4003600 con 0x7efeb80ad7a0 2024-09-21T07:26:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.009+0000 7efeaf400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 0x7efe98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.009+0000 7efec5c12000 1 Processor -- start 2024-09-21T07:26:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.009+0000 7efeaf400640 1 -- 172.21.15.64:0/892441677 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7efea4094f50 con 0x7efeb80ad7a0 2024-09-21T07:26:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.009+0000 7efec5c12000 1 -- start start 2024-09-21T07:26:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 0x7efe98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 0x7efe98075710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efeb00ac000 tx=0x7efeb001a120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e865f890 0x5602e8b74f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8723aa0 0x5602e8b75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5602e8a13cd0 con 0x5602e8a086d0 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5602e8929330 con 0x5602e865f890 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5602e8986bb0 con 0x5602e8723aa0 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36594/0 (socket says 172.21.15.64:36594) 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 -- 172.21.15.64:0/2912423285 learned_addr learned my addr 172.21.15.64:0/2912423285 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb6a00640 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e865f890 0x5602e8b74f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7e00640 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8723aa0 0x5602e8b75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 -- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8723aa0 msgr2=0x5602e8b75470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8723aa0 0x5602e8b75470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 -- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e865f890 msgr2=0x5602e8b74f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e865f890 0x5602e8b74f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 -- 172.21.15.64:0/2912423285 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e892ac80 con 0x5602e8a086d0 2024-09-21T07:26:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efeb7400640 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efeb0098da0 tx=0x7efeb00b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37e4b4e830db57f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efea3e00640 1 -- 172.21.15.64:0/2912423285 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00cb070 con 0x5602e8a086d0 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efea3e00640 1 -- 172.21.15.64:0/2912423285 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efeb00c0050 con 0x5602e8a086d0 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efea3e00640 1 -- 172.21.15.64:0/2912423285 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0006790 con 0x5602e8a086d0 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- 172.21.15.64:0/2912423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 msgr2=0x5602e8b749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efeb0098da0 tx=0x7efeb00b8000 comp rx=0 tx=0).stop 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- 172.21.15.64:0/2912423285 shutdown_connections 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8723aa0 0x5602e8b75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e865f890 0x5602e8b74f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 --2- 172.21.15.64:0/2912423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8a086d0 0x5602e8b749f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- 172.21.15.64:0/2912423285 >> 172.21.15.64:0/2912423285 conn(0x5602e86335c0 msgr2=0x5602e8b31ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- 172.21.15.64:0/2912423285 shutdown_connections 2024-09-21T07:26:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.013+0000 7efec5c12000 1 -- 172.21.15.64:0/2912423285 wait complete. 2024-09-21T07:26:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 -- start start 2024-09-21T07:26:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 Processor -- start 2024-09-21T07:26:06.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8b30a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8b375f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5602e8979df0 con 0x5602e8723aa0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5602e8975fe0 con 0x5602e8a086d0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5602e891b4d0 con 0x5602e865f890 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 10 client.0 _ll_register_callbacks cb 0x5602e88f97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36606/0 (socket says 172.21.15.64:36606) 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 -- 172.21.15.64:0/2784560986 learned_addr learned my addr 172.21.15.64:0/2784560986 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb7400640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8b30a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb7e00640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8b375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 -- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 msgr2=0x5602e8b30a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8b30a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 -- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 msgr2=0x5602e8b375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8b375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 -- 172.21.15.64:0/2784560986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e8914210 con 0x5602e8723aa0 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efeb6a00640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efea8012700 tx=0x7efea8012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa1c7042d9ead27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efea0c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8021060 con 0x5602e8723aa0 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7efea8004230 con 0x5602e8723aa0 2024-09-21T07:26:06.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5602e890e350 con 0x5602e8723aa0 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efea8027050 con 0x5602e8723aa0 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.017+0000 7efec5c12000 10 client.5805 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5602e88fafc0 con 0x5602e8723aa0 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5602e890e350 con 0x5602e8723aa0 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7efea802a020 con 0x5602e8723aa0 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 10 client.5805 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 10 client.5805 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 20 client.5805 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8618930 0x5602e8b7be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 4 client.5805 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e8988b00 con 0x5602e8618930 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efeb7400640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8618930 0x5602e8b7be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efeb7400640 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8618930 0x5602e8b7be80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b80b56a0009db439 server_cookie=256047a3127dc7c1 in_seq=0 out_seq=0 2024-09-21T07:26:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 10 client.5805 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 1 -- 172.21.15.64:0/2784560986 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602e8988b00 con 0x5602e8618930 2024-09-21T07:26:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 10 client.5805 handle_command_reply: tid=0 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 client.5805 shutdown 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 msgr2=0x5602e8b30f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efea8012700 tx=0x7efea8012b00 comp rx=0 tx=0).stop 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 shutdown_connections 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8618930 0x5602e8b7be80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8b375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8b30f40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 --2- 172.21.15.64:0/2784560986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8b30a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efea0c00640 0 client.5805 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 >> 172.21.15.64:0/2784560986 conn(0x5602e86335c0 msgr2=0x5602e8b29d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 shutdown_connections 2024-09-21T07:26:06.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 1 -- 172.21.15.64:0/2784560986 wait complete. 2024-09-21T07:26:06.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.021+0000 7efec5c12000 20 client.5805 trim_cache size 0 max 16384 2024-09-21T07:26:06.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 Processor -- start 2024-09-21T07:26:06.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 -- start start 2024-09-21T07:26:06.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8be61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8be6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5602e8b2fb20 con 0x5602e8723aa0 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8205f30 con 0x5602e8a086d0 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8204f80 con 0x5602e865f890 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36618/0 (socket says 172.21.15.64:36618) 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 -- 172.21.15.64:0/949609090 learned_addr learned my addr 172.21.15.64:0/949609090 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb7e00640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8be6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb7400640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8be61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 -- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 msgr2=0x5602e8be61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8be61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 -- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 msgr2=0x5602e8be6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8be6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 -- 172.21.15.64:0/949609090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e89d3680 con 0x5602e8723aa0 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb7e00640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8be6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb7400640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8be61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efeb6a00640 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efea8009470 tx=0x7efea80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fef3078610c996 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efea3400640 1 -- 172.21.15.64:0/949609090 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea802f070 con 0x5602e8723aa0 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efea3400640 1 -- 172.21.15.64:0/949609090 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea8011d70 con 0x5602e8723aa0 2024-09-21T07:26:06.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.041+0000 7efea3400640 1 -- 172.21.15.64:0/949609090 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea801c690 con 0x5602e8723aa0 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- 172.21.15.64:0/949609090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 msgr2=0x5602e8be6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efea8009470 tx=0x7efea80046d0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- 172.21.15.64:0/949609090 shutdown_connections 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8a086d0 0x5602e8be6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e8723aa0 0x5602e8be6730 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- 172.21.15.64:0/949609090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e865f890 0x5602e8be61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- 172.21.15.64:0/949609090 >> 172.21.15.64:0/949609090 conn(0x5602e86335c0 msgr2=0x5602e8b86fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- 172.21.15.64:0/949609090 shutdown_connections 2024-09-21T07:26:06.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- 172.21.15.64:0/949609090 wait complete. 2024-09-21T07:26:06.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- start start 2024-09-21T07:26:06.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 Processor -- start 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8723aa0 0x5602e8bea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8a086d0 0x5602e8beaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8204930 con 0x5602e865f890 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8204340 con 0x5602e8723aa0 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5602e863b680 con 0x5602e8a086d0 2024-09-21T07:26:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efec5c12000 10 client.0 _ll_register_callbacks cb 0x7efea80097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efeb7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efeb7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36624/0 (socket says 172.21.15.64:36624) 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efeb7400640 1 -- 172.21.15.64:0/3405722495 learned_addr learned my addr 172.21.15.64:0/3405722495 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efeb7e00640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8a086d0 0x5602e8beaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.045+0000 7efeb6a00640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8723aa0 0x5602e8bea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 -- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8a086d0 msgr2=0x5602e8beaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8a086d0 0x5602e8beaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 -- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8723aa0 msgr2=0x5602e8bea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8723aa0 0x5602e8bea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 -- 172.21.15.64:0/3405722495 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e89400b0 con 0x5602e865f890 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb7400640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efeb001cda0 tx=0x7efe9c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c7ae2c87da77d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00cb040 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7efeb0000fc0 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea8011d70 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efeb00dc050 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 10 client.5811 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5602e890c610 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea8011d70 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7efeb00df020 con 0x5602e865f890 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 10 client.5811 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 10 client.5811 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 20 client.5811 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8606990 0x5602e8b2b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 4 client.5811 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5602e89845b0 con 0x5602e8606990 2024-09-21T07:26:06.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb6a00640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8606990 0x5602e8b2b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 10 client.5811 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efeb6a00640 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8606990 0x5602e8b2b860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00bdf6cf6c724df server_cookie=f138c1d6c59cd6b8 in_seq=0 out_seq=0 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 1 -- 172.21.15.64:0/3405722495 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1372 (crc 0 0 0) 0x5602e89845b0 con 0x5602e8606990 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 10 client.5811 handle_command_reply: tid=0 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 client.5811 shutdown 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 msgr2=0x5602e8bea440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efeb001cda0 tx=0x7efe9c005840 comp rx=0 tx=0).stop 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 shutdown_connections 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5602e8606990 0x5602e8b2b860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5602e8a086d0 0x5602e8beaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602e8723aa0 0x5602e8bea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 --2- 172.21.15.64:0/3405722495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5602e865f890 0x5602e8bea440 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efea0c00640 0 client.5811 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 >> 172.21.15.64:0/3405722495 conn(0x5602e86335c0 msgr2=0x5602e8b365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 shutdown_connections 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 1 -- 172.21.15.64:0/3405722495 wait complete. 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efec5c12000 20 client.5811 trim_cache size 0 max 16384 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout: "b81e3d10-66ff-4d8a-9a88-8293f34f326b": { 2024-09-21T07:26:06.058 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:00.573287+0000", 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1": { 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:59.281306+0000", 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:06.059 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "1e7b96c9-870a-401f-a0b0-a05420a615dc": { 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.817313+0000", 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:06.060 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7": { 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.353320+0000", 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:06.061 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 msgr2=0x7efe98075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 0x7efe98075710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efeb00ac000 tx=0x7efeb001a120 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 msgr2=0x7efeb8073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b2870 tx=0x7efea4011c40 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 shutdown_connections 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe98073200 0x7efe98075710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efeb80ad7a0 0x7efeb8073d90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb815db30 0x7efeb81f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 --2- 172.21.15.64:0/892441677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe9c003a80 0x7efeb81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 >> 172.21.15.64:0/892441677 conn(0x7efeb80ccbe0 msgr2=0x7efeb80ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 shutdown_connections 2024-09-21T07:26:06.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.049+0000 7efebe400640 1 -- 172.21.15.64:0/892441677 wait complete. 2024-09-21T07:26:06.075 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:26:06.075 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-21T07:26:06.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 -- 172.21.15.64:0/24255579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f511815ec20 msgr2=0x7f51180ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 --2- 172.21.15.64:0/24255579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f511815ec20 0x7f51180ce740 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f51180c7180 tx=0x7f510801c7d0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 -- 172.21.15.64:0/24255579 shutdown_connections 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 --2- 172.21.15.64:0/24255579 >> v2:172.21.15.90:3300/0 conn(0x7f51180704f0 0x7f51180b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 --2- 172.21.15.64:0/24255579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51180ca990 0x7f511806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 --2- 172.21.15.64:0/24255579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f511815ec20 0x7f51180ce740 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 -- 172.21.15.64:0/24255579 >> 172.21.15.64:0/24255579 conn(0x7f51180ccbe0 msgr2=0x7f51180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 -- 172.21.15.64:0/24255579 shutdown_connections 2024-09-21T07:26:06.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.257+0000 7f511e600640 1 -- 172.21.15.64:0/24255579 wait complete. 2024-09-21T07:26:06.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 Processor -- start 2024-09-21T07:26:06.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- start start 2024-09-21T07:26:06.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51180ca990 0x7f5118165b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511815ec20 0x7f5118158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51180b2470 con 0x7f51180704f0 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51180b22f0 con 0x7f51180ca990 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f51180b25f0 con 0x7f511815ec20 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36644/0 (socket says 172.21.15.64:36644) 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 -- 172.21.15.64:0/2210338059 learned_addr learned my addr 172.21.15.64:0/2210338059 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117e00640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511815ec20 0x7f5118158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5116a00640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51180ca990 0x7f5118165b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 -- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511815ec20 msgr2=0x7f5118158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511815ec20 0x7f5118158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 -- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51180ca990 msgr2=0x7f5118165b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51180ca990 0x7f5118165b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 -- 172.21.15.64:0/2210338059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5118163830 con 0x7f51180704f0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f5117400640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f51080b0040 tx=0x7f5108004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f510f400640 1 -- 172.21.15.64:0/2210338059 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080b2040 con 0x7f51180704f0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f510f400640 1 -- 172.21.15.64:0/2210338059 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5108005320 con 0x7f51180704f0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5118163b10 con 0x7f51180704f0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f510f400640 1 -- 172.21.15.64:0/2210338059 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080a5890 con 0x7f51180704f0 2024-09-21T07:26:06.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.261+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5118164150 con 0x7f51180704f0 2024-09-21T07:26:06.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f510f400640 1 -- 172.21.15.64:0/2210338059 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f51080a5a30 con 0x7f51180704f0 2024-09-21T07:26:06.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f510f400640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 0x7f50f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f510f400640 1 -- 172.21.15.64:0/2210338059 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f510812df70 con 0x7f51180704f0 2024-09-21T07:26:06.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f5125e25000 1 Processor -- start 2024-09-21T07:26:06.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f5125e25000 1 -- start start 2024-09-21T07:26:06.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.265+0000 7f5116a00640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 0x7f50f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5116a00640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 0x7f50f8075710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51180cb410 tx=0x7f510400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea89a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea89aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561aea738d50 con 0x561aea721db0 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561aea6acb10 con 0x561aea7215a0 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x561aea69bf40 con 0x561aea728320 2024-09-21T07:26:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36646/0 (socket says 172.21.15.64:36646) 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 -- 172.21.15.64:0/2730342922 learned_addr learned my addr 172.21.15.64:0/2730342922 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5116a00640 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea89aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117400640 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea89a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 -- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 msgr2=0x561aea89a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea89a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 -- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 msgr2=0x561aea89aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea89aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 -- 172.21.15.64:0/2730342922 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aea61d120 con 0x561aea721db0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5117e00640 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5110009e30 tx=0x7f51100117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab578867521cdfb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5103e00640 1 -- 172.21.15.64:0/2730342922 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110004d30 con 0x561aea721db0 2024-09-21T07:26:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5103e00640 1 -- 172.21.15.64:0/2730342922 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5110003980 con 0x561aea721db0 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5103e00640 1 -- 172.21.15.64:0/2730342922 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110003d90 con 0x561aea721db0 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- 172.21.15.64:0/2730342922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 msgr2=0x561aea89b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5110009e30 tx=0x7f51100117b0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- 172.21.15.64:0/2730342922 shutdown_connections 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea721db0 0x561aea89b3e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea89aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 --2- 172.21.15.64:0/2730342922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea89a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- 172.21.15.64:0/2730342922 >> 172.21.15.64:0/2730342922 conn(0x561aea359920 msgr2=0x561aea87de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- 172.21.15.64:0/2730342922 shutdown_connections 2024-09-21T07:26:06.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- 172.21.15.64:0/2730342922 wait complete. 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.269+0000 7f5125e25000 1 -- start start 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 Processor -- start 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea87d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea87d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561aea641500 con 0x561aea7215a0 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561aea69fd50 con 0x561aea721db0 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x561aea361680 con 0x561aea728320 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 10 client.0 _ll_register_callbacks cb 0x561aea83c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36654/0 (socket says 172.21.15.64:36654) 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 -- 172.21.15.64:0/3751882737 learned_addr learned my addr 172.21.15.64:0/3751882737 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5116a00640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea87d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117e00640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea87d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 -- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 msgr2=0x561aea87d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea87d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 -- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 msgr2=0x561aea87d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea87d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 -- 172.21.15.64:0/3751882737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aea650c60 con 0x561aea7215a0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5117400640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f510812c270 tx=0x7f51080f80f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3c6b5c2068d1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080f87a0 con 0x561aea7215a0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f51080b8cb0 con 0x561aea7215a0 2024-09-21T07:26:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561aea634330 con 0x561aea7215a0 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51080fd1d0 con 0x561aea7215a0 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 10 client.5823 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561aea69abe0 con 0x561aea7215a0 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561aea634330 con 0x561aea7215a0 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f51080bf030 con 0x561aea7215a0 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 10 client.5823 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 10 client.5823 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 20 client.5823 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea33e930 0x561aea8abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 4 client.5823 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:06.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561aea6aea60 con 0x561aea33e930 2024-09-21T07:26:06.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.273+0000 7f5116a00640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea33e930 0x561aea8abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5116a00640 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea33e930 0x561aea8abf20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ea1c8d6c4b0fbf server_cookie=d640b02b08dc59b0 in_seq=0 out_seq=0 2024-09-21T07:26:06.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5100c00640 10 client.5823 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5100c00640 1 -- 172.21.15.64:0/3751882737 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561aea6aea60 con 0x561aea33e930 2024-09-21T07:26:06.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5100c00640 10 client.5823 handle_command_reply: tid=0 2024-09-21T07:26:06.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 client.5823 shutdown 2024-09-21T07:26:06.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 msgr2=0x561aea87cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f510812c270 tx=0x7f51080f80f0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 shutdown_connections 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea33e930 0x561aea8abf20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea728320 0x561aea87d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea87d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 --2- 172.21.15.64:0/3751882737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea87cf50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5100c00640 0 client.5823 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 >> 172.21.15.64:0/3751882737 conn(0x561aea359920 msgr2=0x561aea84e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 shutdown_connections 2024-09-21T07:26:06.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 1 -- 172.21.15.64:0/3751882737 wait complete. 2024-09-21T07:26:06.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.277+0000 7f5125e25000 20 client.5823 trim_cache size 0 max 16384 2024-09-21T07:26:06.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.289+0000 7f5125e25000 1 Processor -- start 2024-09-21T07:26:06.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- start start 2024-09-21T07:26:06.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea359920 0x561aea8558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea8af160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561aea8542b0 con 0x561aea7215a0 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5118205b10 con 0x561aea721db0 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5118204b80 con 0x561aea359920 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36666/0 (socket says 172.21.15.64:36666) 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 -- 172.21.15.64:0/609940193 learned_addr learned my addr 172.21.15.64:0/609940193 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5117400640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea359920 0x561aea8558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5117e00640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea8af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 -- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea359920 msgr2=0x561aea8558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea359920 0x561aea8558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 -- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 msgr2=0x561aea8af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea8af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 -- 172.21.15.64:0/609940193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aea63a1f0 con 0x561aea7215a0 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5117e00640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea8af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5116a00640 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5104011680 tx=0x7f5104013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bab1672abf1c4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5103400640 1 -- 172.21.15.64:0/609940193 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104021190 con 0x561aea7215a0 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5103400640 1 -- 172.21.15.64:0/609940193 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5104021510 con 0x561aea7215a0 2024-09-21T07:26:06.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5103400640 1 -- 172.21.15.64:0/609940193 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104021900 con 0x561aea7215a0 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- 172.21.15.64:0/609940193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 msgr2=0x561aea855de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5104011680 tx=0x7f5104013000 comp rx=0 tx=0).stop 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- 172.21.15.64:0/609940193 shutdown_connections 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea721db0 0x561aea8af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea7215a0 0x561aea855de0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 --2- 172.21.15.64:0/609940193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea359920 0x561aea8558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- 172.21.15.64:0/609940193 >> 172.21.15.64:0/609940193 conn(0x561aea8a7800 msgr2=0x561aea855190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- 172.21.15.64:0/609940193 shutdown_connections 2024-09-21T07:26:06.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.293+0000 7f5125e25000 1 -- 172.21.15.64:0/609940193 wait complete. 2024-09-21T07:26:06.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- start start 2024-09-21T07:26:06.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 Processor -- start 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea8aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea721db0 0x561aea8cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x561aea859d90 con 0x561aea359920 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561aea69f060 con 0x561aea7215a0 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x561aea6678b0 con 0x561aea721db0 2024-09-21T07:26:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 10 client.0 _ll_register_callbacks cb 0x7f51080f8570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36674/0 (socket says 172.21.15.64:36674) 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 -- 172.21.15.64:0/3307672663 learned_addr learned my addr 172.21.15.64:0/3307672663 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5116a00640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea8aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117e00640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea721db0 0x561aea8cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 -- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea721db0 msgr2=0x561aea8cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea721db0 0x561aea8cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 -- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 msgr2=0x561aea8aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea8aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 -- 172.21.15.64:0/3307672663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aea662990 con 0x561aea359920 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5117400640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f51080f8730 tx=0x7f51080a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97646148a0ce9f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5100c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51081020d0 con 0x561aea359920 2024-09-21T07:26:06.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f51080f7a00 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5104021510 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51080f4640 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 10 client.5829 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.297+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561aea632580 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5104021510 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f51080bf070 con 0x561aea359920 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 10 client.5829 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 10 client.5829 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 20 client.5829 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea357fe0 0x561aea8cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 4 client.5829 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561aea6aa510 con 0x561aea357fe0 2024-09-21T07:26:06.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5116a00640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea357fe0 0x561aea8cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5116a00640 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea357fe0 0x561aea8cce30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10ca8cdc80a36a1 server_cookie=36215de638b2d2f4 in_seq=0 out_seq=0 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 10 client.5829 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 1 -- 172.21.15.64:0/3307672663 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x561aea6aa510 con 0x561aea357fe0 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 10 client.5829 handle_command_reply: tid=0 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 client.5829 shutdown 2024-09-21T07:26:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 msgr2=0x561aea8aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f51080f8730 tx=0x7f51080a56a0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 shutdown_connections 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x561aea357fe0 0x561aea8cce30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561aea721db0 0x561aea8cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561aea7215a0 0x561aea8aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 --2- 172.21.15.64:0/3307672663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561aea359920 0x561aea8aea10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 >> 172.21.15.64:0/3307672663 conn(0x561aea8a7800 msgr2=0x561aea855b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5100c00640 0 client.5829 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 shutdown_connections 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 1 -- 172.21.15.64:0/3307672663 wait complete. 2024-09-21T07:26:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f5125e25000 20 client.5829 trim_cache size 0 max 16384 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: "damage_type": "backtrace", 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 2686815757, 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 1099511630408, 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:06.310 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 msgr2=0x7f50f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 0x7f50f8075710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51180cb410 tx=0x7f510400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 msgr2=0x7f5118156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f51080b0040 tx=0x7f5108004600 comp rx=0 tx=0).stop 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 shutdown_connections 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f50f8073200 0x7f50f8075710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511815ec20 0x7f5118158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51180ca990 0x7f5118165b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 --2- 172.21.15.64:0/2210338059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51180704f0 0x7f5118156ae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 >> 172.21.15.64:0/2210338059 conn(0x7f51180ccbe0 msgr2=0x7f51180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 shutdown_connections 2024-09-21T07:26:06.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.301+0000 7f511e600640 1 -- 172.21.15.64:0/2210338059 wait complete. 2024-09-21T07:26:06.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 -- 172.21.15.64:0/392574014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b8c003c90 msgr2=0x7f2b8c0040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 --2- 172.21.15.64:0/392574014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b8c003c90 0x7f2b8c0040e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2b98006fa0 tx=0x7f2b9801cf00 comp rx=0 tx=0).stop 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2baa800640 1 -- 172.21.15.64:0/392574014 reap_dead start 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 -- 172.21.15.64:0/392574014 shutdown_connections 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 -- 172.21.15.64:0/392574014 >> 172.21.15.64:0/392574014 conn(0x7f2ba40cecd0 msgr2=0x7f2ba40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 -- 172.21.15.64:0/392574014 shutdown_connections 2024-09-21T07:26:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.481+0000 7f2bac800640 1 -- 172.21.15.64:0/392574014 wait complete. 2024-09-21T07:26:06.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 Processor -- start 2024-09-21T07:26:06.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- start start 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c003c90 0x7f2ba414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ba4159ec0 0x7f2ba4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4169000 con 0x7f2ba40b7900 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4168e80 con 0x7f2b8c003c90 2024-09-21T07:26:06.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba4169180 con 0x7f2ba4159ec0 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36692/0 (socket says 172.21.15.64:36692) 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 -- 172.21.15.64:0/1622194065 learned_addr learned my addr 172.21.15.64:0/1622194065 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9e00640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c003c90 0x7f2ba414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2baa800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ba4159ec0 0x7f2ba4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 -- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ba4159ec0 msgr2=0x7f2ba4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ba4159ec0 0x7f2ba4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 -- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c003c90 msgr2=0x7f2ba414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c003c90 0x7f2ba414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 -- 172.21.15.64:0/1622194065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba40c5a30 con 0x7f2ba40b7900 2024-09-21T07:26:06.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2ba9400640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2b94003e50 tx=0x7f2b94001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011700 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b94016020 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba414f020 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011b40 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.485+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba41556c0 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.489+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba40d05f0 con 0x7f2ba40b7900 2024-09-21T07:26:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.489+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b94011ce0 con 0x7f2ba40b7900 2024-09-21T07:26:06.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.489+0000 7f2b9e000640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 0x7f2b88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.489+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f2b94095560 con 0x7f2ba40b7900 2024-09-21T07:26:06.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.489+0000 7f2ba9e00640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 0x7f2b88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.493+0000 7f2ba9e00640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 0x7f2b88075710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ac000 tx=0x7f2b98019d40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.493+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2b94020020 con 0x7f2ba40b7900 2024-09-21T07:26:06.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.705+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ba40ccac0 con 0x7f2ba40b7900 2024-09-21T07:26:06.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.705+0000 7f2b9e000640 1 -- 172.21.15.64:0/1622194065 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7f2b9405fd80 con 0x7f2ba40b7900 2024-09-21T07:26:06.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:06.712 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 msgr2=0x7f2b88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 0x7f2b88075710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ac000 tx=0x7f2b98019d40 comp rx=0 tx=0).stop 2024-09-21T07:26:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 msgr2=0x7f2ba4159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2b94003e50 tx=0x7f2b94001810 comp rx=0 tx=0).stop 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 shutdown_connections 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b88073200 0x7f2b88075710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ba4159ec0 0x7f2ba4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba40b7900 0x7f2ba4159980 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 --2- 172.21.15.64:0/1622194065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c003c90 0x7f2ba414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 >> 172.21.15.64:0/1622194065 conn(0x7f2ba40cecd0 msgr2=0x7f2ba4071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 shutdown_connections 2024-09-21T07:26:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.709+0000 7f2bac800640 1 -- 172.21.15.64:0/1622194065 wait complete. 2024-09-21T07:26:06.734 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 2686815757 2024-09-21T07:26:06.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 -- 172.21.15.64:0/2863462737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 msgr2=0x7fced0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 --2- 172.21.15.64:0/2863462737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fced0004c20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fced40016c0 tx=0x7fced401c730 comp rx=0 tx=0).stop 2024-09-21T07:26:06.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 -- 172.21.15.64:0/2863462737 shutdown_connections 2024-09-21T07:26:06.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 --2- 172.21.15.64:0/2863462737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fced0004c20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 -- 172.21.15.64:0/2863462737 >> 172.21.15.64:0/2863462737 conn(0x7fcee806d450 msgr2=0x7fcee80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 -- 172.21.15.64:0/2863462737 shutdown_connections 2024-09-21T07:26:06.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.889+0000 7fceefc00640 1 -- 172.21.15.64:0/2863462737 wait complete. 2024-09-21T07:26:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 Processor -- start 2024-09-21T07:26:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 -- start start 2024-09-21T07:26:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcee809d7b0 0x7fcee8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcee815d560 0x7fcee81f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81602a0 con 0x7fced0004810 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcee8160120 con 0x7fcee815d560 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceefc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcee80b33d0 con 0x7fcee809d7b0 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceed200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceed200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36706/0 (socket says 172.21.15.64:36706) 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceed200640 1 -- 172.21.15.64:0/3640241273 learned_addr learned my addr 172.21.15.64:0/3640241273 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcee809d7b0 0x7fcee8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.893+0000 7fceedc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcee815d560 0x7fcee81f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 -- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcee809d7b0 msgr2=0x7fcee8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcee809d7b0 0x7fcee8158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 -- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcee815d560 msgr2=0x7fcee81f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcee815d560 0x7fcee81f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 -- 172.21.15.64:0/3640241273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee81f9e00 con 0x7fced0004810 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceed200640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcedc011680 tx=0x7fcedc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fcee4c00640 1 -- 172.21.15.64:0/3640241273 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc006170 con 0x7fced0004810 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fcee4c00640 1 -- 172.21.15.64:0/3640241273 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcedc016020 con 0x7fced0004810 2024-09-21T07:26:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fcee4c00640 1 -- 172.21.15.64:0/3640241273 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00f8d0 con 0x7fced0004810 2024-09-21T07:26:06.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee81f9840 con 0x7fced0004810 2024-09-21T07:26:06.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.897+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee81f5a10 con 0x7fced0004810 2024-09-21T07:26:06.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee4c00640 1 -- 172.21.15.64:0/3640241273 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcedc00fa70 con 0x7fced0004810 2024-09-21T07:26:06.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee4c00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 0x7fcec8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 Processor -- start 2024-09-21T07:26:06.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee4c00640 1 -- 172.21.15.64:0/3640241273 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fcedc097100 con 0x7fced0004810 2024-09-21T07:26:06.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 -- start start 2024-09-21T07:26:06.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 0x7fcec8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 0x7fcec8075740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcee80c3df0 tx=0x7fced4019520 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e13dda0 0x55d30e2840f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e284630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d30e121aa0 con 0x55d30e11cb30 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d30e096cb0 con 0x55d30e133400 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d30e0860e0 con 0x55d30e13dda0 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36720/0 (socket says 172.21.15.64:36720) 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 -- 172.21.15.64:0/3696712305 learned_addr learned my addr 172.21.15.64:0/3696712305 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e284630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceed200640 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e13dda0 0x55d30e2840f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 -- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e13dda0 msgr2=0x55d30e2840f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e13dda0 0x55d30e2840f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 -- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 msgr2=0x55d30e284630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e284630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.901+0000 7fceedc00640 1 -- 172.21.15.64:0/3696712305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d30e02a370 con 0x55d30e11cb30 2024-09-21T07:26:06.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fceedc00640 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcee8072030 tx=0x7fcee0003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe789aa6c604006f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fced9600640 1 -- 172.21.15.64:0/3696712305 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee00045b0 con 0x55d30e11cb30 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fced9600640 1 -- 172.21.15.64:0/3696712305 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee0004750 con 0x55d30e11cb30 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fced9600640 1 -- 172.21.15.64:0/3696712305 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0011680 con 0x55d30e11cb30 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- 172.21.15.64:0/3696712305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 msgr2=0x55d30e284b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcee8072030 tx=0x7fcee0003e10 comp rx=0 tx=0).stop 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- 172.21.15.64:0/3696712305 shutdown_connections 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e11cb30 0x55d30e284b70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e284630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 --2- 172.21.15.64:0/3696712305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e13dda0 0x55d30e2840f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- 172.21.15.64:0/3696712305 >> 172.21.15.64:0/3696712305 conn(0x55d30dd43700 msgr2=0x55d30e2675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- 172.21.15.64:0/3696712305 shutdown_connections 2024-09-21T07:26:06.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- 172.21.15.64:0/3696712305 wait complete. 2024-09-21T07:26:06.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 -- start start 2024-09-21T07:26:06.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.905+0000 7fcef7481000 1 Processor -- start 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e28b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e13dda0 0x55d30e28bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d30e10a620 con 0x55d30e133400 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d30e145200 con 0x55d30e13dda0 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d30e02fb30 con 0x55d30e11cb30 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 10 client.0 _ll_register_callbacks cb 0x55d30e225cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36728/0 (socket says 172.21.15.64:36728) 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 -- 172.21.15.64:0/2704643248 learned_addr learned my addr 172.21.15.64:0/2704643248 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fceed200640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e28b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fceedc00640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e13dda0 0x55d30e28bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 -- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 msgr2=0x55d30e28b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e28b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 -- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e13dda0 msgr2=0x55d30e28bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e13dda0 0x55d30e28bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 -- 172.21.15.64:0/2704643248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d30e024280 con 0x55d30e133400 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcee7e00640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fced4000c10 tx=0x7fced4006b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eb1bcb3b3036f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40c6070 con 0x55d30e133400 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fced40b5730 con 0x55d30e133400 2024-09-21T07:26:06.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d30e01e200 con 0x55d30e133400 2024-09-21T07:26:06.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fced40d1050 con 0x55d30e133400 2024-09-21T07:26:06.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 10 client.5847 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d30e04fae0 con 0x55d30e133400 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d30e01e200 con 0x55d30e133400 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fced40d4020 con 0x55d30e133400 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 10 client.5847 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 10 client.5847 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 20 client.5847 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd28a70 0x55d30e295750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 4 client.5847 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d30e098c00 con 0x55d30dd28a70 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fceed200640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd28a70 0x55d30e295750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fceed200640 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd28a70 0x55d30e295750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e6cf2d32be9e4b server_cookie=26c3567529b587e1 in_seq=0 out_seq=0 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 10 client.5847 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 1 -- 172.21.15.64:0/2704643248 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d30e098c00 con 0x55d30dd28a70 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcece000640 10 client.5847 handle_command_reply: tid=0 2024-09-21T07:26:06.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 client.5847 shutdown 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 msgr2=0x55d30e28b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fced4000c10 tx=0x7fced4006b80 comp rx=0 tx=0).stop 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.909+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 shutdown_connections 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd28a70 0x55d30e295750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e13dda0 0x55d30e28bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e133400 0x55d30e28b8b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 --2- 172.21.15.64:0/2704643248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e28b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcece000640 0 client.5847 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 >> 172.21.15.64:0/2704643248 conn(0x55d30dd43700 msgr2=0x55d30e238b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 shutdown_connections 2024-09-21T07:26:06.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 1 -- 172.21.15.64:0/2704643248 wait complete. 2024-09-21T07:26:06.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.913+0000 7fcef7481000 20 client.5847 trim_cache size 0 max 16384 2024-09-21T07:26:06.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.925+0000 7fcef7481000 1 Processor -- start 2024-09-21T07:26:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.925+0000 7fcef7481000 1 -- start start 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e291e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e23efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcee8202030 con 0x55d30e13dda0 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcee82013c0 con 0x55d30e133400 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcee8201a10 con 0x55d30e11cb30 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36738/0 (socket says 172.21.15.64:36738) 2024-09-21T07:26:06.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 -- 172.21.15.64:0/3255590828 learned_addr learned my addr 172.21.15.64:0/3255590828 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e23efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceed200640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e291e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 -- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 msgr2=0x55d30e291e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e291e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 -- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 msgr2=0x55d30e23efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e23efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 -- 172.21.15.64:0/3255590828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d30e10aab0 con 0x55d30e13dda0 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcee7e00640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e23efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceed200640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e291e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fceedc00640 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcee0017000 tx=0x7fcee0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45c59b5c49c84bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fced8c00640 1 -- 172.21.15.64:0/3255590828 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004b30 con 0x55d30e13dda0 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fced8c00640 1 -- 172.21.15.64:0/3255590828 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee0004cd0 con 0x55d30e13dda0 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fced8c00640 1 -- 172.21.15.64:0/3255590828 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0005280 con 0x55d30e13dda0 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- 172.21.15.64:0/3255590828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 msgr2=0x55d30e23f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcee0017000 tx=0x7fcee0004a50 comp rx=0 tx=0).stop 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- 172.21.15.64:0/3255590828 shutdown_connections 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e23f500 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e133400 0x55d30e23efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 --2- 172.21.15.64:0/3255590828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e11cb30 0x55d30e291e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- 172.21.15.64:0/3255590828 >> 172.21.15.64:0/3255590828 conn(0x55d30dd43700 msgr2=0x55d30e28df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- 172.21.15.64:0/3255590828 shutdown_connections 2024-09-21T07:26:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- 172.21.15.64:0/3255590828 wait complete. 2024-09-21T07:26:06.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 -- start start 2024-09-21T07:26:06.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.929+0000 7fcef7481000 1 Processor -- start 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e11cb30 0x55d30e2f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e133400 0x55d30e2f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d30e095a80 con 0x55d30e13dda0 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d30e02ab30 con 0x55d30e11cb30 2024-09-21T07:26:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d30e089200 con 0x55d30e133400 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 10 client.0 _ll_register_callbacks cb 0x7fcee00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36754/0 (socket says 172.21.15.64:36754) 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 -- 172.21.15.64:0/2825699088 learned_addr learned my addr 172.21.15.64:0/2825699088 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceed200640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e11cb30 0x55d30e2f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcee7e00640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e133400 0x55d30e2f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 -- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e133400 msgr2=0x55d30e2f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e133400 0x55d30e2f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 -- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e11cb30 msgr2=0x55d30e2f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e11cb30 0x55d30e2f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 -- 172.21.15.64:0/2825699088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d30e02b350 con 0x55d30e13dda0 2024-09-21T07:26:06.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceedc00640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55d30e1039a0 tx=0x7fcee0005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e410ce3e86de46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004b30 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fcee0030cc0 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcee0004cd0 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcee0005430 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 10 client.5853 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d30e04ecd0 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee0004cd0 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fcee00055d0 con 0x55d30e13dda0 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 10 client.5853 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 10 client.5853 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 20 client.5853 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:06.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd16ad0 0x55d30e239610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 4 client.5853 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 2686815757}] 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2686815757}) -- 0x55d30e0946b0 con 0x55d30dd16ad0 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceed200640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd16ad0 0x55d30e239610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fcece000640 10 client.5853 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.933+0000 7fceed200640 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd16ad0 0x55d30e239610 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7550678d0e3cd656 server_cookie=c54fb276515f52fd in_seq=0 out_seq=0 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcece000640 1 -- 172.21.15.64:0/2825699088 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55d30e0946b0 con 0x55d30dd16ad0 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcece000640 10 client.5853 handle_command_reply: tid=0 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 client.5853 shutdown 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 msgr2=0x55d30e2fa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55d30e1039a0 tx=0x7fcee0005f20 comp rx=0 tx=0).stop 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 shutdown_connections 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55d30dd16ad0 0x55d30e239610 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d30e13dda0 0x55d30e2fa140 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d30e133400 0x55d30e2f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 --2- 172.21.15.64:0/2825699088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d30e11cb30 0x55d30e2f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcece000640 0 client.5853 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 >> 172.21.15.64:0/2825699088 conn(0x55d30dd43700 msgr2=0x55d30e28b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 shutdown_connections 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 1 -- 172.21.15.64:0/2825699088 wait complete. 2024-09-21T07:26:06.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fcef7481000 20 client.5853 trim_cache size 0 max 16384 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 msgr2=0x7fcec8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 0x7fcec8075740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcee80c3df0 tx=0x7fced4019520 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 msgr2=0x7fcee81f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcedc011680 tx=0x7fcedc011b40 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 shutdown_connections 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcec8073230 0x7fcec8075740 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcee815d560 0x7fcee81f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcee809d7b0 0x7fcee8158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 --2- 172.21.15.64:0/3640241273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced0004810 0x7fcee81f8ef0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 >> 172.21.15.64:0/3640241273 conn(0x7fcee806d450 msgr2=0x7fcee80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 shutdown_connections 2024-09-21T07:26:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:06.937+0000 7fceefc00640 1 -- 172.21.15.64:0/3640241273 wait complete. 2024-09-21T07:26:06.961 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-21T07:26:06.961 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 -- 172.21.15.64:0/2495603213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd415ec20 msgr2=0x7f8dd40ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 --2- 172.21.15.64:0/2495603213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd415ec20 0x7f8dd40ce740 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40b3130 tx=0x7f8dc401c790 comp rx=0 tx=0).stop 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 -- 172.21.15.64:0/2495603213 shutdown_connections 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 --2- 172.21.15.64:0/2495603213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8dd40706c0 0x7f8dd40b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 --2- 172.21.15.64:0/2495603213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd415ec20 0x7f8dd40ce740 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 -- 172.21.15.64:0/2495603213 >> 172.21.15.64:0/2495603213 conn(0x7f8dd40ccbe0 msgr2=0x7f8dd40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 -- 172.21.15.64:0/2495603213 shutdown_connections 2024-09-21T07:26:07.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.117+0000 7f8ddac00640 1 -- 172.21.15.64:0/2495603213 wait complete. 2024-09-21T07:26:07.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 Processor -- start 2024-09-21T07:26:07.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 -- start start 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd415ec20 0x7f8dd40adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8dd4156170 0x7f8dd40ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4168dc0 con 0x7f8dd40ca990 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4168c40 con 0x7f8dd415ec20 2024-09-21T07:26:07.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd4168f40 con 0x7f8dd4156170 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36770/0 (socket says 172.21.15.64:36770) 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 -- 172.21.15.64:0/3260237932 learned_addr learned my addr 172.21.15.64:0/3260237932 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 -- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8dd4156170 msgr2=0x7f8dd40ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8dd4156170 0x7f8dd40ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 -- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd415ec20 msgr2=0x7f8dd40adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd415ec20 0x7f8dd40adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 -- 172.21.15.64:0/3260237932 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd41fc840 con 0x7f8dd40ca990 2024-09-21T07:26:07.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4000c10 tx=0x7f8dc4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dcbe00640 1 -- 172.21.15.64:0/3260237932 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40bb070 con 0x7f8dd40ca990 2024-09-21T07:26:07.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dcbe00640 1 -- 172.21.15.64:0/3260237932 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc40a5c00 con 0x7f8dd40ca990 2024-09-21T07:26:07.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8dcbe00640 1 -- 172.21.15.64:0/3260237932 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40b2040 con 0x7f8dd40ca990 2024-09-21T07:26:07.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.121+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd41fcd40 con 0x7f8dd40ca990 2024-09-21T07:26:07.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd41f8c30 con 0x7f8dd40ca990 2024-09-21T07:26:07.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8dcbe00640 1 -- 172.21.15.64:0/3260237932 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8dc4005030 con 0x7f8dd40ca990 2024-09-21T07:26:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8dcbe00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 0x7f8db4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8dcbe00640 1 -- 172.21.15.64:0/3260237932 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f8dc412dcf0 con 0x7f8dd40ca990 2024-09-21T07:26:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8de21ca000 1 Processor -- start 2024-09-21T07:26:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8dd3400640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 0x7f8db4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.125+0000 7f8de21ca000 1 -- start start 2024-09-21T07:26:07.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3400640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 0x7f8db4075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0007fd0 tx=0x7f8dc0007940 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x55564409a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564409a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555643eabc40 con 0x555643f50570 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555643e9b070 con 0x555643f331a0 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555643e9ee80 con 0x555643f49310 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36774/0 (socket says 172.21.15.64:36774) 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 -- 172.21.15.64:0/109977642 learned_addr learned my addr 172.21.15.64:0/109977642 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3400640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x55564409a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564409a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 -- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 msgr2=0x55564409a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x55564409a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 -- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 msgr2=0x55564409a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564409a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 -- 172.21.15.64:0/109977642 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555643e1b790 con 0x555643f50570 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3400640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x55564409a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40f56e0 tx=0x7f8dc40f4440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6741d31e8811547a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dbfe00640 1 -- 172.21.15.64:0/109977642 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40f8470 con 0x555643f50570 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dbfe00640 1 -- 172.21.15.64:0/109977642 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc4101e00 con 0x555643f50570 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8dbfe00640 1 -- 172.21.15.64:0/109977642 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4101970 con 0x555643f50570 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- 172.21.15.64:0/109977642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 msgr2=0x555644099f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40f56e0 tx=0x7f8dc40f4440 comp rx=0 tx=0).stop 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- 172.21.15.64:0/109977642 shutdown_connections 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x55564409a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 --2- 172.21.15.64:0/109977642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644099f00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- 172.21.15.64:0/109977642 >> 172.21.15.64:0/109977642 conn(0x555643f6db30 msgr2=0x555644057230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- 172.21.15.64:0/109977642 shutdown_connections 2024-09-21T07:26:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.129+0000 7f8de21ca000 1 -- 172.21.15.64:0/109977642 wait complete. 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- start start 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 Processor -- start 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x555644056100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x555644056640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555643e40580 con 0x555643f50570 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555643e50a00 con 0x555643f331a0 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555643f55a20 con 0x555643f49310 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 10 client.0 _ll_register_callbacks cb 0x55564403ca60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36778/0 (socket says 172.21.15.64:36778) 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 -- 172.21.15.64:0/1960694530 learned_addr learned my addr 172.21.15.64:0/1960694530 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x555644056640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x555644056100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 -- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 msgr2=0x555644056640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x555644056640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 -- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 msgr2=0x555644056100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x555644056100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 -- 172.21.15.64:0/1960694530 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555643e56f60 con 0x555643f50570 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0107c0 tx=0x7f8dcc010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d2d481b1b15236 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc017070 con 0x555643f50570 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f8dcc004d30 con 0x555643f50570 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555643e33390 con 0x555643f50570 2024-09-21T07:26:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8dcc023050 con 0x555643f50570 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 10 client.5868 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555643e39250 con 0x555643f50570 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x555643e33390 con 0x555643f50570 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.133+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8dcc026020 con 0x555643f50570 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 10 client.5868 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 10 client.5868 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 20 client.5868 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b3d990 0x555644088ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 4 client.5868 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555643eadb90 con 0x555643b3d990 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b3d990 0x555644088ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b3d990 0x555644088ba0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ec0870048bea59e server_cookie=177cd6822bdb22f8 in_seq=0 out_seq=0 2024-09-21T07:26:07.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dbcc00640 10 client.5868 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1960694530 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555643eadb90 con 0x555643b3d990 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dbcc00640 10 client.5868 handle_command_reply: tid=0 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 client.5868 shutdown 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 msgr2=0x555644088190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0107c0 tx=0x7f8dcc010c80 comp rx=0 tx=0).stop 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 shutdown_connections 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b3d990 0x555644088ba0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f50570 0x555644088190 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f49310 0x555644056640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1960694530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x555644056100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 >> 172.21.15.64:0/1960694530 conn(0x555643f6db30 msgr2=0x55564404f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8dbcc00640 0 client.5868 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 shutdown_connections 2024-09-21T07:26:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 1 -- 172.21.15.64:0/1960694530 wait complete. 2024-09-21T07:26:07.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.137+0000 7f8de21ca000 20 client.5868 trim_cache size 0 max 16384 2024-09-21T07:26:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 Processor -- start 2024-09-21T07:26:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 -- start start 2024-09-21T07:26:07.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x5556440a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564404d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4204790 con 0x555643f49310 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4163f70 con 0x555643f331a0 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd42041c0 con 0x555643f50570 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36786/0 (socket says 172.21.15.64:36786) 2024-09-21T07:26:07.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.153+0000 7f8dd3400640 1 -- 172.21.15.64:0/1621416083 learned_addr learned my addr 172.21.15.64:0/1621416083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564404d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x5556440a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 -- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 msgr2=0x55564404d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564404d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 -- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 msgr2=0x5556440a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x5556440a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 -- 172.21.15.64:0/1621416083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555643e51450 con 0x555643f49310 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x5556440a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4072df0 tx=0x7f8dc000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bab498c0638693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dbf400640 1 -- 172.21.15.64:0/1621416083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0014630 con 0x555643f49310 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dbf400640 1 -- 172.21.15.64:0/1621416083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc00147d0 con 0x555643f49310 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8dbf400640 1 -- 172.21.15.64:0/1621416083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0014c20 con 0x555643f49310 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- 172.21.15.64:0/1621416083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 msgr2=0x5556440a7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4072df0 tx=0x7f8dc000f000 comp rx=0 tx=0).stop 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- 172.21.15.64:0/1621416083 shutdown_connections 2024-09-21T07:26:07.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564404d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x5556440a7070 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1621416083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x5556440a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- 172.21.15.64:0/1621416083 >> 172.21.15.64:0/1621416083 conn(0x555643f6db30 msgr2=0x5556440aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- 172.21.15.64:0/1621416083 shutdown_connections 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- 172.21.15.64:0/1621416083 wait complete. 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 -- start start 2024-09-21T07:26:07.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.157+0000 7f8de21ca000 1 Processor -- start 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564410eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564410f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555643e4fd10 con 0x555643f49310 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555643e460d0 con 0x555643f331a0 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555643e9e190 con 0x555643f50570 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 10 client.0 _ll_register_callbacks cb 0x7f8dcc009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36794/0 (socket says 172.21.15.64:36794) 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 -- 172.21.15.64:0/1112797002 learned_addr learned my addr 172.21.15.64:0/1112797002 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564410eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd8c00640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564410f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 -- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 msgr2=0x55564410f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564410f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 -- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 msgr2=0x55564410eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564410eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 -- 172.21.15.64:0/1112797002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555643f20e60 con 0x555643f49310 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3400640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x555643ea7830 tx=0x7f8dc0016ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f73f895afbc6857 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc002a070 con 0x555643f49310 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f8dc0014d90 con 0x555643f49310 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dc00147d0 con 0x555643f49310 2024-09-21T07:26:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8dc0016070 con 0x555643f49310 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 10 client.5874 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555643ef82d0 con 0x555643f49310 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc00147d0 con 0x555643f49310 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8dc0016210 con 0x555643f49310 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 10 client.5874 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 20 client.5874 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b2b9f0 0x555644051380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 4 client.5874 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x555643ea9640 con 0x555643b2b9f0 2024-09-21T07:26:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b2b9f0 0x555644051380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dd3e00640 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b2b9f0 0x555644051380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72bca5ab3350225d server_cookie=d2562e18e6838678 in_seq=0 out_seq=0 2024-09-21T07:26:07.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.161+0000 7f8dbcc00640 10 client.5874 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8dbcc00640 1 -- 172.21.15.64:0/1112797002 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555643ea9640 con 0x555643b2b9f0 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8dbcc00640 10 client.5874 handle_command_reply: tid=0 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 client.5874 shutdown 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 msgr2=0x55564410f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x555643ea7830 tx=0x7f8dc0016ca0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 shutdown_connections 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x555643b2b9f0 0x555644051380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555643f50570 0x55564410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555643f49310 0x55564410f090 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8dbcc00640 0 client.5874 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 --2- 172.21.15.64:0/1112797002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555643f331a0 0x55564410eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 >> 172.21.15.64:0/1112797002 conn(0x555643f6db30 msgr2=0x5556440a6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 shutdown_connections 2024-09-21T07:26:07.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 1 -- 172.21.15.64:0/1112797002 wait complete. 2024-09-21T07:26:07.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8de21ca000 20 client.5874 trim_cache size 0 max 16384 2024-09-21T07:26:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:07.171 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:07.171 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:26:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 msgr2=0x7f8db4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 0x7f8db4075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0007fd0 tx=0x7f8dc0007940 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 msgr2=0x7f8dd40cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4000c10 tx=0x7f8dc4005dd0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 shutdown_connections 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8db4073200 0x7f8db4075710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8dd4156170 0x7f8dd40ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd415ec20 0x7f8dd40adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 --2- 172.21.15.64:0/3260237932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dd40ca990 0x7f8dd40cc190 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 >> 172.21.15.64:0/3260237932 conn(0x7f8dd40ccbe0 msgr2=0x7f8dd415c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 shutdown_connections 2024-09-21T07:26:07.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.165+0000 7f8ddac00640 1 -- 172.21.15.64:0/3260237932 wait complete. 2024-09-21T07:26:07.189 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:26:07.189 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:07.189 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-21T07:26:07.189 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-21T07:26:07.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:07.190 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-21T07:26:07.199 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> import json 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> import sys 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> except OSError as e: 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> sys.exit(e.errno) 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> print(json.dumps( 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-21T07:26:07.200 DEBUG:teuthology.orchestra.run.smithi064:> indent=2)) 2024-09-21T07:26:07.201 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:26:07.313 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:07.313 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mode": 16893, 2024-09-21T07:26:07.313 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ino": 1099511627777, 2024-09-21T07:26:07.313 INFO:teuthology.orchestra.run.smithi064.stdout: "st_dev": 44, 2024-09-21T07:26:07.313 INFO:teuthology.orchestra.run.smithi064.stdout: "st_nlink": 16, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_uid": 1000, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_gid": 1271, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_size": 18, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_atime": 1726903553.4453974, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mtime": 1726903559.649301, 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ctime": 1726903559.649301 2024-09-21T07:26:07.314 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:07.323 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-21T07:26:07.323 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-21T07:26:07.323 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-21T07:26:07.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- 172.21.15.64:0/2096981307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c0706c0 msgr2=0x7fdf3c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 --2- 172.21.15.64:0/2096981307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c0706c0 0x7fdf3c0ce740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0b3130 tx=0x7fdf2401c790 comp rx=0 tx=0).stop 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- 172.21.15.64:0/2096981307 shutdown_connections 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 --2- 172.21.15.64:0/2096981307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf3c0ca990 0x7fdf3c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 --2- 172.21.15.64:0/2096981307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c0706c0 0x7fdf3c0ce740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- 172.21.15.64:0/2096981307 >> 172.21.15.64:0/2096981307 conn(0x7fdf3c0ccbe0 msgr2=0x7fdf3c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- 172.21.15.64:0/2096981307 shutdown_connections 2024-09-21T07:26:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- 172.21.15.64:0/2096981307 wait complete. 2024-09-21T07:26:07.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 Processor -- start 2024-09-21T07:26:07.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.521+0000 7fdf43400640 1 -- start start 2024-09-21T07:26:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf3c0ca990 0x7fdf3c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c15ec20 0x7fdf3c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf3c0c6610 0x7fdf3c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c168d70 con 0x7fdf3c0ca990 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c168bf0 con 0x7fdf3c15ec20 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c168ef0 con 0x7fdf3c0c6610 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf3c0ca990 0x7fdf3c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf3c0ca990 0x7fdf3c151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36804/0 (socket says 172.21.15.64:36804) 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 -- 172.21.15.64:0/1816515452 learned_addr learned my addr 172.21.15.64:0/1816515452 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf33e00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c15ec20 0x7fdf3c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf41400640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf3c0c6610 0x7fdf3c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 -- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf3c0c6610 msgr2=0x7fdf3c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf3c0c6610 0x7fdf3c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 -- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c15ec20 msgr2=0x7fdf3c0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf3c15ec20 0x7fdf3c0c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 -- 172.21.15.64:0/1816515452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c0c3e50 con 0x7fdf3c0ca990 2024-09-21T07:26:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf40a00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf3c0ca990 0x7fdf3c151600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c400 tx=0x7fdf2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf39600640 1 -- 172.21.15.64:0/1816515452 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c011790 con 0x7fdf3c0ca990 2024-09-21T07:26:07.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf39600640 1 -- 172.21.15.64:0/1816515452 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf2c017070 con 0x7fdf3c0ca990 2024-09-21T07:26:07.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf39600640 1 -- 172.21.15.64:0/1816515452 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c011cc0 con 0x7fdf3c0ca990 2024-09-21T07:26:07.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 -- 172.21.15.64:0/1816515452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c159b50 con 0x7fdf3c0ca990 2024-09-21T07:26:07.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.525+0000 7fdf43400640 1 -- 172.21.15.64:0/1816515452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c15a110 con 0x7fdf3c0ca990 2024-09-21T07:26:07.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf39600640 1 -- 172.21.15.64:0/1816515452 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdf2c01c460 con 0x7fdf3c0ca990 2024-09-21T07:26:07.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf39600640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf18073200 0x7fdf18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf39600640 1 -- 172.21.15.64:0/1816515452 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdf2c0940f0 con 0x7fdf3c0ca990 2024-09-21T07:26:07.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf4a998000 1 Processor -- start 2024-09-21T07:26:07.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf33e00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf18073200 0x7fdf18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf4a998000 1 -- start start 2024-09-21T07:26:07.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.529+0000 7fdf33e00640 1 --2- 172.21.15.64:0/1816515452 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf18073200 0x7fdf18075710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdf240af000 tx=0x7fdf2401afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x565265816830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x5652658172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5652656e5bf0 con 0x565265333b30 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56526565ad60 con 0x5652656d5930 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56526564a190 con 0x5652653f7d40 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36808/0 (socket says 172.21.15.64:36808) 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 -- 172.21.15.64:0/2974589651 learned_addr learned my addr 172.21.15.64:0/2974589651 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf41400640 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x5652658172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf40a00640 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x565265816830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 -- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 msgr2=0x5652658172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x5652658172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 -- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 msgr2=0x565265816830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x565265816830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 -- 172.21.15.64:0/2974589651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652655fd440 con 0x565265333b30 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf33e00640 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401d030 tx=0x7fdf240b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6641303bea88567a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf31200640 1 -- 172.21.15.64:0/2974589651 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf240c7070 con 0x565265333b30 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf31200640 1 -- 172.21.15.64:0/2974589651 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf240a5b40 con 0x565265333b30 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf31200640 1 -- 172.21.15.64:0/2974589651 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf240b2040 con 0x565265333b30 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- 172.21.15.64:0/2974589651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 msgr2=0x565265816d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401d030 tx=0x7fdf240b7000 comp rx=0 tx=0).stop 2024-09-21T07:26:07.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- 172.21.15.64:0/2974589651 shutdown_connections 2024-09-21T07:26:07.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x5652658172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x565265816d70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2974589651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x565265816830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- 172.21.15.64:0/2974589651 >> 172.21.15.64:0/2974589651 conn(0x56526571ae10 msgr2=0x56526582b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- 172.21.15.64:0/2974589651 shutdown_connections 2024-09-21T07:26:07.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- 172.21.15.64:0/2974589651 wait complete. 2024-09-21T07:26:07.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 -- start start 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.533+0000 7fdf4a998000 1 Processor -- start 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526584fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x5652658501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5652655ef710 con 0x565265333b30 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56526564dfa0 con 0x5652656d5930 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56526530f920 con 0x5652653f7d40 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 10 client.0 _ll_register_callbacks cb 0x5652656d1d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36816/0 (socket says 172.21.15.64:36816) 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 -- 172.21.15.64:0/757265412 learned_addr learned my addr 172.21.15.64:0/757265412 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf33e00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526584fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf41400640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x5652658501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 -- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 msgr2=0x56526584fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526584fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 -- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 msgr2=0x5652658501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x5652658501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 -- 172.21.15.64:0/757265412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652656185b0 con 0x565265333b30 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf40a00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c05bb00 tx=0x7fdf2c05e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d08b63319df44e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0632c0 con 0x565265333b30 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5652655e24b0 con 0x565265333b30 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdf2c078990 con 0x565265333b30 2024-09-21T07:26:07.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf2c068200 con 0x565265333b30 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 10 client.5886 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5652655e8370 con 0x565265333b30 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5652655e24b0 con 0x565265333b30 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdf2c05fb10 con 0x565265333b30 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 10 client.5886 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 10 client.5886 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 20 client.5886 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652ecbd0 0x565265859b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 4 client.5886 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56526565ccb0 con 0x5652652ecbd0 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.537+0000 7fdf33e00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652ecbd0 0x565265859b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf33e00640 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652ecbd0 0x565265859b20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73dda6336a20247b server_cookie=4869b54186503a4f in_seq=0 out_seq=0 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf29600640 10 client.5886 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf29600640 1 -- 172.21.15.64:0/757265412 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56526565ccb0 con 0x5652652ecbd0 2024-09-21T07:26:07.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf29600640 10 client.5886 handle_command_reply: tid=0 2024-09-21T07:26:07.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 client.5886 shutdown 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 msgr2=0x56526584f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c05bb00 tx=0x7fdf2c05e780 comp rx=0 tx=0).stop 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 shutdown_connections 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652ecbd0 0x565265859b20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652656d5930 0x5652658501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526584fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 --2- 172.21.15.64:0/757265412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x565265333b30 0x56526584f740 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 >> 172.21.15.64:0/757265412 conn(0x56526571ae10 msgr2=0x565265829d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf29600640 0 client.5886 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 shutdown_connections 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 1 -- 172.21.15.64:0/757265412 wait complete. 2024-09-21T07:26:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.541+0000 7fdf4a998000 20 client.5886 trim_cache size 0 max 16384 2024-09-21T07:26:07.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 Processor -- start 2024-09-21T07:26:07.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 -- start start 2024-09-21T07:26:07.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x56526585df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526585e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56526581bc30 con 0x5652656d5930 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c2033d0 con 0x565265333b30 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c2023b0 con 0x5652653f7d40 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36832/0 (socket says 172.21.15.64:36832) 2024-09-21T07:26:07.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 -- 172.21.15.64:0/2384144809 learned_addr learned my addr 172.21.15.64:0/2384144809 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf40a00640 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x56526585df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf33e00640 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526585e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 -- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 msgr2=0x56526585e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526585e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 -- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 msgr2=0x56526585df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x56526585df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.557+0000 7fdf41400640 1 -- 172.21.15.64:0/2384144809 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652656a5880 con 0x5652656d5930 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf41400640 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdf34003cd0 tx=0x7fdf34004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275433f974f05e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf2be00640 1 -- 172.21.15.64:0/2384144809 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004b30 con 0x5652656d5930 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf2be00640 1 -- 172.21.15.64:0/2384144809 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf34004cd0 con 0x5652656d5930 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf2be00640 1 -- 172.21.15.64:0/2384144809 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34005280 con 0x5652656d5930 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- 172.21.15.64:0/2384144809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 msgr2=0x56526587a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdf34003cd0 tx=0x7fdf34004410 comp rx=0 tx=0).stop 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- 172.21.15.64:0/2384144809 shutdown_connections 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652656d5930 0x56526587a040 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652653f7d40 0x56526585e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 --2- 172.21.15.64:0/2384144809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x56526585df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- 172.21.15.64:0/2384144809 >> 172.21.15.64:0/2384144809 conn(0x56526571ae10 msgr2=0x565265827520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- 172.21.15.64:0/2384144809 shutdown_connections 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- 172.21.15.64:0/2384144809 wait complete. 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 -- start start 2024-09-21T07:26:07.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.561+0000 7fdf4a998000 1 Processor -- start 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x5652658c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652656d5930 0x5652658c3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x565265659b30 con 0x5652653f7d40 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56526530f920 con 0x565265333b30 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56526564dfa0 con 0x5652656d5930 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 10 client.0 _ll_register_callbacks cb 0x7fdf2c05e1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36844/0 (socket says 172.21.15.64:36844) 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 -- 172.21.15.64:0/17196476 learned_addr learned my addr 172.21.15.64:0/17196476 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf41400640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652656d5930 0x5652658c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf40a00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x5652658c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 -- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652656d5930 msgr2=0x5652658c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652656d5930 0x5652658c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 -- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 msgr2=0x5652658c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x5652658c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 -- 172.21.15.64:0/17196476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652655d6600 con 0x5652653f7d40 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf33e00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401c7d0 tx=0x7fdf24019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7d775ab05adfd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf240dc060 con 0x5652653f7d40 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fdf240a5c10 con 0x5652653f7d40 2024-09-21T07:26:07.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf34004cd0 con 0x5652653f7d40 2024-09-21T07:26:07.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf240e2050 con 0x5652653f7d40 2024-09-21T07:26:07.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 10 client.5892 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5652655e07e0 con 0x5652653f7d40 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf34004cd0 con 0x5652653f7d40 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdf240e5020 con 0x5652653f7d40 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 10 client.5892 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 10 client.5892 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 20 client.5892 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652dac30 0x56526587e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 4 client.5892 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x565265658760 con 0x5652652dac30 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf40a00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652dac30 0x56526587e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf40a00640 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652dac30 0x56526587e090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae3f00f09bbc0b server_cookie=c15bb10e501eaedf in_seq=0 out_seq=0 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 10 client.5892 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 1 -- 172.21.15.64:0/17196476 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x565265658760 con 0x5652652dac30 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 10 client.5892 handle_command_reply: tid=0 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 client.5892 shutdown 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 msgr2=0x5652658c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401c7d0 tx=0x7fdf24019530 comp rx=0 tx=0).stop 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 shutdown_connections 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5652652dac30 0x56526587e090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5652656d5930 0x5652658c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5652653f7d40 0x5652658c2f20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 --2- 172.21.15.64:0/17196476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565265333b30 0x5652658c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf29600640 0 client.5892 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 >> 172.21.15.64:0/17196476 conn(0x56526571ae10 msgr2=0x565265827520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 shutdown_connections 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 1 -- 172.21.15.64:0/17196476 wait complete. 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.565+0000 7fdf4a998000 20 client.5892 trim_cache size 0 max 16384 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": -2 2024-09-21T07:26:07.574 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:07.575 INFO:teuthology.orchestra.run.smithi064.stderr:Error ENOENT: 2024-09-21T07:26:07.578 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T07:26:07.578 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-21T07:26:07.579 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-21T07:26:07.579 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 -- 172.21.15.64:0/4258062489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d1700 msgr2=0x7fb9b40d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 --2- 172.21.15.64:0/4258062489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d1700 0x7fb9b40d0820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009840 tx=0x7fb9a401c6b0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 -- 172.21.15.64:0/4258062489 shutdown_connections 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 --2- 172.21.15.64:0/4258062489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b40d0d60 0x7fb9b415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 --2- 172.21.15.64:0/4258062489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d1700 0x7fb9b40d0820 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 -- 172.21.15.64:0/4258062489 >> 172.21.15.64:0/4258062489 conn(0x7fb9b40d2400 msgr2=0x7fb9b40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 -- 172.21.15.64:0/4258062489 shutdown_connections 2024-09-21T07:26:07.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.737+0000 7fb9ba400640 1 -- 172.21.15.64:0/4258062489 wait complete. 2024-09-21T07:26:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 Processor -- start 2024-09-21T07:26:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 -- start start 2024-09-21T07:26:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d0d60 0x7fb9b41f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 0x7fb9b41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4169ce0 con 0x7fb9b40d1700 2024-09-21T07:26:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4071a00 con 0x7fb9b40d0d60 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9ba400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b4169e60 con 0x7fb9b415d910 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36854/0 (socket says 172.21.15.64:36854) 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 -- 172.21.15.64:0/3517992413 learned_addr learned my addr 172.21.15.64:0/3517992413 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9b3400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d0d60 0x7fb9b41f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 0x7fb9b41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 -- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 msgr2=0x7fb9b41573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 0x7fb9b41573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 -- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d0d60 msgr2=0x7fb9b41f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d0d60 0x7fb9b41f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 -- 172.21.15.64:0/3517992413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b4155bf0 con 0x7fb9b40d1700 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 0x7fb9b41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:07.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.741+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e770 tx=0x7fb99c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9abe00640 1 -- 172.21.15.64:0/3517992413 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00ccc0 con 0x7fb9b40d1700 2024-09-21T07:26:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9abe00640 1 -- 172.21.15.64:0/3517992413 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb99c00ee80 con 0x7fb9b40d1700 2024-09-21T07:26:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9abe00640 1 -- 172.21.15.64:0/3517992413 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00ce60 con 0x7fb9b40d1700 2024-09-21T07:26:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b4155ed0 con 0x7fb9b40d1700 2024-09-21T07:26:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b4156490 con 0x7fb9b40d1700 2024-09-21T07:26:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.745+0000 7fb9abe00640 1 -- 172.21.15.64:0/3517992413 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb99c005280 con 0x7fb9b40d1700 2024-09-21T07:26:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9abe00640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 0x7fb990075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9abe00640 1 -- 172.21.15.64:0/3517992413 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb99c094e10 con 0x7fb9b40d1700 2024-09-21T07:26:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 0x7fb990075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 Processor -- start 2024-09-21T07:26:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 -- start start 2024-09-21T07:26:07.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 0x7fb990075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40af000 tx=0x7fb9a401aef0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd8f71f0 0x563edda5df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563edda5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563edd86f980 con 0x563edd90d720 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563edd85edb0 con 0x563edd60cd60 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563edd862bc0 con 0x563edd8f71f0 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36868/0 (socket says 172.21.15.64:36868) 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 -- 172.21.15.64:0/2815374126 learned_addr learned my addr 172.21.15.64:0/2815374126 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 -- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd8f71f0 msgr2=0x563edda5df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd8f71f0 0x563edda5df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 -- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 msgr2=0x563edda5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563edda5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 -- 172.21.15.64:0/2815374126 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd813cc0 con 0x563edd90d720 2024-09-21T07:26:07.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9b3400640 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401ad60 tx=0x7fb9a40b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720c68d0d13afca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9a3e00640 1 -- 172.21.15.64:0/2815374126 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ca070 con 0x563edd90d720 2024-09-21T07:26:07.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9a3e00640 1 -- 172.21.15.64:0/2815374126 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9a40c1040 con 0x563edd90d720 2024-09-21T07:26:07.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.749+0000 7fb9a3e00640 1 -- 172.21.15.64:0/2815374126 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40a67d0 con 0x563edd90d720 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2815374126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 msgr2=0x563edda5da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401ad60 tx=0x7fb9a40b7000 comp rx=0 tx=0).stop 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2815374126 shutdown_connections 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563edda5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd8f71f0 0x563edda5df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2815374126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda5da40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2815374126 >> 172.21.15.64:0/2815374126 conn(0x563edd51c400 msgr2=0x563edda40ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2815374126 shutdown_connections 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2815374126 wait complete. 2024-09-21T07:26:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- start start 2024-09-21T07:26:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 Processor -- start 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563edda19790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563edda19cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563edd802f70 con 0x563edd90d720 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563edd80a0d0 con 0x563edd8f71f0 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563edd80bb50 con 0x563edd60cd60 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9c1b0e000 10 client.0 _ll_register_callbacks cb 0x563edd809770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36876/0 (socket says 172.21.15.64:36876) 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 -- 172.21.15.64:0/1043902370 learned_addr learned my addr 172.21.15.64:0/1043902370 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3400640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563edda19790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563edda19cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 -- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 msgr2=0x563edda19790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563edda19790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 -- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 msgr2=0x563edda19cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563edda19cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.753+0000 7fb9b3e00640 1 -- 172.21.15.64:0/1043902370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd7fd0d0 con 0x563edd90d720 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d7f0 tx=0x7fb9ac00d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ca7a52911fef74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac016020 con 0x563edd90d720 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb9ac012800 con 0x563edd90d720 2024-09-21T07:26:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563edd7f7210 con 0x563edd90d720 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9ac020050 con 0x563edd90d720 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 10 client.5904 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x563edd8236a0 con 0x563edd90d720 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563edd7f7210 con 0x563edd90d720 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb9ac023020 con 0x563edd90d720 2024-09-21T07:26:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 10 client.5904 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 20 client.5904 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd501bf0 0x563edda642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 4 client.5904 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563edd8718d0 con 0x563edd501bf0 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9b3400640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd501bf0 0x563edda642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9b3400640 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd501bf0 0x563edda642e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae3d2addaaa4d88 server_cookie=886118181b67965f in_seq=0 out_seq=0 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 10 client.5904 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 1 -- 172.21.15.64:0/1043902370 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563edd8718d0 con 0x563edd501bf0 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 10 client.5904 handle_command_reply: tid=0 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 client.5904 shutdown 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 msgr2=0x563edda1ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d7f0 tx=0x7fb9ac00d8e0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 shutdown_connections 2024-09-21T07:26:07.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd501bf0 0x563edda642e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563edda1ead0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563edda19cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/1043902370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563edda19790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9a0c00640 0 client.5904 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 >> 172.21.15.64:0/1043902370 conn(0x563edd51c400 msgr2=0x563edda11f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 shutdown_connections 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/1043902370 wait complete. 2024-09-21T07:26:07.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.757+0000 7fb9c1b0e000 20 client.5904 trim_cache size 0 max 16384 2024-09-21T07:26:07.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 Processor -- start 2024-09-21T07:26:07.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 -- start start 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563eddad3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563eddad3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4202610 con 0x563edd90d720 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b41fa5f0 con 0x563edd8f71f0 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b4201ff0 con 0x563edd60cd60 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36886/0 (socket says 172.21.15.64:36886) 2024-09-21T07:26:07.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 -- 172.21.15.64:0/2866400049 learned_addr learned my addr 172.21.15.64:0/2866400049 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3400640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563eddad3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563eddad3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 -- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 msgr2=0x563eddad3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563eddad3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 -- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 msgr2=0x563eddad3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.777+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563eddad3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9b3e00640 1 -- 172.21.15.64:0/2866400049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd8e5be0 con 0x563edd90d720 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563eddad3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d7c0 tx=0x7fb9ac002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f1eb28ab460c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9a3400640 1 -- 172.21.15.64:0/2866400049 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac016040 con 0x563edd90d720 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9a3400640 1 -- 172.21.15.64:0/2866400049 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9ac012600 con 0x563edd90d720 2024-09-21T07:26:07.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9a3400640 1 -- 172.21.15.64:0/2866400049 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac01b490 con 0x563edd90d720 2024-09-21T07:26:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2866400049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 msgr2=0x563eddad3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d7c0 tx=0x7fb9ac002170 comp rx=0 tx=0).stop 2024-09-21T07:26:07.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2866400049 shutdown_connections 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd90d720 0x563eddad3ed0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd8f71f0 0x563eddad3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/2866400049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd60cd60 0x563eddad3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2866400049 >> 172.21.15.64:0/2866400049 conn(0x563edd51c400 msgr2=0x563edda70a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2866400049 shutdown_connections 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/2866400049 wait complete. 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 -- start start 2024-09-21T07:26:07.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.781+0000 7fb9c1b0e000 1 Processor -- start 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563eddad7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd90d720 0x563eddad80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563edd81e7e0 con 0x563edd8f71f0 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563edd86e750 con 0x563edd60cd60 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563edd861ed0 con 0x563edd90d720 2024-09-21T07:26:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 10 client.0 _ll_register_callbacks cb 0x7fb9ac002050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36898/0 (socket says 172.21.15.64:36898) 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 -- 172.21.15.64:0/18147982 learned_addr learned my addr 172.21.15.64:0/18147982 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9b3400640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563eddad7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9b3e00640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd90d720 0x563eddad80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 -- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd90d720 msgr2=0x563eddad80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd90d720 0x563eddad80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 -- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 msgr2=0x563eddad7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563eddad7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 -- 172.21.15.64:0/18147982 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd8bbf10 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9aaa00640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb99c05f490 tx=0x7fb99c05fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84a21d314c08066 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c06a060 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb99c068c90 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9ac012600 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb99c070050 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 10 client.5910 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x563edd828ed0 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9ac012600 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb99c073020 con 0x563edd8f71f0 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 10 client.5910 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 20 client.5910 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd4efc50 0x563edda92c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 4 client.5910 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-21T07:26:07.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x563edda6de90 con 0x563edd4efc50 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9b3400640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd4efc50 0x563edda92c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9b3400640 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd4efc50 0x563edda92c70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ccdadfb5383ed1 server_cookie=4934ee5cbf478ded in_seq=0 out_seq=0 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 10 client.5910 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 1 -- 172.21.15.64:0/18147982 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x563edda6de90 con 0x563edd4efc50 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 10 client.5910 handle_command_reply: tid=0 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 client.5910 shutdown 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 msgr2=0x563eddad7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb99c05f490 tx=0x7fb99c05fc00 comp rx=0 tx=0).stop 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 shutdown_connections 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x563edd4efc50 0x563edda92c70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563edd90d720 0x563eddad80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563edd8f71f0 0x563eddad7b60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 --2- 172.21.15.64:0/18147982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563edd60cd60 0x563eddad7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9a0c00640 0 client.5910 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 >> 172.21.15.64:0/18147982 conn(0x563edd51c400 msgr2=0x563edda711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 shutdown_connections 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.785+0000 7fb9c1b0e000 1 -- 172.21.15.64:0/18147982 wait complete. 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9c1b0e000 20 client.5910 trim_cache size 0 max 16384 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": -2 2024-09-21T07:26:07.794 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 msgr2=0x7fb990075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 0x7fb990075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40af000 tx=0x7fb9a401aef0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 msgr2=0x7fb9b41551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e770 tx=0x7fb99c00ec30 comp rx=0 tx=0).stop 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 shutdown_connections 2024-09-21T07:26:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb990073200 0x7fb990075710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9b415d910 0x7fb9b41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b40d1700 0x7fb9b41551b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 --2- 172.21.15.64:0/3517992413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40d0d60 0x7fb9b41f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 >> 172.21.15.64:0/3517992413 conn(0x7fb9b40d2400 msgr2=0x7fb9b41669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 shutdown_connections 2024-09-21T07:26:07.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.789+0000 7fb9ba400640 1 -- 172.21.15.64:0/3517992413 wait complete. 2024-09-21T07:26:07.812 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-21T07:26:07.812 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-21T07:26:07.812 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 -- 172.21.15.64:0/2523814823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80080cb0e0 msgr2=0x7f800815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 --2- 172.21.15.64:0/2523814823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80080cb0e0 0x7f800815c4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009840 tx=0x7f7ff801d230 comp rx=0 tx=0).stop 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 -- 172.21.15.64:0/2523814823 shutdown_connections 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 --2- 172.21.15.64:0/2523814823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80080cb0e0 0x7f800815c4e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 -- 172.21.15.64:0/2523814823 >> 172.21.15.64:0/2523814823 conn(0x7f80080cd2b0 msgr2=0x7f80080cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 -- 172.21.15.64:0/2523814823 shutdown_connections 2024-09-21T07:26:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.969+0000 7f8007e00640 1 -- 172.21.15.64:0/2523814823 wait complete. 2024-09-21T07:26:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 Processor -- start 2024-09-21T07:26:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- start start 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f800806f870 0x7f800814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 0x7f8008150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f800816aad0 con 0x7f80080cb0e0 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f800816a950 con 0x7f80080af6d0 2024-09-21T07:26:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f800816ac50 con 0x7f800806f870 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36904/0 (socket says 172.21.15.64:36904) 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 -- 172.21.15.64:0/4208818474 learned_addr learned my addr 172.21.15.64:0/4208818474 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8006a00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f800806f870 0x7f800814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f7fffe00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 0x7f8008150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 -- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f800806f870 msgr2=0x7f800814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f800806f870 0x7f800814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 -- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 msgr2=0x7f8008150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 0x7f8008150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 -- 172.21.15.64:0/4208818474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8008151fe0 con 0x7f80080cb0e0 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f7fffe00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 0x7f8008150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007400640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f800000c760 tx=0x7f800000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f7ffea00640 1 -- 172.21.15.64:0/4208818474 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000003db0 con 0x7f80080cb0e0 2024-09-21T07:26:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f7ffea00640 1 -- 172.21.15.64:0/4208818474 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f800000ce10 con 0x7f80080cb0e0 2024-09-21T07:26:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f7ffea00640 1 -- 172.21.15.64:0/4208818474 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80000052d0 con 0x7f80080cb0e0 2024-09-21T07:26:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80081522c0 con 0x7f80080cb0e0 2024-09-21T07:26:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.973+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8008152880 con 0x7f80080cb0e0 2024-09-21T07:26:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f7ffea00640 1 -- 172.21.15.64:0/4208818474 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8000005470 con 0x7f80080cb0e0 2024-09-21T07:26:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f7ffea00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 0x7f7fe4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f7ffea00640 1 -- 172.21.15.64:0/4208818474 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f8000094100 con 0x7f80080cb0e0 2024-09-21T07:26:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f8015356000 1 Processor -- start 2024-09-21T07:26:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f8006a00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 0x7f7fe4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.977+0000 7f8015356000 1 -- start start 2024-09-21T07:26:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 0x7f7fe4075710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80ae000 tx=0x7f7ff801b010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385eea700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385eeac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a385cfba70 con 0x55a385d8b410 2024-09-21T07:26:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a385ceaea0 con 0x55a385d77f40 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a385ceecb0 con 0x55a385d71c00 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36914/0 (socket says 172.21.15.64:36914) 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 -- 172.21.15.64:0/1240554559 learned_addr learned my addr 172.21.15.64:0/1240554559 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f7fffe00640 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385eea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8007400640 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385eeac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 -- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 msgr2=0x55a385eeac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385eeac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 -- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 msgr2=0x55a385eea700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385eea700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 -- 172.21.15.64:0/1240554559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a385d976b0 con 0x55a385d8b410 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8006a00640 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80af040 tx=0x7f7ff80b9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727bd791f71dc3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f7ff7400640 1 -- 172.21.15.64:0/1240554559 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80c9070 con 0x55a385d8b410 2024-09-21T07:26:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f7ff7400640 1 -- 172.21.15.64:0/1240554559 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ff80046d0 con 0x55a385d8b410 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f7ff7400640 1 -- 172.21.15.64:0/1240554559 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8004ae0 con 0x55a385d8b410 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- 172.21.15.64:0/1240554559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 msgr2=0x55a385eea1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80af040 tx=0x7f7ff80b9000 comp rx=0 tx=0).stop 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- 172.21.15.64:0/1240554559 shutdown_connections 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385eeac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385eea700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 --2- 172.21.15.64:0/1240554559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385eea1c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- 172.21.15.64:0/1240554559 >> 172.21.15.64:0/1240554559 conn(0x55a3859a8f60 msgr2=0x55a385e9f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- 172.21.15.64:0/1240554559 shutdown_connections 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.981+0000 7f8015356000 1 -- 172.21.15.64:0/1240554559 wait complete. 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- start start 2024-09-21T07:26:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 Processor -- start 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385ea62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385ea6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a385cb2600 con 0x55a385d8b410 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a385caa860 con 0x55a385d77f40 2024-09-21T07:26:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a385cb7150 con 0x55a385d71c00 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 10 client.0 _ll_register_callbacks cb 0x55a385c957f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36918/0 (socket says 172.21.15.64:36918) 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 -- 172.21.15.64:0/4122379457 learned_addr learned my addr 172.21.15.64:0/4122379457 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8006a00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385ea62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7fffe00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385ea6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 -- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 msgr2=0x55a385ea62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385ea62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 -- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 msgr2=0x55a385ea6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385ea6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 -- 172.21.15.64:0/4122379457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a385d35590 con 0x55a385d8b410 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8006a00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385ea62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7fffe00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385ea6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8007400640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f800000c730 tx=0x7f800005e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a7aaee30ef8795 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7febe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800005e880 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f800005fbb0 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a385c83290 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f800007f050 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 10 client.5922 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.985+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a385c9e3a0 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a385c83290 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f800005dae0 con 0x55a385d8b410 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 10 client.5922 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 20 client.5922 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38598dcb0 0x55a385efb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:07.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 4 client.5922 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:07.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a385cfd9c0 con 0x55a38598dcb0 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8006a00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38598dcb0 0x55a385efb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8006a00640 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38598dcb0 0x55a385efb570 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17a2c3231f10f47 server_cookie=aae3cb6476eff508 in_seq=0 out_seq=0 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 10 client.5922 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 1 -- 172.21.15.64:0/4122379457 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a385cfd9c0 con 0x55a38598dcb0 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 10 client.5922 handle_command_reply: tid=0 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 client.5922 shutdown 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 msgr2=0x55a385ed5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:07.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f800000c730 tx=0x7f800005e0b0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 shutdown_connections 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38598dcb0 0x55a385efb570 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385ed5880 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f7febe00640 0 client.5922 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385ea6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 --2- 172.21.15.64:0/4122379457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385ea62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 >> 172.21.15.64:0/4122379457 conn(0x55a3859a8f60 msgr2=0x55a385e9f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 shutdown_connections 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 1 -- 172.21.15.64:0/4122379457 wait complete. 2024-09-21T07:26:07.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:07.989+0000 7f8015356000 20 client.5922 trim_cache size 0 max 16384 2024-09-21T07:26:08.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 Processor -- start 2024-09-21T07:26:08.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 -- start start 2024-09-21T07:26:08.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d71c00 0x55a385f5fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d77f40 0x55a385f60020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8008202380 con 0x55a385d8b410 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f800814f640 con 0x55a385d71c00 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8008157a80 con 0x55a385d77f40 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36926/0 (socket says 172.21.15.64:36926) 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 -- 172.21.15.64:0/1180804971 learned_addr learned my addr 172.21.15.64:0/1180804971 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8006a00640 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d71c00 0x55a385f5fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f7fffe00640 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d77f40 0x55a385f60020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 -- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d77f40 msgr2=0x55a385f60020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d77f40 0x55a385f60020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 -- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d71c00 msgr2=0x55a385f5fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d71c00 0x55a385f5fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 -- 172.21.15.64:0/1180804971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a385d71040 con 0x55a385d8b410 2024-09-21T07:26:08.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f8007400640 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f800005a930 tx=0x7f8000007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f639506f80be1d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.009+0000 7f7ff6a00640 1 -- 172.21.15.64:0/1180804971 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800005e880 con 0x55a385d8b410 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f7ff6a00640 1 -- 172.21.15.64:0/1180804971 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8000068210 con 0x55a385d8b410 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f7ff6a00640 1 -- 172.21.15.64:0/1180804971 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800005fbb0 con 0x55a385d8b410 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- 172.21.15.64:0/1180804971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 msgr2=0x55a385f60560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f800005a930 tx=0x7f8000007e90 comp rx=0 tx=0).stop 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- 172.21.15.64:0/1180804971 shutdown_connections 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f60560 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d77f40 0x55a385f60020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- 172.21.15.64:0/1180804971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d71c00 0x55a385f5fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- 172.21.15.64:0/1180804971 >> 172.21.15.64:0/1180804971 conn(0x55a3859a8f60 msgr2=0x55a385efb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- 172.21.15.64:0/1180804971 shutdown_connections 2024-09-21T07:26:08.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- 172.21.15.64:0/1180804971 wait complete. 2024-09-21T07:26:08.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- start start 2024-09-21T07:26:08.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 Processor -- start 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385f63cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385f641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a385cf32e0 con 0x55a385d8b410 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a385cedfc0 con 0x55a385d77f40 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a385ca0a80 con 0x55a385d71c00 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8015356000 10 client.0 _ll_register_callbacks cb 0x7f800005e650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8007400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36938/0 (socket says 172.21.15.64:36938) 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8007400640 1 -- 172.21.15.64:0/2112001548 learned_addr learned my addr 172.21.15.64:0/2112001548 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f8006a00640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385f63cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.013+0000 7f7fffe00640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385f641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 -- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 msgr2=0x55a385f63cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385f63cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 -- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 msgr2=0x55a385f641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385f641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 -- 172.21.15.64:0/2112001548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a385d482f0 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8007400640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f800000c730 tx=0x7f800005a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8208e09c258b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800006d060 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f800005a3d0 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8000068210 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8000073050 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 10 client.5928 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a385cb1a70 con 0x55a385d8b410 2024-09-21T07:26:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8000068210 con 0x55a385d8b410 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f800005d550 con 0x55a385d8b410 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 10 client.5928 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 10 client.5928 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 20 client.5928 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38597bd10 0x55a385f1f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 4 client.5928 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55a385cf9470 con 0x55a38597bd10 2024-09-21T07:26:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8006a00640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38597bd10 0x55a385f1f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 10 client.5928 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8006a00640 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38597bd10 0x55a385f1f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0b2ca7071498cfe server_cookie=8095329004029d10 in_seq=0 out_seq=0 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 1 -- 172.21.15.64:0/2112001548 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a385cf9470 con 0x55a38597bd10 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 10 client.5928 handle_command_reply: tid=0 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 client.5928 shutdown 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 msgr2=0x55a385f64730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f800000c730 tx=0x7f800005a7a0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 shutdown_connections 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55a38597bd10 0x55a385f1f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a385d8b410 0x55a385f64730 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a385d77f40 0x55a385f641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 --2- 172.21.15.64:0/2112001548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a385d71c00 0x55a385f63cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f7febe00640 0 client.5928 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 >> 172.21.15.64:0/2112001548 conn(0x55a3859a8f60 msgr2=0x55a385e9f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 shutdown_connections 2024-09-21T07:26:08.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 1 -- 172.21.15.64:0/2112001548 wait complete. 2024-09-21T07:26:08.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.017+0000 7f8015356000 20 client.5928 trim_cache size 0 max 16384 2024-09-21T07:26:08.026 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:08.027 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:08.027 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "1d921a40-ece2-4ddf-82ea-fd0245f4ed53", 2024-09-21T07:26:08.027 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:08.027 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 msgr2=0x7f7fe4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 0x7f7fe4075710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80ae000 tx=0x7f7ff801b010 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 msgr2=0x7f8008159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f800000c760 tx=0x7f800000cc20 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 shutdown_connections 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7fe4073200 0x7f7fe4075710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80080cb0e0 0x7f8008159b70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80080af6d0 0x7f8008150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 --2- 172.21.15.64:0/4208818474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f800806f870 0x7f800814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 >> 172.21.15.64:0/4208818474 conn(0x7f80080cd2b0 msgr2=0x7f800815cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 shutdown_connections 2024-09-21T07:26:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.021+0000 7f8007e00640 1 -- 172.21.15.64:0/4208818474 wait complete. 2024-09-21T07:26:08.043 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '1d921a40-ece2-4ddf-82ea-fd0245f4ed53', 'mode': 'asynchronous'}' 2024-09-21T07:26:08.043 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-21T07:26:08.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 -- 172.21.15.64:0/1614418583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640b3140 msgr2=0x7f9d640b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 --2- 172.21.15.64:0/1614418583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640b3140 0x7f9d640b3550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009840 tx=0x7f9d4c01c820 comp rx=0 tx=0).stop 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 -- 172.21.15.64:0/1614418583 shutdown_connections 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 --2- 172.21.15.64:0/1614418583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640b3140 0x7f9d640b3550 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 --2- 172.21.15.64:0/1614418583 >> v2:172.21.15.90:3300/0 conn(0x7f9d640cc960 0x7f9d6415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.201+0000 7f9d6a200640 1 -- 172.21.15.64:0/1614418583 >> 172.21.15.64:0/1614418583 conn(0x7f9d6406d450 msgr2=0x7f9d640d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- 172.21.15.64:0/1614418583 shutdown_connections 2024-09-21T07:26:08.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- 172.21.15.64:0/1614418583 wait complete. 2024-09-21T07:26:08.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 Processor -- start 2024-09-21T07:26:08.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- start start 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d640b3140 0x7f9d64151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640cc960 0x7f9d641580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64169150 con 0x7f9d6406f890 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64168fd0 con 0x7f9d640b3140 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d6a200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d641692d0 con 0x7f9d640cc960 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.205+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36954/0 (socket says 172.21.15.64:36954) 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 -- 172.21.15.64:0/2119329034 learned_addr learned my addr 172.21.15.64:0/2119329034 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d5be00640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d640b3140 0x7f9d64151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63e00640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640cc960 0x7f9d641580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 -- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640cc960 msgr2=0x7f9d641580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640cc960 0x7f9d641580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 -- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d640b3140 msgr2=0x7f9d64151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d640b3140 0x7f9d64151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 -- 172.21.15.64:0/2119329034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d640b26e0 con 0x7f9d6406f890 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d63400640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400ea40 tx=0x7f9d5400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d5b400640 1 -- 172.21.15.64:0/2119329034 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400ce40 con 0x7f9d6406f890 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d5b400640 1 -- 172.21.15.64:0/2119329034 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d54004020 con 0x7f9d6406f890 2024-09-21T07:26:08.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d5b400640 1 -- 172.21.15.64:0/2119329034 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54004470 con 0x7f9d6406f890 2024-09-21T07:26:08.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d641f6e20 con 0x7f9d6406f890 2024-09-21T07:26:08.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d641fb110 con 0x7f9d6406f890 2024-09-21T07:26:08.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.209+0000 7f9d5b400640 1 -- 172.21.15.64:0/2119329034 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d54005030 con 0x7f9d6406f890 2024-09-21T07:26:08.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 Processor -- start 2024-09-21T07:26:08.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5b400640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 0x7f9d40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 -- start start 2024-09-21T07:26:08.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5b400640 1 -- 172.21.15.64:0/2119329034 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f9d54094d20 con 0x7f9d6406f890 2024-09-21T07:26:08.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d63e00640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 0x7f9d40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d63e00640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 0x7f9d40075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c001ba0 tx=0x7f9d5c001b30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa13230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899840 0x564baaa13cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564baa825fc0 con 0x564baa899030 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564baa8153f0 con 0x564baa899840 2024-09-21T07:26:08.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564baa819200 con 0x564baa8ac430 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d63400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa13230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36962/0 (socket says 172.21.15.64:36962) 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 -- 172.21.15.64:0/4079962316 learned_addr learned my addr 172.21.15.64:0/4079962316 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d63e00640 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899840 0x564baaa13cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 -- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 msgr2=0x564baaa13230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa13230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 -- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899840 msgr2=0x564baaa13cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899840 0x564baaa13cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 -- 172.21.15.64:0/4079962316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564baa7d5640 con 0x564baa899030 2024-09-21T07:26:08.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d5be00640 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0b0040 tx=0x7f9d4c0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375487423fa6dcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d53400640 1 -- 172.21.15.64:0/4079962316 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0a66f0 con 0x564baa899030 2024-09-21T07:26:08.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d53400640 1 -- 172.21.15.64:0/4079962316 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c004030 con 0x564baa899030 2024-09-21T07:26:08.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.213+0000 7f9d53400640 1 -- 172.21.15.64:0/4079962316 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c004480 con 0x564baa899030 2024-09-21T07:26:08.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- 172.21.15.64:0/4079962316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 msgr2=0x564baaa13770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0b0040 tx=0x7f9d4c0195c0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- 172.21.15.64:0/4079962316 shutdown_connections 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899840 0x564baaa13cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa13770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- 172.21.15.64:0/4079962316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa13230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- 172.21.15.64:0/4079962316 >> 172.21.15.64:0/4079962316 conn(0x564baa4d1f70 msgr2=0x564baa9f66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- 172.21.15.64:0/4079962316 shutdown_connections 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- 172.21.15.64:0/4079962316 wait complete. 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- start start 2024-09-21T07:26:08.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 Processor -- start 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa19b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa1a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564baa7baad0 con 0x564baa899030 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564baa7d1e80 con 0x564baa8ac430 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564baa7c0520 con 0x564baa899840 2024-09-21T07:26:08.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d71a88000 10 client.0 _ll_register_callbacks cb 0x564baa9b45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36972/0 (socket says 172.21.15.64:36972) 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.217+0000 7f9d63400640 1 -- 172.21.15.64:0/504849389 learned_addr learned my addr 172.21.15.64:0/504849389 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63e00640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa1a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d5be00640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa19b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 -- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 msgr2=0x564baaa19b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa19b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 -- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 msgr2=0x564baaa1a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa1a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 -- 172.21.15.64:0/504849389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564baa7aad70 con 0x564baa899030 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63e00640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa1a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d63400640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400ea10 tx=0x7f9d5405faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57daddb064b6c73c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5407e060 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f9d5405aea0 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564baa7ad910 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d54079030 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 10 client.5937 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x564baa7b37d0 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564baa7ad910 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f9d54020030 con 0x564baa899030 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 10 client.5937 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 10 client.5937 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 20 client.5937 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4b8010 0x564baaa23a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 4 client.5937 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564baa827f10 con 0x564baa4b8010 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d5be00640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4b8010 0x564baaa23a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d5be00640 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4b8010 0x564baaa23a20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7090e0e32cf6e653 server_cookie=d50be1e12a08d90f in_seq=0 out_seq=0 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 10 client.5937 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 1 -- 172.21.15.64:0/504849389 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564baa827f10 con 0x564baa4b8010 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 10 client.5937 handle_command_reply: tid=0 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 client.5937 shutdown 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 msgr2=0x564baaa19640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400ea10 tx=0x7f9d5405faa0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 shutdown_connections 2024-09-21T07:26:08.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4b8010 0x564baaa23a20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa1a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa19b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d47e00640 0 client.5937 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 --2- 172.21.15.64:0/504849389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa19640 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 >> 172.21.15.64:0/504849389 conn(0x564baa4d1f70 msgr2=0x564baa9f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 shutdown_connections 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 1 -- 172.21.15.64:0/504849389 wait complete. 2024-09-21T07:26:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.221+0000 7f9d71a88000 20 client.5937 trim_cache size 0 max 16384 2024-09-21T07:26:08.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 Processor -- start 2024-09-21T07:26:08.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 -- start start 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899030 0x564baaa19ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa1c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64202ae0 con 0x564baa899840 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d640cd680 con 0x564baa899030 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.241+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d642025b0 con 0x564baa8ac430 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36982/0 (socket says 172.21.15.64:36982) 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 -- 172.21.15.64:0/982010035 learned_addr learned my addr 172.21.15.64:0/982010035 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d63400640 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899030 0x564baaa19ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d63e00640 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa1c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 -- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 msgr2=0x564baaa1c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa1c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 -- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899030 msgr2=0x564baaa19ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899030 0x564baaa19ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 -- 172.21.15.64:0/982010035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564baa8710d0 con 0x564baa899840 2024-09-21T07:26:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d5be00640 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c01aed0 tx=0x7f9d4c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5d7846f3938368 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d52a00640 1 -- 172.21.15.64:0/982010035 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0a66f0 con 0x564baa899840 2024-09-21T07:26:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d52a00640 1 -- 172.21.15.64:0/982010035 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c0c7070 con 0x564baa899840 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d52a00640 1 -- 172.21.15.64:0/982010035 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0a6e60 con 0x564baa899840 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- 172.21.15.64:0/982010035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 msgr2=0x564baaa1a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c01aed0 tx=0x7f9d4c01c820 comp rx=0 tx=0).stop 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- 172.21.15.64:0/982010035 shutdown_connections 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa8ac430 0x564baaa1c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899840 0x564baaa1a010 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 --2- 172.21.15.64:0/982010035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa899030 0x564baaa19ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- 172.21.15.64:0/982010035 >> 172.21.15.64:0/982010035 conn(0x564baa4d1f70 msgr2=0x564baa9f5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- 172.21.15.64:0/982010035 shutdown_connections 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- 172.21.15.64:0/982010035 wait complete. 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 -- start start 2024-09-21T07:26:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.245+0000 7f9d71a88000 1 Processor -- start 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa89040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa89580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564baa7e2000 con 0x564baa899030 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564baa824d90 con 0x564baa8ac430 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564baa818510 con 0x564baa899840 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 10 client.0 _ll_register_callbacks cb 0x7f9d5405b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36984/0 (socket says 172.21.15.64:36984) 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 -- 172.21.15.64:0/727734188 learned_addr learned my addr 172.21.15.64:0/727734188 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63e00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa89580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d5be00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa89040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 -- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 msgr2=0x564baaa89040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa89040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 -- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 msgr2=0x564baaa89580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa89580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 -- 172.21.15.64:0/727734188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564baa7db440 con 0x564baa899030 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d5be00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa89040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63e00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa89580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d63400640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009230 tx=0x7f9d5405b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f32c95ce1ba23b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5404ce60 con 0x564baa899030 2024-09-21T07:26:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f9d54066390 con 0x564baa899030 2024-09-21T07:26:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d4c0c7070 con 0x564baa899030 2024-09-21T07:26:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d54053050 con 0x564baa899030 2024-09-21T07:26:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 10 client.5943 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x564baa7abf60 con 0x564baa899030 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c0c7070 con 0x564baa899030 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f9d54056020 con 0x564baa899030 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 10 client.5943 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 20 client.5943 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4a6070 0x564baaa44780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 4 client.5943 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x564baa8239c0 con 0x564baa4a6070 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d5be00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4a6070 0x564baaa44780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d5be00640 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4a6070 0x564baaa44780 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f22174331c5155 server_cookie=6f3da40eb2c6920a in_seq=0 out_seq=0 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.249+0000 7f9d47e00640 10 client.5943 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d47e00640 1 -- 172.21.15.64:0/727734188 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564baa8239c0 con 0x564baa4a6070 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d47e00640 10 client.5943 handle_command_reply: tid=0 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 client.5943 shutdown 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 msgr2=0x564baaa88b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009230 tx=0x7f9d5405b150 comp rx=0 tx=0).stop 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 shutdown_connections 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x564baa4a6070 0x564baaa44780 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564baa8ac430 0x564baaa89580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564baa899840 0x564baaa89040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 --2- 172.21.15.64:0/727734188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564baa899030 0x564baaa88b00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 >> 172.21.15.64:0/727734188 conn(0x564baa4d1f70 msgr2=0x564baaa1b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d47e00640 0 client.5943 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 shutdown_connections 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 1 -- 172.21.15.64:0/727734188 wait complete. 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d71a88000 20 client.5943 trim_cache size 0 max 16384 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "f42caeff-68cd-4e1a-a48e-966f124d5b15", 2024-09-21T07:26:08.259 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:08.260 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:08.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 msgr2=0x7f9d40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 0x7f9d40075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c001ba0 tx=0x7f9d5c001b30 comp rx=0 tx=0).stop 2024-09-21T07:26:08.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 msgr2=0x7f9d641fabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400ea40 tx=0x7f9d5400ef00 comp rx=0 tx=0).stop 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 shutdown_connections 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073200 0x7f9d40075710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d640cc960 0x7f9d641580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d640b3140 0x7f9d64151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 --2- 172.21.15.64:0/2119329034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d6406f890 0x7f9d641fabd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 >> 172.21.15.64:0/2119329034 conn(0x7f9d6406d450 msgr2=0x7f9d6415d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 shutdown_connections 2024-09-21T07:26:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.253+0000 7f9d6a200640 1 -- 172.21.15.64:0/2119329034 wait complete. 2024-09-21T07:26:08.277 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'f42caeff-68cd-4e1a-a48e-966f124d5b15', 'mode': 'asynchronous'}' 2024-09-21T07:26:08.277 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-21T07:26:08.277 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 -- 172.21.15.64:0/3443258547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240cda70 msgr2=0x7fbb240cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3443258547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240cda70 0x7fbb240cde80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009840 tx=0x7fbb0c01c700 comp rx=0 tx=0).stop 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 -- 172.21.15.64:0/3443258547 shutdown_connections 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3443258547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240cda70 0x7fbb240cde80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 -- 172.21.15.64:0/3443258547 >> 172.21.15.64:0/3443258547 conn(0x7fbb240d12b0 msgr2=0x7fbb240d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 -- 172.21.15.64:0/3443258547 shutdown_connections 2024-09-21T07:26:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.433+0000 7fbb2b000640 1 -- 172.21.15.64:0/3443258547 wait complete. 2024-09-21T07:26:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 Processor -- start 2024-09-21T07:26:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 -- start start 2024-09-21T07:26:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb240cda70 0x7fbb240b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 0x7fbb241fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240cd030 con 0x7fbb240b4100 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240cceb0 con 0x7fbb240ce3c0 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb2b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2416a1c0 con 0x7fbb240cda70 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36998/0 (socket says 172.21.15.64:36998) 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb23e00640 1 -- 172.21.15.64:0/3258805812 learned_addr learned my addr 172.21.15.64:0/3258805812 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.437+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb240cda70 0x7fbb240b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb29000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 0x7fbb241fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 -- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb240cda70 msgr2=0x7fbb240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb240cda70 0x7fbb240b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 -- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 msgr2=0x7fbb241fa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 0x7fbb241fa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 -- 172.21.15.64:0/3258805812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb240c5900 con 0x7fbb240b4100 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb29000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 0x7fbb241fa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c400 tx=0x7fbb1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb20c00640 1 -- 172.21.15.64:0/3258805812 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14017070 con 0x7fbb240b4100 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb240c5be0 con 0x7fbb240b4100 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb20c00640 1 -- 172.21.15.64:0/3258805812 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb14005400 con 0x7fbb240b4100 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb20c00640 1 -- 172.21.15.64:0/3258805812 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14003860 con 0x7fbb240b4100 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb240c61a0 con 0x7fbb240b4100 2024-09-21T07:26:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb20c00640 1 -- 172.21.15.64:0/3258805812 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbb1401a070 con 0x7fbb240b4100 2024-09-21T07:26:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.441+0000 7fbb20c00640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 0x7fbb00075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb20c00640 1 -- 172.21.15.64:0/3258805812 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fbb14093760 con 0x7fbb240b4100 2024-09-21T07:26:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 0x7fbb00075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 Processor -- start 2024-09-21T07:26:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 -- start start 2024-09-21T07:26:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 0x7fbb00075710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0af000 tx=0x7fbb0c0b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36ae4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d369942f0 0x560d36ae5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560d368f6c20 con 0x560d3697e180 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d368e6050 con 0x560d369942f0 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560d368e9e60 con 0x560d3699b550 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37002/0 (socket says 172.21.15.64:37002) 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 -- 172.21.15.64:0/3108760825 learned_addr learned my addr 172.21.15.64:0/3108760825 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36ae4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d369942f0 0x560d36ae5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 -- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 msgr2=0x560d36ae4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36ae4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 -- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d369942f0 msgr2=0x560d36ae5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d369942f0 0x560d36ae5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 -- 172.21.15.64:0/3108760825 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d36866770 con 0x560d3697e180 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36ae4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb29000640 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0021a0 tx=0x7fbb1c00d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa74d88d309ad472 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb18c00640 1 -- 172.21.15.64:0/3108760825 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c016020 con 0x560d3697e180 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb18c00640 1 -- 172.21.15.64:0/3108760825 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1c0123f0 con 0x560d3697e180 2024-09-21T07:26:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.445+0000 7fbb18c00640 1 -- 172.21.15.64:0/3108760825 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0127a0 con 0x560d3697e180 2024-09-21T07:26:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- 172.21.15.64:0/3108760825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 msgr2=0x560d36ae5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0021a0 tx=0x7fbb1c00d210 comp rx=0 tx=0).stop 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- 172.21.15.64:0/3108760825 shutdown_connections 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3697e180 0x560d36ae5960 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d369942f0 0x560d36ae5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3108760825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36ae4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- 172.21.15.64:0/3108760825 >> 172.21.15.64:0/3108760825 conn(0x560d369b8b10 msgr2=0x560d36aa2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- 172.21.15.64:0/3108760825 shutdown_connections 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- 172.21.15.64:0/3108760825 wait complete. 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- start start 2024-09-21T07:26:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 Processor -- start 2024-09-21T07:26:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36aa05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36aa6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560d3688b560 con 0x560d369942f0 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d3689b9e0 con 0x560d3697e180 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560d369a0a00 con 0x560d3699b550 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb325c1000 10 client.0 _ll_register_callbacks cb 0x560d36a87a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37018/0 (socket says 172.21.15.64:37018) 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 -- 172.21.15.64:0/1051759680 learned_addr learned my addr 172.21.15.64:0/1051759680 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb23e00640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36aa05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb29000640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36aa6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 -- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 msgr2=0x560d36aa6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36aa6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 -- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 msgr2=0x560d36aa05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36aa05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb1b400640 1 -- 172.21.15.64:0/1051759680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d368a1f40 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.449+0000 7fbb29000640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36aa6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb1b400640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c019310 tx=0x7fbb0c01af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51402e9f546a728c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0cb060 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fbb0c005510 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d3687e370 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb0c0d1050 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 10 client.5955 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560d36884230 con 0x560d369942f0 2024-09-21T07:26:08.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560d3687e370 con 0x560d369942f0 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fbb0c0d4020 con 0x560d369942f0 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 10 client.5955 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 10 client.5955 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 20 client.5955 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d365889c0 0x560d36aa76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 4 client.5955 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d368f8b70 con 0x560d365889c0 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb23e00640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d365889c0 0x560d36aa76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb23e00640 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d365889c0 0x560d36aa76b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4410b11ab7750d93 server_cookie=f41a6bd814d680f6 in_seq=0 out_seq=0 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 10 client.5955 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 1 -- 172.21.15.64:0/1051759680 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d368f8b70 con 0x560d365889c0 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 10 client.5955 handle_command_reply: tid=0 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 client.5955 shutdown 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 msgr2=0x560d36aa0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c019310 tx=0x7fbb0c01af40 comp rx=0 tx=0).stop 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 shutdown_connections 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d365889c0 0x560d36aa76b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3699b550 0x560d36aa6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36aa0b10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 --2- 172.21.15.64:0/1051759680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36aa05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb11600640 0 client.5955 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 >> 172.21.15.64:0/1051759680 conn(0x560d369b8b10 msgr2=0x560d36a9a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 shutdown_connections 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 1 -- 172.21.15.64:0/1051759680 wait complete. 2024-09-21T07:26:08.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.453+0000 7fbb325c1000 20 client.5955 trim_cache size 0 max 16384 2024-09-21T07:26:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 Processor -- start 2024-09-21T07:26:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 -- start start 2024-09-21T07:26:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36b55c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d369942f0 0x560d36b561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240c9ed0 con 0x560d3699b550 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24162450 con 0x560d3697e180 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbb240c9880 con 0x560d369942f0 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37032/0 (socket says 172.21.15.64:37032) 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb29000640 1 -- 172.21.15.64:0/2839170580 learned_addr learned my addr 172.21.15.64:0/2839170580 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb23e00640 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36b55c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.473+0000 7fbb1b400640 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d369942f0 0x560d36b561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 -- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d369942f0 msgr2=0x560d36b561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d369942f0 0x560d36b561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 -- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 msgr2=0x560d36b55c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36b55c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 -- 172.21.15.64:0/2839170580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d36aa7010 con 0x560d3699b550 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb29000640 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c015040 tx=0x7fbb1c001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a311b6f1b3bf2ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb13e00640 1 -- 172.21.15.64:0/2839170580 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c02a070 con 0x560d3699b550 2024-09-21T07:26:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb13e00640 1 -- 172.21.15.64:0/2839170580 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1c01b420 con 0x560d3699b550 2024-09-21T07:26:08.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb13e00640 1 -- 172.21.15.64:0/2839170580 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c016040 con 0x560d3699b550 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- 172.21.15.64:0/2839170580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 msgr2=0x560d36b56710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c015040 tx=0x7fbb1c001520 comp rx=0 tx=0).stop 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- 172.21.15.64:0/2839170580 shutdown_connections 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d3699b550 0x560d36b56710 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d369942f0 0x560d36b561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 --2- 172.21.15.64:0/2839170580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3697e180 0x560d36b55c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- 172.21.15.64:0/2839170580 >> 172.21.15.64:0/2839170580 conn(0x560d369b8b10 msgr2=0x560d36a9f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- 172.21.15.64:0/2839170580 shutdown_connections 2024-09-21T07:26:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- 172.21.15.64:0/2839170580 wait complete. 2024-09-21T07:26:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 -- start start 2024-09-21T07:26:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.477+0000 7fbb325c1000 1 Processor -- start 2024-09-21T07:26:08.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3697e180 0x560d36b59e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3699b550 0x560d36b5a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560d3689acf0 con 0x560d369942f0 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d368910b0 con 0x560d3699b550 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560d368e9170 con 0x560d3697e180 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 10 client.0 _ll_register_callbacks cb 0x7fbb08003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37042/0 (socket says 172.21.15.64:37042) 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3697e180 0x560d36b59e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 -- 172.21.15.64:0/3341271575 learned_addr learned my addr 172.21.15.64:0/3341271575 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb29000640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3699b550 0x560d36b5a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 -- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3697e180 msgr2=0x560d36b59e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3697e180 0x560d36b59e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 -- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3699b550 msgr2=0x560d36b5a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3699b550 0x560d36b5a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 -- 172.21.15.64:0/3341271575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3689c430 con 0x560d369942f0 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb1b400640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0980e0 tx=0x7fbb0c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56d593c66488847 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0d9020 con 0x560d369942f0 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fbb0c0cb9b0 con 0x560d369942f0 2024-09-21T07:26:08.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb1c01b420 con 0x560d369942f0 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb0c0cbbb0 con 0x560d369942f0 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 10 client.5961 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560d3696be40 con 0x560d369942f0 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1c01b420 con 0x560d369942f0 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fbb0c0d4040 con 0x560d369942f0 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 10 client.5961 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 20 client.5961 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d36576a20 0x560d36b15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 4 client.5961 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x560d368f4620 con 0x560d36576a20 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d36576a20 0x560d36b15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb23e00640 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d36576a20 0x560d36b15df0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7d3cf0c66447c6 server_cookie=cea6d90a1d4e3f5a in_seq=0 out_seq=0 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 10 client.5961 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 1 -- 172.21.15.64:0/3341271575 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560d368f4620 con 0x560d36576a20 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 10 client.5961 handle_command_reply: tid=0 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 client.5961 shutdown 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 msgr2=0x560d36b5a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0980e0 tx=0x7fbb0c009580 comp rx=0 tx=0).stop 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 shutdown_connections 2024-09-21T07:26:08.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560d36576a20 0x560d36b15df0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d3699b550 0x560d36b5a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d369942f0 0x560d36b5a360 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 --2- 172.21.15.64:0/3341271575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560d3697e180 0x560d36b59e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb11600640 0 client.5961 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.481+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 >> 172.21.15.64:0/3341271575 conn(0x560d369b8b10 msgr2=0x560d36a9fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 shutdown_connections 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb325c1000 1 -- 172.21.15.64:0/3341271575 wait complete. 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb325c1000 20 client.5961 trim_cache size 0 max 16384 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:08.491 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "d110de51-fd10-4539-b4b9-2fd7dfc5e519", 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 msgr2=0x7fbb00075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 0x7fbb00075710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0af000 tx=0x7fbb0c0b2040 comp rx=0 tx=0).stop 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 msgr2=0x7fbb241642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c400 tx=0x7fbb1400c8c0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 shutdown_connections 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb00073200 0x7fbb00075710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb240ce3c0 0x7fbb241fa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb240cda70 0x7fbb240b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 --2- 172.21.15.64:0/3258805812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb240b4100 0x7fbb241642e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 >> 172.21.15.64:0/3258805812 conn(0x7fbb240d12b0 msgr2=0x7fbb24167a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 shutdown_connections 2024-09-21T07:26:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.485+0000 7fbb2b000640 1 -- 172.21.15.64:0/3258805812 wait complete. 2024-09-21T07:26:08.508 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'd110de51-fd10-4539-b4b9-2fd7dfc5e519', 'mode': 'asynchronous'}' 2024-09-21T07:26:08.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:08.509 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-21T07:26:08.519 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-21T07:26:08.519 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 -- 172.21.15.64:0/3443867327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d600b29d0 msgr2=0x7f7d6015e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 --2- 172.21.15.64:0/3443867327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d600b29d0 0x7f7d6015e760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009bc0 tx=0x7f7d5c01cb70 comp rx=0 tx=0).stop 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 -- 172.21.15.64:0/3443867327 shutdown_connections 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 --2- 172.21.15.64:0/3443867327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d600b29d0 0x7f7d6015e760 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 --2- 172.21.15.64:0/3443867327 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d6015ac00 0x7f7d6006ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 -- 172.21.15.64:0/3443867327 >> 172.21.15.64:0/3443867327 conn(0x7f7d600cd2c0 msgr2=0x7f7d600cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 -- 172.21.15.64:0/3443867327 shutdown_connections 2024-09-21T07:26:08.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.721+0000 7f7d67200640 1 -- 172.21.15.64:0/3443867327 wait complete. 2024-09-21T07:26:08.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 Processor -- start 2024-09-21T07:26:08.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 -- start start 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d6015ac00 0x7f7d600b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d600c8b50 0x7f7d600b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d60168fa0 con 0x7f7d6006f790 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d60168e20 con 0x7f7d600c8b50 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d67200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d60169120 con 0x7f7d6015ac00 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37066/0 (socket says 172.21.15.64:37066) 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 -- 172.21.15.64:0/1510909815 learned_addr learned my addr 172.21.15.64:0/1510909815 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 -- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d6015ac00 msgr2=0x7f7d600b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d6015ac00 0x7f7d600b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 -- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d600c8b50 msgr2=0x7f7d600b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d600c8b50 0x7f7d600b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 -- 172.21.15.64:0/1510909815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d600c9280 con 0x7f7d6006f790 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d65e00640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400e7f0 tx=0x7f7d5400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.725+0000 7f7d5a000640 1 -- 172.21.15.64:0/1510909815 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400ccc0 con 0x7f7d6006f790 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d5a000640 1 -- 172.21.15.64:0/1510909815 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d5400ce80 con 0x7f7d6006f790 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d600c9560 con 0x7f7d6006f790 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d5a000640 1 -- 172.21.15.64:0/1510909815 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54005280 con 0x7f7d6006f790 2024-09-21T07:26:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d600c9b20 con 0x7f7d6006f790 2024-09-21T07:26:08.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d5a000640 1 -- 172.21.15.64:0/1510909815 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d54005420 con 0x7f7d6006f790 2024-09-21T07:26:08.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d5a000640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 0x7f7d44075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.729+0000 7f7d5a000640 1 -- 172.21.15.64:0/1510909815 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7d54094e80 con 0x7f7d6006f790 2024-09-21T07:26:08.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 Processor -- start 2024-09-21T07:26:08.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d65400640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 0x7f7d44075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- start start 2024-09-21T07:26:08.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d65400640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 0x7f7d44075740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d500046c0 tx=0x7f7d50007910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99358b70 0x560c994d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c992e3db0 con 0x560c99080e60 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560c992d31e0 con 0x560c9935fe70 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560c992d6ff0 con 0x560c99358b70 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37078/0 (socket says 172.21.15.64:37078) 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 -- 172.21.15.64:0/2786577853 learned_addr learned my addr 172.21.15.64:0/2786577853 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d65400640 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99358b70 0x560c994d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d65e00640 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 -- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99358b70 msgr2=0x560c994d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99358b70 0x560c994d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 -- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 msgr2=0x560c994d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 -- 172.21.15.64:0/2786577853 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c992864e0 con 0x560c99080e60 2024-09-21T07:26:08.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d66800640 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c01c5e0 tx=0x7f7d5c005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb58475a540bc39d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d4e600640 1 -- 172.21.15.64:0/2786577853 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0b2040 con 0x560c99080e60 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d4e600640 1 -- 172.21.15.64:0/2786577853 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d5c009200 con 0x560c99080e60 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d4e600640 1 -- 172.21.15.64:0/2786577853 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c003ba0 con 0x560c99080e60 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- 172.21.15.64:0/2786577853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 msgr2=0x560c994d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c01c5e0 tx=0x7f7d5c005af0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- 172.21.15.64:0/2786577853 shutdown_connections 2024-09-21T07:26:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99080e60 0x560c994d2020 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99358b70 0x560c994d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/2786577853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- 172.21.15.64:0/2786577853 >> 172.21.15.64:0/2786577853 conn(0x560c9938fc30 msgr2=0x560c99486870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- 172.21.15.64:0/2786577853 shutdown_connections 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.733+0000 7f7d6fefe000 1 -- 172.21.15.64:0/2786577853 wait complete. 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 -- start start 2024-09-21T07:26:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 Processor -- start 2024-09-21T07:26:08.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c994d7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c992772b0 con 0x560c99358b70 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560c9929ccc0 con 0x560c9935fe70 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560c992e2b80 con 0x560c99080e60 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 10 client.0 _ll_register_callbacks cb 0x560c99473500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37086/0 (socket says 172.21.15.64:37086) 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 -- 172.21.15.64:0/4136908843 learned_addr learned my addr 172.21.15.64:0/4136908843 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65e00640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c994d7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d66800640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 -- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 msgr2=0x560c994d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c994d7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 -- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 msgr2=0x560c994d84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 -- 172.21.15.64:0/4136908843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c99253b00 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d65400640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7d50014ef0 tx=0x7f7d50004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8964fd3a68bce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d42a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50025060 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7d500205f0 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.737+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c9926b550 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d5002b050 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 10 client.5976 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560c9928f120 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560c9926b550 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f7d5002e020 con 0x560c99358b70 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 10 client.5976 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 20 client.5976 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f75cf0 0x560c994e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 4 client.5976 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c992e5d00 con 0x560c98f75cf0 2024-09-21T07:26:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d65e00640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f75cf0 0x560c994e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d65e00640 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f75cf0 0x560c994e1e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b3f77009a7a27d server_cookie=6b22be193f53745d in_seq=0 out_seq=0 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 10 client.5976 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 1 -- 172.21.15.64:0/4136908843 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c992e5d00 con 0x560c98f75cf0 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 10 client.5976 handle_command_reply: tid=0 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 client.5976 shutdown 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 msgr2=0x560c994d7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7d50014ef0 tx=0x7f7d50004630 comp rx=0 tx=0).stop 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 shutdown_connections 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f75cf0 0x560c994e1e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c994d84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c994d7f60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/4136908843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c994d7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d42a00640 0 client.5976 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 >> 172.21.15.64:0/4136908843 conn(0x560c9938fc30 msgr2=0x560c99487000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 shutdown_connections 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 1 -- 172.21.15.64:0/4136908843 wait complete. 2024-09-21T07:26:08.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.741+0000 7f7d6fefe000 20 client.5976 trim_cache size 0 max 16384 2024-09-21T07:26:08.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.757+0000 7f7d6fefe000 1 Processor -- start 2024-09-21T07:26:08.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.757+0000 7f7d6fefe000 1 -- start start 2024-09-21T07:26:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.757+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c9948d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.757+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.757+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c99486ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d60204ad0 con 0x560c99358b70 2024-09-21T07:26:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6014a980 con 0x560c9935fe70 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d60204480 con 0x560c99080e60 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37096/0 (socket says 172.21.15.64:37096) 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 -- 172.21.15.64:0/1921651232 learned_addr learned my addr 172.21.15.64:0/1921651232 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65e00640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c9948d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d66800640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c99486ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 -- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 msgr2=0x560c9948d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c9948d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 -- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 msgr2=0x560c99486ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c99486ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 -- 172.21.15.64:0/1921651232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c99271410 con 0x560c99358b70 2024-09-21T07:26:08.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65e00640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c9948d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d65400640 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d50001030 tx=0x7f7d50011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a2f12f7088cf33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d4dc00640 1 -- 172.21.15.64:0/1921651232 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50034070 con 0x560c99358b70 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d4dc00640 1 -- 172.21.15.64:0/1921651232 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d500203f0 con 0x560c99358b70 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d4dc00640 1 -- 172.21.15.64:0/1921651232 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5002f3f0 con 0x560c99358b70 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- 172.21.15.64:0/1921651232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 msgr2=0x560c9948dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d50001030 tx=0x7f7d50011000 comp rx=0 tx=0).stop 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- 172.21.15.64:0/1921651232 shutdown_connections 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c9935fe70 0x560c99486ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c9948dd70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/1921651232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c99080e60 0x560c9948d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- 172.21.15.64:0/1921651232 >> 172.21.15.64:0/1921651232 conn(0x560c9938fc30 msgr2=0x560c9948d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- 172.21.15.64:0/1921651232 shutdown_connections 2024-09-21T07:26:08.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- 172.21.15.64:0/1921651232 wait complete. 2024-09-21T07:26:08.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 -- start start 2024-09-21T07:26:08.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.761+0000 7f7d6fefe000 1 Processor -- start 2024-09-21T07:26:08.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c99080e60 0x560c99546ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c9935fe70 0x560c99547960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560c9929f290 con 0x560c99358b70 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560c992929a0 con 0x560c99080e60 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560c992d6300 con 0x560c9935fe70 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 10 client.0 _ll_register_callbacks cb 0x7f7d50014b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37112/0 (socket says 172.21.15.64:37112) 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 -- 172.21.15.64:0/3797203386 learned_addr learned my addr 172.21.15.64:0/3797203386 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65e00640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c99080e60 0x560c99546ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d66800640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c9935fe70 0x560c99547960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 -- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c9935fe70 msgr2=0x560c99547960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c9935fe70 0x560c99547960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 -- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c99080e60 msgr2=0x560c99546ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c99080e60 0x560c99546ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 -- 172.21.15.64:0/3797203386 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c99330090 con 0x560c99358b70 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65400640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7d50032040 tx=0x7f7d50020e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a21b15b2bb9579 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:08.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:08.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5003c020 con 0x560c99358b70 2024-09-21T07:26:08.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7d50038630 con 0x560c99358b70 2024-09-21T07:26:08.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d500203f0 con 0x560c99358b70 2024-09-21T07:26:08.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d50046050 con 0x560c99358b70 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 10 client.5982 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560c992697d0 con 0x560c99358b70 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d500203f0 con 0x560c99358b70 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f7d50049020 con 0x560c99358b70 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 10 client.5982 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 20 client.5982 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f63d50 0x560c995027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 4 client.5982 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x560c992e17b0 con 0x560c98f63d50 2024-09-21T07:26:08.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65e00640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f63d50 0x560c995027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:08.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d65e00640 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f63d50 0x560c995027a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5acf25553ffceef6 server_cookie=eec9ea35593adb0a in_seq=0 out_seq=0 2024-09-21T07:26:08.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.765+0000 7f7d42a00640 10 client.5982 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d42a00640 1 -- 172.21.15.64:0/3797203386 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c992e17b0 con 0x560c98f63d50 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d42a00640 10 client.5982 handle_command_reply: tid=0 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 client.5982 shutdown 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 msgr2=0x560c99547420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7d50032040 tx=0x7f7d50020e10 comp rx=0 tx=0).stop 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 shutdown_connections 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x560c98f63d50 0x560c995027a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560c9935fe70 0x560c99547960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560c99358b70 0x560c99547420 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d42a00640 0 client.5982 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 --2- 172.21.15.64:0/3797203386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560c99080e60 0x560c99546ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 >> 172.21.15.64:0/3797203386 conn(0x560c9938fc30 msgr2=0x560c9948d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 shutdown_connections 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 1 -- 172.21.15.64:0/3797203386 wait complete. 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d6fefe000 20 client.5982 trim_cache size 0 max 16384 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:26:08.779 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:08.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 msgr2=0x7f7d44075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 0x7f7d44075740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d500046c0 tx=0x7f7d50007910 comp rx=0 tx=0).stop 2024-09-21T07:26:08.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 msgr2=0x7f7d600b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400e7f0 tx=0x7f7d5400ecb0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 shutdown_connections 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d44073230 0x7f7d44075740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d600c8b50 0x7f7d600b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d6015ac00 0x7f7d600b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 --2- 172.21.15.64:0/1510909815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6006f790 0x7f7d600b2460 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 >> 172.21.15.64:0/1510909815 conn(0x7f7d600cd2c0 msgr2=0x7f7d600d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 shutdown_connections 2024-09-21T07:26:08.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:08.773+0000 7f7d67200640 1 -- 172.21.15.64:0/1510909815 wait complete. 2024-09-21T07:26:08.798 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:26:08.798 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:08.798 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:08.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:08.808 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-21T07:26:08.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:26:08.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:26:08.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183511 s, 57.1 MB/s 2024-09-21T07:26:08.884 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-21T07:26:08.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 -- 172.21.15.64:0/1964538181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38a4004010 msgr2=0x7f38a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 --2- 172.21.15.64:0/1964538181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38a4004010 0x7f38a4004810 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38a8001770 tx=0x7f38a801efd0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38be800640 1 -- 172.21.15.64:0/1964538181 reap_dead start 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 -- 172.21.15.64:0/1964538181 shutdown_connections 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 -- 172.21.15.64:0/1964538181 >> 172.21.15.64:0/1964538181 conn(0x7f38c00ccbe0 msgr2=0x7f38c00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 -- 172.21.15.64:0/1964538181 shutdown_connections 2024-09-21T07:26:09.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.089+0000 7f38c5200640 1 -- 172.21.15.64:0/1964538181 wait complete. 2024-09-21T07:26:09.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 Processor -- start 2024-09-21T07:26:09.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- start start 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 0x7f38c014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 0x7f38c0150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38c00af930 con 0x7f38c0150f80 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38c00af7b0 con 0x7f38c01548c0 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f38c015d0b0 con 0x7f38a4004010 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37122/0 (socket says 172.21.15.64:37122) 2024-09-21T07:26:09.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 -- 172.21.15.64:0/613095092 learned_addr learned my addr 172.21.15.64:0/613095092 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38bde00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 0x7f38c014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38b7e00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 0x7f38c0150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 -- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 msgr2=0x7f38c014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 0x7f38c014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 -- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 msgr2=0x7f38c0150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 0x7f38c0150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 -- 172.21.15.64:0/613095092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c0151390 con 0x7f38c0150f80 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38bde00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 0x7f38c014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38b7e00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 0x7f38c0150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38be800640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002240 tx=0x7f38b800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38b6000640 1 -- 172.21.15.64:0/613095092 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b800c8f0 con 0x7f38c0150f80 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38b6000640 1 -- 172.21.15.64:0/613095092 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b8018070 con 0x7f38c0150f80 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c014e6c0 con 0x7f38c0150f80 2024-09-21T07:26:09.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38b6000640 1 -- 172.21.15.64:0/613095092 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b800ce40 con 0x7f38c0150f80 2024-09-21T07:26:09.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.093+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c009cea0 con 0x7f38c0150f80 2024-09-21T07:26:09.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38b6000640 1 -- 172.21.15.64:0/613095092 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f38b801d460 con 0x7f38c0150f80 2024-09-21T07:26:09.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38b6000640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 0x7f389c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38b6000640 1 -- 172.21.15.64:0/613095092 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38b8094830 con 0x7f38c0150f80 2024-09-21T07:26:09.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38cca8d000 1 Processor -- start 2024-09-21T07:26:09.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38cca8d000 1 -- start start 2024-09-21T07:26:09.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38bde00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 0x7f389c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.097+0000 7f38bde00640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 0x7f389c075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009c60 tx=0x7f38b00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20c9b70 0x5578c2242ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c1df1e60 0x5578c2243020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578c2054db0 con 0x5578c20d0e70 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578c20441e0 con 0x5578c1df1e60 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578c2047ff0 con 0x5578c20c9b70 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37128/0 (socket says 172.21.15.64:37128) 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 -- 172.21.15.64:0/3567445871 learned_addr learned my addr 172.21.15.64:0/3567445871 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38be800640 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c1df1e60 0x5578c2243020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38b7e00640 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20c9b70 0x5578c2242ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 -- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20c9b70 msgr2=0x5578c2242ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20c9b70 0x5578c2242ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 -- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c1df1e60 msgr2=0x5578c2243020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c1df1e60 0x5578c2243020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 -- 172.21.15.64:0/3567445871 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c1ff74e0 con 0x5578c20d0e70 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38bde00640 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f38b001e470 tx=0x7f38b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee503247ed0f42b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38aea00640 1 -- 172.21.15.64:0/3567445871 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b001ebe0 con 0x5578c20d0e70 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38aea00640 1 -- 172.21.15.64:0/3567445871 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b001ed80 con 0x5578c20d0e70 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38aea00640 1 -- 172.21.15.64:0/3567445871 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0004020 con 0x5578c20d0e70 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- 172.21.15.64:0/3567445871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 msgr2=0x5578c22425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f38b001e470 tx=0x7f38b0017000 comp rx=0 tx=0).stop 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- 172.21.15.64:0/3567445871 shutdown_connections 2024-09-21T07:26:09.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c1df1e60 0x5578c2243020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20c9b70 0x5578c2242ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3567445871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22425a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- 172.21.15.64:0/3567445871 >> 172.21.15.64:0/3567445871 conn(0x5578c2100c30 msgr2=0x5578c21f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- 172.21.15.64:0/3567445871 shutdown_connections 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- 172.21.15.64:0/3567445871 wait complete. 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.101+0000 7f38cca8d000 1 -- start start 2024-09-21T07:26:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 Processor -- start 2024-09-21T07:26:09.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c2248a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c2248f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578c1fe82b0 con 0x5578c20d0e70 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578c200dcc0 con 0x5578c20c9b70 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578c2053b80 con 0x5578c1df1e60 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 10 client.0 _ll_register_callbacks cb 0x5578c21e4500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37144/0 (socket says 172.21.15.64:37144) 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 -- 172.21.15.64:0/3228698667 learned_addr learned my addr 172.21.15.64:0/3228698667 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38bde00640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c2248a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38b7e00640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c2248f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 -- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 msgr2=0x5578c2248a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c2248a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 -- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 msgr2=0x5578c2248f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c2248f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 -- 172.21.15.64:0/3228698667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c1fc4b00 con 0x5578c20d0e70 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38be800640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38b8092ad0 tx=0x7f38b805f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c85eb2e86108eea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b805e980 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38b805e290 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578c1fdc550 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38b805eb20 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 10 client.5994 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5578c2000120 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578c1fdc550 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f38b8079080 con 0x5578c20d0e70 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 10 client.5994 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 10 client.5994 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 20 client.5994 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1ce6cf0 0x5578c2252e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 4 client.5994 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:09.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578c2056d00 con 0x5578c1ce6cf0 2024-09-21T07:26:09.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.105+0000 7f38bde00640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1ce6cf0 0x5578c2252e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38bde00640 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1ce6cf0 0x5578c2252e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abcf5ba245d72040 server_cookie=d72246caba25c4d8 in_seq=0 out_seq=0 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38a3400640 10 client.5994 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38a3400640 1 -- 172.21.15.64:0/3228698667 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578c2056d00 con 0x5578c1ce6cf0 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38a3400640 10 client.5994 handle_command_reply: tid=0 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 client.5994 shutdown 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 msgr2=0x5578c22494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38b8092ad0 tx=0x7f38b805f770 comp rx=0 tx=0).stop 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 shutdown_connections 2024-09-21T07:26:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1ce6cf0 0x5578c2252e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20d0e70 0x5578c22494a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c2248f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38a3400640 0 client.5994 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3228698667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c2248a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 >> 172.21.15.64:0/3228698667 conn(0x5578c2100c30 msgr2=0x5578c21f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 shutdown_connections 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 1 -- 172.21.15.64:0/3228698667 wait complete. 2024-09-21T07:26:09.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.109+0000 7f38cca8d000 20 client.5994 trim_cache size 0 max 16384 2024-09-21T07:26:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 Processor -- start 2024-09-21T07:26:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 -- start start 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c22b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 0x5578c22b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01f9500 con 0x5578c1df1e60 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01f8860 con 0x5578c20c9b70 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f38c01f8eb0 con 0x5578c20d0e70 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37154/0 (socket says 172.21.15.64:37154) 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 -- 172.21.15.64:0/3278752290 learned_addr learned my addr 172.21.15.64:0/3278752290 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38be800640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 0x5578c22b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38b7e00640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c22b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 -- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 msgr2=0x5578c22b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 0x5578c22b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 -- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 msgr2=0x5578c22b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c22b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38bde00640 1 -- 172.21.15.64:0/3278752290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c1fe2410 con 0x5578c1df1e60 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38be800640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 0x5578c22b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.125+0000 7f38b7e00640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c22b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38bde00640 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38b002b040 tx=0x7f38b0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61684a42866539d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38ae000640 1 -- 172.21.15.64:0/3278752290 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0040070 con 0x5578c1df1e60 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38ae000640 1 -- 172.21.15.64:0/3278752290 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b001e040 con 0x5578c1df1e60 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38ae000640 1 -- 172.21.15.64:0/3278752290 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0004040 con 0x5578c1df1e60 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- 172.21.15.64:0/3278752290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 msgr2=0x5578c22b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38b002b040 tx=0x7f38b0004740 comp rx=0 tx=0).stop 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- 172.21.15.64:0/3278752290 shutdown_connections 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c20d0e70 0x5578c22b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20c9b70 0x5578c22b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- 172.21.15.64:0/3278752290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c1df1e60 0x5578c22b4170 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- 172.21.15.64:0/3278752290 >> 172.21.15.64:0/3278752290 conn(0x5578c2100c30 msgr2=0x5578c21fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- 172.21.15.64:0/3278752290 shutdown_connections 2024-09-21T07:26:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- 172.21.15.64:0/3278752290 wait complete. 2024-09-21T07:26:09.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:09.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- start start 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 Processor -- start 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c224ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20d0e70 0x5578c2274370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578c2010290 con 0x5578c20c9b70 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578c20039a0 con 0x5578c20d0e70 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.129+0000 7f38cca8d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578c2047300 con 0x5578c1df1e60 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 10 client.0 _ll_register_callbacks cb 0x7f38b805e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37160/0 (socket says 172.21.15.64:37160) 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 -- 172.21.15.64:0/1526033976 learned_addr learned my addr 172.21.15.64:0/1526033976 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38bde00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c224ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38be800640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20d0e70 0x5578c2274370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 -- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 msgr2=0x5578c224ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c224ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 -- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20d0e70 msgr2=0x5578c2274370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20d0e70 0x5578c2274370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 -- 172.21.15.64:0/1526033976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c20a1090 con 0x5578c20c9b70 2024-09-21T07:26:09.138 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38b7e00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f38a801ee00 tx=0x7f38a80a8f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafe7eeca8867273 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8006140 con 0x5578c20c9b70 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38a80062e0 con 0x5578c20c9b70 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b001e040 con 0x5578c20c9b70 2024-09-21T07:26:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38a80064e0 con 0x5578c20c9b70 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 10 client.6000 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5578c1fda7d0 con 0x5578c20c9b70 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b001e040 con 0x5578c20c9b70 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f38a8003600 con 0x5578c20c9b70 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 10 client.6000 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 10 client.6000 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 20 client.6000 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1cd4d50 0x5578c22b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 4 client.6000 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x5578c20527b0 con 0x5578c1cd4d50 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38bde00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1cd4d50 0x5578c22b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38a3400640 10 client.6000 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.133+0000 7f38bde00640 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1cd4d50 0x5578c22b83c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986e837e1d3de452 server_cookie=64e030ee61d99e83 in_seq=0 out_seq=0 2024-09-21T07:26:09.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.137+0000 7f38a3400640 1 -- 172.21.15.64:0/1526033976 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578c20527b0 con 0x5578c1cd4d50 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.137+0000 7f38a3400640 10 client.6000 handle_command_reply: tid=0 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.137+0000 7f38cca8d000 1 client.6000 shutdown 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 msgr2=0x5578c224ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f38a801ee00 tx=0x7f38a80a8f40 comp rx=0 tx=0).stop 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 shutdown_connections 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x5578c1cd4d50 0x5578c22b83c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578c20d0e70 0x5578c2274370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578c20c9b70 0x5578c224ef80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38a3400640 0 client.6000 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 --2- 172.21.15.64:0/1526033976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578c1df1e60 0x5578c224ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 >> 172.21.15.64:0/1526033976 conn(0x5578c2100c30 msgr2=0x5578c21fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 shutdown_connections 2024-09-21T07:26:09.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 1 -- 172.21.15.64:0/1526033976 wait complete. 2024-09-21T07:26:09.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38cca8d000 20 client.6000 trim_cache size 0 max 16384 2024-09-21T07:26:09.146 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:09.146 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:09.146 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:26:09.146 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 msgr2=0x7f389c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 0x7f389c075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009c60 tx=0x7f38b00091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 msgr2=0x7f38c00afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002240 tx=0x7f38b800eae0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 shutdown_connections 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f389c073200 0x7f389c075710 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38c0150f80 0x7f38c00afab0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38c01548c0 0x7f38c0150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 --2- 172.21.15.64:0/613095092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38a4004010 0x7f38c014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 >> 172.21.15.64:0/613095092 conn(0x7f38c00ccbe0 msgr2=0x7f38c00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 shutdown_connections 2024-09-21T07:26:09.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.141+0000 7f38c5200640 1 -- 172.21.15.64:0/613095092 wait complete. 2024-09-21T07:26:09.166 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:26:09.166 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:26:09.166 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:26:09.166 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:26:09.166 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:09.167 DEBUG:teuthology.orchestra.run.smithi064:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-21T07:26:09.167 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:26:09.300 INFO:teuthology.orchestra.run.smithi064.stdout:1099511630410 2024-09-21T07:26:09.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:09.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 -- 172.21.15.64:0/1541683563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 msgr2=0x7f33fc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 --2- 172.21.15.64:0/1541683563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f33fc004c20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3418072df0 tx=0x7f340001c820 comp rx=0 tx=0).stop 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 -- 172.21.15.64:0/1541683563 shutdown_connections 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 --2- 172.21.15.64:0/1541683563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f33fc004c20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 -- 172.21.15.64:0/1541683563 >> 172.21.15.64:0/1541683563 conn(0x7f34180ccbe0 msgr2=0x7f34180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 -- 172.21.15.64:0/1541683563 shutdown_connections 2024-09-21T07:26:09.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.509+0000 7f341e800640 1 -- 172.21.15.64:0/1541683563 wait complete. 2024-09-21T07:26:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 Processor -- start 2024-09-21T07:26:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- start start 2024-09-21T07:26:09.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34181f8610 0x7f34181506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34180c71e0 0x7f34181fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f34180b4520 con 0x7f33fc004810 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34180b43a0 con 0x7f34180c71e0 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f34180b46a0 con 0x7f34181f8610 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37176/0 (socket says 172.21.15.64:37176) 2024-09-21T07:26:09.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 -- 172.21.15.64:0/1642668870 learned_addr learned my addr 172.21.15.64:0/1642668870 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 -- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34181f8610 msgr2=0x7f34181506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34181f8610 0x7f34181506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 -- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34180c71e0 msgr2=0x7f34181fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34180c71e0 0x7f34181fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 -- 172.21.15.64:0/1642668870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3418150bf0 con 0x7f33fc004810 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f3417400640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3408006400 tx=0x7f34080039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f340f400640 1 -- 172.21.15.64:0/1642668870 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408015070 con 0x7f33fc004810 2024-09-21T07:26:09.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f340f400640 1 -- 172.21.15.64:0/1642668870 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3408011860 con 0x7f33fc004810 2024-09-21T07:26:09.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34181f8de0 con 0x7f33fc004810 2024-09-21T07:26:09.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f340f400640 1 -- 172.21.15.64:0/1642668870 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408011cb0 con 0x7f33fc004810 2024-09-21T07:26:09.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.513+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34181f93a0 con 0x7f33fc004810 2024-09-21T07:26:09.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f340f400640 1 -- 172.21.15.64:0/1642668870 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3408018070 con 0x7f33fc004810 2024-09-21T07:26:09.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f340f400640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 0x7f33f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f340f400640 1 -- 172.21.15.64:0/1642668870 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f3408094e90 con 0x7f33fc004810 2024-09-21T07:26:09.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f340fe00640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 0x7f33f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f3426066000 1 Processor -- start 2024-09-21T07:26:09.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f3426066000 1 -- start start 2024-09-21T07:26:09.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.517+0000 7f340fe00640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 0x7f33f4075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34180ccbb0 tx=0x7f33fc005840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 0x562b64669ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 0x562b6466a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b64507d50 con 0x562b644f7320 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b6447bb10 con 0x562b644f05a0 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562b6446af40 con 0x562b644f0db0 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37180/0 (socket says 172.21.15.64:37180) 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 -- 172.21.15.64:0/46428280 learned_addr learned my addr 172.21.15.64:0/46428280 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417e00640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 0x562b6466a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f340fe00640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 0x562b64669ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 -- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 msgr2=0x562b6466a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 0x562b6466a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 -- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 msgr2=0x562b64669ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 0x562b64669ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 -- 172.21.15.64:0/46428280 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b643ec120 con 0x562b644f7320 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417e00640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 0x562b6466a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f340fe00640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 0x562b64669ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3417400640 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f34080930d0 tx=0x7f340805f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb0a4c1cd623b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3407e00640 1 -- 172.21.15.64:0/46428280 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340801f040 con 0x562b644f7320 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3407e00640 1 -- 172.21.15.64:0/46428280 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f340805f6a0 con 0x562b644f7320 2024-09-21T07:26:09.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3407e00640 1 -- 172.21.15.64:0/46428280 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408068d70 con 0x562b644f7320 2024-09-21T07:26:09.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- 172.21.15.64:0/46428280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 msgr2=0x562b64669960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f34080930d0 tx=0x7f340805f2f0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- 172.21.15.64:0/46428280 shutdown_connections 2024-09-21T07:26:09.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f0db0 0x562b6466a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f05a0 0x562b64669ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 --2- 172.21.15.64:0/46428280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f7320 0x562b64669960 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- 172.21.15.64:0/46428280 >> 172.21.15.64:0/46428280 conn(0x562b64128920 msgr2=0x562b6464ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- 172.21.15.64:0/46428280 shutdown_connections 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.521+0000 7f3426066000 1 -- 172.21.15.64:0/46428280 wait complete. 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- start start 2024-09-21T07:26:09.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 Processor -- start 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6464bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 0x562b6464c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b64410500 con 0x562b644f0db0 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b6446ed50 con 0x562b644f7320 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562b64130680 con 0x562b644f05a0 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 10 client.0 _ll_register_callbacks cb 0x562b6460b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37188/0 (socket says 172.21.15.64:37188) 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 -- 172.21.15.64:0/3678115287 learned_addr learned my addr 172.21.15.64:0/3678115287 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3417400640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6464bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3417e00640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 0x562b6464c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 -- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 msgr2=0x562b6464bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6464bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 -- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 msgr2=0x562b6464c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 0x562b6464c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 -- 172.21.15.64:0/3678115287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b6441fc60 con 0x562b644f0db0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3417e00640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 0x562b6464c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f340fe00640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3400000fc0 tx=0x7f34000195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624049ac4c49fcbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000be420 con 0x562b644f0db0 2024-09-21T07:26:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f34000c7c50 con 0x562b644f0db0 2024-09-21T07:26:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b64403330 con 0x562b644f0db0 2024-09-21T07:26:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f34000c7e50 con 0x562b644f0db0 2024-09-21T07:26:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 10 client.6012 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562b64469be0 con 0x562b644f0db0 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562b64403330 con 0x562b644f0db0 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f34180707c0 con 0x562b644f0db0 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 10 client.6012 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.525+0000 7f3426066000 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 20 client.6012 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b6410d930 0x562b6467af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 4 client.6012 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b6447da60 con 0x562b6410d930 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3417400640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b6410d930 0x562b6467af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3417400640 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b6410d930 0x562b6467af20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8f5195362dda36 server_cookie=1b0f774ebc86473f in_seq=0 out_seq=0 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3404c00640 10 client.6012 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3404c00640 1 -- 172.21.15.64:0/3678115287 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b6447da60 con 0x562b6410d930 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3404c00640 10 client.6012 handle_command_reply: tid=0 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 client.6012 shutdown 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 msgr2=0x562b6464c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3400000fc0 tx=0x7f34000195c0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 shutdown_connections 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b6410d930 0x562b6467af20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b644f7320 0x562b6464c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3404c00640 0 client.6012 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6464c490 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 --2- 172.21.15.64:0/3678115287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6464bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 >> 172.21.15.64:0/3678115287 conn(0x562b64128920 msgr2=0x562b6461d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 shutdown_connections 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 1 -- 172.21.15.64:0/3678115287 wait complete. 2024-09-21T07:26:09.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.529+0000 7f3426066000 20 client.6012 trim_cache size 0 max 16384 2024-09-21T07:26:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 Processor -- start 2024-09-21T07:26:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 -- start start 2024-09-21T07:26:09.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b64624890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b64624dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b646232a0 con 0x562b644f0db0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3418205f50 con 0x562b64128920 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3418204f50 con 0x562b644f05a0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37202/0 (socket says 172.21.15.64:37202) 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 -- 172.21.15.64:0/1185537059 learned_addr learned my addr 172.21.15.64:0/1185537059 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417400640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b64624890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f340fe00640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b64624dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 -- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 msgr2=0x562b64624dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b64624dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 -- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 msgr2=0x562b64624890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b64624890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 -- 172.21.15.64:0/1185537059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b644091f0 con 0x562b644f0db0 2024-09-21T07:26:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417400640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b64624890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3417e00640 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f34180c71b0 tx=0x7f3410003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd23bd373655589 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3407400640 1 -- 172.21.15.64:0/1185537059 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34100044f0 con 0x562b644f0db0 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3407400640 1 -- 172.21.15.64:0/1185537059 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3410004690 con 0x562b644f0db0 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.545+0000 7f3407400640 1 -- 172.21.15.64:0/1185537059 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34100126b0 con 0x562b644f0db0 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- 172.21.15.64:0/1185537059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 msgr2=0x562b6467e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f34180c71b0 tx=0x7f3410003d50 comp rx=0 tx=0).stop 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- 172.21.15.64:0/1185537059 shutdown_connections 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6467e370 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b64624dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- 172.21.15.64:0/1185537059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b64624890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- 172.21.15.64:0/1185537059 >> 172.21.15.64:0/1185537059 conn(0x562b64676800 msgr2=0x562b64624180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- 172.21.15.64:0/1185537059 shutdown_connections 2024-09-21T07:26:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- 172.21.15.64:0/1185537059 wait complete. 2024-09-21T07:26:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- start start 2024-09-21T07:26:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 Processor -- start 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b6467da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6467df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b64628d90 con 0x562b644f0db0 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b6446e060 con 0x562b64128920 2024-09-21T07:26:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562b644368b0 con 0x562b644f05a0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3426066000 10 client.0 _ll_register_callbacks cb 0x7f33fc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37214/0 (socket says 172.21.15.64:37214) 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 -- 172.21.15.64:0/1994231648 learned_addr learned my addr 172.21.15.64:0/1994231648 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 -- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 msgr2=0x562b6467df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6467df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 -- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 msgr2=0x562b6467da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417400640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b6467da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b6467da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417e00640 1 -- 172.21.15.64:0/1994231648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b64431990 con 0x562b644f0db0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.549+0000 7f3417400640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b6467da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3417e00640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f90 tx=0x7f3410013970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d16abf3829945c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410025440 con 0x562b644f0db0 2024-09-21T07:26:09.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f3410010440 con 0x562b644f0db0 2024-09-21T07:26:09.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3410004690 con 0x562b644f0db0 2024-09-21T07:26:09.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f341002d050 con 0x562b644f0db0 2024-09-21T07:26:09.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 10 client.6018 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562b64401580 con 0x562b644f0db0 2024-09-21T07:26:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3410004690 con 0x562b644f0db0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f3410030020 con 0x562b644f0db0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 10 client.6018 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 10 client.6018 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 20 client.6018 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b64126fe0 0x562b646df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 4 client.6018 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b64479510 con 0x562b64126fe0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3417400640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b64126fe0 0x562b646df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 10 client.6018 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3417400640 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b64126fe0 0x562b646df0b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde978779e25aece server_cookie=c28c7a801f4e410c in_seq=0 out_seq=0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 1 -- 172.21.15.64:0/1994231648 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b64479510 con 0x562b64126fe0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 10 client.6018 handle_command_reply: tid=0 2024-09-21T07:26:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 client.6018 shutdown 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 msgr2=0x562b6469b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3410000f90 tx=0x7f3410013970 comp rx=0 tx=0).stop 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 shutdown_connections 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x562b64126fe0 0x562b646df0b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b644f0db0 0x562b6469b440 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562b644f05a0 0x562b6467df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3404c00640 0 client.6018 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 --2- 172.21.15.64:0/1994231648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b64128920 0x562b6467da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 >> 172.21.15.64:0/1994231648 conn(0x562b64676800 msgr2=0x562b64624b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 shutdown_connections 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 1 -- 172.21.15.64:0/1994231648 wait complete. 2024-09-21T07:26:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f3426066000 20 client.6018 trim_cache size 0 max 16384 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stdout:[] 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 msgr2=0x7f33f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 0x7f33f4075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34180ccbb0 tx=0x7f33fc005840 comp rx=0 tx=0).stop 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 msgr2=0x7f341814dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3408006400 tx=0x7f34080039d0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 shutdown_connections 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f33f4073230 0x7f33f4075740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34180c71e0 0x7f34181fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34181f8610 0x7f34181506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 --2- 172.21.15.64:0/1642668870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33fc004810 0x7f341814dec0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 >> 172.21.15.64:0/1642668870 conn(0x7f34180ccbe0 msgr2=0x7f34180b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 shutdown_connections 2024-09-21T07:26:09.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.553+0000 7f341e800640 1 -- 172.21.15.64:0/1642668870 wait complete. 2024-09-21T07:26:09.580 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4a.00000000 parent 2024-09-21T07:26:09.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.633+0000 7f53d6047080 1 Processor -- start 2024-09-21T07:26:09.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.633+0000 7f53d6047080 1 -- start start 2024-09-21T07:26:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25dcdf20 0x560a25e5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e43f80 0x560a25e5ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a25d32f40 con 0x560a25e5b3b0 2024-09-21T07:26:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a25d3fd00 con 0x560a25e43f80 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560a25cd4a00 con 0x560a25dcdf20 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37226/0 (socket says 172.21.15.64:37226) 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 -- 172.21.15.64:0/3882795791 learned_addr learned my addr 172.21.15.64:0/3882795791 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cdc00640 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e43f80 0x560a25e5ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53ce600640 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25dcdf20 0x560a25e5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 -- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25dcdf20 msgr2=0x560a25e5d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25dcdf20 0x560a25e5d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 -- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e43f80 msgr2=0x560a25e5ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e43f80 0x560a25e5ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 -- 172.21.15.64:0/3882795791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a25e40f00 con 0x560a25e5b3b0 2024-09-21T07:26:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53cf000640 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001630 tx=0x7f53c8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9960478c9ab7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53c7e00640 1 -- 172.21.15.64:0/3882795791 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8016070 con 0x560a25e5b3b0 2024-09-21T07:26:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53c7e00640 1 -- 172.21.15.64:0/3882795791 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c800f820 con 0x560a25e5b3b0 2024-09-21T07:26:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53c7e00640 1 -- 172.21.15.64:0/3882795791 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c800fc70 con 0x560a25e5b3b0 2024-09-21T07:26:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- 172.21.15.64:0/3882795791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 msgr2=0x560a25dc5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001630 tx=0x7f53c8001af0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- 172.21.15.64:0/3882795791 shutdown_connections 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25e5b3b0 0x560a25dc5700 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e43f80 0x560a25e5ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 --2- 172.21.15.64:0/3882795791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25dcdf20 0x560a25e5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- 172.21.15.64:0/3882795791 >> 172.21.15.64:0/3882795791 conn(0x560a25d72d60 msgr2=0x560a25e5a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- 172.21.15.64:0/3882795791 shutdown_connections 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 -- 172.21.15.64:0/3882795791 wait complete. 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.637+0000 7f53d6047080 1 Processor -- start 2024-09-21T07:26:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- start start 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 0x560a25ef3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25e43f80 0x560a25da7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e5b3b0 0x560a25e5c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a25e5ce30 con 0x560a25dcdf20 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a25e411a0 con 0x560a25e5b3b0 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560a25e5d0d0 con 0x560a25e43f80 2024-09-21T07:26:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 0x560a25ef3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 0x560a25ef3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37242/0 (socket says 172.21.15.64:37242) 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 -- 172.21.15.64:0/3503042595 learned_addr learned my addr 172.21.15.64:0/3503042595 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53cdc00640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25e43f80 0x560a25da7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53cf000640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e5b3b0 0x560a25e5c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 -- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25e43f80 msgr2=0x560a25da7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a25e43f80 0x560a25da7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 -- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e5b3b0 msgr2=0x560a25e5c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a25e5b3b0 0x560a25e5c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 -- 172.21.15.64:0/3503042595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a25da8aa0 con 0x560a25dcdf20 2024-09-21T07:26:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53ce600640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 0x560a25ef3a90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f53c001a620 tx=0x7f53c0004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53c6a00640 1 -- 172.21.15.64:0/3503042595 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00b0670 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53c6a00640 1 -- 172.21.15.64:0/3503042595 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c00b0810 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53c6a00640 1 -- 172.21.15.64:0/3503042595 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00b0c20 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a25db3c70 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.641+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a25ef3fd0 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53c6a00640 1 -- 172.21.15.64:0/3503042595 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53c00bc3f0 con 0x560a25dcdf20 2024-09-21T07:26:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53c6a00640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53b0071be0 0x7f53b00740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53c6a00640 1 -- 172.21.15.64:0/3503042595 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f53c0130b50 con 0x560a25dcdf20 2024-09-21T07:26:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53d6047080 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x560a25db4650 0x560a25db4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53cdc00640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53b0071be0 0x7f53b00740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 --> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] -- osd_op(unknown.0.0:1 8.24 8:26e73f49:::10000000a4a.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) -- 0x560a25db4fa0 con 0x560a25db4650 2024-09-21T07:26:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53cf000640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x560a25db4650 0x560a25db4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53cdc00640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53b0071be0 0x7f53b00740f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53bc001500 tx=0x7f53bc003070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.645+0000 7f53cf000640 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x560a25db4650 0x560a25db4a60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53cf000640 1 -- 172.21.15.64:0/3503042595 <== osd.6 v2:172.21.15.90:6818/1592578093 1 ==== osd_op_reply(1 10000000a4a.00000000 [rmxattr] v56'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f53c8019040 con 0x560a25db4650 2024-09-21T07:26:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x560a25db4650 msgr2=0x560a25db4a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x560a25db4650 0x560a25db4a60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53b0071be0 msgr2=0x7f53b00740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f53b0071be0 0x7f53b00740f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53bc001500 tx=0x7f53bc003070 comp rx=0 tx=0).stop 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 msgr2=0x560a25ef3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 --2- 172.21.15.64:0/3503042595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a25dcdf20 0x560a25ef3a90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f53c001a620 tx=0x7f53c0004590 comp rx=0 tx=0).stop 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53cf000640 1 -- 172.21.15.64:0/3503042595 reap_dead start 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 shutdown_connections 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 >> 172.21.15.64:0/3503042595 conn(0x560a25d72d60 msgr2=0x560a25e5b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 shutdown_connections 2024-09-21T07:26:09.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.649+0000 7f53d6047080 1 -- 172.21.15.64:0/3503042595 wait complete. 2024-09-21T07:26:09.658 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-21T07:26:09.658 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-21T07:26:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- 172.21.15.64:0/1749148993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80b3850 msgr2=0x7f50b815ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 --2- 172.21.15.64:0/1749148993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80b3850 0x7f50b815ee70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009840 tx=0x7f50a401c820 comp rx=0 tx=0).stop 2024-09-21T07:26:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- 172.21.15.64:0/1749148993 shutdown_connections 2024-09-21T07:26:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 --2- 172.21.15.64:0/1749148993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80b3850 0x7f50b815ee70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- 172.21.15.64:0/1749148993 >> 172.21.15.64:0/1749148993 conn(0x7f50b806d450 msgr2=0x7f50b80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- 172.21.15.64:0/1749148993 shutdown_connections 2024-09-21T07:26:09.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- 172.21.15.64:0/1749148993 wait complete. 2024-09-21T07:26:09.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 Processor -- start 2024-09-21T07:26:09.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.817+0000 7f50bd600640 1 -- start start 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50b80b3850 0x7f50b81f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80cc960 0x7f50b814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f50b816a330 con 0x7f50b80ce4d0 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50b816a1b0 con 0x7f50b80cc960 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f50b816a4b0 con 0x7f50b80b3850 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37256/0 (socket says 172.21.15.64:37256) 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 -- 172.21.15.64:0/1909651952 learned_addr learned my addr 172.21.15.64:0/1909651952 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50b80b3850 0x7f50b81f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b6000640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80cc960 0x7f50b814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 -- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50b80b3850 msgr2=0x7f50b81f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50b80b3850 0x7f50b81f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 -- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80cc960 msgr2=0x7f50b814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80cc960 0x7f50b814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 -- 172.21.15.64:0/1909651952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b80702b0 con 0x7f50b80ce4d0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50b7400640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c6b0 tx=0x7f50b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50aea00640 1 -- 172.21.15.64:0/1909651952 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0003b80 con 0x7f50b80ce4d0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50aea00640 1 -- 172.21.15.64:0/1909651952 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b0003d20 con 0x7f50b80ce4d0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50aea00640 1 -- 172.21.15.64:0/1909651952 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0005330 con 0x7f50b80ce4d0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b814dff0 con 0x7f50b80ce4d0 2024-09-21T07:26:09.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.821+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b814e5b0 con 0x7f50b80ce4d0 2024-09-21T07:26:09.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50aea00640 1 -- 172.21.15.64:0/1909651952 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f50b00054d0 con 0x7f50b80ce4d0 2024-09-21T07:26:09.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50aea00640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 0x7f5098075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50aea00640 1 -- 172.21.15.64:0/1909651952 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f50b0094060 con 0x7f50b80ce4d0 2024-09-21T07:26:09.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 Processor -- start 2024-09-21T07:26:09.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 0x7f5098075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 -- start start 2024-09-21T07:26:09.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 0x7f5098075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f50a80010a0 tx=0x7f50a8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea030 0x55f8d7767d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d77682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7575a60 con 0x55f8d75fd720 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7564e90 con 0x55f8d75ea840 2024-09-21T07:26:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.825+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f8d7568ca0 con 0x55f8d75ea030 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37266/0 (socket says 172.21.15.64:37266) 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 -- 172.21.15.64:0/855193026 learned_addr learned my addr 172.21.15.64:0/855193026 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6000640 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea030 0x55f8d7767d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b7400640 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d77682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 -- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea030 msgr2=0x55f8d7767d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea030 0x55f8d7767d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 -- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 msgr2=0x55f8d77682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d77682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 -- 172.21.15.64:0/855193026 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d750a3d0 con 0x55f8d75fd720 2024-09-21T07:26:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50b6a00640 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f50a800f940 tx=0x7f50a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27122b031743a33e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50a3000640 1 -- 172.21.15.64:0/855193026 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8025070 con 0x55f8d75fd720 2024-09-21T07:26:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50a3000640 1 -- 172.21.15.64:0/855193026 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a801b050 con 0x55f8d75fd720 2024-09-21T07:26:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50a3000640 1 -- 172.21.15.64:0/855193026 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8014e40 con 0x55f8d75fd720 2024-09-21T07:26:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- 172.21.15.64:0/855193026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 msgr2=0x55f8d7767830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f50a800f940 tx=0x7f50a8012000 comp rx=0 tx=0).stop 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- 172.21.15.64:0/855193026 shutdown_connections 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d77682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea030 0x55f8d7767d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/855193026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d7767830 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- 172.21.15.64:0/855193026 >> 172.21.15.64:0/855193026 conn(0x55f8d7621150 msgr2=0x55f8d77181b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- 172.21.15.64:0/855193026 shutdown_connections 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- 172.21.15.64:0/855193026 wait complete. 2024-09-21T07:26:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 -- start start 2024-09-21T07:26:09.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.829+0000 7f50c4e1d000 1 Processor -- start 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d7753150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75fd720 0x55f8d7753690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f8d750a180 con 0x55f8d75ea030 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f8d756d2d0 con 0x55f8d75ea840 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f8d7510140 con 0x55f8d75fd720 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 10 client.0 _ll_register_callbacks cb 0x55f8d7705120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37276/0 (socket says 172.21.15.64:37276) 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 -- 172.21.15.64:0/1826733202 learned_addr learned my addr 172.21.15.64:0/1826733202 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6000640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d7753150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b7400640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75fd720 0x55f8d7753690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 -- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75fd720 msgr2=0x55f8d7753690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75fd720 0x55f8d7753690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 -- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 msgr2=0x55f8d7753150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d7753150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 -- 172.21.15.64:0/1826733202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d7503140 con 0x55f8d75ea030 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6a00640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55f8d756d6b0 tx=0x7f50a8020ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5837f4c6226fb5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a802e020 con 0x55f8d75ea030 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f50a802a600 con 0x55f8d75ea030 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8d7544e10 con 0x55f8d75ea030 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50a8038050 con 0x55f8d75ea030 2024-09-21T07:26:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 10 client.6039 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f8d75220b0 con 0x55f8d75ea030 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f8d7544e10 con 0x55f8d75ea030 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f50a802a930 con 0x55f8d75ea030 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 10 client.6039 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 10 client.6039 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 20 client.6039 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d7207d10 0x55f8d77540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 4 client.6039 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d75779b0 con 0x55f8d7207d10 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6000640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d7207d10 0x55f8d77540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f5097400640 10 client.6039 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.833+0000 7f50b6000640 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d7207d10 0x55f8d77540a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d008ece3b3d04a24 server_cookie=5378be2cea395c3a in_seq=0 out_seq=0 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f5097400640 1 -- 172.21.15.64:0/1826733202 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8d75779b0 con 0x55f8d7207d10 2024-09-21T07:26:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f5097400640 10 client.6039 handle_command_reply: tid=0 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 client.6039 shutdown 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 msgr2=0x55f8d7752c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55f8d756d6b0 tx=0x7f50a8020ab0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 shutdown_connections 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d7207d10 0x55f8d77540a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75fd720 0x55f8d7753690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea840 0x55f8d7753150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/1826733202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d7752c10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 >> 172.21.15.64:0/1826733202 conn(0x55f8d7621150 msgr2=0x55f8d771ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f5097400640 0 client.6039 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 shutdown_connections 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 1 -- 172.21.15.64:0/1826733202 wait complete. 2024-09-21T07:26:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.837+0000 7f50c4e1d000 20 client.6039 trim_cache size 0 max 16384 2024-09-21T07:26:09.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.853+0000 7f50c4e1d000 1 Processor -- start 2024-09-21T07:26:09.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.853+0000 7f50c4e1d000 1 -- start start 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 0x55f8d7718c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d777de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f50b809b3a0 con 0x55f8d75fd720 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50b81faf10 con 0x55f8d75ea030 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f50b809ad50 con 0x55f8d75ea840 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37282/0 (socket says 172.21.15.64:37282) 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 -- 172.21.15.64:0/2557553598 learned_addr learned my addr 172.21.15.64:0/2557553598 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b6000640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d777de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b6a00640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 0x55f8d7718c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 -- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 msgr2=0x55f8d777de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d777de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 -- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 msgr2=0x55f8d7718c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 0x55f8d7718c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 -- 172.21.15.64:0/2557553598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d74ea1a0 con 0x55f8d75fd720 2024-09-21T07:26:09.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b6a00640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 0x55f8d7718c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:09.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50b7400640 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f50b0092360 tx=0x7f50b0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1a8753fced86f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50a2600640 1 -- 172.21.15.64:0/2557553598 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b005e800 con 0x55f8d75fd720 2024-09-21T07:26:09.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50a2600640 1 -- 172.21.15.64:0/2557553598 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b0063230 con 0x55f8d75fd720 2024-09-21T07:26:09.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50a2600640 1 -- 172.21.15.64:0/2557553598 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0068170 con 0x55f8d75fd720 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2557553598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 msgr2=0x55f8d777e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f50b0092360 tx=0x7f50b0001260 comp rx=0 tx=0).stop 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2557553598 shutdown_connections 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75fd720 0x55f8d777e380 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d777de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2557553598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75ea030 0x55f8d7718c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2557553598 >> 172.21.15.64:0/2557553598 conn(0x55f8d7621150 msgr2=0x55f8d7766130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2557553598 shutdown_connections 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2557553598 wait complete. 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.857+0000 7f50c4e1d000 1 -- start start 2024-09-21T07:26:09.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 Processor -- start 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d77dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75fd720 0x55f8d77dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7528160 con 0x55f8d75ea030 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7574830 con 0x55f8d75fd720 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f8d75246e0 con 0x55f8d75ea840 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 10 client.0 _ll_register_callbacks cb 0x7f50a8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37286/0 (socket says 172.21.15.64:37286) 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 -- 172.21.15.64:0/2536265208 learned_addr learned my addr 172.21.15.64:0/2536265208 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b7400640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75fd720 0x55f8d77dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6000640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d77dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 -- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 msgr2=0x55f8d77dd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d77dd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 -- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75fd720 msgr2=0x55f8d77dd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:09.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75fd720 0x55f8d77dd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 -- 172.21.15.64:0/2536265208 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d75c1ef0 con 0x55f8d75ea030 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6a00640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f50a80148a0 tx=0x7f50a802a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502df0962f65a633 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8041060 con 0x55f8d75ea030 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f50a8033790 con 0x55f8d75ea030 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b0063230 con 0x55f8d75ea030 2024-09-21T07:26:09.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50a8047050 con 0x55f8d75ea030 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 10 client.6045 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f8d721b600 con 0x55f8d75ea030 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b0063230 con 0x55f8d75ea030 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f50a804a020 con 0x55f8d75ea030 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 10 client.6045 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 10 client.6045 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 20 client.6045 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d71f5d70 0x55f8d777a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 4 client.6045 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55f8d7573460 con 0x55f8d71f5d70 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.861+0000 7f50b6000640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d71f5d70 0x55f8d777a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50b6000640 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d71f5d70 0x55f8d777a2f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed76d45a731d01e server_cookie=b3cc1fcced49dde0 in_seq=0 out_seq=0 2024-09-21T07:26:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f5097400640 10 client.6045 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f5097400640 1 -- 172.21.15.64:0/2536265208 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f8d7573460 con 0x55f8d71f5d70 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f5097400640 10 client.6045 handle_command_reply: tid=0 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 client.6045 shutdown 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 msgr2=0x55f8d77dce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f50a80148a0 tx=0x7f50a802a6b0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 shutdown_connections 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f8d71f5d70 0x55f8d777a2f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f8d75fd720 0x55f8d77dd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f8d75ea840 0x55f8d77dd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 --2- 172.21.15.64:0/2536265208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f8d75ea030 0x55f8d77dce40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f5097400640 0 client.6045 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 >> 172.21.15.64:0/2536265208 conn(0x55f8d7621150 msgr2=0x55f8d77668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 shutdown_connections 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 1 -- 172.21.15.64:0/2536265208 wait complete. 2024-09-21T07:26:09.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50c4e1d000 20 client.6045 trim_cache size 0 max 16384 2024-09-21T07:26:09.872 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:09.872 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:09.872 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "24948bbe-6770-44df-93dd-fc52155f2e75", 2024-09-21T07:26:09.872 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:09.872 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:09.872 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:26:09.865+0000 7fe8cd600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4a [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v453 pv455 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-21T07:26:08.865172+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5491=0-4194304@1} caps={5491=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5491 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x559f04946000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4a:[<0x10000000001/new_file_1 v453>,<0x10000000000/ceph-qa-suite v63>,<0x1/scrub_test_path v23>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 msgr2=0x7f5098075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 0x7f5098075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f50a80010a0 tx=0x7f50a8009040 comp rx=0 tx=0).stop 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 msgr2=0x7f50b815a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c6b0 tx=0x7f50b000cb70 comp rx=0 tx=0).stop 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 shutdown_connections 2024-09-21T07:26:09.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5098073200 0x7f5098075710 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50b80ce4d0 0x7f50b815a690 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50b80cc960 0x7f50b814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 --2- 172.21.15.64:0/1909651952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50b80b3850 0x7f50b81f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 >> 172.21.15.64:0/1909651952 conn(0x7f50b806d450 msgr2=0x7f50b815ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 shutdown_connections 2024-09-21T07:26:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:09.865+0000 7f50bd600640 1 -- 172.21.15.64:0/1909651952 wait complete. 2024-09-21T07:26:09.890 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '24948bbe-6770-44df-93dd-fc52155f2e75', 'mode': 'asynchronous'}' 2024-09-21T07:26:09.890 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:26:09.890 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 -- 172.21.15.64:0/517863343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0706c0 msgr2=0x7fb94c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 --2- 172.21.15.64:0/517863343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0706c0 0x7fb94c0ce740 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0b3130 tx=0x7fb93801c6c0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 -- 172.21.15.64:0/517863343 shutdown_connections 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 --2- 172.21.15.64:0/517863343 >> v2:172.21.15.90:3300/0 conn(0x7fb94c0ca990 0x7fb94c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 --2- 172.21.15.64:0/517863343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0706c0 0x7fb94c0ce740 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 -- 172.21.15.64:0/517863343 >> 172.21.15.64:0/517863343 conn(0x7fb94c0ccbe0 msgr2=0x7fb94c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 -- 172.21.15.64:0/517863343 shutdown_connections 2024-09-21T07:26:10.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.045+0000 7fb954000640 1 -- 172.21.15.64:0/517863343 wait complete. 2024-09-21T07:26:10.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 Processor -- start 2024-09-21T07:26:10.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- start start 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb94c15ec20 0x7fb94c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb94c156c60 0x7fb94c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c168cd0 con 0x7fb94c0ca990 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c168b50 con 0x7fb94c156c60 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c168e50 con 0x7fb94c15ec20 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37306/0 (socket says 172.21.15.64:37306) 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 -- 172.21.15.64:0/1163090346 learned_addr learned my addr 172.21.15.64:0/1163090346 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb952000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb94c156c60 0x7fb94c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb950c00640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb94c15ec20 0x7fb94c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 -- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb94c15ec20 msgr2=0x7fb94c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb94c15ec20 0x7fb94c156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 -- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb94c156c60 msgr2=0x7fb94c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb94c156c60 0x7fb94c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 -- 172.21.15.64:0/1163090346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c09aa90 con 0x7fb94c0ca990 2024-09-21T07:26:10.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb951600640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c430 tx=0x7fb94000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb949600640 1 -- 172.21.15.64:0/1163090346 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940011790 con 0x7fb94c0ca990 2024-09-21T07:26:10.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb949600640 1 -- 172.21.15.64:0/1163090346 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb940017070 con 0x7fb94c0ca990 2024-09-21T07:26:10.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb949600640 1 -- 172.21.15.64:0/1163090346 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940011cc0 con 0x7fb94c0ca990 2024-09-21T07:26:10.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c09ad70 con 0x7fb94c0ca990 2024-09-21T07:26:10.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.049+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c09b330 con 0x7fb94c0ca990 2024-09-21T07:26:10.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb949600640 1 -- 172.21.15.64:0/1163090346 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb94001c460 con 0x7fb94c0ca990 2024-09-21T07:26:10.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb949600640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 0x7fb92c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb949600640 1 -- 172.21.15.64:0/1163090346 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb940093fa0 con 0x7fb94c0ca990 2024-09-21T07:26:10.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb95b6da000 1 Processor -- start 2024-09-21T07:26:10.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb950c00640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 0x7fb92c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.053+0000 7fb95b6da000 1 -- start start 2024-09-21T07:26:10.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb950c00640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 0x7fb92c075710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb9380af000 tx=0x7fb93801af00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b093ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b094530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55844af2ecd0 con 0x55844ac3eaa0 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55844ae44330 con 0x55844af236d0 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55844aea1bb0 con 0x55844ab7a890 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37310/0 (socket says 172.21.15.64:37310) 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 -- 172.21.15.64:0/543463268 learned_addr learned my addr 172.21.15.64:0/543463268 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb951600640 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b093ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb950c00640 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 -- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 msgr2=0x55844b094530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b094530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 -- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 msgr2=0x55844b093ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b093ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 -- 172.21.15.64:0/543463268 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844ae45c80 con 0x55844ac3eaa0 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb952000640 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb944009e80 tx=0x7fb9440107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b63d0c95ee71b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb93dc00640 1 -- 172.21.15.64:0/543463268 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944004d30 con 0x55844ac3eaa0 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb93dc00640 1 -- 172.21.15.64:0/543463268 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944003980 con 0x55844ac3eaa0 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb93dc00640 1 -- 172.21.15.64:0/543463268 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944003db0 con 0x55844ac3eaa0 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- 172.21.15.64:0/543463268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 msgr2=0x55844b094a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb944009e80 tx=0x7fb9440107a0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- 172.21.15.64:0/543463268 shutdown_connections 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b094a70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b094530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 --2- 172.21.15.64:0/543463268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b093ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- 172.21.15.64:0/543463268 >> 172.21.15.64:0/543463268 conn(0x55844ab4e5c0 msgr2=0x55844b04cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- 172.21.15.64:0/543463268 shutdown_connections 2024-09-21T07:26:10.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.057+0000 7fb95b6da000 1 -- 172.21.15.64:0/543463268 wait complete. 2024-09-21T07:26:10.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- start start 2024-09-21T07:26:10.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 Processor -- start 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ac3eaa0 0x55844b0561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844af236d0 0x55844b0566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55844ae94df0 con 0x55844ab7a890 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55844ae90fe0 con 0x55844ac3eaa0 2024-09-21T07:26:10.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55844ae364d0 con 0x55844af236d0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 10 client.0 _ll_register_callbacks cb 0x55844ae147f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37314/0 (socket says 172.21.15.64:37314) 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 -- 172.21.15.64:0/2495918182 learned_addr learned my addr 172.21.15.64:0/2495918182 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb950c00640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ac3eaa0 0x55844b0561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb952000640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844af236d0 0x55844b0566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 -- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844af236d0 msgr2=0x55844b0566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844af236d0 0x55844b0566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 -- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ac3eaa0 msgr2=0x55844b0561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ac3eaa0 0x55844b0561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 -- 172.21.15.64:0/2495918182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844ae2f210 con 0x55844ab7a890 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb951600640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c400 tx=0x7fb94005e210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f475d6de7707c4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940078030 con 0x55844ab7a890 2024-09-21T07:26:10.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb940059fe0 con 0x55844ab7a890 2024-09-21T07:26:10.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55844ae29350 con 0x55844ab7a890 2024-09-21T07:26:10.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb94005e690 con 0x55844ab7a890 2024-09-21T07:26:10.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 10 client.6060 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:10.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55844ae15fc0 con 0x55844ab7a890 2024-09-21T07:26:10.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55844ae29350 con 0x55844ab7a890 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.061+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb94005a1e0 con 0x55844ab7a890 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 10 client.6060 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 10 client.6060 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 20 client.6060 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab33930 0x55844b0a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 4 client.6060 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55844aea3b00 con 0x55844ab33930 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb950c00640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab33930 0x55844b0a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb950c00640 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab33930 0x55844b0a55b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b92e09ba964c0a8c server_cookie=33a97ca629c7b246 in_seq=0 out_seq=0 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb932000640 10 client.6060 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb932000640 1 -- 172.21.15.64:0/2495918182 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55844aea3b00 con 0x55844ab33930 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb932000640 10 client.6060 handle_command_reply: tid=0 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 client.6060 shutdown 2024-09-21T07:26:10.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 msgr2=0x55844b055c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c400 tx=0x7fb94005e210 comp rx=0 tx=0).stop 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 shutdown_connections 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab33930 0x55844b0a55b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844af236d0 0x55844b0566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ac3eaa0 0x55844b0561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb932000640 0 client.6060 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 --2- 172.21.15.64:0/2495918182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ab7a890 0x55844b055c70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 >> 172.21.15.64:0/2495918182 conn(0x55844ab4e5c0 msgr2=0x55844b044360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 shutdown_connections 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 1 -- 172.21.15.64:0/2495918182 wait complete. 2024-09-21T07:26:10.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.065+0000 7fb95b6da000 20 client.6060 trim_cache size 0 max 16384 2024-09-21T07:26:10.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 Processor -- start 2024-09-21T07:26:10.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 -- start start 2024-09-21T07:26:10.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 0x55844b044a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ac3eaa0 0x55844b044fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55844b053d40 con 0x55844af236d0 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c201390 con 0x55844ab7a890 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c0b1fb0 con 0x55844ac3eaa0 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37322/0 (socket says 172.21.15.64:37322) 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 -- 172.21.15.64:0/1654645129 learned_addr learned my addr 172.21.15.64:0/1654645129 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb950c00640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ac3eaa0 0x55844b044fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb951600640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 0x55844b044a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 -- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ac3eaa0 msgr2=0x55844b044fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ac3eaa0 0x55844b044fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 -- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 msgr2=0x55844b044a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 0x55844b044a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 -- 172.21.15.64:0/1654645129 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844aeee680 con 0x55844af236d0 2024-09-21T07:26:10.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb951600640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 0x55844b044a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:10.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb952000640 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb944004000 tx=0x7fb944004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ca74f15a61017 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb93d200640 1 -- 172.21.15.64:0/1654645129 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944004d30 con 0x55844af236d0 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb93d200640 1 -- 172.21.15.64:0/1654645129 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944003a40 con 0x55844af236d0 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.085+0000 7fb93d200640 1 -- 172.21.15.64:0/1654645129 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944004030 con 0x55844af236d0 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- 172.21.15.64:0/1654645129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 msgr2=0x55844b0a65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb944004000 tx=0x7fb944004ac0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- 172.21.15.64:0/1654645129 shutdown_connections 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844af236d0 0x55844b0a65c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ac3eaa0 0x55844b044fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- 172.21.15.64:0/1654645129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844ab7a890 0x55844b044a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- 172.21.15.64:0/1654645129 >> 172.21.15.64:0/1654645129 conn(0x55844ab4e5c0 msgr2=0x55844b044360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- 172.21.15.64:0/1654645129 shutdown_connections 2024-09-21T07:26:10.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- 172.21.15.64:0/1654645129 wait complete. 2024-09-21T07:26:10.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- start start 2024-09-21T07:26:10.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 Processor -- start 2024-09-21T07:26:10.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b0a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0b1960 con 0x55844ac3eaa0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0cc0c0 con 0x55844af236d0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55844ab56680 con 0x55844ab7a890 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb95b6da000 10 client.0 _ll_register_callbacks cb 0x7fb94005e520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37332/0 (socket says 172.21.15.64:37332) 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 -- 172.21.15.64:0/3183445842 learned_addr learned my addr 172.21.15.64:0/3183445842 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb951600640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b0a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb952000640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 -- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 msgr2=0x55844b0a8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b0a8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 -- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 msgr2=0x55844b0c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b0c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 -- 172.21.15.64:0/3183445842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844ae5b0b0 con 0x55844ac3eaa0 2024-09-21T07:26:10.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb951600640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b0a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:10.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb952000640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:10.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb950c00640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb938009790 tx=0x7fb9380091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6774c6aba96ce270 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:10.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.089+0000 7fb932000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9380d6060 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fb9380a6b30 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb944003a40 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9380dc050 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 10 client.6066 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55844ae27610 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944003a40 con 0x55844ac3eaa0 2024-09-21T07:26:10.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb9380df020 con 0x55844ac3eaa0 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 10 client.6066 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 10 client.6066 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 20 client.6066 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab21990 0x55844b109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 4 client.6066 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55844ae9f5b0 con 0x55844ab21990 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb951600640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab21990 0x55844b109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb951600640 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab21990 0x55844b109530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f78302e9982d38 server_cookie=ccd51d19c381d877 in_seq=0 out_seq=0 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 10 client.6066 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 1 -- 172.21.15.64:0/3183445842 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3494 (crc 0 0 0) 0x55844ae9f5b0 con 0x55844ab21990 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 10 client.6066 handle_command_reply: tid=0 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 client.6066 shutdown 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 msgr2=0x55844b0a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb938009790 tx=0x7fb9380091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 shutdown_connections 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55844ab21990 0x55844b109530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55844af236d0 0x55844b0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55844ac3eaa0 0x55844b0a9200 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 --2- 172.21.15.64:0/3183445842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55844ab7a890 0x55844b0a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb932000640 0 client.6066 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 >> 172.21.15.64:0/3183445842 conn(0x55844ab4e5c0 msgr2=0x55844b04c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 shutdown_connections 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 1 -- 172.21.15.64:0/3183445842 wait complete. 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb95b6da000 20 client.6066 trim_cache size 0 max 16384 2024-09-21T07:26:10.101 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "1d921a40-ece2-4ddf-82ea-fd0245f4ed53": { 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "1d921a40-ece2-4ddf-82ea-fd0245f4ed53", 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "24948bbe-6770-44df-93dd-fc52155f2e75": { 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "24948bbe-6770-44df-93dd-fc52155f2e75", 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "d110de51-fd10-4539-b4b9-2fd7dfc5e519": { 2024-09-21T07:26:10.102 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "d110de51-fd10-4539-b4b9-2fd7dfc5e519", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "f42caeff-68cd-4e1a-a48e-966f124d5b15": { 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "f42caeff-68cd-4e1a-a48e-966f124d5b15", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "" 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "24948bbe-6770-44df-93dd-fc52155f2e75": { 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:09.865158+0000", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-21T07:26:10.103 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "d110de51-fd10-4539-b4b9-2fd7dfc5e519": { 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.481177+0000", 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "f42caeff-68cd-4e1a-a48e-966f124d5b15": { 2024-09-21T07:26:10.104 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.249180+0000", 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "1d921a40-ece2-4ddf-82ea-fd0245f4ed53": { 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.017183+0000", 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.105 INFO:teuthology.orchestra.run.smithi064.stdout: "b81e3d10-66ff-4d8a-9a88-8293f34f326b": { 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:00.573287+0000", 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1": { 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:59.281306+0000", 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.106 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "1e7b96c9-870a-401f-a0b0-a05420a615dc": { 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.817313+0000", 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7": { 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.353320+0000", 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:10.107 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:10.108 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:10.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:10.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:10.108 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:10.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 msgr2=0x7fb92c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 0x7fb92c075710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb9380af000 tx=0x7fb93801af00 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 msgr2=0x7fb94c15a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c430 tx=0x7fb94000c8f0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 shutdown_connections 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb92c073200 0x7fb92c075710 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb94c156c60 0x7fb94c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb94c15ec20 0x7fb94c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 --2- 172.21.15.64:0/1163090346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0ca990 0x7fb94c15a5c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 >> 172.21.15.64:0/1163090346 conn(0x7fb94c0ccbe0 msgr2=0x7fb94c0746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 shutdown_connections 2024-09-21T07:26:10.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:10.093+0000 7fb954000640 1 -- 172.21.15.64:0/1163090346 wait complete. 2024-09-21T07:26:15.121 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:26:15.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-21T07:26:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- 172.21.15.64:0/1764686430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00cfdf0 msgr2=0x7f38b00d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 --2- 172.21.15.64:0/1764686430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00cfdf0 0x7f38b00d0200 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009bc0 tx=0x7f38ac01cb30 comp rx=0 tx=0).stop 2024-09-21T07:26:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- 172.21.15.64:0/1764686430 shutdown_connections 2024-09-21T07:26:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 --2- 172.21.15.64:0/1764686430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00cfdf0 0x7f38b00d0200 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 --2- 172.21.15.64:0/1764686430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b0160170 0x7f38b015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- 172.21.15.64:0/1764686430 >> 172.21.15.64:0/1764686430 conn(0x7f38b006d480 msgr2=0x7f38b00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- 172.21.15.64:0/1764686430 shutdown_connections 2024-09-21T07:26:15.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- 172.21.15.64:0/1764686430 wait complete. 2024-09-21T07:26:15.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 Processor -- start 2024-09-21T07:26:15.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.293+0000 7f38b8800640 1 -- start start 2024-09-21T07:26:15.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b00cfdf0 0x7f38b01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 0x7f38b0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0169d20 con 0x7f38b00b3d30 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38b015dab0 con 0x7f38b0160170 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f38b0169ea0 con 0x7f38b00cfdf0 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36974/0 (socket says 172.21.15.64:36974) 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 -- 172.21.15.64:0/1612979311 learned_addr learned my addr 172.21.15.64:0/1612979311 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5400640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b00cfdf0 0x7f38b01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b6800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 0x7f38b0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 -- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b00cfdf0 msgr2=0x7f38b01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b00cfdf0 0x7f38b01514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 -- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 msgr2=0x7f38b0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 0x7f38b0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 -- 172.21.15.64:0/1612979311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b014fc10 con 0x7f38b00b3d30 2024-09-21T07:26:15.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b6800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 0x7f38b0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:15.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b5e00640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e7d0 tx=0x7f38a400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38aa000640 1 -- 172.21.15.64:0/1612979311 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a400ccc0 con 0x7f38b00b3d30 2024-09-21T07:26:15.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38aa000640 1 -- 172.21.15.64:0/1612979311 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38a4010430 con 0x7f38b00b3d30 2024-09-21T07:26:15.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b0153440 con 0x7f38b00b3d30 2024-09-21T07:26:15.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38aa000640 1 -- 172.21.15.64:0/1612979311 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4010860 con 0x7f38b00b3d30 2024-09-21T07:26:15.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.297+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b0153a00 con 0x7f38b00b3d30 2024-09-21T07:26:15.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38aa000640 1 -- 172.21.15.64:0/1612979311 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f38a4010a00 con 0x7f38b00b3d30 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38aa000640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 0x7f3894075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38aa000640 1 -- 172.21.15.64:0/1612979311 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38a4094e20 con 0x7f38b00b3d30 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 Processor -- start 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 -- start start 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38b5400640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 0x7f3894075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38b5400640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 0x7f3894075710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38b014fef0 tx=0x7f38a00013a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7fc59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d7fc5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b2d7e64cd0 con 0x55b2d7b74aa0 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2d7d7a330 con 0x55b2d7e596d0 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b2d7dd7bb0 con 0x55b2d7ab0890 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.301+0000 7f38b6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36976/0 (socket says 172.21.15.64:36976) 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 -- 172.21.15.64:0/1140463130 learned_addr learned my addr 172.21.15.64:0/1140463130 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b5400640 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d7fc5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b5e00640 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7fc59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 -- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 msgr2=0x55b2d7fc5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d7fc5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 -- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 msgr2=0x55b2d7fc59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7fc59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 -- 172.21.15.64:0/1140463130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d7d7bc80 con 0x55b2d7b74aa0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38b6800640 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f38ac01b1e0 tx=0x7f38ac01b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e5d087cc2647b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f389e600640 1 -- 172.21.15.64:0/1140463130 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0b2030 con 0x55b2d7b74aa0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f389e600640 1 -- 172.21.15.64:0/1140463130 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38ac0bc070 con 0x55b2d7b74aa0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f389e600640 1 -- 172.21.15.64:0/1140463130 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0092a0 con 0x55b2d7b74aa0 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- 172.21.15.64:0/1140463130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 msgr2=0x55b2d7fc6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f38ac01b1e0 tx=0x7f38ac01b370 comp rx=0 tx=0).stop 2024-09-21T07:26:15.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- 172.21.15.64:0/1140463130 shutdown_connections 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d7fc6470 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d7fc5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 --2- 172.21.15.64:0/1140463130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7fc59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- 172.21.15.64:0/1140463130 >> 172.21.15.64:0/1140463130 conn(0x55b2d7a845c0 msgr2=0x55b2d7f82ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- 172.21.15.64:0/1140463130 shutdown_connections 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- 172.21.15.64:0/1140463130 wait complete. 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 -- start start 2024-09-21T07:26:15.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.305+0000 7f38bff3c000 1 Processor -- start 2024-09-21T07:26:15.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7b74aa0 0x55b2d7f81f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7f885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b2d7dcadf0 con 0x55b2d7ab0890 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2d7dc6fe0 con 0x55b2d7e596d0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b2d7d6c4d0 con 0x55b2d7b74aa0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 10 client.0 _ll_register_callbacks cb 0x55b2d7d4a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36992/0 (socket says 172.21.15.64:36992) 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 -- 172.21.15.64:0/3234043407 learned_addr learned my addr 172.21.15.64:0/3234043407 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b6800640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7f885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5400640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7b74aa0 0x55b2d7f81f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 -- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7b74aa0 msgr2=0x55b2d7f81f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7b74aa0 0x55b2d7f81f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 -- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 msgr2=0x55b2d7f885f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7f885f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 -- 172.21.15.64:0/3234043407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d7d65210 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f38a405c8b0 tx=0x7f38a405edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ef39207562d128 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4063ff0 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38a405af90 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2d7d5f350 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38a4068f30 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 10 client.6081 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55b2d7d4bfc0 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38a406a020 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f38a405b190 con 0x55b2d7ab0890 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 10 client.6081 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:15.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 20 client.6081 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:15.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a69930 0x55b2d7fcce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 4 client.6081 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:15.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2d7dd9b00 con 0x55b2d7a69930 2024-09-21T07:26:15.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5400640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a69930 0x55b2d7fcce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f38b5400640 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a69930 0x55b2d7fcce80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48b5197b30649fbb server_cookie=dc32defbaed2db34 in_seq=0 out_seq=0 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.309+0000 7f3892a00640 10 client.6081 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f3892a00640 1 -- 172.21.15.64:0/3234043407 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2d7dd9b00 con 0x55b2d7a69930 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f3892a00640 10 client.6081 handle_command_reply: tid=0 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 client.6081 shutdown 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 msgr2=0x55b2d7f819d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f38a405c8b0 tx=0x7f38a405edb0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 shutdown_connections 2024-09-21T07:26:15.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a69930 0x55b2d7fcce80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7e596d0 0x55b2d7f885f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7b74aa0 0x55b2d7f81f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f3892a00640 0 client.6081 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3234043407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7ab0890 0x55b2d7f819d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 >> 172.21.15.64:0/3234043407 conn(0x55b2d7a845c0 msgr2=0x55b2d7f7ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 shutdown_connections 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 1 -- 172.21.15.64:0/3234043407 wait complete. 2024-09-21T07:26:15.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.313+0000 7f38bff3c000 20 client.6081 trim_cache size 0 max 16384 2024-09-21T07:26:15.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.329+0000 7f38bff3c000 1 Processor -- start 2024-09-21T07:26:15.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.329+0000 7f38bff3c000 1 -- start start 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7ab0890 0x55b2d80371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7e596d0 0x55b2d8037c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b2d7f80af0 con 0x55b2d7b74aa0 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0205910 con 0x55b2d7ab0890 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f38b0204930 con 0x55b2d7e596d0 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37000/0 (socket says 172.21.15.64:37000) 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 -- 172.21.15.64:0/964806047 learned_addr learned my addr 172.21.15.64:0/964806047 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b6800640 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7e596d0 0x55b2d8037c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5e00640 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7ab0890 0x55b2d80371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 -- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7e596d0 msgr2=0x55b2d8037c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7e596d0 0x55b2d8037c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 -- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7ab0890 msgr2=0x55b2d80371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7ab0890 0x55b2d80371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 -- 172.21.15.64:0/964806047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d7e24680 con 0x55b2d7b74aa0 2024-09-21T07:26:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38b5400640 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f38b00cdec0 tx=0x7f38a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a09ddfa137381d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f389dc00640 1 -- 172.21.15.64:0/964806047 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a001b040 con 0x55b2d7b74aa0 2024-09-21T07:26:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f389dc00640 1 -- 172.21.15.64:0/964806047 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38a001c040 con 0x55b2d7b74aa0 2024-09-21T07:26:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f389dc00640 1 -- 172.21.15.64:0/964806047 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0014d30 con 0x55b2d7b74aa0 2024-09-21T07:26:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- 172.21.15.64:0/964806047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 msgr2=0x55b2d8037730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f38b00cdec0 tx=0x7f38a0015000 comp rx=0 tx=0).stop 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- 172.21.15.64:0/964806047 shutdown_connections 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7e596d0 0x55b2d8037c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7b74aa0 0x55b2d8037730 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 --2- 172.21.15.64:0/964806047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7ab0890 0x55b2d80371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- 172.21.15.64:0/964806047 >> 172.21.15.64:0/964806047 conn(0x55b2d7a845c0 msgr2=0x55b2d7f875a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- 172.21.15.64:0/964806047 shutdown_connections 2024-09-21T07:26:15.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.333+0000 7f38bff3c000 1 -- 172.21.15.64:0/964806047 wait complete. 2024-09-21T07:26:15.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- start start 2024-09-21T07:26:15.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 Processor -- start 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7b74aa0 0x55b2d803bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38b015ff00 con 0x55b2d7e596d0 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38b015f8b0 con 0x55b2d7b74aa0 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b2d7a8c680 con 0x55b2d7ab0890 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 10 client.0 _ll_register_callbacks cb 0x7f38a400cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37012/0 (socket says 172.21.15.64:37012) 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 -- 172.21.15.64:0/3099029679 learned_addr learned my addr 172.21.15.64:0/3099029679 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b5e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:46202/0 (socket says 172.21.15.64:46202) 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b5400640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7b74aa0 0x55b2d803bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 -- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 msgr2=0x55b2d803b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 -- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7b74aa0 msgr2=0x55b2d803bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7b74aa0 0x55b2d803bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 -- 172.21.15.64:0/3099029679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d7d910b0 con 0x55b2d7e596d0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38b6800640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009bc0 tx=0x7f38ac004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56669e6d7cbd3360 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0b2040 con 0x55b2d7e596d0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a001c040 con 0x55b2d7e596d0 2024-09-21T07:26:15.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f38ac0ccc70 con 0x55b2d7e596d0 2024-09-21T07:26:15.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38ac0d3050 con 0x55b2d7e596d0 2024-09-21T07:26:15.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 10 client.6087 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:15.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55b2d7d5d610 con 0x55b2d7e596d0 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38a001c040 con 0x55b2d7e596d0 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f38ac0d6020 con 0x55b2d7e596d0 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 10 client.6087 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 20 client.6087 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a57990 0x55b2d7f7d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 4 client.6087 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.337+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2d7dd55b0 con 0x55b2d7a57990 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a57990 0x55b2d7f7d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b5e00640 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a57990 0x55b2d7f7d1e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a7707968f61a63 server_cookie=c50cd52906ccf377 in_seq=0 out_seq=0 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f3892a00640 10 client.6087 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f3892a00640 1 -- 172.21.15.64:0/3099029679 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2654 (crc 0 0 0) 0x7f38a406aa70 con 0x55b2d7a57990 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f3892a00640 10 client.6087 handle_command_reply: tid=0 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 client.6087 shutdown 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 msgr2=0x55b2d803c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009bc0 tx=0x7f38ac004eb0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 shutdown_connections 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55b2d7a57990 0x55b2d7f7d1e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2d7e596d0 0x55b2d803c0d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b2d7b74aa0 0x55b2d803bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 --2- 172.21.15.64:0/3099029679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b2d7ab0890 0x55b2d803b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 >> 172.21.15.64:0/3099029679 conn(0x55b2d7a845c0 msgr2=0x55b2d7fd7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f3892a00640 0 client.6087 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 shutdown_connections 2024-09-21T07:26:15.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 1 -- 172.21.15.64:0/3099029679 wait complete. 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38bff3c000 20 client.6087 trim_cache size 0 max 16384 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout: "24948bbe-6770-44df-93dd-fc52155f2e75": { 2024-09-21T07:26:15.350 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:09.865158+0000", 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "d110de51-fd10-4539-b4b9-2fd7dfc5e519": { 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.481177+0000", 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.351 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "f42caeff-68cd-4e1a-a48e-966f124d5b15": { 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.249180+0000", 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "1d921a40-ece2-4ddf-82ea-fd0245f4ed53": { 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:08.017183+0000", 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.352 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "b81e3d10-66ff-4d8a-9a88-8293f34f326b": { 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:26:00.573287+0000", 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "4f195809-ffb8-4d3c-ba03-c71e1ca40bd1": { 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:59.281306+0000", 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.353 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "1e7b96c9-870a-401f-a0b0-a05420a615dc": { 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.817313+0000", 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "d2ddf1e4-2b04-4e69-b1f6-dbb2098598f7": { 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:25:58.353320+0000", 2024-09-21T07:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:15.355 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 msgr2=0x7f3894075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 0x7f3894075710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38b014fef0 tx=0x7f38a00013a0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 msgr2=0x7f38b014f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e7d0 tx=0x7f38a400ec90 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 shutdown_connections 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3894073200 0x7f3894075710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38b0160170 0x7f38b0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38b00cfdf0 0x7f38b01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 --2- 172.21.15.64:0/1612979311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38b00b3d30 0x7f38b014f6d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 >> 172.21.15.64:0/1612979311 conn(0x7f38b006d480 msgr2=0x7f38b0158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 shutdown_connections 2024-09-21T07:26:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.341+0000 7f38b8800640 1 -- 172.21.15.64:0/1612979311 wait complete. 2024-09-21T07:26:15.365 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:26:15.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 -- 172.21.15.64:0/112447078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f509415c880 msgr2=0x7f50940b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 --2- 172.21.15.64:0/112447078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f509415c880 0x7f50940b4280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f508c009bf0 tx=0x7f508c01cb50 comp rx=0 tx=0).stop 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 -- 172.21.15.64:0/112447078 shutdown_connections 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 --2- 172.21.15.64:0/112447078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f509415c880 0x7f50940b4280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 -- 172.21.15.64:0/112447078 >> 172.21.15.64:0/112447078 conn(0x7f50940d0c10 msgr2=0x7f50940d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 -- 172.21.15.64:0/112447078 shutdown_connections 2024-09-21T07:26:15.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.521+0000 7f509a600640 1 -- 172.21.15.64:0/112447078 wait complete. 2024-09-21T07:26:15.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 Processor -- start 2024-09-21T07:26:15.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 -- start start 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50940cb980 0x7f509415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f509415c880 0x7f5094157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f509416ae90 con 0x7f50940b2650 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f509416ad10 con 0x7f509415c880 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f509a600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f509416b010 con 0x7f50940cb980 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37016/0 (socket says 172.21.15.64:37016) 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.525+0000 7f5093e00640 1 -- 172.21.15.64:0/1660989144 learned_addr learned my addr 172.21.15.64:0/1660989144 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093400640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50940cb980 0x7f509415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f508be00640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f509415c880 0x7f5094157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 -- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50940cb980 msgr2=0x7f509415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50940cb980 0x7f509415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 -- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f509415c880 msgr2=0x7f5094157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f509415c880 0x7f5094157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 -- 172.21.15.64:0/1660989144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50940b6400 con 0x7f50940b2650 2024-09-21T07:26:15.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f5093e00640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f508c01b3d0 tx=0x7f508c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f508b400640 1 -- 172.21.15.64:0/1660989144 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0bc070 con 0x7f50940b2650 2024-09-21T07:26:15.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f508b400640 1 -- 172.21.15.64:0/1660989144 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c004130 con 0x7f50940b2650 2024-09-21T07:26:15.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50940b2fa0 con 0x7f50940b2650 2024-09-21T07:26:15.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f508b400640 1 -- 172.21.15.64:0/1660989144 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0b2040 con 0x7f50940b2650 2024-09-21T07:26:15.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50940c7f70 con 0x7f50940b2650 2024-09-21T07:26:15.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.529+0000 7f508b400640 1 -- 172.21.15.64:0/1660989144 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f508c0bf070 con 0x7f50940b2650 2024-09-21T07:26:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f508b400640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 0x7f5070075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f508b400640 1 -- 172.21.15.64:0/1660989144 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f508c12e3b0 con 0x7f50940b2650 2024-09-21T07:26:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 Processor -- start 2024-09-21T07:26:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093400640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 0x7f5070075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 -- start start 2024-09-21T07:26:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093400640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 0x7f5070075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5084001640 tx=0x7f5084009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf74e320 0x55cfbf8c0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf75ed50 con 0x55cfbf747db0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf6d2b10 con 0x55cfbf7475a0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cfbf6c1f40 con 0x55cfbf74e320 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37020/0 (socket says 172.21.15.64:37020) 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 -- 172.21.15.64:0/2707450095 learned_addr learned my addr 172.21.15.64:0/2707450095 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093400640 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf74e320 0x55cfbf8c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f508be00640 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 -- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf74e320 msgr2=0x55cfbf8c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf74e320 0x55cfbf8c0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 -- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 msgr2=0x55cfbf8c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 -- 172.21.15.64:0/2707450095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbf643120 con 0x55cfbf747db0 2024-09-21T07:26:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5093e00640 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f508c0f8960 tx=0x7f508c0f85b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23c1c98a805012f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5083e00640 1 -- 172.21.15.64:0/2707450095 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0f9360 con 0x55cfbf747db0 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5083e00640 1 -- 172.21.15.64:0/2707450095 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c0fd740 con 0x55cfbf747db0 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.533+0000 7f5083e00640 1 -- 172.21.15.64:0/2707450095 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c102560 con 0x55cfbf747db0 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- 172.21.15.64:0/2707450095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 msgr2=0x55cfbf8c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f508c0f8960 tx=0x7f508c0f85b0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- 172.21.15.64:0/2707450095 shutdown_connections 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf8c13e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- 172.21.15.64:0/2707450095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf74e320 0x55cfbf8c0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- 172.21.15.64:0/2707450095 >> 172.21.15.64:0/2707450095 conn(0x55cfbf37f920 msgr2=0x55cfbf8a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- 172.21.15.64:0/2707450095 shutdown_connections 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- 172.21.15.64:0/2707450095 wait complete. 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- start start 2024-09-21T07:26:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 Processor -- start 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf747db0 0x55cfbf8a3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf667500 con 0x55cfbf74e320 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf6c5d50 con 0x55cfbf7475a0 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cfbf387680 con 0x55cfbf747db0 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f50a1d50000 10 client.0 _ll_register_callbacks cb 0x55cfbf862100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37030/0 (socket says 172.21.15.64:37030) 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f5093e00640 1 -- 172.21.15.64:0/1677128485 learned_addr learned my addr 172.21.15.64:0/1677128485 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f5093400640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.537+0000 7f508be00640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf747db0 0x55cfbf8a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 -- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf747db0 msgr2=0x55cfbf8a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf747db0 0x55cfbf8a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 -- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 msgr2=0x55cfbf8a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8a2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 -- 172.21.15.64:0/1677128485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbf676c60 con 0x55cfbf74e320 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093e00640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f508c01d030 tx=0x7f508c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ecd21e39fdd6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c1022d0 con 0x55cfbf74e320 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f508c12cb70 con 0x55cfbf74e320 2024-09-21T07:26:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cfbf65a330 con 0x55cfbf74e320 2024-09-21T07:26:15.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f508c0f8c60 con 0x55cfbf74e320 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 10 client.6099 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55cfbf6c0be0 con 0x55cfbf74e320 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cfbf65a330 con 0x55cfbf74e320 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f508c0b5070 con 0x55cfbf74e320 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 10 client.6099 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 10 client.6099 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 20 client.6099 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf364930 0x55cfbf8d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 4 client.6099 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfbf6d4a60 con 0x55cfbf364930 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093400640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf364930 0x55cfbf8d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 10 client.6099 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5093400640 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf364930 0x55cfbf8d1f20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5ac01c368a7e87 server_cookie=5fe1fe4edc7758c9 in_seq=0 out_seq=0 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 1 -- 172.21.15.64:0/1677128485 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfbf6d4a60 con 0x55cfbf364930 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 10 client.6099 handle_command_reply: tid=0 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 client.6099 shutdown 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 msgr2=0x55cfbf8a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f508c01d030 tx=0x7f508c009b80 comp rx=0 tx=0).stop 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 shutdown_connections 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf364930 0x55cfbf8d1f20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf8a39d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf747db0 0x55cfbf8a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 --2- 172.21.15.64:0/1677128485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf7475a0 0x55cfbf8a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 >> 172.21.15.64:0/1677128485 conn(0x55cfbf37f920 msgr2=0x55cfbf8747e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f5080c00640 0 client.6099 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 shutdown_connections 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 1 -- 172.21.15.64:0/1677128485 wait complete. 2024-09-21T07:26:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.541+0000 7f50a1d50000 20 client.6099 trim_cache size 0 max 16384 2024-09-21T07:26:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 Processor -- start 2024-09-21T07:26:15.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 -- start start 2024-09-21T07:26:15.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf8767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf74e320 0x55cfbf877270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf87a2f0 con 0x55cfbf747db0 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5094203450 con 0x55cfbf74e320 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5094202430 con 0x55cfbf7475a0 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37034/0 (socket says 172.21.15.64:37034) 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 -- 172.21.15.64:0/3778888992 learned_addr learned my addr 172.21.15.64:0/3778888992 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f5093e00640 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf74e320 0x55cfbf877270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f5093400640 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf8767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 -- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 msgr2=0x55cfbf8767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf8767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 -- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf74e320 msgr2=0x55cfbf877270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf74e320 0x55cfbf877270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.557+0000 7f508be00640 1 -- 172.21.15.64:0/3778888992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbf6601f0 con 0x55cfbf747db0 2024-09-21T07:26:15.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f508be00640 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f507c001580 tx=0x7f507c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344439d505516f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f5083400640 1 -- 172.21.15.64:0/3778888992 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c01a070 con 0x55cfbf747db0 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f5083400640 1 -- 172.21.15.64:0/3778888992 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f507c0051c0 con 0x55cfbf747db0 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f5083400640 1 -- 172.21.15.64:0/3778888992 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0148a0 con 0x55cfbf747db0 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- 172.21.15.64:0/3778888992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 msgr2=0x55cfbf876d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f507c001580 tx=0x7f507c001a40 comp rx=0 tx=0).stop 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- 172.21.15.64:0/3778888992 shutdown_connections 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf74e320 0x55cfbf877270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf747db0 0x55cfbf876d30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3778888992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf8767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- 172.21.15.64:0/3778888992 >> 172.21.15.64:0/3778888992 conn(0x55cfbf37f920 msgr2=0x55cfbf8d7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- 172.21.15.64:0/3778888992 shutdown_connections 2024-09-21T07:26:15.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- 172.21.15.64:0/3778888992 wait complete. 2024-09-21T07:26:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 -- start start 2024-09-21T07:26:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 Processor -- start 2024-09-21T07:26:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.561+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf9358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf747db0 0x55cfbf935e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf87fd90 con 0x55cfbf74e320 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cfbf6c5060 con 0x55cfbf747db0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cfbf68d8b0 con 0x55cfbf7475a0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 10 client.0 _ll_register_callbacks cb 0x7f508c0fd050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37046/0 (socket says 172.21.15.64:37046) 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 -- 172.21.15.64:0/3522124631 learned_addr learned my addr 172.21.15.64:0/3522124631 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093400640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf9358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f508be00640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf747db0 0x55cfbf935e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 -- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 msgr2=0x55cfbf9358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf9358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 -- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf747db0 msgr2=0x55cfbf935e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:15.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf747db0 0x55cfbf935e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 -- 172.21.15.64:0/3522124631 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbf688990 con 0x55cfbf74e320 2024-09-21T07:26:15.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093e00640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f508c01c980 tx=0x7f508c12c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e072b0c394d2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0f83d0 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f508c11e120 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f507c0051c0 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f508c112070 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 10 client.6105 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55cfbf658580 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f507c0051c0 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f508c0f7ec0 con 0x55cfbf74e320 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 10 client.6105 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:15.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 10 client.6105 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 20 client.6105 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf352990 0x55cfbf8d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 4 client.6105 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfbf6d0510 con 0x55cfbf352990 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093400640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf352990 0x55cfbf8d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5093400640 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf352990 0x55cfbf8d43f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71d242cdfef8768b server_cookie=d1c913f38958c690 in_seq=0 out_seq=0 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 10 client.6105 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 1 -- 172.21.15.64:0/3522124631 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+167 (crc 0 0 0) 0x55cfbf6d0510 con 0x55cfbf352990 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 10 client.6105 handle_command_reply: tid=0 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 client.6105 shutdown 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 msgr2=0x55cfbf936360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f508c01c980 tx=0x7f508c12c620 comp rx=0 tx=0).stop 2024-09-21T07:26:15.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 shutdown_connections 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55cfbf352990 0x55cfbf8d43f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cfbf74e320 0x55cfbf936360 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cfbf747db0 0x55cfbf935e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 --2- 172.21.15.64:0/3522124631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cfbf7475a0 0x55cfbf9358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f5080c00640 0 client.6105 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 >> 172.21.15.64:0/3522124631 conn(0x55cfbf37f920 msgr2=0x55cfbf87b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 shutdown_connections 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 1 -- 172.21.15.64:0/3522124631 wait complete. 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f50a1d50000 20 client.6105 trim_cache size 0 max 16384 2024-09-21T07:26:15.574 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: "damage_type": "backtrace", 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 186965096, 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 1099511630410, 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:15.575 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 msgr2=0x7f5070075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 0x7f5070075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5084001640 tx=0x7f5084009040 comp rx=0 tx=0).stop 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 msgr2=0x7f50940b2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.565+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f508c01b3d0 tx=0x7f508c005b00 comp rx=0 tx=0).stop 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 shutdown_connections 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5070073200 0x7f5070075710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50940b2650 0x7f50940b2a60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f509415c880 0x7f5094157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 --2- 172.21.15.64:0/1660989144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50940cb980 0x7f509415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 >> 172.21.15.64:0/1660989144 conn(0x7f50940d0c10 msgr2=0x7f50940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 shutdown_connections 2024-09-21T07:26:15.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.569+0000 7f509a600640 1 -- 172.21.15.64:0/1660989144 wait complete. 2024-09-21T07:26:15.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 -- 172.21.15.64:0/1225279853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a41602d0 msgr2=0x7f53a41606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 --2- 172.21.15.64:0/1225279853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a41602d0 0x7f53a41606e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f539401c6f0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 -- 172.21.15.64:0/1225279853 shutdown_connections 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 --2- 172.21.15.64:0/1225279853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a41602d0 0x7f53a41606e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 -- 172.21.15.64:0/1225279853 >> 172.21.15.64:0/1225279853 conn(0x7f53a40cecd0 msgr2=0x7f53a40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 -- 172.21.15.64:0/1225279853 shutdown_connections 2024-09-21T07:26:15.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.745+0000 7f53aa000640 1 -- 172.21.15.64:0/1225279853 wait complete. 2024-09-21T07:26:15.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 Processor -- start 2024-09-21T07:26:15.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- start start 2024-09-21T07:26:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 0x7f53a41588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 0x7f53a4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53a416b0c0 con 0x7f53a4071170 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53a416af40 con 0x7f53a41602d0 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f53a416b240 con 0x7f53a40d05f0 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37062/0 (socket says 172.21.15.64:37062) 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 -- 172.21.15.64:0/702487737 learned_addr learned my addr 172.21.15.64:0/702487737 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3e00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 0x7f53a4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f539be00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 0x7f53a41588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 -- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 msgr2=0x7f53a41588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 0x7f53a41588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 -- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 msgr2=0x7f53a4158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 0x7f53a4158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 -- 172.21.15.64:0/702487737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a41f9d50 con 0x7f53a4071170 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3e00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 0x7f53a4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f539be00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 0x7f53a41588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53a3400640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c10 tx=0x7f5394005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53940ac030 con 0x7f53a4071170 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5394004400 con 0x7f53a4071170 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394004970 con 0x7f53a4071170 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a4153900 con 0x7f53a4071170 2024-09-21T07:26:15.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.749+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41fa2d0 con 0x7f53a4071170 2024-09-21T07:26:15.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a41606e0 con 0x7f53a4071170 2024-09-21T07:26:15.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53940af070 con 0x7f53a4071170 2024-09-21T07:26:15.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f539b400640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 0x7f5380075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:15.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f539412e3d0 con 0x7f53a4071170 2024-09-21T07:26:15.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f539be00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 0x7f5380075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:15.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.753+0000 7f539be00640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 0x7f5380075710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f538c0046c0 tx=0x7f538c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:15.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.757+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5394016370 con 0x7f53a4071170 2024-09-21T07:26:15.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.969+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53a40b4ae0 con 0x7f53a4071170 2024-09-21T07:26:15.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.969+0000 7f539b400640 1 -- 172.21.15.64:0/702487737 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7f53940f9140 con 0x7f53a4071170 2024-09-21T07:26:15.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:15.976 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 msgr2=0x7f5380075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 0x7f5380075710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f538c0046c0 tx=0x7f538c009040 comp rx=0 tx=0).stop 2024-09-21T07:26:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 msgr2=0x7f53a414b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c10 tx=0x7f5394005750 comp rx=0 tx=0).stop 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 shutdown_connections 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5380073200 0x7f5380075710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53a41602d0 0x7f53a4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53a40d05f0 0x7f53a41588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 --2- 172.21.15.64:0/702487737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53a4071170 0x7f53a414b340 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 >> 172.21.15.64:0/702487737 conn(0x7f53a40cecd0 msgr2=0x7f53a415ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 shutdown_connections 2024-09-21T07:26:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:15.973+0000 7f53aa000640 1 -- 172.21.15.64:0/702487737 wait complete. 2024-09-21T07:26:15.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 186965096 2024-09-21T07:26:16.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 -- 172.21.15.64:0/2544074811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640ce4d0 msgr2=0x7f78640ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 --2- 172.21.15.64:0/2544074811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640ce4d0 0x7f78640ce8e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f78640b2ee0 tx=0x7f785c01cb40 comp rx=0 tx=0).stop 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 -- 172.21.15.64:0/2544074811 shutdown_connections 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 --2- 172.21.15.64:0/2544074811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640ce4d0 0x7f78640ce8e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 --2- 172.21.15.64:0/2544074811 >> v2:172.21.15.90:3300/0 conn(0x7f78640b3850 0x7f786415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 -- 172.21.15.64:0/2544074811 >> 172.21.15.64:0/2544074811 conn(0x7f786406d450 msgr2=0x7f78640d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 -- 172.21.15.64:0/2544074811 shutdown_connections 2024-09-21T07:26:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.153+0000 7f786b400640 1 -- 172.21.15.64:0/2544074811 wait complete. 2024-09-21T07:26:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 Processor -- start 2024-09-21T07:26:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 -- start start 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78640b3850 0x7f7864143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78640ce4d0 0x7f78640ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7864168cd0 con 0x7f78640cc960 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7864168b50 con 0x7f78640b3850 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f786b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7864168e50 con 0x7f78640ce4d0 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f785be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f785be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37080/0 (socket says 172.21.15.64:37080) 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f785be00640 1 -- 172.21.15.64:0/1594963217 learned_addr learned my addr 172.21.15.64:0/1594963217 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f7868a00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78640b3850 0x7f7864143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.157+0000 7f7869400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78640ce4d0 0x7f78640ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 -- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78640ce4d0 msgr2=0x7f78640ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78640ce4d0 0x7f78640ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 -- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78640b3850 msgr2=0x7f7864143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78640b3850 0x7f7864143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 -- 172.21.15.64:0/1594963217 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7864143ec0 con 0x7f78640cc960 2024-09-21T07:26:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f785be00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e7c0 tx=0x7f784c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f7861600640 1 -- 172.21.15.64:0/1594963217 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c00ccc0 con 0x7f78640cc960 2024-09-21T07:26:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f7861600640 1 -- 172.21.15.64:0/1594963217 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f784c00ce80 con 0x7f78640cc960 2024-09-21T07:26:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f7861600640 1 -- 172.21.15.64:0/1594963217 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c005280 con 0x7f78640cc960 2024-09-21T07:26:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78641411c0 con 0x7f78640cc960 2024-09-21T07:26:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7864141780 con 0x7f78640cc960 2024-09-21T07:26:16.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.161+0000 7f7861600640 1 -- 172.21.15.64:0/1594963217 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f784c005420 con 0x7f78640cc960 2024-09-21T07:26:16.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7861600640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 0x7f7840075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7861600640 1 -- 172.21.15.64:0/1594963217 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f784c094d70 con 0x7f78640cc960 2024-09-21T07:26:16.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 Processor -- start 2024-09-21T07:26:16.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 0x7f7840075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 -- start start 2024-09-21T07:26:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 0x7f7840075710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78540015c0 tx=0x7f7854009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813cf6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813cf6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f813b90810 con 0x55f813b81430 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f813b03980 con 0x55f813b78370 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f813af2db0 con 0x55f813b78b80 2024-09-21T07:26:16.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37098/0 (socket says 172.21.15.64:37098) 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 -- 172.21.15.64:0/2819445941 learned_addr learned my addr 172.21.15.64:0/2819445941 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f785be00640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813cf6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7869400640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813cf6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 -- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 msgr2=0x55f813cf6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813cf6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 -- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 msgr2=0x55f813cf6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813cf6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 -- 172.21.15.64:0/2819445941 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f813ac0af0 con 0x55f813b81430 2024-09-21T07:26:16.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f785be00640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813cf6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:16.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7868a00640 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78540052a0 tx=0x7f7854011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaeeb35ccf01277 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7859200640 1 -- 172.21.15.64:0/2819445941 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785400e6c0 con 0x55f813b81430 2024-09-21T07:26:16.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7859200640 1 -- 172.21.15.64:0/2819445941 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f785400e950 con 0x55f813b81430 2024-09-21T07:26:16.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.165+0000 7f7859200640 1 -- 172.21.15.64:0/2819445941 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785400ed40 con 0x55f813b81430 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- 172.21.15.64:0/2819445941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 msgr2=0x55f813cf6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78540052a0 tx=0x7f7854011000 comp rx=0 tx=0).stop 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- 172.21.15.64:0/2819445941 shutdown_connections 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813cf6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813cf6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2819445941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b81430 0x55f813cf6040 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- 172.21.15.64:0/2819445941 >> 172.21.15.64:0/2819445941 conn(0x55f813c773c0 msgr2=0x55f813ca6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- 172.21.15.64:0/2819445941 shutdown_connections 2024-09-21T07:26:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- 172.21.15.64:0/2819445941 wait complete. 2024-09-21T07:26:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- start start 2024-09-21T07:26:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 Processor -- start 2024-09-21T07:26:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 0x55f813ce1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f813a98140 con 0x55f813b78370 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f813af6bc0 con 0x55f813b78b80 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f813a99320 con 0x55f813b81430 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7872bf3000 10 client.0 _ll_register_callbacks cb 0x55f813c93b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7869400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37108/0 (socket says 172.21.15.64:37108) 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7869400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:46298/0 (socket says 172.21.15.64:46298) 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f7868a00640 1 -- 172.21.15.64:0/2342264389 learned_addr learned my addr 172.21.15.64:0/2342264389 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.169+0000 7f785be00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 0x55f813ce1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 -- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 msgr2=0x55f813ce1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 -- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 msgr2=0x55f813ce1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 0x55f813ce1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 -- 172.21.15.64:0/2342264389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f813a9bba0 con 0x55f813b78370 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7869400640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:26:16.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f785be00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 0x55f813ce1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7868a00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55f813b98200 tx=0x7f785400e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac18f2ea83940a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785400ecf0 con 0x55f813b78370 2024-09-21T07:26:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7854010050 con 0x55f813b78370 2024-09-21T07:26:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f813a8ae20 con 0x55f813b78370 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7854032050 con 0x55f813b78370 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 10 client.6126 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f813a90f90 con 0x55f813b78370 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f813a8ae20 con 0x55f813b78370 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f7854035020 con 0x55f813b78370 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 10 client.6126 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 10 client.6126 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 20 client.6126 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813795a10 0x55f813ce28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 4 client.6126 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f813b058d0 con 0x55f813795a10 2024-09-21T07:26:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.173+0000 7f785be00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813795a10 0x55f813ce28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f785be00640 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813795a10 0x55f813ce28b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf6f15a72e47897 server_cookie=82043b603f9d9aa8 in_seq=0 out_seq=0 2024-09-21T07:26:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7851600640 10 client.6126 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7851600640 1 -- 172.21.15.64:0/2342264389 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f813b058d0 con 0x55f813795a10 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7851600640 10 client.6126 handle_command_reply: tid=0 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 client.6126 shutdown 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 msgr2=0x55f813ce1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55f813b98200 tx=0x7f785400e8f0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 shutdown_connections 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813795a10 0x55f813ce28b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813ce1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78b80 0x55f813ce1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2342264389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813ce1420 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7851600640 0 client.6126 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 >> 172.21.15.64:0/2342264389 conn(0x55f813c773c0 msgr2=0x55f813cad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 shutdown_connections 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 1 -- 172.21.15.64:0/2342264389 wait complete. 2024-09-21T07:26:16.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.177+0000 7f7872bf3000 20 client.6126 trim_cache size 0 max 16384 2024-09-21T07:26:16.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 Processor -- start 2024-09-21T07:26:16.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 -- start start 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813d0c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 0x55f813d0cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f786415a160 con 0x55f813b78370 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f786409c050 con 0x55f813b81430 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f813a775a0 con 0x55f813b78b80 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37116/0 (socket says 172.21.15.64:37116) 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 -- 172.21.15.64:0/2915619568 learned_addr learned my addr 172.21.15.64:0/2915619568 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f785be00640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813d0c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7869400640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 0x55f813d0cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 -- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 msgr2=0x55f813d0c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813d0c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 -- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 msgr2=0x55f813d0cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 0x55f813d0cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 -- 172.21.15.64:0/2915619568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f813abc970 con 0x55f813b78370 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7869400640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 0x55f813d0cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7868a00640 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f785400e180 tx=0x7f7854003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662c491c32382724 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7853e00640 1 -- 172.21.15.64:0/2915619568 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854021450 con 0x55f813b78370 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7853e00640 1 -- 172.21.15.64:0/2915619568 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7854005090 con 0x55f813b78370 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.193+0000 7f7853e00640 1 -- 172.21.15.64:0/2915619568 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540216e0 con 0x55f813b78370 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- 172.21.15.64:0/2915619568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 msgr2=0x55f813cadd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f785400e180 tx=0x7f7854003f10 comp rx=0 tx=0).stop 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- 172.21.15.64:0/2915619568 shutdown_connections 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b81430 0x55f813d0cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b78b80 0x55f813d0c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- 172.21.15.64:0/2915619568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78370 0x55f813cadd50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- 172.21.15.64:0/2915619568 >> 172.21.15.64:0/2915619568 conn(0x55f813c773c0 msgr2=0x55f813cf4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- 172.21.15.64:0/2915619568 shutdown_connections 2024-09-21T07:26:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- 172.21.15.64:0/2915619568 wait complete. 2024-09-21T07:26:16.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- start start 2024-09-21T07:26:16.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 Processor -- start 2024-09-21T07:26:16.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813d6b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813d6bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f813af5ed0 con 0x55f813b78b80 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f813b02750 con 0x55f813b78370 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f813bb3710 con 0x55f813b81430 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7872bf3000 10 client.0 _ll_register_callbacks cb 0x7f785c0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37130/0 (socket says 172.21.15.64:37130) 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 -- 172.21.15.64:0/1643093528 learned_addr learned my addr 172.21.15.64:0/1643093528 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7869400640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813d6bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7868a00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813d6b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 -- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 msgr2=0x55f813d6bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813d6bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 -- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 msgr2=0x55f813d6b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813d6b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 -- 172.21.15.64:0/1643093528 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f813a77f50 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7868a00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813d6b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f785be00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f784c05c760 tx=0x7f784c05bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d437499ca2a9c6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7851600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.197+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c063fd0 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f784c068c00 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7854005090 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f784c073050 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 10 client.6132 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f813ab5a60 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7854005090 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f784c080020 con 0x55f813b78b80 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 10 client.6132 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 10 client.6132 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:26:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 20 client.6132 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813783a70 0x55f813d08f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 4 client.6132 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 186965096}] 2024-09-21T07:26:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "damage rm", "damage_id": 186965096}) -- 0x55f813b01380 con 0x55f813783a70 2024-09-21T07:26:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7868a00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813783a70 0x55f813d08f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 10 client.6132 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7868a00640 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813783a70 0x55f813d08f30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eabccf8478dd10a server_cookie=33db6f80477db523 in_seq=0 out_seq=0 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 1 -- 172.21.15.64:0/1643093528 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55f813b01380 con 0x55f813783a70 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 10 client.6132 handle_command_reply: tid=0 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 client.6132 shutdown 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 msgr2=0x55f813d6b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f784c05c760 tx=0x7f784c05bc70 comp rx=0 tx=0).stop 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 shutdown_connections 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x55f813783a70 0x55f813d08f30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f813b81430 0x55f813d6bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f813b78b80 0x55f813d6b980 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 --2- 172.21.15.64:0/1643093528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f813b78370 0x55f813d6b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7851600640 0 client.6132 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 >> 172.21.15.64:0/1643093528 conn(0x55f813c773c0 msgr2=0x55f813cf5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 shutdown_connections 2024-09-21T07:26:16.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 1 -- 172.21.15.64:0/1643093528 wait complete. 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f7872bf3000 20 client.6132 trim_cache size 0 max 16384 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 msgr2=0x7f7840075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 0x7f7840075710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78540015c0 tx=0x7f7854009040 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 msgr2=0x7f78640acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e7c0 tx=0x7f784c00ec80 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 shutdown_connections 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7840073200 0x7f7840075710 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78640ce4d0 0x7f78640ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78640cc960 0x7f78640acfc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 --2- 172.21.15.64:0/1594963217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78640b3850 0x7f7864143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 >> 172.21.15.64:0/1594963217 conn(0x7f786406d450 msgr2=0x7f786415dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 shutdown_connections 2024-09-21T07:26:16.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.201+0000 7f786b400640 1 -- 172.21.15.64:0/1594963217 wait complete. 2024-09-21T07:26:16.226 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-21T07:26:16.226 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-21T07:26:16.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 -- 172.21.15.64:0/2264626319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 msgr2=0x7f683c15d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 --2- 172.21.15.64:0/2264626319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c15d3d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f682c009870 tx=0x7f682c01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 -- 172.21.15.64:0/2264626319 shutdown_connections 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 --2- 172.21.15.64:0/2264626319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c15d3d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 -- 172.21.15.64:0/2264626319 >> 172.21.15.64:0/2264626319 conn(0x7f683c06d480 msgr2=0x7f683c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 -- 172.21.15.64:0/2264626319 shutdown_connections 2024-09-21T07:26:16.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.381+0000 7f6843000640 1 -- 172.21.15.64:0/2264626319 wait complete. 2024-09-21T07:26:16.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 Processor -- start 2024-09-21T07:26:16.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 -- start start 2024-09-21T07:26:16.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0b3d30 0x7f683c1f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c1fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f683c16b010 con 0x7f683c0cfdf0 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f683c16ae90 con 0x7f683c0b3d30 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6843000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f683c16b190 con 0x7f683c160170 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f683b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f683b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37132/0 (socket says 172.21.15.64:37132) 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f683b400640 1 -- 172.21.15.64:0/2378743057 learned_addr learned my addr 172.21.15.64:0/2378743057 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f683be00640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0b3d30 0x7f683c1f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.385+0000 7f6841000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c1fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 -- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 msgr2=0x7f683c1fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c1fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 -- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0b3d30 msgr2=0x7f683c1f8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0b3d30 0x7f683c1f8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 -- 172.21.15.64:0/2378743057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c1f93d0 con 0x7f683c0cfdf0 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f683b400640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f682800c390 tx=0x7f6828001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f6833e00640 1 -- 172.21.15.64:0/2378743057 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828017070 con 0x7f683c0cfdf0 2024-09-21T07:26:16.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f6833e00640 1 -- 172.21.15.64:0/2378743057 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68280053c0 con 0x7f683c0cfdf0 2024-09-21T07:26:16.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f6833e00640 1 -- 172.21.15.64:0/2378743057 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828003860 con 0x7f683c0cfdf0 2024-09-21T07:26:16.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c152470 con 0x7f683c0cfdf0 2024-09-21T07:26:16.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.389+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c06faa0 con 0x7f683c0cfdf0 2024-09-21T07:26:16.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6833e00640 1 -- 172.21.15.64:0/2378743057 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f682801a070 con 0x7f683c0cfdf0 2024-09-21T07:26:16.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 Processor -- start 2024-09-21T07:26:16.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6833e00640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 0x7f681c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 -- start start 2024-09-21T07:26:16.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6833e00640 1 -- 172.21.15.64:0/2378743057 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f68280936b0 con 0x7f683c0cfdf0 2024-09-21T07:26:16.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 0x7f681c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 0x7f681c075740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68340017b0 tx=0x7f6834001740 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf73ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf740440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558cdf551c40 con 0x558cdf5d91a0 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558cdf541070 con 0x558cdf5f6570 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558cdf544e80 con 0x558cdf5ef310 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37146/0 (socket says 172.21.15.64:37146) 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 -- 172.21.15.64:0/2517140781 learned_addr learned my addr 172.21.15.64:0/2517140781 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f683be00640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf73ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f683b400640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf740440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 -- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 msgr2=0x558cdf740440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf740440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 -- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 msgr2=0x558cdf73ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf73ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f6841000640 1 -- 172.21.15.64:0/2517140781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdf4c1790 con 0x558cdf5d91a0 2024-09-21T07:26:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.393+0000 7f683be00640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf73ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f6841000640 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f683400fc00 tx=0x7f6834012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a3941c6e16ddad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f6830c00640 1 -- 172.21.15.64:0/2517140781 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683401b050 con 0x558cdf5d91a0 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f6830c00640 1 -- 172.21.15.64:0/2517140781 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6834025070 con 0x558cdf5d91a0 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f6830c00640 1 -- 172.21.15.64:0/2517140781 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834020440 con 0x558cdf5d91a0 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- 172.21.15.64:0/2517140781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 msgr2=0x558cdf740980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f683400fc00 tx=0x7f6834012000 comp rx=0 tx=0).stop 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- 172.21.15.64:0/2517140781 shutdown_connections 2024-09-21T07:26:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf740980 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf740440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 --2- 172.21.15.64:0/2517140781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf73ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- 172.21.15.64:0/2517140781 >> 172.21.15.64:0/2517140781 conn(0x558cdf613b30 msgr2=0x558cdf6fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- 172.21.15.64:0/2517140781 shutdown_connections 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- 172.21.15.64:0/2517140781 wait complete. 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 -- start start 2024-09-21T07:26:16.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.397+0000 7f684a55a000 1 Processor -- start 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf6fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf72e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558cdf4e6580 con 0x558cdf5d91a0 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558cdf4f6a00 con 0x558cdf5f6570 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558cdf5fba20 con 0x558cdf5ef310 2024-09-21T07:26:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 10 client.0 _ll_register_callbacks cb 0x558cdf6e2a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37152/0 (socket says 172.21.15.64:37152) 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 -- 172.21.15.64:0/3229134096 learned_addr learned my addr 172.21.15.64:0/3229134096 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683b400640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf6fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6841000640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf72e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 -- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 msgr2=0x558cdf6fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf6fc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 -- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 msgr2=0x558cdf72e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf72e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 -- 172.21.15.64:0/3229134096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdf4fcf60 con 0x558cdf5d91a0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683be00640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f682c000c10 tx=0x7f682c0a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f93a1558c79822 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0bd070 con 0x558cdf5d91a0 2024-09-21T07:26:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558cdf4d9390 con 0x558cdf5d91a0 2024-09-21T07:26:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f682c004240 con 0x558cdf5d91a0 2024-09-21T07:26:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f682c0c8050 con 0x558cdf5d91a0 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 10 client.6144 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558cdf4df250 con 0x558cdf5d91a0 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558cdf4d9390 con 0x558cdf5d91a0 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f682c0cb020 con 0x558cdf5d91a0 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 10 client.6144 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 10 client.6144 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 20 client.6144 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1e3990 0x558cdf72eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 4 client.6144 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cdf553b90 con 0x558cdf1e3990 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683b400640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1e3990 0x558cdf72eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f683b400640 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1e3990 0x558cdf72eba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb3ce31ce7e9624 server_cookie=90ae04225e6d396c in_seq=0 out_seq=0 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 10 client.6144 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 1 -- 172.21.15.64:0/3229134096 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cdf553b90 con 0x558cdf1e3990 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.401+0000 7f6825600640 10 client.6144 handle_command_reply: tid=0 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 client.6144 shutdown 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 msgr2=0x558cdf6fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f682c000c10 tx=0x7f682c0a5660 comp rx=0 tx=0).stop 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 shutdown_connections 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1e3990 0x558cdf72eba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5f6570 0x558cdf72e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5ef310 0x558cdf6fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 --2- 172.21.15.64:0/3229134096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf6fc130 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f6825600640 0 client.6144 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 >> 172.21.15.64:0/3229134096 conn(0x558cdf613b30 msgr2=0x558cdf6f5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 shutdown_connections 2024-09-21T07:26:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 1 -- 172.21.15.64:0/3229134096 wait complete. 2024-09-21T07:26:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.405+0000 7f684a55a000 20 client.6144 trim_cache size 0 max 16384 2024-09-21T07:26:16.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.421+0000 7f684a55a000 1 Processor -- start 2024-09-21T07:26:16.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.421+0000 7f684a55a000 1 -- start start 2024-09-21T07:26:16.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5d91a0 0x558cdf74cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf74d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f683c2049f0 con 0x558cdf5f6570 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f683c1591f0 con 0x558cdf5ef310 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f683c15ecb0 con 0x558cdf5d91a0 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37156/0 (socket says 172.21.15.64:37156) 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 -- 172.21.15.64:0/2140238183 learned_addr learned my addr 172.21.15.64:0/2140238183 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f683be00640 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5d91a0 0x558cdf74cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f683b400640 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf74d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 -- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5d91a0 msgr2=0x558cdf74cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5d91a0 0x558cdf74cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 -- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 msgr2=0x558cdf74d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf74d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 -- 172.21.15.64:0/2140238183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdf4f7450 con 0x558cdf5f6570 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6841000640 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f683400fbd0 tx=0x7f68340019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908a658619f74a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6827e00640 1 -- 172.21.15.64:0/2140238183 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834004c50 con 0x558cdf5f6570 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6827e00640 1 -- 172.21.15.64:0/2140238183 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6834025040 con 0x558cdf5f6570 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f6827e00640 1 -- 172.21.15.64:0/2140238183 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834005280 con 0x558cdf5f6570 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- 172.21.15.64:0/2140238183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 msgr2=0x558cdf6f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f683400fbd0 tx=0x7f68340019c0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- 172.21.15.64:0/2140238183 shutdown_connections 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5f6570 0x558cdf6f38a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf74d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 --2- 172.21.15.64:0/2140238183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5d91a0 0x558cdf74cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- 172.21.15.64:0/2140238183 >> 172.21.15.64:0/2140238183 conn(0x558cdf613b30 msgr2=0x558cdf750380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- 172.21.15.64:0/2140238183 shutdown_connections 2024-09-21T07:26:16.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.425+0000 7f684a55a000 1 -- 172.21.15.64:0/2140238183 wait complete. 2024-09-21T07:26:16.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- start start 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 Processor -- start 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf7b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5f6570 0x558cdf7b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558cdf4f5d10 con 0x558cdf5d91a0 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558cdf4ec0d0 con 0x558cdf5ef310 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558cdf544190 con 0x558cdf5f6570 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 10 client.0 _ll_register_callbacks cb 0x7f6820003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37166/0 (socket says 172.21.15.64:37166) 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 -- 172.21.15.64:0/2352388378 learned_addr learned my addr 172.21.15.64:0/2352388378 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6841000640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5f6570 0x558cdf7b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683b400640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf7b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 -- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5f6570 msgr2=0x558cdf7b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5f6570 0x558cdf7b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 -- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 msgr2=0x558cdf7b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf7b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 -- 172.21.15.64:0/2352388378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdf5c6e60 con 0x558cdf5d91a0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f683be00640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f682c01d090 tx=0x7f682c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c765d6eac07a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0bd040 con 0x558cdf5d91a0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f682c0cdc30 con 0x558cdf5d91a0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6834025040 con 0x558cdf5d91a0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f682c0d4050 con 0x558cdf5d91a0 2024-09-21T07:26:16.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 10 client.6150 fetch_fsmap learned FSMap version 27 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558cdf59e2d0 con 0x558cdf5d91a0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6834025040 con 0x558cdf5d91a0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f682c0d7020 con 0x558cdf5d91a0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 10 client.6150 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 20 client.6150 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1d19f0 0x558cdf6f7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 4 client.6150 mds_command: new command op to 5376 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.429+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 --> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x558cdf54f640 con 0x558cdf1d19f0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f683b400640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1d19f0 0x558cdf6f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f683b400640 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1d19f0 0x558cdf6f7350 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6395ac996097dd9e server_cookie=32c72b7b18d339f0 in_seq=0 out_seq=0 2024-09-21T07:26:16.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f6825600640 10 client.6150 ms_handle_connect on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f6825600640 1 -- 172.21.15.64:0/2352388378 <== mds.0 v2:172.21.15.64:6832/3183811965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558cdf54f640 con 0x558cdf1d19f0 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f6825600640 10 client.6150 handle_command_reply: tid=0 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 client.6150 shutdown 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 msgr2=0x558cdf7b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f682c01d090 tx=0x7f682c005f60 comp rx=0 tx=0).stop 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 shutdown_connections 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:6832/3183811965,v1:172.21.15.64:6833/3183811965] conn(0x558cdf1d19f0 0x558cdf6f7350 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558cdf5f6570 0x558cdf7b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558cdf5ef310 0x558cdf7b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f6825600640 0 client.6150 ms_handle_reset on v2:172.21.15.64:6832/3183811965 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 --2- 172.21.15.64:0/2352388378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558cdf5d91a0 0x558cdf7b4d60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 >> 172.21.15.64:0/2352388378 conn(0x558cdf613b30 msgr2=0x558cdf74cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 shutdown_connections 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 1 -- 172.21.15.64:0/2352388378 wait complete. 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.433+0000 7f684a55a000 20 client.6150 trim_cache size 0 max 16384 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:26:16.443 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:16.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 msgr2=0x7f681c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 0x7f681c075740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68340017b0 tx=0x7f6834001740 comp rx=0 tx=0).stop 2024-09-21T07:26:16.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 msgr2=0x7f683c151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f682800c390 tx=0x7f6828001e80 comp rx=0 tx=0).stop 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 shutdown_connections 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f681c073230 0x7f681c075740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f683c160170 0x7f683c1fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f683c0cfdf0 0x7f683c151f30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 --2- 172.21.15.64:0/2378743057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0b3d30 0x7f683c1f8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 >> 172.21.15.64:0/2378743057 conn(0x7f683c06d480 msgr2=0x7f683c068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 shutdown_connections 2024-09-21T07:26:16.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.437+0000 7f6843000640 1 -- 172.21.15.64:0/2378743057 wait complete. 2024-09-21T07:26:16.459 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-21T07:26:16.460 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:26:16.460 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:26:16.594 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:26:16.682 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:26:16.683 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:26:16.683 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:16.683 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:16.693 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:16.693 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:16.744 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:26:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 -- 172.21.15.64:0/1578520037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 msgr2=0x7f05240b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 --2- 172.21.15.64:0/1578520037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f05240b4cd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f052415fb40 tx=0x7f051401c600 comp rx=0 tx=0).stop 2024-09-21T07:26:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 -- 172.21.15.64:0/1578520037 shutdown_connections 2024-09-21T07:26:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 --2- 172.21.15.64:0/1578520037 >> v2:172.21.15.90:3300/0 conn(0x7f05240aefe0 0x7f05240af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 --2- 172.21.15.64:0/1578520037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f05240b4cd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 -- 172.21.15.64:0/1578520037 >> 172.21.15.64:0/1578520037 conn(0x7f052406d450 msgr2=0x7f05240d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 -- 172.21.15.64:0/1578520037 shutdown_connections 2024-09-21T07:26:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.949+0000 7f0529e00640 1 -- 172.21.15.64:0/1578520037 wait complete. 2024-09-21T07:26:16.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 Processor -- start 2024-09-21T07:26:16.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 -- start start 2024-09-21T07:26:16.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 0x7f052414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f052415eb80 0x7f0524073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05240ce920 con 0x7f0524155560 2024-09-21T07:26:16.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05240ce7a0 con 0x7f05240aefe0 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0529e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f05240ceaa0 con 0x7f052415eb80 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0522000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0522a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 0x7f052414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0522000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37170/0 (socket says 172.21.15.64:37170) 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0522000640 1 -- 172.21.15.64:0/1797534505 learned_addr learned my addr 172.21.15.64:0/1797534505 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:16.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.953+0000 7f0523400640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f052415eb80 0x7f0524073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 -- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f052415eb80 msgr2=0x7f0524073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f052415eb80 0x7f0524073440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 -- 172.21.15.64:0/1797534505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 msgr2=0x7f052414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 -- 172.21.15.64:0/1797534505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052409d830 con 0x7f05240aefe0 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522000640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0522a00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 0x7f052414e4f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05140ab000 tx=0x7f05140a6510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140ac070 con 0x7f05240aefe0 2024-09-21T07:26:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0514004340 con 0x7f05240aefe0 2024-09-21T07:26:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514005320 con 0x7f05240aefe0 2024-09-21T07:26:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0524073f50 con 0x7f05240aefe0 2024-09-21T07:26:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0524074510 con 0x7f05240aefe0 2024-09-21T07:26:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05240704c0 con 0x7f05240aefe0 2024-09-21T07:26:16.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.957+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f05140af070 con 0x7f05240aefe0 2024-09-21T07:26:16.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.961+0000 7f051b400640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 0x7f0504075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:16.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.961+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f051412e720 con 0x7f05240aefe0 2024-09-21T07:26:16.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.961+0000 7f0522000640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 0x7f0504075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:16.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.961+0000 7f0522000640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 0x7f0504075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05240733d0 tx=0x7f0510009110 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:16.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:16.965+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f05240b5210 con 0x7f05240aefe0 2024-09-21T07:26:17.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.149+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0524070cc0 con 0x7f05240aefe0 2024-09-21T07:26:17.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.149+0000 7f051b400640 1 -- 172.21.15.64:0/1797534505 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) ==== 80+0+0 (secure 0 0 0) 0x7f05140f9520 con 0x7f05240aefe0 2024-09-21T07:26:17.155 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:26:17.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 msgr2=0x7f0504075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:17.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 0x7f0504075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05240733d0 tx=0x7f0510009110 comp rx=0 tx=0).stop 2024-09-21T07:26:17.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 msgr2=0x7f052414e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 0x7f052414e4f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05140ab000 tx=0x7f05140a6510 comp rx=0 tx=0).stop 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 shutdown_connections 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0504073200 0x7f0504075710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f052415eb80 0x7f0524073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0524155560 0x7f052414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 --2- 172.21.15.64:0/1797534505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05240aefe0 0x7f052414e4f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 >> 172.21.15.64:0/1797534505 conn(0x7f052406d450 msgr2=0x7f052415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 shutdown_connections 2024-09-21T07:26:17.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:17.153+0000 7f0529e00640 1 -- 172.21.15.64:0/1797534505 wait complete. 2024-09-21T07:26:17.177 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:26:17.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:17.178 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:18.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:26:18.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:18.652 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:26:18.661 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:26:18.661 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:26:18.661 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:18.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:26:18.671 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:26:18.671 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:18.671 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:18.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:26:18.712 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:26:18.712 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:26:18.712 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:18.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:26:18.724 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 -- 172.21.15.64:0/224560654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d200b4700 msgr2=0x7f7d20072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 --2- 172.21.15.64:0/224560654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d200b4700 0x7f7d20072e20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d200c3c60 tx=0x7f7d1801cd20 comp rx=0 tx=0).stop 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 -- 172.21.15.64:0/224560654 shutdown_connections 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 --2- 172.21.15.64:0/224560654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d200b4700 0x7f7d20072e20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 --2- 172.21.15.64:0/224560654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 0x7f7d200b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 --2- 172.21.15.64:0/224560654 >> v2:172.21.15.90:3300/0 conn(0x7f7d2015edb0 0x7f7d200700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 -- 172.21.15.64:0/224560654 >> 172.21.15.64:0/224560654 conn(0x7f7d200ccbe0 msgr2=0x7f7d200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 -- 172.21.15.64:0/224560654 shutdown_connections 2024-09-21T07:26:18.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.913+0000 7f7d28000640 1 -- 172.21.15.64:0/224560654 wait complete. 2024-09-21T07:26:18.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 Processor -- start 2024-09-21T07:26:18.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- start start 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 0x7f7d20165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d200b4700 0x7f7d200b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d200b23d0 con 0x7f7d2015edb0 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d200b2250 con 0x7f7d200b4700 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d200b2550 con 0x7f7d200709b0 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d25600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 0x7f7d20165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37192/0 (socket says 172.21.15.64:37192) 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 -- 172.21.15.64:0/3258912692 learned_addr learned my addr 172.21.15.64:0/3258912692 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d24c00640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d200b4700 0x7f7d200b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 -- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 msgr2=0x7f7d20165c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 0x7f7d20165c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 -- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d200b4700 msgr2=0x7f7d200b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d200b4700 0x7f7d200b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 -- 172.21.15.64:0/3258912692 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d200cbec0 con 0x7f7d2015edb0 2024-09-21T07:26:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d26000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d1801b430 tx=0x7f7d18005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180bb070 con 0x7f7d2015edb0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d180a5e50 con 0x7f7d2015edb0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d201654a0 con 0x7f7d2015edb0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180b2040 con 0x7f7d2015edb0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.917+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d200cc460 con 0x7f7d2015edb0 2024-09-21T07:26:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.921+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d20072e20 con 0x7f7d2015edb0 2024-09-21T07:26:18.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.921+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d180be070 con 0x7f7d2015edb0 2024-09-21T07:26:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.921+0000 7f7d1d600640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 0x7f7d00075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.921+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7d1812ded0 con 0x7f7d2015edb0 2024-09-21T07:26:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.921+0000 7f7d25600640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 0x7f7d00075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:18.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.925+0000 7f7d25600640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 0x7f7d00075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400bb50 tx=0x7f7d1400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:18.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:18.929+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7d18016970 con 0x7f7d2015edb0 2024-09-21T07:26:19.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d2009da20 con 0x7f7d2015edb0 2024-09-21T07:26:19.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d1d600640 1 -- 172.21.15.64:0/3258912692 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7f7d180f8700 con 0x7f7d2015edb0 2024-09-21T07:26:19.154 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:19.154 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:19.154 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 msgr2=0x7f7d00075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 0x7f7d00075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400bb50 tx=0x7f7d1400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 msgr2=0x7f7d20156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d1801b430 tx=0x7f7d18005b00 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 shutdown_connections 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d00073200 0x7f7d00075710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d2015edb0 0x7f7d20156170 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d200b4700 0x7f7d200b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 --2- 172.21.15.64:0/3258912692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d200709b0 0x7f7d20165c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.149+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 >> 172.21.15.64:0/3258912692 conn(0x7f7d200ccbe0 msgr2=0x7f7d201595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:19.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.153+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 shutdown_connections 2024-09-21T07:26:19.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.153+0000 7f7d28000640 1 -- 172.21.15.64:0/3258912692 wait complete. 2024-09-21T07:26:19.176 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:19.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 -- 172.21.15.64:0/2105742094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811406ff90 msgr2=0x7f81140cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 --2- 172.21.15.64:0/2105742094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811406ff90 0x7f81140cdd00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f81140ce800 tx=0x7f810001c7b0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 -- 172.21.15.64:0/2105742094 shutdown_connections 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 --2- 172.21.15.64:0/2105742094 >> v2:172.21.15.90:3300/0 conn(0x7f81140ce240 0x7f811415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 --2- 172.21.15.64:0/2105742094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811406ff90 0x7f81140cdd00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 --2- 172.21.15.64:0/2105742094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811415b700 0x7f81140cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 -- 172.21.15.64:0/2105742094 >> 172.21.15.64:0/2105742094 conn(0x7f811406e890 msgr2=0x7f81140b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 -- 172.21.15.64:0/2105742094 shutdown_connections 2024-09-21T07:26:19.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.333+0000 7f8119400640 1 -- 172.21.15.64:0/2105742094 wait complete. 2024-09-21T07:26:19.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 Processor -- start 2024-09-21T07:26:19.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 -- start start 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f811406ff90 0x7f81141fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81140ce240 0x7f8114164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f811406d480 con 0x7f811415b700 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f811406d300 con 0x7f811406ff90 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8119400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f811406d600 con 0x7f81140ce240 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8113200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8113200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37198/0 (socket says 172.21.15.64:37198) 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8113200640 1 -- 172.21.15.64:0/2270667363 learned_addr learned my addr 172.21.15.64:0/2270667363 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8111e00640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81140ce240 0x7f8114164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.337+0000 7f8112800640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f811406ff90 0x7f81141fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 -- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81140ce240 msgr2=0x7f8114164790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81140ce240 0x7f8114164790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 -- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f811406ff90 msgr2=0x7f81141fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f811406ff90 0x7f81141fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 -- 172.21.15.64:0/2270667363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81141fd150 con 0x7f811415b700 2024-09-21T07:26:19.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8113200640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f810c00cd10 tx=0x7f810c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:19.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00f450 con 0x7f811415b700 2024-09-21T07:26:19.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f810c00f700 con 0x7f811415b700 2024-09-21T07:26:19.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81140b5030 con 0x7f811415b700 2024-09-21T07:26:19.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00fb50 con 0x7f811415b700 2024-09-21T07:26:19.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81140b52d0 con 0x7f811415b700 2024-09-21T07:26:19.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8114166aa0 con 0x7f811415b700 2024-09-21T07:26:19.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.341+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f810c00fcf0 con 0x7f811415b700 2024-09-21T07:26:19.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.345+0000 7f810aa00640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 0x7f80f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.345+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f810c094e60 con 0x7f811415b700 2024-09-21T07:26:19.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.345+0000 7f8112800640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 0x7f80f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.345+0000 7f8112800640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 0x7f80f4075740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f810400bad0 tx=0x7f810400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:19.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.349+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f81141fd150 con 0x7f811415b700 2024-09-21T07:26:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.561+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811406db20 con 0x7f811415b700 2024-09-21T07:26:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.561+0000 7f810aa00640 1 -- 172.21.15.64:0/2270667363 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7f810c014030 con 0x7f811415b700 2024-09-21T07:26:19.567 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:19.568 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:19.568 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 msgr2=0x7f80f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 0x7f80f4075740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f810400bad0 tx=0x7f810400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 msgr2=0x7f8114164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f810c00cd10 tx=0x7f810c00a620 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 shutdown_connections 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80f4073230 0x7f80f4075740 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f811415b700 0x7f8114164cd0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81140ce240 0x7f8114164790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 --2- 172.21.15.64:0/2270667363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f811406ff90 0x7f81141fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 >> 172.21.15.64:0/2270667363 conn(0x7f811406e890 msgr2=0x7f8114074c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 shutdown_connections 2024-09-21T07:26:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.565+0000 7f8119400640 1 -- 172.21.15.64:0/2270667363 wait complete. 2024-09-21T07:26:19.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 -- 172.21.15.64:0/1754824606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba4004810 msgr2=0x7f7ba4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 --2- 172.21.15.64:0/1754824606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba4004810 0x7f7ba4004c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80016f0 tx=0x7f7ba801c750 comp rx=0 tx=0).stop 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 -- 172.21.15.64:0/1754824606 shutdown_connections 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 --2- 172.21.15.64:0/1754824606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba4004810 0x7f7ba4004c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 -- 172.21.15.64:0/1754824606 >> 172.21.15.64:0/1754824606 conn(0x7f7bbc0ccbe0 msgr2=0x7f7bbc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 -- 172.21.15.64:0/1754824606 shutdown_connections 2024-09-21T07:26:19.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.745+0000 7f7bc4200640 1 -- 172.21.15.64:0/1754824606 wait complete. 2024-09-21T07:26:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 Processor -- start 2024-09-21T07:26:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 -- start start 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bbc0c44f0 0x7f7bbc158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bbc0c6110 0x7f7bbc0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc073530 con 0x7f7bbc0c6110 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc0733b0 con 0x7f7ba4004810 2024-09-21T07:26:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc0736b0 con 0x7f7bbc0c44f0 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc2200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bbc0c6110 0x7f7bbc0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:44002/0 (socket says 172.21.15.64:44002) 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 -- 172.21.15.64:0/2477865298 learned_addr learned my addr 172.21.15.64:0/2477865298 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc0e00640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bbc0c44f0 0x7f7bbc158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 -- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bbc0c44f0 msgr2=0x7f7bbc158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bbc0c44f0 0x7f7bbc158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 -- 172.21.15.64:0/2477865298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bbc0c6110 msgr2=0x7f7bbc0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bbc0c6110 0x7f7bbc0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 -- 172.21.15.64:0/2477865298 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc0c6a60 con 0x7f7ba4004810 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc1800640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0011b20 tx=0x7f7bb000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000fe00 con 0x7f7ba4004810 2024-09-21T07:26:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bb0004020 con 0x7f7ba4004810 2024-09-21T07:26:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0004450 con 0x7f7ba4004810 2024-09-21T07:26:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.749+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc0c9f40 con 0x7f7ba4004810 2024-09-21T07:26:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc0cbf00 con 0x7f7ba4004810 2024-09-21T07:26:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bbc0ca460 con 0x7f7ba4004810 2024-09-21T07:26:19.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7bb0003600 con 0x7f7ba4004810 2024-09-21T07:26:19.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bb9600640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 0x7f7b9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:19.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7bb00953e0 con 0x7f7ba4004810 2024-09-21T07:26:19.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.753+0000 7f7bc0e00640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 0x7f7b9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.757+0000 7f7bc0e00640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 0x7f7b9c075710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80016c0 tx=0x7f7ba80b1040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.757+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7bbc0ca460 con 0x7f7ba4004810 2024-09-21T07:26:19.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.933+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bbc0b1c30 con 0x7f7ba4004810 2024-09-21T07:26:19.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bb9600640 1 -- 172.21.15.64:0/2477865298 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16954 (secure 0 0 0) 0x7f7bbc0c6a60 con 0x7f7ba4004810 2024-09-21T07:26:19.941 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:19.941 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":56,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:42.285032+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:25:38.477150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-21T07:25:39.678833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:19.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 msgr2=0x7f7b9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 0x7f7b9c075710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80016c0 tx=0x7f7ba80b1040 comp rx=0 tx=0).stop 2024-09-21T07:26:19.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 msgr2=0x7f7bbc1f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:19.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0011b20 tx=0x7f7bb000f3c0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 shutdown_connections 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b9c073200 0x7f7b9c075710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bbc0c6110 0x7f7bbc0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bbc0c44f0 0x7f7bbc158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 --2- 172.21.15.64:0/2477865298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba4004810 0x7f7bbc1f9920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 >> 172.21.15.64:0/2477865298 conn(0x7f7bbc0ccbe0 msgr2=0x7f7bbc073bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 shutdown_connections 2024-09-21T07:26:19.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:19.937+0000 7f7bc4200640 1 -- 172.21.15.64:0/2477865298 wait complete. 2024-09-21T07:26:19.963 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:26:19.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:20.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 -- 172.21.15.64:0/818233679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 msgr2=0x7fc1e0070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 --2- 172.21.15.64:0/818233679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0070310 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009840 tx=0x7fc1d001c7f0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 -- 172.21.15.64:0/818233679 shutdown_connections 2024-09-21T07:26:20.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 --2- 172.21.15.64:0/818233679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e00b22f0 0x7fc1e00cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 --2- 172.21.15.64:0/818233679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0070310 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 -- 172.21.15.64:0/818233679 >> 172.21.15.64:0/818233679 conn(0x7fc1e00ccbe0 msgr2=0x7fc1e00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:20.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 -- 172.21.15.64:0/818233679 shutdown_connections 2024-09-21T07:26:20.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.117+0000 7fc1e6600640 1 -- 172.21.15.64:0/818233679 wait complete. 2024-09-21T07:26:20.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 Processor -- start 2024-09-21T07:26:20.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 -- start start 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e01520e0 0x7fc1e0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e016a290 con 0x7fc1e0070850 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00b4280 con 0x7fc1e015cbd0 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1e6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e016a410 con 0x7fc1e01520e0 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37228/0 (socket says 172.21.15.64:37228) 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 -- 172.21.15.64:0/2304567534 learned_addr learned my addr 172.21.15.64:0/2304567534 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1d7e00640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1dfe00640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e01520e0 0x7fc1e0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 -- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e01520e0 msgr2=0x7fc1e0154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e01520e0 0x7fc1e0154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 -- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 msgr2=0x7fc1e0153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.121+0000 7fc1df400640 1 -- 172.21.15.64:0/2304567534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e00741a0 con 0x7fc1e0070850 2024-09-21T07:26:20.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1df400640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b0040 tx=0x7fc1d0005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00b2040 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1d00ba070 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e00749c0 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0003860 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e015abf0 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0074c00 con 0x7fc1e0070850 2024-09-21T07:26:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.125+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc1d0003a00 con 0x7fc1e0070850 2024-09-21T07:26:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.129+0000 7fc1d7400640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 0x7fc1bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.129+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fc1d0132860 con 0x7fc1e0070850 2024-09-21T07:26:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.129+0000 7fc1d7e00640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 0x7fc1bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.129+0000 7fc1d7e00640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 0x7fc1bc075740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0156080 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.133+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc1e0074c00 con 0x7fc1e0070850 2024-09-21T07:26:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.345+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1e00cbcd0 con 0x7fc1e0070850 2024-09-21T07:26:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.345+0000 7fc1d7400640 1 -- 172.21.15.64:0/2304567534 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7fc1d0016410 con 0x7fc1e0070850 2024-09-21T07:26:20.351 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:20.352 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 msgr2=0x7fc1bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 0x7fc1bc075740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0156080 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 msgr2=0x7fc1e01fa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b0040 tx=0x7fc1d0005db0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 shutdown_connections 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1bc073230 0x7fc1bc075740 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1e01520e0 0x7fc1e0154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1e015cbd0 0x7fc1e0153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 --2- 172.21.15.64:0/2304567534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1e0070850 0x7fc1e01fa0c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 >> 172.21.15.64:0/2304567534 conn(0x7fc1e00ccbe0 msgr2=0x7fc1e015ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 shutdown_connections 2024-09-21T07:26:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.349+0000 7fc1e6600640 1 -- 172.21.15.64:0/2304567534 wait complete. 2024-09-21T07:26:20.374 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:20.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- 172.21.15.64:0/1021204325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700d1d00 msgr2=0x7f50700d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 --2- 172.21.15.64:0/1021204325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700d1d00 0x7f50700d03f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5060009840 tx=0x7f506001c760 comp rx=0 tx=0).stop 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- 172.21.15.64:0/1021204325 shutdown_connections 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 --2- 172.21.15.64:0/1021204325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700c5ea0 0x7f50700c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 --2- 172.21.15.64:0/1021204325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700d1d00 0x7f50700d03f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- 172.21.15.64:0/1021204325 >> 172.21.15.64:0/1021204325 conn(0x7f507006d1c0 msgr2=0x7f507006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- 172.21.15.64:0/1021204325 shutdown_connections 2024-09-21T07:26:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- 172.21.15.64:0/1021204325 wait complete. 2024-09-21T07:26:20.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 Processor -- start 2024-09-21T07:26:20.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.529+0000 7f5074c00640 1 -- start start 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 0x7f5070154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700c5ea0 0x7f5070166810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5070169f50 con 0x7f50700d1d00 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5070169dd0 con 0x7f50700c5ea0 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f507016a0d0 con 0x7f50700b3d60 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37234/0 (socket says 172.21.15.64:37234) 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 -- 172.21.15.64:0/1566265425 learned_addr learned my addr 172.21.15.64:0/1566265425 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506de00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 0x7f5070154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5067e00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700c5ea0 0x7f5070166810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 -- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 msgr2=0x7f5070154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 0x7f5070154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 -- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700c5ea0 msgr2=0x7f5070166810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700c5ea0 0x7f5070166810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 -- 172.21.15.64:0/1566265425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5070154d00 con 0x7f50700d1d00 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506de00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 0x7f5070154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:20.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f506e800640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f506800ebd0 tx=0x7f506800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068003b80 con 0x7f50700d1d00 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5068003d20 con 0x7f50700d1d00 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068004280 con 0x7f50700d1d00 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5070154fe0 con 0x7f50700d1d00 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701555a0 con 0x7f50700d1d00 2024-09-21T07:26:20.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.533+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5070154a70 con 0x7f50700d1d00 2024-09-21T07:26:20.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.537+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5068004420 con 0x7f50700d1d00 2024-09-21T07:26:20.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.537+0000 7f5066000640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 0x7f504c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.537+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f5068095050 con 0x7f50700d1d00 2024-09-21T07:26:20.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.537+0000 7f506de00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 0x7f504c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.537+0000 7f506de00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 0x7f504c075740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f50600af000 tx=0x7f506001afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.541+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f506805fed0 con 0x7f50700d1d00 2024-09-21T07:26:20.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50700c62b0 con 0x7f50700d1d00 2024-09-21T07:26:20.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5066000640 1 -- 172.21.15.64:0/1566265425 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5223 (secure 0 0 0) 0x7f506805f7d0 con 0x7f50700d1d00 2024-09-21T07:26:20.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"btime":"2024-09-21T07:26:01:534187+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:25:40.723732+0000","modified":"2024-09-21T07:26:01.344011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6833/3183811965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3183811965},{"type":"v1","addr":"172.21.15.64:6833","nonce":3183811965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5376,"qdb_cluster":[5376]},"id":3}]} 2024-09-21T07:26:20.766 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 27 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 msgr2=0x7f504c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 0x7f504c075740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f50600af000 tx=0x7f506001afa0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 msgr2=0x7f507015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f506800ebd0 tx=0x7f506800c6a0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 shutdown_connections 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f504c073230 0x7f504c075740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50700d1d00 0x7f507015ef30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50700c5ea0 0x7f5070166810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 --2- 172.21.15.64:0/1566265425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50700b3d60 0x7f5070154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 >> 172.21.15.64:0/1566265425 conn(0x7f507006d1c0 msgr2=0x7f50701571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.761+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 shutdown_connections 2024-09-21T07:26:20.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.765+0000 7f5074c00640 1 -- 172.21.15.64:0/1566265425 wait complete. 2024-09-21T07:26:20.788 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 -- 172.21.15.64:0/2344657791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c15edb0 msgr2=0x7fe42c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 --2- 172.21.15.64:0/2344657791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c15edb0 0x7fe42c0700b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009840 tx=0x7fe41c01c6b0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 -- 172.21.15.64:0/2344657791 shutdown_connections 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 --2- 172.21.15.64:0/2344657791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0b48d0 0x7fe42c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 --2- 172.21.15.64:0/2344657791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c15edb0 0x7fe42c0700b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 -- 172.21.15.64:0/2344657791 >> 172.21.15.64:0/2344657791 conn(0x7fe42c0ccbe0 msgr2=0x7fe42c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 -- 172.21.15.64:0/2344657791 shutdown_connections 2024-09-21T07:26:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.941+0000 7fe431600640 1 -- 172.21.15.64:0/2344657791 wait complete. 2024-09-21T07:26:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 Processor -- start 2024-09-21T07:26:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- start start 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c15edb0 0x7fe42c09cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 0x7fe42c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0736f0 con 0x7fe42c0709b0 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c073570 con 0x7fe42c1f7b20 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c073870 con 0x7fe42c15edb0 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37244/0 (socket says 172.21.15.64:37244) 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 -- 172.21.15.64:0/58358657 learned_addr learned my addr 172.21.15.64:0/58358657 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42b400640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 0x7fe42c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42a000640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c15edb0 0x7fe42c09cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 -- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c15edb0 msgr2=0x7fe42c09cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c15edb0 0x7fe42c09cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 -- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 msgr2=0x7fe42c0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 0x7fe42c0b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 -- 172.21.15.64:0/58358657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c156f80 con 0x7fe42c0709b0 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42b400640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 0x7fe42c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:20.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe42aa00640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009790 tx=0x7fe41c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0be070 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe41c005360 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c1f7040 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0046d0 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.945+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c1f7600 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.949+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c072e20 con 0x7fe42c0709b0 2024-09-21T07:26:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.949+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe41c0c1070 con 0x7fe42c0709b0 2024-09-21T07:26:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.949+0000 7fe422a00640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 0x7fe40c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.949+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7fe41c12eb60 con 0x7fe42c0709b0 2024-09-21T07:26:20.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.949+0000 7fe42a000640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 0x7fe40c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:20.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.953+0000 7fe42a000640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 0x7fe40c075740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b20f0 tx=0x7fe41800c040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:20.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:20.953+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe41c016330 con 0x7fe42c0709b0 2024-09-21T07:26:21.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe42c09da20 con 0x7fe42c0709b0 2024-09-21T07:26:21.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe422a00640 1 -- 172.21.15.64:0/58358657 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16954 (secure 0 0 0) 0x7fe41c0f9390 con 0x7fe42c0709b0 2024-09-21T07:26:21.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:21.138 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":56,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:25:42.285032+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:25:38.477150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-21T07:25:39.678833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 msgr2=0x7fe40c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 0x7fe40c075740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b20f0 tx=0x7fe41800c040 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 msgr2=0x7fe42c1f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009790 tx=0x7fe41c004040 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 shutdown_connections 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe40c073230 0x7fe40c075740 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c1f7b20 0x7fe42c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c15edb0 0x7fe42c09cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 --2- 172.21.15.64:0/58358657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0709b0 0x7fe42c1f43e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.133+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 >> 172.21.15.64:0/58358657 conn(0x7fe42c0ccbe0 msgr2=0x7fe42c15aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:21.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.137+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 shutdown_connections 2024-09-21T07:26:21.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.137+0000 7fe431600640 1 -- 172.21.15.64:0/58358657 wait complete. 2024-09-21T07:26:21.160 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:26:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 -- 172.21.15.64:0/3789239028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a415fff0 msgr2=0x7f58a40cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 --2- 172.21.15.64:0/3789239028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a415fff0 0x7f58a40cbbe0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5898009900 tx=0x7f589801c850 comp rx=0 tx=0).stop 2024-09-21T07:26:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 -- 172.21.15.64:0/3789239028 shutdown_connections 2024-09-21T07:26:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 --2- 172.21.15.64:0/3789239028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415d0c0 0x7f58a415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 --2- 172.21.15.64:0/3789239028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a415fff0 0x7f58a40cbbe0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 -- 172.21.15.64:0/3789239028 >> 172.21.15.64:0/3789239028 conn(0x7f58a40d1010 msgr2=0x7f58a40d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 -- 172.21.15.64:0/3789239028 shutdown_connections 2024-09-21T07:26:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.317+0000 7f58aa200640 1 -- 172.21.15.64:0/3789239028 wait complete. 2024-09-21T07:26:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 Processor -- start 2024-09-21T07:26:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 -- start start 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58a415d0c0 0x7f58a414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415fff0 0x7f58a40b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41533f0 con 0x7f58a4073bd0 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58a40743b0 con 0x7f58a415d0c0 2024-09-21T07:26:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58aa200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f58a4153570 con 0x7f58a415fff0 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37254/0 (socket says 172.21.15.64:37254) 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 -- 172.21.15.64:0/963632791 learned_addr learned my addr 172.21.15.64:0/963632791 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a3e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58a415d0c0 0x7f58a414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a9800640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415fff0 0x7f58a40b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 -- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415fff0 msgr2=0x7f58a40b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415fff0 0x7f58a40b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 -- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58a415d0c0 msgr2=0x7f58a414bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58a415d0c0 0x7f58a414bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.321+0000 7f58a8e00640 1 -- 172.21.15.64:0/963632791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a4156de0 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a8e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58980b0040 tx=0x7f58980a5600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980b2040 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58980043b0 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a4153ff0 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898005270 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a40b5940 con 0x7f58a4073bd0 2024-09-21T07:26:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a415d4d0 con 0x7f58a4073bd0 2024-09-21T07:26:21.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f58980be060 con 0x7f58a4073bd0 2024-09-21T07:26:21.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.325+0000 7f58a0c00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 0x7f5884075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.329+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f589812d7c0 con 0x7f58a4073bd0 2024-09-21T07:26:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.329+0000 7f58a3e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 0x7f5884075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.329+0000 7f58a3e00640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 0x7f5884075710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58a41f9d10 tx=0x7f58900091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:21.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.333+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f58980164d0 con 0x7f58a4073bd0 2024-09-21T07:26:21.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.545+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58a414c280 con 0x7f58a4073bd0 2024-09-21T07:26:21.549 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:26:21.545+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:26:21.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.545+0000 7f58a0c00640 1 -- 172.21.15.64:0/963632791 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f58980f7ff0 con 0x7f58a4073bd0 2024-09-21T07:26:21.552 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:26:21.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 msgr2=0x7f5884075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 0x7f5884075710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58a41f9d10 tx=0x7f58900091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 msgr2=0x7f58a4153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58980b0040 tx=0x7f58980a5600 comp rx=0 tx=0).stop 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 shutdown_connections 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5884073200 0x7f5884075710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58a415fff0 0x7f58a40b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58a415d0c0 0x7f58a414bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 --2- 172.21.15.64:0/963632791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58a4073bd0 0x7f58a4153ab0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 >> 172.21.15.64:0/963632791 conn(0x7f58a40d1010 msgr2=0x7f58a415ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:21.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 shutdown_connections 2024-09-21T07:26:21.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.549+0000 7f58aa200640 1 -- 172.21.15.64:0/963632791 wait complete. 2024-09-21T07:26:21.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:26:21.698 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:26:21.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 -- 172.21.15.64:0/664175157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a400706c0 msgr2=0x7f3a400ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 --2- 172.21.15.64:0/664175157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a400706c0 0x7f3a400ce740 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009900 tx=0x7f3a2801c7c0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 -- 172.21.15.64:0/664175157 shutdown_connections 2024-09-21T07:26:21.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 --2- 172.21.15.64:0/664175157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a400706c0 0x7f3a400ce740 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 -- 172.21.15.64:0/664175157 >> 172.21.15.64:0/664175157 conn(0x7f3a400ccbe0 msgr2=0x7f3a400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:21.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 -- 172.21.15.64:0/664175157 shutdown_connections 2024-09-21T07:26:21.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.737+0000 7f3a45400640 1 -- 172.21.15.64:0/664175157 wait complete. 2024-09-21T07:26:21.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 Processor -- start 2024-09-21T07:26:21.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- start start 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a400ca990 0x7f3a400c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4015ec20 0x7f3a400c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4016a2c0 con 0x7f3a4015b2d0 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4016a140 con 0x7f3a4015ec20 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4016a440 con 0x7f3a400ca990 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37312/0 (socket says 172.21.15.64:37312) 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 -- 172.21.15.64:0/4172278456 learned_addr learned my addr 172.21.15.64:0/4172278456 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a37e00640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4015ec20 0x7f3a400c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3e800640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a400ca990 0x7f3a400c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 -- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a400ca990 msgr2=0x7f3a400c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a400ca990 0x7f3a400c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 -- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4015ec20 msgr2=0x7f3a400c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4015ec20 0x7f3a400c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 -- 172.21.15.64:0/4172278456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a40165d10 con 0x7f3a4015b2d0 2024-09-21T07:26:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a3f200640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c760 tx=0x7f3a3800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38003b80 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a38003d20 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800aab0 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a40165ff0 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.741+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a400c7380 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.745+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a400ce740 con 0x7f3a4015b2d0 2024-09-21T07:26:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.745+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3a3800ac50 con 0x7f3a4015b2d0 2024-09-21T07:26:21.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.745+0000 7f3a36a00640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 0x7f3a1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.745+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6187+0+0 (secure 0 0 0) 0x7f3a380940c0 con 0x7f3a4015b2d0 2024-09-21T07:26:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.745+0000 7f3a3e800640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 0x7f3a1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.749+0000 7f3a3e800640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 0x7f3a1c075710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:21.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.749+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3a3805e8a0 con 0x7f3a4015b2d0 2024-09-21T07:26:21.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:21.961+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3a400707e0 con 0x7f3a4015b2d0 2024-09-21T07:26:22.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.613+0000 7f3a36a00640 1 -- 172.21.15.64:0/4172278456 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f3a380632d0 con 0x7f3a4015b2d0 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.613+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 msgr2=0x7f3a1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.613+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 0x7f3a1c075710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30009040 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.613+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 msgr2=0x7f3a400c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.613+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c760 tx=0x7f3a3800cc20 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 shutdown_connections 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a1c073200 0x7f3a1c075710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a4015b2d0 0x7f3a400c7de0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4015ec20 0x7f3a400c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 --2- 172.21.15.64:0/4172278456 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a400ca990 0x7f3a400c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 >> 172.21.15.64:0/4172278456 conn(0x7f3a400ccbe0 msgr2=0x7f3a400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:22.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 shutdown_connections 2024-09-21T07:26:22.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.616+0000 7f3a45400640 1 -- 172.21.15.64:0/4172278456 wait complete. 2024-09-21T07:26:22.642 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 -- 172.21.15.64:0/249434153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7340003c20 msgr2=0x7f7340004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 --2- 172.21.15.64:0/249434153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7340003c20 0x7f7340004070 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f734c00c3c0 tx=0x7f734c01cec0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f735e600640 1 -- 172.21.15.64:0/249434153 reap_dead start 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 -- 172.21.15.64:0/249434153 shutdown_connections 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 -- 172.21.15.64:0/249434153 >> 172.21.15.64:0/249434153 conn(0x7f73580d0c50 msgr2=0x7f73580d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 -- 172.21.15.64:0/249434153 shutdown_connections 2024-09-21T07:26:22.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.800+0000 7f7360600640 1 -- 172.21.15.64:0/249434153 wait complete. 2024-09-21T07:26:22.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 Processor -- start 2024-09-21T07:26:22.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- start start 2024-09-21T07:26:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7340003c20 0x7f7358151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73580ad870 0x7f7358154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f73581680a0 con 0x7f73580aee60 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7358167f20 con 0x7f73580ad870 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7358168220 con 0x7f7340003c20 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37330/0 (socket says 172.21.15.64:37330) 2024-09-21T07:26:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 -- 172.21.15.64:0/547120768 learned_addr learned my addr 172.21.15.64:0/547120768 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:22.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735d200640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73580ad870 0x7f7358154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:22.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735dc00640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7340003c20 0x7f7358151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:22.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 -- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7340003c20 msgr2=0x7f7358151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:22.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7340003c20 0x7f7358151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 -- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73580ad870 msgr2=0x7f7358154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73580ad870 0x7f7358154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 -- 172.21.15.64:0/547120768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580adfe0 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f735e600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7358074800 tx=0x7f7350006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735000f960 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f735000fb20 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73580ae2c0 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350011430 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.804+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73580ae880 con 0x7f73580aee60 2024-09-21T07:26:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73580ce650 con 0x7f73580aee60 2024-09-21T07:26:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f73500115d0 con 0x7f73580aee60 2024-09-21T07:26:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f7355600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 0x7f7338075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6187+0+0 (secure 0 0 0) 0x7f7350094d40 con 0x7f73580aee60 2024-09-21T07:26:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f735dc00640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 0x7f7338075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.808+0000 7f735dc00640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 0x7f7338075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f734c0ac000 tx=0x7f734c0b0040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:22.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.812+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f735005fa60 con 0x7f73580aee60 2024-09-21T07:26:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:22.988+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73580add70 con 0x7f73580aee60 2024-09-21T07:26:23.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.616+0000 7f7355600640 1 -- 172.21.15.64:0/547120768 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) ==== 181+0+0 (secure 0 0 0) 0x7f735005f360 con 0x7f73580aee60 2024-09-21T07:26:23.627 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:26:23.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 msgr2=0x7f7338075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:23.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 0x7f7338075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f734c0ac000 tx=0x7f734c0b0040 comp rx=0 tx=0).stop 2024-09-21T07:26:23.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 msgr2=0x7f7358155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:23.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7358074800 tx=0x7f7350006430 comp rx=0 tx=0).stop 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 shutdown_connections 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7338073200 0x7f7338075710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73580aee60 0x7f7358155300 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73580ad870 0x7f7358154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 --2- 172.21.15.64:0/547120768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7340003c20 0x7f7358151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 >> 172.21.15.64:0/547120768 conn(0x7f73580d0c50 msgr2=0x7f735806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:23.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 shutdown_connections 2024-09-21T07:26:23.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.620+0000 7f7360600640 1 -- 172.21.15.64:0/547120768 wait complete. 2024-09-21T07:26:23.649 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 -- 172.21.15.64:0/4091362736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 msgr2=0x7f56640cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 --2- 172.21.15.64:0/4091362736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f56640cd420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f565c009c80 tx=0x7f565c01cd10 comp rx=0 tx=0).stop 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 -- 172.21.15.64:0/4091362736 shutdown_connections 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 --2- 172.21.15.64:0/4091362736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f56640cd420 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 --2- 172.21.15.64:0/4091362736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 0x7f56640ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 -- 172.21.15.64:0/4091362736 >> 172.21.15.64:0/4091362736 conn(0x7f56640d2140 msgr2=0x7f56640d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 -- 172.21.15.64:0/4091362736 shutdown_connections 2024-09-21T07:26:23.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.808+0000 7f566ae00640 1 -- 172.21.15.64:0/4091362736 wait complete. 2024-09-21T07:26:23.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 Processor -- start 2024-09-21T07:26:23.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 -- start start 2024-09-21T07:26:23.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56640ceeb0 0x7f566406f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:23.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 0x7f56641639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5664169d40 con 0x7f56640cf2c0 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5664169bc0 con 0x7f56640ceeb0 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566ae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5664169ec0 con 0x7f56640d0ca0 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f5669000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f5669000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37344/0 (socket says 172.21.15.64:37344) 2024-09-21T07:26:23.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f5669000640 1 -- 172.21.15.64:0/2330485134 learned_addr learned my addr 172.21.15.64:0/2330485134 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f566a400640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 0x7f56641639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.812+0000 7f5669a00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56640ceeb0 0x7f566406f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 -- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 msgr2=0x7f56641639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 0x7f56641639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 -- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56640ceeb0 msgr2=0x7f566406f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56640ceeb0 0x7f566406f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 -- 172.21.15.64:0/2330485134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5664161ca0 con 0x7f56640cf2c0 2024-09-21T07:26:23.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5669000640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f565000c3c0 tx=0x7f565000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:23.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650017070 con 0x7f56640cf2c0 2024-09-21T07:26:23.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56500053c0 con 0x7f56640cf2c0 2024-09-21T07:26:23.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5664161f80 con 0x7f56640cf2c0 2024-09-21T07:26:23.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650003860 con 0x7f56640cf2c0 2024-09-21T07:26:23.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5664162540 con 0x7f56640cf2c0 2024-09-21T07:26:23.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56640ce970 con 0x7f56640cf2c0 2024-09-21T07:26:23.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f565001a070 con 0x7f56640cf2c0 2024-09-21T07:26:23.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.816+0000 7f5661600640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 0x7f5644075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:23.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.820+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5749+0+0 (secure 0 0 0) 0x7f5650093680 con 0x7f56640cf2c0 2024-09-21T07:26:23.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.820+0000 7f5669a00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 0x7f5644075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:23.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.820+0000 7f5669a00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 0x7f5644075740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f565800bb50 tx=0x7f565800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.824+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f565005df00 con 0x7f56640cf2c0 2024-09-21T07:26:24.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:23.996+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f56640b2a00 con 0x7f56640cf2c0 2024-09-21T07:26:24.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f5661600640 1 -- 172.21.15.64:0/2330485134 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) ==== 169+0+0 (secure 0 0 0) 0x7f5650062930 con 0x7f56640cf2c0 2024-09-21T07:26:24.624 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 msgr2=0x7f5644075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 0x7f5644075740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f565800bb50 tx=0x7f565800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 msgr2=0x7f5664161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f565000c3c0 tx=0x7f565000c880 comp rx=0 tx=0).stop 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 shutdown_connections 2024-09-21T07:26:24.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5644073230 0x7f5644075740 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56640d0ca0 0x7f56641639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56640cf2c0 0x7f5664161000 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 --2- 172.21.15.64:0/2330485134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56640ceeb0 0x7f566406f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 >> 172.21.15.64:0/2330485134 conn(0x7f56640d2140 msgr2=0x7f56640b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 shutdown_connections 2024-09-21T07:26:24.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.620+0000 7f566ae00640 1 -- 172.21.15.64:0/2330485134 wait complete. 2024-09-21T07:26:24.660 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:26:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- 172.21.15.64:0/2789717588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b1a40 msgr2=0x7f87580cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 --2- 172.21.15.64:0/2789717588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b1a40 0x7f87580cdae0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8750009bc0 tx=0x7f875001cb40 comp rx=0 tx=0).stop 2024-09-21T07:26:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- 172.21.15.64:0/2789717588 shutdown_connections 2024-09-21T07:26:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 --2- 172.21.15.64:0/2789717588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b1a40 0x7f87580cdae0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 --2- 172.21.15.64:0/2789717588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87580cf1d0 0x7f87580d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- 172.21.15.64:0/2789717588 >> 172.21.15.64:0/2789717588 conn(0x7f875808bf80 msgr2=0x7f87580d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- 172.21.15.64:0/2789717588 shutdown_connections 2024-09-21T07:26:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- 172.21.15.64:0/2789717588 wait complete. 2024-09-21T07:26:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 Processor -- start 2024-09-21T07:26:24.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.816+0000 7f875de00640 1 -- start start 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 0x7f87580b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 0x7f875815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8758169d20 con 0x7f87580b77d0 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8758169ba0 con 0x7f87580b1a40 2024-09-21T07:26:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8758169ea0 con 0x7f875815de10 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37360/0 (socket says 172.21.15.64:37360) 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 -- 172.21.15.64:0/269924163 learned_addr learned my addr 172.21.15.64:0/269924163 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875d400640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 0x7f875815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875ca00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 0x7f87580b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 -- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 msgr2=0x7f875815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 0x7f875815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 -- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 msgr2=0x7f87580b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 0x7f87580b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 -- 172.21.15.64:0/269924163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87581fa8c0 con 0x7f87580b77d0 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875d400640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 0x7f875815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875ca00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 0x7f87580b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8757e00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f874400d720 tx=0x7f874400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744017070 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8744009d20 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87580aec50 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744005280 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87581f9de0 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f875815d8a0 con 0x7f87580b77d0 2024-09-21T07:26:24.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.820+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8744005420 con 0x7f87580b77d0 2024-09-21T07:26:24.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.824+0000 7f8754c00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 0x7f8738075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:24.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.824+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f8744094110 con 0x7f87580b77d0 2024-09-21T07:26:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.824+0000 7f875ca00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 0x7f8738075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.824+0000 7f875ca00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 0x7f8738075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f874c001630 tx=0x7f874c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:24.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:24.828+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f874405f3c0 con 0x7f87580b77d0 2024-09-21T07:26:25.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.004+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f87580aeee0 con 0x7f87580b77d0 2024-09-21T07:26:25.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.008+0000 7f8754c00640 1 -- 172.21.15.64:0/269924163 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f874405ecc0 con 0x7f87580b77d0 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 msgr2=0x7f8738075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 0x7f8738075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f874c001630 tx=0x7f874c009040 comp rx=0 tx=0).stop 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 msgr2=0x7f8758156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f874400d720 tx=0x7f874400dbe0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 shutdown_connections 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8738073200 0x7f8738075710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f875815de10 0x7f875815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87580b77d0 0x7f8758156f70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 --2- 172.21.15.64:0/269924163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87580b1a40 0x7f87580b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 >> 172.21.15.64:0/269924163 conn(0x7f875808bf80 msgr2=0x7f8758158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:25.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 shutdown_connections 2024-09-21T07:26:25.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.012+0000 7f875de00640 1 -- 172.21.15.64:0/269924163 wait complete. 2024-09-21T07:26:25.037 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 -- 172.21.15.64:0/1039550262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f2815edb0 msgr2=0x7f0f280700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/1039550262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f2815edb0 0x7f0f280700b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0f2806f220 tx=0x7f0f1801c820 comp rx=0 tx=0).stop 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 -- 172.21.15.64:0/1039550262 shutdown_connections 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/1039550262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f2815edb0 0x7f0f280700b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 -- 172.21.15.64:0/1039550262 >> 172.21.15.64:0/1039550262 conn(0x7f0f280ccbe0 msgr2=0x7f0f280ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 -- 172.21.15.64:0/1039550262 shutdown_connections 2024-09-21T07:26:25.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.192+0000 7f0f2ee00640 1 -- 172.21.15.64:0/1039550262 wait complete. 2024-09-21T07:26:25.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 Processor -- start 2024-09-21T07:26:25.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- start start 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 0x7f0f280cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 0x7f0f2815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2816a240 con 0x7f0f280709b0 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2816a0c0 con 0x7f0f280cb6e0 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2816a3c0 con 0x7f0f2815edb0 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40888/0 (socket says 172.21.15.64:40888) 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 -- 172.21.15.64:0/808306635 learned_addr learned my addr 172.21.15.64:0/808306635 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 -- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 msgr2=0x7f0f280cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ce00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 0x7f0f2815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f1fe00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 0x7f0f280cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 0x7f0f280cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 -- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 msgr2=0x7f0f2815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 0x7f0f2815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 -- 172.21.15.64:0/808306635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f280cbe60 con 0x7f0f280709b0 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ce00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 0x7f0f2815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f1fe00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 0x7f0f280cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:25.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f27e00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f180b0040 tx=0x7f0f180a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:25.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004110 con 0x7f0f280709b0 2024-09-21T07:26:25.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f180be070 con 0x7f0f280709b0 2024-09-21T07:26:25.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f281578b0 con 0x7f0f280709b0 2024-09-21T07:26:25.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18003600 con 0x7f0f280709b0 2024-09-21T07:26:25.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.196+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f28157e70 con 0x7f0f280709b0 2024-09-21T07:26:25.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f280700b0 con 0x7f0f280709b0 2024-09-21T07:26:25.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f180037a0 con 0x7f0f280709b0 2024-09-21T07:26:25.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f24c00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 0x7f0f04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f0f1812e890 con 0x7f0f280709b0 2024-09-21T07:26:25.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f1fe00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 0x7f0f04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.200+0000 7f0f1fe00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 0x7f0f04075710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0f2815ae60 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:25.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.204+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0f180c7020 con 0x7f0f280709b0 2024-09-21T07:26:25.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.448+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f0f2809da20 con 0x7f0f280709b0 2024-09-21T07:26:25.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.628+0000 7f0f24c00640 1 -- 172.21.15.64:0/808306635 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v184) ==== 143+0+0 (secure 0 0 0) 0x7f0f18016410 con 0x7f0f280709b0 2024-09-21T07:26:25.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 msgr2=0x7f0f04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 0x7f0f04075710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0f2815ae60 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2024-09-21T07:26:25.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 msgr2=0x7f0f2809d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f180b0040 tx=0x7f0f180a6600 comp rx=0 tx=0).stop 2024-09-21T07:26:25.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 shutdown_connections 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f04073200 0x7f0f04075710 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f280cb6e0 0x7f0f2815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f2815edb0 0x7f0f280cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 --2- 172.21.15.64:0/808306635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f280709b0 0x7f0f2809d1f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 >> 172.21.15.64:0/808306635 conn(0x7f0f280ccbe0 msgr2=0x7f0f280b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 shutdown_connections 2024-09-21T07:26:25.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.632+0000 7f0f2ee00640 1 -- 172.21.15.64:0/808306635 wait complete. 2024-09-21T07:26:25.657 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-21T07:26:25.657 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-21T07:26:25.657 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:26:25.657 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:25.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- 172.21.15.64:0/1276622206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 msgr2=0x7f66b0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 --2- 172.21.15.64:0/1276622206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66b0004c20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f66c80cf8a0 tx=0x7f66b401ce30 comp rx=0 tx=0).stop 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cd600640 1 -- 172.21.15.64:0/1276622206 reap_dead start 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- 172.21.15.64:0/1276622206 shutdown_connections 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- 172.21.15.64:0/1276622206 >> 172.21.15.64:0/1276622206 conn(0x7f66c806d1c0 msgr2=0x7f66c806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- 172.21.15.64:0/1276622206 shutdown_connections 2024-09-21T07:26:25.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- 172.21.15.64:0/1276622206 wait complete. 2024-09-21T07:26:25.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 Processor -- start 2024-09-21T07:26:25.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.812+0000 7f66cf600640 1 -- start start 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66c8151280 0x7f66c81603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66c8151690 0x7f66c81608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66c8168ea0 con 0x7f66b0004810 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66c8168d20 con 0x7f66c8151280 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f66c8169020 con 0x7f66c8151690 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40908/0 (socket says 172.21.15.64:40908) 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 -- 172.21.15.64:0/2140454564 learned_addr learned my addr 172.21.15.64:0/2140454564 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66c7e00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66c8151280 0x7f66c81603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cd600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66c8151690 0x7f66c81608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 -- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66c8151690 msgr2=0x7f66c81608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66c8151690 0x7f66c81608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 -- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66c8151280 msgr2=0x7f66c81603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:25.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66c8151280 0x7f66c81603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:25.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 -- 172.21.15.64:0/2140454564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c8153d70 con 0x7f66b0004810 2024-09-21T07:26:25.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66ccc00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0119b0 tx=0x7f66bc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00fcf0 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66bc004030 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc004460 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c8153400 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c80b1b40 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.816+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c80c62b0 con 0x7f66b0004810 2024-09-21T07:26:25.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.820+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f66bc003600 con 0x7f66b0004810 2024-09-21T07:26:25.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.820+0000 7f66c4c00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 0x7f66a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:25.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.820+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f66bc0956b0 con 0x7f66b0004810 2024-09-21T07:26:25.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.820+0000 7f66c7e00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 0x7f66a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:25.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.820+0000 7f66c7e00640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 0x7f66a8075710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f66b40ac000 tx=0x7f66b40b0040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:25.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:25.824+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f66bc0608b0 con 0x7f66b0004810 2024-09-21T07:26:26.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.024+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66c81587a0 con 0x7f66b0004810 2024-09-21T07:26:26.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.024+0000 7f66c4c00640 1 -- 172.21.15.64:0/2140454564 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+13257 (secure 0 0 0) 0x7f66bc065e20 con 0x7f66b0004810 2024-09-21T07:26:26.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:26.031 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":59,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:24.622157+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6833/3183811965":"2024-09-22T07:26:21.549526+0000","172.21.15.64:6832/3183811965":"2024-09-22T07:26:21.549526+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 msgr2=0x7f66a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 0x7f66a8075710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f66b40ac000 tx=0x7f66b40b0040 comp rx=0 tx=0).stop 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 msgr2=0x7f66c8152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0119b0 tx=0x7f66bc011e70 comp rx=0 tx=0).stop 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 shutdown_connections 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66a8073200 0x7f66a8075710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66c8151690 0x7f66c81608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66c8151280 0x7f66c81603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 --2- 172.21.15.64:0/2140454564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b0004810 0x7f66c8152ec0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 >> 172.21.15.64:0/2140454564 conn(0x7f66c806d1c0 msgr2=0x7f66c8157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:26.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 shutdown_connections 2024-09-21T07:26:26.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.028+0000 7f66cf600640 1 -- 172.21.15.64:0/2140454564 wait complete. 2024-09-21T07:26:26.053 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:26:26.054 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 -- 172.21.15.64:0/3768215379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d0850 msgr2=0x7f8a50072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 --2- 172.21.15.64:0/3768215379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d0850 0x7f8a50072200 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009c80 tx=0x7f8a4801cd70 comp rx=0 tx=0).stop 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 -- 172.21.15.64:0/3768215379 shutdown_connections 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 --2- 172.21.15.64:0/3768215379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d0850 0x7f8a50072200 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 -- 172.21.15.64:0/3768215379 >> 172.21.15.64:0/3768215379 conn(0x7f8a500b2db0 msgr2=0x7f8a500b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 -- 172.21.15.64:0/3768215379 shutdown_connections 2024-09-21T07:26:26.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.208+0000 7f8a56c00640 1 -- 172.21.15.64:0/3768215379 wait complete. 2024-09-21T07:26:26.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 Processor -- start 2024-09-21T07:26:26.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 -- start start 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a50071df0 0x7f8a501fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a500d0850 0x7f8a501f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5016a180 con 0x7f8a5015ba60 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5016a000 con 0x7f8a500d0850 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a56c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5016a300 con 0x7f8a50071df0 2024-09-21T07:26:26.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40922/0 (socket says 172.21.15.64:40922) 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 -- 172.21.15.64:0/2181719501 learned_addr learned my addr 172.21.15.64:0/2181719501 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a4fe00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a50071df0 0x7f8a501fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a47e00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a500d0850 0x7f8a501f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 -- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a50071df0 msgr2=0x7f8a501fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a50071df0 0x7f8a501fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 -- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a500d0850 msgr2=0x7f8a501f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a500d0850 0x7f8a501f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 -- 172.21.15.64:0/2181719501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a501f9940 con 0x7f8a5015ba60 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.212+0000 7f8a54c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8a4801a9a0 tx=0x7f8a480093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480bb070 con 0x7f8a5015ba60 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a48004e00 con 0x7f8a5015ba60 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b2040 con 0x7f8a5015ba60 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a501f9c20 con 0x7f8a5015ba60 2024-09-21T07:26:26.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a501fa8f0 con 0x7f8a5015ba60 2024-09-21T07:26:26.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a501fab70 con 0x7f8a5015ba60 2024-09-21T07:26:26.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.216+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a480ad850 con 0x7f8a5015ba60 2024-09-21T07:26:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.220+0000 7f8a4cc00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 0x7f8a2c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.220+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f8a4812e170 con 0x7f8a5015ba60 2024-09-21T07:26:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.220+0000 7f8a4fe00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 0x7f8a2c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.220+0000 7f8a4fe00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 0x7f8a2c075740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a40007fd0 tx=0x7f8a40009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:26.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.224+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8a48016990 con 0x7f8a5015ba60 2024-09-21T07:26:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.400+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8a5015d050 con 0x7f8a5015ba60 2024-09-21T07:26:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.400+0000 7f8a4cc00640 1 -- 172.21.15.64:0/2181719501 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f8a480f8c10 con 0x7f8a5015ba60 2024-09-21T07:26:26.407 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 msgr2=0x7f8a2c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 0x7f8a2c075740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a40007fd0 tx=0x7f8a40009040 comp rx=0 tx=0).stop 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 msgr2=0x7f8a501fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8a4801a9a0 tx=0x7f8a480093d0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 shutdown_connections 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073230 0x7f8a2c075740 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a5015ba60 0x7f8a501fa2b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a500d0850 0x7f8a501f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 --2- 172.21.15.64:0/2181719501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a50071df0 0x7f8a501fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 >> 172.21.15.64:0/2181719501 conn(0x7f8a500b2db0 msgr2=0x7f8a500cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 shutdown_connections 2024-09-21T07:26:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.404+0000 7f8a56c00640 1 -- 172.21.15.64:0/2181719501 wait complete. 2024-09-21T07:26:26.429 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 -- 172.21.15.64:0/3293332327 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 msgr2=0x7f769c0d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3293332327 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c0d0150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7694009bf0 tx=0x7f769401ca40 comp rx=0 tx=0).stop 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 -- 172.21.15.64:0/3293332327 shutdown_connections 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3293332327 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c0d0150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 -- 172.21.15.64:0/3293332327 >> 172.21.15.64:0/3293332327 conn(0x7f769c06d3f0 msgr2=0x7f769c0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 -- 172.21.15.64:0/3293332327 shutdown_connections 2024-09-21T07:26:26.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.580+0000 7f76a2c00640 1 -- 172.21.15.64:0/3293332327 wait complete. 2024-09-21T07:26:26.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 Processor -- start 2024-09-21T07:26:26.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 -- start start 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 0x7f769c166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c1670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f769c16ae40 con 0x7f769c0b3c80 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f769c16acc0 con 0x7f769c0ccdf0 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.584+0000 7f76a2c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f769c16afc0 con 0x7f769c0cfd40 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40924/0 (socket says 172.21.15.64:40924) 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 -- 172.21.15.64:0/3707619751 learned_addr learned my addr 172.21.15.64:0/3707619751 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a2200640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c1670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a0e00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 0x7f769c166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 -- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 msgr2=0x7f769c1670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c1670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 -- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 msgr2=0x7f769c166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 0x7f769c166b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 -- 172.21.15.64:0/3707619751 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0b6080 con 0x7f769c0b3c80 2024-09-21T07:26:26.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a0e00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 0x7f769c166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a1800640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7690001230 tx=0x7f769000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690016020 con 0x7f769c0b3c80 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f769000a930 con 0x7f769c0b3c80 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c0b6340 con 0x7f769c0b3c80 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769000ad80 con 0x7f769c0b3c80 2024-09-21T07:26:26.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c0b6900 con 0x7f769c0b3c80 2024-09-21T07:26:26.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c0d0150 con 0x7f769c0b3c80 2024-09-21T07:26:26.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.588+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7690019020 con 0x7f769c0b3c80 2024-09-21T07:26:26.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.592+0000 7f7699600640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 0x7f767c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:26.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.592+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f76900942b0 con 0x7f769c0b3c80 2024-09-21T07:26:26.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.592+0000 7f76a0e00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 0x7f767c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:26.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.592+0000 7f76a0e00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 0x7f767c075710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f769c0b3400 tx=0x7f7688009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:26.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.596+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7690020020 con 0x7f769c0b3c80 2024-09-21T07:26:26.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:26.836+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f769c0b6fc0 con 0x7f769c0b3c80 2024-09-21T07:26:27.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.636+0000 7f7699600640 1 -- 172.21.15.64:0/3707619751 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v186) ==== 154+0+0 (secure 0 0 0) 0x7f769005f3b0 con 0x7f769c0b3c80 2024-09-21T07:26:27.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 msgr2=0x7f767c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:27.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 0x7f767c075710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f769c0b3400 tx=0x7f7688009040 comp rx=0 tx=0).stop 2024-09-21T07:26:27.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 msgr2=0x7f769c155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7690001230 tx=0x7f769000cb70 comp rx=0 tx=0).stop 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 shutdown_connections 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f767c073200 0x7f767c075710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f769c0cfd40 0x7f769c1670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769c0ccdf0 0x7f769c166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 --2- 172.21.15.64:0/3707619751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f769c0b3c80 0x7f769c155750 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 >> 172.21.15.64:0/3707619751 conn(0x7f769c06d3f0 msgr2=0x7f769c15bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 shutdown_connections 2024-09-21T07:26:27.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.640+0000 7f76a2c00640 1 -- 172.21.15.64:0/3707619751 wait complete. 2024-09-21T07:26:27.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:26:27.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 -- 172.21.15.64:0/1916332557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2300b48d0 msgr2=0x7fd230072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 --2- 172.21.15.64:0/1916332557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2300b48d0 0x7fd230072e20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd2300c3c60 tx=0x7fd22801cd80 comp rx=0 tx=0).stop 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 -- 172.21.15.64:0/1916332557 shutdown_connections 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 --2- 172.21.15.64:0/1916332557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2300b48d0 0x7fd230072e20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 --2- 172.21.15.64:0/1916332557 >> v2:172.21.15.90:3300/0 conn(0x7fd23015edb0 0x7fd2300700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 -- 172.21.15.64:0/1916332557 >> 172.21.15.64:0/1916332557 conn(0x7fd2300ccbe0 msgr2=0x7fd2300ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 -- 172.21.15.64:0/1916332557 shutdown_connections 2024-09-21T07:26:27.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.828+0000 7fd235600640 1 -- 172.21.15.64:0/1916332557 wait complete. 2024-09-21T07:26:27.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 Processor -- start 2024-09-21T07:26:27.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- start start 2024-09-21T07:26:27.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2300709b0 0x7fd2301fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:27.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:27.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd23014a590 0x7fd2300b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:27.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd230168c00 con 0x7fd23015edb0 2024-09-21T07:26:27.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd230168a80 con 0x7fd23014a590 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd230168d80 con 0x7fd2300709b0 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40940/0 (socket says 172.21.15.64:40940) 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 -- 172.21.15.64:0/2929983199 learned_addr learned my addr 172.21.15.64:0/2929983199 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22ea00640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2300709b0 0x7fd2301fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22f400640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd23014a590 0x7fd2300b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 -- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2300709b0 msgr2=0x7fd2301fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2300709b0 0x7fd2301fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 -- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd23014a590 msgr2=0x7fd2300b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd23014a590 0x7fd2300b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 -- 172.21.15.64:0/2929983199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd230153ca0 con 0x7fd23015edb0 2024-09-21T07:26:27.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd22e000640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c3c0 tx=0x7fd21c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c017070 con 0x7fd23015edb0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd21c0053c0 con 0x7fd23015edb0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003860 con 0x7fd23015edb0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd230153f80 con 0x7fd23015edb0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.832+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2300b1510 con 0x7fd23015edb0 2024-09-21T07:26:27.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2301f9ca0 con 0x7fd23015edb0 2024-09-21T07:26:27.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd21c01a070 con 0x7fd23015edb0 2024-09-21T07:26:27.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd226a00640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 0x7fd210075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:27.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7fd21c0933b0 con 0x7fd23015edb0 2024-09-21T07:26:27.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd22ea00640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 0x7fd210075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:27.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.836+0000 7fd22ea00640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 0x7fd210075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd220009b40 tx=0x7fd2200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:27.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:27.840+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd21c05def0 con 0x7fd23015edb0 2024-09-21T07:26:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd230153a10 con 0x7fd23015edb0 2024-09-21T07:26:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd226a00640 1 -- 172.21.15.64:0/2929983199 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7fd21c062920 con 0x7fd23015edb0 2024-09-21T07:26:28.024 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:26:28.024 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:26:28.024 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:26:28.025 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:26:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:26:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 msgr2=0x7fd210075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 0x7fd210075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd220009b40 tx=0x7fd2200091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 msgr2=0x7fd2300b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c3c0 tx=0x7fd21c00c880 comp rx=0 tx=0).stop 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 shutdown_connections 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd210073200 0x7fd210075710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd23014a590 0x7fd2300b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd23015edb0 0x7fd2300b24b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 --2- 172.21.15.64:0/2929983199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2300709b0 0x7fd2301fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 >> 172.21.15.64:0/2929983199 conn(0x7fd2300ccbe0 msgr2=0x7fd230157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 shutdown_connections 2024-09-21T07:26:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.020+0000 7fd235600640 1 -- 172.21.15.64:0/2929983199 wait complete. 2024-09-21T07:26:28.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:26:28.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 -- 172.21.15.64:0/1412201022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f38073ea0 msgr2=0x7f7f380742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 --2- 172.21.15.64:0/1412201022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f38073ea0 0x7f7f380742b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009cb0 tx=0x7f7f3001cc50 comp rx=0 tx=0).stop 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 -- 172.21.15.64:0/1412201022 shutdown_connections 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 --2- 172.21.15.64:0/1412201022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f38073ea0 0x7f7f380742b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 -- 172.21.15.64:0/1412201022 >> 172.21.15.64:0/1412201022 conn(0x7f7f380b1c60 msgr2=0x7f7f380b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 -- 172.21.15.64:0/1412201022 shutdown_connections 2024-09-21T07:26:28.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.204+0000 7f7f3d000640 1 -- 172.21.15.64:0/1412201022 wait complete. 2024-09-21T07:26:28.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 Processor -- start 2024-09-21T07:26:28.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- start start 2024-09-21T07:26:28.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f38073ea0 0x7f7f3813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f3815fa60 0x7f7f380ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38169b80 con 0x7f7f380cc910 2024-09-21T07:26:28.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38169a00 con 0x7f7f38073ea0 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7f38169d00 con 0x7f7f3815fa60 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40950/0 (socket says 172.21.15.64:40950) 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 -- 172.21.15.64:0/879600757 learned_addr learned my addr 172.21.15.64:0/879600757 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f37e00640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f3815fa60 0x7f7f380ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f37400640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f38073ea0 0x7f7f3813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 -- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f3815fa60 msgr2=0x7f7f380ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f3815fa60 0x7f7f380ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 -- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f38073ea0 msgr2=0x7f7f3813fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f38073ea0 0x7f7f3813fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 -- 172.21.15.64:0/879600757 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f381402f0 con 0x7f7f380cc910 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2fe00640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000c420 tx=0x7f7f2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20017070 con 0x7f7f380cc910 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f200053c0 con 0x7f7f380cc910 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f381fc5a0 con 0x7f7f380cc910 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20003860 con 0x7f7f380cc910 2024-09-21T07:26:28.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.208+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f38155af0 con 0x7f7f380cc910 2024-09-21T07:26:28.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.212+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f381fcac0 con 0x7f7f380cc910 2024-09-21T07:26:28.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.212+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f2001a070 con 0x7f7f380cc910 2024-09-21T07:26:28.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.212+0000 7f7f2f400640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.212+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f7f20093390 con 0x7f7f380cc910 2024-09-21T07:26:28.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.212+0000 7f7f37400640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.216+0000 7f7f37400640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007fd0 tx=0x7f7f28009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:28.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.216+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7f381fcac0 con 0x7f7f380cc910 2024-09-21T07:26:28.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.396+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7f380742b0 con 0x7f7f380cc910 2024-09-21T07:26:28.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.400+0000 7f7f2f400640 1 -- 172.21.15.64:0/879600757 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f7f2005df00 con 0x7f7f380cc910 2024-09-21T07:26:28.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 msgr2=0x7f7f14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007fd0 tx=0x7f7f28009040 comp rx=0 tx=0).stop 2024-09-21T07:26:28.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 msgr2=0x7f7f381fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000c420 tx=0x7f7f2000c8e0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 shutdown_connections 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f3815fa60 0x7f7f380ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380cc910 0x7f7f381fbb70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 --2- 172.21.15.64:0/879600757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f38073ea0 0x7f7f3813fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 >> 172.21.15.64:0/879600757 conn(0x7f7f380b1c60 msgr2=0x7f7f3815a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 shutdown_connections 2024-09-21T07:26:28.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.404+0000 7f7f3d000640 1 -- 172.21.15.64:0/879600757 wait complete. 2024-09-21T07:26:28.428 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:26:28.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:26:28.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:26:28.631 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:26:28.631 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:28.631 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:28.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:26:28.640 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:26:28.640 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:28.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:26:28.652 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:28.652 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:28.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:26:28.696 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:26:28.696 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:28.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:26:28.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:26:28.705 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:28.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- 172.21.15.64:0/2736004069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 msgr2=0x7f073c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 --2- 172.21.15.64:0/2736004069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c0cc0e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0734009c80 tx=0x7f073401cd70 comp rx=0 tx=0).stop 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- 172.21.15.64:0/2736004069 shutdown_connections 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 --2- 172.21.15.64:0/2736004069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c0cc0e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 --2- 172.21.15.64:0/2736004069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 0x7f073c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- 172.21.15.64:0/2736004069 >> 172.21.15.64:0/2736004069 conn(0x7f073c0ccbe0 msgr2=0x7f073c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- 172.21.15.64:0/2736004069 shutdown_connections 2024-09-21T07:26:28.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- 172.21.15.64:0/2736004069 wait complete. 2024-09-21T07:26:28.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 Processor -- start 2024-09-21T07:26:28.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.896+0000 7f0742200640 1 -- start start 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 0x7f073c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 0x7f073c1f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f073c0b42e0 con 0x7f073c0cbcd0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f073c0b4160 con 0x7f073c15cbd0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f073c16a290 con 0x7f073c0b1be0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40956/0 (socket says 172.21.15.64:40956) 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 -- 172.21.15.64:0/3901657717 learned_addr learned my addr 172.21.15.64:0/3901657717 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f073b400640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 0x7f073c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f073be00640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 0x7f073c1f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 -- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 msgr2=0x7f073c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 0x7f073c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 -- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 msgr2=0x7f073c1f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 0x7f073c1f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 -- 172.21.15.64:0/3901657717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c1f8d10 con 0x7f073c0cbcd0 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f073be00640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 0x7f073c1f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:28.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733e00640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f072400d6b0 tx=0x7f072400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724017070 con 0x7f073c0cbcd0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0724005310 con 0x7f073c0cbcd0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724009820 con 0x7f073c0cbcd0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073c09b010 con 0x7f073c0cbcd0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073c09b5d0 con 0x7f073c0cbcd0 2024-09-21T07:26:28.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.900+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073c09ad80 con 0x7f073c0cbcd0 2024-09-21T07:26:28.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.904+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07240099c0 con 0x7f073c0cbcd0 2024-09-21T07:26:28.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.904+0000 7f0733400640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:28.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.904+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7f0724094050 con 0x7f073c0cbcd0 2024-09-21T07:26:28.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.904+0000 7f073b400640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:28.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.904+0000 7f073b400640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f072c007fd0 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:28.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:28.908+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f072405eb90 con 0x7f073c0cbcd0 2024-09-21T07:26:29.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.124+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f073c0b1ff0 con 0x7f073c0cbcd0 2024-09-21T07:26:29.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.124+0000 7f0733400640 1 -- 172.21.15.64:0/3901657717 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3911 (secure 0 0 0) 0x7f07240635c0 con 0x7f073c0cbcd0 2024-09-21T07:26:29.131 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:29.131 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"btime":"2024-09-21T07:26:22:607801+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3129681739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3129681739},{"type":"v1","addr":"172.21.15.90:6835","nonce":3129681739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1642049804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1642049804},{"type":"v1","addr":"172.21.15.64:6835","nonce":1642049804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1126957896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1126957896},{"type":"v1","addr":"172.21.15.90:6837","nonce":1126957896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2887655692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2887655692},{"type":"v1","addr":"172.21.15.64:6833","nonce":2887655692}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-21T07:26:29.132 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 29 2024-09-21T07:26:29.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 msgr2=0x7f0718075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f072c007fd0 tx=0x7f072c009040 comp rx=0 tx=0).stop 2024-09-21T07:26:29.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 msgr2=0x7f073c09cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f072400d6b0 tx=0x7f072400db70 comp rx=0 tx=0).stop 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 shutdown_connections 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073c15cbd0 0x7f073c1f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f073c0cbcd0 0x7f073c09cfa0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 --2- 172.21.15.64:0/3901657717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f073c0b1be0 0x7f073c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 >> 172.21.15.64:0/3901657717 conn(0x7f073c0ccbe0 msgr2=0x7f073c158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 shutdown_connections 2024-09-21T07:26:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.128+0000 7f0742200640 1 -- 172.21.15.64:0/3901657717 wait complete. 2024-09-21T07:26:29.154 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:26:29.154 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:26:29.154 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:26:29.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:29.155 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:26:29.155 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:26:29.155 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:26:29.155 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:29.155 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:26:29.155 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:26:29.156 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:26:29.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:29.156 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:26:29.156 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:26:29.156 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:26:29.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:29.169 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:26:29.169 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:26:29.171 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:26:29.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:26:29.172 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:26:29.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:26:29.179 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:26:29.179 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:26:29.215 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:26:29.215 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:29.216 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:26:29.217 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:29.225 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:26:29.226 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:29.227 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:26:29.228 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:29.228 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:26:29.321 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:26:29.322 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:26:29.329 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:26:29.329 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 -- 172.21.15.64:0/3549016981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 msgr2=0x7fb2100b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 --2- 172.21.15.64:0/3549016981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb2100b4cd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb204005fd0 tx=0x7fb20401c790 comp rx=0 tx=0).stop 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 -- 172.21.15.64:0/3549016981 shutdown_connections 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 --2- 172.21.15.64:0/3549016981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb2100b4cd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 -- 172.21.15.64:0/3549016981 >> 172.21.15.64:0/3549016981 conn(0x7fb21006d450 msgr2=0x7fb2100d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 -- 172.21.15.64:0/3549016981 shutdown_connections 2024-09-21T07:26:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.388+0000 7fb218800640 1 -- 172.21.15.64:0/3549016981 wait complete. 2024-09-21T07:26:29.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 Processor -- start 2024-09-21T07:26:29.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 -- start start 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb210149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb21015eb80 0x7fb210152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101694d0 con 0x7fb2100aefe0 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb210169350 con 0x7fb210155560 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb218800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb210169650 con 0x7fb21015eb80 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40994/0 (socket says 172.21.15.64:40994) 2024-09-21T07:26:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 -- 172.21.15.64:0/2394255002 learned_addr learned my addr 172.21.15.64:0/2394255002 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:29.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb216800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb21015eb80 0x7fb210152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215400640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb210149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 -- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb21015eb80 msgr2=0x7fb210152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb21015eb80 0x7fb210152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 -- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 msgr2=0x7fb210149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb210149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.392+0000 7fb215e00640 1 -- 172.21.15.64:0/2394255002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21014ee20 con 0x7fb2100aefe0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb215e00640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb20401ae40 tx=0x7fb204003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204005c40 con 0x7fb2100aefe0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb204004120 con 0x7fb2100aefe0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204005050 con 0x7fb2100aefe0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21014f100 con 0x7fb2100aefe0 2024-09-21T07:26:29.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2100cbac0 con 0x7fb2100aefe0 2024-09-21T07:26:29.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2100b4cd0 con 0x7fb2100aefe0 2024-09-21T07:26:29.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb2040be020 con 0x7fb2100aefe0 2024-09-21T07:26:29.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 0x7fb1f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.396+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5335+0+0 (secure 0 0 0) 0x7fb20412e960 con 0x7fb2100aefe0 2024-09-21T07:26:29.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.400+0000 7fb215400640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 0x7fb1f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.400+0000 7fb215400640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 0x7fb1f4075740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb21015a5b0 tx=0x7fb200009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:29.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.400+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2040c5020 con 0x7fb2100aefe0 2024-09-21T07:26:29.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.588+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb2100704c0 con 0x7fb2100aefe0 2024-09-21T07:26:29.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.656+0000 7fb20a000640 1 -- 172.21.15.64:0/2394255002 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) ==== 97+0+0 (secure 0 0 0) 0x7fb204016410 con 0x7fb2100aefe0 2024-09-21T07:26:29.664 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 msgr2=0x7fb1f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 0x7fb1f4075740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb21015a5b0 tx=0x7fb200009040 comp rx=0 tx=0).stop 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 msgr2=0x7fb21014e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb20401ae40 tx=0x7fb204003ca0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 shutdown_connections 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f4073230 0x7fb1f4075740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb21015eb80 0x7fb210152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb210155560 0x7fb210149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 --2- 172.21.15.64:0/2394255002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2100aefe0 0x7fb21014e260 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 >> 172.21.15.64:0/2394255002 conn(0x7fb21006d450 msgr2=0x7fb210073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 shutdown_connections 2024-09-21T07:26:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.660+0000 7fb218800640 1 -- 172.21.15.64:0/2394255002 wait complete. 2024-09-21T07:26:29.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:26:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- 172.21.15.64:0/697467397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 msgr2=0x7f91c8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 --2- 172.21.15.64:0/697467397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c8072e20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009bc0 tx=0x7f91c001cba0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- 172.21.15.64:0/697467397 shutdown_connections 2024-09-21T07:26:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 --2- 172.21.15.64:0/697467397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c8072e20 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 --2- 172.21.15.64:0/697467397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c80709b0 0x7f91c80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- 172.21.15.64:0/697467397 >> 172.21.15.64:0/697467397 conn(0x7f91c80ccbe0 msgr2=0x7f91c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- 172.21.15.64:0/697467397 shutdown_connections 2024-09-21T07:26:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- 172.21.15.64:0/697467397 wait complete. 2024-09-21T07:26:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 Processor -- start 2024-09-21T07:26:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.844+0000 7f91cee00640 1 -- start start 2024-09-21T07:26:29.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91c80709b0 0x7f91c80ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c815edb0 0x7f91c80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8168ba0 con 0x7f91c80b4700 2024-09-21T07:26:29.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8168a20 con 0x7f91c80709b0 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f91c8168d20 con 0x7f91c815edb0 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41008/0 (socket says 172.21.15.64:41008) 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 -- 172.21.15.64:0/972143391 learned_addr learned my addr 172.21.15.64:0/972143391 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cce00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c815edb0 0x7f91c80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91c7e00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91c80709b0 0x7f91c80ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 -- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c815edb0 msgr2=0x7f91c80cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c815edb0 0x7f91c80cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 -- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91c80709b0 msgr2=0x7f91c80ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91c80709b0 0x7f91c80ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 -- 172.21.15.64:0/972143391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c81fd0e0 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91bf400640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f91b000d750 tx=0x7f91b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0017070 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91b0009d20 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c81f9040 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0005280 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81f9600 con 0x7f91c80b4700 2024-09-21T07:26:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c80b41c0 con 0x7f91c80b4700 2024-09-21T07:26:29.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.848+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91b0005420 con 0x7f91c80b4700 2024-09-21T07:26:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.852+0000 7f91c4c00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 0x7f91a4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.852+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7f91b0094190 con 0x7f91c80b4700 2024-09-21T07:26:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.852+0000 7f91c7e00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 0x7f91a4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.852+0000 7f91c7e00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 0x7f91a4075740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000f70 tx=0x7f91b8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:29.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:29.856+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f91b000de60 con 0x7f91c80b4700 2024-09-21T07:26:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f91c81fce70 con 0x7f91c80b4700 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91c4c00640 1 -- 172.21.15.64:0/972143391 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f91b005f360 con 0x7f91c80b4700 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.101 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.102 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:26:30.103 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:26:30.104 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.106 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.107 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.109 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.110 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.111 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.112 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:26:30.113 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.114 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:26:30.115 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:26:30.116 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:26:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:30.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 msgr2=0x7f91a4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 0x7f91a4075740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000f70 tx=0x7f91b8009040 comp rx=0 tx=0).stop 2024-09-21T07:26:30.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 msgr2=0x7f91c81fc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f91b000d750 tx=0x7f91b000dc10 comp rx=0 tx=0).stop 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 shutdown_connections 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91a4073230 0x7f91a4075740 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f91c815edb0 0x7f91c80cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91c80b4700 0x7f91c81fc490 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 --2- 172.21.15.64:0/972143391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91c80709b0 0x7f91c80ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 >> 172.21.15.64:0/972143391 conn(0x7f91c80ccbe0 msgr2=0x7f91c80af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 shutdown_connections 2024-09-21T07:26:30.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.096+0000 7f91cee00640 1 -- 172.21.15.64:0/972143391 wait complete. 2024-09-21T07:26:30.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 -- 172.21.15.64:0/377338023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540b48d0 msgr2=0x7fac54072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 --2- 172.21.15.64:0/377338023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540b48d0 0x7fac54072e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009bf0 tx=0x7fac4c01cbe0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 -- 172.21.15.64:0/377338023 shutdown_connections 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 --2- 172.21.15.64:0/377338023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540b48d0 0x7fac54072e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 -- 172.21.15.64:0/377338023 >> 172.21.15.64:0/377338023 conn(0x7fac540ccbe0 msgr2=0x7fac540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 -- 172.21.15.64:0/377338023 shutdown_connections 2024-09-21T07:26:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.276+0000 7fac59c00640 1 -- 172.21.15.64:0/377338023 wait complete. 2024-09-21T07:26:30.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 Processor -- start 2024-09-21T07:26:30.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- start start 2024-09-21T07:26:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 0x7fac540b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 0x7fac540b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac5416a460 con 0x7fac540b3fb0 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac5416a2e0 con 0x7fac5415edb0 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac5416a5e0 con 0x7fac540709b0 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41016/0 (socket says 172.21.15.64:41016) 2024-09-21T07:26:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 -- 172.21.15.64:0/4057237933 learned_addr learned my addr 172.21.15.64:0/4057237933 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac52a00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 0x7fac540b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac4be00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 0x7fac540b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 -- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 msgr2=0x7fac540b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 0x7fac540b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 -- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 msgr2=0x7fac540b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 0x7fac540b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 -- 172.21.15.64:0/4057237933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac540b4900 con 0x7fac540b3fb0 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac52a00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 0x7fac540b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac4be00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 0x7fac540b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac53400640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fac4c01b290 tx=0x7fac4c005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:30.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0b2040 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac4c004b40 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c004040 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac541f8ea0 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.280+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac541f9460 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac54072e20 con 0x7fac540b3fb0 2024-09-21T07:26:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac4c0be060 con 0x7fac540b3fb0 2024-09-21T07:26:30.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac4aa00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 0x7fac30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7fac4c12ddf0 con 0x7fac540b3fb0 2024-09-21T07:26:30.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac52a00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 0x7fac30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.284+0000 7fac52a00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 0x7fac30075710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac44007fd0 tx=0x7fac44009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:30.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.288+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fac540b4900 con 0x7fac540b3fb0 2024-09-21T07:26:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.468+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fac5409da20 con 0x7fac540b3fb0 2024-09-21T07:26:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.468+0000 7fac4aa00640 1 -- 172.21.15.64:0/4057237933 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) ==== 84+0+65 (secure 0 0 0) 0x7fac4c0167d0 con 0x7fac540b3fb0 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:26:30.474 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 msgr2=0x7fac30075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 0x7fac30075710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac44007fd0 tx=0x7fac44009040 comp rx=0 tx=0).stop 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 msgr2=0x7fac540b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fac4c01b290 tx=0x7fac4c005aa0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 shutdown_connections 2024-09-21T07:26:30.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac30073200 0x7fac30075710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac540b3fb0 0x7fac540b43c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac5415edb0 0x7fac540b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 --2- 172.21.15.64:0/4057237933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac540709b0 0x7fac540b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 >> 172.21.15.64:0/4057237933 conn(0x7fac540ccbe0 msgr2=0x7fac540cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 shutdown_connections 2024-09-21T07:26:30.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.472+0000 7fac59c00640 1 -- 172.21.15.64:0/4057237933 wait complete. 2024-09-21T07:26:30.496 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:26:30.496 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 -- 172.21.15.64:0/2821051414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2180cfef0 msgr2=0x7fb2180d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 --2- 172.21.15.64:0/2821051414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2180cfef0 0x7fb2180d0300 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb2180b3cd0 tx=0x7fb20401c6e0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 -- 172.21.15.64:0/2821051414 shutdown_connections 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 --2- 172.21.15.64:0/2821051414 >> v2:172.21.15.90:3300/0 conn(0x7fb21806cdf0 0x7fb21806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 --2- 172.21.15.64:0/2821051414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2180cfef0 0x7fb2180d0300 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 -- 172.21.15.64:0/2821051414 >> 172.21.15.64:0/2821051414 conn(0x7fb2180cdd00 msgr2=0x7fb2180ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 -- 172.21.15.64:0/2821051414 shutdown_connections 2024-09-21T07:26:30.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.652+0000 7fb21f800640 1 -- 172.21.15.64:0/2821051414 wait complete. 2024-09-21T07:26:30.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 Processor -- start 2024-09-21T07:26:30.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 -- start start 2024-09-21T07:26:30.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2180affa0 0x7fb21815b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2180cfef0 0x7fb2181fc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb21816c200 con 0x7fb21806cdf0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb21816c080 con 0x7fb2180cfef0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb21816c380 con 0x7fb2180affa0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41032/0 (socket says 172.21.15.64:41032) 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21ce00640 1 -- 172.21.15.64:0/2095369294 learned_addr learned my addr 172.21.15.64:0/2095369294 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb217e00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2180affa0 0x7fb21815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.656+0000 7fb21d800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2180cfef0 0x7fb2181fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 -- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2180affa0 msgr2=0x7fb21815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2180affa0 0x7fb21815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 -- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2180cfef0 msgr2=0x7fb2181fc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2180cfef0 0x7fb2181fc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:30.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 -- 172.21.15.64:0/2095369294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2181636e0 con 0x7fb21806cdf0 2024-09-21T07:26:30.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21ce00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3f0 tx=0x7fb20c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:30.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c017070 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb20c003600 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb218161030 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c003a50 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2181669f0 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2180c4930 con 0x7fb21806cdf0 2024-09-21T07:26:30.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.660+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb20c01a070 con 0x7fb21806cdf0 2024-09-21T07:26:30.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.664+0000 7fb214c00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 0x7fb1f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:30.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.664+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7fb20c0933d0 con 0x7fb21806cdf0 2024-09-21T07:26:30.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.664+0000 7fb217e00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 0x7fb1f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:30.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.664+0000 7fb217e00640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 0x7fb1f8075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2040af000 tx=0x7fb2040b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:30.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.668+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2180c4930 con 0x7fb21806cdf0 2024-09-21T07:26:30.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:30.844+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb2181667e0 con 0x7fb21806cdf0 2024-09-21T07:26:31.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.676+0000 7fb214c00640 1 -- 172.21.15.64:0/2095369294 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) ==== 138+0+0 (secure 0 0 0) 0x7fb20c05de40 con 0x7fb21806cdf0 2024-09-21T07:26:31.680 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.676+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 msgr2=0x7fb1f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.676+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 0x7fb1f8075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2040af000 tx=0x7fb2040b2040 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.676+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 msgr2=0x7fb21815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.676+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3f0 tx=0x7fb20c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 shutdown_connections 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f8073200 0x7fb1f8075710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2180cfef0 0x7fb2181fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2180affa0 0x7fb21815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 --2- 172.21.15.64:0/2095369294 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb21806cdf0 0x7fb21815a3e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 >> 172.21.15.64:0/2095369294 conn(0x7fb2180cdd00 msgr2=0x7fb2180af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 shutdown_connections 2024-09-21T07:26:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.680+0000 7fb21f800640 1 -- 172.21.15.64:0/2095369294 wait complete. 2024-09-21T07:26:31.710 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- 172.21.15.64:0/1584215222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 msgr2=0x7f6c8c06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 --2- 172.21.15.64:0/1584215222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c06ffb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009840 tx=0x7f6c7401c790 comp rx=0 tx=0).stop 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- 172.21.15.64:0/1584215222 shutdown_connections 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 --2- 172.21.15.64:0/1584215222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c06ffb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 --2- 172.21.15.64:0/1584215222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c15ec20 0x7f6c8c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- 172.21.15.64:0/1584215222 >> 172.21.15.64:0/1584215222 conn(0x7f6c8c0ccbe0 msgr2=0x7f6c8c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- 172.21.15.64:0/1584215222 shutdown_connections 2024-09-21T07:26:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- 172.21.15.64:0/1584215222 wait complete. 2024-09-21T07:26:31.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 Processor -- start 2024-09-21T07:26:31.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.872+0000 7f6c91a00640 1 -- start start 2024-09-21T07:26:31.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c0704f0 0x7f6c8c073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c8c15ec20 0x7f6c8c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c168ff0 con 0x7f6c8c0ca990 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c168e70 con 0x7f6c8c15ec20 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c169170 con 0x7f6c8c0704f0 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41050/0 (socket says 172.21.15.64:41050) 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 -- 172.21.15.64:0/2005594138 learned_addr learned my addr 172.21.15.64:0/2005594138 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c8aa00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c0704f0 0x7f6c8c073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c8b400640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c8c15ec20 0x7f6c8c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 -- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c0704f0 msgr2=0x7f6c8c073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c0704f0 0x7f6c8c073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 -- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c8c15ec20 msgr2=0x7f6c8c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c8c15ec20 0x7f6c8c0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 -- 172.21.15.64:0/2005594138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0b1690 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c83e00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c7401ae40 tx=0x7f6c74005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740b2040 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c740043e0 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c0b1930 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740052d0 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c151fe0 con 0x7f6c8c0ca990 2024-09-21T07:26:31.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.876+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c1522c0 con 0x7f6c8c0ca990 2024-09-21T07:26:31.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.880+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6c74005470 con 0x7f6c8c0ca990 2024-09-21T07:26:31.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.880+0000 7f6c82a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 0x7f6c68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:31.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.880+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5619+0+0 (secure 0 0 0) 0x7f6c7412df60 con 0x7f6c8c0ca990 2024-09-21T07:26:31.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.880+0000 7f6c8aa00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 0x7f6c68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:31.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.880+0000 7f6c8aa00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 0x7f6c68075710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c072330 tx=0x7f6c7c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:31.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:31.884+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6c740bd060 con 0x7f6c8c0ca990 2024-09-21T07:26:32.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.064+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6c8c06ffb0 con 0x7f6c8c0ca990 2024-09-21T07:26:32.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.680+0000 7f6c82a00640 1 -- 172.21.15.64:0/2005594138 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) ==== 170+0+0 (secure 0 0 0) 0x7f6c74016410 con 0x7f6c8c0ca990 2024-09-21T07:26:32.688 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:26:32.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 msgr2=0x7f6c68075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:32.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 0x7f6c68075710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c072330 tx=0x7f6c7c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 msgr2=0x7f6c8c0aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:32.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c7401ae40 tx=0x7f6c74005db0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 shutdown_connections 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c68073200 0x7f6c68075710 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c8c15ec20 0x7f6c8c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8c0ca990 0x7f6c8c0aff80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 --2- 172.21.15.64:0/2005594138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8c0704f0 0x7f6c8c073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 >> 172.21.15.64:0/2005594138 conn(0x7f6c8c0ccbe0 msgr2=0x7f6c8c15d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 shutdown_connections 2024-09-21T07:26:32.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.684+0000 7f6c91a00640 1 -- 172.21.15.64:0/2005594138 wait complete. 2024-09-21T07:26:32.732 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:26:32.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 -- 172.21.15.64:0/542127596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 msgr2=0x7f6f7015e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 --2- 172.21.15.64:0/542127596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f7015e960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009840 tx=0x7f6f6401c7f0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 -- 172.21.15.64:0/542127596 shutdown_connections 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 --2- 172.21.15.64:0/542127596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f700b5c70 0x7f6f700b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 --2- 172.21.15.64:0/542127596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f7015e960 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 -- 172.21.15.64:0/542127596 >> 172.21.15.64:0/542127596 conn(0x7f6f7009b3b0 msgr2=0x7f6f700d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 -- 172.21.15.64:0/542127596 shutdown_connections 2024-09-21T07:26:32.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.888+0000 7f6f76a00640 1 -- 172.21.15.64:0/542127596 wait complete. 2024-09-21T07:26:32.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 Processor -- start 2024-09-21T07:26:32.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- start start 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f7006e330 0x7f6f701f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f700b5c70 0x7f6f7015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7016be20 con 0x7f6f700b7280 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7016bca0 con 0x7f6f700b5c70 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7016bfa0 con 0x7f6f7006e330 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41068/0 (socket says 172.21.15.64:41068) 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 -- 172.21.15.64:0/2819145405 learned_addr learned my addr 172.21.15.64:0/2819145405 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f75600640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f7006e330 0x7f6f701f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f74c00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f700b5c70 0x7f6f7015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 -- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f7006e330 msgr2=0x7f6f701f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f7006e330 0x7f6f701f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 -- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f700b5c70 msgr2=0x7f6f7015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f700b5c70 0x7f6f7015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 -- 172.21.15.64:0/2819145405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700b45e0 con 0x7f6f700b7280 2024-09-21T07:26:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76000640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e910 tx=0x7f6f6800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004d30 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f6800cb20 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68005020 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f701597c0 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.892+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7015ad40 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.896+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f700b6080 con 0x7f6f700b7280 2024-09-21T07:26:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.896+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f680051c0 con 0x7f6f700b7280 2024-09-21T07:26:32.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.896+0000 7f6f6d600640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 0x7f6f50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:32.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.896+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6001+0+0 (secure 0 0 0) 0x7f6f68094b40 con 0x7f6f700b7280 2024-09-21T07:26:32.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.896+0000 7f6f75600640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 0x7f6f50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:32.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.900+0000 7f6f75600640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 0x7f6f50075710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f640af000 tx=0x7f6f6401b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:32.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:32.904+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6f68016030 con 0x7f6f700b7280 2024-09-21T07:26:33.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.116+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6f7015e180 con 0x7f6f700b7280 2024-09-21T07:26:33.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.700+0000 7f6f6d600640 1 -- 172.21.15.64:0/2819145405 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v32) ==== 173+0+0 (secure 0 0 0) 0x7f6f6805f3d0 con 0x7f6f700b7280 2024-09-21T07:26:33.705 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 9 and data pool 10 2024-09-21T07:26:33.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.704+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 msgr2=0x7f6f50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:33.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.704+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 0x7f6f50075710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f640af000 tx=0x7f6f6401b030 comp rx=0 tx=0).stop 2024-09-21T07:26:33.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.704+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 msgr2=0x7f6f70153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:33.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.704+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e910 tx=0x7f6f6800edd0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 shutdown_connections 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f50073200 0x7f6f50075710 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f700b7280 0x7f6f70153010 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f700b5c70 0x7f6f7015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 --2- 172.21.15.64:0/2819145405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f7006e330 0x7f6f701f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 >> 172.21.15.64:0/2819145405 conn(0x7f6f7009b3b0 msgr2=0x7f6f700b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:33.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 shutdown_connections 2024-09-21T07:26:33.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.708+0000 7f6f76a00640 1 -- 172.21.15.64:0/2819145405 wait complete. 2024-09-21T07:26:33.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 -- 172.21.15.64:0/4283840037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 msgr2=0x7f14cc0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 --2- 172.21.15.64:0/4283840037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc0b41c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06f220 tx=0x7f14b401c7e0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 -- 172.21.15.64:0/4283840037 shutdown_connections 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 --2- 172.21.15.64:0/4283840037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc0b41c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 --2- 172.21.15.64:0/4283840037 >> v2:172.21.15.90:3300/0 conn(0x7f14cc15edb0 0x7f14cc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 -- 172.21.15.64:0/4283840037 >> 172.21.15.64:0/4283840037 conn(0x7f14cc0ccbe0 msgr2=0x7f14cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 -- 172.21.15.64:0/4283840037 shutdown_connections 2024-09-21T07:26:33.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.900+0000 7f14d2200640 1 -- 172.21.15.64:0/4283840037 wait complete. 2024-09-21T07:26:33.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 Processor -- start 2024-09-21T07:26:33.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- start start 2024-09-21T07:26:33.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:33.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14cc0b4700 0x7f14cc1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14cc15edb0 0x7f14cc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc168fb0 con 0x7f14cc0709b0 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc168e30 con 0x7f14cc15edb0 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc169130 con 0x7f14cc0b4700 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41084/0 (socket says 172.21.15.64:41084) 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 -- 172.21.15.64:0/739862856 learned_addr learned my addr 172.21.15.64:0/739862856 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cbe00640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14cc15edb0 0x7f14cc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14c3e00640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14cc0b4700 0x7f14cc1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 -- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14cc0b4700 msgr2=0x7f14cc1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14cc0b4700 0x7f14cc1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 -- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14cc15edb0 msgr2=0x7f14cc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:33.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14cc15edb0 0x7f14cc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 -- 172.21.15.64:0/739862856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc1fa7d0 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14cb400640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00d720 tx=0x7f14bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc017070 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14bc009d20 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc005280 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc1faab0 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc15a070 con 0x7f14cc0709b0 2024-09-21T07:26:33.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.904+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc0b41c0 con 0x7f14cc0709b0 2024-09-21T07:26:33.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.908+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f14bc005420 con 0x7f14cc0709b0 2024-09-21T07:26:33.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.908+0000 7f14c3400640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 0x7f14a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:33.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.908+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f14bc0944b0 con 0x7f14cc0709b0 2024-09-21T07:26:33.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.908+0000 7f14c3e00640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 0x7f14a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:33.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.908+0000 7f14c3e00640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 0x7f14a8075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14b40af000 tx=0x7f14b401b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:33.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:33.912+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f14bc05f3c0 con 0x7f14cc0709b0 2024-09-21T07:26:34.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.088+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14cc09da20 con 0x7f14cc0709b0 2024-09-21T07:26:34.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14c3400640 1 -- 172.21.15.64:0/739862856 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16909 (secure 0 0 0) 0x7f14bc05ecc0 con 0x7f14cc0709b0 2024-09-21T07:26:34.097 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:34.097 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":66,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:33.122092+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:26:30.860830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-21T07:26:32.079106+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 msgr2=0x7f14a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 0x7f14a8075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14b40af000 tx=0x7f14b401b020 comp rx=0 tx=0).stop 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 msgr2=0x7f14cc1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00d720 tx=0x7f14bc00dbe0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 shutdown_connections 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14a8073230 0x7f14a8075740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14cc15edb0 0x7f14cc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14cc0b4700 0x7f14cc1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 --2- 172.21.15.64:0/739862856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14cc0709b0 0x7f14cc1552f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 >> 172.21.15.64:0/739862856 conn(0x7f14cc0ccbe0 msgr2=0x7f14cc09d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 shutdown_connections 2024-09-21T07:26:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.092+0000 7f14d2200640 1 -- 172.21.15.64:0/739862856 wait complete. 2024-09-21T07:26:34.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:34.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 -- 172.21.15.64:0/3638826246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd47015edb0 msgr2=0x7fd4700700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 --2- 172.21.15.64:0/3638826246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd47015edb0 0x7fd4700700b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd460009870 tx=0x7fd46001c780 comp rx=0 tx=0).stop 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 -- 172.21.15.64:0/3638826246 shutdown_connections 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 --2- 172.21.15.64:0/3638826246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd47015edb0 0x7fd4700700b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 -- 172.21.15.64:0/3638826246 >> 172.21.15.64:0/3638826246 conn(0x7fd4700ccbe0 msgr2=0x7fd4700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 -- 172.21.15.64:0/3638826246 shutdown_connections 2024-09-21T07:26:34.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.272+0000 7fd476400640 1 -- 172.21.15.64:0/3638826246 wait complete. 2024-09-21T07:26:34.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 Processor -- start 2024-09-21T07:26:34.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 -- start start 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4700709b0 0x7fd4701f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4700ae620 0x7fd470154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd47016a380 con 0x7fd47015edb0 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd47016a200 con 0x7fd4700ae620 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd476400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd47016a500 con 0x7fd4700709b0 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41100/0 (socket says 172.21.15.64:41100) 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 -- 172.21.15.64:0/3621717015 learned_addr learned my addr 172.21.15.64:0/3621717015 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd46f400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4700709b0 0x7fd4701f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd46fe00640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4700ae620 0x7fd470154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 -- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4700709b0 msgr2=0x7fd4701f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4700709b0 0x7fd4701f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 -- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4700ae620 msgr2=0x7fd470154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4700ae620 0x7fd470154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 -- 172.21.15.64:0/3621717015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700cbfd0 con 0x7fd47015edb0 2024-09-21T07:26:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.276+0000 7fd466a00640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c4d0 tx=0x7fd45800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458012830 con 0x7fd47015edb0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4700cc2b0 con 0x7fd47015edb0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd458017070 con 0x7fd47015edb0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458012d00 con 0x7fd47015edb0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47015c390 con 0x7fd47015edb0 2024-09-21T07:26:34.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4700700b0 con 0x7fd47015edb0 2024-09-21T07:26:34.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd45801c460 con 0x7fd47015edb0 2024-09-21T07:26:34.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 0x7fd44c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7fd4580941b0 con 0x7fd47015edb0 2024-09-21T07:26:34.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.280+0000 7fd46f400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 0x7fd44c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.284+0000 7fd46f400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 0x7fd44c075710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4600af000 tx=0x7fd4600b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:34.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.284+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd45805e960 con 0x7fd47015edb0 2024-09-21T07:26:34.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd47009da20 con 0x7fd47015edb0 2024-09-21T07:26:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd467e00640 1 -- 172.21.15.64:0/3621717015 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16909 (secure 0 0 0) 0x7fd458063390 con 0x7fd47015edb0 2024-09-21T07:26:34.469 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:34.469 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":66,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:33.122092+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:26:30.860830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-21T07:26:32.079106+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:34.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 msgr2=0x7fd44c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 0x7fd44c075710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4600af000 tx=0x7fd4600b2040 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 msgr2=0x7fd4700ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c4d0 tx=0x7fd45800c990 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 shutdown_connections 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd44c073200 0x7fd44c075710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4700ae620 0x7fd470154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd47015edb0 0x7fd4700ae0e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 --2- 172.21.15.64:0/3621717015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4700709b0 0x7fd4701f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 >> 172.21.15.64:0/3621717015 conn(0x7fd4700ccbe0 msgr2=0x7fd47015da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.464+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 shutdown_connections 2024-09-21T07:26:34.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.468+0000 7fd476400640 1 -- 172.21.15.64:0/3621717015 wait complete. 2024-09-21T07:26:34.492 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:26:34.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 -- 172.21.15.64:0/201308645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80afde0 msgr2=0x7f3cb80cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 --2- 172.21.15.64:0/201308645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80afde0 0x7f3cb80cb850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca001c6f0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 -- 172.21.15.64:0/201308645 shutdown_connections 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 --2- 172.21.15.64:0/201308645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80afde0 0x7f3cb80cb850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 -- 172.21.15.64:0/201308645 >> 172.21.15.64:0/201308645 conn(0x7f3cb80b2510 msgr2=0x7f3cb80b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 -- 172.21.15.64:0/201308645 shutdown_connections 2024-09-21T07:26:34.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.648+0000 7f3cbd000640 1 -- 172.21.15.64:0/201308645 wait complete. 2024-09-21T07:26:34.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 Processor -- start 2024-09-21T07:26:34.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 -- start start 2024-09-21T07:26:34.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815b850 0x7f3cb80c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb81f9c20 0x7f3cb81fa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb816a140 con 0x7f3cb80cbd90 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb806f8b0 con 0x7f3cb815b850 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cbd000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb816a2c0 con 0x7f3cb81f9c20 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41102/0 (socket says 172.21.15.64:41102) 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 -- 172.21.15.64:0/2168566236 learned_addr learned my addr 172.21.15.64:0/2168566236 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cad400640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815b850 0x7f3cb80c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb6800640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb81f9c20 0x7f3cb81fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 -- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb81f9c20 msgr2=0x7f3cb81fa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb81f9c20 0x7f3cb81fa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 -- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815b850 msgr2=0x7f3cb80c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815b850 0x7f3cb80c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 -- 172.21.15.64:0/2168566236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb81fa570 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3cb5e00640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c430 tx=0x7f3ca800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.652+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8017070 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca80053c0 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8003860 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb80c7410 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81583d0 con 0x7f3cb80cbd90 2024-09-21T07:26:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb80cb850 con 0x7f3cb80cbd90 2024-09-21T07:26:34.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3ca801a070 con 0x7f3cb80cbd90 2024-09-21T07:26:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.656+0000 7f3caea00640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 0x7f3c94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.660+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f3ca8093700 con 0x7f3cb80cbd90 2024-09-21T07:26:34.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.660+0000 7f3cad400640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 0x7f3c94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:34.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.660+0000 7f3cad400640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 0x7f3c94075710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00af000 tx=0x7f3ca00b5040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:34.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.664+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3cb81fa570 con 0x7f3cb80cbd90 2024-09-21T07:26:34.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:34.880+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3cb806b130 con 0x7f3cb80cbd90 2024-09-21T07:26:35.681 INFO:tasks.ceph.mds.d.smithi090.stderr:2024-09-21T07:26:35.678+0000 7f78d2000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:26:35.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.720+0000 7f3caea00640 1 -- 172.21.15.64:0/2168566236 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f3ca805dfd0 con 0x7f3cb80cbd90 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 msgr2=0x7f3c94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 0x7f3c94075710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00af000 tx=0x7f3ca00b5040 comp rx=0 tx=0).stop 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 msgr2=0x7f3cb8157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c430 tx=0x7f3ca800c8f0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 shutdown_connections 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073200 0x7f3c94075710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb81f9c20 0x7f3cb81fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815b850 0x7f3cb80c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 --2- 172.21.15.64:0/2168566236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb80cbd90 0x7f3cb8157710 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 >> 172.21.15.64:0/2168566236 conn(0x7f3cb80b2510 msgr2=0x7f3cb80cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:35.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 shutdown_connections 2024-09-21T07:26:35.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.724+0000 7f3cbd000640 1 -- 172.21.15.64:0/2168566236 wait complete. 2024-09-21T07:26:35.753 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:26:35.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:26:35.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- 172.21.15.64:0/3048173171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 msgr2=0x7f64040b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:35.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 --2- 172.21.15.64:0/3048173171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f64040b4290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009840 tx=0x7f63ec01c790 comp rx=0 tx=0).stop 2024-09-21T07:26:35.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- 172.21.15.64:0/3048173171 shutdown_connections 2024-09-21T07:26:35.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 --2- 172.21.15.64:0/3048173171 >> v2:172.21.15.90:3300/0 conn(0x7f64040d0100 0x7f64040d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 --2- 172.21.15.64:0/3048173171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f64040b4290 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- 172.21.15.64:0/3048173171 >> 172.21.15.64:0/3048173171 conn(0x7f64040cee80 msgr2=0x7f64040cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:35.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- 172.21.15.64:0/3048173171 shutdown_connections 2024-09-21T07:26:35.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- 172.21.15.64:0/3048173171 wait complete. 2024-09-21T07:26:35.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 Processor -- start 2024-09-21T07:26:35.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 -- start start 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f6404157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.916+0000 7f640aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64040d0100 0x7f64041509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f640416a390 con 0x7f640415c9a0 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f640416a210 con 0x7f64040d0100 2024-09-21T07:26:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f640416a510 con 0x7f64040b3e80 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46048/0 (socket says 172.21.15.64:46048) 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 -- 172.21.15.64:0/2055764249 learned_addr learned my addr 172.21.15.64:0/2055764249 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f63fb400640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64040d0100 0x7f64041509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6403e00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f6404157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 -- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 msgr2=0x7f6404157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f6404157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 -- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64040d0100 msgr2=0x7f64041509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64040d0100 0x7f64041509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 -- 172.21.15.64:0/2055764249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64041577b0 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6408a00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00eab0 tx=0x7f63fc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00ce40 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63fc004b30 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6404150f00 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc005020 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64040c7930 con 0x7f640415c9a0 2024-09-21T07:26:35.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64040c73c0 con 0x7f640415c9a0 2024-09-21T07:26:35.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.920+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63fc0051c0 con 0x7f640415c9a0 2024-09-21T07:26:35.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.924+0000 7f6400c00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:35.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.924+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f63fc094f80 con 0x7f640415c9a0 2024-09-21T07:26:35.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.924+0000 7f6403e00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:35.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.924+0000 7f6403e00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 0x7f63e0075710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f63f4001780 tx=0x7f63f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:35.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:35.928+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f64041577b0 con 0x7f640415c9a0 2024-09-21T07:26:36.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.140+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f64040b4290 con 0x7f640415c9a0 2024-09-21T07:26:36.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f6400c00640 1 -- 172.21.15.64:0/2055764249 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f63fc05f730 con 0x7f640415c9a0 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 msgr2=0x7f63e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 0x7f63e0075710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f63f4001780 tx=0x7f63f4009040 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 msgr2=0x7f64041661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00eab0 tx=0x7f63fc00ef70 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 shutdown_connections 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f640415c9a0 0x7f64041661f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64040d0100 0x7f64041509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 --2- 172.21.15.64:0/2055764249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64040b3e80 0x7f6404157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 >> 172.21.15.64:0/2055764249 conn(0x7f64040cee80 msgr2=0x7f64041512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:36.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 shutdown_connections 2024-09-21T07:26:36.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.728+0000 7f640aa00640 1 -- 172.21.15.64:0/2055764249 wait complete. 2024-09-21T07:26:36.757 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:26:36.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- 172.21.15.64:0/2174046396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004d50 msgr2=0x7f87ac005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 --2- 172.21.15.64:0/2174046396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004d50 0x7f87ac005160 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009e90 tx=0x7f87bc01d590 comp rx=0 tx=0).stop 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87c9e00640 1 -- 172.21.15.64:0/2174046396 reap_dead start 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- 172.21.15.64:0/2174046396 shutdown_connections 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- 172.21.15.64:0/2174046396 >> 172.21.15.64:0/2174046396 conn(0x7f87c406d1c0 msgr2=0x7f87c406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:36.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- 172.21.15.64:0/2174046396 shutdown_connections 2024-09-21T07:26:36.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- 172.21.15.64:0/2174046396 wait complete. 2024-09-21T07:26:36.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 Processor -- start 2024-09-21T07:26:36.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.912+0000 7f87cbe00640 1 -- start start 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 0x7f87c4157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c40b5b20 0x7f87c40b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40c6860 con 0x7f87c40b5f30 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40c66e0 con 0x7f87ac004d50 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f87c40c69e0 con 0x7f87c40b5b20 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46062/0 (socket says 172.21.15.64:46062) 2024-09-21T07:26:36.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 -- 172.21.15.64:0/3593668284 learned_addr learned my addr 172.21.15.64:0/3593668284 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c8a00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c40b5b20 0x7f87c40b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9400640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 0x7f87c4157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 -- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c40b5b20 msgr2=0x7f87c40b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c40b5b20 0x7f87c40b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 -- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 msgr2=0x7f87c4157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 0x7f87c4157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 -- 172.21.15.64:0/3593668284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c40ca140 con 0x7f87c40b5f30 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9400640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 0x7f87c4157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c9e00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0ae040 tx=0x7f87bc004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0b0070 con 0x7f87c40b5f30 2024-09-21T07:26:36.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87bc0b1040 con 0x7f87c40b5f30 2024-09-21T07:26:36.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c415f4b0 con 0x7f87c40b5f30 2024-09-21T07:26:36.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a7040 con 0x7f87c40b5f30 2024-09-21T07:26:36.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c415fc00 con 0x7f87c40b5f30 2024-09-21T07:26:36.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.916+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c40ca310 con 0x7f87c40b5f30 2024-09-21T07:26:36.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.920+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f87bc0c0060 con 0x7f87c40b5f30 2024-09-21T07:26:36.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.920+0000 7f87c1600640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 0x7f87a4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:36.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.920+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f87bc12e820 con 0x7f87c40b5f30 2024-09-21T07:26:36.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.920+0000 7f87c9400640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 0x7f87a4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:36.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.920+0000 7f87c9400640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 0x7f87a4075740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f87b8001750 tx=0x7f87b8006920 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:36.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:36.924+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f87bc0172e0 con 0x7f87c40b5f30 2024-09-21T07:26:37.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87c415f680 con 0x7f87c40b5f30 2024-09-21T07:26:37.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87c1600640 1 -- 172.21.15.64:0/3593668284 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5224 (secure 0 0 0) 0x7f87bc0f9610 con 0x7f87c40b5f30 2024-09-21T07:26:37.145 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:37.145 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":36,"btime":"2024-09-21T07:26:36:726462+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2154117473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2154117473},{"type":"v1","addr":"172.21.15.90:6835","nonce":2154117473}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6172,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1583991454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1583991454},{"type":"v1","addr":"172.21.15.64:6834","nonce":1583991454}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3528879025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3528879025},{"type":"v1","addr":"172.21.15.64:6835","nonce":3528879025}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:36.147161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1195501528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1195501528},{"type":"v1","addr":"172.21.15.90:6837","nonce":1195501528}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-09-21T07:26:37.145 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 36 2024-09-21T07:26:37.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 msgr2=0x7f87a4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 0x7f87a4075740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f87b8001750 tx=0x7f87b8006920 comp rx=0 tx=0).stop 2024-09-21T07:26:37.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 msgr2=0x7f87c40b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0ae040 tx=0x7f87bc004f30 comp rx=0 tx=0).stop 2024-09-21T07:26:37.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 shutdown_connections 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87a4073230 0x7f87a4075740 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c40b5f30 0x7f87c40b7180 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87c40b5b20 0x7f87c40b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 --2- 172.21.15.64:0/3593668284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87ac004d50 0x7f87c4157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 >> 172.21.15.64:0/3593668284 conn(0x7f87c406d1c0 msgr2=0x7f87c4159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 shutdown_connections 2024-09-21T07:26:37.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.140+0000 7f87cbe00640 1 -- 172.21.15.64:0/3593668284 wait complete. 2024-09-21T07:26:37.168 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:26:37.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 -- 172.21.15.64:0/1786933457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 msgr2=0x7fd350070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 --2- 172.21.15.64:0/1786933457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd350070310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd340009840 tx=0x7fd34001c710 comp rx=0 tx=0).stop 2024-09-21T07:26:37.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 -- 172.21.15.64:0/1786933457 shutdown_connections 2024-09-21T07:26:37.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 --2- 172.21.15.64:0/1786933457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3500b22f0 0x7fd3500cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 --2- 172.21.15.64:0/1786933457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd350070310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 -- 172.21.15.64:0/1786933457 >> 172.21.15.64:0/1786933457 conn(0x7fd3500ccbe0 msgr2=0x7fd3500ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 -- 172.21.15.64:0/1786933457 shutdown_connections 2024-09-21T07:26:37.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.320+0000 7fd356800640 1 -- 172.21.15.64:0/1786933457 wait complete. 2024-09-21T07:26:37.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 Processor -- start 2024-09-21T07:26:37.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 -- start start 2024-09-21T07:26:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd3500ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3501547e0 0x7fd3500b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd35016a290 con 0x7fd350070850 2024-09-21T07:26:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3500b4280 con 0x7fd35015cbd0 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd356800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd35016a410 con 0x7fd3501547e0 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46064/0 (socket says 172.21.15.64:46064) 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 -- 172.21.15.64:0/490339888 learned_addr learned my addr 172.21.15.64:0/490339888 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34fe00640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3501547e0 0x7fd3500b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34ea00640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd3500ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 -- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3501547e0 msgr2=0x7fd3500b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3501547e0 0x7fd3500b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 -- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 msgr2=0x7fd3500ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd3500ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 -- 172.21.15.64:0/490339888 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3500c9080 con 0x7fd350070850 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34ea00640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd3500ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.324+0000 7fd34f400640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd34001cfb0 tx=0x7fd340005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3400bc070 con 0x7fd350070850 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3400a5b40 con 0x7fd350070850 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3400b2040 con 0x7fd350070850 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3500c9360 con 0x7fd350070850 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3500c9920 con 0x7fd350070850 2024-09-21T07:26:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3500cbcd0 con 0x7fd350070850 2024-09-21T07:26:37.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd340003600 con 0x7fd350070850 2024-09-21T07:26:37.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 0x7fd330075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd34012dd00 con 0x7fd350070850 2024-09-21T07:26:37.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.328+0000 7fd34ea00640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 0x7fd330075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.332+0000 7fd34ea00640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 0x7fd330075710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001ec0 tx=0x7fd33c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.336+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd340016330 con 0x7fd350070850 2024-09-21T07:26:37.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd35015bdf0 con 0x7fd350070850 2024-09-21T07:26:37.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd347400640 1 -- 172.21.15.64:0/490339888 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16896 (secure 0 0 0) 0x7fd3400f84a0 con 0x7fd350070850 2024-09-21T07:26:37.521 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:37.521 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":67,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:34.700375+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:26:30.860830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-21T07:26:32.079106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:26:37.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 msgr2=0x7fd330075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 0x7fd330075710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001ec0 tx=0x7fd33c009040 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 msgr2=0x7fd3501f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd34001cfb0 tx=0x7fd340005ca0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 shutdown_connections 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd330073200 0x7fd330075710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3501547e0 0x7fd3500b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35015cbd0 0x7fd3500ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 --2- 172.21.15.64:0/490339888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd350070850 0x7fd3501f95a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 >> 172.21.15.64:0/490339888 conn(0x7fd3500ccbe0 msgr2=0x7fd3500cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 shutdown_connections 2024-09-21T07:26:37.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.516+0000 7fd356800640 1 -- 172.21.15.64:0/490339888 wait complete. 2024-09-21T07:26:37.544 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:26:37.544 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- 172.21.15.64:0/1484792781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415f040 msgr2=0x7faa3415f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 --2- 172.21.15.64:0/1484792781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415f040 0x7faa3415f450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009bc0 tx=0x7faa2c01ca50 comp rx=0 tx=0).stop 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- 172.21.15.64:0/1484792781 shutdown_connections 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 --2- 172.21.15.64:0/1484792781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415f040 0x7faa3415f450 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- 172.21.15.64:0/1484792781 >> 172.21.15.64:0/1484792781 conn(0x7faa340cd3a0 msgr2=0x7faa340cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- 172.21.15.64:0/1484792781 shutdown_connections 2024-09-21T07:26:37.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- 172.21.15.64:0/1484792781 wait complete. 2024-09-21T07:26:37.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 Processor -- start 2024-09-21T07:26:37.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.700+0000 7faa38a00640 1 -- start start 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa340ca550 0x7faa340b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa3415f040 0x7faa34159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa34169f50 con 0x7faa3415b540 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa34169dd0 con 0x7faa340ca550 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faa3416a0d0 con 0x7faa3415f040 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46094/0 (socket says 172.21.15.64:46094) 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 -- 172.21.15.64:0/3726377211 learned_addr learned my addr 172.21.15.64:0/3726377211 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa33400640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa340ca550 0x7faa340b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa33e00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa3415f040 0x7faa34159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 -- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa3415f040 msgr2=0x7faa34159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa3415f040 0x7faa34159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 -- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa340ca550 msgr2=0x7faa340b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa340ca550 0x7faa340b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 -- 172.21.15.64:0/3726377211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa34152450 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2be00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c450 tx=0x7faa1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0052d0 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa1c005470 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c012870 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa34152730 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3409ceb0 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.704+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3415f450 con 0x7faa3415b540 2024-09-21T07:26:37.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.708+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa1c003600 con 0x7faa3415b540 2024-09-21T07:26:37.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.708+0000 7faa2b400640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 0x7faa10075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.708+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7faa1c093d30 con 0x7faa3415b540 2024-09-21T07:26:37.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.708+0000 7faa33400640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 0x7faa10075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.708+0000 7faa33400640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 0x7faa10075740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faa24007fd0 tx=0x7faa24009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.712+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faa1c05e600 con 0x7faa3415b540 2024-09-21T07:26:37.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.888+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa34152200 con 0x7faa10073230 2024-09-21T07:26:37.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.892+0000 7faa2b400640 1 -- 172.21.15.64:0/3726377211 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243122 (secure 0 0 0) 0x7faa34152200 con 0x7faa10073230 2024-09-21T07:26:37.901 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:37.903 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 msgr2=0x7faa10075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 0x7faa10075740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faa24007fd0 tx=0x7faa24009040 comp rx=0 tx=0).stop 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 msgr2=0x7faa340b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c450 tx=0x7faa1c00c910 comp rx=0 tx=0).stop 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 shutdown_connections 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa10073230 0x7faa10075740 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa3415f040 0x7faa34159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa3415b540 0x7faa340b1920 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 --2- 172.21.15.64:0/3726377211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa340ca550 0x7faa340b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 >> 172.21.15.64:0/3726377211 conn(0x7faa340cd3a0 msgr2=0x7faa34154650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 shutdown_connections 2024-09-21T07:26:37.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:37.896+0000 7faa38a00640 1 -- 172.21.15.64:0/3726377211 wait complete. 2024-09-21T07:26:37.923 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-21T07:26:37.480496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":294192,"kb_used_data":7220,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680528,"statfs":{"total":773094113280,"available":772792860672,"internally_reserved":0,"allocated":7393280,"data_stored":3962515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":293654067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829883+0000","last_change":"2024-09-21T07:26:33.719818+0000","last_active":"2024-09-21T07:26:34.829883+0000","last_peered":"2024-09-21T07:26:34.829883+0000","last_clean":"2024-09-21T07:26:34.829883+0000","last_became_active":"2024-09-21T07:26:33.719487+0000","last_became_peered":"2024-09-21T07:26:33.719487+0000","last_unstale":"2024-09-21T07:26:34.829883+0000","last_undegraded":"2024-09-21T07:26:34.829883+0000","last_fullsized":"2024-09-21T07:26:34.829883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:40.586013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830201+0000","last_change":"2024-09-21T07:26:33.735244+0000","last_active":"2024-09-21T07:26:34.830201+0000","last_peered":"2024-09-21T07:26:34.830201+0000","last_clean":"2024-09-21T07:26:34.830201+0000","last_became_active":"2024-09-21T07:26:33.734869+0000","last_became_peered":"2024-09-21T07:26:33.734869+0000","last_unstale":"2024-09-21T07:26:34.830201+0000","last_undegraded":"2024-09-21T07:26:34.830201+0000","last_fullsized":"2024-09-21T07:26:34.830201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:56.186491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829783+0000","last_change":"2024-09-21T07:26:33.729856+0000","last_active":"2024-09-21T07:26:34.829783+0000","last_peered":"2024-09-21T07:26:34.829783+0000","last_clean":"2024-09-21T07:26:34.829783+0000","last_became_active":"2024-09-21T07:26:33.728193+0000","last_became_peered":"2024-09-21T07:26:33.728193+0000","last_unstale":"2024-09-21T07:26:34.829783+0000","last_undegraded":"2024-09-21T07:26:34.829783+0000","last_fullsized":"2024-09-21T07:26:34.829783+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:14.296128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829991+0000","last_change":"2024-09-21T07:26:33.727636+0000","last_active":"2024-09-21T07:26:34.829991+0000","last_peered":"2024-09-21T07:26:34.829991+0000","last_clean":"2024-09-21T07:26:34.829991+0000","last_became_active":"2024-09-21T07:26:33.718633+0000","last_became_peered":"2024-09-21T07:26:33.718633+0000","last_unstale":"2024-09-21T07:26:34.829991+0000","last_undegraded":"2024-09-21T07:26:34.829991+0000","last_fullsized":"2024-09-21T07:26:34.829991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:37.109885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829845+0000","last_change":"2024-09-21T07:26:33.714569+0000","last_active":"2024-09-21T07:26:34.829845+0000","last_peered":"2024-09-21T07:26:34.829845+0000","last_clean":"2024-09-21T07:26:34.829845+0000","last_became_active":"2024-09-21T07:26:33.714245+0000","last_became_peered":"2024-09-21T07:26:33.714245+0000","last_unstale":"2024-09-21T07:26:34.829845+0000","last_undegraded":"2024-09-21T07:26:34.829845+0000","last_fullsized":"2024-09-21T07:26:34.829845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.617192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707622+0000","last_change":"2024-09-21T07:26:33.714237+0000","last_active":"2024-09-21T07:26:34.707622+0000","last_peered":"2024-09-21T07:26:34.707622+0000","last_clean":"2024-09-21T07:26:34.707622+0000","last_became_active":"2024-09-21T07:26:33.713885+0000","last_became_peered":"2024-09-21T07:26:33.713885+0000","last_unstale":"2024-09-21T07:26:34.707622+0000","last_undegraded":"2024-09-21T07:26:34.707622+0000","last_fullsized":"2024-09-21T07:26:34.707622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:41.615956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707273+0000","last_change":"2024-09-21T07:26:33.716014+0000","last_active":"2024-09-21T07:26:34.707273+0000","last_peered":"2024-09-21T07:26:34.707273+0000","last_clean":"2024-09-21T07:26:34.707273+0000","last_became_active":"2024-09-21T07:26:33.715646+0000","last_became_peered":"2024-09-21T07:26:33.715646+0000","last_unstale":"2024-09-21T07:26:34.707273+0000","last_undegraded":"2024-09-21T07:26:34.707273+0000","last_fullsized":"2024-09-21T07:26:34.707273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:54.097384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707232+0000","last_change":"2024-09-21T07:26:33.715793+0000","last_active":"2024-09-21T07:26:34.707232+0000","last_peered":"2024-09-21T07:26:34.707232+0000","last_clean":"2024-09-21T07:26:34.707232+0000","last_became_active":"2024-09-21T07:26:33.715534+0000","last_became_peered":"2024-09-21T07:26:33.715534+0000","last_unstale":"2024-09-21T07:26:34.707232+0000","last_undegraded":"2024-09-21T07:26:34.707232+0000","last_fullsized":"2024-09-21T07:26:34.707232+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:00.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829471+0000","last_change":"2024-09-21T07:26:33.719495+0000","last_active":"2024-09-21T07:26:34.829471+0000","last_peered":"2024-09-21T07:26:34.829471+0000","last_clean":"2024-09-21T07:26:34.829471+0000","last_became_active":"2024-09-21T07:26:33.719197+0000","last_became_peered":"2024-09-21T07:26:33.719197+0000","last_unstale":"2024-09-21T07:26:34.829471+0000","last_undegraded":"2024-09-21T07:26:34.829471+0000","last_fullsized":"2024-09-21T07:26:34.829471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:19.973936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830261+0000","last_change":"2024-09-21T07:26:33.731886+0000","last_active":"2024-09-21T07:26:34.830261+0000","last_peered":"2024-09-21T07:26:34.830261+0000","last_clean":"2024-09-21T07:26:34.830261+0000","last_became_active":"2024-09-21T07:26:33.731590+0000","last_became_peered":"2024-09-21T07:26:33.731590+0000","last_unstale":"2024-09-21T07:26:34.830261+0000","last_undegraded":"2024-09-21T07:26:34.830261+0000","last_fullsized":"2024-09-21T07:26:34.830261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:36.960428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683197+0000","last_change":"2024-09-21T07:26:31.683197+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683197+0000","last_undegraded":"2024-09-21T07:26:31.683197+0000","last_fullsized":"2024-09-21T07:26:31.683197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690512+0000","last_change":"2024-09-21T07:26:31.690512+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690512+0000","last_undegraded":"2024-09-21T07:26:31.690512+0000","last_fullsized":"2024-09-21T07:26:31.690512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691668+0000","last_change":"2024-09-21T07:26:31.691668+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691668+0000","last_undegraded":"2024-09-21T07:26:31.691668+0000","last_fullsized":"2024-09-21T07:26:31.691668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830055+0000","last_change":"2024-09-21T07:26:33.728398+0000","last_active":"2024-09-21T07:26:34.830055+0000","last_peered":"2024-09-21T07:26:34.830055+0000","last_clean":"2024-09-21T07:26:34.830055+0000","last_became_active":"2024-09-21T07:26:33.728110+0000","last_became_peered":"2024-09-21T07:26:33.728110+0000","last_unstale":"2024-09-21T07:26:34.830055+0000","last_undegraded":"2024-09-21T07:26:34.830055+0000","last_fullsized":"2024-09-21T07:26:34.830055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:40.217242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690428+0000","last_change":"2024-09-21T07:26:31.690428+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690428+0000","last_undegraded":"2024-09-21T07:26:31.690428+0000","last_fullsized":"2024-09-21T07:26:31.690428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707548+0000","last_change":"2024-09-21T07:26:32.705538+0000","last_active":"2024-09-21T07:26:34.707548+0000","last_peered":"2024-09-21T07:26:34.707548+0000","last_clean":"2024-09-21T07:26:34.707548+0000","last_became_active":"2024-09-21T07:26:32.705215+0000","last_became_peered":"2024-09-21T07:26:32.705215+0000","last_unstale":"2024-09-21T07:26:34.707548+0000","last_undegraded":"2024-09-21T07:26:34.707548+0000","last_fullsized":"2024-09-21T07:26:34.707548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:36.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707186+0000","last_change":"2024-09-21T07:26:32.706993+0000","last_active":"2024-09-21T07:26:34.707186+0000","last_peered":"2024-09-21T07:26:34.707186+0000","last_clean":"2024-09-21T07:26:34.707186+0000","last_became_active":"2024-09-21T07:26:32.706667+0000","last_became_peered":"2024-09-21T07:26:32.706667+0000","last_unstale":"2024-09-21T07:26:34.707186+0000","last_undegraded":"2024-09-21T07:26:34.707186+0000","last_fullsized":"2024-09-21T07:26:34.707186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:23.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707153+0000","last_change":"2024-09-21T07:26:32.704657+0000","last_active":"2024-09-21T07:26:34.707153+0000","last_peered":"2024-09-21T07:26:34.707153+0000","last_clean":"2024-09-21T07:26:34.707153+0000","last_became_active":"2024-09-21T07:26:32.704359+0000","last_became_peered":"2024-09-21T07:26:32.704359+0000","last_unstale":"2024-09-21T07:26:34.707153+0000","last_undegraded":"2024-09-21T07:26:34.707153+0000","last_fullsized":"2024-09-21T07:26:34.707153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:13.239895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707601+0000","last_change":"2024-09-21T07:26:33.715873+0000","last_active":"2024-09-21T07:26:34.707601+0000","last_peered":"2024-09-21T07:26:34.707601+0000","last_clean":"2024-09-21T07:26:34.707601+0000","last_became_active":"2024-09-21T07:26:33.715561+0000","last_became_peered":"2024-09-21T07:26:33.715561+0000","last_unstale":"2024-09-21T07:26:34.707601+0000","last_undegraded":"2024-09-21T07:26:34.707601+0000","last_fullsized":"2024-09-21T07:26:34.707601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:05.220655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.684636+0000","last_change":"2024-09-21T07:26:31.684636+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.684636+0000","last_undegraded":"2024-09-21T07:26:31.684636+0000","last_fullsized":"2024-09-21T07:26:31.684636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830191+0000","last_change":"2024-09-21T07:26:32.717966+0000","last_active":"2024-09-21T07:26:34.830191+0000","last_peered":"2024-09-21T07:26:34.830191+0000","last_clean":"2024-09-21T07:26:34.830191+0000","last_became_active":"2024-09-21T07:26:32.717578+0000","last_became_peered":"2024-09-21T07:26:32.717578+0000","last_unstale":"2024-09-21T07:26:34.830191+0000","last_undegraded":"2024-09-21T07:26:34.830191+0000","last_fullsized":"2024-09-21T07:26:34.830191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:06.698663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707654+0000","last_change":"2024-09-21T07:26:33.726854+0000","last_active":"2024-09-21T07:26:34.707654+0000","last_peered":"2024-09-21T07:26:34.707654+0000","last_clean":"2024-09-21T07:26:34.707654+0000","last_became_active":"2024-09-21T07:26:33.726465+0000","last_became_peered":"2024-09-21T07:26:33.726465+0000","last_unstale":"2024-09-21T07:26:34.707654+0000","last_undegraded":"2024-09-21T07:26:34.707654+0000","last_fullsized":"2024-09-21T07:26:34.707654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:43.518328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.687024+0000","last_change":"2024-09-21T07:26:31.687024+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.687024+0000","last_undegraded":"2024-09-21T07:26:31.687024+0000","last_fullsized":"2024-09-21T07:26:31.687024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829661+0000","last_change":"2024-09-21T07:26:32.717213+0000","last_active":"2024-09-21T07:26:34.829661+0000","last_peered":"2024-09-21T07:26:34.829661+0000","last_clean":"2024-09-21T07:26:34.829661+0000","last_became_active":"2024-09-21T07:26:32.716200+0000","last_became_peered":"2024-09-21T07:26:32.716200+0000","last_unstale":"2024-09-21T07:26:34.829661+0000","last_undegraded":"2024-09-21T07:26:34.829661+0000","last_fullsized":"2024-09-21T07:26:34.829661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:05.433165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683805+0000","last_change":"2024-09-21T07:26:31.683805+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683805+0000","last_undegraded":"2024-09-21T07:26:31.683805+0000","last_fullsized":"2024-09-21T07:26:31.683805+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829877+0000","last_change":"2024-09-21T07:26:32.713456+0000","last_active":"2024-09-21T07:26:34.829877+0000","last_peered":"2024-09-21T07:26:34.829877+0000","last_clean":"2024-09-21T07:26:34.829877+0000","last_became_active":"2024-09-21T07:26:32.713105+0000","last_became_peered":"2024-09-21T07:26:32.713105+0000","last_unstale":"2024-09-21T07:26:34.829877+0000","last_undegraded":"2024-09-21T07:26:34.829877+0000","last_fullsized":"2024-09-21T07:26:34.829877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.016585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694968+0000","last_change":"2024-09-21T07:26:31.694968+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694968+0000","last_undegraded":"2024-09-21T07:26:31.694968+0000","last_fullsized":"2024-09-21T07:26:31.694968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829769+0000","last_change":"2024-09-21T07:26:32.715629+0000","last_active":"2024-09-21T07:26:34.829769+0000","last_peered":"2024-09-21T07:26:34.829769+0000","last_clean":"2024-09-21T07:26:34.829769+0000","last_became_active":"2024-09-21T07:26:32.714299+0000","last_became_peered":"2024-09-21T07:26:32.714299+0000","last_unstale":"2024-09-21T07:26:34.829769+0000","last_undegraded":"2024-09-21T07:26:34.829769+0000","last_fullsized":"2024-09-21T07:26:34.829769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.440088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.686092+0000","last_change":"2024-09-21T07:26:31.686092+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.686092+0000","last_undegraded":"2024-09-21T07:26:31.686092+0000","last_fullsized":"2024-09-21T07:26:31.686092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830176+0000","last_change":"2024-09-21T07:26:33.732772+0000","last_active":"2024-09-21T07:26:34.830176+0000","last_peered":"2024-09-21T07:26:34.830176+0000","last_clean":"2024-09-21T07:26:34.830176+0000","last_became_active":"2024-09-21T07:26:33.732465+0000","last_became_peered":"2024-09-21T07:26:33.732465+0000","last_unstale":"2024-09-21T07:26:34.830176+0000","last_undegraded":"2024-09-21T07:26:34.830176+0000","last_fullsized":"2024-09-21T07:26:34.830176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:34.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694763+0000","last_change":"2024-09-21T07:26:31.694763+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694763+0000","last_undegraded":"2024-09-21T07:26:31.694763+0000","last_fullsized":"2024-09-21T07:26:31.694763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829825+0000","last_change":"2024-09-21T07:26:32.715720+0000","last_active":"2024-09-21T07:26:34.829825+0000","last_peered":"2024-09-21T07:26:34.829825+0000","last_clean":"2024-09-21T07:26:34.829825+0000","last_became_active":"2024-09-21T07:26:32.715163+0000","last_became_peered":"2024-09-21T07:26:32.715163+0000","last_unstale":"2024-09-21T07:26:34.829825+0000","last_undegraded":"2024-09-21T07:26:34.829825+0000","last_fullsized":"2024-09-21T07:26:34.829825+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:47.679106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829821+0000","last_change":"2024-09-21T07:26:32.717014+0000","last_active":"2024-09-21T07:26:34.829821+0000","last_peered":"2024-09-21T07:26:34.829821+0000","last_clean":"2024-09-21T07:26:34.829821+0000","last_became_active":"2024-09-21T07:26:32.716627+0000","last_became_peered":"2024-09-21T07:26:32.716627+0000","last_unstale":"2024-09-21T07:26:34.829821+0000","last_undegraded":"2024-09-21T07:26:34.829821+0000","last_fullsized":"2024-09-21T07:26:34.829821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:28.633725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707512+0000","last_change":"2024-09-21T07:26:32.707991+0000","last_active":"2024-09-21T07:26:34.707512+0000","last_peered":"2024-09-21T07:26:34.707512+0000","last_clean":"2024-09-21T07:26:34.707512+0000","last_became_active":"2024-09-21T07:26:32.707628+0000","last_became_peered":"2024-09-21T07:26:32.707628+0000","last_unstale":"2024-09-21T07:26:34.707512+0000","last_undegraded":"2024-09-21T07:26:34.707512+0000","last_fullsized":"2024-09-21T07:26:34.707512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:08.739164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690788+0000","last_change":"2024-09-21T07:26:31.690788+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690788+0000","last_undegraded":"2024-09-21T07:26:31.690788+0000","last_fullsized":"2024-09-21T07:26:31.690788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693883+0000","last_change":"2024-09-21T07:26:31.693883+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693883+0000","last_undegraded":"2024-09-21T07:26:31.693883+0000","last_fullsized":"2024-09-21T07:26:31.693883+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690506+0000","last_change":"2024-09-21T07:26:31.690506+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690506+0000","last_undegraded":"2024-09-21T07:26:31.690506+0000","last_fullsized":"2024-09-21T07:26:31.690506+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693819+0000","last_change":"2024-09-21T07:26:31.693819+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693819+0000","last_undegraded":"2024-09-21T07:26:31.693819+0000","last_fullsized":"2024-09-21T07:26:31.693819+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693866+0000","last_change":"2024-09-21T07:26:31.693866+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693866+0000","last_undegraded":"2024-09-21T07:26:31.693866+0000","last_fullsized":"2024-09-21T07:26:31.693866+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691172+0000","last_change":"2024-09-21T07:26:31.691172+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691172+0000","last_undegraded":"2024-09-21T07:26:31.691172+0000","last_fullsized":"2024-09-21T07:26:31.691172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683285+0000","last_change":"2024-09-21T07:26:31.683285+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683285+0000","last_undegraded":"2024-09-21T07:26:31.683285+0000","last_fullsized":"2024-09-21T07:26:31.683285+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830034+0000","last_change":"2024-09-21T07:26:32.714302+0000","last_active":"2024-09-21T07:26:34.830034+0000","last_peered":"2024-09-21T07:26:34.830034+0000","last_clean":"2024-09-21T07:26:34.830034+0000","last_became_active":"2024-09-21T07:26:32.713972+0000","last_became_peered":"2024-09-21T07:26:32.713972+0000","last_unstale":"2024-09-21T07:26:34.830034+0000","last_undegraded":"2024-09-21T07:26:34.830034+0000","last_fullsized":"2024-09-21T07:26:34.830034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707294+0000","last_change":"2024-09-21T07:26:32.711484+0000","last_active":"2024-09-21T07:26:34.707294+0000","last_peered":"2024-09-21T07:26:34.707294+0000","last_clean":"2024-09-21T07:26:34.707294+0000","last_became_active":"2024-09-21T07:26:32.711179+0000","last_became_peered":"2024-09-21T07:26:32.711179+0000","last_unstale":"2024-09-21T07:26:34.707294+0000","last_undegraded":"2024-09-21T07:26:34.707294+0000","last_fullsized":"2024-09-21T07:26:34.707294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:39.578312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707269+0000","last_change":"2024-09-21T07:26:32.703003+0000","last_active":"2024-09-21T07:26:34.707269+0000","last_peered":"2024-09-21T07:26:34.707269+0000","last_clean":"2024-09-21T07:26:34.707269+0000","last_became_active":"2024-09-21T07:26:32.702679+0000","last_became_peered":"2024-09-21T07:26:32.702679+0000","last_unstale":"2024-09-21T07:26:34.707269+0000","last_undegraded":"2024-09-21T07:26:34.707269+0000","last_fullsized":"2024-09-21T07:26:34.707269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:39.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683286+0000","last_change":"2024-09-21T07:26:31.683286+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683286+0000","last_undegraded":"2024-09-21T07:26:31.683286+0000","last_fullsized":"2024-09-21T07:26:31.683286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707087+0000","last_change":"2024-09-21T07:26:32.704855+0000","last_active":"2024-09-21T07:26:34.707087+0000","last_peered":"2024-09-21T07:26:34.707087+0000","last_clean":"2024-09-21T07:26:34.707087+0000","last_became_active":"2024-09-21T07:26:32.704385+0000","last_became_peered":"2024-09-21T07:26:32.704385+0000","last_unstale":"2024-09-21T07:26:34.707087+0000","last_undegraded":"2024-09-21T07:26:34.707087+0000","last_fullsized":"2024-09-21T07:26:34.707087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:06.609096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829436+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:26:34.829436+0000","last_peered":"2024-09-21T07:26:34.829436+0000","last_clean":"2024-09-21T07:26:34.829436+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:26:34.829436+0000","last_undegraded":"2024-09-21T07:26:34.829436+0000","last_fullsized":"2024-09-21T07:26:34.829436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36108,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335732,"statfs":{"total":96636764160,"available":96599789568,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":753664,"data_stored":337063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36096,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1359872,"data_stored":933640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1413120,"data_stored":954934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:26:37.927 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 -- 172.21.15.64:0/2726702200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a41602d0 msgr2=0x7f04a41606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 --2- 172.21.15.64:0/2726702200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a41602d0 0x7f04a41606e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0498009840 tx=0x7f049801c790 comp rx=0 tx=0).stop 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 -- 172.21.15.64:0/2726702200 shutdown_connections 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 --2- 172.21.15.64:0/2726702200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a4071170 0x7f04a4071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 --2- 172.21.15.64:0/2726702200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a41602d0 0x7f04a41606e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 -- 172.21.15.64:0/2726702200 >> 172.21.15.64:0/2726702200 conn(0x7f04a40cecd0 msgr2=0x7f04a40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 -- 172.21.15.64:0/2726702200 shutdown_connections 2024-09-21T07:26:38.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.120+0000 7f04ab400640 1 -- 172.21.15.64:0/2726702200 wait complete. 2024-09-21T07:26:38.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 Processor -- start 2024-09-21T07:26:38.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- start start 2024-09-21T07:26:38.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 0x7f04a40b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 0x7f04a4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4169df0 con 0x7f04a4071170 2024-09-21T07:26:38.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4169c70 con 0x7f04a41602d0 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f04a4169f70 con 0x7f04a40d05f0 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46112/0 (socket says 172.21.15.64:46112) 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 -- 172.21.15.64:0/2778075187 learned_addr learned my addr 172.21.15.64:0/2778075187 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a3e00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 0x7f04a40b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 -- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 msgr2=0x7f04a40b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a9400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 0x7f04a4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 0x7f04a40b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 -- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 msgr2=0x7f04a4155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 0x7f04a4155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 -- 172.21.15.64:0/2778075187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a40b1ed0 con 0x7f04a4071170 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a3e00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 0x7f04a40b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a9400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 0x7f04a4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a8a00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f049801a3c0 tx=0x7f0498005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980bb070 con 0x7f04a4071170 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0498004330 con 0x7f04a4071170 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a40b21b0 con 0x7f04a4071170 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980b2040 con 0x7f04a4071170 2024-09-21T07:26:38.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.124+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a41f8a90 con 0x7f04a4071170 2024-09-21T07:26:38.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a40b23f0 con 0x7f04a4071170 2024-09-21T07:26:38.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0498003840 con 0x7f04a4071170 2024-09-21T07:26:38.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04a0c00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 0x7f0484075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f049812dcf0 con 0x7f04a4071170 2024-09-21T07:26:38.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04a3e00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 0x7f0484075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.128+0000 7f04a3e00640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 0x7f0484075740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0490005fd0 tx=0x7f0490005de0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.132+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f04980f2290 con 0x7f04a4071170 2024-09-21T07:26:38.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.312+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04a40b1c80 con 0x7f0484073230 2024-09-21T07:26:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.316+0000 7f04a0c00640 1 -- 172.21.15.64:0/2778075187 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243122 (secure 0 0 0) 0x7f04a40b1c80 con 0x7f0484073230 2024-09-21T07:26:38.323 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 msgr2=0x7f0484075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 0x7f0484075740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0490005fd0 tx=0x7f0490005de0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 msgr2=0x7f04a40b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f049801a3c0 tx=0x7f0498005d20 comp rx=0 tx=0).stop 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 shutdown_connections 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0484073230 0x7f0484075740 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a41602d0 0x7f04a4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a40d05f0 0x7f04a40b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 --2- 172.21.15.64:0/2778075187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a4071170 0x7f04a40b2640 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 >> 172.21.15.64:0/2778075187 conn(0x7f04a40cecd0 msgr2=0x7f04a415ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 shutdown_connections 2024-09-21T07:26:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.320+0000 7f04ab400640 1 -- 172.21.15.64:0/2778075187 wait complete. 2024-09-21T07:26:38.344 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-21T07:26:37.480496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":294192,"kb_used_data":7220,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680528,"statfs":{"total":773094113280,"available":772792860672,"internally_reserved":0,"allocated":7393280,"data_stored":3962515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":293654067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829883+0000","last_change":"2024-09-21T07:26:33.719818+0000","last_active":"2024-09-21T07:26:34.829883+0000","last_peered":"2024-09-21T07:26:34.829883+0000","last_clean":"2024-09-21T07:26:34.829883+0000","last_became_active":"2024-09-21T07:26:33.719487+0000","last_became_peered":"2024-09-21T07:26:33.719487+0000","last_unstale":"2024-09-21T07:26:34.829883+0000","last_undegraded":"2024-09-21T07:26:34.829883+0000","last_fullsized":"2024-09-21T07:26:34.829883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:40.586013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830201+0000","last_change":"2024-09-21T07:26:33.735244+0000","last_active":"2024-09-21T07:26:34.830201+0000","last_peered":"2024-09-21T07:26:34.830201+0000","last_clean":"2024-09-21T07:26:34.830201+0000","last_became_active":"2024-09-21T07:26:33.734869+0000","last_became_peered":"2024-09-21T07:26:33.734869+0000","last_unstale":"2024-09-21T07:26:34.830201+0000","last_undegraded":"2024-09-21T07:26:34.830201+0000","last_fullsized":"2024-09-21T07:26:34.830201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:56.186491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829783+0000","last_change":"2024-09-21T07:26:33.729856+0000","last_active":"2024-09-21T07:26:34.829783+0000","last_peered":"2024-09-21T07:26:34.829783+0000","last_clean":"2024-09-21T07:26:34.829783+0000","last_became_active":"2024-09-21T07:26:33.728193+0000","last_became_peered":"2024-09-21T07:26:33.728193+0000","last_unstale":"2024-09-21T07:26:34.829783+0000","last_undegraded":"2024-09-21T07:26:34.829783+0000","last_fullsized":"2024-09-21T07:26:34.829783+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:14.296128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829991+0000","last_change":"2024-09-21T07:26:33.727636+0000","last_active":"2024-09-21T07:26:34.829991+0000","last_peered":"2024-09-21T07:26:34.829991+0000","last_clean":"2024-09-21T07:26:34.829991+0000","last_became_active":"2024-09-21T07:26:33.718633+0000","last_became_peered":"2024-09-21T07:26:33.718633+0000","last_unstale":"2024-09-21T07:26:34.829991+0000","last_undegraded":"2024-09-21T07:26:34.829991+0000","last_fullsized":"2024-09-21T07:26:34.829991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:37.109885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829845+0000","last_change":"2024-09-21T07:26:33.714569+0000","last_active":"2024-09-21T07:26:34.829845+0000","last_peered":"2024-09-21T07:26:34.829845+0000","last_clean":"2024-09-21T07:26:34.829845+0000","last_became_active":"2024-09-21T07:26:33.714245+0000","last_became_peered":"2024-09-21T07:26:33.714245+0000","last_unstale":"2024-09-21T07:26:34.829845+0000","last_undegraded":"2024-09-21T07:26:34.829845+0000","last_fullsized":"2024-09-21T07:26:34.829845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.617192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707622+0000","last_change":"2024-09-21T07:26:33.714237+0000","last_active":"2024-09-21T07:26:34.707622+0000","last_peered":"2024-09-21T07:26:34.707622+0000","last_clean":"2024-09-21T07:26:34.707622+0000","last_became_active":"2024-09-21T07:26:33.713885+0000","last_became_peered":"2024-09-21T07:26:33.713885+0000","last_unstale":"2024-09-21T07:26:34.707622+0000","last_undegraded":"2024-09-21T07:26:34.707622+0000","last_fullsized":"2024-09-21T07:26:34.707622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:41.615956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707273+0000","last_change":"2024-09-21T07:26:33.716014+0000","last_active":"2024-09-21T07:26:34.707273+0000","last_peered":"2024-09-21T07:26:34.707273+0000","last_clean":"2024-09-21T07:26:34.707273+0000","last_became_active":"2024-09-21T07:26:33.715646+0000","last_became_peered":"2024-09-21T07:26:33.715646+0000","last_unstale":"2024-09-21T07:26:34.707273+0000","last_undegraded":"2024-09-21T07:26:34.707273+0000","last_fullsized":"2024-09-21T07:26:34.707273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:54.097384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707232+0000","last_change":"2024-09-21T07:26:33.715793+0000","last_active":"2024-09-21T07:26:34.707232+0000","last_peered":"2024-09-21T07:26:34.707232+0000","last_clean":"2024-09-21T07:26:34.707232+0000","last_became_active":"2024-09-21T07:26:33.715534+0000","last_became_peered":"2024-09-21T07:26:33.715534+0000","last_unstale":"2024-09-21T07:26:34.707232+0000","last_undegraded":"2024-09-21T07:26:34.707232+0000","last_fullsized":"2024-09-21T07:26:34.707232+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:00.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829471+0000","last_change":"2024-09-21T07:26:33.719495+0000","last_active":"2024-09-21T07:26:34.829471+0000","last_peered":"2024-09-21T07:26:34.829471+0000","last_clean":"2024-09-21T07:26:34.829471+0000","last_became_active":"2024-09-21T07:26:33.719197+0000","last_became_peered":"2024-09-21T07:26:33.719197+0000","last_unstale":"2024-09-21T07:26:34.829471+0000","last_undegraded":"2024-09-21T07:26:34.829471+0000","last_fullsized":"2024-09-21T07:26:34.829471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:19.973936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830261+0000","last_change":"2024-09-21T07:26:33.731886+0000","last_active":"2024-09-21T07:26:34.830261+0000","last_peered":"2024-09-21T07:26:34.830261+0000","last_clean":"2024-09-21T07:26:34.830261+0000","last_became_active":"2024-09-21T07:26:33.731590+0000","last_became_peered":"2024-09-21T07:26:33.731590+0000","last_unstale":"2024-09-21T07:26:34.830261+0000","last_undegraded":"2024-09-21T07:26:34.830261+0000","last_fullsized":"2024-09-21T07:26:34.830261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:36.960428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683197+0000","last_change":"2024-09-21T07:26:31.683197+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683197+0000","last_undegraded":"2024-09-21T07:26:31.683197+0000","last_fullsized":"2024-09-21T07:26:31.683197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690512+0000","last_change":"2024-09-21T07:26:31.690512+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690512+0000","last_undegraded":"2024-09-21T07:26:31.690512+0000","last_fullsized":"2024-09-21T07:26:31.690512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691668+0000","last_change":"2024-09-21T07:26:31.691668+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691668+0000","last_undegraded":"2024-09-21T07:26:31.691668+0000","last_fullsized":"2024-09-21T07:26:31.691668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830055+0000","last_change":"2024-09-21T07:26:33.728398+0000","last_active":"2024-09-21T07:26:34.830055+0000","last_peered":"2024-09-21T07:26:34.830055+0000","last_clean":"2024-09-21T07:26:34.830055+0000","last_became_active":"2024-09-21T07:26:33.728110+0000","last_became_peered":"2024-09-21T07:26:33.728110+0000","last_unstale":"2024-09-21T07:26:34.830055+0000","last_undegraded":"2024-09-21T07:26:34.830055+0000","last_fullsized":"2024-09-21T07:26:34.830055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:40.217242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690428+0000","last_change":"2024-09-21T07:26:31.690428+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690428+0000","last_undegraded":"2024-09-21T07:26:31.690428+0000","last_fullsized":"2024-09-21T07:26:31.690428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707548+0000","last_change":"2024-09-21T07:26:32.705538+0000","last_active":"2024-09-21T07:26:34.707548+0000","last_peered":"2024-09-21T07:26:34.707548+0000","last_clean":"2024-09-21T07:26:34.707548+0000","last_became_active":"2024-09-21T07:26:32.705215+0000","last_became_peered":"2024-09-21T07:26:32.705215+0000","last_unstale":"2024-09-21T07:26:34.707548+0000","last_undegraded":"2024-09-21T07:26:34.707548+0000","last_fullsized":"2024-09-21T07:26:34.707548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:36.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707186+0000","last_change":"2024-09-21T07:26:32.706993+0000","last_active":"2024-09-21T07:26:34.707186+0000","last_peered":"2024-09-21T07:26:34.707186+0000","last_clean":"2024-09-21T07:26:34.707186+0000","last_became_active":"2024-09-21T07:26:32.706667+0000","last_became_peered":"2024-09-21T07:26:32.706667+0000","last_unstale":"2024-09-21T07:26:34.707186+0000","last_undegraded":"2024-09-21T07:26:34.707186+0000","last_fullsized":"2024-09-21T07:26:34.707186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:23.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707153+0000","last_change":"2024-09-21T07:26:32.704657+0000","last_active":"2024-09-21T07:26:34.707153+0000","last_peered":"2024-09-21T07:26:34.707153+0000","last_clean":"2024-09-21T07:26:34.707153+0000","last_became_active":"2024-09-21T07:26:32.704359+0000","last_became_peered":"2024-09-21T07:26:32.704359+0000","last_unstale":"2024-09-21T07:26:34.707153+0000","last_undegraded":"2024-09-21T07:26:34.707153+0000","last_fullsized":"2024-09-21T07:26:34.707153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:13.239895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707601+0000","last_change":"2024-09-21T07:26:33.715873+0000","last_active":"2024-09-21T07:26:34.707601+0000","last_peered":"2024-09-21T07:26:34.707601+0000","last_clean":"2024-09-21T07:26:34.707601+0000","last_became_active":"2024-09-21T07:26:33.715561+0000","last_became_peered":"2024-09-21T07:26:33.715561+0000","last_unstale":"2024-09-21T07:26:34.707601+0000","last_undegraded":"2024-09-21T07:26:34.707601+0000","last_fullsized":"2024-09-21T07:26:34.707601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:05.220655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.684636+0000","last_change":"2024-09-21T07:26:31.684636+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.684636+0000","last_undegraded":"2024-09-21T07:26:31.684636+0000","last_fullsized":"2024-09-21T07:26:31.684636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830191+0000","last_change":"2024-09-21T07:26:32.717966+0000","last_active":"2024-09-21T07:26:34.830191+0000","last_peered":"2024-09-21T07:26:34.830191+0000","last_clean":"2024-09-21T07:26:34.830191+0000","last_became_active":"2024-09-21T07:26:32.717578+0000","last_became_peered":"2024-09-21T07:26:32.717578+0000","last_unstale":"2024-09-21T07:26:34.830191+0000","last_undegraded":"2024-09-21T07:26:34.830191+0000","last_fullsized":"2024-09-21T07:26:34.830191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:06.698663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707654+0000","last_change":"2024-09-21T07:26:33.726854+0000","last_active":"2024-09-21T07:26:34.707654+0000","last_peered":"2024-09-21T07:26:34.707654+0000","last_clean":"2024-09-21T07:26:34.707654+0000","last_became_active":"2024-09-21T07:26:33.726465+0000","last_became_peered":"2024-09-21T07:26:33.726465+0000","last_unstale":"2024-09-21T07:26:34.707654+0000","last_undegraded":"2024-09-21T07:26:34.707654+0000","last_fullsized":"2024-09-21T07:26:34.707654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:43.518328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.687024+0000","last_change":"2024-09-21T07:26:31.687024+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.687024+0000","last_undegraded":"2024-09-21T07:26:31.687024+0000","last_fullsized":"2024-09-21T07:26:31.687024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829661+0000","last_change":"2024-09-21T07:26:32.717213+0000","last_active":"2024-09-21T07:26:34.829661+0000","last_peered":"2024-09-21T07:26:34.829661+0000","last_clean":"2024-09-21T07:26:34.829661+0000","last_became_active":"2024-09-21T07:26:32.716200+0000","last_became_peered":"2024-09-21T07:26:32.716200+0000","last_unstale":"2024-09-21T07:26:34.829661+0000","last_undegraded":"2024-09-21T07:26:34.829661+0000","last_fullsized":"2024-09-21T07:26:34.829661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:05.433165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683805+0000","last_change":"2024-09-21T07:26:31.683805+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683805+0000","last_undegraded":"2024-09-21T07:26:31.683805+0000","last_fullsized":"2024-09-21T07:26:31.683805+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829877+0000","last_change":"2024-09-21T07:26:32.713456+0000","last_active":"2024-09-21T07:26:34.829877+0000","last_peered":"2024-09-21T07:26:34.829877+0000","last_clean":"2024-09-21T07:26:34.829877+0000","last_became_active":"2024-09-21T07:26:32.713105+0000","last_became_peered":"2024-09-21T07:26:32.713105+0000","last_unstale":"2024-09-21T07:26:34.829877+0000","last_undegraded":"2024-09-21T07:26:34.829877+0000","last_fullsized":"2024-09-21T07:26:34.829877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.016585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694968+0000","last_change":"2024-09-21T07:26:31.694968+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694968+0000","last_undegraded":"2024-09-21T07:26:31.694968+0000","last_fullsized":"2024-09-21T07:26:31.694968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829769+0000","last_change":"2024-09-21T07:26:32.715629+0000","last_active":"2024-09-21T07:26:34.829769+0000","last_peered":"2024-09-21T07:26:34.829769+0000","last_clean":"2024-09-21T07:26:34.829769+0000","last_became_active":"2024-09-21T07:26:32.714299+0000","last_became_peered":"2024-09-21T07:26:32.714299+0000","last_unstale":"2024-09-21T07:26:34.829769+0000","last_undegraded":"2024-09-21T07:26:34.829769+0000","last_fullsized":"2024-09-21T07:26:34.829769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.440088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.686092+0000","last_change":"2024-09-21T07:26:31.686092+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.686092+0000","last_undegraded":"2024-09-21T07:26:31.686092+0000","last_fullsized":"2024-09-21T07:26:31.686092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830176+0000","last_change":"2024-09-21T07:26:33.732772+0000","last_active":"2024-09-21T07:26:34.830176+0000","last_peered":"2024-09-21T07:26:34.830176+0000","last_clean":"2024-09-21T07:26:34.830176+0000","last_became_active":"2024-09-21T07:26:33.732465+0000","last_became_peered":"2024-09-21T07:26:33.732465+0000","last_unstale":"2024-09-21T07:26:34.830176+0000","last_undegraded":"2024-09-21T07:26:34.830176+0000","last_fullsized":"2024-09-21T07:26:34.830176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:34.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694763+0000","last_change":"2024-09-21T07:26:31.694763+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694763+0000","last_undegraded":"2024-09-21T07:26:31.694763+0000","last_fullsized":"2024-09-21T07:26:31.694763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829825+0000","last_change":"2024-09-21T07:26:32.715720+0000","last_active":"2024-09-21T07:26:34.829825+0000","last_peered":"2024-09-21T07:26:34.829825+0000","last_clean":"2024-09-21T07:26:34.829825+0000","last_became_active":"2024-09-21T07:26:32.715163+0000","last_became_peered":"2024-09-21T07:26:32.715163+0000","last_unstale":"2024-09-21T07:26:34.829825+0000","last_undegraded":"2024-09-21T07:26:34.829825+0000","last_fullsized":"2024-09-21T07:26:34.829825+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:47.679106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829821+0000","last_change":"2024-09-21T07:26:32.717014+0000","last_active":"2024-09-21T07:26:34.829821+0000","last_peered":"2024-09-21T07:26:34.829821+0000","last_clean":"2024-09-21T07:26:34.829821+0000","last_became_active":"2024-09-21T07:26:32.716627+0000","last_became_peered":"2024-09-21T07:26:32.716627+0000","last_unstale":"2024-09-21T07:26:34.829821+0000","last_undegraded":"2024-09-21T07:26:34.829821+0000","last_fullsized":"2024-09-21T07:26:34.829821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:28.633725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707512+0000","last_change":"2024-09-21T07:26:32.707991+0000","last_active":"2024-09-21T07:26:34.707512+0000","last_peered":"2024-09-21T07:26:34.707512+0000","last_clean":"2024-09-21T07:26:34.707512+0000","last_became_active":"2024-09-21T07:26:32.707628+0000","last_became_peered":"2024-09-21T07:26:32.707628+0000","last_unstale":"2024-09-21T07:26:34.707512+0000","last_undegraded":"2024-09-21T07:26:34.707512+0000","last_fullsized":"2024-09-21T07:26:34.707512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:08.739164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690788+0000","last_change":"2024-09-21T07:26:31.690788+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690788+0000","last_undegraded":"2024-09-21T07:26:31.690788+0000","last_fullsized":"2024-09-21T07:26:31.690788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693883+0000","last_change":"2024-09-21T07:26:31.693883+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693883+0000","last_undegraded":"2024-09-21T07:26:31.693883+0000","last_fullsized":"2024-09-21T07:26:31.693883+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690506+0000","last_change":"2024-09-21T07:26:31.690506+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690506+0000","last_undegraded":"2024-09-21T07:26:31.690506+0000","last_fullsized":"2024-09-21T07:26:31.690506+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693819+0000","last_change":"2024-09-21T07:26:31.693819+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693819+0000","last_undegraded":"2024-09-21T07:26:31.693819+0000","last_fullsized":"2024-09-21T07:26:31.693819+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693866+0000","last_change":"2024-09-21T07:26:31.693866+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693866+0000","last_undegraded":"2024-09-21T07:26:31.693866+0000","last_fullsized":"2024-09-21T07:26:31.693866+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691172+0000","last_change":"2024-09-21T07:26:31.691172+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691172+0000","last_undegraded":"2024-09-21T07:26:31.691172+0000","last_fullsized":"2024-09-21T07:26:31.691172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683285+0000","last_change":"2024-09-21T07:26:31.683285+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683285+0000","last_undegraded":"2024-09-21T07:26:31.683285+0000","last_fullsized":"2024-09-21T07:26:31.683285+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830034+0000","last_change":"2024-09-21T07:26:32.714302+0000","last_active":"2024-09-21T07:26:34.830034+0000","last_peered":"2024-09-21T07:26:34.830034+0000","last_clean":"2024-09-21T07:26:34.830034+0000","last_became_active":"2024-09-21T07:26:32.713972+0000","last_became_peered":"2024-09-21T07:26:32.713972+0000","last_unstale":"2024-09-21T07:26:34.830034+0000","last_undegraded":"2024-09-21T07:26:34.830034+0000","last_fullsized":"2024-09-21T07:26:34.830034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707294+0000","last_change":"2024-09-21T07:26:32.711484+0000","last_active":"2024-09-21T07:26:34.707294+0000","last_peered":"2024-09-21T07:26:34.707294+0000","last_clean":"2024-09-21T07:26:34.707294+0000","last_became_active":"2024-09-21T07:26:32.711179+0000","last_became_peered":"2024-09-21T07:26:32.711179+0000","last_unstale":"2024-09-21T07:26:34.707294+0000","last_undegraded":"2024-09-21T07:26:34.707294+0000","last_fullsized":"2024-09-21T07:26:34.707294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:39.578312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707269+0000","last_change":"2024-09-21T07:26:32.703003+0000","last_active":"2024-09-21T07:26:34.707269+0000","last_peered":"2024-09-21T07:26:34.707269+0000","last_clean":"2024-09-21T07:26:34.707269+0000","last_became_active":"2024-09-21T07:26:32.702679+0000","last_became_peered":"2024-09-21T07:26:32.702679+0000","last_unstale":"2024-09-21T07:26:34.707269+0000","last_undegraded":"2024-09-21T07:26:34.707269+0000","last_fullsized":"2024-09-21T07:26:34.707269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:39.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683286+0000","last_change":"2024-09-21T07:26:31.683286+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683286+0000","last_undegraded":"2024-09-21T07:26:31.683286+0000","last_fullsized":"2024-09-21T07:26:31.683286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707087+0000","last_change":"2024-09-21T07:26:32.704855+0000","last_active":"2024-09-21T07:26:34.707087+0000","last_peered":"2024-09-21T07:26:34.707087+0000","last_clean":"2024-09-21T07:26:34.707087+0000","last_became_active":"2024-09-21T07:26:32.704385+0000","last_became_peered":"2024-09-21T07:26:32.704385+0000","last_unstale":"2024-09-21T07:26:34.707087+0000","last_undegraded":"2024-09-21T07:26:34.707087+0000","last_fullsized":"2024-09-21T07:26:34.707087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:06.609096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829436+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:26:34.829436+0000","last_peered":"2024-09-21T07:26:34.829436+0000","last_clean":"2024-09-21T07:26:34.829436+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:26:34.829436+0000","last_undegraded":"2024-09-21T07:26:34.829436+0000","last_fullsized":"2024-09-21T07:26:34.829436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36108,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335732,"statfs":{"total":96636764160,"available":96599789568,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":753664,"data_stored":337063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36096,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1359872,"data_stored":933640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1413120,"data_stored":954934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:26:38.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 -- 172.21.15.64:0/1254163581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 msgr2=0x7f9f50005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 --2- 172.21.15.64:0/1254163581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f50005160 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0735b0 tx=0x7f9f6401d590 comp rx=0 tx=0).stop 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f6a800640 1 -- 172.21.15.64:0/1254163581 reap_dead start 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 -- 172.21.15.64:0/1254163581 shutdown_connections 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 -- 172.21.15.64:0/1254163581 >> 172.21.15.64:0/1254163581 conn(0x7f9f6c0d0de0 msgr2=0x7f9f6c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 -- 172.21.15.64:0/1254163581 shutdown_connections 2024-09-21T07:26:38.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.540+0000 7f9f70a00640 1 -- 172.21.15.64:0/1254163581 wait complete. 2024-09-21T07:26:38.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 Processor -- start 2024-09-21T07:26:38.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 -- start start 2024-09-21T07:26:38.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 0x7f9f6c0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 0x7f9f6c1f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c06ff20 con 0x7f9f50004d50 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c06fda0 con 0x7f9f6c1f7c20 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f70a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c0700a0 con 0x7f9f6c1f7050 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46136/0 (socket says 172.21.15.64:46136) 2024-09-21T07:26:38.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 -- 172.21.15.64:0/419985551 learned_addr learned my addr 172.21.15.64:0/419985551 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:38.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f6a800640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 0x7f9f6c1f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f61400640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 0x7f9f6c0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 -- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 msgr2=0x7f9f6c1f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 0x7f9f6c1f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 -- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 msgr2=0x7f9f6c0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 0x7f9f6c0c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 -- 172.21.15.64:0/419985551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c155ee0 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f6a800640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 0x7f9f6c1f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f61400640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 0x7f9f6c0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f69e00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c011a80 tx=0x7f9f5c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00fe70 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f5c016070 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.544+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0127a0 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c153240 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c1f79a0 con 0x7f9f50004d50 2024-09-21T07:26:38.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6c070630 con 0x7f9f50004d50 2024-09-21T07:26:38.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f5c018030 con 0x7f9f50004d50 2024-09-21T07:26:38.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f62a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f9f5c094df0 con 0x7f9f50004d50 2024-09-21T07:26:38.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.548+0000 7f9f61400640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.552+0000 7f9f61400640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 0x7f9f48075710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c1f4bc0 tx=0x7f9f54001d20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.552+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9f5c05fc70 con 0x7f9f50004d50 2024-09-21T07:26:38.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.728+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f6c0c42b0 con 0x7f9f48073200 2024-09-21T07:26:38.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.732+0000 7f9f62a00640 1 -- 172.21.15.64:0/419985551 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243122 (secure 0 0 0) 0x7f9f6c0c42b0 con 0x7f9f48073200 2024-09-21T07:26:38.740 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:38.742 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:26:38.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 msgr2=0x7f9f48075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 0x7f9f48075710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c1f4bc0 tx=0x7f9f54001d20 comp rx=0 tx=0).stop 2024-09-21T07:26:38.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 msgr2=0x7f9f6c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c011a80 tx=0x7f9f5c011f40 comp rx=0 tx=0).stop 2024-09-21T07:26:38.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 shutdown_connections 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f6c1f7050 0x7f9f6c1f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f6c1f7c20 0x7f9f6c0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 --2- 172.21.15.64:0/419985551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f50004d50 0x7f9f6c152b90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 >> 172.21.15.64:0/419985551 conn(0x7f9f6c0d0de0 msgr2=0x7f9f6c068f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 shutdown_connections 2024-09-21T07:26:38.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.736+0000 7f9f70a00640 1 -- 172.21.15.64:0/419985551 wait complete. 2024-09-21T07:26:38.762 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-21T07:26:37.480496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":294192,"kb_used_data":7220,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680528,"statfs":{"total":773094113280,"available":772792860672,"internally_reserved":0,"allocated":7393280,"data_stored":3962515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":293654067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829883+0000","last_change":"2024-09-21T07:26:33.719818+0000","last_active":"2024-09-21T07:26:34.829883+0000","last_peered":"2024-09-21T07:26:34.829883+0000","last_clean":"2024-09-21T07:26:34.829883+0000","last_became_active":"2024-09-21T07:26:33.719487+0000","last_became_peered":"2024-09-21T07:26:33.719487+0000","last_unstale":"2024-09-21T07:26:34.829883+0000","last_undegraded":"2024-09-21T07:26:34.829883+0000","last_fullsized":"2024-09-21T07:26:34.829883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:40.586013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830201+0000","last_change":"2024-09-21T07:26:33.735244+0000","last_active":"2024-09-21T07:26:34.830201+0000","last_peered":"2024-09-21T07:26:34.830201+0000","last_clean":"2024-09-21T07:26:34.830201+0000","last_became_active":"2024-09-21T07:26:33.734869+0000","last_became_peered":"2024-09-21T07:26:33.734869+0000","last_unstale":"2024-09-21T07:26:34.830201+0000","last_undegraded":"2024-09-21T07:26:34.830201+0000","last_fullsized":"2024-09-21T07:26:34.830201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:56.186491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829783+0000","last_change":"2024-09-21T07:26:33.729856+0000","last_active":"2024-09-21T07:26:34.829783+0000","last_peered":"2024-09-21T07:26:34.829783+0000","last_clean":"2024-09-21T07:26:34.829783+0000","last_became_active":"2024-09-21T07:26:33.728193+0000","last_became_peered":"2024-09-21T07:26:33.728193+0000","last_unstale":"2024-09-21T07:26:34.829783+0000","last_undegraded":"2024-09-21T07:26:34.829783+0000","last_fullsized":"2024-09-21T07:26:34.829783+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:14.296128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829991+0000","last_change":"2024-09-21T07:26:33.727636+0000","last_active":"2024-09-21T07:26:34.829991+0000","last_peered":"2024-09-21T07:26:34.829991+0000","last_clean":"2024-09-21T07:26:34.829991+0000","last_became_active":"2024-09-21T07:26:33.718633+0000","last_became_peered":"2024-09-21T07:26:33.718633+0000","last_unstale":"2024-09-21T07:26:34.829991+0000","last_undegraded":"2024-09-21T07:26:34.829991+0000","last_fullsized":"2024-09-21T07:26:34.829991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:37.109885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829845+0000","last_change":"2024-09-21T07:26:33.714569+0000","last_active":"2024-09-21T07:26:34.829845+0000","last_peered":"2024-09-21T07:26:34.829845+0000","last_clean":"2024-09-21T07:26:34.829845+0000","last_became_active":"2024-09-21T07:26:33.714245+0000","last_became_peered":"2024-09-21T07:26:33.714245+0000","last_unstale":"2024-09-21T07:26:34.829845+0000","last_undegraded":"2024-09-21T07:26:34.829845+0000","last_fullsized":"2024-09-21T07:26:34.829845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.617192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707622+0000","last_change":"2024-09-21T07:26:33.714237+0000","last_active":"2024-09-21T07:26:34.707622+0000","last_peered":"2024-09-21T07:26:34.707622+0000","last_clean":"2024-09-21T07:26:34.707622+0000","last_became_active":"2024-09-21T07:26:33.713885+0000","last_became_peered":"2024-09-21T07:26:33.713885+0000","last_unstale":"2024-09-21T07:26:34.707622+0000","last_undegraded":"2024-09-21T07:26:34.707622+0000","last_fullsized":"2024-09-21T07:26:34.707622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:41.615956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707273+0000","last_change":"2024-09-21T07:26:33.716014+0000","last_active":"2024-09-21T07:26:34.707273+0000","last_peered":"2024-09-21T07:26:34.707273+0000","last_clean":"2024-09-21T07:26:34.707273+0000","last_became_active":"2024-09-21T07:26:33.715646+0000","last_became_peered":"2024-09-21T07:26:33.715646+0000","last_unstale":"2024-09-21T07:26:34.707273+0000","last_undegraded":"2024-09-21T07:26:34.707273+0000","last_fullsized":"2024-09-21T07:26:34.707273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:54.097384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707232+0000","last_change":"2024-09-21T07:26:33.715793+0000","last_active":"2024-09-21T07:26:34.707232+0000","last_peered":"2024-09-21T07:26:34.707232+0000","last_clean":"2024-09-21T07:26:34.707232+0000","last_became_active":"2024-09-21T07:26:33.715534+0000","last_became_peered":"2024-09-21T07:26:33.715534+0000","last_unstale":"2024-09-21T07:26:34.707232+0000","last_undegraded":"2024-09-21T07:26:34.707232+0000","last_fullsized":"2024-09-21T07:26:34.707232+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:00.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829471+0000","last_change":"2024-09-21T07:26:33.719495+0000","last_active":"2024-09-21T07:26:34.829471+0000","last_peered":"2024-09-21T07:26:34.829471+0000","last_clean":"2024-09-21T07:26:34.829471+0000","last_became_active":"2024-09-21T07:26:33.719197+0000","last_became_peered":"2024-09-21T07:26:33.719197+0000","last_unstale":"2024-09-21T07:26:34.829471+0000","last_undegraded":"2024-09-21T07:26:34.829471+0000","last_fullsized":"2024-09-21T07:26:34.829471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:19.973936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830261+0000","last_change":"2024-09-21T07:26:33.731886+0000","last_active":"2024-09-21T07:26:34.830261+0000","last_peered":"2024-09-21T07:26:34.830261+0000","last_clean":"2024-09-21T07:26:34.830261+0000","last_became_active":"2024-09-21T07:26:33.731590+0000","last_became_peered":"2024-09-21T07:26:33.731590+0000","last_unstale":"2024-09-21T07:26:34.830261+0000","last_undegraded":"2024-09-21T07:26:34.830261+0000","last_fullsized":"2024-09-21T07:26:34.830261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:36.960428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683197+0000","last_change":"2024-09-21T07:26:31.683197+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683197+0000","last_undegraded":"2024-09-21T07:26:31.683197+0000","last_fullsized":"2024-09-21T07:26:31.683197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690512+0000","last_change":"2024-09-21T07:26:31.690512+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690512+0000","last_undegraded":"2024-09-21T07:26:31.690512+0000","last_fullsized":"2024-09-21T07:26:31.690512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691668+0000","last_change":"2024-09-21T07:26:31.691668+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691668+0000","last_undegraded":"2024-09-21T07:26:31.691668+0000","last_fullsized":"2024-09-21T07:26:31.691668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830055+0000","last_change":"2024-09-21T07:26:33.728398+0000","last_active":"2024-09-21T07:26:34.830055+0000","last_peered":"2024-09-21T07:26:34.830055+0000","last_clean":"2024-09-21T07:26:34.830055+0000","last_became_active":"2024-09-21T07:26:33.728110+0000","last_became_peered":"2024-09-21T07:26:33.728110+0000","last_unstale":"2024-09-21T07:26:34.830055+0000","last_undegraded":"2024-09-21T07:26:34.830055+0000","last_fullsized":"2024-09-21T07:26:34.830055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:40.217242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690428+0000","last_change":"2024-09-21T07:26:31.690428+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690428+0000","last_undegraded":"2024-09-21T07:26:31.690428+0000","last_fullsized":"2024-09-21T07:26:31.690428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707548+0000","last_change":"2024-09-21T07:26:32.705538+0000","last_active":"2024-09-21T07:26:34.707548+0000","last_peered":"2024-09-21T07:26:34.707548+0000","last_clean":"2024-09-21T07:26:34.707548+0000","last_became_active":"2024-09-21T07:26:32.705215+0000","last_became_peered":"2024-09-21T07:26:32.705215+0000","last_unstale":"2024-09-21T07:26:34.707548+0000","last_undegraded":"2024-09-21T07:26:34.707548+0000","last_fullsized":"2024-09-21T07:26:34.707548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:36.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707186+0000","last_change":"2024-09-21T07:26:32.706993+0000","last_active":"2024-09-21T07:26:34.707186+0000","last_peered":"2024-09-21T07:26:34.707186+0000","last_clean":"2024-09-21T07:26:34.707186+0000","last_became_active":"2024-09-21T07:26:32.706667+0000","last_became_peered":"2024-09-21T07:26:32.706667+0000","last_unstale":"2024-09-21T07:26:34.707186+0000","last_undegraded":"2024-09-21T07:26:34.707186+0000","last_fullsized":"2024-09-21T07:26:34.707186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:23.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707153+0000","last_change":"2024-09-21T07:26:32.704657+0000","last_active":"2024-09-21T07:26:34.707153+0000","last_peered":"2024-09-21T07:26:34.707153+0000","last_clean":"2024-09-21T07:26:34.707153+0000","last_became_active":"2024-09-21T07:26:32.704359+0000","last_became_peered":"2024-09-21T07:26:32.704359+0000","last_unstale":"2024-09-21T07:26:34.707153+0000","last_undegraded":"2024-09-21T07:26:34.707153+0000","last_fullsized":"2024-09-21T07:26:34.707153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:13.239895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707601+0000","last_change":"2024-09-21T07:26:33.715873+0000","last_active":"2024-09-21T07:26:34.707601+0000","last_peered":"2024-09-21T07:26:34.707601+0000","last_clean":"2024-09-21T07:26:34.707601+0000","last_became_active":"2024-09-21T07:26:33.715561+0000","last_became_peered":"2024-09-21T07:26:33.715561+0000","last_unstale":"2024-09-21T07:26:34.707601+0000","last_undegraded":"2024-09-21T07:26:34.707601+0000","last_fullsized":"2024-09-21T07:26:34.707601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:05.220655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.684636+0000","last_change":"2024-09-21T07:26:31.684636+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.684636+0000","last_undegraded":"2024-09-21T07:26:31.684636+0000","last_fullsized":"2024-09-21T07:26:31.684636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830191+0000","last_change":"2024-09-21T07:26:32.717966+0000","last_active":"2024-09-21T07:26:34.830191+0000","last_peered":"2024-09-21T07:26:34.830191+0000","last_clean":"2024-09-21T07:26:34.830191+0000","last_became_active":"2024-09-21T07:26:32.717578+0000","last_became_peered":"2024-09-21T07:26:32.717578+0000","last_unstale":"2024-09-21T07:26:34.830191+0000","last_undegraded":"2024-09-21T07:26:34.830191+0000","last_fullsized":"2024-09-21T07:26:34.830191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:06.698663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707654+0000","last_change":"2024-09-21T07:26:33.726854+0000","last_active":"2024-09-21T07:26:34.707654+0000","last_peered":"2024-09-21T07:26:34.707654+0000","last_clean":"2024-09-21T07:26:34.707654+0000","last_became_active":"2024-09-21T07:26:33.726465+0000","last_became_peered":"2024-09-21T07:26:33.726465+0000","last_unstale":"2024-09-21T07:26:34.707654+0000","last_undegraded":"2024-09-21T07:26:34.707654+0000","last_fullsized":"2024-09-21T07:26:34.707654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:43.518328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.687024+0000","last_change":"2024-09-21T07:26:31.687024+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.687024+0000","last_undegraded":"2024-09-21T07:26:31.687024+0000","last_fullsized":"2024-09-21T07:26:31.687024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829661+0000","last_change":"2024-09-21T07:26:32.717213+0000","last_active":"2024-09-21T07:26:34.829661+0000","last_peered":"2024-09-21T07:26:34.829661+0000","last_clean":"2024-09-21T07:26:34.829661+0000","last_became_active":"2024-09-21T07:26:32.716200+0000","last_became_peered":"2024-09-21T07:26:32.716200+0000","last_unstale":"2024-09-21T07:26:34.829661+0000","last_undegraded":"2024-09-21T07:26:34.829661+0000","last_fullsized":"2024-09-21T07:26:34.829661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:05.433165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683805+0000","last_change":"2024-09-21T07:26:31.683805+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683805+0000","last_undegraded":"2024-09-21T07:26:31.683805+0000","last_fullsized":"2024-09-21T07:26:31.683805+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829877+0000","last_change":"2024-09-21T07:26:32.713456+0000","last_active":"2024-09-21T07:26:34.829877+0000","last_peered":"2024-09-21T07:26:34.829877+0000","last_clean":"2024-09-21T07:26:34.829877+0000","last_became_active":"2024-09-21T07:26:32.713105+0000","last_became_peered":"2024-09-21T07:26:32.713105+0000","last_unstale":"2024-09-21T07:26:34.829877+0000","last_undegraded":"2024-09-21T07:26:34.829877+0000","last_fullsized":"2024-09-21T07:26:34.829877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.016585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694968+0000","last_change":"2024-09-21T07:26:31.694968+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694968+0000","last_undegraded":"2024-09-21T07:26:31.694968+0000","last_fullsized":"2024-09-21T07:26:31.694968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829769+0000","last_change":"2024-09-21T07:26:32.715629+0000","last_active":"2024-09-21T07:26:34.829769+0000","last_peered":"2024-09-21T07:26:34.829769+0000","last_clean":"2024-09-21T07:26:34.829769+0000","last_became_active":"2024-09-21T07:26:32.714299+0000","last_became_peered":"2024-09-21T07:26:32.714299+0000","last_unstale":"2024-09-21T07:26:34.829769+0000","last_undegraded":"2024-09-21T07:26:34.829769+0000","last_fullsized":"2024-09-21T07:26:34.829769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.440088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.686092+0000","last_change":"2024-09-21T07:26:31.686092+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.686092+0000","last_undegraded":"2024-09-21T07:26:31.686092+0000","last_fullsized":"2024-09-21T07:26:31.686092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830176+0000","last_change":"2024-09-21T07:26:33.732772+0000","last_active":"2024-09-21T07:26:34.830176+0000","last_peered":"2024-09-21T07:26:34.830176+0000","last_clean":"2024-09-21T07:26:34.830176+0000","last_became_active":"2024-09-21T07:26:33.732465+0000","last_became_peered":"2024-09-21T07:26:33.732465+0000","last_unstale":"2024-09-21T07:26:34.830176+0000","last_undegraded":"2024-09-21T07:26:34.830176+0000","last_fullsized":"2024-09-21T07:26:34.830176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:34.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.694763+0000","last_change":"2024-09-21T07:26:31.694763+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.694763+0000","last_undegraded":"2024-09-21T07:26:31.694763+0000","last_fullsized":"2024-09-21T07:26:31.694763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829825+0000","last_change":"2024-09-21T07:26:32.715720+0000","last_active":"2024-09-21T07:26:34.829825+0000","last_peered":"2024-09-21T07:26:34.829825+0000","last_clean":"2024-09-21T07:26:34.829825+0000","last_became_active":"2024-09-21T07:26:32.715163+0000","last_became_peered":"2024-09-21T07:26:32.715163+0000","last_unstale":"2024-09-21T07:26:34.829825+0000","last_undegraded":"2024-09-21T07:26:34.829825+0000","last_fullsized":"2024-09-21T07:26:34.829825+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:47.679106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829821+0000","last_change":"2024-09-21T07:26:32.717014+0000","last_active":"2024-09-21T07:26:34.829821+0000","last_peered":"2024-09-21T07:26:34.829821+0000","last_clean":"2024-09-21T07:26:34.829821+0000","last_became_active":"2024-09-21T07:26:32.716627+0000","last_became_peered":"2024-09-21T07:26:32.716627+0000","last_unstale":"2024-09-21T07:26:34.829821+0000","last_undegraded":"2024-09-21T07:26:34.829821+0000","last_fullsized":"2024-09-21T07:26:34.829821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:28.633725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707512+0000","last_change":"2024-09-21T07:26:32.707991+0000","last_active":"2024-09-21T07:26:34.707512+0000","last_peered":"2024-09-21T07:26:34.707512+0000","last_clean":"2024-09-21T07:26:34.707512+0000","last_became_active":"2024-09-21T07:26:32.707628+0000","last_became_peered":"2024-09-21T07:26:32.707628+0000","last_unstale":"2024-09-21T07:26:34.707512+0000","last_undegraded":"2024-09-21T07:26:34.707512+0000","last_fullsized":"2024-09-21T07:26:34.707512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:08.739164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690788+0000","last_change":"2024-09-21T07:26:31.690788+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690788+0000","last_undegraded":"2024-09-21T07:26:31.690788+0000","last_fullsized":"2024-09-21T07:26:31.690788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693883+0000","last_change":"2024-09-21T07:26:31.693883+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693883+0000","last_undegraded":"2024-09-21T07:26:31.693883+0000","last_fullsized":"2024-09-21T07:26:31.693883+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.690506+0000","last_change":"2024-09-21T07:26:31.690506+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.690506+0000","last_undegraded":"2024-09-21T07:26:31.690506+0000","last_fullsized":"2024-09-21T07:26:31.690506+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693819+0000","last_change":"2024-09-21T07:26:31.693819+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693819+0000","last_undegraded":"2024-09-21T07:26:31.693819+0000","last_fullsized":"2024-09-21T07:26:31.693819+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.693866+0000","last_change":"2024-09-21T07:26:31.693866+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.693866+0000","last_undegraded":"2024-09-21T07:26:31.693866+0000","last_fullsized":"2024-09-21T07:26:31.693866+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.691172+0000","last_change":"2024-09-21T07:26:31.691172+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.691172+0000","last_undegraded":"2024-09-21T07:26:31.691172+0000","last_fullsized":"2024-09-21T07:26:31.691172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683285+0000","last_change":"2024-09-21T07:26:31.683285+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683285+0000","last_undegraded":"2024-09-21T07:26:31.683285+0000","last_fullsized":"2024-09-21T07:26:31.683285+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830034+0000","last_change":"2024-09-21T07:26:32.714302+0000","last_active":"2024-09-21T07:26:34.830034+0000","last_peered":"2024-09-21T07:26:34.830034+0000","last_clean":"2024-09-21T07:26:34.830034+0000","last_became_active":"2024-09-21T07:26:32.713972+0000","last_became_peered":"2024-09-21T07:26:32.713972+0000","last_unstale":"2024-09-21T07:26:34.830034+0000","last_undegraded":"2024-09-21T07:26:34.830034+0000","last_fullsized":"2024-09-21T07:26:34.830034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707294+0000","last_change":"2024-09-21T07:26:32.711484+0000","last_active":"2024-09-21T07:26:34.707294+0000","last_peered":"2024-09-21T07:26:34.707294+0000","last_clean":"2024-09-21T07:26:34.707294+0000","last_became_active":"2024-09-21T07:26:32.711179+0000","last_became_peered":"2024-09-21T07:26:32.711179+0000","last_unstale":"2024-09-21T07:26:34.707294+0000","last_undegraded":"2024-09-21T07:26:34.707294+0000","last_fullsized":"2024-09-21T07:26:34.707294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:39.578312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707269+0000","last_change":"2024-09-21T07:26:32.703003+0000","last_active":"2024-09-21T07:26:34.707269+0000","last_peered":"2024-09-21T07:26:34.707269+0000","last_clean":"2024-09-21T07:26:34.707269+0000","last_became_active":"2024-09-21T07:26:32.702679+0000","last_became_peered":"2024-09-21T07:26:32.702679+0000","last_unstale":"2024-09-21T07:26:34.707269+0000","last_undegraded":"2024-09-21T07:26:34.707269+0000","last_fullsized":"2024-09-21T07:26:34.707269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:39.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-09-21T07:26:31.683286+0000","last_change":"2024-09-21T07:26:31.683286+0000","last_active":"2024-09-21T07:26:31.672953+0000","last_peered":"2024-09-21T07:26:31.672953+0000","last_clean":"2024-09-21T07:26:31.672953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:31.683286+0000","last_undegraded":"2024-09-21T07:26:31.683286+0000","last_fullsized":"2024-09-21T07:26:31.683286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:26:32.680654+0000","last_change":"2024-09-21T07:26:32.680654+0000","last_active":"2024-09-21T07:26:32.680654+0000","last_peered":"2024-09-21T07:26:32.680654+0000","last_clean":"2024-09-21T07:26:32.680654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:26:32.680654+0000","last_undegraded":"2024-09-21T07:26:32.680654+0000","last_fullsized":"2024-09-21T07:26:32.680654+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707087+0000","last_change":"2024-09-21T07:26:32.704855+0000","last_active":"2024-09-21T07:26:34.707087+0000","last_peered":"2024-09-21T07:26:34.707087+0000","last_clean":"2024-09-21T07:26:34.707087+0000","last_became_active":"2024-09-21T07:26:32.704385+0000","last_became_peered":"2024-09-21T07:26:32.704385+0000","last_unstale":"2024-09-21T07:26:34.707087+0000","last_undegraded":"2024-09-21T07:26:34.707087+0000","last_fullsized":"2024-09-21T07:26:34.707087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:06.609096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829436+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:26:34.829436+0000","last_peered":"2024-09-21T07:26:34.829436+0000","last_clean":"2024-09-21T07:26:34.829436+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:26:34.829436+0000","last_undegraded":"2024-09-21T07:26:34.829436+0000","last_fullsized":"2024-09-21T07:26:34.829436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36108,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335732,"statfs":{"total":96636764160,"available":96599789568,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":753664,"data_stored":337063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36096,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":765952,"data_stored":343272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1359872,"data_stored":933640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1413120,"data_stored":954934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:26:38.765 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-09-21T07:26:38.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3a is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-21T07:26:38.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-09-21T07:26:38.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-09-21T07:26:38.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 10.20 is not active+clean 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.769 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.683197+0000', 'last_change': '2024-09-21T07:26:31.683197+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.683197+0000', 'last_undegraded': '2024-09-21T07:26:31.683197+0000', 'last_fullsized': '2024-09-21T07:26:31.683197+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.690512+0000', 'last_change': '2024-09-21T07:26:31.690512+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.690512+0000', 'last_undegraded': '2024-09-21T07:26:31.690512+0000', 'last_fullsized': '2024-09-21T07:26:31.690512+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.770 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.691668+0000', 'last_change': '2024-09-21T07:26:31.691668+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.691668+0000', 'last_undegraded': '2024-09-21T07:26:31.691668+0000', 'last_fullsized': '2024-09-21T07:26:31.691668+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.690428+0000', 'last_change': '2024-09-21T07:26:31.690428+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.690428+0000', 'last_undegraded': '2024-09-21T07:26:31.690428+0000', 'last_fullsized': '2024-09-21T07:26:31.690428+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-21T07:26:38.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.684636+0000', 'last_change': '2024-09-21T07:26:31.684636+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.684636+0000', 'last_undegraded': '2024-09-21T07:26:31.684636+0000', 'last_fullsized': '2024-09-21T07:26:31.684636+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.687024+0000', 'last_change': '2024-09-21T07:26:31.687024+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.687024+0000', 'last_undegraded': '2024-09-21T07:26:31.687024+0000', 'last_fullsized': '2024-09-21T07:26:31.687024+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.683805+0000', 'last_change': '2024-09-21T07:26:31.683805+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.683805+0000', 'last_undegraded': '2024-09-21T07:26:31.683805+0000', 'last_fullsized': '2024-09-21T07:26:31.683805+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:26:38.772 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.694968+0000', 'last_change': '2024-09-21T07:26:31.694968+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.694968+0000', 'last_undegraded': '2024-09-21T07:26:31.694968+0000', 'last_fullsized': '2024-09-21T07:26:31.694968+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.773 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.686092+0000', 'last_change': '2024-09-21T07:26:31.686092+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.686092+0000', 'last_undegraded': '2024-09-21T07:26:31.686092+0000', 'last_fullsized': '2024-09-21T07:26:31.686092+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.694763+0000', 'last_change': '2024-09-21T07:26:31.694763+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.694763+0000', 'last_undegraded': '2024-09-21T07:26:31.694763+0000', 'last_fullsized': '2024-09-21T07:26:31.694763+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-09-21T07:26:38.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.690788+0000', 'last_change': '2024-09-21T07:26:31.690788+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.690788+0000', 'last_undegraded': '2024-09-21T07:26:31.690788+0000', 'last_fullsized': '2024-09-21T07:26:31.690788+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.693883+0000', 'last_change': '2024-09-21T07:26:31.693883+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.693883+0000', 'last_undegraded': '2024-09-21T07:26:31.693883+0000', 'last_fullsized': '2024-09-21T07:26:31.693883+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-21T07:26:38.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.690506+0000', 'last_change': '2024-09-21T07:26:31.690506+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.690506+0000', 'last_undegraded': '2024-09-21T07:26:31.690506+0000', 'last_fullsized': '2024-09-21T07:26:31.690506+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.693819+0000', 'last_change': '2024-09-21T07:26:31.693819+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.693819+0000', 'last_undegraded': '2024-09-21T07:26:31.693819+0000', 'last_fullsized': '2024-09-21T07:26:31.693819+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.693866+0000', 'last_change': '2024-09-21T07:26:31.693866+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.693866+0000', 'last_undegraded': '2024-09-21T07:26:31.693866+0000', 'last_fullsized': '2024-09-21T07:26:31.693866+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.776 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.691172+0000', 'last_change': '2024-09-21T07:26:31.691172+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.691172+0000', 'last_undegraded': '2024-09-21T07:26:31.691172+0000', 'last_fullsized': '2024-09-21T07:26:31.691172+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.683285+0000', 'last_change': '2024-09-21T07:26:31.683285+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.683285+0000', 'last_undegraded': '2024-09-21T07:26:31.683285+0000', 'last_fullsized': '2024-09-21T07:26:31.683285+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-21T07:26:38.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:26:31.683286+0000', 'last_change': '2024-09-21T07:26:31.683286+0000', 'last_active': '2024-09-21T07:26:31.672953+0000', 'last_peered': '2024-09-21T07:26:31.672953+0000', 'last_clean': '2024-09-21T07:26:31.672953+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:31.683286+0000', 'last_undegraded': '2024-09-21T07:26:31.683286+0000', 'last_fullsized': '2024-09-21T07:26:31.683286+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:31.672953+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-21T07:26:38.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:26:32.680654+0000', 'last_change': '2024-09-21T07:26:32.680654+0000', 'last_active': '2024-09-21T07:26:32.680654+0000', 'last_peered': '2024-09-21T07:26:32.680654+0000', 'last_clean': '2024-09-21T07:26:32.680654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:26:32.680654+0000', 'last_undegraded': '2024-09-21T07:26:32.680654+0000', 'last_fullsized': '2024-09-21T07:26:32.680654+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'last_clean_scrub_stamp': '2024-09-21T07:26:32.680654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:26:38.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- 172.21.15.64:0/2722167452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e415edb0 msgr2=0x7f00e40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 --2- 172.21.15.64:0/2722167452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e415edb0 0x7f00e40700b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00e40728d0 tx=0x7f00d401c860 comp rx=0 tx=0).stop 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- 172.21.15.64:0/2722167452 shutdown_connections 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 --2- 172.21.15.64:0/2722167452 >> v2:172.21.15.90:3300/0 conn(0x7f00e40b4700 0x7f00e4072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 --2- 172.21.15.64:0/2722167452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 0x7f00e40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 --2- 172.21.15.64:0/2722167452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e415edb0 0x7f00e40700b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- 172.21.15.64:0/2722167452 >> 172.21.15.64:0/2722167452 conn(0x7f00e40ccbe0 msgr2=0x7f00e40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- 172.21.15.64:0/2722167452 shutdown_connections 2024-09-21T07:26:38.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- 172.21.15.64:0/2722167452 wait complete. 2024-09-21T07:26:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 Processor -- start 2024-09-21T07:26:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.956+0000 7f00e9600640 1 -- start start 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 0x7f00e4156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 0x7f00e409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f00e40b2380 con 0x7f00e40b4700 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00e40b2200 con 0x7f00e415edb0 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f00e40b2500 con 0x7f00e40709b0 2024-09-21T07:26:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46150/0 (socket says 172.21.15.64:46150) 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 -- 172.21.15.64:0/2943076275 learned_addr learned my addr 172.21.15.64:0/2943076275 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e3400640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 0x7f00e409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e2a00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 0x7f00e4156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 -- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 msgr2=0x7f00e4156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 0x7f00e4156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 -- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 msgr2=0x7f00e409b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 0x7f00e409b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 -- 172.21.15.64:0/2943076275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e409c530 con 0x7f00e40b4700 2024-09-21T07:26:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e3400640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 0x7f00e409b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00dbe00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00b410 tx=0x7f00cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc015020 con 0x7f00e40b4700 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00cc011920 con 0x7f00e40b4700 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e409c810 con 0x7f00e40b4700 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc011d70 con 0x7f00e40b4700 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e409aa90 con 0x7f00e40b4700 2024-09-21T07:26:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.960+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e4072e20 con 0x7f00e40b4700 2024-09-21T07:26:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.964+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f00cc018020 con 0x7f00e40b4700 2024-09-21T07:26:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.964+0000 7f00daa00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 0x7f00c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.964+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f00cc094320 con 0x7f00e40b4700 2024-09-21T07:26:38.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.964+0000 7f00e2a00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 0x7f00c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:38.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.964+0000 7f00e2a00640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 0x7f00c0075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f00d40af000 tx=0x7f00d401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:38.968+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f00cc01f020 con 0x7f00e40b4700 2024-09-21T07:26:39.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:39.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:39.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.208+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f00e409c280 con 0x7f00e40b4700 2024-09-21T07:26:39.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.208+0000 7f00daa00640 1 -- 172.21.15.64:0/2943076275 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1216 (secure 0 0 0) 0x7f00cc05f110 con 0x7f00e40b4700 2024-09-21T07:26:39.216 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:39.216 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":257,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":50},{"state_name":"active+clean","count":29},{"state_name":"creating+peering","count":18}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590562,"bytes_used":301252608,"bytes_avail":772792860672,"bytes_total":773094113280,"unknown_pgs_ratio":0.51546388864517212,"inactive_pgs_ratio":0.18556700646877289,"write_bytes_sec":1589,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":36,"btime":"2024-09-21T07:26:36:726462+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6300}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-21T07:25:29.461075+0000","services":{}},"progress_events":{}} 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 msgr2=0x7f00c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 0x7f00c0075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f00d40af000 tx=0x7f00d401b100 comp rx=0 tx=0).stop 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 msgr2=0x7f00e4155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00b410 tx=0x7f00cc00b8d0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 shutdown_connections 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00c0073200 0x7f00c0075710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e415edb0 0x7f00e409b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e40b4700 0x7f00e4155940 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 --2- 172.21.15.64:0/2943076275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e40709b0 0x7f00e4156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 >> 172.21.15.64:0/2943076275 conn(0x7f00e40ccbe0 msgr2=0x7f00e415e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:39.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 shutdown_connections 2024-09-21T07:26:39.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.212+0000 7f00e9600640 1 -- 172.21.15.64:0/2943076275 wait complete. 2024-09-21T07:26:39.239 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:26:39.239 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:26:39.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 -- 172.21.15.64:0/3426919092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800709b0 msgr2=0x7f49800b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 --2- 172.21.15.64:0/3426919092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800709b0 0x7f49800b41c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4968009900 tx=0x7f496801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 -- 172.21.15.64:0/3426919092 shutdown_connections 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 --2- 172.21.15.64:0/3426919092 >> v2:172.21.15.90:3300/0 conn(0x7f49800b4700 0x7f4980072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 --2- 172.21.15.64:0/3426919092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800709b0 0x7f49800b41c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 -- 172.21.15.64:0/3426919092 >> 172.21.15.64:0/3426919092 conn(0x7f49800ccbe0 msgr2=0x7f49800ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 -- 172.21.15.64:0/3426919092 shutdown_connections 2024-09-21T07:26:39.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.452+0000 7f4987000640 1 -- 172.21.15.64:0/3426919092 wait complete. 2024-09-21T07:26:39.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 Processor -- start 2024-09-21T07:26:39.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 -- start start 2024-09-21T07:26:39.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49800709b0 0x7f49801f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800b4700 0x7f49801f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4980168c00 con 0x7f498015edb0 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4980168a80 con 0x7f49800709b0 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4980168d80 con 0x7f49800b4700 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46152/0 (socket says 172.21.15.64:46152) 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 -- 172.21.15.64:0/768226766 learned_addr learned my addr 172.21.15.64:0/768226766 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4977e00640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800b4700 0x7f49801f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f497fe00640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49800709b0 0x7f49801f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 -- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800b4700 msgr2=0x7f49801f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800b4700 0x7f49801f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 -- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49800709b0 msgr2=0x7f49801f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49800709b0 0x7f49801f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 -- 172.21.15.64:0/768226766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801f9eb0 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4985000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f497800ea80 tx=0x7f497800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497800ce40 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49801fcfc0 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4978004b30 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.456+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978005020 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49801f9170 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49800b41c0 con 0x7f498015edb0 2024-09-21T07:26:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f49780051c0 con 0x7f498015edb0 2024-09-21T07:26:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f497cc00640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 0x7f495c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f4978094fe0 con 0x7f498015edb0 2024-09-21T07:26:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.460+0000 7f497fe00640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 0x7f495c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.464+0000 7f497fe00640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 0x7f495c075740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4970007fd0 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:39.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.464+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f497805f700 con 0x7f498015edb0 2024-09-21T07:26:39.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.640+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f498009da20 con 0x7f495c073230 2024-09-21T07:26:39.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.644+0000 7f497cc00640 1 -- 172.21.15.64:0/768226766 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252009 (secure 0 0 0) 0x7f498009da20 con 0x7f495c073230 2024-09-21T07:26:39.653 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:39.654 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:26:39.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 msgr2=0x7f495c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 0x7f495c075740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4970007fd0 tx=0x7f4970009040 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 msgr2=0x7f49801547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f497800ea80 tx=0x7f497800ef40 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 shutdown_connections 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f495c073230 0x7f495c075740 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f498015edb0 0x7f49801547c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49800b4700 0x7f49801f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 --2- 172.21.15.64:0/768226766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49800709b0 0x7f49801f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 >> 172.21.15.64:0/768226766 conn(0x7f49800ccbe0 msgr2=0x7f49800ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 shutdown_connections 2024-09-21T07:26:39.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:39.648+0000 7f4987000640 1 -- 172.21.15.64:0/768226766 wait complete. 2024-09-21T07:26:39.675 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-21T07:26:39.481097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294476,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680244,"statfs":{"total":773094113280,"available":772792569856,"internally_reserved":0,"allocated":7675904,"data_stored":4095876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":293654067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.792062"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300993+0000","last_change":"2024-09-21T07:26:33.733709+0000","last_active":"2024-09-21T07:26:35.300993+0000","last_peered":"2024-09-21T07:26:35.300993+0000","last_clean":"2024-09-21T07:26:35.300993+0000","last_became_active":"2024-09-21T07:26:33.733351+0000","last_became_peered":"2024-09-21T07:26:33.733351+0000","last_unstale":"2024-09-21T07:26:35.300993+0000","last_undegraded":"2024-09-21T07:26:35.300993+0000","last_fullsized":"2024-09-21T07:26:35.300993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:24.882255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300763+0000","last_change":"2024-09-21T07:26:33.706258+0000","last_active":"2024-09-21T07:26:35.300763+0000","last_peered":"2024-09-21T07:26:35.300763+0000","last_clean":"2024-09-21T07:26:35.300763+0000","last_became_active":"2024-09-21T07:26:33.705905+0000","last_became_peered":"2024-09-21T07:26:33.705905+0000","last_unstale":"2024-09-21T07:26:35.300763+0000","last_undegraded":"2024-09-21T07:26:35.300763+0000","last_fullsized":"2024-09-21T07:26:35.300763+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.282369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829883+0000","last_change":"2024-09-21T07:26:33.719818+0000","last_active":"2024-09-21T07:26:34.829883+0000","last_peered":"2024-09-21T07:26:34.829883+0000","last_clean":"2024-09-21T07:26:34.829883+0000","last_became_active":"2024-09-21T07:26:33.719487+0000","last_became_peered":"2024-09-21T07:26:33.719487+0000","last_unstale":"2024-09-21T07:26:34.829883+0000","last_undegraded":"2024-09-21T07:26:34.829883+0000","last_fullsized":"2024-09-21T07:26:34.829883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:40.586013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706126+0000","last_change":"2024-09-21T07:26:33.721286+0000","last_active":"2024-09-21T07:26:34.706126+0000","last_peered":"2024-09-21T07:26:34.706126+0000","last_clean":"2024-09-21T07:26:34.706126+0000","last_became_active":"2024-09-21T07:26:33.719160+0000","last_became_peered":"2024-09-21T07:26:33.719160+0000","last_unstale":"2024-09-21T07:26:34.706126+0000","last_undegraded":"2024-09-21T07:26:34.706126+0000","last_fullsized":"2024-09-21T07:26:34.706126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:24.345926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300030+0000","last_change":"2024-09-21T07:26:33.719273+0000","last_active":"2024-09-21T07:26:35.300030+0000","last_peered":"2024-09-21T07:26:35.300030+0000","last_clean":"2024-09-21T07:26:35.300030+0000","last_became_active":"2024-09-21T07:26:33.718961+0000","last_became_peered":"2024-09-21T07:26:33.718961+0000","last_unstale":"2024-09-21T07:26:35.300030+0000","last_undegraded":"2024-09-21T07:26:35.300030+0000","last_fullsized":"2024-09-21T07:26:35.300030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.707093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299687+0000","last_change":"2024-09-21T07:26:33.720121+0000","last_active":"2024-09-21T07:26:35.299687+0000","last_peered":"2024-09-21T07:26:35.299687+0000","last_clean":"2024-09-21T07:26:35.299687+0000","last_became_active":"2024-09-21T07:26:33.719688+0000","last_became_peered":"2024-09-21T07:26:33.719688+0000","last_unstale":"2024-09-21T07:26:35.299687+0000","last_undegraded":"2024-09-21T07:26:35.299687+0000","last_fullsized":"2024-09-21T07:26:35.299687+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.375975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705213+0000","last_change":"2024-09-21T07:26:33.718761+0000","last_active":"2024-09-21T07:26:34.705213+0000","last_peered":"2024-09-21T07:26:34.705213+0000","last_clean":"2024-09-21T07:26:34.705213+0000","last_became_active":"2024-09-21T07:26:33.718464+0000","last_became_peered":"2024-09-21T07:26:33.718464+0000","last_unstale":"2024-09-21T07:26:34.705213+0000","last_undegraded":"2024-09-21T07:26:34.705213+0000","last_fullsized":"2024-09-21T07:26:34.705213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:25.496538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718562+0000","last_change":"2024-09-21T07:26:33.721359+0000","last_active":"2024-09-21T07:26:34.718562+0000","last_peered":"2024-09-21T07:26:34.718562+0000","last_clean":"2024-09-21T07:26:34.718562+0000","last_became_active":"2024-09-21T07:26:33.721046+0000","last_became_peered":"2024-09-21T07:26:33.721046+0000","last_unstale":"2024-09-21T07:26:34.718562+0000","last_undegraded":"2024-09-21T07:26:34.718562+0000","last_fullsized":"2024-09-21T07:26:34.718562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:14.099237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830201+0000","last_change":"2024-09-21T07:26:33.735244+0000","last_active":"2024-09-21T07:26:34.830201+0000","last_peered":"2024-09-21T07:26:34.830201+0000","last_clean":"2024-09-21T07:26:34.830201+0000","last_became_active":"2024-09-21T07:26:33.734869+0000","last_became_peered":"2024-09-21T07:26:33.734869+0000","last_unstale":"2024-09-21T07:26:34.830201+0000","last_undegraded":"2024-09-21T07:26:34.830201+0000","last_fullsized":"2024-09-21T07:26:34.830201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:56.186491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829783+0000","last_change":"2024-09-21T07:26:33.729856+0000","last_active":"2024-09-21T07:26:34.829783+0000","last_peered":"2024-09-21T07:26:34.829783+0000","last_clean":"2024-09-21T07:26:34.829783+0000","last_became_active":"2024-09-21T07:26:33.728193+0000","last_became_peered":"2024-09-21T07:26:33.728193+0000","last_unstale":"2024-09-21T07:26:34.829783+0000","last_undegraded":"2024-09-21T07:26:34.829783+0000","last_fullsized":"2024-09-21T07:26:34.829783+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:14.296128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706150+0000","last_change":"2024-09-21T07:26:33.711125+0000","last_active":"2024-09-21T07:26:34.706150+0000","last_peered":"2024-09-21T07:26:34.706150+0000","last_clean":"2024-09-21T07:26:34.706150+0000","last_became_active":"2024-09-21T07:26:33.710817+0000","last_became_peered":"2024-09-21T07:26:33.710817+0000","last_unstale":"2024-09-21T07:26:34.706150+0000","last_undegraded":"2024-09-21T07:26:34.706150+0000","last_fullsized":"2024-09-21T07:26:34.706150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:07.077043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718565+0000","last_change":"2024-09-21T07:26:33.724781+0000","last_active":"2024-09-21T07:26:34.718565+0000","last_peered":"2024-09-21T07:26:34.718565+0000","last_clean":"2024-09-21T07:26:34.718565+0000","last_became_active":"2024-09-21T07:26:33.723984+0000","last_became_peered":"2024-09-21T07:26:33.723984+0000","last_unstale":"2024-09-21T07:26:34.718565+0000","last_undegraded":"2024-09-21T07:26:34.718565+0000","last_fullsized":"2024-09-21T07:26:34.718565+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:46.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718757+0000","last_change":"2024-09-21T07:26:33.725501+0000","last_active":"2024-09-21T07:26:34.718757+0000","last_peered":"2024-09-21T07:26:34.718757+0000","last_clean":"2024-09-21T07:26:34.718757+0000","last_became_active":"2024-09-21T07:26:33.725190+0000","last_became_peered":"2024-09-21T07:26:33.725190+0000","last_unstale":"2024-09-21T07:26:34.718757+0000","last_undegraded":"2024-09-21T07:26:34.718757+0000","last_fullsized":"2024-09-21T07:26:34.718757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829991+0000","last_change":"2024-09-21T07:26:33.727636+0000","last_active":"2024-09-21T07:26:34.829991+0000","last_peered":"2024-09-21T07:26:34.829991+0000","last_clean":"2024-09-21T07:26:34.829991+0000","last_became_active":"2024-09-21T07:26:33.718633+0000","last_became_peered":"2024-09-21T07:26:33.718633+0000","last_unstale":"2024-09-21T07:26:34.829991+0000","last_undegraded":"2024-09-21T07:26:34.829991+0000","last_fullsized":"2024-09-21T07:26:34.829991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:37.109885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829845+0000","last_change":"2024-09-21T07:26:33.714569+0000","last_active":"2024-09-21T07:26:34.829845+0000","last_peered":"2024-09-21T07:26:34.829845+0000","last_clean":"2024-09-21T07:26:34.829845+0000","last_became_active":"2024-09-21T07:26:33.714245+0000","last_became_peered":"2024-09-21T07:26:33.714245+0000","last_unstale":"2024-09-21T07:26:34.829845+0000","last_undegraded":"2024-09-21T07:26:34.829845+0000","last_fullsized":"2024-09-21T07:26:34.829845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.617192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705296+0000","last_change":"2024-09-21T07:26:33.720070+0000","last_active":"2024-09-21T07:26:34.705296+0000","last_peered":"2024-09-21T07:26:34.705296+0000","last_clean":"2024-09-21T07:26:34.705296+0000","last_became_active":"2024-09-21T07:26:33.719721+0000","last_became_peered":"2024-09-21T07:26:33.719721+0000","last_unstale":"2024-09-21T07:26:34.705296+0000","last_undegraded":"2024-09-21T07:26:34.705296+0000","last_fullsized":"2024-09-21T07:26:34.705296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.461750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.301041+0000","last_change":"2024-09-21T07:26:33.719017+0000","last_active":"2024-09-21T07:26:35.301041+0000","last_peered":"2024-09-21T07:26:35.301041+0000","last_clean":"2024-09-21T07:26:35.301041+0000","last_became_active":"2024-09-21T07:26:33.718705+0000","last_became_peered":"2024-09-21T07:26:33.718705+0000","last_unstale":"2024-09-21T07:26:35.301041+0000","last_undegraded":"2024-09-21T07:26:35.301041+0000","last_fullsized":"2024-09-21T07:26:35.301041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:14.082233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706626+0000","last_change":"2024-09-21T07:26:33.706968+0000","last_active":"2024-09-21T07:26:34.706626+0000","last_peered":"2024-09-21T07:26:34.706626+0000","last_clean":"2024-09-21T07:26:34.706626+0000","last_became_active":"2024-09-21T07:26:33.706646+0000","last_became_peered":"2024-09-21T07:26:33.706646+0000","last_unstale":"2024-09-21T07:26:34.706626+0000","last_undegraded":"2024-09-21T07:26:34.706626+0000","last_fullsized":"2024-09-21T07:26:34.706626+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:56.825599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300446+0000","last_change":"2024-09-21T07:26:33.725121+0000","last_active":"2024-09-21T07:26:35.300446+0000","last_peered":"2024-09-21T07:26:35.300446+0000","last_clean":"2024-09-21T07:26:35.300446+0000","last_became_active":"2024-09-21T07:26:33.716738+0000","last_became_peered":"2024-09-21T07:26:33.716738+0000","last_unstale":"2024-09-21T07:26:35.300446+0000","last_undegraded":"2024-09-21T07:26:35.300446+0000","last_fullsized":"2024-09-21T07:26:35.300446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:51.107803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707622+0000","last_change":"2024-09-21T07:26:33.714237+0000","last_active":"2024-09-21T07:26:34.707622+0000","last_peered":"2024-09-21T07:26:34.707622+0000","last_clean":"2024-09-21T07:26:34.707622+0000","last_became_active":"2024-09-21T07:26:33.713885+0000","last_became_peered":"2024-09-21T07:26:33.713885+0000","last_unstale":"2024-09-21T07:26:34.707622+0000","last_undegraded":"2024-09-21T07:26:34.707622+0000","last_fullsized":"2024-09-21T07:26:34.707622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:41.615956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718964+0000","last_change":"2024-09-21T07:26:33.729057+0000","last_active":"2024-09-21T07:26:34.718964+0000","last_peered":"2024-09-21T07:26:34.718964+0000","last_clean":"2024-09-21T07:26:34.718964+0000","last_became_active":"2024-09-21T07:26:33.728665+0000","last_became_peered":"2024-09-21T07:26:33.728665+0000","last_unstale":"2024-09-21T07:26:34.718964+0000","last_undegraded":"2024-09-21T07:26:34.718964+0000","last_fullsized":"2024-09-21T07:26:34.718964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:40.368251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707273+0000","last_change":"2024-09-21T07:26:33.716014+0000","last_active":"2024-09-21T07:26:34.707273+0000","last_peered":"2024-09-21T07:26:34.707273+0000","last_clean":"2024-09-21T07:26:34.707273+0000","last_became_active":"2024-09-21T07:26:33.715646+0000","last_became_peered":"2024-09-21T07:26:33.715646+0000","last_unstale":"2024-09-21T07:26:34.707273+0000","last_undegraded":"2024-09-21T07:26:34.707273+0000","last_fullsized":"2024-09-21T07:26:34.707273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:54.097384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707232+0000","last_change":"2024-09-21T07:26:33.715793+0000","last_active":"2024-09-21T07:26:34.707232+0000","last_peered":"2024-09-21T07:26:34.707232+0000","last_clean":"2024-09-21T07:26:34.707232+0000","last_became_active":"2024-09-21T07:26:33.715534+0000","last_became_peered":"2024-09-21T07:26:33.715534+0000","last_unstale":"2024-09-21T07:26:34.707232+0000","last_undegraded":"2024-09-21T07:26:34.707232+0000","last_fullsized":"2024-09-21T07:26:34.707232+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:00.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829471+0000","last_change":"2024-09-21T07:26:33.719495+0000","last_active":"2024-09-21T07:26:34.829471+0000","last_peered":"2024-09-21T07:26:34.829471+0000","last_clean":"2024-09-21T07:26:34.829471+0000","last_became_active":"2024-09-21T07:26:33.719197+0000","last_became_peered":"2024-09-21T07:26:33.719197+0000","last_unstale":"2024-09-21T07:26:34.829471+0000","last_undegraded":"2024-09-21T07:26:34.829471+0000","last_fullsized":"2024-09-21T07:26:34.829471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:19.973936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718752+0000","last_change":"2024-09-21T07:26:33.729253+0000","last_active":"2024-09-21T07:26:34.718752+0000","last_peered":"2024-09-21T07:26:34.718752+0000","last_clean":"2024-09-21T07:26:34.718752+0000","last_became_active":"2024-09-21T07:26:33.728705+0000","last_became_peered":"2024-09-21T07:26:33.728705+0000","last_unstale":"2024-09-21T07:26:34.718752+0000","last_undegraded":"2024-09-21T07:26:34.718752+0000","last_fullsized":"2024-09-21T07:26:34.718752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:31.574691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718975+0000","last_change":"2024-09-21T07:26:33.729098+0000","last_active":"2024-09-21T07:26:34.718975+0000","last_peered":"2024-09-21T07:26:34.718975+0000","last_clean":"2024-09-21T07:26:34.718975+0000","last_became_active":"2024-09-21T07:26:33.728688+0000","last_became_peered":"2024-09-21T07:26:33.728688+0000","last_unstale":"2024-09-21T07:26:34.718975+0000","last_undegraded":"2024-09-21T07:26:34.718975+0000","last_fullsized":"2024-09-21T07:26:34.718975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:46.875616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706519+0000","last_change":"2024-09-21T07:26:33.714195+0000","last_active":"2024-09-21T07:26:34.706519+0000","last_peered":"2024-09-21T07:26:34.706519+0000","last_clean":"2024-09-21T07:26:34.706519+0000","last_became_active":"2024-09-21T07:26:33.713828+0000","last_became_peered":"2024-09-21T07:26:33.713828+0000","last_unstale":"2024-09-21T07:26:34.706519+0000","last_undegraded":"2024-09-21T07:26:34.706519+0000","last_fullsized":"2024-09-21T07:26:34.706519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:17.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300406+0000","last_change":"2024-09-21T07:26:33.718167+0000","last_active":"2024-09-21T07:26:35.300406+0000","last_peered":"2024-09-21T07:26:35.300406+0000","last_clean":"2024-09-21T07:26:35.300406+0000","last_became_active":"2024-09-21T07:26:33.717805+0000","last_became_peered":"2024-09-21T07:26:33.717805+0000","last_unstale":"2024-09-21T07:26:35.300406+0000","last_undegraded":"2024-09-21T07:26:35.300406+0000","last_fullsized":"2024-09-21T07:26:35.300406+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.831597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830261+0000","last_change":"2024-09-21T07:26:33.731886+0000","last_active":"2024-09-21T07:26:34.830261+0000","last_peered":"2024-09-21T07:26:34.830261+0000","last_clean":"2024-09-21T07:26:34.830261+0000","last_became_active":"2024-09-21T07:26:33.731590+0000","last_became_peered":"2024-09-21T07:26:33.731590+0000","last_unstale":"2024-09-21T07:26:34.830261+0000","last_undegraded":"2024-09-21T07:26:34.830261+0000","last_fullsized":"2024-09-21T07:26:34.830261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:36.960428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718648+0000","last_change":"2024-09-21T07:26:33.729790+0000","last_active":"2024-09-21T07:26:34.718648+0000","last_peered":"2024-09-21T07:26:34.718648+0000","last_clean":"2024-09-21T07:26:34.718648+0000","last_became_active":"2024-09-21T07:26:33.729432+0000","last_became_peered":"2024-09-21T07:26:33.729432+0000","last_unstale":"2024-09-21T07:26:34.718648+0000","last_undegraded":"2024-09-21T07:26:34.718648+0000","last_fullsized":"2024-09-21T07:26:34.718648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:11.708764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705560+0000","last_change":"2024-09-21T07:26:33.715108+0000","last_active":"2024-09-21T07:26:34.705560+0000","last_peered":"2024-09-21T07:26:34.705560+0000","last_clean":"2024-09-21T07:26:34.705560+0000","last_became_active":"2024-09-21T07:26:33.714783+0000","last_became_peered":"2024-09-21T07:26:33.714783+0000","last_unstale":"2024-09-21T07:26:34.705560+0000","last_undegraded":"2024-09-21T07:26:34.705560+0000","last_fullsized":"2024-09-21T07:26:34.705560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:45.900587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299387+0000","last_change":"2024-09-21T07:26:33.711137+0000","last_active":"2024-09-21T07:26:35.299387+0000","last_peered":"2024-09-21T07:26:35.299387+0000","last_clean":"2024-09-21T07:26:35.299387+0000","last_became_active":"2024-09-21T07:26:33.710796+0000","last_became_peered":"2024-09-21T07:26:33.710796+0000","last_unstale":"2024-09-21T07:26:35.299387+0000","last_undegraded":"2024-09-21T07:26:35.299387+0000","last_fullsized":"2024-09-21T07:26:35.299387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:09.494028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300421+0000","last_change":"2024-09-21T07:26:33.708441+0000","last_active":"2024-09-21T07:26:35.300421+0000","last_peered":"2024-09-21T07:26:35.300421+0000","last_clean":"2024-09-21T07:26:35.300421+0000","last_became_active":"2024-09-21T07:26:33.708123+0000","last_became_peered":"2024-09-21T07:26:33.708123+0000","last_unstale":"2024-09-21T07:26:35.300421+0000","last_undegraded":"2024-09-21T07:26:35.300421+0000","last_fullsized":"2024-09-21T07:26:35.300421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:13.944307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.301034+0000","last_change":"2024-09-21T07:26:32.713882+0000","last_active":"2024-09-21T07:26:35.301034+0000","last_peered":"2024-09-21T07:26:35.301034+0000","last_clean":"2024-09-21T07:26:35.301034+0000","last_became_active":"2024-09-21T07:26:32.713390+0000","last_became_peered":"2024-09-21T07:26:32.713390+0000","last_unstale":"2024-09-21T07:26:35.301034+0000","last_undegraded":"2024-09-21T07:26:35.301034+0000","last_fullsized":"2024-09-21T07:26:35.301034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:17.039493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706718+0000","last_change":"2024-09-21T07:26:33.703002+0000","last_active":"2024-09-21T07:26:34.706718+0000","last_peered":"2024-09-21T07:26:34.706718+0000","last_clean":"2024-09-21T07:26:34.706718+0000","last_became_active":"2024-09-21T07:26:33.702663+0000","last_became_peered":"2024-09-21T07:26:33.702663+0000","last_unstale":"2024-09-21T07:26:34.706718+0000","last_undegraded":"2024-09-21T07:26:34.706718+0000","last_fullsized":"2024-09-21T07:26:34.706718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.707093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300629+0000","last_change":"2024-09-21T07:26:32.712358+0000","last_active":"2024-09-21T07:26:35.300629+0000","last_peered":"2024-09-21T07:26:35.300629+0000","last_clean":"2024-09-21T07:26:35.300629+0000","last_became_active":"2024-09-21T07:26:32.712002+0000","last_became_peered":"2024-09-21T07:26:32.712002+0000","last_unstale":"2024-09-21T07:26:35.300629+0000","last_undegraded":"2024-09-21T07:26:35.300629+0000","last_fullsized":"2024-09-21T07:26:35.300629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.546546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300467+0000","last_change":"2024-09-21T07:26:33.714050+0000","last_active":"2024-09-21T07:26:35.300467+0000","last_peered":"2024-09-21T07:26:35.300467+0000","last_clean":"2024-09-21T07:26:35.300467+0000","last_became_active":"2024-09-21T07:26:33.713528+0000","last_became_peered":"2024-09-21T07:26:33.713528+0000","last_unstale":"2024-09-21T07:26:35.300467+0000","last_undegraded":"2024-09-21T07:26:35.300467+0000","last_fullsized":"2024-09-21T07:26:35.300467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:45.012726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299961+0000","last_change":"2024-09-21T07:26:32.712794+0000","last_active":"2024-09-21T07:26:35.299961+0000","last_peered":"2024-09-21T07:26:35.299961+0000","last_clean":"2024-09-21T07:26:35.299961+0000","last_became_active":"2024-09-21T07:26:32.712443+0000","last_became_peered":"2024-09-21T07:26:32.712443+0000","last_unstale":"2024-09-21T07:26:35.299961+0000","last_undegraded":"2024-09-21T07:26:35.299961+0000","last_fullsized":"2024-09-21T07:26:35.299961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:19.081099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830055+0000","last_change":"2024-09-21T07:26:33.728398+0000","last_active":"2024-09-21T07:26:34.830055+0000","last_peered":"2024-09-21T07:26:34.830055+0000","last_clean":"2024-09-21T07:26:34.830055+0000","last_became_active":"2024-09-21T07:26:33.728110+0000","last_became_peered":"2024-09-21T07:26:33.728110+0000","last_unstale":"2024-09-21T07:26:34.830055+0000","last_undegraded":"2024-09-21T07:26:34.830055+0000","last_fullsized":"2024-09-21T07:26:34.830055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:40.217242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300144+0000","last_change":"2024-09-21T07:26:32.705500+0000","last_active":"2024-09-21T07:26:35.300144+0000","last_peered":"2024-09-21T07:26:35.300144+0000","last_clean":"2024-09-21T07:26:35.300144+0000","last_became_active":"2024-09-21T07:26:32.705189+0000","last_became_peered":"2024-09-21T07:26:32.705189+0000","last_unstale":"2024-09-21T07:26:35.300144+0000","last_undegraded":"2024-09-21T07:26:35.300144+0000","last_fullsized":"2024-09-21T07:26:35.300144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:38.999417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705216+0000","last_change":"2024-09-21T07:26:33.709282+0000","last_active":"2024-09-21T07:26:34.705216+0000","last_peered":"2024-09-21T07:26:34.705216+0000","last_clean":"2024-09-21T07:26:34.705216+0000","last_became_active":"2024-09-21T07:26:33.708939+0000","last_became_peered":"2024-09-21T07:26:33.708939+0000","last_unstale":"2024-09-21T07:26:34.705216+0000","last_undegraded":"2024-09-21T07:26:34.705216+0000","last_fullsized":"2024-09-21T07:26:34.705216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:04.952982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707548+0000","last_change":"2024-09-21T07:26:32.705538+0000","last_active":"2024-09-21T07:26:34.707548+0000","last_peered":"2024-09-21T07:26:34.707548+0000","last_clean":"2024-09-21T07:26:34.707548+0000","last_became_active":"2024-09-21T07:26:32.705215+0000","last_became_peered":"2024-09-21T07:26:32.705215+0000","last_unstale":"2024-09-21T07:26:34.707548+0000","last_undegraded":"2024-09-21T07:26:34.707548+0000","last_fullsized":"2024-09-21T07:26:34.707548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:36.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300221+0000","last_change":"2024-09-21T07:26:33.717976+0000","last_active":"2024-09-21T07:26:35.300221+0000","last_peered":"2024-09-21T07:26:35.300221+0000","last_clean":"2024-09-21T07:26:35.300221+0000","last_became_active":"2024-09-21T07:26:33.717694+0000","last_became_peered":"2024-09-21T07:26:33.717694+0000","last_unstale":"2024-09-21T07:26:35.300221+0000","last_undegraded":"2024-09-21T07:26:35.300221+0000","last_fullsized":"2024-09-21T07:26:35.300221+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:59.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707186+0000","last_change":"2024-09-21T07:26:32.706993+0000","last_active":"2024-09-21T07:26:34.707186+0000","last_peered":"2024-09-21T07:26:34.707186+0000","last_clean":"2024-09-21T07:26:34.707186+0000","last_became_active":"2024-09-21T07:26:32.706667+0000","last_became_peered":"2024-09-21T07:26:32.706667+0000","last_unstale":"2024-09-21T07:26:34.707186+0000","last_undegraded":"2024-09-21T07:26:34.707186+0000","last_fullsized":"2024-09-21T07:26:34.707186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:23.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300009+0000","last_change":"2024-09-21T07:26:33.700583+0000","last_active":"2024-09-21T07:26:35.300009+0000","last_peered":"2024-09-21T07:26:35.300009+0000","last_clean":"2024-09-21T07:26:35.300009+0000","last_became_active":"2024-09-21T07:26:33.699910+0000","last_became_peered":"2024-09-21T07:26:33.699910+0000","last_unstale":"2024-09-21T07:26:35.300009+0000","last_undegraded":"2024-09-21T07:26:35.300009+0000","last_fullsized":"2024-09-21T07:26:35.300009+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:13.337752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707153+0000","last_change":"2024-09-21T07:26:32.704657+0000","last_active":"2024-09-21T07:26:34.707153+0000","last_peered":"2024-09-21T07:26:34.707153+0000","last_clean":"2024-09-21T07:26:34.707153+0000","last_became_active":"2024-09-21T07:26:32.704359+0000","last_became_peered":"2024-09-21T07:26:32.704359+0000","last_unstale":"2024-09-21T07:26:34.707153+0000","last_undegraded":"2024-09-21T07:26:34.707153+0000","last_fullsized":"2024-09-21T07:26:34.707153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:13.239895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707601+0000","last_change":"2024-09-21T07:26:33.715873+0000","last_active":"2024-09-21T07:26:34.707601+0000","last_peered":"2024-09-21T07:26:34.707601+0000","last_clean":"2024-09-21T07:26:34.707601+0000","last_became_active":"2024-09-21T07:26:33.715561+0000","last_became_peered":"2024-09-21T07:26:33.715561+0000","last_unstale":"2024-09-21T07:26:34.707601+0000","last_undegraded":"2024-09-21T07:26:34.707601+0000","last_fullsized":"2024-09-21T07:26:34.707601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:05.220655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299797+0000","last_change":"2024-09-21T07:26:32.710133+0000","last_active":"2024-09-21T07:26:35.299797+0000","last_peered":"2024-09-21T07:26:35.299797+0000","last_clean":"2024-09-21T07:26:35.299797+0000","last_became_active":"2024-09-21T07:26:32.709770+0000","last_became_peered":"2024-09-21T07:26:32.709770+0000","last_unstale":"2024-09-21T07:26:35.299797+0000","last_undegraded":"2024-09-21T07:26:35.299797+0000","last_fullsized":"2024-09-21T07:26:35.299797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:44.100405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300642+0000","last_change":"2024-09-21T07:26:33.711299+0000","last_active":"2024-09-21T07:26:35.300642+0000","last_peered":"2024-09-21T07:26:35.300642+0000","last_clean":"2024-09-21T07:26:35.300642+0000","last_became_active":"2024-09-21T07:26:33.711004+0000","last_became_peered":"2024-09-21T07:26:33.711004+0000","last_unstale":"2024-09-21T07:26:35.300642+0000","last_undegraded":"2024-09-21T07:26:35.300642+0000","last_fullsized":"2024-09-21T07:26:35.300642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:12.302101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830191+0000","last_change":"2024-09-21T07:26:32.717966+0000","last_active":"2024-09-21T07:26:34.830191+0000","last_peered":"2024-09-21T07:26:34.830191+0000","last_clean":"2024-09-21T07:26:34.830191+0000","last_became_active":"2024-09-21T07:26:32.717578+0000","last_became_peered":"2024-09-21T07:26:32.717578+0000","last_unstale":"2024-09-21T07:26:34.830191+0000","last_undegraded":"2024-09-21T07:26:34.830191+0000","last_fullsized":"2024-09-21T07:26:34.830191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:06.698663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707654+0000","last_change":"2024-09-21T07:26:33.726854+0000","last_active":"2024-09-21T07:26:34.707654+0000","last_peered":"2024-09-21T07:26:34.707654+0000","last_clean":"2024-09-21T07:26:34.707654+0000","last_became_active":"2024-09-21T07:26:33.726465+0000","last_became_peered":"2024-09-21T07:26:33.726465+0000","last_unstale":"2024-09-21T07:26:34.707654+0000","last_undegraded":"2024-09-21T07:26:34.707654+0000","last_fullsized":"2024-09-21T07:26:34.707654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:43.518328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706627+0000","last_change":"2024-09-21T07:26:32.703889+0000","last_active":"2024-09-21T07:26:34.706627+0000","last_peered":"2024-09-21T07:26:34.706627+0000","last_clean":"2024-09-21T07:26:34.706627+0000","last_became_active":"2024-09-21T07:26:32.703546+0000","last_became_peered":"2024-09-21T07:26:32.703546+0000","last_unstale":"2024-09-21T07:26:34.706627+0000","last_undegraded":"2024-09-21T07:26:34.706627+0000","last_fullsized":"2024-09-21T07:26:34.706627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:20.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300623+0000","last_change":"2024-09-21T07:26:33.726254+0000","last_active":"2024-09-21T07:26:35.300623+0000","last_peered":"2024-09-21T07:26:35.300623+0000","last_clean":"2024-09-21T07:26:35.300623+0000","last_became_active":"2024-09-21T07:26:33.725916+0000","last_became_peered":"2024-09-21T07:26:33.725916+0000","last_unstale":"2024-09-21T07:26:35.300623+0000","last_undegraded":"2024-09-21T07:26:35.300623+0000","last_fullsized":"2024-09-21T07:26:35.300623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:06.772773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829661+0000","last_change":"2024-09-21T07:26:32.717213+0000","last_active":"2024-09-21T07:26:34.829661+0000","last_peered":"2024-09-21T07:26:34.829661+0000","last_clean":"2024-09-21T07:26:34.829661+0000","last_became_active":"2024-09-21T07:26:32.716200+0000","last_became_peered":"2024-09-21T07:26:32.716200+0000","last_unstale":"2024-09-21T07:26:34.829661+0000","last_undegraded":"2024-09-21T07:26:34.829661+0000","last_fullsized":"2024-09-21T07:26:34.829661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:05.433165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706709+0000","last_change":"2024-09-21T07:26:33.712628+0000","last_active":"2024-09-21T07:26:34.706709+0000","last_peered":"2024-09-21T07:26:34.706709+0000","last_clean":"2024-09-21T07:26:34.706709+0000","last_became_active":"2024-09-21T07:26:33.706324+0000","last_became_peered":"2024-09-21T07:26:33.706324+0000","last_unstale":"2024-09-21T07:26:34.706709+0000","last_undegraded":"2024-09-21T07:26:34.706709+0000","last_fullsized":"2024-09-21T07:26:34.706709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:18.544180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300763+0000","last_change":"2024-09-21T07:26:32.710099+0000","last_active":"2024-09-21T07:26:35.300763+0000","last_peered":"2024-09-21T07:26:35.300763+0000","last_clean":"2024-09-21T07:26:35.300763+0000","last_became_active":"2024-09-21T07:26:32.709379+0000","last_became_peered":"2024-09-21T07:26:32.709379+0000","last_unstale":"2024-09-21T07:26:35.300763+0000","last_undegraded":"2024-09-21T07:26:35.300763+0000","last_fullsized":"2024-09-21T07:26:35.300763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:25.243614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705553+0000","last_change":"2024-09-21T07:26:33.732323+0000","last_active":"2024-09-21T07:26:34.705553+0000","last_peered":"2024-09-21T07:26:34.705553+0000","last_clean":"2024-09-21T07:26:34.705553+0000","last_became_active":"2024-09-21T07:26:33.731777+0000","last_became_peered":"2024-09-21T07:26:33.731777+0000","last_unstale":"2024-09-21T07:26:34.705553+0000","last_undegraded":"2024-09-21T07:26:34.705553+0000","last_fullsized":"2024-09-21T07:26:34.705553+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.592194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829877+0000","last_change":"2024-09-21T07:26:32.713456+0000","last_active":"2024-09-21T07:26:34.829877+0000","last_peered":"2024-09-21T07:26:34.829877+0000","last_clean":"2024-09-21T07:26:34.829877+0000","last_became_active":"2024-09-21T07:26:32.713105+0000","last_became_peered":"2024-09-21T07:26:32.713105+0000","last_unstale":"2024-09-21T07:26:34.829877+0000","last_undegraded":"2024-09-21T07:26:34.829877+0000","last_fullsized":"2024-09-21T07:26:34.829877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.016585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718785+0000","last_change":"2024-09-21T07:26:33.717966+0000","last_active":"2024-09-21T07:26:34.718785+0000","last_peered":"2024-09-21T07:26:34.718785+0000","last_clean":"2024-09-21T07:26:34.718785+0000","last_became_active":"2024-09-21T07:26:33.717640+0000","last_became_peered":"2024-09-21T07:26:33.717640+0000","last_unstale":"2024-09-21T07:26:34.718785+0000","last_undegraded":"2024-09-21T07:26:34.718785+0000","last_fullsized":"2024-09-21T07:26:34.718785+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:12.799566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718259+0000","last_change":"2024-09-21T07:26:32.716524+0000","last_active":"2024-09-21T07:26:34.718259+0000","last_peered":"2024-09-21T07:26:34.718259+0000","last_clean":"2024-09-21T07:26:34.718259+0000","last_became_active":"2024-09-21T07:26:32.716115+0000","last_became_peered":"2024-09-21T07:26:32.716115+0000","last_unstale":"2024-09-21T07:26:34.718259+0000","last_undegraded":"2024-09-21T07:26:34.718259+0000","last_fullsized":"2024-09-21T07:26:34.718259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.017561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299976+0000","last_change":"2024-09-21T07:26:33.725831+0000","last_active":"2024-09-21T07:26:35.299976+0000","last_peered":"2024-09-21T07:26:35.299976+0000","last_clean":"2024-09-21T07:26:35.299976+0000","last_became_active":"2024-09-21T07:26:33.716751+0000","last_became_peered":"2024-09-21T07:26:33.716751+0000","last_unstale":"2024-09-21T07:26:35.299976+0000","last_undegraded":"2024-09-21T07:26:35.299976+0000","last_fullsized":"2024-09-21T07:26:35.299976+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:07.077043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829769+0000","last_change":"2024-09-21T07:26:32.715629+0000","last_active":"2024-09-21T07:26:34.829769+0000","last_peered":"2024-09-21T07:26:34.829769+0000","last_clean":"2024-09-21T07:26:34.829769+0000","last_became_active":"2024-09-21T07:26:32.714299+0000","last_became_peered":"2024-09-21T07:26:32.714299+0000","last_unstale":"2024-09-21T07:26:34.829769+0000","last_undegraded":"2024-09-21T07:26:34.829769+0000","last_fullsized":"2024-09-21T07:26:34.829769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.440088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300113+0000","last_change":"2024-09-21T07:26:33.732748+0000","last_active":"2024-09-21T07:26:35.300113+0000","last_peered":"2024-09-21T07:26:35.300113+0000","last_clean":"2024-09-21T07:26:35.300113+0000","last_became_active":"2024-09-21T07:26:33.732400+0000","last_became_peered":"2024-09-21T07:26:33.732400+0000","last_unstale":"2024-09-21T07:26:35.300113+0000","last_undegraded":"2024-09-21T07:26:35.300113+0000","last_fullsized":"2024-09-21T07:26:35.300113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:21.570517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":23,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705329+0000","last_change":"2024-09-21T07:26:32.711883+0000","last_active":"2024-09-21T07:26:34.705329+0000","last_peered":"2024-09-21T07:26:34.705329+0000","last_clean":"2024-09-21T07:26:34.705329+0000","last_became_active":"2024-09-21T07:26:32.711557+0000","last_became_peered":"2024-09-21T07:26:32.711557+0000","last_unstale":"2024-09-21T07:26:34.705329+0000","last_undegraded":"2024-09-21T07:26:34.705329+0000","last_fullsized":"2024-09-21T07:26:34.705329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:19.354237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830176+0000","last_change":"2024-09-21T07:26:33.732772+0000","last_active":"2024-09-21T07:26:34.830176+0000","last_peered":"2024-09-21T07:26:34.830176+0000","last_clean":"2024-09-21T07:26:34.830176+0000","last_became_active":"2024-09-21T07:26:33.732465+0000","last_became_peered":"2024-09-21T07:26:33.732465+0000","last_unstale":"2024-09-21T07:26:34.830176+0000","last_undegraded":"2024-09-21T07:26:34.830176+0000","last_fullsized":"2024-09-21T07:26:34.830176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:34.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718629+0000","last_change":"2024-09-21T07:26:32.717844+0000","last_active":"2024-09-21T07:26:34.718629+0000","last_peered":"2024-09-21T07:26:34.718629+0000","last_clean":"2024-09-21T07:26:34.718629+0000","last_became_active":"2024-09-21T07:26:32.717034+0000","last_became_peered":"2024-09-21T07:26:32.717034+0000","last_unstale":"2024-09-21T07:26:34.718629+0000","last_undegraded":"2024-09-21T07:26:34.718629+0000","last_fullsized":"2024-09-21T07:26:34.718629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:35.872907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300615+0000","last_change":"2024-09-21T07:26:33.719812+0000","last_active":"2024-09-21T07:26:35.300615+0000","last_peered":"2024-09-21T07:26:35.300615+0000","last_clean":"2024-09-21T07:26:35.300615+0000","last_became_active":"2024-09-21T07:26:33.714131+0000","last_became_peered":"2024-09-21T07:26:33.714131+0000","last_unstale":"2024-09-21T07:26:35.300615+0000","last_undegraded":"2024-09-21T07:26:35.300615+0000","last_fullsized":"2024-09-21T07:26:35.300615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:05.637051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829825+0000","last_change":"2024-09-21T07:26:32.715720+0000","last_active":"2024-09-21T07:26:34.829825+0000","last_peered":"2024-09-21T07:26:34.829825+0000","last_clean":"2024-09-21T07:26:34.829825+0000","last_became_active":"2024-09-21T07:26:32.715163+0000","last_became_peered":"2024-09-21T07:26:32.715163+0000","last_unstale":"2024-09-21T07:26:34.829825+0000","last_undegraded":"2024-09-21T07:26:34.829825+0000","last_fullsized":"2024-09-21T07:26:34.829825+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:47.679106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706575+0000","last_change":"2024-09-21T07:26:33.716319+0000","last_active":"2024-09-21T07:26:34.706575+0000","last_peered":"2024-09-21T07:26:34.706575+0000","last_clean":"2024-09-21T07:26:34.706575+0000","last_became_active":"2024-09-21T07:26:33.715996+0000","last_became_peered":"2024-09-21T07:26:33.715996+0000","last_unstale":"2024-09-21T07:26:34.706575+0000","last_undegraded":"2024-09-21T07:26:34.706575+0000","last_fullsized":"2024-09-21T07:26:34.706575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:29.118321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829821+0000","last_change":"2024-09-21T07:26:32.717014+0000","last_active":"2024-09-21T07:26:34.829821+0000","last_peered":"2024-09-21T07:26:34.829821+0000","last_clean":"2024-09-21T07:26:34.829821+0000","last_became_active":"2024-09-21T07:26:32.716627+0000","last_became_peered":"2024-09-21T07:26:32.716627+0000","last_unstale":"2024-09-21T07:26:34.829821+0000","last_undegraded":"2024-09-21T07:26:34.829821+0000","last_fullsized":"2024-09-21T07:26:34.829821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:28.633725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300631+0000","last_change":"2024-09-21T07:26:33.705059+0000","last_active":"2024-09-21T07:26:35.300631+0000","last_peered":"2024-09-21T07:26:35.300631+0000","last_clean":"2024-09-21T07:26:35.300631+0000","last_became_active":"2024-09-21T07:26:33.704771+0000","last_became_peered":"2024-09-21T07:26:33.704771+0000","last_unstale":"2024-09-21T07:26:35.300631+0000","last_undegraded":"2024-09-21T07:26:35.300631+0000","last_fullsized":"2024-09-21T07:26:35.300631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:24.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707512+0000","last_change":"2024-09-21T07:26:32.707991+0000","last_active":"2024-09-21T07:26:34.707512+0000","last_peered":"2024-09-21T07:26:34.707512+0000","last_clean":"2024-09-21T07:26:34.707512+0000","last_became_active":"2024-09-21T07:26:32.707628+0000","last_became_peered":"2024-09-21T07:26:32.707628+0000","last_unstale":"2024-09-21T07:26:34.707512+0000","last_undegraded":"2024-09-21T07:26:34.707512+0000","last_fullsized":"2024-09-21T07:26:34.707512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:08.739164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299512+0000","last_change":"2024-09-21T07:26:33.710870+0000","last_active":"2024-09-21T07:26:35.299512+0000","last_peered":"2024-09-21T07:26:35.299512+0000","last_clean":"2024-09-21T07:26:35.299512+0000","last_became_active":"2024-09-21T07:26:33.710566+0000","last_became_peered":"2024-09-21T07:26:33.710566+0000","last_unstale":"2024-09-21T07:26:35.299512+0000","last_undegraded":"2024-09-21T07:26:35.299512+0000","last_fullsized":"2024-09-21T07:26:35.299512+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:27.912360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299743+0000","last_change":"2024-09-21T07:26:32.707240+0000","last_active":"2024-09-21T07:26:35.299743+0000","last_peered":"2024-09-21T07:26:35.299743+0000","last_clean":"2024-09-21T07:26:35.299743+0000","last_became_active":"2024-09-21T07:26:32.706878+0000","last_became_peered":"2024-09-21T07:26:32.706878+0000","last_unstale":"2024-09-21T07:26:35.299743+0000","last_undegraded":"2024-09-21T07:26:35.299743+0000","last_fullsized":"2024-09-21T07:26:35.299743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:45.550972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718819+0000","last_change":"2024-09-21T07:26:33.729146+0000","last_active":"2024-09-21T07:26:34.718819+0000","last_peered":"2024-09-21T07:26:34.718819+0000","last_clean":"2024-09-21T07:26:34.718819+0000","last_became_active":"2024-09-21T07:26:33.728606+0000","last_became_peered":"2024-09-21T07:26:33.728606+0000","last_unstale":"2024-09-21T07:26:34.718819+0000","last_undegraded":"2024-09-21T07:26:34.718819+0000","last_fullsized":"2024-09-21T07:26:34.718819+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:53.045217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718415+0000","last_change":"2024-09-21T07:26:32.715797+0000","last_active":"2024-09-21T07:26:34.718415+0000","last_peered":"2024-09-21T07:26:34.718415+0000","last_clean":"2024-09-21T07:26:34.718415+0000","last_became_active":"2024-09-21T07:26:32.715535+0000","last_became_peered":"2024-09-21T07:26:32.715535+0000","last_unstale":"2024-09-21T07:26:34.718415+0000","last_undegraded":"2024-09-21T07:26:34.718415+0000","last_fullsized":"2024-09-21T07:26:34.718415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:23.509212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300525+0000","last_change":"2024-09-21T07:26:33.699624+0000","last_active":"2024-09-21T07:26:35.300525+0000","last_peered":"2024-09-21T07:26:35.300525+0000","last_clean":"2024-09-21T07:26:35.300525+0000","last_became_active":"2024-09-21T07:26:33.699195+0000","last_became_peered":"2024-09-21T07:26:33.699195+0000","last_unstale":"2024-09-21T07:26:35.300525+0000","last_undegraded":"2024-09-21T07:26:35.300525+0000","last_fullsized":"2024-09-21T07:26:35.300525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:15.428470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299392+0000","last_change":"2024-09-21T07:26:32.711993+0000","last_active":"2024-09-21T07:26:35.299392+0000","last_peered":"2024-09-21T07:26:35.299392+0000","last_clean":"2024-09-21T07:26:35.299392+0000","last_became_active":"2024-09-21T07:26:32.711625+0000","last_became_peered":"2024-09-21T07:26:32.711625+0000","last_unstale":"2024-09-21T07:26:35.299392+0000","last_undegraded":"2024-09-21T07:26:35.299392+0000","last_fullsized":"2024-09-21T07:26:35.299392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.195898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300072+0000","last_change":"2024-09-21T07:26:33.704732+0000","last_active":"2024-09-21T07:26:35.300072+0000","last_peered":"2024-09-21T07:26:35.300072+0000","last_clean":"2024-09-21T07:26:35.300072+0000","last_became_active":"2024-09-21T07:26:33.704391+0000","last_became_peered":"2024-09-21T07:26:33.704391+0000","last_unstale":"2024-09-21T07:26:35.300072+0000","last_undegraded":"2024-09-21T07:26:35.300072+0000","last_fullsized":"2024-09-21T07:26:35.300072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:35.223589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718859+0000","last_change":"2024-09-21T07:26:32.718081+0000","last_active":"2024-09-21T07:26:34.718859+0000","last_peered":"2024-09-21T07:26:34.718859+0000","last_clean":"2024-09-21T07:26:34.718859+0000","last_became_active":"2024-09-21T07:26:32.717486+0000","last_became_peered":"2024-09-21T07:26:32.717486+0000","last_unstale":"2024-09-21T07:26:34.718859+0000","last_undegraded":"2024-09-21T07:26:34.718859+0000","last_fullsized":"2024-09-21T07:26:34.718859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:27.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705640+0000","last_change":"2024-09-21T07:26:33.709277+0000","last_active":"2024-09-21T07:26:34.705640+0000","last_peered":"2024-09-21T07:26:34.705640+0000","last_clean":"2024-09-21T07:26:34.705640+0000","last_became_active":"2024-09-21T07:26:33.709003+0000","last_became_peered":"2024-09-21T07:26:33.709003+0000","last_unstale":"2024-09-21T07:26:34.705640+0000","last_undegraded":"2024-09-21T07:26:34.705640+0000","last_fullsized":"2024-09-21T07:26:34.705640+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:23.972321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.719135+0000","last_change":"2024-09-21T07:26:32.714816+0000","last_active":"2024-09-21T07:26:34.719135+0000","last_peered":"2024-09-21T07:26:34.719135+0000","last_clean":"2024-09-21T07:26:34.719135+0000","last_became_active":"2024-09-21T07:26:32.712923+0000","last_became_peered":"2024-09-21T07:26:32.712923+0000","last_unstale":"2024-09-21T07:26:34.719135+0000","last_undegraded":"2024-09-21T07:26:34.719135+0000","last_fullsized":"2024-09-21T07:26:34.719135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:25.186430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.719002+0000","last_change":"2024-09-21T07:26:33.723117+0000","last_active":"2024-09-21T07:26:34.719002+0000","last_peered":"2024-09-21T07:26:34.719002+0000","last_clean":"2024-09-21T07:26:34.719002+0000","last_became_active":"2024-09-21T07:26:33.722054+0000","last_became_peered":"2024-09-21T07:26:33.722054+0000","last_unstale":"2024-09-21T07:26:34.719002+0000","last_undegraded":"2024-09-21T07:26:34.719002+0000","last_fullsized":"2024-09-21T07:26:34.719002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:46.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300005+0000","last_change":"2024-09-21T07:26:32.710480+0000","last_active":"2024-09-21T07:26:35.300005+0000","last_peered":"2024-09-21T07:26:35.300005+0000","last_clean":"2024-09-21T07:26:35.300005+0000","last_became_active":"2024-09-21T07:26:32.710069+0000","last_became_peered":"2024-09-21T07:26:32.710069+0000","last_unstale":"2024-09-21T07:26:35.300005+0000","last_undegraded":"2024-09-21T07:26:35.300005+0000","last_fullsized":"2024-09-21T07:26:35.300005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:43.454122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300607+0000","last_change":"2024-09-21T07:26:33.704456+0000","last_active":"2024-09-21T07:26:35.300607+0000","last_peered":"2024-09-21T07:26:35.300607+0000","last_clean":"2024-09-21T07:26:35.300607+0000","last_became_active":"2024-09-21T07:26:33.704194+0000","last_became_peered":"2024-09-21T07:26:33.704194+0000","last_unstale":"2024-09-21T07:26:35.300607+0000","last_undegraded":"2024-09-21T07:26:35.300607+0000","last_fullsized":"2024-09-21T07:26:35.300607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:29.025262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300837+0000","last_change":"2024-09-21T07:26:32.709793+0000","last_active":"2024-09-21T07:26:35.300837+0000","last_peered":"2024-09-21T07:26:35.300837+0000","last_clean":"2024-09-21T07:26:35.300837+0000","last_became_active":"2024-09-21T07:26:32.709018+0000","last_became_peered":"2024-09-21T07:26:32.709018+0000","last_unstale":"2024-09-21T07:26:35.300837+0000","last_undegraded":"2024-09-21T07:26:35.300837+0000","last_fullsized":"2024-09-21T07:26:35.300837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:05.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299966+0000","last_change":"2024-09-21T07:26:33.712283+0000","last_active":"2024-09-21T07:26:35.299966+0000","last_peered":"2024-09-21T07:26:35.299966+0000","last_clean":"2024-09-21T07:26:35.299966+0000","last_became_active":"2024-09-21T07:26:33.711978+0000","last_became_peered":"2024-09-21T07:26:33.711978+0000","last_unstale":"2024-09-21T07:26:35.299966+0000","last_undegraded":"2024-09-21T07:26:35.299966+0000","last_fullsized":"2024-09-21T07:26:35.299966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:24.345926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830034+0000","last_change":"2024-09-21T07:26:32.714302+0000","last_active":"2024-09-21T07:26:34.830034+0000","last_peered":"2024-09-21T07:26:34.830034+0000","last_clean":"2024-09-21T07:26:34.830034+0000","last_became_active":"2024-09-21T07:26:32.713972+0000","last_became_peered":"2024-09-21T07:26:32.713972+0000","last_unstale":"2024-09-21T07:26:34.830034+0000","last_undegraded":"2024-09-21T07:26:34.830034+0000","last_fullsized":"2024-09-21T07:26:34.830034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705680+0000","last_change":"2024-09-21T07:26:33.725683+0000","last_active":"2024-09-21T07:26:34.705680+0000","last_peered":"2024-09-21T07:26:34.705680+0000","last_clean":"2024-09-21T07:26:34.705680+0000","last_became_active":"2024-09-21T07:26:33.725239+0000","last_became_peered":"2024-09-21T07:26:33.725239+0000","last_unstale":"2024-09-21T07:26:34.705680+0000","last_undegraded":"2024-09-21T07:26:34.705680+0000","last_fullsized":"2024-09-21T07:26:34.705680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:17.110812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707294+0000","last_change":"2024-09-21T07:26:32.711484+0000","last_active":"2024-09-21T07:26:34.707294+0000","last_peered":"2024-09-21T07:26:34.707294+0000","last_clean":"2024-09-21T07:26:34.707294+0000","last_became_active":"2024-09-21T07:26:32.711179+0000","last_became_peered":"2024-09-21T07:26:32.711179+0000","last_unstale":"2024-09-21T07:26:34.707294+0000","last_undegraded":"2024-09-21T07:26:34.707294+0000","last_fullsized":"2024-09-21T07:26:34.707294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:39.578312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300651+0000","last_change":"2024-09-21T07:26:33.721426+0000","last_active":"2024-09-21T07:26:35.300651+0000","last_peered":"2024-09-21T07:26:35.300651+0000","last_clean":"2024-09-21T07:26:35.300651+0000","last_became_active":"2024-09-21T07:26:33.720896+0000","last_became_peered":"2024-09-21T07:26:33.720896+0000","last_unstale":"2024-09-21T07:26:35.300651+0000","last_undegraded":"2024-09-21T07:26:35.300651+0000","last_fullsized":"2024-09-21T07:26:35.300651+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:51.152597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707269+0000","last_change":"2024-09-21T07:26:32.703003+0000","last_active":"2024-09-21T07:26:34.707269+0000","last_peered":"2024-09-21T07:26:34.707269+0000","last_clean":"2024-09-21T07:26:34.707269+0000","last_became_active":"2024-09-21T07:26:32.702679+0000","last_became_peered":"2024-09-21T07:26:32.702679+0000","last_unstale":"2024-09-21T07:26:34.707269+0000","last_undegraded":"2024-09-21T07:26:34.707269+0000","last_fullsized":"2024-09-21T07:26:34.707269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:39.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705242+0000","last_change":"2024-09-21T07:26:33.728946+0000","last_active":"2024-09-21T07:26:34.705242+0000","last_peered":"2024-09-21T07:26:34.705242+0000","last_clean":"2024-09-21T07:26:34.705242+0000","last_became_active":"2024-09-21T07:26:33.728630+0000","last_became_peered":"2024-09-21T07:26:33.728630+0000","last_unstale":"2024-09-21T07:26:34.705242+0000","last_undegraded":"2024-09-21T07:26:34.705242+0000","last_fullsized":"2024-09-21T07:26:34.705242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:58.826148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299740+0000","last_change":"2024-09-21T07:26:32.709146+0000","last_active":"2024-09-21T07:26:35.299740+0000","last_peered":"2024-09-21T07:26:35.299740+0000","last_clean":"2024-09-21T07:26:35.299740+0000","last_became_active":"2024-09-21T07:26:32.708854+0000","last_became_peered":"2024-09-21T07:26:32.708854+0000","last_unstale":"2024-09-21T07:26:35.299740+0000","last_undegraded":"2024-09-21T07:26:35.299740+0000","last_fullsized":"2024-09-21T07:26:35.299740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:01.993973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300195+0000","last_change":"2024-09-21T07:26:33.709551+0000","last_active":"2024-09-21T07:26:35.300195+0000","last_peered":"2024-09-21T07:26:35.300195+0000","last_clean":"2024-09-21T07:26:35.300195+0000","last_became_active":"2024-09-21T07:26:33.709229+0000","last_became_peered":"2024-09-21T07:26:33.709229+0000","last_unstale":"2024-09-21T07:26:35.300195+0000","last_undegraded":"2024-09-21T07:26:35.300195+0000","last_fullsized":"2024-09-21T07:26:35.300195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:07.415573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707087+0000","last_change":"2024-09-21T07:26:32.704855+0000","last_active":"2024-09-21T07:26:34.707087+0000","last_peered":"2024-09-21T07:26:34.707087+0000","last_clean":"2024-09-21T07:26:34.707087+0000","last_became_active":"2024-09-21T07:26:32.704385+0000","last_became_peered":"2024-09-21T07:26:32.704385+0000","last_unstale":"2024-09-21T07:26:34.707087+0000","last_undegraded":"2024-09-21T07:26:34.707087+0000","last_fullsized":"2024-09-21T07:26:34.707087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:06.609096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829436+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:26:34.829436+0000","last_peered":"2024-09-21T07:26:34.829436+0000","last_clean":"2024-09-21T07:26:34.829436+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:26:34.829436+0000","last_undegraded":"2024-09-21T07:26:34.829436+0000","last_fullsized":"2024-09-21T07:26:34.829436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":806912,"data_stored":363824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":806912,"data_stored":363812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40308,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331532,"statfs":{"total":96636764160,"available":96595488768,"internally_reserved":0,"allocated":815104,"data_stored":365402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36132,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335708,"statfs":{"total":96636764160,"available":96599764992,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335672,"statfs":{"total":96636764160,"available":96599728128,"internally_reserved":0,"allocated":831488,"data_stored":366166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1396736,"data_stored":954158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1413120,"data_stored":954934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:26:42.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 -- 172.21.15.64:0/1054069112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c0b48d0 msgr2=0x7f7f5c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 --2- 172.21.15.64:0/1054069112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c0b48d0 0x7f7f5c072e20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009bc0 tx=0x7f7f5401cba0 comp rx=0 tx=0).stop 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 -- 172.21.15.64:0/1054069112 shutdown_connections 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 --2- 172.21.15.64:0/1054069112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c0b48d0 0x7f7f5c072e20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 -- 172.21.15.64:0/1054069112 >> 172.21.15.64:0/1054069112 conn(0x7f7f5c0ccbe0 msgr2=0x7f7f5c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 -- 172.21.15.64:0/1054069112 shutdown_connections 2024-09-21T07:26:42.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.848+0000 7f7f61800640 1 -- 172.21.15.64:0/1054069112 wait complete. 2024-09-21T07:26:42.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 Processor -- start 2024-09-21T07:26:42.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- start start 2024-09-21T07:26:42.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:42.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c15edb0 0x7f7f5c1f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c09c4f0 0x7f7f5c1fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c16a420 con 0x7f7f5c15edb0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c16a2a0 con 0x7f7f5c09c4f0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5c16a5a0 con 0x7f7f5c0709b0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:50810/0 (socket says 172.21.15.64:50810) 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 -- 172.21.15.64:0/928871174 learned_addr learned my addr 172.21.15.64:0/928871174 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f52000640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c15edb0 0x7f7f5c1f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5b400640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c09c4f0 0x7f7f5c1fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 -- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c09c4f0 msgr2=0x7f7f5c1fcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c09c4f0 0x7f7f5c1fcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 -- 172.21.15.64:0/928871174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c15edb0 msgr2=0x7f7f5c1f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c15edb0 0x7f7f5c1f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:42.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 -- 172.21.15.64:0/928871174 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c09d720 con 0x7f7f5c0709b0 2024-09-21T07:26:42.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f5aa00640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c3f0 tx=0x7f7f4c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:42.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c017070 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f4c003600 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c09ce80 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c003a50 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.852+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c09d440 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.856+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c072e20 con 0x7f7f5c0709b0 2024-09-21T07:26:42.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.856+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f4c01a070 con 0x7f7f5c0709b0 2024-09-21T07:26:42.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.856+0000 7f7f53400640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 0x7f7f38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:42.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.856+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f7f4c0936b0 con 0x7f7f5c0709b0 2024-09-21T07:26:42.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.856+0000 7f7f52000640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 0x7f7f38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:42.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.860+0000 7f7f52000640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 0x7f7f38075710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0ce690 tx=0x7f7f44009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:42.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:42.864+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7f4c05de50 con 0x7f7f5c0709b0 2024-09-21T07:26:43.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.036+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f5c1fc4d0 con 0x7f7f38073200 2024-09-21T07:26:43.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.040+0000 7f7f53400640 1 -- 172.21.15.64:0/928871174 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251997 (secure 0 0 0) 0x7f7f5c1fc4d0 con 0x7f7f38073200 2024-09-21T07:26:43.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:43.050 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 msgr2=0x7f7f38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 0x7f7f38075710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0ce690 tx=0x7f7f44009040 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 msgr2=0x7f7f5c166d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c3f0 tx=0x7f7f4c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 shutdown_connections 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f38073200 0x7f7f38075710 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c09c4f0 0x7f7f5c1fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f5c15edb0 0x7f7f5c1f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 --2- 172.21.15.64:0/928871174 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5c0709b0 0x7f7f5c166d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 >> 172.21.15.64:0/928871174 conn(0x7f7f5c0ccbe0 msgr2=0x7f7f5c159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 shutdown_connections 2024-09-21T07:26:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.044+0000 7f7f61800640 1 -- 172.21.15.64:0/928871174 wait complete. 2024-09-21T07:26:43.071 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-21T07:26:41.481801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294476,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680244,"statfs":{"total":773094113280,"available":772792569856,"internally_reserved":0,"allocated":7675904,"data_stored":4095876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":293654067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002403"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300993+0000","last_change":"2024-09-21T07:26:33.733709+0000","last_active":"2024-09-21T07:26:35.300993+0000","last_peered":"2024-09-21T07:26:35.300993+0000","last_clean":"2024-09-21T07:26:35.300993+0000","last_became_active":"2024-09-21T07:26:33.733351+0000","last_became_peered":"2024-09-21T07:26:33.733351+0000","last_unstale":"2024-09-21T07:26:35.300993+0000","last_undegraded":"2024-09-21T07:26:35.300993+0000","last_fullsized":"2024-09-21T07:26:35.300993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:24.882255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300763+0000","last_change":"2024-09-21T07:26:33.706258+0000","last_active":"2024-09-21T07:26:35.300763+0000","last_peered":"2024-09-21T07:26:35.300763+0000","last_clean":"2024-09-21T07:26:35.300763+0000","last_became_active":"2024-09-21T07:26:33.705905+0000","last_became_peered":"2024-09-21T07:26:33.705905+0000","last_unstale":"2024-09-21T07:26:35.300763+0000","last_undegraded":"2024-09-21T07:26:35.300763+0000","last_fullsized":"2024-09-21T07:26:35.300763+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.282369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829883+0000","last_change":"2024-09-21T07:26:33.719818+0000","last_active":"2024-09-21T07:26:34.829883+0000","last_peered":"2024-09-21T07:26:34.829883+0000","last_clean":"2024-09-21T07:26:34.829883+0000","last_became_active":"2024-09-21T07:26:33.719487+0000","last_became_peered":"2024-09-21T07:26:33.719487+0000","last_unstale":"2024-09-21T07:26:34.829883+0000","last_undegraded":"2024-09-21T07:26:34.829883+0000","last_fullsized":"2024-09-21T07:26:34.829883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:40.586013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706126+0000","last_change":"2024-09-21T07:26:33.721286+0000","last_active":"2024-09-21T07:26:34.706126+0000","last_peered":"2024-09-21T07:26:34.706126+0000","last_clean":"2024-09-21T07:26:34.706126+0000","last_became_active":"2024-09-21T07:26:33.719160+0000","last_became_peered":"2024-09-21T07:26:33.719160+0000","last_unstale":"2024-09-21T07:26:34.706126+0000","last_undegraded":"2024-09-21T07:26:34.706126+0000","last_fullsized":"2024-09-21T07:26:34.706126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:24.345926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300030+0000","last_change":"2024-09-21T07:26:33.719273+0000","last_active":"2024-09-21T07:26:35.300030+0000","last_peered":"2024-09-21T07:26:35.300030+0000","last_clean":"2024-09-21T07:26:35.300030+0000","last_became_active":"2024-09-21T07:26:33.718961+0000","last_became_peered":"2024-09-21T07:26:33.718961+0000","last_unstale":"2024-09-21T07:26:35.300030+0000","last_undegraded":"2024-09-21T07:26:35.300030+0000","last_fullsized":"2024-09-21T07:26:35.300030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.707093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299687+0000","last_change":"2024-09-21T07:26:33.720121+0000","last_active":"2024-09-21T07:26:35.299687+0000","last_peered":"2024-09-21T07:26:35.299687+0000","last_clean":"2024-09-21T07:26:35.299687+0000","last_became_active":"2024-09-21T07:26:33.719688+0000","last_became_peered":"2024-09-21T07:26:33.719688+0000","last_unstale":"2024-09-21T07:26:35.299687+0000","last_undegraded":"2024-09-21T07:26:35.299687+0000","last_fullsized":"2024-09-21T07:26:35.299687+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.375975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705213+0000","last_change":"2024-09-21T07:26:33.718761+0000","last_active":"2024-09-21T07:26:34.705213+0000","last_peered":"2024-09-21T07:26:34.705213+0000","last_clean":"2024-09-21T07:26:34.705213+0000","last_became_active":"2024-09-21T07:26:33.718464+0000","last_became_peered":"2024-09-21T07:26:33.718464+0000","last_unstale":"2024-09-21T07:26:34.705213+0000","last_undegraded":"2024-09-21T07:26:34.705213+0000","last_fullsized":"2024-09-21T07:26:34.705213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:25.496538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718562+0000","last_change":"2024-09-21T07:26:33.721359+0000","last_active":"2024-09-21T07:26:34.718562+0000","last_peered":"2024-09-21T07:26:34.718562+0000","last_clean":"2024-09-21T07:26:34.718562+0000","last_became_active":"2024-09-21T07:26:33.721046+0000","last_became_peered":"2024-09-21T07:26:33.721046+0000","last_unstale":"2024-09-21T07:26:34.718562+0000","last_undegraded":"2024-09-21T07:26:34.718562+0000","last_fullsized":"2024-09-21T07:26:34.718562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:14.099237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830201+0000","last_change":"2024-09-21T07:26:33.735244+0000","last_active":"2024-09-21T07:26:34.830201+0000","last_peered":"2024-09-21T07:26:34.830201+0000","last_clean":"2024-09-21T07:26:34.830201+0000","last_became_active":"2024-09-21T07:26:33.734869+0000","last_became_peered":"2024-09-21T07:26:33.734869+0000","last_unstale":"2024-09-21T07:26:34.830201+0000","last_undegraded":"2024-09-21T07:26:34.830201+0000","last_fullsized":"2024-09-21T07:26:34.830201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:56.186491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829783+0000","last_change":"2024-09-21T07:26:33.729856+0000","last_active":"2024-09-21T07:26:34.829783+0000","last_peered":"2024-09-21T07:26:34.829783+0000","last_clean":"2024-09-21T07:26:34.829783+0000","last_became_active":"2024-09-21T07:26:33.728193+0000","last_became_peered":"2024-09-21T07:26:33.728193+0000","last_unstale":"2024-09-21T07:26:34.829783+0000","last_undegraded":"2024-09-21T07:26:34.829783+0000","last_fullsized":"2024-09-21T07:26:34.829783+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:14.296128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706150+0000","last_change":"2024-09-21T07:26:33.711125+0000","last_active":"2024-09-21T07:26:34.706150+0000","last_peered":"2024-09-21T07:26:34.706150+0000","last_clean":"2024-09-21T07:26:34.706150+0000","last_became_active":"2024-09-21T07:26:33.710817+0000","last_became_peered":"2024-09-21T07:26:33.710817+0000","last_unstale":"2024-09-21T07:26:34.706150+0000","last_undegraded":"2024-09-21T07:26:34.706150+0000","last_fullsized":"2024-09-21T07:26:34.706150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:07.077043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718565+0000","last_change":"2024-09-21T07:26:33.724781+0000","last_active":"2024-09-21T07:26:34.718565+0000","last_peered":"2024-09-21T07:26:34.718565+0000","last_clean":"2024-09-21T07:26:34.718565+0000","last_became_active":"2024-09-21T07:26:33.723984+0000","last_became_peered":"2024-09-21T07:26:33.723984+0000","last_unstale":"2024-09-21T07:26:34.718565+0000","last_undegraded":"2024-09-21T07:26:34.718565+0000","last_fullsized":"2024-09-21T07:26:34.718565+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:46.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718757+0000","last_change":"2024-09-21T07:26:33.725501+0000","last_active":"2024-09-21T07:26:34.718757+0000","last_peered":"2024-09-21T07:26:34.718757+0000","last_clean":"2024-09-21T07:26:34.718757+0000","last_became_active":"2024-09-21T07:26:33.725190+0000","last_became_peered":"2024-09-21T07:26:33.725190+0000","last_unstale":"2024-09-21T07:26:34.718757+0000","last_undegraded":"2024-09-21T07:26:34.718757+0000","last_fullsized":"2024-09-21T07:26:34.718757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829991+0000","last_change":"2024-09-21T07:26:33.727636+0000","last_active":"2024-09-21T07:26:34.829991+0000","last_peered":"2024-09-21T07:26:34.829991+0000","last_clean":"2024-09-21T07:26:34.829991+0000","last_became_active":"2024-09-21T07:26:33.718633+0000","last_became_peered":"2024-09-21T07:26:33.718633+0000","last_unstale":"2024-09-21T07:26:34.829991+0000","last_undegraded":"2024-09-21T07:26:34.829991+0000","last_fullsized":"2024-09-21T07:26:34.829991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:37.109885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829845+0000","last_change":"2024-09-21T07:26:33.714569+0000","last_active":"2024-09-21T07:26:34.829845+0000","last_peered":"2024-09-21T07:26:34.829845+0000","last_clean":"2024-09-21T07:26:34.829845+0000","last_became_active":"2024-09-21T07:26:33.714245+0000","last_became_peered":"2024-09-21T07:26:33.714245+0000","last_unstale":"2024-09-21T07:26:34.829845+0000","last_undegraded":"2024-09-21T07:26:34.829845+0000","last_fullsized":"2024-09-21T07:26:34.829845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.617192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705296+0000","last_change":"2024-09-21T07:26:33.720070+0000","last_active":"2024-09-21T07:26:34.705296+0000","last_peered":"2024-09-21T07:26:34.705296+0000","last_clean":"2024-09-21T07:26:34.705296+0000","last_became_active":"2024-09-21T07:26:33.719721+0000","last_became_peered":"2024-09-21T07:26:33.719721+0000","last_unstale":"2024-09-21T07:26:34.705296+0000","last_undegraded":"2024-09-21T07:26:34.705296+0000","last_fullsized":"2024-09-21T07:26:34.705296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.461750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.301041+0000","last_change":"2024-09-21T07:26:33.719017+0000","last_active":"2024-09-21T07:26:35.301041+0000","last_peered":"2024-09-21T07:26:35.301041+0000","last_clean":"2024-09-21T07:26:35.301041+0000","last_became_active":"2024-09-21T07:26:33.718705+0000","last_became_peered":"2024-09-21T07:26:33.718705+0000","last_unstale":"2024-09-21T07:26:35.301041+0000","last_undegraded":"2024-09-21T07:26:35.301041+0000","last_fullsized":"2024-09-21T07:26:35.301041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:14.082233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706626+0000","last_change":"2024-09-21T07:26:33.706968+0000","last_active":"2024-09-21T07:26:34.706626+0000","last_peered":"2024-09-21T07:26:34.706626+0000","last_clean":"2024-09-21T07:26:34.706626+0000","last_became_active":"2024-09-21T07:26:33.706646+0000","last_became_peered":"2024-09-21T07:26:33.706646+0000","last_unstale":"2024-09-21T07:26:34.706626+0000","last_undegraded":"2024-09-21T07:26:34.706626+0000","last_fullsized":"2024-09-21T07:26:34.706626+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:56.825599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300446+0000","last_change":"2024-09-21T07:26:33.725121+0000","last_active":"2024-09-21T07:26:35.300446+0000","last_peered":"2024-09-21T07:26:35.300446+0000","last_clean":"2024-09-21T07:26:35.300446+0000","last_became_active":"2024-09-21T07:26:33.716738+0000","last_became_peered":"2024-09-21T07:26:33.716738+0000","last_unstale":"2024-09-21T07:26:35.300446+0000","last_undegraded":"2024-09-21T07:26:35.300446+0000","last_fullsized":"2024-09-21T07:26:35.300446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:51.107803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707622+0000","last_change":"2024-09-21T07:26:33.714237+0000","last_active":"2024-09-21T07:26:34.707622+0000","last_peered":"2024-09-21T07:26:34.707622+0000","last_clean":"2024-09-21T07:26:34.707622+0000","last_became_active":"2024-09-21T07:26:33.713885+0000","last_became_peered":"2024-09-21T07:26:33.713885+0000","last_unstale":"2024-09-21T07:26:34.707622+0000","last_undegraded":"2024-09-21T07:26:34.707622+0000","last_fullsized":"2024-09-21T07:26:34.707622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:41.615956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718964+0000","last_change":"2024-09-21T07:26:33.729057+0000","last_active":"2024-09-21T07:26:34.718964+0000","last_peered":"2024-09-21T07:26:34.718964+0000","last_clean":"2024-09-21T07:26:34.718964+0000","last_became_active":"2024-09-21T07:26:33.728665+0000","last_became_peered":"2024-09-21T07:26:33.728665+0000","last_unstale":"2024-09-21T07:26:34.718964+0000","last_undegraded":"2024-09-21T07:26:34.718964+0000","last_fullsized":"2024-09-21T07:26:34.718964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:40.368251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707273+0000","last_change":"2024-09-21T07:26:33.716014+0000","last_active":"2024-09-21T07:26:34.707273+0000","last_peered":"2024-09-21T07:26:34.707273+0000","last_clean":"2024-09-21T07:26:34.707273+0000","last_became_active":"2024-09-21T07:26:33.715646+0000","last_became_peered":"2024-09-21T07:26:33.715646+0000","last_unstale":"2024-09-21T07:26:34.707273+0000","last_undegraded":"2024-09-21T07:26:34.707273+0000","last_fullsized":"2024-09-21T07:26:34.707273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:54.097384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707232+0000","last_change":"2024-09-21T07:26:33.715793+0000","last_active":"2024-09-21T07:26:34.707232+0000","last_peered":"2024-09-21T07:26:34.707232+0000","last_clean":"2024-09-21T07:26:34.707232+0000","last_became_active":"2024-09-21T07:26:33.715534+0000","last_became_peered":"2024-09-21T07:26:33.715534+0000","last_unstale":"2024-09-21T07:26:34.707232+0000","last_undegraded":"2024-09-21T07:26:34.707232+0000","last_fullsized":"2024-09-21T07:26:34.707232+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:00.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829471+0000","last_change":"2024-09-21T07:26:33.719495+0000","last_active":"2024-09-21T07:26:34.829471+0000","last_peered":"2024-09-21T07:26:34.829471+0000","last_clean":"2024-09-21T07:26:34.829471+0000","last_became_active":"2024-09-21T07:26:33.719197+0000","last_became_peered":"2024-09-21T07:26:33.719197+0000","last_unstale":"2024-09-21T07:26:34.829471+0000","last_undegraded":"2024-09-21T07:26:34.829471+0000","last_fullsized":"2024-09-21T07:26:34.829471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:19.973936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718752+0000","last_change":"2024-09-21T07:26:33.729253+0000","last_active":"2024-09-21T07:26:34.718752+0000","last_peered":"2024-09-21T07:26:34.718752+0000","last_clean":"2024-09-21T07:26:34.718752+0000","last_became_active":"2024-09-21T07:26:33.728705+0000","last_became_peered":"2024-09-21T07:26:33.728705+0000","last_unstale":"2024-09-21T07:26:34.718752+0000","last_undegraded":"2024-09-21T07:26:34.718752+0000","last_fullsized":"2024-09-21T07:26:34.718752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:31.574691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718975+0000","last_change":"2024-09-21T07:26:33.729098+0000","last_active":"2024-09-21T07:26:34.718975+0000","last_peered":"2024-09-21T07:26:34.718975+0000","last_clean":"2024-09-21T07:26:34.718975+0000","last_became_active":"2024-09-21T07:26:33.728688+0000","last_became_peered":"2024-09-21T07:26:33.728688+0000","last_unstale":"2024-09-21T07:26:34.718975+0000","last_undegraded":"2024-09-21T07:26:34.718975+0000","last_fullsized":"2024-09-21T07:26:34.718975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:46.875616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706519+0000","last_change":"2024-09-21T07:26:33.714195+0000","last_active":"2024-09-21T07:26:34.706519+0000","last_peered":"2024-09-21T07:26:34.706519+0000","last_clean":"2024-09-21T07:26:34.706519+0000","last_became_active":"2024-09-21T07:26:33.713828+0000","last_became_peered":"2024-09-21T07:26:33.713828+0000","last_unstale":"2024-09-21T07:26:34.706519+0000","last_undegraded":"2024-09-21T07:26:34.706519+0000","last_fullsized":"2024-09-21T07:26:34.706519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:17.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300406+0000","last_change":"2024-09-21T07:26:33.718167+0000","last_active":"2024-09-21T07:26:35.300406+0000","last_peered":"2024-09-21T07:26:35.300406+0000","last_clean":"2024-09-21T07:26:35.300406+0000","last_became_active":"2024-09-21T07:26:33.717805+0000","last_became_peered":"2024-09-21T07:26:33.717805+0000","last_unstale":"2024-09-21T07:26:35.300406+0000","last_undegraded":"2024-09-21T07:26:35.300406+0000","last_fullsized":"2024-09-21T07:26:35.300406+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.831597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830261+0000","last_change":"2024-09-21T07:26:33.731886+0000","last_active":"2024-09-21T07:26:34.830261+0000","last_peered":"2024-09-21T07:26:34.830261+0000","last_clean":"2024-09-21T07:26:34.830261+0000","last_became_active":"2024-09-21T07:26:33.731590+0000","last_became_peered":"2024-09-21T07:26:33.731590+0000","last_unstale":"2024-09-21T07:26:34.830261+0000","last_undegraded":"2024-09-21T07:26:34.830261+0000","last_fullsized":"2024-09-21T07:26:34.830261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:36.960428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718648+0000","last_change":"2024-09-21T07:26:33.729790+0000","last_active":"2024-09-21T07:26:34.718648+0000","last_peered":"2024-09-21T07:26:34.718648+0000","last_clean":"2024-09-21T07:26:34.718648+0000","last_became_active":"2024-09-21T07:26:33.729432+0000","last_became_peered":"2024-09-21T07:26:33.729432+0000","last_unstale":"2024-09-21T07:26:34.718648+0000","last_undegraded":"2024-09-21T07:26:34.718648+0000","last_fullsized":"2024-09-21T07:26:34.718648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:11.708764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705560+0000","last_change":"2024-09-21T07:26:33.715108+0000","last_active":"2024-09-21T07:26:34.705560+0000","last_peered":"2024-09-21T07:26:34.705560+0000","last_clean":"2024-09-21T07:26:34.705560+0000","last_became_active":"2024-09-21T07:26:33.714783+0000","last_became_peered":"2024-09-21T07:26:33.714783+0000","last_unstale":"2024-09-21T07:26:34.705560+0000","last_undegraded":"2024-09-21T07:26:34.705560+0000","last_fullsized":"2024-09-21T07:26:34.705560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:45.900587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299387+0000","last_change":"2024-09-21T07:26:33.711137+0000","last_active":"2024-09-21T07:26:35.299387+0000","last_peered":"2024-09-21T07:26:35.299387+0000","last_clean":"2024-09-21T07:26:35.299387+0000","last_became_active":"2024-09-21T07:26:33.710796+0000","last_became_peered":"2024-09-21T07:26:33.710796+0000","last_unstale":"2024-09-21T07:26:35.299387+0000","last_undegraded":"2024-09-21T07:26:35.299387+0000","last_fullsized":"2024-09-21T07:26:35.299387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:09.494028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300421+0000","last_change":"2024-09-21T07:26:33.708441+0000","last_active":"2024-09-21T07:26:35.300421+0000","last_peered":"2024-09-21T07:26:35.300421+0000","last_clean":"2024-09-21T07:26:35.300421+0000","last_became_active":"2024-09-21T07:26:33.708123+0000","last_became_peered":"2024-09-21T07:26:33.708123+0000","last_unstale":"2024-09-21T07:26:35.300421+0000","last_undegraded":"2024-09-21T07:26:35.300421+0000","last_fullsized":"2024-09-21T07:26:35.300421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:13.944307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.301034+0000","last_change":"2024-09-21T07:26:32.713882+0000","last_active":"2024-09-21T07:26:35.301034+0000","last_peered":"2024-09-21T07:26:35.301034+0000","last_clean":"2024-09-21T07:26:35.301034+0000","last_became_active":"2024-09-21T07:26:32.713390+0000","last_became_peered":"2024-09-21T07:26:32.713390+0000","last_unstale":"2024-09-21T07:26:35.301034+0000","last_undegraded":"2024-09-21T07:26:35.301034+0000","last_fullsized":"2024-09-21T07:26:35.301034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:17.039493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706718+0000","last_change":"2024-09-21T07:26:33.703002+0000","last_active":"2024-09-21T07:26:34.706718+0000","last_peered":"2024-09-21T07:26:34.706718+0000","last_clean":"2024-09-21T07:26:34.706718+0000","last_became_active":"2024-09-21T07:26:33.702663+0000","last_became_peered":"2024-09-21T07:26:33.702663+0000","last_unstale":"2024-09-21T07:26:34.706718+0000","last_undegraded":"2024-09-21T07:26:34.706718+0000","last_fullsized":"2024-09-21T07:26:34.706718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.707093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300629+0000","last_change":"2024-09-21T07:26:32.712358+0000","last_active":"2024-09-21T07:26:35.300629+0000","last_peered":"2024-09-21T07:26:35.300629+0000","last_clean":"2024-09-21T07:26:35.300629+0000","last_became_active":"2024-09-21T07:26:32.712002+0000","last_became_peered":"2024-09-21T07:26:32.712002+0000","last_unstale":"2024-09-21T07:26:35.300629+0000","last_undegraded":"2024-09-21T07:26:35.300629+0000","last_fullsized":"2024-09-21T07:26:35.300629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.546546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300467+0000","last_change":"2024-09-21T07:26:33.714050+0000","last_active":"2024-09-21T07:26:35.300467+0000","last_peered":"2024-09-21T07:26:35.300467+0000","last_clean":"2024-09-21T07:26:35.300467+0000","last_became_active":"2024-09-21T07:26:33.713528+0000","last_became_peered":"2024-09-21T07:26:33.713528+0000","last_unstale":"2024-09-21T07:26:35.300467+0000","last_undegraded":"2024-09-21T07:26:35.300467+0000","last_fullsized":"2024-09-21T07:26:35.300467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:45.012726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299961+0000","last_change":"2024-09-21T07:26:32.712794+0000","last_active":"2024-09-21T07:26:35.299961+0000","last_peered":"2024-09-21T07:26:35.299961+0000","last_clean":"2024-09-21T07:26:35.299961+0000","last_became_active":"2024-09-21T07:26:32.712443+0000","last_became_peered":"2024-09-21T07:26:32.712443+0000","last_unstale":"2024-09-21T07:26:35.299961+0000","last_undegraded":"2024-09-21T07:26:35.299961+0000","last_fullsized":"2024-09-21T07:26:35.299961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:19.081099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830055+0000","last_change":"2024-09-21T07:26:33.728398+0000","last_active":"2024-09-21T07:26:34.830055+0000","last_peered":"2024-09-21T07:26:34.830055+0000","last_clean":"2024-09-21T07:26:34.830055+0000","last_became_active":"2024-09-21T07:26:33.728110+0000","last_became_peered":"2024-09-21T07:26:33.728110+0000","last_unstale":"2024-09-21T07:26:34.830055+0000","last_undegraded":"2024-09-21T07:26:34.830055+0000","last_fullsized":"2024-09-21T07:26:34.830055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:40.217242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300144+0000","last_change":"2024-09-21T07:26:32.705500+0000","last_active":"2024-09-21T07:26:35.300144+0000","last_peered":"2024-09-21T07:26:35.300144+0000","last_clean":"2024-09-21T07:26:35.300144+0000","last_became_active":"2024-09-21T07:26:32.705189+0000","last_became_peered":"2024-09-21T07:26:32.705189+0000","last_unstale":"2024-09-21T07:26:35.300144+0000","last_undegraded":"2024-09-21T07:26:35.300144+0000","last_fullsized":"2024-09-21T07:26:35.300144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:38.999417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705216+0000","last_change":"2024-09-21T07:26:33.709282+0000","last_active":"2024-09-21T07:26:34.705216+0000","last_peered":"2024-09-21T07:26:34.705216+0000","last_clean":"2024-09-21T07:26:34.705216+0000","last_became_active":"2024-09-21T07:26:33.708939+0000","last_became_peered":"2024-09-21T07:26:33.708939+0000","last_unstale":"2024-09-21T07:26:34.705216+0000","last_undegraded":"2024-09-21T07:26:34.705216+0000","last_fullsized":"2024-09-21T07:26:34.705216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:04.952982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707548+0000","last_change":"2024-09-21T07:26:32.705538+0000","last_active":"2024-09-21T07:26:34.707548+0000","last_peered":"2024-09-21T07:26:34.707548+0000","last_clean":"2024-09-21T07:26:34.707548+0000","last_became_active":"2024-09-21T07:26:32.705215+0000","last_became_peered":"2024-09-21T07:26:32.705215+0000","last_unstale":"2024-09-21T07:26:34.707548+0000","last_undegraded":"2024-09-21T07:26:34.707548+0000","last_fullsized":"2024-09-21T07:26:34.707548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:36.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300221+0000","last_change":"2024-09-21T07:26:33.717976+0000","last_active":"2024-09-21T07:26:35.300221+0000","last_peered":"2024-09-21T07:26:35.300221+0000","last_clean":"2024-09-21T07:26:35.300221+0000","last_became_active":"2024-09-21T07:26:33.717694+0000","last_became_peered":"2024-09-21T07:26:33.717694+0000","last_unstale":"2024-09-21T07:26:35.300221+0000","last_undegraded":"2024-09-21T07:26:35.300221+0000","last_fullsized":"2024-09-21T07:26:35.300221+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:59.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707186+0000","last_change":"2024-09-21T07:26:32.706993+0000","last_active":"2024-09-21T07:26:34.707186+0000","last_peered":"2024-09-21T07:26:34.707186+0000","last_clean":"2024-09-21T07:26:34.707186+0000","last_became_active":"2024-09-21T07:26:32.706667+0000","last_became_peered":"2024-09-21T07:26:32.706667+0000","last_unstale":"2024-09-21T07:26:34.707186+0000","last_undegraded":"2024-09-21T07:26:34.707186+0000","last_fullsized":"2024-09-21T07:26:34.707186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:23.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300009+0000","last_change":"2024-09-21T07:26:33.700583+0000","last_active":"2024-09-21T07:26:35.300009+0000","last_peered":"2024-09-21T07:26:35.300009+0000","last_clean":"2024-09-21T07:26:35.300009+0000","last_became_active":"2024-09-21T07:26:33.699910+0000","last_became_peered":"2024-09-21T07:26:33.699910+0000","last_unstale":"2024-09-21T07:26:35.300009+0000","last_undegraded":"2024-09-21T07:26:35.300009+0000","last_fullsized":"2024-09-21T07:26:35.300009+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:13.337752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707153+0000","last_change":"2024-09-21T07:26:32.704657+0000","last_active":"2024-09-21T07:26:34.707153+0000","last_peered":"2024-09-21T07:26:34.707153+0000","last_clean":"2024-09-21T07:26:34.707153+0000","last_became_active":"2024-09-21T07:26:32.704359+0000","last_became_peered":"2024-09-21T07:26:32.704359+0000","last_unstale":"2024-09-21T07:26:34.707153+0000","last_undegraded":"2024-09-21T07:26:34.707153+0000","last_fullsized":"2024-09-21T07:26:34.707153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:13.239895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707601+0000","last_change":"2024-09-21T07:26:33.715873+0000","last_active":"2024-09-21T07:26:34.707601+0000","last_peered":"2024-09-21T07:26:34.707601+0000","last_clean":"2024-09-21T07:26:34.707601+0000","last_became_active":"2024-09-21T07:26:33.715561+0000","last_became_peered":"2024-09-21T07:26:33.715561+0000","last_unstale":"2024-09-21T07:26:34.707601+0000","last_undegraded":"2024-09-21T07:26:34.707601+0000","last_fullsized":"2024-09-21T07:26:34.707601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:05.220655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299797+0000","last_change":"2024-09-21T07:26:32.710133+0000","last_active":"2024-09-21T07:26:35.299797+0000","last_peered":"2024-09-21T07:26:35.299797+0000","last_clean":"2024-09-21T07:26:35.299797+0000","last_became_active":"2024-09-21T07:26:32.709770+0000","last_became_peered":"2024-09-21T07:26:32.709770+0000","last_unstale":"2024-09-21T07:26:35.299797+0000","last_undegraded":"2024-09-21T07:26:35.299797+0000","last_fullsized":"2024-09-21T07:26:35.299797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:44.100405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300642+0000","last_change":"2024-09-21T07:26:33.711299+0000","last_active":"2024-09-21T07:26:35.300642+0000","last_peered":"2024-09-21T07:26:35.300642+0000","last_clean":"2024-09-21T07:26:35.300642+0000","last_became_active":"2024-09-21T07:26:33.711004+0000","last_became_peered":"2024-09-21T07:26:33.711004+0000","last_unstale":"2024-09-21T07:26:35.300642+0000","last_undegraded":"2024-09-21T07:26:35.300642+0000","last_fullsized":"2024-09-21T07:26:35.300642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:12.302101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830191+0000","last_change":"2024-09-21T07:26:32.717966+0000","last_active":"2024-09-21T07:26:34.830191+0000","last_peered":"2024-09-21T07:26:34.830191+0000","last_clean":"2024-09-21T07:26:34.830191+0000","last_became_active":"2024-09-21T07:26:32.717578+0000","last_became_peered":"2024-09-21T07:26:32.717578+0000","last_unstale":"2024-09-21T07:26:34.830191+0000","last_undegraded":"2024-09-21T07:26:34.830191+0000","last_fullsized":"2024-09-21T07:26:34.830191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:06.698663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707654+0000","last_change":"2024-09-21T07:26:33.726854+0000","last_active":"2024-09-21T07:26:34.707654+0000","last_peered":"2024-09-21T07:26:34.707654+0000","last_clean":"2024-09-21T07:26:34.707654+0000","last_became_active":"2024-09-21T07:26:33.726465+0000","last_became_peered":"2024-09-21T07:26:33.726465+0000","last_unstale":"2024-09-21T07:26:34.707654+0000","last_undegraded":"2024-09-21T07:26:34.707654+0000","last_fullsized":"2024-09-21T07:26:34.707654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:43.518328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706627+0000","last_change":"2024-09-21T07:26:32.703889+0000","last_active":"2024-09-21T07:26:34.706627+0000","last_peered":"2024-09-21T07:26:34.706627+0000","last_clean":"2024-09-21T07:26:34.706627+0000","last_became_active":"2024-09-21T07:26:32.703546+0000","last_became_peered":"2024-09-21T07:26:32.703546+0000","last_unstale":"2024-09-21T07:26:34.706627+0000","last_undegraded":"2024-09-21T07:26:34.706627+0000","last_fullsized":"2024-09-21T07:26:34.706627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:20.664780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300623+0000","last_change":"2024-09-21T07:26:33.726254+0000","last_active":"2024-09-21T07:26:35.300623+0000","last_peered":"2024-09-21T07:26:35.300623+0000","last_clean":"2024-09-21T07:26:35.300623+0000","last_became_active":"2024-09-21T07:26:33.725916+0000","last_became_peered":"2024-09-21T07:26:33.725916+0000","last_unstale":"2024-09-21T07:26:35.300623+0000","last_undegraded":"2024-09-21T07:26:35.300623+0000","last_fullsized":"2024-09-21T07:26:35.300623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:06.772773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829661+0000","last_change":"2024-09-21T07:26:32.717213+0000","last_active":"2024-09-21T07:26:34.829661+0000","last_peered":"2024-09-21T07:26:34.829661+0000","last_clean":"2024-09-21T07:26:34.829661+0000","last_became_active":"2024-09-21T07:26:32.716200+0000","last_became_peered":"2024-09-21T07:26:32.716200+0000","last_unstale":"2024-09-21T07:26:34.829661+0000","last_undegraded":"2024-09-21T07:26:34.829661+0000","last_fullsized":"2024-09-21T07:26:34.829661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:05.433165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706709+0000","last_change":"2024-09-21T07:26:33.712628+0000","last_active":"2024-09-21T07:26:34.706709+0000","last_peered":"2024-09-21T07:26:34.706709+0000","last_clean":"2024-09-21T07:26:34.706709+0000","last_became_active":"2024-09-21T07:26:33.706324+0000","last_became_peered":"2024-09-21T07:26:33.706324+0000","last_unstale":"2024-09-21T07:26:34.706709+0000","last_undegraded":"2024-09-21T07:26:34.706709+0000","last_fullsized":"2024-09-21T07:26:34.706709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:18.544180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300763+0000","last_change":"2024-09-21T07:26:32.710099+0000","last_active":"2024-09-21T07:26:35.300763+0000","last_peered":"2024-09-21T07:26:35.300763+0000","last_clean":"2024-09-21T07:26:35.300763+0000","last_became_active":"2024-09-21T07:26:32.709379+0000","last_became_peered":"2024-09-21T07:26:32.709379+0000","last_unstale":"2024-09-21T07:26:35.300763+0000","last_undegraded":"2024-09-21T07:26:35.300763+0000","last_fullsized":"2024-09-21T07:26:35.300763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:25.243614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705553+0000","last_change":"2024-09-21T07:26:33.732323+0000","last_active":"2024-09-21T07:26:34.705553+0000","last_peered":"2024-09-21T07:26:34.705553+0000","last_clean":"2024-09-21T07:26:34.705553+0000","last_became_active":"2024-09-21T07:26:33.731777+0000","last_became_peered":"2024-09-21T07:26:33.731777+0000","last_unstale":"2024-09-21T07:26:34.705553+0000","last_undegraded":"2024-09-21T07:26:34.705553+0000","last_fullsized":"2024-09-21T07:26:34.705553+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.592194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829877+0000","last_change":"2024-09-21T07:26:32.713456+0000","last_active":"2024-09-21T07:26:34.829877+0000","last_peered":"2024-09-21T07:26:34.829877+0000","last_clean":"2024-09-21T07:26:34.829877+0000","last_became_active":"2024-09-21T07:26:32.713105+0000","last_became_peered":"2024-09-21T07:26:32.713105+0000","last_unstale":"2024-09-21T07:26:34.829877+0000","last_undegraded":"2024-09-21T07:26:34.829877+0000","last_fullsized":"2024-09-21T07:26:34.829877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.016585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718785+0000","last_change":"2024-09-21T07:26:33.717966+0000","last_active":"2024-09-21T07:26:34.718785+0000","last_peered":"2024-09-21T07:26:34.718785+0000","last_clean":"2024-09-21T07:26:34.718785+0000","last_became_active":"2024-09-21T07:26:33.717640+0000","last_became_peered":"2024-09-21T07:26:33.717640+0000","last_unstale":"2024-09-21T07:26:34.718785+0000","last_undegraded":"2024-09-21T07:26:34.718785+0000","last_fullsized":"2024-09-21T07:26:34.718785+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:12.799566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718259+0000","last_change":"2024-09-21T07:26:32.716524+0000","last_active":"2024-09-21T07:26:34.718259+0000","last_peered":"2024-09-21T07:26:34.718259+0000","last_clean":"2024-09-21T07:26:34.718259+0000","last_became_active":"2024-09-21T07:26:32.716115+0000","last_became_peered":"2024-09-21T07:26:32.716115+0000","last_unstale":"2024-09-21T07:26:34.718259+0000","last_undegraded":"2024-09-21T07:26:34.718259+0000","last_fullsized":"2024-09-21T07:26:34.718259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.017561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299976+0000","last_change":"2024-09-21T07:26:33.725831+0000","last_active":"2024-09-21T07:26:35.299976+0000","last_peered":"2024-09-21T07:26:35.299976+0000","last_clean":"2024-09-21T07:26:35.299976+0000","last_became_active":"2024-09-21T07:26:33.716751+0000","last_became_peered":"2024-09-21T07:26:33.716751+0000","last_unstale":"2024-09-21T07:26:35.299976+0000","last_undegraded":"2024-09-21T07:26:35.299976+0000","last_fullsized":"2024-09-21T07:26:35.299976+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:07.077043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829769+0000","last_change":"2024-09-21T07:26:32.715629+0000","last_active":"2024-09-21T07:26:34.829769+0000","last_peered":"2024-09-21T07:26:34.829769+0000","last_clean":"2024-09-21T07:26:34.829769+0000","last_became_active":"2024-09-21T07:26:32.714299+0000","last_became_peered":"2024-09-21T07:26:32.714299+0000","last_unstale":"2024-09-21T07:26:34.829769+0000","last_undegraded":"2024-09-21T07:26:34.829769+0000","last_fullsized":"2024-09-21T07:26:34.829769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.440088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300113+0000","last_change":"2024-09-21T07:26:33.732748+0000","last_active":"2024-09-21T07:26:35.300113+0000","last_peered":"2024-09-21T07:26:35.300113+0000","last_clean":"2024-09-21T07:26:35.300113+0000","last_became_active":"2024-09-21T07:26:33.732400+0000","last_became_peered":"2024-09-21T07:26:33.732400+0000","last_unstale":"2024-09-21T07:26:35.300113+0000","last_undegraded":"2024-09-21T07:26:35.300113+0000","last_fullsized":"2024-09-21T07:26:35.300113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:21.570517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":23,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705329+0000","last_change":"2024-09-21T07:26:32.711883+0000","last_active":"2024-09-21T07:26:34.705329+0000","last_peered":"2024-09-21T07:26:34.705329+0000","last_clean":"2024-09-21T07:26:34.705329+0000","last_became_active":"2024-09-21T07:26:32.711557+0000","last_became_peered":"2024-09-21T07:26:32.711557+0000","last_unstale":"2024-09-21T07:26:34.705329+0000","last_undegraded":"2024-09-21T07:26:34.705329+0000","last_fullsized":"2024-09-21T07:26:34.705329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:19.354237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830176+0000","last_change":"2024-09-21T07:26:33.732772+0000","last_active":"2024-09-21T07:26:34.830176+0000","last_peered":"2024-09-21T07:26:34.830176+0000","last_clean":"2024-09-21T07:26:34.830176+0000","last_became_active":"2024-09-21T07:26:33.732465+0000","last_became_peered":"2024-09-21T07:26:33.732465+0000","last_unstale":"2024-09-21T07:26:34.830176+0000","last_undegraded":"2024-09-21T07:26:34.830176+0000","last_fullsized":"2024-09-21T07:26:34.830176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:34.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718629+0000","last_change":"2024-09-21T07:26:32.717844+0000","last_active":"2024-09-21T07:26:34.718629+0000","last_peered":"2024-09-21T07:26:34.718629+0000","last_clean":"2024-09-21T07:26:34.718629+0000","last_became_active":"2024-09-21T07:26:32.717034+0000","last_became_peered":"2024-09-21T07:26:32.717034+0000","last_unstale":"2024-09-21T07:26:34.718629+0000","last_undegraded":"2024-09-21T07:26:34.718629+0000","last_fullsized":"2024-09-21T07:26:34.718629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:35.872907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300615+0000","last_change":"2024-09-21T07:26:33.719812+0000","last_active":"2024-09-21T07:26:35.300615+0000","last_peered":"2024-09-21T07:26:35.300615+0000","last_clean":"2024-09-21T07:26:35.300615+0000","last_became_active":"2024-09-21T07:26:33.714131+0000","last_became_peered":"2024-09-21T07:26:33.714131+0000","last_unstale":"2024-09-21T07:26:35.300615+0000","last_undegraded":"2024-09-21T07:26:35.300615+0000","last_fullsized":"2024-09-21T07:26:35.300615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:05.637051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829825+0000","last_change":"2024-09-21T07:26:32.715720+0000","last_active":"2024-09-21T07:26:34.829825+0000","last_peered":"2024-09-21T07:26:34.829825+0000","last_clean":"2024-09-21T07:26:34.829825+0000","last_became_active":"2024-09-21T07:26:32.715163+0000","last_became_peered":"2024-09-21T07:26:32.715163+0000","last_unstale":"2024-09-21T07:26:34.829825+0000","last_undegraded":"2024-09-21T07:26:34.829825+0000","last_fullsized":"2024-09-21T07:26:34.829825+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:47.679106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.706575+0000","last_change":"2024-09-21T07:26:33.716319+0000","last_active":"2024-09-21T07:26:34.706575+0000","last_peered":"2024-09-21T07:26:34.706575+0000","last_clean":"2024-09-21T07:26:34.706575+0000","last_became_active":"2024-09-21T07:26:33.715996+0000","last_became_peered":"2024-09-21T07:26:33.715996+0000","last_unstale":"2024-09-21T07:26:34.706575+0000","last_undegraded":"2024-09-21T07:26:34.706575+0000","last_fullsized":"2024-09-21T07:26:34.706575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:29.118321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829821+0000","last_change":"2024-09-21T07:26:32.717014+0000","last_active":"2024-09-21T07:26:34.829821+0000","last_peered":"2024-09-21T07:26:34.829821+0000","last_clean":"2024-09-21T07:26:34.829821+0000","last_became_active":"2024-09-21T07:26:32.716627+0000","last_became_peered":"2024-09-21T07:26:32.716627+0000","last_unstale":"2024-09-21T07:26:34.829821+0000","last_undegraded":"2024-09-21T07:26:34.829821+0000","last_fullsized":"2024-09-21T07:26:34.829821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:28.633725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300631+0000","last_change":"2024-09-21T07:26:33.705059+0000","last_active":"2024-09-21T07:26:35.300631+0000","last_peered":"2024-09-21T07:26:35.300631+0000","last_clean":"2024-09-21T07:26:35.300631+0000","last_became_active":"2024-09-21T07:26:33.704771+0000","last_became_peered":"2024-09-21T07:26:33.704771+0000","last_unstale":"2024-09-21T07:26:35.300631+0000","last_undegraded":"2024-09-21T07:26:35.300631+0000","last_fullsized":"2024-09-21T07:26:35.300631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:24.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707512+0000","last_change":"2024-09-21T07:26:32.707991+0000","last_active":"2024-09-21T07:26:34.707512+0000","last_peered":"2024-09-21T07:26:34.707512+0000","last_clean":"2024-09-21T07:26:34.707512+0000","last_became_active":"2024-09-21T07:26:32.707628+0000","last_became_peered":"2024-09-21T07:26:32.707628+0000","last_unstale":"2024-09-21T07:26:34.707512+0000","last_undegraded":"2024-09-21T07:26:34.707512+0000","last_fullsized":"2024-09-21T07:26:34.707512+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:08.739164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299512+0000","last_change":"2024-09-21T07:26:33.710870+0000","last_active":"2024-09-21T07:26:35.299512+0000","last_peered":"2024-09-21T07:26:35.299512+0000","last_clean":"2024-09-21T07:26:35.299512+0000","last_became_active":"2024-09-21T07:26:33.710566+0000","last_became_peered":"2024-09-21T07:26:33.710566+0000","last_unstale":"2024-09-21T07:26:35.299512+0000","last_undegraded":"2024-09-21T07:26:35.299512+0000","last_fullsized":"2024-09-21T07:26:35.299512+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:27.912360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299743+0000","last_change":"2024-09-21T07:26:32.707240+0000","last_active":"2024-09-21T07:26:35.299743+0000","last_peered":"2024-09-21T07:26:35.299743+0000","last_clean":"2024-09-21T07:26:35.299743+0000","last_became_active":"2024-09-21T07:26:32.706878+0000","last_became_peered":"2024-09-21T07:26:32.706878+0000","last_unstale":"2024-09-21T07:26:35.299743+0000","last_undegraded":"2024-09-21T07:26:35.299743+0000","last_fullsized":"2024-09-21T07:26:35.299743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:45.550972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718819+0000","last_change":"2024-09-21T07:26:33.729146+0000","last_active":"2024-09-21T07:26:34.718819+0000","last_peered":"2024-09-21T07:26:34.718819+0000","last_clean":"2024-09-21T07:26:34.718819+0000","last_became_active":"2024-09-21T07:26:33.728606+0000","last_became_peered":"2024-09-21T07:26:33.728606+0000","last_unstale":"2024-09-21T07:26:34.718819+0000","last_undegraded":"2024-09-21T07:26:34.718819+0000","last_fullsized":"2024-09-21T07:26:34.718819+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:53.045217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718415+0000","last_change":"2024-09-21T07:26:32.715797+0000","last_active":"2024-09-21T07:26:34.718415+0000","last_peered":"2024-09-21T07:26:34.718415+0000","last_clean":"2024-09-21T07:26:34.718415+0000","last_became_active":"2024-09-21T07:26:32.715535+0000","last_became_peered":"2024-09-21T07:26:32.715535+0000","last_unstale":"2024-09-21T07:26:34.718415+0000","last_undegraded":"2024-09-21T07:26:34.718415+0000","last_fullsized":"2024-09-21T07:26:34.718415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:23.509212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300525+0000","last_change":"2024-09-21T07:26:33.699624+0000","last_active":"2024-09-21T07:26:35.300525+0000","last_peered":"2024-09-21T07:26:35.300525+0000","last_clean":"2024-09-21T07:26:35.300525+0000","last_became_active":"2024-09-21T07:26:33.699195+0000","last_became_peered":"2024-09-21T07:26:33.699195+0000","last_unstale":"2024-09-21T07:26:35.300525+0000","last_undegraded":"2024-09-21T07:26:35.300525+0000","last_fullsized":"2024-09-21T07:26:35.300525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:15.428470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299392+0000","last_change":"2024-09-21T07:26:32.711993+0000","last_active":"2024-09-21T07:26:35.299392+0000","last_peered":"2024-09-21T07:26:35.299392+0000","last_clean":"2024-09-21T07:26:35.299392+0000","last_became_active":"2024-09-21T07:26:32.711625+0000","last_became_peered":"2024-09-21T07:26:32.711625+0000","last_unstale":"2024-09-21T07:26:35.299392+0000","last_undegraded":"2024-09-21T07:26:35.299392+0000","last_fullsized":"2024-09-21T07:26:35.299392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.195898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300072+0000","last_change":"2024-09-21T07:26:33.704732+0000","last_active":"2024-09-21T07:26:35.300072+0000","last_peered":"2024-09-21T07:26:35.300072+0000","last_clean":"2024-09-21T07:26:35.300072+0000","last_became_active":"2024-09-21T07:26:33.704391+0000","last_became_peered":"2024-09-21T07:26:33.704391+0000","last_unstale":"2024-09-21T07:26:35.300072+0000","last_undegraded":"2024-09-21T07:26:35.300072+0000","last_fullsized":"2024-09-21T07:26:35.300072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:35.223589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.718859+0000","last_change":"2024-09-21T07:26:32.718081+0000","last_active":"2024-09-21T07:26:34.718859+0000","last_peered":"2024-09-21T07:26:34.718859+0000","last_clean":"2024-09-21T07:26:34.718859+0000","last_became_active":"2024-09-21T07:26:32.717486+0000","last_became_peered":"2024-09-21T07:26:32.717486+0000","last_unstale":"2024-09-21T07:26:34.718859+0000","last_undegraded":"2024-09-21T07:26:34.718859+0000","last_fullsized":"2024-09-21T07:26:34.718859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:27.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705640+0000","last_change":"2024-09-21T07:26:33.709277+0000","last_active":"2024-09-21T07:26:34.705640+0000","last_peered":"2024-09-21T07:26:34.705640+0000","last_clean":"2024-09-21T07:26:34.705640+0000","last_became_active":"2024-09-21T07:26:33.709003+0000","last_became_peered":"2024-09-21T07:26:33.709003+0000","last_unstale":"2024-09-21T07:26:34.705640+0000","last_undegraded":"2024-09-21T07:26:34.705640+0000","last_fullsized":"2024-09-21T07:26:34.705640+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:23.972321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.719135+0000","last_change":"2024-09-21T07:26:32.714816+0000","last_active":"2024-09-21T07:26:34.719135+0000","last_peered":"2024-09-21T07:26:34.719135+0000","last_clean":"2024-09-21T07:26:34.719135+0000","last_became_active":"2024-09-21T07:26:32.712923+0000","last_became_peered":"2024-09-21T07:26:32.712923+0000","last_unstale":"2024-09-21T07:26:34.719135+0000","last_undegraded":"2024-09-21T07:26:34.719135+0000","last_fullsized":"2024-09-21T07:26:34.719135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:25.186430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.719002+0000","last_change":"2024-09-21T07:26:33.723117+0000","last_active":"2024-09-21T07:26:34.719002+0000","last_peered":"2024-09-21T07:26:34.719002+0000","last_clean":"2024-09-21T07:26:34.719002+0000","last_became_active":"2024-09-21T07:26:33.722054+0000","last_became_peered":"2024-09-21T07:26:33.722054+0000","last_unstale":"2024-09-21T07:26:34.719002+0000","last_undegraded":"2024-09-21T07:26:34.719002+0000","last_fullsized":"2024-09-21T07:26:34.719002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:46.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300005+0000","last_change":"2024-09-21T07:26:32.710480+0000","last_active":"2024-09-21T07:26:35.300005+0000","last_peered":"2024-09-21T07:26:35.300005+0000","last_clean":"2024-09-21T07:26:35.300005+0000","last_became_active":"2024-09-21T07:26:32.710069+0000","last_became_peered":"2024-09-21T07:26:32.710069+0000","last_unstale":"2024-09-21T07:26:35.300005+0000","last_undegraded":"2024-09-21T07:26:35.300005+0000","last_fullsized":"2024-09-21T07:26:35.300005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:43.454122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300607+0000","last_change":"2024-09-21T07:26:33.704456+0000","last_active":"2024-09-21T07:26:35.300607+0000","last_peered":"2024-09-21T07:26:35.300607+0000","last_clean":"2024-09-21T07:26:35.300607+0000","last_became_active":"2024-09-21T07:26:33.704194+0000","last_became_peered":"2024-09-21T07:26:33.704194+0000","last_unstale":"2024-09-21T07:26:35.300607+0000","last_undegraded":"2024-09-21T07:26:35.300607+0000","last_fullsized":"2024-09-21T07:26:35.300607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:29.025262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300837+0000","last_change":"2024-09-21T07:26:32.709793+0000","last_active":"2024-09-21T07:26:35.300837+0000","last_peered":"2024-09-21T07:26:35.300837+0000","last_clean":"2024-09-21T07:26:35.300837+0000","last_became_active":"2024-09-21T07:26:32.709018+0000","last_became_peered":"2024-09-21T07:26:32.709018+0000","last_unstale":"2024-09-21T07:26:35.300837+0000","last_undegraded":"2024-09-21T07:26:35.300837+0000","last_fullsized":"2024-09-21T07:26:35.300837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:05.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299966+0000","last_change":"2024-09-21T07:26:33.712283+0000","last_active":"2024-09-21T07:26:35.299966+0000","last_peered":"2024-09-21T07:26:35.299966+0000","last_clean":"2024-09-21T07:26:35.299966+0000","last_became_active":"2024-09-21T07:26:33.711978+0000","last_became_peered":"2024-09-21T07:26:33.711978+0000","last_unstale":"2024-09-21T07:26:35.299966+0000","last_undegraded":"2024-09-21T07:26:35.299966+0000","last_fullsized":"2024-09-21T07:26:35.299966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:24.345926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.830034+0000","last_change":"2024-09-21T07:26:32.714302+0000","last_active":"2024-09-21T07:26:34.830034+0000","last_peered":"2024-09-21T07:26:34.830034+0000","last_clean":"2024-09-21T07:26:34.830034+0000","last_became_active":"2024-09-21T07:26:32.713972+0000","last_became_peered":"2024-09-21T07:26:32.713972+0000","last_unstale":"2024-09-21T07:26:34.830034+0000","last_undegraded":"2024-09-21T07:26:34.830034+0000","last_fullsized":"2024-09-21T07:26:34.830034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705680+0000","last_change":"2024-09-21T07:26:33.725683+0000","last_active":"2024-09-21T07:26:34.705680+0000","last_peered":"2024-09-21T07:26:34.705680+0000","last_clean":"2024-09-21T07:26:34.705680+0000","last_became_active":"2024-09-21T07:26:33.725239+0000","last_became_peered":"2024-09-21T07:26:33.725239+0000","last_unstale":"2024-09-21T07:26:34.705680+0000","last_undegraded":"2024-09-21T07:26:34.705680+0000","last_fullsized":"2024-09-21T07:26:34.705680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:17.110812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707294+0000","last_change":"2024-09-21T07:26:32.711484+0000","last_active":"2024-09-21T07:26:34.707294+0000","last_peered":"2024-09-21T07:26:34.707294+0000","last_clean":"2024-09-21T07:26:34.707294+0000","last_became_active":"2024-09-21T07:26:32.711179+0000","last_became_peered":"2024-09-21T07:26:32.711179+0000","last_unstale":"2024-09-21T07:26:34.707294+0000","last_undegraded":"2024-09-21T07:26:34.707294+0000","last_fullsized":"2024-09-21T07:26:34.707294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:39.578312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300651+0000","last_change":"2024-09-21T07:26:33.721426+0000","last_active":"2024-09-21T07:26:35.300651+0000","last_peered":"2024-09-21T07:26:35.300651+0000","last_clean":"2024-09-21T07:26:35.300651+0000","last_became_active":"2024-09-21T07:26:33.720896+0000","last_became_peered":"2024-09-21T07:26:33.720896+0000","last_unstale":"2024-09-21T07:26:35.300651+0000","last_undegraded":"2024-09-21T07:26:35.300651+0000","last_fullsized":"2024-09-21T07:26:35.300651+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:51.152597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707269+0000","last_change":"2024-09-21T07:26:32.703003+0000","last_active":"2024-09-21T07:26:34.707269+0000","last_peered":"2024-09-21T07:26:34.707269+0000","last_clean":"2024-09-21T07:26:34.707269+0000","last_became_active":"2024-09-21T07:26:32.702679+0000","last_became_peered":"2024-09-21T07:26:32.702679+0000","last_unstale":"2024-09-21T07:26:34.707269+0000","last_undegraded":"2024-09-21T07:26:34.707269+0000","last_fullsized":"2024-09-21T07:26:34.707269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:39.209541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.705242+0000","last_change":"2024-09-21T07:26:33.728946+0000","last_active":"2024-09-21T07:26:34.705242+0000","last_peered":"2024-09-21T07:26:34.705242+0000","last_clean":"2024-09-21T07:26:34.705242+0000","last_became_active":"2024-09-21T07:26:33.728630+0000","last_became_peered":"2024-09-21T07:26:33.728630+0000","last_unstale":"2024-09-21T07:26:34.705242+0000","last_undegraded":"2024-09-21T07:26:34.705242+0000","last_fullsized":"2024-09-21T07:26:34.705242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:58.826148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.299740+0000","last_change":"2024-09-21T07:26:32.709146+0000","last_active":"2024-09-21T07:26:35.299740+0000","last_peered":"2024-09-21T07:26:35.299740+0000","last_clean":"2024-09-21T07:26:35.299740+0000","last_became_active":"2024-09-21T07:26:32.708854+0000","last_became_peered":"2024-09-21T07:26:32.708854+0000","last_unstale":"2024-09-21T07:26:35.299740+0000","last_undegraded":"2024-09-21T07:26:35.299740+0000","last_fullsized":"2024-09-21T07:26:35.299740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:01.993973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:35.300195+0000","last_change":"2024-09-21T07:26:33.709551+0000","last_active":"2024-09-21T07:26:35.300195+0000","last_peered":"2024-09-21T07:26:35.300195+0000","last_clean":"2024-09-21T07:26:35.300195+0000","last_became_active":"2024-09-21T07:26:33.709229+0000","last_became_peered":"2024-09-21T07:26:33.709229+0000","last_unstale":"2024-09-21T07:26:35.300195+0000","last_undegraded":"2024-09-21T07:26:35.300195+0000","last_fullsized":"2024-09-21T07:26:35.300195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:32.680654+0000","last_clean_scrub_stamp":"2024-09-21T07:26:32.680654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:07.415573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.707087+0000","last_change":"2024-09-21T07:26:32.704855+0000","last_active":"2024-09-21T07:26:34.707087+0000","last_peered":"2024-09-21T07:26:34.707087+0000","last_clean":"2024-09-21T07:26:34.707087+0000","last_became_active":"2024-09-21T07:26:32.704385+0000","last_became_peered":"2024-09-21T07:26:32.704385+0000","last_unstale":"2024-09-21T07:26:34.707087+0000","last_undegraded":"2024-09-21T07:26:34.707087+0000","last_fullsized":"2024-09-21T07:26:34.707087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:26:31.672953+0000","last_clean_scrub_stamp":"2024-09-21T07:26:31.672953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:06.609096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-21T07:26:34.829436+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:26:34.829436+0000","last_peered":"2024-09-21T07:26:34.829436+0000","last_clean":"2024-09-21T07:26:34.829436+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:26:34.829436+0000","last_undegraded":"2024-09-21T07:26:34.829436+0000","last_fullsized":"2024-09-21T07:26:34.829436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":806912,"data_stored":363824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":806912,"data_stored":363812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40308,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331532,"statfs":{"total":96636764160,"available":96595488768,"internally_reserved":0,"allocated":815104,"data_stored":365402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36132,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335708,"statfs":{"total":96636764160,"available":96599764992,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335672,"statfs":{"total":96636764160,"available":96599728128,"internally_reserved":0,"allocated":831488,"data_stored":366166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1396736,"data_stored":954158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1413120,"data_stored":954934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":363790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:26:43.075 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:26:43.075 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:26:43.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- 172.21.15.64:0/2532360733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940706c0 msgr2=0x7fea940b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 --2- 172.21.15.64:0/2532360733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940706c0 0x7fea940b3ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea940b3130 tx=0x7fea8c01ccb0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- 172.21.15.64:0/2532360733 shutdown_connections 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 --2- 172.21.15.64:0/2532360733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940706c0 0x7fea940b3ce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 --2- 172.21.15.64:0/2532360733 >> v2:172.21.15.90:3300/0 conn(0x7fea9415ec20 0x7fea940ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- 172.21.15.64:0/2532360733 >> 172.21.15.64:0/2532360733 conn(0x7fea940ccbe0 msgr2=0x7fea940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- 172.21.15.64:0/2532360733 shutdown_connections 2024-09-21T07:26:43.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- 172.21.15.64:0/2532360733 wait complete. 2024-09-21T07:26:43.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 Processor -- start 2024-09-21T07:26:43.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.272+0000 7fea9b000640 1 -- start start 2024-09-21T07:26:43.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940ca990 0x7fea94156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea9415ec20 0x7fea94072e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea94168d70 con 0x7fea94151800 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea94168bf0 con 0x7fea9415ec20 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea94168ef0 con 0x7fea940ca990 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46178/0 (socket says 172.21.15.64:46178) 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 -- 172.21.15.64:0/1687774826 learned_addr learned my addr 172.21.15.64:0/1687774826 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea93e00640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940ca990 0x7fea94156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea8be00640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea9415ec20 0x7fea94072e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 -- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940ca990 msgr2=0x7fea94156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940ca990 0x7fea94156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 -- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea9415ec20 msgr2=0x7fea94072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea9415ec20 0x7fea94072e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 -- 172.21.15.64:0/1687774826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea94159f10 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea99000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0987b0 tx=0x7fea8c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0b2040 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8c0bb070 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea940b0f80 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c004240 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea940b1540 con 0x7fea94151800 2024-09-21T07:26:43.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.276+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea940b3ce0 con 0x7fea94151800 2024-09-21T07:26:43.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.280+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea8c0043e0 con 0x7fea94151800 2024-09-21T07:26:43.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.280+0000 7fea90c00640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 0x7fea70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.280+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fea8c12ed50 con 0x7fea94151800 2024-09-21T07:26:43.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.280+0000 7fea93e00640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 0x7fea70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.280+0000 7fea93e00640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 0x7fea70075710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea94072330 tx=0x7fea840091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.284+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fea8c016990 con 0x7fea94151800 2024-09-21T07:26:43.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.524+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fea9415c4a0 con 0x7fea94151800 2024-09-21T07:26:43.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.528+0000 7fea90c00640 1 -- 172.21.15.64:0/1687774826 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7fea8c0f94f0 con 0x7fea94151800 2024-09-21T07:26:43.534 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:26:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:26:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:26:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:26:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:26:43.535 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:26:43.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 msgr2=0x7fea70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 0x7fea70075710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea94072330 tx=0x7fea840091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 msgr2=0x7fea94073360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0987b0 tx=0x7fea8c005c80 comp rx=0 tx=0).stop 2024-09-21T07:26:43.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 shutdown_connections 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea70073200 0x7fea70075710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea94151800 0x7fea94073360 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea9415ec20 0x7fea94072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 --2- 172.21.15.64:0/1687774826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea940ca990 0x7fea94156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 >> 172.21.15.64:0/1687774826 conn(0x7fea940ccbe0 msgr2=0x7fea940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 shutdown_connections 2024-09-21T07:26:43.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.532+0000 7fea9b000640 1 -- 172.21.15.64:0/1687774826 wait complete. 2024-09-21T07:26:43.558 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:43.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- 172.21.15.64:0/3674443993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0cbcd0 msgr2=0x7fa2ac0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 --2- 172.21.15.64:0/3674443993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0cbcd0 0x7fa2ac0cc0e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009c80 tx=0x7fa2a401cd70 comp rx=0 tx=0).stop 2024-09-21T07:26:43.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- 172.21.15.64:0/3674443993 shutdown_connections 2024-09-21T07:26:43.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 --2- 172.21.15.64:0/3674443993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0cbcd0 0x7fa2ac0cc0e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 --2- 172.21.15.64:0/3674443993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0b1be0 0x7fa2ac0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- 172.21.15.64:0/3674443993 >> 172.21.15.64:0/3674443993 conn(0x7fa2ac0ccbe0 msgr2=0x7fa2ac0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- 172.21.15.64:0/3674443993 shutdown_connections 2024-09-21T07:26:43.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- 172.21.15.64:0/3674443993 wait complete. 2024-09-21T07:26:43.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 Processor -- start 2024-09-21T07:26:43.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.712+0000 7fa2b1800640 1 -- start start 2024-09-21T07:26:43.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0cbcd0 0x7fa2ac14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2ac15cbd0 0x7fa2ac14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac0b42e0 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac0b4160 con 0x7fa2ac15cbd0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa2ac16a290 con 0x7fa2ac0cbcd0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46194/0 (socket says 172.21.15.64:46194) 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 -- 172.21.15.64:0/1422313207 learned_addr learned my addr 172.21.15.64:0/1422313207 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2a2000640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0cbcd0 0x7fa2ac14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2ab400640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2ac15cbd0 0x7fa2ac14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 -- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0cbcd0 msgr2=0x7fa2ac14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0cbcd0 0x7fa2ac14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 -- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2ac15cbd0 msgr2=0x7fa2ac14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2ac15cbd0 0x7fa2ac14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 -- 172.21.15.64:0/1422313207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ac0af1e0 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2aaa00640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c3f0 tx=0x7fa29c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c017070 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa29c0053c0 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ac0aea60 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c003860 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ac0acf10 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.716+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ac0b1ff0 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.720+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa29c01a070 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.720+0000 7fa2a3400640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 0x7fa288075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.720+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fa29c0936d0 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.720+0000 7fa2a2000640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 0x7fa288075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.720+0000 7fa2a2000640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 0x7fa288075710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac1565d0 tx=0x7fa29400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.724+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa2ac0b2530 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.936+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2ac06de00 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2a3400640 1 -- 172.21.15.64:0/1422313207 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5224 (secure 0 0 0) 0x7fa29c05df00 con 0x7fa2ac0b1be0 2024-09-21T07:26:43.944 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:43.944 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":36,"btime":"2024-09-21T07:26:36:726462+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2154117473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2154117473},{"type":"v1","addr":"172.21.15.90:6835","nonce":2154117473}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6172,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1583991454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1583991454},{"type":"v1","addr":"172.21.15.64:6834","nonce":1583991454}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3528879025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3528879025},{"type":"v1","addr":"172.21.15.64:6835","nonce":3528879025}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:36.147161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1195501528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1195501528},{"type":"v1","addr":"172.21.15.90:6837","nonce":1195501528}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-09-21T07:26:43.945 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 36 2024-09-21T07:26:43.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 msgr2=0x7fa288075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 0x7fa288075710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac1565d0 tx=0x7fa29400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 msgr2=0x7fa2ac14e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c3f0 tx=0x7fa29c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 shutdown_connections 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa288073200 0x7fa288075710 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2ac15cbd0 0x7fa2ac14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2ac0cbcd0 0x7fa2ac14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 --2- 172.21.15.64:0/1422313207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2ac0b1be0 0x7fa2ac14e110 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 >> 172.21.15.64:0/1422313207 conn(0x7fa2ac0ccbe0 msgr2=0x7fa2ac0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 shutdown_connections 2024-09-21T07:26:43.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:43.940+0000 7fa2b1800640 1 -- 172.21.15.64:0/1422313207 wait complete. 2024-09-21T07:26:44.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:26:33.122049+0000', 'modified': '2024-09-21T07:26:36.147161+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6300': {'gid': 6300, 'name': 'd', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/1195501528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 1195501528}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 1195501528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6300, 'qdb_cluster': [6300]} 2024-09-21T07:26:44.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:26:44.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- 172.21.15.64:0/1896558029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 msgr2=0x7f27240ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 --2- 172.21.15.64:0/1896558029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240ce1f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2724070f10 tx=0x7f270c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- 172.21.15.64:0/1896558029 shutdown_connections 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 --2- 172.21.15.64:0/1896558029 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27240ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 --2- 172.21.15.64:0/1896558029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240ce1f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 --2- 172.21.15.64:0/1896558029 >> v2:172.21.15.90:3300/0 conn(0x7f272409df30 0x7f27240b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- 172.21.15.64:0/1896558029 >> 172.21.15.64:0/1896558029 conn(0x7f272406d450 msgr2=0x7f27240d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- 172.21.15.64:0/1896558029 shutdown_connections 2024-09-21T07:26:44.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- 172.21.15.64:0/1896558029 wait complete. 2024-09-21T07:26:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 Processor -- start 2024-09-21T07:26:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.528+0000 7f2729000640 1 -- start start 2024-09-21T07:26:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 0x7f27240ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27241f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27240ccef0 con 0x7f27240b3910 2024-09-21T07:26:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27240ccd70 con 0x7f272409df30 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f27240cd070 con 0x7f27240ce730 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46206/0 (socket says 172.21.15.64:46206) 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 -- 172.21.15.64:0/2116662239 learned_addr learned my addr 172.21.15.64:0/2116662239 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 -- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 msgr2=0x7f27241f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2722800640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27241f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2721e00640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 0x7f27240ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27241f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 -- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 msgr2=0x7f27240ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 0x7f27240ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 -- 172.21.15.64:0/2116662239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27240b0a00 con 0x7f27240b3910 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2722800640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27241f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2721e00640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 0x7f27240ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2719400640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f270c01b430 tx=0x7f270c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f271aa00640 1 -- 172.21.15.64:0/2116662239 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c0bb070 con 0x7f27240b3910 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f271aa00640 1 -- 172.21.15.64:0/2116662239 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f270c004d40 con 0x7f27240b3910 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27240b0ce0 con 0x7f27240b3910 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f271aa00640 1 -- 172.21.15.64:0/2116662239 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c0b2040 con 0x7f27240b3910 2024-09-21T07:26:44.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.532+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27240b12a0 con 0x7f27240b3910 2024-09-21T07:26:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f271aa00640 1 -- 172.21.15.64:0/2116662239 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f270c0be070 con 0x7f27240b3910 2024-09-21T07:26:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f271aa00640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 0x7f2700075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f271aa00640 1 -- 172.21.15.64:0/2116662239 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f270c12e190 con 0x7f27240b3910 2024-09-21T07:26:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f273086a000 1 Processor -- start 2024-09-21T07:26:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f273086a000 1 -- start start 2024-09-21T07:26:44.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f2721e00640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 0x7f2700075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.536+0000 7f2721e00640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 0x7f2700075740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2714009a20 tx=0x7f2714005cd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55bceb460 0x55d55c22c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55c0c4ca0 0x55d55c22d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d55c101410 con 0x55d55c0db950 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d55c03eb40 con 0x55d55bceb460 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d55c02df70 con 0x55d55c0c4ca0 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46216/0 (socket says 172.21.15.64:46216) 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 -- 172.21.15.64:0/3338240160 learned_addr learned my addr 172.21.15.64:0/3338240160 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2721e00640 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55bceb460 0x55d55c22c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2722800640 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55c0c4ca0 0x55d55c22d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 -- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55c0c4ca0 msgr2=0x55d55c22d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55c0c4ca0 0x55d55c22d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 -- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55bceb460 msgr2=0x55d55c22c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55bceb460 0x55d55c22c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 -- 172.21.15.64:0/3338240160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d55bff55b0 con 0x55d55c0db950 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2719400640 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f270c12c430 tx=0x7f270c0f47f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9230684c875fad1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2712a00640 1 -- 172.21.15.64:0/3338240160 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c0a5d00 con 0x55d55c0db950 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2712a00640 1 -- 172.21.15.64:0/3338240160 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f270c0f83a0 con 0x55d55c0db950 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f2712a00640 1 -- 172.21.15.64:0/3338240160 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c0f8f90 con 0x55d55c0db950 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- 172.21.15.64:0/3338240160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 msgr2=0x55d55c22cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f270c12c430 tx=0x7f270c0f47f0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- 172.21.15.64:0/3338240160 shutdown_connections 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55c0c4ca0 0x55d55c22d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c22cbe0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 --2- 172.21.15.64:0/3338240160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55bceb460 0x55d55c22c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- 172.21.15.64:0/3338240160 >> 172.21.15.64:0/3338240160 conn(0x55d55c1b1d90 msgr2=0x55d55c1e1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- 172.21.15.64:0/3338240160 shutdown_connections 2024-09-21T07:26:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- 172.21.15.64:0/3338240160 wait complete. 2024-09-21T07:26:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 -- start start 2024-09-21T07:26:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.540+0000 7f273086a000 1 Processor -- start 2024-09-21T07:26:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c233920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c233e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d55bfc85f0 con 0x55d55c0db950 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d55c031d80 con 0x55d55c0c4ca0 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d55bfd4520 con 0x55d55bceb460 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 10 client.0 _ll_register_callbacks cb 0x55d55bfd8830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46220/0 (socket says 172.21.15.64:46220) 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 -- 172.21.15.64:0/2469581782 learned_addr learned my addr 172.21.15.64:0/2469581782 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2721e00640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c233920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2719400640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c233e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 -- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 msgr2=0x55d55c233920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c233920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 -- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 msgr2=0x55d55c233e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c233e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 -- 172.21.15.64:0/2469581782 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d55bfcc190 con 0x55d55c0db950 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2721e00640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c233920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2719400640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c233e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2722800640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f271c009f30 tx=0x7f271c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e06b0aeba8468 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c012920 con 0x55d55c0db950 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f271c012ac0 con 0x55d55c0db950 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d55bfc6110 con 0x55d55c0db950 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f271c024050 con 0x55d55c0db950 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 10 client.6456 fetch_fsmap learned FSMap version 36 2024-09-21T07:26:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55d55c0b2f10 con 0x55d55c0db950 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d55bfc6110 con 0x55d55c0db950 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f271c027020 con 0x55d55c0db950 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 10 client.6456 fetch_fsmap finished waiting for FSMap version 36 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 10 client.6456 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 20 client.6456 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcd07d0 0x55d55c23dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 4 client.6456 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 --> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d55c040a90 con 0x55d55bcd07d0 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.544+0000 7f2721e00640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcd07d0 0x55d55c23dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f2721e00640 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcd07d0 0x55d55c23dd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55da820621b40665 server_cookie=6265ecfc99bd63aa in_seq=0 out_seq=0 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f2707400640 10 client.6456 ms_handle_connect on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f2707400640 1 -- 172.21.15.64:0/2469581782 <== mds.0 v2:172.21.15.90:6836/1195501528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d55c040a90 con 0x55d55bcd07d0 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f2707400640 10 client.6456 handle_command_reply: tid=0 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 client.6456 shutdown 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 msgr2=0x55d55c2343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f271c009f30 tx=0x7f271c011870 comp rx=0 tx=0).stop 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 shutdown_connections 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcd07d0 0x55d55c23dd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c2343a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c233e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 --2- 172.21.15.64:0/2469581782 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c233920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 >> 172.21.15.64:0/2469581782 conn(0x55d55c1b1d90 msgr2=0x55d55c1e8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f2707400640 0 client.6456 ms_handle_reset on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:44.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 shutdown_connections 2024-09-21T07:26:44.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 1 -- 172.21.15.64:0/2469581782 wait complete. 2024-09-21T07:26:44.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.548+0000 7f273086a000 20 client.6456 trim_cache size 0 max 16384 2024-09-21T07:26:44.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 Processor -- start 2024-09-21T07:26:44.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 -- start start 2024-09-21T07:26:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c29d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c29d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2724205860 con 0x55d55c0db950 2024-09-21T07:26:44.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2724140990 con 0x55d55c0c4ca0 2024-09-21T07:26:44.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2724142d90 con 0x55d55bceb460 2024-09-21T07:26:44.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f2722800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f2722800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46222/0 (socket says 172.21.15.64:46222) 2024-09-21T07:26:44.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.568+0000 7f2722800640 1 -- 172.21.15.64:0/1639465834 learned_addr learned my addr 172.21.15.64:0/1639465834 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2719400640 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c29d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 -- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 msgr2=0x55d55c29d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c29d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 -- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 msgr2=0x55d55c29d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c29d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 -- 172.21.15.64:0/1639465834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d55c089db0 con 0x55d55c0db950 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2719400640 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c29d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2722800640 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f271c006010 tx=0x7f271c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a48239da315994a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2712000640 1 -- 172.21.15.64:0/1639465834 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c011d70 con 0x55d55c0db950 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2712000640 1 -- 172.21.15.64:0/1639465834 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f271c02c030 con 0x55d55c0db950 2024-09-21T07:26:44.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f2712000640 1 -- 172.21.15.64:0/1639465834 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c012ad0 con 0x55d55c0db950 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- 172.21.15.64:0/1639465834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 msgr2=0x55d55c29df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f271c006010 tx=0x7f271c004740 comp rx=0 tx=0).stop 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- 172.21.15.64:0/1639465834 shutdown_connections 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0db950 0x55d55c29df00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0c4ca0 0x55d55c29d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 --2- 172.21.15.64:0/1639465834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c29d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- 172.21.15.64:0/1639465834 >> 172.21.15.64:0/1639465834 conn(0x55d55c1b1d90 msgr2=0x55d55c1ee440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- 172.21.15.64:0/1639465834 shutdown_connections 2024-09-21T07:26:44.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- 172.21.15.64:0/1639465834 wait complete. 2024-09-21T07:26:44.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 -- start start 2024-09-21T07:26:44.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.572+0000 7f273086a000 1 Processor -- start 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c1e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0db950 0x55d55c25d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d55c03d910 con 0x55d55c0c4ca0 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d55bff9ee0 con 0x55d55c0db950 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d55c0ed750 con 0x55d55bceb460 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 10 client.0 _ll_register_callbacks cb 0x7f271c0096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46234/0 (socket says 172.21.15.64:46234) 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 -- 172.21.15.64:0/319640820 learned_addr learned my addr 172.21.15.64:0/319640820 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2722800640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0db950 0x55d55c25d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2721e00640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c1e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 -- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 msgr2=0x55d55c1e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c1e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 -- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0db950 msgr2=0x55d55c25d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:44.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0db950 0x55d55c25d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 -- 172.21.15.64:0/319640820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d55bff4ab0 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2719400640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f270c01c7f0 tx=0x7f270c004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808809714429dd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c0a5d00 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f270c0f9bc0 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f271c02c030 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f270c0f83a0 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 10 client.6462 fetch_fsmap learned FSMap version 36 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55d55bfd3070 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f271c02c030 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f270c0b5030 con 0x55d55c0c4ca0 2024-09-21T07:26:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 10 client.6462 fetch_fsmap finished waiting for FSMap version 36 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 10 client.6462 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 20 client.6462 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcbe830 0x55d55c25dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 4 client.6462 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 --> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] -- command(tid 0: {"prefix": "status"}) -- 0x55d55c03c540 con 0x55d55bcbe830 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2721e00640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcbe830 0x55d55c25dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 10 client.6462 ms_handle_connect on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2721e00640 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcbe830 0x55d55c25dce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2caca14d419c38 server_cookie=7843dc7bfd72f373 in_seq=0 out_seq=0 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 1 -- 172.21.15.64:0/319640820 <== mds.0 v2:172.21.15.90:6836/1195501528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d55c03c540 con 0x55d55bcbe830 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f2707400640 10 client.6462 handle_command_reply: tid=0 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 client.6462 shutdown 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 msgr2=0x55d55c25d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.576+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f270c01c7f0 tx=0x7f270c004f80 comp rx=0 tx=0).stop 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 shutdown_connections 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55d55bcbe830 0x55d55c25dce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d55c0db950 0x55d55c25d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d55c0c4ca0 0x55d55c25d260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 --2- 172.21.15.64:0/319640820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d55bceb460 0x55d55c1e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2707400640 0 client.6462 ms_handle_reset on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 >> 172.21.15.64:0/319640820 conn(0x55d55c1b1d90 msgr2=0x55d55c1eda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 shutdown_connections 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 1 -- 172.21.15.64:0/319640820 wait complete. 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f273086a000 20 client.6462 trim_cache size 0 max 16384 2024-09-21T07:26:44.587 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 6300, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.881235689, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 36, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 67, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 67, 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.255882938999999 2024-09-21T07:26:44.588 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 msgr2=0x7f2700075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 0x7f2700075740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2714009a20 tx=0x7f2714005cd0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 msgr2=0x7f27240afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f270c01b430 tx=0x7f270c009360 comp rx=0 tx=0).stop 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 shutdown_connections 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2700073230 0x7f2700075740 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27240ce730 0x7f27241f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27240b3910 0x7f27240afcd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 --2- 172.21.15.64:0/2116662239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f272409df30 0x7f27240ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 >> 172.21.15.64:0/2116662239 conn(0x7f272406d450 msgr2=0x7f27240cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 shutdown_connections 2024-09-21T07:26:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.580+0000 7f2729000640 1 -- 172.21.15.64:0/2116662239 wait complete. 2024-09-21T07:26:44.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:26:44.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 -- 172.21.15.64:0/2879982146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 msgr2=0x7f974c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 --2- 172.21.15.64:0/2879982146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c0b41c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9734009840 tx=0x7f973401c820 comp rx=0 tx=0).stop 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 -- 172.21.15.64:0/2879982146 shutdown_connections 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 --2- 172.21.15.64:0/2879982146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c0b41c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 -- 172.21.15.64:0/2879982146 >> 172.21.15.64:0/2879982146 conn(0x7f974c0ccbe0 msgr2=0x7f974c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 -- 172.21.15.64:0/2879982146 shutdown_connections 2024-09-21T07:26:44.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.756+0000 7f9752c00640 1 -- 172.21.15.64:0/2879982146 wait complete. 2024-09-21T07:26:44.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 Processor -- start 2024-09-21T07:26:44.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 -- start start 2024-09-21T07:26:44.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f974c0b4700 0x7f974c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f974c15edb0 0x7f974c144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f974c16a290 con 0x7f974c0709b0 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f974c16a110 con 0x7f974c0b4700 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9752c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f974c16a410 con 0x7f974c15edb0 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46250/0 (socket says 172.21.15.64:46250) 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 -- 172.21.15.64:0/3413901247 learned_addr learned my addr 172.21.15.64:0/3413901247 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9743e00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f974c0b4700 0x7f974c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f9750c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f974c15edb0 0x7f974c144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 -- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f974c15edb0 msgr2=0x7f974c144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f974c15edb0 0x7f974c144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 -- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f974c0b4700 msgr2=0x7f974c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f974c0b4700 0x7f974c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.760+0000 7f974be00640 1 -- 172.21.15.64:0/3413901247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c145ce0 con 0x7f974c0709b0 2024-09-21T07:26:44.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f974be00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c3f0 tx=0x7f973c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c017070 con 0x7f974c0709b0 2024-09-21T07:26:44.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f973c0053c0 con 0x7f974c0709b0 2024-09-21T07:26:44.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c003860 con 0x7f974c0709b0 2024-09-21T07:26:44.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c15b920 con 0x7f974c0709b0 2024-09-21T07:26:44.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c15bee0 con 0x7f974c0709b0 2024-09-21T07:26:44.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c0b41c0 con 0x7f974c0709b0 2024-09-21T07:26:44.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f973c01a070 con 0x7f974c0709b0 2024-09-21T07:26:44.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 0x7f9728075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:44.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.764+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f973c093740 con 0x7f974c0709b0 2024-09-21T07:26:44.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.768+0000 7f9743e00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 0x7f9728075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.768+0000 7f9743e00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 0x7f9728075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f97340af000 tx=0x7f973401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:44.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.772+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f973c05dee0 con 0x7f974c0709b0 2024-09-21T07:26:44.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f974c09da20 con 0x7f974c0709b0 2024-09-21T07:26:44.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9748c00640 1 -- 172.21.15.64:0/3413901247 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f973c062910 con 0x7f974c0709b0 2024-09-21T07:26:44.988 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 msgr2=0x7f9728075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 0x7f9728075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f97340af000 tx=0x7f973401b060 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 msgr2=0x7f974c159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c3f0 tx=0x7f973c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 shutdown_connections 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9728073200 0x7f9728075710 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f974c15edb0 0x7f974c144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f974c0b4700 0x7f974c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 --2- 172.21.15.64:0/3413901247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f974c0709b0 0x7f974c159ed0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 >> 172.21.15.64:0/3413901247 conn(0x7f974c0ccbe0 msgr2=0x7f974c0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:44.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 shutdown_connections 2024-09-21T07:26:44.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:44.984+0000 7f9752c00640 1 -- 172.21.15.64:0/3413901247 wait complete. 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:26:45.011 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:26:45.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.012 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:26:45.020 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:26:45.021 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.022 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:26:45.023 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:26:45.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.024 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:26:45.089 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:26:45.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.092 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:26:45.150 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:26:45.150 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:26:45.150 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:26:45.151 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:26:45.151 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:26:45.151 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:26:45.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:26:45.152 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:26:45.152 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:26:45.152 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:26:45.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:26:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:45.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.292 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:26:45.301 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:26:45.301 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:26:45.301 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:26:45.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.302 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:26:45.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:26:45.364 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:45.415 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:26:45.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:26:45.416 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:45.467 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:26:45.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.467 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:26:45.568 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:26:45.568 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:26:45.585 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:26:45.585 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:26:45.585 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:26:45.586 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:26:45.586 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:26:45.589 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:26:45.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:45.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:45.610 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:26:45.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:26:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:45.721 INFO:teuthology.orchestra.run.smithi064.stdout:client5891 2024-09-21T07:26:45.721 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:45.722 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:45.731 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-21T07:26:45.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- 172.21.15.64:0/573488289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c15d6b0 msgr2=0x7fe33c160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 --2- 172.21.15.64:0/573488289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c15d6b0 0x7fe33c160c30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009bc0 tx=0x7fe32c01cb70 comp rx=0 tx=0).stop 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- 172.21.15.64:0/573488289 shutdown_connections 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 --2- 172.21.15.64:0/573488289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c0b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 --2- 172.21.15.64:0/573488289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c15d6b0 0x7fe33c160c30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- 172.21.15.64:0/573488289 >> 172.21.15.64:0/573488289 conn(0x7fe33c0ccfa0 msgr2=0x7fe33c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- 172.21.15.64:0/573488289 shutdown_connections 2024-09-21T07:26:45.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- 172.21.15.64:0/573488289 wait complete. 2024-09-21T07:26:45.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 Processor -- start 2024-09-21T07:26:45.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.932+0000 7fe342c00640 1 -- start start 2024-09-21T07:26:45.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c165720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 0x7fe33c1f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c169b80 con 0x7fe33c0cb300 2024-09-21T07:26:45.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0cbf70 con 0x7fe33c15d6b0 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c169d00 con 0x7fe33c0b1fa0 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36608/0 (socket says 172.21.15.64:36608) 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 -- 172.21.15.64:0/205484293 learned_addr learned my addr 172.21.15.64:0/205484293 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe33be00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe340c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 0x7fe33c1f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 -- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 msgr2=0x7fe33c165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 -- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 msgr2=0x7fe33c1f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 0x7fe33c1f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 -- 172.21.15.64:0/205484293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c0c7d50 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe33be00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe340c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 0x7fe33c1f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe333400640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c9a0 tx=0x7fe32400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324014070 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3240077a0 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c0c8030 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324007bd0 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c0c85f0 con 0x7fe33c0cb300 2024-09-21T07:26:45.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c0b23b0 con 0x7fe33c0cb300 2024-09-21T07:26:45.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.936+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe324017070 con 0x7fe33c0cb300 2024-09-21T07:26:45.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.940+0000 7fe338c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 0x7fe318075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.940+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fe324094730 con 0x7fe33c0cb300 2024-09-21T07:26:45.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.940+0000 7fe33be00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 0x7fe318075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.940+0000 7fe33be00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 0x7fe318075710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0af000 tx=0x7fe32c01b3b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:45.944+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe32405f530 con 0x7fe33c0cb300 2024-09-21T07:26:46.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.120+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fe33c0b2d90 con 0x7fe33c0cb300 2024-09-21T07:26:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.124+0000 7fe338c00640 1 -- 172.21.15.64:0/205484293 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v37)=0 v37) ==== 117+0+0 (secure 0 0 0) 0x7fe32405ee30 con 0x7fe33c0cb300 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 msgr2=0x7fe318075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 0x7fe318075710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0af000 tx=0x7fe32c01b3b0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 msgr2=0x7fe33c165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c9a0 tx=0x7fe32400ce60 comp rx=0 tx=0).stop 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 shutdown_connections 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe318073200 0x7fe318075710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe33c15d6b0 0x7fe33c1f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe33c0cb300 0x7fe33c165c60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 --2- 172.21.15.64:0/205484293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe33c0b1fa0 0x7fe33c165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 >> 172.21.15.64:0/205484293 conn(0x7fe33c0ccfa0 msgr2=0x7fe33c0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 shutdown_connections 2024-09-21T07:26:46.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.128+0000 7fe342c00640 1 -- 172.21.15.64:0/205484293 wait complete. 2024-09-21T07:26:46.153 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- 172.21.15.64:0/2689993612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8418004d50 msgr2=0x7f8418005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 --2- 172.21.15.64:0/2689993612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8418004d50 0x7f8418005160 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f843415ea90 tx=0x7f842c01d2e0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8433400640 1 -- 172.21.15.64:0/2689993612 reap_dead start 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- 172.21.15.64:0/2689993612 shutdown_connections 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- 172.21.15.64:0/2689993612 >> 172.21.15.64:0/2689993612 conn(0x7f843406d450 msgr2=0x7f84340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- 172.21.15.64:0/2689993612 shutdown_connections 2024-09-21T07:26:46.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- 172.21.15.64:0/2689993612 wait complete. 2024-09-21T07:26:46.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 Processor -- start 2024-09-21T07:26:46.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.312+0000 7f8439800640 1 -- start start 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8418004d50 0x7f84340b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84340cf400 0x7f84340cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84340cce90 con 0x7f84340b2400 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84340b3330 con 0x7f8418004d50 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f84340cd010 con 0x7f84340cf400 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36620/0 (socket says 172.21.15.64:36620) 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 -- 172.21.15.64:0/1355116370 learned_addr learned my addr 172.21.15.64:0/1355116370 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8432a00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8418004d50 0x7f84340b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8433400640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84340cf400 0x7f84340cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 -- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84340cf400 msgr2=0x7f84340cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84340cf400 0x7f84340cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 -- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8418004d50 msgr2=0x7f84340b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8418004d50 0x7f84340b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 -- 172.21.15.64:0/1355116370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84340cfd50 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842be00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f841c011b10 tx=0x7f841c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c01e070 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f841c00fc90 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00fea0 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84340b12a0 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341f97a0 con 0x7f84340b2400 2024-09-21T07:26:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.316+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843415f540 con 0x7f84340b2400 2024-09-21T07:26:46.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.320+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f841c021070 con 0x7f84340b2400 2024-09-21T07:26:46.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.320+0000 7f842aa00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 0x7f8410075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.320+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f841c094c40 con 0x7f84340b2400 2024-09-21T07:26:46.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.320+0000 7f8432a00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 0x7f8410075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.320+0000 7f8432a00640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 0x7f8410075710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8424005fd0 tx=0x7f8424005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.324+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f84340cfd50 con 0x7f84340b2400 2024-09-21T07:26:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.500+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f84340cadf0 con 0x7f84340b2400 2024-09-21T07:26:46.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.504+0000 7f842aa00640 1 -- 172.21.15.64:0/1355116370 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v38)=0 v38) ==== 116+0+0 (secure 0 0 0) 0x7f841c05f3e0 con 0x7f84340b2400 2024-09-21T07:26:46.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 msgr2=0x7f8410075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 0x7f8410075710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8424005fd0 tx=0x7f8424005f40 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 msgr2=0x7f84341f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f841c011b10 tx=0x7f841c011f10 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 shutdown_connections 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8410073200 0x7f8410075710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84340cf400 0x7f84340cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84340b2400 0x7f84341f5110 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 --2- 172.21.15.64:0/1355116370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8418004d50 0x7f84340b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 >> 172.21.15.64:0/1355116370 conn(0x7f843406d450 msgr2=0x7f84340aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 shutdown_connections 2024-09-21T07:26:46.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.508+0000 7f8439800640 1 -- 172.21.15.64:0/1355116370 wait complete. 2024-09-21T07:26:46.534 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 -- 172.21.15.64:0/1616598608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc003ad0 msgr2=0x7f5ccc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 --2- 172.21.15.64:0/1616598608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc003ad0 0x7f5ccc003f40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c310 tx=0x7f5cd801cf00 comp rx=0 tx=0).stop 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 -- 172.21.15.64:0/1616598608 shutdown_connections 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 --2- 172.21.15.64:0/1616598608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc003ad0 0x7f5ccc003f40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 -- 172.21.15.64:0/1616598608 >> 172.21.15.64:0/1616598608 conn(0x7f5ce806d450 msgr2=0x7f5ce80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 -- 172.21.15.64:0/1616598608 shutdown_connections 2024-09-21T07:26:46.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 -- 172.21.15.64:0/1616598608 wait complete. 2024-09-21T07:26:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.692+0000 7f5ceec00640 1 Processor -- start 2024-09-21T07:26:46.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- start start 2024-09-21T07:26:46.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ccc003ad0 0x7f5ce80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ce80b13d0 0x7f5ce80b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce8070630 con 0x7f5ce80cac20 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80704b0 con 0x7f5ccc003ad0 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce80707b0 con 0x7f5ce80b13d0 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36632/0 (socket says 172.21.15.64:36632) 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ce7400640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ce80b13d0 0x7f5ce80b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 -- 172.21.15.64:0/3273302575 learned_addr learned my addr 172.21.15.64:0/3273302575 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:46.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ce7e00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ccc003ad0 0x7f5ce80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 -- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ce80b13d0 msgr2=0x7f5ce80b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ce80b13d0 0x7f5ce80b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 -- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ccc003ad0 msgr2=0x7f5ce80b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ccc003ad0 0x7f5ce80b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 -- 172.21.15.64:0/3273302575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce80cb570 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cecc00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80cc8f0 tx=0x7f5ce00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0011870 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ce0017070 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0011da0 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce81fcb00 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce81fcde0 con 0x7f5ce80cac20 2024-09-21T07:26:46.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.696+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce80ce640 con 0x7f5ce80cac20 2024-09-21T07:26:46.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.700+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5ce001c460 con 0x7f5ce80cac20 2024-09-21T07:26:46.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.700+0000 7f5cdfe00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 0x7f5cc8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:46.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.700+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f5ce0094ba0 con 0x7f5ce80cac20 2024-09-21T07:26:46.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.700+0000 7f5ce7e00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 0x7f5cc8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:46.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.700+0000 7f5ce7e00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 0x7f5cc8075740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ab000 tx=0x7f5cd8006040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:46.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.704+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5ce80cb570 con 0x7f5ce80cac20 2024-09-21T07:26:46.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.880+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5ce81fc890 con 0x7f5ce80cac20 2024-09-21T07:26:46.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.888+0000 7f5cdfe00640 1 -- 172.21.15.64:0/3273302575 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v39)=0 v39) ==== 116+0+0 (secure 0 0 0) 0x7f5ce005f350 con 0x7f5ce80cac20 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 msgr2=0x7f5cc8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 0x7f5cc8075740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ab000 tx=0x7f5cd8006040 comp rx=0 tx=0).stop 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 msgr2=0x7f5ce80cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80cc8f0 tx=0x7f5ce00019c0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 shutdown_connections 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5cc8073230 0x7f5cc8075740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ce80cac20 0x7f5ce80cb030 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ce80b13d0 0x7f5ce80b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 --2- 172.21.15.64:0/3273302575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ccc003ad0 0x7f5ce80b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 >> 172.21.15.64:0/3273302575 conn(0x7f5ce806d450 msgr2=0x7f5ce8073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 shutdown_connections 2024-09-21T07:26:46.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:46.892+0000 7f5ceec00640 1 -- 172.21.15.64:0/3273302575 wait complete. 2024-09-21T07:26:46.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:46.916 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-21T07:26:46.933 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:26:46.933 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:26:46.933 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:26:46.934 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:46.934 DEBUG:teuthology.orchestra.run.smithi064:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-21T07:26:46.934 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:26:47.041 INFO:teuthology.orchestra.run.smithi064.stdout:1099511627776 2024-09-21T07:26:47.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:47.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:47.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- 172.21.15.64:0/1984148092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c40d0b90 msgr2=0x7fc7c4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 --2- 172.21.15.64:0/1984148092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c40d0b90 0x7fc7c4071690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009c80 tx=0x7fc7bc01cda0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- 172.21.15.64:0/1984148092 shutdown_connections 2024-09-21T07:26:47.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 --2- 172.21.15.64:0/1984148092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c40d0b90 0x7fc7c4071690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 --2- 172.21.15.64:0/1984148092 >> v2:172.21.15.90:3300/0 conn(0x7fc7c415f1e0 0x7fc7c415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- 172.21.15.64:0/1984148092 >> 172.21.15.64:0/1984148092 conn(0x7fc7c40b2dc0 msgr2=0x7fc7c40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:47.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- 172.21.15.64:0/1984148092 shutdown_connections 2024-09-21T07:26:47.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- 172.21.15.64:0/1984148092 wait complete. 2024-09-21T07:26:47.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 Processor -- start 2024-09-21T07:26:47.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.244+0000 7fc7cb800640 1 -- start start 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7c4071280 0x7fc7c4146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c41fc4e0 0x7fc7c4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c4074a20 con 0x7fc7c415f1e0 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40748a0 con 0x7fc7c4071280 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c4074ba0 con 0x7fc7c41fc4e0 2024-09-21T07:26:47.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36648/0 (socket says 172.21.15.64:36648) 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 -- 172.21.15.64:0/3827389698 learned_addr learned my addr 172.21.15.64:0/3827389698 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7c8e00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7c4071280 0x7fc7c4146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7c9800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c41fc4e0 0x7fc7c4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 -- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c41fc4e0 msgr2=0x7fc7c4155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c41fc4e0 0x7fc7c4155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 -- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7c4071280 msgr2=0x7fc7c4146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7c4071280 0x7fc7c4146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 -- 172.21.15.64:0/3827389698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c41fce00 con 0x7fc7c415f1e0 2024-09-21T07:26:47.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7bbe00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00c390 tx=0x7fc7ac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:47.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0052d0 con 0x7fc7c415f1e0 2024-09-21T07:26:47.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7ac007020 con 0x7fc7c415f1e0 2024-09-21T07:26:47.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c41470a0 con 0x7fc7c415f1e0 2024-09-21T07:26:47.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac007470 con 0x7fc7c415f1e0 2024-09-21T07:26:47.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c40b4ee0 con 0x7fc7c415f1e0 2024-09-21T07:26:47.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.248+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c4071690 con 0x7fc7c415f1e0 2024-09-21T07:26:47.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.252+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc7ac0067e0 con 0x7fc7c415f1e0 2024-09-21T07:26:47.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.252+0000 7fc7c1600640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 0x7fc7a0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.252+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fc7ac093880 con 0x7fc7c415f1e0 2024-09-21T07:26:47.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.252+0000 7fc7c8e00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 0x7fc7a0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.256+0000 7fc7c8e00640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 0x7fc7a0075740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009600 tx=0x7fc7b40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:47.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.256+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc7c41470a0 con 0x7fc7c415f1e0 2024-09-21T07:26:47.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.468+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7c4070630 con 0x7fc7c415f1e0 2024-09-21T07:26:47.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.468+0000 7fc7c1600640 1 -- 172.21.15.64:0/3827389698 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5224 (secure 0 0 0) 0x7fc7c41fce00 con 0x7fc7c415f1e0 2024-09-21T07:26:47.475 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:47.475 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":36,"btime":"2024-09-21T07:26:36:726462+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6166,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2154117473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2154117473},{"type":"v1","addr":"172.21.15.90:6835","nonce":2154117473}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6172,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1583991454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1583991454},{"type":"v1","addr":"172.21.15.64:6834","nonce":1583991454}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3528879025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3528879025},{"type":"v1","addr":"172.21.15.64:6835","nonce":3528879025}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:36.147161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1195501528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1195501528},{"type":"v1","addr":"172.21.15.90:6837","nonce":1195501528}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-09-21T07:26:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 36 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 msgr2=0x7fc7a0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 0x7fc7a0075740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009600 tx=0x7fc7b40091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 msgr2=0x7fc7c41fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00c390 tx=0x7fc7ac00c850 comp rx=0 tx=0).stop 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 shutdown_connections 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc7a0073230 0x7fc7a0075740 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7c41fc4e0 0x7fc7c4155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c415f1e0 0x7fc7c41fbfa0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 --2- 172.21.15.64:0/3827389698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7c4071280 0x7fc7c4146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 >> 172.21.15.64:0/3827389698 conn(0x7fc7c40b2dc0 msgr2=0x7fc7c4070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 shutdown_connections 2024-09-21T07:26:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47.472+0000 7fc7cb800640 1 -- 172.21.15.64:0/3827389698 wait complete. 2024-09-21T07:26:47.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump inode 1099511627776 2024-09-21T07:26:47.673 INFO:teuthology.orchestra.run.smithi090.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:26:46.924515+0000","btime":"2024-09-21T07:26:46.924515+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:26:46.924515+0000","atime":"2024-09-21T07:26:46.924515+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5891,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":5891,"want_loner":5891,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:26:47.674 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:26:46.924515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-21T07:26:46.924515+0000", "change_attr": 0, "client_caps": [ { "client_id": 5891, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-21T07:26:46.924515+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5891, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:26:46.924515+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5891, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-21T07:26:47.674 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:47.674 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:47.683 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> import uuid 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> n = 40 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = False 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> if 0 > 0: 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = True 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> dpath = os.path.dirname(path) 2024-09-21T07:26:47.684 DEBUG:teuthology.orchestra.run.smithi064:> fnameprefix = os.path.basename(path) 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> for i in range(n): 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:26:47.685 DEBUG:teuthology.orchestra.run.smithi064:> f.write(f"{i}") 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> f.flush() 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(f.fileno()) 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.unlink(fpath) 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> if create_hard_links: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> for j in range(0): 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> finally: 2024-09-21T07:26:47.686 DEBUG:teuthology.orchestra.run.smithi064:> os.close(dirfd) 2024-09-21T07:26:47.687 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:26:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:26:47.880 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:47.880 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:47.936 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:26:47.936 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:26:47.988 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:26:48.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 -- 172.21.15.64:0/1146161574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc0cca80 msgr2=0x7f7dbc0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 --2- 172.21.15.64:0/1146161574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc0cca80 0x7f7dbc0cce90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009840 tx=0x7f7da801c820 comp rx=0 tx=0).stop 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 -- 172.21.15.64:0/1146161574 shutdown_connections 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 --2- 172.21.15.64:0/1146161574 >> v2:172.21.15.90:3300/0 conn(0x7f7dbc06ef80 0x7f7dbc06f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 --2- 172.21.15.64:0/1146161574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc0cca80 0x7f7dbc0cce90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 -- 172.21.15.64:0/1146161574 >> 172.21.15.64:0/1146161574 conn(0x7f7dbc06d450 msgr2=0x7f7dbc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 -- 172.21.15.64:0/1146161574 shutdown_connections 2024-09-21T07:26:48.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.188+0000 7f7dc3600640 1 -- 172.21.15.64:0/1146161574 wait complete. 2024-09-21T07:26:48.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 Processor -- start 2024-09-21T07:26:48.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- start start 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc06ef80 0x7f7dbc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dbc0b4d40 0x7f7dbc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc168050 con 0x7f7dbc0cca80 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc167ed0 con 0x7f7dbc0b4d40 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc1681d0 con 0x7f7dbc06ef80 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36660/0 (socket says 172.21.15.64:36660) 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 -- 172.21.15.64:0/3604750815 learned_addr learned my addr 172.21.15.64:0/3604750815 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc0c00640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc06ef80 0x7f7dbc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dbbe00640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dbc0b4d40 0x7f7dbc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 -- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc06ef80 msgr2=0x7f7dbc152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc06ef80 0x7f7dbc152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 -- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dbc0b4d40 msgr2=0x7f7dbc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dbc0b4d40 0x7f7dbc156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 -- 172.21.15.64:0/3604750815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc155ae0 con 0x7f7dbc0cca80 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc1600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7db400eb90 tx=0x7f7db400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4004d30 con 0x7f7dbc0cca80 2024-09-21T07:26:48.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db400b570 con 0x7f7dbc0cca80 2024-09-21T07:26:48.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400b980 con 0x7f7dbc0cca80 2024-09-21T07:26:48.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc1554c0 con 0x7f7dbc0cca80 2024-09-21T07:26:48.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.192+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc155d80 con 0x7f7dbc0cca80 2024-09-21T07:26:48.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.196+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc06f390 con 0x7f7dbc0cca80 2024-09-21T07:26:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.196+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7db400bb20 con 0x7f7dbc0cca80 2024-09-21T07:26:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.196+0000 7f7db8c00640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 0x7f7d9c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.196+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f7db4094fc0 con 0x7f7dbc0cca80 2024-09-21T07:26:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.196+0000 7f7dc0c00640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 0x7f7d9c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.200+0000 7f7dc0c00640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 0x7f7d9c075740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc15ea90 tx=0x7f7db0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.200+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7db405fe40 con 0x7f7dbc0cca80 2024-09-21T07:26:48.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7dbc0cbcf0 con 0x7f7dbc0cca80 2024-09-21T07:26:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7db8c00640 1 -- 172.21.15.64:0/3604750815 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f7db405f740 con 0x7f7dbc0cca80 2024-09-21T07:26:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 msgr2=0x7f7d9c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 0x7f7d9c075740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc15ea90 tx=0x7f7db0009040 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 msgr2=0x7f7dbc0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7db400eb90 tx=0x7f7db400c7a0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 shutdown_connections 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073230 0x7f7d9c075740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dbc0cca80 0x7f7dbc0cf410 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dbc0b4d40 0x7f7dbc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 --2- 172.21.15.64:0/3604750815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dbc06ef80 0x7f7dbc152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 >> 172.21.15.64:0/3604750815 conn(0x7f7dbc06d450 msgr2=0x7f7dbc15a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.388+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 shutdown_connections 2024-09-21T07:26:48.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.392+0000 7f7dc3600640 1 -- 172.21.15.64:0/3604750815 wait complete. 2024-09-21T07:26:48.416 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:26:48.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:48.416 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:26:48.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:26:48.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:48.531 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:26:48.541 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 -- 172.21.15.64:0/1414767668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dbc004810 msgr2=0x7f5dbc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1414767668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dbc004810 0x7f5dbc004c20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009b10 tx=0x7f5dc001d250 comp rx=0 tx=0).stop 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddd200640 1 -- 172.21.15.64:0/1414767668 reap_dead start 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 -- 172.21.15.64:0/1414767668 shutdown_connections 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 -- 172.21.15.64:0/1414767668 >> 172.21.15.64:0/1414767668 conn(0x7f5dd80ccbe0 msgr2=0x7f5dd80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 -- 172.21.15.64:0/1414767668 shutdown_connections 2024-09-21T07:26:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.744+0000 7f5ddf200640 1 -- 172.21.15.64:0/1414767668 wait complete. 2024-09-21T07:26:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 Processor -- start 2024-09-21T07:26:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 -- start start 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd80c9290 0x7f5dd80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd80ae400 0x7f5dd81fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80ceb80 con 0x7f5dd80c9290 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80cea00 con 0x7f5dd80ae400 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddf200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8166230 con 0x7f5dbc004810 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd80c9290 0x7f5dd80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5ddd200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd80ae400 0x7f5dd81fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37050/0 (socket says 172.21.15.64:37050) 2024-09-21T07:26:48.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 -- 172.21.15.64:0/1690899879 learned_addr learned my addr 172.21.15.64:0/1690899879 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 -- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd80ae400 msgr2=0x7f5dd81fb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd80ae400 0x7f5dd81fb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 -- 172.21.15.64:0/1690899879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd80c9290 msgr2=0x7f5dd80adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd80c9290 0x7f5dd80adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 -- 172.21.15.64:0/1690899879 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80ae810 con 0x7f5dbc004810 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.748+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8006630 tx=0x7f5dc80039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5dd4c00640 1 -- 172.21.15.64:0/1690899879 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8015070 con 0x7f5dbc004810 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5dd4c00640 1 -- 172.21.15.64:0/1690899879 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dc8011920 con 0x7f5dbc004810 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5dd4c00640 1 -- 172.21.15.64:0/1690899879 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011d70 con 0x7f5dbc004810 2024-09-21T07:26:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd80c44c0 con 0x7f5dbc004810 2024-09-21T07:26:48.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd815f510 con 0x7f5dbc004810 2024-09-21T07:26:48.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.752+0000 7f5dd4c00640 1 -- 172.21.15.64:0/1690899879 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5dc8018070 con 0x7f5dbc004810 2024-09-21T07:26:48.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dd4c00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 0x7f5db4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dd4c00640 1 -- 172.21.15.64:0/1690899879 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f5dc8094fc0 con 0x7f5dbc004810 2024-09-21T07:26:48.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 Processor -- start 2024-09-21T07:26:48.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 0x7f5db4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 -- start start 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 0x7f5db4075740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00ad000 tx=0x7f5dc0019ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d51c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d51cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55601d3bbcd0 con 0x55601d0cbaa0 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601d2d1330 con 0x55601d3b06d0 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55601d32ebb0 con 0x55601d007890 2024-09-21T07:26:48.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36682/0 (socket says 172.21.15.64:36682) 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 -- 172.21.15.64:0/2375058899 learned_addr learned my addr 172.21.15.64:0/2375058899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d51cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d51c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 -- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 msgr2=0x55601d51cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d51cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 -- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 msgr2=0x55601d51c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d51c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 -- 172.21.15.64:0/2375058899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601d2d2c80 con 0x55601d0cbaa0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5ddd200640 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5dd806e700 tx=0x7f5dd0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bd194ac09b1b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dccc00640 1 -- 172.21.15.64:0/2375058899 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00044f0 con 0x55601d0cbaa0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dccc00640 1 -- 172.21.15.64:0/2375058899 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd0004690 con 0x55601d0cbaa0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.756+0000 7f5dccc00640 1 -- 172.21.15.64:0/2375058899 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00116a0 con 0x55601d0cbaa0 2024-09-21T07:26:48.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2375058899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 msgr2=0x55601d51d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5dd806e700 tx=0x7f5dd0003d50 comp rx=0 tx=0).stop 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2375058899 shutdown_connections 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d51d470 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d51cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2375058899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d51c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2375058899 >> 172.21.15.64:0/2375058899 conn(0x55601cfdb5c0 msgr2=0x55601d4d9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2375058899 shutdown_connections 2024-09-21T07:26:48.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2375058899 wait complete. 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- start start 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 Processor -- start 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d4d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d4df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55601d321df0 con 0x55601d0cbaa0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601d31dfe0 con 0x55601d3b06d0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55601d2c34d0 con 0x55601d007890 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5de6a0d000 10 client.0 _ll_register_callbacks cb 0x55601d2a17f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36694/0 (socket says 172.21.15.64:36694) 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 -- 172.21.15.64:0/2838626833 learned_addr learned my addr 172.21.15.64:0/2838626833 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d4d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5ddd200640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d4df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 -- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 msgr2=0x55601d4d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d4d89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 -- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 msgr2=0x55601d4df5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d4df5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5dcfe00640 1 -- 172.21.15.64:0/2838626833 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601d2bc210 con 0x55601d0cbaa0 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.760+0000 7f5ddd200640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d4df5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5dc001bad0 tx=0x7f5dc00091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f8c13ac6cb6e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004e20 con 0x55601d0cbaa0 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55601d2b6350 con 0x55601d0cbaa0 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f5dc00cf440 con 0x55601d0cbaa0 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dc00d7050 con 0x55601d0cbaa0 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 10 client.6513 fetch_fsmap learned FSMap version 36 2024-09-21T07:26:48.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55601d2a2fc0 con 0x55601d0cbaa0 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55601d2b6350 con 0x55601d0cbaa0 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f5dc00cd020 con 0x55601d0cbaa0 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 10 client.6513 fetch_fsmap finished waiting for FSMap version 36 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 10 client.6513 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 20 client.6513 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfc0930 0x55601d523e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 4 client.6513 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:48.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 --> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55601d330b00 con 0x55601cfc0930 2024-09-21T07:26:48.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfc0930 0x55601d523e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 10 client.6513 ms_handle_connect on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:48.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfc0930 0x55601d523e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966bb1d7972514a1 server_cookie=9a1444c8e91126b1 in_seq=0 out_seq=0 2024-09-21T07:26:48.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 1 -- 172.21.15.64:0/2838626833 <== mds.0 v2:172.21.15.90:6836/1195501528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55601d330b00 con 0x55601cfc0930 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 10 client.6513 handle_command_reply: tid=0 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 client.6513 shutdown 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 msgr2=0x55601d4d8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5dc001bad0 tx=0x7f5dc00091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 shutdown_connections 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfc0930 0x55601d523e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d3b06d0 0x55601d4df5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d4d8f10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/2838626833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d4d89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 >> 172.21.15.64:0/2838626833 conn(0x55601cfdb5c0 msgr2=0x55601d4d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5dc5600640 0 client.6513 ms_handle_reset on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 shutdown_connections 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 1 -- 172.21.15.64:0/2838626833 wait complete. 2024-09-21T07:26:48.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.764+0000 7f5de6a0d000 20 client.6513 trim_cache size 0 max 16384 2024-09-21T07:26:48.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.780+0000 7f5de6a0d000 1 Processor -- start 2024-09-21T07:26:48.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.780+0000 7f5de6a0d000 1 -- start start 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d58dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d0cbaa0 0x55601d58e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd82059e0 con 0x55601d3b06d0 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8204a50 con 0x55601d0cbaa0 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd80c7cf0 con 0x55601d007890 2024-09-21T07:26:48.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36702/0 (socket says 172.21.15.64:36702) 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 -- 172.21.15.64:0/3164565868 learned_addr learned my addr 172.21.15.64:0/3164565868 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d0cbaa0 0x55601d58e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d58dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 -- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 msgr2=0x55601d58dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d58dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 -- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d0cbaa0 msgr2=0x55601d58e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d0cbaa0 0x55601d58e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 -- 172.21.15.64:0/3164565868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601d37b680 con 0x55601d3b06d0 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5ddd200640 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55601d3d1760 tx=0x7f5dd0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75be8c4a8ae06e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5dc7e00640 1 -- 172.21.15.64:0/3164565868 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00044f0 con 0x55601d3b06d0 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5dc7e00640 1 -- 172.21.15.64:0/3164565868 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd0004690 con 0x55601d3b06d0 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5dc7e00640 1 -- 172.21.15.64:0/3164565868 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00266c0 con 0x55601d3b06d0 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- 172.21.15.64:0/3164565868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 msgr2=0x55601d58ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55601d3d1760 tx=0x7f5dd0004a50 comp rx=0 tx=0).stop 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- 172.21.15.64:0/3164565868 shutdown_connections 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d3b06d0 0x55601d58ea60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d0cbaa0 0x55601d58e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/3164565868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d007890 0x55601d58dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- 172.21.15.64:0/3164565868 >> 172.21.15.64:0/3164565868 conn(0x55601cfdb5c0 msgr2=0x55601d52efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- 172.21.15.64:0/3164565868 shutdown_connections 2024-09-21T07:26:48.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- 172.21.15.64:0/3164565868 wait complete. 2024-09-21T07:26:48.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.784+0000 7f5de6a0d000 1 -- start start 2024-09-21T07:26:48.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 Processor -- start 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d007890 0x55601d592440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d3b06d0 0x55601d592ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55601d321100 con 0x55601d0cbaa0 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601d4dcd60 con 0x55601d007890 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55601d2b5300 con 0x55601d3b06d0 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 10 client.0 _ll_register_callbacks cb 0x7f5dd00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36710/0 (socket says 172.21.15.64:36710) 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 -- 172.21.15.64:0/4264658678 learned_addr learned my addr 172.21.15.64:0/4264658678 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d007890 0x55601d592440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5ddd200640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d3b06d0 0x55601d592ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 -- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d3b06d0 msgr2=0x55601d592ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d3b06d0 0x55601d592ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 -- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d007890 msgr2=0x55601d592440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d007890 0x55601d592440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 -- 172.21.15.64:0/4264658678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601d2e80b0 con 0x55601d0cbaa0 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dcfe00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0005010 tx=0x7f5dc00cfad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac75713972e5e536 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:48.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00df020 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd0004690 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f5dc00cfbd0 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dc00e9050 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 10 client.6519 fetch_fsmap learned FSMap version 36 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55601d2b4610 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd0004690 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f5dc00ec020 con 0x55601d0cbaa0 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 10 client.6519 fetch_fsmap finished waiting for FSMap version 36 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 10 client.6519 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 20 client.6519 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfae990 0x55601d4d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 4 client.6519 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:26:48.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 --> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55601d32c5b0 con 0x55601cfae990 2024-09-21T07:26:48.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.788+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfae990 0x55601d4d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.792+0000 7f5dd7e00640 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfae990 0x55601d4d3c80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee5e4cbb289ff52 server_cookie=c0383fd458eec1b in_seq=0 out_seq=0 2024-09-21T07:26:48.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.792+0000 7f5dc5600640 10 client.6519 ms_handle_connect on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5dc5600640 1 -- 172.21.15.64:0/4264658678 <== mds.0 v2:172.21.15.90:6836/1195501528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55601d32c5b0 con 0x55601cfae990 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5dc5600640 10 client.6519 handle_command_reply: tid=0 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 client.6519 shutdown 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 msgr2=0x55601d592980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0005010 tx=0x7f5dc00cfad0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 shutdown_connections 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:6836/1195501528,v1:172.21.15.90:6837/1195501528] conn(0x55601cfae990 0x55601d4d3c80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55601d3b06d0 0x55601d592ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55601d0cbaa0 0x55601d592980 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5dc5600640 0 client.6519 ms_handle_reset on v2:172.21.15.90:6836/1195501528 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 --2- 172.21.15.64:0/4264658678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601d007890 0x55601d592440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 >> 172.21.15.64:0/4264658678 conn(0x55601cfdb5c0 msgr2=0x55601d4de5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 shutdown_connections 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 1 -- 172.21.15.64:0/4264658678 wait complete. 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5de6a0d000 20 client.6519 trim_cache size 0 max 16384 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:26:48.814 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:26:48.815 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:48.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 msgr2=0x7f5db4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 0x7f5db4075740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00ad000 tx=0x7f5dc0019ff0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 msgr2=0x7f5dd815a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8006630 tx=0x7f5dc80039f0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 shutdown_connections 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5db4073230 0x7f5db4075740 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd80ae400 0x7f5dd81fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5dd80c9290 0x7f5dd80adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 --2- 172.21.15.64:0/1690899879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dbc004810 0x7f5dd815a790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 >> 172.21.15.64:0/1690899879 conn(0x7f5dd80ccbe0 msgr2=0x7f5dd815b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 shutdown_connections 2024-09-21T07:26:48.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:48.808+0000 7f5ddf200640 1 -- 172.21.15.64:0/1690899879 wait complete. 2024-09-21T07:26:48.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:26:48.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:48.834 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:26:48.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:48.834 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:26:48.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:48.835 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:26:48.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:26:48.849 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:26:48.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-21T07:26:48.851 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:26:48.851 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-21T07:26:48.852 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:26:48.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-21T07:26:48.853 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:26:48.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-21T07:26:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 -- 172.21.15.64:0/3158944326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c15fa60 msgr2=0x7f2f9c0ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 --2- 172.21.15.64:0/3158944326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0ce400 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009840 tx=0x7f2f9001c6d0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 -- 172.21.15.64:0/3158944326 shutdown_connections 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 --2- 172.21.15.64:0/3158944326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 --2- 172.21.15.64:0/3158944326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0ce400 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 -- 172.21.15.64:0/3158944326 >> 172.21.15.64:0/3158944326 conn(0x7f2f9c0b1c60 msgr2=0x7f2f9c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f39b2000640 1 -- 172.21.15.64:0/1313978564 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40a5d20 con 0x7f39b415c770 2024-09-21T07:26:49.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 -- 172.21.15.64:0/3158944326 shutdown_connections 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.060+0000 7f2fa2600640 1 -- 172.21.15.64:0/3158944326 wait complete. 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- 172.21.15.64:0/1313978564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b415c770 msgr2=0x7f39b4073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 --2- 172.21.15.64:0/1313978564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b415c770 0x7f39b4073bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009840 tx=0x7f39a401c760 comp rx=0 tx=0).stop 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- 172.21.15.64:0/1313978564 shutdown_connections 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 --2- 172.21.15.64:0/1313978564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 --2- 172.21.15.64:0/1313978564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b415c770 0x7f39b4073bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- 172.21.15.64:0/1313978564 >> 172.21.15.64:0/1313978564 conn(0x7f39b40cdb20 msgr2=0x7f39b40cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- 172.21.15.64:0/1313978564 shutdown_connections 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- 172.21.15.64:0/1313978564 wait complete. 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 -- 172.21.15.64:0/3765063102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 msgr2=0x7f0ce40d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 --2- 172.21.15.64:0/3765063102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40d06f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009930 tx=0x7f0cd401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 -- 172.21.15.64:0/3765063102 shutdown_connections 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 --2- 172.21.15.64:0/3765063102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 0x7f0ce4160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 --2- 172.21.15.64:0/3765063102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40d06f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 -- 172.21.15.64:0/3765063102 >> 172.21.15.64:0/3765063102 conn(0x7f0ce40d2250 msgr2=0x7f0ce40d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 -- 172.21.15.64:0/3765063102 shutdown_connections 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f0ce9200640 1 -- 172.21.15.64:0/3765063102 wait complete. 2024-09-21T07:26:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f2fa2600640 1 Processor -- start 2024-09-21T07:26:49.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 Processor -- start 2024-09-21T07:26:49.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f39b9000640 1 -- start start 2024-09-21T07:26:49.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.064+0000 7f2fa2600640 1 -- start start 2024-09-21T07:26:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 -- 172.21.15.64:0/3154134108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 msgr2=0x7f33440afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 --2- 172.21.15.64:0/3154134108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440afcb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f33440cae60 tx=0x7f333401c770 comp rx=0 tx=0).stop 2024-09-21T07:26:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 -- 172.21.15.64:0/3154134108 shutdown_connections 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 --2- 172.21.15.64:0/3154134108 >> v2:172.21.15.90:3300/0 conn(0x7f33440ce7f0 0x7f33440cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 --2- 172.21.15.64:0/3154134108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440afcb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 -- 172.21.15.64:0/3154134108 >> 172.21.15.64:0/3154134108 conn(0x7f33440cd330 msgr2=0x7f33440cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 -- 172.21.15.64:0/3154134108 shutdown_connections 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 -- 172.21.15.64:0/3154134108 wait complete. 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 Processor -- start 2024-09-21T07:26:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 -- start start 2024-09-21T07:26:49.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b40b2b20 0x7f39b414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39b416a0c0 con 0x7f39b415c770 2024-09-21T07:26:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4169f40 con 0x7f39b40b2b20 2024-09-21T07:26:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b9000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f39b416a240 con 0x7f39b406cdf0 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ceac0 con 0x7f2f9c0cc910 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ce940 con 0x7f2f9c15fa60 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c1689f0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36768/0 (socket says 172.21.15.64:36768) 2024-09-21T07:26:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3e00640 1 -- 172.21.15.64:0/2022438097 learned_addr learned my addr 172.21.15.64:0/2022438097 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36752/0 (socket says 172.21.15.64:36752) 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f9be00640 1 -- 172.21.15.64:0/2622036289 learned_addr learned my addr 172.21.15.64:0/2622036289 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1c00640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b2a00640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b40b2b20 0x7f39b414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 -- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f9c15fa60 msgr2=0x7f2f9c0c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 -- 172.21.15.64:0/2622036289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 msgr2=0x7f2f9c0c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 -- 172.21.15.64:0/2622036289 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c153fa0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f9be00640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 -- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b40b2b20 msgr2=0x7f39b414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b40b2b20 0x7f39b414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 -- 172.21.15.64:0/2022438097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 msgr2=0x7f39b415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 -- 172.21.15.64:0/2022438097 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b41f8f90 con 0x7f39b406cdf0 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3e00640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa1200640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0b4640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0702d0 tx=0x7f2f900a5570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39b3400640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b415f720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39a40ac000 tx=0x7f39a4005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900bb070 con 0x7f2f9c073ea0 2024-09-21T07:26:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f900043b0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b2040 con 0x7f2f9c073ea0 2024-09-21T07:26:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40bb070 con 0x7f39b406cdf0 2024-09-21T07:26:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c152f00 con 0x7f2f9c073ea0 2024-09-21T07:26:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a4004330 con 0x7f39b406cdf0 2024-09-21T07:26:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40b2040 con 0x7f39b406cdf0 2024-09-21T07:26:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f3348e00640 1 Processor -- start 2024-09-21T07:26:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 0x7f0ce40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 0x7f0ce4165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4169ef0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4169d70 con 0x7f0ce40710d0 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f0ce9200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce416a070 con 0x7f0ce4160750 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.068+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c1534c0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36780/0 (socket says 172.21.15.64:36780) 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 -- 172.21.15.64:0/4208386578 learned_addr learned my addr 172.21.15.64:0/4208386578 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce3e00640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 0x7f0ce4165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce3400640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 0x7f0ce40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b41f9270 con 0x7f39b406cdf0 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 -- start start 2024-09-21T07:26:49.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b41f9830 con 0x7f39b406cdf0 2024-09-21T07:26:49.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 -- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 msgr2=0x7f0ce4165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 0x7f0ce4165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9c0742b0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 -- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 msgr2=0x7f0ce40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 0x7f0ce40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 -- 172.21.15.64:0/4208386578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce40b76c0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce3400640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 0x7f0ce40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce2a00640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000e7f0 tx=0x7f0cd000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b406d200 con 0x7f39b406cdf0 2024-09-21T07:26:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000ccc0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cd000ce80 con 0x7f0ce40d02e0 2024-09-21T07:26:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0005280 con 0x7f0ce40d02e0 2024-09-21T07:26:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 0x7f334415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3344166e40 con 0x7f33440cca50 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3344166cc0 con 0x7f3344073450 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3348e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f33440b23a0 con 0x7f33440ce7f0 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:60178/0 (socket says 172.21.15.64:60178) 2024-09-21T07:26:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce40b79a0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36790/0 (socket says 172.21.15.64:36790) 2024-09-21T07:26:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343400640 1 -- 172.21.15.64:0/1261869774 learned_addr learned my addr 172.21.15.64:0/1261869774 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 0x7f334415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce40c76d0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f39a4003820 con 0x7f39b406cdf0 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 -- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 msgr2=0x7f334415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 0x7f334415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 -- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 msgr2=0x7f33441fd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3342a00640 1 -- 172.21.15.64:0/1261869774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3344143aa0 con 0x7f33440cca50 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 0x7f334415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2f90005290 con 0x7f2f9c073ea0 2024-09-21T07:26:49.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.072+0000 7f3343400640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:49.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f3342a00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f333000c390 tx=0x7f333000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce40d06f0 con 0x7f0ce40d02e0 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330011790 con 0x7f33440cca50 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3330017070 con 0x7f33440cca50 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3344143d80 con 0x7f33440cca50 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3344144340 con 0x7f33440cca50 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330011c60 con 0x7f33440cca50 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f39ab400640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 0x7f3994075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f39a412dbb0 con 0x7f39b406cdf0 2024-09-21T07:26:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f39b2a00640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 0x7f3994075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f2f98c00640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 0x7f2f7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f2f9012ded0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f2f9be00640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 0x7f2f7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c0052a0 con 0x7f33440cca50 2024-09-21T07:26:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f39b2a00640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 0x7f3994075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39b40ce3d0 tx=0x7f39a00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f2f9be00640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 0x7f2f7c075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c165970 tx=0x7f2f88009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0cd0005420 con 0x7f0ce40d02e0 2024-09-21T07:26:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2f90016410 con 0x7f2f9c073ea0 2024-09-21T07:26:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.076+0000 7f0cdb400640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 0x7f0cc4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f0cd0095190 con 0x7f0ce40d02e0 2024-09-21T07:26:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f0ce3400640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 0x7f0cc4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f33300050d0 con 0x7f33440cca50 2024-09-21T07:26:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f0ce3400640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 0x7f0cc4075740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40af000 tx=0x7f0cd401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f333b400640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 0x7f3324075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f3343400640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 0x7f3324075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f3343400640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 0x7f3324075790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f333401a3a0 tx=0x7f333401afb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f3330011e00 con 0x7f33440cca50 2024-09-21T07:26:49.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.080+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0cd0060000 con 0x7f0ce40d02e0 2024-09-21T07:26:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.084+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f39a4016410 con 0x7f39b406cdf0 2024-09-21T07:26:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.088+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f333005f410 con 0x7f33440cca50 2024-09-21T07:26:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.324+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f0ce40c5f90 con 0x7f0ce40d02e0 2024-09-21T07:26:49.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.332+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f331c005860 con 0x7f33440cca50 2024-09-21T07:26:49.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.476+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f2f9c0b2210 con 0x7f2f9c073ea0 2024-09-21T07:26:49.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.484+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f39b40c7050 con 0x7f39b406cdf0 2024-09-21T07:26:49.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.908+0000 7f0cdb400640 1 -- 172.21.15.64:0/4208386578 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6172 v37) ==== 95+0+0 (secure 0 0 0) 0x7f0cd005f900 con 0x7f0ce40d02e0 2024-09-21T07:26:49.914 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6172 2024-09-21T07:26:49.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 msgr2=0x7f0cc4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 0x7f0cc4075740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40af000 tx=0x7f0cd401b120 comp rx=0 tx=0).stop 2024-09-21T07:26:49.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 msgr2=0x7f0ce40c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000e7f0 tx=0x7f0cd000ecb0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 shutdown_connections 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cc4073230 0x7f0cc4075740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce4160750 0x7f0ce4165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce40d02e0 0x7f0ce40c4ac0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 --2- 172.21.15.64:0/4208386578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce40710d0 0x7f0ce40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 >> 172.21.15.64:0/4208386578 conn(0x7f0ce40d2250 msgr2=0x7f0ce4072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 shutdown_connections 2024-09-21T07:26:49.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f0ce9200640 1 -- 172.21.15.64:0/4208386578 wait complete. 2024-09-21T07:26:49.917 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:26:49.912+0000 7fae8b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:26:49.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.912+0000 7f333b400640 1 -- 172.21.15.64:0/1261869774 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6300 v38) ==== 95+0+0 (secure 0 0 0) 0x7f333005ed10 con 0x7f33440cca50 2024-09-21T07:26:49.918 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6300 2024-09-21T07:26:49.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 msgr2=0x7f3324075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 0x7f3324075790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f333401a3a0 tx=0x7f333401afb0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 msgr2=0x7f33440c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f333000c390 tx=0x7f333000c850 comp rx=0 tx=0).stop 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 shutdown_connections 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3324073280 0x7f3324075790 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33440ce7f0 0x7f334415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33440cca50 0x7f33440c7930 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 --2- 172.21.15.64:0/1261869774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344073450 0x7f33441fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 >> 172.21.15.64:0/1261869774 conn(0x7f33440cd330 msgr2=0x7f3344158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 shutdown_connections 2024-09-21T07:26:49.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.916+0000 7f3348e00640 1 -- 172.21.15.64:0/1261869774 wait complete. 2024-09-21T07:26:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2f98c00640 1 -- 172.21.15.64:0/2622036289 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6175 v39) ==== 95+0+0 (secure 0 0 0) 0x7f2f900f8dd0 con 0x7f2f9c073ea0 2024-09-21T07:26:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6175 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 msgr2=0x7f2f7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 0x7f2f7c075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c165970 tx=0x7f2f88009040 comp rx=0 tx=0).stop 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 msgr2=0x7f2f9c0b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0b4640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0702d0 tx=0x7f2f900a5570 comp rx=0 tx=0).stop 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 shutdown_connections 2024-09-21T07:26:49.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2f7c073200 0x7f2f7c075710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f9c15fa60 0x7f2f9c0c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f9c0cc910 0x7f2f9c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 --2- 172.21.15.64:0/2622036289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f9c073ea0 0x7f2f9c0b4640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 >> 172.21.15.64:0/2622036289 conn(0x7f2f9c0b1c60 msgr2=0x7f2f9c154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 shutdown_connections 2024-09-21T07:26:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:49.928+0000 7f2fa2600640 1 -- 172.21.15.64:0/2622036289 wait complete. 2024-09-21T07:26:49.945 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:26:49.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:26:49.950 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:26:49.950 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:49.951 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:26:49.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:26:49.954 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:26:49.954 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:49.960 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:26:49.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:26:50.007 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:26:50.007 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:50.047 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:26:50.056 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:26:50.110 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:26:50.910 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:26:50.904+0000 7fae8b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:26:50.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.912+0000 7f39ab400640 1 -- 172.21.15.64:0/2022438097 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6166 v40) ==== 95+0+0 (secure 0 0 0) 0x7f39a40f83e0 con 0x7f39b406cdf0 2024-09-21T07:26:50.918 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6166 2024-09-21T07:26:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 msgr2=0x7f3994075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 0x7f3994075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39b40ce3d0 tx=0x7f39a00091e0 comp rx=0 tx=0).stop 2024-09-21T07:26:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 msgr2=0x7f39b415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b415f720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39a40ac000 tx=0x7f39a4005780 comp rx=0 tx=0).stop 2024-09-21T07:26:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 shutdown_connections 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3994073200 0x7f3994075710 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39b415c770 0x7f39b415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39b40b2b20 0x7f39b414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 --2- 172.21.15.64:0/2022438097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39b406cdf0 0x7f39b415f720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 >> 172.21.15.64:0/2022438097 conn(0x7f39b40cdb20 msgr2=0x7f39b40c6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 shutdown_connections 2024-09-21T07:26:50.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:50.916+0000 7f39b9000640 1 -- 172.21.15.64:0/2022438097 wait complete. 2024-09-21T07:26:50.949 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:26:50.949 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:26:50.952 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:26:50.953 DEBUG:teuthology.parallel:result is None 2024-09-21T07:26:50.953 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:51.048 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- 172.21.15.64:0/3771635681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0cc4e0 msgr2=0x7fc2dc0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 --2- 172.21.15.64:0/3771635681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0cc4e0 0x7fc2dc0b2120 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0cb120 tx=0x7fc2c401c7e0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- 172.21.15.64:0/3771635681 shutdown_connections 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 --2- 172.21.15.64:0/3771635681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0cc4e0 0x7fc2dc0b2120 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 --2- 172.21.15.64:0/3771635681 >> v2:172.21.15.90:3300/0 conn(0x7fc2dc0b4170 0x7fc2dc0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- 172.21.15.64:0/3771635681 >> 172.21.15.64:0/3771635681 conn(0x7fc2dc0ccbe0 msgr2=0x7fc2dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:51.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- 172.21.15.64:0/3771635681 shutdown_connections 2024-09-21T07:26:51.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- 172.21.15.64:0/3771635681 wait complete. 2024-09-21T07:26:51.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 Processor -- start 2024-09-21T07:26:51.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.148+0000 7fc2e2000640 1 -- start start 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc0b4170 0x7fc2dc09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2dc0cc4e0 0x7fc2dc09d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc166180 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc166000 con 0x7fc2dc0b4170 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc166300 con 0x7fc2dc0cc4e0 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36828/0 (socket says 172.21.15.64:36828) 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 -- 172.21.15.64:0/1358562628 learned_addr learned my addr 172.21.15.64:0/1358562628 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:51.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2d3e00640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc0b4170 0x7fc2dc09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2dbe00640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2dc0cc4e0 0x7fc2dc09d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 -- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2dc0cc4e0 msgr2=0x7fc2dc09d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2dc0cc4e0 0x7fc2dc09d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 -- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc0b4170 msgr2=0x7fc2dc09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc0b4170 0x7fc2dc09cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 -- 172.21.15.64:0/1358562628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc154ed0 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2db400640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00e7f0 tx=0x7fc2cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00ccc0 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2cc00ce80 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc1f9ce0 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc005280 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc1f9200 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.152+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc0b33c0 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.156+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2cc005420 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.156+0000 7fc2d3400640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 0x7fc2b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:51.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.156+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fc2cc094d20 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.156+0000 7fc2d3e00640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 0x7fc2b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:51.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.156+0000 7fc2d3e00640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 0x7fc2b8075710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40af000 tx=0x7fc2c401b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:51.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.160+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc2cc05f450 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.376+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2dc154570 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.376+0000 7fc2d3400640 1 -- 172.21.15.64:0/1358562628 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+4390 (secure 0 0 0) 0x7fc2cc063e80 con 0x7fc2dc0b2fb0 2024-09-21T07:26:51.383 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:51.384 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":41,"btime":"2024-09-21T07:26:50:916060+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:50.916040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-21T07:26:51.384 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 41 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 msgr2=0x7fc2b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 0x7fc2b8075710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40af000 tx=0x7fc2c401b020 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 msgr2=0x7fc2dc154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00e7f0 tx=0x7fc2cc00ecb0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 shutdown_connections 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2b8073200 0x7fc2b8075710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2dc0cc4e0 0x7fc2dc09d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc0b4170 0x7fc2dc09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 --2- 172.21.15.64:0/1358562628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2dc0b2fb0 0x7fc2dc154030 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 >> 172.21.15.64:0/1358562628 conn(0x7fc2dc0ccbe0 msgr2=0x7fc2dc155290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 shutdown_connections 2024-09-21T07:26:51.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:51.380+0000 7fc2e2000640 1 -- 172.21.15.64:0/1358562628 wait complete. 2024-09-21T07:26:51.808 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:26:33.122049+0000', 'modified': '2024-09-21T07:26:50.916040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6552}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6552': {'gid': 6552, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.64:6833/1639006862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 1639006862}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 1639006862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:26:51.808 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6552:up:replay 2024-09-21T07:26:52.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 -- 172.21.15.64:0/1360846760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100709b0 msgr2=0x7fdc100b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 --2- 172.21.15.64:0/1360846760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100709b0 0x7fdc100b41c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009840 tx=0x7fdbfc01c820 comp rx=0 tx=0).stop 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 -- 172.21.15.64:0/1360846760 shutdown_connections 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 --2- 172.21.15.64:0/1360846760 >> v2:172.21.15.90:3300/0 conn(0x7fdc100b4700 0x7fdc10072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 --2- 172.21.15.64:0/1360846760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc100709b0 0x7fdc100b41c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 -- 172.21.15.64:0/1360846760 >> 172.21.15.64:0/1360846760 conn(0x7fdc100ccbe0 msgr2=0x7fdc100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 -- 172.21.15.64:0/1360846760 shutdown_connections 2024-09-21T07:26:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.976+0000 7fdc17800640 1 -- 172.21.15.64:0/1360846760 wait complete. 2024-09-21T07:26:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 Processor -- start 2024-09-21T07:26:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 -- start start 2024-09-21T07:26:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc100b4700 0x7fdc101fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc1015edb0 0x7fdc101f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10168bb0 con 0x7fdc100709b0 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10168a30 con 0x7fdc100b4700 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc17800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdc10168d30 con 0x7fdc1015edb0 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36834/0 (socket says 172.21.15.64:36834) 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 -- 172.21.15.64:0/2606588213 learned_addr learned my addr 172.21.15.64:0/2606588213 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc100b4700 0x7fdc101fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc15800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc1015edb0 0x7fdc101f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 -- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc1015edb0 msgr2=0x7fdc101f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc1015edb0 0x7fdc101f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 -- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc100b4700 msgr2=0x7fdc101fcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc100b4700 0x7fdc101fcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 -- 172.21.15.64:0/2606588213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc100b0440 con 0x7fdc100709b0 2024-09-21T07:26:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.980+0000 7fdc14e00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c730 tx=0x7fdc0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04016020 con 0x7fdc100709b0 2024-09-21T07:26:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0400a950 con 0x7fdc100709b0 2024-09-21T07:26:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc101f9d00 con 0x7fdc100709b0 2024-09-21T07:26:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400ada0 con 0x7fdc100709b0 2024-09-21T07:26:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc100b0160 con 0x7fdc100709b0 2024-09-21T07:26:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc100b41c0 con 0x7fdc100709b0 2024-09-21T07:26:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdc04019020 con 0x7fdc100709b0 2024-09-21T07:26:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 0x7fdbf0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fdc040943f0 con 0x7fdc100709b0 2024-09-21T07:26:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.984+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 0x7fdbf0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.988+0000 7fdc0fe00640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 0x7fdbf0075740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0af000 tx=0x7fdbfc01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:52.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:52.992+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdc04020020 con 0x7fdc100709b0 2024-09-21T07:26:53.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc100d05a0 con 0x7fdc100709b0 2024-09-21T07:26:53.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc0cc00640 1 -- 172.21.15.64:0/2606588213 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5215 (secure 0 0 0) 0x7fdc100b0440 con 0x7fdc100709b0 2024-09-21T07:26:53.209 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:53.209 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":43,"btime":"2024-09-21T07:26:52:925663+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:51.927494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-21T07:26:53.209 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 43 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 msgr2=0x7fdbf0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 0x7fdbf0075740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0af000 tx=0x7fdbfc01b060 comp rx=0 tx=0).stop 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 msgr2=0x7fdc1009d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c730 tx=0x7fdc0400cbf0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 shutdown_connections 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdbf0073230 0x7fdbf0075740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc1015edb0 0x7fdc101f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc100b4700 0x7fdc101fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 --2- 172.21.15.64:0/2606588213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc100709b0 0x7fdc1009d3b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 >> 172.21.15.64:0/2606588213 conn(0x7fdc100ccbe0 msgr2=0x7fdc10158830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 shutdown_connections 2024-09-21T07:26:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:53.204+0000 7fdc17800640 1 -- 172.21.15.64:0/2606588213 wait complete. 2024-09-21T07:26:53.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:26:33.122049+0000', 'modified': '2024-09-21T07:26:51.927494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6552}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6552': {'gid': 6552, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.64:6833/1639006862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 1639006862}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 1639006862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:26:53.634 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6552:up:rejoin 2024-09-21T07:26:54.635 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 -- 172.21.15.64:0/87221227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c0cefa0 msgr2=0x7f4f5c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 --2- 172.21.15.64:0/87221227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c0cefa0 0x7f4f5c070b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009840 tx=0x7f4f4401c820 comp rx=0 tx=0).stop 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 -- 172.21.15.64:0/87221227 shutdown_connections 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 --2- 172.21.15.64:0/87221227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c0cefa0 0x7f4f5c070b40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 --2- 172.21.15.64:0/87221227 >> v2:172.21.15.90:3300/0 conn(0x7f4f5c159280 0x7f4f5c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 -- 172.21.15.64:0/87221227 >> 172.21.15.64:0/87221227 conn(0x7f4f5c0d10a0 msgr2=0x7f4f5c0d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 -- 172.21.15.64:0/87221227 shutdown_connections 2024-09-21T07:26:54.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.800+0000 7f4f5be00640 1 -- 172.21.15.64:0/87221227 wait complete. 2024-09-21T07:26:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 Processor -- start 2024-09-21T07:26:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 -- start start 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f5c0cf3b0 0x7f4f5c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c159280 0x7f4f5c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1696c0 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c169540 con 0x7f4f5c0cf3b0 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c169840 con 0x7f4f5c159280 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36836/0 (socket says 172.21.15.64:36836) 2024-09-21T07:26:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.804+0000 7f4f5aa00640 1 -- 172.21.15.64:0/3283788624 learned_addr learned my addr 172.21.15.64:0/3283788624 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f53e00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f5c0cf3b0 0x7f4f5c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5b400640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c159280 0x7f4f5c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 -- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c159280 msgr2=0x7f4f5c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c159280 0x7f4f5c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 -- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f5c0cf3b0 msgr2=0x7f4f5c152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f5c0cf3b0 0x7f4f5c152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 -- 172.21.15.64:0/3283788624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c0b2d60 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5aa00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e9a0 tx=0x7f4f4c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00cd20 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f4c004020 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c004450 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c0b3040 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c0b3600 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5c070b40 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.808+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4f4c003600 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.812+0000 7f4f52a00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 0x7f4f38075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:54.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.812+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f4f4c094be0 con 0x7f4f5c0cefa0 2024-09-21T07:26:54.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.812+0000 7f4f53e00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 0x7f4f38075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:54.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.812+0000 7f4f53e00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 0x7f4f38075740 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f440af000 tx=0x7f4f4401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:54.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:54.816+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4f4c05fae0 con 0x7f4f5c0cefa0 2024-09-21T07:26:55.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.028+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f5c155c00 con 0x7f4f5c0cefa0 2024-09-21T07:26:55.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.028+0000 7f4f52a00640 1 -- 172.21.15.64:0/3283788624 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f4f4c068020 con 0x7f4f5c0cefa0 2024-09-21T07:26:55.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:55.036 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:26:55.036 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 msgr2=0x7f4f38075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 0x7f4f38075740 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f440af000 tx=0x7f4f4401b060 comp rx=0 tx=0).stop 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 msgr2=0x7f4f5c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e9a0 tx=0x7f4f4c00ee60 comp rx=0 tx=0).stop 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 shutdown_connections 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f38073230 0x7f4f38075740 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f5c159280 0x7f4f5c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f5c0cf3b0 0x7f4f5c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 --2- 172.21.15.64:0/3283788624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f5c0cefa0 0x7f4f5c1515a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 >> 172.21.15.64:0/3283788624 conn(0x7f4f5c0d10a0 msgr2=0x7f4f5c0d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 shutdown_connections 2024-09-21T07:26:55.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.032+0000 7f4f5be00640 1 -- 172.21.15.64:0/3283788624 wait complete. 2024-09-21T07:26:55.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:26:33.122049+0000', 'modified': '2024-09-21T07:26:53.932578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6552}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6552': {'gid': 6552, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6833/1639006862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 1639006862}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 1639006862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6552, 'qdb_cluster': [6552]} 2024-09-21T07:26:55.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:26:55.461 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- 172.21.15.64:0/2803729543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f110809df30 msgr2=0x7f11080b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 --2- 172.21.15.64:0/2803729543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f110809df30 0x7f11080b33d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f10fc005fd0 tx=0x7f10fc01c820 comp rx=0 tx=0).stop 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- 172.21.15.64:0/2803729543 shutdown_connections 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 --2- 172.21.15.64:0/2803729543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080ce900 0x7f110806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 --2- 172.21.15.64:0/2803729543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f110809df30 0x7f11080b33d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- 172.21.15.64:0/2803729543 >> 172.21.15.64:0/2803729543 conn(0x7f110806d450 msgr2=0x7f11080d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- 172.21.15.64:0/2803729543 shutdown_connections 2024-09-21T07:26:55.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- 172.21.15.64:0/2803729543 wait complete. 2024-09-21T07:26:55.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 Processor -- start 2024-09-21T07:26:55.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.620+0000 7f1110000640 1 -- start start 2024-09-21T07:26:55.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110809df30 0x7f110815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080b3910 0x7f11080c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1108169000 con 0x7f11080ce900 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1108168e80 con 0x7f110809df30 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1108169180 con 0x7f11080b3910 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41042/0 (socket says 172.21.15.64:41042) 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 -- 172.21.15.64:0/2378926032 learned_addr learned my addr 172.21.15.64:0/2378926032 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110d600640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110809df30 0x7f110815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110cc00640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080b3910 0x7f11080c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 -- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080b3910 msgr2=0x7f11080c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080b3910 0x7f11080c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 -- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110809df30 msgr2=0x7f110815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110809df30 0x7f110815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 -- 172.21.15.64:0/2378926032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110815e340 con 0x7f11080ce900 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f110e000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f110000e970 tx=0x7f110000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1105600640 1 -- 172.21.15.64:0/2378926032 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100004d30 con 0x7f11080ce900 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1105600640 1 -- 172.21.15.64:0/2378926032 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f110000cb20 con 0x7f11080ce900 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1108151580 con 0x7f11080ce900 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1105600640 1 -- 172.21.15.64:0/2378926032 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100005020 con 0x7f11080ce900 2024-09-21T07:26:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.624+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1108151b00 con 0x7f11080ce900 2024-09-21T07:26:55.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f1105600640 1 -- 172.21.15.64:0/2378926032 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f11000051c0 con 0x7f11080ce900 2024-09-21T07:26:55.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f1105600640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 0x7f10e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f1105600640 1 -- 172.21.15.64:0/2378926032 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f1100094dd0 con 0x7f11080ce900 2024-09-21T07:26:55.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 Processor -- start 2024-09-21T07:26:55.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 -- start start 2024-09-21T07:26:55.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110d600640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 0x7f10e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110d600640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 0x7f10e8075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ae000 tx=0x7f10fc01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0a5ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a5f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558ec0933410 con 0x558ec051d460 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558ec0870b40 con 0x558ec090d950 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558ec085ff70 con 0x558ec08f6ca0 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41048/0 (socket says 172.21.15.64:41048) 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110d600640 1 -- 172.21.15.64:0/2083228147 learned_addr learned my addr 172.21.15.64:0/2083228147 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110cc00640 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0a5ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.628+0000 7f110e000640 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a5f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 -- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 msgr2=0x558ec0a5f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a5f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 -- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 msgr2=0x558ec0a5ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0a5ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 -- 172.21.15.64:0/2083228147 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec08275b0 con 0x558ec051d460 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f110d600640 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f10fc098200 tx=0x7f10fc0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fa7f5f51971cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f10f9c00640 1 -- 172.21.15.64:0/2083228147 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0ca070 con 0x558ec051d460 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f10f9c00640 1 -- 172.21.15.64:0/2083228147 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10fc0c1040 con 0x558ec051d460 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f10f9c00640 1 -- 172.21.15.64:0/2083228147 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004910 con 0x558ec051d460 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- 172.21.15.64:0/2083228147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 msgr2=0x558ec0a5e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f10fc098200 tx=0x7f10fc0b7000 comp rx=0 tx=0).stop 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- 172.21.15.64:0/2083228147 shutdown_connections 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a5f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0a5ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 --2- 172.21.15.64:0/2083228147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec051d460 0x558ec0a5e6a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- 172.21.15.64:0/2083228147 >> 172.21.15.64:0/2083228147 conn(0x558ec09e3d90 msgr2=0x558ec0a13690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- 172.21.15.64:0/2083228147 shutdown_connections 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- 172.21.15.64:0/2083228147 wait complete. 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 -- start start 2024-09-21T07:26:55.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.632+0000 7f11175c5000 1 Processor -- start 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec051d460 0x558ec0a65920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a65e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558ec07fa5f0 con 0x558ec090d950 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558ec0863d80 con 0x558ec051d460 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558ec0806520 con 0x558ec08f6ca0 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 10 client.0 _ll_register_callbacks cb 0x558ec080a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41060/0 (socket says 172.21.15.64:41060) 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 -- 172.21.15.64:0/1949997836 learned_addr learned my addr 172.21.15.64:0/1949997836 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110d600640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec051d460 0x558ec0a65920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110cc00640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a65e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 -- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 msgr2=0x558ec0a65e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a65e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 -- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec051d460 msgr2=0x558ec0a65920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec051d460 0x558ec0a65920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 -- 172.21.15.64:0/1949997836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec07fe190 con 0x558ec090d950 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110e000640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f110005f1c0 tx=0x7f110005fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762ba8bcfff93f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110001f050 con 0x558ec090d950 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f110005e190 con 0x558ec090d950 2024-09-21T07:26:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ec07f8110 con 0x558ec090d950 2024-09-21T07:26:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f110005f4c0 con 0x558ec090d950 2024-09-21T07:26:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 10 client.6600 fetch_fsmap learned FSMap version 44 2024-09-21T07:26:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x558ec08e4f10 con 0x558ec090d950 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558ec07f8110 con 0x558ec090d950 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f110000f040 con 0x558ec090d950 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 10 client.6600 fetch_fsmap finished waiting for FSMap version 44 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 10 client.6600 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 20 client.6600 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec05027d0 0x558ec0a6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 4 client.6600 mds_command: new command op to 6552 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 --> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ec0872a90 con 0x558ec05027d0 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110d600640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec05027d0 0x558ec0a6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f110d600640 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec05027d0 0x558ec0a6fd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a19c4e56334759d2 server_cookie=8786e8eab631a9d8 in_seq=0 out_seq=0 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.636+0000 7f10ee000640 10 client.6600 ms_handle_connect on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f10ee000640 1 -- 172.21.15.64:0/1949997836 <== mds.0 v2:172.21.15.64:6832/1639006862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ec0872a90 con 0x558ec05027d0 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f10ee000640 10 client.6600 handle_command_reply: tid=0 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 client.6600 shutdown 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 msgr2=0x558ec0a663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f110005f1c0 tx=0x7f110005fae0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 shutdown_connections 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec05027d0 0x558ec0a6fd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec090d950 0x558ec0a663a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec08f6ca0 0x558ec0a65e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 --2- 172.21.15.64:0/1949997836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec051d460 0x558ec0a65920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 >> 172.21.15.64:0/1949997836 conn(0x558ec09e3d90 msgr2=0x558ec0a1a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f10ee000640 0 client.6600 ms_handle_reset on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 shutdown_connections 2024-09-21T07:26:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 1 -- 172.21.15.64:0/1949997836 wait complete. 2024-09-21T07:26:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.640+0000 7f11175c5000 20 client.6600 trim_cache size 0 max 16384 2024-09-21T07:26:55.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 Processor -- start 2024-09-21T07:26:55.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 -- start start 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1108205b10 con 0x558ec08f6ca0 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1108204b50 con 0x558ec090d950 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f110815ddc0 con 0x558ec051d460 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:36690/0 (socket says 172.21.15.64:36690) 2024-09-21T07:26:55.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41072/0 (socket says 172.21.15.64:41072) 2024-09-21T07:26:55.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 -- 172.21.15.64:0/1276344767 learned_addr learned my addr 172.21.15.64:0/1276344767 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110e000640 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 -- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 msgr2=0x558ec0ad10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 -- 172.21.15.64:0/1276344767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 msgr2=0x558ec0ad0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 -- 172.21.15.64:0/1276344767 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec08bbdb0 con 0x558ec051d460 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f110d600640 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10fc098200 tx=0x7f10fc0195c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e54b3013c15f41c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f10f9200640 1 -- 172.21.15.64:0/1276344767 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0ca070 con 0x558ec051d460 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f10f9200640 1 -- 172.21.15.64:0/1276344767 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10fc0d2070 con 0x558ec051d460 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f10f9200640 1 -- 172.21.15.64:0/1276344767 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0cff90 con 0x558ec051d460 2024-09-21T07:26:55.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 -- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 msgr2=0x558ec0ad0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.660+0000 7f11175c5000 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10fc098200 tx=0x7f10fc0195c0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- 172.21.15.64:0/1276344767 shutdown_connections 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- 172.21.15.64:0/1276344767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec051d460 0x558ec0ad0620 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- 172.21.15.64:0/1276344767 >> 172.21.15.64:0/1276344767 conn(0x558ec09e3d90 msgr2=0x558ec0a5c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- 172.21.15.64:0/1276344767 shutdown_connections 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- 172.21.15.64:0/1276344767 wait complete. 2024-09-21T07:26:55.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- start start 2024-09-21T07:26:55.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 Processor -- start 2024-09-21T07:26:55.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec04f0830 0x558ec0ad52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558ec0863090 con 0x558ec08f6ca0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558ec086f910 con 0x558ec090d950 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558ec091f750 con 0x558ec04f0830 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f11175c5000 10 client.0 _ll_register_callbacks cb 0x7f110005b450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41080/0 (socket says 172.21.15.64:41080) 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 -- 172.21.15.64:0/2840058087 learned_addr learned my addr 172.21.15.64:0/2840058087 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110cc00640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110e000640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec04f0830 0x558ec0ad52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 -- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec04f0830 msgr2=0x558ec0ad52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec04f0830 0x558ec0ad52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 -- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 msgr2=0x558ec0ad4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 -- 172.21.15.64:0/2840058087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec0826ab0 con 0x558ec08f6ca0 2024-09-21T07:26:55.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f110d600640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006010 tx=0x7f10fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e927d62cc8455d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.664+0000 7f10ee000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0ca070 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10fc0d2070 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f10fc004c60 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f10fc004e60 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 10 client.6606 fetch_fsmap learned FSMap version 44 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x558ec0805070 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10fc0d2070 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f10fc0a64f0 con 0x558ec08f6ca0 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 10 client.6606 fetch_fsmap finished waiting for FSMap version 44 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 10 client.6606 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:26:55.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 20 client.6606 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec0a905b0 0x558ec0a909c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 4 client.6606 mds_command: new command op to 6552 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 --> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] -- command(tid 0: {"prefix": "status"}) -- 0x558ec086e540 con 0x558ec0a905b0 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f110cc00640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec0a905b0 0x558ec0a909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f110cc00640 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec0a905b0 0x558ec0a909c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e45c84755a9d20e server_cookie=6e65025219645b2f in_seq=0 out_seq=0 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 10 client.6606 ms_handle_connect on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 1 -- 172.21.15.64:0/2840058087 <== mds.0 v2:172.21.15.64:6832/1639006862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558ec086e540 con 0x558ec0a905b0 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 10 client.6606 handle_command_reply: tid=0 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 client.6606 shutdown 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 msgr2=0x558ec0ad4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006010 tx=0x7f10fc004750 comp rx=0 tx=0).stop 2024-09-21T07:26:55.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 shutdown_connections 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x558ec0a905b0 0x558ec0a909c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558ec04f0830 0x558ec0ad52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558ec090d950 0x558ec0ad4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 --2- 172.21.15.64:0/2840058087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ec08f6ca0 0x558ec0ad4870 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f10ee000640 0 client.6606 ms_handle_reset on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 >> 172.21.15.64:0/2840058087 conn(0x558ec09e3d90 msgr2=0x558ec0a6f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 shutdown_connections 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 1 -- 172.21.15.64:0/2840058087 wait complete. 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f11175c5000 20 client.6606 trim_cache size 0 max 16384 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:55.677 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 6552, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 4.7498603460000002, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 44, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 71, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 71, 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 5.6234137659999996 2024-09-21T07:26:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 msgr2=0x7f10e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 0x7f10e8075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ae000 tx=0x7f10fc01b060 comp rx=0 tx=0).stop 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 msgr2=0x7f11080c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f110000e970 tx=0x7f110000ee30 comp rx=0 tx=0).stop 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 shutdown_connections 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f10e8073200 0x7f10e8075710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11080ce900 0x7f11080c8770 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11080b3910 0x7f11080c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 --2- 172.21.15.64:0/2378926032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110809df30 0x7f110815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 >> 172.21.15.64:0/2378926032 conn(0x7f110806d450 msgr2=0x7f11080cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 shutdown_connections 2024-09-21T07:26:55.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.668+0000 7f1110000640 1 -- 172.21.15.64:0/2378926032 wait complete. 2024-09-21T07:26:55.695 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- 172.21.15.64:0/4221375272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 msgr2=0x7f6df40b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 --2- 172.21.15.64:0/4221375272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df40b33d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009c70 tx=0x7f6de401cd20 comp rx=0 tx=0).stop 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- 172.21.15.64:0/4221375272 shutdown_connections 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 --2- 172.21.15.64:0/4221375272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40ce900 0x7f6df406f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 --2- 172.21.15.64:0/4221375272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df40b33d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- 172.21.15.64:0/4221375272 >> 172.21.15.64:0/4221375272 conn(0x7f6df406d450 msgr2=0x7f6df40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- 172.21.15.64:0/4221375272 shutdown_connections 2024-09-21T07:26:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- 172.21.15.64:0/4221375272 wait complete. 2024-09-21T07:26:55.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 Processor -- start 2024-09-21T07:26:55.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.852+0000 7f6df9a00640 1 -- start start 2024-09-21T07:26:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df4074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40b3910 0x7f6df41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4169000 con 0x7f6df40ce900 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4168e80 con 0x7f6df409df30 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6df4169180 con 0x7f6df40b3910 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41092/0 (socket says 172.21.15.64:41092) 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 -- 172.21.15.64:0/2660496155 learned_addr learned my addr 172.21.15.64:0/2660496155 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6dea000640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40b3910 0x7f6df41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df2a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df4074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 -- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40b3910 msgr2=0x7f6df41534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40b3910 0x7f6df41534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 -- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 msgr2=0x7f6df4074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df4074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 -- 172.21.15.64:0/2660496155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4074980 con 0x7f6df40ce900 2024-09-21T07:26:55.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df3400640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e740 tx=0x7f6dec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00ccc0 con 0x7f6df40ce900 2024-09-21T07:26:55.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dec00ce80 con 0x7f6df40ce900 2024-09-21T07:26:55.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df4155a10 con 0x7f6df40ce900 2024-09-21T07:26:55.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec005280 con 0x7f6df40ce900 2024-09-21T07:26:55.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df4155fd0 con 0x7f6df40ce900 2024-09-21T07:26:55.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.856+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df40b33d0 con 0x7f6df40ce900 2024-09-21T07:26:55.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.860+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6dec005420 con 0x7f6df40ce900 2024-09-21T07:26:55.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.860+0000 7f6deb400640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 0x7f6dd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.860+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f6dec094cb0 con 0x7f6df40ce900 2024-09-21T07:26:55.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.860+0000 7f6df2a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 0x7f6dd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.860+0000 7f6df2a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 0x7f6dd0075710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af000 tx=0x7f6de401b560 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:55.864+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6dec05f430 con 0x7f6df40ce900 2024-09-21T07:26:55.926 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:26:55.920+0000 7fe60a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:26:56.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.044+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f6df4157360 con 0x7f6df40ce900 2024-09-21T07:26:56.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.048+0000 7f6deb400640 1 -- 172.21.15.64:0/2660496155 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v40)=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7f6dec063e60 con 0x7f6df40ce900 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 msgr2=0x7f6dd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 0x7f6dd0075710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af000 tx=0x7f6de401b560 comp rx=0 tx=0).stop 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 msgr2=0x7f6df4072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e740 tx=0x7f6dec00ec00 comp rx=0 tx=0).stop 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 shutdown_connections 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6dd0073200 0x7f6dd0075710 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6df40ce900 0x7f6df4072c70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6df40b3910 0x7f6df41534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 --2- 172.21.15.64:0/2660496155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df409df30 0x7f6df4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 >> 172.21.15.64:0/2660496155 conn(0x7f6df406d450 msgr2=0x7f6df415a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 shutdown_connections 2024-09-21T07:26:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.052+0000 7f6df9a00640 1 -- 172.21.15.64:0/2660496155 wait complete. 2024-09-21T07:26:56.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-21T07:26:56.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 -- 172.21.15.64:0/2271751553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd501604c0 msgr2=0x7fbd50166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 --2- 172.21.15.64:0/2271751553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd501604c0 0x7fbd50166c60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009840 tx=0x7fbd4801c820 comp rx=0 tx=0).stop 2024-09-21T07:26:56.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 -- 172.21.15.64:0/2271751553 shutdown_connections 2024-09-21T07:26:56.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 --2- 172.21.15.64:0/2271751553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd501604c0 0x7fbd50166c60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 -- 172.21.15.64:0/2271751553 >> 172.21.15.64:0/2271751553 conn(0x7fbd5006d450 msgr2=0x7fbd500d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:56.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 -- 172.21.15.64:0/2271751553 shutdown_connections 2024-09-21T07:26:56.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.232+0000 7fbd55000640 1 -- 172.21.15.64:0/2271751553 wait complete. 2024-09-21T07:26:56.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 Processor -- start 2024-09-21T07:26:56.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- start start 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 0x7fbd5015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 0x7fbd5015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50169f60 con 0x7fbd5009df30 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50169de0 con 0x7fbd5015f9a0 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5016a0e0 con 0x7fbd501604c0 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41104/0 (socket says 172.21.15.64:41104) 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 -- 172.21.15.64:0/3522778259 learned_addr learned my addr 172.21.15.64:0/3522778259 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd45400640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 0x7fbd5015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4e800640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 0x7fbd5015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 -- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 msgr2=0x7fbd5015b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 0x7fbd5015b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 -- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 msgr2=0x7fbd5015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 0x7fbd5015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 -- 172.21.15.64:0/3522778259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd500b2710 con 0x7fbd5009df30 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd45400640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 0x7fbd5015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4e800640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 0x7fbd5015b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:56.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd4de00640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000ba80 tx=0x7fbd4000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000cc00 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd400039d0 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5015aa70 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003e60 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.236+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5015b030 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.240+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd500b33d0 con 0x7fbd5009df30 2024-09-21T07:26:56.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.240+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbd4001b020 con 0x7fbd5009df30 2024-09-21T07:26:56.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.240+0000 7fbd46a00640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 0x7fbd2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.240+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fbd400946b0 con 0x7fbd5009df30 2024-09-21T07:26:56.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.240+0000 7fbd45400640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 0x7fbd2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.244+0000 7fbd45400640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 0x7fbd2c075710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd5015a690 tx=0x7fbd38009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:56.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.244+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbd4005f400 con 0x7fbd5009df30 2024-09-21T07:26:56.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.420+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fbd500ce670 con 0x7fbd5009df30 2024-09-21T07:26:56.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.424+0000 7fbd46a00640 1 -- 172.21.15.64:0/3522778259 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v41)=0 v41) ==== 117+0+0 (secure 0 0 0) 0x7fbd4005ed00 con 0x7fbd5009df30 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 msgr2=0x7fbd2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 0x7fbd2c075710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd5015a690 tx=0x7fbd38009040 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 msgr2=0x7fbd5015e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000ba80 tx=0x7fbd4000bf40 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 shutdown_connections 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd2c073200 0x7fbd2c075710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd501604c0 0x7fbd5015b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd5015f9a0 0x7fbd5015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 --2- 172.21.15.64:0/3522778259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd5009df30 0x7fbd5015e810 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 >> 172.21.15.64:0/3522778259 conn(0x7fbd5006d450 msgr2=0x7fbd50154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:56.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 shutdown_connections 2024-09-21T07:26:56.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.428+0000 7fbd55000640 1 -- 172.21.15.64:0/3522778259 wait complete. 2024-09-21T07:26:56.454 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:56.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- 172.21.15.64:0/2435051630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162860 msgr2=0x7f8b840cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 --2- 172.21.15.64:0/2435051630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162860 0x7f8b840cf6a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009bc0 tx=0x7f8b7c01cb70 comp rx=0 tx=0).stop 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- 172.21.15.64:0/2435051630 shutdown_connections 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 --2- 172.21.15.64:0/2435051630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162860 0x7f8b840cf6a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 --2- 172.21.15.64:0/2435051630 >> v2:172.21.15.90:3300/0 conn(0x7f8b84162450 0x7f8b840cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- 172.21.15.64:0/2435051630 >> 172.21.15.64:0/2435051630 conn(0x7f8b8406d1c0 msgr2=0x7f8b8406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- 172.21.15.64:0/2435051630 shutdown_connections 2024-09-21T07:26:56.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- 172.21.15.64:0/2435051630 wait complete. 2024-09-21T07:26:56.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 Processor -- start 2024-09-21T07:26:56.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.608+0000 7f8b8a800640 1 -- start start 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b8406e8d0 0x7f8b84155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162450 0x7f8b84155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416bbe0 con 0x7f8b84162860 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416ba60 con 0x7f8b8406e8d0 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8416bd60 con 0x7f8b84162450 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41112/0 (socket says 172.21.15.64:41112) 2024-09-21T07:26:56.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 -- 172.21.15.64:0/816960713 learned_addr learned my addr 172.21.15.64:0/816960713 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b7be00640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162450 0x7f8b84155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83400640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b8406e8d0 0x7f8b84155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 -- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162450 msgr2=0x7f8b84155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162450 0x7f8b84155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 -- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b8406e8d0 msgr2=0x7f8b84155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b8406e8d0 0x7f8b84155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 -- 172.21.15.64:0/816960713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b840b5640 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b83e00640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c01a7a0 tx=0x7f8b7c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0bb070 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b7c004d40 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b840b6030 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0b2040 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841557b0 con 0x7f8b84162860 2024-09-21T07:26:56.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.612+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8415a9b0 con 0x7f8b84162860 2024-09-21T07:26:56.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.616+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8b7c004230 con 0x7f8b84162860 2024-09-21T07:26:56.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.616+0000 7f8b7b400640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 0x7f8b60075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:56.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.616+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f8b7c12e270 con 0x7f8b84162860 2024-09-21T07:26:56.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.616+0000 7f8b83400640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 0x7f8b60075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:56.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.616+0000 7f8b83400640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 0x7f8b60075740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8b74001870 tx=0x7f8b74001380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:56.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.620+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8b8415a9b0 con 0x7f8b84162860 2024-09-21T07:26:56.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.832+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b8415f800 con 0x7f8b84162860 2024-09-21T07:26:56.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.832+0000 7f8b7b400640 1 -- 172.21.15.64:0/816960713 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f8b840b5640 con 0x7f8b84162860 2024-09-21T07:26:56.839 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:56.839 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:26:56.839 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:26:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 msgr2=0x7f8b60075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 0x7f8b60075740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8b74001870 tx=0x7f8b74001380 comp rx=0 tx=0).stop 2024-09-21T07:26:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 msgr2=0x7f8b841564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c01a7a0 tx=0x7f8b7c003f60 comp rx=0 tx=0).stop 2024-09-21T07:26:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 shutdown_connections 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b60073230 0x7f8b60075740 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84162860 0x7f8b841564f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b84162450 0x7f8b84155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 --2- 172.21.15.64:0/816960713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b8406e8d0 0x7f8b84155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 >> 172.21.15.64:0/816960713 conn(0x7f8b8406d1c0 msgr2=0x7f8b841580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 shutdown_connections 2024-09-21T07:26:56.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:56.836+0000 7f8b8a800640 1 -- 172.21.15.64:0/816960713 wait complete. 2024-09-21T07:26:56.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:26:57.032 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:26:47.860491+0000","btime":"2024-09-21T07:26:46.924515+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:26:47.860491+0000","atime":"2024-09-21T07:26:46.924515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:26:47.860491+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:26:57.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:26:46.924515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:26:46.924515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:26:47.860491+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-21T07:26:47.860491+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:26:47.860491+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:26:57.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:26:57.033 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- 172.21.15.64:0/2227413803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 msgr2=0x7fe00c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 --2- 172.21.15.64:0/2227413803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c158db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009840 tx=0x7fdffc01c740 comp rx=0 tx=0).stop 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- 172.21.15.64:0/2227413803 shutdown_connections 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 --2- 172.21.15.64:0/2227413803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c158db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- 172.21.15.64:0/2227413803 >> 172.21.15.64:0/2227413803 conn(0x7fe00c0d0170 msgr2=0x7fe00c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- 172.21.15.64:0/2227413803 shutdown_connections 2024-09-21T07:26:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- 172.21.15.64:0/2227413803 wait complete. 2024-09-21T07:26:57.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 Processor -- start 2024-09-21T07:26:57.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.192+0000 7fe011a00640 1 -- start start 2024-09-21T07:26:57.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00c1592f0 0x7fe00c166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c16a340 con 0x7fe00c0af530 2024-09-21T07:26:57.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c16a1c0 con 0x7fe00c06ec70 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c16a4c0 con 0x7fe00c1592f0 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41120/0 (socket says 172.21.15.64:41120) 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 -- 172.21.15.64:0/2025934874 learned_addr learned my addr 172.21.15.64:0/2025934874 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe00aa00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe00b400640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00c1592f0 0x7fe00c166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 -- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00c1592f0 msgr2=0x7fe00c166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00c1592f0 0x7fe00c166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 -- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 msgr2=0x7fe00c164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 -- 172.21.15.64:0/2025934874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c0ad050 con 0x7fe00c0af530 2024-09-21T07:26:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe00aa00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe002000640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c4d0 tx=0x7fdff400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe003400640 1 -- 172.21.15.64:0/2025934874 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4016020 con 0x7fe00c0af530 2024-09-21T07:26:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe003400640 1 -- 172.21.15.64:0/2025934874 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff4012920 con 0x7fe00c0af530 2024-09-21T07:26:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c0ad330 con 0x7fe00c0af530 2024-09-21T07:26:57.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe003400640 1 -- 172.21.15.64:0/2025934874 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4012d50 con 0x7fe00c0af530 2024-09-21T07:26:57.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.196+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c0ad8f0 con 0x7fe00c0af530 2024-09-21T07:26:57.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe003400640 1 -- 172.21.15.64:0/2025934874 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdff4019020 con 0x7fe00c0af530 2024-09-21T07:26:57.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe003400640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 0x7fdfe8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe003400640 1 -- 172.21.15.64:0/2025934874 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fdff4094200 con 0x7fe00c0af530 2024-09-21T07:26:57.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe00aa00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 0x7fdfe8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe0190f9000 1 Processor -- start 2024-09-21T07:26:57.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe0190f9000 1 -- start start 2024-09-21T07:26:57.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.200+0000 7fe00aa00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 0x7fdfe8075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0af000 tx=0x7fdffc0b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e8ce0 0x55beb255bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb255c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55beb236da60 con 0x55beb23fc940 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55beb235ce90 con 0x55beb23e8ce0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55beb2360ca0 con 0x55beb23e29a0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41134/0 (socket says 172.21.15.64:41134) 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 -- 172.21.15.64:0/3639755111 learned_addr learned my addr 172.21.15.64:0/3639755111 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00b400640 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb255c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe002000640 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e8ce0 0x55beb255bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 -- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 msgr2=0x55beb255c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb255c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 -- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e8ce0 msgr2=0x55beb255bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e8ce0 0x55beb255bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 -- 172.21.15.64:0/3639755111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb23a6060 con 0x55beb23fc940 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe00aa00640 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009600 tx=0x7fdffc01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edca36cf369be78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fdffb400640 1 -- 172.21.15.64:0/3639755111 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0044c0 con 0x55beb23fc940 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fdffb400640 1 -- 172.21.15.64:0/3639755111 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdffc0b04f0 con 0x55beb23fc940 2024-09-21T07:26:57.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fdffb400640 1 -- 172.21.15.64:0/3639755111 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0b0940 con 0x55beb23fc940 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- 172.21.15.64:0/3639755111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 msgr2=0x55beb255b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009600 tx=0x7fdffc01c740 comp rx=0 tx=0).stop 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- 172.21.15.64:0/3639755111 shutdown_connections 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb255c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e8ce0 0x55beb255bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3639755111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb255b620 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- 172.21.15.64:0/3639755111 >> 172.21.15.64:0/3639755111 conn(0x55beb201b330 msgr2=0x55beb25105d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- 172.21.15.64:0/3639755111 shutdown_connections 2024-09-21T07:26:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- 172.21.15.64:0/3639755111 wait complete. 2024-09-21T07:26:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.204+0000 7fe0190f9000 1 -- start start 2024-09-21T07:26:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 Processor -- start 2024-09-21T07:26:57.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb2516f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb2517440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55beb23a0b80 con 0x55beb23e29a0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55beb2306970 con 0x55beb23fc940 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55beb2312bd0 con 0x55beb23e8ce0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 10 client.0 _ll_register_callbacks cb 0x55beb2303410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41148/0 (socket says 172.21.15.64:41148) 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 -- 172.21.15.64:0/757599545 learned_addr learned my addr 172.21.15.64:0/757599545 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe002000640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb2516f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00b400640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb2517440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 -- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 msgr2=0x55beb2516f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb2516f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 -- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 msgr2=0x55beb2517440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb2517440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 -- 172.21.15.64:0/757599545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb2305b50 con 0x55beb23e29a0 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe002000640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb2516f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00b400640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb2517440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe00aa00640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdffc01a370 tx=0x7fdffc0b08e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6fd5ac06ad776d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0d3020 con 0x55beb23e29a0 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55beb22f5200 con 0x55beb23e29a0 2024-09-21T07:26:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fdffc0b0ad0 con 0x55beb23e29a0 2024-09-21T07:26:57.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fdffc0044c0 con 0x55beb23e29a0 2024-09-21T07:26:57.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 10 client.6633 fetch_fsmap learned FSMap version 44 2024-09-21T07:26:57.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55beb22fb0c0 con 0x55beb23e29a0 2024-09-21T07:26:57.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55beb22f5200 con 0x55beb23e29a0 2024-09-21T07:26:57.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fdffc0ce050 con 0x55beb23e29a0 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 10 client.6633 fetch_fsmap finished waiting for FSMap version 44 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 10 client.6633 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 20 client.6633 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fffb10 0x55beb251d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 4 client.6633 mds_command: new command op to 6552 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.208+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 --> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beb236f9b0 con 0x55beb1fffb10 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe002000640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fffb10 0x55beb251d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe002000640 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fffb10 0x55beb251d0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12610cdef9a429f7 server_cookie=5f016ad9b017d911 in_seq=0 out_seq=0 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fdfefe00640 10 client.6633 ms_handle_connect on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fdfefe00640 1 -- 172.21.15.64:0/757599545 <== mds.0 v2:172.21.15.64:6832/1639006862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55beb236f9b0 con 0x55beb1fffb10 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fdfefe00640 10 client.6633 handle_command_reply: tid=0 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 client.6633 shutdown 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 msgr2=0x55beb255ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdffc01a370 tx=0x7fdffc0b08e0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 shutdown_connections 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fffb10 0x55beb251d0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb2517440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb2516f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fdfefe00640 0 client.6633 ms_handle_reset on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 --2- 172.21.15.64:0/757599545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e29a0 0x55beb255ae50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 >> 172.21.15.64:0/757599545 conn(0x55beb201b330 msgr2=0x55beb25105d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 shutdown_connections 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 1 -- 172.21.15.64:0/757599545 wait complete. 2024-09-21T07:26:57.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.212+0000 7fe0190f9000 20 client.6633 trim_cache size 0 max 16384 2024-09-21T07:26:57.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 Processor -- start 2024-09-21T07:26:57.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 -- start start 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e29a0 0x55beb25cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb25ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1fcff0 con 0x55beb23fc940 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c15c520 con 0x55beb23e29a0 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c1fc9a0 con 0x55beb23e8ce0 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41154/0 (socket says 172.21.15.64:41154) 2024-09-21T07:26:57.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 -- 172.21.15.64:0/3685213083 learned_addr learned my addr 172.21.15.64:0/3685213083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe002000640 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb25ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00aa00640 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e29a0 0x55beb25cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 -- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 msgr2=0x55beb25ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb25ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 -- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e29a0 msgr2=0x55beb25cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e29a0 0x55beb25cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 -- 172.21.15.64:0/3685213083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb23e1de0 con 0x55beb23fc940 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fe00b400640 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe004003c50 tx=0x7fe004005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fecb6b65c0327c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fdffaa00640 1 -- 172.21.15.64:0/3685213083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00401a020 con 0x55beb23fc940 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fdffaa00640 1 -- 172.21.15.64:0/3685213083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe004001ba0 con 0x55beb23fc940 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.232+0000 7fdffaa00640 1 -- 172.21.15.64:0/3685213083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004001fb0 con 0x55beb23fc940 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- 172.21.15.64:0/3685213083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 msgr2=0x55beb25cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe004003c50 tx=0x7fe004005420 comp rx=0 tx=0).stop 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- 172.21.15.64:0/3685213083 shutdown_connections 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23fc940 0x55beb25cd490 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e8ce0 0x55beb25ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- 172.21.15.64:0/3685213083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23e29a0 0x55beb25cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- 172.21.15.64:0/3685213083 >> 172.21.15.64:0/3685213083 conn(0x55beb201b330 msgr2=0x55beb256b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- 172.21.15.64:0/3685213083 shutdown_connections 2024-09-21T07:26:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- 172.21.15.64:0/3685213083 wait complete. 2024-09-21T07:26:57.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- start start 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 Processor -- start 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb25cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb258beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55beb2328f60 con 0x55beb23e8ce0 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55beb2328780 con 0x55beb23fc940 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55beb235ffb0 con 0x55beb23e29a0 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe0190f9000 10 client.0 _ll_register_callbacks cb 0x7fdff4013f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:26:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41166/0 (socket says 172.21.15.64:41166) 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 -- 172.21.15.64:0/1868961167 learned_addr learned my addr 172.21.15.64:0/1868961167 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe00aa00640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb25cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe00b400640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb258beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 -- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 msgr2=0x55beb25cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb25cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 -- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 msgr2=0x55beb258beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb258beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 -- 172.21.15.64:0/1868961167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb22f3640 con 0x55beb23e8ce0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fe002000640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdff400ce90 tx=0x7fdff4094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6606aa96e82da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.236+0000 7fdfefe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4078070 con 0x55beb23e8ce0 2024-09-21T07:26:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fdff405dd30 con 0x55beb23e8ce0 2024-09-21T07:26:57.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe004001ba0 con 0x55beb23e8ce0 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fdff4068260 con 0x55beb23e8ce0 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 10 client.6639 fetch_fsmap learned FSMap version 44 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55beb2325b10 con 0x55beb23e8ce0 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe004001ba0 con 0x55beb23e8ce0 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fdff405a220 con 0x55beb23e8ce0 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 10 client.6639 fetch_fsmap finished waiting for FSMap version 44 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 10 client.6639 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 20 client.6639 populate_metadata read hostname 'smithi064' 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fedb70 0x55beb258ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 4 client.6639 mds_command: new command op to 6552 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-21T07:26:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 --> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55beb236b460 con 0x55beb1fedb70 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe00aa00640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fedb70 0x55beb258ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe00aa00640 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fedb70 0x55beb258ca50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c70d6cd168af77 server_cookie=a70cc8ee54869756 in_seq=0 out_seq=0 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 10 client.6639 ms_handle_connect on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 1 -- 172.21.15.64:0/1868961167 <== mds.0 v2:172.21.15.64:6832/1639006862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55beb236b460 con 0x55beb1fedb70 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 10 client.6639 handle_command_reply: tid=0 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 client.6639 shutdown 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 msgr2=0x55beb25cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdff400ce90 tx=0x7fdff4094040 comp rx=0 tx=0).stop 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 shutdown_connections 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:6832/1639006862,v1:172.21.15.64:6833/1639006862] conn(0x55beb1fedb70 0x55beb258ca50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55beb23fc940 0x55beb258beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55beb23e8ce0 0x55beb25cd390 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 --2- 172.21.15.64:0/1868961167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55beb23e29a0 0x55beb25cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 >> 172.21.15.64:0/1868961167 conn(0x55beb201b330 msgr2=0x55beb250fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fdfefe00640 0 client.6639 ms_handle_reset on v2:172.21.15.64:6832/1639006862 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 shutdown_connections 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 1 -- 172.21.15.64:0/1868961167 wait complete. 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe0190f9000 20 client.6639 trim_cache size 0 max 16384 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:26:57.250 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "74a0beaa-6745-4389-a084-4631c47d5a25", 2024-09-21T07:26:57.251 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:26:57.251 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:26:57.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 msgr2=0x7fdfe8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 0x7fdfe8075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0af000 tx=0x7fdffc0b2040 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 msgr2=0x7fe00c0ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c4d0 tx=0x7fdff400c990 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 shutdown_connections 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfe8073200 0x7fdfe8075710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe00c1592f0 0x7fe00c166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe00c0af530 0x7fe00c0ae0f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 --2- 172.21.15.64:0/2025934874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe00c06ec70 0x7fe00c164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 >> 172.21.15.64:0/2025934874 conn(0x7fe00c0d0170 msgr2=0x7fe00c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 shutdown_connections 2024-09-21T07:26:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.240+0000 7fe011a00640 1 -- 172.21.15.64:0/2025934874 wait complete. 2024-09-21T07:26:57.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 -- 172.21.15.64:0/2733910217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 msgr2=0x7f64380cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 --2- 172.21.15.64:0/2733910217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f64380cc190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f642000a980 tx=0x7f642001db90 comp rx=0 tx=0).stop 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 -- 172.21.15.64:0/2733910217 shutdown_connections 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 --2- 172.21.15.64:0/2733910217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f64380cc190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 -- 172.21.15.64:0/2733910217 >> 172.21.15.64:0/2733910217 conn(0x7f64380743a0 msgr2=0x7f64380747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 -- 172.21.15.64:0/2733910217 shutdown_connections 2024-09-21T07:26:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.420+0000 7f643d200640 1 -- 172.21.15.64:0/2733910217 wait complete. 2024-09-21T07:26:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 Processor -- start 2024-09-21T07:26:57.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 -- start start 2024-09-21T07:26:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f643815b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 0x7f6438164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64380cd9e0 con 0x7f64380b3220 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64380cd860 con 0x7f64380cc6d0 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f643d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f64380cdb60 con 0x7f64380b5a20 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f6437400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f6437400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41172/0 (socket says 172.21.15.64:41172) 2024-09-21T07:26:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.424+0000 7f6437400640 1 -- 172.21.15.64:0/2269717697 learned_addr learned my addr 172.21.15.64:0/2269717697 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:26:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642fe00640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f643815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437e00640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 0x7f6438164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 -- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 msgr2=0x7f643815b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f643815b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 -- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 msgr2=0x7f6438164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 0x7f6438164580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 -- 172.21.15.64:0/2269717697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643815bc90 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437e00640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 0x7f6438164580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f6437400640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f642800c3c0 tx=0x7f642800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428017070 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64280054e0 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6438165e40 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280038b0 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6438163d80 con 0x7f64380b3220 2024-09-21T07:26:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64380510a0 con 0x7f64380b3220 2024-09-21T07:26:57.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f642801a070 con 0x7f64380b3220 2024-09-21T07:26:57.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.428+0000 7f642f400640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 0x7f6414075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:57.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.432+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f6428093780 con 0x7f64380b3220 2024-09-21T07:26:57.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.432+0000 7f642fe00640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 0x7f6414075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:57.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.432+0000 7f642fe00640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 0x7f6414075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f64200b0000 tx=0x7f642001c3d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:57.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.436+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f642805e560 con 0x7f64380b3220 2024-09-21T07:26:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64380750c0 con 0x7f64380b3220 2024-09-21T07:26:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f642f400640 1 -- 172.21.15.64:0/2269717697 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f642805de60 con 0x7f64380b3220 2024-09-21T07:26:57.654 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:26:57.654 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:26:57.654 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:26:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 msgr2=0x7f6414075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 0x7f6414075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f64200b0000 tx=0x7f642001c3d0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 msgr2=0x7f64380adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f642800c3c0 tx=0x7f642800c880 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 shutdown_connections 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6414073200 0x7f6414075710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64380cc6d0 0x7f6438164580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64380b5a20 0x7f643815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 --2- 172.21.15.64:0/2269717697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64380b3220 0x7f64380adb60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 >> 172.21.15.64:0/2269717697 conn(0x7f64380743a0 msgr2=0x7f643815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 shutdown_connections 2024-09-21T07:26:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:26:57.648+0000 7f643d200640 1 -- 172.21.15.64:0/2269717697 wait complete. 2024-09-21T07:26:57.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:26:57.850 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:26:47.860491+0000","btime":"2024-09-21T07:26:46.924515+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:26:47.860491+0000","atime":"2024-09-21T07:26:46.924515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:26:47.860491+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:26:57.850 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:26:46.924515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:26:46.924515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:26:47.860491+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-21T07:26:47.860491+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:26:47.860491+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:26:57.851 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-21T07:27:02.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- 172.21.15.64:0/1994806135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f747415f040 msgr2=0x7f747415f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 --2- 172.21.15.64:0/1994806135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f747415f040 0x7f747415f450 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7474071a80 tx=0x7f746001c7a0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- 172.21.15.64:0/1994806135 shutdown_connections 2024-09-21T07:27:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 --2- 172.21.15.64:0/1994806135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f747415f040 0x7f747415f450 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 --2- 172.21.15.64:0/1994806135 >> v2:172.21.15.90:3300/0 conn(0x7f74740ca550 0x7f747415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- 172.21.15.64:0/1994806135 >> 172.21.15.64:0/1994806135 conn(0x7f74740cd3a0 msgr2=0x7f74740cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- 172.21.15.64:0/1994806135 shutdown_connections 2024-09-21T07:27:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- 172.21.15.64:0/1994806135 wait complete. 2024-09-21T07:27:03.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 Processor -- start 2024-09-21T07:27:03.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.020+0000 7f7478c00640 1 -- start start 2024-09-21T07:27:03.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74740ca550 0x7f74741fc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 0x7f74741fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7474168d30 con 0x7f74740ce8c0 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7474168bb0 con 0x7f747415f040 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7474168eb0 con 0x7f74740ca550 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41192/0 (socket says 172.21.15.64:41192) 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 -- 172.21.15.64:0/2701653323 learned_addr learned my addr 172.21.15.64:0/2701653323 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7473400640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74740ca550 0x7f74741fc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7473e00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 0x7f74741fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 -- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74740ca550 msgr2=0x7f74741fc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74740ca550 0x7f74741fc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 -- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 msgr2=0x7f74741fcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 0x7f74741fcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 -- 172.21.15.64:0/2701653323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747409d400 con 0x7f74740ce8c0 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7473e00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 0x7f74741fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7472a00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f746400c400 tx=0x7f746400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464017070 con 0x7f74740ce8c0 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7464003600 con 0x7f74740ce8c0 2024-09-21T07:27:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464003a50 con 0x7f74740ce8c0 2024-09-21T07:27:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747409d6e0 con 0x7f74740ce8c0 2024-09-21T07:27:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74740b5a50 con 0x7f74740ce8c0 2024-09-21T07:27:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.024+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7474147bd0 con 0x7f74740ce8c0 2024-09-21T07:27:03.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.028+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f746401a070 con 0x7f74740ce8c0 2024-09-21T07:27:03.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.028+0000 7f746b400640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 0x7f7454075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.028+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f7464093730 con 0x7f74740ce8c0 2024-09-21T07:27:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.028+0000 7f7473400640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 0x7f7454075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.028+0000 7f7473400640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 0x7f7454075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f746c009eb0 tx=0x7f746c009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:03.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.032+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f74740ca960 con 0x7f74740ce8c0 2024-09-21T07:27:03.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f747415b540 con 0x7f74740ce8c0 2024-09-21T07:27:03.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f746b400640 1 -- 172.21.15.64:0/2701653323 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f746405e590 con 0x7f74740ce8c0 2024-09-21T07:27:03.253 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:03.253 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:27:03.254 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 msgr2=0x7f7454075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 0x7f7454075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f746c009eb0 tx=0x7f746c009500 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 msgr2=0x7f74741fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f746400c400 tx=0x7f746400c8c0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 shutdown_connections 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7454073200 0x7f7454075710 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747415f040 0x7f74741fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74740ce8c0 0x7f74741fca20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 --2- 172.21.15.64:0/2701653323 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74740ca550 0x7f74741fc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 >> 172.21.15.64:0/2701653323 conn(0x7f74740cd3a0 msgr2=0x7f747415a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 shutdown_connections 2024-09-21T07:27:03.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.248+0000 7f7478c00640 1 -- 172.21.15.64:0/2701653323 wait complete. 2024-09-21T07:27:03.277 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:27:03.449 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:26:47.860491+0000","btime":"2024-09-21T07:26:46.924515+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:26:47.860491+0000","atime":"2024-09-21T07:26:46.924515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:26:47.860491+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:26:47.864491+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-21T07:26:57.247192+0000","last_scrub_version":244,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:27:03.450 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:26:46.924515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:26:46.924515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:26:47.860491+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-21T07:26:47.860491+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-21T07:26:57.247192+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:26:47.860491+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-21T07:26:47.864491+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:27:03.450 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T07:27:03.451 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:27:03.451 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:03.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:03.643 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:27:03.643 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:03.643 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:03.643 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:03.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:03.652 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:03.652 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:03.652 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:03.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:03.661 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:03.661 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:03.661 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:03.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:03.704 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:03.704 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:03.705 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:03.715 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:03.715 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:03.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- 172.21.15.64:0/3416594041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 msgr2=0x7f22a8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 --2- 172.21.15.64:0/3416594041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22a8004c20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f22c40b50c0 tx=0x7f22ac01f660 comp rx=0 tx=0).stop 2024-09-21T07:27:03.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c3400640 1 -- 172.21.15.64:0/3416594041 reap_dead start 2024-09-21T07:27:03.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- 172.21.15.64:0/3416594041 shutdown_connections 2024-09-21T07:27:03.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- 172.21.15.64:0/3416594041 >> 172.21.15.64:0/3416594041 conn(0x7f22c40ccbe0 msgr2=0x7f22c40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:03.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- 172.21.15.64:0/3416594041 shutdown_connections 2024-09-21T07:27:03.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- 172.21.15.64:0/3416594041 wait complete. 2024-09-21T07:27:03.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 Processor -- start 2024-09-21T07:27:03.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.900+0000 7f22c9a00640 1 -- start start 2024-09-21T07:27:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c414e940 0x7f22c40cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c40cf110 0x7f22c41509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f22c40cc7f0 con 0x7f22a8004810 2024-09-21T07:27:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22c40cc670 con 0x7f22c40cf110 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f22c40cc970 con 0x7f22c414e940 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41216/0 (socket says 172.21.15.64:41216) 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 -- 172.21.15.64:0/4016220288 learned_addr learned my addr 172.21.15.64:0/4016220288 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c3400640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c40cf110 0x7f22c41509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22ba000640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c414e940 0x7f22c40cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 -- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c414e940 msgr2=0x7f22c40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c414e940 0x7f22c40cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 -- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c40cf110 msgr2=0x7f22c41509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c40cf110 0x7f22c41509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 -- 172.21.15.64:0/4016220288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c414e630 con 0x7f22a8004810 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c2a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f22b400f750 tx=0x7f22b400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b400bcb0 con 0x7f22a8004810 2024-09-21T07:27:03.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22b400fe60 con 0x7f22a8004810 2024-09-21T07:27:03.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011680 con 0x7f22a8004810 2024-09-21T07:27:03.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c409db50 con 0x7f22a8004810 2024-09-21T07:27:03.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c409aee0 con 0x7f22a8004810 2024-09-21T07:27:03.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.904+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c409a9f0 con 0x7f22a8004810 2024-09-21T07:27:03.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.908+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22b4019020 con 0x7f22a8004810 2024-09-21T07:27:03.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.908+0000 7f22bb400640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 0x7f22a0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:03.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.908+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f22b4094d20 con 0x7f22a8004810 2024-09-21T07:27:03.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.908+0000 7f22ba000640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 0x7f22a0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:03.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.908+0000 7f22ba000640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 0x7f22a0075740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0b0000 tx=0x7f22ac01c4a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:03.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:03.912+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f22b405f4a0 con 0x7f22a8004810 2024-09-21T07:27:04.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.128+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22c40cbcd0 con 0x7f22a8004810 2024-09-21T07:27:04.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.128+0000 7f22bb400640 1 -- 172.21.15.64:0/4016220288 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f22b4063ed0 con 0x7f22a8004810 2024-09-21T07:27:04.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:27:04.136 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 msgr2=0x7f22a0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 0x7f22a0075740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0b0000 tx=0x7f22ac01c4a0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 msgr2=0x7f22c414e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f22b400f750 tx=0x7f22b400fc10 comp rx=0 tx=0).stop 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 shutdown_connections 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22a0073230 0x7f22a0075740 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c40cf110 0x7f22c41509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c414e940 0x7f22c40cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 --2- 172.21.15.64:0/4016220288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22a8004810 0x7f22c414e0f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 >> 172.21.15.64:0/4016220288 conn(0x7f22c40ccbe0 msgr2=0x7f22c4072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 shutdown_connections 2024-09-21T07:27:04.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.132+0000 7f22c9a00640 1 -- 172.21.15.64:0/4016220288 wait complete. 2024-09-21T07:27:04.159 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- 172.21.15.64:0/604069243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380b4700 msgr2=0x7f9f38072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/604069243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380b4700 0x7f9f38072e20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9f3806adf0 tx=0x7f9f3001cd20 comp rx=0 tx=0).stop 2024-09-21T07:27:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- 172.21.15.64:0/604069243 shutdown_connections 2024-09-21T07:27:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/604069243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380b4700 0x7f9f38072e20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/604069243 >> v2:172.21.15.90:3300/0 conn(0x7f9f380709b0 0x7f9f380b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/604069243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 0x7f9f380700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- 172.21.15.64:0/604069243 >> 172.21.15.64:0/604069243 conn(0x7f9f380ccbe0 msgr2=0x7f9f380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- 172.21.15.64:0/604069243 shutdown_connections 2024-09-21T07:27:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- 172.21.15.64:0/604069243 wait complete. 2024-09-21T07:27:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 Processor -- start 2024-09-21T07:27:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.312+0000 7f9f3ce00640 1 -- start start 2024-09-21T07:27:04.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f380b4700 0x7f9f3814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 0x7f9f3809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9f380b2420 con 0x7f9f380709b0 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f380b22a0 con 0x7f9f380b4700 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9f380b25a0 con 0x7f9f3815edb0 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41238/0 (socket says 172.21.15.64:41238) 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 -- 172.21.15.64:0/969573597 learned_addr learned my addr 172.21.15.64:0/969573597 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35400640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f380b4700 0x7f9f3814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f36800640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 0x7f9f3809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 -- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 msgr2=0x7f9f3809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 0x7f9f3809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 -- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f380b4700 msgr2=0x7f9f3814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f380b4700 0x7f9f3814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 -- 172.21.15.64:0/969573597 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f380c5a70 con 0x7f9f380709b0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f35e00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800e7c0 tx=0x7f9f2800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800ccc0 con 0x7f9f380709b0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f2800ce80 con 0x7f9f380709b0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28005280 con 0x7f9f380709b0 2024-09-21T07:27:04.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f380c5d50 con 0x7f9f380709b0 2024-09-21T07:27:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f380c6310 con 0x7f9f380709b0 2024-09-21T07:27:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.316+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f38072e20 con 0x7f9f380709b0 2024-09-21T07:27:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.320+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f28005420 con 0x7f9f380709b0 2024-09-21T07:27:04.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.320+0000 7f9f2e000640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 0x7f9f18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.320+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f9f28094da0 con 0x7f9f380709b0 2024-09-21T07:27:04.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.320+0000 7f9f35400640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 0x7f9f18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.320+0000 7f9f35400640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 0x7f9f18075710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9f380b04a0 tx=0x7f9f240091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.324+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9f2805f490 con 0x7f9f380709b0 2024-09-21T07:27:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.536+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f3809da20 con 0x7f9f380709b0 2024-09-21T07:27:04.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f2e000640 1 -- 172.21.15.64:0/969573597 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f9f28063ec0 con 0x7f9f380709b0 2024-09-21T07:27:04.544 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:04.544 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:27:04.545 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:27:04.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 msgr2=0x7f9f18075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 0x7f9f18075710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9f380b04a0 tx=0x7f9f240091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 msgr2=0x7f9f3814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800e7c0 tx=0x7f9f2800ec80 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 shutdown_connections 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073200 0x7f9f18075710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3815edb0 0x7f9f3809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f380b4700 0x7f9f3814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 --2- 172.21.15.64:0/969573597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f380709b0 0x7f9f3814bfa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 >> 172.21.15.64:0/969573597 conn(0x7f9f380ccbe0 msgr2=0x7f9f381679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 shutdown_connections 2024-09-21T07:27:04.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.540+0000 7f9f3ce00640 1 -- 172.21.15.64:0/969573597 wait complete. 2024-09-21T07:27:04.567 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 -- 172.21.15.64:0/4171486385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c0070850 msgr2=0x7fa0c00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/4171486385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c0070850 0x7fa0c00b1be0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa0c006ad60 tx=0x7fa0a801c890 comp rx=0 tx=0).stop 2024-09-21T07:27:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 -- 172.21.15.64:0/4171486385 shutdown_connections 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/4171486385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00b2120 0x7fa0c00cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/4171486385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c0070850 0x7fa0c00b1be0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/4171486385 >> v2:172.21.15.90:3300/0 conn(0x7fa0c015cbd0 0x7fa0c0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.720+0000 7fa0c7a00640 1 -- 172.21.15.64:0/4171486385 >> 172.21.15.64:0/4171486385 conn(0x7fa0c00ccbe0 msgr2=0x7fa0c00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- 172.21.15.64:0/4171486385 shutdown_connections 2024-09-21T07:27:04.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- 172.21.15.64:0/4171486385 wait complete. 2024-09-21T07:27:04.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 Processor -- start 2024-09-21T07:27:04.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- start start 2024-09-21T07:27:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c0070850 0x7fa0c009c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015cbd0 0x7fa0c0145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c006fa30 con 0x7fa0c00b2120 2024-09-21T07:27:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c006f8b0 con 0x7fa0c015cbd0 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0c7a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c006fbb0 con 0x7fa0c0070850 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.724+0000 7fa0b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41266/0 (socket says 172.21.15.64:41266) 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 -- 172.21.15.64:0/1890718204 learned_addr learned my addr 172.21.15.64:0/1890718204 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0c5000640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c0070850 0x7fa0c009c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0c5a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015cbd0 0x7fa0c0145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 -- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c0070850 msgr2=0x7fa0c009c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c0070850 0x7fa0c009c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 -- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015cbd0 msgr2=0x7fa0c0145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015cbd0 0x7fa0c0145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 -- 172.21.15.64:0/1890718204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c0156cb0 con 0x7fa0c00b2120 2024-09-21T07:27:04.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0b7e00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801af40 tx=0x7fa0a80a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b2040 con 0x7fa0c00b2120 2024-09-21T07:27:04.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0a80043d0 con 0x7fa0c00b2120 2024-09-21T07:27:04.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8005290 con 0x7fa0c00b2120 2024-09-21T07:27:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c009cf30 con 0x7fa0c00b2120 2024-09-21T07:27:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c009d4f0 con 0x7fa0c00b2120 2024-09-21T07:27:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.728+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c00cbcd0 con 0x7fa0c00b2120 2024-09-21T07:27:04.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa0a80be060 con 0x7fa0c00b2120 2024-09-21T07:27:04.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0bd600640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 0x7fa09c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fa0a812db60 con 0x7fa0c00b2120 2024-09-21T07:27:04.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0c5000640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 0x7fa09c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0c5000640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 0x7fa09c075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009b40 tx=0x7fa0b00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.732+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa0a80164b0 con 0x7fa0c00b2120 2024-09-21T07:27:04.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0c0074c10 con 0x7fa0c00b2120 2024-09-21T07:27:04.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0bd600640 1 -- 172.21.15.64:0/1890718204 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+17155 (secure 0 0 0) 0x7fa0a80f89d0 con 0x7fa0c00b2120 2024-09-21T07:27:04.917 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:04.918 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":71,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:50.910205+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:26:30.860830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-21T07:26:32.079106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.90:6834/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.90:6837/1195501528":"2024-09-22T07:26:49.916389+0000","172.21.15.90:6836/1195501528":"2024-09-22T07:26:49.916389+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 msgr2=0x7fa09c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 0x7fa09c075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009b40 tx=0x7fa0b00091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 msgr2=0x7fa0c0143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801af40 tx=0x7fa0a80a5790 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 shutdown_connections 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa09c073200 0x7fa09c075710 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015cbd0 0x7fa0c0145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0c00b2120 0x7fa0c0143040 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 --2- 172.21.15.64:0/1890718204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c0070850 0x7fa0c009c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.912+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 >> 172.21.15.64:0/1890718204 conn(0x7fa0c00ccbe0 msgr2=0x7fa0c0157140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.916+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 shutdown_connections 2024-09-21T07:27:04.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:04.916+0000 7fa0c7a00640 1 -- 172.21.15.64:0/1890718204 wait complete. 2024-09-21T07:27:04.940 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:27:04.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3251385436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec0ce410 msgr2=0x7f6fec15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3251385436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec0ce410 0x7f6fec15f250 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009c80 tx=0x7f6fe401ccb0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3251385436 shutdown_connections 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3251385436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec0ce410 0x7f6fec15f250 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3251385436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec15b700 0x7f6fec0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3251385436 >> 172.21.15.64:0/3251385436 conn(0x7f6fec06e890 msgr2=0x7f6fec0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3251385436 shutdown_connections 2024-09-21T07:27:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3251385436 wait complete. 2024-09-21T07:27:05.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 Processor -- start 2024-09-21T07:27:05.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.096+0000 7f6ff2c00640 1 -- start start 2024-09-21T07:27:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec06ff90 0x7f6fec0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fec15b700 0x7f6fec0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec168b70 con 0x7f6fec164790 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1689f0 con 0x7f6fec15b700 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6fec168cf0 con 0x7f6fec06ff90 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57330/0 (socket says 172.21.15.64:57330) 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 -- 172.21.15.64:0/3992888142 learned_addr learned my addr 172.21.15.64:0/3992888142 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6fe3e00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fec15b700 0x7f6fec0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6febe00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec06ff90 0x7f6fec0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 -- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec06ff90 msgr2=0x7f6fec0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec06ff90 0x7f6fec0b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 -- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fec15b700 msgr2=0x7f6fec0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fec15b700 0x7f6fec0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 -- 172.21.15.64:0/3992888142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec074ca0 con 0x7f6fec164790 2024-09-21T07:27:05.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff0c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6fe401b360 tx=0x7f6fe4005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40bc070 con 0x7f6fec164790 2024-09-21T07:27:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fe4003fd0 con 0x7f6fec164790 2024-09-21T07:27:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1650e0 con 0x7f6fec164790 2024-09-21T07:27:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b2040 con 0x7f6fec164790 2024-09-21T07:27:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1fcc30 con 0x7f6fec164790 2024-09-21T07:27:05.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.100+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec1fc6c0 con 0x7f6fec164790 2024-09-21T07:27:05.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.104+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6fe40bf070 con 0x7f6fec164790 2024-09-21T07:27:05.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.104+0000 7f6fe8c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 0x7f6fc8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.104+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f6fe412dfa0 con 0x7f6fec164790 2024-09-21T07:27:05.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.104+0000 7f6febe00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 0x7f6fc8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.104+0000 7f6febe00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 0x7f6fc8075740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009b40 tx=0x7f6fdc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.108+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6fec1650e0 con 0x7f6fec164790 2024-09-21T07:27:05.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fec0b4240 con 0x7f6fec164790 2024-09-21T07:27:05.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6fe8c00640 1 -- 172.21.15.64:0/3992888142 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7f6fe4016990 con 0x7f6fec164790 2024-09-21T07:27:05.328 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:05.329 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:27:05.329 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 msgr2=0x7f6fc8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 0x7f6fc8075740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009b40 tx=0x7f6fdc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 msgr2=0x7f6fec164ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6fe401b360 tx=0x7f6fe4005ae0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 shutdown_connections 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6fc8073230 0x7f6fc8075740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fec164790 0x7f6fec164ba0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fec15b700 0x7f6fec0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 --2- 172.21.15.64:0/3992888142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6fec06ff90 0x7f6fec0b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 >> 172.21.15.64:0/3992888142 conn(0x7f6fec06e890 msgr2=0x7f6fec06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:05.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 shutdown_connections 2024-09-21T07:27:05.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.324+0000 7f6ff2c00640 1 -- 172.21.15.64:0/3992888142 wait complete. 2024-09-21T07:27:05.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 -- 172.21.15.64:0/2689979883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 msgr2=0x7fd1b415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/2689979883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b415f030 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4072780 tx=0x7fd1a801c760 comp rx=0 tx=0).stop 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 -- 172.21.15.64:0/2689979883 shutdown_connections 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/2689979883 >> v2:172.21.15.90:3300/0 conn(0x7fd1b415b620 0x7fd1b415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/2689979883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b415f030 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 -- 172.21.15.64:0/2689979883 >> 172.21.15.64:0/2689979883 conn(0x7fd1b40743a0 msgr2=0x7fd1b40747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 -- 172.21.15.64:0/2689979883 shutdown_connections 2024-09-21T07:27:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.504+0000 7fd1b9e00640 1 -- 172.21.15.64:0/2689979883 wait complete. 2024-09-21T07:27:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 Processor -- start 2024-09-21T07:27:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 -- start start 2024-09-21T07:27:05.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b415b620 0x7fd1b40b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b415fab0 0x7fd1b40b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4169130 con 0x7fd1b40b53d0 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4168fb0 con 0x7fd1b415fab0 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b41692b0 con 0x7fd1b415b620 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57360/0 (socket says 172.21.15.64:57360) 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 -- 172.21.15.64:0/936183447 learned_addr learned my addr 172.21.15.64:0/936183447 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b9400640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b415fab0 0x7fd1b40b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b3e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b415b620 0x7fd1b40b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 -- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b415b620 msgr2=0x7fd1b40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b415b620 0x7fd1b40b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 -- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b415fab0 msgr2=0x7fd1b40b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b415fab0 0x7fd1b40b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.508+0000 7fd1b8a00640 1 -- 172.21.15.64:0/936183447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b4159760 con 0x7fd1b40b53d0 2024-09-21T07:27:05.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b8a00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8019370 tx=0x7fd1a80a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80bb070 con 0x7fd1b40b53d0 2024-09-21T07:27:05.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1a8005030 con 0x7fd1b40b53d0 2024-09-21T07:27:05.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80b2040 con 0x7fd1b40b53d0 2024-09-21T07:27:05.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b4159a40 con 0x7fd1b40b53d0 2024-09-21T07:27:05.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b415a000 con 0x7fd1b40b53d0 2024-09-21T07:27:05.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b40510a0 con 0x7fd1b40b53d0 2024-09-21T07:27:05.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd1a80be070 con 0x7fd1b40b53d0 2024-09-21T07:27:05.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.512+0000 7fd1b0c00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 0x7fd194075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.516+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7fd1a812df50 con 0x7fd1b40b53d0 2024-09-21T07:27:05.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.516+0000 7fd1b3e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 0x7fd194075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.516+0000 7fd1b3e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 0x7fd194075710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.520+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd1a8016470 con 0x7fd1b40b53d0 2024-09-21T07:27:05.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.748+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1b40d0080 con 0x7fd1b40b53d0 2024-09-21T07:27:05.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.748+0000 7fd1b0c00640 1 -- 172.21.15.64:0/936183447 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5222 (secure 0 0 0) 0x7fd1a80f8c90 con 0x7fd1b40b53d0 2024-09-21T07:27:05.755 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:05.755 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":44,"btime":"2024-09-21T07:26:53:932585+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:26:33.122049+0000","modified":"2024-09-21T07:26:53.932578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6833/1639006862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1639006862},{"type":"v1","addr":"172.21.15.64:6833","nonce":1639006862}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6552,"qdb_cluster":[6552]},"id":4}]} 2024-09-21T07:27:05.755 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 44 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 msgr2=0x7fd194075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 0x7fd194075710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0008040 comp rx=0 tx=0).stop 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 msgr2=0x7fd1b4154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8019370 tx=0x7fd1a80a5750 comp rx=0 tx=0).stop 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 shutdown_connections 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd194073200 0x7fd194075710 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b415fab0 0x7fd1b40b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b415b620 0x7fd1b40b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 --2- 172.21.15.64:0/936183447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1b40b53d0 0x7fd1b4154200 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 >> 172.21.15.64:0/936183447 conn(0x7fd1b40743a0 msgr2=0x7fd1b4158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:05.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 shutdown_connections 2024-09-21T07:27:05.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.752+0000 7fd1b9e00640 1 -- 172.21.15.64:0/936183447 wait complete. 2024-09-21T07:27:05.777 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.928+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3554936844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480b2120 msgr2=0x7f7e480b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.928+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3554936844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480b2120 0x7f7e480b36c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806b090 tx=0x7f7e4001cd80 comp rx=0 tx=0).stop 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3554936844 shutdown_connections 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3554936844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480b2120 0x7f7e480b36c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3554936844 >> v2:172.21.15.90:3300/0 conn(0x7f7e480b4170 0x7f7e480b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3554936844 >> 172.21.15.64:0/3554936844 conn(0x7f7e480ccbe0 msgr2=0x7f7e480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:05.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3554936844 shutdown_connections 2024-09-21T07:27:05.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3554936844 wait complete. 2024-09-21T07:27:05.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 Processor -- start 2024-09-21T07:27:05.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.932+0000 7f7e4ce00640 1 -- start start 2024-09-21T07:27:05.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e480b2120 0x7f7e48150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e480b4170 0x7f7e480b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48165de0 con 0x7f7e480cc4e0 2024-09-21T07:27:05.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48165c60 con 0x7f7e480b2120 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7e48165f60 con 0x7f7e480b4170 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57378/0 (socket says 172.21.15.64:57378) 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 -- 172.21.15.64:0/3633920215 learned_addr learned my addr 172.21.15.64:0/3633920215 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e45e00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e480b2120 0x7f7e48150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e3fe00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e480b4170 0x7f7e480b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 -- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e480b4170 msgr2=0x7f7e480b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e480b4170 0x7f7e480b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 -- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e480b2120 msgr2=0x7f7e48150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e480b2120 0x7f7e48150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 -- 172.21.15.64:0/3633920215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481fc900 con 0x7f7e480cc4e0 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e46800640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7e40098990 tx=0x7f7e40005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400b2040 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e400bb070 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40004550 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481fcbe0 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481fd1a0 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e481664a0 con 0x7f7e480cc4e0 2024-09-21T07:27:05.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.936+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7e400046f0 con 0x7f7e480cc4e0 2024-09-21T07:27:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.940+0000 7f7e3e000640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 0x7f7e24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.940+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f7e4012ee50 con 0x7f7e480cc4e0 2024-09-21T07:27:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.940+0000 7f7e45e00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 0x7f7e24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.940+0000 7f7e45e00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 0x7f7e24075710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7e38004630 tx=0x7f7e3800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:05.944+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7e40016970 con 0x7f7e480cc4e0 2024-09-21T07:27:06.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.124+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e480b3240 con 0x7f7e480cc4e0 2024-09-21T07:27:06.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.124+0000 7f7e3e000640 1 -- 172.21.15.64:0/3633920215 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+17155 (secure 0 0 0) 0x7f7e400f95d0 con 0x7f7e480cc4e0 2024-09-21T07:27:06.131 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:06.131 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":71,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:26:50.910205+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:26:30.860830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-21T07:26:32.079106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.90:6834/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.90:6837/1195501528":"2024-09-22T07:26:49.916389+0000","172.21.15.90:6836/1195501528":"2024-09-22T07:26:49.916389+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 msgr2=0x7f7e24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 0x7f7e24075710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7e38004630 tx=0x7f7e3800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 msgr2=0x7f7e480b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7e40098990 tx=0x7f7e40005c90 comp rx=0 tx=0).stop 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 shutdown_connections 2024-09-21T07:27:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7e24073200 0x7f7e24075710 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e480cc4e0 0x7f7e480b1720 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e480b4170 0x7f7e480b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 --2- 172.21.15.64:0/3633920215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e480b2120 0x7f7e48150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 >> 172.21.15.64:0/3633920215 conn(0x7f7e480ccbe0 msgr2=0x7f7e481568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 shutdown_connections 2024-09-21T07:27:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.128+0000 7f7e4ce00640 1 -- 172.21.15.64:0/3633920215 wait complete. 2024-09-21T07:27:06.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:27:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 -- 172.21.15.64:0/2441919949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 msgr2=0x7f2764073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 --2- 172.21.15.64:0/2441919949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764073f30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f27640b6070 tx=0x7f275401c750 comp rx=0 tx=0).stop 2024-09-21T07:27:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 -- 172.21.15.64:0/2441919949 shutdown_connections 2024-09-21T07:27:06.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 --2- 172.21.15.64:0/2441919949 >> v2:172.21.15.90:3300/0 conn(0x7f27640cf8a0 0x7f276415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 --2- 172.21.15.64:0/2441919949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764073f30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 -- 172.21.15.64:0/2441919949 >> 172.21.15.64:0/2441919949 conn(0x7f27640cdd10 msgr2=0x7f27640ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:06.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 -- 172.21.15.64:0/2441919949 shutdown_connections 2024-09-21T07:27:06.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.308+0000 7f276ac00640 1 -- 172.21.15.64:0/2441919949 wait complete. 2024-09-21T07:27:06.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 Processor -- start 2024-09-21T07:27:06.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 -- start start 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27640b59e0 0x7f2764157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2764159a30 0x7f2764159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2764169790 con 0x7f276406ff90 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2764169610 con 0x7f27640b59e0 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f276ac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2764169910 con 0x7f2764159a30 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57392/0 (socket says 172.21.15.64:57392) 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 -- 172.21.15.64:0/3327282933 learned_addr learned my addr 172.21.15.64:0/3327282933 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f275b400640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27640b59e0 0x7f2764157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2768c00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2764159a30 0x7f2764159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 -- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2764159a30 msgr2=0x7f2764159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2764159a30 0x7f2764159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 -- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27640b59e0 msgr2=0x7f2764157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27640b59e0 0x7f2764157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 -- 172.21.15.64:0/3327282933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276415a380 con 0x7f276406ff90 2024-09-21T07:27:06.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.312+0000 7f2763e00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2754009790 tx=0x7f2754005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540bb020 con 0x7f276406ff90 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27540049c0 con 0x7f276406ff90 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27641f99e0 con 0x7f276406ff90 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754004db0 con 0x7f276406ff90 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27641f9fa0 con 0x7f276406ff90 2024-09-21T07:27:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764073f30 con 0x7f276406ff90 2024-09-21T07:27:06.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.316+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f27540be020 con 0x7f276406ff90 2024-09-21T07:27:06.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.320+0000 7f2760c00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 0x7f2740075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.320+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6273+0+0 (secure 0 0 0) 0x7f275412ed60 con 0x7f276406ff90 2024-09-21T07:27:06.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.320+0000 7f275b400640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 0x7f2740075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.320+0000 7f275b400640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 0x7f2740075710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f276415ad30 tx=0x7f274c0013a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:06.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.324+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f27540c5030 con 0x7f276406ff90 2024-09-21T07:27:06.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.536+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f27640b60c0 con 0x7f276406ff90 2024-09-21T07:27:06.544 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:27:06.540+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:27:06.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.540+0000 7f2760c00640 1 -- 172.21.15.64:0/3327282933 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7f276415a380 con 0x7f276406ff90 2024-09-21T07:27:06.546 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 msgr2=0x7f2740075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 0x7f2740075710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f276415ad30 tx=0x7f274c0013a0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 msgr2=0x7f2764151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2754009790 tx=0x7f2754005750 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 shutdown_connections 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2740073200 0x7f2740075710 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2764159a30 0x7f2764159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27640b59e0 0x7f2764157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 --2- 172.21.15.64:0/3327282933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f276406ff90 0x7f2764151220 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 >> 172.21.15.64:0/3327282933 conn(0x7f27640cdd10 msgr2=0x7f2764071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:06.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 shutdown_connections 2024-09-21T07:27:06.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.544+0000 7f276ac00640 1 -- 172.21.15.64:0/3327282933 wait complete. 2024-09-21T07:27:06.560 INFO:tasks.ceph.mds.c.smithi064.stderr: -5333> 2024-09-21T07:26:55.920+0000 7fe60a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:27:06.571 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:27:06.681 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 -- 172.21.15.64:0/3215568332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0c5ea0 msgr2=0x7f242c0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 --2- 172.21.15.64:0/3215568332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0c5ea0 0x7f242c0c62b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2424009c80 tx=0x7f242401cce0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 -- 172.21.15.64:0/3215568332 shutdown_connections 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 --2- 172.21.15.64:0/3215568332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0c5ea0 0x7f242c0c62b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 --2- 172.21.15.64:0/3215568332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0b3d60 0x7f242c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 -- 172.21.15.64:0/3215568332 >> 172.21.15.64:0/3215568332 conn(0x7f242c06d1c0 msgr2=0x7f242c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 -- 172.21.15.64:0/3215568332 shutdown_connections 2024-09-21T07:27:06.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.728+0000 7f2433200640 1 -- 172.21.15.64:0/3215568332 wait complete. 2024-09-21T07:27:06.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 Processor -- start 2024-09-21T07:27:06.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 -- start start 2024-09-21T07:27:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f242c0b3d60 0x7f242c14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0c5ea0 0x7f242c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f242c169ed0 con 0x7f242c0d1d00 2024-09-21T07:27:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f242c169d50 con 0x7f242c0b3d60 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2433200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f242c16a050 con 0x7f242c0c5ea0 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57436/0 (socket says 172.21.15.64:57436) 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 -- 172.21.15.64:0/4214503378 learned_addr learned my addr 172.21.15.64:0/4214503378 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f242be00640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f242c0b3d60 0x7f242c14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2423400640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0c5ea0 0x7f242c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 -- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0c5ea0 msgr2=0x7f242c0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0c5ea0 0x7f242c0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 -- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f242c0b3d60 msgr2=0x7f242c14d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f242c0b3d60 0x7f242c14d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 -- 172.21.15.64:0/4214503378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c14e5f0 con 0x7f242c0d1d00 2024-09-21T07:27:06.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.732+0000 7f2431200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2424009bd0 tx=0x7f24240093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24240bc070 con 0x7f242c0d1d00 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24240ad8e0 con 0x7f242c0d1d00 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24240b2040 con 0x7f242c0d1d00 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242c14e8d0 con 0x7f242c0d1d00 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242c1512b0 con 0x7f242c0d1d00 2024-09-21T07:27:06.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242c0b4170 con 0x7f242c0d1d00 2024-09-21T07:27:06.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f24240add10 con 0x7f242c0d1d00 2024-09-21T07:27:06.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 0x7f2408075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:06.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6359+0+0 (secure 0 0 0) 0x7f242412e5e0 con 0x7f242c0d1d00 2024-09-21T07:27:06.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.736+0000 7f242be00640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 0x7f2408075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:06.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.740+0000 7f242be00640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 0x7f2408075710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f241c001650 tx=0x7f241c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:06.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.740+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2424016990 con 0x7f242c0d1d00 2024-09-21T07:27:06.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:06.952+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f242c0b14e0 con 0x7f242c0d1d00 2024-09-21T07:27:07.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2428c00640 1 -- 172.21.15.64:0/4214503378 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7f24240f9370 con 0x7f242c0d1d00 2024-09-21T07:27:07.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 msgr2=0x7f2408075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:07.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 0x7f2408075710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f241c001650 tx=0x7f241c009040 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 msgr2=0x7f242c0b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2424009bd0 tx=0x7f24240093d0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 shutdown_connections 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2408073200 0x7f2408075710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f242c0d1d00 0x7f242c0b1cc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f242c0c5ea0 0x7f242c0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 --2- 172.21.15.64:0/4214503378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f242c0b3d60 0x7f242c14d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 >> 172.21.15.64:0/4214503378 conn(0x7f242c06d1c0 msgr2=0x7f242c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 shutdown_connections 2024-09-21T07:27:07.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.544+0000 7f2433200640 1 -- 172.21.15.64:0/4214503378 wait complete. 2024-09-21T07:27:07.574 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- 172.21.15.64:0/2523320072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 msgr2=0x7f96a015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 --2- 172.21.15.64:0/2523320072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a015c850 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9690009840 tx=0x7f969001c6b0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- 172.21.15.64:0/2523320072 shutdown_connections 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 --2- 172.21.15.64:0/2523320072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a015c850 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- 172.21.15.64:0/2523320072 >> 172.21.15.64:0/2523320072 conn(0x7f96a00d0170 msgr2=0x7f96a00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:07.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- 172.21.15.64:0/2523320072 shutdown_connections 2024-09-21T07:27:07.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- 172.21.15.64:0/2523320072 wait complete. 2024-09-21T07:27:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 Processor -- start 2024-09-21T07:27:07.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.740+0000 7f96a7a00640 1 -- start start 2024-09-21T07:27:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96a00ace00 0x7f96a01fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a009ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96a016adb0 con 0x7f96a00ad210 2024-09-21T07:27:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0073760 con 0x7f96a00ca7c0 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f96a016af30 con 0x7f96a00ace00 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57446/0 (socket says 172.21.15.64:57446) 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 -- 172.21.15.64:0/3587746411 learned_addr learned my addr 172.21.15.64:0/3587746411 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a5000640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96a00ace00 0x7f96a01fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:07.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a5a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a009ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:07.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 -- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96a00ace00 msgr2=0x7f96a01fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:07.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96a00ace00 0x7f96a01fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 -- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 msgr2=0x7f96a009ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a009ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 -- 172.21.15.64:0/3587746411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01fd1c0 con 0x7f96a00ad210 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f9697e00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f968800c460 tx=0x7f968800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96880052d0 con 0x7f96a00ad210 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9688005470 con 0x7f96a00ad210 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688012870 con 0x7f96a00ad210 2024-09-21T07:27:07.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0152540 con 0x7f96a00ad210 2024-09-21T07:27:07.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a0152800 con 0x7f96a00ad210 2024-09-21T07:27:07.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.744+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a015c850 con 0x7f96a00ad210 2024-09-21T07:27:07.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.748+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9688003600 con 0x7f96a00ad210 2024-09-21T07:27:07.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.748+0000 7f969d600640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 0x7f967c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.748+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6359+0+0 (secure 0 0 0) 0x7f9688093ff0 con 0x7f96a00ad210 2024-09-21T07:27:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.748+0000 7f96a5000640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 0x7f967c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:07.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.748+0000 7f96a5000640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 0x7f967c075740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f96900af000 tx=0x7f96900b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.752+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f96a01fd1c0 con 0x7f96a00ad210 2024-09-21T07:27:07.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:07.928+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96a00702e0 con 0x7f96a00ad210 2024-09-21T07:27:08.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.544+0000 7f969d600640 1 -- 172.21.15.64:0/3587746411 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7f968805ed00 con 0x7f96a00ad210 2024-09-21T07:27:08.551 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:27:08.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 msgr2=0x7f967c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 0x7f967c075740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f96900af000 tx=0x7f96900b2040 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 msgr2=0x7f96a009c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f968800c460 tx=0x7f968800c920 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 shutdown_connections 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f967c073230 0x7f967c075740 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96a00ca7c0 0x7f96a009ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96a00ad210 0x7f96a009c540 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 --2- 172.21.15.64:0/3587746411 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96a00ace00 0x7f96a01fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 >> 172.21.15.64:0/3587746411 conn(0x7f96a00d0170 msgr2=0x7f96a01534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.548+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 shutdown_connections 2024-09-21T07:27:08.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.552+0000 7f96a7a00640 1 -- 172.21.15.64:0/3587746411 wait complete. 2024-09-21T07:27:08.583 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:27:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 -- 172.21.15.64:0/753230894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c15f660 msgr2=0x7f216c06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 --2- 172.21.15.64:0/753230894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c15f660 0x7f216c06f500 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f216c0b60a0 tx=0x7f215c01c830 comp rx=0 tx=0).stop 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 -- 172.21.15.64:0/753230894 shutdown_connections 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 --2- 172.21.15.64:0/753230894 >> v2:172.21.15.90:3300/0 conn(0x7f216c074580 0x7f216c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 --2- 172.21.15.64:0/753230894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c15f660 0x7f216c06f500 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 -- 172.21.15.64:0/753230894 >> 172.21.15.64:0/753230894 conn(0x7f216c0d0170 msgr2=0x7f216c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 -- 172.21.15.64:0/753230894 shutdown_connections 2024-09-21T07:27:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.744+0000 7f2173000640 1 -- 172.21.15.64:0/753230894 wait complete. 2024-09-21T07:27:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 Processor -- start 2024-09-21T07:27:08.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 -- start start 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f216c06fa40 0x7f216c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f216c15f660 0x7f216c0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f216c06f000 con 0x7f216c074580 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f216c06ee80 con 0x7f216c06fa40 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2173000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f216c06f180 con 0x7f216c15f660 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57476/0 (socket says 172.21.15.64:57476) 2024-09-21T07:27:08.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 -- 172.21.15.64:0/1700956739 learned_addr learned my addr 172.21.15.64:0/1700956739 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2171000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f216c15f660 0x7f216c0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216be00640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f216c06fa40 0x7f216c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 -- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f216c15f660 msgr2=0x7f216c0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f216c15f660 0x7f216c0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 -- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f216c06fa40 msgr2=0x7f216c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f216c06fa40 0x7f216c15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:08.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 -- 172.21.15.64:0/1700956739 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c0b20a0 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f216b400640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f215800c3f0 tx=0x7f215800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.748+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158017070 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21580053c0 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c1fc580 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158003860 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1fcb40 con 0x7f216c074580 2024-09-21T07:27:08.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c06f4c0 con 0x7f216c074580 2024-09-21T07:27:08.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f215801a070 con 0x7f216c074580 2024-09-21T07:27:08.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2163e00640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 0x7f214c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:08.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5921+0+0 (secure 0 0 0) 0x7f2158093650 con 0x7f216c074580 2024-09-21T07:27:08.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.752+0000 7f216be00640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 0x7f214c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:08.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.756+0000 7f216be00640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 0x7f214c075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f215c0af000 tx=0x7f215c0195d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:08.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.756+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f215805dea0 con 0x7f216c074580 2024-09-21T07:27:08.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:08.936+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f216c1fcd40 con 0x7f216c074580 2024-09-21T07:27:09.261 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:09.264 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.552+0000 7f2163e00640 1 -- 172.21.15.64:0/1700956739 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7f2158091e20 con 0x7f216c074580 2024-09-21T07:27:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:27:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.552+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 msgr2=0x7f214c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.552+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 0x7f214c075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f215c0af000 tx=0x7f215c0195d0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.552+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 msgr2=0x7f216c0c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.552+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f215800c3f0 tx=0x7f215800c8b0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 shutdown_connections 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f214c073200 0x7f214c075710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f216c15f660 0x7f216c0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f216c074580 0x7f216c0c6370 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 --2- 172.21.15.64:0/1700956739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f216c06fa40 0x7f216c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 >> 172.21.15.64:0/1700956739 conn(0x7f216c0d0170 msgr2=0x7f216c164230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 shutdown_connections 2024-09-21T07:27:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.556+0000 7f2173000640 1 -- 172.21.15.64:0/1700956739 wait complete. 2024-09-21T07:27:09.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 -- 172.21.15.64:0/3493527288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30c8004d50 msgr2=0x7f30c8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3493527288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30c8004d50 0x7f30c8005160 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f30e406ddd0 tx=0x7f30dc01d300 comp rx=0 tx=0).stop 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e3400640 1 -- 172.21.15.64:0/3493527288 reap_dead start 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 -- 172.21.15.64:0/3493527288 shutdown_connections 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 -- 172.21.15.64:0/3493527288 >> 172.21.15.64:0/3493527288 conn(0x7f30e406d450 msgr2=0x7f30e40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:09.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 -- 172.21.15.64:0/3493527288 shutdown_connections 2024-09-21T07:27:09.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.740+0000 7f30e9c00640 1 -- 172.21.15.64:0/3493527288 wait complete. 2024-09-21T07:27:09.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 Processor -- start 2024-09-21T07:27:09.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- start start 2024-09-21T07:27:09.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c8004d50 0x7f30e40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:09.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e40b0fd0 0x7f30e4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:09.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b3550 con 0x7f30e40adda0 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b33d0 con 0x7f30e40b0fd0 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f30e40b36d0 con 0x7f30c8004d50 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57496/0 (socket says 172.21.15.64:57496) 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 -- 172.21.15.64:0/3302972 learned_addr learned my addr 172.21.15.64:0/3302972 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c8004d50 0x7f30e40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30dbe00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e40b0fd0 0x7f30e4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 -- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c8004d50 msgr2=0x7f30e40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c8004d50 0x7f30e40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 -- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e40b0fd0 msgr2=0x7f30e4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e40b0fd0 0x7f30e4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 -- 172.21.15.64:0/3302972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e40ae6f0 con 0x7f30e40adda0 2024-09-21T07:27:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e3400640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f30dc098ed0 tx=0x7f30dc006580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0be070 con 0x7f30e40adda0 2024-09-21T07:27:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30dc0067f0 con 0x7f30e40adda0 2024-09-21T07:27:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e41f9ef0 con 0x7f30e40adda0 2024-09-21T07:27:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0b2040 con 0x7f30e40adda0 2024-09-21T07:27:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.744+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41f9410 con 0x7f30e40adda0 2024-09-21T07:27:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e40cee30 con 0x7f30e40adda0 2024-09-21T07:27:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f30dc0c1070 con 0x7f30e40adda0 2024-09-21T07:27:09.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30daa00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 0x7f30c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:09.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f30dc12e710 con 0x7f30e40adda0 2024-09-21T07:27:09.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30e2a00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 0x7f30c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:09.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.748+0000 7f30e2a00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 0x7f30c0075710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005fd0 tx=0x7f30d4005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:09.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.752+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f30e40ae6f0 con 0x7f30e40adda0 2024-09-21T07:27:09.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.932+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f30e40b13e0 con 0x7f30e40adda0 2024-09-21T07:27:09.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.936+0000 7f30daa00640 1 -- 172.21.15.64:0/3302972 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v42) ==== 71+0+0 (secure 0 0 0) 0x7f30dc0170b0 con 0x7f30e40adda0 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 msgr2=0x7f30c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 0x7f30c0075710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005fd0 tx=0x7f30d4005f40 comp rx=0 tx=0).stop 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 msgr2=0x7f30e40ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f30dc098ed0 tx=0x7f30dc006580 comp rx=0 tx=0).stop 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 shutdown_connections 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30c0073200 0x7f30c0075710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30e40adda0 0x7f30e40ae1b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e40b0fd0 0x7f30e4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 --2- 172.21.15.64:0/3302972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c8004d50 0x7f30e40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 >> 172.21.15.64:0/3302972 conn(0x7f30e406d450 msgr2=0x7f30e4074380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 shutdown_connections 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:09.940+0000 7f30e9c00640 1 -- 172.21.15.64:0/3302972 wait complete. 2024-09-21T07:27:09.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-21T07:27:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 -- 172.21.15.64:0/3659278834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb05815edb0 msgr2=0x7fb0580700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 --2- 172.21.15.64:0/3659278834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb05815edb0 0x7fb0580700b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb0580afb50 tx=0x7fb04801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 -- 172.21.15.64:0/3659278834 shutdown_connections 2024-09-21T07:27:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 --2- 172.21.15.64:0/3659278834 >> v2:172.21.15.90:3300/0 conn(0x7fb0580b48d0 0x7fb058072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 --2- 172.21.15.64:0/3659278834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb05815edb0 0x7fb0580700b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 -- 172.21.15.64:0/3659278834 >> 172.21.15.64:0/3659278834 conn(0x7fb0580ccbe0 msgr2=0x7fb0580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 -- 172.21.15.64:0/3659278834 shutdown_connections 2024-09-21T07:27:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.124+0000 7fb05e000640 1 -- 172.21.15.64:0/3659278834 wait complete. 2024-09-21T07:27:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 Processor -- start 2024-09-21T07:27:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 -- start start 2024-09-21T07:27:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb05815edb0 0x7fb058151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 0x7fb058163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb058168c00 con 0x7fb0580709b0 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb058168a80 con 0x7fb058163810 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb05e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb058168d80 con 0x7fb05815edb0 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.128+0000 7fb057400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57516/0 (socket says 172.21.15.64:57516) 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 -- 172.21.15.64:0/2837240220 learned_addr learned my addr 172.21.15.64:0/2837240220 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb056a00640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb05815edb0 0x7fb058151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057e00640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 0x7fb058163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 -- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb05815edb0 msgr2=0x7fb058151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb05815edb0 0x7fb058151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 -- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 msgr2=0x7fb058163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 0x7fb058163c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 -- 172.21.15.64:0/2837240220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb058164160 con 0x7fb0580709b0 2024-09-21T07:27:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057e00640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 0x7fb058163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb057400640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb0480b0040 tx=0x7fb0480a5580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b2040 con 0x7fb0580709b0 2024-09-21T07:27:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0480043b0 con 0x7fb0580709b0 2024-09-21T07:27:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048005290 con 0x7fb0580709b0 2024-09-21T07:27:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0580aeff0 con 0x7fb0580709b0 2024-09-21T07:27:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb058165960 con 0x7fb0580709b0 2024-09-21T07:27:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb058072e20 con 0x7fb0580709b0 2024-09-21T07:27:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.132+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0480bd060 con 0x7fb0580709b0 2024-09-21T07:27:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.136+0000 7fb04f400640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 0x7fb038075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.136+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7fb04812d560 con 0x7fb0580709b0 2024-09-21T07:27:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.136+0000 7fb056a00640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 0x7fb038075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.136+0000 7fb056a00640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 0x7fb038075710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb058159b50 tx=0x7fb044009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.140+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb058164160 con 0x7fb0580709b0 2024-09-21T07:27:10.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.388+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fb05809da20 con 0x7fb0580709b0 2024-09-21T07:27:10.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.552+0000 7fb04f400640 1 -- 172.21.15.64:0/2837240220 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v227) ==== 151+0+0 (secure 0 0 0) 0x7fb0480164b0 con 0x7fb0580709b0 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 msgr2=0x7fb038075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 0x7fb038075710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb058159b50 tx=0x7fb044009040 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 msgr2=0x7fb0581fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb0480b0040 tx=0x7fb0480a5580 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 shutdown_connections 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb038073200 0x7fb038075710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb058163810 0x7fb058163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb05815edb0 0x7fb058151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 --2- 172.21.15.64:0/2837240220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0580709b0 0x7fb0581fc7a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 >> 172.21.15.64:0/2837240220 conn(0x7fb0580ccbe0 msgr2=0x7fb0580cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 shutdown_connections 2024-09-21T07:27:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.556+0000 7fb05e000640 1 -- 172.21.15.64:0/2837240220 wait complete. 2024-09-21T07:27:10.580 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-21T07:27:10.581 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:27:10.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:10.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 -- 172.21.15.64:0/677386896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3620003c90 msgr2=0x7f36200040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 --2- 172.21.15.64:0/677386896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3620003c90 0x7f36200040e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f362c00c640 tx=0x7f362c01d260 comp rx=0 tx=0).stop 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f363a800640 1 -- 172.21.15.64:0/677386896 reap_dead start 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 -- 172.21.15.64:0/677386896 shutdown_connections 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 -- 172.21.15.64:0/677386896 >> 172.21.15.64:0/677386896 conn(0x7f363c0ccbe0 msgr2=0x7f363c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 -- 172.21.15.64:0/677386896 shutdown_connections 2024-09-21T07:27:10.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.736+0000 7f3641000640 1 -- 172.21.15.64:0/677386896 wait complete. 2024-09-21T07:27:10.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 Processor -- start 2024-09-21T07:27:10.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 -- start start 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3620003c90 0x7f363c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f363c157760 0x7f363c09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1672b0 con 0x7f363c157c70 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f363c167430 con 0x7f3620003c90 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3641000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f363c1675b0 con 0x7f363c157760 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3631400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3631400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57526/0 (socket says 172.21.15.64:57526) 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3631400640 1 -- 172.21.15.64:0/1102810613 learned_addr learned my addr 172.21.15.64:0/1102810613 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:10.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f3639e00640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3620003c90 0x7f363c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.740+0000 7f363a800640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f363c157760 0x7f363c09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 -- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f363c157760 msgr2=0x7f363c09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f363c157760 0x7f363c09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 -- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3620003c90 msgr2=0x7f363c0b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3620003c90 0x7f363c0b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 -- 172.21.15.64:0/1102810613 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c09d7e0 con 0x7f363c157c70 2024-09-21T07:27:10.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3631400640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3624004c60 tx=0x7f3624001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624015020 con 0x7f363c157c70 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3624011960 con 0x7f363c157c70 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363c1fb790 con 0x7f363c157c70 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624011d70 con 0x7f363c157c70 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363c1fbd50 con 0x7f363c157c70 2024-09-21T07:27:10.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363c09d550 con 0x7f363c157c70 2024-09-21T07:27:10.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.744+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3624018020 con 0x7f363c157c70 2024-09-21T07:27:10.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.748+0000 7f3632a00640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 0x7f3618075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:10.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.748+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f3624094af0 con 0x7f363c157c70 2024-09-21T07:27:10.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.748+0000 7f3639e00640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 0x7f3618075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:10.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.748+0000 7f3639e00640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 0x7f3618075710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ac000 tx=0x7f362c01a0a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:10.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.752+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f362401f020 con 0x7f363c157c70 2024-09-21T07:27:10.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.936+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f363c0b41c0 con 0x7f363c157c70 2024-09-21T07:27:10.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3632a00640 1 -- 172.21.15.64:0/1102810613 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13518 (secure 0 0 0) 0x7f362405f4e0 con 0x7f363c157c70 2024-09-21T07:27:10.944 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:10.944 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":74,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:09.551394+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6833/1639006862":"2024-09-22T07:27:06.543949+0000","172.21.15.90:6835/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.64:6832/1639006862":"2024-09-22T07:27:06.543949+0000","172.21.15.90:6834/2154117473":"2024-09-22T07:26:50.910173+0000","172.21.15.90:6837/1195501528":"2024-09-22T07:26:49.916389+0000","172.21.15.90:6836/1195501528":"2024-09-22T07:26:49.916389+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 msgr2=0x7f3618075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 0x7f3618075710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ac000 tx=0x7f362c01a0a0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 msgr2=0x7f363c0b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3624004c60 tx=0x7f3624001800 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 shutdown_connections 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3618073200 0x7f3618075710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f363c157760 0x7f363c09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f363c157c70 0x7f363c0b3860 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 --2- 172.21.15.64:0/1102810613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3620003c90 0x7f363c0b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 >> 172.21.15.64:0/1102810613 conn(0x7f363c0ccbe0 msgr2=0x7f363c0aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 shutdown_connections 2024-09-21T07:27:10.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:10.940+0000 7f3641000640 1 -- 172.21.15.64:0/1102810613 wait complete. 2024-09-21T07:27:10.967 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:27:10.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 -- 172.21.15.64:0/2072620961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab2c004050 msgr2=0x7fab2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 --2- 172.21.15.64:0/2072620961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab2c004050 0x7fab2c004810 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fab44070e00 tx=0x7fab3001f700 comp rx=0 tx=0).stop 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab49600640 1 -- 172.21.15.64:0/2072620961 reap_dead start 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 -- 172.21.15.64:0/2072620961 shutdown_connections 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 -- 172.21.15.64:0/2072620961 >> 172.21.15.64:0/2072620961 conn(0x7fab4406d450 msgr2=0x7fab440d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 -- 172.21.15.64:0/2072620961 shutdown_connections 2024-09-21T07:27:11.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 -- 172.21.15.64:0/2072620961 wait complete. 2024-09-21T07:27:11.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.124+0000 7fab4b600640 1 Processor -- start 2024-09-21T07:27:11.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- start start 2024-09-21T07:27:11.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab2c004050 0x7fab4414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44073c30 0x7fab44074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fab440b33d0 con 0x7fab441f5990 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab440cef70 con 0x7fab2c004050 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fab440b3550 con 0x7fab44073c30 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57542/0 (socket says 172.21.15.64:57542) 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 -- 172.21.15.64:0/2439077579 learned_addr learned my addr 172.21.15.64:0/2439077579 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab49600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44073c30 0x7fab44074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab48c00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab2c004050 0x7fab4414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 -- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44073c30 msgr2=0x7fab44074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44073c30 0x7fab44074040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 -- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab2c004050 msgr2=0x7fab4414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab2c004050 0x7fab4414dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 -- 172.21.15.64:0/2439077579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44074580 con 0x7fab441f5990 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab43e00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fab30026410 tx=0x7fab30001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300bf070 con 0x7fab441f5990 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab30006090 con 0x7fab441f5990 2024-09-21T07:27:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab44150700 con 0x7fab441f5990 2024-09-21T07:27:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300b3070 con 0x7fab441f5990 2024-09-21T07:27:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab44150cc0 con 0x7fab441f5990 2024-09-21T07:27:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.128+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab441f6470 con 0x7fab441f5990 2024-09-21T07:27:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.132+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fab300c2070 con 0x7fab441f5990 2024-09-21T07:27:11.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.132+0000 7fab40c00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 0x7fab24075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.132+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7fab301317c0 con 0x7fab441f5990 2024-09-21T07:27:11.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.132+0000 7fab48c00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 0x7fab24075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.132+0000 7fab48c00640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 0x7fab24075740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fab38005e60 tx=0x7fab38005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:11.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.136+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fab44074580 con 0x7fab441f5990 2024-09-21T07:27:11.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.312+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab4406f890 con 0x7fab441f5990 2024-09-21T07:27:11.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.312+0000 7fab40c00640 1 -- 172.21.15.64:0/2439077579 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fab300194b0 con 0x7fab441f5990 2024-09-21T07:27:11.319 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 msgr2=0x7fab24075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 0x7fab24075740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fab38005e60 tx=0x7fab38005f40 comp rx=0 tx=0).stop 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 msgr2=0x7fab441f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fab30026410 tx=0x7fab30001d80 comp rx=0 tx=0).stop 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 shutdown_connections 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab24073230 0x7fab24075740 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44073c30 0x7fab44074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab441f5990 0x7fab441f5da0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 --2- 172.21.15.64:0/2439077579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab2c004050 0x7fab4414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 >> 172.21.15.64:0/2439077579 conn(0x7fab4406d450 msgr2=0x7fab440cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 shutdown_connections 2024-09-21T07:27:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.316+0000 7fab4b600640 1 -- 172.21.15.64:0/2439077579 wait complete. 2024-09-21T07:27:11.342 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-21T07:27:11.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- 172.21.15.64:0/1750387197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810006f620 msgr2=0x7f810006fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 --2- 172.21.15.64:0/1750387197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810006f620 0x7f810006fa30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f81000748b0 tx=0x7f80f801cd50 comp rx=0 tx=0).stop 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- 172.21.15.64:0/1750387197 shutdown_connections 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 --2- 172.21.15.64:0/1750387197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810006f620 0x7f810006fa30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 --2- 172.21.15.64:0/1750387197 >> v2:172.21.15.90:3300/0 conn(0x7f810015b810 0x7f81000ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- 172.21.15.64:0/1750387197 >> 172.21.15.64:0/1750387197 conn(0x7f81000d0de0 msgr2=0x7f81000d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- 172.21.15.64:0/1750387197 shutdown_connections 2024-09-21T07:27:11.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- 172.21.15.64:0/1750387197 wait complete. 2024-09-21T07:27:11.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 Processor -- start 2024-09-21T07:27:11.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.496+0000 7f8106600640 1 -- start start 2024-09-21T07:27:11.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f810006d020 0x7f8100154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 0x7f81000b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8100168bf0 con 0x7f810015b810 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8100168a70 con 0x7f810006d020 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8100168d70 con 0x7f810006f620 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57548/0 (socket says 172.21.15.64:57548) 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 -- 172.21.15.64:0/905409529 learned_addr learned my addr 172.21.15.64:0/905409529 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ff400640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f810006d020 0x7f8100154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80f6a00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 0x7f81000b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 -- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 msgr2=0x7f81000b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 0x7f81000b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 -- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f810006d020 msgr2=0x7f8100154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f810006d020 0x7f8100154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 -- 172.21.15.64:0/905409529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001548d0 con 0x7f810015b810 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80f6a00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 0x7f81000b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80ffe00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f80f8019960 tx=0x7f80f8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f80bb070 con 0x7f810015b810 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f8004c50 con 0x7f810015b810 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f80b2040 con 0x7f810015b810 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81001531f0 con 0x7f810015b810 2024-09-21T07:27:11.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001537b0 con 0x7f810015b810 2024-09-21T07:27:11.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.500+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810006fa30 con 0x7f810015b810 2024-09-21T07:27:11.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.504+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f80f80ad850 con 0x7f810015b810 2024-09-21T07:27:11.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.504+0000 7f80f7e00640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 0x7f80dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:11.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.504+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f80f812e0e0 con 0x7f810015b810 2024-09-21T07:27:11.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.504+0000 7f80ff400640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 0x7f80dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:11.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.504+0000 7f80ff400640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 0x7f80dc075710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f80f000bb50 tx=0x7f80f000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:11.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.508+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f80f8016970 con 0x7f810015b810 2024-09-21T07:27:11.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:11.744+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f81000b5c10 con 0x7f810015b810 2024-09-21T07:27:12.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f80f7e00640 1 -- 172.21.15.64:0/905409529 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v229) ==== 146+0+0 (secure 0 0 0) 0x7f80f8004e20 con 0x7f810015b810 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 msgr2=0x7f80dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 0x7f80dc075710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f80f000bb50 tx=0x7f80f000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 msgr2=0x7f8100156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f80f8019960 tx=0x7f80f8005b00 comp rx=0 tx=0).stop 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 shutdown_connections 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073200 0x7f80dc075710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810015b810 0x7f8100156540 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810006f620 0x7f81000b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 --2- 172.21.15.64:0/905409529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f810006d020 0x7f8100154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 >> 172.21.15.64:0/905409529 conn(0x7f81000d0de0 msgr2=0x7f810015adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 shutdown_connections 2024-09-21T07:27:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.564+0000 7f8106600640 1 -- 172.21.15.64:0/905409529 wait complete. 2024-09-21T07:27:12.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 -- 172.21.15.64:0/3852567715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 msgr2=0x7f79480700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 --2- 172.21.15.64:0/3852567715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f79480700b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7938009900 tx=0x7f793801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 -- 172.21.15.64:0/3852567715 shutdown_connections 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 --2- 172.21.15.64:0/3852567715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79480b48d0 0x7f7948072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 --2- 172.21.15.64:0/3852567715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f79480700b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 -- 172.21.15.64:0/3852567715 >> 172.21.15.64:0/3852567715 conn(0x7f79480ccbe0 msgr2=0x7f79480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:12.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 -- 172.21.15.64:0/3852567715 shutdown_connections 2024-09-21T07:27:12.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.751+0000 7f794ea00640 1 -- 172.21.15.64:0/3852567715 wait complete. 2024-09-21T07:27:12.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 Processor -- start 2024-09-21T07:27:12.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- start start 2024-09-21T07:27:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79480709b0 0x7f794809d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794809aaa0 0x7f79481fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7948168c00 con 0x7f794815edb0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7948168a80 con 0x7f79480709b0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7948168d80 con 0x7f794809aaa0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57576/0 (socket says 172.21.15.64:57576) 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 -- 172.21.15.64:0/3325027659 learned_addr learned my addr 172.21.15.64:0/3325027659 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f7947e00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79480709b0 0x7f794809d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ca00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794809aaa0 0x7f79481fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 -- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794809aaa0 msgr2=0x7f79481fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794809aaa0 0x7f79481fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 -- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79480709b0 msgr2=0x7f794809d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79480709b0 0x7f794809d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 -- 172.21.15.64:0/3325027659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79481640b0 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f793fe00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f793000c3f0 tx=0x7f793000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930017070 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79300053c0 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7948147940 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930003860 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.755+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7948156990 con 0x7f794815edb0 2024-09-21T07:27:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7948072e20 con 0x7f794815edb0 2024-09-21T07:27:12.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f793001a070 con 0x7f794815edb0 2024-09-21T07:27:12.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f7944c00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:12.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f7930093560 con 0x7f794815edb0 2024-09-21T07:27:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f7947e00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.759+0000 7f7947e00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 0x7f7924075710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f793801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:12.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.763+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7930021080 con 0x7f794815edb0 2024-09-21T07:27:12.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.939+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f794809da20 con 0x7f794815edb0 2024-09-21T07:27:12.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f7944c00640 1 -- 172.21.15.64:0/3325027659 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v42) ==== 59+0+2294 (secure 0 0 0) 0x7f793005e0d0 con 0x7f794815edb0 2024-09-21T07:27:12.948 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:27:12.948 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:27:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:27:12.950 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:27:12.950 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:27:12.950 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:27:12.950 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:27:12.950 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:27:12.951 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:27:12.952 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:27:12.952 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:27:12.952 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:27:12.952 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:27:12.952 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:27:12.953 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:27:12.953 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:27:12.953 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:27:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 msgr2=0x7f7924075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 0x7f7924075710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f793801b120 comp rx=0 tx=0).stop 2024-09-21T07:27:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 msgr2=0x7f7948147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f793000c3f0 tx=0x7f793000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 shutdown_connections 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794809aaa0 0x7f79481fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f794815edb0 0x7f7948147400 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 --2- 172.21.15.64:0/3325027659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79480709b0 0x7f794809d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 >> 172.21.15.64:0/3325027659 conn(0x7f79480ccbe0 msgr2=0x7f79480b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:12.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 shutdown_connections 2024-09-21T07:27:12.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:12.943+0000 7f794ea00640 1 -- 172.21.15.64:0/3325027659 wait complete. 2024-09-21T07:27:12.970 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:27:13.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- 172.21.15.64:0/2047607437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 msgr2=0x7f92000ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 --2- 172.21.15.64:0/2047607437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000ce1f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009900 tx=0x7f91ec01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- 172.21.15.64:0/2047607437 shutdown_connections 2024-09-21T07:27:13.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 --2- 172.21.15.64:0/2047607437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000ce1f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 --2- 172.21.15.64:0/2047607437 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f920009df30 0x7f92000b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- 172.21.15.64:0/2047607437 >> 172.21.15.64:0/2047607437 conn(0x7f920006d450 msgr2=0x7f92000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:13.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- 172.21.15.64:0/2047607437 shutdown_connections 2024-09-21T07:27:13.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- 172.21.15.64:0/2047607437 wait complete. 2024-09-21T07:27:13.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 Processor -- start 2024-09-21T07:27:13.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.127+0000 7f9207e00640 1 -- start start 2024-09-21T07:27:13.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920009df30 0x7f92000b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 0x7f92000c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9200169110 con 0x7f92000b3910 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9200168f90 con 0x7f920009df30 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9200169290 con 0x7f92000ce730 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57592/0 (socket says 172.21.15.64:57592) 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 -- 172.21.15.64:0/3553361138 learned_addr learned my addr 172.21.15.64:0/3553361138 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9205400640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920009df30 0x7f92000b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9205e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 0x7f92000c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 -- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 msgr2=0x7f92000c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 0x7f92000c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 -- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920009df30 msgr2=0x7f92000b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920009df30 0x7f92000b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 -- 172.21.15.64:0/3553361138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92000b2940 con 0x7f92000b3910 2024-09-21T07:27:13.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9205e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 0x7f92000c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:13.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9204a00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0b0040 tx=0x7f91ec005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0b2040 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91ec005310 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0a58d0 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92000c9af0 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92000ca0b0 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92000c9860 con 0x7f92000b3910 2024-09-21T07:27:13.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.131+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91ec0bd060 con 0x7f92000b3910 2024-09-21T07:27:13.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.135+0000 7f91fd600640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 0x7f91e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.135+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f91ec12d8a0 con 0x7f92000b3910 2024-09-21T07:27:13.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.135+0000 7f9205400640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 0x7f91e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.135+0000 7f9205400640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 0x7f91e0075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91f4005fd0 tx=0x7f91f400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:13.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.139+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f91ec0164d0 con 0x7f92000b3910 2024-09-21T07:27:13.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.315+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f92000b33d0 con 0x7f92000b3910 2024-09-21T07:27:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f91fd600640 1 -- 172.21.15.64:0/3553361138 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7f91ec0f8980 con 0x7f92000b3910 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 msgr2=0x7f91e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 0x7f91e0075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91f4005fd0 tx=0x7f91f400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 msgr2=0x7f92000c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0b0040 tx=0x7f91ec005e00 comp rx=0 tx=0).stop 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 shutdown_connections 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91e0073200 0x7f91e0075710 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92000ce730 0x7f92000c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92000b3910 0x7f92000c8970 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 --2- 172.21.15.64:0/3553361138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920009df30 0x7f92000b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 >> 172.21.15.64:0/3553361138 conn(0x7f920006d450 msgr2=0x7f920015b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 shutdown_connections 2024-09-21T07:27:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.319+0000 7f9207e00640 1 -- 172.21.15.64:0/3553361138 wait complete. 2024-09-21T07:27:13.346 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:27:13.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:13.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:13.550 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:27:13.551 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:13.551 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:13.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:13.559 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:13.560 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:13.569 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:13.569 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:13.569 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:13.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:13.616 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:13.617 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:13.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:13.626 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:27:13.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 -- 172.21.15.64:0/2309407160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4db8003c90 msgr2=0x7f4db80040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 --2- 172.21.15.64:0/2309407160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4db8003c90 0x7f4db80040e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c4a0 tx=0x7f4dc401cee0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd3200640 1 -- 172.21.15.64:0/2309407160 reap_dead start 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 -- 172.21.15.64:0/2309407160 shutdown_connections 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 -- 172.21.15.64:0/2309407160 >> 172.21.15.64:0/2309407160 conn(0x7f4dd40ccbe0 msgr2=0x7f4dd40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 -- 172.21.15.64:0/2309407160 shutdown_connections 2024-09-21T07:27:13.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.815+0000 7f4dd9400640 1 -- 172.21.15.64:0/2309407160 wait complete. 2024-09-21T07:27:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 Processor -- start 2024-09-21T07:27:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 -- start start 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4db8003c90 0x7f4dd4156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 0x7f4dd41585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4168120 con 0x7f4dd4161e30 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4167fa0 con 0x7f4dd409bd80 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd9400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd41682a0 con 0x7f4db8003c90 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57624/0 (socket says 172.21.15.64:57624) 2024-09-21T07:27:13.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 -- 172.21.15.64:0/4175783426 learned_addr learned my addr 172.21.15.64:0/4175783426 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd2800640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4db8003c90 0x7f4dd4156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd3200640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 0x7f4dd41585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 -- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4db8003c90 msgr2=0x7f4dd4156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4db8003c90 0x7f4dd4156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 -- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 msgr2=0x7f4dd41585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 0x7f4dd41585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 -- 172.21.15.64:0/4175783426 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd415e2e0 con 0x7f4dd4161e30 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dd3200640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 0x7f4dd41585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.819+0000 7f4dc9e00640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc011680 tx=0x7f4dbc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc01f070 con 0x7f4dd4161e30 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dbc00fc30 con 0x7f4dd4161e30 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd409ad90 con 0x7f4dd4161e30 2024-09-21T07:27:13.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc012450 con 0x7f4dd4161e30 2024-09-21T07:27:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd409b350 con 0x7f4dd4161e30 2024-09-21T07:27:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd4072e20 con 0x7f4dd4161e30 2024-09-21T07:27:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4dbc022070 con 0x7f4dd4161e30 2024-09-21T07:27:13.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 0x7f4db0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:13.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f4dbc094a30 con 0x7f4dd4161e30 2024-09-21T07:27:13.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.823+0000 7f4dd2800640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 0x7f4db0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:13.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.827+0000 7f4dd2800640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 0x7f4db0075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40ab000 tx=0x7f4dc4019d20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:13.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:13.831+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4dbc05f4c0 con 0x7f4dd4161e30 2024-09-21T07:27:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.043+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dd409da20 con 0x7f4dd4161e30 2024-09-21T07:27:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dcb400640 1 -- 172.21.15.64:0/4175783426 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+3908 (secure 0 0 0) 0x7f4dbc063ef0 con 0x7f4dd4161e30 2024-09-21T07:27:14.052 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:14.052 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":46,"btime":"2024-09-21T07:27:07:546363+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3622919763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3622919763},{"type":"v1","addr":"172.21.15.90:6837","nonce":3622919763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6080,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3032280102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3032280102},{"type":"v1","addr":"172.21.15.64:6833","nonce":3032280102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/475341356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":475341356},{"type":"v1","addr":"172.21.15.90:6835","nonce":475341356}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2309186187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2309186187},{"type":"v1","addr":"172.21.15.64:6835","nonce":2309186187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-21T07:27:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 46 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 msgr2=0x7f4db0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 0x7f4db0075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40ab000 tx=0x7f4dc4019d20 comp rx=0 tx=0).stop 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 msgr2=0x7f4dd4158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc011680 tx=0x7f4dbc011b40 comp rx=0 tx=0).stop 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 shutdown_connections 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db0073200 0x7f4db0075710 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd409bd80 0x7f4dd41585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd4161e30 0x7f4dd4158060 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 --2- 172.21.15.64:0/4175783426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4db8003c90 0x7f4dd4156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 >> 172.21.15.64:0/4175783426 conn(0x7f4dd40ccbe0 msgr2=0x7f4dd4068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:14.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 shutdown_connections 2024-09-21T07:27:14.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.047+0000 7f4dd9400640 1 -- 172.21.15.64:0/4175783426 wait complete. 2024-09-21T07:27:14.074 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:27:14.075 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:27:14.075 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:27:14.075 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:14.075 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:27:14.075 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:27:14.075 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:27:14.075 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:14.076 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:27:14.076 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:27:14.076 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:27:14.076 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:14.076 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:27:14.076 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:27:14.076 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:27:14.076 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:14.089 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:27:14.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:27:14.090 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:27:14.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:27:14.091 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:27:14.092 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:27:14.097 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:27:14.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:27:14.138 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:27:14.138 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:14.140 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:27:14.140 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:14.145 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:27:14.146 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:14.147 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:27:14.147 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:14.147 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:27:14.236 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:27:14.238 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:27:14.248 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:27:14.249 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 -- 172.21.15.64:0/463742893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f00b3910 msgr2=0x7f07f00ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 --2- 172.21.15.64:0/463742893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f00b3910 0x7f07f00ce1f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f07f0070f10 tx=0x7f07dc01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 -- 172.21.15.64:0/463742893 shutdown_connections 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 --2- 172.21.15.64:0/463742893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00ce730 0x7f07f00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 --2- 172.21.15.64:0/463742893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f00b3910 0x7f07f00ce1f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 --2- 172.21.15.64:0/463742893 >> v2:172.21.15.90:3300/0 conn(0x7f07f009df30 0x7f07f00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.307+0000 7f07f7800640 1 -- 172.21.15.64:0/463742893 >> 172.21.15.64:0/463742893 conn(0x7f07f006d450 msgr2=0x7f07f00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- 172.21.15.64:0/463742893 shutdown_connections 2024-09-21T07:27:14.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- 172.21.15.64:0/463742893 wait complete. 2024-09-21T07:27:14.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 Processor -- start 2024-09-21T07:27:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- start start 2024-09-21T07:27:14.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:14.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 0x7f07f015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:14.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07f00ce730 0x7f07f015b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:14.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00ccef0 con 0x7f07f009df30 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00ccd70 con 0x7f07f00ce730 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.311+0000 7f07f7800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f07f00cd070 con 0x7f07f00b3910 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57698/0 (socket says 172.21.15.64:57698) 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 -- 172.21.15.64:0/2846095512 learned_addr learned my addr 172.21.15.64:0/2846095512 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f5800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07f00ce730 0x7f07f015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07efe00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 0x7f07f015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 -- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 msgr2=0x7f07f015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 0x7f07f015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 -- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07f00ce730 msgr2=0x7f07f015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07f00ce730 0x7f07f015b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 -- 172.21.15.64:0/2846095512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f015a650 con 0x7f07f009df30 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07efe00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 0x7f07f015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:27:14.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f4e00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f07e400e9f0 tx=0x7f07e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:14.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e400cc60 con 0x7f07f009df30 2024-09-21T07:27:14.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07e4010430 con 0x7f07f009df30 2024-09-21T07:27:14.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f015bdc0 con 0x7f07f009df30 2024-09-21T07:27:14.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4010860 con 0x7f07f009df30 2024-09-21T07:27:14.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f015bac0 con 0x7f07f009df30 2024-09-21T07:27:14.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f00ce1f0 con 0x7f07f009df30 2024-09-21T07:27:14.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.315+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07e4010a00 con 0x7f07f009df30 2024-09-21T07:27:14.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.319+0000 7f07ecc00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 0x7f07d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:14.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.319+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5507+0+0 (secure 0 0 0) 0x7f07e4094cc0 con 0x7f07f009df30 2024-09-21T07:27:14.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.319+0000 7f07efe00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 0x7f07d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:14.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.319+0000 7f07efe00640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 0x7f07d0075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0af000 tx=0x7f07dc01b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:14.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.323+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f07e405f6d0 con 0x7f07f009df30 2024-09-21T07:27:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:14.515+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f07f00ae9f0 con 0x7f07f009df30 2024-09-21T07:27:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07ecc00640 1 -- 172.21.15.64:0/2846095512 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) ==== 97+0+0 (secure 0 0 0) 0x7f07e4064100 con 0x7f07f009df30 2024-09-21T07:27:15.343 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 msgr2=0x7f07d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 0x7f07d0075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0af000 tx=0x7f07dc01b100 comp rx=0 tx=0).stop 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 msgr2=0x7f07f014f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f07e400e9f0 tx=0x7f07e400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 shutdown_connections 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07d0073200 0x7f07d0075710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07f00ce730 0x7f07f015b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07f00b3910 0x7f07f015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 --2- 172.21.15.64:0/2846095512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07f009df30 0x7f07f014f9c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 >> 172.21.15.64:0/2846095512 conn(0x7f07f006d450 msgr2=0x7f07f00cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 shutdown_connections 2024-09-21T07:27:15.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.339+0000 7f07f7800640 1 -- 172.21.15.64:0/2846095512 wait complete. 2024-09-21T07:27:15.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:27:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 -- 172.21.15.64:0/3561546594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 msgr2=0x7fe24006ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 --2- 172.21.15.64:0/3561546594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe24006ffb0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe240073820 tx=0x7fe23801cc30 comp rx=0 tx=0).stop 2024-09-21T07:27:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 -- 172.21.15.64:0/3561546594 shutdown_connections 2024-09-21T07:27:15.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 --2- 172.21.15.64:0/3561546594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe24006ffb0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 --2- 172.21.15.64:0/3561546594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe24015f100 0x7fe24015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 --2- 172.21.15.64:0/3561546594 >> v2:172.21.15.90:3300/0 conn(0x7fe2400cd790 0x7fe24015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 -- 172.21.15.64:0/3561546594 >> 172.21.15.64:0/3561546594 conn(0x7fe2400b2ca0 msgr2=0x7fe2400b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 -- 172.21.15.64:0/3561546594 shutdown_connections 2024-09-21T07:27:15.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.527+0000 7fe246000640 1 -- 172.21.15.64:0/3561546594 wait complete. 2024-09-21T07:27:15.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 Processor -- start 2024-09-21T07:27:15.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 -- start start 2024-09-21T07:27:15.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2400cd790 0x7fe240159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe24015f100 0x7fe2401597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400b6740 con 0x7fe24006fba0 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400b65c0 con 0x7fe24015f100 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe246000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400b68c0 con 0x7fe2400cd790 2024-09-21T07:27:15.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41520/0 (socket says 172.21.15.64:41520) 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23f400640 1 -- 172.21.15.64:0/433359957 learned_addr learned my addr 172.21.15.64:0/433359957 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe237e00640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2400cd790 0x7fe240159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23fe00640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe24015f100 0x7fe2401597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23f400640 1 -- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2400cd790 msgr2=0x7fe240159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.531+0000 7fe23f400640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2400cd790 0x7fe240159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe23f400640 1 -- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe24015f100 msgr2=0x7fe2401597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe23f400640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe24015f100 0x7fe2401597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe23f400640 1 -- 172.21.15.64:0/433359957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240146580 con 0x7fe24006fba0 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe23f400640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d6a0 tx=0x7fe23000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230017070 con 0x7fe24006fba0 2024-09-21T07:27:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe230004310 con 0x7fe24006fba0 2024-09-21T07:27:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230005280 con 0x7fe24006fba0 2024-09-21T07:27:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2401fc040 con 0x7fe24006fba0 2024-09-21T07:27:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2401fc2e0 con 0x7fe24006fba0 2024-09-21T07:27:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24015b320 con 0x7fe24006fba0 2024-09-21T07:27:15.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.535+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe230005420 con 0x7fe24006fba0 2024-09-21T07:27:15.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.539+0000 7fe237400640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 0x7fe21c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.539+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7fe230094410 con 0x7fe24006fba0 2024-09-21T07:27:15.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.539+0000 7fe237e00640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 0x7fe21c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.539+0000 7fe237e00640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 0x7fe21c075710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe228005fd0 tx=0x7fe228005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:15.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.543+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe230020020 con 0x7fe24006fba0 2024-09-21T07:27:15.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.787+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe2400b3bb0 con 0x7fe24006fba0 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.787+0000 7fe237400640 1 -- 172.21.15.64:0/433359957 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7fe23005f680 con 0x7fe24006fba0 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:27:15.794 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:27:15.795 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.796 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.797 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.798 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:27:15.799 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.800 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.801 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.802 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:27:15.803 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:27:15.804 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:15.805 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.806 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:27:15.807 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:15.808 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.808 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:15.808 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:27:15.808 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 msgr2=0x7fe21c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 0x7fe21c075710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe228005fd0 tx=0x7fe228005e40 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 msgr2=0x7fe2401459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d6a0 tx=0x7fe23000db60 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 shutdown_connections 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe21c073200 0x7fe21c075710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe24015f100 0x7fe2401597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2400cd790 0x7fe240159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 --2- 172.21.15.64:0/433359957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24006fba0 0x7fe2401459d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 >> 172.21.15.64:0/433359957 conn(0x7fe2400b2ca0 msgr2=0x7fe2400b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 shutdown_connections 2024-09-21T07:27:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.791+0000 7fe246000640 1 -- 172.21.15.64:0/433359957 wait complete. 2024-09-21T07:27:15.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- 172.21.15.64:0/2560717744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 msgr2=0x7f46480b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 --2- 172.21.15.64:0/2560717744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f46480b3120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f463000a950 tx=0x7f463001da90 comp rx=0 tx=0).stop 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- 172.21.15.64:0/2560717744 shutdown_connections 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 --2- 172.21.15.64:0/2560717744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f46480b3120 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- 172.21.15.64:0/2560717744 >> 172.21.15.64:0/2560717744 conn(0x7f46480ccbe0 msgr2=0x7f46480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- 172.21.15.64:0/2560717744 shutdown_connections 2024-09-21T07:27:15.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- 172.21.15.64:0/2560717744 wait complete. 2024-09-21T07:27:15.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 Processor -- start 2024-09-21T07:27:15.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.971+0000 7f464da00640 1 -- start start 2024-09-21T07:27:15.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46480b24e0 0x7f46481541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f464806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46481692c0 con 0x7f46480cb2d0 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4648169140 con 0x7f46480caec0 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4648169440 con 0x7f46480b24e0 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41524/0 (socket says 172.21.15.64:41524) 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 -- 172.21.15.64:0/3161153227 learned_addr learned my addr 172.21.15.64:0/3161153227 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f463fe00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f464806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4646a00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46480b24e0 0x7f46481541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 -- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46480b24e0 msgr2=0x7f46481541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46480b24e0 0x7f46481541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 -- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 msgr2=0x7f464806ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f464806ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 -- 172.21.15.64:0/3161153227 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46481f9440 con 0x7f46480cb2d0 2024-09-21T07:27:15.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f4647400640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f464000c6b0 tx=0x7f464000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640003b80 con 0x7f46480cb2d0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4640003d20 con 0x7f46480cb2d0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640005330 con 0x7f46480cb2d0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481f9720 con 0x7f46480cb2d0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481f9ce0 con 0x7f46480cb2d0 2024-09-21T07:27:15.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.975+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46480ca7b0 con 0x7f46480cb2d0 2024-09-21T07:27:15.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.979+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f46400054d0 con 0x7f46480cb2d0 2024-09-21T07:27:15.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.979+0000 7f463ea00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 0x7f4624075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:15.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.979+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7f4640093db0 con 0x7f46480cb2d0 2024-09-21T07:27:15.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.979+0000 7f4646a00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 0x7f4624075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:15.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.979+0000 7f4646a00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 0x7f4624075710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4638001870 tx=0x7f46380016a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:15.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:15.983+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4640098070 con 0x7f46480cb2d0 2024-09-21T07:27:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.159+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f464809af70 con 0x7f46480cb2d0 2024-09-21T07:27:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.159+0000 7f463ea00640 1 -- 172.21.15.64:0/3161153227 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f464005e8a0 con 0x7f46480cb2d0 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:16.167 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 msgr2=0x7f4624075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 0x7f4624075710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4638001870 tx=0x7f46380016a0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 msgr2=0x7f464806f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f464000c6b0 tx=0x7f464000cb70 comp rx=0 tx=0).stop 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 shutdown_connections 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4624073200 0x7f4624075710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46480cb2d0 0x7f464806f290 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46480caec0 0x7f464806ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 --2- 172.21.15.64:0/3161153227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46480b24e0 0x7f46481541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 >> 172.21.15.64:0/3161153227 conn(0x7f46480ccbe0 msgr2=0x7f4648068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 shutdown_connections 2024-09-21T07:27:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.163+0000 7f464da00640 1 -- 172.21.15.64:0/3161153227 wait complete. 2024-09-21T07:27:16.189 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:27:16.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/378042403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b51a0 msgr2=0x7f05c80b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/378042403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b51a0 0x7f05c80b55b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009bc0 tx=0x7f05c001cba0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/378042403 shutdown_connections 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/378042403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b51a0 0x7f05c80b55b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/378042403 >> 172.21.15.64:0/378042403 conn(0x7f05c806d220 msgr2=0x7f05c806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/378042403 shutdown_connections 2024-09-21T07:27:16.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/378042403 wait complete. 2024-09-21T07:27:16.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 Processor -- start 2024-09-21T07:27:16.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- start start 2024-09-21T07:27:16.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:16.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05c80b51a0 0x7f05c8167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:16.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05c80b7b50 0x7f05c8167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05c816af10 con 0x7f05c80b3dd0 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05c816ad90 con 0x7f05c80b51a0 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f05c816b090 con 0x7f05c80b7b50 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41552/0 (socket says 172.21.15.64:41552) 2024-09-21T07:27:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 -- 172.21.15.64:0/4126930349 learned_addr learned my addr 172.21.15.64:0/4126930349 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6000640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05c80b51a0 0x7f05c8167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c7400640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05c80b7b50 0x7f05c8167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 -- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05c80b7b50 msgr2=0x7f05c8167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05c80b7b50 0x7f05c8167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 -- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05c80b51a0 msgr2=0x7f05c8167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05c80b51a0 0x7f05c8167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 -- 172.21.15.64:0/4126930349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c80afcd0 con 0x7f05c80b3dd0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05c6a00640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c420 tx=0x7f05b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8017070 con 0x7f05c80b3dd0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b80053c0 con 0x7f05c80b3dd0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c81fbd70 con 0x7f05c80b3dd0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8003860 con 0x7f05c80b3dd0 2024-09-21T07:27:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c80c9fa0 con 0x7f05c80b3dd0 2024-09-21T07:27:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80ca200 con 0x7f05c80b3dd0 2024-09-21T07:27:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.359+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f05b801a070 con 0x7f05c80b3dd0 2024-09-21T07:27:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.359+0000 7f05bea00640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 0x7f05a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.359+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7f05b80933d0 con 0x7f05c80b3dd0 2024-09-21T07:27:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.359+0000 7f05c6000640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 0x7f05a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.359+0000 7f05c6000640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 0x7f05a8075710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05c80c5da0 tx=0x7f05b4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:16.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.363+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f05b805e630 con 0x7f05c80b3dd0 2024-09-21T07:27:16.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:16.543+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f05c80b55b0 con 0x7f05c80b3dd0 2024-09-21T07:27:17.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.347+0000 7f05bea00640 1 -- 172.21.15.64:0/4126930349 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7f05b805df30 con 0x7f05c80b3dd0 2024-09-21T07:27:17.349 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:27:17.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 msgr2=0x7f05a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:17.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 0x7f05a8075710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05c80c5da0 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 msgr2=0x7f05c815acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c420 tx=0x7f05b800c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 shutdown_connections 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05a8073200 0x7f05a8075710 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05c80c5da0 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05c80b7b50 0x7f05c8167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05c80b51a0 0x7f05c8167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 --2- 172.21.15.64:0/4126930349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05c80b3dd0 0x7f05c815acb0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 >> 172.21.15.64:0/4126930349 conn(0x7f05c806d220 msgr2=0x7f05c8068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:17.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 shutdown_connections 2024-09-21T07:27:17.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.351+0000 7f05cd800640 1 -- 172.21.15.64:0/4126930349 wait complete. 2024-09-21T07:27:17.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:27:17.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- 172.21.15.64:0/2084430599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c070870 msgr2=0x7f466c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 --2- 172.21.15.64:0/2084430599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c070870 0x7f466c0b2cf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f466c076640 tx=0x7f465401f0b0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- 172.21.15.64:0/2084430599 shutdown_connections 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 --2- 172.21.15.64:0/2084430599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c070870 0x7f466c0b2cf0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 --2- 172.21.15.64:0/2084430599 >> v2:172.21.15.90:3300/0 conn(0x7f466c0d07e0 0x7f466c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- 172.21.15.64:0/2084430599 >> 172.21.15.64:0/2084430599 conn(0x7f466c0cdcf0 msgr2=0x7f466c0ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- 172.21.15.64:0/2084430599 shutdown_connections 2024-09-21T07:27:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- 172.21.15.64:0/2084430599 wait complete. 2024-09-21T07:27:17.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 Processor -- start 2024-09-21T07:27:17.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.551+0000 7f4671400640 1 -- start start 2024-09-21T07:27:17.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f466c070870 0x7f466c1e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:17.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:17.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c0d07e0 0x7f466c09da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:17.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b4e70 con 0x7f466c0b3230 2024-09-21T07:27:17.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b4cf0 con 0x7f466c0d07e0 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0b4ff0 con 0x7f466c070870 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41558/0 (socket says 172.21.15.64:41558) 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 -- 172.21.15.64:0/35436213 learned_addr learned my addr 172.21.15.64:0/35436213 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f466a800640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f466c070870 0x7f466c1e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f466b200640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c0d07e0 0x7f466c09da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 -- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f466c070870 msgr2=0x7f466c1e7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f466c070870 0x7f466c1e7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 -- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c0d07e0 msgr2=0x7f466c09da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c0d07e0 0x7f466c09da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 -- 172.21.15.64:0/35436213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c14cbe0 con 0x7f466c0b3230 2024-09-21T07:27:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4663e00640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f46540b3040 tx=0x7f4654005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540b5040 con 0x7f466c0b3230 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4654005310 con 0x7f466c0b3230 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540046d0 con 0x7f466c0b3230 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c14cec0 con 0x7f466c0b3230 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c14d480 con 0x7f466c0b3230 2024-09-21T07:27:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.555+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c0b2cf0 con 0x7f466c0b3230 2024-09-21T07:27:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.559+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f46540c1060 con 0x7f466c0b3230 2024-09-21T07:27:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.559+0000 7f4662a00640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 0x7f4648075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.559+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5619+0+0 (secure 0 0 0) 0x7f4654131090 con 0x7f466c0b3230 2024-09-21T07:27:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.559+0000 7f466a800640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 0x7f4648075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.559+0000 7f466a800640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 0x7f4648075710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f465c005fd0 tx=0x7f465c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.563+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4654018c10 con 0x7f466c0b3230 2024-09-21T07:27:17.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:17.743+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f466c0b0fb0 con 0x7f466c0b3230 2024-09-21T07:27:18.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.355+0000 7f4662a00640 1 -- 172.21.15.64:0/35436213 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7f46540fba20 con 0x7f466c0b3230 2024-09-21T07:27:18.359 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 msgr2=0x7f4648075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 0x7f4648075710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f465c005fd0 tx=0x7f465c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 msgr2=0x7f466c149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f46540b3040 tx=0x7f4654005e00 comp rx=0 tx=0).stop 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 shutdown_connections 2024-09-21T07:27:18.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4648073200 0x7f4648075710 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c0d07e0 0x7f466c09da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f466c0b3230 0x7f466c149f80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 --2- 172.21.15.64:0/35436213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f466c070870 0x7f466c1e7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 >> 172.21.15.64:0/35436213 conn(0x7f466c0cdcf0 msgr2=0x7f466c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 shutdown_connections 2024-09-21T07:27:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.359+0000 7f4671400640 1 -- 172.21.15.64:0/35436213 wait complete. 2024-09-21T07:27:18.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- 172.21.15.64:0/820773288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e00cf8a0 msgr2=0x7f85e015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 --2- 172.21.15.64:0/820773288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e00cf8a0 0x7f85e015aee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009c80 tx=0x7f85dc01cd10 comp rx=0 tx=0).stop 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- 172.21.15.64:0/820773288 shutdown_connections 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 --2- 172.21.15.64:0/820773288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e00cf8a0 0x7f85e015aee0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 --2- 172.21.15.64:0/820773288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e006ff90 0x7f85e0073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- 172.21.15.64:0/820773288 >> 172.21.15.64:0/820773288 conn(0x7f85e00cdd10 msgr2=0x7f85e00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- 172.21.15.64:0/820773288 shutdown_connections 2024-09-21T07:27:18.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- 172.21.15.64:0/820773288 wait complete. 2024-09-21T07:27:18.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 Processor -- start 2024-09-21T07:27:18.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.567+0000 7f85e8800640 1 -- start start 2024-09-21T07:27:18.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85e006ff90 0x7f85e0157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:18.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e00b59e0 0x7f85e015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85e0169790 con 0x7f85e01f9290 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85e0169610 con 0x7f85e006ff90 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f85e0169910 con 0x7f85e00b59e0 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85e006ff90 0x7f85e0157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41564/0 (socket says 172.21.15.64:41564) 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 -- 172.21.15.64:0/4279632804 learned_addr learned my addr 172.21.15.64:0/4279632804 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:18.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e5400640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e00b59e0 0x7f85e015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:18.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 -- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e00b59e0 msgr2=0x7f85e015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:18.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e00b59e0 0x7f85e015c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 -- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85e006ff90 msgr2=0x7f85e0157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:18.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85e006ff90 0x7f85e0157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 -- 172.21.15.64:0/4279632804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e00cd6e0 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e6800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01b3c0 tx=0x7f85dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0bb070 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85dc0044e0 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e015ce50 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b2040 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e015d410 con 0x7f85e01f9290 2024-09-21T07:27:18.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.571+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e0073f30 con 0x7f85e01f9290 2024-09-21T07:27:18.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.575+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85dc0be070 con 0x7f85e01f9290 2024-09-21T07:27:18.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.575+0000 7f85da000640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 0x7f85c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:18.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.575+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6001+0+0 (secure 0 0 0) 0x7f85dc12e320 con 0x7f85e01f9290 2024-09-21T07:27:18.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.575+0000 7f85e5e00640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 0x7f85c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:18.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.575+0000 7f85e5e00640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 0x7f85c4075710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85d4004590 tx=0x7f85d400b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:18.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.579+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f85e00cd6e0 con 0x7f85e01f9290 2024-09-21T07:27:18.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:18.791+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f85e015cbe0 con 0x7f85e01f9290 2024-09-21T07:27:19.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.371+0000 7f85da000640 1 -- 172.21.15.64:0/4279632804 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v48) ==== 174+0+0 (secure 0 0 0) 0x7f85dc016990 con 0x7f85e01f9290 2024-09-21T07:27:19.374 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 11 and data pool 12 2024-09-21T07:27:19.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.375+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 msgr2=0x7f85c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.375+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 0x7f85c4075710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85d4004590 tx=0x7f85d400b390 comp rx=0 tx=0).stop 2024-09-21T07:27:19.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.375+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 msgr2=0x7f85e01f96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.375+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01b3c0 tx=0x7f85dc0042f0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 shutdown_connections 2024-09-21T07:27:19.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85c4073200 0x7f85c4075710 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85e01f9290 0x7f85e01f96a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85e00b59e0 0x7f85e015c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 --2- 172.21.15.64:0/4279632804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85e006ff90 0x7f85e0157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 >> 172.21.15.64:0/4279632804 conn(0x7f85e00cdd10 msgr2=0x7f85e015ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.387+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 shutdown_connections 2024-09-21T07:27:19.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.391+0000 7f85e8800640 1 -- 172.21.15.64:0/4279632804 wait complete. 2024-09-21T07:27:19.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 -- 172.21.15.64:0/2622736038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 msgr2=0x7faabc0706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 --2- 172.21.15.64:0/2622736038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc0706c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7faabc0cd4b0 tx=0x7faaa801c770 comp rx=0 tx=0).stop 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 -- 172.21.15.64:0/2622736038 shutdown_connections 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 --2- 172.21.15.64:0/2622736038 >> v2:172.21.15.90:3300/0 conn(0x7faabc070c00 0x7faabc071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 --2- 172.21.15.64:0/2622736038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc0706c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 -- 172.21.15.64:0/2622736038 >> 172.21.15.64:0/2622736038 conn(0x7faabc0d0c50 msgr2=0x7faabc0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:19.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 -- 172.21.15.64:0/2622736038 shutdown_connections 2024-09-21T07:27:19.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.583+0000 7faac3400640 1 -- 172.21.15.64:0/2622736038 wait complete. 2024-09-21T07:27:19.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 Processor -- start 2024-09-21T07:27:19.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 -- start start 2024-09-21T07:27:19.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc06cdf0 0x7faabc0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 0x7faabc154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faabc169c10 con 0x7faabc0702b0 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0af960 con 0x7faabc06cdf0 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac3400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faabc169d90 con 0x7faabc070c00 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41586/0 (socket says 172.21.15.64:41586) 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 -- 172.21.15.64:0/1056310653 learned_addr learned my addr 172.21.15.64:0/1056310653 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:19.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac0a00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc06cdf0 0x7faabc0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac1400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 0x7faabc154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 -- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 msgr2=0x7faabc154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 0x7faabc154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 -- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc06cdf0 msgr2=0x7faabc0b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc06cdf0 0x7faabc0b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faabbe00640 1 -- 172.21.15.64:0/1056310653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc154570 con 0x7faabc0702b0 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.587+0000 7faac1400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 0x7faabc154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faabbe00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7faaa801cc50 tx=0x7faaa8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa80b2040 con 0x7faabc0702b0 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaa8004040 con 0x7faabc0702b0 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc15fa20 con 0x7faabc0702b0 2024-09-21T07:27:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8004470 con 0x7faabc0702b0 2024-09-21T07:27:19.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc153550 con 0x7faabc0702b0 2024-09-21T07:27:19.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc0706c0 con 0x7faabc0702b0 2024-09-21T07:27:19.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faaa80bd030 con 0x7faabc0702b0 2024-09-21T07:27:19.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.591+0000 7faab8c00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 0x7faa9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.595+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7faaa812df00 con 0x7faabc0702b0 2024-09-21T07:27:19.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.595+0000 7faac0a00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 0x7faa9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.595+0000 7faac0a00640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 0x7faa9c075710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faab0001640 tx=0x7faab0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:19.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.599+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faaa80c4060 con 0x7faabc0702b0 2024-09-21T07:27:19.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.775+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faabc1671d0 con 0x7faabc0702b0 2024-09-21T07:27:19.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.775+0000 7faab8c00640 1 -- 172.21.15.64:0/1056310653 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16970 (secure 0 0 0) 0x7faaa80163f0 con 0x7faabc0702b0 2024-09-21T07:27:19.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:19.779 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":82,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:18.794480+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:27:16.554525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-21T07:27:17.755507+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:19.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 msgr2=0x7faa9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 0x7faa9c075710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faab0001640 tx=0x7faab0009040 comp rx=0 tx=0).stop 2024-09-21T07:27:19.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 msgr2=0x7faabc152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7faaa801cc50 tx=0x7faaa8005760 comp rx=0 tx=0).stop 2024-09-21T07:27:19.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 shutdown_connections 2024-09-21T07:27:19.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa9c073200 0x7faa9c075710 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faabc070c00 0x7faabc154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc0702b0 0x7faabc152b80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 --2- 172.21.15.64:0/1056310653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc06cdf0 0x7faabc0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 >> 172.21.15.64:0/1056310653 conn(0x7faabc0d0c50 msgr2=0x7faabc0b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:19.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 shutdown_connections 2024-09-21T07:27:19.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.779+0000 7faac3400640 1 -- 172.21.15.64:0/1056310653 wait complete. 2024-09-21T07:27:19.803 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:19.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 -- 172.21.15.64:0/154347363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 msgr2=0x7f0e840b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/154347363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e840b41c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009840 tx=0x7f0e7001c820 comp rx=0 tx=0).stop 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 -- 172.21.15.64:0/154347363 shutdown_connections 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/154347363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b4700 0x7f0e84072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/154347363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e840b41c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 -- 172.21.15.64:0/154347363 >> 172.21.15.64:0/154347363 conn(0x7f0e840ccbe0 msgr2=0x7f0e840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 -- 172.21.15.64:0/154347363 shutdown_connections 2024-09-21T07:27:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.959+0000 7f0e8bc00640 1 -- 172.21.15.64:0/154347363 wait complete. 2024-09-21T07:27:19.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 Processor -- start 2024-09-21T07:27:19.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- start start 2024-09-21T07:27:19.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 0x7f0e84158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e8415edb0 0x7f0e8415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0e84168b90 con 0x7f0e840709b0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e84168a10 con 0x7f0e840b4700 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0e84168d10 con 0x7f0e8415edb0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41598/0 (socket says 172.21.15.64:41598) 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 -- 172.21.15.64:0/941366874 learned_addr learned my addr 172.21.15.64:0/941366874 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89c00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e8415edb0 0x7f0e8415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e83e00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 0x7f0e84158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 -- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e8415edb0 msgr2=0x7f0e8415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e8415edb0 0x7f0e8415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 -- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 msgr2=0x7f0e84158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 0x7f0e84158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 -- 172.21.15.64:0/941366874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e841fae50 con 0x7f0e840709b0 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e83e00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 0x7f0e84158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e89200640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0e78001ec0 tx=0x7f0e7800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78017070 con 0x7f0e840709b0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e78003600 con 0x7f0e840709b0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78003a50 con 0x7f0e840709b0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e840b1520 con 0x7f0e840709b0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.963+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e840b1020 con 0x7f0e840709b0 2024-09-21T07:27:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.967+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e840b41c0 con 0x7f0e840709b0 2024-09-21T07:27:19.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.967+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0e7801a070 con 0x7f0e840709b0 2024-09-21T07:27:19.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.967+0000 7f0e80c00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 0x7f0e64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:19.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.967+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f0e780936f0 con 0x7f0e840709b0 2024-09-21T07:27:19.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.967+0000 7f0e83e00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 0x7f0e64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:19.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.971+0000 7f0e83e00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 0x7f0e64075710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0e700af000 tx=0x7f0e7001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:19.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:19.971+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0e840b4b10 con 0x7f0e840709b0 2024-09-21T07:27:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.151+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e8415dbb0 con 0x7f0e840709b0 2024-09-21T07:27:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.151+0000 7f0e80c00640 1 -- 172.21.15.64:0/941366874 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16970 (secure 0 0 0) 0x7f0e7805df20 con 0x7f0e840709b0 2024-09-21T07:27:20.155 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:20.155 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":82,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:18.794480+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:27:16.554525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-21T07:27:17.755507+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 msgr2=0x7f0e64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 0x7f0e64075710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0e700af000 tx=0x7f0e7001b060 comp rx=0 tx=0).stop 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 msgr2=0x7f0e8415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0e78001ec0 tx=0x7f0e7800c890 comp rx=0 tx=0).stop 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 shutdown_connections 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e64073200 0x7f0e64075710 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e8415edb0 0x7f0e8415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e840b4700 0x7f0e84158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 --2- 172.21.15.64:0/941366874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e840709b0 0x7f0e8415c810 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 >> 172.21.15.64:0/941366874 conn(0x7f0e840ccbe0 msgr2=0x7f0e8415e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 shutdown_connections 2024-09-21T07:27:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.155+0000 7f0e8bc00640 1 -- 172.21.15.64:0/941366874 wait complete. 2024-09-21T07:27:20.178 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:27:20.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- 172.21.15.64:0/1166411469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef00b3910 msgr2=0x7faef00ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:20.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 --2- 172.21.15.64:0/1166411469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef00b3910 0x7faef00ce1f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7faedc009900 tx=0x7faedc01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- 172.21.15.64:0/1166411469 shutdown_connections 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 --2- 172.21.15.64:0/1166411469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef00b3910 0x7faef00ce1f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 --2- 172.21.15.64:0/1166411469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef009df30 0x7faef00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- 172.21.15.64:0/1166411469 >> 172.21.15.64:0/1166411469 conn(0x7faef006d450 msgr2=0x7faef00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- 172.21.15.64:0/1166411469 shutdown_connections 2024-09-21T07:27:20.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- 172.21.15.64:0/1166411469 wait complete. 2024-09-21T07:27:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 Processor -- start 2024-09-21T07:27:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.339+0000 7faef8000640 1 -- start start 2024-09-21T07:27:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 0x7faef00afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef00ce730 0x7faef0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faef01691f0 con 0x7faef009df30 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faef0169070 con 0x7faef00b3910 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faef0169370 con 0x7faef00ce730 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41624/0 (socket says 172.21.15.64:41624) 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 -- 172.21.15.64:0/2817702727 learned_addr learned my addr 172.21.15.64:0/2817702727 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef4c00640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 0x7faef00afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef6000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef00ce730 0x7faef0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:20.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 -- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef00ce730 msgr2=0x7faef0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef00ce730 0x7faef0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 -- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 msgr2=0x7faef00afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 0x7faef00afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 -- 172.21.15.64:0/2817702727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef01f97a0 con 0x7faef009df30 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef4c00640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 0x7faef00afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:20.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef5600640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7faee400d730 tx=0x7faee400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:20.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4017070 con 0x7faef009df30 2024-09-21T07:27:20.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faee4009a30 con 0x7faef009df30 2024-09-21T07:27:20.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4010460 con 0x7faef009df30 2024-09-21T07:27:20.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef01f9a80 con 0x7faef009df30 2024-09-21T07:27:20.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef0159350 con 0x7faef009df30 2024-09-21T07:27:20.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.343+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef009bc10 con 0x7faef009df30 2024-09-21T07:27:20.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.347+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faee401a070 con 0x7faef009df30 2024-09-21T07:27:20.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.347+0000 7faeed600640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 0x7faed0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:20.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.347+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7faee4094550 con 0x7faef009df30 2024-09-21T07:27:20.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.347+0000 7faef4c00640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 0x7faed0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:20.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.347+0000 7faef4c00640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 0x7faed0075710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faedc0af000 tx=0x7faedc01b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:20.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.351+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faee405f3d0 con 0x7faef009df30 2024-09-21T07:27:20.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:20.567+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faef00b33d0 con 0x7faef009df30 2024-09-21T07:27:21.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.383+0000 7faeed600640 1 -- 172.21.15.64:0/2817702727 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7faee405ecd0 con 0x7faef009df30 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 msgr2=0x7faed0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 0x7faed0075710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faedc0af000 tx=0x7faedc01b120 comp rx=0 tx=0).stop 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 msgr2=0x7faef01f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7faee400d730 tx=0x7faee400dbf0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 shutdown_connections 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faed0073200 0x7faed0075710 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faef00ce730 0x7faef0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faef00b3910 0x7faef00afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 --2- 172.21.15.64:0/2817702727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faef009df30 0x7faef01f8f10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 >> 172.21.15.64:0/2817702727 conn(0x7faef006d450 msgr2=0x7faef00ad730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:21.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 shutdown_connections 2024-09-21T07:27:21.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.387+0000 7faef8000640 1 -- 172.21.15.64:0/2817702727 wait complete. 2024-09-21T07:27:21.413 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:27:21.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:27:21.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 -- 172.21.15.64:0/2224153586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 msgr2=0x7f5a3c162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 --2- 172.21.15.64:0/2224153586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c162850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009840 tx=0x7f5a2401c790 comp rx=0 tx=0).stop 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 -- 172.21.15.64:0/2224153586 shutdown_connections 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 --2- 172.21.15.64:0/2224153586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c162850 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 -- 172.21.15.64:0/2224153586 >> 172.21.15.64:0/2224153586 conn(0x7f5a3c0d21d0 msgr2=0x7f5a3c0d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 -- 172.21.15.64:0/2224153586 shutdown_connections 2024-09-21T07:27:21.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.575+0000 7f5a3b200640 1 -- 172.21.15.64:0/2224153586 wait complete. 2024-09-21T07:27:21.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 Processor -- start 2024-09-21T07:27:21.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 -- start start 2024-09-21T07:27:21.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:21.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3c0d0720 0x7f5a3c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3c162d90 0x7f5a3c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c16d150 con 0x7f5a3c06df00 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c16cfd0 con 0x7f5a3c0d0720 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c16d2d0 con 0x7f5a3c162d90 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a39e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a39e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41646/0 (socket says 172.21.15.64:41646) 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a39e00640 1 -- 172.21.15.64:0/1490251824 learned_addr learned my addr 172.21.15.64:0/1490251824 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a33e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3c0d0720 0x7f5a3c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:21.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.579+0000 7f5a3a800640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3c162d90 0x7f5a3c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:21.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 -- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3c162d90 msgr2=0x7f5a3c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:21.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3c162d90 0x7f5a3c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 -- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3c0d0720 msgr2=0x7f5a3c15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:21.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3c0d0720 0x7f5a3c15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 -- 172.21.15.64:0/1490251824 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c159000 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a39e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c760 tx=0x7f5a2c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c016020 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a2c00a950 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c151660 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00ada0 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1598c0 con 0x7f5a3c06df00 2024-09-21T07:27:21.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c162850 con 0x7f5a3c06df00 2024-09-21T07:27:21.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.583+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a2c019020 con 0x7f5a3c06df00 2024-09-21T07:27:21.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.587+0000 7f5a32000640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 0x7f5a18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:21.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.587+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f5a2c094110 con 0x7f5a3c06df00 2024-09-21T07:27:21.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.587+0000 7f5a33e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 0x7f5a18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.587+0000 7f5a33e00640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 0x7f5a18075710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5a240ae000 tx=0x7f5a240b3040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.591+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5a2c020020 con 0x7f5a3c06df00 2024-09-21T07:27:21.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:21.803+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5a3c161cb0 con 0x7f5a3c06df00 2024-09-21T07:27:22.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a32000640 1 -- 172.21.15.64:0/1490251824 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f5a3c0d0050 con 0x7f5a3c06df00 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 msgr2=0x7f5a18075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 0x7f5a18075710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5a240ae000 tx=0x7f5a240b3040 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 msgr2=0x7f5a3c14f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c760 tx=0x7f5a2c00cc20 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 shutdown_connections 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a18073200 0x7f5a18075710 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a3c162d90 0x7f5a3c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a3c0d0720 0x7f5a3c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 --2- 172.21.15.64:0/1490251824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a3c06df00 0x7f5a3c14f7a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 >> 172.21.15.64:0/1490251824 conn(0x7f5a3c0d21d0 msgr2=0x7f5a3c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 shutdown_connections 2024-09-21T07:27:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.387+0000 7f5a3b200640 1 -- 172.21.15.64:0/1490251824 wait complete. 2024-09-21T07:27:22.413 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:27:22.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- 172.21.15.64:0/416703017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80b4700 msgr2=0x7fc3e8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 --2- 172.21.15.64:0/416703017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80b4700 0x7fc3e8072e20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009bc0 tx=0x7fc3e001cba0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- 172.21.15.64:0/416703017 shutdown_connections 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 --2- 172.21.15.64:0/416703017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80b4700 0x7fc3e8072e20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 --2- 172.21.15.64:0/416703017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80709b0 0x7fc3e80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- 172.21.15.64:0/416703017 >> 172.21.15.64:0/416703017 conn(0x7fc3e80ccbe0 msgr2=0x7fc3e80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- 172.21.15.64:0/416703017 shutdown_connections 2024-09-21T07:27:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- 172.21.15.64:0/416703017 wait complete. 2024-09-21T07:27:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 Processor -- start 2024-09-21T07:27:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.571+0000 7fc3ee000640 1 -- start start 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80709b0 0x7fc3e809d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80b4700 0x7fc3e8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8168ba0 con 0x7fc3e815edb0 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8168a20 con 0x7fc3e80709b0 2024-09-21T07:27:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e8168d20 con 0x7fc3e80b4700 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41652/0 (socket says 172.21.15.64:41652) 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 -- 172.21.15.64:0/3954489988 learned_addr learned my addr 172.21.15.64:0/3954489988 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7400640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80709b0 0x7fc3e809d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3dfe00640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80b4700 0x7fc3e8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 -- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80b4700 msgr2=0x7fc3e8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80b4700 0x7fc3e8154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 -- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80709b0 msgr2=0x7fc3e809d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80709b0 0x7fc3e809d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 -- 172.21.15.64:0/3954489988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e80c9970 con 0x7fc3e815edb0 2024-09-21T07:27:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3e7e00640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b0040 tx=0x7fc3e0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00b2040 con 0x7fc3e815edb0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3e00bb070 con 0x7fc3e815edb0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e80b1cc0 con 0x7fc3e815edb0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004370 con 0x7fc3e815edb0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e80b1f60 con 0x7fc3e815edb0 2024-09-21T07:27:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.575+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e80b41c0 con 0x7fc3e815edb0 2024-09-21T07:27:22.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.579+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc3e0004510 con 0x7fc3e815edb0 2024-09-21T07:27:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.579+0000 7fc3df400640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 0x7fc3c4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.579+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fc3e012ed20 con 0x7fc3e815edb0 2024-09-21T07:27:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.579+0000 7fc3e7400640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 0x7fc3c4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.579+0000 7fc3e7400640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 0x7fc3c4075740 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8007d70 tx=0x7fc3d8007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.583+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc3e0016790 con 0x7fc3e815edb0 2024-09-21T07:27:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3e80c9b70 con 0x7fc3e815edb0 2024-09-21T07:27:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3df400640 1 -- 172.21.15.64:0/3954489988 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7fc3e00f9b20 con 0x7fc3e815edb0 2024-09-21T07:27:22.797 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:22.798 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":52,"btime":"2024-09-21T07:27:22:385997+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3476229811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3476229811},{"type":"v1","addr":"172.21.15.90:6837","nonce":3476229811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/565775790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":565775790},{"type":"v1","addr":"172.21.15.64:6835","nonce":565775790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2323125620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2323125620},{"type":"v1","addr":"172.21.15.90:6835","nonce":2323125620}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:21.806267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6804},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6804":{"gid":6804,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2439635016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2439635016},{"type":"v1","addr":"172.21.15.64:6834","nonce":2439635016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6804,"qdb_cluster":[6804]},"id":5}]} 2024-09-21T07:27:22.798 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 52 2024-09-21T07:27:22.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 msgr2=0x7fc3c4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 0x7fc3c4075740 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8007d70 tx=0x7fc3d8007d00 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 msgr2=0x7fc3e80aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b0040 tx=0x7fc3e0003f40 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 shutdown_connections 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3c4073230 0x7fc3c4075740 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3e815edb0 0x7fc3e80aeb20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3e80b4700 0x7fc3e8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 --2- 172.21.15.64:0/3954489988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3e80709b0 0x7fc3e809d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.795+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 >> 172.21.15.64:0/3954489988 conn(0x7fc3e80ccbe0 msgr2=0x7fc3e815ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.799+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 shutdown_connections 2024-09-21T07:27:22.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.799+0000 7fc3ee000640 1 -- 172.21.15.64:0/3954489988 wait complete. 2024-09-21T07:27:22.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 -- 172.21.15.64:0/2398736119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b415b700 msgr2=0x7f55b40cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 --2- 172.21.15.64:0/2398736119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b415b700 0x7f55b40cfb20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a401c7d0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 -- 172.21.15.64:0/2398736119 shutdown_connections 2024-09-21T07:27:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 --2- 172.21.15.64:0/2398736119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b415b700 0x7f55b40cfb20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 -- 172.21.15.64:0/2398736119 >> 172.21.15.64:0/2398736119 conn(0x7f55b406e890 msgr2=0x7f55b40b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 -- 172.21.15.64:0/2398736119 shutdown_connections 2024-09-21T07:27:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.975+0000 7f55b9400640 1 -- 172.21.15.64:0/2398736119 wait complete. 2024-09-21T07:27:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 Processor -- start 2024-09-21T07:27:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 -- start start 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 0x7f55b415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b40b2840 0x7f55b40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f55b416a1a0 con 0x7f55b415b700 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55b416a020 con 0x7f55b406ff90 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f55b416a320 con 0x7f55b40b2840 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41668/0 (socket says 172.21.15.64:41668) 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 -- 172.21.15.64:0/1125768131 learned_addr learned my addr 172.21.15.64:0/1125768131 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b3200640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b40b2840 0x7f55b40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b2800640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 0x7f55b415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 -- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b40b2840 msgr2=0x7f55b40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b40b2840 0x7f55b40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 -- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 msgr2=0x7f55b415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 0x7f55b415e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 -- 172.21.15.64:0/1125768131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b40b3190 con 0x7f55b415b700 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b2800640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 0x7f55b415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55a9e00640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c400 tx=0x7f559c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c017070 con 0x7f55b415b700 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f559c003600 con 0x7f55b415b700 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c003a50 con 0x7f55b415b700 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.979+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b4143310 con 0x7f55b415b700 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b4142550 con 0x7f55b415b700 2024-09-21T07:27:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b40b0700 con 0x7f55b415b700 2024-09-21T07:27:22.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f559c01a070 con 0x7f55b415b700 2024-09-21T07:27:22.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55ab400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 0x7f5590075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f559c093720 con 0x7f55b415b700 2024-09-21T07:27:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.983+0000 7f55b2800640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 0x7f5590075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.987+0000 7f55b2800640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 0x7f5590075710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55a40af000 tx=0x7f55a401b010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:22.987+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f55b40b3190 con 0x7f55b415b700 2024-09-21T07:27:23.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.167+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55b40d0910 con 0x7f55b415b700 2024-09-21T07:27:23.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.167+0000 7f55ab400640 1 -- 172.21.15.64:0/1125768131 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16957 (secure 0 0 0) 0x7f559c05e5a0 con 0x7f55b415b700 2024-09-21T07:27:23.172 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:23.173 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":83,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:20.372015+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:27:16.554525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-21T07:27:17.755507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 msgr2=0x7f5590075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 0x7f5590075710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55a40af000 tx=0x7f55a401b010 comp rx=0 tx=0).stop 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 msgr2=0x7f55b4164790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c400 tx=0x7f559c00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 shutdown_connections 2024-09-21T07:27:23.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5590073200 0x7f5590075710 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55b40b2840 0x7f55b40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b415b700 0x7f55b4164790 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 --2- 172.21.15.64:0/1125768131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55b406ff90 0x7f55b415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 >> 172.21.15.64:0/1125768131 conn(0x7f55b406e890 msgr2=0x7f55b40b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 shutdown_connections 2024-09-21T07:27:23.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.171+0000 7f55b9400640 1 -- 172.21.15.64:0/1125768131 wait complete. 2024-09-21T07:27:23.195 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:27:23.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:27:23.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 -- 172.21.15.64:0/695813329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 msgr2=0x7fb6e40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/695813329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e40b41c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009840 tx=0x7fb6cc01c740 comp rx=0 tx=0).stop 2024-09-21T07:27:23.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 -- 172.21.15.64:0/695813329 shutdown_connections 2024-09-21T07:27:23.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/695813329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e40b4700 0x7fb6e4072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/695813329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e40b41c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 -- 172.21.15.64:0/695813329 >> 172.21.15.64:0/695813329 conn(0x7fb6e40ccbe0 msgr2=0x7fb6e40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:23.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 -- 172.21.15.64:0/695813329 shutdown_connections 2024-09-21T07:27:23.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.351+0000 7fb6e9c00640 1 -- 172.21.15.64:0/695813329 wait complete. 2024-09-21T07:27:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 Processor -- start 2024-09-21T07:27:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- start start 2024-09-21T07:27:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e415c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e415edb0 0x7fb6e40ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4168c40 con 0x7fb6e40b4700 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4168ac0 con 0x7fb6e40709b0 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e4168dc0 con 0x7fb6e415edb0 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41670/0 (socket says 172.21.15.64:41670) 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 -- 172.21.15.64:0/2438323841 learned_addr learned my addr 172.21.15.64:0/2438323841 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e3400640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e415edb0 0x7fb6e40ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e2a00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 -- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e415edb0 msgr2=0x7fb6e40ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e415edb0 0x7fb6e40ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 -- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 msgr2=0x7fb6e415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 -- 172.21.15.64:0/2438323841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e415ca60 con 0x7fb6e40b4700 2024-09-21T07:27:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e2a00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6dbe00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc01cc20 tx=0x7fb6cc005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0ad070 con 0x7fb6e40b4700 2024-09-21T07:27:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6cc0043e0 con 0x7fb6e40b4700 2024-09-21T07:27:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e409bae0 con 0x7fb6e40b4700 2024-09-21T07:27:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc004910 con 0x7fb6e40b4700 2024-09-21T07:27:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.355+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e409c0a0 con 0x7fb6e40b4700 2024-09-21T07:27:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e40b41c0 con 0x7fb6e40b4700 2024-09-21T07:27:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6cc0b0070 con 0x7fb6e40b4700 2024-09-21T07:27:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6daa00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 0x7fb6c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fb6cc12e6f0 con 0x7fb6e40b4700 2024-09-21T07:27:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6e2a00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 0x7fb6c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.359+0000 7fb6e2a00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 0x7fb6c0075740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4001ec0 tx=0x7fb6d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.363+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb6cc0b8070 con 0x7fb6e40b4700 2024-09-21T07:27:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.543+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6e415cd00 con 0x7fb6c0073230 2024-09-21T07:27:23.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.547+0000 7fb6daa00640 1 -- 172.21.15.64:0/2438323841 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7fb6e415cd00 con 0x7fb6c0073230 2024-09-21T07:27:23.555 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:27:23.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 msgr2=0x7fb6c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 0x7fb6c0075740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4001ec0 tx=0x7fb6d4009040 comp rx=0 tx=0).stop 2024-09-21T07:27:23.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 msgr2=0x7fb6e40ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc01cc20 tx=0x7fb6cc005730 comp rx=0 tx=0).stop 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 shutdown_connections 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c0073230 0x7fb6c0075740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e415edb0 0x7fb6e40ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e40b4700 0x7fb6e40ace70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 --2- 172.21.15.64:0/2438323841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6e40709b0 0x7fb6e415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 >> 172.21.15.64:0/2438323841 conn(0x7fb6e40ccbe0 msgr2=0x7fb6e4165a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 shutdown_connections 2024-09-21T07:27:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.551+0000 7fb6e9c00640 1 -- 172.21.15.64:0/2438323841 wait complete. 2024-09-21T07:27:23.575 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-09-21T07:27:23.493935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304396,"kb_used_data":9096,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754670324,"statfs":{"total":773094113280,"available":772782411776,"internally_reserved":0,"allocated":9314304,"data_stored":4898140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":302173747},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001556"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383730+0000","last_change":"2024-09-21T07:27:19.387016+0000","last_active":"2024-09-21T07:27:20.383730+0000","last_peered":"2024-09-21T07:27:20.383730+0000","last_clean":"2024-09-21T07:27:20.383730+0000","last_became_active":"2024-09-21T07:27:19.386691+0000","last_became_peered":"2024-09-21T07:27:19.386691+0000","last_unstale":"2024-09-21T07:27:20.383730+0000","last_undegraded":"2024-09-21T07:27:20.383730+0000","last_fullsized":"2024-09-21T07:27:20.383730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:43.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391762+0000","last_change":"2024-09-21T07:27:19.392358+0000","last_active":"2024-09-21T07:27:20.391762+0000","last_peered":"2024-09-21T07:27:20.391762+0000","last_clean":"2024-09-21T07:27:20.391762+0000","last_became_active":"2024-09-21T07:27:19.392055+0000","last_became_peered":"2024-09-21T07:27:19.392055+0000","last_unstale":"2024-09-21T07:27:20.391762+0000","last_undegraded":"2024-09-21T07:27:20.391762+0000","last_fullsized":"2024-09-21T07:27:20.391762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:34.712487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565537+0000","last_change":"2024-09-21T07:27:19.370150+0000","last_active":"2024-09-21T07:27:20.565537+0000","last_peered":"2024-09-21T07:27:20.565537+0000","last_clean":"2024-09-21T07:27:20.565537+0000","last_became_active":"2024-09-21T07:27:19.369802+0000","last_became_peered":"2024-09-21T07:27:19.369802+0000","last_unstale":"2024-09-21T07:27:20.565537+0000","last_undegraded":"2024-09-21T07:27:20.565537+0000","last_fullsized":"2024-09-21T07:27:20.565537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:54.560364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566813+0000","last_change":"2024-09-21T07:27:19.388588+0000","last_active":"2024-09-21T07:27:20.566813+0000","last_peered":"2024-09-21T07:27:20.566813+0000","last_clean":"2024-09-21T07:27:20.566813+0000","last_became_active":"2024-09-21T07:27:19.387575+0000","last_became_peered":"2024-09-21T07:27:19.387575+0000","last_unstale":"2024-09-21T07:27:20.566813+0000","last_undegraded":"2024-09-21T07:27:20.566813+0000","last_fullsized":"2024-09-21T07:27:20.566813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:40.015940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394475+0000","last_change":"2024-09-21T07:27:19.392735+0000","last_active":"2024-09-21T07:27:20.394475+0000","last_peered":"2024-09-21T07:27:20.394475+0000","last_clean":"2024-09-21T07:27:20.394475+0000","last_became_active":"2024-09-21T07:27:19.392241+0000","last_became_peered":"2024-09-21T07:27:19.392241+0000","last_unstale":"2024-09-21T07:27:20.394475+0000","last_undegraded":"2024-09-21T07:27:20.394475+0000","last_fullsized":"2024-09-21T07:27:20.394475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:14.787362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378984+0000","last_change":"2024-09-21T07:27:19.387879+0000","last_active":"2024-09-21T07:27:20.378984+0000","last_peered":"2024-09-21T07:27:20.378984+0000","last_clean":"2024-09-21T07:27:20.378984+0000","last_became_active":"2024-09-21T07:27:19.387588+0000","last_became_peered":"2024-09-21T07:27:19.387588+0000","last_unstale":"2024-09-21T07:27:20.378984+0000","last_undegraded":"2024-09-21T07:27:20.378984+0000","last_fullsized":"2024-09-21T07:27:20.378984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:46.393448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566931+0000","last_change":"2024-09-21T07:27:19.391648+0000","last_active":"2024-09-21T07:27:20.566931+0000","last_peered":"2024-09-21T07:27:20.566931+0000","last_clean":"2024-09-21T07:27:20.566931+0000","last_became_active":"2024-09-21T07:27:19.391274+0000","last_became_peered":"2024-09-21T07:27:19.391274+0000","last_unstale":"2024-09-21T07:27:20.566931+0000","last_undegraded":"2024-09-21T07:27:20.566931+0000","last_fullsized":"2024-09-21T07:27:20.566931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:36.991939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394029+0000","last_change":"2024-09-21T07:27:19.384903+0000","last_active":"2024-09-21T07:27:20.394029+0000","last_peered":"2024-09-21T07:27:20.394029+0000","last_clean":"2024-09-21T07:27:20.394029+0000","last_became_active":"2024-09-21T07:27:19.384418+0000","last_became_peered":"2024-09-21T07:27:19.384418+0000","last_unstale":"2024-09-21T07:27:20.394029+0000","last_undegraded":"2024-09-21T07:27:20.394029+0000","last_fullsized":"2024-09-21T07:27:20.394029+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:35.851635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384104+0000","last_change":"2024-09-21T07:27:19.389931+0000","last_active":"2024-09-21T07:27:20.384104+0000","last_peered":"2024-09-21T07:27:20.384104+0000","last_clean":"2024-09-21T07:27:20.384104+0000","last_became_active":"2024-09-21T07:27:19.389584+0000","last_became_peered":"2024-09-21T07:27:19.389584+0000","last_unstale":"2024-09-21T07:27:20.384104+0000","last_undegraded":"2024-09-21T07:27:20.384104+0000","last_fullsized":"2024-09-21T07:27:20.384104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.581400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566339+0000","last_change":"2024-09-21T07:27:19.383541+0000","last_active":"2024-09-21T07:27:20.566339+0000","last_peered":"2024-09-21T07:27:20.566339+0000","last_clean":"2024-09-21T07:27:20.566339+0000","last_became_active":"2024-09-21T07:27:19.383181+0000","last_became_peered":"2024-09-21T07:27:19.383181+0000","last_unstale":"2024-09-21T07:27:20.566339+0000","last_undegraded":"2024-09-21T07:27:20.566339+0000","last_fullsized":"2024-09-21T07:27:20.566339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:04.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391908+0000","last_change":"2024-09-21T07:27:19.399251+0000","last_active":"2024-09-21T07:27:20.391908+0000","last_peered":"2024-09-21T07:27:20.391908+0000","last_clean":"2024-09-21T07:27:20.391908+0000","last_became_active":"2024-09-21T07:27:19.399026+0000","last_became_peered":"2024-09-21T07:27:19.399026+0000","last_unstale":"2024-09-21T07:27:20.391908+0000","last_undegraded":"2024-09-21T07:27:20.391908+0000","last_fullsized":"2024-09-21T07:27:20.391908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:55.756413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566885+0000","last_change":"2024-09-21T07:27:19.388801+0000","last_active":"2024-09-21T07:27:20.566885+0000","last_peered":"2024-09-21T07:27:20.566885+0000","last_clean":"2024-09-21T07:27:20.566885+0000","last_became_active":"2024-09-21T07:27:19.388122+0000","last_became_peered":"2024-09-21T07:27:19.388122+0000","last_unstale":"2024-09-21T07:27:20.566885+0000","last_undegraded":"2024-09-21T07:27:20.566885+0000","last_fullsized":"2024-09-21T07:27:20.566885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:55.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394684+0000","last_change":"2024-09-21T07:27:19.407586+0000","last_active":"2024-09-21T07:27:20.394684+0000","last_peered":"2024-09-21T07:27:20.394684+0000","last_clean":"2024-09-21T07:27:20.394684+0000","last_became_active":"2024-09-21T07:27:19.405329+0000","last_became_peered":"2024-09-21T07:27:19.405329+0000","last_unstale":"2024-09-21T07:27:20.394684+0000","last_undegraded":"2024-09-21T07:27:20.394684+0000","last_fullsized":"2024-09-21T07:27:20.394684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:04.213220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379136+0000","last_change":"2024-09-21T07:27:19.387724+0000","last_active":"2024-09-21T07:27:20.379136+0000","last_peered":"2024-09-21T07:27:20.379136+0000","last_clean":"2024-09-21T07:27:20.379136+0000","last_became_active":"2024-09-21T07:27:19.387171+0000","last_became_peered":"2024-09-21T07:27:19.387171+0000","last_unstale":"2024-09-21T07:27:20.379136+0000","last_undegraded":"2024-09-21T07:27:20.379136+0000","last_fullsized":"2024-09-21T07:27:20.379136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:43.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391002+0000","last_change":"2024-09-21T07:27:19.375011+0000","last_active":"2024-09-21T07:27:20.391002+0000","last_peered":"2024-09-21T07:27:20.391002+0000","last_clean":"2024-09-21T07:27:20.391002+0000","last_became_active":"2024-09-21T07:27:19.374593+0000","last_became_peered":"2024-09-21T07:27:19.374593+0000","last_unstale":"2024-09-21T07:27:20.391002+0000","last_undegraded":"2024-09-21T07:27:20.391002+0000","last_fullsized":"2024-09-21T07:27:20.391002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:51.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383996+0000","last_change":"2024-09-21T07:27:19.387634+0000","last_active":"2024-09-21T07:27:20.383996+0000","last_peered":"2024-09-21T07:27:20.383996+0000","last_clean":"2024-09-21T07:27:20.383996+0000","last_became_active":"2024-09-21T07:27:19.387286+0000","last_became_peered":"2024-09-21T07:27:19.387286+0000","last_unstale":"2024-09-21T07:27:20.383996+0000","last_undegraded":"2024-09-21T07:27:20.383996+0000","last_fullsized":"2024-09-21T07:27:20.383996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:12.218650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394867+0000","last_change":"2024-09-21T07:27:19.397819+0000","last_active":"2024-09-21T07:27:20.394867+0000","last_peered":"2024-09-21T07:27:20.394867+0000","last_clean":"2024-09-21T07:27:20.394867+0000","last_became_active":"2024-09-21T07:27:19.397486+0000","last_became_peered":"2024-09-21T07:27:19.397486+0000","last_unstale":"2024-09-21T07:27:20.394867+0000","last_undegraded":"2024-09-21T07:27:20.394867+0000","last_fullsized":"2024-09-21T07:27:20.394867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:54.726085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565537+0000","last_change":"2024-09-21T07:27:19.385970+0000","last_active":"2024-09-21T07:27:20.565537+0000","last_peered":"2024-09-21T07:27:20.565537+0000","last_clean":"2024-09-21T07:27:20.565537+0000","last_became_active":"2024-09-21T07:27:19.385673+0000","last_became_peered":"2024-09-21T07:27:19.385673+0000","last_unstale":"2024-09-21T07:27:20.565537+0000","last_undegraded":"2024-09-21T07:27:20.565537+0000","last_fullsized":"2024-09-21T07:27:20.565537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:48.949943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379483+0000","last_change":"2024-09-21T07:27:19.398257+0000","last_active":"2024-09-21T07:27:20.379483+0000","last_peered":"2024-09-21T07:27:20.379483+0000","last_clean":"2024-09-21T07:27:20.379483+0000","last_became_active":"2024-09-21T07:27:19.397876+0000","last_became_peered":"2024-09-21T07:27:19.397876+0000","last_unstale":"2024-09-21T07:27:20.379483+0000","last_undegraded":"2024-09-21T07:27:20.379483+0000","last_fullsized":"2024-09-21T07:27:20.379483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:37.464703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394732+0000","last_change":"2024-09-21T07:27:19.396876+0000","last_active":"2024-09-21T07:27:20.394732+0000","last_peered":"2024-09-21T07:27:20.394732+0000","last_clean":"2024-09-21T07:27:20.394732+0000","last_became_active":"2024-09-21T07:27:19.396531+0000","last_became_peered":"2024-09-21T07:27:19.396531+0000","last_unstale":"2024-09-21T07:27:20.394732+0000","last_undegraded":"2024-09-21T07:27:20.394732+0000","last_fullsized":"2024-09-21T07:27:20.394732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.556181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384100+0000","last_change":"2024-09-21T07:27:19.387753+0000","last_active":"2024-09-21T07:27:20.384100+0000","last_peered":"2024-09-21T07:27:20.384100+0000","last_clean":"2024-09-21T07:27:20.384100+0000","last_became_active":"2024-09-21T07:27:19.386132+0000","last_became_peered":"2024-09-21T07:27:19.386132+0000","last_unstale":"2024-09-21T07:27:20.384100+0000","last_undegraded":"2024-09-21T07:27:20.384100+0000","last_fullsized":"2024-09-21T07:27:20.384100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:55.163069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394374+0000","last_change":"2024-09-21T07:27:19.400604+0000","last_active":"2024-09-21T07:27:20.394374+0000","last_peered":"2024-09-21T07:27:20.394374+0000","last_clean":"2024-09-21T07:27:20.394374+0000","last_became_active":"2024-09-21T07:27:19.398828+0000","last_became_peered":"2024-09-21T07:27:19.398828+0000","last_unstale":"2024-09-21T07:27:20.394374+0000","last_undegraded":"2024-09-21T07:27:20.394374+0000","last_fullsized":"2024-09-21T07:27:20.394374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:21.988330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383047+0000","last_change":"2024-09-21T07:27:19.389149+0000","last_active":"2024-09-21T07:27:20.383047+0000","last_peered":"2024-09-21T07:27:20.383047+0000","last_clean":"2024-09-21T07:27:20.383047+0000","last_became_active":"2024-09-21T07:27:19.387403+0000","last_became_peered":"2024-09-21T07:27:19.387403+0000","last_unstale":"2024-09-21T07:27:20.383047+0000","last_undegraded":"2024-09-21T07:27:20.383047+0000","last_fullsized":"2024-09-21T07:27:20.383047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:57.377805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391207+0000","last_change":"2024-09-21T07:27:19.385357+0000","last_active":"2024-09-21T07:27:20.391207+0000","last_peered":"2024-09-21T07:27:20.391207+0000","last_clean":"2024-09-21T07:27:20.391207+0000","last_became_active":"2024-09-21T07:27:19.384959+0000","last_became_peered":"2024-09-21T07:27:19.384959+0000","last_unstale":"2024-09-21T07:27:20.391207+0000","last_undegraded":"2024-09-21T07:27:20.391207+0000","last_fullsized":"2024-09-21T07:27:20.391207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.559605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391724+0000","last_change":"2024-09-21T07:27:19.381939+0000","last_active":"2024-09-21T07:27:20.391724+0000","last_peered":"2024-09-21T07:27:20.391724+0000","last_clean":"2024-09-21T07:27:20.391724+0000","last_became_active":"2024-09-21T07:27:19.378790+0000","last_became_peered":"2024-09-21T07:27:19.378790+0000","last_unstale":"2024-09-21T07:27:20.391724+0000","last_undegraded":"2024-09-21T07:27:20.391724+0000","last_fullsized":"2024-09-21T07:27:20.391724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.956819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566427+0000","last_change":"2024-09-21T07:27:19.378185+0000","last_active":"2024-09-21T07:27:20.566427+0000","last_peered":"2024-09-21T07:27:20.566427+0000","last_clean":"2024-09-21T07:27:20.566427+0000","last_became_active":"2024-09-21T07:27:19.377844+0000","last_became_peered":"2024-09-21T07:27:19.377844+0000","last_unstale":"2024-09-21T07:27:20.566427+0000","last_undegraded":"2024-09-21T07:27:20.566427+0000","last_fullsized":"2024-09-21T07:27:20.566427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:05.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382810+0000","last_change":"2024-09-21T07:27:19.389001+0000","last_active":"2024-09-21T07:27:20.382810+0000","last_peered":"2024-09-21T07:27:20.382810+0000","last_clean":"2024-09-21T07:27:20.382810+0000","last_became_active":"2024-09-21T07:27:19.387873+0000","last_became_peered":"2024-09-21T07:27:19.387873+0000","last_unstale":"2024-09-21T07:27:20.382810+0000","last_undegraded":"2024-09-21T07:27:20.382810+0000","last_fullsized":"2024-09-21T07:27:20.382810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:45.636027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394609+0000","last_change":"2024-09-21T07:27:19.393272+0000","last_active":"2024-09-21T07:27:20.394609+0000","last_peered":"2024-09-21T07:27:20.394609+0000","last_clean":"2024-09-21T07:27:20.394609+0000","last_became_active":"2024-09-21T07:27:19.392913+0000","last_became_peered":"2024-09-21T07:27:19.392913+0000","last_unstale":"2024-09-21T07:27:20.394609+0000","last_undegraded":"2024-09-21T07:27:20.394609+0000","last_fullsized":"2024-09-21T07:27:20.394609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:42.494640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391323+0000","last_change":"2024-09-21T07:27:19.370919+0000","last_active":"2024-09-21T07:27:20.391323+0000","last_peered":"2024-09-21T07:27:20.391323+0000","last_clean":"2024-09-21T07:27:20.391323+0000","last_became_active":"2024-09-21T07:27:19.370611+0000","last_became_peered":"2024-09-21T07:27:19.370611+0000","last_unstale":"2024-09-21T07:27:20.391323+0000","last_undegraded":"2024-09-21T07:27:20.391323+0000","last_fullsized":"2024-09-21T07:27:20.391323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:37.859844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382619+0000","last_change":"2024-09-21T07:27:19.390286+0000","last_active":"2024-09-21T07:27:20.382619+0000","last_peered":"2024-09-21T07:27:20.382619+0000","last_clean":"2024-09-21T07:27:20.382619+0000","last_became_active":"2024-09-21T07:27:19.389977+0000","last_became_peered":"2024-09-21T07:27:19.389977+0000","last_unstale":"2024-09-21T07:27:20.382619+0000","last_undegraded":"2024-09-21T07:27:20.382619+0000","last_fullsized":"2024-09-21T07:27:20.382619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.218406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565441+0000","last_change":"2024-09-21T07:27:19.370543+0000","last_active":"2024-09-21T07:27:20.565441+0000","last_peered":"2024-09-21T07:27:20.565441+0000","last_clean":"2024-09-21T07:27:20.565441+0000","last_became_active":"2024-09-21T07:27:19.370131+0000","last_became_peered":"2024-09-21T07:27:19.370131+0000","last_unstale":"2024-09-21T07:27:20.565441+0000","last_undegraded":"2024-09-21T07:27:20.565441+0000","last_fullsized":"2024-09-21T07:27:20.565441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.913726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382847+0000","last_change":"2024-09-21T07:27:19.392744+0000","last_active":"2024-09-21T07:27:20.382847+0000","last_peered":"2024-09-21T07:27:20.382847+0000","last_clean":"2024-09-21T07:27:20.382847+0000","last_became_active":"2024-09-21T07:27:19.392355+0000","last_became_peered":"2024-09-21T07:27:19.392355+0000","last_unstale":"2024-09-21T07:27:20.382847+0000","last_undegraded":"2024-09-21T07:27:20.382847+0000","last_fullsized":"2024-09-21T07:27:20.382847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:28.470687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565257+0000","last_change":"2024-09-21T07:27:19.382952+0000","last_active":"2024-09-21T07:27:20.565257+0000","last_peered":"2024-09-21T07:27:20.565257+0000","last_clean":"2024-09-21T07:27:20.565257+0000","last_became_active":"2024-09-21T07:27:19.382641+0000","last_became_peered":"2024-09-21T07:27:19.382641+0000","last_unstale":"2024-09-21T07:27:20.565257+0000","last_undegraded":"2024-09-21T07:27:20.565257+0000","last_fullsized":"2024-09-21T07:27:20.565257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:17.926236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394742+0000","last_change":"2024-09-21T07:27:18.382986+0000","last_active":"2024-09-21T07:27:20.394742+0000","last_peered":"2024-09-21T07:27:20.394742+0000","last_clean":"2024-09-21T07:27:20.394742+0000","last_became_active":"2024-09-21T07:27:18.381601+0000","last_became_peered":"2024-09-21T07:27:18.381601+0000","last_unstale":"2024-09-21T07:27:20.394742+0000","last_undegraded":"2024-09-21T07:27:20.394742+0000","last_fullsized":"2024-09-21T07:27:20.394742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:27.288014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391071+0000","last_change":"2024-09-21T07:27:19.382407+0000","last_active":"2024-09-21T07:27:20.391071+0000","last_peered":"2024-09-21T07:27:20.391071+0000","last_clean":"2024-09-21T07:27:20.391071+0000","last_became_active":"2024-09-21T07:27:19.379059+0000","last_became_peered":"2024-09-21T07:27:19.379059+0000","last_unstale":"2024-09-21T07:27:20.391071+0000","last_undegraded":"2024-09-21T07:27:20.391071+0000","last_fullsized":"2024-09-21T07:27:20.391071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:11.550463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383568+0000","last_change":"2024-09-21T07:27:18.391135+0000","last_active":"2024-09-21T07:27:20.383568+0000","last_peered":"2024-09-21T07:27:20.383568+0000","last_clean":"2024-09-21T07:27:20.383568+0000","last_became_active":"2024-09-21T07:27:18.389784+0000","last_became_peered":"2024-09-21T07:27:18.389784+0000","last_unstale":"2024-09-21T07:27:20.383568+0000","last_undegraded":"2024-09-21T07:27:20.383568+0000","last_fullsized":"2024-09-21T07:27:20.383568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.825175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383532+0000","last_change":"2024-09-21T07:27:19.390650+0000","last_active":"2024-09-21T07:27:20.383532+0000","last_peered":"2024-09-21T07:27:20.383532+0000","last_clean":"2024-09-21T07:27:20.383532+0000","last_became_active":"2024-09-21T07:27:19.389534+0000","last_became_peered":"2024-09-21T07:27:19.389534+0000","last_unstale":"2024-09-21T07:27:20.383532+0000","last_undegraded":"2024-09-21T07:27:20.383532+0000","last_fullsized":"2024-09-21T07:27:20.383532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:53.439416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382945+0000","last_change":"2024-09-21T07:27:18.390327+0000","last_active":"2024-09-21T07:27:20.382945+0000","last_peered":"2024-09-21T07:27:20.382945+0000","last_clean":"2024-09-21T07:27:20.382945+0000","last_became_active":"2024-09-21T07:27:18.390011+0000","last_became_peered":"2024-09-21T07:27:18.390011+0000","last_unstale":"2024-09-21T07:27:20.382945+0000","last_undegraded":"2024-09-21T07:27:20.382945+0000","last_fullsized":"2024-09-21T07:27:20.382945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:00.298851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384330+0000","last_change":"2024-09-21T07:27:19.388267+0000","last_active":"2024-09-21T07:27:20.384330+0000","last_peered":"2024-09-21T07:27:20.384330+0000","last_clean":"2024-09-21T07:27:20.384330+0000","last_became_active":"2024-09-21T07:27:19.385460+0000","last_became_peered":"2024-09-21T07:27:19.385460+0000","last_unstale":"2024-09-21T07:27:20.384330+0000","last_undegraded":"2024-09-21T07:27:20.384330+0000","last_fullsized":"2024-09-21T07:27:20.384330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:51.045016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567374+0000","last_change":"2024-09-21T07:27:18.384117+0000","last_active":"2024-09-21T07:27:20.567374+0000","last_peered":"2024-09-21T07:27:20.567374+0000","last_clean":"2024-09-21T07:27:20.567374+0000","last_became_active":"2024-09-21T07:27:18.383504+0000","last_became_peered":"2024-09-21T07:27:18.383504+0000","last_unstale":"2024-09-21T07:27:20.567374+0000","last_undegraded":"2024-09-21T07:27:20.567374+0000","last_fullsized":"2024-09-21T07:27:20.567374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:38.308746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391280+0000","last_change":"2024-09-21T07:27:19.389671+0000","last_active":"2024-09-21T07:27:20.391280+0000","last_peered":"2024-09-21T07:27:20.391280+0000","last_clean":"2024-09-21T07:27:20.391280+0000","last_became_active":"2024-09-21T07:27:19.389305+0000","last_became_peered":"2024-09-21T07:27:19.389305+0000","last_unstale":"2024-09-21T07:27:20.391280+0000","last_undegraded":"2024-09-21T07:27:20.391280+0000","last_fullsized":"2024-09-21T07:27:20.391280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:16.152509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384258+0000","last_change":"2024-09-21T07:27:18.382963+0000","last_active":"2024-09-21T07:27:20.384258+0000","last_peered":"2024-09-21T07:27:20.384258+0000","last_clean":"2024-09-21T07:27:20.384258+0000","last_became_active":"2024-09-21T07:27:18.382614+0000","last_became_peered":"2024-09-21T07:27:18.382614+0000","last_unstale":"2024-09-21T07:27:20.384258+0000","last_undegraded":"2024-09-21T07:27:20.384258+0000","last_fullsized":"2024-09-21T07:27:20.384258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:51.306626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391663+0000","last_change":"2024-09-21T07:27:19.393637+0000","last_active":"2024-09-21T07:27:20.391663+0000","last_peered":"2024-09-21T07:27:20.391663+0000","last_clean":"2024-09-21T07:27:20.391663+0000","last_became_active":"2024-09-21T07:27:19.393346+0000","last_became_peered":"2024-09-21T07:27:19.393346+0000","last_unstale":"2024-09-21T07:27:20.391663+0000","last_undegraded":"2024-09-21T07:27:20.391663+0000","last_fullsized":"2024-09-21T07:27:20.391663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:58.683482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566012+0000","last_change":"2024-09-21T07:27:18.391871+0000","last_active":"2024-09-21T07:27:20.566012+0000","last_peered":"2024-09-21T07:27:20.566012+0000","last_clean":"2024-09-21T07:27:20.566012+0000","last_became_active":"2024-09-21T07:27:18.391353+0000","last_became_peered":"2024-09-21T07:27:18.391353+0000","last_unstale":"2024-09-21T07:27:20.566012+0000","last_undegraded":"2024-09-21T07:27:20.566012+0000","last_fullsized":"2024-09-21T07:27:20.566012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:18.794915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383629+0000","last_change":"2024-09-21T07:27:19.388472+0000","last_active":"2024-09-21T07:27:20.383629+0000","last_peered":"2024-09-21T07:27:20.383629+0000","last_clean":"2024-09-21T07:27:20.383629+0000","last_became_active":"2024-09-21T07:27:19.388146+0000","last_became_peered":"2024-09-21T07:27:19.388146+0000","last_unstale":"2024-09-21T07:27:20.383629+0000","last_undegraded":"2024-09-21T07:27:20.383629+0000","last_fullsized":"2024-09-21T07:27:20.383629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:12.889552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391087+0000","last_change":"2024-09-21T07:27:18.384754+0000","last_active":"2024-09-21T07:27:20.391087+0000","last_peered":"2024-09-21T07:27:20.391087+0000","last_clean":"2024-09-21T07:27:20.391087+0000","last_became_active":"2024-09-21T07:27:18.384459+0000","last_became_peered":"2024-09-21T07:27:18.384459+0000","last_unstale":"2024-09-21T07:27:20.391087+0000","last_undegraded":"2024-09-21T07:27:20.391087+0000","last_fullsized":"2024-09-21T07:27:20.391087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:23.205121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567623+0000","last_change":"2024-09-21T07:27:19.392456+0000","last_active":"2024-09-21T07:27:20.567623+0000","last_peered":"2024-09-21T07:27:20.567623+0000","last_clean":"2024-09-21T07:27:20.567623+0000","last_became_active":"2024-09-21T07:27:19.392126+0000","last_became_peered":"2024-09-21T07:27:19.392126+0000","last_unstale":"2024-09-21T07:27:20.567623+0000","last_undegraded":"2024-09-21T07:27:20.567623+0000","last_fullsized":"2024-09-21T07:27:20.567623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:25.259592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.393893+0000","last_change":"2024-09-21T07:27:18.376002+0000","last_active":"2024-09-21T07:27:20.393893+0000","last_peered":"2024-09-21T07:27:20.393893+0000","last_clean":"2024-09-21T07:27:20.393893+0000","last_became_active":"2024-09-21T07:27:18.374990+0000","last_became_peered":"2024-09-21T07:27:18.374990+0000","last_unstale":"2024-09-21T07:27:20.393893+0000","last_undegraded":"2024-09-21T07:27:20.393893+0000","last_fullsized":"2024-09-21T07:27:20.393893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:06.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391053+0000","last_change":"2024-09-21T07:27:19.382638+0000","last_active":"2024-09-21T07:27:20.391053+0000","last_peered":"2024-09-21T07:27:20.391053+0000","last_clean":"2024-09-21T07:27:20.391053+0000","last_became_active":"2024-09-21T07:27:19.378872+0000","last_became_peered":"2024-09-21T07:27:19.378872+0000","last_unstale":"2024-09-21T07:27:20.391053+0000","last_undegraded":"2024-09-21T07:27:20.391053+0000","last_fullsized":"2024-09-21T07:27:20.391053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:10.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383795+0000","last_change":"2024-09-21T07:27:18.388949+0000","last_active":"2024-09-21T07:27:20.383795+0000","last_peered":"2024-09-21T07:27:20.383795+0000","last_clean":"2024-09-21T07:27:20.383795+0000","last_became_active":"2024-09-21T07:27:18.388248+0000","last_became_peered":"2024-09-21T07:27:18.388248+0000","last_unstale":"2024-09-21T07:27:20.383795+0000","last_undegraded":"2024-09-21T07:27:20.383795+0000","last_fullsized":"2024-09-21T07:27:20.383795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:26.750741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566550+0000","last_change":"2024-09-21T07:27:19.384711+0000","last_active":"2024-09-21T07:27:20.566550+0000","last_peered":"2024-09-21T07:27:20.566550+0000","last_clean":"2024-09-21T07:27:20.566550+0000","last_became_active":"2024-09-21T07:27:19.384384+0000","last_became_peered":"2024-09-21T07:27:19.384384+0000","last_unstale":"2024-09-21T07:27:20.566550+0000","last_undegraded":"2024-09-21T07:27:20.566550+0000","last_fullsized":"2024-09-21T07:27:20.566550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:40.778682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566547+0000","last_change":"2024-09-21T07:27:18.383361+0000","last_active":"2024-09-21T07:27:20.566547+0000","last_peered":"2024-09-21T07:27:20.566547+0000","last_clean":"2024-09-21T07:27:20.566547+0000","last_became_active":"2024-09-21T07:27:18.382808+0000","last_became_peered":"2024-09-21T07:27:18.382808+0000","last_unstale":"2024-09-21T07:27:20.566547+0000","last_undegraded":"2024-09-21T07:27:20.566547+0000","last_fullsized":"2024-09-21T07:27:20.566547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:23.205121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379416+0000","last_change":"2024-09-21T07:27:19.385385+0000","last_active":"2024-09-21T07:27:20.379416+0000","last_peered":"2024-09-21T07:27:20.379416+0000","last_clean":"2024-09-21T07:27:20.379416+0000","last_became_active":"2024-09-21T07:27:19.385072+0000","last_became_peered":"2024-09-21T07:27:19.385072+0000","last_unstale":"2024-09-21T07:27:20.379416+0000","last_undegraded":"2024-09-21T07:27:20.379416+0000","last_fullsized":"2024-09-21T07:27:20.379416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:04.556517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394688+0000","last_change":"2024-09-21T07:27:18.386710+0000","last_active":"2024-09-21T07:27:20.394688+0000","last_peered":"2024-09-21T07:27:20.394688+0000","last_clean":"2024-09-21T07:27:20.394688+0000","last_became_active":"2024-09-21T07:27:18.385401+0000","last_became_peered":"2024-09-21T07:27:18.385401+0000","last_unstale":"2024-09-21T07:27:20.394688+0000","last_undegraded":"2024-09-21T07:27:20.394688+0000","last_fullsized":"2024-09-21T07:27:20.394688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:30.463667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565235+0000","last_change":"2024-09-21T07:27:19.370914+0000","last_active":"2024-09-21T07:27:20.565235+0000","last_peered":"2024-09-21T07:27:20.565235+0000","last_clean":"2024-09-21T07:27:20.565235+0000","last_became_active":"2024-09-21T07:27:19.370604+0000","last_became_peered":"2024-09-21T07:27:19.370604+0000","last_unstale":"2024-09-21T07:27:20.565235+0000","last_undegraded":"2024-09-21T07:27:20.565235+0000","last_fullsized":"2024-09-21T07:27:20.565235+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:01.992285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"82'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567475+0000","last_change":"2024-09-21T07:27:18.383976+0000","last_active":"2024-09-21T07:27:20.567475+0000","last_peered":"2024-09-21T07:27:20.567475+0000","last_clean":"2024-09-21T07:27:20.567475+0000","last_became_active":"2024-09-21T07:27:18.383511+0000","last_became_peered":"2024-09-21T07:27:18.383511+0000","last_unstale":"2024-09-21T07:27:20.567475+0000","last_undegraded":"2024-09-21T07:27:20.567475+0000","last_fullsized":"2024-09-21T07:27:20.567475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:52.434881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567049+0000","last_change":"2024-09-21T07:27:19.380337+0000","last_active":"2024-09-21T07:27:20.567049+0000","last_peered":"2024-09-21T07:27:20.567049+0000","last_clean":"2024-09-21T07:27:20.567049+0000","last_became_active":"2024-09-21T07:27:19.379961+0000","last_became_peered":"2024-09-21T07:27:19.379961+0000","last_unstale":"2024-09-21T07:27:20.567049+0000","last_undegraded":"2024-09-21T07:27:20.567049+0000","last_fullsized":"2024-09-21T07:27:20.567049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:55.704460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566033+0000","last_change":"2024-09-21T07:27:18.375772+0000","last_active":"2024-09-21T07:27:20.566033+0000","last_peered":"2024-09-21T07:27:20.566033+0000","last_clean":"2024-09-21T07:27:20.566033+0000","last_became_active":"2024-09-21T07:27:18.375274+0000","last_became_peered":"2024-09-21T07:27:18.375274+0000","last_unstale":"2024-09-21T07:27:20.566033+0000","last_undegraded":"2024-09-21T07:27:20.566033+0000","last_fullsized":"2024-09-21T07:27:20.566033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:36.948705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567304+0000","last_change":"2024-09-21T07:27:19.372188+0000","last_active":"2024-09-21T07:27:20.567304+0000","last_peered":"2024-09-21T07:27:20.567304+0000","last_clean":"2024-09-21T07:27:20.567304+0000","last_became_active":"2024-09-21T07:27:19.371875+0000","last_became_peered":"2024-09-21T07:27:19.371875+0000","last_unstale":"2024-09-21T07:27:20.567304+0000","last_undegraded":"2024-09-21T07:27:20.567304+0000","last_fullsized":"2024-09-21T07:27:20.567304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:53.110714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382483+0000","last_change":"2024-09-21T07:27:18.389427+0000","last_active":"2024-09-21T07:27:20.382483+0000","last_peered":"2024-09-21T07:27:20.382483+0000","last_clean":"2024-09-21T07:27:20.382483+0000","last_became_active":"2024-09-21T07:27:18.389047+0000","last_became_peered":"2024-09-21T07:27:18.389047+0000","last_unstale":"2024-09-21T07:27:20.382483+0000","last_undegraded":"2024-09-21T07:27:20.382483+0000","last_fullsized":"2024-09-21T07:27:20.382483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:45.109621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567617+0000","last_change":"2024-09-21T07:27:19.386750+0000","last_active":"2024-09-21T07:27:20.567617+0000","last_peered":"2024-09-21T07:27:20.567617+0000","last_clean":"2024-09-21T07:27:20.567617+0000","last_became_active":"2024-09-21T07:27:19.386429+0000","last_became_peered":"2024-09-21T07:27:19.386429+0000","last_unstale":"2024-09-21T07:27:20.567617+0000","last_undegraded":"2024-09-21T07:27:20.567617+0000","last_fullsized":"2024-09-21T07:27:20.567617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:43.976159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.393931+0000","last_change":"2024-09-21T07:27:18.382072+0000","last_active":"2024-09-21T07:27:20.393931+0000","last_peered":"2024-09-21T07:27:20.393931+0000","last_clean":"2024-09-21T07:27:20.393931+0000","last_became_active":"2024-09-21T07:27:18.381517+0000","last_became_peered":"2024-09-21T07:27:18.381517+0000","last_unstale":"2024-09-21T07:27:20.393931+0000","last_undegraded":"2024-09-21T07:27:20.393931+0000","last_fullsized":"2024-09-21T07:27:20.393931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:29.772612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567632+0000","last_change":"2024-09-21T07:27:19.376133+0000","last_active":"2024-09-21T07:27:20.567632+0000","last_peered":"2024-09-21T07:27:20.567632+0000","last_clean":"2024-09-21T07:27:20.567632+0000","last_became_active":"2024-09-21T07:27:19.375829+0000","last_became_peered":"2024-09-21T07:27:19.375829+0000","last_unstale":"2024-09-21T07:27:20.567632+0000","last_undegraded":"2024-09-21T07:27:20.567632+0000","last_fullsized":"2024-09-21T07:27:20.567632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:18.072131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"82'8","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391134+0000","last_change":"2024-09-21T07:27:18.385219+0000","last_active":"2024-09-21T07:27:20.391134+0000","last_peered":"2024-09-21T07:27:20.391134+0000","last_clean":"2024-09-21T07:27:20.391134+0000","last_became_active":"2024-09-21T07:27:18.380075+0000","last_became_peered":"2024-09-21T07:27:18.380075+0000","last_unstale":"2024-09-21T07:27:20.391134+0000","last_undegraded":"2024-09-21T07:27:20.391134+0000","last_fullsized":"2024-09-21T07:27:20.391134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:53.880971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378875+0000","last_change":"2024-09-21T07:27:19.393448+0000","last_active":"2024-09-21T07:27:20.378875+0000","last_peered":"2024-09-21T07:27:20.378875+0000","last_clean":"2024-09-21T07:27:20.378875+0000","last_became_active":"2024-09-21T07:27:19.393168+0000","last_became_peered":"2024-09-21T07:27:19.393168+0000","last_unstale":"2024-09-21T07:27:20.378875+0000","last_undegraded":"2024-09-21T07:27:20.378875+0000","last_fullsized":"2024-09-21T07:27:20.378875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:28.470687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383876+0000","last_change":"2024-09-21T07:27:18.387286+0000","last_active":"2024-09-21T07:27:20.383876+0000","last_peered":"2024-09-21T07:27:20.383876+0000","last_clean":"2024-09-21T07:27:20.383876+0000","last_became_active":"2024-09-21T07:27:18.386941+0000","last_became_peered":"2024-09-21T07:27:18.386941+0000","last_unstale":"2024-09-21T07:27:20.383876+0000","last_undegraded":"2024-09-21T07:27:20.383876+0000","last_fullsized":"2024-09-21T07:27:20.383876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394061+0000","last_change":"2024-09-21T07:27:19.395400+0000","last_active":"2024-09-21T07:27:20.394061+0000","last_peered":"2024-09-21T07:27:20.394061+0000","last_clean":"2024-09-21T07:27:20.394061+0000","last_became_active":"2024-09-21T07:27:19.395109+0000","last_became_peered":"2024-09-21T07:27:19.395109+0000","last_unstale":"2024-09-21T07:27:20.394061+0000","last_undegraded":"2024-09-21T07:27:20.394061+0000","last_fullsized":"2024-09-21T07:27:20.394061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:50.461116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383594+0000","last_change":"2024-09-21T07:27:18.386413+0000","last_active":"2024-09-21T07:27:20.383594+0000","last_peered":"2024-09-21T07:27:20.383594+0000","last_clean":"2024-09-21T07:27:20.383594+0000","last_became_active":"2024-09-21T07:27:18.386066+0000","last_became_peered":"2024-09-21T07:27:18.386066+0000","last_unstale":"2024-09-21T07:27:20.383594+0000","last_undegraded":"2024-09-21T07:27:20.383594+0000","last_fullsized":"2024-09-21T07:27:20.383594+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:54.696741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394081+0000","last_change":"2024-09-21T07:27:19.390160+0000","last_active":"2024-09-21T07:27:20.394081+0000","last_peered":"2024-09-21T07:27:20.394081+0000","last_clean":"2024-09-21T07:27:20.394081+0000","last_became_active":"2024-09-21T07:27:19.389795+0000","last_became_peered":"2024-09-21T07:27:19.389795+0000","last_unstale":"2024-09-21T07:27:20.394081+0000","last_undegraded":"2024-09-21T07:27:20.394081+0000","last_fullsized":"2024-09-21T07:27:20.394081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:59.006793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394685+0000","last_change":"2024-09-21T07:27:18.380186+0000","last_active":"2024-09-21T07:27:20.394685+0000","last_peered":"2024-09-21T07:27:20.394685+0000","last_clean":"2024-09-21T07:27:20.394685+0000","last_became_active":"2024-09-21T07:27:18.379862+0000","last_became_peered":"2024-09-21T07:27:18.379862+0000","last_unstale":"2024-09-21T07:27:20.394685+0000","last_undegraded":"2024-09-21T07:27:20.394685+0000","last_fullsized":"2024-09-21T07:27:20.394685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:28.473767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379287+0000","last_change":"2024-09-21T07:27:19.400106+0000","last_active":"2024-09-21T07:27:20.379287+0000","last_peered":"2024-09-21T07:27:20.379287+0000","last_clean":"2024-09-21T07:27:20.379287+0000","last_became_active":"2024-09-21T07:27:19.399789+0000","last_became_peered":"2024-09-21T07:27:19.399789+0000","last_unstale":"2024-09-21T07:27:20.379287+0000","last_undegraded":"2024-09-21T07:27:20.379287+0000","last_fullsized":"2024-09-21T07:27:20.379287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:12.218650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565171+0000","last_change":"2024-09-21T07:27:18.380438+0000","last_active":"2024-09-21T07:27:20.565171+0000","last_peered":"2024-09-21T07:27:20.565171+0000","last_clean":"2024-09-21T07:27:20.565171+0000","last_became_active":"2024-09-21T07:27:18.380128+0000","last_became_peered":"2024-09-21T07:27:18.380128+0000","last_unstale":"2024-09-21T07:27:20.565171+0000","last_undegraded":"2024-09-21T07:27:20.565171+0000","last_fullsized":"2024-09-21T07:27:20.565171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:36.408859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391576+0000","last_change":"2024-09-21T07:27:19.381813+0000","last_active":"2024-09-21T07:27:20.391576+0000","last_peered":"2024-09-21T07:27:20.391576+0000","last_clean":"2024-09-21T07:27:20.391576+0000","last_became_active":"2024-09-21T07:27:19.381455+0000","last_became_peered":"2024-09-21T07:27:19.381455+0000","last_unstale":"2024-09-21T07:27:20.391576+0000","last_undegraded":"2024-09-21T07:27:20.391576+0000","last_fullsized":"2024-09-21T07:27:20.391576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:17.659403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379243+0000","last_change":"2024-09-21T07:27:18.390963+0000","last_active":"2024-09-21T07:27:20.379243+0000","last_peered":"2024-09-21T07:27:20.379243+0000","last_clean":"2024-09-21T07:27:20.379243+0000","last_became_active":"2024-09-21T07:27:18.390261+0000","last_became_peered":"2024-09-21T07:27:18.390261+0000","last_unstale":"2024-09-21T07:27:20.379243+0000","last_undegraded":"2024-09-21T07:27:20.379243+0000","last_fullsized":"2024-09-21T07:27:20.379243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:19.124025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391787+0000","last_change":"2024-09-21T07:27:19.382811+0000","last_active":"2024-09-21T07:27:20.391787+0000","last_peered":"2024-09-21T07:27:20.391787+0000","last_clean":"2024-09-21T07:27:20.391787+0000","last_became_active":"2024-09-21T07:27:19.382503+0000","last_became_peered":"2024-09-21T07:27:19.382503+0000","last_unstale":"2024-09-21T07:27:20.391787+0000","last_undegraded":"2024-09-21T07:27:20.391787+0000","last_fullsized":"2024-09-21T07:27:20.391787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:28.307382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378904+0000","last_change":"2024-09-21T07:27:18.384632+0000","last_active":"2024-09-21T07:27:20.378904+0000","last_peered":"2024-09-21T07:27:20.378904+0000","last_clean":"2024-09-21T07:27:20.378904+0000","last_became_active":"2024-09-21T07:27:18.379316+0000","last_became_peered":"2024-09-21T07:27:18.379316+0000","last_unstale":"2024-09-21T07:27:20.378904+0000","last_undegraded":"2024-09-21T07:27:20.378904+0000","last_fullsized":"2024-09-21T07:27:20.378904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567865+0000","last_change":"2024-09-21T07:27:19.382596+0000","last_active":"2024-09-21T07:27:20.567865+0000","last_peered":"2024-09-21T07:27:20.567865+0000","last_clean":"2024-09-21T07:27:20.567865+0000","last_became_active":"2024-09-21T07:27:19.382317+0000","last_became_peered":"2024-09-21T07:27:19.382317+0000","last_unstale":"2024-09-21T07:27:20.567865+0000","last_undegraded":"2024-09-21T07:27:20.567865+0000","last_fullsized":"2024-09-21T07:27:20.567865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:27.487026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378970+0000","last_change":"2024-09-21T07:27:18.380043+0000","last_active":"2024-09-21T07:27:20.378970+0000","last_peered":"2024-09-21T07:27:20.378970+0000","last_clean":"2024-09-21T07:27:20.378970+0000","last_became_active":"2024-09-21T07:27:18.379631+0000","last_became_peered":"2024-09-21T07:27:18.379631+0000","last_unstale":"2024-09-21T07:27:20.378970+0000","last_undegraded":"2024-09-21T07:27:20.378970+0000","last_fullsized":"2024-09-21T07:27:20.378970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:26.750741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383043+0000","last_change":"2024-09-21T07:27:19.385172+0000","last_active":"2024-09-21T07:27:20.383043+0000","last_peered":"2024-09-21T07:27:20.383043+0000","last_clean":"2024-09-21T07:27:20.383043+0000","last_became_active":"2024-09-21T07:27:19.384675+0000","last_became_peered":"2024-09-21T07:27:19.384675+0000","last_unstale":"2024-09-21T07:27:20.383043+0000","last_undegraded":"2024-09-21T07:27:20.383043+0000","last_fullsized":"2024-09-21T07:27:20.383043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:51.604536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566402+0000","last_change":"2024-09-21T07:27:18.381412+0000","last_active":"2024-09-21T07:27:20.566402+0000","last_peered":"2024-09-21T07:27:20.566402+0000","last_clean":"2024-09-21T07:27:20.566402+0000","last_became_active":"2024-09-21T07:27:18.381087+0000","last_became_peered":"2024-09-21T07:27:18.381087+0000","last_unstale":"2024-09-21T07:27:20.566402+0000","last_undegraded":"2024-09-21T07:27:20.566402+0000","last_fullsized":"2024-09-21T07:27:20.566402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:53.880971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566946+0000","last_change":"2024-09-21T07:27:19.377620+0000","last_active":"2024-09-21T07:27:20.566946+0000","last_peered":"2024-09-21T07:27:20.566946+0000","last_clean":"2024-09-21T07:27:20.566946+0000","last_became_active":"2024-09-21T07:27:19.377298+0000","last_became_peered":"2024-09-21T07:27:19.377298+0000","last_unstale":"2024-09-21T07:27:20.566946+0000","last_undegraded":"2024-09-21T07:27:20.566946+0000","last_fullsized":"2024-09-21T07:27:20.566946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.957390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"83'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391836+0000","last_change":"2024-09-21T07:27:18.373261+0000","last_active":"2024-09-21T07:27:20.391836+0000","last_peered":"2024-09-21T07:27:20.391836+0000","last_clean":"2024-09-21T07:27:20.391836+0000","last_became_active":"2024-09-21T07:27:18.372936+0000","last_became_peered":"2024-09-21T07:27:18.372936+0000","last_unstale":"2024-09-21T07:27:20.391836+0000","last_undegraded":"2024-09-21T07:27:20.391836+0000","last_fullsized":"2024-09-21T07:27:20.391836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:21.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383788+0000","last_change":"2024-09-21T07:27:19.390325+0000","last_active":"2024-09-21T07:27:20.383788+0000","last_peered":"2024-09-21T07:27:20.383788+0000","last_clean":"2024-09-21T07:27:20.383788+0000","last_became_active":"2024-09-21T07:27:19.389125+0000","last_became_peered":"2024-09-21T07:27:19.389125+0000","last_unstale":"2024-09-21T07:27:20.383788+0000","last_undegraded":"2024-09-21T07:27:20.383788+0000","last_fullsized":"2024-09-21T07:27:20.383788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:58.583211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383279+0000","last_change":"2024-09-21T07:27:18.390422+0000","last_active":"2024-09-21T07:27:20.383279+0000","last_peered":"2024-09-21T07:27:20.383279+0000","last_clean":"2024-09-21T07:27:20.383279+0000","last_became_active":"2024-09-21T07:27:18.390069+0000","last_became_peered":"2024-09-21T07:27:18.390069+0000","last_unstale":"2024-09-21T07:27:20.383279+0000","last_undegraded":"2024-09-21T07:27:20.383279+0000","last_fullsized":"2024-09-21T07:27:20.383279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.556774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391143+0000","last_change":"2024-09-21T07:27:19.381320+0000","last_active":"2024-09-21T07:27:20.391143+0000","last_peered":"2024-09-21T07:27:20.391143+0000","last_clean":"2024-09-21T07:27:20.391143+0000","last_became_active":"2024-09-21T07:27:19.380999+0000","last_became_peered":"2024-09-21T07:27:19.380999+0000","last_unstale":"2024-09-21T07:27:20.391143+0000","last_undegraded":"2024-09-21T07:27:20.391143+0000","last_fullsized":"2024-09-21T07:27:20.391143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:35.224754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382597+0000","last_change":"2024-09-21T07:27:18.388398+0000","last_active":"2024-09-21T07:27:20.382597+0000","last_peered":"2024-09-21T07:27:20.382597+0000","last_clean":"2024-09-21T07:27:20.382597+0000","last_became_active":"2024-09-21T07:27:18.388065+0000","last_became_peered":"2024-09-21T07:27:18.388065+0000","last_unstale":"2024-09-21T07:27:20.382597+0000","last_undegraded":"2024-09-21T07:27:20.382597+0000","last_fullsized":"2024-09-21T07:27:20.382597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:44.211392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567402+0000","last_change":"2024-09-21T07:27:19.379163+0000","last_active":"2024-09-21T07:27:20.567402+0000","last_peered":"2024-09-21T07:27:20.567402+0000","last_clean":"2024-09-21T07:27:20.567402+0000","last_became_active":"2024-09-21T07:27:19.377518+0000","last_became_peered":"2024-09-21T07:27:19.377518+0000","last_unstale":"2024-09-21T07:27:20.567402+0000","last_undegraded":"2024-09-21T07:27:20.567402+0000","last_fullsized":"2024-09-21T07:27:20.567402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:02.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567170+0000","last_change":"2024-09-21T07:27:18.388326+0000","last_active":"2024-09-21T07:27:20.567170+0000","last_peered":"2024-09-21T07:27:20.567170+0000","last_clean":"2024-09-21T07:27:20.567170+0000","last_became_active":"2024-09-21T07:27:18.387846+0000","last_became_peered":"2024-09-21T07:27:18.387846+0000","last_unstale":"2024-09-21T07:27:20.567170+0000","last_undegraded":"2024-09-21T07:27:20.567170+0000","last_fullsized":"2024-09-21T07:27:20.567170+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:50.600002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567371+0000","last_change":"2024-09-21T07:27:19.394683+0000","last_active":"2024-09-21T07:27:20.567371+0000","last_peered":"2024-09-21T07:27:20.567371+0000","last_clean":"2024-09-21T07:27:20.567371+0000","last_became_active":"2024-09-21T07:27:19.394097+0000","last_became_peered":"2024-09-21T07:27:19.394097+0000","last_unstale":"2024-09-21T07:27:20.567371+0000","last_undegraded":"2024-09-21T07:27:20.567371+0000","last_fullsized":"2024-09-21T07:27:20.567371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:44.629122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394224+0000","last_change":"2024-09-21T07:27:18.383774+0000","last_active":"2024-09-21T07:27:20.394224+0000","last_peered":"2024-09-21T07:27:20.394224+0000","last_clean":"2024-09-21T07:27:20.394224+0000","last_became_active":"2024-09-21T07:27:18.383473+0000","last_became_peered":"2024-09-21T07:27:18.383473+0000","last_unstale":"2024-09-21T07:27:20.394224+0000","last_undegraded":"2024-09-21T07:27:20.394224+0000","last_fullsized":"2024-09-21T07:27:20.394224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:29.243954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565774+0000","last_change":"2024-09-21T07:27:19.372784+0000","last_active":"2024-09-21T07:27:20.565774+0000","last_peered":"2024-09-21T07:27:20.565774+0000","last_clean":"2024-09-21T07:27:20.565774+0000","last_became_active":"2024-09-21T07:27:19.372462+0000","last_became_peered":"2024-09-21T07:27:19.372462+0000","last_unstale":"2024-09-21T07:27:20.565774+0000","last_undegraded":"2024-09-21T07:27:20.565774+0000","last_fullsized":"2024-09-21T07:27:20.565774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:51.016774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567049+0000","last_change":"2024-09-21T07:27:18.384797+0000","last_active":"2024-09-21T07:27:20.567049+0000","last_peered":"2024-09-21T07:27:20.567049+0000","last_clean":"2024-09-21T07:27:20.567049+0000","last_became_active":"2024-09-21T07:27:18.383740+0000","last_became_peered":"2024-09-21T07:27:18.383740+0000","last_unstale":"2024-09-21T07:27:20.567049+0000","last_undegraded":"2024-09-21T07:27:20.567049+0000","last_fullsized":"2024-09-21T07:27:20.567049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:31.223179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565740+0000","last_change":"2024-09-21T07:27:19.383346+0000","last_active":"2024-09-21T07:27:20.565740+0000","last_peered":"2024-09-21T07:27:20.565740+0000","last_clean":"2024-09-21T07:27:20.565740+0000","last_became_active":"2024-09-21T07:27:19.382991+0000","last_became_peered":"2024-09-21T07:27:19.382991+0000","last_unstale":"2024-09-21T07:27:20.565740+0000","last_undegraded":"2024-09-21T07:27:20.565740+0000","last_fullsized":"2024-09-21T07:27:20.565740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:23.746542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.564972+0000","last_change":"2024-09-21T07:27:18.382683+0000","last_active":"2024-09-21T07:27:20.564972+0000","last_peered":"2024-09-21T07:27:20.564972+0000","last_clean":"2024-09-21T07:27:20.564972+0000","last_became_active":"2024-09-21T07:27:18.382355+0000","last_became_peered":"2024-09-21T07:27:18.382355+0000","last_unstale":"2024-09-21T07:27:20.564972+0000","last_undegraded":"2024-09-21T07:27:20.564972+0000","last_fullsized":"2024-09-21T07:27:20.564972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:18.020611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383157+0000","last_change":"2024-09-21T07:27:19.392959+0000","last_active":"2024-09-21T07:27:20.383157+0000","last_peered":"2024-09-21T07:27:20.383157+0000","last_clean":"2024-09-21T07:27:20.383157+0000","last_became_active":"2024-09-21T07:27:19.392611+0000","last_became_peered":"2024-09-21T07:27:19.392611+0000","last_unstale":"2024-09-21T07:27:20.383157+0000","last_undegraded":"2024-09-21T07:27:20.383157+0000","last_fullsized":"2024-09-21T07:27:20.383157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:46.393448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379446+0000","last_change":"2024-09-21T07:27:18.381694+0000","last_active":"2024-09-21T07:27:20.379446+0000","last_peered":"2024-09-21T07:27:20.379446+0000","last_clean":"2024-09-21T07:27:20.379446+0000","last_became_active":"2024-09-21T07:27:18.381307+0000","last_became_peered":"2024-09-21T07:27:18.381307+0000","last_unstale":"2024-09-21T07:27:20.379446+0000","last_undegraded":"2024-09-21T07:27:20.379446+0000","last_fullsized":"2024-09-21T07:27:20.379446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:05.244237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382930+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:27:20.382930+0000","last_peered":"2024-09-21T07:27:20.382930+0000","last_clean":"2024-09-21T07:27:20.382930+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:27:20.382930+0000","last_undegraded":"2024-09-21T07:27:20.382930+0000","last_fullsized":"2024-09-21T07:27:20.382930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1019904,"data_stored":465685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1011712,"data_stored":464107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1028096,"data_stored":465789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1019904,"data_stored":464815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1015808,"data_stored":464185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41076,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330764,"statfs":{"total":96636764160,"available":96594702336,"internally_reserved":0,"allocated":1601536,"data_stored":1054441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1605632,"data_stored":1054463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1011712,"data_stored":464655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:27:23.579 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:27:23.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- 172.21.15.64:0/1076873888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 msgr2=0x7fce2c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 --2- 172.21.15.64:0/1076873888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c0b1b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fce24009840 tx=0x7fce2401c820 comp rx=0 tx=0).stop 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- 172.21.15.64:0/1076873888 shutdown_connections 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 --2- 172.21.15.64:0/1076873888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c0b1b90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 --2- 172.21.15.64:0/1076873888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cf030 0x7fce2c0cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- 172.21.15.64:0/1076873888 >> 172.21.15.64:0/1076873888 conn(0x7fce2c09b3f0 msgr2=0x7fce2c0d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- 172.21.15.64:0/1076873888 shutdown_connections 2024-09-21T07:27:23.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- 172.21.15.64:0/1076873888 wait complete. 2024-09-21T07:27:23.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 Processor -- start 2024-09-21T07:27:23.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.771+0000 7fce2b200640 1 -- start start 2024-09-21T07:27:23.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 0x7fce2c1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 0x7fce2c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c169ac0 con 0x7fce2c0b1780 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c169940 con 0x7fce2c0cf030 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c169c40 con 0x7fce2c0cec20 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41678/0 (socket says 172.21.15.64:41678) 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 -- 172.21.15.64:0/3279601845 learned_addr learned my addr 172.21.15.64:0/3279601845 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce21400640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 0x7fce2c1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2a800640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 0x7fce2c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 -- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 msgr2=0x7fce2c1f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 0x7fce2c1f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 -- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 msgr2=0x7fce2c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 0x7fce2c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 -- 172.21.15.64:0/3279601845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c0aef30 con 0x7fce2c0b1780 2024-09-21T07:27:23.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2a800640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 0x7fce2c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:23.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce21400640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 0x7fce2c1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce29e00640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c750 tx=0x7fce1c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c017070 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce1c005070 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00ce60 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c0af210 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c0af7d0 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.775+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2c0b1b90 con 0x7fce2c0b1780 2024-09-21T07:27:23.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.779+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce1c01a070 con 0x7fce2c0b1780 2024-09-21T07:27:23.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.779+0000 7fce22a00640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 0x7fce08075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:23.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.779+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fce1c093a80 con 0x7fce2c0b1780 2024-09-21T07:27:23.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.779+0000 7fce21400640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 0x7fce08075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:23.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.779+0000 7fce21400640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 0x7fce08075740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce14005fd0 tx=0x7fce14005de0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:23.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.783+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fce1c095e20 con 0x7fce2c0b1780 2024-09-21T07:27:23.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.955+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce2c160fa0 con 0x7fce08073230 2024-09-21T07:27:23.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.959+0000 7fce22a00640 1 -- 172.21.15.64:0/3279601845 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7fce2c160fa0 con 0x7fce08073230 2024-09-21T07:27:23.965 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:23.967 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 msgr2=0x7fce08075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 0x7fce08075740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce14005fd0 tx=0x7fce14005de0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 msgr2=0x7fce2c06f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c750 tx=0x7fce1c00cc10 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 shutdown_connections 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce08073230 0x7fce08075740 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce2c0cf030 0x7fce2c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce2c0cec20 0x7fce2c1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 --2- 172.21.15.64:0/3279601845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c0b1780 0x7fce2c06f030 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 >> 172.21.15.64:0/3279601845 conn(0x7fce2c09b3f0 msgr2=0x7fce2c068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:23.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 shutdown_connections 2024-09-21T07:27:23.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:23.963+0000 7fce2b200640 1 -- 172.21.15.64:0/3279601845 wait complete. 2024-09-21T07:27:23.987 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-09-21T07:27:23.493935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304396,"kb_used_data":9096,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754670324,"statfs":{"total":773094113280,"available":772782411776,"internally_reserved":0,"allocated":9314304,"data_stored":4898140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":302173747},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001556"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383730+0000","last_change":"2024-09-21T07:27:19.387016+0000","last_active":"2024-09-21T07:27:20.383730+0000","last_peered":"2024-09-21T07:27:20.383730+0000","last_clean":"2024-09-21T07:27:20.383730+0000","last_became_active":"2024-09-21T07:27:19.386691+0000","last_became_peered":"2024-09-21T07:27:19.386691+0000","last_unstale":"2024-09-21T07:27:20.383730+0000","last_undegraded":"2024-09-21T07:27:20.383730+0000","last_fullsized":"2024-09-21T07:27:20.383730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:43.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391762+0000","last_change":"2024-09-21T07:27:19.392358+0000","last_active":"2024-09-21T07:27:20.391762+0000","last_peered":"2024-09-21T07:27:20.391762+0000","last_clean":"2024-09-21T07:27:20.391762+0000","last_became_active":"2024-09-21T07:27:19.392055+0000","last_became_peered":"2024-09-21T07:27:19.392055+0000","last_unstale":"2024-09-21T07:27:20.391762+0000","last_undegraded":"2024-09-21T07:27:20.391762+0000","last_fullsized":"2024-09-21T07:27:20.391762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:34.712487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565537+0000","last_change":"2024-09-21T07:27:19.370150+0000","last_active":"2024-09-21T07:27:20.565537+0000","last_peered":"2024-09-21T07:27:20.565537+0000","last_clean":"2024-09-21T07:27:20.565537+0000","last_became_active":"2024-09-21T07:27:19.369802+0000","last_became_peered":"2024-09-21T07:27:19.369802+0000","last_unstale":"2024-09-21T07:27:20.565537+0000","last_undegraded":"2024-09-21T07:27:20.565537+0000","last_fullsized":"2024-09-21T07:27:20.565537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:54.560364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566813+0000","last_change":"2024-09-21T07:27:19.388588+0000","last_active":"2024-09-21T07:27:20.566813+0000","last_peered":"2024-09-21T07:27:20.566813+0000","last_clean":"2024-09-21T07:27:20.566813+0000","last_became_active":"2024-09-21T07:27:19.387575+0000","last_became_peered":"2024-09-21T07:27:19.387575+0000","last_unstale":"2024-09-21T07:27:20.566813+0000","last_undegraded":"2024-09-21T07:27:20.566813+0000","last_fullsized":"2024-09-21T07:27:20.566813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:40.015940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394475+0000","last_change":"2024-09-21T07:27:19.392735+0000","last_active":"2024-09-21T07:27:20.394475+0000","last_peered":"2024-09-21T07:27:20.394475+0000","last_clean":"2024-09-21T07:27:20.394475+0000","last_became_active":"2024-09-21T07:27:19.392241+0000","last_became_peered":"2024-09-21T07:27:19.392241+0000","last_unstale":"2024-09-21T07:27:20.394475+0000","last_undegraded":"2024-09-21T07:27:20.394475+0000","last_fullsized":"2024-09-21T07:27:20.394475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:14.787362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378984+0000","last_change":"2024-09-21T07:27:19.387879+0000","last_active":"2024-09-21T07:27:20.378984+0000","last_peered":"2024-09-21T07:27:20.378984+0000","last_clean":"2024-09-21T07:27:20.378984+0000","last_became_active":"2024-09-21T07:27:19.387588+0000","last_became_peered":"2024-09-21T07:27:19.387588+0000","last_unstale":"2024-09-21T07:27:20.378984+0000","last_undegraded":"2024-09-21T07:27:20.378984+0000","last_fullsized":"2024-09-21T07:27:20.378984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:46.393448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566931+0000","last_change":"2024-09-21T07:27:19.391648+0000","last_active":"2024-09-21T07:27:20.566931+0000","last_peered":"2024-09-21T07:27:20.566931+0000","last_clean":"2024-09-21T07:27:20.566931+0000","last_became_active":"2024-09-21T07:27:19.391274+0000","last_became_peered":"2024-09-21T07:27:19.391274+0000","last_unstale":"2024-09-21T07:27:20.566931+0000","last_undegraded":"2024-09-21T07:27:20.566931+0000","last_fullsized":"2024-09-21T07:27:20.566931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:36.991939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394029+0000","last_change":"2024-09-21T07:27:19.384903+0000","last_active":"2024-09-21T07:27:20.394029+0000","last_peered":"2024-09-21T07:27:20.394029+0000","last_clean":"2024-09-21T07:27:20.394029+0000","last_became_active":"2024-09-21T07:27:19.384418+0000","last_became_peered":"2024-09-21T07:27:19.384418+0000","last_unstale":"2024-09-21T07:27:20.394029+0000","last_undegraded":"2024-09-21T07:27:20.394029+0000","last_fullsized":"2024-09-21T07:27:20.394029+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:35.851635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384104+0000","last_change":"2024-09-21T07:27:19.389931+0000","last_active":"2024-09-21T07:27:20.384104+0000","last_peered":"2024-09-21T07:27:20.384104+0000","last_clean":"2024-09-21T07:27:20.384104+0000","last_became_active":"2024-09-21T07:27:19.389584+0000","last_became_peered":"2024-09-21T07:27:19.389584+0000","last_unstale":"2024-09-21T07:27:20.384104+0000","last_undegraded":"2024-09-21T07:27:20.384104+0000","last_fullsized":"2024-09-21T07:27:20.384104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.581400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566339+0000","last_change":"2024-09-21T07:27:19.383541+0000","last_active":"2024-09-21T07:27:20.566339+0000","last_peered":"2024-09-21T07:27:20.566339+0000","last_clean":"2024-09-21T07:27:20.566339+0000","last_became_active":"2024-09-21T07:27:19.383181+0000","last_became_peered":"2024-09-21T07:27:19.383181+0000","last_unstale":"2024-09-21T07:27:20.566339+0000","last_undegraded":"2024-09-21T07:27:20.566339+0000","last_fullsized":"2024-09-21T07:27:20.566339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:04.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391908+0000","last_change":"2024-09-21T07:27:19.399251+0000","last_active":"2024-09-21T07:27:20.391908+0000","last_peered":"2024-09-21T07:27:20.391908+0000","last_clean":"2024-09-21T07:27:20.391908+0000","last_became_active":"2024-09-21T07:27:19.399026+0000","last_became_peered":"2024-09-21T07:27:19.399026+0000","last_unstale":"2024-09-21T07:27:20.391908+0000","last_undegraded":"2024-09-21T07:27:20.391908+0000","last_fullsized":"2024-09-21T07:27:20.391908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:55.756413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566885+0000","last_change":"2024-09-21T07:27:19.388801+0000","last_active":"2024-09-21T07:27:20.566885+0000","last_peered":"2024-09-21T07:27:20.566885+0000","last_clean":"2024-09-21T07:27:20.566885+0000","last_became_active":"2024-09-21T07:27:19.388122+0000","last_became_peered":"2024-09-21T07:27:19.388122+0000","last_unstale":"2024-09-21T07:27:20.566885+0000","last_undegraded":"2024-09-21T07:27:20.566885+0000","last_fullsized":"2024-09-21T07:27:20.566885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:55.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394684+0000","last_change":"2024-09-21T07:27:19.407586+0000","last_active":"2024-09-21T07:27:20.394684+0000","last_peered":"2024-09-21T07:27:20.394684+0000","last_clean":"2024-09-21T07:27:20.394684+0000","last_became_active":"2024-09-21T07:27:19.405329+0000","last_became_peered":"2024-09-21T07:27:19.405329+0000","last_unstale":"2024-09-21T07:27:20.394684+0000","last_undegraded":"2024-09-21T07:27:20.394684+0000","last_fullsized":"2024-09-21T07:27:20.394684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:04.213220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379136+0000","last_change":"2024-09-21T07:27:19.387724+0000","last_active":"2024-09-21T07:27:20.379136+0000","last_peered":"2024-09-21T07:27:20.379136+0000","last_clean":"2024-09-21T07:27:20.379136+0000","last_became_active":"2024-09-21T07:27:19.387171+0000","last_became_peered":"2024-09-21T07:27:19.387171+0000","last_unstale":"2024-09-21T07:27:20.379136+0000","last_undegraded":"2024-09-21T07:27:20.379136+0000","last_fullsized":"2024-09-21T07:27:20.379136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:43.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391002+0000","last_change":"2024-09-21T07:27:19.375011+0000","last_active":"2024-09-21T07:27:20.391002+0000","last_peered":"2024-09-21T07:27:20.391002+0000","last_clean":"2024-09-21T07:27:20.391002+0000","last_became_active":"2024-09-21T07:27:19.374593+0000","last_became_peered":"2024-09-21T07:27:19.374593+0000","last_unstale":"2024-09-21T07:27:20.391002+0000","last_undegraded":"2024-09-21T07:27:20.391002+0000","last_fullsized":"2024-09-21T07:27:20.391002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:51.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383996+0000","last_change":"2024-09-21T07:27:19.387634+0000","last_active":"2024-09-21T07:27:20.383996+0000","last_peered":"2024-09-21T07:27:20.383996+0000","last_clean":"2024-09-21T07:27:20.383996+0000","last_became_active":"2024-09-21T07:27:19.387286+0000","last_became_peered":"2024-09-21T07:27:19.387286+0000","last_unstale":"2024-09-21T07:27:20.383996+0000","last_undegraded":"2024-09-21T07:27:20.383996+0000","last_fullsized":"2024-09-21T07:27:20.383996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:12.218650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394867+0000","last_change":"2024-09-21T07:27:19.397819+0000","last_active":"2024-09-21T07:27:20.394867+0000","last_peered":"2024-09-21T07:27:20.394867+0000","last_clean":"2024-09-21T07:27:20.394867+0000","last_became_active":"2024-09-21T07:27:19.397486+0000","last_became_peered":"2024-09-21T07:27:19.397486+0000","last_unstale":"2024-09-21T07:27:20.394867+0000","last_undegraded":"2024-09-21T07:27:20.394867+0000","last_fullsized":"2024-09-21T07:27:20.394867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:54.726085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565537+0000","last_change":"2024-09-21T07:27:19.385970+0000","last_active":"2024-09-21T07:27:20.565537+0000","last_peered":"2024-09-21T07:27:20.565537+0000","last_clean":"2024-09-21T07:27:20.565537+0000","last_became_active":"2024-09-21T07:27:19.385673+0000","last_became_peered":"2024-09-21T07:27:19.385673+0000","last_unstale":"2024-09-21T07:27:20.565537+0000","last_undegraded":"2024-09-21T07:27:20.565537+0000","last_fullsized":"2024-09-21T07:27:20.565537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:48.949943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379483+0000","last_change":"2024-09-21T07:27:19.398257+0000","last_active":"2024-09-21T07:27:20.379483+0000","last_peered":"2024-09-21T07:27:20.379483+0000","last_clean":"2024-09-21T07:27:20.379483+0000","last_became_active":"2024-09-21T07:27:19.397876+0000","last_became_peered":"2024-09-21T07:27:19.397876+0000","last_unstale":"2024-09-21T07:27:20.379483+0000","last_undegraded":"2024-09-21T07:27:20.379483+0000","last_fullsized":"2024-09-21T07:27:20.379483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:37.464703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394732+0000","last_change":"2024-09-21T07:27:19.396876+0000","last_active":"2024-09-21T07:27:20.394732+0000","last_peered":"2024-09-21T07:27:20.394732+0000","last_clean":"2024-09-21T07:27:20.394732+0000","last_became_active":"2024-09-21T07:27:19.396531+0000","last_became_peered":"2024-09-21T07:27:19.396531+0000","last_unstale":"2024-09-21T07:27:20.394732+0000","last_undegraded":"2024-09-21T07:27:20.394732+0000","last_fullsized":"2024-09-21T07:27:20.394732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.556181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384100+0000","last_change":"2024-09-21T07:27:19.387753+0000","last_active":"2024-09-21T07:27:20.384100+0000","last_peered":"2024-09-21T07:27:20.384100+0000","last_clean":"2024-09-21T07:27:20.384100+0000","last_became_active":"2024-09-21T07:27:19.386132+0000","last_became_peered":"2024-09-21T07:27:19.386132+0000","last_unstale":"2024-09-21T07:27:20.384100+0000","last_undegraded":"2024-09-21T07:27:20.384100+0000","last_fullsized":"2024-09-21T07:27:20.384100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:55.163069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394374+0000","last_change":"2024-09-21T07:27:19.400604+0000","last_active":"2024-09-21T07:27:20.394374+0000","last_peered":"2024-09-21T07:27:20.394374+0000","last_clean":"2024-09-21T07:27:20.394374+0000","last_became_active":"2024-09-21T07:27:19.398828+0000","last_became_peered":"2024-09-21T07:27:19.398828+0000","last_unstale":"2024-09-21T07:27:20.394374+0000","last_undegraded":"2024-09-21T07:27:20.394374+0000","last_fullsized":"2024-09-21T07:27:20.394374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:21.988330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383047+0000","last_change":"2024-09-21T07:27:19.389149+0000","last_active":"2024-09-21T07:27:20.383047+0000","last_peered":"2024-09-21T07:27:20.383047+0000","last_clean":"2024-09-21T07:27:20.383047+0000","last_became_active":"2024-09-21T07:27:19.387403+0000","last_became_peered":"2024-09-21T07:27:19.387403+0000","last_unstale":"2024-09-21T07:27:20.383047+0000","last_undegraded":"2024-09-21T07:27:20.383047+0000","last_fullsized":"2024-09-21T07:27:20.383047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:57.377805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391207+0000","last_change":"2024-09-21T07:27:19.385357+0000","last_active":"2024-09-21T07:27:20.391207+0000","last_peered":"2024-09-21T07:27:20.391207+0000","last_clean":"2024-09-21T07:27:20.391207+0000","last_became_active":"2024-09-21T07:27:19.384959+0000","last_became_peered":"2024-09-21T07:27:19.384959+0000","last_unstale":"2024-09-21T07:27:20.391207+0000","last_undegraded":"2024-09-21T07:27:20.391207+0000","last_fullsized":"2024-09-21T07:27:20.391207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.559605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391724+0000","last_change":"2024-09-21T07:27:19.381939+0000","last_active":"2024-09-21T07:27:20.391724+0000","last_peered":"2024-09-21T07:27:20.391724+0000","last_clean":"2024-09-21T07:27:20.391724+0000","last_became_active":"2024-09-21T07:27:19.378790+0000","last_became_peered":"2024-09-21T07:27:19.378790+0000","last_unstale":"2024-09-21T07:27:20.391724+0000","last_undegraded":"2024-09-21T07:27:20.391724+0000","last_fullsized":"2024-09-21T07:27:20.391724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.956819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566427+0000","last_change":"2024-09-21T07:27:19.378185+0000","last_active":"2024-09-21T07:27:20.566427+0000","last_peered":"2024-09-21T07:27:20.566427+0000","last_clean":"2024-09-21T07:27:20.566427+0000","last_became_active":"2024-09-21T07:27:19.377844+0000","last_became_peered":"2024-09-21T07:27:19.377844+0000","last_unstale":"2024-09-21T07:27:20.566427+0000","last_undegraded":"2024-09-21T07:27:20.566427+0000","last_fullsized":"2024-09-21T07:27:20.566427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:05.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382810+0000","last_change":"2024-09-21T07:27:19.389001+0000","last_active":"2024-09-21T07:27:20.382810+0000","last_peered":"2024-09-21T07:27:20.382810+0000","last_clean":"2024-09-21T07:27:20.382810+0000","last_became_active":"2024-09-21T07:27:19.387873+0000","last_became_peered":"2024-09-21T07:27:19.387873+0000","last_unstale":"2024-09-21T07:27:20.382810+0000","last_undegraded":"2024-09-21T07:27:20.382810+0000","last_fullsized":"2024-09-21T07:27:20.382810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:45.636027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394609+0000","last_change":"2024-09-21T07:27:19.393272+0000","last_active":"2024-09-21T07:27:20.394609+0000","last_peered":"2024-09-21T07:27:20.394609+0000","last_clean":"2024-09-21T07:27:20.394609+0000","last_became_active":"2024-09-21T07:27:19.392913+0000","last_became_peered":"2024-09-21T07:27:19.392913+0000","last_unstale":"2024-09-21T07:27:20.394609+0000","last_undegraded":"2024-09-21T07:27:20.394609+0000","last_fullsized":"2024-09-21T07:27:20.394609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:42.494640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391323+0000","last_change":"2024-09-21T07:27:19.370919+0000","last_active":"2024-09-21T07:27:20.391323+0000","last_peered":"2024-09-21T07:27:20.391323+0000","last_clean":"2024-09-21T07:27:20.391323+0000","last_became_active":"2024-09-21T07:27:19.370611+0000","last_became_peered":"2024-09-21T07:27:19.370611+0000","last_unstale":"2024-09-21T07:27:20.391323+0000","last_undegraded":"2024-09-21T07:27:20.391323+0000","last_fullsized":"2024-09-21T07:27:20.391323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:37.859844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382619+0000","last_change":"2024-09-21T07:27:19.390286+0000","last_active":"2024-09-21T07:27:20.382619+0000","last_peered":"2024-09-21T07:27:20.382619+0000","last_clean":"2024-09-21T07:27:20.382619+0000","last_became_active":"2024-09-21T07:27:19.389977+0000","last_became_peered":"2024-09-21T07:27:19.389977+0000","last_unstale":"2024-09-21T07:27:20.382619+0000","last_undegraded":"2024-09-21T07:27:20.382619+0000","last_fullsized":"2024-09-21T07:27:20.382619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.218406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565441+0000","last_change":"2024-09-21T07:27:19.370543+0000","last_active":"2024-09-21T07:27:20.565441+0000","last_peered":"2024-09-21T07:27:20.565441+0000","last_clean":"2024-09-21T07:27:20.565441+0000","last_became_active":"2024-09-21T07:27:19.370131+0000","last_became_peered":"2024-09-21T07:27:19.370131+0000","last_unstale":"2024-09-21T07:27:20.565441+0000","last_undegraded":"2024-09-21T07:27:20.565441+0000","last_fullsized":"2024-09-21T07:27:20.565441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.913726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382847+0000","last_change":"2024-09-21T07:27:19.392744+0000","last_active":"2024-09-21T07:27:20.382847+0000","last_peered":"2024-09-21T07:27:20.382847+0000","last_clean":"2024-09-21T07:27:20.382847+0000","last_became_active":"2024-09-21T07:27:19.392355+0000","last_became_peered":"2024-09-21T07:27:19.392355+0000","last_unstale":"2024-09-21T07:27:20.382847+0000","last_undegraded":"2024-09-21T07:27:20.382847+0000","last_fullsized":"2024-09-21T07:27:20.382847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:28.470687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565257+0000","last_change":"2024-09-21T07:27:19.382952+0000","last_active":"2024-09-21T07:27:20.565257+0000","last_peered":"2024-09-21T07:27:20.565257+0000","last_clean":"2024-09-21T07:27:20.565257+0000","last_became_active":"2024-09-21T07:27:19.382641+0000","last_became_peered":"2024-09-21T07:27:19.382641+0000","last_unstale":"2024-09-21T07:27:20.565257+0000","last_undegraded":"2024-09-21T07:27:20.565257+0000","last_fullsized":"2024-09-21T07:27:20.565257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:17.926236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394742+0000","last_change":"2024-09-21T07:27:18.382986+0000","last_active":"2024-09-21T07:27:20.394742+0000","last_peered":"2024-09-21T07:27:20.394742+0000","last_clean":"2024-09-21T07:27:20.394742+0000","last_became_active":"2024-09-21T07:27:18.381601+0000","last_became_peered":"2024-09-21T07:27:18.381601+0000","last_unstale":"2024-09-21T07:27:20.394742+0000","last_undegraded":"2024-09-21T07:27:20.394742+0000","last_fullsized":"2024-09-21T07:27:20.394742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:27.288014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391071+0000","last_change":"2024-09-21T07:27:19.382407+0000","last_active":"2024-09-21T07:27:20.391071+0000","last_peered":"2024-09-21T07:27:20.391071+0000","last_clean":"2024-09-21T07:27:20.391071+0000","last_became_active":"2024-09-21T07:27:19.379059+0000","last_became_peered":"2024-09-21T07:27:19.379059+0000","last_unstale":"2024-09-21T07:27:20.391071+0000","last_undegraded":"2024-09-21T07:27:20.391071+0000","last_fullsized":"2024-09-21T07:27:20.391071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:11.550463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383568+0000","last_change":"2024-09-21T07:27:18.391135+0000","last_active":"2024-09-21T07:27:20.383568+0000","last_peered":"2024-09-21T07:27:20.383568+0000","last_clean":"2024-09-21T07:27:20.383568+0000","last_became_active":"2024-09-21T07:27:18.389784+0000","last_became_peered":"2024-09-21T07:27:18.389784+0000","last_unstale":"2024-09-21T07:27:20.383568+0000","last_undegraded":"2024-09-21T07:27:20.383568+0000","last_fullsized":"2024-09-21T07:27:20.383568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.825175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383532+0000","last_change":"2024-09-21T07:27:19.390650+0000","last_active":"2024-09-21T07:27:20.383532+0000","last_peered":"2024-09-21T07:27:20.383532+0000","last_clean":"2024-09-21T07:27:20.383532+0000","last_became_active":"2024-09-21T07:27:19.389534+0000","last_became_peered":"2024-09-21T07:27:19.389534+0000","last_unstale":"2024-09-21T07:27:20.383532+0000","last_undegraded":"2024-09-21T07:27:20.383532+0000","last_fullsized":"2024-09-21T07:27:20.383532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:53.439416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382945+0000","last_change":"2024-09-21T07:27:18.390327+0000","last_active":"2024-09-21T07:27:20.382945+0000","last_peered":"2024-09-21T07:27:20.382945+0000","last_clean":"2024-09-21T07:27:20.382945+0000","last_became_active":"2024-09-21T07:27:18.390011+0000","last_became_peered":"2024-09-21T07:27:18.390011+0000","last_unstale":"2024-09-21T07:27:20.382945+0000","last_undegraded":"2024-09-21T07:27:20.382945+0000","last_fullsized":"2024-09-21T07:27:20.382945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:00.298851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384330+0000","last_change":"2024-09-21T07:27:19.388267+0000","last_active":"2024-09-21T07:27:20.384330+0000","last_peered":"2024-09-21T07:27:20.384330+0000","last_clean":"2024-09-21T07:27:20.384330+0000","last_became_active":"2024-09-21T07:27:19.385460+0000","last_became_peered":"2024-09-21T07:27:19.385460+0000","last_unstale":"2024-09-21T07:27:20.384330+0000","last_undegraded":"2024-09-21T07:27:20.384330+0000","last_fullsized":"2024-09-21T07:27:20.384330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:51.045016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567374+0000","last_change":"2024-09-21T07:27:18.384117+0000","last_active":"2024-09-21T07:27:20.567374+0000","last_peered":"2024-09-21T07:27:20.567374+0000","last_clean":"2024-09-21T07:27:20.567374+0000","last_became_active":"2024-09-21T07:27:18.383504+0000","last_became_peered":"2024-09-21T07:27:18.383504+0000","last_unstale":"2024-09-21T07:27:20.567374+0000","last_undegraded":"2024-09-21T07:27:20.567374+0000","last_fullsized":"2024-09-21T07:27:20.567374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:38.308746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391280+0000","last_change":"2024-09-21T07:27:19.389671+0000","last_active":"2024-09-21T07:27:20.391280+0000","last_peered":"2024-09-21T07:27:20.391280+0000","last_clean":"2024-09-21T07:27:20.391280+0000","last_became_active":"2024-09-21T07:27:19.389305+0000","last_became_peered":"2024-09-21T07:27:19.389305+0000","last_unstale":"2024-09-21T07:27:20.391280+0000","last_undegraded":"2024-09-21T07:27:20.391280+0000","last_fullsized":"2024-09-21T07:27:20.391280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:16.152509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.384258+0000","last_change":"2024-09-21T07:27:18.382963+0000","last_active":"2024-09-21T07:27:20.384258+0000","last_peered":"2024-09-21T07:27:20.384258+0000","last_clean":"2024-09-21T07:27:20.384258+0000","last_became_active":"2024-09-21T07:27:18.382614+0000","last_became_peered":"2024-09-21T07:27:18.382614+0000","last_unstale":"2024-09-21T07:27:20.384258+0000","last_undegraded":"2024-09-21T07:27:20.384258+0000","last_fullsized":"2024-09-21T07:27:20.384258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:51.306626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391663+0000","last_change":"2024-09-21T07:27:19.393637+0000","last_active":"2024-09-21T07:27:20.391663+0000","last_peered":"2024-09-21T07:27:20.391663+0000","last_clean":"2024-09-21T07:27:20.391663+0000","last_became_active":"2024-09-21T07:27:19.393346+0000","last_became_peered":"2024-09-21T07:27:19.393346+0000","last_unstale":"2024-09-21T07:27:20.391663+0000","last_undegraded":"2024-09-21T07:27:20.391663+0000","last_fullsized":"2024-09-21T07:27:20.391663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:58.683482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566012+0000","last_change":"2024-09-21T07:27:18.391871+0000","last_active":"2024-09-21T07:27:20.566012+0000","last_peered":"2024-09-21T07:27:20.566012+0000","last_clean":"2024-09-21T07:27:20.566012+0000","last_became_active":"2024-09-21T07:27:18.391353+0000","last_became_peered":"2024-09-21T07:27:18.391353+0000","last_unstale":"2024-09-21T07:27:20.566012+0000","last_undegraded":"2024-09-21T07:27:20.566012+0000","last_fullsized":"2024-09-21T07:27:20.566012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:18.794915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383629+0000","last_change":"2024-09-21T07:27:19.388472+0000","last_active":"2024-09-21T07:27:20.383629+0000","last_peered":"2024-09-21T07:27:20.383629+0000","last_clean":"2024-09-21T07:27:20.383629+0000","last_became_active":"2024-09-21T07:27:19.388146+0000","last_became_peered":"2024-09-21T07:27:19.388146+0000","last_unstale":"2024-09-21T07:27:20.383629+0000","last_undegraded":"2024-09-21T07:27:20.383629+0000","last_fullsized":"2024-09-21T07:27:20.383629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:12.889552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391087+0000","last_change":"2024-09-21T07:27:18.384754+0000","last_active":"2024-09-21T07:27:20.391087+0000","last_peered":"2024-09-21T07:27:20.391087+0000","last_clean":"2024-09-21T07:27:20.391087+0000","last_became_active":"2024-09-21T07:27:18.384459+0000","last_became_peered":"2024-09-21T07:27:18.384459+0000","last_unstale":"2024-09-21T07:27:20.391087+0000","last_undegraded":"2024-09-21T07:27:20.391087+0000","last_fullsized":"2024-09-21T07:27:20.391087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:23.205121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567623+0000","last_change":"2024-09-21T07:27:19.392456+0000","last_active":"2024-09-21T07:27:20.567623+0000","last_peered":"2024-09-21T07:27:20.567623+0000","last_clean":"2024-09-21T07:27:20.567623+0000","last_became_active":"2024-09-21T07:27:19.392126+0000","last_became_peered":"2024-09-21T07:27:19.392126+0000","last_unstale":"2024-09-21T07:27:20.567623+0000","last_undegraded":"2024-09-21T07:27:20.567623+0000","last_fullsized":"2024-09-21T07:27:20.567623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:25.259592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.393893+0000","last_change":"2024-09-21T07:27:18.376002+0000","last_active":"2024-09-21T07:27:20.393893+0000","last_peered":"2024-09-21T07:27:20.393893+0000","last_clean":"2024-09-21T07:27:20.393893+0000","last_became_active":"2024-09-21T07:27:18.374990+0000","last_became_peered":"2024-09-21T07:27:18.374990+0000","last_unstale":"2024-09-21T07:27:20.393893+0000","last_undegraded":"2024-09-21T07:27:20.393893+0000","last_fullsized":"2024-09-21T07:27:20.393893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:06.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391053+0000","last_change":"2024-09-21T07:27:19.382638+0000","last_active":"2024-09-21T07:27:20.391053+0000","last_peered":"2024-09-21T07:27:20.391053+0000","last_clean":"2024-09-21T07:27:20.391053+0000","last_became_active":"2024-09-21T07:27:19.378872+0000","last_became_peered":"2024-09-21T07:27:19.378872+0000","last_unstale":"2024-09-21T07:27:20.391053+0000","last_undegraded":"2024-09-21T07:27:20.391053+0000","last_fullsized":"2024-09-21T07:27:20.391053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:10.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383795+0000","last_change":"2024-09-21T07:27:18.388949+0000","last_active":"2024-09-21T07:27:20.383795+0000","last_peered":"2024-09-21T07:27:20.383795+0000","last_clean":"2024-09-21T07:27:20.383795+0000","last_became_active":"2024-09-21T07:27:18.388248+0000","last_became_peered":"2024-09-21T07:27:18.388248+0000","last_unstale":"2024-09-21T07:27:20.383795+0000","last_undegraded":"2024-09-21T07:27:20.383795+0000","last_fullsized":"2024-09-21T07:27:20.383795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:26.750741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566550+0000","last_change":"2024-09-21T07:27:19.384711+0000","last_active":"2024-09-21T07:27:20.566550+0000","last_peered":"2024-09-21T07:27:20.566550+0000","last_clean":"2024-09-21T07:27:20.566550+0000","last_became_active":"2024-09-21T07:27:19.384384+0000","last_became_peered":"2024-09-21T07:27:19.384384+0000","last_unstale":"2024-09-21T07:27:20.566550+0000","last_undegraded":"2024-09-21T07:27:20.566550+0000","last_fullsized":"2024-09-21T07:27:20.566550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:40.778682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566547+0000","last_change":"2024-09-21T07:27:18.383361+0000","last_active":"2024-09-21T07:27:20.566547+0000","last_peered":"2024-09-21T07:27:20.566547+0000","last_clean":"2024-09-21T07:27:20.566547+0000","last_became_active":"2024-09-21T07:27:18.382808+0000","last_became_peered":"2024-09-21T07:27:18.382808+0000","last_unstale":"2024-09-21T07:27:20.566547+0000","last_undegraded":"2024-09-21T07:27:20.566547+0000","last_fullsized":"2024-09-21T07:27:20.566547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:23.205121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379416+0000","last_change":"2024-09-21T07:27:19.385385+0000","last_active":"2024-09-21T07:27:20.379416+0000","last_peered":"2024-09-21T07:27:20.379416+0000","last_clean":"2024-09-21T07:27:20.379416+0000","last_became_active":"2024-09-21T07:27:19.385072+0000","last_became_peered":"2024-09-21T07:27:19.385072+0000","last_unstale":"2024-09-21T07:27:20.379416+0000","last_undegraded":"2024-09-21T07:27:20.379416+0000","last_fullsized":"2024-09-21T07:27:20.379416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:04.556517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394688+0000","last_change":"2024-09-21T07:27:18.386710+0000","last_active":"2024-09-21T07:27:20.394688+0000","last_peered":"2024-09-21T07:27:20.394688+0000","last_clean":"2024-09-21T07:27:20.394688+0000","last_became_active":"2024-09-21T07:27:18.385401+0000","last_became_peered":"2024-09-21T07:27:18.385401+0000","last_unstale":"2024-09-21T07:27:20.394688+0000","last_undegraded":"2024-09-21T07:27:20.394688+0000","last_fullsized":"2024-09-21T07:27:20.394688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:30.463667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565235+0000","last_change":"2024-09-21T07:27:19.370914+0000","last_active":"2024-09-21T07:27:20.565235+0000","last_peered":"2024-09-21T07:27:20.565235+0000","last_clean":"2024-09-21T07:27:20.565235+0000","last_became_active":"2024-09-21T07:27:19.370604+0000","last_became_peered":"2024-09-21T07:27:19.370604+0000","last_unstale":"2024-09-21T07:27:20.565235+0000","last_undegraded":"2024-09-21T07:27:20.565235+0000","last_fullsized":"2024-09-21T07:27:20.565235+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:01.992285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"82'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567475+0000","last_change":"2024-09-21T07:27:18.383976+0000","last_active":"2024-09-21T07:27:20.567475+0000","last_peered":"2024-09-21T07:27:20.567475+0000","last_clean":"2024-09-21T07:27:20.567475+0000","last_became_active":"2024-09-21T07:27:18.383511+0000","last_became_peered":"2024-09-21T07:27:18.383511+0000","last_unstale":"2024-09-21T07:27:20.567475+0000","last_undegraded":"2024-09-21T07:27:20.567475+0000","last_fullsized":"2024-09-21T07:27:20.567475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:52.434881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567049+0000","last_change":"2024-09-21T07:27:19.380337+0000","last_active":"2024-09-21T07:27:20.567049+0000","last_peered":"2024-09-21T07:27:20.567049+0000","last_clean":"2024-09-21T07:27:20.567049+0000","last_became_active":"2024-09-21T07:27:19.379961+0000","last_became_peered":"2024-09-21T07:27:19.379961+0000","last_unstale":"2024-09-21T07:27:20.567049+0000","last_undegraded":"2024-09-21T07:27:20.567049+0000","last_fullsized":"2024-09-21T07:27:20.567049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:55.704460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566033+0000","last_change":"2024-09-21T07:27:18.375772+0000","last_active":"2024-09-21T07:27:20.566033+0000","last_peered":"2024-09-21T07:27:20.566033+0000","last_clean":"2024-09-21T07:27:20.566033+0000","last_became_active":"2024-09-21T07:27:18.375274+0000","last_became_peered":"2024-09-21T07:27:18.375274+0000","last_unstale":"2024-09-21T07:27:20.566033+0000","last_undegraded":"2024-09-21T07:27:20.566033+0000","last_fullsized":"2024-09-21T07:27:20.566033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:36.948705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567304+0000","last_change":"2024-09-21T07:27:19.372188+0000","last_active":"2024-09-21T07:27:20.567304+0000","last_peered":"2024-09-21T07:27:20.567304+0000","last_clean":"2024-09-21T07:27:20.567304+0000","last_became_active":"2024-09-21T07:27:19.371875+0000","last_became_peered":"2024-09-21T07:27:19.371875+0000","last_unstale":"2024-09-21T07:27:20.567304+0000","last_undegraded":"2024-09-21T07:27:20.567304+0000","last_fullsized":"2024-09-21T07:27:20.567304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:53.110714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382483+0000","last_change":"2024-09-21T07:27:18.389427+0000","last_active":"2024-09-21T07:27:20.382483+0000","last_peered":"2024-09-21T07:27:20.382483+0000","last_clean":"2024-09-21T07:27:20.382483+0000","last_became_active":"2024-09-21T07:27:18.389047+0000","last_became_peered":"2024-09-21T07:27:18.389047+0000","last_unstale":"2024-09-21T07:27:20.382483+0000","last_undegraded":"2024-09-21T07:27:20.382483+0000","last_fullsized":"2024-09-21T07:27:20.382483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:45.109621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567617+0000","last_change":"2024-09-21T07:27:19.386750+0000","last_active":"2024-09-21T07:27:20.567617+0000","last_peered":"2024-09-21T07:27:20.567617+0000","last_clean":"2024-09-21T07:27:20.567617+0000","last_became_active":"2024-09-21T07:27:19.386429+0000","last_became_peered":"2024-09-21T07:27:19.386429+0000","last_unstale":"2024-09-21T07:27:20.567617+0000","last_undegraded":"2024-09-21T07:27:20.567617+0000","last_fullsized":"2024-09-21T07:27:20.567617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:43.976159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.393931+0000","last_change":"2024-09-21T07:27:18.382072+0000","last_active":"2024-09-21T07:27:20.393931+0000","last_peered":"2024-09-21T07:27:20.393931+0000","last_clean":"2024-09-21T07:27:20.393931+0000","last_became_active":"2024-09-21T07:27:18.381517+0000","last_became_peered":"2024-09-21T07:27:18.381517+0000","last_unstale":"2024-09-21T07:27:20.393931+0000","last_undegraded":"2024-09-21T07:27:20.393931+0000","last_fullsized":"2024-09-21T07:27:20.393931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:29.772612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567632+0000","last_change":"2024-09-21T07:27:19.376133+0000","last_active":"2024-09-21T07:27:20.567632+0000","last_peered":"2024-09-21T07:27:20.567632+0000","last_clean":"2024-09-21T07:27:20.567632+0000","last_became_active":"2024-09-21T07:27:19.375829+0000","last_became_peered":"2024-09-21T07:27:19.375829+0000","last_unstale":"2024-09-21T07:27:20.567632+0000","last_undegraded":"2024-09-21T07:27:20.567632+0000","last_fullsized":"2024-09-21T07:27:20.567632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:18.072131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"82'8","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391134+0000","last_change":"2024-09-21T07:27:18.385219+0000","last_active":"2024-09-21T07:27:20.391134+0000","last_peered":"2024-09-21T07:27:20.391134+0000","last_clean":"2024-09-21T07:27:20.391134+0000","last_became_active":"2024-09-21T07:27:18.380075+0000","last_became_peered":"2024-09-21T07:27:18.380075+0000","last_unstale":"2024-09-21T07:27:20.391134+0000","last_undegraded":"2024-09-21T07:27:20.391134+0000","last_fullsized":"2024-09-21T07:27:20.391134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:53.880971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378875+0000","last_change":"2024-09-21T07:27:19.393448+0000","last_active":"2024-09-21T07:27:20.378875+0000","last_peered":"2024-09-21T07:27:20.378875+0000","last_clean":"2024-09-21T07:27:20.378875+0000","last_became_active":"2024-09-21T07:27:19.393168+0000","last_became_peered":"2024-09-21T07:27:19.393168+0000","last_unstale":"2024-09-21T07:27:20.378875+0000","last_undegraded":"2024-09-21T07:27:20.378875+0000","last_fullsized":"2024-09-21T07:27:20.378875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:28.470687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383876+0000","last_change":"2024-09-21T07:27:18.387286+0000","last_active":"2024-09-21T07:27:20.383876+0000","last_peered":"2024-09-21T07:27:20.383876+0000","last_clean":"2024-09-21T07:27:20.383876+0000","last_became_active":"2024-09-21T07:27:18.386941+0000","last_became_peered":"2024-09-21T07:27:18.386941+0000","last_unstale":"2024-09-21T07:27:20.383876+0000","last_undegraded":"2024-09-21T07:27:20.383876+0000","last_fullsized":"2024-09-21T07:27:20.383876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394061+0000","last_change":"2024-09-21T07:27:19.395400+0000","last_active":"2024-09-21T07:27:20.394061+0000","last_peered":"2024-09-21T07:27:20.394061+0000","last_clean":"2024-09-21T07:27:20.394061+0000","last_became_active":"2024-09-21T07:27:19.395109+0000","last_became_peered":"2024-09-21T07:27:19.395109+0000","last_unstale":"2024-09-21T07:27:20.394061+0000","last_undegraded":"2024-09-21T07:27:20.394061+0000","last_fullsized":"2024-09-21T07:27:20.394061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:50.461116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383594+0000","last_change":"2024-09-21T07:27:18.386413+0000","last_active":"2024-09-21T07:27:20.383594+0000","last_peered":"2024-09-21T07:27:20.383594+0000","last_clean":"2024-09-21T07:27:20.383594+0000","last_became_active":"2024-09-21T07:27:18.386066+0000","last_became_peered":"2024-09-21T07:27:18.386066+0000","last_unstale":"2024-09-21T07:27:20.383594+0000","last_undegraded":"2024-09-21T07:27:20.383594+0000","last_fullsized":"2024-09-21T07:27:20.383594+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:54.696741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394081+0000","last_change":"2024-09-21T07:27:19.390160+0000","last_active":"2024-09-21T07:27:20.394081+0000","last_peered":"2024-09-21T07:27:20.394081+0000","last_clean":"2024-09-21T07:27:20.394081+0000","last_became_active":"2024-09-21T07:27:19.389795+0000","last_became_peered":"2024-09-21T07:27:19.389795+0000","last_unstale":"2024-09-21T07:27:20.394081+0000","last_undegraded":"2024-09-21T07:27:20.394081+0000","last_fullsized":"2024-09-21T07:27:20.394081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:59.006793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394685+0000","last_change":"2024-09-21T07:27:18.380186+0000","last_active":"2024-09-21T07:27:20.394685+0000","last_peered":"2024-09-21T07:27:20.394685+0000","last_clean":"2024-09-21T07:27:20.394685+0000","last_became_active":"2024-09-21T07:27:18.379862+0000","last_became_peered":"2024-09-21T07:27:18.379862+0000","last_unstale":"2024-09-21T07:27:20.394685+0000","last_undegraded":"2024-09-21T07:27:20.394685+0000","last_fullsized":"2024-09-21T07:27:20.394685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:28.473767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379287+0000","last_change":"2024-09-21T07:27:19.400106+0000","last_active":"2024-09-21T07:27:20.379287+0000","last_peered":"2024-09-21T07:27:20.379287+0000","last_clean":"2024-09-21T07:27:20.379287+0000","last_became_active":"2024-09-21T07:27:19.399789+0000","last_became_peered":"2024-09-21T07:27:19.399789+0000","last_unstale":"2024-09-21T07:27:20.379287+0000","last_undegraded":"2024-09-21T07:27:20.379287+0000","last_fullsized":"2024-09-21T07:27:20.379287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:12.218650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565171+0000","last_change":"2024-09-21T07:27:18.380438+0000","last_active":"2024-09-21T07:27:20.565171+0000","last_peered":"2024-09-21T07:27:20.565171+0000","last_clean":"2024-09-21T07:27:20.565171+0000","last_became_active":"2024-09-21T07:27:18.380128+0000","last_became_peered":"2024-09-21T07:27:18.380128+0000","last_unstale":"2024-09-21T07:27:20.565171+0000","last_undegraded":"2024-09-21T07:27:20.565171+0000","last_fullsized":"2024-09-21T07:27:20.565171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:36.408859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391576+0000","last_change":"2024-09-21T07:27:19.381813+0000","last_active":"2024-09-21T07:27:20.391576+0000","last_peered":"2024-09-21T07:27:20.391576+0000","last_clean":"2024-09-21T07:27:20.391576+0000","last_became_active":"2024-09-21T07:27:19.381455+0000","last_became_peered":"2024-09-21T07:27:19.381455+0000","last_unstale":"2024-09-21T07:27:20.391576+0000","last_undegraded":"2024-09-21T07:27:20.391576+0000","last_fullsized":"2024-09-21T07:27:20.391576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:17.659403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379243+0000","last_change":"2024-09-21T07:27:18.390963+0000","last_active":"2024-09-21T07:27:20.379243+0000","last_peered":"2024-09-21T07:27:20.379243+0000","last_clean":"2024-09-21T07:27:20.379243+0000","last_became_active":"2024-09-21T07:27:18.390261+0000","last_became_peered":"2024-09-21T07:27:18.390261+0000","last_unstale":"2024-09-21T07:27:20.379243+0000","last_undegraded":"2024-09-21T07:27:20.379243+0000","last_fullsized":"2024-09-21T07:27:20.379243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:19.124025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391787+0000","last_change":"2024-09-21T07:27:19.382811+0000","last_active":"2024-09-21T07:27:20.391787+0000","last_peered":"2024-09-21T07:27:20.391787+0000","last_clean":"2024-09-21T07:27:20.391787+0000","last_became_active":"2024-09-21T07:27:19.382503+0000","last_became_peered":"2024-09-21T07:27:19.382503+0000","last_unstale":"2024-09-21T07:27:20.391787+0000","last_undegraded":"2024-09-21T07:27:20.391787+0000","last_fullsized":"2024-09-21T07:27:20.391787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:28.307382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378904+0000","last_change":"2024-09-21T07:27:18.384632+0000","last_active":"2024-09-21T07:27:20.378904+0000","last_peered":"2024-09-21T07:27:20.378904+0000","last_clean":"2024-09-21T07:27:20.378904+0000","last_became_active":"2024-09-21T07:27:18.379316+0000","last_became_peered":"2024-09-21T07:27:18.379316+0000","last_unstale":"2024-09-21T07:27:20.378904+0000","last_undegraded":"2024-09-21T07:27:20.378904+0000","last_fullsized":"2024-09-21T07:27:20.378904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567865+0000","last_change":"2024-09-21T07:27:19.382596+0000","last_active":"2024-09-21T07:27:20.567865+0000","last_peered":"2024-09-21T07:27:20.567865+0000","last_clean":"2024-09-21T07:27:20.567865+0000","last_became_active":"2024-09-21T07:27:19.382317+0000","last_became_peered":"2024-09-21T07:27:19.382317+0000","last_unstale":"2024-09-21T07:27:20.567865+0000","last_undegraded":"2024-09-21T07:27:20.567865+0000","last_fullsized":"2024-09-21T07:27:20.567865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:27.487026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.378970+0000","last_change":"2024-09-21T07:27:18.380043+0000","last_active":"2024-09-21T07:27:20.378970+0000","last_peered":"2024-09-21T07:27:20.378970+0000","last_clean":"2024-09-21T07:27:20.378970+0000","last_became_active":"2024-09-21T07:27:18.379631+0000","last_became_peered":"2024-09-21T07:27:18.379631+0000","last_unstale":"2024-09-21T07:27:20.378970+0000","last_undegraded":"2024-09-21T07:27:20.378970+0000","last_fullsized":"2024-09-21T07:27:20.378970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:26.750741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383043+0000","last_change":"2024-09-21T07:27:19.385172+0000","last_active":"2024-09-21T07:27:20.383043+0000","last_peered":"2024-09-21T07:27:20.383043+0000","last_clean":"2024-09-21T07:27:20.383043+0000","last_became_active":"2024-09-21T07:27:19.384675+0000","last_became_peered":"2024-09-21T07:27:19.384675+0000","last_unstale":"2024-09-21T07:27:20.383043+0000","last_undegraded":"2024-09-21T07:27:20.383043+0000","last_fullsized":"2024-09-21T07:27:20.383043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:51.604536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566402+0000","last_change":"2024-09-21T07:27:18.381412+0000","last_active":"2024-09-21T07:27:20.566402+0000","last_peered":"2024-09-21T07:27:20.566402+0000","last_clean":"2024-09-21T07:27:20.566402+0000","last_became_active":"2024-09-21T07:27:18.381087+0000","last_became_peered":"2024-09-21T07:27:18.381087+0000","last_unstale":"2024-09-21T07:27:20.566402+0000","last_undegraded":"2024-09-21T07:27:20.566402+0000","last_fullsized":"2024-09-21T07:27:20.566402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:53.880971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.566946+0000","last_change":"2024-09-21T07:27:19.377620+0000","last_active":"2024-09-21T07:27:20.566946+0000","last_peered":"2024-09-21T07:27:20.566946+0000","last_clean":"2024-09-21T07:27:20.566946+0000","last_became_active":"2024-09-21T07:27:19.377298+0000","last_became_peered":"2024-09-21T07:27:19.377298+0000","last_unstale":"2024-09-21T07:27:20.566946+0000","last_undegraded":"2024-09-21T07:27:20.566946+0000","last_fullsized":"2024-09-21T07:27:20.566946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.957390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"83'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391836+0000","last_change":"2024-09-21T07:27:18.373261+0000","last_active":"2024-09-21T07:27:20.391836+0000","last_peered":"2024-09-21T07:27:20.391836+0000","last_clean":"2024-09-21T07:27:20.391836+0000","last_became_active":"2024-09-21T07:27:18.372936+0000","last_became_peered":"2024-09-21T07:27:18.372936+0000","last_unstale":"2024-09-21T07:27:20.391836+0000","last_undegraded":"2024-09-21T07:27:20.391836+0000","last_fullsized":"2024-09-21T07:27:20.391836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:21.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383788+0000","last_change":"2024-09-21T07:27:19.390325+0000","last_active":"2024-09-21T07:27:20.383788+0000","last_peered":"2024-09-21T07:27:20.383788+0000","last_clean":"2024-09-21T07:27:20.383788+0000","last_became_active":"2024-09-21T07:27:19.389125+0000","last_became_peered":"2024-09-21T07:27:19.389125+0000","last_unstale":"2024-09-21T07:27:20.383788+0000","last_undegraded":"2024-09-21T07:27:20.383788+0000","last_fullsized":"2024-09-21T07:27:20.383788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:58.583211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383279+0000","last_change":"2024-09-21T07:27:18.390422+0000","last_active":"2024-09-21T07:27:20.383279+0000","last_peered":"2024-09-21T07:27:20.383279+0000","last_clean":"2024-09-21T07:27:20.383279+0000","last_became_active":"2024-09-21T07:27:18.390069+0000","last_became_peered":"2024-09-21T07:27:18.390069+0000","last_unstale":"2024-09-21T07:27:20.383279+0000","last_undegraded":"2024-09-21T07:27:20.383279+0000","last_fullsized":"2024-09-21T07:27:20.383279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.556774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.391143+0000","last_change":"2024-09-21T07:27:19.381320+0000","last_active":"2024-09-21T07:27:20.391143+0000","last_peered":"2024-09-21T07:27:20.391143+0000","last_clean":"2024-09-21T07:27:20.391143+0000","last_became_active":"2024-09-21T07:27:19.380999+0000","last_became_peered":"2024-09-21T07:27:19.380999+0000","last_unstale":"2024-09-21T07:27:20.391143+0000","last_undegraded":"2024-09-21T07:27:20.391143+0000","last_fullsized":"2024-09-21T07:27:20.391143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:35.224754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382597+0000","last_change":"2024-09-21T07:27:18.388398+0000","last_active":"2024-09-21T07:27:20.382597+0000","last_peered":"2024-09-21T07:27:20.382597+0000","last_clean":"2024-09-21T07:27:20.382597+0000","last_became_active":"2024-09-21T07:27:18.388065+0000","last_became_peered":"2024-09-21T07:27:18.388065+0000","last_unstale":"2024-09-21T07:27:20.382597+0000","last_undegraded":"2024-09-21T07:27:20.382597+0000","last_fullsized":"2024-09-21T07:27:20.382597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:44.211392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567402+0000","last_change":"2024-09-21T07:27:19.379163+0000","last_active":"2024-09-21T07:27:20.567402+0000","last_peered":"2024-09-21T07:27:20.567402+0000","last_clean":"2024-09-21T07:27:20.567402+0000","last_became_active":"2024-09-21T07:27:19.377518+0000","last_became_peered":"2024-09-21T07:27:19.377518+0000","last_unstale":"2024-09-21T07:27:20.567402+0000","last_undegraded":"2024-09-21T07:27:20.567402+0000","last_fullsized":"2024-09-21T07:27:20.567402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:02.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567170+0000","last_change":"2024-09-21T07:27:18.388326+0000","last_active":"2024-09-21T07:27:20.567170+0000","last_peered":"2024-09-21T07:27:20.567170+0000","last_clean":"2024-09-21T07:27:20.567170+0000","last_became_active":"2024-09-21T07:27:18.387846+0000","last_became_peered":"2024-09-21T07:27:18.387846+0000","last_unstale":"2024-09-21T07:27:20.567170+0000","last_undegraded":"2024-09-21T07:27:20.567170+0000","last_fullsized":"2024-09-21T07:27:20.567170+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:50.600002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567371+0000","last_change":"2024-09-21T07:27:19.394683+0000","last_active":"2024-09-21T07:27:20.567371+0000","last_peered":"2024-09-21T07:27:20.567371+0000","last_clean":"2024-09-21T07:27:20.567371+0000","last_became_active":"2024-09-21T07:27:19.394097+0000","last_became_peered":"2024-09-21T07:27:19.394097+0000","last_unstale":"2024-09-21T07:27:20.567371+0000","last_undegraded":"2024-09-21T07:27:20.567371+0000","last_fullsized":"2024-09-21T07:27:20.567371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:44.629122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.394224+0000","last_change":"2024-09-21T07:27:18.383774+0000","last_active":"2024-09-21T07:27:20.394224+0000","last_peered":"2024-09-21T07:27:20.394224+0000","last_clean":"2024-09-21T07:27:20.394224+0000","last_became_active":"2024-09-21T07:27:18.383473+0000","last_became_peered":"2024-09-21T07:27:18.383473+0000","last_unstale":"2024-09-21T07:27:20.394224+0000","last_undegraded":"2024-09-21T07:27:20.394224+0000","last_fullsized":"2024-09-21T07:27:20.394224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:29.243954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565774+0000","last_change":"2024-09-21T07:27:19.372784+0000","last_active":"2024-09-21T07:27:20.565774+0000","last_peered":"2024-09-21T07:27:20.565774+0000","last_clean":"2024-09-21T07:27:20.565774+0000","last_became_active":"2024-09-21T07:27:19.372462+0000","last_became_peered":"2024-09-21T07:27:19.372462+0000","last_unstale":"2024-09-21T07:27:20.565774+0000","last_undegraded":"2024-09-21T07:27:20.565774+0000","last_fullsized":"2024-09-21T07:27:20.565774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:51.016774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.567049+0000","last_change":"2024-09-21T07:27:18.384797+0000","last_active":"2024-09-21T07:27:20.567049+0000","last_peered":"2024-09-21T07:27:20.567049+0000","last_clean":"2024-09-21T07:27:20.567049+0000","last_became_active":"2024-09-21T07:27:18.383740+0000","last_became_peered":"2024-09-21T07:27:18.383740+0000","last_unstale":"2024-09-21T07:27:20.567049+0000","last_undegraded":"2024-09-21T07:27:20.567049+0000","last_fullsized":"2024-09-21T07:27:20.567049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:31.223179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.565740+0000","last_change":"2024-09-21T07:27:19.383346+0000","last_active":"2024-09-21T07:27:20.565740+0000","last_peered":"2024-09-21T07:27:20.565740+0000","last_clean":"2024-09-21T07:27:20.565740+0000","last_became_active":"2024-09-21T07:27:19.382991+0000","last_became_peered":"2024-09-21T07:27:19.382991+0000","last_unstale":"2024-09-21T07:27:20.565740+0000","last_undegraded":"2024-09-21T07:27:20.565740+0000","last_fullsized":"2024-09-21T07:27:20.565740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:23.746542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.564972+0000","last_change":"2024-09-21T07:27:18.382683+0000","last_active":"2024-09-21T07:27:20.564972+0000","last_peered":"2024-09-21T07:27:20.564972+0000","last_clean":"2024-09-21T07:27:20.564972+0000","last_became_active":"2024-09-21T07:27:18.382355+0000","last_became_peered":"2024-09-21T07:27:18.382355+0000","last_unstale":"2024-09-21T07:27:20.564972+0000","last_undegraded":"2024-09-21T07:27:20.564972+0000","last_fullsized":"2024-09-21T07:27:20.564972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:18.020611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.383157+0000","last_change":"2024-09-21T07:27:19.392959+0000","last_active":"2024-09-21T07:27:20.383157+0000","last_peered":"2024-09-21T07:27:20.383157+0000","last_clean":"2024-09-21T07:27:20.383157+0000","last_became_active":"2024-09-21T07:27:19.392611+0000","last_became_peered":"2024-09-21T07:27:19.392611+0000","last_unstale":"2024-09-21T07:27:20.383157+0000","last_undegraded":"2024-09-21T07:27:20.383157+0000","last_fullsized":"2024-09-21T07:27:20.383157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:18.349695+0000","last_clean_scrub_stamp":"2024-09-21T07:27:18.349695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:46.393448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.379446+0000","last_change":"2024-09-21T07:27:18.381694+0000","last_active":"2024-09-21T07:27:20.379446+0000","last_peered":"2024-09-21T07:27:20.379446+0000","last_clean":"2024-09-21T07:27:20.379446+0000","last_became_active":"2024-09-21T07:27:18.381307+0000","last_became_peered":"2024-09-21T07:27:18.381307+0000","last_unstale":"2024-09-21T07:27:20.379446+0000","last_undegraded":"2024-09-21T07:27:20.379446+0000","last_fullsized":"2024-09-21T07:27:20.379446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:27:17.345160+0000","last_clean_scrub_stamp":"2024-09-21T07:27:17.345160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:05.244237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:27:20.382930+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:27:20.382930+0000","last_peered":"2024-09-21T07:27:20.382930+0000","last_clean":"2024-09-21T07:27:20.382930+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:27:20.382930+0000","last_undegraded":"2024-09-21T07:27:20.382930+0000","last_fullsized":"2024-09-21T07:27:20.382930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1019904,"data_stored":465685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1011712,"data_stored":464107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1028096,"data_stored":465789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1019904,"data_stored":464815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1015808,"data_stored":464185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41076,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330764,"statfs":{"total":96636764160,"available":96594702336,"internally_reserved":0,"allocated":1601536,"data_stored":1054441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1605632,"data_stored":1054463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1011712,"data_stored":464655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:27:24.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:27:24.054 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- 172.21.15.64:0/4267504939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26180b2120 msgr2=0x7f26180aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 --2- 172.21.15.64:0/4267504939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26180b2120 0x7f26180aee90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2610009c80 tx=0x7f261001cd10 comp rx=0 tx=0).stop 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- 172.21.15.64:0/4267504939 shutdown_connections 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 --2- 172.21.15.64:0/4267504939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26180b2120 0x7f26180aee90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 --2- 172.21.15.64:0/4267504939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 0x7f26180b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- 172.21.15.64:0/4267504939 >> 172.21.15.64:0/4267504939 conn(0x7f26180ccbe0 msgr2=0x7f26180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- 172.21.15.64:0/4267504939 shutdown_connections 2024-09-21T07:27:24.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- 172.21.15.64:0/4267504939 wait complete. 2024-09-21T07:27:24.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 Processor -- start 2024-09-21T07:27:24.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.219+0000 7f261e200640 1 -- start start 2024-09-21T07:27:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26180b2120 0x7f2618155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 0x7f26180adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f261806f830 con 0x7f2618159db0 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f261806f6b0 con 0x7f26180b2120 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f261806f9b0 con 0x7f261815a1c0 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41692/0 (socket says 172.21.15.64:41692) 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f2617400640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26180b2120 0x7f2618155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 -- 172.21.15.64:0/718820232 learned_addr learned my addr 172.21.15.64:0/718820232 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f2617e00640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 0x7f26180adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 -- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 msgr2=0x7f26180adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 0x7f26180adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 -- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26180b2120 msgr2=0x7f2618155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26180b2120 0x7f2618155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 -- 172.21.15.64:0/718820232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26180c57e0 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260ea00640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f260000d720 tx=0x7f260000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600017070 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2600009d20 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26181f6850 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600005280 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26181f6df0 con 0x7f2618159db0 2024-09-21T07:27:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.223+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26181f7790 con 0x7f2618159db0 2024-09-21T07:27:24.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.227+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2600005420 con 0x7f2618159db0 2024-09-21T07:27:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.227+0000 7f260fe00640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 0x7f25f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.227+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f2600094440 con 0x7f2618159db0 2024-09-21T07:27:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.227+0000 7f2617400640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 0x7f25f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.227+0000 7f2617400640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 0x7f25f4075710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2608007fd0 tx=0x7f2608009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:24.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.231+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f26181f7790 con 0x7f2618159db0 2024-09-21T07:27:24.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.475+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f26180c3c10 con 0x7f2618159db0 2024-09-21T07:27:24.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.479+0000 7f260fe00640 1 -- 172.21.15.64:0/718820232 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f260005ed00 con 0x7f2618159db0 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:27:24.484 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:27:24.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 msgr2=0x7f25f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 0x7f25f4075710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2608007fd0 tx=0x7f2608009040 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 msgr2=0x7f26180c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f260000d720 tx=0x7f260000dbe0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 shutdown_connections 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f4073200 0x7f25f4075710 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f261815a1c0 0x7f26180adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2618159db0 0x7f26180c5a60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 --2- 172.21.15.64:0/718820232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26180b2120 0x7f2618155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 >> 172.21.15.64:0/718820232 conn(0x7f26180ccbe0 msgr2=0x7f26180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 shutdown_connections 2024-09-21T07:27:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.483+0000 7f261e200640 1 -- 172.21.15.64:0/718820232 wait complete. 2024-09-21T07:27:24.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:24.578 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:27:24.575+0000 7f9914c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 -- 172.21.15.64:0/751348893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c004be0 msgr2=0x7f3b7c005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 --2- 172.21.15.64:0/751348893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c004be0 0x7f3b7c005050 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c310 tx=0x7f3b8801cf20 comp rx=0 tx=0).stop 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 -- 172.21.15.64:0/751348893 shutdown_connections 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 --2- 172.21.15.64:0/751348893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c004be0 0x7f3b7c005050 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 -- 172.21.15.64:0/751348893 >> 172.21.15.64:0/751348893 conn(0x7f3b940cd5d0 msgr2=0x7f3b940cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 -- 172.21.15.64:0/751348893 shutdown_connections 2024-09-21T07:27:24.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.663+0000 7f3b9c000640 1 -- 172.21.15.64:0/751348893 wait complete. 2024-09-21T07:27:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 Processor -- start 2024-09-21T07:27:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 -- start start 2024-09-21T07:27:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7c004be0 0x7f3b941f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b941f6430 0x7f3b941f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9406b1f0 con 0x7f3b940aa110 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9406b070 con 0x7f3b7c004be0 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3b940cf170 con 0x7f3b941f6430 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.667+0000 7f3b9a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b99600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7c004be0 0x7f3b941f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41718/0 (socket says 172.21.15.64:41718) 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b98c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b941f6430 0x7f3b941f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 -- 172.21.15.64:0/2382269284 learned_addr learned my addr 172.21.15.64:0/2382269284 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 -- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b941f6430 msgr2=0x7f3b941f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b941f6430 0x7f3b941f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 -- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7c004be0 msgr2=0x7f3b941f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7c004be0 0x7f3b941f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 -- 172.21.15.64:0/2382269284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b941f7ce0 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9a000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3b940d0650 tx=0x7f3b8c010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c017070 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b8c015070 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b940aaa60 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c004d90 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941f8460 con 0x7f3b940aa110 2024-09-21T07:27:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b940cd170 con 0x7f3b940aa110 2024-09-21T07:27:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.671+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b8c003980 con 0x7f3b940aa110 2024-09-21T07:27:24.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.675+0000 7f3b91600640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 0x7f3b74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:24.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.675+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f3b8c094960 con 0x7f3b940aa110 2024-09-21T07:27:24.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.675+0000 7f3b99600640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 0x7f3b74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.675+0000 7f3b99600640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 0x7f3b74075710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b880ab000 tx=0x7f3b88019d60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:24.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.679+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3b940aaa60 con 0x7f3b940aa110 2024-09-21T07:27:24.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b940b6900 con 0x7f3b940aa110 2024-09-21T07:27:24.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b91600640 1 -- 172.21.15.64:0/2382269284 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7f3b941f7ce0 con 0x7f3b940aa110 2024-09-21T07:27:24.901 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:24.901 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":52,"btime":"2024-09-21T07:27:22:385997+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3476229811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3476229811},{"type":"v1","addr":"172.21.15.90:6837","nonce":3476229811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/565775790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":565775790},{"type":"v1","addr":"172.21.15.64:6835","nonce":565775790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2323125620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2323125620},{"type":"v1","addr":"172.21.15.90:6835","nonce":2323125620}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:21.806267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6804},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6804":{"gid":6804,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2439635016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2439635016},{"type":"v1","addr":"172.21.15.64:6834","nonce":2439635016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6804,"qdb_cluster":[6804]},"id":5}]} 2024-09-21T07:27:24.901 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 52 2024-09-21T07:27:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 msgr2=0x7f3b74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 0x7f3b74075710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b880ab000 tx=0x7f3b88019d60 comp rx=0 tx=0).stop 2024-09-21T07:27:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 msgr2=0x7f3b940aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3b940d0650 tx=0x7f3b8c010f20 comp rx=0 tx=0).stop 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 shutdown_connections 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073200 0x7f3b74075710 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940aa110 0x7f3b940aa520 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b941f6430 0x7f3b941f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2382269284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b7c004be0 0x7f3b941f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 >> 172.21.15.64:0/2382269284 conn(0x7f3b940cd5d0 msgr2=0x7f3b940b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 shutdown_connections 2024-09-21T07:27:24.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:24.899+0000 7f3b9c000640 1 -- 172.21.15.64:0/2382269284 wait complete. 2024-09-21T07:27:25.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:27:18.794425+0000', 'modified': '2024-09-21T07:27:21.806267+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6804}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6804': {'gid': 6804, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6834/2439635016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2439635016}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2439635016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6804, 'qdb_cluster': [6804]} 2024-09-21T07:27:25.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:27:25.326 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 -- 172.21.15.64:0/2269807631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34005360 msgr2=0x7feb3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 --2- 172.21.15.64:0/2269807631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34005360 0x7feb3400b9d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7feb50073640 tx=0x7feb4801d2a0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 -- 172.21.15.64:0/2269807631 shutdown_connections 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 --2- 172.21.15.64:0/2269807631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb34005360 0x7feb3400b9d0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 -- 172.21.15.64:0/2269807631 >> 172.21.15.64:0/2269807631 conn(0x7feb500ccfa0 msgr2=0x7feb500cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 -- 172.21.15.64:0/2269807631 shutdown_connections 2024-09-21T07:27:25.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.487+0000 7feb55a00640 1 -- 172.21.15.64:0/2269807631 wait complete. 2024-09-21T07:27:25.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 Processor -- start 2024-09-21T07:27:25.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- start start 2024-09-21T07:27:25.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb34005360 0x7feb500c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb500ae3c0 0x7feb500ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb50152670 con 0x7feb500ac4c0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb501524f0 con 0x7feb34005360 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feb501527f0 con 0x7feb500ae3c0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33954/0 (socket says 172.21.15.64:33954) 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb4ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb34005360 0x7feb500c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 -- 172.21.15.64:0/2310014073 learned_addr learned my addr 172.21.15.64:0/2310014073 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb4f400640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb500ae3c0 0x7feb500ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 -- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb500ae3c0 msgr2=0x7feb500ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb500ae3c0 0x7feb500ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 -- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb34005360 msgr2=0x7feb500c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb34005360 0x7feb500c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 -- 172.21.15.64:0/2310014073 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb500c9f60 con 0x7feb500ac4c0 2024-09-21T07:27:25.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb47e00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb38011a50 tx=0x7feb38011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb46a00640 1 -- 172.21.15.64:0/2310014073 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3801f070 con 0x7feb500ac4c0 2024-09-21T07:27:25.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb46a00640 1 -- 172.21.15.64:0/2310014073 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb38012450 con 0x7feb500ac4c0 2024-09-21T07:27:25.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb46a00640 1 -- 172.21.15.64:0/2310014073 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38012840 con 0x7feb500ac4c0 2024-09-21T07:27:25.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb500ace10 con 0x7feb500ac4c0 2024-09-21T07:27:25.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.491+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb500ca750 con 0x7feb500ac4c0 2024-09-21T07:27:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb46a00640 1 -- 172.21.15.64:0/2310014073 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feb38022070 con 0x7feb500ac4c0 2024-09-21T07:27:25.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb46a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 0x7feb2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb46a00640 1 -- 172.21.15.64:0/2310014073 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7feb38094ff0 con 0x7feb500ac4c0 2024-09-21T07:27:25.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb5cfb9000 1 Processor -- start 2024-09-21T07:27:25.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb4ea00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 0x7feb2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.495+0000 7feb5cfb9000 1 -- start start 2024-09-21T07:27:25.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb4ea00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 0x7feb2c075710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feb40006660 tx=0x7feb40003ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987772c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775c4ca0 0x55987772d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559877601410 con 0x5598775db950 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55987753eb40 con 0x5598771eb460 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55987752df70 con 0x5598775c4ca0 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33968/0 (socket says 172.21.15.64:33968) 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 -- 172.21.15.64:0/2117934759 learned_addr learned my addr 172.21.15.64:0/2117934759 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb4ea00640 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987772c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb4f400640 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775c4ca0 0x55987772d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 -- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775c4ca0 msgr2=0x55987772d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775c4ca0 0x55987772d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 -- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 msgr2=0x55987772c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987772c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 -- 172.21.15.64:0/2117934759 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598774f55b0 con 0x5598775db950 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb47e00640 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb3800f730 tx=0x7feb3805b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d020e643018b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb3f400640 1 -- 172.21.15.64:0/2117934759 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3805f7b0 con 0x5598775db950 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb3f400640 1 -- 172.21.15.64:0/2117934759 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb380641e0 con 0x5598775db950 2024-09-21T07:27:25.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb3f400640 1 -- 172.21.15.64:0/2117934759 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38068e90 con 0x5598775db950 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2117934759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 msgr2=0x55987772cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb3800f730 tx=0x7feb3805b780 comp rx=0 tx=0).stop 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2117934759 shutdown_connections 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775c4ca0 0x55987772d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775db950 0x55987772cbe0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2117934759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987772c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2117934759 >> 172.21.15.64:0/2117934759 conn(0x5598776b1d90 msgr2=0x5598776e1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2117934759 shutdown_connections 2024-09-21T07:27:25.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.499+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2117934759 wait complete. 2024-09-21T07:27:25.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- start start 2024-09-21T07:27:25.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 Processor -- start 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598775c4ca0 0x559877738240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877738780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5598774c85f0 con 0x5598771eb460 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559877531d80 con 0x5598775c4ca0 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5598774d4520 con 0x5598775db950 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 10 client.0 _ll_register_callbacks cb 0x5598774d8830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33984/0 (socket says 172.21.15.64:33984) 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 -- 172.21.15.64:0/1445294717 learned_addr learned my addr 172.21.15.64:0/1445294717 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb47e00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598775c4ca0 0x559877738240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4f400640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877738780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 -- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 msgr2=0x559877738780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877738780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 -- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598775c4ca0 msgr2=0x559877738240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598775c4ca0 0x559877738240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 -- 172.21.15.64:0/1445294717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598774cc190 con 0x5598771eb460 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb4ea00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feb40012a60 tx=0x7feb40001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f8e19bcb6516cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb33e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40022bd0 con 0x5598771eb460 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7feb40022d70 con 0x5598771eb460 2024-09-21T07:27:25.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598774c6110 con 0x5598771eb460 2024-09-21T07:27:25.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7feb40032050 con 0x5598771eb460 2024-09-21T07:27:25.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 10 client.6930 fetch_fsmap learned FSMap version 52 2024-09-21T07:27:25.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.503+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5598775b2f10 con 0x5598771eb460 2024-09-21T07:27:25.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5598774c6110 con 0x5598771eb460 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7feb40035020 con 0x5598771eb460 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 10 client.6930 fetch_fsmap finished waiting for FSMap version 52 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 10 client.6930 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 20 client.6930 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771d07d0 0x5598777420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 4 client.6930 mds_command: new command op to 6804 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 --> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559877540a90 con 0x5598771d07d0 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb47e00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771d07d0 0x5598777420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 10 client.6930 ms_handle_connect on v2:172.21.15.64:6832/2439635016 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb47e00640 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771d07d0 0x5598777420e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d65a7f4c47787c server_cookie=3d187e7231c9e691 in_seq=0 out_seq=0 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 1 -- 172.21.15.64:0/1445294717 <== mds.0 v2:172.21.15.64:6832/2439635016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559877540a90 con 0x5598771d07d0 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 10 client.6930 handle_command_reply: tid=0 2024-09-21T07:27:25.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 client.6930 shutdown 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 msgr2=0x559877737d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feb40012a60 tx=0x7feb40001280 comp rx=0 tx=0).stop 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 shutdown_connections 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771d07d0 0x5598777420e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877738780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598775c4ca0 0x559877738240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb33e00640 0 client.6930 ms_handle_reset on v2:172.21.15.64:6832/2439635016 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/1445294717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598771eb460 0x559877737d00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 >> 172.21.15.64:0/1445294717 conn(0x5598776b1d90 msgr2=0x559877733000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 shutdown_connections 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 1 -- 172.21.15.64:0/1445294717 wait complete. 2024-09-21T07:27:25.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.507+0000 7feb5cfb9000 20 client.6930 trim_cache size 0 max 16384 2024-09-21T07:27:25.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 Processor -- start 2024-09-21T07:27:25.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 -- start start 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877731e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb501feb10 con 0x5598775c4ca0 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb50148770 con 0x5598771eb460 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feb500c5610 con 0x5598775db950 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33990/0 (socket says 172.21.15.64:33990) 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 -- 172.21.15.64:0/2134396515 learned_addr learned my addr 172.21.15.64:0/2134396515 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb4ea00640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb4f400640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877731e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 -- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 msgr2=0x559877731e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877731e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 -- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 msgr2=0x55987773d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb47e00640 1 -- 172.21.15.64:0/2134396515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559877589db0 con 0x5598775c4ca0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.527+0000 7feb4f400640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877731e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb47e00640 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7feb3800f730 tx=0x7feb38077040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca76ca1dcfc6e531 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb3ea00640 1 -- 172.21.15.64:0/2134396515 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3805f7b0 con 0x5598775c4ca0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb3ea00640 1 -- 172.21.15.64:0/2134396515 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb38068c90 con 0x5598775c4ca0 2024-09-21T07:27:25.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb3ea00640 1 -- 172.21.15.64:0/2134396515 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3805ea10 con 0x5598775c4ca0 2024-09-21T07:27:25.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2134396515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 msgr2=0x5598777318e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7feb3800f730 tx=0x7feb38077040 comp rx=0 tx=0).stop 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2134396515 shutdown_connections 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877731e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x5598777318e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/2134396515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2134396515 >> 172.21.15.64:0/2134396515 conn(0x5598776b1d90 msgr2=0x5598776e3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2134396515 shutdown_connections 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- 172.21.15.64:0/2134396515 wait complete. 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- start start 2024-09-21T07:27:25.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 Processor -- start 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877762600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55987753d910 con 0x5598775c4ca0 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559877531090 con 0x5598771eb460 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5598775ed750 con 0x5598775db950 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.531+0000 7feb5cfb9000 10 client.0 _ll_register_callbacks cb 0x7feb40003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34004/0 (socket says 172.21.15.64:34004) 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 -- 172.21.15.64:0/3930016547 learned_addr learned my addr 172.21.15.64:0/3930016547 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb4f400640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877762600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb4ea00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 -- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 msgr2=0x559877762600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877762600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 -- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 msgr2=0x55987773cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 -- 172.21.15.64:0/3930016547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598774f4ab0 con 0x5598775c4ca0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb47e00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7feb38005e10 tx=0x7feb3805b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465cde95dcf5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3805f7b0 con 0x5598775c4ca0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7feb3805ea10 con 0x5598775c4ca0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb38068c90 con 0x5598775c4ca0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7feb3805ec10 con 0x5598775c4ca0 2024-09-21T07:27:25.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 10 client.6936 fetch_fsmap learned FSMap version 52 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5598774d3070 con 0x5598775c4ca0 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb38068c90 con 0x5598775c4ca0 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7feb3805b100 con 0x5598775c4ca0 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 10 client.6936 fetch_fsmap finished waiting for FSMap version 52 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 10 client.6936 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 20 client.6936 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771be830 0x559877762f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 4 client.6936 mds_command: new command op to 6804 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 --> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] -- command(tid 0: {"prefix": "status"}) -- 0x559877748400 con 0x5598771be830 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb4ea00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771be830 0x559877762f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb4ea00640 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771be830 0x559877762f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=655b84f1a17db285 server_cookie=21735442af750855 in_seq=0 out_seq=0 2024-09-21T07:27:25.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 10 client.6936 ms_handle_connect on v2:172.21.15.64:6832/2439635016 2024-09-21T07:27:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 1 -- 172.21.15.64:0/3930016547 <== mds.0 v2:172.21.15.64:6832/2439635016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559877748400 con 0x5598771be830 2024-09-21T07:27:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 10 client.6936 handle_command_reply: tid=0 2024-09-21T07:27:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 client.6936 shutdown 2024-09-21T07:27:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 msgr2=0x55987773d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7feb38005e10 tx=0x7feb3805b650 comp rx=0 tx=0).stop 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 shutdown_connections 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:6832/2439635016,v1:172.21.15.64:6834/2439635016] conn(0x5598771be830 0x559877762f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5598775db950 0x559877762600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598775c4ca0 0x55987773d2e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 --2- 172.21.15.64:0/3930016547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5598771eb460 0x55987773cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb33e00640 0 client.6936 ms_handle_reset on v2:172.21.15.64:6832/2439635016 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 >> 172.21.15.64:0/3930016547 conn(0x5598776b1d90 msgr2=0x5598776e48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 shutdown_connections 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 1 -- 172.21.15.64:0/3930016547 wait complete. 2024-09-21T07:27:25.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.535+0000 7feb5cfb9000 20 client.6936 trim_cache size 0 max 16384 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 6804, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 6.1611544660000002, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 52, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 83, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T07:27:25.543 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 11.286515206000001 2024-09-21T07:27:25.544 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:27:25.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 msgr2=0x7feb2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 0x7feb2c075710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feb40006660 tx=0x7feb40003ff0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 msgr2=0x7feb500ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb38011a50 tx=0x7feb38011f10 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 shutdown_connections 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb2c073200 0x7feb2c075710 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb500ae3c0 0x7feb500ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb500ac4c0 0x7feb500ac8d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 --2- 172.21.15.64:0/2310014073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb34005360 0x7feb500c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 >> 172.21.15.64:0/2310014073 conn(0x7feb500ccfa0 msgr2=0x7feb5006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 shutdown_connections 2024-09-21T07:27:25.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.539+0000 7feb55a00640 1 -- 172.21.15.64:0/2310014073 wait complete. 2024-09-21T07:27:25.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 -- 172.21.15.64:0/3559458114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 msgr2=0x7f32101627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 --2- 172.21.15.64:0/3559458114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101627a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f32100d14d0 tx=0x7f320801cd50 comp rx=0 tx=0).stop 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 -- 172.21.15.64:0/3559458114 shutdown_connections 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 --2- 172.21.15.64:0/3559458114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101627a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 --2- 172.21.15.64:0/3559458114 >> v2:172.21.15.90:3300/0 conn(0x7f32100ccd90 0x7f32100cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 --2- 172.21.15.64:0/3559458114 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100b5820 0x7f32100cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 -- 172.21.15.64:0/3559458114 >> 172.21.15.64:0/3559458114 conn(0x7f32100743a0 msgr2=0x7f32100747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 -- 172.21.15.64:0/3559458114 shutdown_connections 2024-09-21T07:27:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.715+0000 7f3216c00640 1 -- 172.21.15.64:0/3559458114 wait complete. 2024-09-21T07:27:25.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 Processor -- start 2024-09-21T07:27:25.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 -- start start 2024-09-21T07:27:25.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32100b5820 0x7f321009dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100ccd90 0x7f32100c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f32100b1160 con 0x7f3210162390 2024-09-21T07:27:25.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32100b0fe0 con 0x7f32100b5820 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f32100b12e0 con 0x7f32100ccd90 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34022/0 (socket says 172.21.15.64:34022) 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 -- 172.21.15.64:0/1722022781 learned_addr learned my addr 172.21.15.64:0/1722022781 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3215800640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32100b5820 0x7f321009dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3214e00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100ccd90 0x7f32100c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 -- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100ccd90 msgr2=0x7f32100c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100ccd90 0x7f32100c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 -- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32100b5820 msgr2=0x7f321009dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32100b5820 0x7f321009dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 -- 172.21.15.64:0/1722022781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32101fd020 con 0x7f3210162390 2024-09-21T07:27:25.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.719+0000 7f3216200640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f320801b400 tx=0x7f32080092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080bb070 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3208004d40 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080b2040 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32100c64d0 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32101f9e10 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32100c6240 con 0x7f3210162390 2024-09-21T07:27:25.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f32080ad850 con 0x7f3210162390 2024-09-21T07:27:25.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 0x7f31f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:25.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f320812e410 con 0x7f3210162390 2024-09-21T07:27:25.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.723+0000 7f3215800640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 0x7f31f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:25.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.727+0000 7f3215800640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 0x7f31f0075710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3204005fd0 tx=0x7f3204005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:25.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.727+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3208016970 con 0x7f3210162390 2024-09-21T07:27:25.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32100510a0 con 0x7f3210162390 2024-09-21T07:27:25.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f320d600640 1 -- 172.21.15.64:0/1722022781 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f32080f8bb0 con 0x7f3210162390 2024-09-21T07:27:25.945 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:27:25.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 msgr2=0x7f31f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 0x7f31f0075710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3204005fd0 tx=0x7f3204005f40 comp rx=0 tx=0).stop 2024-09-21T07:27:25.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 msgr2=0x7f32101fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f320801b400 tx=0x7f32080092c0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 shutdown_connections 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31f0073200 0x7f31f0075710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3210162390 0x7f32101fc240 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32100ccd90 0x7f32100c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 --2- 172.21.15.64:0/1722022781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32100b5820 0x7f321009dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 >> 172.21.15.64:0/1722022781 conn(0x7f32100743a0 msgr2=0x7f32100ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 shutdown_connections 2024-09-21T07:27:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:25.943+0000 7f3216c00640 1 -- 172.21.15.64:0/1722022781 wait complete. 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:27:25.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:27:25.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:27:25.968 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:25.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:25.968 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:27:25.977 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42138sec preferred_lft 42138sec 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:27:25.979 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:27:25.980 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:25.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:25.980 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:27:26.042 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:27:26.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.044 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:26.099 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:27:26.100 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:27:26.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:27:26.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:27:26.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.238 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:27:26.247 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:27:26.247 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:27:26.248 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:26.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.248 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:27:26.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:27:26.315 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:26.371 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:26.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:27:26.371 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:26.427 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:27:26.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.427 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:27:26.551 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:26.552 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:27:26.552 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:27:26.552 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:27:26.552 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:27:26.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:27:26.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.555 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:26.575 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:27:26.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:27:26.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:27:26.691 INFO:teuthology.orchestra.run.smithi064.stdout:client6727 2024-09-21T07:27:26.692 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:26.692 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:26.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.703 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-21T07:27:26.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:26.758 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-21T07:27:26.809 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:27:26.810 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:27:26.810 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:27:26.810 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:27:26.810 DEBUG:teuthology.orchestra.run.smithi064:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-21T07:27:26.810 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:27:26.917 INFO:teuthology.orchestra.run.smithi064.stdout:1099511627776 2024-09-21T07:27:26.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:27:26.926 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:26.926 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:26.980 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:26.980 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:27.031 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:27:27.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 -- 172.21.15.64:0/1842774360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 msgr2=0x7f4f94003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/1842774360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4f94003ef0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009b50 tx=0x7f4fa001d290 comp rx=0 tx=0).stop 2024-09-21T07:27:27.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb4e00640 1 -- 172.21.15.64:0/1842774360 reap_dead start 2024-09-21T07:27:27.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 -- 172.21.15.64:0/1842774360 shutdown_connections 2024-09-21T07:27:27.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 -- 172.21.15.64:0/1842774360 >> 172.21.15.64:0/1842774360 conn(0x7f4fb006d450 msgr2=0x7f4fb00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:27.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 -- 172.21.15.64:0/1842774360 shutdown_connections 2024-09-21T07:27:27.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.235+0000 7f4fb6e00640 1 -- 172.21.15.64:0/1842774360 wait complete. 2024-09-21T07:27:27.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 Processor -- start 2024-09-21T07:27:27.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 -- start start 2024-09-21T07:27:27.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb01fa9f0 0x7f4fb015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb015e110 0x7f4fb01f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb006f9c0 con 0x7f4f94003a80 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb006f840 con 0x7f4fb01fa9f0 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb006fb40 con 0x7f4fb015e110 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fafe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fafe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34038/0 (socket says 172.21.15.64:34038) 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fafe00640 1 -- 172.21.15.64:0/2591546729 learned_addr learned my addr 172.21.15.64:0/2591546729 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4fb4e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb015e110 0x7f4fb01f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.239+0000 7f4faf400640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb01fa9f0 0x7f4fb015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 -- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb015e110 msgr2=0x7f4fb01f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb015e110 0x7f4fb01f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 -- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb01fa9f0 msgr2=0x7f4fb015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb01fa9f0 0x7f4fb015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 -- 172.21.15.64:0/2591546729 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb00c7660 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fafe00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4fa001d0c0 tx=0x7f4fa0004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0004d80 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa0005030 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb00c7940 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0005460 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01fa4d0 con 0x7f4f94003a80 2024-09-21T07:27:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb015f540 con 0x7f4f94003a80 2024-09-21T07:27:27.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.243+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4fa00bb440 con 0x7f4f94003a80 2024-09-21T07:27:27.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.247+0000 7f4fa7e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 0x7f4f90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.247+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f4fa012ef80 con 0x7f4f94003a80 2024-09-21T07:27:27.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.247+0000 7f4faf400640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 0x7f4f90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.247+0000 7f4faf400640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 0x7f4f90075710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00b2e30 tx=0x7f4f9c0011b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:27.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.251+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4fa0016fa0 con 0x7f4f94003a80 2024-09-21T07:27:27.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.443+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4fb015ad40 con 0x7f4f94003a80 2024-09-21T07:27:27.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.443+0000 7f4fa7e00640 1 -- 172.21.15.64:0/2591546729 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) ==== 80+0+0 (secure 0 0 0) 0x7f4fa00f9e00 con 0x7f4f94003a80 2024-09-21T07:27:27.447 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:27:27.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 msgr2=0x7f4f90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 0x7f4f90075710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00b2e30 tx=0x7f4f9c0011b0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 msgr2=0x7f4fb01565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4fa001d0c0 tx=0x7f4fa0004890 comp rx=0 tx=0).stop 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 shutdown_connections 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f90073200 0x7f4f90075710 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb015e110 0x7f4fb01f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb01fa9f0 0x7f4fb015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 --2- 172.21.15.64:0/2591546729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f94003a80 0x7f4fb01565a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 >> 172.21.15.64:0/2591546729 conn(0x7f4fb006d450 msgr2=0x7f4fb00cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 shutdown_connections 2024-09-21T07:27:27.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.447+0000 7f4fb6e00640 1 -- 172.21.15.64:0/2591546729 wait complete. 2024-09-21T07:27:27.470 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:27:27.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:27.470 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:27.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:27:27.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:27.537 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:27:27.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:27.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 -- 172.21.15.64:0/868420079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40709b0 msgr2=0x7ff3f40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/868420079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40709b0 0x7ff3f40b41c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc009900 tx=0x7ff3dc01c700 comp rx=0 tx=0).stop 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 -- 172.21.15.64:0/868420079 shutdown_connections 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/868420079 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 0x7ff3f4072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/868420079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40709b0 0x7ff3f40b41c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 -- 172.21.15.64:0/868420079 >> 172.21.15.64:0/868420079 conn(0x7ff3f40ccbe0 msgr2=0x7ff3f40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 -- 172.21.15.64:0/868420079 shutdown_connections 2024-09-21T07:27:27.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.763+0000 7ff3f9e00640 1 -- 172.21.15.64:0/868420079 wait complete. 2024-09-21T07:27:27.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 Processor -- start 2024-09-21T07:27:27.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- start start 2024-09-21T07:27:27.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f40709b0 0x7ff3f414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 0x7ff3f414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f4168bf0 con 0x7ff3f415edb0 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f4168a70 con 0x7ff3f40709b0 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f4168d70 con 0x7ff3f40b4700 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34050/0 (socket says 172.21.15.64:34050) 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 -- 172.21.15.64:0/3451398392 learned_addr learned my addr 172.21.15.64:0/3451398392 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f2a00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f40709b0 0x7ff3f414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3ebe00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 0x7ff3f414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 -- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 msgr2=0x7ff3f414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 0x7ff3f414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 -- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f40709b0 msgr2=0x7ff3f414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f40709b0 0x7ff3f414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 -- 172.21.15.64:0/3451398392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f409d6d0 con 0x7ff3f415edb0 2024-09-21T07:27:27.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f3400640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00cab0 tx=0x7ff3ec00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:27.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00ae20 con 0x7ff3f415edb0 2024-09-21T07:27:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3ec00f560 con 0x7ff3f415edb0 2024-09-21T07:27:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f41f98a0 con 0x7ff3f415edb0 2024-09-21T07:27:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00f9b0 con 0x7ff3f415edb0 2024-09-21T07:27:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.767+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f40c9e40 con 0x7ff3f415edb0 2024-09-21T07:27:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f40b41c0 con 0x7ff3f415edb0 2024-09-21T07:27:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3ec00fb50 con 0x7ff3f415edb0 2024-09-21T07:27:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3eb400640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 0x7ff3d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7ff3ec094e20 con 0x7ff3f415edb0 2024-09-21T07:27:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3f2a00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 0x7ff3d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.771+0000 7ff3f2a00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 0x7ff3d0075740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098e0 tx=0x7ff3e4009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:27.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.775+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff3ec014030 con 0x7ff3f415edb0 2024-09-21T07:27:27.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3f4165e70 con 0x7ff3f415edb0 2024-09-21T07:27:27.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3eb400640 1 -- 172.21.15.64:0/3451398392 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7ff3ec05f5c0 con 0x7ff3f415edb0 2024-09-21T07:27:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:27.993 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":52,"btime":"2024-09-21T07:27:22:385997+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3476229811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3476229811},{"type":"v1","addr":"172.21.15.90:6837","nonce":3476229811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/565775790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":565775790},{"type":"v1","addr":"172.21.15.64:6835","nonce":565775790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2323125620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2323125620},{"type":"v1","addr":"172.21.15.90:6835","nonce":2323125620}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:21.806267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6804},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6804":{"gid":6804,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2439635016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2439635016},{"type":"v1","addr":"172.21.15.64:6834","nonce":2439635016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6804,"qdb_cluster":[6804]},"id":5}]} 2024-09-21T07:27:27.993 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 52 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 msgr2=0x7ff3d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 0x7ff3d0075740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098e0 tx=0x7ff3e4009060 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 msgr2=0x7ff3f41f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00cab0 tx=0x7ff3ec00cf70 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 shutdown_connections 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d0073230 0x7ff3d0075740 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f415edb0 0x7ff3f41f7fc0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f40b4700 0x7ff3f414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 --2- 172.21.15.64:0/3451398392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f40709b0 0x7ff3f414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 >> 172.21.15.64:0/3451398392 conn(0x7ff3f40ccbe0 msgr2=0x7ff3f40caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:27.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 shutdown_connections 2024-09-21T07:27:27.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:27.991+0000 7ff3f9e00640 1 -- 172.21.15.64:0/3451398392 wait complete. 2024-09-21T07:27:28.015 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-21T07:27:28.197 INFO:teuthology.orchestra.run.smithi064.stdout:{"message":"","return_code":0} 2024-09-21T07:27:28.197 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-21T07:27:28.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:27:28.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:28.198 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:27:28.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:28.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:27:28.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:28.199 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:27:28.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:28.210 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:27:28.210 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:28.212 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:27:28.212 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:28.213 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:27:28.213 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:28.226 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:27:28.226 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:28.226 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-21T07:27:28.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.311+0000 7f77dadad080 1 Processor -- start 2024-09-21T07:27:28.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.311+0000 7f77dadad080 1 -- start start 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77b8002350 0x5580cd42ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd3a7920 0x5580cd310950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5580cd27cf40 con 0x5580cd38cc20 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5580cd289d00 con 0x5580cd3a7920 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5580cd21ea00 con 0x7f77b8002350 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34068/0 (socket says 172.21.15.64:34068) 2024-09-21T07:27:28.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 -- 172.21.15.64:0/2835631300 learned_addr learned my addr 172.21.15.64:0/2835631300 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d4000640 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77b8002350 0x5580cd42ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d4a00640 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd3a7920 0x5580cd310950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 -- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77b8002350 msgr2=0x5580cd42ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77b8002350 0x5580cd42ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 -- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd3a7920 msgr2=0x5580cd310950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd3a7920 0x5580cd310950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 -- 172.21.15.64:0/2835631300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580cd38d4d0 con 0x5580cd38cc20 2024-09-21T07:27:28.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d3600640 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f77c000d430 tx=0x7f77c000d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d504b33efb2aeef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d2200640 1 -- 172.21.15.64:0/2835631300 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c000f4f0 con 0x5580cd38cc20 2024-09-21T07:27:28.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d2200640 1 -- 172.21.15.64:0/2835631300 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77c0014020 con 0x5580cd38cc20 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77d2200640 1 -- 172.21.15.64:0/2835631300 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c000f910 con 0x5580cd38cc20 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- 172.21.15.64:0/2835631300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 msgr2=0x5580cd3a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f77c000d430 tx=0x7f77c000d8f0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- 172.21.15.64:0/2835631300 shutdown_connections 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd3a7920 0x5580cd310950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5580cd38cc20 0x5580cd3a73e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 --2- 172.21.15.64:0/2835631300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77b8002350 0x5580cd42ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- 172.21.15.64:0/2835631300 >> 172.21.15.64:0/2835631300 conn(0x5580cd2bcd60 msgr2=0x5580cd31a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- 172.21.15.64:0/2835631300 shutdown_connections 2024-09-21T07:27:28.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- 172.21.15.64:0/2835631300 wait complete. 2024-09-21T07:27:28.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 Processor -- start 2024-09-21T07:27:28.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.315+0000 7f77dadad080 1 -- start start 2024-09-21T07:27:28.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd38cc20 0x5580cd314ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5580cd3a7920 0x5580cd38c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 0x5580cd2fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5580cd38d770 con 0x7f77b8002350 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5580cd38d270 con 0x5580cd38cc20 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5580cd42e6e0 con 0x5580cd3a7920 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 0x5580cd2fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 0x5580cd2fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34076/0 (socket says 172.21.15.64:34076) 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 -- 172.21.15.64:0/86757557 learned_addr learned my addr 172.21.15.64:0/86757557 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d3600640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5580cd3a7920 0x5580cd38c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4000640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd38cc20 0x5580cd314ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 -- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5580cd3a7920 msgr2=0x5580cd38c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5580cd3a7920 0x5580cd38c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 -- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd38cc20 msgr2=0x5580cd314ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580cd38cc20 0x5580cd314ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 -- 172.21.15.64:0/86757557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580cd3161f0 con 0x7f77b8002350 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d3600640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5580cd3a7920 0x5580cd38c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:28.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d4a00640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 0x5580cd2fffe0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x5580cd2fe660 tx=0x7f77cc0138b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d0e00640 1 -- 172.21.15.64:0/86757557 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc01c070 con 0x7f77b8002350 2024-09-21T07:27:28.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d0e00640 1 -- 172.21.15.64:0/86757557 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77cc0166a0 con 0x7f77b8002350 2024-09-21T07:27:28.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580cd316490 con 0x7f77b8002350 2024-09-21T07:27:28.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77d0e00640 1 -- 172.21.15.64:0/86757557 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc016ad0 con 0x7f77b8002350 2024-09-21T07:27:28.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.319+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580cd3169d0 con 0x7f77b8002350 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d0e00640 1 -- 172.21.15.64:0/86757557 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f77cc01f070 con 0x7f77b8002350 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d0e00640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77b4071c10 0x7f77b4074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d0e00640 1 -- 172.21.15.64:0/86757557 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f77cc095830 con 0x7f77b8002350 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77dadad080 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x5580cd317110 0x5580cd310950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83) -- 0x5580cd310e90 con 0x5580cd317110 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d4000640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77b4071c10 0x7f77b4074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d3600640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x5580cd317110 0x5580cd310950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d3600640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x5580cd317110 0x5580cd310950 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.323+0000 7f77d4000640 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77b4071c10 0x7f77b4074120 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77c40ac000 tx=0x7f77c40a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77d3600640 1 -- 172.21.15.64:0/86757557 <== osd.0 v2:172.21.15.64:6816/3519639794 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v83'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f77c0008070 con 0x5580cd317110 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x5580cd317110 msgr2=0x5580cd310950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x5580cd317110 0x5580cd310950 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77b4071c10 msgr2=0x7f77b4074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77b4071c10 0x7f77b4074120 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77c40ac000 tx=0x7f77c40a7040 comp rx=0 tx=0).stop 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 msgr2=0x5580cd2fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 --2- 172.21.15.64:0/86757557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77b8002350 0x5580cd2fffe0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x5580cd2fe660 tx=0x7f77cc0138b0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77d4a00640 1 -- 172.21.15.64:0/86757557 reap_dead start 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 shutdown_connections 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 >> 172.21.15.64:0/86757557 conn(0x5580cd2bcd60 msgr2=0x5580cd31a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 shutdown_connections 2024-09-21T07:27:28.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.327+0000 7f77dadad080 1 -- 172.21.15.64:0/86757557 wait complete. 2024-09-21T07:27:28.334 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-21T07:27:28.335 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-21T07:27:28.335 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-21T07:27:28.335 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-21T07:27:28.336 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-21T07:27:28.336 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-21T07:27:28.336 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-21T07:27:28.336 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-21T07:27:28.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- 172.21.15.64:0/4124740298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c1654f0 msgr2=0x7fcd4c167910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 --2- 172.21.15.64:0/4124740298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c1654f0 0x7fcd4c167910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009bf0 tx=0x7fcd4401cb50 comp rx=0 tx=0).stop 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- 172.21.15.64:0/4124740298 shutdown_connections 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 --2- 172.21.15.64:0/4124740298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c1654f0 0x7fcd4c167910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- 172.21.15.64:0/4124740298 >> 172.21.15.64:0/4124740298 conn(0x7fcd4c0cee80 msgr2=0x7fcd4c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- 172.21.15.64:0/3786063562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc155560 msgr2=0x7f08fc0b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 --2- 172.21.15.64:0/3786063562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc155560 0x7f08fc0b4cd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f08f00098f0 tx=0x7f08f001c820 comp rx=0 tx=0).stop 2024-09-21T07:27:28.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- 172.21.15.64:0/4124740298 shutdown_connections 2024-09-21T07:27:28.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- 172.21.15.64:0/4124740298 wait complete. 2024-09-21T07:27:28.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- 172.21.15.64:0/3786063562 shutdown_connections 2024-09-21T07:27:28.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 --2- 172.21.15.64:0/3786063562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 0x7f08fc15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 --2- 172.21.15.64:0/3786063562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc155560 0x7f08fc0b4cd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- 172.21.15.64:0/3786063562 >> 172.21.15.64:0/3786063562 conn(0x7f08fc06d450 msgr2=0x7f08fc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- 172.21.15.64:0/3786063562 shutdown_connections 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- 172.21.15.64:0/3786063562 wait complete. 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 -- 172.21.15.64:0/1600963281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 msgr2=0x7f4588072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 --2- 172.21.15.64:0/1600963281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f4588072200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4580009bf0 tx=0x7f458001cbb0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 -- 172.21.15.64:0/1600963281 shutdown_connections 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 --2- 172.21.15.64:0/1600963281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f4588072200 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 -- 172.21.15.64:0/1600963281 >> 172.21.15.64:0/1600963281 conn(0x7f45880b2db0 msgr2=0x7f45880b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 -- 172.21.15.64:0/1600963281 shutdown_connections 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f458e600640 1 -- 172.21.15.64:0/1600963281 wait complete. 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 Processor -- start 2024-09-21T07:27:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 Processor -- start 2024-09-21T07:27:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7f0904200640 1 -- start start 2024-09-21T07:27:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.507+0000 7fcd51e00640 1 -- start start 2024-09-21T07:27:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 -- 172.21.15.64:0/242691734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95b0003ad0 msgr2=0x7f95b0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 --2- 172.21.15.64:0/242691734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95b0003ad0 0x7f95b0003f40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001190 tx=0x7f95bc01cf20 comp rx=0 tx=0).stop 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 -- 172.21.15.64:0/242691734 shutdown_connections 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 --2- 172.21.15.64:0/242691734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95b0003ad0 0x7f95b0003f40 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 -- 172.21.15.64:0/242691734 >> 172.21.15.64:0/242691734 conn(0x7f95cc0d12d0 msgr2=0x7f95cc0d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 -- 172.21.15.64:0/242691734 shutdown_connections 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f95d0c00640 1 -- 172.21.15.64:0/242691734 wait complete. 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 Processor -- start 2024-09-21T07:27:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 -- start start 2024-09-21T07:27:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08fc155560 0x7f08fc168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 0x7f08fc169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc167330 con 0x7f08fc0aefe0 2024-09-21T07:27:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1671b0 con 0x7f08fc155560 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f08fc1674b0 con 0x7f08fc15eb80 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0902200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 0x7f08fc169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34100/0 (socket says 172.21.15.64:34100) 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 -- 172.21.15.64:0/4003438667 learned_addr learned my addr 172.21.15.64:0/4003438667 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0900e00640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08fc155560 0x7f08fc168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd4c0b3e80 0x7fcd4c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c15c9a0 0x7fcd4c1fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1691e0 con 0x7fcd4c1654f0 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c169060 con 0x7fcd4c0b3e80 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 -- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 msgr2=0x7f08fc169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 0x7f08fc169520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd51e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c169360 con 0x7fcd4c15c9a0 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 -- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08fc155560 msgr2=0x7f08fc168fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08fc155560 0x7f08fc168fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 -- 172.21.15.64:0/4003438667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc0cc4e0 con 0x7f08fc0aefe0 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 0x7f45880ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f45880ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f458815ba60 0x7f4588156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f458806da70 con 0x7f458815ba60 2024-09-21T07:27:28.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f458806d8f0 con 0x7f4588071df0 2024-09-21T07:27:28.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f458e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f458806dbf0 con 0x7f45880d0850 2024-09-21T07:27:28.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0901800640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000c10 tx=0x7f08f00a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4a000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c15c9a0 0x7fcd4c1fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34116/0 (socket says 172.21.15.64:34116) 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 -- 172.21.15.64:0/1661859216 learned_addr learned my addr 172.21.15.64:0/1661859216 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4aa00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd4c0b3e80 0x7fcd4c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 -- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c15c9a0 msgr2=0x7fcd4c1fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c15c9a0 0x7fcd4c1fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 -- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd4c0b3e80 msgr2=0x7fcd4c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f4587400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 0x7f45880ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f4586a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f45880ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f4587400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 0x7f45880ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:47378/0 (socket says 172.21.15.64:47378) 2024-09-21T07:27:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f4587400640 1 -- 172.21.15.64:0/2542508985 learned_addr learned my addr 172.21.15.64:0/2542508985 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd4c0b3e80 0x7fcd4c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7fcd4b400640 1 -- 172.21.15.64:0/1661859216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0b6540 con 0x7fcd4c1654f0 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f00b2040 con 0x7f08fc0aefe0 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08f00041b0 con 0x7f08fc0aefe0 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0003600 con 0x7f08fc0aefe0 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08fc1f9500 con 0x7f08fc0aefe0 2024-09-21T07:27:28.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f4587e00640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f458815ba60 0x7f4588156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.511+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08fc1f9ac0 con 0x7f08fc0aefe0 2024-09-21T07:27:28.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd4b400640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401a780 tx=0x7fcd44009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 Processor -- start 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 -- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 msgr2=0x7f45880ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 0x7f45880ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 -- 172.21.15.64:0/2542508985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f458815ba60 msgr2=0x7f4588156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f458815ba60 0x7f4588156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 -- 172.21.15.64:0/2542508985 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4588154dd0 con 0x7f45880d0850 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 -- start start 2024-09-21T07:27:28.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f4586a00640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f45880ca790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f457400c390 tx=0x7f457400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08fc1f9310 con 0x7f08fc0aefe0 2024-09-21T07:27:28.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574011790 con 0x7f45880d0850 2024-09-21T07:27:28.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45881550b0 con 0x7f45880d0850 2024-09-21T07:27:28.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b2040 con 0x7fcd4c1654f0 2024-09-21T07:27:28.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd44003d70 con 0x7fcd4c1654f0 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004cb0 con 0x7fcd4c1654f0 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4588155670 con 0x7f45880d0850 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4574017070 con 0x7f45880d0850 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574011ce0 con 0x7f45880d0850 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c0b6820 con 0x7fcd4c1654f0 2024-09-21T07:27:28.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c0b6de0 con 0x7fcd4c1654f0 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95cc1f7850 0x7f95cc1f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95cc161720 0x7f95cc161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0b0410 con 0x7f95cc161720 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0b0290 con 0x7f95b0003ad0 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95d0c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0b0590 con 0x7f95cc1f7850 2024-09-21T07:27:28.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:47390/0 (socket says 172.21.15.64:47390) 2024-09-21T07:27:28.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9e00640 1 -- 172.21.15.64:0/755765338 learned_addr learned my addr 172.21.15.64:0/755765338 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:28.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45600052a0 con 0x7f45880d0850 2024-09-21T07:27:28.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9400640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95cc1f7850 0x7f95cc1f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd240052a0 con 0x7fcd4c1654f0 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9e00640 1 -- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95cc1f7850 msgr2=0x7f95cc1f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.515+0000 7f95c9e00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95cc1f7850 0x7f95cc1f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c9e00640 1 -- 172.21.15.64:0/755765338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95cc161720 msgr2=0x7f95cc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c9e00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95cc161720 0x7f95cc161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c9e00640 1 -- 172.21.15.64:0/755765338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc15f170 con 0x7f95b0003ad0 2024-09-21T07:27:28.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f08f00bd030 con 0x7f08fc0aefe0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c9e00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95bc01b620 tx=0x7f95bc0a7ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc000ee0 con 0x7f95b0003ad0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95bc001170 con 0x7f95b0003ad0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003860 con 0x7f95b0003ad0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc162070 con 0x7f95b0003ad0 2024-09-21T07:27:28.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc1fc030 con 0x7f95b0003ad0 2024-09-21T07:27:28.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcd440be060 con 0x7fcd4c1654f0 2024-09-21T07:27:28.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f08f9600640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 0x7f08dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f08f012e810 con 0x7f08fc0aefe0 2024-09-21T07:27:28.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4574005020 con 0x7f45880d0850 2024-09-21T07:27:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc0b0af0 con 0x7f95b0003ad0 2024-09-21T07:27:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f0900e00640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 0x7f08dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f457f400640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 0x7f4568075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f0900e00640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 0x7f08dc075710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08fc09dc90 tx=0x7f08e800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f4574094060 con 0x7f45880d0850 2024-09-21T07:27:28.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7fcd43400640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 0x7fcd2c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.519+0000 7f4587400640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 0x7f4568075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7fcd4aa00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 0x7fcd2c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f4587400640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 0x7f4568075740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45780017f0 tx=0x7f4578009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f95bc003a00 con 0x7f95b0003ad0 2024-09-21T07:27:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7fcd4aa00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 0x7fcd2c075740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c001180 tx=0x7fcd3c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f457405ef60 con 0x7f45880d0850 2024-09-21T07:27:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f95c2000640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 0x7f95ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f95bc12ee40 con 0x7f95b0003ad0 2024-09-21T07:27:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f95c9400640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 0x7f95ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7f95c9400640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 0x7f95ac075710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c10 tx=0x7f95b8006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:28.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.523+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fcd4412c040 con 0x7fcd4c1654f0 2024-09-21T07:27:28.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.527+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f08f00c4060 con 0x7f08fc0aefe0 2024-09-21T07:27:28.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.527+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f95bc0bf030 con 0x7f95b0003ad0 2024-09-21T07:27:28.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.531+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcd440167d0 con 0x7fcd4c1654f0 2024-09-21T07:27:28.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.767+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f4560005860 con 0x7f45880d0850 2024-09-21T07:27:28.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.771+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f08fc0b4cd0 con 0x7f08fc0aefe0 2024-09-21T07:27:28.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.779+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fcd24005590 con 0x7fcd4c1654f0 2024-09-21T07:27:28.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:28.779+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f95cc15cd90 con 0x7f95b0003ad0 2024-09-21T07:27:29.565 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:27:29.563+0000 7fae8b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:27:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f457f400640 1 -- 172.21.15.64:0/2542508985 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6598 v53) ==== 95+0+0 (secure 0 0 0) 0x7f457405e860 con 0x7f45880d0850 2024-09-21T07:27:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6598 2024-09-21T07:27:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f08f9600640 1 -- 172.21.15.64:0/4003438667 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6804 v54) ==== 95+0+0 (secure 0 0 0) 0x7f08fc15f4d0 con 0x7f08fc0aefe0 2024-09-21T07:27:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6804 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 msgr2=0x7f4568075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 0x7f4568075740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45780017f0 tx=0x7f4578009040 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 msgr2=0x7f45880ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.567+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f45880ca790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f457400c390 tx=0x7f457400c850 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 shutdown_connections 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4568073230 0x7f4568075740 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f458815ba60 0x7f4588156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45880d0850 0x7f45880ca790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 --2- 172.21.15.64:0/2542508985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4588071df0 0x7f45880ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 >> 172.21.15.64:0/2542508985 conn(0x7f45880b2db0 msgr2=0x7f45880d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 shutdown_connections 2024-09-21T07:27:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f458e600640 1 -- 172.21.15.64:0/2542508985 wait complete. 2024-09-21T07:27:29.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 msgr2=0x7f08dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 0x7f08dc075710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08fc09dc90 tx=0x7f08e800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 msgr2=0x7f08fc0b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000c10 tx=0x7f08f00a56e0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 shutdown_connections 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08dc073200 0x7f08dc075710 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08fc15eb80 0x7f08fc169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08fc155560 0x7f08fc168fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 --2- 172.21.15.64:0/4003438667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08fc0aefe0 0x7f08fc0b12d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 >> 172.21.15.64:0/4003438667 conn(0x7f08fc06d450 msgr2=0x7f08fc0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 shutdown_connections 2024-09-21T07:27:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.571+0000 7f0904200640 1 -- 172.21.15.64:0/4003438667 wait complete. 2024-09-21T07:27:29.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.575+0000 7fcd43400640 1 -- 172.21.15.64:0/1661859216 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6152 v55) ==== 95+0+0 (secure 0 0 0) 0x7fcd440f8460 con 0x7fcd4c1654f0 2024-09-21T07:27:29.577 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6152 2024-09-21T07:27:29.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 msgr2=0x7fcd2c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 0x7fcd2c075740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c001180 tx=0x7fcd3c009040 comp rx=0 tx=0).stop 2024-09-21T07:27:29.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 msgr2=0x7fcd4c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401a780 tx=0x7fcd44009280 comp rx=0 tx=0).stop 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 shutdown_connections 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcd2c073230 0x7fcd2c075740 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd4c1654f0 0x7fcd4c0cbec0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd4c15c9a0 0x7fcd4c1fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 --2- 172.21.15.64:0/1661859216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd4c0b3e80 0x7fcd4c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 >> 172.21.15.64:0/1661859216 conn(0x7fcd4c0cee80 msgr2=0x7fcd4c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 shutdown_connections 2024-09-21T07:27:29.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:29.579+0000 7fcd51e00640 1 -- 172.21.15.64:0/1661859216 wait complete. 2024-09-21T07:27:29.608 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:27:29.608 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:27:29.611 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:27:29.612 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:29.612 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:27:29.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:27:29.613 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:27:29.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:27:29.616 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:27:29.616 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:29.658 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:27:29.658 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:29.711 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:27:29.716 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:27:29.759 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:27:30.568 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:27:30.567+0000 7fae8b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:27:30.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.571+0000 7f95c2000640 1 -- 172.21.15.64:0/755765338 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6146 v56) ==== 95+0+0 (secure 0 0 0) 0x7f95cc162070 con 0x7f95b0003ad0 2024-09-21T07:27:30.574 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6146 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 msgr2=0x7f95ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 0x7f95ac075710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c10 tx=0x7f95b8006b80 comp rx=0 tx=0).stop 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 msgr2=0x7f95cc152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95bc01b620 tx=0x7f95bc0a7ec0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 shutdown_connections 2024-09-21T07:27:30.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f95ac073200 0x7f95ac075710 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95cc161720 0x7f95cc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95cc1f7850 0x7f95cc1f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 --2- 172.21.15.64:0/755765338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95b0003ad0 0x7f95cc152680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 >> 172.21.15.64:0/755765338 conn(0x7f95cc0d12d0 msgr2=0x7f95cc15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 shutdown_connections 2024-09-21T07:27:30.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.575+0000 7f95d0c00640 1 -- 172.21.15.64:0/755765338 wait complete. 2024-09-21T07:27:30.610 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:27:30.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:27:30.613 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:27:30.614 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:30.614 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:30.706 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:27:30.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- 172.21.15.64:0/2180431133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f580b48d0 msgr2=0x7f7f58072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/2180431133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f580b48d0 0x7f7f58072e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009870 tx=0x7f7f5001c860 comp rx=0 tx=0).stop 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- 172.21.15.64:0/2180431133 shutdown_connections 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/2180431133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f580b48d0 0x7f7f58072e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- 172.21.15.64:0/2180431133 >> 172.21.15.64:0/2180431133 conn(0x7f7f580ccbe0 msgr2=0x7f7f580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- 172.21.15.64:0/2180431133 shutdown_connections 2024-09-21T07:27:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- 172.21.15.64:0/2180431133 wait complete. 2024-09-21T07:27:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 Processor -- start 2024-09-21T07:27:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.815+0000 7f7f5ce00640 1 -- start start 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 0x7f7f58150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 0x7f7f581513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5816a4b0 con 0x7f7f580709b0 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5816a330 con 0x7f7f5809ac00 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5816a630 con 0x7f7f5815edb0 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34182/0 (socket says 172.21.15.64:34182) 2024-09-21T07:27:30.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 -- 172.21.15.64:0/1042193340 learned_addr learned my addr 172.21.15.64:0/1042193340 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f56800640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 0x7f7f581513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f4d400640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 0x7f7f58150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 -- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 msgr2=0x7f7f58150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 0x7f7f58150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 -- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 msgr2=0x7f7f581513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 0x7f7f581513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 -- 172.21.15.64:0/1042193340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f580c69e0 con 0x7f7f580709b0 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f56800640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 0x7f7f581513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f4d400640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 0x7f7f58150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:30.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f55e00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c440 tx=0x7f7f4800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48017070 con 0x7f7f580709b0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f48003600 con 0x7f7f580709b0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f580c7460 con 0x7f7f580709b0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48003a50 con 0x7f7f580709b0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f58157a50 con 0x7f7f580709b0 2024-09-21T07:27:30.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.819+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f58157560 con 0x7f7f580709b0 2024-09-21T07:27:30.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.823+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f4801a070 con 0x7f7f580709b0 2024-09-21T07:27:30.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.823+0000 7f7f4ea00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 0x7f7f34075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:30.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.823+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f7f48093870 con 0x7f7f580709b0 2024-09-21T07:27:30.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.823+0000 7f7f4d400640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 0x7f7f34075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:30.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.823+0000 7f7f4d400640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 0x7f7f34075740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f5809ab50 tx=0x7f7f40009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:30.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:30.827+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7f4805e5b0 con 0x7f7f580709b0 2024-09-21T07:27:31.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f58072e20 con 0x7f7f580709b0 2024-09-21T07:27:31.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f4ea00640 1 -- 172.21.15.64:0/1042193340 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+4394 (secure 0 0 0) 0x7f7f48007e20 con 0x7f7f580709b0 2024-09-21T07:27:31.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:31.045 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":57,"btime":"2024-09-21T07:27:30:575750+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:30.575723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-21T07:27:31.045 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 57 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 msgr2=0x7f7f34075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 0x7f7f34075740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f5809ab50 tx=0x7f7f40009040 comp rx=0 tx=0).stop 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 msgr2=0x7f7f580c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c440 tx=0x7f7f4800c900 comp rx=0 tx=0).stop 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 shutdown_connections 2024-09-21T07:27:31.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f34073230 0x7f7f34075740 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5809ac00 0x7f7f581513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f5815edb0 0x7f7f58150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 --2- 172.21.15.64:0/1042193340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f580709b0 0x7f7f580c64a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 >> 172.21.15.64:0/1042193340 conn(0x7f7f580ccbe0 msgr2=0x7f7f580ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 shutdown_connections 2024-09-21T07:27:31.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:31.043+0000 7f7f5ce00640 1 -- 172.21.15.64:0/1042193340 wait complete. 2024-09-21T07:27:31.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:27:18.794425+0000', 'modified': '2024-09-21T07:27:30.575723+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6996}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6996': {'gid': 6996, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/3463091313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3463091313}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3463091313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:27:31.470 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6996:up:replay 2024-09-21T07:27:32.471 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- 172.21.15.64:0/1129323538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38200b48d0 msgr2=0x7f3820072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 --2- 172.21.15.64:0/1129323538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38200b48d0 0x7f3820072e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f38200c3c60 tx=0x7f381801cd80 comp rx=0 tx=0).stop 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- 172.21.15.64:0/1129323538 shutdown_connections 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 --2- 172.21.15.64:0/1129323538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38200b48d0 0x7f3820072e20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 --2- 172.21.15.64:0/1129323538 >> v2:172.21.15.90:3300/0 conn(0x7f382015edb0 0x7f38200700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- 172.21.15.64:0/1129323538 >> 172.21.15.64:0/1129323538 conn(0x7f38200ccbe0 msgr2=0x7f38200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:32.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- 172.21.15.64:0/1129323538 shutdown_connections 2024-09-21T07:27:32.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- 172.21.15.64:0/1129323538 wait complete. 2024-09-21T07:27:32.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 Processor -- start 2024-09-21T07:27:32.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.643+0000 7f3828400640 1 -- start start 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38200709b0 0x7f38200b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f382015edb0 0x7f382009c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3820168b60 con 0x7f38201f7460 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38201689e0 con 0x7f38200709b0 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3820168ce0 con 0x7f382015edb0 2024-09-21T07:27:32.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34208/0 (socket says 172.21.15.64:34208) 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 -- 172.21.15.64:0/2704310952 learned_addr learned my addr 172.21.15.64:0/2704310952 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3825a00640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38200709b0 0x7f38200b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3825000640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f382015edb0 0x7f382009c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 -- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f382015edb0 msgr2=0x7f382009c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f382015edb0 0x7f382009c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 -- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38200709b0 msgr2=0x7f38200b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38200709b0 0x7f38200b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 -- 172.21.15.64:0/2704310952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201f6700 con 0x7f38201f7460 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3826400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3818009bd0 tx=0x7f3818005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38180bc070 con 0x7f38201f7460 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38180042f0 con 0x7f38201f7460 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38200b2840 con 0x7f38201f7460 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38180b2040 con 0x7f38201f7460 2024-09-21T07:27:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38201f6c60 con 0x7f38201f7460 2024-09-21T07:27:32.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38200b25b0 con 0x7f38201f7460 2024-09-21T07:27:32.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.647+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f38180bf070 con 0x7f38201f7460 2024-09-21T07:27:32.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.651+0000 7f381d600640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 0x7f3800075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:32.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.651+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f381812e080 con 0x7f38201f7460 2024-09-21T07:27:32.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.651+0000 7f3825a00640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 0x7f3800075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:32.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.651+0000 7f3825a00640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 0x7f3800075710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f381400bb50 tx=0x7f381400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:32.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.655+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f38201f6700 con 0x7f38201f7460 2024-09-21T07:27:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3820072e20 con 0x7f38201f7460 2024-09-21T07:27:32.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f381d600640 1 -- 172.21.15.64:0/2704310952 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5219 (secure 0 0 0) 0x7f3818016970 con 0x7f38201f7460 2024-09-21T07:27:32.872 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:32.872 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":59,"btime":"2024-09-21T07:27:32:586959+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:31.588319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-21T07:27:32.873 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 59 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 msgr2=0x7f3800075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 0x7f3800075710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f381400bb50 tx=0x7f381400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 msgr2=0x7f38200b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3818009bd0 tx=0x7f3818005b10 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 shutdown_connections 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3800073200 0x7f3800075710 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38201f7460 0x7f38200b3930 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f382015edb0 0x7f382009c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 --2- 172.21.15.64:0/2704310952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38200709b0 0x7f38200b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 >> 172.21.15.64:0/2704310952 conn(0x7f38200ccbe0 msgr2=0x7f382014ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 shutdown_connections 2024-09-21T07:27:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:32.871+0000 7f3828400640 1 -- 172.21.15.64:0/2704310952 wait complete. 2024-09-21T07:27:33.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:27:18.794425+0000', 'modified': '2024-09-21T07:27:31.588319+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6996}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6996': {'gid': 6996, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.64:6835/3463091313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3463091313}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3463091313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:27:33.298 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6996:up:rejoin 2024-09-21T07:27:34.299 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- 172.21.15.64:0/1339041086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b8004810 msgr2=0x7f83b8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 --2- 172.21.15.64:0/1339041086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b8004810 0x7f83b8004c20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c2e0 tx=0x7f83bc01f740 comp rx=0 tx=0).stop 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83d9c00640 1 -- 172.21.15.64:0/1339041086 reap_dead start 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- 172.21.15.64:0/1339041086 shutdown_connections 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- 172.21.15.64:0/1339041086 >> 172.21.15.64:0/1339041086 conn(0x7f83d40ccbe0 msgr2=0x7f83d40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:34.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- 172.21.15.64:0/1339041086 shutdown_connections 2024-09-21T07:27:34.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- 172.21.15.64:0/1339041086 wait complete. 2024-09-21T07:27:34.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 Processor -- start 2024-09-21T07:27:34.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.467+0000 7f83dbc00640 1 -- start start 2024-09-21T07:27:34.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b8004810 0x7f83d40b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:34.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d41f9600 0x7f83d4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:34.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:34.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4072e20 con 0x7f83d40cb520 2024-09-21T07:27:34.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83d40b4ae0 con 0x7f83d41f9600 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f83d4072fa0 con 0x7f83b8004810 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34238/0 (socket says 172.21.15.64:34238) 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 -- 172.21.15.64:0/3047213371 learned_addr learned my addr 172.21.15.64:0/3047213371 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 -- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b8004810 msgr2=0x7f83d40b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b8004810 0x7f83d40b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 -- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d41f9600 msgr2=0x7f83d4155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d41f9600 0x7f83d4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 -- 172.21.15.64:0/3047213371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d40b7160 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d9c00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f83d4072dd0 tx=0x7f83cc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc004b30 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83cc004cd0 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d40cbe70 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc003be0 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d40ad270 con 0x7f83d40cb520 2024-09-21T07:27:34.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.471+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d40b73a0 con 0x7f83d40cb520 2024-09-21T07:27:34.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.475+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f83cc004030 con 0x7f83d40cb520 2024-09-21T07:27:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.475+0000 7f83d1600640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 0x7f83b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.475+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f83cc094a80 con 0x7f83d40cb520 2024-09-21T07:27:34.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.475+0000 7f83d9200640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 0x7f83b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:34.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.475+0000 7f83d9200640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 0x7f83b0075710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83c40058d0 tx=0x7f83c4005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:34.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.479+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f83cc096e20 con 0x7f83d40cb520 2024-09-21T07:27:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.695+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83d409da20 con 0x7f83d40cb520 2024-09-21T07:27:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.695+0000 7f83d1600640 1 -- 172.21.15.64:0/3047213371 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5226 (secure 0 0 0) 0x7f83d40cbe70 con 0x7f83d40cb520 2024-09-21T07:27:34.697 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:34.697 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":60,"btime":"2024-09-21T07:27:33:595445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:33.595434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6996,"qdb_cluster":[6996]},"id":5}]} 2024-09-21T07:27:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 60 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 msgr2=0x7f83b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 0x7f83b0075710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83c40058d0 tx=0x7f83c4005860 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 msgr2=0x7f83d40cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f83d4072dd0 tx=0x7f83cc00f3c0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 shutdown_connections 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f83b0073200 0x7f83b0075710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83d40cb520 0x7f83d40cb930 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d41f9600 0x7f83d4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 --2- 172.21.15.64:0/3047213371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b8004810 0x7f83d40b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 >> 172.21.15.64:0/3047213371 conn(0x7f83d40ccbe0 msgr2=0x7f83d409abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 shutdown_connections 2024-09-21T07:27:34.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:34.699+0000 7f83dbc00640 1 -- 172.21.15.64:0/3047213371 wait complete. 2024-09-21T07:27:35.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:27:18.794425+0000', 'modified': '2024-09-21T07:27:33.595434+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6996}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6996': {'gid': 6996, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6835/3463091313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3463091313}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3463091313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6996, 'qdb_cluster': [6996]} 2024-09-21T07:27:35.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:27:35.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 -- 172.21.15.64:0/3149570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0ce730 msgr2=0x7f863c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 --2- 172.21.15.64:0/3149570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0ce730 0x7f863c0ceb40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f863c070f10 tx=0x7f863401cd80 comp rx=0 tx=0).stop 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 -- 172.21.15.64:0/3149570588 shutdown_connections 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 --2- 172.21.15.64:0/3149570588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0ce730 0x7f863c0ceb40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 --2- 172.21.15.64:0/3149570588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0b3910 0x7f863c0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 --2- 172.21.15.64:0/3149570588 >> v2:172.21.15.90:3300/0 conn(0x7f863c09df30 0x7f863c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 -- 172.21.15.64:0/3149570588 >> 172.21.15.64:0/3149570588 conn(0x7f863c06d450 msgr2=0x7f863c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 -- 172.21.15.64:0/3149570588 shutdown_connections 2024-09-21T07:27:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.283+0000 7f8641800640 1 -- 172.21.15.64:0/3149570588 wait complete. 2024-09-21T07:27:35.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 Processor -- start 2024-09-21T07:27:35.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- start start 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f863c09df30 0x7f863c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0ce730 0x7f863c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f863c06fa10 con 0x7f863c0b3910 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f863c06f890 con 0x7f863c09df30 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f863c06fb90 con 0x7f863c0ce730 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55006/0 (socket says 172.21.15.64:55006) 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 -- 172.21.15.64:0/3505773496 learned_addr learned my addr 172.21.15.64:0/3505773496 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f863aa00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f863c09df30 0x7f863c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f863b400640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0ce730 0x7f863c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 -- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0ce730 msgr2=0x7f863c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0ce730 0x7f863c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 -- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f863c09df30 msgr2=0x7f863c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f863c09df30 0x7f863c0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 -- 172.21.15.64:0/3505773496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c1564a0 con 0x7f863c0b3910 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8633e00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f862400d700 tx=0x7f862400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8632a00640 1 -- 172.21.15.64:0/3505773496 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624017070 con 0x7f863c0b3910 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8632a00640 1 -- 172.21.15.64:0/3505773496 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8624009b10 con 0x7f863c0b3910 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c156ce0 con 0x7f863c0b3910 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8632a00640 1 -- 172.21.15.64:0/3505773496 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624010460 con 0x7f863c0b3910 2024-09-21T07:27:35.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.287+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c156720 con 0x7f863c0b3910 2024-09-21T07:27:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f8632a00640 1 -- 172.21.15.64:0/3505773496 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f862401a070 con 0x7f863c0b3910 2024-09-21T07:27:35.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f8632a00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 0x7f8618075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f8632a00640 1 -- 172.21.15.64:0/3505773496 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f86240945e0 con 0x7f863c0b3910 2024-09-21T07:27:35.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f8648f0a000 1 Processor -- start 2024-09-21T07:27:35.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f863aa00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 0x7f8618075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.291+0000 7f8648f0a000 1 -- start start 2024-09-21T07:27:35.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863aa00640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 0x7f8618075740 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f862c005fd0 tx=0x7f862c00b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e10be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591c5ce5410 con 0x5591c5ca8ca0 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5591c5c22b40 con 0x5591c58cf460 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5591c5c11f70 con 0x5591c5cbf950 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55016/0 (socket says 172.21.15.64:55016) 2024-09-21T07:27:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 -- 172.21.15.64:0/921828236 learned_addr learned my addr 172.21.15.64:0/921828236 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8633e00640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e10be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863aa00640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 -- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 msgr2=0x5591c5e10be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e10be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 -- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 msgr2=0x5591c5e106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 -- 172.21.15.64:0/921828236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591c5bd95b0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863aa00640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f863b400640 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f86340b0040 tx=0x7f8634019b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c17697ed9c2433e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f862b400640 1 -- 172.21.15.64:0/921828236 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86340b2040 con 0x5591c5ca8ca0 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f862b400640 1 -- 172.21.15.64:0/921828236 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634004a50 con 0x5591c5ca8ca0 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f862b400640 1 -- 172.21.15.64:0/921828236 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634004e40 con 0x5591c5ca8ca0 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- 172.21.15.64:0/921828236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 msgr2=0x5591c5e11120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f86340b0040 tx=0x7f8634019b20 comp rx=0 tx=0).stop 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- 172.21.15.64:0/921828236 shutdown_connections 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e11120 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e10be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 --2- 172.21.15.64:0/921828236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- 172.21.15.64:0/921828236 >> 172.21.15.64:0/921828236 conn(0x5591c5d95d90 msgr2=0x5591c5dc5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- 172.21.15.64:0/921828236 shutdown_connections 2024-09-21T07:27:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.295+0000 7f8648f0a000 1 -- 172.21.15.64:0/921828236 wait complete. 2024-09-21T07:27:35.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- start start 2024-09-21T07:27:35.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 Processor -- start 2024-09-21T07:27:35.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e17920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591c5bac5f0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5591c5c15d80 con 0x5591c58cf460 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5591c5bb8520 con 0x5591c5cbf950 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 10 client.0 _ll_register_callbacks cb 0x5591c5bbc830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55032/0 (socket says 172.21.15.64:55032) 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 -- 172.21.15.64:0/9541629 learned_addr learned my addr 172.21.15.64:0/9541629 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f863aa00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e17920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f863b400640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 -- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 msgr2=0x5591c5e183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 -- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 msgr2=0x5591c5e17920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e17920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 -- 172.21.15.64:0/9541629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591c5bb0190 con 0x5591c5ca8ca0 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8633e00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f862400d6d0 tx=0x7f862405e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cfedd13cce03b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f861fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624021040 con 0x5591c5ca8ca0 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f8624084120 con 0x5591c5ca8ca0 2024-09-21T07:27:35.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591c5baa110 con 0x5591c5ca8ca0 2024-09-21T07:27:35.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8624063790 con 0x5591c5ca8ca0 2024-09-21T07:27:35.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 10 client.7032 fetch_fsmap learned FSMap version 60 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5591c5c96f10 con 0x5591c5ca8ca0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.299+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5591c5baa110 con 0x5591c5ca8ca0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f862404c1b0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 10 client.7032 fetch_fsmap finished waiting for FSMap version 60 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 10 client.7032 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 20 client.7032 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58b47d0 0x5591c5e21d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 4 client.7032 mds_command: new command op to 6996 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 --> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591c5c24a90 con 0x5591c58b47d0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f863aa00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58b47d0 0x5591c5e21d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f863aa00640 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58b47d0 0x5591c5e21d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96accfb7fc762b4 server_cookie=db8462c1b2d143bd in_seq=0 out_seq=0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f861fe00640 10 client.7032 ms_handle_connect on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f861fe00640 1 -- 172.21.15.64:0/9541629 <== mds.0 v2:172.21.15.64:6834/3463091313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591c5c24a90 con 0x5591c58b47d0 2024-09-21T07:27:35.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f861fe00640 10 client.7032 handle_command_reply: tid=0 2024-09-21T07:27:35.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 client.7032 shutdown 2024-09-21T07:27:35.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 msgr2=0x5591c5e17e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f862400d6d0 tx=0x7f862405e5c0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 shutdown_connections 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58b47d0 0x5591c5e21d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5cbf950 0x5591c5e183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e17e60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f861fe00640 0 client.7032 ms_handle_reset on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 --2- 172.21.15.64:0/9541629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e17920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 >> 172.21.15.64:0/9541629 conn(0x5591c5d95d90 msgr2=0x5591c5dcc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 shutdown_connections 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 1 -- 172.21.15.64:0/9541629 wait complete. 2024-09-21T07:27:35.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.303+0000 7f8648f0a000 20 client.7032 trim_cache size 0 max 16384 2024-09-21T07:27:35.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 Processor -- start 2024-09-21T07:27:35.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 -- start start 2024-09-21T07:27:35.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5d95d90 0x5591c5e82620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e82b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f863c205c10 con 0x5591c5ca8ca0 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f863c204c80 con 0x5591c58cf460 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f863c204030 con 0x5591c5d95d90 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f863b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f863b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55034/0 (socket says 172.21.15.64:55034) 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.323+0000 7f863b400640 1 -- 172.21.15.64:0/2999535923 learned_addr learned my addr 172.21.15.64:0/2999535923 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863aa00640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5d95d90 0x5591c5e82620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8633e00640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e82b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 -- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5d95d90 msgr2=0x5591c5e82620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5d95d90 0x5591c5e82620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 -- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 msgr2=0x5591c5e82b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e82b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 -- 172.21.15.64:0/2999535923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591c5c6ddb0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8633e00640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e82b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f863b400640 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f863401c7f0 tx=0x7f86340095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec3673662502e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f862aa00640 1 -- 172.21.15.64:0/2999535923 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86340c7070 con 0x5591c5ca8ca0 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f862aa00640 1 -- 172.21.15.64:0/2999535923 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634004d60 con 0x5591c5ca8ca0 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f862aa00640 1 -- 172.21.15.64:0/2999535923 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86340b2040 con 0x5591c5ca8ca0 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- 172.21.15.64:0/2999535923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 msgr2=0x5591c5e830a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f863401c7f0 tx=0x7f86340095c0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- 172.21.15.64:0/2999535923 shutdown_connections 2024-09-21T07:27:35.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e830a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c58cf460 0x5591c5e82b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 --2- 172.21.15.64:0/2999535923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c5d95d90 0x5591c5e82620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- 172.21.15.64:0/2999535923 >> 172.21.15.64:0/2999535923 conn(0x5591c5dcc740 msgr2=0x5591c5e0e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- 172.21.15.64:0/2999535923 shutdown_connections 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- 172.21.15.64:0/2999535923 wait complete. 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 -- start start 2024-09-21T07:27:35.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.327+0000 7f8648f0a000 1 Processor -- start 2024-09-21T07:27:35.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c58cf460 0x5591c5e865a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c5d95d90 0x5591c5e87020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5591c5bac5f0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f863c204630 con 0x5591c5d95d90 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5591c5bddee0 con 0x5591c58cf460 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 10 client.0 _ll_register_callbacks cb 0x7f86340b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55046/0 (socket says 172.21.15.64:55046) 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 -- 172.21.15.64:0/954140349 learned_addr learned my addr 172.21.15.64:0/954140349 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f863aa00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c58cf460 0x5591c5e865a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f863b400640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c5d95d90 0x5591c5e87020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 -- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c58cf460 msgr2=0x5591c5e865a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c58cf460 0x5591c5e865a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 -- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c5d95d90 msgr2=0x5591c5e87020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c5d95d90 0x5591c5e87020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 -- 172.21.15.64:0/954140349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591c5bd8ab0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8633e00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f862405ec40 tx=0x7f862405e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7212eac3a79ba444 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624021070 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f862405dfc0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8634004d60 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f862407a080 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 10 client.7038 fetch_fsmap learned FSMap version 60 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5591c5bb7070 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634004d60 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f862405a6b0 con 0x5591c5ca8ca0 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 10 client.7038 fetch_fsmap finished waiting for FSMap version 60 2024-09-21T07:27:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 10 client.7038 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:27:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 20 client.7038 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58cde80 0x5591c5e42610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 4 client.7038 mds_command: new command op to 6996 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:27:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 --> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] -- command(tid 0: {"prefix": "status"}) -- 0x5591c5c20540 con 0x5591c58cde80 2024-09-21T07:27:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f863aa00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58cde80 0x5591c5e42610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f863aa00640 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58cde80 0x5591c5e42610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59a096d9159e0842 server_cookie=27b4b87774a32512 in_seq=0 out_seq=0 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 10 client.7038 ms_handle_connect on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 1 -- 172.21.15.64:0/954140349 <== mds.0 v2:172.21.15.64:6834/3463091313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5591c5c20540 con 0x5591c58cde80 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 10 client.7038 handle_command_reply: tid=0 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 client.7038 shutdown 2024-09-21T07:27:35.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 msgr2=0x5591c5e86ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f862405ec40 tx=0x7f862405e540 comp rx=0 tx=0).stop 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 shutdown_connections 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x5591c58cde80 0x5591c5e42610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5591c5d95d90 0x5591c5e87020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5591c5ca8ca0 0x5591c5e86ae0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 --2- 172.21.15.64:0/954140349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5591c58cf460 0x5591c5e865a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 >> 172.21.15.64:0/954140349 conn(0x5591c5dcc740 msgr2=0x5591c5e216a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f861fe00640 0 client.7038 ms_handle_reset on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 shutdown_connections 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 1 -- 172.21.15.64:0/954140349 wait complete. 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.331+0000 7f8648f0a000 20 client.7038 trim_cache size 0 max 16384 2024-09-21T07:27:35.338 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 6996, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 4.7522814249999996, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 60, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 87, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 87, 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 5.5730235749999997 2024-09-21T07:27:35.339 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 msgr2=0x7f8618075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 0x7f8618075740 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f862c005fd0 tx=0x7f862c00b260 comp rx=0 tx=0).stop 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 msgr2=0x7f863c15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f862400d700 tx=0x7f862400dbc0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 shutdown_connections 2024-09-21T07:27:35.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8618073230 0x7f8618075740 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f863c0ce730 0x7f863c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f863c0b3910 0x7f863c15b660 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 --2- 172.21.15.64:0/3505773496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f863c09df30 0x7f863c0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 >> 172.21.15.64:0/3505773496 conn(0x7f863c06d450 msgr2=0x7f863c06fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 shutdown_connections 2024-09-21T07:27:35.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.335+0000 7f8641800640 1 -- 172.21.15.64:0/3505773496 wait complete. 2024-09-21T07:27:35.355 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- 172.21.15.64:0/1064140820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700cbcd0 msgr2=0x7fb5700cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 --2- 172.21.15.64:0/1064140820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700cbcd0 0x7fb5700cc0e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb568009bc0 tx=0x7fb56801cb70 comp rx=0 tx=0).stop 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- 172.21.15.64:0/1064140820 shutdown_connections 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 --2- 172.21.15.64:0/1064140820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700cbcd0 0x7fb5700cc0e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 --2- 172.21.15.64:0/1064140820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b1be0 0x7fb5700b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- 172.21.15.64:0/1064140820 >> 172.21.15.64:0/1064140820 conn(0x7fb5700ccbe0 msgr2=0x7fb5700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- 172.21.15.64:0/1064140820 shutdown_connections 2024-09-21T07:27:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- 172.21.15.64:0/1064140820 wait complete. 2024-09-21T07:27:35.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 Processor -- start 2024-09-21T07:27:35.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.515+0000 7fb575000640 1 -- start start 2024-09-21T07:27:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700cbcd0 0x7fb57014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57015cbd0 0x7fb5701fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700b4240 con 0x7fb5700b1be0 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700b40c0 con 0x7fb57015cbd0 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb57016a290 con 0x7fb5700cbcd0 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55076/0 (socket says 172.21.15.64:55076) 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 -- 172.21.15.64:0/919174430 learned_addr learned my addr 172.21.15.64:0/919174430 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb567e00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700cbcd0 0x7fb57014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56e800640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57015cbd0 0x7fb5701fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 -- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700cbcd0 msgr2=0x7fb57014d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700cbcd0 0x7fb57014d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 -- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57015cbd0 msgr2=0x7fb5701fa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57015cbd0 0x7fb5701fa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 -- 172.21.15.64:0/919174430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb570158330 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb56de00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c730 tx=0x7fb56000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560016020 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb56000a950 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ada0 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb570158610 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5701515b0 con 0x7fb5700b1be0 2024-09-21T07:27:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.519+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5700b1ff0 con 0x7fb5700b1be0 2024-09-21T07:27:35.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.523+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb560019020 con 0x7fb5700b1be0 2024-09-21T07:27:35.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.523+0000 7fb566000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:35.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.523+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7fb5600942b0 con 0x7fb5700b1be0 2024-09-21T07:27:35.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.523+0000 7fb567e00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:35.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.523+0000 7fb567e00640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb570051100 tx=0x7fb55800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:35.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.527+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb560020020 con 0x7fb5700b1be0 2024-09-21T07:27:35.585 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:27:35.583+0000 7fc5ad600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:27:35.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb57009dde0 con 0x7fb5700b1be0 2024-09-21T07:27:35.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb566000640 1 -- 172.21.15.64:0/919174430 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7fb5700b2530 con 0x7fb5700b1be0 2024-09-21T07:27:35.745 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:27:35.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 msgr2=0x7fb54c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb570051100 tx=0x7fb55800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 msgr2=0x7fb570154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:35.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c730 tx=0x7fb56000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 shutdown_connections 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57015cbd0 0x7fb5701fa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700cbcd0 0x7fb57014d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 --2- 172.21.15.64:0/919174430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700b1be0 0x7fb570154020 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 >> 172.21.15.64:0/919174430 conn(0x7fb5700ccbe0 msgr2=0x7fb570155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 shutdown_connections 2024-09-21T07:27:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35.743+0000 7fb575000640 1 -- 172.21.15.64:0/919174430 wait complete. 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:27:35.768 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:35.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:35.768 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:35.778 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42128sec preferred_lft 42128sec 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.779 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:27:35.780 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:27:35.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:35.781 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:27:35.845 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:27:35.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:35.848 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:27:35.907 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:27:35.908 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:27:35.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:27:36.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:27:36.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:36.047 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:27:36.103 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:27:36.103 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:27:36.104 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:36.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:36.105 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:27:36.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:27:36.167 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:36.215 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:27:36.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:27:36.215 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:36.270 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:27:36.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:36.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:36.372 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:36.372 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:27:36.386 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:27:36.386 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:27:36.386 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:27:36.386 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:27:36.387 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:27:36.390 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:27:36.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:36.391 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:36.410 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:27:36.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:27:36.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:27:36.509 INFO:teuthology.orchestra.run.smithi064.stdout:client7050 2024-09-21T07:27:36.509 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:36.509 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:36.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:36.518 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-21T07:27:36.572 INFO:teuthology.orchestra.run.smithi064.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-21T07:27:36.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:36.573 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-21T07:27:36.573 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-21T07:27:36.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 -- 172.21.15.64:0/2206879130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26bc005280 msgr2=0x7f26bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 --2- 172.21.15.64:0/2206879130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26bc005280 0x7f26bc00b9d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f26d0001dc0 tx=0x7f26d001cb30 comp rx=0 tx=0).stop 2024-09-21T07:27:36.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26d6800640 1 -- 172.21.15.64:0/2206879130 reap_dead start 2024-09-21T07:27:36.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 -- 172.21.15.64:0/2206879130 shutdown_connections 2024-09-21T07:27:36.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 -- 172.21.15.64:0/2206879130 >> 172.21.15.64:0/2206879130 conn(0x7f26d80d0170 msgr2=0x7f26d80d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 -- 172.21.15.64:0/2206879130 shutdown_connections 2024-09-21T07:27:36.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.775+0000 7f26dcc00640 1 -- 172.21.15.64:0/2206879130 wait complete. 2024-09-21T07:27:36.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 Processor -- start 2024-09-21T07:27:36.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 -- start start 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26bc005280 0x7f26d80ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81465d0 0x7f26d80b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8159640 con 0x7f26d80b0df0 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26d81594c0 con 0x7f26d81465d0 2024-09-21T07:27:36.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26dcc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f26d80aee20 con 0x7f26bc005280 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55098/0 (socket says 172.21.15.64:55098) 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 -- 172.21.15.64:0/1722987675 learned_addr learned my addr 172.21.15.64:0/1722987675 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d5e00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26bc005280 0x7f26d80ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26cd400640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81465d0 0x7f26d80b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 -- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26bc005280 msgr2=0x7f26d80ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26bc005280 0x7f26d80ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 -- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81465d0 msgr2=0x7f26d80b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.779+0000 7f26d6800640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81465d0 0x7f26d80b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26d6800640 1 -- 172.21.15.64:0/1722987675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d80b1740 con 0x7f26d80b0df0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26d6800640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f26d0001dc0 tx=0x7f26d0006e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26cea00640 1 -- 172.21.15.64:0/1722987675 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0003d90 con 0x7f26d80b0df0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26cea00640 1 -- 172.21.15.64:0/1722987675 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d00011d0 con 0x7f26d80b0df0 2024-09-21T07:27:36.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d80caac0 con 0x7f26d80b0df0 2024-09-21T07:27:36.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26cea00640 1 -- 172.21.15.64:0/1722987675 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0006330 con 0x7f26d80b0df0 2024-09-21T07:27:36.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d80cb080 con 0x7f26d80b0df0 2024-09-21T07:27:36.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.783+0000 7f26cea00640 1 -- 172.21.15.64:0/1722987675 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f26d00064d0 con 0x7f26d80b0df0 2024-09-21T07:27:36.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26cea00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 0x7f26b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26cea00640 1 -- 172.21.15.64:0/1722987675 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f26d012dee0 con 0x7f26d80b0df0 2024-09-21T07:27:36.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 Processor -- start 2024-09-21T07:27:36.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d5e00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 0x7f26b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 -- start start 2024-09-21T07:27:36.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d5e00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 0x7f26b4075740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26c8000fc0 tx=0x7f26c80067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b831a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b831f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564a3b643e80 con 0x564a3b3e0da0 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564a3b6332b0 con 0x564a3b6bf640 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564a3b6370c0 con 0x564a3b6b8340 2024-09-21T07:27:36.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55106/0 (socket says 172.21.15.64:55106) 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 -- 172.21.15.64:0/200108621 learned_addr learned my addr 172.21.15.64:0/200108621 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 -- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 msgr2=0x564a3b831f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b831f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 -- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 msgr2=0x564a3b831a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b831a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 -- 172.21.15.64:0/200108621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3b5dbfe0 con 0x564a3b3e0da0 2024-09-21T07:27:36.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26d6800640 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f26d00ab040 tx=0x7f26d0006f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19cbcbf0be8162e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26c6600640 1 -- 172.21.15.64:0/200108621 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d00bd070 con 0x564a3b3e0da0 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26c6600640 1 -- 172.21.15.64:0/200108621 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d00a9040 con 0x564a3b3e0da0 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26c6600640 1 -- 172.21.15.64:0/200108621 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d00f85b0 con 0x564a3b3e0da0 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 -- 172.21.15.64:0/200108621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 msgr2=0x564a3b8324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.787+0000 7f26e42fd000 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f26d00ab040 tx=0x7f26d0006f00 comp rx=0 tx=0).stop 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- 172.21.15.64:0/200108621 shutdown_connections 2024-09-21T07:27:36.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8324c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b831f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- 172.21.15.64:0/200108621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b831a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- 172.21.15.64:0/200108621 >> 172.21.15.64:0/200108621 conn(0x564a3b2f0010 msgr2=0x564a3b7e6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- 172.21.15.64:0/200108621 shutdown_connections 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- 172.21.15.64:0/200108621 wait complete. 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- start start 2024-09-21T07:27:36.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 Processor -- start 2024-09-21T07:27:36.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b3e0da0 0x564a3b7f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b7f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564a3b5d8760 con 0x564a3b6b8340 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564a3b646ab0 con 0x564a3b6bf640 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564a3b6f32d0 con 0x564a3b3e0da0 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26e42fd000 10 client.0 _ll_register_callbacks cb 0x564a3b6985c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55108/0 (socket says 172.21.15.64:55108) 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 -- 172.21.15.64:0/572695625 learned_addr learned my addr 172.21.15.64:0/572695625 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26d5e00640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b3e0da0 0x564a3b7f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26d6800640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b7f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 -- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b3e0da0 msgr2=0x564a3b7f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b3e0da0 0x564a3b7f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 -- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 msgr2=0x564a3b7f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b7f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 -- 172.21.15.64:0/572695625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3b5d1550 con 0x564a3b6b8340 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26d6800640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b7f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26cd400640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f26c0003880 tx=0x7f26c0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca1f0d1a50d7eea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.791+0000 7f26baa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c001b440 con 0x564a3b6b8340 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a3b5cb690 con 0x564a3b6b8340 2024-09-21T07:27:36.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f26c001b5e0 con 0x564a3b6b8340 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f26c001b7e0 con 0x564a3b6b8340 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 10 client.7062 fetch_fsmap learned FSMap version 60 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x564a3b5fcdb0 con 0x564a3b6b8340 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564a3b5cb690 con 0x564a3b6b8340 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f26c0019020 con 0x564a3b6b8340 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 10 client.7062 fetch_fsmap finished waiting for FSMap version 60 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 10 client.7062 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 20 client.7062 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:36.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2d5c30 0x564a3b843000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 4 client.7062 mds_command: new command op to 6996 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 --> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a3b645dd0 con 0x564a3b2d5c30 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26d5e00640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2d5c30 0x564a3b843000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26d5e00640 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2d5c30 0x564a3b843000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09b3b1bdc21e0f9 server_cookie=c0c3dac67193e573 in_seq=0 out_seq=0 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 10 client.7062 ms_handle_connect on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 1 -- 172.21.15.64:0/572695625 <== mds.0 v2:172.21.15.64:6834/3463091313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a3b645dd0 con 0x564a3b2d5c30 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 10 client.7062 handle_command_reply: tid=0 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 client.7062 shutdown 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 msgr2=0x564a3b7f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f26c0003880 tx=0x7f26c0003d40 comp rx=0 tx=0).stop 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 shutdown_connections 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2d5c30 0x564a3b843000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b7f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b6b8340 0x564a3b7f41a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26baa00640 0 client.7062 ms_handle_reset on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:36.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 --2- 172.21.15.64:0/572695625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b3e0da0 0x564a3b7f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 >> 172.21.15.64:0/572695625 conn(0x564a3b2f0010 msgr2=0x564a3b7edb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 shutdown_connections 2024-09-21T07:27:36.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 1 -- 172.21.15.64:0/572695625 wait complete. 2024-09-21T07:27:36.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.795+0000 7f26e42fd000 20 client.7062 trim_cache size 0 max 16384 2024-09-21T07:27:36.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 Processor -- start 2024-09-21T07:27:36.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 -- start start 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6b8340 0x564a3b8a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6bf640 0x564a3b8a4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8201f60 con 0x564a3b3e0da0 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26d81f9fd0 con 0x564a3b6b8340 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f26d8201ad0 con 0x564a3b6bf640 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55124/0 (socket says 172.21.15.64:55124) 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 -- 172.21.15.64:0/3729320720 learned_addr learned my addr 172.21.15.64:0/3729320720 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d6800640 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6bf640 0x564a3b8a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26cd400640 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6b8340 0x564a3b8a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 -- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6bf640 msgr2=0x564a3b8a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6bf640 0x564a3b8a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 -- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6b8340 msgr2=0x564a3b8a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6b8340 0x564a3b8a3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.815+0000 7f26d5e00640 1 -- 172.21.15.64:0/3729320720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3b5b8470 con 0x564a3b3e0da0 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26d5e00640 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005d10 tx=0x7f26c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621806b6a663011e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26c5c00640 1 -- 172.21.15.64:0/3729320720 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c802b070 con 0x564a3b3e0da0 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26c5c00640 1 -- 172.21.15.64:0/3729320720 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26c80036c0 con 0x564a3b3e0da0 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26c5c00640 1 -- 172.21.15.64:0/3729320720 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8003ad0 con 0x564a3b3e0da0 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- 172.21.15.64:0/3729320720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 msgr2=0x564a3b8a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005d10 tx=0x7f26c8014000 comp rx=0 tx=0).stop 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- 172.21.15.64:0/3729320720 shutdown_connections 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6bf640 0x564a3b8a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6b8340 0x564a3b8a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- 172.21.15.64:0/3729320720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a39a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- 172.21.15.64:0/3729320720 >> 172.21.15.64:0/3729320720 conn(0x564a3b2f0010 msgr2=0x564a3b841890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- 172.21.15.64:0/3729320720 shutdown_connections 2024-09-21T07:27:36.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- 172.21.15.64:0/3729320720 wait complete. 2024-09-21T07:27:36.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- start start 2024-09-21T07:27:36.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 Processor -- start 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b8a8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b8a8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564a3b5b7ac0 con 0x564a3b3e0da0 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564a3b642c50 con 0x564a3b6bf640 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564a3b6363d0 con 0x564a3b6b8340 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.819+0000 7f26e42fd000 10 client.0 _ll_register_callbacks cb 0x7f26c0005750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:27:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55128/0 (socket says 172.21.15.64:55128) 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 -- 172.21.15.64:0/2908780447 learned_addr learned my addr 172.21.15.64:0/2908780447 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d6800640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b8a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26cd400640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b8a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 -- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 msgr2=0x564a3b8a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b8a8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 -- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 msgr2=0x564a3b8a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b8a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 -- 172.21.15.64:0/2908780447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3b5f79a0 con 0x564a3b3e0da0 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26d5e00640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005990 tx=0x7f26c8000ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924f4cc65f382680 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:27:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c802b070 con 0x564a3b3e0da0 2024-09-21T07:27:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f26c80055d0 con 0x564a3b3e0da0 2024-09-21T07:27:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c80036c0 con 0x564a3b3e0da0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f26c8042050 con 0x564a3b3e0da0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 10 client.7068 fetch_fsmap learned FSMap version 60 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x564a3b5c98f0 con 0x564a3b3e0da0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26c80036c0 con 0x564a3b3e0da0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f26c8031460 con 0x564a3b3e0da0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 10 client.7068 fetch_fsmap finished waiting for FSMap version 60 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 10 client.7068 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 20 client.7068 populate_metadata read hostname 'smithi064' 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2c3c90 0x564a3b863380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 4 client.7068 mds_command: new command op to 6996 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 --> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x564a3b641880 con 0x564a3b2c3c90 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26cd400640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2c3c90 0x564a3b863380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26cd400640 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2c3c90 0x564a3b863380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e6c5c3d5ebf3fe server_cookie=15c95a7c5582357d in_seq=0 out_seq=0 2024-09-21T07:27:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 10 client.7068 ms_handle_connect on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 1 -- 172.21.15.64:0/2908780447 <== mds.0 v2:172.21.15.64:6834/3463091313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564a3b641880 con 0x564a3b2c3c90 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 10 client.7068 handle_command_reply: tid=0 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 client.7068 shutdown 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 msgr2=0x564a3b8a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005990 tx=0x7f26c8000ff0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 shutdown_connections 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:6834/3463091313,v1:172.21.15.64:6835/3463091313] conn(0x564a3b2c3c90 0x564a3b863380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a3b6bf640 0x564a3b8a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564a3b6b8340 0x564a3b8a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26baa00640 0 client.7068 ms_handle_reset on v2:172.21.15.64:6834/3463091313 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 --2- 172.21.15.64:0/2908780447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564a3b3e0da0 0x564a3b8a7af0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 >> 172.21.15.64:0/2908780447 conn(0x564a3b2f0010 msgr2=0x564a3b7e6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 shutdown_connections 2024-09-21T07:27:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.823+0000 7f26e42fd000 1 -- 172.21.15.64:0/2908780447 wait complete. 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26e42fd000 20 client.7068 trim_cache size 0 max 16384 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "1a8a4a57-971d-49bc-9ed5-35a52b2dd8d1", 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:27:36.830 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 msgr2=0x7f26b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 0x7f26b4075740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26c8000fc0 tx=0x7f26c80067b0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 msgr2=0x7f26d80b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f26d0001dc0 tx=0x7f26d0006e80 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 shutdown_connections 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f26b4073230 0x7f26b4075740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26d80b0df0 0x7f26d80b1200 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81465d0 0x7f26d80b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 --2- 172.21.15.64:0/1722987675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26bc005280 0x7f26d80ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 >> 172.21.15.64:0/1722987675 conn(0x7f26d80d0170 msgr2=0x7f26d80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:36.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 shutdown_connections 2024-09-21T07:27:36.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:36.827+0000 7f26dcc00640 1 -- 172.21.15.64:0/1722987675 wait complete. 2024-09-21T07:27:36.848 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '1a8a4a57-971d-49bc-9ed5-35a52b2dd8d1', 'mode': 'asynchronous'}' 2024-09-21T07:27:39.321 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:39.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:46.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:46.848 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-21T07:27:46.862 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:27:46.862 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:46.994 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:47.094 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:27:47.094 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:47.094 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:47.094 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:47.105 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:47.105 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:47.156 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:27:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- 172.21.15.64:0/1926210455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc1809df30 msgr2=0x7efc180b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 --2- 172.21.15.64:0/1926210455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc1809df30 0x7efc180b33d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7efc180cfc10 tx=0x7efc0801c8a0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- 172.21.15.64:0/1926210455 shutdown_connections 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 --2- 172.21.15.64:0/1926210455 >> v2:172.21.15.90:3300/0 conn(0x7efc180ce900 0x7efc1806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 --2- 172.21.15.64:0/1926210455 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc1809df30 0x7efc180b33d0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- 172.21.15.64:0/1926210455 >> 172.21.15.64:0/1926210455 conn(0x7efc1806d450 msgr2=0x7efc180d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- 172.21.15.64:0/1926210455 shutdown_connections 2024-09-21T07:27:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- 172.21.15.64:0/1926210455 wait complete. 2024-09-21T07:27:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 Processor -- start 2024-09-21T07:27:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.363+0000 7efc1fc00640 1 -- start start 2024-09-21T07:27:47.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc1809df30 0x7efc1815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc180ce900 0x7efc1809cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc18169000 con 0x7efc180b3910 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc18168e80 con 0x7efc180ce900 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efc18169180 con 0x7efc1809df30 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35716/0 (socket says 172.21.15.64:35716) 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 -- 172.21.15.64:0/2049785829 learned_addr learned my addr 172.21.15.64:0/2049785829 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1dc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc180ce900 0x7efc1809cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1d200640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc1809df30 0x7efc1815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 -- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc1809df30 msgr2=0x7efc1815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc1809df30 0x7efc1815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 -- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc180ce900 msgr2=0x7efc1809cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc180ce900 0x7efc1809cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 -- 172.21.15.64:0/2049785829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc181f9e50 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc0fe00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c3f0 tx=0x7efc0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00017070 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc000053c0 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00003860 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc180c8340 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc180c8900 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.367+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc181f9bc0 con 0x7efc180b3910 2024-09-21T07:27:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.371+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efc0001a070 con 0x7efc180b3910 2024-09-21T07:27:47.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.371+0000 7efc15600640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 0x7efbf4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.371+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7efc000937a0 con 0x7efc180b3910 2024-09-21T07:27:47.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.371+0000 7efc1d200640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 0x7efbf4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.371+0000 7efc1d200640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 0x7efbf4075740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efc080af000 tx=0x7efc0801b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:47.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.375+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efc00001090 con 0x7efc180b3910 2024-09-21T07:27:47.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.563+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efc180b33d0 con 0x7efc180b3910 2024-09-21T07:27:47.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.563+0000 7efc15600640 1 -- 172.21.15.64:0/2049785829 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v87) ==== 80+0+244 (secure 0 0 0) 0x7efc0005de90 con 0x7efc180b3910 2024-09-21T07:27:47.567 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.90:6837/3476229811 2024-09-22T07:27:30.567785+0000 2024-09-21T07:27:47.567 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.90:6836/3476229811 2024-09-22T07:27:30.567785+0000 2024-09-21T07:27:47.567 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6834/2439635016 2024-09-22T07:27:29.564914+0000 2024-09-21T07:27:47.567 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6832/2439635016 2024-09-22T07:27:29.564914+0000 2024-09-21T07:27:47.568 INFO:teuthology.orchestra.run.smithi064.stderr:listed 4 entries 2024-09-21T07:27:47.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 msgr2=0x7efbf4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 0x7efbf4075740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efc080af000 tx=0x7efc0801b0e0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 msgr2=0x7efc181f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c3f0 tx=0x7efc0000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 shutdown_connections 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbf4073230 0x7efbf4075740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc180ce900 0x7efc1809cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc180b3910 0x7efc181f9120 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 --2- 172.21.15.64:0/2049785829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc1809df30 0x7efc1815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 >> 172.21.15.64:0/2049785829 conn(0x7efc1806d450 msgr2=0x7efc180ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 shutdown_connections 2024-09-21T07:27:47.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.567+0000 7efc1fc00640 1 -- 172.21.15.64:0/2049785829 wait complete. 2024-09-21T07:27:47.590 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:27:47.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:47.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:27:47.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:27:47.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:27:47.619 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:27:47.668 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:47.668 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:47.668 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:47.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:47.677 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:47.677 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:47.677 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:47.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:47.720 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:27:47.720 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:47.720 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:47.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:47.729 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- 172.21.15.64:0/3252349523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c15edb0 msgr2=0x7fce6c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 --2- 172.21.15.64:0/3252349523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c15edb0 0x7fce6c0700b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fce6c06f220 tx=0x7fce6001c7e0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- 172.21.15.64:0/3252349523 shutdown_connections 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 --2- 172.21.15.64:0/3252349523 >> v2:172.21.15.90:3300/0 conn(0x7fce6c0709b0 0x7fce6c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 --2- 172.21.15.64:0/3252349523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c15edb0 0x7fce6c0700b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- 172.21.15.64:0/3252349523 >> 172.21.15.64:0/3252349523 conn(0x7fce6c0ccbe0 msgr2=0x7fce6c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- 172.21.15.64:0/3252349523 shutdown_connections 2024-09-21T07:27:47.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- 172.21.15.64:0/3252349523 wait complete. 2024-09-21T07:27:47.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 Processor -- start 2024-09-21T07:27:47.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.919+0000 7fce74000640 1 -- start start 2024-09-21T07:27:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 0x7fce6c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce6c15edb0 0x7fce6c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c168fb0 con 0x7fce6c0b4700 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c168e30 con 0x7fce6c0709b0 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fce6c169130 con 0x7fce6c15edb0 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35726/0 (socket says 172.21.15.64:35726) 2024-09-21T07:27:47.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 -- 172.21.15.64:0/3519302910 learned_addr learned my addr 172.21.15.64:0/3519302910 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce71600640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 0x7fce6c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 -- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce6c15edb0 msgr2=0x7fce6c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce6c15edb0 0x7fce6c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 -- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 msgr2=0x7fce6c09c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 0x7fce6c09c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 -- 172.21.15.64:0/3519302910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c1fd1d0 con 0x7fce6c0b4700 2024-09-21T07:27:47.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce71600640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 0x7fce6c09c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce70c00640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fce5800e7f0 tx=0x7fce5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5800ccc0 con 0x7fce6c0b4700 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce5800ce80 con 0x7fce6c0b4700 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c148c60 con 0x7fce6c0b4700 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58005280 con 0x7fce6c0b4700 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c149220 con 0x7fce6c0b4700 2024-09-21T07:27:47.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.923+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c0b41c0 con 0x7fce6c0b4700 2024-09-21T07:27:47.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.927+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce58005420 con 0x7fce6c0b4700 2024-09-21T07:27:47.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.927+0000 7fce69600640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 0x7fce4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:47.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.927+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7fce58094e80 con 0x7fce6c0b4700 2024-09-21T07:27:47.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.927+0000 7fce71600640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 0x7fce4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:47.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.927+0000 7fce71600640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 0x7fce4c075740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fce600af000 tx=0x7fce6001b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:47.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:47.931+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fce5805fc00 con 0x7fce6c0b4700 2024-09-21T07:27:48.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6c09da20 con 0x7fce6c0b4700 2024-09-21T07:27:48.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce69600640 1 -- 172.21.15.64:0/3519302910 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5226 (secure 0 0 0) 0x7fce5805f500 con 0x7fce6c0b4700 2024-09-21T07:27:48.148 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":60,"btime":"2024-09-21T07:27:33:595445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:33.595434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6996,"qdb_cluster":[6996]},"id":5}]} 2024-09-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 60 2024-09-21T07:27:48.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 msgr2=0x7fce4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 0x7fce4c075740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fce600af000 tx=0x7fce6001b020 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 msgr2=0x7fce6c146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fce5800e7f0 tx=0x7fce5800ecb0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 shutdown_connections 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce4c073230 0x7fce4c075740 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce6c15edb0 0x7fce6c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce6c0b4700 0x7fce6c146070 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 --2- 172.21.15.64:0/3519302910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0709b0 0x7fce6c09c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 >> 172.21.15.64:0/3519302910 conn(0x7fce6c0ccbe0 msgr2=0x7fce6c0ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 shutdown_connections 2024-09-21T07:27:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.147+0000 7fce74000640 1 -- 172.21.15.64:0/3519302910 wait complete. 2024-09-21T07:27:48.172 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 -- 172.21.15.64:0/432293977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e080b48d0 msgr2=0x7f5e08072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 --2- 172.21.15.64:0/432293977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e080b48d0 0x7f5e08072e20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5e080c3c60 tx=0x7f5e0001cd80 comp rx=0 tx=0).stop 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 -- 172.21.15.64:0/432293977 shutdown_connections 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 --2- 172.21.15.64:0/432293977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e080b48d0 0x7f5e08072e20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 --2- 172.21.15.64:0/432293977 >> v2:172.21.15.90:3300/0 conn(0x7f5e0815edb0 0x7f5e080700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 -- 172.21.15.64:0/432293977 >> 172.21.15.64:0/432293977 conn(0x7f5e080ccbe0 msgr2=0x7f5e080ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 -- 172.21.15.64:0/432293977 shutdown_connections 2024-09-21T07:27:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.327+0000 7f5e0e600640 1 -- 172.21.15.64:0/432293977 wait complete. 2024-09-21T07:27:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 Processor -- start 2024-09-21T07:27:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- start start 2024-09-21T07:27:48.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e080709b0 0x7f5e080af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e08164c30 0x7f5e081530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08168c00 con 0x7f5e0815edb0 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08168a80 con 0x7f5e08164c30 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5e08168d80 con 0x7f5e080709b0 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35744/0 (socket says 172.21.15.64:35744) 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 -- 172.21.15.64:0/2138959592 learned_addr learned my addr 172.21.15.64:0/2138959592 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e07400640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e080709b0 0x7f5e080af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e07e00640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e08164c30 0x7f5e081530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 -- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e080709b0 msgr2=0x7f5e080af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e080709b0 0x7f5e080af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 -- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e08164c30 msgr2=0x7f5e081530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e08164c30 0x7f5e081530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 -- 172.21.15.64:0/2138959592 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080ae8c0 con 0x7f5e0815edb0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dffe00640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f5df000b3e0 tx=0x7f5df000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0015020 con 0x7f5e0815edb0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5df0011940 con 0x7f5e0815edb0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e081fcc80 con 0x7f5e0815edb0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011d90 con 0x7f5e0815edb0 2024-09-21T07:27:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e08165690 con 0x7f5e0815edb0 2024-09-21T07:27:48.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.331+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e08072e20 con 0x7f5e0815edb0 2024-09-21T07:27:48.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.335+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5df0018020 con 0x7f5e0815edb0 2024-09-21T07:27:48.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.335+0000 7f5dff400640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 0x7f5de4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.335+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f5df0094130 con 0x7f5e0815edb0 2024-09-21T07:27:48.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.335+0000 7f5e07400640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 0x7f5de4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.335+0000 7f5e07400640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 0x7f5de4075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5df8006fd0 tx=0x7f5df8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:48.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.339+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5df001f030 con 0x7f5e0815edb0 2024-09-21T07:27:48.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.555+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e080b3430 con 0x7f5e0815edb0 2024-09-21T07:27:48.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.555+0000 7f5dff400640 1 -- 172.21.15.64:0/2138959592 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5226 (secure 0 0 0) 0x7f5df005ef00 con 0x7f5e0815edb0 2024-09-21T07:27:48.559 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:48.559 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":60,"btime":"2024-09-21T07:27:33:595445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:33.595434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6996,"qdb_cluster":[6996]},"id":5}]} 2024-09-21T07:27:48.559 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 60 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 msgr2=0x7f5de4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 0x7f5de4075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5df8006fd0 tx=0x7f5df8008040 comp rx=0 tx=0).stop 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 msgr2=0x7f5e0809c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f5df000b3e0 tx=0x7f5df000b8a0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 shutdown_connections 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5de4073200 0x7f5de4075710 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e08164c30 0x7f5e081530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e0815edb0 0x7f5e0809c310 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 --2- 172.21.15.64:0/2138959592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e080709b0 0x7f5e080af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 >> 172.21.15.64:0/2138959592 conn(0x7f5e080ccbe0 msgr2=0x7f5e080ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:48.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 shutdown_connections 2024-09-21T07:27:48.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.559+0000 7f5e0e600640 1 -- 172.21.15.64:0/2138959592 wait complete. 2024-09-21T07:27:48.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:48.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- 172.21.15.64:0/1010915113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac0b4400 msgr2=0x7f9cac0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 --2- 172.21.15.64:0/1010915113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac0b4400 0x7f9cac0d05b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009bc0 tx=0x7f9ca401cac0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- 172.21.15.64:0/1010915113 shutdown_connections 2024-09-21T07:27:48.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 --2- 172.21.15.64:0/1010915113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac0b4400 0x7f9cac0d05b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 --2- 172.21.15.64:0/1010915113 >> v2:172.21.15.90:3300/0 conn(0x7f9cac15a330 0x7f9cac160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- 172.21.15.64:0/1010915113 >> 172.21.15.64:0/1010915113 conn(0x7f9cac06d530 msgr2=0x7f9cac0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:48.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- 172.21.15.64:0/1010915113 shutdown_connections 2024-09-21T07:27:48.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- 172.21.15.64:0/1010915113 wait complete. 2024-09-21T07:27:48.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 Processor -- start 2024-09-21T07:27:48.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.743+0000 7f9cb2400640 1 -- start start 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac15a330 0x7f9cac159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cac15d500 0x7f9cac0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac16a3c0 con 0x7f9cac152880 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac16a240 con 0x7f9cac15d500 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac16a540 con 0x7f9cac15a330 2024-09-21T07:27:48.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35746/0 (socket says 172.21.15.64:35746) 2024-09-21T07:27:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 -- 172.21.15.64:0/2869282087 learned_addr learned my addr 172.21.15.64:0/2869282087 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cab400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac15a330 0x7f9cac159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9ca3e00640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cac15d500 0x7f9cac0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 -- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac15a330 msgr2=0x7f9cac159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac15a330 0x7f9cac159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 -- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cac15d500 msgr2=0x7f9cac0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cac15d500 0x7f9cac0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 -- 172.21.15.64:0/2869282087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac0b3700 con 0x7f9cac152880 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cabe00640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9ca401b170 tx=0x7f9ca4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40bb070 con 0x7f9cac152880 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac158970 con 0x7f9cac152880 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca4004d40 con 0x7f9cac152880 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40b2040 con 0x7f9cac152880 2024-09-21T07:27:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac158f30 con 0x7f9cac152880 2024-09-21T07:27:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.747+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac1603e0 con 0x7f9cac152880 2024-09-21T07:27:48.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.751+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ca40a5bb0 con 0x7f9cac152880 2024-09-21T07:27:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.751+0000 7f9ca3400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.751+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f9ca412dea0 con 0x7f9cac152880 2024-09-21T07:27:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.751+0000 7f9cab400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:48.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.751+0000 7f9cab400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009b40 tx=0x7f9c9c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:48.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.755+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9ca40166b0 con 0x7f9cac152880 2024-09-21T07:27:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.935+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cac0b3490 con 0x7f9cac152880 2024-09-21T07:27:48.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.935+0000 7f9ca3400640 1 -- 172.21.15.64:0/2869282087 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17216 (secure 0 0 0) 0x7f9ca40f8510 con 0x7f9cac152880 2024-09-21T07:27:48.938 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:48.938 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":87,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:30.567819+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:27:16.554525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-21T07:27:17.755507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6837/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.90:6836/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.64:6834/2439635016":"2024-09-22T07:27:29.564914+0000","172.21.15.64:6832/2439635016":"2024-09-22T07:27:29.564914+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 msgr2=0x7f9c88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009b40 tx=0x7f9c9c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 msgr2=0x7f9cac0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9ca401b170 tx=0x7f9ca4003f60 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 shutdown_connections 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9c88073200 0x7f9c88075710 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cac152880 0x7f9cac0c5d10 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cac15d500 0x7f9cac0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 --2- 172.21.15.64:0/2869282087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cac15a330 0x7f9cac159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:48.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 >> 172.21.15.64:0/2869282087 conn(0x7f9cac06d530 msgr2=0x7f9cac15c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:48.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 shutdown_connections 2024-09-21T07:27:48.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:48.939+0000 7f9cb2400640 1 -- 172.21.15.64:0/2869282087 wait complete. 2024-09-21T07:27:48.960 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:27:48.961 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:49.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 -- 172.21.15.64:0/47138800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40d1da0 msgr2=0x7fcab40ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 --2- 172.21.15.64:0/47138800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40d1da0 0x7fcab40ccc20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009900 tx=0x7fcaa401c850 comp rx=0 tx=0).stop 2024-09-21T07:27:49.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 -- 172.21.15.64:0/47138800 shutdown_connections 2024-09-21T07:27:49.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 --2- 172.21.15.64:0/47138800 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 0x7fcab4071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 --2- 172.21.15.64:0/47138800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40d1da0 0x7fcab40ccc20 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 -- 172.21.15.64:0/47138800 >> 172.21.15.64:0/47138800 conn(0x7fcab40d2330 msgr2=0x7fcab40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 -- 172.21.15.64:0/47138800 shutdown_connections 2024-09-21T07:27:49.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.115+0000 7fcabb200640 1 -- 172.21.15.64:0/47138800 wait complete. 2024-09-21T07:27:49.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 Processor -- start 2024-09-21T07:27:49.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 -- start start 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 0x7fcab415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcab40d1da0 0x7fcab415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcab416a0e0 con 0x7fcab40716d0 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcab4169f60 con 0x7fcab40d1da0 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcabb200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcab416a260 con 0x7fcab40cd160 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcab3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcab3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35760/0 (socket says 172.21.15.64:35760) 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.119+0000 7fcab3e00640 1 -- 172.21.15.64:0/3019967420 learned_addr learned my addr 172.21.15.64:0/3019967420 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcaab400640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 0x7fcab415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab9200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcab40d1da0 0x7fcab415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 -- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 msgr2=0x7fcab415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 0x7fcab415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 -- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcab40d1da0 msgr2=0x7fcab415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcab40d1da0 0x7fcab415d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 -- 172.21.15.64:0/3019967420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab41f92e0 con 0x7fcab40716d0 2024-09-21T07:27:49.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab3e00640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40b0040 tx=0x7fcaa40a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40b2040 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcaa40043b0 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4005290 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab41f95c0 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab41f9b80 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab40cc430 con 0x7fcab40716d0 2024-09-21T07:27:49.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.123+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcaa4005430 con 0x7fcab40716d0 2024-09-21T07:27:49.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.127+0000 7fcab0c00640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 0x7fca90075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.127+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7fcaa412e540 con 0x7fcab40716d0 2024-09-21T07:27:49.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.127+0000 7fcaab400640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 0x7fca90075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.127+0000 7fcaab400640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 0x7fca90075740 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcab41f6840 tx=0x7fca9c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.131+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcaa40164d0 con 0x7fcab40716d0 2024-09-21T07:27:49.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.339+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcab40b46a0 con 0x7fcab40716d0 2024-09-21T07:27:49.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.339+0000 7fcab0c00640 1 -- 172.21.15.64:0/3019967420 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5226 (secure 0 0 0) 0x7fcaa40f9320 con 0x7fcab40716d0 2024-09-21T07:27:49.343 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:49.343 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":60,"btime":"2024-09-21T07:27:33:595445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:33.595434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6996,"qdb_cluster":[6996]},"id":5}]} 2024-09-21T07:27:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 60 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 msgr2=0x7fca90075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 0x7fca90075740 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcab41f6840 tx=0x7fca9c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 msgr2=0x7fcab415a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40b0040 tx=0x7fcaa40a5790 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 shutdown_connections 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fca90073230 0x7fca90075740 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcab40d1da0 0x7fcab415d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcab40cd160 0x7fcab415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 --2- 172.21.15.64:0/3019967420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcab40716d0 0x7fcab415a7b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 >> 172.21.15.64:0/3019967420 conn(0x7fcab40d2330 msgr2=0x7fcab40b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 shutdown_connections 2024-09-21T07:27:49.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.343+0000 7fcabb200640 1 -- 172.21.15.64:0/3019967420 wait complete. 2024-09-21T07:27:49.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- 172.21.15.64:0/565676868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 msgr2=0x7f9d7015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 --2- 172.21.15.64:0/565676868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d7015f510 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9d70073820 tx=0x7f9d5801c770 comp rx=0 tx=0).stop 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- 172.21.15.64:0/565676868 shutdown_connections 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 --2- 172.21.15.64:0/565676868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d7006fba0 0x7f9d7006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 --2- 172.21.15.64:0/565676868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d7015f510 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 --2- 172.21.15.64:0/565676868 >> v2:172.21.15.90:3300/0 conn(0x7f9d700cd790 0x7f9d7015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- 172.21.15.64:0/565676868 >> 172.21.15.64:0/565676868 conn(0x7f9d700b2ca0 msgr2=0x7f9d700b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- 172.21.15.64:0/565676868 shutdown_connections 2024-09-21T07:27:49.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- 172.21.15.64:0/565676868 wait complete. 2024-09-21T07:27:49.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 Processor -- start 2024-09-21T07:27:49.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 -- start start 2024-09-21T07:27:49.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.523+0000 7f9d76000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d7006fba0 0x7f9d70164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d700cd790 0x7f9d700b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700b6620 con 0x7f9d7015f100 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700b64a0 con 0x7f9d7006fba0 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d700b67a0 con 0x7f9d700cd790 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35788/0 (socket says 172.21.15.64:35788) 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 -- 172.21.15.64:0/3895921953 learned_addr learned my addr 172.21.15.64:0/3895921953 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6f400640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d7006fba0 0x7f9d70164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d67e00640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d700cd790 0x7f9d700b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 -- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d700cd790 msgr2=0x7f9d700b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d700cd790 0x7f9d700b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 -- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d7006fba0 msgr2=0x7f9d70164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d7006fba0 0x7f9d70164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 -- 172.21.15.64:0/3895921953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d700b1600 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d6fe00640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800d950 tx=0x7f9d6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68016070 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d6800bd00 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d700c7c20 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d680106c0 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d70164aa0 con 0x7f9d7015f100 2024-09-21T07:27:49.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7015b320 con 0x7f9d7015f100 2024-09-21T07:27:49.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.527+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d68019070 con 0x7f9d7015f100 2024-09-21T07:27:49.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.531+0000 7f9d67400640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 0x7f9d4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.531+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f9d680946a0 con 0x7f9d7015f100 2024-09-21T07:27:49.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.531+0000 7f9d6f400640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 0x7f9d4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.531+0000 7f9d6f400640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 0x7f9d4c075710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009b40 tx=0x7f9d600091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.535+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9d6805eec0 con 0x7f9d7015f100 2024-09-21T07:27:49.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.747+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d700b3bb0 con 0x7f9d7015f100 2024-09-21T07:27:49.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.747+0000 7f9d67400640 1 -- 172.21.15.64:0/3895921953 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5226 (secure 0 0 0) 0x7f9d680638f0 con 0x7f9d7015f100 2024-09-21T07:27:49.751 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:49.751 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":60,"btime":"2024-09-21T07:27:33:595445+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:27:18.794425+0000","modified":"2024-09-21T07:27:33.595434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6996},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6996":{"gid":6996,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3463091313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3463091313},{"type":"v1","addr":"172.21.15.64:6835","nonce":3463091313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6996,"qdb_cluster":[6996]},"id":5}]} 2024-09-21T07:27:49.751 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 60 2024-09-21T07:27:49.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 msgr2=0x7f9d4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 0x7f9d4c075710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009b40 tx=0x7f9d600091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 msgr2=0x7f9d701fcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800d950 tx=0x7f9d6800de10 comp rx=0 tx=0).stop 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 shutdown_connections 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d4c073200 0x7f9d4c075710 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7015f100 0x7f9d701fcd20 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d700cd790 0x7f9d700b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 --2- 172.21.15.64:0/3895921953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d7006fba0 0x7f9d70164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 >> 172.21.15.64:0/3895921953 conn(0x7f9d700b2ca0 msgr2=0x7f9d7006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 shutdown_connections 2024-09-21T07:27:49.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.751+0000 7f9d76000640 1 -- 172.21.15.64:0/3895921953 wait complete. 2024-09-21T07:27:49.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- 172.21.15.64:0/3879559397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86640b1670 msgr2=0x7f86640c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 --2- 172.21.15.64:0/3879559397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86640b1670 0x7f86640c5d30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f865c009bc0 tx=0x7f865c01ca80 comp rx=0 tx=0).stop 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- 172.21.15.64:0/3879559397 shutdown_connections 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 --2- 172.21.15.64:0/3879559397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86640b1670 0x7f86640c5d30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- 172.21.15.64:0/3879559397 >> 172.21.15.64:0/3879559397 conn(0x7f866406d480 msgr2=0x7f86640d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- 172.21.15.64:0/3879559397 shutdown_connections 2024-09-21T07:27:49.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- 172.21.15.64:0/3879559397 wait complete. 2024-09-21T07:27:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 Processor -- start 2024-09-21T07:27:49.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.931+0000 7f8668a00640 1 -- start start 2024-09-21T07:27:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86640b1670 0x7f866414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 0x7f866415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f866416b1d0 con 0x7f8664152a40 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f866416b050 con 0x7f86640b1670 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f866416b350 con 0x7f866415c8a0 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35814/0 (socket says 172.21.15.64:35814) 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 -- 172.21.15.64:0/263136619 learned_addr learned my addr 172.21.15.64:0/263136619 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8661e00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86640b1670 0x7f866414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f865be00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 0x7f866415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 -- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 msgr2=0x7f866415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 0x7f866415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 -- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86640b1670 msgr2=0x7f866414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86640b1670 0x7f866414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 -- 172.21.15.64:0/263136619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86640b64a0 con 0x7f8664152a40 2024-09-21T07:27:49.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f865be00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 0x7f866415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:49.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8662800640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f865c0b0040 tx=0x7f865c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c0b2040 con 0x7f8664152a40 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f865c0041f0 con 0x7f8664152a40 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c004600 con 0x7f8664152a40 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86641f6d10 con 0x7f8664152a40 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86641f72d0 con 0x7f8664152a40 2024-09-21T07:27:49.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.935+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86640c5d30 con 0x7f8664152a40 2024-09-21T07:27:49.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.939+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f865c0bd030 con 0x7f8664152a40 2024-09-21T07:27:49.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.939+0000 7f865a000640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 0x7f8640075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:49.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.939+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f865c12e5c0 con 0x7f8664152a40 2024-09-21T07:27:49.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.939+0000 7f8661e00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 0x7f8640075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:49.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.939+0000 7f8661e00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 0x7f8640075710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8654007fd0 tx=0x7f8654009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:49.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:49.943+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f865c0c4060 con 0x7f8664152a40 2024-09-21T07:27:50.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.119+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86641f6aa0 con 0x7f8664152a40 2024-09-21T07:27:50.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f865a000640 1 -- 172.21.15.64:0/263136619 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17216 (secure 0 0 0) 0x7f865c016790 con 0x7f8664152a40 2024-09-21T07:27:50.124 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:50.125 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":87,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:30.567819+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:27:16.554525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-21T07:27:17.755507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6837/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.90:6836/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.64:6834/2439635016":"2024-09-22T07:27:29.564914+0000","172.21.15.64:6832/2439635016":"2024-09-22T07:27:29.564914+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 msgr2=0x7f8640075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 0x7f8640075710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8654007fd0 tx=0x7f8654009040 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 msgr2=0x7f866415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f865c0b0040 tx=0x7f865c005ae0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 shutdown_connections 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8640073200 0x7f8640075710 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8664152a40 0x7f866415aff0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f866415c8a0 0x7f866415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 --2- 172.21.15.64:0/263136619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86640b1670 0x7f866414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 >> 172.21.15.64:0/263136619 conn(0x7f866406d480 msgr2=0x7f8664068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 shutdown_connections 2024-09-21T07:27:50.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.123+0000 7f8668a00640 1 -- 172.21.15.64:0/263136619 wait complete. 2024-09-21T07:27:50.147 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:27:50.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 -- 172.21.15.64:0/4181270161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d581604c0 msgr2=0x7f7d58166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/4181270161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d581604c0 0x7f7d58166c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009bc0 tx=0x7f7d5001cba0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 -- 172.21.15.64:0/4181270161 shutdown_connections 2024-09-21T07:27:50.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/4181270161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d581604c0 0x7f7d58166c60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 -- 172.21.15.64:0/4181270161 >> 172.21.15.64:0/4181270161 conn(0x7f7d5806d450 msgr2=0x7f7d580d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:50.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 -- 172.21.15.64:0/4181270161 shutdown_connections 2024-09-21T07:27:50.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.303+0000 7f7d5ea00640 1 -- 172.21.15.64:0/4181270161 wait complete. 2024-09-21T07:27:50.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 Processor -- start 2024-09-21T07:27:50.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 -- start start 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 0x7f7d58159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d581604c0 0x7f7d580cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58169f10 con 0x7f7d5815f9a0 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58169d90 con 0x7f7d5809df30 2024-09-21T07:27:50.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5816a090 con 0x7f7d581604c0 2024-09-21T07:27:50.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35822/0 (socket says 172.21.15.64:35822) 2024-09-21T07:27:50.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.307+0000 7f7d4fe00640 1 -- 172.21.15.64:0/3346633074 learned_addr learned my addr 172.21.15.64:0/3346633074 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:50.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d5ca00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d581604c0 0x7f7d580cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d57e00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 0x7f7d58159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 -- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d581604c0 msgr2=0x7f7d580cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d581604c0 0x7f7d580cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 -- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 msgr2=0x7f7d58159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 0x7f7d58159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 -- 172.21.15.64:0/3346633074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580b1cb0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d57e00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 0x7f7d58159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d4fe00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c460 tx=0x7f7d4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400052d0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d40005470 con 0x7f7d5815f9a0 2024-09-21T07:27:50.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40012870 con 0x7f7d5815f9a0 2024-09-21T07:27:50.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d580b1f90 con 0x7f7d5815f9a0 2024-09-21T07:27:50.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d580b2550 con 0x7f7d5815f9a0 2024-09-21T07:27:50.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d580b33d0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.311+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d40003600 con 0x7f7d5815f9a0 2024-09-21T07:27:50.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.315+0000 7f7d54c00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 0x7f7d34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.315+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6273+0+0 (secure 0 0 0) 0x7f7d40093f60 con 0x7f7d5815f9a0 2024-09-21T07:27:50.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.315+0000 7f7d57e00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 0x7f7d34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.315+0000 7f7d57e00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 0x7f7d34075710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d48007fd0 tx=0x7f7d48009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:50.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.319+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7d4005eca0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.531+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7d580cbfa0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.534 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:27:50.531+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:27:50.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.535+0000 7f7d54c00640 1 -- 172.21.15.64:0/3346633074 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 161+0+0 (secure 0 0 0) 0x7f7d4005e5a0 con 0x7f7d5815f9a0 2024-09-21T07:27:50.537 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:27:50.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 msgr2=0x7f7d34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 0x7f7d34075710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d48007fd0 tx=0x7f7d48009040 comp rx=0 tx=0).stop 2024-09-21T07:27:50.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 msgr2=0x7f7d58166350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c460 tx=0x7f7d4000c920 comp rx=0 tx=0).stop 2024-09-21T07:27:50.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 shutdown_connections 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d34073200 0x7f7d34075710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d581604c0 0x7f7d580cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d5815f9a0 0x7f7d58166350 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 --2- 172.21.15.64:0/3346633074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d5809df30 0x7f7d58159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 >> 172.21.15.64:0/3346633074 conn(0x7f7d5806d450 msgr2=0x7f7d580acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 shutdown_connections 2024-09-21T07:27:50.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.539+0000 7f7d5ea00640 1 -- 172.21.15.64:0/3346633074 wait complete. 2024-09-21T07:27:50.548 INFO:tasks.ceph.mds.c.smithi064.stderr: -2497> 2024-09-21T07:27:35.583+0000 7fc5ad600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:27:50.564 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:27:50.668 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:27:50.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 -- 172.21.15.64:0/1147962396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 msgr2=0x7ff478003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 --2- 172.21.15.64:0/1147962396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff478003f20 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff484009b40 tx=0x7ff48401d270 comp rx=0 tx=0).stop 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff492800640 1 -- 172.21.15.64:0/1147962396 reap_dead start 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 -- 172.21.15.64:0/1147962396 shutdown_connections 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 -- 172.21.15.64:0/1147962396 >> 172.21.15.64:0/1147962396 conn(0x7ff49406d480 msgr2=0x7ff4940d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 -- 172.21.15.64:0/1147962396 shutdown_connections 2024-09-21T07:27:50.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.727+0000 7ff498c00640 1 -- 172.21.15.64:0/1147962396 wait complete. 2024-09-21T07:27:50.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 Processor -- start 2024-09-21T07:27:50.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 -- start start 2024-09-21T07:27:50.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 0x7ff4940b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3030 0x7ff49415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff494168a10 con 0x7ff478003ab0 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff494168890 con 0x7ff4941fd530 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff498c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff494168b90 con 0x7ff4940b3030 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35854/0 (socket says 172.21.15.64:35854) 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 -- 172.21.15.64:0/3834769671 learned_addr learned my addr 172.21.15.64:0/3834769671 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff492800640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3030 0x7ff49415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff48be00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 0x7ff4940b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 -- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3030 msgr2=0x7ff49415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3030 0x7ff49415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 -- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 msgr2=0x7ff4940b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 0x7ff4940b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 -- 172.21.15.64:0/3834769671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940b3440 con 0x7ff478003ab0 2024-09-21T07:27:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff48be00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 0x7ff4940b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.731+0000 7ff491e00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ae040 tx=0x7ff484005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840bb030 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4840047c0 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484004c10 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4941f9b40 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4941fa100 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4940d0200 con 0x7ff478003ab0 2024-09-21T07:27:50.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff4840be030 con 0x7ff478003ab0 2024-09-21T07:27:50.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 0x7ff470075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:50.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6359+0+0 (secure 0 0 0) 0x7ff48412f770 con 0x7ff478003ab0 2024-09-21T07:27:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.735+0000 7ff48be00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 0x7ff470075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.739+0000 7ff48be00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 0x7ff470075740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff4940c8810 tx=0x7ff47c000f80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:50.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.739+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff4940b3440 con 0x7ff478003ab0 2024-09-21T07:27:50.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:50.955+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff4940b3b10 con 0x7ff478003ab0 2024-09-21T07:27:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.647+0000 7ff48a000640 1 -- 172.21.15.64:0/3834769671 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) ==== 104+0+0 (secure 0 0 0) 0x7ff484016f80 con 0x7ff478003ab0 2024-09-21T07:27:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 msgr2=0x7ff470075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 0x7ff470075740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff4940c8810 tx=0x7ff47c000f80 comp rx=0 tx=0).stop 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 msgr2=0x7ff494155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ae040 tx=0x7ff484005660 comp rx=0 tx=0).stop 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 shutdown_connections 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff470073230 0x7ff470075740 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3030 0x7ff49415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4941fd530 0x7ff4940b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 --2- 172.21.15.64:0/3834769671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff478003ab0 0x7ff494155320 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 >> 172.21.15.64:0/3834769671 conn(0x7ff49406d480 msgr2=0x7ff494157720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:51.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 shutdown_connections 2024-09-21T07:27:51.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.651+0000 7ff498c00640 1 -- 172.21.15.64:0/3834769671 wait complete. 2024-09-21T07:27:51.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 -- 172.21.15.64:0/708625414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 msgr2=0x7fbf100d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 --2- 172.21.15.64:0/708625414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100d25d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009900 tx=0x7fbf0001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 -- 172.21.15.64:0/708625414 shutdown_connections 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 --2- 172.21.15.64:0/708625414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b51a0 0x7fbf100b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 --2- 172.21.15.64:0/708625414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100d25d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 -- 172.21.15.64:0/708625414 >> 172.21.15.64:0/708625414 conn(0x7fbf1006d220 msgr2=0x7fbf1006d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 -- 172.21.15.64:0/708625414 shutdown_connections 2024-09-21T07:27:51.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.843+0000 7fbf16000640 1 -- 172.21.15.64:0/708625414 wait complete. 2024-09-21T07:27:51.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 Processor -- start 2024-09-21T07:27:51.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- start start 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b3dd0 0x7fbf100cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 0x7fbf1014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10169ca0 con 0x7fbf100b7b50 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10169b20 con 0x7fbf100b51a0 2024-09-21T07:27:51.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbf10169e20 con 0x7fbf100b3dd0 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35882/0 (socket says 172.21.15.64:35882) 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 -- 172.21.15.64:0/3530608003 learned_addr learned my addr 172.21.15.64:0/3530608003 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0f400640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b3dd0 0x7fbf100cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf06a00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 0x7fbf1014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 -- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b3dd0 msgr2=0x7fbf100cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b3dd0 0x7fbf100cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 -- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 msgr2=0x7fbf1014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 0x7fbf1014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 -- 172.21.15.64:0/3530608003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf100b2990 con 0x7fbf100b7b50 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf06a00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 0x7fbf1014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:51.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf0fe00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800cab0 tx=0x7fbf0800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800ae20 con 0x7fbf100b7b50 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf0800f560 con 0x7fbf100b7b50 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf100c5900 con 0x7fbf100b7b50 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800f9b0 con 0x7fbf100b7b50 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.847+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf100cbb10 con 0x7fbf100b7b50 2024-09-21T07:27:51.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1014d240 con 0x7fbf100b7b50 2024-09-21T07:27:51.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf0800fb50 con 0x7fbf100b7b50 2024-09-21T07:27:51.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf07e00640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 0x7fbeec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:51.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6359+0+0 (secure 0 0 0) 0x7fbf08094fe0 con 0x7fbf100b7b50 2024-09-21T07:27:51.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf0f400640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 0x7fbeec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:51.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.851+0000 7fbf0f400640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 0x7fbeec075710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbf000af000 tx=0x7fbf0001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:51.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:51.855+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbf08014030 con 0x7fbf100b7b50 2024-09-21T07:27:52.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.035+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf100b55b0 con 0x7fbf100b7b50 2024-09-21T07:27:52.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.659+0000 7fbf07e00640 1 -- 172.21.15.64:0/3530608003 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7fbf0805fcd0 con 0x7fbf100b7b50 2024-09-21T07:27:52.660 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 msgr2=0x7fbeec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 0x7fbeec075710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbf000af000 tx=0x7fbf0001b120 comp rx=0 tx=0).stop 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 msgr2=0x7fbf100c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800cab0 tx=0x7fbf0800cf70 comp rx=0 tx=0).stop 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 shutdown_connections 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbeec073200 0x7fbeec075710 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100b7b50 0x7fbf100c5fd0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf100b51a0 0x7fbf1014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 --2- 172.21.15.64:0/3530608003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf100b3dd0 0x7fbf100cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 >> 172.21.15.64:0/3530608003 conn(0x7fbf1006d220 msgr2=0x7fbf100d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 shutdown_connections 2024-09-21T07:27:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.663+0000 7fbf16000640 1 -- 172.21.15.64:0/3530608003 wait complete. 2024-09-21T07:27:52.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 -- 172.21.15.64:0/3957530669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c006fc10 msgr2=0x7fb6c0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 --2- 172.21.15.64:0/3957530669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c006fc10 0x7fb6c0073570 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009840 tx=0x7fb6a801c790 comp rx=0 tx=0).stop 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 -- 172.21.15.64:0/3957530669 shutdown_connections 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 --2- 172.21.15.64:0/3957530669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6c00cee50 0x7fb6c0073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 --2- 172.21.15.64:0/3957530669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c006fc10 0x7fb6c0073570 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 -- 172.21.15.64:0/3957530669 >> 172.21.15.64:0/3957530669 conn(0x7fb6c00d0170 msgr2=0x7fb6c00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 -- 172.21.15.64:0/3957530669 shutdown_connections 2024-09-21T07:27:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.851+0000 7fb6c6200640 1 -- 172.21.15.64:0/3957530669 wait complete. 2024-09-21T07:27:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 Processor -- start 2024-09-21T07:27:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 -- start start 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 0x7fb6c01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6c0155cd0 0x7fb6c009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00748e0 con 0x7fb6c00cee50 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0074760 con 0x7fb6c015f660 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6c6200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c0168070 con 0x7fb6c0155cd0 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35900/0 (socket says 172.21.15.64:35900) 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 -- 172.21.15.64:0/4106827465 learned_addr learned my addr 172.21.15.64:0/4106827465 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 -- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6c0155cd0 msgr2=0x7fb6c009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6c0155cd0 0x7fb6c009c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 -- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 msgr2=0x7fb6c01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6b6a00640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 0x7fb6c01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 0x7fb6c01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6bf400640 1 -- 172.21.15.64:0/4106827465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c01642a0 con 0x7fb6c00cee50 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.855+0000 7fb6b6a00640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 0x7fb6c01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6bf400640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c3e0 tx=0x7fb6b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0011790 con 0x7fb6c00cee50 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6b0017070 con 0x7fb6c00cee50 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c0164580 con 0x7fb6c00cee50 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0011ce0 con 0x7fb6c00cee50 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c0164b40 con 0x7fb6c00cee50 2024-09-21T07:27:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c0073570 con 0x7fb6c00cee50 2024-09-21T07:27:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6b001c460 con 0x7fb6c00cee50 2024-09-21T07:27:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 0x7fb69c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.859+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5921+0+0 (secure 0 0 0) 0x7fb6b00941c0 con 0x7fb6c00cee50 2024-09-21T07:27:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.863+0000 7fb6b6a00640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 0x7fb69c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.863+0000 7fb6b6a00640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 0x7fb69c075710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af000 tx=0x7fb6a801afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:52.867+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb6b005f060 con 0x7fb6c00cee50 2024-09-21T07:27:53.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.043+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6c00b60f0 con 0x7fb6c00cee50 2024-09-21T07:27:53.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.663+0000 7fb6b7e00640 1 -- 172.21.15.64:0/4106827465 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7fb6b005e960 con 0x7fb6c00cee50 2024-09-21T07:27:53.667 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:27:53.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 msgr2=0x7fb69c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 0x7fb69c075710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af000 tx=0x7fb6a801afd0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 msgr2=0x7fb6c0165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c3e0 tx=0x7fb6b000c8a0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 shutdown_connections 2024-09-21T07:27:53.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb69c073200 0x7fb69c075710 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6c0155cd0 0x7fb6c009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6c015f660 0x7fb6c01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 --2- 172.21.15.64:0/4106827465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c00cee50 0x7fb6c0165340 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.667+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 >> 172.21.15.64:0/4106827465 conn(0x7fb6c00d0170 msgr2=0x7fb6c00b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:53.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.671+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 shutdown_connections 2024-09-21T07:27:53.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.671+0000 7fb6c6200640 1 -- 172.21.15.64:0/4106827465 wait complete. 2024-09-21T07:27:53.698 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:27:53.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 -- 172.21.15.64:0/1850162858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0a00 msgr2=0x7f3e7015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 --2- 172.21.15.64:0/1850162858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0a00 0x7f3e7015eb80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009840 tx=0x7f3e5801c760 comp rx=0 tx=0).stop 2024-09-21T07:27:53.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 -- 172.21.15.64:0/1850162858 shutdown_connections 2024-09-21T07:27:53.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 --2- 172.21.15.64:0/1850162858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0a00 0x7f3e7015eb80 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 --2- 172.21.15.64:0/1850162858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e700b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 -- 172.21.15.64:0/1850162858 >> 172.21.15.64:0/1850162858 conn(0x7f3e7006d450 msgr2=0x7f3e700d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:53.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 -- 172.21.15.64:0/1850162858 shutdown_connections 2024-09-21T07:27:53.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 -- 172.21.15.64:0/1850162858 wait complete. 2024-09-21T07:27:53.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.863+0000 7f3e75a00640 1 Processor -- start 2024-09-21T07:27:53.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- start start 2024-09-21T07:27:53.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 0x7f3e701f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e70074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e701698c0 con 0x7f3e700d0e10 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e70169740 con 0x7f3e700d0a00 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e70169a40 con 0x7f3e70155560 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35930/0 (socket says 172.21.15.64:35930) 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 -- 172.21.15.64:0/4125665843 learned_addr learned my addr 172.21.15.64:0/4125665843 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e6ea00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 0x7f3e701f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e6f400640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e70074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 -- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 msgr2=0x7f3e70074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e70074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 -- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 msgr2=0x7f3e701f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 0x7f3e701f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 -- 172.21.15.64:0/4125665843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e701fdd50 con 0x7f3e700d0e10 2024-09-21T07:27:53.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e6ea00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 0x7f3e701f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:53.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e6f400640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e70074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:53.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e66000640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3e5801a390 tx=0x7f3e580a55b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e580bb070 con 0x7f3e700d0e10 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e58004470 con 0x7f3e700d0e10 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e580b2040 con 0x7f3e700d0e10 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e70145260 con 0x7f3e700d0e10 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e701449c0 con 0x7f3e700d0e10 2024-09-21T07:27:53.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.867+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7015eb80 con 0x7f3e700d0e10 2024-09-21T07:27:53.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.871+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e58005290 con 0x7f3e700d0e10 2024-09-21T07:27:53.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.871+0000 7f3e67400640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 0x7f3e4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.871+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7f3e5812db80 con 0x7f3e700d0e10 2024-09-21T07:27:53.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.871+0000 7f3e6ea00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 0x7f3e4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.871+0000 7f3e6ea00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 0x7f3e4c075740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000bbc0 tx=0x7f3e60005ef0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:53.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:53.875+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3e58016410 con 0x7f3e700d0e10 2024-09-21T07:27:54.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.051+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f3e70070cc0 con 0x7f3e700d0e10 2024-09-21T07:27:54.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.055+0000 7f3e67400640 1 -- 172.21.15.64:0/4125665843 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7f3e580f8c60 con 0x7f3e700d0e10 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 msgr2=0x7f3e4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 0x7f3e4c075740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000bbc0 tx=0x7f3e60005ef0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 msgr2=0x7f3e701fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3e5801a390 tx=0x7f3e580a55b0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 shutdown_connections 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e4c073230 0x7f3e4c075740 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e70155560 0x7f3e70074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e700d0e10 0x7f3e701fd810 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 --2- 172.21.15.64:0/4125665843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e700d0a00 0x7f3e701f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 >> 172.21.15.64:0/4125665843 conn(0x7f3e7006d450 msgr2=0x7f3e700aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:54.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 shutdown_connections 2024-09-21T07:27:54.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.059+0000 7f3e75a00640 1 -- 172.21.15.64:0/4125665843 wait complete. 2024-09-21T07:27:54.081 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-21T07:27:54.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- 172.21.15.64:0/2119214008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2234004810 msgr2=0x7f2234004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 --2- 172.21.15.64:0/2119214008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2234004810 0x7f2234004c20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2238001770 tx=0x7f223801ef70 comp rx=0 tx=0).stop 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- 172.21.15.64:0/2119214008 shutdown_connections 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 --2- 172.21.15.64:0/2119214008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2234004810 0x7f2234004c20 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- 172.21.15.64:0/2119214008 >> 172.21.15.64:0/2119214008 conn(0x7f22500b2b80 msgr2=0x7f22500b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- 172.21.15.64:0/2119214008 shutdown_connections 2024-09-21T07:27:54.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- 172.21.15.64:0/2119214008 wait complete. 2024-09-21T07:27:54.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 Processor -- start 2024-09-21T07:27:54.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.239+0000 7f224fe00640 1 -- start start 2024-09-21T07:27:54.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2234004810 0x7f22501f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22500b2700 0x7f22501f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2250074c70 con 0x7f22500b6840 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2250074af0 con 0x7f2234004810 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2250074df0 con 0x7f22500b2700 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35944/0 (socket says 172.21.15.64:35944) 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 -- 172.21.15.64:0/2106655454 learned_addr learned my addr 172.21.15.64:0/2106655454 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224f400640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22500b2700 0x7f22501f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224ea00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2234004810 0x7f22501f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 -- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22500b2700 msgr2=0x7f22501f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22500b2700 0x7f22501f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 -- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2234004810 msgr2=0x7f22501f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2234004810 0x7f22501f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 -- 172.21.15.64:0/2106655454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22500d0330 con 0x7f22500b6840 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2246000640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2238000fc0 tx=0x7f2238006960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238006140 con 0x7f22500b6840 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22380063d0 con 0x7f22500b6840 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225015d6c0 con 0x7f22500b6840 2024-09-21T07:27:54.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380a8d00 con 0x7f22500b6840 2024-09-21T07:27:54.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501f2470 con 0x7f22500b6840 2024-09-21T07:27:54.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250070380 con 0x7f22500b6840 2024-09-21T07:27:54.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.243+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22380aa110 con 0x7f22500b6840 2024-09-21T07:27:54.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.247+0000 7f2247e00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 0x7f222c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.247+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7f2238130d70 con 0x7f22500b6840 2024-09-21T07:27:54.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.247+0000 7f224ea00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 0x7f222c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.247+0000 7f224ea00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 0x7f222c075710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2240001420 tx=0x7f2240006900 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:54.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.251+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f22380c0070 con 0x7f22500b6840 2024-09-21T07:27:54.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.491+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f2250074170 con 0x7f22500b6840 2024-09-21T07:27:54.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f2247e00640 1 -- 172.21.15.64:0/2106655454 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v265) ==== 143+0+0 (secure 0 0 0) 0x7f2238018c80 con 0x7f22500b6840 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 msgr2=0x7f222c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 0x7f222c075710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2240001420 tx=0x7f2240006900 comp rx=0 tx=0).stop 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 msgr2=0x7f22501f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2238000fc0 tx=0x7f2238006960 comp rx=0 tx=0).stop 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 shutdown_connections 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f222c073200 0x7f222c075710 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22500b2700 0x7f22501f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22500b6840 0x7f22501f1bc0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 --2- 172.21.15.64:0/2106655454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2234004810 0x7f22501f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 >> 172.21.15.64:0/2106655454 conn(0x7f22500b2b80 msgr2=0x7f225014e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:54.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 shutdown_connections 2024-09-21T07:27:54.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.667+0000 7f224fe00640 1 -- 172.21.15.64:0/2106655454 wait complete. 2024-09-21T07:27:54.691 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-21T07:27:54.692 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-21T07:27:54.692 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:27:54.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:27:54.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 -- 172.21.15.64:0/2508136677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00b4170 msgr2=0x7fc8f00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 --2- 172.21.15.64:0/2508136677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00b4170 0x7fc8f00b1be0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00cb120 tx=0x7fc8e401cb60 comp rx=0 tx=0).stop 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 -- 172.21.15.64:0/2508136677 shutdown_connections 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 --2- 172.21.15.64:0/2508136677 >> v2:172.21.15.90:3300/0 conn(0x7fc8f00cc4e0 0x7fc8f00b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 --2- 172.21.15.64:0/2508136677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00b4170 0x7fc8f00b1be0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 -- 172.21.15.64:0/2508136677 >> 172.21.15.64:0/2508136677 conn(0x7fc8f00ccbe0 msgr2=0x7fc8f00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 -- 172.21.15.64:0/2508136677 shutdown_connections 2024-09-21T07:27:54.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.847+0000 7fc8f8000640 1 -- 172.21.15.64:0/2508136677 wait complete. 2024-09-21T07:27:54.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 Processor -- start 2024-09-21T07:27:54.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 -- start start 2024-09-21T07:27:54.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 0x7fc8f00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 0x7fc8f0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f01661a0 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f0166020 con 0x7fc8f00b4170 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f0166320 con 0x7fc8f00b2fb0 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35962/0 (socket says 172.21.15.64:35962) 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 -- 172.21.15.64:0/811129835 learned_addr learned my addr 172.21.15.64:0/811129835 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f5600640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 0x7fc8f00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f4c00640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 0x7fc8f0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 -- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 msgr2=0x7fc8f00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 0x7fc8f00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 -- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 msgr2=0x7fc8f0144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 0x7fc8f0144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:54.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 -- 172.21.15.64:0/811129835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f01fa680 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f5600640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 0x7fc8f00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f4c00640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 0x7fc8f0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.851+0000 7fc8f6000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800c390 tx=0x7fc8e800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8017070 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e8003600 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8003a30 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f01fa960 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f0146740 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f00c9f20 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc8e801a070 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 0x7fc8d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7fc8e80933d0 con 0x7fc8f00cc4e0 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.855+0000 7fc8f5600640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 0x7fc8d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:54.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.859+0000 7fc8f5600640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 0x7fc8d0075710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40af000 tx=0x7fc8e401b3a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:54.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:54.859+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc8e805e4a0 con 0x7fc8f00cc4e0 2024-09-21T07:27:55.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.039+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f00b33c0 con 0x7fc8f00cc4e0 2024-09-21T07:27:55.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.039+0000 7fc8ed600640 1 -- 172.21.15.64:0/811129835 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+13518 (secure 0 0 0) 0x7fc8e805dda0 con 0x7fc8f00cc4e0 2024-09-21T07:27:55.041 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:55.041 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":90,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:27:53.660615+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/3463091313":"2024-09-22T07:27:50.534993+0000","172.21.15.64:6834/3463091313":"2024-09-22T07:27:50.534993+0000","172.21.15.90:6837/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.90:6836/3476229811":"2024-09-22T07:27:30.567785+0000","172.21.15.64:6834/2439635016":"2024-09-22T07:27:29.564914+0000","172.21.15.64:6832/2439635016":"2024-09-22T07:27:29.564914+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:27:55.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 msgr2=0x7fc8d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 0x7fc8d0075710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40af000 tx=0x7fc8e401b3a0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 msgr2=0x7fc8f01451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800c390 tx=0x7fc8e800c790 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 shutdown_connections 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc8d0073200 0x7fc8d0075710 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8f00cc4e0 0x7fc8f01451a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8f00b4170 0x7fc8f0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 --2- 172.21.15.64:0/811129835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc8f00b2fb0 0x7fc8f00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 >> 172.21.15.64:0/811129835 conn(0x7fc8f00ccbe0 msgr2=0x7fc8f0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 shutdown_connections 2024-09-21T07:27:55.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.043+0000 7fc8f8000640 1 -- 172.21.15.64:0/811129835 wait complete. 2024-09-21T07:27:55.064 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:27:55.064 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 -- 172.21.15.64:0/412200022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac15f290 msgr2=0x7f88ac0aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 --2- 172.21.15.64:0/412200022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac15f290 0x7f88ac0aefe0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009bc0 tx=0x7f88a401cb10 comp rx=0 tx=0).stop 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 -- 172.21.15.64:0/412200022 shutdown_connections 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 --2- 172.21.15.64:0/412200022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac15f290 0x7f88ac0aefe0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 -- 172.21.15.64:0/412200022 >> 172.21.15.64:0/412200022 conn(0x7f88ac06d450 msgr2=0x7f88ac0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 -- 172.21.15.64:0/412200022 shutdown_connections 2024-09-21T07:27:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.223+0000 7f88b2c00640 1 -- 172.21.15.64:0/412200022 wait complete. 2024-09-21T07:27:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 Processor -- start 2024-09-21T07:27:55.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 -- start start 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88ac155560 0x7f88ac0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88ac0c6800 0x7f88ac0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac16a5f0 con 0x7f88ac0d0a00 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac16a470 con 0x7f88ac0c6800 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b2c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac16a770 con 0x7f88ac155560 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45814/0 (socket says 172.21.15.64:45814) 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 -- 172.21.15.64:0/1833167805 learned_addr learned my addr 172.21.15.64:0/1833167805 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88b0c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88ac0c6800 0x7f88ac0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88a3e00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88ac155560 0x7f88ac0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 -- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88ac155560 msgr2=0x7f88ac0ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88ac155560 0x7f88ac0ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 -- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88ac0c6800 msgr2=0x7f88ac0ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88ac0c6800 0x7f88ac0ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.227+0000 7f88abe00640 1 -- 172.21.15.64:0/1833167805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac141350 con 0x7f88ac0d0a00 2024-09-21T07:27:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88abe00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f889c00b3f0 tx=0x7f889c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c015020 con 0x7f88ac0d0a00 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f889c011940 con 0x7f88ac0d0a00 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac0c3710 con 0x7f88ac0d0a00 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c011d90 con 0x7f88ac0d0a00 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac0b15c0 con 0x7f88ac0d0a00 2024-09-21T07:27:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac141520 con 0x7f88ac0d0a00 2024-09-21T07:27:55.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f889c018020 con 0x7f88ac0d0a00 2024-09-21T07:27:55.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 0x7f8888075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.231+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7f889c093f80 con 0x7f88ac0d0a00 2024-09-21T07:27:55.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.235+0000 7f88a3e00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 0x7f8888075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.235+0000 7f88a3e00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 0x7f8888075710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0c67a0 tx=0x7f8894009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:55.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.235+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f889c05efc0 con 0x7f88ac0d0a00 2024-09-21T07:27:55.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88ac0aefe0 con 0x7f88ac0d0a00 2024-09-21T07:27:55.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88a8c00640 1 -- 172.21.15.64:0/1833167805 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f889c05e8c0 con 0x7f88ac0d0a00 2024-09-21T07:27:55.420 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:27:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 msgr2=0x7f8888075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 0x7f8888075710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0c67a0 tx=0x7f8894009040 comp rx=0 tx=0).stop 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 msgr2=0x7f88ac0c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f889c00b3f0 tx=0x7f889c00b8b0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 shutdown_connections 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8888073200 0x7f8888075710 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88ac0c6800 0x7f88ac0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88ac155560 0x7f88ac0ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 --2- 172.21.15.64:0/1833167805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ac0d0a00 0x7f88ac0c31d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 >> 172.21.15.64:0/1833167805 conn(0x7f88ac06d450 msgr2=0x7f88ac0ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 shutdown_connections 2024-09-21T07:27:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.419+0000 7f88b2c00640 1 -- 172.21.15.64:0/1833167805 wait complete. 2024-09-21T07:27:55.442 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-21T07:27:55.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 -- 172.21.15.64:0/1524130671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 msgr2=0x7f3d740b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 --2- 172.21.15.64:0/1524130671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 0x7f3d740b4170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009900 tx=0x7f3d5c01c820 comp rx=0 tx=0).stop 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 -- 172.21.15.64:0/1524130671 shutdown_connections 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 --2- 172.21.15.64:0/1524130671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 0x7f3d740b4170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 --2- 172.21.15.64:0/1524130671 >> v2:172.21.15.90:3300/0 conn(0x7f3d740d1d00 0x7f3d740d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 -- 172.21.15.64:0/1524130671 >> 172.21.15.64:0/1524130671 conn(0x7f3d7406d1c0 msgr2=0x7f3d7406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 -- 172.21.15.64:0/1524130671 shutdown_connections 2024-09-21T07:27:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.599+0000 7f3d7b000640 1 -- 172.21.15.64:0/1524130671 wait complete. 2024-09-21T07:27:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 Processor -- start 2024-09-21T07:27:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 -- start start 2024-09-21T07:27:55.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 0x7f3d74158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 0x7f3d7406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7416a330 con 0x7f3d74071190 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7416a1b0 con 0x7f3d740d1d00 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7416a4b0 con 0x7f3d740b3d60 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45830/0 (socket says 172.21.15.64:45830) 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 -- 172.21.15.64:0/2565502621 learned_addr learned my addr 172.21.15.64:0/2565502621 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 -- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 msgr2=0x7f3d74158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 0x7f3d74158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 -- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 msgr2=0x7f3d7406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d79000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 0x7f3d7406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 0x7f3d7406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 -- 172.21.15.64:0/2565502621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d741598b0 con 0x7f3d74071190 2024-09-21T07:27:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d79000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 0x7f3d7406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d73e00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400e970 tx=0x7f3d6400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400cd80 con 0x7f3d74071190 2024-09-21T07:27:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d64004020 con 0x7f3d74071190 2024-09-21T07:27:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d74159b90 con 0x7f3d74071190 2024-09-21T07:27:55.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.603+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64004470 con 0x7f3d74071190 2024-09-21T07:27:55.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d741517c0 con 0x7f3d74071190 2024-09-21T07:27:55.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d740b4170 con 0x7f3d74071190 2024-09-21T07:27:55.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3d64003600 con 0x7f3d74071190 2024-09-21T07:27:55.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d70c00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 0x7f3d50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:55.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7f3d64094b60 con 0x7f3d74071190 2024-09-21T07:27:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.607+0000 7f3d6be00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 0x7f3d50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.611+0000 7f3d6be00640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 0x7f3d50075710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af000 tx=0x7f3d5c0195c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:55.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.611+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3d6405fc50 con 0x7f3d74071190 2024-09-21T07:27:55.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:55.855+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f3d74070110 con 0x7f3d74071190 2024-09-21T07:27:56.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.675+0000 7f3d70c00640 1 -- 172.21.15.64:0/2565502621 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v267) ==== 154+0+0 (secure 0 0 0) 0x7f3d6405f550 con 0x7f3d74071190 2024-09-21T07:27:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 msgr2=0x7f3d50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 0x7f3d50075710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af000 tx=0x7f3d5c0195c0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 msgr2=0x7f3d74150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400e970 tx=0x7f3d6400ee30 comp rx=0 tx=0).stop 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 shutdown_connections 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3d50073200 0x7f3d50075710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d740d1d00 0x7f3d7406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d740b3d60 0x7f3d74158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 --2- 172.21.15.64:0/2565502621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d74071190 0x7f3d74150040 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 >> 172.21.15.64:0/2565502621 conn(0x7f3d7406d1c0 msgr2=0x7f3d7406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 shutdown_connections 2024-09-21T07:27:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.679+0000 7f3d7b000640 1 -- 172.21.15.64:0/2565502621 wait complete. 2024-09-21T07:27:56.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:27:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 -- 172.21.15.64:0/1474215635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 msgr2=0x7febc00d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 --2- 172.21.15.64:0/1474215635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc00d03f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7febc00b1cf0 tx=0x7febb001c800 comp rx=0 tx=0).stop 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 -- 172.21.15.64:0/1474215635 shutdown_connections 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 --2- 172.21.15.64:0/1474215635 >> v2:172.21.15.90:3300/0 conn(0x7febc00b3d60 0x7febc00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 --2- 172.21.15.64:0/1474215635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc00d03f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 -- 172.21.15.64:0/1474215635 >> 172.21.15.64:0/1474215635 conn(0x7febc006d1c0 msgr2=0x7febc006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 -- 172.21.15.64:0/1474215635 shutdown_connections 2024-09-21T07:27:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.859+0000 7febc7800640 1 -- 172.21.15.64:0/1474215635 wait complete. 2024-09-21T07:27:56.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 Processor -- start 2024-09-21T07:27:56.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 -- start start 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 0x7febc0150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7febc00b3d60 0x7febc00b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7febc016a380 con 0x7febc00d1d00 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7febc016a200 con 0x7febc0071190 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc7800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7febc016a500 con 0x7febc00b3d60 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45844/0 (socket says 172.21.15.64:45844) 2024-09-21T07:27:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc5800640 1 -- 172.21.15.64:0/243793482 learned_addr learned my addr 172.21.15.64:0/243793482 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.863+0000 7febc4e00640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 0x7febc0150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febb7e00640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7febc00b3d60 0x7febc00b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 -- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7febc00b3d60 msgr2=0x7febc00b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7febc00b3d60 0x7febc00b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 -- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 msgr2=0x7febc0150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 0x7febc0150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 -- 172.21.15.64:0/243793482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc014f010 con 0x7febc00d1d00 2024-09-21T07:27:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc4e00640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 0x7febc0150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc5800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7febb800c6b0 tx=0x7febb800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8003b80 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb8003d20 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc00b2250 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8005330 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc014f5d0 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc00b4170 con 0x7febc00d1d00 2024-09-21T07:27:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.867+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7febb80054d0 con 0x7febc00d1d00 2024-09-21T07:27:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.871+0000 7febbd600640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 0x7feb9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.871+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7febb8093e80 con 0x7febc00d1d00 2024-09-21T07:27:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.871+0000 7febc4e00640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 0x7feb9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.871+0000 7febc4e00640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 0x7feb9c075710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febb00af000 tx=0x7febb001b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:56.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:56.875+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7febc00b46b0 con 0x7febc00d1d00 2024-09-21T07:27:57.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.051+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7febc014ed40 con 0x7febc00d1d00 2024-09-21T07:27:57.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.051+0000 7febbd600640 1 -- 172.21.15.64:0/243793482 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v44) ==== 59+0+2294 (secure 0 0 0) 0x7febb805e880 con 0x7febc00d1d00 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:27:57.054 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:27:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:27:57.056 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:27:57.056 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:27:57.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 msgr2=0x7feb9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 0x7feb9c075710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febb00af000 tx=0x7febb001b040 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 msgr2=0x7febc015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7febb800c6b0 tx=0x7febb800cb70 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 shutdown_connections 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feb9c073200 0x7feb9c075710 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febc00d1d00 0x7febc015b770 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7febc00b3d60 0x7febc00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 --2- 172.21.15.64:0/243793482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febc0071190 0x7febc0150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 >> 172.21.15.64:0/243793482 conn(0x7febc006d1c0 msgr2=0x7febc0156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 shutdown_connections 2024-09-21T07:27:57.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.055+0000 7febc7800640 1 -- 172.21.15.64:0/243793482 wait complete. 2024-09-21T07:27:57.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:27:57.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 -- 172.21.15.64:0/1341746069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7381602f0 msgr2=0x7fe73806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 --2- 172.21.15.64:0/1341746069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7381602f0 0x7fe73806f890 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe730009bc0 tx=0x7fe73001cba0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 -- 172.21.15.64:0/1341746069 shutdown_connections 2024-09-21T07:27:57.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 --2- 172.21.15.64:0/1341746069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7381602f0 0x7fe73806f890 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 --2- 172.21.15.64:0/1341746069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 0x7fe73815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 -- 172.21.15.64:0/1341746069 >> 172.21.15.64:0/1341746069 conn(0x7fe73806d450 msgr2=0x7fe7380d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 -- 172.21.15.64:0/1341746069 shutdown_connections 2024-09-21T07:27:57.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.235+0000 7fe73cc00640 1 -- 172.21.15.64:0/1341746069 wait complete. 2024-09-21T07:27:57.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 Processor -- start 2024-09-21T07:27:57.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- start start 2024-09-21T07:27:57.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 0x7fe738165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7381602f0 0x7fe7380acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe738168df0 con 0x7fe73809df30 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe738168c70 con 0x7fe7381602f0 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe738168f70 con 0x7fe73815f9a0 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45856/0 (socket says 172.21.15.64:45856) 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 -- 172.21.15.64:0/348097248 learned_addr learned my addr 172.21.15.64:0/348097248 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe72d400640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 0x7fe738165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe736800640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7381602f0 0x7fe7380acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 -- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 msgr2=0x7fe738165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 0x7fe738165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 -- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7381602f0 msgr2=0x7fe7380acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7381602f0 0x7fe7380acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 -- 172.21.15.64:0/348097248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381fae80 con 0x7fe73809df30 2024-09-21T07:27:57.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe735e00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe72800c3f0 tx=0x7fe72800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728017070 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe728003600 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728003a50 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe738158f90 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.239+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381f70e0 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73815fdb0 con 0x7fe73809df30 2024-09-21T07:27:57.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe72801a070 con 0x7fe73809df30 2024-09-21T07:27:57.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe72ea00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 0x7fe714075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7fe7280935c0 con 0x7fe73809df30 2024-09-21T07:27:57.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe72d400640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 0x7fe714075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.243+0000 7fe72d400640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 0x7fe714075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7200058d0 tx=0x7fe720005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.247+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe7381fae80 con 0x7fe73809df30 2024-09-21T07:27:57.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.423+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe7380b3680 con 0x7fe73809df30 2024-09-21T07:27:57.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.427+0000 7fe72ea00640 1 -- 172.21.15.64:0/348097248 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fe72805e600 con 0x7fe73809df30 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 msgr2=0x7fe714075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 0x7fe714075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7200058d0 tx=0x7fe720005860 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 msgr2=0x7fe7381fa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe72800c3f0 tx=0x7fe72800c8b0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 shutdown_connections 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe714073200 0x7fe714075710 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7381602f0 0x7fe7380acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe73815f9a0 0x7fe738165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 --2- 172.21.15.64:0/348097248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe73809df30 0x7fe7381fa940 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 >> 172.21.15.64:0/348097248 conn(0x7fe73806d450 msgr2=0x7fe7380ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 shutdown_connections 2024-09-21T07:27:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.431+0000 7fe73cc00640 1 -- 172.21.15.64:0/348097248 wait complete. 2024-09-21T07:27:57.453 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:27:57.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:57.562 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:27:57.642 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:27:57.642 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:57.643 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:57.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:57.651 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:57.651 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:57.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:57.661 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:27:57.661 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:57.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:27:57.703 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:27:57.703 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:27:57.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:27:57.713 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:27:57.713 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:27:57.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- 172.21.15.64:0/3525742421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0709b0 msgr2=0x7facec0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 --2- 172.21.15.64:0/3525742421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0709b0 0x7facec0b41c0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7facd4009900 tx=0x7facd401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- 172.21.15.64:0/3525742421 shutdown_connections 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 --2- 172.21.15.64:0/3525742421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 0x7facec072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 --2- 172.21.15.64:0/3525742421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0709b0 0x7facec0b41c0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- 172.21.15.64:0/3525742421 >> 172.21.15.64:0/3525742421 conn(0x7facec0ccbe0 msgr2=0x7facec0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- 172.21.15.64:0/3525742421 shutdown_connections 2024-09-21T07:27:57.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- 172.21.15.64:0/3525742421 wait complete. 2024-09-21T07:27:57.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 Processor -- start 2024-09-21T07:27:57.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.903+0000 7facf1a00640 1 -- start start 2024-09-21T07:27:57.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facec0709b0 0x7facec1f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 0x7facec09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7facec168c90 con 0x7facec15edb0 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7facec168b10 con 0x7facec0709b0 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7facec168e10 con 0x7facec0b4700 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45864/0 (socket says 172.21.15.64:45864) 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 -- 172.21.15.64:0/1566772976 learned_addr learned my addr 172.21.15.64:0/1566772976 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7face3e00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 0x7facec09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceaa00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facec0709b0 0x7facec1f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 -- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 msgr2=0x7facec09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 0x7facec09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 -- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facec0709b0 msgr2=0x7facec1f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facec0709b0 0x7facec1f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 -- 172.21.15.64:0/1566772976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec14ab30 con 0x7facec15edb0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7faceb400640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7face400eae0 tx=0x7face4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face400ce40 con 0x7facec15edb0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face4004c20 con 0x7facec15edb0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4005020 con 0x7facec15edb0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec0c40e0 con 0x7facec15edb0 2024-09-21T07:27:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec0c5d80 con 0x7facec15edb0 2024-09-21T07:27:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.907+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec0c3e30 con 0x7facec15edb0 2024-09-21T07:27:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.911+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7face40051c0 con 0x7facec15edb0 2024-09-21T07:27:57.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.911+0000 7face2a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 0x7facc8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:57.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.911+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7face4094e90 con 0x7facec15edb0 2024-09-21T07:27:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.911+0000 7faceaa00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 0x7facc8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.911+0000 7faceaa00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 0x7facc8075740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7facdc001650 tx=0x7facdc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:57.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:57.915+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7face405ff60 con 0x7facec15edb0 2024-09-21T07:27:58.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.131+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facec0b41c0 con 0x7facec15edb0 2024-09-21T07:27:58.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.131+0000 7face2a00640 1 -- 172.21.15.64:0/1566772976 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+3911 (secure 0 0 0) 0x7face4096f60 con 0x7facec15edb0 2024-09-21T07:27:58.133 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:58.134 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":62,"btime":"2024-09-21T07:27:51:645245+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3219434518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3219434518},{"type":"v1","addr":"172.21.15.64:6833","nonce":3219434518}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3161443421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3161443421},{"type":"v1","addr":"172.21.15.90:6837","nonce":3161443421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2521639562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2521639562},{"type":"v1","addr":"172.21.15.90:6835","nonce":2521639562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7131,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2436328975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2436328975},{"type":"v1","addr":"172.21.15.64:6835","nonce":2436328975}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[]} 2024-09-21T07:27:58.134 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 62 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 msgr2=0x7facc8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 0x7facc8075740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7facdc001650 tx=0x7facdc009040 comp rx=0 tx=0).stop 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 msgr2=0x7facec0b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7face400eae0 tx=0x7face4009f70 comp rx=0 tx=0).stop 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 shutdown_connections 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7facc8073230 0x7facc8075740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec15edb0 0x7facec0b23b0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facec0b4700 0x7facec09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 --2- 172.21.15.64:0/1566772976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facec0709b0 0x7facec1f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 >> 172.21.15.64:0/1566772976 conn(0x7facec0ccbe0 msgr2=0x7facec165690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:58.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 shutdown_connections 2024-09-21T07:27:58.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.135+0000 7facf1a00640 1 -- 172.21.15.64:0/1566772976 wait complete. 2024-09-21T07:27:58.156 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:27:58.156 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:27:58.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:27:58.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:58.157 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:27:58.157 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:27:58.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:27:58.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:58.157 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:27:58.158 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:27:58.158 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:27:58.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:58.158 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:27:58.158 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:27:58.158 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:27:58.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:27:58.170 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:27:58.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:27:58.171 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:27:58.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:27:58.172 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:27:58.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:27:58.180 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:27:58.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:27:58.222 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:27:58.222 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:58.223 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:27:58.224 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:58.229 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:27:58.229 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:58.231 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:27:58.231 DEBUG:teuthology.parallel:result is None 2024-09-21T07:27:58.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:27:58.324 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:27:58.325 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:27:58.331 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:27:58.333 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:27:58.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 -- 172.21.15.64:0/2659962413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 msgr2=0x7f344c0ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 --2- 172.21.15.64:0/2659962413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c0ce360 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f344c0c3d80 tx=0x7f344401dbe0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 -- 172.21.15.64:0/2659962413 shutdown_connections 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 --2- 172.21.15.64:0/2659962413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c0ce360 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 --2- 172.21.15.64:0/2659962413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 --2- 172.21.15.64:0/2659962413 >> v2:172.21.15.90:3300/0 conn(0x7f344c0afbf0 0x7f344c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 -- 172.21.15.64:0/2659962413 >> 172.21.15.64:0/2659962413 conn(0x7f344c0b1e70 msgr2=0x7f344c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 -- 172.21.15.64:0/2659962413 shutdown_connections 2024-09-21T07:27:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.395+0000 7f344b200640 1 -- 172.21.15.64:0/2659962413 wait complete. 2024-09-21T07:27:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 Processor -- start 2024-09-21T07:27:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 -- start start 2024-09-21T07:27:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 0x7f344c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0b57b0 con 0x7f344c0cdf50 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0b1cd0 con 0x7f344c0afbf0 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f344c0b5930 con 0x7f344c0cb4e0 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45914/0 (socket says 172.21.15.64:45914) 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 -- 172.21.15.64:0/1123281122 learned_addr learned my addr 172.21.15.64:0/1123281122 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f3441400640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f3449e00640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 0x7f344c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 -- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 msgr2=0x7f344c0b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 -- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 msgr2=0x7f344c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 0x7f344c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 -- 172.21.15.64:0/1123281122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c1fc760 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f3441400640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f3449e00640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 0x7f344c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.399+0000 7f344a800640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f344400ace0 tx=0x7f3444003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440bb020 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3444004b40 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c1fca00 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440b3040 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c1fcfc0 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c0b5ec0 con 0x7f344c0cdf50 2024-09-21T07:27:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3444003fb0 con 0x7f344c0cdf50 2024-09-21T07:27:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 0x7f3428075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5507+0+0 (secure 0 0 0) 0x7f344412e6c0 con 0x7f344c0cdf50 2024-09-21T07:27:58.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.403+0000 7f3449e00640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 0x7f3428075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:58.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.407+0000 7f3449e00640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 0x7f3428075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f343c005fd0 tx=0x7f343c005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:58.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.407+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f34440c5060 con 0x7f344c0cdf50 2024-09-21T07:27:58.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:58.599+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f344c0b16b0 con 0x7f344c0cdf50 2024-09-21T07:27:59.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f3442a00640 1 -- 172.21.15.64:0/1123281122 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) ==== 97+0+0 (secure 0 0 0) 0x7f3444017860 con 0x7f344c0cdf50 2024-09-21T07:27:59.452 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 msgr2=0x7f3428075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 0x7f3428075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f343c005fd0 tx=0x7f343c005f40 comp rx=0 tx=0).stop 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 msgr2=0x7f344c159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f344400ace0 tx=0x7f3444003f40 comp rx=0 tx=0).stop 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.451+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 shutdown_connections 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3428073200 0x7f3428075710 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0cdf50 0x7f344c159ed0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f344c0cb4e0 0x7f344c0b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 --2- 172.21.15.64:0/1123281122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f344c0afbf0 0x7f344c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 >> 172.21.15.64:0/1123281122 conn(0x7f344c0b1e70 msgr2=0x7f344c0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:59.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 shutdown_connections 2024-09-21T07:27:59.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.455+0000 7f344b200640 1 -- 172.21.15.64:0/1123281122 wait complete. 2024-09-21T07:27:59.479 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 -- 172.21.15.64:0/198414718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 msgr2=0x7f44d4004150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 --2- 172.21.15.64:0/198414718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44d4004150 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f44e0006b30 tx=0x7f44e001c830 comp rx=0 tx=0).stop 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 -- 172.21.15.64:0/198414718 shutdown_connections 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 --2- 172.21.15.64:0/198414718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44d4004150 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 -- 172.21.15.64:0/198414718 >> 172.21.15.64:0/198414718 conn(0x7f44f00d0de0 msgr2=0x7f44f00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 -- 172.21.15.64:0/198414718 shutdown_connections 2024-09-21T07:27:59.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.639+0000 7f44f4a00640 1 -- 172.21.15.64:0/198414718 wait complete. 2024-09-21T07:27:59.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 Processor -- start 2024-09-21T07:27:59.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 -- start start 2024-09-21T07:27:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f015a140 0x7f44f015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 0x7f44f00c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00cc7b0 con 0x7f44d4003d00 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00cea00 con 0x7f44f015f680 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00cc930 con 0x7f44f015a140 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45926/0 (socket says 172.21.15.64:45926) 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 -- 172.21.15.64:0/358675595 learned_addr learned my addr 172.21.15.64:0/358675595 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ee800640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 0x7f44f00c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44e7e00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f015a140 0x7f44f015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 -- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f015a140 msgr2=0x7f44f015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f015a140 0x7f44f015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 -- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 msgr2=0x7f44f00c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 0x7f44f00c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 -- 172.21.15.64:0/358675595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f015fa90 con 0x7f44d4003d00 2024-09-21T07:27:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ee800640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 0x7f44f00c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:59.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44ede00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005040 tx=0x7f44e00a5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:59.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0006750 con 0x7f44d4003d00 2024-09-21T07:27:59.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44e00b4070 con 0x7f44d4003d00 2024-09-21T07:27:59.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.643+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f01fbda0 con 0x7f44d4003d00 2024-09-21T07:27:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0001870 con 0x7f44d4003d00 2024-09-21T07:27:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f01fc360 con 0x7f44d4003d00 2024-09-21T07:27:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f00cce90 con 0x7f44d4003d00 2024-09-21T07:27:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f44e0003860 con 0x7f44d4003d00 2024-09-21T07:27:59.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44e6000640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 0x7f44cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:59.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7f44e012e540 con 0x7f44d4003d00 2024-09-21T07:27:59.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.647+0000 7f44e7e00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 0x7f44cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:59.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.651+0000 7f44e7e00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 0x7f44cc075740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f44f00af190 tx=0x7f44d80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:59.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.651+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f44f015fa90 con 0x7f44d4003d00 2024-09-21T07:27:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.891+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f44f00b5c10 con 0x7f44d4003d00 2024-09-21T07:27:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44e6000640 1 -- 172.21.15.64:0/358675595 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f44f006d970 con 0x7f44d4003d00 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:59.896 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.897 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.898 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:27:59.900 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.901 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.902 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:27:59.903 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:27:59.905 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:27:59.906 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:59.907 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:27:59.908 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:27:59.910 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 msgr2=0x7f44cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 0x7f44cc075740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f44f00af190 tx=0x7f44d80091e0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 msgr2=0x7f44f0154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005040 tx=0x7f44e00a5de0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 shutdown_connections 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44cc073230 0x7f44cc075740 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f015f680 0x7f44f00c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f015a140 0x7f44f015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 --2- 172.21.15.64:0/358675595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44d4003d00 0x7f44f0154fb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 >> 172.21.15.64:0/358675595 conn(0x7f44f00d0de0 msgr2=0x7f44f015dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 shutdown_connections 2024-09-21T07:27:59.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:27:59.895+0000 7f44f4a00640 1 -- 172.21.15.64:0/358675595 wait complete. 2024-09-21T07:27:59.918 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:28:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 -- 172.21.15.64:0/4149521071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c004240 msgr2=0x7f423c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 --2- 172.21.15.64:0/4149521071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c004240 0x7f423c004810 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4240009b40 tx=0x7f424001d270 comp rx=0 tx=0).stop 2024-09-21T07:28:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f4257e00640 1 -- 172.21.15.64:0/4149521071 reap_dead start 2024-09-21T07:28:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 -- 172.21.15.64:0/4149521071 shutdown_connections 2024-09-21T07:28:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 -- 172.21.15.64:0/4149521071 >> 172.21.15.64:0/4149521071 conn(0x7f42580ccbe0 msgr2=0x7f42580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 -- 172.21.15.64:0/4149521071 shutdown_connections 2024-09-21T07:28:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.075+0000 7f425e800640 1 -- 172.21.15.64:0/4149521071 wait complete. 2024-09-21T07:28:00.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 Processor -- start 2024-09-21T07:28:00.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 -- start start 2024-09-21T07:28:00.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c004240 0x7f42580c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 0x7f42580c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f42580b4550 con 0x7f42580b1890 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42580b43d0 con 0x7f42580c7bb0 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f425e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4258073530 con 0x7f423c004240 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45934/0 (socket says 172.21.15.64:45934) 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 -- 172.21.15.64:0/2784907707 learned_addr learned my addr 172.21.15.64:0/2784907707 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257400640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c004240 0x7f42580c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f424fe00640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 0x7f42580c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 -- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c004240 msgr2=0x7f42580c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c004240 0x7f42580c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 -- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 msgr2=0x7f42580c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 0x7f42580c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 -- 172.21.15.64:0/2784907707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42580ca8b0 con 0x7f42580b1890 2024-09-21T07:28:00.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f424fe00640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 0x7f42580c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:00.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.079+0000 7f4257e00640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f90 tx=0x7f4250006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425000fa80 con 0x7f42580b1890 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4250018070 con 0x7f42580b1890 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250011430 con 0x7f42580b1890 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42580c74c0 con 0x7f42580b1890 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42580b0db0 con 0x7f42580b1890 2024-09-21T07:28:00.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4258072e20 con 0x7f42580b1890 2024-09-21T07:28:00.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.083+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42500115d0 con 0x7f42580b1890 2024-09-21T07:28:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.087+0000 7f424f400640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 0x7f4234075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.087+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7f4250095390 con 0x7f42580b1890 2024-09-21T07:28:00.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.087+0000 7f4257400640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 0x7f4234075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.087+0000 7f4257400640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 0x7f4234075710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4248006040 tx=0x7f4248006ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:00.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.087+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f42580b4b10 con 0x7f42580b1890 2024-09-21T07:28:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f425809da20 con 0x7f42580b1890 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f424f400640 1 -- 172.21.15.64:0/2784907707 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) ==== 84+0+65 (secure 0 0 0) 0x7f42500605d0 con 0x7f42580b1890 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:00.273 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:28:00.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 msgr2=0x7f4234075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 0x7f4234075710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4248006040 tx=0x7f4248006ac0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 msgr2=0x7f42580b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f90 tx=0x7f4250006660 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 shutdown_connections 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4234073200 0x7f4234075710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42580b1890 0x7f42580b1ca0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42580c7bb0 0x7f42580c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 --2- 172.21.15.64:0/2784907707 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c004240 0x7f42580c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.271+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 >> 172.21.15.64:0/2784907707 conn(0x7f42580ccbe0 msgr2=0x7f42580aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.275+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 shutdown_connections 2024-09-21T07:28:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.275+0000 7f425e800640 1 -- 172.21.15.64:0/2784907707 wait complete. 2024-09-21T07:28:00.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:28:00.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:28:00.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 -- 172.21.15.64:0/79217861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c06ec70 msgr2=0x7fd35c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 --2- 172.21.15.64:0/79217861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c06ec70 0x7fd35c158db0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009840 tx=0x7fd34c01c760 comp rx=0 tx=0).stop 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 -- 172.21.15.64:0/79217861 shutdown_connections 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 --2- 172.21.15.64:0/79217861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c1592f0 0x7fd35c0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 --2- 172.21.15.64:0/79217861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c06ec70 0x7fd35c158db0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 -- 172.21.15.64:0/79217861 >> 172.21.15.64:0/79217861 conn(0x7fd35c0d0170 msgr2=0x7fd35c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 -- 172.21.15.64:0/79217861 shutdown_connections 2024-09-21T07:28:00.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.455+0000 7fd362a00640 1 -- 172.21.15.64:0/79217861 wait complete. 2024-09-21T07:28:00.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 Processor -- start 2024-09-21T07:28:00.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 -- start start 2024-09-21T07:28:00.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35c06ec70 0x7fd35c166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c0af360 0x7fd35c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c15c850 con 0x7fd35c1592f0 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c15c6d0 con 0x7fd35c06ec70 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd362a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c15c9d0 con 0x7fd35c0af360 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45948/0 (socket says 172.21.15.64:45948) 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 -- 172.21.15.64:0/3401739640 learned_addr learned my addr 172.21.15.64:0/3401739640 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd35be00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35c06ec70 0x7fd35c166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd35b400640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c0af360 0x7fd35c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 -- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c0af360 msgr2=0x7fd35c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c0af360 0x7fd35c0b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 -- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35c06ec70 msgr2=0x7fd35c166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35c06ec70 0x7fd35c166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.459+0000 7fd360a00640 1 -- 172.21.15.64:0/3401739640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c160b60 con 0x7fd35c1592f0 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd360a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd35400cae0 tx=0x7fd35400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354016020 con 0x7fd35c1592f0 2024-09-21T07:28:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd35400ab40 con 0x7fd35c1592f0 2024-09-21T07:28:00.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35400ce20 con 0x7fd35c1592f0 2024-09-21T07:28:00.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c1605a0 con 0x7fd35c1592f0 2024-09-21T07:28:00.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c157e30 con 0x7fd35c1592f0 2024-09-21T07:28:00.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c1f7790 con 0x7fd35c1592f0 2024-09-21T07:28:00.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd354019020 con 0x7fd35c1592f0 2024-09-21T07:28:00.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 0x7fd33c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:00.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7fd354094130 con 0x7fd35c1592f0 2024-09-21T07:28:00.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.463+0000 7fd35be00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 0x7fd33c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:00.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.467+0000 7fd35be00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 0x7fd33c075710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0af000 tx=0x7fd34c01afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:00.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.471+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd354020020 con 0x7fd35c1592f0 2024-09-21T07:28:00.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:00.643+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd35c158db0 con 0x7fd35c1592f0 2024-09-21T07:28:01.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.455+0000 7fd353e00640 1 -- 172.21.15.64:0/3401739640 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) ==== 138+0+0 (secure 0 0 0) 0x7fd35405ed40 con 0x7fd35c1592f0 2024-09-21T07:28:01.457 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:28:01.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 msgr2=0x7fd33c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:01.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 0x7fd33c075710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0af000 tx=0x7fd34c01afa0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 msgr2=0x7fd35c0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd35400cae0 tx=0x7fd35400cbd0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 shutdown_connections 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd33c073200 0x7fd33c075710 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd35c1592f0 0x7fd35c0b54f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd35c0af360 0x7fd35c0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 --2- 172.21.15.64:0/3401739640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd35c06ec70 0x7fd35c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 >> 172.21.15.64:0/3401739640 conn(0x7fd35c0d0170 msgr2=0x7fd35c15f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 shutdown_connections 2024-09-21T07:28:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.459+0000 7fd362a00640 1 -- 172.21.15.64:0/3401739640 wait complete. 2024-09-21T07:28:01.490 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:28:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 -- 172.21.15.64:0/592740327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 msgr2=0x7fde200b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 --2- 172.21.15.64:0/592740327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde200b2790 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fde20073b80 tx=0x7fde1801cc60 comp rx=0 tx=0).stop 2024-09-21T07:28:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 -- 172.21.15.64:0/592740327 shutdown_connections 2024-09-21T07:28:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 --2- 172.21.15.64:0/592740327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde200b2790 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 --2- 172.21.15.64:0/592740327 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 0x7fde200b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 --2- 172.21.15.64:0/592740327 >> v2:172.21.15.90:3300/0 conn(0x7fde200ceaa0 0x7fde200ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 -- 172.21.15.64:0/592740327 >> 172.21.15.64:0/592740327 conn(0x7fde2009b340 msgr2=0x7fde200d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 -- 172.21.15.64:0/592740327 shutdown_connections 2024-09-21T07:28:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.659+0000 7fde1fe00640 1 -- 172.21.15.64:0/592740327 wait complete. 2024-09-21T07:28:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 Processor -- start 2024-09-21T07:28:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 -- start start 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 0x7fde20072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200ceaa0 0x7fde200c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fde200d0c10 con 0x7fde200b2380 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde200d0a90 con 0x7fde200ceaa0 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fde200d0d90 con 0x7fde200b1a30 2024-09-21T07:28:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:01.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45960/0 (socket says 172.21.15.64:45960) 2024-09-21T07:28:01.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 -- 172.21.15.64:0/2587226312 learned_addr learned my addr 172.21.15.64:0/2587226312 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:01.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1ea00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 0x7fde20072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:01.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde1f400640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200ceaa0 0x7fde200c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 -- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 msgr2=0x7fde20072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 0x7fde20072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 -- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200ceaa0 msgr2=0x7fde200c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200ceaa0 0x7fde200c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 -- 172.21.15.64:0/2587226312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde20144da0 con 0x7fde200b2380 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde17e00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fde0800e7c0 tx=0x7fde0800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.663+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0800ccc0 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde0800ce60 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08005280 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde20145080 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde20145640 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde200b2790 con 0x7fde200b2380 2024-09-21T07:28:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fde08005420 con 0x7fde200b2380 2024-09-21T07:28:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde16a00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 0x7fddfc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5619+0+0 (secure 0 0 0) 0x7fde08094a10 con 0x7fde200b2380 2024-09-21T07:28:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.667+0000 7fde1ea00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 0x7fddfc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.671+0000 7fde1ea00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 0x7fddfc075710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fde10009b40 tx=0x7fde100091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.675+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fde0805f430 con 0x7fde200b2380 2024-09-21T07:28:01.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:01.851+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fde20072650 con 0x7fde200b2380 2024-09-21T07:28:02.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde16a00640 1 -- 172.21.15.64:0/2587226312 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) ==== 170+0+0 (secure 0 0 0) 0x7fde08063e60 con 0x7fde200b2380 2024-09-21T07:28:02.460 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:28:02.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 msgr2=0x7fddfc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 0x7fddfc075710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fde10009b40 tx=0x7fde100091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 msgr2=0x7fde20156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fde0800e7c0 tx=0x7fde0800ec80 comp rx=0 tx=0).stop 2024-09-21T07:28:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 shutdown_connections 2024-09-21T07:28:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fddfc073200 0x7fddfc075710 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200ceaa0 0x7fde200c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde200b2380 0x7fde20156030 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 --2- 172.21.15.64:0/2587226312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde200b1a30 0x7fde20072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 >> 172.21.15.64:0/2587226312 conn(0x7fde2009b340 msgr2=0x7fde2015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.459+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 shutdown_connections 2024-09-21T07:28:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.463+0000 7fde1fe00640 1 -- 172.21.15.64:0/2587226312 wait complete. 2024-09-21T07:28:02.502 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:28:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- 172.21.15.64:0/2783233925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181602f0 msgr2=0x7f7e1806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 --2- 172.21.15.64:0/2783233925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181602f0 0x7f7e1806f890 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009c80 tx=0x7f7e1001cda0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- 172.21.15.64:0/2783233925 shutdown_connections 2024-09-21T07:28:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 --2- 172.21.15.64:0/2783233925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e181602f0 0x7f7e1806f890 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 --2- 172.21.15.64:0/2783233925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1815f9a0 0x7f7e1815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- 172.21.15.64:0/2783233925 >> 172.21.15.64:0/2783233925 conn(0x7f7e1806d450 msgr2=0x7f7e180d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- 172.21.15.64:0/2783233925 shutdown_connections 2024-09-21T07:28:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- 172.21.15.64:0/2783233925 wait complete. 2024-09-21T07:28:02.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 Processor -- start 2024-09-21T07:28:02.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.663+0000 7f7e20200640 1 -- start start 2024-09-21T07:28:02.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1809df30 0x7f7e180afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:02.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:02.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e181602f0 0x7f7e181657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18168df0 con 0x7f7e1815f9a0 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18168c70 con 0x7f7e181602f0 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7e18168f70 con 0x7f7e1809df30 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45974/0 (socket says 172.21.15.64:45974) 2024-09-21T07:28:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 -- 172.21.15.64:0/140225181 learned_addr learned my addr 172.21.15.64:0/140225181 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1d800640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1809df30 0x7f7e180afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1e200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e181602f0 0x7f7e181657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 -- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1809df30 msgr2=0x7f7e180afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1809df30 0x7f7e180afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 -- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e181602f0 msgr2=0x7f7e181657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:02.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e181602f0 0x7f7e181657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 -- 172.21.15.64:0/140225181 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e180b0010 con 0x7f7e1815f9a0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e1ce00640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400d700 tx=0x7f7e0400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04017070 con 0x7f7e1815f9a0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e04009b10 con 0x7f7e1815f9a0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04010460 con 0x7f7e1815f9a0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e180b1400 con 0x7f7e1815f9a0 2024-09-21T07:28:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1815cc80 con 0x7f7e1815f9a0 2024-09-21T07:28:02.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.667+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1815fdb0 con 0x7f7e1815f9a0 2024-09-21T07:28:02.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.671+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7e0401a070 con 0x7f7e1815f9a0 2024-09-21T07:28:02.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.671+0000 7f7e15600640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 0x7f7df8075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:02.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.671+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6001+0+0 (secure 0 0 0) 0x7f7e04094450 con 0x7f7e1815f9a0 2024-09-21T07:28:02.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.671+0000 7f7e1d800640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 0x7f7df8075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:02.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.671+0000 7f7e1d800640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 0x7f7df8075760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001780 tx=0x7f7e0c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:02.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.675+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7e0405ed60 con 0x7f7e1815f9a0 2024-09-21T07:28:02.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:02.887+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7e1815c6c0 con 0x7f7e1815f9a0 2024-09-21T07:28:03.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.479+0000 7f7e15600640 1 -- 172.21.15.64:0/140225181 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v64) ==== 174+0+0 (secure 0 0 0) 0x7f7e04063790 con 0x7f7e1815f9a0 2024-09-21T07:28:03.481 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 13 and data pool 14 2024-09-21T07:28:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 msgr2=0x7f7df8075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 0x7f7df8075760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001780 tx=0x7f7e0c009040 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 msgr2=0x7f7e180b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400d700 tx=0x7f7e0400dbc0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 shutdown_connections 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7df8073250 0x7f7df8075760 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e181602f0 0x7f7e181657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e1815f9a0 0x7f7e180b0ec0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 --2- 172.21.15.64:0/140225181 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e1809df30 0x7f7e180afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 >> 172.21.15.64:0/140225181 conn(0x7f7e1806d450 msgr2=0x7f7e180ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 shutdown_connections 2024-09-21T07:28:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.483+0000 7f7e20200640 1 -- 172.21.15.64:0/140225181 wait complete. 2024-09-21T07:28:03.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- 172.21.15.64:0/3050057243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00cc4e0 msgr2=0x7f0fb00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 --2- 172.21.15.64:0/3050057243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb00b2120 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009900 tx=0x7f0f9c01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- 172.21.15.64:0/3050057243 shutdown_connections 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 --2- 172.21.15.64:0/3050057243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb00b2120 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 --2- 172.21.15.64:0/3050057243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b4170 0x7f0fb00b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- 172.21.15.64:0/3050057243 >> 172.21.15.64:0/3050057243 conn(0x7f0fb00ccbe0 msgr2=0x7f0fb00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- 172.21.15.64:0/3050057243 shutdown_connections 2024-09-21T07:28:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- 172.21.15.64:0/3050057243 wait complete. 2024-09-21T07:28:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 Processor -- start 2024-09-21T07:28:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.687+0000 7f0fb8000640 1 -- start start 2024-09-21T07:28:03.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b2fb0 0x7f0fb00c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb009d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb01661d0 con 0x7f0fb00b4170 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0166050 con 0x7f0fb00cc4e0 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb0166350 con 0x7f0fb00b2fb0 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45984/0 (socket says 172.21.15.64:45984) 2024-09-21T07:28:03.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 -- 172.21.15.64:0/594161107 learned_addr learned my addr 172.21.15.64:0/594161107 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb5600640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b2fb0 0x7f0fb00c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb6000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb009d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 -- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b2fb0 msgr2=0x7f0fb00c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b2fb0 0x7f0fb00c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 -- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 msgr2=0x7f0fb009d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb009d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 -- 172.21.15.64:0/594161107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb01f8350 con 0x7f0fb00b4170 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb6000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb009d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb4c00640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009850 tx=0x7f0f9c0a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0b2040 con 0x7f0fb00b4170 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f9c0044b0 con 0x7f0fb00b4170 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c005270 con 0x7f0fb00b4170 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb01f7590 con 0x7f0fb00b4170 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb01f7b50 con 0x7f0fb00b4170 2024-09-21T07:28:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.691+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb00b33c0 con 0x7f0fb00b4170 2024-09-21T07:28:03.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.695+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f9c005410 con 0x7f0fb00b4170 2024-09-21T07:28:03.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.695+0000 7f0fad600640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 0x7f0f90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:03.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.695+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0f9c12de50 con 0x7f0fb00b4170 2024-09-21T07:28:03.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.695+0000 7f0fb5600640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 0x7f0f90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:03.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.695+0000 7f0fb5600640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 0x7f0f90075710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400bb50 tx=0x7f0fa400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:03.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.699+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0f9c0164d0 con 0x7f0fb00b4170 2024-09-21T07:28:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.875+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fb00b22a0 con 0x7f0fb00b4170 2024-09-21T07:28:03.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fad600640 1 -- 172.21.15.64:0/594161107 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16910 (secure 0 0 0) 0x7f0f9c0f85f0 con 0x7f0fb00b4170 2024-09-21T07:28:03.880 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:03.880 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":98,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:02.892248+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:00.658026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:01.864625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 msgr2=0x7f0f90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 0x7f0f90075710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400bb50 tx=0x7f0fa400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 msgr2=0x7f0fb009cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009850 tx=0x7f0f9c0a5810 comp rx=0 tx=0).stop 2024-09-21T07:28:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 shutdown_connections 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f90073200 0x7f0f90075710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fb00cc4e0 0x7f0fb009d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fb00b4170 0x7f0fb009cbc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 --2- 172.21.15.64:0/594161107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fb00b2fb0 0x7f0fb00c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 >> 172.21.15.64:0/594161107 conn(0x7f0fb00ccbe0 msgr2=0x7f0fb00b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 shutdown_connections 2024-09-21T07:28:03.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:03.879+0000 7f0fb8000640 1 -- 172.21.15.64:0/594161107 wait complete. 2024-09-21T07:28:03.903 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 -- 172.21.15.64:0/1911648130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b24e0 msgr2=0x7f952c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 --2- 172.21.15.64:0/1911648130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b24e0 0x7f952c0ca7b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f951c00a950 tx=0x7f951c01db70 comp rx=0 tx=0).stop 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 -- 172.21.15.64:0/1911648130 shutdown_connections 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 --2- 172.21.15.64:0/1911648130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b24e0 0x7f952c0ca7b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 -- 172.21.15.64:0/1911648130 >> 172.21.15.64:0/1911648130 conn(0x7f952c0ccbe0 msgr2=0x7f952c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 -- 172.21.15.64:0/1911648130 shutdown_connections 2024-09-21T07:28:04.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.059+0000 7f9532400640 1 -- 172.21.15.64:0/1911648130 wait complete. 2024-09-21T07:28:04.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 Processor -- start 2024-09-21T07:28:04.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 -- start start 2024-09-21T07:28:04.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 0x7f952c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f952c0cacf0 0x7f952c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1690e0 con 0x7f952c0b24e0 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f952c168f60 con 0x7f952c0b4130 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f952c169260 con 0x7f952c0cacf0 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45988/0 (socket says 172.21.15.64:45988) 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 -- 172.21.15.64:0/1114331093 learned_addr learned my addr 172.21.15.64:0/1114331093 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9523e00640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 0x7f952c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952be00640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f952c0cacf0 0x7f952c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 -- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f952c0cacf0 msgr2=0x7f952c0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f952c0cacf0 0x7f952c0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 -- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 msgr2=0x7f952c1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 0x7f952c1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 -- 172.21.15.64:0/1114331093 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0ca1d0 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9523e00640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 0x7f952c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f952b400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f951c00a8a0 tx=0x7f951c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0b3040 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f951c005310 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0046d0 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.063+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c0ca4b0 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c1fc850 con 0x7f952c0b24e0 2024-09-21T07:28:04.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c072f70 con 0x7f952c0b24e0 2024-09-21T07:28:04.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f951c004870 con 0x7f952c0b24e0 2024-09-21T07:28:04.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9523400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 0x7f9508075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f951c12ec40 con 0x7f952c0b24e0 2024-09-21T07:28:04.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.067+0000 7f9523e00640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 0x7f9508075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.071+0000 7f9523e00640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 0x7f9508075740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f952c09b540 tx=0x7f9514009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:04.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.071+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f951c017760 con 0x7f952c0b24e0 2024-09-21T07:28:04.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.251+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f952c06fec0 con 0x7f952c0b24e0 2024-09-21T07:28:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9523400640 1 -- 172.21.15.64:0/1114331093 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16910 (secure 0 0 0) 0x7f951c0f9a30 con 0x7f952c0b24e0 2024-09-21T07:28:04.255 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:04.255 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":98,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:02.892248+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:00.658026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:01.864625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:04.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 msgr2=0x7f9508075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 0x7f9508075740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f952c09b540 tx=0x7f9514009040 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 msgr2=0x7f952c0c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f951c00a8a0 tx=0x7f951c005ca0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 shutdown_connections 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9508073230 0x7f9508075740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f952c0cacf0 0x7f952c0afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952c0b4130 0x7f952c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 --2- 172.21.15.64:0/1114331093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952c0b24e0 0x7f952c0c4600 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 >> 172.21.15.64:0/1114331093 conn(0x7f952c0ccbe0 msgr2=0x7f952c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 shutdown_connections 2024-09-21T07:28:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.255+0000 7f9532400640 1 -- 172.21.15.64:0/1114331093 wait complete. 2024-09-21T07:28:04.278 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:28:04.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.435+0000 7f2b5f800640 1 -- 172.21.15.64:0/2456966911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 msgr2=0x7f2b580ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.435+0000 7f2b5f800640 1 --2- 172.21.15.64:0/2456966911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b580ceb40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f2b580711c0 tx=0x7f2b5001cd80 comp rx=0 tx=0).stop 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- 172.21.15.64:0/2456966911 shutdown_connections 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- 172.21.15.64:0/2456966911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b580ceb40 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- 172.21.15.64:0/2456966911 >> v2:172.21.15.90:3300/0 conn(0x7f2b580b3910 0x7f2b580ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- 172.21.15.64:0/2456966911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b5809df30 0x7f2b580b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- 172.21.15.64:0/2456966911 >> 172.21.15.64:0/2456966911 conn(0x7f2b5806d450 msgr2=0x7f2b580d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- 172.21.15.64:0/2456966911 shutdown_connections 2024-09-21T07:28:04.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- 172.21.15.64:0/2456966911 wait complete. 2024-09-21T07:28:04.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 Processor -- start 2024-09-21T07:28:04.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- start start 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b5809df30 0x7f2b58155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 0x7f2b5815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580ccef0 con 0x7f2b580ce730 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580ccd70 con 0x7f2b5809df30 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.439+0000 7f2b5f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2b580cd070 con 0x7f2b580b3910 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b5809df30 0x7f2b58155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45996/0 (socket says 172.21.15.64:45996) 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 -- 172.21.15.64:0/1927323379 learned_addr learned my addr 172.21.15.64:0/1927323379 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b57e00640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 0x7f2b5815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 -- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 msgr2=0x7f2b5815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 0x7f2b5815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 -- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b5809df30 msgr2=0x7f2b58155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b5809df30 0x7f2b58155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 -- 172.21.15.64:0/1927323379 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5815f200 con 0x7f2b580ce730 2024-09-21T07:28:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b57e00640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 0x7f2b5815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5d800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001b430 tx=0x7f2b50005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b500bb070 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b50004d40 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b500b2040 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b58159880 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b581fcb90 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5815ec90 con 0x7f2b580ce730 2024-09-21T07:28:04.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.443+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b50004240 con 0x7f2b580ce730 2024-09-21T07:28:04.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.447+0000 7f2b54c00640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 0x7f2b38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:04.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.447+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2b5012e200 con 0x7f2b580ce730 2024-09-21T07:28:04.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.447+0000 7f2b5ce00640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 0x7f2b38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:04.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.447+0000 7f2b5ce00640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 0x7f2b38075710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005fd0 tx=0x7f2b4c00b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:04.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.451+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2b50016970 con 0x7f2b580ce730 2024-09-21T07:28:04.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:04.667+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2b580ce1f0 con 0x7f2b580ce730 2024-09-21T07:28:05.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.507+0000 7f2b54c00640 1 -- 172.21.15.64:0/1927323379 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f2b500f8a30 con 0x7f2b580ce730 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 msgr2=0x7f2b38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 0x7f2b38075710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005fd0 tx=0x7f2b4c00b260 comp rx=0 tx=0).stop 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 msgr2=0x7f2b581fbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001b430 tx=0x7f2b50005b00 comp rx=0 tx=0).stop 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 shutdown_connections 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b38073200 0x7f2b38075710 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b580ce730 0x7f2b581fbdd0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b580b3910 0x7f2b5815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 --2- 172.21.15.64:0/1927323379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b5809df30 0x7f2b58155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 >> 172.21.15.64:0/1927323379 conn(0x7f2b5806d450 msgr2=0x7f2b580cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 shutdown_connections 2024-09-21T07:28:05.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.511+0000 7f2b5f800640 1 -- 172.21.15.64:0/1927323379 wait complete. 2024-09-21T07:28:05.537 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:28:05.538 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- 172.21.15.64:0/2154276143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00ce900 msgr2=0x7ff6a006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/2154276143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00ce900 0x7ff6a006f890 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff698009bc0 tx=0x7ff69801cba0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- 172.21.15.64:0/2154276143 shutdown_connections 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/2154276143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00ce900 0x7ff6a006f890 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/2154276143 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 0x7ff6a00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- 172.21.15.64:0/2154276143 >> 172.21.15.64:0/2154276143 conn(0x7ff6a006d450 msgr2=0x7ff6a00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- 172.21.15.64:0/2154276143 shutdown_connections 2024-09-21T07:28:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- 172.21.15.64:0/2154276143 wait complete. 2024-09-21T07:28:05.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 Processor -- start 2024-09-21T07:28:05.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.703+0000 7ff6a4e00640 1 -- start start 2024-09-21T07:28:05.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 0x7ff6a0165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:05.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:05.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6a00ce900 0x7ff6a01fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:05.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0169000 con 0x7ff6a00b3910 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0168e80 con 0x7ff6a00ce900 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a0169180 con 0x7ff6a009df30 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32938/0 (socket says 172.21.15.64:32938) 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 -- 172.21.15.64:0/1754343672 learned_addr learned my addr 172.21.15.64:0/1754343672 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff69de00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 0x7ff6a0165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff69e800640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6a00ce900 0x7ff6a01fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 -- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 msgr2=0x7ff6a0165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 0x7ff6a0165780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 -- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6a00ce900 msgr2=0x7ff6a01fc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6a00ce900 0x7ff6a01fc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 -- 172.21.15.64:0/1754343672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a00b0250 con 0x7ff6a00b3910 2024-09-21T07:28:05.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff697e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c3c0 tx=0x7ff68800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:05.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688011790 con 0x7ff6a00b3910 2024-09-21T07:28:05.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff688017070 con 0x7ff6a00b3910 2024-09-21T07:28:05.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a00b0530 con 0x7ff6a00b3910 2024-09-21T07:28:05.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688011ce0 con 0x7ff6a00b3910 2024-09-21T07:28:05.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a00b0af0 con 0x7ff6a00b3910 2024-09-21T07:28:05.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.707+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a00b33d0 con 0x7ff6a00b3910 2024-09-21T07:28:05.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.711+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff68801c460 con 0x7ff6a00b3910 2024-09-21T07:28:05.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.711+0000 7ff696000640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 0x7ff67c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:05.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.711+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7ff688093fd0 con 0x7ff6a00b3910 2024-09-21T07:28:05.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.711+0000 7ff69de00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 0x7ff67c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:05.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.711+0000 7ff69de00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 0x7ff67c075710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff690005fd0 tx=0x7ff69000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:05.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.715+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff68805e800 con 0x7ff6a00b3910 2024-09-21T07:28:05.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:05.939+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff6a00ae490 con 0x7ff6a00b3910 2024-09-21T07:28:06.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.515+0000 7ff696000640 1 -- 172.21.15.64:0/1754343672 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7ff688063230 con 0x7ff6a00b3910 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 msgr2=0x7ff67c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 0x7ff67c075710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff690005fd0 tx=0x7ff69000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 msgr2=0x7ff6a0165cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c3c0 tx=0x7ff68800c880 comp rx=0 tx=0).stop 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 shutdown_connections 2024-09-21T07:28:06.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff67c073200 0x7ff67c075710 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6a00ce900 0x7ff6a01fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6a00b3910 0x7ff6a0165cc0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 --2- 172.21.15.64:0/1754343672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff6a009df30 0x7ff6a0165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 >> 172.21.15.64:0/1754343672 conn(0x7ff6a006d450 msgr2=0x7ff6a00ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 shutdown_connections 2024-09-21T07:28:06.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.519+0000 7ff6a4e00640 1 -- 172.21.15.64:0/1754343672 wait complete. 2024-09-21T07:28:06.544 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:28:06.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:06.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 -- 172.21.15.64:0/298868420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd314004810 msgr2=0x7fd314004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 --2- 172.21.15.64:0/298868420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd314004810 0x7fd314004c20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd31800c2e0 tx=0x7fd31801f740 comp rx=0 tx=0).stop 2024-09-21T07:28:06.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd332200640 1 -- 172.21.15.64:0/298868420 reap_dead start 2024-09-21T07:28:06.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 -- 172.21.15.64:0/298868420 shutdown_connections 2024-09-21T07:28:06.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 -- 172.21.15.64:0/298868420 >> 172.21.15.64:0/298868420 conn(0x7fd32c0ccbe0 msgr2=0x7fd32c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:06.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 -- 172.21.15.64:0/298868420 shutdown_connections 2024-09-21T07:28:06.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.703+0000 7fd334200640 1 -- 172.21.15.64:0/298868420 wait complete. 2024-09-21T07:28:06.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 Processor -- start 2024-09-21T07:28:06.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 -- start start 2024-09-21T07:28:06.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 0x7fd32c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:06.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 0x7fd32c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:06.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c072e20 con 0x7fd32c1e82e0 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0b4ae0 con 0x7fd314004810 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd334200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c072fa0 con 0x7fd32c158e30 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32950/0 (socket says 172.21.15.64:32950) 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 -- 172.21.15.64:0/355353246 learned_addr learned my addr 172.21.15.64:0/355353246 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd330e00640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 0x7fd32c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd331800640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 0x7fd32c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 -- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 msgr2=0x7fd32c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 0x7fd32c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 -- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 msgr2=0x7fd32c1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 0x7fd32c1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 -- 172.21.15.64:0/355353246 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c1e8c30 con 0x7fd32c1e82e0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd330e00640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 0x7fd32c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd331800640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 0x7fd32c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.707+0000 7fd332200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0ceee0 tx=0x7fd324010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324017070 con 0x7fd32c1e82e0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd324015070 con 0x7fd32c1e82e0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324004d90 con 0x7fd32c1e82e0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c1f72e0 con 0x7fd32c1e82e0 2024-09-21T07:28:06.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1f78a0 con 0x7fd32c1e82e0 2024-09-21T07:28:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c1f7050 con 0x7fd32c1e82e0 2024-09-21T07:28:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd32400e940 con 0x7fd32c1e82e0 2024-09-21T07:28:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fd3240948d0 con 0x7fd32c1e82e0 2024-09-21T07:28:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.711+0000 7fd331800640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.715+0000 7fd331800640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd320009aa0 tx=0x7fd3200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:06.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.715+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd32c1e8c30 con 0x7fd32c1e82e0 2024-09-21T07:28:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.927+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd32c0700b0 con 0x7fd32c1e82e0 2024-09-21T07:28:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd329600640 1 -- 172.21.15.64:0/355353246 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5222 (secure 0 0 0) 0x7fd324066e20 con 0x7fd32c1e82e0 2024-09-21T07:28:06.932 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:06.932 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":68,"btime":"2024-09-21T07:28:06:516570+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6434,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1949078533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1949078533},{"type":"v1","addr":"172.21.15.64:6834","nonce":1949078533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6437,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/311810591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":311810591},{"type":"v1","addr":"172.21.15.64:6835","nonce":311810591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2030244673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2030244673},{"type":"v1","addr":"172.21.15.90:6836","nonce":2030244673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:05.941571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7233":{"gid":7233,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/4106969991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":4106969991},{"type":"v1","addr":"172.21.15.90:6837","nonce":4106969991}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7233,"qdb_cluster":[7233]},"id":6}]} 2024-09-21T07:28:06.932 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 68 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 msgr2=0x7fd30c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd320009aa0 tx=0x7fd3200091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 msgr2=0x7fd32c1e86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0ceee0 tx=0x7fd324010e90 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 shutdown_connections 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd32c1e82e0 0x7fd32c1e86f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd32c158e30 0x7fd32c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 --2- 172.21.15.64:0/355353246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd314004810 0x7fd32c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 >> 172.21.15.64:0/355353246 conn(0x7fd32c0ccbe0 msgr2=0x7fd32c09ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 shutdown_connections 2024-09-21T07:28:06.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:06.931+0000 7fd334200640 1 -- 172.21.15.64:0/355353246 wait complete. 2024-09-21T07:28:06.954 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 -- 172.21.15.64:0/4280302342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 msgr2=0x7f4dd8070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 --2- 172.21.15.64:0/4280302342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd8070310 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009870 tx=0x7f4dc801c7f0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 -- 172.21.15.64:0/4280302342 shutdown_connections 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 --2- 172.21.15.64:0/4280302342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd8070310 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 -- 172.21.15.64:0/4280302342 >> 172.21.15.64:0/4280302342 conn(0x7f4dd80ccbe0 msgr2=0x7f4dd80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 -- 172.21.15.64:0/4280302342 shutdown_connections 2024-09-21T07:28:07.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 -- 172.21.15.64:0/4280302342 wait complete. 2024-09-21T07:28:07.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.111+0000 7f4dddc00640 1 Processor -- start 2024-09-21T07:28:07.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- start start 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4dd8070850 0x7f4dd80b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80ad690 0x7f4dd815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd816b6b0 con 0x7f4dd815cbd0 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd816b530 con 0x7f4dd80ad690 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd816b830 con 0x7f4dd8070850 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32974/0 (socket says 172.21.15.64:32974) 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 -- 172.21.15.64:0/1900491828 learned_addr learned my addr 172.21.15.64:0/1900491828 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:07.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dd6a00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4dd8070850 0x7f4dd80b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dd7400640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80ad690 0x7f4dd815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 -- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4dd8070850 msgr2=0x7f4dd80b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4dd8070850 0x7f4dd80b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 -- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80ad690 msgr2=0x7f4dd815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80ad690 0x7f4dd815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 -- 172.21.15.64:0/1900491828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd80afaa0 con 0x7f4dd815cbd0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcfe00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c430 tx=0x7f4dc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0011790 con 0x7f4dd815cbd0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dc0017070 con 0x7f4dd815cbd0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0011ce0 con 0x7f4dd815cbd0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd80aff10 con 0x7f4dd815cbd0 2024-09-21T07:28:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.115+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd80b04d0 con 0x7f4dd815cbd0 2024-09-21T07:28:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd8070310 con 0x7f4dd815cbd0 2024-09-21T07:28:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4dc001c460 con 0x7f4dd815cbd0 2024-09-21T07:28:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dcea00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f4dc0094080 con 0x7f4dd815cbd0 2024-09-21T07:28:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dd6a00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.119+0000 7f4dd6a00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 0x7f4db4075710 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80af000 tx=0x7f4dc801b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.123+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4dc005e970 con 0x7f4dd815cbd0 2024-09-21T07:28:07.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.299+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dd80afc70 con 0x7f4dd815cbd0 2024-09-21T07:28:07.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dcea00640 1 -- 172.21.15.64:0/1900491828 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16897 (secure 0 0 0) 0x7f4dc00633a0 con 0x7f4dd815cbd0 2024-09-21T07:28:07.304 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:07.304 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":99,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:04.481718+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:00.658026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:01.864625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 msgr2=0x7f4db4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 0x7f4db4075710 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80af000 tx=0x7f4dc801b030 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 msgr2=0x7f4dd80ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c430 tx=0x7f4dc000c8f0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 shutdown_connections 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80ad690 0x7f4dd815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4dd815cbd0 0x7f4dd80ad150 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 --2- 172.21.15.64:0/1900491828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4dd8070850 0x7f4dd80b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 >> 172.21.15.64:0/1900491828 conn(0x7f4dd80ccbe0 msgr2=0x7f4dd80739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 shutdown_connections 2024-09-21T07:28:07.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.303+0000 7f4dddc00640 1 -- 172.21.15.64:0/1900491828 wait complete. 2024-09-21T07:28:07.327 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:28:07.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 -- 172.21.15.64:0/1391632692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd815cbd0 msgr2=0x7fbdd8070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 --2- 172.21.15.64:0/1391632692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd815cbd0 0x7fbdd8070310 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009c80 tx=0x7fbdc801cd30 comp rx=0 tx=0).stop 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 -- 172.21.15.64:0/1391632692 shutdown_connections 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 --2- 172.21.15.64:0/1391632692 >> v2:172.21.15.90:3300/0 conn(0x7fbdd80b22f0 0x7fbdd80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 --2- 172.21.15.64:0/1391632692 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd815cbd0 0x7fbdd8070310 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 -- 172.21.15.64:0/1391632692 >> 172.21.15.64:0/1391632692 conn(0x7fbdd80ccbe0 msgr2=0x7fbdd80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 -- 172.21.15.64:0/1391632692 shutdown_connections 2024-09-21T07:28:07.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.483+0000 7fbddee00640 1 -- 172.21.15.64:0/1391632692 wait complete. 2024-09-21T07:28:07.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 Processor -- start 2024-09-21T07:28:07.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- start start 2024-09-21T07:28:07.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd8070850 0x7fbdd8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbdd815cbd0 0x7fbdd809a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd816a290 con 0x7fbdd809af30 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd80b4280 con 0x7fbdd8070850 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd816a410 con 0x7fbdd815cbd0 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32992/0 (socket says 172.21.15.64:32992) 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 -- 172.21.15.64:0/224607027 learned_addr learned my addr 172.21.15.64:0/224607027 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd8070850 0x7fbdd8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbdcf400640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbdd815cbd0 0x7fbdd809a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 -- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbdd815cbd0 msgr2=0x7fbdd809a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbdd815cbd0 0x7fbdd809a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 -- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd8070850 msgr2=0x7fbdd8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd8070850 0x7fbdd8157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 -- 172.21.15.64:0/224607027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8158160 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddce00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d640 tx=0x7fbdd000db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0017070 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd0005310 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd809b720 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00047b0 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.487+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81fc3b0 con 0x7fbdd809af30 2024-09-21T07:28:07.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.491+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd80cbcd0 con 0x7fbdd809af30 2024-09-21T07:28:07.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.491+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbdd0004950 con 0x7fbdd809af30 2024-09-21T07:28:07.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.491+0000 7fbdd4c00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 0x7fbdb4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.491+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fbdd0094320 con 0x7fbdd809af30 2024-09-21T07:28:07.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.491+0000 7fbdd7e00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 0x7fbdb4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.495+0000 7fbdd7e00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 0x7fbdb4075740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80af000 tx=0x7fbdc801b570 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.495+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbdd005eb50 con 0x7fbdd809af30 2024-09-21T07:28:07.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.675+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbdd809b4b0 con 0x7fbdb4073230 2024-09-21T07:28:07.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.679+0000 7fbdd4c00640 1 -- 172.21.15.64:0/224607027 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247700 (secure 0 0 0) 0x7fbdd809b4b0 con 0x7fbdb4073230 2024-09-21T07:28:07.684 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:07.685 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 msgr2=0x7fbdb4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 0x7fbdb4075740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80af000 tx=0x7fbdc801b570 comp rx=0 tx=0).stop 2024-09-21T07:28:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 msgr2=0x7fbdd80c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d640 tx=0x7fbdd000db00 comp rx=0 tx=0).stop 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 shutdown_connections 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbdb4073230 0x7fbdb4075740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbdd809af30 0x7fbdd80c9090 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbdd815cbd0 0x7fbdd809a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 --2- 172.21.15.64:0/224607027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd8070850 0x7fbdd8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 >> 172.21.15.64:0/224607027 conn(0x7fbdd80ccbe0 msgr2=0x7fbdd815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 shutdown_connections 2024-09-21T07:28:07.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.683+0000 7fbddee00640 1 -- 172.21.15.64:0/224607027 wait complete. 2024-09-21T07:28:07.705 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-09-21T07:28:07.507100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309888,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664832,"statfs":{"total":773094113280,"available":772776787968,"internally_reserved":0,"allocated":10698752,"data_stored":5585818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":306433587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486307+0000","last_change":"2024-09-21T07:28:03.498429+0000","last_active":"2024-09-21T07:28:04.486307+0000","last_peered":"2024-09-21T07:28:04.486307+0000","last_clean":"2024-09-21T07:28:04.486307+0000","last_became_active":"2024-09-21T07:28:03.498139+0000","last_became_peered":"2024-09-21T07:28:03.498139+0000","last_unstale":"2024-09-21T07:28:04.486307+0000","last_undegraded":"2024-09-21T07:28:04.486307+0000","last_fullsized":"2024-09-21T07:28:04.486307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:18.070246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475069+0000","last_change":"2024-09-21T07:28:02.475069+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475069+0000","last_undegraded":"2024-09-21T07:28:02.475069+0000","last_fullsized":"2024-09-21T07:28:02.475069+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486317+0000","last_change":"2024-09-21T07:28:03.500537+0000","last_active":"2024-09-21T07:28:04.486317+0000","last_peered":"2024-09-21T07:28:04.486317+0000","last_clean":"2024-09-21T07:28:04.486317+0000","last_became_active":"2024-09-21T07:28:03.500232+0000","last_became_peered":"2024-09-21T07:28:03.500232+0000","last_unstale":"2024-09-21T07:28:04.486317+0000","last_undegraded":"2024-09-21T07:28:04.486317+0000","last_fullsized":"2024-09-21T07:28:04.486317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:40.849017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468819+0000","last_change":"2024-09-21T07:28:02.468819+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468819+0000","last_undegraded":"2024-09-21T07:28:02.468819+0000","last_fullsized":"2024-09-21T07:28:02.468819+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472274+0000","last_change":"2024-09-21T07:28:02.472274+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472274+0000","last_undegraded":"2024-09-21T07:28:02.472274+0000","last_fullsized":"2024-09-21T07:28:02.472274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.480209+0000","last_change":"2024-09-21T07:28:02.480209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.480209+0000","last_undegraded":"2024-09-21T07:28:02.480209+0000","last_fullsized":"2024-09-21T07:28:02.480209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559345+0000","last_change":"2024-09-21T07:28:03.514701+0000","last_active":"2024-09-21T07:28:04.559345+0000","last_peered":"2024-09-21T07:28:04.559345+0000","last_clean":"2024-09-21T07:28:04.559345+0000","last_became_active":"2024-09-21T07:28:03.514394+0000","last_became_peered":"2024-09-21T07:28:03.514394+0000","last_unstale":"2024-09-21T07:28:04.559345+0000","last_undegraded":"2024-09-21T07:28:04.559345+0000","last_fullsized":"2024-09-21T07:28:04.559345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:13.467674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469662+0000","last_change":"2024-09-21T07:28:02.469662+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469662+0000","last_undegraded":"2024-09-21T07:28:02.469662+0000","last_fullsized":"2024-09-21T07:28:02.469662+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474209+0000","last_change":"2024-09-21T07:28:02.474209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474209+0000","last_undegraded":"2024-09-21T07:28:02.474209+0000","last_fullsized":"2024-09-21T07:28:02.474209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465314+0000","last_change":"2024-09-21T07:28:02.465314+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465314+0000","last_undegraded":"2024-09-21T07:28:02.465314+0000","last_fullsized":"2024-09-21T07:28:02.465314+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479071+0000","last_change":"2024-09-21T07:28:02.479071+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479071+0000","last_undegraded":"2024-09-21T07:28:02.479071+0000","last_fullsized":"2024-09-21T07:28:02.479071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466077+0000","last_change":"2024-09-21T07:28:02.466077+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466077+0000","last_undegraded":"2024-09-21T07:28:02.466077+0000","last_fullsized":"2024-09-21T07:28:02.466077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466930+0000","last_change":"2024-09-21T07:28:02.466930+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466930+0000","last_undegraded":"2024-09-21T07:28:02.466930+0000","last_fullsized":"2024-09-21T07:28:02.466930+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471082+0000","last_change":"2024-09-21T07:28:02.471082+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471082+0000","last_undegraded":"2024-09-21T07:28:02.471082+0000","last_fullsized":"2024-09-21T07:28:02.471082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466470+0000","last_change":"2024-09-21T07:28:02.466470+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466470+0000","last_undegraded":"2024-09-21T07:28:02.466470+0000","last_fullsized":"2024-09-21T07:28:02.466470+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479710+0000","last_change":"2024-09-21T07:28:02.479710+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479710+0000","last_undegraded":"2024-09-21T07:28:02.479710+0000","last_fullsized":"2024-09-21T07:28:02.479710+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479066+0000","last_change":"2024-09-21T07:28:02.479066+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479066+0000","last_undegraded":"2024-09-21T07:28:02.479066+0000","last_fullsized":"2024-09-21T07:28:02.479066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486498+0000","last_change":"2024-09-21T07:28:03.516916+0000","last_active":"2024-09-21T07:28:04.486498+0000","last_peered":"2024-09-21T07:28:04.486498+0000","last_clean":"2024-09-21T07:28:04.486498+0000","last_became_active":"2024-09-21T07:28:03.516579+0000","last_became_peered":"2024-09-21T07:28:03.516579+0000","last_unstale":"2024-09-21T07:28:04.486498+0000","last_undegraded":"2024-09-21T07:28:04.486498+0000","last_fullsized":"2024-09-21T07:28:04.486498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478599+0000","last_change":"2024-09-21T07:28:02.478599+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478599+0000","last_undegraded":"2024-09-21T07:28:02.478599+0000","last_fullsized":"2024-09-21T07:28:02.478599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467656+0000","last_change":"2024-09-21T07:28:02.467656+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467656+0000","last_undegraded":"2024-09-21T07:28:02.467656+0000","last_fullsized":"2024-09-21T07:28:02.467656+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472810+0000","last_change":"2024-09-21T07:28:02.472810+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472810+0000","last_undegraded":"2024-09-21T07:28:02.472810+0000","last_fullsized":"2024-09-21T07:28:02.472810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470466+0000","last_change":"2024-09-21T07:28:02.470466+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470466+0000","last_undegraded":"2024-09-21T07:28:02.470466+0000","last_fullsized":"2024-09-21T07:28:02.470466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470127+0000","last_change":"2024-09-21T07:28:02.470127+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470127+0000","last_undegraded":"2024-09-21T07:28:02.470127+0000","last_fullsized":"2024-09-21T07:28:02.470127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485864+0000","last_change":"2024-09-21T07:28:03.496999+0000","last_active":"2024-09-21T07:28:04.485864+0000","last_peered":"2024-09-21T07:28:04.485864+0000","last_clean":"2024-09-21T07:28:04.485864+0000","last_became_active":"2024-09-21T07:28:03.495267+0000","last_became_peered":"2024-09-21T07:28:03.495267+0000","last_unstale":"2024-09-21T07:28:04.485864+0000","last_undegraded":"2024-09-21T07:28:04.485864+0000","last_fullsized":"2024-09-21T07:28:04.485864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:33.747730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474681+0000","last_change":"2024-09-21T07:28:02.474681+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474681+0000","last_undegraded":"2024-09-21T07:28:02.474681+0000","last_fullsized":"2024-09-21T07:28:02.474681+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477889+0000","last_change":"2024-09-21T07:28:02.477889+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477889+0000","last_undegraded":"2024-09-21T07:28:02.477889+0000","last_fullsized":"2024-09-21T07:28:02.477889+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465301+0000","last_change":"2024-09-21T07:28:02.465301+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465301+0000","last_undegraded":"2024-09-21T07:28:02.465301+0000","last_fullsized":"2024-09-21T07:28:02.465301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467158+0000","last_change":"2024-09-21T07:28:02.467158+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467158+0000","last_undegraded":"2024-09-21T07:28:02.467158+0000","last_fullsized":"2024-09-21T07:28:02.467158+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559111+0000","last_change":"2024-09-21T07:28:03.522857+0000","last_active":"2024-09-21T07:28:04.559111+0000","last_peered":"2024-09-21T07:28:04.559111+0000","last_clean":"2024-09-21T07:28:04.559111+0000","last_became_active":"2024-09-21T07:28:03.522439+0000","last_became_peered":"2024-09-21T07:28:03.522439+0000","last_unstale":"2024-09-21T07:28:04.559111+0000","last_undegraded":"2024-09-21T07:28:04.559111+0000","last_fullsized":"2024-09-21T07:28:04.559111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469797+0000","last_change":"2024-09-21T07:28:02.469797+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469797+0000","last_undegraded":"2024-09-21T07:28:02.469797+0000","last_fullsized":"2024-09-21T07:28:02.469797+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474365+0000","last_change":"2024-09-21T07:28:02.474365+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474365+0000","last_undegraded":"2024-09-21T07:28:02.474365+0000","last_fullsized":"2024-09-21T07:28:02.474365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479245+0000","last_change":"2024-09-21T07:28:02.479245+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479245+0000","last_undegraded":"2024-09-21T07:28:02.479245+0000","last_fullsized":"2024-09-21T07:28:02.479245+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477183+0000","last_change":"2024-09-21T07:28:02.477183+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477183+0000","last_undegraded":"2024-09-21T07:28:02.477183+0000","last_fullsized":"2024-09-21T07:28:02.477183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.486046+0000","last_change":"2024-09-21T07:28:02.480401+0000","last_active":"2024-09-21T07:28:02.486046+0000","last_peered":"2024-09-21T07:28:02.486046+0000","last_clean":"2024-09-21T07:28:02.486046+0000","last_became_active":"2024-09-21T07:28:02.480063+0000","last_became_peered":"2024-09-21T07:28:02.480063+0000","last_unstale":"2024-09-21T07:28:02.486046+0000","last_undegraded":"2024-09-21T07:28:02.486046+0000","last_fullsized":"2024-09-21T07:28:02.486046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.683081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478264+0000","last_change":"2024-09-21T07:28:02.478264+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478264+0000","last_undegraded":"2024-09-21T07:28:02.478264+0000","last_fullsized":"2024-09-21T07:28:02.478264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.490708+0000","last_change":"2024-09-21T07:28:02.489572+0000","last_active":"2024-09-21T07:28:02.490708+0000","last_peered":"2024-09-21T07:28:02.490708+0000","last_clean":"2024-09-21T07:28:02.490708+0000","last_became_active":"2024-09-21T07:28:02.489240+0000","last_became_peered":"2024-09-21T07:28:02.489240+0000","last_unstale":"2024-09-21T07:28:02.490708+0000","last_undegraded":"2024-09-21T07:28:02.490708+0000","last_fullsized":"2024-09-21T07:28:02.490708+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:06.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559385+0000","last_change":"2024-09-21T07:28:03.526754+0000","last_active":"2024-09-21T07:28:04.559385+0000","last_peered":"2024-09-21T07:28:04.559385+0000","last_clean":"2024-09-21T07:28:04.559385+0000","last_became_active":"2024-09-21T07:28:03.526453+0000","last_became_peered":"2024-09-21T07:28:03.526453+0000","last_unstale":"2024-09-21T07:28:04.559385+0000","last_undegraded":"2024-09-21T07:28:04.559385+0000","last_fullsized":"2024-09-21T07:28:04.559385+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559310+0000","last_change":"2024-09-21T07:28:02.492575+0000","last_active":"2024-09-21T07:28:04.559310+0000","last_peered":"2024-09-21T07:28:04.559310+0000","last_clean":"2024-09-21T07:28:04.559310+0000","last_became_active":"2024-09-21T07:28:02.491529+0000","last_became_peered":"2024-09-21T07:28:02.491529+0000","last_unstale":"2024-09-21T07:28:04.559310+0000","last_undegraded":"2024-09-21T07:28:04.559310+0000","last_fullsized":"2024-09-21T07:28:04.559310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476312+0000","last_change":"2024-09-21T07:28:02.476312+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476312+0000","last_undegraded":"2024-09-21T07:28:02.476312+0000","last_fullsized":"2024-09-21T07:28:02.476312+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487115+0000","last_change":"2024-09-21T07:28:02.483081+0000","last_active":"2024-09-21T07:28:02.487115+0000","last_peered":"2024-09-21T07:28:02.487115+0000","last_clean":"2024-09-21T07:28:02.487115+0000","last_became_active":"2024-09-21T07:28:02.482548+0000","last_became_peered":"2024-09-21T07:28:02.482548+0000","last_unstale":"2024-09-21T07:28:02.487115+0000","last_undegraded":"2024-09-21T07:28:02.487115+0000","last_fullsized":"2024-09-21T07:28:02.487115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.915932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469139+0000","last_change":"2024-09-21T07:28:02.469139+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469139+0000","last_undegraded":"2024-09-21T07:28:02.469139+0000","last_fullsized":"2024-09-21T07:28:02.469139+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487087+0000","last_change":"2024-09-21T07:28:02.485679+0000","last_active":"2024-09-21T07:28:02.487087+0000","last_peered":"2024-09-21T07:28:02.487087+0000","last_clean":"2024-09-21T07:28:02.487087+0000","last_became_active":"2024-09-21T07:28:02.484985+0000","last_became_peered":"2024-09-21T07:28:02.484985+0000","last_unstale":"2024-09-21T07:28:02.487087+0000","last_undegraded":"2024-09-21T07:28:02.487087+0000","last_fullsized":"2024-09-21T07:28:02.487087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:10.970100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469579+0000","last_change":"2024-09-21T07:28:02.469579+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469579+0000","last_undegraded":"2024-09-21T07:28:02.469579+0000","last_fullsized":"2024-09-21T07:28:02.469579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488859+0000","last_change":"2024-09-21T07:28:02.484131+0000","last_active":"2024-09-21T07:28:02.488859+0000","last_peered":"2024-09-21T07:28:02.488859+0000","last_clean":"2024-09-21T07:28:02.488859+0000","last_became_active":"2024-09-21T07:28:02.483822+0000","last_became_peered":"2024-09-21T07:28:02.483822+0000","last_unstale":"2024-09-21T07:28:02.488859+0000","last_undegraded":"2024-09-21T07:28:02.488859+0000","last_fullsized":"2024-09-21T07:28:02.488859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:19.845520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476090+0000","last_change":"2024-09-21T07:28:02.476090+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476090+0000","last_undegraded":"2024-09-21T07:28:02.476090+0000","last_fullsized":"2024-09-21T07:28:02.476090+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485851+0000","last_change":"2024-09-21T07:28:02.481366+0000","last_active":"2024-09-21T07:28:04.485851+0000","last_peered":"2024-09-21T07:28:04.485851+0000","last_clean":"2024-09-21T07:28:04.485851+0000","last_became_active":"2024-09-21T07:28:02.480991+0000","last_became_peered":"2024-09-21T07:28:02.480991+0000","last_unstale":"2024-09-21T07:28:04.485851+0000","last_undegraded":"2024-09-21T07:28:04.485851+0000","last_fullsized":"2024-09-21T07:28:04.485851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466325+0000","last_change":"2024-09-21T07:28:02.466325+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466325+0000","last_undegraded":"2024-09-21T07:28:02.466325+0000","last_fullsized":"2024-09-21T07:28:02.466325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557899+0000","last_change":"2024-09-21T07:28:02.494170+0000","last_active":"2024-09-21T07:28:04.557899+0000","last_peered":"2024-09-21T07:28:04.557899+0000","last_clean":"2024-09-21T07:28:04.557899+0000","last_became_active":"2024-09-21T07:28:02.493439+0000","last_became_peered":"2024-09-21T07:28:02.493439+0000","last_unstale":"2024-09-21T07:28:04.557899+0000","last_undegraded":"2024-09-21T07:28:04.557899+0000","last_fullsized":"2024-09-21T07:28:04.557899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:27.800486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472878+0000","last_change":"2024-09-21T07:28:02.472878+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472878+0000","last_undegraded":"2024-09-21T07:28:02.472878+0000","last_fullsized":"2024-09-21T07:28:02.472878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.485718+0000","last_change":"2024-09-21T07:28:02.483843+0000","last_active":"2024-09-21T07:28:02.485718+0000","last_peered":"2024-09-21T07:28:02.485718+0000","last_clean":"2024-09-21T07:28:02.485718+0000","last_became_active":"2024-09-21T07:28:02.483455+0000","last_became_peered":"2024-09-21T07:28:02.483455+0000","last_unstale":"2024-09-21T07:28:02.485718+0000","last_undegraded":"2024-09-21T07:28:02.485718+0000","last_fullsized":"2024-09-21T07:28:02.485718+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:26.638902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559290+0000","last_change":"2024-09-21T07:28:03.528617+0000","last_active":"2024-09-21T07:28:04.559290+0000","last_peered":"2024-09-21T07:28:04.559290+0000","last_clean":"2024-09-21T07:28:04.559290+0000","last_became_active":"2024-09-21T07:28:03.528268+0000","last_became_peered":"2024-09-21T07:28:03.528268+0000","last_unstale":"2024-09-21T07:28:04.559290+0000","last_undegraded":"2024-09-21T07:28:04.559290+0000","last_fullsized":"2024-09-21T07:28:04.559290+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486479+0000","last_change":"2024-09-21T07:28:02.490608+0000","last_active":"2024-09-21T07:28:04.486479+0000","last_peered":"2024-09-21T07:28:04.486479+0000","last_clean":"2024-09-21T07:28:04.486479+0000","last_became_active":"2024-09-21T07:28:02.490278+0000","last_became_peered":"2024-09-21T07:28:02.490278+0000","last_unstale":"2024-09-21T07:28:04.486479+0000","last_undegraded":"2024-09-21T07:28:04.486479+0000","last_fullsized":"2024-09-21T07:28:04.486479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486360+0000","last_change":"2024-09-21T07:28:03.499223+0000","last_active":"2024-09-21T07:28:04.486360+0000","last_peered":"2024-09-21T07:28:04.486360+0000","last_clean":"2024-09-21T07:28:04.486360+0000","last_became_active":"2024-09-21T07:28:03.498880+0000","last_became_peered":"2024-09-21T07:28:03.498880+0000","last_unstale":"2024-09-21T07:28:04.486360+0000","last_undegraded":"2024-09-21T07:28:04.486360+0000","last_fullsized":"2024-09-21T07:28:04.486360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495580+0000","last_change":"2024-09-21T07:28:02.491104+0000","last_active":"2024-09-21T07:28:02.495580+0000","last_peered":"2024-09-21T07:28:02.495580+0000","last_clean":"2024-09-21T07:28:02.495580+0000","last_became_active":"2024-09-21T07:28:02.490329+0000","last_became_peered":"2024-09-21T07:28:02.490329+0000","last_unstale":"2024-09-21T07:28:02.495580+0000","last_undegraded":"2024-09-21T07:28:02.495580+0000","last_fullsized":"2024-09-21T07:28:02.495580+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:48.697276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466805+0000","last_change":"2024-09-21T07:28:02.466805+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466805+0000","last_undegraded":"2024-09-21T07:28:02.466805+0000","last_fullsized":"2024-09-21T07:28:02.466805+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489356+0000","last_change":"2024-09-21T07:28:02.481710+0000","last_active":"2024-09-21T07:28:02.489356+0000","last_peered":"2024-09-21T07:28:02.489356+0000","last_clean":"2024-09-21T07:28:02.489356+0000","last_became_active":"2024-09-21T07:28:02.481285+0000","last_became_peered":"2024-09-21T07:28:02.481285+0000","last_unstale":"2024-09-21T07:28:02.489356+0000","last_undegraded":"2024-09-21T07:28:02.489356+0000","last_fullsized":"2024-09-21T07:28:02.489356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:06.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468623+0000","last_change":"2024-09-21T07:28:02.468623+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468623+0000","last_undegraded":"2024-09-21T07:28:02.468623+0000","last_fullsized":"2024-09-21T07:28:02.468623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558949+0000","last_change":"2024-09-21T07:28:02.495439+0000","last_active":"2024-09-21T07:28:04.558949+0000","last_peered":"2024-09-21T07:28:04.558949+0000","last_clean":"2024-09-21T07:28:04.558949+0000","last_became_active":"2024-09-21T07:28:02.494223+0000","last_became_peered":"2024-09-21T07:28:02.494223+0000","last_unstale":"2024-09-21T07:28:04.558949+0000","last_undegraded":"2024-09-21T07:28:04.558949+0000","last_fullsized":"2024-09-21T07:28:04.558949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:50.727753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471322+0000","last_change":"2024-09-21T07:28:02.471322+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471322+0000","last_undegraded":"2024-09-21T07:28:02.471322+0000","last_fullsized":"2024-09-21T07:28:02.471322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489612+0000","last_change":"2024-09-21T07:28:02.486025+0000","last_active":"2024-09-21T07:28:02.489612+0000","last_peered":"2024-09-21T07:28:02.489612+0000","last_clean":"2024-09-21T07:28:02.489612+0000","last_became_active":"2024-09-21T07:28:02.485713+0000","last_became_peered":"2024-09-21T07:28:02.485713+0000","last_unstale":"2024-09-21T07:28:02.489612+0000","last_undegraded":"2024-09-21T07:28:02.489612+0000","last_fullsized":"2024-09-21T07:28:02.489612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:02.610962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465783+0000","last_change":"2024-09-21T07:28:02.465783+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465783+0000","last_undegraded":"2024-09-21T07:28:02.465783+0000","last_fullsized":"2024-09-21T07:28:02.465783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.481892+0000","last_change":"2024-09-21T07:28:02.475561+0000","last_active":"2024-09-21T07:28:02.481892+0000","last_peered":"2024-09-21T07:28:02.481892+0000","last_clean":"2024-09-21T07:28:02.481892+0000","last_became_active":"2024-09-21T07:28:02.475232+0000","last_became_peered":"2024-09-21T07:28:02.475232+0000","last_unstale":"2024-09-21T07:28:02.481892+0000","last_undegraded":"2024-09-21T07:28:02.481892+0000","last_fullsized":"2024-09-21T07:28:02.481892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:53.568044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465238+0000","last_change":"2024-09-21T07:28:02.465238+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465238+0000","last_undegraded":"2024-09-21T07:28:02.465238+0000","last_fullsized":"2024-09-21T07:28:02.465238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.492130+0000","last_change":"2024-09-21T07:28:02.489670+0000","last_active":"2024-09-21T07:28:02.492130+0000","last_peered":"2024-09-21T07:28:02.492130+0000","last_clean":"2024-09-21T07:28:02.492130+0000","last_became_active":"2024-09-21T07:28:02.485518+0000","last_became_peered":"2024-09-21T07:28:02.485518+0000","last_unstale":"2024-09-21T07:28:02.492130+0000","last_undegraded":"2024-09-21T07:28:02.492130+0000","last_fullsized":"2024-09-21T07:28:02.492130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.269217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476665+0000","last_change":"2024-09-21T07:28:02.476665+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476665+0000","last_undegraded":"2024-09-21T07:28:02.476665+0000","last_fullsized":"2024-09-21T07:28:02.476665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.496103+0000","last_change":"2024-09-21T07:28:02.490405+0000","last_active":"2024-09-21T07:28:02.496103+0000","last_peered":"2024-09-21T07:28:02.496103+0000","last_clean":"2024-09-21T07:28:02.496103+0000","last_became_active":"2024-09-21T07:28:02.488124+0000","last_became_peered":"2024-09-21T07:28:02.488124+0000","last_unstale":"2024-09-21T07:28:02.496103+0000","last_undegraded":"2024-09-21T07:28:02.496103+0000","last_fullsized":"2024-09-21T07:28:02.496103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:54.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468806+0000","last_change":"2024-09-21T07:28:02.468806+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468806+0000","last_undegraded":"2024-09-21T07:28:02.468806+0000","last_fullsized":"2024-09-21T07:28:02.468806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559227+0000","last_change":"2024-09-21T07:28:02.493001+0000","last_active":"2024-09-21T07:28:04.559227+0000","last_peered":"2024-09-21T07:28:04.559227+0000","last_clean":"2024-09-21T07:28:04.559227+0000","last_became_active":"2024-09-21T07:28:02.492584+0000","last_became_peered":"2024-09-21T07:28:02.492584+0000","last_unstale":"2024-09-21T07:28:04.559227+0000","last_undegraded":"2024-09-21T07:28:04.559227+0000","last_fullsized":"2024-09-21T07:28:04.559227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477436+0000","last_change":"2024-09-21T07:28:02.477436+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477436+0000","last_undegraded":"2024-09-21T07:28:02.477436+0000","last_fullsized":"2024-09-21T07:28:02.477436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495866+0000","last_change":"2024-09-21T07:28:02.492630+0000","last_active":"2024-09-21T07:28:02.495866+0000","last_peered":"2024-09-21T07:28:02.495866+0000","last_clean":"2024-09-21T07:28:02.495866+0000","last_became_active":"2024-09-21T07:28:02.492255+0000","last_became_peered":"2024-09-21T07:28:02.492255+0000","last_unstale":"2024-09-21T07:28:02.495866+0000","last_undegraded":"2024-09-21T07:28:02.495866+0000","last_fullsized":"2024-09-21T07:28:02.495866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:02.904038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475001+0000","last_change":"2024-09-21T07:28:02.475001+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475001+0000","last_undegraded":"2024-09-21T07:28:02.475001+0000","last_fullsized":"2024-09-21T07:28:02.475001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494035+0000","last_change":"2024-09-21T07:28:02.492296+0000","last_active":"2024-09-21T07:28:02.494035+0000","last_peered":"2024-09-21T07:28:02.494035+0000","last_clean":"2024-09-21T07:28:02.494035+0000","last_became_active":"2024-09-21T07:28:02.491988+0000","last_became_peered":"2024-09-21T07:28:02.491988+0000","last_unstale":"2024-09-21T07:28:02.494035+0000","last_undegraded":"2024-09-21T07:28:02.494035+0000","last_fullsized":"2024-09-21T07:28:02.494035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:54.718727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473705+0000","last_change":"2024-09-21T07:28:02.473705+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473705+0000","last_undegraded":"2024-09-21T07:28:02.473705+0000","last_fullsized":"2024-09-21T07:28:02.473705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484619+0000","last_change":"2024-09-21T07:28:02.481472+0000","last_active":"2024-09-21T07:28:02.484619+0000","last_peered":"2024-09-21T07:28:02.484619+0000","last_clean":"2024-09-21T07:28:02.484619+0000","last_became_active":"2024-09-21T07:28:02.480516+0000","last_became_peered":"2024-09-21T07:28:02.480516+0000","last_unstale":"2024-09-21T07:28:02.484619+0000","last_undegraded":"2024-09-21T07:28:02.484619+0000","last_fullsized":"2024-09-21T07:28:02.484619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:48.998413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474529+0000","last_change":"2024-09-21T07:28:02.474529+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474529+0000","last_undegraded":"2024-09-21T07:28:02.474529+0000","last_fullsized":"2024-09-21T07:28:02.474529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491150+0000","last_change":"2024-09-21T07:28:02.488106+0000","last_active":"2024-09-21T07:28:02.491150+0000","last_peered":"2024-09-21T07:28:02.491150+0000","last_clean":"2024-09-21T07:28:02.491150+0000","last_became_active":"2024-09-21T07:28:02.487749+0000","last_became_peered":"2024-09-21T07:28:02.487749+0000","last_unstale":"2024-09-21T07:28:02.491150+0000","last_undegraded":"2024-09-21T07:28:02.491150+0000","last_fullsized":"2024-09-21T07:28:02.491150+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:14.892991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475585+0000","last_change":"2024-09-21T07:28:02.475585+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475585+0000","last_undegraded":"2024-09-21T07:28:02.475585+0000","last_fullsized":"2024-09-21T07:28:02.475585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484502+0000","last_change":"2024-09-21T07:28:02.480862+0000","last_active":"2024-09-21T07:28:02.484502+0000","last_peered":"2024-09-21T07:28:02.484502+0000","last_clean":"2024-09-21T07:28:02.484502+0000","last_became_active":"2024-09-21T07:28:02.479884+0000","last_became_peered":"2024-09-21T07:28:02.479884+0000","last_unstale":"2024-09-21T07:28:02.484502+0000","last_undegraded":"2024-09-21T07:28:02.484502+0000","last_fullsized":"2024-09-21T07:28:02.484502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:58.148746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468917+0000","last_change":"2024-09-21T07:28:02.468917+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468917+0000","last_undegraded":"2024-09-21T07:28:02.468917+0000","last_fullsized":"2024-09-21T07:28:02.468917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.493358+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.493044+0000","last_became_peered":"2024-09-21T07:28:02.493044+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:54.105626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473545+0000","last_change":"2024-09-21T07:28:02.473545+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473545+0000","last_undegraded":"2024-09-21T07:28:02.473545+0000","last_fullsized":"2024-09-21T07:28:02.473545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491951+0000","last_change":"2024-09-21T07:28:02.490011+0000","last_active":"2024-09-21T07:28:02.491951+0000","last_peered":"2024-09-21T07:28:02.491951+0000","last_clean":"2024-09-21T07:28:02.491951+0000","last_became_active":"2024-09-21T07:28:02.489295+0000","last_became_peered":"2024-09-21T07:28:02.489295+0000","last_unstale":"2024-09-21T07:28:02.491951+0000","last_undegraded":"2024-09-21T07:28:02.491951+0000","last_fullsized":"2024-09-21T07:28:02.491951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:09.470145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472814+0000","last_change":"2024-09-21T07:28:02.472814+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472814+0000","last_undegraded":"2024-09-21T07:28:02.472814+0000","last_fullsized":"2024-09-21T07:28:02.472814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495608+0000","last_change":"2024-09-21T07:28:02.491433+0000","last_active":"2024-09-21T07:28:02.495608+0000","last_peered":"2024-09-21T07:28:02.495608+0000","last_clean":"2024-09-21T07:28:02.495608+0000","last_became_active":"2024-09-21T07:28:02.490769+0000","last_became_peered":"2024-09-21T07:28:02.490769+0000","last_unstale":"2024-09-21T07:28:02.495608+0000","last_undegraded":"2024-09-21T07:28:02.495608+0000","last_fullsized":"2024-09-21T07:28:02.495608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473836+0000","last_change":"2024-09-21T07:28:02.473836+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473836+0000","last_undegraded":"2024-09-21T07:28:02.473836+0000","last_fullsized":"2024-09-21T07:28:02.473836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487148+0000","last_change":"2024-09-21T07:28:02.484294+0000","last_active":"2024-09-21T07:28:02.487148+0000","last_peered":"2024-09-21T07:28:02.487148+0000","last_clean":"2024-09-21T07:28:02.487148+0000","last_became_active":"2024-09-21T07:28:02.483654+0000","last_became_peered":"2024-09-21T07:28:02.483654+0000","last_unstale":"2024-09-21T07:28:02.487148+0000","last_undegraded":"2024-09-21T07:28:02.487148+0000","last_fullsized":"2024-09-21T07:28:02.487148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:49.122271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465586+0000","last_change":"2024-09-21T07:28:02.465586+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465586+0000","last_undegraded":"2024-09-21T07:28:02.465586+0000","last_fullsized":"2024-09-21T07:28:02.465586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.493787+0000","last_change":"2024-09-21T07:28:02.488252+0000","last_active":"2024-09-21T07:28:02.493787+0000","last_peered":"2024-09-21T07:28:02.493787+0000","last_clean":"2024-09-21T07:28:02.493787+0000","last_became_active":"2024-09-21T07:28:02.486549+0000","last_became_peered":"2024-09-21T07:28:02.486549+0000","last_unstale":"2024-09-21T07:28:02.493787+0000","last_undegraded":"2024-09-21T07:28:02.493787+0000","last_fullsized":"2024-09-21T07:28:02.493787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:39.970875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485858+0000","last_change":"2024-09-21T07:28:03.505904+0000","last_active":"2024-09-21T07:28:04.485858+0000","last_peered":"2024-09-21T07:28:04.485858+0000","last_clean":"2024-09-21T07:28:04.485858+0000","last_became_active":"2024-09-21T07:28:03.505598+0000","last_became_peered":"2024-09-21T07:28:03.505598+0000","last_unstale":"2024-09-21T07:28:04.485858+0000","last_undegraded":"2024-09-21T07:28:04.485858+0000","last_fullsized":"2024-09-21T07:28:04.485858+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.467698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494856+0000","last_change":"2024-09-21T07:28:02.492642+0000","last_active":"2024-09-21T07:28:02.494856+0000","last_peered":"2024-09-21T07:28:02.494856+0000","last_clean":"2024-09-21T07:28:02.494856+0000","last_became_active":"2024-09-21T07:28:02.491303+0000","last_became_peered":"2024-09-21T07:28:02.491303+0000","last_unstale":"2024-09-21T07:28:02.494856+0000","last_undegraded":"2024-09-21T07:28:02.494856+0000","last_fullsized":"2024-09-21T07:28:02.494856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468536+0000","last_change":"2024-09-21T07:28:02.468536+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468536+0000","last_undegraded":"2024-09-21T07:28:02.468536+0000","last_fullsized":"2024-09-21T07:28:02.468536+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489132+0000","last_change":"2024-09-21T07:28:02.485310+0000","last_active":"2024-09-21T07:28:02.489132+0000","last_peered":"2024-09-21T07:28:02.489132+0000","last_clean":"2024-09-21T07:28:02.489132+0000","last_became_active":"2024-09-21T07:28:02.484055+0000","last_became_peered":"2024-09-21T07:28:02.484055+0000","last_unstale":"2024-09-21T07:28:02.489132+0000","last_undegraded":"2024-09-21T07:28:02.489132+0000","last_fullsized":"2024-09-21T07:28:02.489132+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:56.841102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473074+0000","last_change":"2024-09-21T07:28:02.473074+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473074+0000","last_undegraded":"2024-09-21T07:28:02.473074+0000","last_fullsized":"2024-09-21T07:28:02.473074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558020+0000","last_change":"2024-09-21T07:28:02.494597+0000","last_active":"2024-09-21T07:28:04.558020+0000","last_peered":"2024-09-21T07:28:04.558020+0000","last_clean":"2024-09-21T07:28:04.558020+0000","last_became_active":"2024-09-21T07:28:02.493870+0000","last_became_peered":"2024-09-21T07:28:02.493870+0000","last_unstale":"2024-09-21T07:28:04.558020+0000","last_undegraded":"2024-09-21T07:28:04.558020+0000","last_fullsized":"2024-09-21T07:28:04.558020+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.788786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559427+0000","last_change":"2024-09-21T07:28:03.522880+0000","last_active":"2024-09-21T07:28:04.559427+0000","last_peered":"2024-09-21T07:28:04.559427+0000","last_clean":"2024-09-21T07:28:04.559427+0000","last_became_active":"2024-09-21T07:28:03.522515+0000","last_became_peered":"2024-09-21T07:28:03.522515+0000","last_unstale":"2024-09-21T07:28:04.559427+0000","last_undegraded":"2024-09-21T07:28:04.559427+0000","last_fullsized":"2024-09-21T07:28:04.559427+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:11.357619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488270+0000","last_change":"2024-09-21T07:28:02.480599+0000","last_active":"2024-09-21T07:28:02.488270+0000","last_peered":"2024-09-21T07:28:02.488270+0000","last_clean":"2024-09-21T07:28:02.488270+0000","last_became_active":"2024-09-21T07:28:02.480200+0000","last_became_peered":"2024-09-21T07:28:02.480200+0000","last_unstale":"2024-09-21T07:28:02.488270+0000","last_undegraded":"2024-09-21T07:28:02.488270+0000","last_fullsized":"2024-09-21T07:28:02.488270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:53.144565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40656,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331184,"statfs":{"total":96636764160,"available":96595132416,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":1134198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":1154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:07.709 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- 172.21.15.64:0/1847572223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 msgr2=0x7f30240c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 --2- 172.21.15.64:0/1847572223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f30240c5440 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f30240cc350 tx=0x7f301c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- 172.21.15.64:0/1847572223 shutdown_connections 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 --2- 172.21.15.64:0/1847572223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f30240c5440 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 --2- 172.21.15.64:0/1847572223 >> v2:172.21.15.90:3300/0 conn(0x7f302406d730 0x7f30240c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- 172.21.15.64:0/1847572223 >> 172.21.15.64:0/1847572223 conn(0x7f30240d0de0 msgr2=0x7f30240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- 172.21.15.64:0/1847572223 shutdown_connections 2024-09-21T07:28:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- 172.21.15.64:0/1847572223 wait complete. 2024-09-21T07:28:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 Processor -- start 2024-09-21T07:28:07.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.907+0000 7f302b400640 1 -- start start 2024-09-21T07:28:07.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 0x7f30240c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ca880 0x7f30240c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f302416a060 con 0x7f30240c5030 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3024169ee0 con 0x7f30240cf8b0 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f302416a1e0 con 0x7f30240ca880 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33014/0 (socket says 172.21.15.64:33014) 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 -- 172.21.15.64:0/1083252916 learned_addr learned my addr 172.21.15.64:0/1083252916 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3023e00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 0x7f30240c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3029400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ca880 0x7f30240c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 -- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ca880 msgr2=0x7f30240c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ca880 0x7f30240c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 -- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 msgr2=0x7f30240c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 0x7f30240c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 -- 172.21.15.64:0/1083252916 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302415c540 con 0x7f30240c5030 2024-09-21T07:28:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3023e00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 0x7f30240c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3028a00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f301800c3c0 tx=0x7f301800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018017070 con 0x7f30240c5030 2024-09-21T07:28:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30180053c0 con 0x7f30240c5030 2024-09-21T07:28:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302414cdf0 con 0x7f30240c5030 2024-09-21T07:28:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018003860 con 0x7f30240c5030 2024-09-21T07:28:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302414d3b0 con 0x7f30240c5030 2024-09-21T07:28:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.911+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30240c4af0 con 0x7f30240c5030 2024-09-21T07:28:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.915+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f301801a070 con 0x7f30240c5030 2024-09-21T07:28:07.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.915+0000 7f3020c00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 0x7f3004075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:07.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.915+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f3018093720 con 0x7f30240c5030 2024-09-21T07:28:07.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.915+0000 7f3023e00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 0x7f3004075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:07.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.915+0000 7f3023e00640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 0x7f3004075710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30240c4060 tx=0x7f301000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:07.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:07.919+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f301805df50 con 0x7f30240c5030 2024-09-21T07:28:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.091+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30240d1690 con 0x7f3004073200 2024-09-21T07:28:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.099+0000 7f3020c00640 1 -- 172.21.15.64:0/1083252916 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247700 (secure 0 0 0) 0x7f30240d1690 con 0x7f3004073200 2024-09-21T07:28:08.103 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 msgr2=0x7f3004075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 0x7f3004075710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30240c4060 tx=0x7f301000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 msgr2=0x7f302414bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f301800c3c0 tx=0x7f301800c880 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 shutdown_connections 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3004073200 0x7f3004075710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ca880 0x7f30240c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30240cf8b0 0x7f30240c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 --2- 172.21.15.64:0/1083252916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30240c5030 0x7f302414bf20 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 >> 172.21.15.64:0/1083252916 conn(0x7f30240d0de0 msgr2=0x7f30240b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 shutdown_connections 2024-09-21T07:28:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.103+0000 7f302b400640 1 -- 172.21.15.64:0/1083252916 wait complete. 2024-09-21T07:28:08.125 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-09-21T07:28:07.507100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309888,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664832,"statfs":{"total":773094113280,"available":772776787968,"internally_reserved":0,"allocated":10698752,"data_stored":5585818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":306433587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486307+0000","last_change":"2024-09-21T07:28:03.498429+0000","last_active":"2024-09-21T07:28:04.486307+0000","last_peered":"2024-09-21T07:28:04.486307+0000","last_clean":"2024-09-21T07:28:04.486307+0000","last_became_active":"2024-09-21T07:28:03.498139+0000","last_became_peered":"2024-09-21T07:28:03.498139+0000","last_unstale":"2024-09-21T07:28:04.486307+0000","last_undegraded":"2024-09-21T07:28:04.486307+0000","last_fullsized":"2024-09-21T07:28:04.486307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:18.070246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475069+0000","last_change":"2024-09-21T07:28:02.475069+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475069+0000","last_undegraded":"2024-09-21T07:28:02.475069+0000","last_fullsized":"2024-09-21T07:28:02.475069+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486317+0000","last_change":"2024-09-21T07:28:03.500537+0000","last_active":"2024-09-21T07:28:04.486317+0000","last_peered":"2024-09-21T07:28:04.486317+0000","last_clean":"2024-09-21T07:28:04.486317+0000","last_became_active":"2024-09-21T07:28:03.500232+0000","last_became_peered":"2024-09-21T07:28:03.500232+0000","last_unstale":"2024-09-21T07:28:04.486317+0000","last_undegraded":"2024-09-21T07:28:04.486317+0000","last_fullsized":"2024-09-21T07:28:04.486317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:40.849017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468819+0000","last_change":"2024-09-21T07:28:02.468819+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468819+0000","last_undegraded":"2024-09-21T07:28:02.468819+0000","last_fullsized":"2024-09-21T07:28:02.468819+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472274+0000","last_change":"2024-09-21T07:28:02.472274+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472274+0000","last_undegraded":"2024-09-21T07:28:02.472274+0000","last_fullsized":"2024-09-21T07:28:02.472274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.480209+0000","last_change":"2024-09-21T07:28:02.480209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.480209+0000","last_undegraded":"2024-09-21T07:28:02.480209+0000","last_fullsized":"2024-09-21T07:28:02.480209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559345+0000","last_change":"2024-09-21T07:28:03.514701+0000","last_active":"2024-09-21T07:28:04.559345+0000","last_peered":"2024-09-21T07:28:04.559345+0000","last_clean":"2024-09-21T07:28:04.559345+0000","last_became_active":"2024-09-21T07:28:03.514394+0000","last_became_peered":"2024-09-21T07:28:03.514394+0000","last_unstale":"2024-09-21T07:28:04.559345+0000","last_undegraded":"2024-09-21T07:28:04.559345+0000","last_fullsized":"2024-09-21T07:28:04.559345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:13.467674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469662+0000","last_change":"2024-09-21T07:28:02.469662+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469662+0000","last_undegraded":"2024-09-21T07:28:02.469662+0000","last_fullsized":"2024-09-21T07:28:02.469662+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474209+0000","last_change":"2024-09-21T07:28:02.474209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474209+0000","last_undegraded":"2024-09-21T07:28:02.474209+0000","last_fullsized":"2024-09-21T07:28:02.474209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465314+0000","last_change":"2024-09-21T07:28:02.465314+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465314+0000","last_undegraded":"2024-09-21T07:28:02.465314+0000","last_fullsized":"2024-09-21T07:28:02.465314+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479071+0000","last_change":"2024-09-21T07:28:02.479071+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479071+0000","last_undegraded":"2024-09-21T07:28:02.479071+0000","last_fullsized":"2024-09-21T07:28:02.479071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466077+0000","last_change":"2024-09-21T07:28:02.466077+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466077+0000","last_undegraded":"2024-09-21T07:28:02.466077+0000","last_fullsized":"2024-09-21T07:28:02.466077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466930+0000","last_change":"2024-09-21T07:28:02.466930+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466930+0000","last_undegraded":"2024-09-21T07:28:02.466930+0000","last_fullsized":"2024-09-21T07:28:02.466930+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471082+0000","last_change":"2024-09-21T07:28:02.471082+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471082+0000","last_undegraded":"2024-09-21T07:28:02.471082+0000","last_fullsized":"2024-09-21T07:28:02.471082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466470+0000","last_change":"2024-09-21T07:28:02.466470+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466470+0000","last_undegraded":"2024-09-21T07:28:02.466470+0000","last_fullsized":"2024-09-21T07:28:02.466470+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479710+0000","last_change":"2024-09-21T07:28:02.479710+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479710+0000","last_undegraded":"2024-09-21T07:28:02.479710+0000","last_fullsized":"2024-09-21T07:28:02.479710+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479066+0000","last_change":"2024-09-21T07:28:02.479066+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479066+0000","last_undegraded":"2024-09-21T07:28:02.479066+0000","last_fullsized":"2024-09-21T07:28:02.479066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486498+0000","last_change":"2024-09-21T07:28:03.516916+0000","last_active":"2024-09-21T07:28:04.486498+0000","last_peered":"2024-09-21T07:28:04.486498+0000","last_clean":"2024-09-21T07:28:04.486498+0000","last_became_active":"2024-09-21T07:28:03.516579+0000","last_became_peered":"2024-09-21T07:28:03.516579+0000","last_unstale":"2024-09-21T07:28:04.486498+0000","last_undegraded":"2024-09-21T07:28:04.486498+0000","last_fullsized":"2024-09-21T07:28:04.486498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478599+0000","last_change":"2024-09-21T07:28:02.478599+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478599+0000","last_undegraded":"2024-09-21T07:28:02.478599+0000","last_fullsized":"2024-09-21T07:28:02.478599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467656+0000","last_change":"2024-09-21T07:28:02.467656+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467656+0000","last_undegraded":"2024-09-21T07:28:02.467656+0000","last_fullsized":"2024-09-21T07:28:02.467656+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472810+0000","last_change":"2024-09-21T07:28:02.472810+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472810+0000","last_undegraded":"2024-09-21T07:28:02.472810+0000","last_fullsized":"2024-09-21T07:28:02.472810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470466+0000","last_change":"2024-09-21T07:28:02.470466+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470466+0000","last_undegraded":"2024-09-21T07:28:02.470466+0000","last_fullsized":"2024-09-21T07:28:02.470466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470127+0000","last_change":"2024-09-21T07:28:02.470127+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470127+0000","last_undegraded":"2024-09-21T07:28:02.470127+0000","last_fullsized":"2024-09-21T07:28:02.470127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485864+0000","last_change":"2024-09-21T07:28:03.496999+0000","last_active":"2024-09-21T07:28:04.485864+0000","last_peered":"2024-09-21T07:28:04.485864+0000","last_clean":"2024-09-21T07:28:04.485864+0000","last_became_active":"2024-09-21T07:28:03.495267+0000","last_became_peered":"2024-09-21T07:28:03.495267+0000","last_unstale":"2024-09-21T07:28:04.485864+0000","last_undegraded":"2024-09-21T07:28:04.485864+0000","last_fullsized":"2024-09-21T07:28:04.485864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:33.747730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474681+0000","last_change":"2024-09-21T07:28:02.474681+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474681+0000","last_undegraded":"2024-09-21T07:28:02.474681+0000","last_fullsized":"2024-09-21T07:28:02.474681+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477889+0000","last_change":"2024-09-21T07:28:02.477889+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477889+0000","last_undegraded":"2024-09-21T07:28:02.477889+0000","last_fullsized":"2024-09-21T07:28:02.477889+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465301+0000","last_change":"2024-09-21T07:28:02.465301+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465301+0000","last_undegraded":"2024-09-21T07:28:02.465301+0000","last_fullsized":"2024-09-21T07:28:02.465301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467158+0000","last_change":"2024-09-21T07:28:02.467158+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467158+0000","last_undegraded":"2024-09-21T07:28:02.467158+0000","last_fullsized":"2024-09-21T07:28:02.467158+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559111+0000","last_change":"2024-09-21T07:28:03.522857+0000","last_active":"2024-09-21T07:28:04.559111+0000","last_peered":"2024-09-21T07:28:04.559111+0000","last_clean":"2024-09-21T07:28:04.559111+0000","last_became_active":"2024-09-21T07:28:03.522439+0000","last_became_peered":"2024-09-21T07:28:03.522439+0000","last_unstale":"2024-09-21T07:28:04.559111+0000","last_undegraded":"2024-09-21T07:28:04.559111+0000","last_fullsized":"2024-09-21T07:28:04.559111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469797+0000","last_change":"2024-09-21T07:28:02.469797+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469797+0000","last_undegraded":"2024-09-21T07:28:02.469797+0000","last_fullsized":"2024-09-21T07:28:02.469797+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474365+0000","last_change":"2024-09-21T07:28:02.474365+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474365+0000","last_undegraded":"2024-09-21T07:28:02.474365+0000","last_fullsized":"2024-09-21T07:28:02.474365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479245+0000","last_change":"2024-09-21T07:28:02.479245+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479245+0000","last_undegraded":"2024-09-21T07:28:02.479245+0000","last_fullsized":"2024-09-21T07:28:02.479245+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477183+0000","last_change":"2024-09-21T07:28:02.477183+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477183+0000","last_undegraded":"2024-09-21T07:28:02.477183+0000","last_fullsized":"2024-09-21T07:28:02.477183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.486046+0000","last_change":"2024-09-21T07:28:02.480401+0000","last_active":"2024-09-21T07:28:02.486046+0000","last_peered":"2024-09-21T07:28:02.486046+0000","last_clean":"2024-09-21T07:28:02.486046+0000","last_became_active":"2024-09-21T07:28:02.480063+0000","last_became_peered":"2024-09-21T07:28:02.480063+0000","last_unstale":"2024-09-21T07:28:02.486046+0000","last_undegraded":"2024-09-21T07:28:02.486046+0000","last_fullsized":"2024-09-21T07:28:02.486046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.683081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478264+0000","last_change":"2024-09-21T07:28:02.478264+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478264+0000","last_undegraded":"2024-09-21T07:28:02.478264+0000","last_fullsized":"2024-09-21T07:28:02.478264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.490708+0000","last_change":"2024-09-21T07:28:02.489572+0000","last_active":"2024-09-21T07:28:02.490708+0000","last_peered":"2024-09-21T07:28:02.490708+0000","last_clean":"2024-09-21T07:28:02.490708+0000","last_became_active":"2024-09-21T07:28:02.489240+0000","last_became_peered":"2024-09-21T07:28:02.489240+0000","last_unstale":"2024-09-21T07:28:02.490708+0000","last_undegraded":"2024-09-21T07:28:02.490708+0000","last_fullsized":"2024-09-21T07:28:02.490708+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:06.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559385+0000","last_change":"2024-09-21T07:28:03.526754+0000","last_active":"2024-09-21T07:28:04.559385+0000","last_peered":"2024-09-21T07:28:04.559385+0000","last_clean":"2024-09-21T07:28:04.559385+0000","last_became_active":"2024-09-21T07:28:03.526453+0000","last_became_peered":"2024-09-21T07:28:03.526453+0000","last_unstale":"2024-09-21T07:28:04.559385+0000","last_undegraded":"2024-09-21T07:28:04.559385+0000","last_fullsized":"2024-09-21T07:28:04.559385+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559310+0000","last_change":"2024-09-21T07:28:02.492575+0000","last_active":"2024-09-21T07:28:04.559310+0000","last_peered":"2024-09-21T07:28:04.559310+0000","last_clean":"2024-09-21T07:28:04.559310+0000","last_became_active":"2024-09-21T07:28:02.491529+0000","last_became_peered":"2024-09-21T07:28:02.491529+0000","last_unstale":"2024-09-21T07:28:04.559310+0000","last_undegraded":"2024-09-21T07:28:04.559310+0000","last_fullsized":"2024-09-21T07:28:04.559310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476312+0000","last_change":"2024-09-21T07:28:02.476312+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476312+0000","last_undegraded":"2024-09-21T07:28:02.476312+0000","last_fullsized":"2024-09-21T07:28:02.476312+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487115+0000","last_change":"2024-09-21T07:28:02.483081+0000","last_active":"2024-09-21T07:28:02.487115+0000","last_peered":"2024-09-21T07:28:02.487115+0000","last_clean":"2024-09-21T07:28:02.487115+0000","last_became_active":"2024-09-21T07:28:02.482548+0000","last_became_peered":"2024-09-21T07:28:02.482548+0000","last_unstale":"2024-09-21T07:28:02.487115+0000","last_undegraded":"2024-09-21T07:28:02.487115+0000","last_fullsized":"2024-09-21T07:28:02.487115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.915932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469139+0000","last_change":"2024-09-21T07:28:02.469139+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469139+0000","last_undegraded":"2024-09-21T07:28:02.469139+0000","last_fullsized":"2024-09-21T07:28:02.469139+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487087+0000","last_change":"2024-09-21T07:28:02.485679+0000","last_active":"2024-09-21T07:28:02.487087+0000","last_peered":"2024-09-21T07:28:02.487087+0000","last_clean":"2024-09-21T07:28:02.487087+0000","last_became_active":"2024-09-21T07:28:02.484985+0000","last_became_peered":"2024-09-21T07:28:02.484985+0000","last_unstale":"2024-09-21T07:28:02.487087+0000","last_undegraded":"2024-09-21T07:28:02.487087+0000","last_fullsized":"2024-09-21T07:28:02.487087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:10.970100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469579+0000","last_change":"2024-09-21T07:28:02.469579+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469579+0000","last_undegraded":"2024-09-21T07:28:02.469579+0000","last_fullsized":"2024-09-21T07:28:02.469579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488859+0000","last_change":"2024-09-21T07:28:02.484131+0000","last_active":"2024-09-21T07:28:02.488859+0000","last_peered":"2024-09-21T07:28:02.488859+0000","last_clean":"2024-09-21T07:28:02.488859+0000","last_became_active":"2024-09-21T07:28:02.483822+0000","last_became_peered":"2024-09-21T07:28:02.483822+0000","last_unstale":"2024-09-21T07:28:02.488859+0000","last_undegraded":"2024-09-21T07:28:02.488859+0000","last_fullsized":"2024-09-21T07:28:02.488859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:19.845520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476090+0000","last_change":"2024-09-21T07:28:02.476090+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476090+0000","last_undegraded":"2024-09-21T07:28:02.476090+0000","last_fullsized":"2024-09-21T07:28:02.476090+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485851+0000","last_change":"2024-09-21T07:28:02.481366+0000","last_active":"2024-09-21T07:28:04.485851+0000","last_peered":"2024-09-21T07:28:04.485851+0000","last_clean":"2024-09-21T07:28:04.485851+0000","last_became_active":"2024-09-21T07:28:02.480991+0000","last_became_peered":"2024-09-21T07:28:02.480991+0000","last_unstale":"2024-09-21T07:28:04.485851+0000","last_undegraded":"2024-09-21T07:28:04.485851+0000","last_fullsized":"2024-09-21T07:28:04.485851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466325+0000","last_change":"2024-09-21T07:28:02.466325+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466325+0000","last_undegraded":"2024-09-21T07:28:02.466325+0000","last_fullsized":"2024-09-21T07:28:02.466325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557899+0000","last_change":"2024-09-21T07:28:02.494170+0000","last_active":"2024-09-21T07:28:04.557899+0000","last_peered":"2024-09-21T07:28:04.557899+0000","last_clean":"2024-09-21T07:28:04.557899+0000","last_became_active":"2024-09-21T07:28:02.493439+0000","last_became_peered":"2024-09-21T07:28:02.493439+0000","last_unstale":"2024-09-21T07:28:04.557899+0000","last_undegraded":"2024-09-21T07:28:04.557899+0000","last_fullsized":"2024-09-21T07:28:04.557899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:27.800486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472878+0000","last_change":"2024-09-21T07:28:02.472878+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472878+0000","last_undegraded":"2024-09-21T07:28:02.472878+0000","last_fullsized":"2024-09-21T07:28:02.472878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.485718+0000","last_change":"2024-09-21T07:28:02.483843+0000","last_active":"2024-09-21T07:28:02.485718+0000","last_peered":"2024-09-21T07:28:02.485718+0000","last_clean":"2024-09-21T07:28:02.485718+0000","last_became_active":"2024-09-21T07:28:02.483455+0000","last_became_peered":"2024-09-21T07:28:02.483455+0000","last_unstale":"2024-09-21T07:28:02.485718+0000","last_undegraded":"2024-09-21T07:28:02.485718+0000","last_fullsized":"2024-09-21T07:28:02.485718+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:26.638902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559290+0000","last_change":"2024-09-21T07:28:03.528617+0000","last_active":"2024-09-21T07:28:04.559290+0000","last_peered":"2024-09-21T07:28:04.559290+0000","last_clean":"2024-09-21T07:28:04.559290+0000","last_became_active":"2024-09-21T07:28:03.528268+0000","last_became_peered":"2024-09-21T07:28:03.528268+0000","last_unstale":"2024-09-21T07:28:04.559290+0000","last_undegraded":"2024-09-21T07:28:04.559290+0000","last_fullsized":"2024-09-21T07:28:04.559290+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486479+0000","last_change":"2024-09-21T07:28:02.490608+0000","last_active":"2024-09-21T07:28:04.486479+0000","last_peered":"2024-09-21T07:28:04.486479+0000","last_clean":"2024-09-21T07:28:04.486479+0000","last_became_active":"2024-09-21T07:28:02.490278+0000","last_became_peered":"2024-09-21T07:28:02.490278+0000","last_unstale":"2024-09-21T07:28:04.486479+0000","last_undegraded":"2024-09-21T07:28:04.486479+0000","last_fullsized":"2024-09-21T07:28:04.486479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486360+0000","last_change":"2024-09-21T07:28:03.499223+0000","last_active":"2024-09-21T07:28:04.486360+0000","last_peered":"2024-09-21T07:28:04.486360+0000","last_clean":"2024-09-21T07:28:04.486360+0000","last_became_active":"2024-09-21T07:28:03.498880+0000","last_became_peered":"2024-09-21T07:28:03.498880+0000","last_unstale":"2024-09-21T07:28:04.486360+0000","last_undegraded":"2024-09-21T07:28:04.486360+0000","last_fullsized":"2024-09-21T07:28:04.486360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495580+0000","last_change":"2024-09-21T07:28:02.491104+0000","last_active":"2024-09-21T07:28:02.495580+0000","last_peered":"2024-09-21T07:28:02.495580+0000","last_clean":"2024-09-21T07:28:02.495580+0000","last_became_active":"2024-09-21T07:28:02.490329+0000","last_became_peered":"2024-09-21T07:28:02.490329+0000","last_unstale":"2024-09-21T07:28:02.495580+0000","last_undegraded":"2024-09-21T07:28:02.495580+0000","last_fullsized":"2024-09-21T07:28:02.495580+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:48.697276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466805+0000","last_change":"2024-09-21T07:28:02.466805+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466805+0000","last_undegraded":"2024-09-21T07:28:02.466805+0000","last_fullsized":"2024-09-21T07:28:02.466805+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489356+0000","last_change":"2024-09-21T07:28:02.481710+0000","last_active":"2024-09-21T07:28:02.489356+0000","last_peered":"2024-09-21T07:28:02.489356+0000","last_clean":"2024-09-21T07:28:02.489356+0000","last_became_active":"2024-09-21T07:28:02.481285+0000","last_became_peered":"2024-09-21T07:28:02.481285+0000","last_unstale":"2024-09-21T07:28:02.489356+0000","last_undegraded":"2024-09-21T07:28:02.489356+0000","last_fullsized":"2024-09-21T07:28:02.489356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:06.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468623+0000","last_change":"2024-09-21T07:28:02.468623+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468623+0000","last_undegraded":"2024-09-21T07:28:02.468623+0000","last_fullsized":"2024-09-21T07:28:02.468623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558949+0000","last_change":"2024-09-21T07:28:02.495439+0000","last_active":"2024-09-21T07:28:04.558949+0000","last_peered":"2024-09-21T07:28:04.558949+0000","last_clean":"2024-09-21T07:28:04.558949+0000","last_became_active":"2024-09-21T07:28:02.494223+0000","last_became_peered":"2024-09-21T07:28:02.494223+0000","last_unstale":"2024-09-21T07:28:04.558949+0000","last_undegraded":"2024-09-21T07:28:04.558949+0000","last_fullsized":"2024-09-21T07:28:04.558949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:50.727753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471322+0000","last_change":"2024-09-21T07:28:02.471322+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471322+0000","last_undegraded":"2024-09-21T07:28:02.471322+0000","last_fullsized":"2024-09-21T07:28:02.471322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489612+0000","last_change":"2024-09-21T07:28:02.486025+0000","last_active":"2024-09-21T07:28:02.489612+0000","last_peered":"2024-09-21T07:28:02.489612+0000","last_clean":"2024-09-21T07:28:02.489612+0000","last_became_active":"2024-09-21T07:28:02.485713+0000","last_became_peered":"2024-09-21T07:28:02.485713+0000","last_unstale":"2024-09-21T07:28:02.489612+0000","last_undegraded":"2024-09-21T07:28:02.489612+0000","last_fullsized":"2024-09-21T07:28:02.489612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:02.610962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465783+0000","last_change":"2024-09-21T07:28:02.465783+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465783+0000","last_undegraded":"2024-09-21T07:28:02.465783+0000","last_fullsized":"2024-09-21T07:28:02.465783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.481892+0000","last_change":"2024-09-21T07:28:02.475561+0000","last_active":"2024-09-21T07:28:02.481892+0000","last_peered":"2024-09-21T07:28:02.481892+0000","last_clean":"2024-09-21T07:28:02.481892+0000","last_became_active":"2024-09-21T07:28:02.475232+0000","last_became_peered":"2024-09-21T07:28:02.475232+0000","last_unstale":"2024-09-21T07:28:02.481892+0000","last_undegraded":"2024-09-21T07:28:02.481892+0000","last_fullsized":"2024-09-21T07:28:02.481892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:53.568044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465238+0000","last_change":"2024-09-21T07:28:02.465238+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465238+0000","last_undegraded":"2024-09-21T07:28:02.465238+0000","last_fullsized":"2024-09-21T07:28:02.465238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.492130+0000","last_change":"2024-09-21T07:28:02.489670+0000","last_active":"2024-09-21T07:28:02.492130+0000","last_peered":"2024-09-21T07:28:02.492130+0000","last_clean":"2024-09-21T07:28:02.492130+0000","last_became_active":"2024-09-21T07:28:02.485518+0000","last_became_peered":"2024-09-21T07:28:02.485518+0000","last_unstale":"2024-09-21T07:28:02.492130+0000","last_undegraded":"2024-09-21T07:28:02.492130+0000","last_fullsized":"2024-09-21T07:28:02.492130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.269217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476665+0000","last_change":"2024-09-21T07:28:02.476665+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476665+0000","last_undegraded":"2024-09-21T07:28:02.476665+0000","last_fullsized":"2024-09-21T07:28:02.476665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.496103+0000","last_change":"2024-09-21T07:28:02.490405+0000","last_active":"2024-09-21T07:28:02.496103+0000","last_peered":"2024-09-21T07:28:02.496103+0000","last_clean":"2024-09-21T07:28:02.496103+0000","last_became_active":"2024-09-21T07:28:02.488124+0000","last_became_peered":"2024-09-21T07:28:02.488124+0000","last_unstale":"2024-09-21T07:28:02.496103+0000","last_undegraded":"2024-09-21T07:28:02.496103+0000","last_fullsized":"2024-09-21T07:28:02.496103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:54.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468806+0000","last_change":"2024-09-21T07:28:02.468806+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468806+0000","last_undegraded":"2024-09-21T07:28:02.468806+0000","last_fullsized":"2024-09-21T07:28:02.468806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559227+0000","last_change":"2024-09-21T07:28:02.493001+0000","last_active":"2024-09-21T07:28:04.559227+0000","last_peered":"2024-09-21T07:28:04.559227+0000","last_clean":"2024-09-21T07:28:04.559227+0000","last_became_active":"2024-09-21T07:28:02.492584+0000","last_became_peered":"2024-09-21T07:28:02.492584+0000","last_unstale":"2024-09-21T07:28:04.559227+0000","last_undegraded":"2024-09-21T07:28:04.559227+0000","last_fullsized":"2024-09-21T07:28:04.559227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477436+0000","last_change":"2024-09-21T07:28:02.477436+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477436+0000","last_undegraded":"2024-09-21T07:28:02.477436+0000","last_fullsized":"2024-09-21T07:28:02.477436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495866+0000","last_change":"2024-09-21T07:28:02.492630+0000","last_active":"2024-09-21T07:28:02.495866+0000","last_peered":"2024-09-21T07:28:02.495866+0000","last_clean":"2024-09-21T07:28:02.495866+0000","last_became_active":"2024-09-21T07:28:02.492255+0000","last_became_peered":"2024-09-21T07:28:02.492255+0000","last_unstale":"2024-09-21T07:28:02.495866+0000","last_undegraded":"2024-09-21T07:28:02.495866+0000","last_fullsized":"2024-09-21T07:28:02.495866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:02.904038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475001+0000","last_change":"2024-09-21T07:28:02.475001+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475001+0000","last_undegraded":"2024-09-21T07:28:02.475001+0000","last_fullsized":"2024-09-21T07:28:02.475001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494035+0000","last_change":"2024-09-21T07:28:02.492296+0000","last_active":"2024-09-21T07:28:02.494035+0000","last_peered":"2024-09-21T07:28:02.494035+0000","last_clean":"2024-09-21T07:28:02.494035+0000","last_became_active":"2024-09-21T07:28:02.491988+0000","last_became_peered":"2024-09-21T07:28:02.491988+0000","last_unstale":"2024-09-21T07:28:02.494035+0000","last_undegraded":"2024-09-21T07:28:02.494035+0000","last_fullsized":"2024-09-21T07:28:02.494035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:54.718727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473705+0000","last_change":"2024-09-21T07:28:02.473705+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473705+0000","last_undegraded":"2024-09-21T07:28:02.473705+0000","last_fullsized":"2024-09-21T07:28:02.473705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484619+0000","last_change":"2024-09-21T07:28:02.481472+0000","last_active":"2024-09-21T07:28:02.484619+0000","last_peered":"2024-09-21T07:28:02.484619+0000","last_clean":"2024-09-21T07:28:02.484619+0000","last_became_active":"2024-09-21T07:28:02.480516+0000","last_became_peered":"2024-09-21T07:28:02.480516+0000","last_unstale":"2024-09-21T07:28:02.484619+0000","last_undegraded":"2024-09-21T07:28:02.484619+0000","last_fullsized":"2024-09-21T07:28:02.484619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:48.998413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474529+0000","last_change":"2024-09-21T07:28:02.474529+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474529+0000","last_undegraded":"2024-09-21T07:28:02.474529+0000","last_fullsized":"2024-09-21T07:28:02.474529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491150+0000","last_change":"2024-09-21T07:28:02.488106+0000","last_active":"2024-09-21T07:28:02.491150+0000","last_peered":"2024-09-21T07:28:02.491150+0000","last_clean":"2024-09-21T07:28:02.491150+0000","last_became_active":"2024-09-21T07:28:02.487749+0000","last_became_peered":"2024-09-21T07:28:02.487749+0000","last_unstale":"2024-09-21T07:28:02.491150+0000","last_undegraded":"2024-09-21T07:28:02.491150+0000","last_fullsized":"2024-09-21T07:28:02.491150+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:14.892991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475585+0000","last_change":"2024-09-21T07:28:02.475585+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475585+0000","last_undegraded":"2024-09-21T07:28:02.475585+0000","last_fullsized":"2024-09-21T07:28:02.475585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484502+0000","last_change":"2024-09-21T07:28:02.480862+0000","last_active":"2024-09-21T07:28:02.484502+0000","last_peered":"2024-09-21T07:28:02.484502+0000","last_clean":"2024-09-21T07:28:02.484502+0000","last_became_active":"2024-09-21T07:28:02.479884+0000","last_became_peered":"2024-09-21T07:28:02.479884+0000","last_unstale":"2024-09-21T07:28:02.484502+0000","last_undegraded":"2024-09-21T07:28:02.484502+0000","last_fullsized":"2024-09-21T07:28:02.484502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:58.148746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468917+0000","last_change":"2024-09-21T07:28:02.468917+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468917+0000","last_undegraded":"2024-09-21T07:28:02.468917+0000","last_fullsized":"2024-09-21T07:28:02.468917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.493358+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.493044+0000","last_became_peered":"2024-09-21T07:28:02.493044+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:54.105626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473545+0000","last_change":"2024-09-21T07:28:02.473545+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473545+0000","last_undegraded":"2024-09-21T07:28:02.473545+0000","last_fullsized":"2024-09-21T07:28:02.473545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491951+0000","last_change":"2024-09-21T07:28:02.490011+0000","last_active":"2024-09-21T07:28:02.491951+0000","last_peered":"2024-09-21T07:28:02.491951+0000","last_clean":"2024-09-21T07:28:02.491951+0000","last_became_active":"2024-09-21T07:28:02.489295+0000","last_became_peered":"2024-09-21T07:28:02.489295+0000","last_unstale":"2024-09-21T07:28:02.491951+0000","last_undegraded":"2024-09-21T07:28:02.491951+0000","last_fullsized":"2024-09-21T07:28:02.491951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:09.470145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472814+0000","last_change":"2024-09-21T07:28:02.472814+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472814+0000","last_undegraded":"2024-09-21T07:28:02.472814+0000","last_fullsized":"2024-09-21T07:28:02.472814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495608+0000","last_change":"2024-09-21T07:28:02.491433+0000","last_active":"2024-09-21T07:28:02.495608+0000","last_peered":"2024-09-21T07:28:02.495608+0000","last_clean":"2024-09-21T07:28:02.495608+0000","last_became_active":"2024-09-21T07:28:02.490769+0000","last_became_peered":"2024-09-21T07:28:02.490769+0000","last_unstale":"2024-09-21T07:28:02.495608+0000","last_undegraded":"2024-09-21T07:28:02.495608+0000","last_fullsized":"2024-09-21T07:28:02.495608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473836+0000","last_change":"2024-09-21T07:28:02.473836+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473836+0000","last_undegraded":"2024-09-21T07:28:02.473836+0000","last_fullsized":"2024-09-21T07:28:02.473836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487148+0000","last_change":"2024-09-21T07:28:02.484294+0000","last_active":"2024-09-21T07:28:02.487148+0000","last_peered":"2024-09-21T07:28:02.487148+0000","last_clean":"2024-09-21T07:28:02.487148+0000","last_became_active":"2024-09-21T07:28:02.483654+0000","last_became_peered":"2024-09-21T07:28:02.483654+0000","last_unstale":"2024-09-21T07:28:02.487148+0000","last_undegraded":"2024-09-21T07:28:02.487148+0000","last_fullsized":"2024-09-21T07:28:02.487148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:49.122271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465586+0000","last_change":"2024-09-21T07:28:02.465586+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465586+0000","last_undegraded":"2024-09-21T07:28:02.465586+0000","last_fullsized":"2024-09-21T07:28:02.465586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.493787+0000","last_change":"2024-09-21T07:28:02.488252+0000","last_active":"2024-09-21T07:28:02.493787+0000","last_peered":"2024-09-21T07:28:02.493787+0000","last_clean":"2024-09-21T07:28:02.493787+0000","last_became_active":"2024-09-21T07:28:02.486549+0000","last_became_peered":"2024-09-21T07:28:02.486549+0000","last_unstale":"2024-09-21T07:28:02.493787+0000","last_undegraded":"2024-09-21T07:28:02.493787+0000","last_fullsized":"2024-09-21T07:28:02.493787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:39.970875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485858+0000","last_change":"2024-09-21T07:28:03.505904+0000","last_active":"2024-09-21T07:28:04.485858+0000","last_peered":"2024-09-21T07:28:04.485858+0000","last_clean":"2024-09-21T07:28:04.485858+0000","last_became_active":"2024-09-21T07:28:03.505598+0000","last_became_peered":"2024-09-21T07:28:03.505598+0000","last_unstale":"2024-09-21T07:28:04.485858+0000","last_undegraded":"2024-09-21T07:28:04.485858+0000","last_fullsized":"2024-09-21T07:28:04.485858+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.467698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494856+0000","last_change":"2024-09-21T07:28:02.492642+0000","last_active":"2024-09-21T07:28:02.494856+0000","last_peered":"2024-09-21T07:28:02.494856+0000","last_clean":"2024-09-21T07:28:02.494856+0000","last_became_active":"2024-09-21T07:28:02.491303+0000","last_became_peered":"2024-09-21T07:28:02.491303+0000","last_unstale":"2024-09-21T07:28:02.494856+0000","last_undegraded":"2024-09-21T07:28:02.494856+0000","last_fullsized":"2024-09-21T07:28:02.494856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468536+0000","last_change":"2024-09-21T07:28:02.468536+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468536+0000","last_undegraded":"2024-09-21T07:28:02.468536+0000","last_fullsized":"2024-09-21T07:28:02.468536+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489132+0000","last_change":"2024-09-21T07:28:02.485310+0000","last_active":"2024-09-21T07:28:02.489132+0000","last_peered":"2024-09-21T07:28:02.489132+0000","last_clean":"2024-09-21T07:28:02.489132+0000","last_became_active":"2024-09-21T07:28:02.484055+0000","last_became_peered":"2024-09-21T07:28:02.484055+0000","last_unstale":"2024-09-21T07:28:02.489132+0000","last_undegraded":"2024-09-21T07:28:02.489132+0000","last_fullsized":"2024-09-21T07:28:02.489132+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:56.841102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473074+0000","last_change":"2024-09-21T07:28:02.473074+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473074+0000","last_undegraded":"2024-09-21T07:28:02.473074+0000","last_fullsized":"2024-09-21T07:28:02.473074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558020+0000","last_change":"2024-09-21T07:28:02.494597+0000","last_active":"2024-09-21T07:28:04.558020+0000","last_peered":"2024-09-21T07:28:04.558020+0000","last_clean":"2024-09-21T07:28:04.558020+0000","last_became_active":"2024-09-21T07:28:02.493870+0000","last_became_peered":"2024-09-21T07:28:02.493870+0000","last_unstale":"2024-09-21T07:28:04.558020+0000","last_undegraded":"2024-09-21T07:28:04.558020+0000","last_fullsized":"2024-09-21T07:28:04.558020+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.788786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559427+0000","last_change":"2024-09-21T07:28:03.522880+0000","last_active":"2024-09-21T07:28:04.559427+0000","last_peered":"2024-09-21T07:28:04.559427+0000","last_clean":"2024-09-21T07:28:04.559427+0000","last_became_active":"2024-09-21T07:28:03.522515+0000","last_became_peered":"2024-09-21T07:28:03.522515+0000","last_unstale":"2024-09-21T07:28:04.559427+0000","last_undegraded":"2024-09-21T07:28:04.559427+0000","last_fullsized":"2024-09-21T07:28:04.559427+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:11.357619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488270+0000","last_change":"2024-09-21T07:28:02.480599+0000","last_active":"2024-09-21T07:28:02.488270+0000","last_peered":"2024-09-21T07:28:02.488270+0000","last_clean":"2024-09-21T07:28:02.488270+0000","last_became_active":"2024-09-21T07:28:02.480200+0000","last_became_peered":"2024-09-21T07:28:02.480200+0000","last_unstale":"2024-09-21T07:28:02.488270+0000","last_undegraded":"2024-09-21T07:28:02.488270+0000","last_fullsized":"2024-09-21T07:28:02.488270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:53.144565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40656,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331184,"statfs":{"total":96636764160,"available":96595132416,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":1134198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":1154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:08.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:08.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 -- 172.21.15.64:0/2039301856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 msgr2=0x7f49580b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 --2- 172.21.15.64:0/2039301856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49580b1be0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4944009870 tx=0x7f494401c7f0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 -- 172.21.15.64:0/2039301856 shutdown_connections 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 --2- 172.21.15.64:0/2039301856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49580b1be0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 --2- 172.21.15.64:0/2039301856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f4958070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 -- 172.21.15.64:0/2039301856 >> 172.21.15.64:0/2039301856 conn(0x7f49580ccbe0 msgr2=0x7f49580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 -- 172.21.15.64:0/2039301856 shutdown_connections 2024-09-21T07:28:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.323+0000 7f495f400640 1 -- 172.21.15.64:0/2039301856 wait complete. 2024-09-21T07:28:08.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 Processor -- start 2024-09-21T07:28:08.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- start start 2024-09-21T07:28:08.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49580b2120 0x7f495815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f49581541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f49580b41f0 con 0x7f4958070850 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f49580b4070 con 0x7f49580b2120 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f49580b4370 con 0x7f495815cbd0 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33040/0 (socket says 172.21.15.64:33040) 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 -- 172.21.15.64:0/3530786770 learned_addr learned my addr 172.21.15.64:0/3530786770 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f4957e00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49580b2120 0x7f495815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 -- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 msgr2=0x7f49581541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495d400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f49581541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f49581541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 -- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49580b2120 msgr2=0x7f495815b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49580b2120 0x7f495815b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 -- 172.21.15.64:0/3530786770 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958072f30 con 0x7f4958070850 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495d400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f49581541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495ca00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e7c0 tx=0x7f494c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c00ccc0 con 0x7f4958070850 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f494c00ce80 con 0x7f4958070850 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4958073210 con 0x7f4958070850 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c005280 con 0x7f4958070850 2024-09-21T07:28:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.327+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49580737d0 con 0x7f4958070850 2024-09-21T07:28:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.331+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49580b1be0 con 0x7f4958070850 2024-09-21T07:28:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.331+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f494c005420 con 0x7f4958070850 2024-09-21T07:28:08.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.331+0000 7f4954c00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 0x7f4938075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.331+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f494c094e00 con 0x7f4958070850 2024-09-21T07:28:08.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.331+0000 7f4957e00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 0x7f4938075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.335+0000 7f4957e00640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 0x7f4938075710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f49440af000 tx=0x7f494401b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:08.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.335+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f494c05fc80 con 0x7f4958070850 2024-09-21T07:28:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.511+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f495815be70 con 0x7f4938073200 2024-09-21T07:28:08.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.515+0000 7f4954c00640 1 -- 172.21.15.64:0/3530786770 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247700 (secure 0 0 0) 0x7f49440a6ab0 con 0x7f4938073200 2024-09-21T07:28:08.519 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:08.521 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:08.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 msgr2=0x7f4938075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 0x7f4938075710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f49440af000 tx=0x7f494401b030 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 msgr2=0x7f49581525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e7c0 tx=0x7f494c00ec80 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 shutdown_connections 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4938073200 0x7f4938075710 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f495815cbd0 0x7f49581541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49580b2120 0x7f495815b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 --2- 172.21.15.64:0/3530786770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4958070850 0x7f49581525d0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 >> 172.21.15.64:0/3530786770 conn(0x7f49580ccbe0 msgr2=0x7f4958155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 shutdown_connections 2024-09-21T07:28:08.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.519+0000 7f495f400640 1 -- 172.21.15.64:0/3530786770 wait complete. 2024-09-21T07:28:08.541 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-09-21T07:28:07.507100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309888,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664832,"statfs":{"total":773094113280,"available":772776787968,"internally_reserved":0,"allocated":10698752,"data_stored":5585818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":306433587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486307+0000","last_change":"2024-09-21T07:28:03.498429+0000","last_active":"2024-09-21T07:28:04.486307+0000","last_peered":"2024-09-21T07:28:04.486307+0000","last_clean":"2024-09-21T07:28:04.486307+0000","last_became_active":"2024-09-21T07:28:03.498139+0000","last_became_peered":"2024-09-21T07:28:03.498139+0000","last_unstale":"2024-09-21T07:28:04.486307+0000","last_undegraded":"2024-09-21T07:28:04.486307+0000","last_fullsized":"2024-09-21T07:28:04.486307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:18.070246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475069+0000","last_change":"2024-09-21T07:28:02.475069+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475069+0000","last_undegraded":"2024-09-21T07:28:02.475069+0000","last_fullsized":"2024-09-21T07:28:02.475069+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486317+0000","last_change":"2024-09-21T07:28:03.500537+0000","last_active":"2024-09-21T07:28:04.486317+0000","last_peered":"2024-09-21T07:28:04.486317+0000","last_clean":"2024-09-21T07:28:04.486317+0000","last_became_active":"2024-09-21T07:28:03.500232+0000","last_became_peered":"2024-09-21T07:28:03.500232+0000","last_unstale":"2024-09-21T07:28:04.486317+0000","last_undegraded":"2024-09-21T07:28:04.486317+0000","last_fullsized":"2024-09-21T07:28:04.486317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:40.849017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468819+0000","last_change":"2024-09-21T07:28:02.468819+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468819+0000","last_undegraded":"2024-09-21T07:28:02.468819+0000","last_fullsized":"2024-09-21T07:28:02.468819+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472274+0000","last_change":"2024-09-21T07:28:02.472274+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472274+0000","last_undegraded":"2024-09-21T07:28:02.472274+0000","last_fullsized":"2024-09-21T07:28:02.472274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.480209+0000","last_change":"2024-09-21T07:28:02.480209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.480209+0000","last_undegraded":"2024-09-21T07:28:02.480209+0000","last_fullsized":"2024-09-21T07:28:02.480209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559345+0000","last_change":"2024-09-21T07:28:03.514701+0000","last_active":"2024-09-21T07:28:04.559345+0000","last_peered":"2024-09-21T07:28:04.559345+0000","last_clean":"2024-09-21T07:28:04.559345+0000","last_became_active":"2024-09-21T07:28:03.514394+0000","last_became_peered":"2024-09-21T07:28:03.514394+0000","last_unstale":"2024-09-21T07:28:04.559345+0000","last_undegraded":"2024-09-21T07:28:04.559345+0000","last_fullsized":"2024-09-21T07:28:04.559345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:13.467674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469662+0000","last_change":"2024-09-21T07:28:02.469662+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469662+0000","last_undegraded":"2024-09-21T07:28:02.469662+0000","last_fullsized":"2024-09-21T07:28:02.469662+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474209+0000","last_change":"2024-09-21T07:28:02.474209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474209+0000","last_undegraded":"2024-09-21T07:28:02.474209+0000","last_fullsized":"2024-09-21T07:28:02.474209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465314+0000","last_change":"2024-09-21T07:28:02.465314+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465314+0000","last_undegraded":"2024-09-21T07:28:02.465314+0000","last_fullsized":"2024-09-21T07:28:02.465314+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479071+0000","last_change":"2024-09-21T07:28:02.479071+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479071+0000","last_undegraded":"2024-09-21T07:28:02.479071+0000","last_fullsized":"2024-09-21T07:28:02.479071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466077+0000","last_change":"2024-09-21T07:28:02.466077+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466077+0000","last_undegraded":"2024-09-21T07:28:02.466077+0000","last_fullsized":"2024-09-21T07:28:02.466077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466930+0000","last_change":"2024-09-21T07:28:02.466930+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466930+0000","last_undegraded":"2024-09-21T07:28:02.466930+0000","last_fullsized":"2024-09-21T07:28:02.466930+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471082+0000","last_change":"2024-09-21T07:28:02.471082+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471082+0000","last_undegraded":"2024-09-21T07:28:02.471082+0000","last_fullsized":"2024-09-21T07:28:02.471082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466470+0000","last_change":"2024-09-21T07:28:02.466470+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466470+0000","last_undegraded":"2024-09-21T07:28:02.466470+0000","last_fullsized":"2024-09-21T07:28:02.466470+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479710+0000","last_change":"2024-09-21T07:28:02.479710+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479710+0000","last_undegraded":"2024-09-21T07:28:02.479710+0000","last_fullsized":"2024-09-21T07:28:02.479710+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479066+0000","last_change":"2024-09-21T07:28:02.479066+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479066+0000","last_undegraded":"2024-09-21T07:28:02.479066+0000","last_fullsized":"2024-09-21T07:28:02.479066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486498+0000","last_change":"2024-09-21T07:28:03.516916+0000","last_active":"2024-09-21T07:28:04.486498+0000","last_peered":"2024-09-21T07:28:04.486498+0000","last_clean":"2024-09-21T07:28:04.486498+0000","last_became_active":"2024-09-21T07:28:03.516579+0000","last_became_peered":"2024-09-21T07:28:03.516579+0000","last_unstale":"2024-09-21T07:28:04.486498+0000","last_undegraded":"2024-09-21T07:28:04.486498+0000","last_fullsized":"2024-09-21T07:28:04.486498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478599+0000","last_change":"2024-09-21T07:28:02.478599+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478599+0000","last_undegraded":"2024-09-21T07:28:02.478599+0000","last_fullsized":"2024-09-21T07:28:02.478599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467656+0000","last_change":"2024-09-21T07:28:02.467656+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467656+0000","last_undegraded":"2024-09-21T07:28:02.467656+0000","last_fullsized":"2024-09-21T07:28:02.467656+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472810+0000","last_change":"2024-09-21T07:28:02.472810+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472810+0000","last_undegraded":"2024-09-21T07:28:02.472810+0000","last_fullsized":"2024-09-21T07:28:02.472810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470466+0000","last_change":"2024-09-21T07:28:02.470466+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470466+0000","last_undegraded":"2024-09-21T07:28:02.470466+0000","last_fullsized":"2024-09-21T07:28:02.470466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470127+0000","last_change":"2024-09-21T07:28:02.470127+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470127+0000","last_undegraded":"2024-09-21T07:28:02.470127+0000","last_fullsized":"2024-09-21T07:28:02.470127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485864+0000","last_change":"2024-09-21T07:28:03.496999+0000","last_active":"2024-09-21T07:28:04.485864+0000","last_peered":"2024-09-21T07:28:04.485864+0000","last_clean":"2024-09-21T07:28:04.485864+0000","last_became_active":"2024-09-21T07:28:03.495267+0000","last_became_peered":"2024-09-21T07:28:03.495267+0000","last_unstale":"2024-09-21T07:28:04.485864+0000","last_undegraded":"2024-09-21T07:28:04.485864+0000","last_fullsized":"2024-09-21T07:28:04.485864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:33.747730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474681+0000","last_change":"2024-09-21T07:28:02.474681+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474681+0000","last_undegraded":"2024-09-21T07:28:02.474681+0000","last_fullsized":"2024-09-21T07:28:02.474681+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477889+0000","last_change":"2024-09-21T07:28:02.477889+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477889+0000","last_undegraded":"2024-09-21T07:28:02.477889+0000","last_fullsized":"2024-09-21T07:28:02.477889+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465301+0000","last_change":"2024-09-21T07:28:02.465301+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465301+0000","last_undegraded":"2024-09-21T07:28:02.465301+0000","last_fullsized":"2024-09-21T07:28:02.465301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467158+0000","last_change":"2024-09-21T07:28:02.467158+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467158+0000","last_undegraded":"2024-09-21T07:28:02.467158+0000","last_fullsized":"2024-09-21T07:28:02.467158+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559111+0000","last_change":"2024-09-21T07:28:03.522857+0000","last_active":"2024-09-21T07:28:04.559111+0000","last_peered":"2024-09-21T07:28:04.559111+0000","last_clean":"2024-09-21T07:28:04.559111+0000","last_became_active":"2024-09-21T07:28:03.522439+0000","last_became_peered":"2024-09-21T07:28:03.522439+0000","last_unstale":"2024-09-21T07:28:04.559111+0000","last_undegraded":"2024-09-21T07:28:04.559111+0000","last_fullsized":"2024-09-21T07:28:04.559111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469797+0000","last_change":"2024-09-21T07:28:02.469797+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469797+0000","last_undegraded":"2024-09-21T07:28:02.469797+0000","last_fullsized":"2024-09-21T07:28:02.469797+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474365+0000","last_change":"2024-09-21T07:28:02.474365+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474365+0000","last_undegraded":"2024-09-21T07:28:02.474365+0000","last_fullsized":"2024-09-21T07:28:02.474365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479245+0000","last_change":"2024-09-21T07:28:02.479245+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479245+0000","last_undegraded":"2024-09-21T07:28:02.479245+0000","last_fullsized":"2024-09-21T07:28:02.479245+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477183+0000","last_change":"2024-09-21T07:28:02.477183+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477183+0000","last_undegraded":"2024-09-21T07:28:02.477183+0000","last_fullsized":"2024-09-21T07:28:02.477183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.486046+0000","last_change":"2024-09-21T07:28:02.480401+0000","last_active":"2024-09-21T07:28:02.486046+0000","last_peered":"2024-09-21T07:28:02.486046+0000","last_clean":"2024-09-21T07:28:02.486046+0000","last_became_active":"2024-09-21T07:28:02.480063+0000","last_became_peered":"2024-09-21T07:28:02.480063+0000","last_unstale":"2024-09-21T07:28:02.486046+0000","last_undegraded":"2024-09-21T07:28:02.486046+0000","last_fullsized":"2024-09-21T07:28:02.486046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.683081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478264+0000","last_change":"2024-09-21T07:28:02.478264+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478264+0000","last_undegraded":"2024-09-21T07:28:02.478264+0000","last_fullsized":"2024-09-21T07:28:02.478264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.490708+0000","last_change":"2024-09-21T07:28:02.489572+0000","last_active":"2024-09-21T07:28:02.490708+0000","last_peered":"2024-09-21T07:28:02.490708+0000","last_clean":"2024-09-21T07:28:02.490708+0000","last_became_active":"2024-09-21T07:28:02.489240+0000","last_became_peered":"2024-09-21T07:28:02.489240+0000","last_unstale":"2024-09-21T07:28:02.490708+0000","last_undegraded":"2024-09-21T07:28:02.490708+0000","last_fullsized":"2024-09-21T07:28:02.490708+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:06.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559385+0000","last_change":"2024-09-21T07:28:03.526754+0000","last_active":"2024-09-21T07:28:04.559385+0000","last_peered":"2024-09-21T07:28:04.559385+0000","last_clean":"2024-09-21T07:28:04.559385+0000","last_became_active":"2024-09-21T07:28:03.526453+0000","last_became_peered":"2024-09-21T07:28:03.526453+0000","last_unstale":"2024-09-21T07:28:04.559385+0000","last_undegraded":"2024-09-21T07:28:04.559385+0000","last_fullsized":"2024-09-21T07:28:04.559385+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559310+0000","last_change":"2024-09-21T07:28:02.492575+0000","last_active":"2024-09-21T07:28:04.559310+0000","last_peered":"2024-09-21T07:28:04.559310+0000","last_clean":"2024-09-21T07:28:04.559310+0000","last_became_active":"2024-09-21T07:28:02.491529+0000","last_became_peered":"2024-09-21T07:28:02.491529+0000","last_unstale":"2024-09-21T07:28:04.559310+0000","last_undegraded":"2024-09-21T07:28:04.559310+0000","last_fullsized":"2024-09-21T07:28:04.559310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476312+0000","last_change":"2024-09-21T07:28:02.476312+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476312+0000","last_undegraded":"2024-09-21T07:28:02.476312+0000","last_fullsized":"2024-09-21T07:28:02.476312+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487115+0000","last_change":"2024-09-21T07:28:02.483081+0000","last_active":"2024-09-21T07:28:02.487115+0000","last_peered":"2024-09-21T07:28:02.487115+0000","last_clean":"2024-09-21T07:28:02.487115+0000","last_became_active":"2024-09-21T07:28:02.482548+0000","last_became_peered":"2024-09-21T07:28:02.482548+0000","last_unstale":"2024-09-21T07:28:02.487115+0000","last_undegraded":"2024-09-21T07:28:02.487115+0000","last_fullsized":"2024-09-21T07:28:02.487115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.915932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469139+0000","last_change":"2024-09-21T07:28:02.469139+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469139+0000","last_undegraded":"2024-09-21T07:28:02.469139+0000","last_fullsized":"2024-09-21T07:28:02.469139+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487087+0000","last_change":"2024-09-21T07:28:02.485679+0000","last_active":"2024-09-21T07:28:02.487087+0000","last_peered":"2024-09-21T07:28:02.487087+0000","last_clean":"2024-09-21T07:28:02.487087+0000","last_became_active":"2024-09-21T07:28:02.484985+0000","last_became_peered":"2024-09-21T07:28:02.484985+0000","last_unstale":"2024-09-21T07:28:02.487087+0000","last_undegraded":"2024-09-21T07:28:02.487087+0000","last_fullsized":"2024-09-21T07:28:02.487087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:10.970100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469579+0000","last_change":"2024-09-21T07:28:02.469579+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469579+0000","last_undegraded":"2024-09-21T07:28:02.469579+0000","last_fullsized":"2024-09-21T07:28:02.469579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488859+0000","last_change":"2024-09-21T07:28:02.484131+0000","last_active":"2024-09-21T07:28:02.488859+0000","last_peered":"2024-09-21T07:28:02.488859+0000","last_clean":"2024-09-21T07:28:02.488859+0000","last_became_active":"2024-09-21T07:28:02.483822+0000","last_became_peered":"2024-09-21T07:28:02.483822+0000","last_unstale":"2024-09-21T07:28:02.488859+0000","last_undegraded":"2024-09-21T07:28:02.488859+0000","last_fullsized":"2024-09-21T07:28:02.488859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:19.845520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476090+0000","last_change":"2024-09-21T07:28:02.476090+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476090+0000","last_undegraded":"2024-09-21T07:28:02.476090+0000","last_fullsized":"2024-09-21T07:28:02.476090+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485851+0000","last_change":"2024-09-21T07:28:02.481366+0000","last_active":"2024-09-21T07:28:04.485851+0000","last_peered":"2024-09-21T07:28:04.485851+0000","last_clean":"2024-09-21T07:28:04.485851+0000","last_became_active":"2024-09-21T07:28:02.480991+0000","last_became_peered":"2024-09-21T07:28:02.480991+0000","last_unstale":"2024-09-21T07:28:04.485851+0000","last_undegraded":"2024-09-21T07:28:04.485851+0000","last_fullsized":"2024-09-21T07:28:04.485851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466325+0000","last_change":"2024-09-21T07:28:02.466325+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466325+0000","last_undegraded":"2024-09-21T07:28:02.466325+0000","last_fullsized":"2024-09-21T07:28:02.466325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557899+0000","last_change":"2024-09-21T07:28:02.494170+0000","last_active":"2024-09-21T07:28:04.557899+0000","last_peered":"2024-09-21T07:28:04.557899+0000","last_clean":"2024-09-21T07:28:04.557899+0000","last_became_active":"2024-09-21T07:28:02.493439+0000","last_became_peered":"2024-09-21T07:28:02.493439+0000","last_unstale":"2024-09-21T07:28:04.557899+0000","last_undegraded":"2024-09-21T07:28:04.557899+0000","last_fullsized":"2024-09-21T07:28:04.557899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:27.800486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472878+0000","last_change":"2024-09-21T07:28:02.472878+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472878+0000","last_undegraded":"2024-09-21T07:28:02.472878+0000","last_fullsized":"2024-09-21T07:28:02.472878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.485718+0000","last_change":"2024-09-21T07:28:02.483843+0000","last_active":"2024-09-21T07:28:02.485718+0000","last_peered":"2024-09-21T07:28:02.485718+0000","last_clean":"2024-09-21T07:28:02.485718+0000","last_became_active":"2024-09-21T07:28:02.483455+0000","last_became_peered":"2024-09-21T07:28:02.483455+0000","last_unstale":"2024-09-21T07:28:02.485718+0000","last_undegraded":"2024-09-21T07:28:02.485718+0000","last_fullsized":"2024-09-21T07:28:02.485718+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:26.638902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559290+0000","last_change":"2024-09-21T07:28:03.528617+0000","last_active":"2024-09-21T07:28:04.559290+0000","last_peered":"2024-09-21T07:28:04.559290+0000","last_clean":"2024-09-21T07:28:04.559290+0000","last_became_active":"2024-09-21T07:28:03.528268+0000","last_became_peered":"2024-09-21T07:28:03.528268+0000","last_unstale":"2024-09-21T07:28:04.559290+0000","last_undegraded":"2024-09-21T07:28:04.559290+0000","last_fullsized":"2024-09-21T07:28:04.559290+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486479+0000","last_change":"2024-09-21T07:28:02.490608+0000","last_active":"2024-09-21T07:28:04.486479+0000","last_peered":"2024-09-21T07:28:04.486479+0000","last_clean":"2024-09-21T07:28:04.486479+0000","last_became_active":"2024-09-21T07:28:02.490278+0000","last_became_peered":"2024-09-21T07:28:02.490278+0000","last_unstale":"2024-09-21T07:28:04.486479+0000","last_undegraded":"2024-09-21T07:28:04.486479+0000","last_fullsized":"2024-09-21T07:28:04.486479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486360+0000","last_change":"2024-09-21T07:28:03.499223+0000","last_active":"2024-09-21T07:28:04.486360+0000","last_peered":"2024-09-21T07:28:04.486360+0000","last_clean":"2024-09-21T07:28:04.486360+0000","last_became_active":"2024-09-21T07:28:03.498880+0000","last_became_peered":"2024-09-21T07:28:03.498880+0000","last_unstale":"2024-09-21T07:28:04.486360+0000","last_undegraded":"2024-09-21T07:28:04.486360+0000","last_fullsized":"2024-09-21T07:28:04.486360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495580+0000","last_change":"2024-09-21T07:28:02.491104+0000","last_active":"2024-09-21T07:28:02.495580+0000","last_peered":"2024-09-21T07:28:02.495580+0000","last_clean":"2024-09-21T07:28:02.495580+0000","last_became_active":"2024-09-21T07:28:02.490329+0000","last_became_peered":"2024-09-21T07:28:02.490329+0000","last_unstale":"2024-09-21T07:28:02.495580+0000","last_undegraded":"2024-09-21T07:28:02.495580+0000","last_fullsized":"2024-09-21T07:28:02.495580+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:48.697276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466805+0000","last_change":"2024-09-21T07:28:02.466805+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466805+0000","last_undegraded":"2024-09-21T07:28:02.466805+0000","last_fullsized":"2024-09-21T07:28:02.466805+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489356+0000","last_change":"2024-09-21T07:28:02.481710+0000","last_active":"2024-09-21T07:28:02.489356+0000","last_peered":"2024-09-21T07:28:02.489356+0000","last_clean":"2024-09-21T07:28:02.489356+0000","last_became_active":"2024-09-21T07:28:02.481285+0000","last_became_peered":"2024-09-21T07:28:02.481285+0000","last_unstale":"2024-09-21T07:28:02.489356+0000","last_undegraded":"2024-09-21T07:28:02.489356+0000","last_fullsized":"2024-09-21T07:28:02.489356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:06.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468623+0000","last_change":"2024-09-21T07:28:02.468623+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468623+0000","last_undegraded":"2024-09-21T07:28:02.468623+0000","last_fullsized":"2024-09-21T07:28:02.468623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558949+0000","last_change":"2024-09-21T07:28:02.495439+0000","last_active":"2024-09-21T07:28:04.558949+0000","last_peered":"2024-09-21T07:28:04.558949+0000","last_clean":"2024-09-21T07:28:04.558949+0000","last_became_active":"2024-09-21T07:28:02.494223+0000","last_became_peered":"2024-09-21T07:28:02.494223+0000","last_unstale":"2024-09-21T07:28:04.558949+0000","last_undegraded":"2024-09-21T07:28:04.558949+0000","last_fullsized":"2024-09-21T07:28:04.558949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:50.727753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471322+0000","last_change":"2024-09-21T07:28:02.471322+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471322+0000","last_undegraded":"2024-09-21T07:28:02.471322+0000","last_fullsized":"2024-09-21T07:28:02.471322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489612+0000","last_change":"2024-09-21T07:28:02.486025+0000","last_active":"2024-09-21T07:28:02.489612+0000","last_peered":"2024-09-21T07:28:02.489612+0000","last_clean":"2024-09-21T07:28:02.489612+0000","last_became_active":"2024-09-21T07:28:02.485713+0000","last_became_peered":"2024-09-21T07:28:02.485713+0000","last_unstale":"2024-09-21T07:28:02.489612+0000","last_undegraded":"2024-09-21T07:28:02.489612+0000","last_fullsized":"2024-09-21T07:28:02.489612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:02.610962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465783+0000","last_change":"2024-09-21T07:28:02.465783+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465783+0000","last_undegraded":"2024-09-21T07:28:02.465783+0000","last_fullsized":"2024-09-21T07:28:02.465783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.481892+0000","last_change":"2024-09-21T07:28:02.475561+0000","last_active":"2024-09-21T07:28:02.481892+0000","last_peered":"2024-09-21T07:28:02.481892+0000","last_clean":"2024-09-21T07:28:02.481892+0000","last_became_active":"2024-09-21T07:28:02.475232+0000","last_became_peered":"2024-09-21T07:28:02.475232+0000","last_unstale":"2024-09-21T07:28:02.481892+0000","last_undegraded":"2024-09-21T07:28:02.481892+0000","last_fullsized":"2024-09-21T07:28:02.481892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:53.568044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465238+0000","last_change":"2024-09-21T07:28:02.465238+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465238+0000","last_undegraded":"2024-09-21T07:28:02.465238+0000","last_fullsized":"2024-09-21T07:28:02.465238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.492130+0000","last_change":"2024-09-21T07:28:02.489670+0000","last_active":"2024-09-21T07:28:02.492130+0000","last_peered":"2024-09-21T07:28:02.492130+0000","last_clean":"2024-09-21T07:28:02.492130+0000","last_became_active":"2024-09-21T07:28:02.485518+0000","last_became_peered":"2024-09-21T07:28:02.485518+0000","last_unstale":"2024-09-21T07:28:02.492130+0000","last_undegraded":"2024-09-21T07:28:02.492130+0000","last_fullsized":"2024-09-21T07:28:02.492130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.269217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476665+0000","last_change":"2024-09-21T07:28:02.476665+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476665+0000","last_undegraded":"2024-09-21T07:28:02.476665+0000","last_fullsized":"2024-09-21T07:28:02.476665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.496103+0000","last_change":"2024-09-21T07:28:02.490405+0000","last_active":"2024-09-21T07:28:02.496103+0000","last_peered":"2024-09-21T07:28:02.496103+0000","last_clean":"2024-09-21T07:28:02.496103+0000","last_became_active":"2024-09-21T07:28:02.488124+0000","last_became_peered":"2024-09-21T07:28:02.488124+0000","last_unstale":"2024-09-21T07:28:02.496103+0000","last_undegraded":"2024-09-21T07:28:02.496103+0000","last_fullsized":"2024-09-21T07:28:02.496103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:54.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468806+0000","last_change":"2024-09-21T07:28:02.468806+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468806+0000","last_undegraded":"2024-09-21T07:28:02.468806+0000","last_fullsized":"2024-09-21T07:28:02.468806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559227+0000","last_change":"2024-09-21T07:28:02.493001+0000","last_active":"2024-09-21T07:28:04.559227+0000","last_peered":"2024-09-21T07:28:04.559227+0000","last_clean":"2024-09-21T07:28:04.559227+0000","last_became_active":"2024-09-21T07:28:02.492584+0000","last_became_peered":"2024-09-21T07:28:02.492584+0000","last_unstale":"2024-09-21T07:28:04.559227+0000","last_undegraded":"2024-09-21T07:28:04.559227+0000","last_fullsized":"2024-09-21T07:28:04.559227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477436+0000","last_change":"2024-09-21T07:28:02.477436+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477436+0000","last_undegraded":"2024-09-21T07:28:02.477436+0000","last_fullsized":"2024-09-21T07:28:02.477436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495866+0000","last_change":"2024-09-21T07:28:02.492630+0000","last_active":"2024-09-21T07:28:02.495866+0000","last_peered":"2024-09-21T07:28:02.495866+0000","last_clean":"2024-09-21T07:28:02.495866+0000","last_became_active":"2024-09-21T07:28:02.492255+0000","last_became_peered":"2024-09-21T07:28:02.492255+0000","last_unstale":"2024-09-21T07:28:02.495866+0000","last_undegraded":"2024-09-21T07:28:02.495866+0000","last_fullsized":"2024-09-21T07:28:02.495866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:02.904038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475001+0000","last_change":"2024-09-21T07:28:02.475001+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475001+0000","last_undegraded":"2024-09-21T07:28:02.475001+0000","last_fullsized":"2024-09-21T07:28:02.475001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494035+0000","last_change":"2024-09-21T07:28:02.492296+0000","last_active":"2024-09-21T07:28:02.494035+0000","last_peered":"2024-09-21T07:28:02.494035+0000","last_clean":"2024-09-21T07:28:02.494035+0000","last_became_active":"2024-09-21T07:28:02.491988+0000","last_became_peered":"2024-09-21T07:28:02.491988+0000","last_unstale":"2024-09-21T07:28:02.494035+0000","last_undegraded":"2024-09-21T07:28:02.494035+0000","last_fullsized":"2024-09-21T07:28:02.494035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:54.718727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473705+0000","last_change":"2024-09-21T07:28:02.473705+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473705+0000","last_undegraded":"2024-09-21T07:28:02.473705+0000","last_fullsized":"2024-09-21T07:28:02.473705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484619+0000","last_change":"2024-09-21T07:28:02.481472+0000","last_active":"2024-09-21T07:28:02.484619+0000","last_peered":"2024-09-21T07:28:02.484619+0000","last_clean":"2024-09-21T07:28:02.484619+0000","last_became_active":"2024-09-21T07:28:02.480516+0000","last_became_peered":"2024-09-21T07:28:02.480516+0000","last_unstale":"2024-09-21T07:28:02.484619+0000","last_undegraded":"2024-09-21T07:28:02.484619+0000","last_fullsized":"2024-09-21T07:28:02.484619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:48.998413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474529+0000","last_change":"2024-09-21T07:28:02.474529+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474529+0000","last_undegraded":"2024-09-21T07:28:02.474529+0000","last_fullsized":"2024-09-21T07:28:02.474529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491150+0000","last_change":"2024-09-21T07:28:02.488106+0000","last_active":"2024-09-21T07:28:02.491150+0000","last_peered":"2024-09-21T07:28:02.491150+0000","last_clean":"2024-09-21T07:28:02.491150+0000","last_became_active":"2024-09-21T07:28:02.487749+0000","last_became_peered":"2024-09-21T07:28:02.487749+0000","last_unstale":"2024-09-21T07:28:02.491150+0000","last_undegraded":"2024-09-21T07:28:02.491150+0000","last_fullsized":"2024-09-21T07:28:02.491150+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:14.892991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475585+0000","last_change":"2024-09-21T07:28:02.475585+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475585+0000","last_undegraded":"2024-09-21T07:28:02.475585+0000","last_fullsized":"2024-09-21T07:28:02.475585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484502+0000","last_change":"2024-09-21T07:28:02.480862+0000","last_active":"2024-09-21T07:28:02.484502+0000","last_peered":"2024-09-21T07:28:02.484502+0000","last_clean":"2024-09-21T07:28:02.484502+0000","last_became_active":"2024-09-21T07:28:02.479884+0000","last_became_peered":"2024-09-21T07:28:02.479884+0000","last_unstale":"2024-09-21T07:28:02.484502+0000","last_undegraded":"2024-09-21T07:28:02.484502+0000","last_fullsized":"2024-09-21T07:28:02.484502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:58.148746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468917+0000","last_change":"2024-09-21T07:28:02.468917+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468917+0000","last_undegraded":"2024-09-21T07:28:02.468917+0000","last_fullsized":"2024-09-21T07:28:02.468917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.493358+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.493044+0000","last_became_peered":"2024-09-21T07:28:02.493044+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:54.105626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473545+0000","last_change":"2024-09-21T07:28:02.473545+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473545+0000","last_undegraded":"2024-09-21T07:28:02.473545+0000","last_fullsized":"2024-09-21T07:28:02.473545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491951+0000","last_change":"2024-09-21T07:28:02.490011+0000","last_active":"2024-09-21T07:28:02.491951+0000","last_peered":"2024-09-21T07:28:02.491951+0000","last_clean":"2024-09-21T07:28:02.491951+0000","last_became_active":"2024-09-21T07:28:02.489295+0000","last_became_peered":"2024-09-21T07:28:02.489295+0000","last_unstale":"2024-09-21T07:28:02.491951+0000","last_undegraded":"2024-09-21T07:28:02.491951+0000","last_fullsized":"2024-09-21T07:28:02.491951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:09.470145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472814+0000","last_change":"2024-09-21T07:28:02.472814+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472814+0000","last_undegraded":"2024-09-21T07:28:02.472814+0000","last_fullsized":"2024-09-21T07:28:02.472814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495608+0000","last_change":"2024-09-21T07:28:02.491433+0000","last_active":"2024-09-21T07:28:02.495608+0000","last_peered":"2024-09-21T07:28:02.495608+0000","last_clean":"2024-09-21T07:28:02.495608+0000","last_became_active":"2024-09-21T07:28:02.490769+0000","last_became_peered":"2024-09-21T07:28:02.490769+0000","last_unstale":"2024-09-21T07:28:02.495608+0000","last_undegraded":"2024-09-21T07:28:02.495608+0000","last_fullsized":"2024-09-21T07:28:02.495608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473836+0000","last_change":"2024-09-21T07:28:02.473836+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473836+0000","last_undegraded":"2024-09-21T07:28:02.473836+0000","last_fullsized":"2024-09-21T07:28:02.473836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487148+0000","last_change":"2024-09-21T07:28:02.484294+0000","last_active":"2024-09-21T07:28:02.487148+0000","last_peered":"2024-09-21T07:28:02.487148+0000","last_clean":"2024-09-21T07:28:02.487148+0000","last_became_active":"2024-09-21T07:28:02.483654+0000","last_became_peered":"2024-09-21T07:28:02.483654+0000","last_unstale":"2024-09-21T07:28:02.487148+0000","last_undegraded":"2024-09-21T07:28:02.487148+0000","last_fullsized":"2024-09-21T07:28:02.487148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:49.122271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465586+0000","last_change":"2024-09-21T07:28:02.465586+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465586+0000","last_undegraded":"2024-09-21T07:28:02.465586+0000","last_fullsized":"2024-09-21T07:28:02.465586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.493787+0000","last_change":"2024-09-21T07:28:02.488252+0000","last_active":"2024-09-21T07:28:02.493787+0000","last_peered":"2024-09-21T07:28:02.493787+0000","last_clean":"2024-09-21T07:28:02.493787+0000","last_became_active":"2024-09-21T07:28:02.486549+0000","last_became_peered":"2024-09-21T07:28:02.486549+0000","last_unstale":"2024-09-21T07:28:02.493787+0000","last_undegraded":"2024-09-21T07:28:02.493787+0000","last_fullsized":"2024-09-21T07:28:02.493787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:39.970875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485858+0000","last_change":"2024-09-21T07:28:03.505904+0000","last_active":"2024-09-21T07:28:04.485858+0000","last_peered":"2024-09-21T07:28:04.485858+0000","last_clean":"2024-09-21T07:28:04.485858+0000","last_became_active":"2024-09-21T07:28:03.505598+0000","last_became_peered":"2024-09-21T07:28:03.505598+0000","last_unstale":"2024-09-21T07:28:04.485858+0000","last_undegraded":"2024-09-21T07:28:04.485858+0000","last_fullsized":"2024-09-21T07:28:04.485858+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.467698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494856+0000","last_change":"2024-09-21T07:28:02.492642+0000","last_active":"2024-09-21T07:28:02.494856+0000","last_peered":"2024-09-21T07:28:02.494856+0000","last_clean":"2024-09-21T07:28:02.494856+0000","last_became_active":"2024-09-21T07:28:02.491303+0000","last_became_peered":"2024-09-21T07:28:02.491303+0000","last_unstale":"2024-09-21T07:28:02.494856+0000","last_undegraded":"2024-09-21T07:28:02.494856+0000","last_fullsized":"2024-09-21T07:28:02.494856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468536+0000","last_change":"2024-09-21T07:28:02.468536+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468536+0000","last_undegraded":"2024-09-21T07:28:02.468536+0000","last_fullsized":"2024-09-21T07:28:02.468536+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489132+0000","last_change":"2024-09-21T07:28:02.485310+0000","last_active":"2024-09-21T07:28:02.489132+0000","last_peered":"2024-09-21T07:28:02.489132+0000","last_clean":"2024-09-21T07:28:02.489132+0000","last_became_active":"2024-09-21T07:28:02.484055+0000","last_became_peered":"2024-09-21T07:28:02.484055+0000","last_unstale":"2024-09-21T07:28:02.489132+0000","last_undegraded":"2024-09-21T07:28:02.489132+0000","last_fullsized":"2024-09-21T07:28:02.489132+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:56.841102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473074+0000","last_change":"2024-09-21T07:28:02.473074+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473074+0000","last_undegraded":"2024-09-21T07:28:02.473074+0000","last_fullsized":"2024-09-21T07:28:02.473074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558020+0000","last_change":"2024-09-21T07:28:02.494597+0000","last_active":"2024-09-21T07:28:04.558020+0000","last_peered":"2024-09-21T07:28:04.558020+0000","last_clean":"2024-09-21T07:28:04.558020+0000","last_became_active":"2024-09-21T07:28:02.493870+0000","last_became_peered":"2024-09-21T07:28:02.493870+0000","last_unstale":"2024-09-21T07:28:04.558020+0000","last_undegraded":"2024-09-21T07:28:04.558020+0000","last_fullsized":"2024-09-21T07:28:04.558020+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.788786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559427+0000","last_change":"2024-09-21T07:28:03.522880+0000","last_active":"2024-09-21T07:28:04.559427+0000","last_peered":"2024-09-21T07:28:04.559427+0000","last_clean":"2024-09-21T07:28:04.559427+0000","last_became_active":"2024-09-21T07:28:03.522515+0000","last_became_peered":"2024-09-21T07:28:03.522515+0000","last_unstale":"2024-09-21T07:28:04.559427+0000","last_undegraded":"2024-09-21T07:28:04.559427+0000","last_fullsized":"2024-09-21T07:28:04.559427+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:11.357619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488270+0000","last_change":"2024-09-21T07:28:02.480599+0000","last_active":"2024-09-21T07:28:02.488270+0000","last_peered":"2024-09-21T07:28:02.488270+0000","last_clean":"2024-09-21T07:28:02.488270+0000","last_became_active":"2024-09-21T07:28:02.480200+0000","last_became_peered":"2024-09-21T07:28:02.480200+0000","last_unstale":"2024-09-21T07:28:02.488270+0000","last_undegraded":"2024-09-21T07:28:02.488270+0000","last_fullsized":"2024-09-21T07:28:02.488270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:53.144565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40656,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331184,"statfs":{"total":96636764160,"available":96595132416,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":1134198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":1154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:08.545 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3e is not active+clean 2024-09-21T07:28:08.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.475069+0000', 'last_change': '2024-09-21T07:28:02.475069+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.475069+0000', 'last_undegraded': '2024-09-21T07:28:02.475069+0000', 'last_fullsized': '2024-09-21T07:28:02.475069+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.545 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3c is not active+clean 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.468819+0000', 'last_change': '2024-09-21T07:28:02.468819+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.468819+0000', 'last_undegraded': '2024-09-21T07:28:02.468819+0000', 'last_fullsized': '2024-09-21T07:28:02.468819+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3b is not active+clean 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.472274+0000', 'last_change': '2024-09-21T07:28:02.472274+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.472274+0000', 'last_undegraded': '2024-09-21T07:28:02.472274+0000', 'last_fullsized': '2024-09-21T07:28:02.472274+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3a is not active+clean 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.480209+0000', 'last_change': '2024-09-21T07:28:02.480209+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.480209+0000', 'last_undegraded': '2024-09-21T07:28:02.480209+0000', 'last_fullsized': '2024-09-21T07:28:02.480209+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:PG 14.38 is not active+clean 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.469662+0000', 'last_change': '2024-09-21T07:28:02.469662+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.469662+0000', 'last_undegraded': '2024-09-21T07:28:02.469662+0000', 'last_fullsized': '2024-09-21T07:28:02.469662+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:PG 14.37 is not active+clean 2024-09-21T07:28:08.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.474209+0000', 'last_change': '2024-09-21T07:28:02.474209+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.474209+0000', 'last_undegraded': '2024-09-21T07:28:02.474209+0000', 'last_fullsized': '2024-09-21T07:28:02.474209+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.36 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.465314+0000', 'last_change': '2024-09-21T07:28:02.465314+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.465314+0000', 'last_undegraded': '2024-09-21T07:28:02.465314+0000', 'last_fullsized': '2024-09-21T07:28:02.465314+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.35 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.479071+0000', 'last_change': '2024-09-21T07:28:02.479071+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.479071+0000', 'last_undegraded': '2024-09-21T07:28:02.479071+0000', 'last_fullsized': '2024-09-21T07:28:02.479071+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.34 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.466077+0000', 'last_change': '2024-09-21T07:28:02.466077+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.466077+0000', 'last_undegraded': '2024-09-21T07:28:02.466077+0000', 'last_fullsized': '2024-09-21T07:28:02.466077+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.33 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.466930+0000', 'last_change': '2024-09-21T07:28:02.466930+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.466930+0000', 'last_undegraded': '2024-09-21T07:28:02.466930+0000', 'last_fullsized': '2024-09-21T07:28:02.466930+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.32 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.471082+0000', 'last_change': '2024-09-21T07:28:02.471082+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.471082+0000', 'last_undegraded': '2024-09-21T07:28:02.471082+0000', 'last_fullsized': '2024-09-21T07:28:02.471082+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:PG 14.31 is not active+clean 2024-09-21T07:28:08.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.466470+0000', 'last_change': '2024-09-21T07:28:02.466470+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.466470+0000', 'last_undegraded': '2024-09-21T07:28:02.466470+0000', 'last_fullsized': '2024-09-21T07:28:02.466470+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.30 is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.479710+0000', 'last_change': '2024-09-21T07:28:02.479710+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.479710+0000', 'last_undegraded': '2024-09-21T07:28:02.479710+0000', 'last_fullsized': '2024-09-21T07:28:02.479710+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2f is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.479066+0000', 'last_change': '2024-09-21T07:28:02.479066+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.479066+0000', 'last_undegraded': '2024-09-21T07:28:02.479066+0000', 'last_fullsized': '2024-09-21T07:28:02.479066+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2d is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.478599+0000', 'last_change': '2024-09-21T07:28:02.478599+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.478599+0000', 'last_undegraded': '2024-09-21T07:28:02.478599+0000', 'last_fullsized': '2024-09-21T07:28:02.478599+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2c is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.467656+0000', 'last_change': '2024-09-21T07:28:02.467656+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.467656+0000', 'last_undegraded': '2024-09-21T07:28:02.467656+0000', 'last_fullsized': '2024-09-21T07:28:02.467656+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2b is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.472810+0000', 'last_change': '2024-09-21T07:28:02.472810+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.472810+0000', 'last_undegraded': '2024-09-21T07:28:02.472810+0000', 'last_fullsized': '2024-09-21T07:28:02.472810+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2a is not active+clean 2024-09-21T07:28:08.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.470466+0000', 'last_change': '2024-09-21T07:28:02.470466+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.470466+0000', 'last_undegraded': '2024-09-21T07:28:02.470466+0000', 'last_fullsized': '2024-09-21T07:28:02.470466+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:PG 14.29 is not active+clean 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.470127+0000', 'last_change': '2024-09-21T07:28:02.470127+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.470127+0000', 'last_undegraded': '2024-09-21T07:28:02.470127+0000', 'last_fullsized': '2024-09-21T07:28:02.470127+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:PG 14.27 is not active+clean 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.474681+0000', 'last_change': '2024-09-21T07:28:02.474681+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.474681+0000', 'last_undegraded': '2024-09-21T07:28:02.474681+0000', 'last_fullsized': '2024-09-21T07:28:02.474681+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:PG 14.26 is not active+clean 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.477889+0000', 'last_change': '2024-09-21T07:28:02.477889+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.477889+0000', 'last_undegraded': '2024-09-21T07:28:02.477889+0000', 'last_fullsized': '2024-09-21T07:28:02.477889+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:PG 14.25 is not active+clean 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.465301+0000', 'last_change': '2024-09-21T07:28:02.465301+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.465301+0000', 'last_undegraded': '2024-09-21T07:28:02.465301+0000', 'last_fullsized': '2024-09-21T07:28:02.465301+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.549 INFO:tasks.ceph.ceph_manager.ceph:PG 14.24 is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.467158+0000', 'last_change': '2024-09-21T07:28:02.467158+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.467158+0000', 'last_undegraded': '2024-09-21T07:28:02.467158+0000', 'last_fullsized': '2024-09-21T07:28:02.467158+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:PG 14.22 is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.469797+0000', 'last_change': '2024-09-21T07:28:02.469797+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.469797+0000', 'last_undegraded': '2024-09-21T07:28:02.469797+0000', 'last_fullsized': '2024-09-21T07:28:02.469797+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:PG 14.21 is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.474365+0000', 'last_change': '2024-09-21T07:28:02.474365+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.474365+0000', 'last_undegraded': '2024-09-21T07:28:02.474365+0000', 'last_fullsized': '2024-09-21T07:28:02.474365+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:PG 14.20 is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.479245+0000', 'last_change': '2024-09-21T07:28:02.479245+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.479245+0000', 'last_undegraded': '2024-09-21T07:28:02.479245+0000', 'last_fullsized': '2024-09-21T07:28:02.479245+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1c is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.477183+0000', 'last_change': '2024-09-21T07:28:02.477183+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.477183+0000', 'last_undegraded': '2024-09-21T07:28:02.477183+0000', 'last_fullsized': '2024-09-21T07:28:02.477183+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-09-21T07:28:08.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.478264+0000', 'last_change': '2024-09-21T07:28:02.478264+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.478264+0000', 'last_undegraded': '2024-09-21T07:28:02.478264+0000', 'last_fullsized': '2024-09-21T07:28:02.478264+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1f is not active+clean 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.476312+0000', 'last_change': '2024-09-21T07:28:02.476312+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.476312+0000', 'last_undegraded': '2024-09-21T07:28:02.476312+0000', 'last_fullsized': '2024-09-21T07:28:02.476312+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:PG 14.18 is not active+clean 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.469139+0000', 'last_change': '2024-09-21T07:28:02.469139+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.469139+0000', 'last_undegraded': '2024-09-21T07:28:02.469139+0000', 'last_fullsized': '2024-09-21T07:28:02.469139+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.469579+0000', 'last_change': '2024-09-21T07:28:02.469579+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.469579+0000', 'last_undegraded': '2024-09-21T07:28:02.469579+0000', 'last_fullsized': '2024-09-21T07:28:02.469579+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.476090+0000', 'last_change': '2024-09-21T07:28:02.476090+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.476090+0000', 'last_undegraded': '2024-09-21T07:28:02.476090+0000', 'last_fullsized': '2024-09-21T07:28:02.476090+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1b is not active+clean 2024-09-21T07:28:08.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.466325+0000', 'last_change': '2024-09-21T07:28:02.466325+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.466325+0000', 'last_undegraded': '2024-09-21T07:28:02.466325+0000', 'last_fullsized': '2024-09-21T07:28:02.466325+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.472878+0000', 'last_change': '2024-09-21T07:28:02.472878+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.472878+0000', 'last_undegraded': '2024-09-21T07:28:02.472878+0000', 'last_fullsized': '2024-09-21T07:28:02.472878+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:PG 14.17 is not active+clean 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.466805+0000', 'last_change': '2024-09-21T07:28:02.466805+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.466805+0000', 'last_undegraded': '2024-09-21T07:28:02.466805+0000', 'last_fullsized': '2024-09-21T07:28:02.466805+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:PG 14.10 is not active+clean 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.468623+0000', 'last_change': '2024-09-21T07:28:02.468623+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.468623+0000', 'last_undegraded': '2024-09-21T07:28:02.468623+0000', 'last_fullsized': '2024-09-21T07:28:02.468623+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-09-21T07:28:08.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.471322+0000', 'last_change': '2024-09-21T07:28:02.471322+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.471322+0000', 'last_undegraded': '2024-09-21T07:28:02.471322+0000', 'last_fullsized': '2024-09-21T07:28:02.471322+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:PG 14.12 is not active+clean 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.465783+0000', 'last_change': '2024-09-21T07:28:02.465783+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.465783+0000', 'last_undegraded': '2024-09-21T07:28:02.465783+0000', 'last_fullsized': '2024-09-21T07:28:02.465783+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:PG 14.13 is not active+clean 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.465238+0000', 'last_change': '2024-09-21T07:28:02.465238+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.465238+0000', 'last_undegraded': '2024-09-21T07:28:02.465238+0000', 'last_fullsized': '2024-09-21T07:28:02.465238+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:PG 14.c is not active+clean 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.476665+0000', 'last_change': '2024-09-21T07:28:02.476665+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.476665+0000', 'last_undegraded': '2024-09-21T07:28:02.476665+0000', 'last_fullsized': '2024-09-21T07:28:02.476665+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.468806+0000', 'last_change': '2024-09-21T07:28:02.468806+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.468806+0000', 'last_undegraded': '2024-09-21T07:28:02.468806+0000', 'last_fullsized': '2024-09-21T07:28:02.468806+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-09-21T07:28:08.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.477436+0000', 'last_change': '2024-09-21T07:28:02.477436+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.477436+0000', 'last_undegraded': '2024-09-21T07:28:02.477436+0000', 'last_fullsized': '2024-09-21T07:28:02.477436+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.475001+0000', 'last_change': '2024-09-21T07:28:02.475001+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.475001+0000', 'last_undegraded': '2024-09-21T07:28:02.475001+0000', 'last_fullsized': '2024-09-21T07:28:02.475001+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.9 is not active+clean 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.473705+0000', 'last_change': '2024-09-21T07:28:02.473705+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.473705+0000', 'last_undegraded': '2024-09-21T07:28:02.473705+0000', 'last_fullsized': '2024-09-21T07:28:02.473705+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.a is not active+clean 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.474529+0000', 'last_change': '2024-09-21T07:28:02.474529+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.474529+0000', 'last_undegraded': '2024-09-21T07:28:02.474529+0000', 'last_fullsized': '2024-09-21T07:28:02.474529+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.b is not active+clean 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.475585+0000', 'last_change': '2024-09-21T07:28:02.475585+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.475585+0000', 'last_undegraded': '2024-09-21T07:28:02.475585+0000', 'last_fullsized': '2024-09-21T07:28:02.475585+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.468917+0000', 'last_change': '2024-09-21T07:28:02.468917+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.468917+0000', 'last_undegraded': '2024-09-21T07:28:02.468917+0000', 'last_fullsized': '2024-09-21T07:28:02.468917+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:08.554 INFO:tasks.ceph.ceph_manager.ceph:PG 14.5 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.473545+0000', 'last_change': '2024-09-21T07:28:02.473545+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.473545+0000', 'last_undegraded': '2024-09-21T07:28:02.473545+0000', 'last_fullsized': '2024-09-21T07:28:02.473545+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:PG 14.6 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.472814+0000', 'last_change': '2024-09-21T07:28:02.472814+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.472814+0000', 'last_undegraded': '2024-09-21T07:28:02.472814+0000', 'last_fullsized': '2024-09-21T07:28:02.472814+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:PG 14.7 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.473836+0000', 'last_change': '2024-09-21T07:28:02.473836+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.473836+0000', 'last_undegraded': '2024-09-21T07:28:02.473836+0000', 'last_fullsized': '2024-09-21T07:28:02.473836+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:PG 14.0 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.465586+0000', 'last_change': '2024-09-21T07:28:02.465586+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.465586+0000', 'last_undegraded': '2024-09-21T07:28:02.465586+0000', 'last_fullsized': '2024-09-21T07:28:02.465586+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.468536+0000', 'last_change': '2024-09-21T07:28:02.468536+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.468536+0000', 'last_undegraded': '2024-09-21T07:28:02.468536+0000', 'last_fullsized': '2024-09-21T07:28:02.468536+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-09-21T07:28:08.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:02.473074+0000', 'last_change': '2024-09-21T07:28:02.473074+0000', 'last_active': '2024-09-21T07:28:02.456935+0000', 'last_peered': '2024-09-21T07:28:02.456935+0000', 'last_clean': '2024-09-21T07:28:02.456935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:02.473074+0000', 'last_undegraded': '2024-09-21T07:28:02.473074+0000', 'last_fullsized': '2024-09-21T07:28:02.473074+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:02.456935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:08.556 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:28:08.690 INFO:tasks.ceph.mds.d.smithi090.stderr:2024-09-21T07:28:08.685+0000 7f187b800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:28:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 -- 172.21.15.64:0/4263023061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3120 msgr2=0x7f66b00b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 --2- 172.21.15.64:0/4263023061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3120 0x7f66b00b3530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6698009870 tx=0x7f669801c780 comp rx=0 tx=0).stop 2024-09-21T07:28:08.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 -- 172.21.15.64:0/4263023061 shutdown_connections 2024-09-21T07:28:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 --2- 172.21.15.64:0/4263023061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3120 0x7f66b00b3530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 -- 172.21.15.64:0/4263023061 >> 172.21.15.64:0/4263023061 conn(0x7f66b00ccbe0 msgr2=0x7f66b00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 -- 172.21.15.64:0/4263023061 shutdown_connections 2024-09-21T07:28:08.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.739+0000 7f66b6600640 1 -- 172.21.15.64:0/4263023061 wait complete. 2024-09-21T07:28:08.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 Processor -- start 2024-09-21T07:28:08.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- start start 2024-09-21T07:28:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b00b1c50 0x7f66b00c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3a70 0x7f66b00adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66b016a250 con 0x7f66b00b3120 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66b016a0d0 con 0x7f66b00b1c50 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f66b016a3d0 con 0x7f66b00b3a70 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33052/0 (socket says 172.21.15.64:33052) 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 -- 172.21.15.64:0/3193134695 learned_addr learned my addr 172.21.15.64:0/3193134695 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66af400640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b00b1c50 0x7f66b00c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66afe00640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3a70 0x7f66b00adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 -- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3a70 msgr2=0x7f66b00adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3a70 0x7f66b00adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 -- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b00b1c50 msgr2=0x7f66b00c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b00b1c50 0x7f66b00c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 -- 172.21.15.64:0/3193134695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b00ca510 con 0x7f66b00b3120 2024-09-21T07:28:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7e00640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f669801ae30 tx=0x7f66980a8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698005ca0 con 0x7f66b00b3120 2024-09-21T07:28:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66980b9700 con 0x7f66b00b3120 2024-09-21T07:28:08.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980b9b30 con 0x7f66b00b3120 2024-09-21T07:28:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b00c4560 con 0x7f66b00b3120 2024-09-21T07:28:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.743+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b01fc860 con 0x7f66b00b3120 2024-09-21T07:28:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.747+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b00c42d0 con 0x7f66b00b3120 2024-09-21T07:28:08.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.747+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f66980b7070 con 0x7f66b00b3120 2024-09-21T07:28:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.747+0000 7f66a7400640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 0x7f668c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.747+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f669812eb10 con 0x7f66b00b3120 2024-09-21T07:28:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.747+0000 7f66af400640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 0x7f668c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:08.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.751+0000 7f66af400640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 0x7f668c075710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f66a0001ec0 tx=0x7f66a0001760 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:08.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.751+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f66980ac030 con 0x7f66b00b3120 2024-09-21T07:28:08.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f66b00b3530 con 0x7f66b00b3120 2024-09-21T07:28:08.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66a7400640 1 -- 172.21.15.64:0/3193134695 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f6698016370 con 0x7f66b00b3120 2024-09-21T07:28:08.993 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:08.993 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":347,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":53},{"state_name":"active+clean","count":44}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590402,"bytes_used":317325312,"bytes_avail":772776787968,"bytes_total":773094113280,"inactive_pgs_ratio":0.54639172554016113,"write_bytes_sec":1194,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":68,"btime":"2024-09-21T07:28:06:516570+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7233}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-21T07:27:51.503074+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 msgr2=0x7f668c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 0x7f668c075710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f66a0001ec0 tx=0x7f66a0001760 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 msgr2=0x7f66b0158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f669801ae30 tx=0x7f66980a8d50 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 shutdown_connections 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f668c073200 0x7f668c075710 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b00b3a70 0x7f66b00adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66b00b3120 0x7f66b0158190 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 --2- 172.21.15.64:0/3193134695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b00b1c50 0x7f66b00c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 >> 172.21.15.64:0/3193134695 conn(0x7f66b00ccbe0 msgr2=0x7f66b00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:08.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 shutdown_connections 2024-09-21T07:28:08.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:08.991+0000 7f66b6600640 1 -- 172.21.15.64:0/3193134695 wait complete. 2024-09-21T07:28:09.015 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:28:09.015 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 -- 172.21.15.64:0/2512519482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 msgr2=0x7ff4ec0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 --2- 172.21.15.64:0/2512519482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec0ce5b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009900 tx=0x7ff4dc01c8b0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 -- 172.21.15.64:0/2512519482 shutdown_connections 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 --2- 172.21.15.64:0/2512519482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06f620 0x7ff4ec06fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 --2- 172.21.15.64:0/2512519482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec0ce5b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 -- 172.21.15.64:0/2512519482 >> 172.21.15.64:0/2512519482 conn(0x7ff4ec0d0de0 msgr2=0x7ff4ec0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 -- 172.21.15.64:0/2512519482 shutdown_connections 2024-09-21T07:28:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.171+0000 7ff4f1000640 1 -- 172.21.15.64:0/2512519482 wait complete. 2024-09-21T07:28:09.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 Processor -- start 2024-09-21T07:28:09.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- start start 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 0x7ff4ec0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 0x7ff4ec0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec168bb0 con 0x7ff4ec15b810 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec168a30 con 0x7ff4ec06f620 2024-09-21T07:28:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec168d30 con 0x7ff4ec06d020 2024-09-21T07:28:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:09.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33060/0 (socket says 172.21.15.64:33060) 2024-09-21T07:28:09.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 -- 172.21.15.64:0/3019897693 learned_addr learned my addr 172.21.15.64:0/3019897693 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:09.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e9e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 0x7ff4ec0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:09.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 -- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 msgr2=0x7ff4ec0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e3e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 0x7ff4ec0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 0x7ff4ec0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 -- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 msgr2=0x7ff4ec0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 0x7ff4ec0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 -- 172.21.15.64:0/3019897693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec0c8fb0 con 0x7ff4ec15b810 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e9e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 0x7ff4ec0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e3e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 0x7ff4ec0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4ea800640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400eab0 tx=0x7ff4e4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400ce40 con 0x7ff4ec15b810 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e4004c20 con 0x7ff4ec15b810 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec0ca560 con 0x7ff4ec15b810 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4005020 con 0x7ff4ec15b810 2024-09-21T07:28:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.175+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec0c94c0 con 0x7ff4ec15b810 2024-09-21T07:28:09.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec0c9230 con 0x7ff4ec15b810 2024-09-21T07:28:09.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff4e40051e0 con 0x7ff4ec15b810 2024-09-21T07:28:09.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4e2000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 0x7ff4c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:09.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7ff4e4095310 con 0x7ff4ec15b810 2024-09-21T07:28:09.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4e9e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 0x7ff4c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:09.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.179+0000 7ff4e9e00640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 0x7ff4c8075710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0af000 tx=0x7ff4dc01b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:09.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.183+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff4e4060100 con 0x7ff4ec15b810 2024-09-21T07:28:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.359+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4ec0b5c10 con 0x7ff4c8073200 2024-09-21T07:28:09.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.363+0000 7ff4e2000640 1 -- 172.21.15.64:0/3019897693 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247700 (secure 0 0 0) 0x7ff4ec0b5c10 con 0x7ff4c8073200 2024-09-21T07:28:09.367 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:09.368 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:09.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 msgr2=0x7ff4c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 0x7ff4c8075710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0af000 tx=0x7ff4dc01b0f0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 msgr2=0x7ff4ec1fc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400eab0 tx=0x7ff4e4009f70 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 shutdown_connections 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4c8073200 0x7ff4c8075710 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4ec15b810 0x7ff4ec1fc490 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ec06f620 0x7ff4ec0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 --2- 172.21.15.64:0/3019897693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4ec06d020 0x7ff4ec0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 >> 172.21.15.64:0/3019897693 conn(0x7ff4ec0d0de0 msgr2=0x7ff4ec0b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 shutdown_connections 2024-09-21T07:28:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:09.367+0000 7ff4f1000640 1 -- 172.21.15.64:0/3019897693 wait complete. 2024-09-21T07:28:09.389 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-09-21T07:28:07.507100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309888,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664832,"statfs":{"total":773094113280,"available":772776787968,"internally_reserved":0,"allocated":10698752,"data_stored":5585818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":306433587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486307+0000","last_change":"2024-09-21T07:28:03.498429+0000","last_active":"2024-09-21T07:28:04.486307+0000","last_peered":"2024-09-21T07:28:04.486307+0000","last_clean":"2024-09-21T07:28:04.486307+0000","last_became_active":"2024-09-21T07:28:03.498139+0000","last_became_peered":"2024-09-21T07:28:03.498139+0000","last_unstale":"2024-09-21T07:28:04.486307+0000","last_undegraded":"2024-09-21T07:28:04.486307+0000","last_fullsized":"2024-09-21T07:28:04.486307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:18.070246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475069+0000","last_change":"2024-09-21T07:28:02.475069+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475069+0000","last_undegraded":"2024-09-21T07:28:02.475069+0000","last_fullsized":"2024-09-21T07:28:02.475069+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486317+0000","last_change":"2024-09-21T07:28:03.500537+0000","last_active":"2024-09-21T07:28:04.486317+0000","last_peered":"2024-09-21T07:28:04.486317+0000","last_clean":"2024-09-21T07:28:04.486317+0000","last_became_active":"2024-09-21T07:28:03.500232+0000","last_became_peered":"2024-09-21T07:28:03.500232+0000","last_unstale":"2024-09-21T07:28:04.486317+0000","last_undegraded":"2024-09-21T07:28:04.486317+0000","last_fullsized":"2024-09-21T07:28:04.486317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:40.849017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468819+0000","last_change":"2024-09-21T07:28:02.468819+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468819+0000","last_undegraded":"2024-09-21T07:28:02.468819+0000","last_fullsized":"2024-09-21T07:28:02.468819+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472274+0000","last_change":"2024-09-21T07:28:02.472274+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472274+0000","last_undegraded":"2024-09-21T07:28:02.472274+0000","last_fullsized":"2024-09-21T07:28:02.472274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.480209+0000","last_change":"2024-09-21T07:28:02.480209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.480209+0000","last_undegraded":"2024-09-21T07:28:02.480209+0000","last_fullsized":"2024-09-21T07:28:02.480209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559345+0000","last_change":"2024-09-21T07:28:03.514701+0000","last_active":"2024-09-21T07:28:04.559345+0000","last_peered":"2024-09-21T07:28:04.559345+0000","last_clean":"2024-09-21T07:28:04.559345+0000","last_became_active":"2024-09-21T07:28:03.514394+0000","last_became_peered":"2024-09-21T07:28:03.514394+0000","last_unstale":"2024-09-21T07:28:04.559345+0000","last_undegraded":"2024-09-21T07:28:04.559345+0000","last_fullsized":"2024-09-21T07:28:04.559345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:13.467674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469662+0000","last_change":"2024-09-21T07:28:02.469662+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469662+0000","last_undegraded":"2024-09-21T07:28:02.469662+0000","last_fullsized":"2024-09-21T07:28:02.469662+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474209+0000","last_change":"2024-09-21T07:28:02.474209+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474209+0000","last_undegraded":"2024-09-21T07:28:02.474209+0000","last_fullsized":"2024-09-21T07:28:02.474209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465314+0000","last_change":"2024-09-21T07:28:02.465314+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465314+0000","last_undegraded":"2024-09-21T07:28:02.465314+0000","last_fullsized":"2024-09-21T07:28:02.465314+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479071+0000","last_change":"2024-09-21T07:28:02.479071+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479071+0000","last_undegraded":"2024-09-21T07:28:02.479071+0000","last_fullsized":"2024-09-21T07:28:02.479071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466077+0000","last_change":"2024-09-21T07:28:02.466077+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466077+0000","last_undegraded":"2024-09-21T07:28:02.466077+0000","last_fullsized":"2024-09-21T07:28:02.466077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466930+0000","last_change":"2024-09-21T07:28:02.466930+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466930+0000","last_undegraded":"2024-09-21T07:28:02.466930+0000","last_fullsized":"2024-09-21T07:28:02.466930+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471082+0000","last_change":"2024-09-21T07:28:02.471082+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471082+0000","last_undegraded":"2024-09-21T07:28:02.471082+0000","last_fullsized":"2024-09-21T07:28:02.471082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466470+0000","last_change":"2024-09-21T07:28:02.466470+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466470+0000","last_undegraded":"2024-09-21T07:28:02.466470+0000","last_fullsized":"2024-09-21T07:28:02.466470+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479710+0000","last_change":"2024-09-21T07:28:02.479710+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479710+0000","last_undegraded":"2024-09-21T07:28:02.479710+0000","last_fullsized":"2024-09-21T07:28:02.479710+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479066+0000","last_change":"2024-09-21T07:28:02.479066+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479066+0000","last_undegraded":"2024-09-21T07:28:02.479066+0000","last_fullsized":"2024-09-21T07:28:02.479066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486498+0000","last_change":"2024-09-21T07:28:03.516916+0000","last_active":"2024-09-21T07:28:04.486498+0000","last_peered":"2024-09-21T07:28:04.486498+0000","last_clean":"2024-09-21T07:28:04.486498+0000","last_became_active":"2024-09-21T07:28:03.516579+0000","last_became_peered":"2024-09-21T07:28:03.516579+0000","last_unstale":"2024-09-21T07:28:04.486498+0000","last_undegraded":"2024-09-21T07:28:04.486498+0000","last_fullsized":"2024-09-21T07:28:04.486498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478599+0000","last_change":"2024-09-21T07:28:02.478599+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478599+0000","last_undegraded":"2024-09-21T07:28:02.478599+0000","last_fullsized":"2024-09-21T07:28:02.478599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467656+0000","last_change":"2024-09-21T07:28:02.467656+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467656+0000","last_undegraded":"2024-09-21T07:28:02.467656+0000","last_fullsized":"2024-09-21T07:28:02.467656+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472810+0000","last_change":"2024-09-21T07:28:02.472810+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472810+0000","last_undegraded":"2024-09-21T07:28:02.472810+0000","last_fullsized":"2024-09-21T07:28:02.472810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470466+0000","last_change":"2024-09-21T07:28:02.470466+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470466+0000","last_undegraded":"2024-09-21T07:28:02.470466+0000","last_fullsized":"2024-09-21T07:28:02.470466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.470127+0000","last_change":"2024-09-21T07:28:02.470127+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.470127+0000","last_undegraded":"2024-09-21T07:28:02.470127+0000","last_fullsized":"2024-09-21T07:28:02.470127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485864+0000","last_change":"2024-09-21T07:28:03.496999+0000","last_active":"2024-09-21T07:28:04.485864+0000","last_peered":"2024-09-21T07:28:04.485864+0000","last_clean":"2024-09-21T07:28:04.485864+0000","last_became_active":"2024-09-21T07:28:03.495267+0000","last_became_peered":"2024-09-21T07:28:03.495267+0000","last_unstale":"2024-09-21T07:28:04.485864+0000","last_undegraded":"2024-09-21T07:28:04.485864+0000","last_fullsized":"2024-09-21T07:28:04.485864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:33.747730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474681+0000","last_change":"2024-09-21T07:28:02.474681+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474681+0000","last_undegraded":"2024-09-21T07:28:02.474681+0000","last_fullsized":"2024-09-21T07:28:02.474681+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477889+0000","last_change":"2024-09-21T07:28:02.477889+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477889+0000","last_undegraded":"2024-09-21T07:28:02.477889+0000","last_fullsized":"2024-09-21T07:28:02.477889+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465301+0000","last_change":"2024-09-21T07:28:02.465301+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465301+0000","last_undegraded":"2024-09-21T07:28:02.465301+0000","last_fullsized":"2024-09-21T07:28:02.465301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.467158+0000","last_change":"2024-09-21T07:28:02.467158+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.467158+0000","last_undegraded":"2024-09-21T07:28:02.467158+0000","last_fullsized":"2024-09-21T07:28:02.467158+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559111+0000","last_change":"2024-09-21T07:28:03.522857+0000","last_active":"2024-09-21T07:28:04.559111+0000","last_peered":"2024-09-21T07:28:04.559111+0000","last_clean":"2024-09-21T07:28:04.559111+0000","last_became_active":"2024-09-21T07:28:03.522439+0000","last_became_peered":"2024-09-21T07:28:03.522439+0000","last_unstale":"2024-09-21T07:28:04.559111+0000","last_undegraded":"2024-09-21T07:28:04.559111+0000","last_fullsized":"2024-09-21T07:28:04.559111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469797+0000","last_change":"2024-09-21T07:28:02.469797+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469797+0000","last_undegraded":"2024-09-21T07:28:02.469797+0000","last_fullsized":"2024-09-21T07:28:02.469797+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474365+0000","last_change":"2024-09-21T07:28:02.474365+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474365+0000","last_undegraded":"2024-09-21T07:28:02.474365+0000","last_fullsized":"2024-09-21T07:28:02.474365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.479245+0000","last_change":"2024-09-21T07:28:02.479245+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.479245+0000","last_undegraded":"2024-09-21T07:28:02.479245+0000","last_fullsized":"2024-09-21T07:28:02.479245+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477183+0000","last_change":"2024-09-21T07:28:02.477183+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477183+0000","last_undegraded":"2024-09-21T07:28:02.477183+0000","last_fullsized":"2024-09-21T07:28:02.477183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.486046+0000","last_change":"2024-09-21T07:28:02.480401+0000","last_active":"2024-09-21T07:28:02.486046+0000","last_peered":"2024-09-21T07:28:02.486046+0000","last_clean":"2024-09-21T07:28:02.486046+0000","last_became_active":"2024-09-21T07:28:02.480063+0000","last_became_peered":"2024-09-21T07:28:02.480063+0000","last_unstale":"2024-09-21T07:28:02.486046+0000","last_undegraded":"2024-09-21T07:28:02.486046+0000","last_fullsized":"2024-09-21T07:28:02.486046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.683081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.478264+0000","last_change":"2024-09-21T07:28:02.478264+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.478264+0000","last_undegraded":"2024-09-21T07:28:02.478264+0000","last_fullsized":"2024-09-21T07:28:02.478264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.490708+0000","last_change":"2024-09-21T07:28:02.489572+0000","last_active":"2024-09-21T07:28:02.490708+0000","last_peered":"2024-09-21T07:28:02.490708+0000","last_clean":"2024-09-21T07:28:02.490708+0000","last_became_active":"2024-09-21T07:28:02.489240+0000","last_became_peered":"2024-09-21T07:28:02.489240+0000","last_unstale":"2024-09-21T07:28:02.490708+0000","last_undegraded":"2024-09-21T07:28:02.490708+0000","last_fullsized":"2024-09-21T07:28:02.490708+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:06.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559385+0000","last_change":"2024-09-21T07:28:03.526754+0000","last_active":"2024-09-21T07:28:04.559385+0000","last_peered":"2024-09-21T07:28:04.559385+0000","last_clean":"2024-09-21T07:28:04.559385+0000","last_became_active":"2024-09-21T07:28:03.526453+0000","last_became_peered":"2024-09-21T07:28:03.526453+0000","last_unstale":"2024-09-21T07:28:04.559385+0000","last_undegraded":"2024-09-21T07:28:04.559385+0000","last_fullsized":"2024-09-21T07:28:04.559385+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559310+0000","last_change":"2024-09-21T07:28:02.492575+0000","last_active":"2024-09-21T07:28:04.559310+0000","last_peered":"2024-09-21T07:28:04.559310+0000","last_clean":"2024-09-21T07:28:04.559310+0000","last_became_active":"2024-09-21T07:28:02.491529+0000","last_became_peered":"2024-09-21T07:28:02.491529+0000","last_unstale":"2024-09-21T07:28:04.559310+0000","last_undegraded":"2024-09-21T07:28:04.559310+0000","last_fullsized":"2024-09-21T07:28:04.559310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476312+0000","last_change":"2024-09-21T07:28:02.476312+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476312+0000","last_undegraded":"2024-09-21T07:28:02.476312+0000","last_fullsized":"2024-09-21T07:28:02.476312+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487115+0000","last_change":"2024-09-21T07:28:02.483081+0000","last_active":"2024-09-21T07:28:02.487115+0000","last_peered":"2024-09-21T07:28:02.487115+0000","last_clean":"2024-09-21T07:28:02.487115+0000","last_became_active":"2024-09-21T07:28:02.482548+0000","last_became_peered":"2024-09-21T07:28:02.482548+0000","last_unstale":"2024-09-21T07:28:02.487115+0000","last_undegraded":"2024-09-21T07:28:02.487115+0000","last_fullsized":"2024-09-21T07:28:02.487115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.915932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469139+0000","last_change":"2024-09-21T07:28:02.469139+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469139+0000","last_undegraded":"2024-09-21T07:28:02.469139+0000","last_fullsized":"2024-09-21T07:28:02.469139+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487087+0000","last_change":"2024-09-21T07:28:02.485679+0000","last_active":"2024-09-21T07:28:02.487087+0000","last_peered":"2024-09-21T07:28:02.487087+0000","last_clean":"2024-09-21T07:28:02.487087+0000","last_became_active":"2024-09-21T07:28:02.484985+0000","last_became_peered":"2024-09-21T07:28:02.484985+0000","last_unstale":"2024-09-21T07:28:02.487087+0000","last_undegraded":"2024-09-21T07:28:02.487087+0000","last_fullsized":"2024-09-21T07:28:02.487087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:10.970100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.469579+0000","last_change":"2024-09-21T07:28:02.469579+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.469579+0000","last_undegraded":"2024-09-21T07:28:02.469579+0000","last_fullsized":"2024-09-21T07:28:02.469579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488859+0000","last_change":"2024-09-21T07:28:02.484131+0000","last_active":"2024-09-21T07:28:02.488859+0000","last_peered":"2024-09-21T07:28:02.488859+0000","last_clean":"2024-09-21T07:28:02.488859+0000","last_became_active":"2024-09-21T07:28:02.483822+0000","last_became_peered":"2024-09-21T07:28:02.483822+0000","last_unstale":"2024-09-21T07:28:02.488859+0000","last_undegraded":"2024-09-21T07:28:02.488859+0000","last_fullsized":"2024-09-21T07:28:02.488859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:19.845520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476090+0000","last_change":"2024-09-21T07:28:02.476090+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476090+0000","last_undegraded":"2024-09-21T07:28:02.476090+0000","last_fullsized":"2024-09-21T07:28:02.476090+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485851+0000","last_change":"2024-09-21T07:28:02.481366+0000","last_active":"2024-09-21T07:28:04.485851+0000","last_peered":"2024-09-21T07:28:04.485851+0000","last_clean":"2024-09-21T07:28:04.485851+0000","last_became_active":"2024-09-21T07:28:02.480991+0000","last_became_peered":"2024-09-21T07:28:02.480991+0000","last_unstale":"2024-09-21T07:28:04.485851+0000","last_undegraded":"2024-09-21T07:28:04.485851+0000","last_fullsized":"2024-09-21T07:28:04.485851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466325+0000","last_change":"2024-09-21T07:28:02.466325+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466325+0000","last_undegraded":"2024-09-21T07:28:02.466325+0000","last_fullsized":"2024-09-21T07:28:02.466325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557899+0000","last_change":"2024-09-21T07:28:02.494170+0000","last_active":"2024-09-21T07:28:04.557899+0000","last_peered":"2024-09-21T07:28:04.557899+0000","last_clean":"2024-09-21T07:28:04.557899+0000","last_became_active":"2024-09-21T07:28:02.493439+0000","last_became_peered":"2024-09-21T07:28:02.493439+0000","last_unstale":"2024-09-21T07:28:04.557899+0000","last_undegraded":"2024-09-21T07:28:04.557899+0000","last_fullsized":"2024-09-21T07:28:04.557899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:27.800486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472878+0000","last_change":"2024-09-21T07:28:02.472878+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472878+0000","last_undegraded":"2024-09-21T07:28:02.472878+0000","last_fullsized":"2024-09-21T07:28:02.472878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.485718+0000","last_change":"2024-09-21T07:28:02.483843+0000","last_active":"2024-09-21T07:28:02.485718+0000","last_peered":"2024-09-21T07:28:02.485718+0000","last_clean":"2024-09-21T07:28:02.485718+0000","last_became_active":"2024-09-21T07:28:02.483455+0000","last_became_peered":"2024-09-21T07:28:02.483455+0000","last_unstale":"2024-09-21T07:28:02.485718+0000","last_undegraded":"2024-09-21T07:28:02.485718+0000","last_fullsized":"2024-09-21T07:28:02.485718+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:26.638902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559290+0000","last_change":"2024-09-21T07:28:03.528617+0000","last_active":"2024-09-21T07:28:04.559290+0000","last_peered":"2024-09-21T07:28:04.559290+0000","last_clean":"2024-09-21T07:28:04.559290+0000","last_became_active":"2024-09-21T07:28:03.528268+0000","last_became_peered":"2024-09-21T07:28:03.528268+0000","last_unstale":"2024-09-21T07:28:04.559290+0000","last_undegraded":"2024-09-21T07:28:04.559290+0000","last_fullsized":"2024-09-21T07:28:04.559290+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486479+0000","last_change":"2024-09-21T07:28:02.490608+0000","last_active":"2024-09-21T07:28:04.486479+0000","last_peered":"2024-09-21T07:28:04.486479+0000","last_clean":"2024-09-21T07:28:04.486479+0000","last_became_active":"2024-09-21T07:28:02.490278+0000","last_became_peered":"2024-09-21T07:28:02.490278+0000","last_unstale":"2024-09-21T07:28:04.486479+0000","last_undegraded":"2024-09-21T07:28:04.486479+0000","last_fullsized":"2024-09-21T07:28:04.486479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486360+0000","last_change":"2024-09-21T07:28:03.499223+0000","last_active":"2024-09-21T07:28:04.486360+0000","last_peered":"2024-09-21T07:28:04.486360+0000","last_clean":"2024-09-21T07:28:04.486360+0000","last_became_active":"2024-09-21T07:28:03.498880+0000","last_became_peered":"2024-09-21T07:28:03.498880+0000","last_unstale":"2024-09-21T07:28:04.486360+0000","last_undegraded":"2024-09-21T07:28:04.486360+0000","last_fullsized":"2024-09-21T07:28:04.486360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495580+0000","last_change":"2024-09-21T07:28:02.491104+0000","last_active":"2024-09-21T07:28:02.495580+0000","last_peered":"2024-09-21T07:28:02.495580+0000","last_clean":"2024-09-21T07:28:02.495580+0000","last_became_active":"2024-09-21T07:28:02.490329+0000","last_became_peered":"2024-09-21T07:28:02.490329+0000","last_unstale":"2024-09-21T07:28:02.495580+0000","last_undegraded":"2024-09-21T07:28:02.495580+0000","last_fullsized":"2024-09-21T07:28:02.495580+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:48.697276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.466805+0000","last_change":"2024-09-21T07:28:02.466805+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.466805+0000","last_undegraded":"2024-09-21T07:28:02.466805+0000","last_fullsized":"2024-09-21T07:28:02.466805+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489356+0000","last_change":"2024-09-21T07:28:02.481710+0000","last_active":"2024-09-21T07:28:02.489356+0000","last_peered":"2024-09-21T07:28:02.489356+0000","last_clean":"2024-09-21T07:28:02.489356+0000","last_became_active":"2024-09-21T07:28:02.481285+0000","last_became_peered":"2024-09-21T07:28:02.481285+0000","last_unstale":"2024-09-21T07:28:02.489356+0000","last_undegraded":"2024-09-21T07:28:02.489356+0000","last_fullsized":"2024-09-21T07:28:02.489356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:06.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468623+0000","last_change":"2024-09-21T07:28:02.468623+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468623+0000","last_undegraded":"2024-09-21T07:28:02.468623+0000","last_fullsized":"2024-09-21T07:28:02.468623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558949+0000","last_change":"2024-09-21T07:28:02.495439+0000","last_active":"2024-09-21T07:28:04.558949+0000","last_peered":"2024-09-21T07:28:04.558949+0000","last_clean":"2024-09-21T07:28:04.558949+0000","last_became_active":"2024-09-21T07:28:02.494223+0000","last_became_peered":"2024-09-21T07:28:02.494223+0000","last_unstale":"2024-09-21T07:28:04.558949+0000","last_undegraded":"2024-09-21T07:28:04.558949+0000","last_fullsized":"2024-09-21T07:28:04.558949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:50.727753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.471322+0000","last_change":"2024-09-21T07:28:02.471322+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.471322+0000","last_undegraded":"2024-09-21T07:28:02.471322+0000","last_fullsized":"2024-09-21T07:28:02.471322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489612+0000","last_change":"2024-09-21T07:28:02.486025+0000","last_active":"2024-09-21T07:28:02.489612+0000","last_peered":"2024-09-21T07:28:02.489612+0000","last_clean":"2024-09-21T07:28:02.489612+0000","last_became_active":"2024-09-21T07:28:02.485713+0000","last_became_peered":"2024-09-21T07:28:02.485713+0000","last_unstale":"2024-09-21T07:28:02.489612+0000","last_undegraded":"2024-09-21T07:28:02.489612+0000","last_fullsized":"2024-09-21T07:28:02.489612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:02.610962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465783+0000","last_change":"2024-09-21T07:28:02.465783+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465783+0000","last_undegraded":"2024-09-21T07:28:02.465783+0000","last_fullsized":"2024-09-21T07:28:02.465783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.481892+0000","last_change":"2024-09-21T07:28:02.475561+0000","last_active":"2024-09-21T07:28:02.481892+0000","last_peered":"2024-09-21T07:28:02.481892+0000","last_clean":"2024-09-21T07:28:02.481892+0000","last_became_active":"2024-09-21T07:28:02.475232+0000","last_became_peered":"2024-09-21T07:28:02.475232+0000","last_unstale":"2024-09-21T07:28:02.481892+0000","last_undegraded":"2024-09-21T07:28:02.481892+0000","last_fullsized":"2024-09-21T07:28:02.481892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:53.568044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465238+0000","last_change":"2024-09-21T07:28:02.465238+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465238+0000","last_undegraded":"2024-09-21T07:28:02.465238+0000","last_fullsized":"2024-09-21T07:28:02.465238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.492130+0000","last_change":"2024-09-21T07:28:02.489670+0000","last_active":"2024-09-21T07:28:02.492130+0000","last_peered":"2024-09-21T07:28:02.492130+0000","last_clean":"2024-09-21T07:28:02.492130+0000","last_became_active":"2024-09-21T07:28:02.485518+0000","last_became_peered":"2024-09-21T07:28:02.485518+0000","last_unstale":"2024-09-21T07:28:02.492130+0000","last_undegraded":"2024-09-21T07:28:02.492130+0000","last_fullsized":"2024-09-21T07:28:02.492130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.269217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.476665+0000","last_change":"2024-09-21T07:28:02.476665+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.476665+0000","last_undegraded":"2024-09-21T07:28:02.476665+0000","last_fullsized":"2024-09-21T07:28:02.476665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.496103+0000","last_change":"2024-09-21T07:28:02.490405+0000","last_active":"2024-09-21T07:28:02.496103+0000","last_peered":"2024-09-21T07:28:02.496103+0000","last_clean":"2024-09-21T07:28:02.496103+0000","last_became_active":"2024-09-21T07:28:02.488124+0000","last_became_peered":"2024-09-21T07:28:02.488124+0000","last_unstale":"2024-09-21T07:28:02.496103+0000","last_undegraded":"2024-09-21T07:28:02.496103+0000","last_fullsized":"2024-09-21T07:28:02.496103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:54.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468806+0000","last_change":"2024-09-21T07:28:02.468806+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468806+0000","last_undegraded":"2024-09-21T07:28:02.468806+0000","last_fullsized":"2024-09-21T07:28:02.468806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559227+0000","last_change":"2024-09-21T07:28:02.493001+0000","last_active":"2024-09-21T07:28:04.559227+0000","last_peered":"2024-09-21T07:28:04.559227+0000","last_clean":"2024-09-21T07:28:04.559227+0000","last_became_active":"2024-09-21T07:28:02.492584+0000","last_became_peered":"2024-09-21T07:28:02.492584+0000","last_unstale":"2024-09-21T07:28:04.559227+0000","last_undegraded":"2024-09-21T07:28:04.559227+0000","last_fullsized":"2024-09-21T07:28:04.559227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.477436+0000","last_change":"2024-09-21T07:28:02.477436+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.477436+0000","last_undegraded":"2024-09-21T07:28:02.477436+0000","last_fullsized":"2024-09-21T07:28:02.477436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495866+0000","last_change":"2024-09-21T07:28:02.492630+0000","last_active":"2024-09-21T07:28:02.495866+0000","last_peered":"2024-09-21T07:28:02.495866+0000","last_clean":"2024-09-21T07:28:02.495866+0000","last_became_active":"2024-09-21T07:28:02.492255+0000","last_became_peered":"2024-09-21T07:28:02.492255+0000","last_unstale":"2024-09-21T07:28:02.495866+0000","last_undegraded":"2024-09-21T07:28:02.495866+0000","last_fullsized":"2024-09-21T07:28:02.495866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:02.904038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475001+0000","last_change":"2024-09-21T07:28:02.475001+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475001+0000","last_undegraded":"2024-09-21T07:28:02.475001+0000","last_fullsized":"2024-09-21T07:28:02.475001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494035+0000","last_change":"2024-09-21T07:28:02.492296+0000","last_active":"2024-09-21T07:28:02.494035+0000","last_peered":"2024-09-21T07:28:02.494035+0000","last_clean":"2024-09-21T07:28:02.494035+0000","last_became_active":"2024-09-21T07:28:02.491988+0000","last_became_peered":"2024-09-21T07:28:02.491988+0000","last_unstale":"2024-09-21T07:28:02.494035+0000","last_undegraded":"2024-09-21T07:28:02.494035+0000","last_fullsized":"2024-09-21T07:28:02.494035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:54.718727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473705+0000","last_change":"2024-09-21T07:28:02.473705+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473705+0000","last_undegraded":"2024-09-21T07:28:02.473705+0000","last_fullsized":"2024-09-21T07:28:02.473705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484619+0000","last_change":"2024-09-21T07:28:02.481472+0000","last_active":"2024-09-21T07:28:02.484619+0000","last_peered":"2024-09-21T07:28:02.484619+0000","last_clean":"2024-09-21T07:28:02.484619+0000","last_became_active":"2024-09-21T07:28:02.480516+0000","last_became_peered":"2024-09-21T07:28:02.480516+0000","last_unstale":"2024-09-21T07:28:02.484619+0000","last_undegraded":"2024-09-21T07:28:02.484619+0000","last_fullsized":"2024-09-21T07:28:02.484619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:48.998413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.474529+0000","last_change":"2024-09-21T07:28:02.474529+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.474529+0000","last_undegraded":"2024-09-21T07:28:02.474529+0000","last_fullsized":"2024-09-21T07:28:02.474529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491150+0000","last_change":"2024-09-21T07:28:02.488106+0000","last_active":"2024-09-21T07:28:02.491150+0000","last_peered":"2024-09-21T07:28:02.491150+0000","last_clean":"2024-09-21T07:28:02.491150+0000","last_became_active":"2024-09-21T07:28:02.487749+0000","last_became_peered":"2024-09-21T07:28:02.487749+0000","last_unstale":"2024-09-21T07:28:02.491150+0000","last_undegraded":"2024-09-21T07:28:02.491150+0000","last_fullsized":"2024-09-21T07:28:02.491150+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:14.892991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.475585+0000","last_change":"2024-09-21T07:28:02.475585+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.475585+0000","last_undegraded":"2024-09-21T07:28:02.475585+0000","last_fullsized":"2024-09-21T07:28:02.475585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.484502+0000","last_change":"2024-09-21T07:28:02.480862+0000","last_active":"2024-09-21T07:28:02.484502+0000","last_peered":"2024-09-21T07:28:02.484502+0000","last_clean":"2024-09-21T07:28:02.484502+0000","last_became_active":"2024-09-21T07:28:02.479884+0000","last_became_peered":"2024-09-21T07:28:02.479884+0000","last_unstale":"2024-09-21T07:28:02.484502+0000","last_undegraded":"2024-09-21T07:28:02.484502+0000","last_fullsized":"2024-09-21T07:28:02.484502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:58.148746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468917+0000","last_change":"2024-09-21T07:28:02.468917+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468917+0000","last_undegraded":"2024-09-21T07:28:02.468917+0000","last_fullsized":"2024-09-21T07:28:02.468917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.493358+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.493044+0000","last_became_peered":"2024-09-21T07:28:02.493044+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:54.105626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473545+0000","last_change":"2024-09-21T07:28:02.473545+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473545+0000","last_undegraded":"2024-09-21T07:28:02.473545+0000","last_fullsized":"2024-09-21T07:28:02.473545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.491951+0000","last_change":"2024-09-21T07:28:02.490011+0000","last_active":"2024-09-21T07:28:02.491951+0000","last_peered":"2024-09-21T07:28:02.491951+0000","last_clean":"2024-09-21T07:28:02.491951+0000","last_became_active":"2024-09-21T07:28:02.489295+0000","last_became_peered":"2024-09-21T07:28:02.489295+0000","last_unstale":"2024-09-21T07:28:02.491951+0000","last_undegraded":"2024-09-21T07:28:02.491951+0000","last_fullsized":"2024-09-21T07:28:02.491951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:09.470145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.472814+0000","last_change":"2024-09-21T07:28:02.472814+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.472814+0000","last_undegraded":"2024-09-21T07:28:02.472814+0000","last_fullsized":"2024-09-21T07:28:02.472814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.495608+0000","last_change":"2024-09-21T07:28:02.491433+0000","last_active":"2024-09-21T07:28:02.495608+0000","last_peered":"2024-09-21T07:28:02.495608+0000","last_clean":"2024-09-21T07:28:02.495608+0000","last_became_active":"2024-09-21T07:28:02.490769+0000","last_became_peered":"2024-09-21T07:28:02.490769+0000","last_unstale":"2024-09-21T07:28:02.495608+0000","last_undegraded":"2024-09-21T07:28:02.495608+0000","last_fullsized":"2024-09-21T07:28:02.495608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473836+0000","last_change":"2024-09-21T07:28:02.473836+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473836+0000","last_undegraded":"2024-09-21T07:28:02.473836+0000","last_fullsized":"2024-09-21T07:28:02.473836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.487148+0000","last_change":"2024-09-21T07:28:02.484294+0000","last_active":"2024-09-21T07:28:02.487148+0000","last_peered":"2024-09-21T07:28:02.487148+0000","last_clean":"2024-09-21T07:28:02.487148+0000","last_became_active":"2024-09-21T07:28:02.483654+0000","last_became_peered":"2024-09-21T07:28:02.483654+0000","last_unstale":"2024-09-21T07:28:02.487148+0000","last_undegraded":"2024-09-21T07:28:02.487148+0000","last_fullsized":"2024-09-21T07:28:02.487148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:49.122271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.465586+0000","last_change":"2024-09-21T07:28:02.465586+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.465586+0000","last_undegraded":"2024-09-21T07:28:02.465586+0000","last_fullsized":"2024-09-21T07:28:02.465586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.493787+0000","last_change":"2024-09-21T07:28:02.488252+0000","last_active":"2024-09-21T07:28:02.493787+0000","last_peered":"2024-09-21T07:28:02.493787+0000","last_clean":"2024-09-21T07:28:02.493787+0000","last_became_active":"2024-09-21T07:28:02.486549+0000","last_became_peered":"2024-09-21T07:28:02.486549+0000","last_unstale":"2024-09-21T07:28:02.493787+0000","last_undegraded":"2024-09-21T07:28:02.493787+0000","last_fullsized":"2024-09-21T07:28:02.493787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:39.970875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485858+0000","last_change":"2024-09-21T07:28:03.505904+0000","last_active":"2024-09-21T07:28:04.485858+0000","last_peered":"2024-09-21T07:28:04.485858+0000","last_clean":"2024-09-21T07:28:04.485858+0000","last_became_active":"2024-09-21T07:28:03.505598+0000","last_became_peered":"2024-09-21T07:28:03.505598+0000","last_unstale":"2024-09-21T07:28:04.485858+0000","last_undegraded":"2024-09-21T07:28:04.485858+0000","last_fullsized":"2024-09-21T07:28:04.485858+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.467698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.494856+0000","last_change":"2024-09-21T07:28:02.492642+0000","last_active":"2024-09-21T07:28:02.494856+0000","last_peered":"2024-09-21T07:28:02.494856+0000","last_clean":"2024-09-21T07:28:02.494856+0000","last_became_active":"2024-09-21T07:28:02.491303+0000","last_became_peered":"2024-09-21T07:28:02.491303+0000","last_unstale":"2024-09-21T07:28:02.494856+0000","last_undegraded":"2024-09-21T07:28:02.494856+0000","last_fullsized":"2024-09-21T07:28:02.494856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.468536+0000","last_change":"2024-09-21T07:28:02.468536+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.468536+0000","last_undegraded":"2024-09-21T07:28:02.468536+0000","last_fullsized":"2024-09-21T07:28:02.468536+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.489132+0000","last_change":"2024-09-21T07:28:02.485310+0000","last_active":"2024-09-21T07:28:02.489132+0000","last_peered":"2024-09-21T07:28:02.489132+0000","last_clean":"2024-09-21T07:28:02.489132+0000","last_became_active":"2024-09-21T07:28:02.484055+0000","last_became_peered":"2024-09-21T07:28:02.484055+0000","last_unstale":"2024-09-21T07:28:02.489132+0000","last_undegraded":"2024-09-21T07:28:02.489132+0000","last_fullsized":"2024-09-21T07:28:02.489132+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:56.841102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-09-21T07:28:02.473074+0000","last_change":"2024-09-21T07:28:02.473074+0000","last_active":"2024-09-21T07:28:02.456935+0000","last_peered":"2024-09-21T07:28:02.456935+0000","last_clean":"2024-09-21T07:28:02.456935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:02.473074+0000","last_undegraded":"2024-09-21T07:28:02.473074+0000","last_fullsized":"2024-09-21T07:28:02.473074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558020+0000","last_change":"2024-09-21T07:28:02.494597+0000","last_active":"2024-09-21T07:28:04.558020+0000","last_peered":"2024-09-21T07:28:04.558020+0000","last_clean":"2024-09-21T07:28:04.558020+0000","last_became_active":"2024-09-21T07:28:02.493870+0000","last_became_peered":"2024-09-21T07:28:02.493870+0000","last_unstale":"2024-09-21T07:28:04.558020+0000","last_undegraded":"2024-09-21T07:28:04.558020+0000","last_fullsized":"2024-09-21T07:28:04.558020+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.788786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559427+0000","last_change":"2024-09-21T07:28:03.522880+0000","last_active":"2024-09-21T07:28:04.559427+0000","last_peered":"2024-09-21T07:28:04.559427+0000","last_clean":"2024-09-21T07:28:04.559427+0000","last_became_active":"2024-09-21T07:28:03.522515+0000","last_became_peered":"2024-09-21T07:28:03.522515+0000","last_unstale":"2024-09-21T07:28:04.559427+0000","last_undegraded":"2024-09-21T07:28:04.559427+0000","last_fullsized":"2024-09-21T07:28:04.559427+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:11.357619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-21T07:28:02.488270+0000","last_change":"2024-09-21T07:28:02.480599+0000","last_active":"2024-09-21T07:28:02.488270+0000","last_peered":"2024-09-21T07:28:02.488270+0000","last_clean":"2024-09-21T07:28:02.488270+0000","last_became_active":"2024-09-21T07:28:02.480200+0000","last_became_peered":"2024-09-21T07:28:02.480200+0000","last_unstale":"2024-09-21T07:28:02.488270+0000","last_undegraded":"2024-09-21T07:28:02.488270+0000","last_fullsized":"2024-09-21T07:28:02.488270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:53.144565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40656,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331184,"statfs":{"total":96636764160,"available":96595132416,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1187840,"data_stored":550497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":543830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":1134198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":1154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:09.614 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:09.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:12.394 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 -- 172.21.15.64:0/4189804291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 msgr2=0x7f132406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 --2- 172.21.15.64:0/4189804291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132406d020 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f130c009840 tx=0x7f130c01c820 comp rx=0 tx=0).stop 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 -- 172.21.15.64:0/4189804291 shutdown_connections 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 --2- 172.21.15.64:0/4189804291 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 0x7f1324073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 --2- 172.21.15.64:0/4189804291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132406d020 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 -- 172.21.15.64:0/4189804291 >> 172.21.15.64:0/4189804291 conn(0x7f13240d0de0 msgr2=0x7f13240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 -- 172.21.15.64:0/4189804291 shutdown_connections 2024-09-21T07:28:12.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.563+0000 7f132b400640 1 -- 172.21.15.64:0/4189804291 wait complete. 2024-09-21T07:28:12.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 Processor -- start 2024-09-21T07:28:12.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 -- start start 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 0x7f1324156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1324073b40 0x7f1324159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13240c5da0 con 0x7f13240cf8b0 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13240c5c20 con 0x7f1324073b40 2024-09-21T07:28:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f132b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f132416a260 con 0x7f132406d560 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f1329400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f1329400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33082/0 (socket says 172.21.15.64:33082) 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f1329400640 1 -- 172.21.15.64:0/2508097454 learned_addr learned my addr 172.21.15.64:0/2508097454 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f131be00640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1324073b40 0x7f1324159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.567+0000 7f1328a00640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 0x7f1324156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 -- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 msgr2=0x7f1324156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 0x7f1324156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 -- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1324073b40 msgr2=0x7f1324159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1324073b40 0x7f1324159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 -- 172.21.15.64:0/2508097454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1324157790 con 0x7f13240cf8b0 2024-09-21T07:28:12.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1329400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c760 tx=0x7f131c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c003db0 con 0x7f13240cf8b0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f131c00ce10 con 0x7f13240cf8b0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0052d0 con 0x7f13240cf8b0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1324157a70 con 0x7f13240cf8b0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1324158030 con 0x7f13240cf8b0 2024-09-21T07:28:12.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1324073600 con 0x7f13240cf8b0 2024-09-21T07:28:12.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f131c005470 con 0x7f13240cf8b0 2024-09-21T07:28:12.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.571+0000 7f1321600640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 0x7f1300075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.575+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f131c094280 con 0x7f13240cf8b0 2024-09-21T07:28:12.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.575+0000 7f1328a00640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 0x7f1300075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.575+0000 7f1328a00640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 0x7f1300075710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f130c0af000 tx=0x7f130c01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:12.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.579+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f132406d970 con 0x7f13240cf8b0 2024-09-21T07:28:12.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.751+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13240c6da0 con 0x7f1300073200 2024-09-21T07:28:12.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.755+0000 7f1321600640 1 -- 172.21.15.64:0/2508097454 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252053 (secure 0 0 0) 0x7f13240c6da0 con 0x7f1300073200 2024-09-21T07:28:12.760 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 msgr2=0x7f1300075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 0x7f1300075710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f130c0af000 tx=0x7f130c01b060 comp rx=0 tx=0).stop 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 msgr2=0x7f132414ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c760 tx=0x7f131c00cc20 comp rx=0 tx=0).stop 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 shutdown_connections 2024-09-21T07:28:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1300073200 0x7f1300075710 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13240cf8b0 0x7f132414ea70 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1324073b40 0x7f1324159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 --2- 172.21.15.64:0/2508097454 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f132406d560 0x7f1324156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 >> 172.21.15.64:0/2508097454 conn(0x7f13240d0de0 msgr2=0x7f13240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 shutdown_connections 2024-09-21T07:28:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.759+0000 7f132b400640 1 -- 172.21.15.64:0/2508097454 wait complete. 2024-09-21T07:28:12.783 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-09-21T07:28:11.508670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310132,"kb_used_data":10696,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664588,"statfs":{"total":773094113280,"available":772776538112,"internally_reserved":0,"allocated":10952704,"data_stored":5700404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":306433587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.024067"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486307+0000","last_change":"2024-09-21T07:28:03.498429+0000","last_active":"2024-09-21T07:28:04.486307+0000","last_peered":"2024-09-21T07:28:04.486307+0000","last_clean":"2024-09-21T07:28:04.486307+0000","last_became_active":"2024-09-21T07:28:03.498139+0000","last_became_peered":"2024-09-21T07:28:03.498139+0000","last_unstale":"2024-09-21T07:28:04.486307+0000","last_undegraded":"2024-09-21T07:28:04.486307+0000","last_fullsized":"2024-09-21T07:28:04.486307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:18.070246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490345+0000","last_change":"2024-09-21T07:28:03.516977+0000","last_active":"2024-09-21T07:28:04.490345+0000","last_peered":"2024-09-21T07:28:04.490345+0000","last_clean":"2024-09-21T07:28:04.490345+0000","last_became_active":"2024-09-21T07:28:03.514454+0000","last_became_peered":"2024-09-21T07:28:03.514454+0000","last_unstale":"2024-09-21T07:28:04.490345+0000","last_undegraded":"2024-09-21T07:28:04.490345+0000","last_fullsized":"2024-09-21T07:28:04.490345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:40.973527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486317+0000","last_change":"2024-09-21T07:28:03.500537+0000","last_active":"2024-09-21T07:28:04.486317+0000","last_peered":"2024-09-21T07:28:04.486317+0000","last_clean":"2024-09-21T07:28:04.486317+0000","last_became_active":"2024-09-21T07:28:03.500232+0000","last_became_peered":"2024-09-21T07:28:03.500232+0000","last_unstale":"2024-09-21T07:28:04.486317+0000","last_undegraded":"2024-09-21T07:28:04.486317+0000","last_fullsized":"2024-09-21T07:28:04.486317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:40.849017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559546+0000","last_change":"2024-09-21T07:28:03.518556+0000","last_active":"2024-09-21T07:28:04.559546+0000","last_peered":"2024-09-21T07:28:04.559546+0000","last_clean":"2024-09-21T07:28:04.559546+0000","last_became_active":"2024-09-21T07:28:03.511372+0000","last_became_peered":"2024-09-21T07:28:03.511372+0000","last_unstale":"2024-09-21T07:28:04.559546+0000","last_undegraded":"2024-09-21T07:28:04.559546+0000","last_fullsized":"2024-09-21T07:28:04.559546+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:43.375299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558744+0000","last_change":"2024-09-21T07:28:03.499862+0000","last_active":"2024-09-21T07:28:04.558744+0000","last_peered":"2024-09-21T07:28:04.558744+0000","last_clean":"2024-09-21T07:28:04.558744+0000","last_became_active":"2024-09-21T07:28:03.499520+0000","last_became_peered":"2024-09-21T07:28:03.499520+0000","last_unstale":"2024-09-21T07:28:04.558744+0000","last_undegraded":"2024-09-21T07:28:04.558744+0000","last_fullsized":"2024-09-21T07:28:04.558744+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:12.414622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558162+0000","last_change":"2024-09-21T07:28:03.522018+0000","last_active":"2024-09-21T07:28:04.558162+0000","last_peered":"2024-09-21T07:28:04.558162+0000","last_clean":"2024-09-21T07:28:04.558162+0000","last_became_active":"2024-09-21T07:28:03.521651+0000","last_became_peered":"2024-09-21T07:28:03.521651+0000","last_unstale":"2024-09-21T07:28:04.558162+0000","last_undegraded":"2024-09-21T07:28:04.558162+0000","last_fullsized":"2024-09-21T07:28:04.558162+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:35.372629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559345+0000","last_change":"2024-09-21T07:28:03.514701+0000","last_active":"2024-09-21T07:28:04.559345+0000","last_peered":"2024-09-21T07:28:04.559345+0000","last_clean":"2024-09-21T07:28:04.559345+0000","last_became_active":"2024-09-21T07:28:03.514394+0000","last_became_peered":"2024-09-21T07:28:03.514394+0000","last_unstale":"2024-09-21T07:28:04.559345+0000","last_undegraded":"2024-09-21T07:28:04.559345+0000","last_fullsized":"2024-09-21T07:28:04.559345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:13.467674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558099+0000","last_change":"2024-09-21T07:28:03.515304+0000","last_active":"2024-09-21T07:28:04.558099+0000","last_peered":"2024-09-21T07:28:04.558099+0000","last_clean":"2024-09-21T07:28:04.558099+0000","last_became_active":"2024-09-21T07:28:03.514223+0000","last_became_peered":"2024-09-21T07:28:03.514223+0000","last_unstale":"2024-09-21T07:28:04.558099+0000","last_undegraded":"2024-09-21T07:28:04.558099+0000","last_fullsized":"2024-09-21T07:28:04.558099+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:57.755086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558485+0000","last_change":"2024-09-21T07:28:03.524001+0000","last_active":"2024-09-21T07:28:04.558485+0000","last_peered":"2024-09-21T07:28:04.558485+0000","last_clean":"2024-09-21T07:28:04.558485+0000","last_became_active":"2024-09-21T07:28:03.521432+0000","last_became_peered":"2024-09-21T07:28:03.521432+0000","last_unstale":"2024-09-21T07:28:04.558485+0000","last_undegraded":"2024-09-21T07:28:04.558485+0000","last_fullsized":"2024-09-21T07:28:04.558485+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:18.819727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.560428+0000","last_change":"2024-09-21T07:28:03.528290+0000","last_active":"2024-09-21T07:28:04.560428+0000","last_peered":"2024-09-21T07:28:04.560428+0000","last_clean":"2024-09-21T07:28:04.560428+0000","last_became_active":"2024-09-21T07:28:03.527300+0000","last_became_peered":"2024-09-21T07:28:03.527300+0000","last_unstale":"2024-09-21T07:28:04.560428+0000","last_undegraded":"2024-09-21T07:28:04.560428+0000","last_fullsized":"2024-09-21T07:28:04.560428+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:39.270309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558865+0000","last_change":"2024-09-21T07:28:03.525256+0000","last_active":"2024-09-21T07:28:04.558865+0000","last_peered":"2024-09-21T07:28:04.558865+0000","last_clean":"2024-09-21T07:28:04.558865+0000","last_became_active":"2024-09-21T07:28:03.520812+0000","last_became_peered":"2024-09-21T07:28:03.520812+0000","last_unstale":"2024-09-21T07:28:04.558865+0000","last_undegraded":"2024-09-21T07:28:04.558865+0000","last_fullsized":"2024-09-21T07:28:04.558865+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.863653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.560078+0000","last_change":"2024-09-21T07:28:03.516306+0000","last_active":"2024-09-21T07:28:04.560078+0000","last_peered":"2024-09-21T07:28:04.560078+0000","last_clean":"2024-09-21T07:28:04.560078+0000","last_became_active":"2024-09-21T07:28:03.513097+0000","last_became_peered":"2024-09-21T07:28:03.513097+0000","last_unstale":"2024-09-21T07:28:04.560078+0000","last_undegraded":"2024-09-21T07:28:04.560078+0000","last_fullsized":"2024-09-21T07:28:04.560078+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:42.690451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559266+0000","last_change":"2024-09-21T07:28:03.514023+0000","last_active":"2024-09-21T07:28:04.559266+0000","last_peered":"2024-09-21T07:28:04.559266+0000","last_clean":"2024-09-21T07:28:04.559266+0000","last_became_active":"2024-09-21T07:28:03.513736+0000","last_became_peered":"2024-09-21T07:28:03.513736+0000","last_unstale":"2024-09-21T07:28:04.559266+0000","last_undegraded":"2024-09-21T07:28:04.559266+0000","last_fullsized":"2024-09-21T07:28:04.559266+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:31.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558024+0000","last_change":"2024-09-21T07:28:03.517726+0000","last_active":"2024-09-21T07:28:04.558024+0000","last_peered":"2024-09-21T07:28:04.558024+0000","last_clean":"2024-09-21T07:28:04.558024+0000","last_became_active":"2024-09-21T07:28:03.514831+0000","last_became_peered":"2024-09-21T07:28:03.514831+0000","last_unstale":"2024-09-21T07:28:04.558024+0000","last_undegraded":"2024-09-21T07:28:04.558024+0000","last_fullsized":"2024-09-21T07:28:04.558024+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:19.331994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558162+0000","last_change":"2024-09-21T07:28:03.518366+0000","last_active":"2024-09-21T07:28:04.558162+0000","last_peered":"2024-09-21T07:28:04.558162+0000","last_clean":"2024-09-21T07:28:04.558162+0000","last_became_active":"2024-09-21T07:28:03.516575+0000","last_became_peered":"2024-09-21T07:28:03.516575+0000","last_unstale":"2024-09-21T07:28:04.558162+0000","last_undegraded":"2024-09-21T07:28:04.558162+0000","last_fullsized":"2024-09-21T07:28:04.558162+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:18.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557859+0000","last_change":"2024-09-21T07:28:03.506705+0000","last_active":"2024-09-21T07:28:04.557859+0000","last_peered":"2024-09-21T07:28:04.557859+0000","last_clean":"2024-09-21T07:28:04.557859+0000","last_became_active":"2024-09-21T07:28:03.506417+0000","last_became_peered":"2024-09-21T07:28:03.506417+0000","last_unstale":"2024-09-21T07:28:04.557859+0000","last_undegraded":"2024-09-21T07:28:04.557859+0000","last_fullsized":"2024-09-21T07:28:04.557859+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:13.580121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558945+0000","last_change":"2024-09-21T07:28:03.494824+0000","last_active":"2024-09-21T07:28:04.558945+0000","last_peered":"2024-09-21T07:28:04.558945+0000","last_clean":"2024-09-21T07:28:04.558945+0000","last_became_active":"2024-09-21T07:28:03.494238+0000","last_became_peered":"2024-09-21T07:28:03.494238+0000","last_unstale":"2024-09-21T07:28:04.558945+0000","last_undegraded":"2024-09-21T07:28:04.558945+0000","last_fullsized":"2024-09-21T07:28:04.558945+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:27.882633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486498+0000","last_change":"2024-09-21T07:28:03.516916+0000","last_active":"2024-09-21T07:28:04.486498+0000","last_peered":"2024-09-21T07:28:04.486498+0000","last_clean":"2024-09-21T07:28:04.486498+0000","last_became_active":"2024-09-21T07:28:03.516579+0000","last_became_peered":"2024-09-21T07:28:03.516579+0000","last_unstale":"2024-09-21T07:28:04.486498+0000","last_undegraded":"2024-09-21T07:28:04.486498+0000","last_fullsized":"2024-09-21T07:28:04.486498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558970+0000","last_change":"2024-09-21T07:28:03.513458+0000","last_active":"2024-09-21T07:28:04.558970+0000","last_peered":"2024-09-21T07:28:04.558970+0000","last_clean":"2024-09-21T07:28:04.558970+0000","last_became_active":"2024-09-21T07:28:03.512063+0000","last_became_peered":"2024-09-21T07:28:03.512063+0000","last_unstale":"2024-09-21T07:28:04.558970+0000","last_undegraded":"2024-09-21T07:28:04.558970+0000","last_fullsized":"2024-09-21T07:28:04.558970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.264647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.560046+0000","last_change":"2024-09-21T07:28:03.520436+0000","last_active":"2024-09-21T07:28:04.560046+0000","last_peered":"2024-09-21T07:28:04.560046+0000","last_clean":"2024-09-21T07:28:04.560046+0000","last_became_active":"2024-09-21T07:28:03.512902+0000","last_became_peered":"2024-09-21T07:28:03.512902+0000","last_unstale":"2024-09-21T07:28:04.560046+0000","last_undegraded":"2024-09-21T07:28:04.560046+0000","last_fullsized":"2024-09-21T07:28:04.560046+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:01.578782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558252+0000","last_change":"2024-09-21T07:28:03.508318+0000","last_active":"2024-09-21T07:28:04.558252+0000","last_peered":"2024-09-21T07:28:04.558252+0000","last_clean":"2024-09-21T07:28:04.558252+0000","last_became_active":"2024-09-21T07:28:03.506915+0000","last_became_peered":"2024-09-21T07:28:03.506915+0000","last_unstale":"2024-09-21T07:28:04.558252+0000","last_undegraded":"2024-09-21T07:28:04.558252+0000","last_fullsized":"2024-09-21T07:28:04.558252+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:00.259749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558269+0000","last_change":"2024-09-21T07:28:03.517323+0000","last_active":"2024-09-21T07:28:04.558269+0000","last_peered":"2024-09-21T07:28:04.558269+0000","last_clean":"2024-09-21T07:28:04.558269+0000","last_became_active":"2024-09-21T07:28:03.514403+0000","last_became_peered":"2024-09-21T07:28:03.514403+0000","last_unstale":"2024-09-21T07:28:04.558269+0000","last_undegraded":"2024-09-21T07:28:04.558269+0000","last_fullsized":"2024-09-21T07:28:04.558269+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:21.967084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489586+0000","last_change":"2024-09-21T07:28:03.525047+0000","last_active":"2024-09-21T07:28:04.489586+0000","last_peered":"2024-09-21T07:28:04.489586+0000","last_clean":"2024-09-21T07:28:04.489586+0000","last_became_active":"2024-09-21T07:28:03.524727+0000","last_became_peered":"2024-09-21T07:28:03.524727+0000","last_unstale":"2024-09-21T07:28:04.489586+0000","last_undegraded":"2024-09-21T07:28:04.489586+0000","last_fullsized":"2024-09-21T07:28:04.489586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:00.259749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485864+0000","last_change":"2024-09-21T07:28:03.496999+0000","last_active":"2024-09-21T07:28:04.485864+0000","last_peered":"2024-09-21T07:28:04.485864+0000","last_clean":"2024-09-21T07:28:04.485864+0000","last_became_active":"2024-09-21T07:28:03.495267+0000","last_became_peered":"2024-09-21T07:28:03.495267+0000","last_unstale":"2024-09-21T07:28:04.485864+0000","last_undegraded":"2024-09-21T07:28:04.485864+0000","last_fullsized":"2024-09-21T07:28:04.485864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:33.747730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490052+0000","last_change":"2024-09-21T07:28:03.520206+0000","last_active":"2024-09-21T07:28:04.490052+0000","last_peered":"2024-09-21T07:28:04.490052+0000","last_clean":"2024-09-21T07:28:04.490052+0000","last_became_active":"2024-09-21T07:28:03.519807+0000","last_became_peered":"2024-09-21T07:28:03.519807+0000","last_unstale":"2024-09-21T07:28:04.490052+0000","last_undegraded":"2024-09-21T07:28:04.490052+0000","last_fullsized":"2024-09-21T07:28:04.490052+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:03.613613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:28:03.512835+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:28:03.512077+0000","last_became_peered":"2024-09-21T07:28:03.512077+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:48.666845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559724+0000","last_change":"2024-09-21T07:28:03.513106+0000","last_active":"2024-09-21T07:28:04.559724+0000","last_peered":"2024-09-21T07:28:04.559724+0000","last_clean":"2024-09-21T07:28:04.559724+0000","last_became_active":"2024-09-21T07:28:03.512780+0000","last_became_peered":"2024-09-21T07:28:03.512780+0000","last_unstale":"2024-09-21T07:28:04.559724+0000","last_undegraded":"2024-09-21T07:28:04.559724+0000","last_fullsized":"2024-09-21T07:28:04.559724+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:56.996792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.560125+0000","last_change":"2024-09-21T07:28:03.518912+0000","last_active":"2024-09-21T07:28:04.560125+0000","last_peered":"2024-09-21T07:28:04.560125+0000","last_clean":"2024-09-21T07:28:04.560125+0000","last_became_active":"2024-09-21T07:28:03.510569+0000","last_became_peered":"2024-09-21T07:28:03.510569+0000","last_unstale":"2024-09-21T07:28:04.560125+0000","last_undegraded":"2024-09-21T07:28:04.560125+0000","last_fullsized":"2024-09-21T07:28:04.560125+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.848340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559111+0000","last_change":"2024-09-21T07:28:03.522857+0000","last_active":"2024-09-21T07:28:04.559111+0000","last_peered":"2024-09-21T07:28:04.559111+0000","last_clean":"2024-09-21T07:28:04.559111+0000","last_became_active":"2024-09-21T07:28:03.522439+0000","last_became_peered":"2024-09-21T07:28:03.522439+0000","last_unstale":"2024-09-21T07:28:04.559111+0000","last_undegraded":"2024-09-21T07:28:04.559111+0000","last_fullsized":"2024-09-21T07:28:04.559111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558373+0000","last_change":"2024-09-21T07:28:03.518345+0000","last_active":"2024-09-21T07:28:04.558373+0000","last_peered":"2024-09-21T07:28:04.558373+0000","last_clean":"2024-09-21T07:28:04.558373+0000","last_became_active":"2024-09-21T07:28:03.515234+0000","last_became_peered":"2024-09-21T07:28:03.515234+0000","last_unstale":"2024-09-21T07:28:04.558373+0000","last_undegraded":"2024-09-21T07:28:04.558373+0000","last_fullsized":"2024-09-21T07:28:04.558373+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:42.790722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490020+0000","last_change":"2024-09-21T07:28:03.526208+0000","last_active":"2024-09-21T07:28:04.490020+0000","last_peered":"2024-09-21T07:28:04.490020+0000","last_clean":"2024-09-21T07:28:04.490020+0000","last_became_active":"2024-09-21T07:28:03.525815+0000","last_became_peered":"2024-09-21T07:28:03.525815+0000","last_unstale":"2024-09-21T07:28:04.490020+0000","last_undegraded":"2024-09-21T07:28:04.490020+0000","last_fullsized":"2024-09-21T07:28:04.490020+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:07.698695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558106+0000","last_change":"2024-09-21T07:28:03.503263+0000","last_active":"2024-09-21T07:28:04.558106+0000","last_peered":"2024-09-21T07:28:04.558106+0000","last_clean":"2024-09-21T07:28:04.558106+0000","last_became_active":"2024-09-21T07:28:03.502957+0000","last_became_peered":"2024-09-21T07:28:03.502957+0000","last_unstale":"2024-09-21T07:28:04.558106+0000","last_undegraded":"2024-09-21T07:28:04.558106+0000","last_fullsized":"2024-09-21T07:28:04.558106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:32.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558837+0000","last_change":"2024-09-21T07:28:03.510862+0000","last_active":"2024-09-21T07:28:04.558837+0000","last_peered":"2024-09-21T07:28:04.558837+0000","last_clean":"2024-09-21T07:28:04.558837+0000","last_became_active":"2024-09-21T07:28:03.510521+0000","last_became_peered":"2024-09-21T07:28:03.510521+0000","last_unstale":"2024-09-21T07:28:04.558837+0000","last_undegraded":"2024-09-21T07:28:04.558837+0000","last_fullsized":"2024-09-21T07:28:04.558837+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.887206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"98'4","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490622+0000","last_change":"2024-09-21T07:28:02.480401+0000","last_active":"2024-09-21T07:28:04.490622+0000","last_peered":"2024-09-21T07:28:04.490622+0000","last_clean":"2024-09-21T07:28:04.490622+0000","last_became_active":"2024-09-21T07:28:02.480063+0000","last_became_peered":"2024-09-21T07:28:02.480063+0000","last_unstale":"2024-09-21T07:28:04.490622+0000","last_undegraded":"2024-09-21T07:28:04.490622+0000","last_fullsized":"2024-09-21T07:28:04.490622+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:58.126691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559653+0000","last_change":"2024-09-21T07:28:03.518171+0000","last_active":"2024-09-21T07:28:04.559653+0000","last_peered":"2024-09-21T07:28:04.559653+0000","last_clean":"2024-09-21T07:28:04.559653+0000","last_became_active":"2024-09-21T07:28:03.517814+0000","last_became_peered":"2024-09-21T07:28:03.517814+0000","last_unstale":"2024-09-21T07:28:04.559653+0000","last_undegraded":"2024-09-21T07:28:04.559653+0000","last_fullsized":"2024-09-21T07:28:04.559653+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:08.622258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558551+0000","last_change":"2024-09-21T07:28:02.489572+0000","last_active":"2024-09-21T07:28:04.558551+0000","last_peered":"2024-09-21T07:28:04.558551+0000","last_clean":"2024-09-21T07:28:04.558551+0000","last_became_active":"2024-09-21T07:28:02.489240+0000","last_became_peered":"2024-09-21T07:28:02.489240+0000","last_unstale":"2024-09-21T07:28:04.558551+0000","last_undegraded":"2024-09-21T07:28:04.558551+0000","last_fullsized":"2024-09-21T07:28:04.558551+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:52.155029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559385+0000","last_change":"2024-09-21T07:28:03.526754+0000","last_active":"2024-09-21T07:28:04.559385+0000","last_peered":"2024-09-21T07:28:04.559385+0000","last_clean":"2024-09-21T07:28:04.559385+0000","last_became_active":"2024-09-21T07:28:03.526453+0000","last_became_peered":"2024-09-21T07:28:03.526453+0000","last_unstale":"2024-09-21T07:28:04.559385+0000","last_undegraded":"2024-09-21T07:28:04.559385+0000","last_fullsized":"2024-09-21T07:28:04.559385+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559310+0000","last_change":"2024-09-21T07:28:02.492575+0000","last_active":"2024-09-21T07:28:04.559310+0000","last_peered":"2024-09-21T07:28:04.559310+0000","last_clean":"2024-09-21T07:28:04.559310+0000","last_became_active":"2024-09-21T07:28:02.491529+0000","last_became_peered":"2024-09-21T07:28:02.491529+0000","last_unstale":"2024-09-21T07:28:04.559310+0000","last_undegraded":"2024-09-21T07:28:04.559310+0000","last_fullsized":"2024-09-21T07:28:04.559310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559228+0000","last_change":"2024-09-21T07:28:03.509155+0000","last_active":"2024-09-21T07:28:04.559228+0000","last_peered":"2024-09-21T07:28:04.559228+0000","last_clean":"2024-09-21T07:28:04.559228+0000","last_became_active":"2024-09-21T07:28:03.508788+0000","last_became_peered":"2024-09-21T07:28:03.508788+0000","last_unstale":"2024-09-21T07:28:04.559228+0000","last_undegraded":"2024-09-21T07:28:04.559228+0000","last_fullsized":"2024-09-21T07:28:04.559228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490480+0000","last_change":"2024-09-21T07:28:02.483081+0000","last_active":"2024-09-21T07:28:04.490480+0000","last_peered":"2024-09-21T07:28:04.490480+0000","last_clean":"2024-09-21T07:28:04.490480+0000","last_became_active":"2024-09-21T07:28:02.482548+0000","last_became_peered":"2024-09-21T07:28:02.482548+0000","last_unstale":"2024-09-21T07:28:04.490480+0000","last_undegraded":"2024-09-21T07:28:04.490480+0000","last_fullsized":"2024-09-21T07:28:04.490480+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.899132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558349+0000","last_change":"2024-09-21T07:28:03.515619+0000","last_active":"2024-09-21T07:28:04.558349+0000","last_peered":"2024-09-21T07:28:04.558349+0000","last_clean":"2024-09-21T07:28:04.558349+0000","last_became_active":"2024-09-21T07:28:03.514744+0000","last_became_peered":"2024-09-21T07:28:03.514744+0000","last_unstale":"2024-09-21T07:28:04.558349+0000","last_undegraded":"2024-09-21T07:28:04.558349+0000","last_fullsized":"2024-09-21T07:28:04.558349+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:49.240150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558590+0000","last_change":"2024-09-21T07:28:02.485679+0000","last_active":"2024-09-21T07:28:04.558590+0000","last_peered":"2024-09-21T07:28:04.558590+0000","last_clean":"2024-09-21T07:28:04.558590+0000","last_became_active":"2024-09-21T07:28:02.484985+0000","last_became_peered":"2024-09-21T07:28:02.484985+0000","last_unstale":"2024-09-21T07:28:04.558590+0000","last_undegraded":"2024-09-21T07:28:04.558590+0000","last_fullsized":"2024-09-21T07:28:04.558590+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:10.591614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489616+0000","last_change":"2024-09-21T07:28:03.511857+0000","last_active":"2024-09-21T07:28:04.489616+0000","last_peered":"2024-09-21T07:28:04.489616+0000","last_clean":"2024-09-21T07:28:04.489616+0000","last_became_active":"2024-09-21T07:28:03.511543+0000","last_became_peered":"2024-09-21T07:28:03.511543+0000","last_unstale":"2024-09-21T07:28:04.489616+0000","last_undegraded":"2024-09-21T07:28:04.489616+0000","last_fullsized":"2024-09-21T07:28:04.489616+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:21.967084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559069+0000","last_change":"2024-09-21T07:28:02.484131+0000","last_active":"2024-09-21T07:28:04.559069+0000","last_peered":"2024-09-21T07:28:04.559069+0000","last_clean":"2024-09-21T07:28:04.559069+0000","last_became_active":"2024-09-21T07:28:02.483822+0000","last_became_peered":"2024-09-21T07:28:02.483822+0000","last_unstale":"2024-09-21T07:28:04.559069+0000","last_undegraded":"2024-09-21T07:28:04.559069+0000","last_fullsized":"2024-09-21T07:28:04.559069+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:25.930229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558414+0000","last_change":"2024-09-21T07:28:03.512856+0000","last_active":"2024-09-21T07:28:04.558414+0000","last_peered":"2024-09-21T07:28:04.558414+0000","last_clean":"2024-09-21T07:28:04.558414+0000","last_became_active":"2024-09-21T07:28:03.512557+0000","last_became_peered":"2024-09-21T07:28:03.512557+0000","last_unstale":"2024-09-21T07:28:04.558414+0000","last_undegraded":"2024-09-21T07:28:04.558414+0000","last_fullsized":"2024-09-21T07:28:04.558414+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:19.888951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485851+0000","last_change":"2024-09-21T07:28:02.481366+0000","last_active":"2024-09-21T07:28:04.485851+0000","last_peered":"2024-09-21T07:28:04.485851+0000","last_clean":"2024-09-21T07:28:04.485851+0000","last_became_active":"2024-09-21T07:28:02.480991+0000","last_became_peered":"2024-09-21T07:28:02.480991+0000","last_unstale":"2024-09-21T07:28:04.485851+0000","last_undegraded":"2024-09-21T07:28:04.485851+0000","last_fullsized":"2024-09-21T07:28:04.485851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.839283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559509+0000","last_change":"2024-09-21T07:28:03.524284+0000","last_active":"2024-09-21T07:28:04.559509+0000","last_peered":"2024-09-21T07:28:04.559509+0000","last_clean":"2024-09-21T07:28:04.559509+0000","last_became_active":"2024-09-21T07:28:03.523637+0000","last_became_peered":"2024-09-21T07:28:03.523637+0000","last_unstale":"2024-09-21T07:28:04.559509+0000","last_undegraded":"2024-09-21T07:28:04.559509+0000","last_fullsized":"2024-09-21T07:28:04.559509+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:11.534590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557899+0000","last_change":"2024-09-21T07:28:02.494170+0000","last_active":"2024-09-21T07:28:04.557899+0000","last_peered":"2024-09-21T07:28:04.557899+0000","last_clean":"2024-09-21T07:28:04.557899+0000","last_became_active":"2024-09-21T07:28:02.493439+0000","last_became_peered":"2024-09-21T07:28:02.493439+0000","last_unstale":"2024-09-21T07:28:04.557899+0000","last_undegraded":"2024-09-21T07:28:04.557899+0000","last_fullsized":"2024-09-21T07:28:04.557899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:27.800486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558321+0000","last_change":"2024-09-21T07:28:03.503504+0000","last_active":"2024-09-21T07:28:04.558321+0000","last_peered":"2024-09-21T07:28:04.558321+0000","last_clean":"2024-09-21T07:28:04.558321+0000","last_became_active":"2024-09-21T07:28:03.503117+0000","last_became_peered":"2024-09-21T07:28:03.503117+0000","last_unstale":"2024-09-21T07:28:04.558321+0000","last_undegraded":"2024-09-21T07:28:04.558321+0000","last_fullsized":"2024-09-21T07:28:04.558321+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.766643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490220+0000","last_change":"2024-09-21T07:28:02.483843+0000","last_active":"2024-09-21T07:28:04.490220+0000","last_peered":"2024-09-21T07:28:04.490220+0000","last_clean":"2024-09-21T07:28:04.490220+0000","last_became_active":"2024-09-21T07:28:02.483455+0000","last_became_peered":"2024-09-21T07:28:02.483455+0000","last_unstale":"2024-09-21T07:28:04.490220+0000","last_undegraded":"2024-09-21T07:28:04.490220+0000","last_fullsized":"2024-09-21T07:28:04.490220+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:26.726293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559290+0000","last_change":"2024-09-21T07:28:03.528617+0000","last_active":"2024-09-21T07:28:04.559290+0000","last_peered":"2024-09-21T07:28:04.559290+0000","last_clean":"2024-09-21T07:28:04.559290+0000","last_became_active":"2024-09-21T07:28:03.528268+0000","last_became_peered":"2024-09-21T07:28:03.528268+0000","last_unstale":"2024-09-21T07:28:04.559290+0000","last_undegraded":"2024-09-21T07:28:04.559290+0000","last_fullsized":"2024-09-21T07:28:04.559290+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.962212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486479+0000","last_change":"2024-09-21T07:28:02.490608+0000","last_active":"2024-09-21T07:28:04.486479+0000","last_peered":"2024-09-21T07:28:04.486479+0000","last_clean":"2024-09-21T07:28:04.486479+0000","last_became_active":"2024-09-21T07:28:02.490278+0000","last_became_peered":"2024-09-21T07:28:02.490278+0000","last_unstale":"2024-09-21T07:28:04.486479+0000","last_undegraded":"2024-09-21T07:28:04.486479+0000","last_fullsized":"2024-09-21T07:28:04.486479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.486360+0000","last_change":"2024-09-21T07:28:03.499223+0000","last_active":"2024-09-21T07:28:04.486360+0000","last_peered":"2024-09-21T07:28:04.486360+0000","last_clean":"2024-09-21T07:28:04.486360+0000","last_became_active":"2024-09-21T07:28:03.498880+0000","last_became_peered":"2024-09-21T07:28:03.498880+0000","last_unstale":"2024-09-21T07:28:04.486360+0000","last_undegraded":"2024-09-21T07:28:04.486360+0000","last_fullsized":"2024-09-21T07:28:04.486360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:46.021754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"98'3","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559144+0000","last_change":"2024-09-21T07:28:02.491104+0000","last_active":"2024-09-21T07:28:04.559144+0000","last_peered":"2024-09-21T07:28:04.559144+0000","last_clean":"2024-09-21T07:28:04.559144+0000","last_became_active":"2024-09-21T07:28:02.490329+0000","last_became_peered":"2024-09-21T07:28:02.490329+0000","last_unstale":"2024-09-21T07:28:04.559144+0000","last_undegraded":"2024-09-21T07:28:04.559144+0000","last_fullsized":"2024-09-21T07:28:04.559144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:21.509186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559795+0000","last_change":"2024-09-21T07:28:03.521734+0000","last_active":"2024-09-21T07:28:04.559795+0000","last_peered":"2024-09-21T07:28:04.559795+0000","last_clean":"2024-09-21T07:28:04.559795+0000","last_became_active":"2024-09-21T07:28:03.521103+0000","last_became_peered":"2024-09-21T07:28:03.521103+0000","last_unstale":"2024-09-21T07:28:04.559795+0000","last_undegraded":"2024-09-21T07:28:04.559795+0000","last_fullsized":"2024-09-21T07:28:04.559795+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:10.104819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"98'6","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559243+0000","last_change":"2024-09-21T07:28:02.481710+0000","last_active":"2024-09-21T07:28:04.559243+0000","last_peered":"2024-09-21T07:28:04.559243+0000","last_clean":"2024-09-21T07:28:04.559243+0000","last_became_active":"2024-09-21T07:28:02.481285+0000","last_became_peered":"2024-09-21T07:28:02.481285+0000","last_unstale":"2024-09-21T07:28:04.559243+0000","last_undegraded":"2024-09-21T07:28:04.559243+0000","last_fullsized":"2024-09-21T07:28:04.559243+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:40.294274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558590+0000","last_change":"2024-09-21T07:28:03.518925+0000","last_active":"2024-09-21T07:28:04.558590+0000","last_peered":"2024-09-21T07:28:04.558590+0000","last_clean":"2024-09-21T07:28:04.558590+0000","last_became_active":"2024-09-21T07:28:03.515138+0000","last_became_peered":"2024-09-21T07:28:03.515138+0000","last_unstale":"2024-09-21T07:28:04.558590+0000","last_undegraded":"2024-09-21T07:28:04.558590+0000","last_fullsized":"2024-09-21T07:28:04.558590+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:08.481311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558949+0000","last_change":"2024-09-21T07:28:02.495439+0000","last_active":"2024-09-21T07:28:04.558949+0000","last_peered":"2024-09-21T07:28:04.558949+0000","last_clean":"2024-09-21T07:28:04.558949+0000","last_became_active":"2024-09-21T07:28:02.494223+0000","last_became_peered":"2024-09-21T07:28:02.494223+0000","last_unstale":"2024-09-21T07:28:04.558949+0000","last_undegraded":"2024-09-21T07:28:04.558949+0000","last_fullsized":"2024-09-21T07:28:04.558949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:50.727753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557945+0000","last_change":"2024-09-21T07:28:03.514959+0000","last_active":"2024-09-21T07:28:04.557945+0000","last_peered":"2024-09-21T07:28:04.557945+0000","last_clean":"2024-09-21T07:28:04.557945+0000","last_became_active":"2024-09-21T07:28:03.514629+0000","last_became_peered":"2024-09-21T07:28:03.514629+0000","last_unstale":"2024-09-21T07:28:04.557945+0000","last_undegraded":"2024-09-21T07:28:04.557945+0000","last_fullsized":"2024-09-21T07:28:04.557945+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:55.657703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558579+0000","last_change":"2024-09-21T07:28:02.486025+0000","last_active":"2024-09-21T07:28:04.558579+0000","last_peered":"2024-09-21T07:28:04.558579+0000","last_clean":"2024-09-21T07:28:04.558579+0000","last_became_active":"2024-09-21T07:28:02.485713+0000","last_became_peered":"2024-09-21T07:28:02.485713+0000","last_unstale":"2024-09-21T07:28:04.558579+0000","last_undegraded":"2024-09-21T07:28:04.558579+0000","last_fullsized":"2024-09-21T07:28:04.558579+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.030194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557674+0000","last_change":"2024-09-21T07:28:03.525950+0000","last_active":"2024-09-21T07:28:04.557674+0000","last_peered":"2024-09-21T07:28:04.557674+0000","last_clean":"2024-09-21T07:28:04.557674+0000","last_became_active":"2024-09-21T07:28:03.525492+0000","last_became_peered":"2024-09-21T07:28:03.525492+0000","last_unstale":"2024-09-21T07:28:04.557674+0000","last_undegraded":"2024-09-21T07:28:04.557674+0000","last_fullsized":"2024-09-21T07:28:04.557674+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:23.420520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558454+0000","last_change":"2024-09-21T07:28:02.475561+0000","last_active":"2024-09-21T07:28:04.558454+0000","last_peered":"2024-09-21T07:28:04.558454+0000","last_clean":"2024-09-21T07:28:04.558454+0000","last_became_active":"2024-09-21T07:28:02.475232+0000","last_became_peered":"2024-09-21T07:28:02.475232+0000","last_unstale":"2024-09-21T07:28:04.558454+0000","last_undegraded":"2024-09-21T07:28:04.558454+0000","last_fullsized":"2024-09-21T07:28:04.558454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:55.842595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559304+0000","last_change":"2024-09-21T07:28:03.516216+0000","last_active":"2024-09-21T07:28:04.559304+0000","last_peered":"2024-09-21T07:28:04.559304+0000","last_clean":"2024-09-21T07:28:04.559304+0000","last_became_active":"2024-09-21T07:28:03.515932+0000","last_became_peered":"2024-09-21T07:28:03.515932+0000","last_unstale":"2024-09-21T07:28:04.559304+0000","last_undegraded":"2024-09-21T07:28:04.559304+0000","last_fullsized":"2024-09-21T07:28:04.559304+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:37.546655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"98'8","reported_seq":23,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558757+0000","last_change":"2024-09-21T07:28:02.489670+0000","last_active":"2024-09-21T07:28:04.558757+0000","last_peered":"2024-09-21T07:28:04.558757+0000","last_clean":"2024-09-21T07:28:04.558757+0000","last_became_active":"2024-09-21T07:28:02.485518+0000","last_became_peered":"2024-09-21T07:28:02.485518+0000","last_unstale":"2024-09-21T07:28:04.558757+0000","last_undegraded":"2024-09-21T07:28:04.558757+0000","last_fullsized":"2024-09-21T07:28:04.558757+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:31.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559074+0000","last_change":"2024-09-21T07:28:03.510556+0000","last_active":"2024-09-21T07:28:04.559074+0000","last_peered":"2024-09-21T07:28:04.559074+0000","last_clean":"2024-09-21T07:28:04.559074+0000","last_became_active":"2024-09-21T07:28:03.510253+0000","last_became_peered":"2024-09-21T07:28:03.510253+0000","last_unstale":"2024-09-21T07:28:04.559074+0000","last_undegraded":"2024-09-21T07:28:04.559074+0000","last_fullsized":"2024-09-21T07:28:04.559074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:29.767584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490743+0000","last_change":"2024-09-21T07:28:02.490405+0000","last_active":"2024-09-21T07:28:04.490743+0000","last_peered":"2024-09-21T07:28:04.490743+0000","last_clean":"2024-09-21T07:28:04.490743+0000","last_became_active":"2024-09-21T07:28:02.488124+0000","last_became_peered":"2024-09-21T07:28:02.488124+0000","last_unstale":"2024-09-21T07:28:04.490743+0000","last_undegraded":"2024-09-21T07:28:04.490743+0000","last_fullsized":"2024-09-21T07:28:04.490743+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.258783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490838+0000","last_change":"2024-09-21T07:28:03.515978+0000","last_active":"2024-09-21T07:28:04.490838+0000","last_peered":"2024-09-21T07:28:04.490838+0000","last_clean":"2024-09-21T07:28:04.490838+0000","last_became_active":"2024-09-21T07:28:03.515532+0000","last_became_peered":"2024-09-21T07:28:03.515532+0000","last_unstale":"2024-09-21T07:28:04.490838+0000","last_undegraded":"2024-09-21T07:28:04.490838+0000","last_fullsized":"2024-09-21T07:28:04.490838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:32.064059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559227+0000","last_change":"2024-09-21T07:28:02.493001+0000","last_active":"2024-09-21T07:28:04.559227+0000","last_peered":"2024-09-21T07:28:04.559227+0000","last_clean":"2024-09-21T07:28:04.559227+0000","last_became_active":"2024-09-21T07:28:02.492584+0000","last_became_peered":"2024-09-21T07:28:02.492584+0000","last_unstale":"2024-09-21T07:28:04.559227+0000","last_undegraded":"2024-09-21T07:28:04.559227+0000","last_fullsized":"2024-09-21T07:28:04.559227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558421+0000","last_change":"2024-09-21T07:28:03.518883+0000","last_active":"2024-09-21T07:28:04.558421+0000","last_peered":"2024-09-21T07:28:04.558421+0000","last_clean":"2024-09-21T07:28:04.558421+0000","last_became_active":"2024-09-21T07:28:03.518041+0000","last_became_peered":"2024-09-21T07:28:03.518041+0000","last_unstale":"2024-09-21T07:28:04.558421+0000","last_undegraded":"2024-09-21T07:28:04.558421+0000","last_fullsized":"2024-09-21T07:28:04.558421+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:32.064059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.492630+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.492255+0000","last_became_peered":"2024-09-21T07:28:02.492255+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:09.763863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558382+0000","last_change":"2024-09-21T07:28:03.528742+0000","last_active":"2024-09-21T07:28:04.558382+0000","last_peered":"2024-09-21T07:28:04.558382+0000","last_clean":"2024-09-21T07:28:04.558382+0000","last_became_active":"2024-09-21T07:28:03.527856+0000","last_became_peered":"2024-09-21T07:28:03.527856+0000","last_unstale":"2024-09-21T07:28:04.558382+0000","last_undegraded":"2024-09-21T07:28:04.558382+0000","last_fullsized":"2024-09-21T07:28:04.558382+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:03.583122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489455+0000","last_change":"2024-09-21T07:28:02.492296+0000","last_active":"2024-09-21T07:28:04.489455+0000","last_peered":"2024-09-21T07:28:04.489455+0000","last_clean":"2024-09-21T07:28:04.489455+0000","last_became_active":"2024-09-21T07:28:02.491988+0000","last_became_peered":"2024-09-21T07:28:02.491988+0000","last_unstale":"2024-09-21T07:28:04.489455+0000","last_undegraded":"2024-09-21T07:28:04.489455+0000","last_fullsized":"2024-09-21T07:28:04.489455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:34.343109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489485+0000","last_change":"2024-09-21T07:28:03.514596+0000","last_active":"2024-09-21T07:28:04.489485+0000","last_peered":"2024-09-21T07:28:04.489485+0000","last_clean":"2024-09-21T07:28:04.489485+0000","last_became_active":"2024-09-21T07:28:03.514116+0000","last_became_peered":"2024-09-21T07:28:03.514116+0000","last_unstale":"2024-09-21T07:28:04.489485+0000","last_undegraded":"2024-09-21T07:28:04.489485+0000","last_fullsized":"2024-09-21T07:28:04.489485+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:18.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558639+0000","last_change":"2024-09-21T07:28:02.481472+0000","last_active":"2024-09-21T07:28:04.558639+0000","last_peered":"2024-09-21T07:28:04.558639+0000","last_clean":"2024-09-21T07:28:04.558639+0000","last_became_active":"2024-09-21T07:28:02.480516+0000","last_became_peered":"2024-09-21T07:28:02.480516+0000","last_unstale":"2024-09-21T07:28:04.558639+0000","last_undegraded":"2024-09-21T07:28:04.558639+0000","last_fullsized":"2024-09-21T07:28:04.558639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:52.637027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489517+0000","last_change":"2024-09-21T07:28:03.523774+0000","last_active":"2024-09-21T07:28:04.489517+0000","last_peered":"2024-09-21T07:28:04.489517+0000","last_clean":"2024-09-21T07:28:04.489517+0000","last_became_active":"2024-09-21T07:28:03.523300+0000","last_became_peered":"2024-09-21T07:28:03.523300+0000","last_unstale":"2024-09-21T07:28:04.489517+0000","last_undegraded":"2024-09-21T07:28:04.489517+0000","last_fullsized":"2024-09-21T07:28:04.489517+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:28.225131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489716+0000","last_change":"2024-09-21T07:28:02.488106+0000","last_active":"2024-09-21T07:28:04.489716+0000","last_peered":"2024-09-21T07:28:04.489716+0000","last_clean":"2024-09-21T07:28:04.489716+0000","last_became_active":"2024-09-21T07:28:02.487749+0000","last_became_peered":"2024-09-21T07:28:02.487749+0000","last_unstale":"2024-09-21T07:28:04.489716+0000","last_undegraded":"2024-09-21T07:28:04.489716+0000","last_fullsized":"2024-09-21T07:28:04.489716+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:01.506256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558876+0000","last_change":"2024-09-21T07:28:03.520210+0000","last_active":"2024-09-21T07:28:04.558876+0000","last_peered":"2024-09-21T07:28:04.558876+0000","last_clean":"2024-09-21T07:28:04.558876+0000","last_became_active":"2024-09-21T07:28:03.519890+0000","last_became_peered":"2024-09-21T07:28:03.519890+0000","last_unstale":"2024-09-21T07:28:04.558876+0000","last_undegraded":"2024-09-21T07:28:04.558876+0000","last_fullsized":"2024-09-21T07:28:04.558876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:42.221465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557544+0000","last_change":"2024-09-21T07:28:02.480862+0000","last_active":"2024-09-21T07:28:04.557544+0000","last_peered":"2024-09-21T07:28:04.557544+0000","last_clean":"2024-09-21T07:28:04.557544+0000","last_became_active":"2024-09-21T07:28:02.479884+0000","last_became_peered":"2024-09-21T07:28:02.479884+0000","last_unstale":"2024-09-21T07:28:04.557544+0000","last_undegraded":"2024-09-21T07:28:04.557544+0000","last_fullsized":"2024-09-21T07:28:04.557544+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:16.392290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490522+0000","last_change":"2024-09-21T07:28:03.504179+0000","last_active":"2024-09-21T07:28:04.490522+0000","last_peered":"2024-09-21T07:28:04.490522+0000","last_clean":"2024-09-21T07:28:04.490522+0000","last_became_active":"2024-09-21T07:28:03.503812+0000","last_became_peered":"2024-09-21T07:28:03.503812+0000","last_unstale":"2024-09-21T07:28:04.490522+0000","last_undegraded":"2024-09-21T07:28:04.490522+0000","last_fullsized":"2024-09-21T07:28:04.490522+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:42.790722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559149+0000","last_change":"2024-09-21T07:28:02.493358+0000","last_active":"2024-09-21T07:28:04.559149+0000","last_peered":"2024-09-21T07:28:04.559149+0000","last_clean":"2024-09-21T07:28:04.559149+0000","last_became_active":"2024-09-21T07:28:02.493044+0000","last_became_peered":"2024-09-21T07:28:02.493044+0000","last_unstale":"2024-09-21T07:28:04.559149+0000","last_undegraded":"2024-09-21T07:28:04.559149+0000","last_fullsized":"2024-09-21T07:28:04.559149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:54.105626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559990+0000","last_change":"2024-09-21T07:28:03.514287+0000","last_active":"2024-09-21T07:28:04.559990+0000","last_peered":"2024-09-21T07:28:04.559990+0000","last_clean":"2024-09-21T07:28:04.559990+0000","last_became_active":"2024-09-21T07:28:03.513963+0000","last_became_peered":"2024-09-21T07:28:03.513963+0000","last_unstale":"2024-09-21T07:28:04.559990+0000","last_undegraded":"2024-09-21T07:28:04.559990+0000","last_fullsized":"2024-09-21T07:28:04.559990+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:29.265919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"99'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558625+0000","last_change":"2024-09-21T07:28:02.490011+0000","last_active":"2024-09-21T07:28:04.558625+0000","last_peered":"2024-09-21T07:28:04.558625+0000","last_clean":"2024-09-21T07:28:04.558625+0000","last_became_active":"2024-09-21T07:28:02.489295+0000","last_became_peered":"2024-09-21T07:28:02.489295+0000","last_unstale":"2024-09-21T07:28:04.558625+0000","last_undegraded":"2024-09-21T07:28:04.558625+0000","last_fullsized":"2024-09-21T07:28:04.558625+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:52.237769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559659+0000","last_change":"2024-09-21T07:28:03.519073+0000","last_active":"2024-09-21T07:28:04.559659+0000","last_peered":"2024-09-21T07:28:04.559659+0000","last_clean":"2024-09-21T07:28:04.559659+0000","last_became_active":"2024-09-21T07:28:03.518758+0000","last_became_peered":"2024-09-21T07:28:03.518758+0000","last_unstale":"2024-09-21T07:28:04.559659+0000","last_undegraded":"2024-09-21T07:28:04.559659+0000","last_fullsized":"2024-09-21T07:28:04.559659+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:33.987173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559266+0000","last_change":"2024-09-21T07:28:02.491433+0000","last_active":"2024-09-21T07:28:04.559266+0000","last_peered":"2024-09-21T07:28:04.559266+0000","last_clean":"2024-09-21T07:28:04.559266+0000","last_became_active":"2024-09-21T07:28:02.490769+0000","last_became_peered":"2024-09-21T07:28:02.490769+0000","last_unstale":"2024-09-21T07:28:04.559266+0000","last_undegraded":"2024-09-21T07:28:04.559266+0000","last_fullsized":"2024-09-21T07:28:04.559266+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.683081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490379+0000","last_change":"2024-09-21T07:28:03.522320+0000","last_active":"2024-09-21T07:28:04.490379+0000","last_peered":"2024-09-21T07:28:04.490379+0000","last_clean":"2024-09-21T07:28:04.490379+0000","last_became_active":"2024-09-21T07:28:03.521998+0000","last_became_peered":"2024-09-21T07:28:03.521998+0000","last_unstale":"2024-09-21T07:28:04.490379+0000","last_undegraded":"2024-09-21T07:28:04.490379+0000","last_fullsized":"2024-09-21T07:28:04.490379+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:41.296925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490607+0000","last_change":"2024-09-21T07:28:02.484294+0000","last_active":"2024-09-21T07:28:04.490607+0000","last_peered":"2024-09-21T07:28:04.490607+0000","last_clean":"2024-09-21T07:28:04.490607+0000","last_became_active":"2024-09-21T07:28:02.483654+0000","last_became_peered":"2024-09-21T07:28:02.483654+0000","last_unstale":"2024-09-21T07:28:04.490607+0000","last_undegraded":"2024-09-21T07:28:04.490607+0000","last_fullsized":"2024-09-21T07:28:04.490607+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:10.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.557619+0000","last_change":"2024-09-21T07:28:03.517027+0000","last_active":"2024-09-21T07:28:04.557619+0000","last_peered":"2024-09-21T07:28:04.557619+0000","last_clean":"2024-09-21T07:28:04.557619+0000","last_became_active":"2024-09-21T07:28:03.516686+0000","last_became_peered":"2024-09-21T07:28:03.516686+0000","last_unstale":"2024-09-21T07:28:04.557619+0000","last_undegraded":"2024-09-21T07:28:04.557619+0000","last_fullsized":"2024-09-21T07:28:04.557619+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:35.711776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559293+0000","last_change":"2024-09-21T07:28:02.488252+0000","last_active":"2024-09-21T07:28:04.559293+0000","last_peered":"2024-09-21T07:28:04.559293+0000","last_clean":"2024-09-21T07:28:04.559293+0000","last_became_active":"2024-09-21T07:28:02.486549+0000","last_became_peered":"2024-09-21T07:28:02.486549+0000","last_unstale":"2024-09-21T07:28:04.559293+0000","last_undegraded":"2024-09-21T07:28:04.559293+0000","last_fullsized":"2024-09-21T07:28:04.559293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:39.396203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.485858+0000","last_change":"2024-09-21T07:28:03.505904+0000","last_active":"2024-09-21T07:28:04.485858+0000","last_peered":"2024-09-21T07:28:04.485858+0000","last_clean":"2024-09-21T07:28:04.485858+0000","last_became_active":"2024-09-21T07:28:03.505598+0000","last_became_peered":"2024-09-21T07:28:03.505598+0000","last_unstale":"2024-09-21T07:28:04.485858+0000","last_undegraded":"2024-09-21T07:28:04.485858+0000","last_fullsized":"2024-09-21T07:28:04.485858+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.467698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.489728+0000","last_change":"2024-09-21T07:28:02.492642+0000","last_active":"2024-09-21T07:28:04.489728+0000","last_peered":"2024-09-21T07:28:04.489728+0000","last_clean":"2024-09-21T07:28:04.489728+0000","last_became_active":"2024-09-21T07:28:02.491303+0000","last_became_peered":"2024-09-21T07:28:02.491303+0000","last_unstale":"2024-09-21T07:28:04.489728+0000","last_undegraded":"2024-09-21T07:28:04.489728+0000","last_fullsized":"2024-09-21T07:28:04.489728+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:56.150810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490215+0000","last_change":"2024-09-21T07:28:03.524870+0000","last_active":"2024-09-21T07:28:04.490215+0000","last_peered":"2024-09-21T07:28:04.490215+0000","last_clean":"2024-09-21T07:28:04.490215+0000","last_became_active":"2024-09-21T07:28:03.524489+0000","last_became_peered":"2024-09-21T07:28:03.524489+0000","last_unstale":"2024-09-21T07:28:04.490215+0000","last_undegraded":"2024-09-21T07:28:04.490215+0000","last_fullsized":"2024-09-21T07:28:04.490215+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:01.766643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.490081+0000","last_change":"2024-09-21T07:28:02.485310+0000","last_active":"2024-09-21T07:28:04.490081+0000","last_peered":"2024-09-21T07:28:04.490081+0000","last_clean":"2024-09-21T07:28:04.490081+0000","last_became_active":"2024-09-21T07:28:02.484055+0000","last_became_peered":"2024-09-21T07:28:02.484055+0000","last_unstale":"2024-09-21T07:28:04.490081+0000","last_undegraded":"2024-09-21T07:28:04.490081+0000","last_fullsized":"2024-09-21T07:28:04.490081+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:41.849926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559122+0000","last_change":"2024-09-21T07:28:03.499947+0000","last_active":"2024-09-21T07:28:04.559122+0000","last_peered":"2024-09-21T07:28:04.559122+0000","last_clean":"2024-09-21T07:28:04.559122+0000","last_became_active":"2024-09-21T07:28:03.499669+0000","last_became_peered":"2024-09-21T07:28:03.499669+0000","last_unstale":"2024-09-21T07:28:04.559122+0000","last_undegraded":"2024-09-21T07:28:04.559122+0000","last_fullsized":"2024-09-21T07:28:04.559122+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:12.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558020+0000","last_change":"2024-09-21T07:28:02.494597+0000","last_active":"2024-09-21T07:28:04.558020+0000","last_peered":"2024-09-21T07:28:04.558020+0000","last_clean":"2024-09-21T07:28:04.558020+0000","last_became_active":"2024-09-21T07:28:02.493870+0000","last_became_peered":"2024-09-21T07:28:02.493870+0000","last_unstale":"2024-09-21T07:28:04.558020+0000","last_undegraded":"2024-09-21T07:28:04.558020+0000","last_fullsized":"2024-09-21T07:28:04.558020+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.788786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.559427+0000","last_change":"2024-09-21T07:28:03.522880+0000","last_active":"2024-09-21T07:28:04.559427+0000","last_peered":"2024-09-21T07:28:04.559427+0000","last_clean":"2024-09-21T07:28:04.559427+0000","last_became_active":"2024-09-21T07:28:03.522515+0000","last_became_peered":"2024-09-21T07:28:03.522515+0000","last_unstale":"2024-09-21T07:28:04.559427+0000","last_undegraded":"2024-09-21T07:28:04.559427+0000","last_fullsized":"2024-09-21T07:28:04.559427+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:02.456935+0000","last_clean_scrub_stamp":"2024-09-21T07:28:02.456935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:11.357619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.560210+0000","last_change":"2024-09-21T07:28:02.480599+0000","last_active":"2024-09-21T07:28:04.560210+0000","last_peered":"2024-09-21T07:28:04.560210+0000","last_clean":"2024-09-21T07:28:04.560210+0000","last_became_active":"2024-09-21T07:28:02.480200+0000","last_became_peered":"2024-09-21T07:28:02.480200+0000","last_unstale":"2024-09-21T07:28:04.560210+0000","last_undegraded":"2024-09-21T07:28:04.560210+0000","last_fullsized":"2024-09-21T07:28:04.560210+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:01.454284+0000","last_clean_scrub_stamp":"2024-09-21T07:28:01.454284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:52.944599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T07:28:04.558135+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:04.558135+0000","last_peered":"2024-09-21T07:28:04.558135+0000","last_clean":"2024-09-21T07:28:04.558135+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:04.558135+0000","last_undegraded":"2024-09-21T07:28:04.558135+0000","last_fullsized":"2024-09-21T07:28:04.558135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40716,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331124,"statfs":{"total":96636764160,"available":96595070976,"internally_reserved":0,"allocated":1232896,"data_stored":566572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509510,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40700,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331140,"statfs":{"total":96636764160,"available":96595087360,"internally_reserved":0,"allocated":1220608,"data_stored":564516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36540,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335300,"statfs":{"total":96636764160,"available":96599347200,"internally_reserved":0,"allocated":1216512,"data_stored":564426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1830912,"data_stored":1157042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":1154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1212416,"data_stored":564356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:12.787 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:28:12.787 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- 172.21.15.64:0/3371744511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23080717c0 msgr2=0x7f23080d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 --2- 172.21.15.64:0/3371744511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23080717c0 0x7f23080d0980 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2300009bc0 tx=0x7f230001cba0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- 172.21.15.64:0/3371744511 shutdown_connections 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 --2- 172.21.15.64:0/3371744511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23080717c0 0x7f23080d0980 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 --2- 172.21.15.64:0/3371744511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f230815c7f0 0x7f2308160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- 172.21.15.64:0/3371744511 >> 172.21.15.64:0/3371744511 conn(0x7f230806d3f0 msgr2=0x7f23080d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:12.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- 172.21.15.64:0/3371744511 shutdown_connections 2024-09-21T07:28:12.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- 172.21.15.64:0/3371744511 wait complete. 2024-09-21T07:28:12.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 Processor -- start 2024-09-21T07:28:12.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.991+0000 7f2310400640 1 -- start start 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23080b5110 0x7f2308153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23080b4900 0x7f23080d2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f230816a500 con 0x7f230815c7f0 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f230816a380 con 0x7f23080b5110 2024-09-21T07:28:12.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f230816a680 con 0x7f23080b4900 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33114/0 (socket says 172.21.15.64:33114) 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 -- 172.21.15.64:0/1081912142 learned_addr learned my addr 172.21.15.64:0/1081912142 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230e400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23080b4900 0x7f23080d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230da00640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23080b5110 0x7f2308153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 -- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23080b4900 msgr2=0x7f23080d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23080b4900 0x7f23080d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 -- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23080b5110 msgr2=0x7f2308153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23080b5110 0x7f2308153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 -- 172.21.15.64:0/1081912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23080b3820 con 0x7f230815c7f0 2024-09-21T07:28:12.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f230d000640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c3d0 tx=0x7f22f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:12.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4017070 con 0x7f230815c7f0 2024-09-21T07:28:12.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22f4003600 con 0x7f230815c7f0 2024-09-21T07:28:12.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23080b3b00 con 0x7f230815c7f0 2024-09-21T07:28:13.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4003a50 con 0x7f230815c7f0 2024-09-21T07:28:13.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2308159aa0 con 0x7f230815c7f0 2024-09-21T07:28:13.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.995+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23080d0980 con 0x7f230815c7f0 2024-09-21T07:28:13.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.999+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22f401a070 con 0x7f230815c7f0 2024-09-21T07:28:13.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.999+0000 7f2305600640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 0x7f22e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:13.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.999+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f22f4093650 con 0x7f230815c7f0 2024-09-21T07:28:13.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.999+0000 7f230da00640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 0x7f22e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:13.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:12.999+0000 7f230da00640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 0x7f22e8075710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009b40 tx=0x7f22fc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:13.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.003+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f22f405de80 con 0x7f230815c7f0 2024-09-21T07:28:13.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.243+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2308154090 con 0x7f230815c7f0 2024-09-21T07:28:13.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2305600640 1 -- 172.21.15.64:0/1081912142 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7f22f40628b0 con 0x7f230815c7f0 2024-09-21T07:28:13.247 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:28:13.248 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:28:13.248 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:28:13.248 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:28:13.248 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:28:13.248 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:28:13.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 msgr2=0x7f22e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 0x7f22e8075710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009b40 tx=0x7f22fc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 msgr2=0x7f23080d2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c3d0 tx=0x7f22f400c890 comp rx=0 tx=0).stop 2024-09-21T07:28:13.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 shutdown_connections 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f22e8073200 0x7f22e8075710 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23080b4900 0x7f23080d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f230815c7f0 0x7f23080d2030 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 --2- 172.21.15.64:0/1081912142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23080b5110 0x7f2308153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 >> 172.21.15.64:0/1081912142 conn(0x7f230806d3f0 msgr2=0x7f230806df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 shutdown_connections 2024-09-21T07:28:13.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.247+0000 7f2310400640 1 -- 172.21.15.64:0/1081912142 wait complete. 2024-09-21T07:28:13.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:13.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- 172.21.15.64:0/2589160799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840cbcd0 msgr2=0x7f80840cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 --2- 172.21.15.64:0/2589160799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840cbcd0 0x7f80840cc0e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f807c009c80 tx=0x7f807c01cd70 comp rx=0 tx=0).stop 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- 172.21.15.64:0/2589160799 shutdown_connections 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 --2- 172.21.15.64:0/2589160799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840cbcd0 0x7f80840cc0e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 --2- 172.21.15.64:0/2589160799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80840b1be0 0x7f80840b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- 172.21.15.64:0/2589160799 >> 172.21.15.64:0/2589160799 conn(0x7f80840ccbe0 msgr2=0x7f80840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- 172.21.15.64:0/2589160799 shutdown_connections 2024-09-21T07:28:13.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- 172.21.15.64:0/2589160799 wait complete. 2024-09-21T07:28:13.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 Processor -- start 2024-09-21T07:28:13.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.427+0000 7f808ba00640 1 -- start start 2024-09-21T07:28:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 0x7f8084151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 0x7f8084156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80840b4240 con 0x7f80840b1be0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80840b40c0 con 0x7f80840cbcd0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f808416a290 con 0x7f808415cbd0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33146/0 (socket says 172.21.15.64:33146) 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 -- 172.21.15.64:0/3222971470 learned_addr learned my addr 172.21.15.64:0/3222971470 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8083e00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 0x7f8084151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089a00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 0x7f8084156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 -- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 msgr2=0x7f8084156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 0x7f8084156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 -- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 msgr2=0x7f8084151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 0x7f8084151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 -- 172.21.15.64:0/3222971470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80841f8f50 con 0x7f80840b1be0 2024-09-21T07:28:13.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089a00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 0x7f8084156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8083e00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 0x7f8084151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8089000640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f807800c3f0 tx=0x7f807800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078017070 con 0x7f80840b1be0 2024-09-21T07:28:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80780053c0 con 0x7f80840b1be0 2024-09-21T07:28:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078003860 con 0x7f80840b1be0 2024-09-21T07:28:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80841fd230 con 0x7f80840b1be0 2024-09-21T07:28:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80841f94b0 con 0x7f80840b1be0 2024-09-21T07:28:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.431+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80840b1ff0 con 0x7f80840b1be0 2024-09-21T07:28:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.435+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f807801a070 con 0x7f80840b1be0 2024-09-21T07:28:13.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.435+0000 7f8080c00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 0x7f8064075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:13.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.435+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f80780937f0 con 0x7f80840b1be0 2024-09-21T07:28:13.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.435+0000 7f8083e00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 0x7f8064075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:13.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.435+0000 7f8083e00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 0x7f8064075710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8070005fd0 tx=0x7f8070005f00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:13.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.439+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f80841f8f50 con 0x7f80840b1be0 2024-09-21T07:28:13.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8084159210 con 0x7f80840b1be0 2024-09-21T07:28:13.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f8080c00640 1 -- 172.21.15.64:0/3222971470 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5222 (secure 0 0 0) 0x7f80840b2530 con 0x7f80840b1be0 2024-09-21T07:28:13.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:13.656 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":68,"btime":"2024-09-21T07:28:06:516570+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6434,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1949078533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1949078533},{"type":"v1","addr":"172.21.15.64:6834","nonce":1949078533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6437,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/311810591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":311810591},{"type":"v1","addr":"172.21.15.64:6835","nonce":311810591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2030244673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2030244673},{"type":"v1","addr":"172.21.15.90:6836","nonce":2030244673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:05.941571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7233":{"gid":7233,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/4106969991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":4106969991},{"type":"v1","addr":"172.21.15.90:6837","nonce":4106969991}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7233,"qdb_cluster":[7233]},"id":6}]} 2024-09-21T07:28:13.656 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 68 2024-09-21T07:28:13.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 msgr2=0x7f8064075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 0x7f8064075710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8070005fd0 tx=0x7f8070005f00 comp rx=0 tx=0).stop 2024-09-21T07:28:13.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 msgr2=0x7f80840cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:13.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f807800c3f0 tx=0x7f807800c8b0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 shutdown_connections 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8064073200 0x7f8064075710 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f808415cbd0 0x7f8084156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80840cbcd0 0x7f8084151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 --2- 172.21.15.64:0/3222971470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80840b1be0 0x7f80840cf890 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 >> 172.21.15.64:0/3222971470 conn(0x7f80840ccbe0 msgr2=0x7f8084155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 shutdown_connections 2024-09-21T07:28:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:13.655+0000 7f808ba00640 1 -- 172.21.15.64:0/3222971470 wait complete. 2024-09-21T07:28:14.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:28:02.892207+0000', 'modified': '2024-09-21T07:28:05.941571+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7233': {'gid': 7233, 'name': 'd', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/4106969991', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6835', 'nonce': 4106969991}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 4106969991}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7233, 'qdb_cluster': [7233]} 2024-09-21T07:28:14.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:28:14.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T07:28:14.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 -- 172.21.15.64:0/4235061934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b78004810 msgr2=0x7f2b78004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 --2- 172.21.15.64:0/4235061934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b78004810 0x7f2b78004c20 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009b30 tx=0x7f2b7c01d270 comp rx=0 tx=0).stop 2024-09-21T07:28:14.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b93200640 1 -- 172.21.15.64:0/4235061934 reap_dead start 2024-09-21T07:28:14.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 -- 172.21.15.64:0/4235061934 shutdown_connections 2024-09-21T07:28:14.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 -- 172.21.15.64:0/4235061934 >> 172.21.15.64:0/4235061934 conn(0x7f2b9406d450 msgr2=0x7f2b940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 -- 172.21.15.64:0/4235061934 shutdown_connections 2024-09-21T07:28:14.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.243+0000 7f2b99400640 1 -- 172.21.15.64:0/4235061934 wait complete. 2024-09-21T07:28:14.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 Processor -- start 2024-09-21T07:28:14.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 -- start start 2024-09-21T07:28:14.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 0x7f2b940b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9415d650 0x7f2b940b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 0x7f2b940cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940b3550 con 0x7f2b940b2010 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940b33d0 con 0x7f2b9415d650 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2b940b36d0 con 0x7f2b78004810 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b92800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 0x7f2b940b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 0x7f2b940cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b92800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 0x7f2b940b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:42214/0 (socket says 172.21.15.64:42214) 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b92800640 1 -- 172.21.15.64:0/3912523467 learned_addr learned my addr 172.21.15.64:0/3912523467 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b89e00640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9415d650 0x7f2b940b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 -- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 msgr2=0x7f2b940b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 0x7f2b940b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 -- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9415d650 msgr2=0x7f2b940b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9415d650 0x7f2b940b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 -- 172.21.15.64:0/3912523467 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b941f5a80 con 0x7f2b940b2010 2024-09-21T07:28:14.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b93200640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 0x7f2b940cd120 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b4dd0 tx=0x7f2b8c0129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b8b400640 1 -- 172.21.15.64:0/3912523467 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c013920 con 0x7f2b940b2010 2024-09-21T07:28:14.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b8b400640 1 -- 172.21.15.64:0/3912523467 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b8c013ae0 con 0x7f2b940b2010 2024-09-21T07:28:14.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b941f5d40 con 0x7f2b940b2010 2024-09-21T07:28:14.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.247+0000 7f2b8b400640 1 -- 172.21.15.64:0/3912523467 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c010480 con 0x7f2b940b2010 2024-09-21T07:28:14.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.251+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b941f6300 con 0x7f2b940b2010 2024-09-21T07:28:14.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.251+0000 7f2b8b400640 1 -- 172.21.15.64:0/3912523467 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b8c010620 con 0x7f2b940b2010 2024-09-21T07:28:14.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b8b400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 0x7f2b70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b8b400640 1 -- 172.21.15.64:0/3912523467 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f2b8c098160 con 0x7f2b940b2010 2024-09-21T07:28:14.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 Processor -- start 2024-09-21T07:28:14.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 -- start start 2024-09-21T07:28:14.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 0x7f2b70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 0x7f2b70075710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009c00 tx=0x7f2b84005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e195120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559b8e069410 con 0x559b8e043950 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559b8dfa6b40 con 0x559b8dc53460 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559b8df95f70 con 0x559b8e02cca0 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33176/0 (socket says 172.21.15.64:33176) 2024-09-21T07:28:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b89e00640 1 -- 172.21.15.64:0/3527669013 learned_addr learned my addr 172.21.15.64:0/3527669013 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:38158/0 (socket says 172.21.15.64:38158) 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b93200640 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 -- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 msgr2=0x559b8e195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e195120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 -- 172.21.15.64:0/3527669013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 msgr2=0x559b8e194be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 -- 172.21.15.64:0/3527669013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8df5d5b0 con 0x559b8dc53460 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b89e00640 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b92800640 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2b840128e0 tx=0x7f2b84017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1c9369c9b56ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b83000640 1 -- 172.21.15.64:0/3527669013 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84003b50 con 0x559b8dc53460 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b83000640 1 -- 172.21.15.64:0/3527669013 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b84003cf0 con 0x559b8dc53460 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.255+0000 7f2b83000640 1 -- 172.21.15.64:0/3527669013 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8401e6d0 con 0x559b8dc53460 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 msgr2=0x559b8e1946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2b840128e0 tx=0x7f2b84017000 comp rx=0 tx=0).stop 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- 172.21.15.64:0/3527669013 shutdown_connections 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e195120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e194be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/3527669013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8dc53460 0x559b8e1946a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- 172.21.15.64:0/3527669013 >> 172.21.15.64:0/3527669013 conn(0x559b8e119d90 msgr2=0x559b8e149690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- 172.21.15.64:0/3527669013 shutdown_connections 2024-09-21T07:28:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- 172.21.15.64:0/3527669013 wait complete. 2024-09-21T07:28:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- start start 2024-09-21T07:28:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 Processor -- start 2024-09-21T07:28:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e19b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559b8df305f0 con 0x559b8e02cca0 2024-09-21T07:28:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559b8df99d80 con 0x559b8e043950 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559b8df3c520 con 0x559b8dc53460 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2ba0c50000 10 client.0 _ll_register_callbacks cb 0x559b8df40830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33190/0 (socket says 172.21.15.64:33190) 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2b89e00640 1 -- 172.21.15.64:0/1260197852 learned_addr learned my addr 172.21.15.64:0/1260197852 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2b92800640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.259+0000 7f2b93200640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 -- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 msgr2=0x559b8e19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 -- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 msgr2=0x559b8e19c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e19c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 -- 172.21.15.64:0/1260197852 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8df34190 con 0x559b8e02cca0 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b89e00640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c10 tx=0x7f2b7c0a5e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6681f87a23ecfac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0b1040 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b8df2e110 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f2b7c005380 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2b7c0c9050 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 10 client.7386 fetch_fsmap learned FSMap version 68 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559b8e01af10 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559b8df2e110 con 0x559b8e02cca0 2024-09-21T07:28:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f2b7c0cc020 con 0x559b8e02cca0 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 10 client.7386 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 10 client.7386 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 20 client.7386 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc387d0 0x559b8e1a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 4 client.7386 mds_command: new command op to 7233 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 --> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b8dfa8a90 con 0x559b8dc387d0 2024-09-21T07:28:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b92800640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc387d0 0x559b8e1a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b92800640 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc387d0 0x559b8e1a5d00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e3e582b652588d0 server_cookie=f92e6302c416b80 in_seq=0 out_seq=0 2024-09-21T07:28:14.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 10 client.7386 ms_handle_connect on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 1 -- 172.21.15.64:0/1260197852 <== mds.0 v2:172.21.15.90:6835/4106969991 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b8dfa8a90 con 0x559b8dc387d0 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 10 client.7386 handle_command_reply: tid=0 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 client.7386 shutdown 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 msgr2=0x559b8e19be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c10 tx=0x7f2b7c0a5e70 comp rx=0 tx=0).stop 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 shutdown_connections 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc387d0 0x559b8e1a5d00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e02cca0 0x559b8e19be60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1260197852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 >> 172.21.15.64:0/1260197852 conn(0x559b8e119d90 msgr2=0x559b8e150440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.263+0000 7f2b77400640 0 client.7386 ms_handle_reset on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.267+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 shutdown_connections 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.267+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1260197852 wait complete. 2024-09-21T07:28:14.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.267+0000 7f2ba0c50000 20 client.7386 trim_cache size 0 max 16384 2024-09-21T07:28:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.283+0000 7f2ba0c50000 1 Processor -- start 2024-09-21T07:28:14.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.283+0000 7f2ba0c50000 1 -- start start 2024-09-21T07:28:14.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e206840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e02cca0 0x559b8e206d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94202ee0 con 0x559b8e043950 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9415cf50 con 0x559b8e02cca0 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2b94155e90 con 0x559b8dc53460 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33196/0 (socket says 172.21.15.64:33196) 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 -- 172.21.15.64:0/1408467891 learned_addr learned my addr 172.21.15.64:0/1408467891 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b92800640 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e206840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b89e00640 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e02cca0 0x559b8e206d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 -- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 msgr2=0x559b8e206840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e206840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 -- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e02cca0 msgr2=0x559b8e206d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e02cca0 0x559b8e206d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 -- 172.21.15.64:0/1408467891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8dff1db0 con 0x559b8e043950 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b93200640 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000f90 tx=0x7f2b8c001e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc920203b966ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b82600640 1 -- 172.21.15.64:0/1408467891 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c022040 con 0x559b8e043950 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b82600640 1 -- 172.21.15.64:0/1408467891 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b8c0840d0 con 0x559b8e043950 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2b82600640 1 -- 172.21.15.64:0/1408467891 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c067340 con 0x559b8e043950 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1408467891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 msgr2=0x559b8e2072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000f90 tx=0x7f2b8c001e00 comp rx=0 tx=0).stop 2024-09-21T07:28:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1408467891 shutdown_connections 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8e043950 0x559b8e2072c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e02cca0 0x559b8e206d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/1408467891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8dc53460 0x559b8e206840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1408467891 >> 172.21.15.64:0/1408467891 conn(0x559b8e119d90 msgr2=0x559b8e148cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1408467891 shutdown_connections 2024-09-21T07:28:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- 172.21.15.64:0/1408467891 wait complete. 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.287+0000 7f2ba0c50000 1 -- start start 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 Processor -- start 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e20a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e20ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559b8dfa5910 con 0x559b8dc53460 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559b8e01aa80 con 0x559b8e043950 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559b8e055750 con 0x559b8e02cca0 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 10 client.0 _ll_register_callbacks cb 0x7f2b7c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33200/0 (socket says 172.21.15.64:33200) 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 -- 172.21.15.64:0/4164902 learned_addr learned my addr 172.21.15.64:0/4164902 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b93200640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e20ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b89e00640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e20a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 -- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 msgr2=0x559b8e20a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e20a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 -- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 msgr2=0x559b8e20ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e20ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 -- 172.21.15.64:0/4164902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8df5cab0 con 0x559b8dc53460 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b89e00640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e20a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b92800640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2b840046a0 tx=0x7f2b84004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ed423c277ce6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84003e50 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f2b84003ad0 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8c0840d0 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2b84029440 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 10 client.7392 fetch_fsmap learned FSMap version 68 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559b8df3b070 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b8c0840d0 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f2b84027070 con 0x559b8dc53460 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 10 client.7392 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T07:28:14.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 10 client.7392 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 20 client.7392 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc26830 0x559b8e1c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 4 client.7392 mds_command: new command op to 7233 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.291+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 --> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] -- command(tid 0: {"prefix": "status"}) -- 0x559b8dfa4540 con 0x559b8dc26830 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b89e00640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc26830 0x559b8e1c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b77400640 10 client.7392 ms_handle_connect on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b89e00640 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc26830 0x559b8e1c6080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6cab8da93340759 server_cookie=ee9dbac6b02f57c6 in_seq=0 out_seq=0 2024-09-21T07:28:14.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b77400640 1 -- 172.21.15.64:0/4164902 <== mds.0 v2:172.21.15.90:6835/4106969991 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559b8dfa4540 con 0x559b8dc26830 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b77400640 10 client.7392 handle_command_reply: tid=0 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 client.7392 shutdown 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 msgr2=0x559b8e20a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2b840046a0 tx=0x7f2b84004740 comp rx=0 tx=0).stop 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 shutdown_connections 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559b8e043950 0x559b8e20ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559b8e02cca0 0x559b8e20a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x559b8dc26830 0x559b8e1c6080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 --2- 172.21.15.64:0/4164902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b8dc53460 0x559b8e20a3d0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 >> 172.21.15.64:0/4164902 conn(0x559b8e119d90 msgr2=0x559b8e149690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b77400640 0 client.7392 ms_handle_reset on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 shutdown_connections 2024-09-21T07:28:14.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 1 -- 172.21.15.64:0/4164902 wait complete. 2024-09-21T07:28:14.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2ba0c50000 20 client.7392 trim_cache size 0 max 16384 2024-09-21T07:28:14.307 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:14.307 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:28:14.307 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 7233, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.813687128, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 68, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 99, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 99, 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.966300588999999 2024-09-21T07:28:14.308 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 msgr2=0x7f2b70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 0x7f2b70075710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009c00 tx=0x7f2b84005f40 comp rx=0 tx=0).stop 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 msgr2=0x7f2b940cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 0x7f2b940cd120 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b4dd0 tx=0x7f2b8c0129e0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 shutdown_connections 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b70073200 0x7f2b70075710 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b940b2010 0x7f2b940cd120 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9415d650 0x7f2b940b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 --2- 172.21.15.64:0/3912523467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b78004810 0x7f2b940b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 >> 172.21.15.64:0/3912523467 conn(0x7f2b9406d450 msgr2=0x7f2b940c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 shutdown_connections 2024-09-21T07:28:14.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.295+0000 7f2b99400640 1 -- 172.21.15.64:0/3912523467 wait complete. 2024-09-21T07:28:14.317 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:28:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- 172.21.15.64:0/1480315681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 msgr2=0x7f8728003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 --2- 172.21.15.64:0/1480315681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8728003ef0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8734005fd0 tx=0x7f873401cda0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8746600640 1 -- 172.21.15.64:0/1480315681 reap_dead start 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- 172.21.15.64:0/1480315681 shutdown_connections 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- 172.21.15.64:0/1480315681 >> 172.21.15.64:0/1480315681 conn(0x7f87400ccbe0 msgr2=0x7f87400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- 172.21.15.64:0/1480315681 shutdown_connections 2024-09-21T07:28:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- 172.21.15.64:0/1480315681 wait complete. 2024-09-21T07:28:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 Processor -- start 2024-09-21T07:28:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.475+0000 7f8748600640 1 -- start start 2024-09-21T07:28:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874015c200 0x7f87400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87400b0560 0x7f87400b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f87400b38f0 con 0x7f8728003a80 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87400b3770 con 0x7f874015c200 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f87400b3a70 con 0x7f87400b0560 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33212/0 (socket says 172.21.15.64:33212) 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 -- 172.21.15.64:0/1151720832 learned_addr learned my addr 172.21.15.64:0/1151720832 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745200640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874015c200 0x7f87400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8746600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87400b0560 0x7f87400b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 -- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87400b0560 msgr2=0x7f87400b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87400b0560 0x7f87400b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 -- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874015c200 msgr2=0x7f87400b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874015c200 0x7f87400b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 -- 172.21.15.64:0/1151720832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874015bdc0 con 0x7f8728003a80 2024-09-21T07:28:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8745c00640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f873401cbd0 tx=0x7f8734005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340ab040 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87340a5990 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874009ca00 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734004280 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874009cfc0 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.479+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8740072e20 con 0x7f8728003a80 2024-09-21T07:28:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.483+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f87340c0020 con 0x7f8728003a80 2024-09-21T07:28:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.483+0000 7f873d600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 0x7f8720075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.483+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f873412ee20 con 0x7f8728003a80 2024-09-21T07:28:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.483+0000 7f8745200640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 0x7f8720075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.483+0000 7f8745200640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 0x7f8720075710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f872c001970 tx=0x7f872c001900 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:14.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.487+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8734016ab0 con 0x7f8728003a80 2024-09-21T07:28:14.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f874009da20 con 0x7f8728003a80 2024-09-21T07:28:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f873d600640 1 -- 172.21.15.64:0/1151720832 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f87340f9c20 con 0x7f8728003a80 2024-09-21T07:28:14.705 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:28:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 msgr2=0x7f8720075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 0x7f8720075710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f872c001970 tx=0x7f872c001900 comp rx=0 tx=0).stop 2024-09-21T07:28:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 msgr2=0x7f8740158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f873401cbd0 tx=0x7f8734005640 comp rx=0 tx=0).stop 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 shutdown_connections 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8720073200 0x7f8720075710 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87400b0560 0x7f87400b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874015c200 0x7f87400b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 --2- 172.21.15.64:0/1151720832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8728003a80 0x7f8740158650 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.703+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 >> 172.21.15.64:0/1151720832 conn(0x7f87400ccbe0 msgr2=0x7f874015f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.707+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 shutdown_connections 2024-09-21T07:28:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14.707+0000 7f8748600640 1 -- 172.21.15.64:0/1151720832 wait complete. 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:28:14.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:28:14.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:14.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:14.728 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.737 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42089sec preferred_lft 42089sec 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.738 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.739 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:28:14.740 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:28:14.740 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:28:14.740 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:14.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:14.741 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:28:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:28:14.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:14.803 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:28:14.854 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:28:14.854 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:28:14.854 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:28:14.854 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:14.855 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:28:14.855 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:28:14.855 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:28:14.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:28:14.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:28:14.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:28:14.856 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:28:14.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:28:14.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:14.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:14.991 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:28:15.000 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:28:15.000 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:28:15.001 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:15.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:15.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:28:15.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:28:15.063 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:15.115 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:15.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:28:15.115 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:15.166 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:28:15.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:15.166 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:15.268 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:15.268 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:28:15.283 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:15.283 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:28:15.283 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:28:15.283 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:28:15.284 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:28:15.286 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:28:15.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:15.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:15.307 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:28:15.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:28:15.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:15.421 INFO:teuthology.orchestra.run.smithi064.stdout:client6560 2024-09-21T07:28:15.422 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:15.422 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:15.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:15.431 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-21T07:28:15.491 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:28:15.492 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:28:15.492 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:28:15.492 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:28:15.492 DEBUG:teuthology.orchestra.run.smithi064:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-21T07:28:15.492 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:28:15.601 INFO:teuthology.orchestra.run.smithi064.stdout:1099511627776 2024-09-21T07:28:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:15.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:15.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 -- 172.21.15.64:0/2908095380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 msgr2=0x7f4394005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 --2- 172.21.15.64:0/2908095380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f4394005160 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f43b0160190 tx=0x7f43a801cf20 comp rx=0 tx=0).stop 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43afe00640 1 -- 172.21.15.64:0/2908095380 reap_dead start 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 -- 172.21.15.64:0/2908095380 shutdown_connections 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 -- 172.21.15.64:0/2908095380 >> 172.21.15.64:0/2908095380 conn(0x7f43b00ccbe0 msgr2=0x7f43b00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 -- 172.21.15.64:0/2908095380 shutdown_connections 2024-09-21T07:28:15.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.815+0000 7f43b6200640 1 -- 172.21.15.64:0/2908095380 wait complete. 2024-09-21T07:28:15.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 Processor -- start 2024-09-21T07:28:15.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 -- start start 2024-09-21T07:28:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 0x7f43b01581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43b00c9a30 0x7f43b0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00cc770 con 0x7f4394004d50 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00cc5f0 con 0x7f43b00c9620 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43b6200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00cc8f0 con 0x7f43b00c9a30 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46566/0 (socket says 172.21.15.64:46566) 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 -- 172.21.15.64:0/9281009 learned_addr learned my addr 172.21.15.64:0/9281009 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43afe00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43b00c9a30 0x7f43b0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:15.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43a6a00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 0x7f43b01581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:15.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 -- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43b00c9a30 msgr2=0x7f43b0155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43b00c9a30 0x7f43b0155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 -- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 msgr2=0x7f43b01581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 0x7f43b01581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43af400640 1 -- 172.21.15.64:0/9281009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b009dcd0 con 0x7f4394004d50 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.819+0000 7f43a6a00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 0x7f43b01581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43af400640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f43a0011dc0 tx=0x7f43a000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a000fea0 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43a0003980 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0003db0 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b00c8580 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b00c8b40 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b0070310 con 0x7f4394004d50 2024-09-21T07:28:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f43a0004030 con 0x7f4394004d50 2024-09-21T07:28:15.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 0x7f438c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:15.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.823+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f43a0095240 con 0x7f4394004d50 2024-09-21T07:28:15.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.827+0000 7f43a6a00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 0x7f438c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:15.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.827+0000 7f43a6a00640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 0x7f438c075740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f43b009df70 tx=0x7f43980091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:15.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:15.827+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f43a005fa70 con 0x7f4394004d50 2024-09-21T07:28:16.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.043+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43b009dfa0 con 0x7f4394004d50 2024-09-21T07:28:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.043+0000 7f43a7e00640 1 -- 172.21.15.64:0/9281009 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5222 (secure 0 0 0) 0x7f43a00644a0 con 0x7f4394004d50 2024-09-21T07:28:16.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:16.045 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":68,"btime":"2024-09-21T07:28:06:516570+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6434,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1949078533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1949078533},{"type":"v1","addr":"172.21.15.64:6834","nonce":1949078533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6437,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/311810591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":311810591},{"type":"v1","addr":"172.21.15.64:6835","nonce":311810591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2030244673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2030244673},{"type":"v1","addr":"172.21.15.90:6836","nonce":2030244673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:05.941571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7233":{"gid":7233,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/4106969991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":4106969991},{"type":"v1","addr":"172.21.15.90:6837","nonce":4106969991}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7233,"qdb_cluster":[7233]},"id":6}]} 2024-09-21T07:28:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 68 2024-09-21T07:28:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 msgr2=0x7f438c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 0x7f438c075740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f43b009df70 tx=0x7f43980091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 msgr2=0x7f43b00ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f43a0011dc0 tx=0x7f43a000f790 comp rx=0 tx=0).stop 2024-09-21T07:28:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 shutdown_connections 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f438c073230 0x7f438c075740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43b00c9a30 0x7f43b0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43b00c9620 0x7f43b01581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 --2- 172.21.15.64:0/9281009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4394004d50 0x7f43b00ad7f0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 >> 172.21.15.64:0/9281009 conn(0x7f43b00ccbe0 msgr2=0x7f43b0074860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 shutdown_connections 2024-09-21T07:28:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.047+0000 7f43b6200640 1 -- 172.21.15.64:0/9281009 wait complete. 2024-09-21T07:28:16.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump inode 1099511627776 2024-09-21T07:28:16.244 INFO:teuthology.orchestra.run.smithi090.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:28:15.483438+0000","btime":"2024-09-21T07:28:15.483438+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:28:15.483438+0000","atime":"2024-09-21T07:28:15.483438+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6560,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6560,"want_loner":6560,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:28:16.244 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:28:15.483438+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-21T07:28:15.483438+0000", "change_attr": 0, "client_caps": [ { "client_id": 6560, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-21T07:28:15.483438+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6560, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:28:15.483438+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6560, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-21T07:28:16.245 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:16.245 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> import uuid 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> n = 21 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = False 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> if 0 > 0: 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = True 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:28:16.254 DEBUG:teuthology.orchestra.run.smithi064:> dpath = os.path.dirname(path) 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> fnameprefix = os.path.basename(path) 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> for i in range(n): 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> f.write(f"{i}") 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> f.flush() 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(f.fileno()) 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:28:16.255 DEBUG:teuthology.orchestra.run.smithi064:> os.unlink(fpath) 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> if create_hard_links: 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> for j in range(0): 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> finally: 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> os.close(dirfd) 2024-09-21T07:28:16.256 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:28:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:16.409 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:16.409 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:16.459 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:16.459 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:16.513 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 -- 172.21.15.64:0/2537916313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 msgr2=0x7f80c006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 --2- 172.21.15.64:0/2537916313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c006f590 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009bc0 tx=0x7f80b801cba0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 -- 172.21.15.64:0/2537916313 shutdown_connections 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 --2- 172.21.15.64:0/2537916313 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c006f590 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 -- 172.21.15.64:0/2537916313 >> 172.21.15.64:0/2537916313 conn(0x7f80c006d450 msgr2=0x7f80c00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 -- 172.21.15.64:0/2537916313 shutdown_connections 2024-09-21T07:28:16.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.715+0000 7f80c5600640 1 -- 172.21.15.64:0/2537916313 wait complete. 2024-09-21T07:28:16.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 Processor -- start 2024-09-21T07:28:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- start start 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c00d0e60 0x7f80c0163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c00cbab0 0x7f80c00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80c016b0b0 con 0x7f80c00b4de0 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80c016af30 con 0x7f80c00d0e60 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f80c016b230 con 0x7f80c00cbab0 2024-09-21T07:28:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46586/0 (socket says 172.21.15.64:46586) 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 -- 172.21.15.64:0/2312275652 learned_addr learned my addr 172.21.15.64:0/2312275652 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80b7e00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c00d0e60 0x7f80c0163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bf400640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c00cbab0 0x7f80c00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 -- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c00cbab0 msgr2=0x7f80c00cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c00cbab0 0x7f80c00cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 -- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c00d0e60 msgr2=0x7f80c0163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c00d0e60 0x7f80c0163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 -- 172.21.15.64:0/2312275652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c00caa10 con 0x7f80c00b4de0 2024-09-21T07:28:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80bea00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c3a0 tx=0x7f80b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0017070 con 0x7f80c00b4de0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80b00053c0 con 0x7f80c00b4de0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b00038b0 con 0x7f80c00b4de0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c00cacf0 con 0x7f80c00b4de0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.719+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c00cb2b0 con 0x7f80c00b4de0 2024-09-21T07:28:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c00cc400 con 0x7f80c00b4de0 2024-09-21T07:28:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f80b001a070 con 0x7f80c00b4de0 2024-09-21T07:28:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80b6a00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 0x7f809c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f80b00937a0 con 0x7f80c00b4de0 2024-09-21T07:28:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80b7e00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 0x7f809c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:16.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.723+0000 7f80b7e00640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 0x7f809c075710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ca940 tx=0x7f80a8007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:16.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.727+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f80b005dfd0 con 0x7f80c00b4de0 2024-09-21T07:28:16.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.915+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f80c00ccd00 con 0x7f80c00b4de0 2024-09-21T07:28:16.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.915+0000 7f80b6a00640 1 -- 172.21.15.64:0/2312275652 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) ==== 80+0+0 (secure 0 0 0) 0x7f80b0062a00 con 0x7f80c00b4de0 2024-09-21T07:28:16.918 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 msgr2=0x7f809c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 0x7f809c075710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ca940 tx=0x7f80a8007ea0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 msgr2=0x7f80c00c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c3a0 tx=0x7f80b000c860 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 shutdown_connections 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f809c073200 0x7f809c075710 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c00cbab0 0x7f80c00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c00d0e60 0x7f80c0163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 --2- 172.21.15.64:0/2312275652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00b4de0 0x7f80c00c7e90 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 >> 172.21.15.64:0/2312275652 conn(0x7f80c006d450 msgr2=0x7f80c00b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:16.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 shutdown_connections 2024-09-21T07:28:16.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:16.919+0000 7f80c5600640 1 -- 172.21.15.64:0/2312275652 wait complete. 2024-09-21T07:28:16.940 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:28:16.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:16.940 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:17.031 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:28:17.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:17.031 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:28:17.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-21T07:28:17.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 -- 172.21.15.64:0/3343027380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf40cdd30 msgr2=0x7f3bf40b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 --2- 172.21.15.64:0/3343027380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf40cdd30 0x7f3bf40b1be0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b3f0 tx=0x7f3be401cfa0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 -- 172.21.15.64:0/3343027380 shutdown_connections 2024-09-21T07:28:17.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 --2- 172.21.15.64:0/3343027380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf406f5b0 0x7f3bf41654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 --2- 172.21.15.64:0/3343027380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf40cdd30 0x7f3bf40b1be0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 -- 172.21.15.64:0/3343027380 >> 172.21.15.64:0/3343027380 conn(0x7f3bf40ccbe0 msgr2=0x7f3bf40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 -- 172.21.15.64:0/3343027380 shutdown_connections 2024-09-21T07:28:17.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.247+0000 7f3bfb800640 1 -- 172.21.15.64:0/3343027380 wait complete. 2024-09-21T07:28:17.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 Processor -- start 2024-09-21T07:28:17.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 -- start start 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 0x7f3bf40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 0x7f3bf40cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf41696e0 con 0x7f3bf406f5b0 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4169560 con 0x7f3bf40b2120 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bfb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf4169860 con 0x7f3bf40cdd30 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46614/0 (socket says 172.21.15.64:46614) 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 -- 172.21.15.64:0/2277421735 learned_addr learned my addr 172.21.15.64:0/2277421735 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 0x7f3bf40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf9800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 0x7f3bf40cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 -- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 msgr2=0x7f3bf40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 0x7f3bf40cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 -- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 msgr2=0x7f3bf40cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 0x7f3bf40cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 -- 172.21.15.64:0/2277421735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf40cc960 con 0x7f3bf406f5b0 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 0x7f3bf40cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf9800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 0x7f3bf40cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.251+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3be401d840 tx=0x7f3be40092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 -- 172.21.15.64:0/2277421735 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be40b2040 con 0x7f3bf406f5b0 2024-09-21T07:28:17.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 -- 172.21.15.64:0/2277421735 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3be40097b0 con 0x7f3bf406f5b0 2024-09-21T07:28:17.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 -- 172.21.15.64:0/2277421735 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4003860 con 0x7f3bf406f5b0 2024-09-21T07:28:17.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf41543a0 con 0x7f3bf406f5b0 2024-09-21T07:28:17.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf409c330 con 0x7f3bf406f5b0 2024-09-21T07:28:17.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 -- 172.21.15.64:0/2277421735 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3be40bf060 con 0x7f3bf406f5b0 2024-09-21T07:28:17.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 0x7f3bd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.255+0000 7f3bf1600640 1 -- 172.21.15.64:0/2277421735 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f3be412dfe0 con 0x7f3bf406f5b0 2024-09-21T07:28:17.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 0x7f3bd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 Processor -- start 2024-09-21T07:28:17.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 -- start start 2024-09-21T07:28:17.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 0x7f3bd0075740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4156d80 tx=0x7f3bdc008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a09b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a09ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ef89f35ce0 con 0x55ef89b61890 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef89e2b330 con 0x55ef89c25aa0 2024-09-21T07:28:17.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ef89e88bb0 con 0x55ef89f2a6e0 2024-09-21T07:28:17.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46630/0 (socket says 172.21.15.64:46630) 2024-09-21T07:28:17.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 -- 172.21.15.64:0/1254169589 learned_addr learned my addr 172.21.15.64:0/1254169589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a09b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bf9800640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a09ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 -- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 msgr2=0x55ef8a09b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a09b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 -- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 msgr2=0x55ef8a09ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a09ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 -- 172.21.15.64:0/1254169589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef89e2cc80 con 0x55ef89b61890 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bf9800640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a09ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:17.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3bebe00640 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d830 tx=0x7f3bdc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd9421d61b4078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3be9600640 1 -- 172.21.15.64:0/1254169589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc024070 con 0x55ef89b61890 2024-09-21T07:28:17.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3be9600640 1 -- 172.21.15.64:0/1254169589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bdc0149b0 con 0x55ef89b61890 2024-09-21T07:28:17.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.259+0000 7f3be9600640 1 -- 172.21.15.64:0/1254169589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc014d60 con 0x55ef89b61890 2024-09-21T07:28:17.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- 172.21.15.64:0/1254169589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 msgr2=0x55ef8a09b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d830 tx=0x7f3bdc010000 comp rx=0 tx=0).stop 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- 172.21.15.64:0/1254169589 shutdown_connections 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a09ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a09b540 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- 172.21.15.64:0/1254169589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a09b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- 172.21.15.64:0/1254169589 >> 172.21.15.64:0/1254169589 conn(0x55ef89b355c0 msgr2=0x55ef8a053af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- 172.21.15.64:0/1254169589 shutdown_connections 2024-09-21T07:28:17.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- 172.21.15.64:0/1254169589 wait complete. 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- start start 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 Processor -- start 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89b61890 0x55ef8a05ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a05d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ef89e7bdf0 con 0x55ef89c25aa0 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef89e77fe0 con 0x55ef89b61890 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ef89e1d4d0 con 0x55ef89f2a6e0 2024-09-21T07:28:17.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3c02e91000 10 client.0 _ll_register_callbacks cb 0x55ef89dfb7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46646/0 (socket says 172.21.15.64:46646) 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bebe00640 1 -- 172.21.15.64:0/3251396562 learned_addr learned my addr 172.21.15.64:0/3251396562 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89b61890 0x55ef8a05ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bf9800640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a05d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bebe00640 1 -- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 msgr2=0x55ef8a05d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.263+0000 7f3bebe00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a05d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bebe00640 1 -- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89b61890 msgr2=0x55ef8a05ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bebe00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89b61890 0x55ef8a05ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bebe00640 1 -- 172.21.15.64:0/3251396562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef89e16210 con 0x55ef89c25aa0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bebe00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc022040 tx=0x7f3bdc015ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415c2f1090bc55e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:17.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc024040 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef89e10350 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f3bdc02a450 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f3bdc015e10 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 10 client.7425 fetch_fsmap learned FSMap version 68 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ef89dfcfc0 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ef89e10350 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f3bdc013070 con 0x55ef89c25aa0 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 10 client.7425 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 10 client.7425 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 20 client.7425 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b1a930 0x55ef8a05e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 4 client.7425 mds_command: new command op to 7233 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:28:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 --> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef89e8ab00 con 0x55ef89b1a930 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b1a930 0x55ef8a05e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b1a930 0x55ef8a05e140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dd65c1d911bc3ff server_cookie=a152ef7612854cc7 in_seq=0 out_seq=0 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 10 client.7425 ms_handle_connect on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 1 -- 172.21.15.64:0/3251396562 <== mds.0 v2:172.21.15.90:6835/4106969991 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef89e8ab00 con 0x55ef89b1a930 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 10 client.7425 handle_command_reply: tid=0 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 client.7425 shutdown 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 msgr2=0x55ef8a05d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc022040 tx=0x7f3bdc015ca0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 shutdown_connections 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a05d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b1a930 0x55ef8a05e140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a05d1f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3251396562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89b61890 0x55ef8a05ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3be2000640 0 client.7425 ms_handle_reset on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 >> 172.21.15.64:0/3251396562 conn(0x55ef89b355c0 msgr2=0x55ef8a04b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 shutdown_connections 2024-09-21T07:28:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 1 -- 172.21.15.64:0/3251396562 wait complete. 2024-09-21T07:28:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.267+0000 7f3c02e91000 20 client.7425 trim_cache size 0 max 16384 2024-09-21T07:28:17.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.283+0000 7f3c02e91000 1 Processor -- start 2024-09-21T07:28:17.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.283+0000 7f3c02e91000 1 -- start start 2024-09-21T07:28:17.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a0526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4201d70 con 0x55ef89b61890 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40ae1f0 con 0x55ef89c25aa0 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf4154090 con 0x55ef89f2a6e0 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46650/0 (socket says 172.21.15.64:46650) 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 -- 172.21.15.64:0/3322194497 learned_addr learned my addr 172.21.15.64:0/3322194497 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bebe00640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a0526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf9800640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 -- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 msgr2=0x55ef8a0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a0ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 -- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 msgr2=0x55ef8a0526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a0526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 -- 172.21.15.64:0/3322194497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef89ef5690 con 0x55ef89b61890 2024-09-21T07:28:17.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bebe00640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a0526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:17.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3be40f5a90 tx=0x7f3be401cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3c47a6221a6c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3be8c00640 1 -- 172.21.15.64:0/3322194497 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4116030 con 0x55ef89b61890 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3be8c00640 1 -- 172.21.15.64:0/3322194497 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3be40f8f20 con 0x55ef89b61890 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3be8c00640 1 -- 172.21.15.64:0/3322194497 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be40f8820 con 0x55ef89b61890 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- 172.21.15.64:0/3322194497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 msgr2=0x55ef8a052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3be40f5a90 tx=0x7f3be401cfa0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- 172.21.15.64:0/3322194497 shutdown_connections 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89f2a6e0 0x55ef8a0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89c25aa0 0x55ef8a0526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 --2- 172.21.15.64:0/3322194497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89b61890 0x55ef8a052160 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- 172.21.15.64:0/3322194497 >> 172.21.15.64:0/3322194497 conn(0x55ef89b355c0 msgr2=0x55ef8a04c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- 172.21.15.64:0/3322194497 shutdown_connections 2024-09-21T07:28:17.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- 172.21.15.64:0/3322194497 wait complete. 2024-09-21T07:28:17.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.287+0000 7f3c02e91000 1 -- start start 2024-09-21T07:28:17.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 Processor -- start 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89b61890 0x55ef8a1109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89f2a6e0 0x55ef8a111450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ef89e72ee0 con 0x55ef89c25aa0 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef89e40610 con 0x55ef89f2a6e0 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ef89e7b100 con 0x55ef89b61890 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 10 client.0 _ll_register_callbacks cb 0x7f3bdc022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46652/0 (socket says 172.21.15.64:46652) 2024-09-21T07:28:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 -- 172.21.15.64:0/2122986891 learned_addr learned my addr 172.21.15.64:0/2122986891 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89b61890 0x55ef8a1109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bf9800640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89f2a6e0 0x55ef8a111450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 -- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89b61890 msgr2=0x55ef8a1109d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89b61890 0x55ef8a1109d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 -- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89f2a6e0 msgr2=0x55ef8a111450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89f2a6e0 0x55ef8a111450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 -- 172.21.15.64:0/2122986891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef89e420b0 con 0x55ef89c25aa0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bebe00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc022040 tx=0x7f3bdc009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d6c2c09dbed403 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc03f070 con 0x55ef89c25aa0 2024-09-21T07:28:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f3bdc014b50 con 0x55ef89c25aa0 2024-09-21T07:28:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3be40f8f20 con 0x55ef89c25aa0 2024-09-21T07:28:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f3bdc047050 con 0x55ef89c25aa0 2024-09-21T07:28:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 10 client.7431 fetch_fsmap learned FSMap version 68 2024-09-21T07:28:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ef89e0e610 con 0x55ef89c25aa0 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3be40f8f20 con 0x55ef89c25aa0 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f3bdc04a020 con 0x55ef89c25aa0 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 10 client.7431 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 10 client.7431 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 20 client.7431 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b08990 0x55ef8a0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 4 client.7431 mds_command: new command op to 7233 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 --> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ef89e865b0 con 0x55ef89b08990 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.291+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b08990 0x55ef8a0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.295+0000 7f3bf8e00640 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b08990 0x55ef8a0b05b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47dedf42d2ace10a server_cookie=624ea86eaaeee886 in_seq=0 out_seq=0 2024-09-21T07:28:17.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.295+0000 7f3be2000640 10 client.7431 ms_handle_connect on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3be2000640 1 -- 172.21.15.64:0/2122986891 <== mds.0 v2:172.21.15.90:6835/4106969991 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ef89e865b0 con 0x55ef89b08990 2024-09-21T07:28:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3be2000640 10 client.7431 handle_command_reply: tid=0 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 client.7431 shutdown 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 msgr2=0x55ef8a110f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc022040 tx=0x7f3bdc009eb0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 shutdown_connections 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89f2a6e0 0x55ef8a111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:6835/4106969991,v1:172.21.15.90:6837/4106969991] conn(0x55ef89b08990 0x55ef8a0b05b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ef89c25aa0 0x55ef8a110f10 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 --2- 172.21.15.64:0/2122986891 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ef89b61890 0x55ef8a1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3be2000640 0 client.7431 ms_handle_reset on v2:172.21.15.90:6835/4106969991 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 >> 172.21.15.64:0/2122986891 conn(0x55ef89b355c0 msgr2=0x55ef8a051150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 shutdown_connections 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 1 -- 172.21.15.64:0/2122986891 wait complete. 2024-09-21T07:28:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3c02e91000 20 client.7431 trim_cache size 0 max 16384 2024-09-21T07:28:17.310 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:17.310 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:28:17.310 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:28:17.310 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 msgr2=0x7f3bd0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 0x7f3bd0075740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4156d80 tx=0x7f3bdc008040 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 msgr2=0x7f3bf4151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3be401d840 tx=0x7f3be40092b0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 shutdown_connections 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3bd0073230 0x7f3bd0075740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bf40cdd30 0x7f3bf40cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bf40b2120 0x7f3bf40cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 --2- 172.21.15.64:0/2277421735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bf406f5b0 0x7f3bf4151500 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 >> 172.21.15.64:0/2277421735 conn(0x7f3bf40ccbe0 msgr2=0x7f3bf4155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 shutdown_connections 2024-09-21T07:28:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.307+0000 7f3bfb800640 1 -- 172.21.15.64:0/2277421735 wait complete. 2024-09-21T07:28:17.329 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:28:17.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:17.329 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:28:17.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:17.330 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:28:17.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:17.330 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:28:17.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:17.343 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:28:17.344 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-21T07:28:17.345 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:28:17.345 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-21T07:28:17.347 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:28:17.347 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-21T07:28:17.348 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:28:17.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-21T07:28:17.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 -- 172.21.15.64:0/720854235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c00b2b10 msgr2=0x7f97c00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 --2- 172.21.15.64:0/720854235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c00b2b10 0x7f97c00b2f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009900 tx=0x7f97b001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 -- 172.21.15.64:0/720854235 shutdown_connections 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 --2- 172.21.15.64:0/720854235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c00b2b10 0x7f97c00b2f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 --2- 172.21.15.64:0/720854235 >> v2:172.21.15.90:3300/0 conn(0x7f97c015c2c0 0x7f97c015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 -- 172.21.15.64:0/720854235 >> 172.21.15.64:0/720854235 conn(0x7f97c00d1010 msgr2=0x7f97c00d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 -- 172.21.15.64:0/2217123724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7244072e20 msgr2=0x7f724409ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 --2- 172.21.15.64:0/2217123724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7244072e20 0x7f724409ddd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f72440c3b50 tx=0x7f723401c750 comp rx=0 tx=0).stop 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 -- 172.21.15.64:0/720854235 shutdown_connections 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 -- 172.21.15.64:0/2217123724 shutdown_connections 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 --2- 172.21.15.64:0/2217123724 >> v2:172.21.15.90:3300/0 conn(0x7f724406fe90 0x7f72440cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 --2- 172.21.15.64:0/2217123724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7244072e20 0x7f724409ddd0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 -- 172.21.15.64:0/2217123724 >> 172.21.15.64:0/2217123724 conn(0x7f724406d450 msgr2=0x7f72440d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f97c7200640 1 -- 172.21.15.64:0/720854235 wait complete. 2024-09-21T07:28:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 -- 172.21.15.64:0/2217123724 shutdown_connections 2024-09-21T07:28:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.555+0000 7f7249200640 1 -- 172.21.15.64:0/2217123724 wait complete. 2024-09-21T07:28:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 -- 172.21.15.64:0/3980264175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 msgr2=0x7f5b0c09ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 --2- 172.21.15.64:0/3980264175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c09ddd0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009900 tx=0x7f5af801c850 comp rx=0 tx=0).stop 2024-09-21T07:28:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 -- 172.21.15.64:0/3980264175 shutdown_connections 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 --2- 172.21.15.64:0/3980264175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c09ddd0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 -- 172.21.15.64:0/3980264175 >> 172.21.15.64:0/3980264175 conn(0x7f5b0c06d450 msgr2=0x7f5b0c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 -- 172.21.15.64:0/3980264175 shutdown_connections 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f5b12a00640 1 -- 172.21.15.64:0/3980264175 wait complete. 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f97c7200640 1 Processor -- start 2024-09-21T07:28:17.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f97c7200640 1 -- start start 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f7249200640 1 Processor -- start 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.559+0000 7f7249200640 1 -- start start 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 Processor -- start 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c00b2b10 0x7f97c00b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c015c2c0 0x7f97c01f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01689e0 con 0x7f97c00ceb50 2024-09-21T07:28:17.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0168860 con 0x7f97c00b2b10 2024-09-21T07:28:17.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 -- start start 2024-09-21T07:28:17.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c7200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f97c0168b60 con 0x7f97c015c2c0 2024-09-21T07:28:17.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 -- 172.21.15.64:0/2969956021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6890074ad0 msgr2=0x7f689006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 --2- 172.21.15.64:0/2969956021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6890074ad0 0x7f689006cdf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6884009840 tx=0x7f688401c790 comp rx=0 tx=0).stop 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46686/0 (socket says 172.21.15.64:46686) 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 -- 172.21.15.64:0/776778832 learned_addr learned my addr 172.21.15.64:0/776778832 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 -- 172.21.15.64:0/2969956021 shutdown_connections 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 --2- 172.21.15.64:0/2969956021 >> v2:172.21.15.90:3300/0 conn(0x7f689015f820 0x7f6890071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 --2- 172.21.15.64:0/2969956021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6890074ad0 0x7f689006cdf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 -- 172.21.15.64:0/2969956021 >> 172.21.15.64:0/2969956021 conn(0x7f68900b2db0 msgr2=0x7f68900b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 -- 172.21.15.64:0/2969956021 shutdown_connections 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c6800640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c015c2c0 0x7f97c01f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 -- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c015c2c0 msgr2=0x7f97c01f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c015c2c0 0x7f97c01f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 -- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c00b2b10 msgr2=0x7f97c00b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c00b2b10 0x7f97c00b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 -- 172.21.15.64:0/776778832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c00ce500 con 0x7f97c00ceb50 2024-09-21T07:28:17.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f6898600640 1 -- 172.21.15.64:0/2969956021 wait complete. 2024-09-21T07:28:17.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72440af610 0x7f7244143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7244168000 con 0x7f724406fe90 2024-09-21T07:28:17.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7244167e80 con 0x7f72440af610 2024-09-21T07:28:17.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7249200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7244168180 con 0x7f7244072e20 2024-09-21T07:28:17.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f97c5400640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009850 tx=0x7f97b00a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46696/0 (socket says 172.21.15.64:46696) 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:57910/0 (socket says 172.21.15.64:57910) 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7242800640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72440af610 0x7f7244143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 -- 172.21.15.64:0/3237575092 learned_addr learned my addr 172.21.15.64:0/3237575092 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c1fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 0x7f5b0c0ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c16a0c0 con 0x7f5b0c06fe90 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c169f40 con 0x7f5b0c072e20 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b12a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c16a240 con 0x7f5b0c0af610 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:42632/0 (socket says 172.21.15.64:42632) 2024-09-21T07:28:17.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 -- 172.21.15.64:0/2754229311 learned_addr learned my addr 172.21.15.64:0/2754229311 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 -- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 msgr2=0x7f72441433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 -- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72440af610 msgr2=0x7f7244143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72440af610 0x7f7244143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 -- 172.21.15.64:0/3237575092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440b2820 con 0x7f724406fe90 2024-09-21T07:28:17.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241400640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b10a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 0x7f5b0c0ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0be00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c1fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f7241e00640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7234000c10 tx=0x7f72340a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 -- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 msgr2=0x7f5b0c0ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 0x7f5b0c0ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 -- 172.21.15.64:0/2754229311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 msgr2=0x7f5b0c1fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c1fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 -- 172.21.15.64:0/2754229311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c15cc60 con 0x7f5b0c072e20 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b10a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 0x7f5b0c0ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:17.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.563+0000 7f5b0b400640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b0040 tx=0x7f5af80a5600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af80b2040 con 0x7f5b0c072e20 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5af80042c0 con 0x7f5b0c072e20 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8005030 con 0x7f5b0c072e20 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c15cf40 con 0x7f5b0c072e20 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c150f10 con 0x7f5b0c072e20 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340bb070 con 0x7f724406fe90 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72441438f0 con 0x7f724406fe90 2024-09-21T07:28:17.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72440b1520 con 0x7f724406fe90 2024-09-21T07:28:17.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00b2040 con 0x7f97c00ceb50 2024-09-21T07:28:17.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97b00043b0 con 0x7f97c00ceb50 2024-09-21T07:28:17.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00b2040 con 0x7f97c00ceb50 2024-09-21T07:28:17.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7234005030 con 0x7f724406fe90 2024-09-21T07:28:17.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340b2040 con 0x7f724406fe90 2024-09-21T07:28:17.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f6898600640 1 Processor -- start 2024-09-21T07:28:17.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f6898600640 1 -- start start 2024-09-21T07:28:17.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c00b40d0 con 0x7f97c00ceb50 2024-09-21T07:28:17.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c00b43b0 con 0x7f97c00ceb50 2024-09-21T07:28:17.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c09ddd0 con 0x7f5b0c072e20 2024-09-21T07:28:17.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c0052a0 con 0x7f724406fe90 2024-09-21T07:28:17.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c00b2f20 con 0x7f97c00ceb50 2024-09-21T07:28:17.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f6898600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f689006d330 0x7f68900b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f6898600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.567+0000 7f6898600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 0x7f68901fc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f689016c530 con 0x7f689006d330 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f689016c3b0 con 0x7f6890074ad0 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f689016c6b0 con 0x7f689015f820 2024-09-21T07:28:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5af80051f0 con 0x7f5b0c072e20 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6895200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6895200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:42646/0 (socket says 172.21.15.64:42646) 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6895200640 1 -- 172.21.15.64:0/3905637185 learned_addr learned my addr 172.21.15.64:0/3905637185 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6895c00640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f689006d330 0x7f68900b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 0x7f68901fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 -- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 msgr2=0x7f68900b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 -- 172.21.15.64:0/3905637185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f689006d330 msgr2=0x7f68900b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f689006d330 0x7f68900b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 -- 172.21.15.64:0/3905637185 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68901f9830 con 0x7f689015f820 2024-09-21T07:28:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6895200640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:17.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f72340be070 con 0x7f724406fe90 2024-09-21T07:28:17.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6896600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 0x7f68901fc990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f688800ebf0 tx=0x7f688800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f5b03e00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 0x7f5aec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888003b80 con 0x7f689015f820 2024-09-21T07:28:17.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f5af812e200 con 0x7f5b0c072e20 2024-09-21T07:28:17.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6888003d20 con 0x7f689015f820 2024-09-21T07:28:17.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68901f9b10 con 0x7f689015f820 2024-09-21T07:28:17.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f97b00a59a0 con 0x7f97c00ceb50 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f5b0be00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 0x7f5aec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f723a000640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 0x7f7224075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f723412e0c0 con 0x7f724406fe90 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888004280 con 0x7f689015f820 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68901fa0d0 con 0x7f689015f820 2024-09-21T07:28:17.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68901f95a0 con 0x7f689015f820 2024-09-21T07:28:17.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f7241400640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 0x7f7224075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.571+0000 7f5b0be00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 0x7f5aec075740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000fe0 tx=0x7f5afc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f97ba000640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 0x7f97a4075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f97b012d460 con 0x7f97c00ceb50 2024-09-21T07:28:17.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f97c5e00640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 0x7f97a4075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f7241400640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 0x7f7224075710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72300046c0 tx=0x7f7230007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f97c5e00640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 0x7f97a4075910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f97b400b980 tx=0x7f97b4005cf0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6888004420 con 0x7f689015f820 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f688d600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 0x7f6870075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f6888094fb0 con 0x7f689015f820 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f6895c00640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 0x7f6870075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f6895c00640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 0x7f6870075710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f68840af000 tx=0x7f688401afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:17.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5af80c4060 con 0x7f5b0c072e20 2024-09-21T07:28:17.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.575+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f97b00164d0 con 0x7f97c00ceb50 2024-09-21T07:28:17.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.579+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f688805f750 con 0x7f689015f820 2024-09-21T07:28:17.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.583+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f72340c5080 con 0x7f724406fe90 2024-09-21T07:28:17.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.819+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f97c006dce0 con 0x7f97c00ceb50 2024-09-21T07:28:17.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.823+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f5b0c1fd770 con 0x7f5b0c072e20 2024-09-21T07:28:17.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.827+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f689006cdf0 con 0x7f689015f820 2024-09-21T07:28:17.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:17.843+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f721c005860 con 0x7f724406fe90 2024-09-21T07:28:18.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.575+0000 7f97ba000640 1 -- 172.21.15.64:0/776778832 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6434 v69) ==== 95+0+0 (secure 0 0 0) 0x7f97b00f82e0 con 0x7f97c00ceb50 2024-09-21T07:28:18.578 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6434 2024-09-21T07:28:18.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 msgr2=0x7f97a4075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 0x7f97a4075910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f97b400b980 tx=0x7f97b4005cf0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 msgr2=0x7f97c00cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009850 tx=0x7f97b00a5730 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 shutdown_connections 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97a4073400 0x7f97a4075910 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97c015c2c0 0x7f97c01f90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97c00ceb50 0x7f97c00cdfc0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 --2- 172.21.15.64:0/776778832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c00b2b10 0x7f97c00b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 >> 172.21.15.64:0/776778832 conn(0x7f97c00d1010 msgr2=0x7f97c0150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 shutdown_connections 2024-09-21T07:28:18.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.579+0000 7f97c7200640 1 -- 172.21.15.64:0/776778832 wait complete. 2024-09-21T07:28:18.591 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:28:18.591+0000 7fae8b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:28:18.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f688d600640 1 -- 172.21.15.64:0/3905637185 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7233 v70) ==== 95+0+0 (secure 0 0 0) 0x7f6888064180 con 0x7f689015f820 2024-09-21T07:28:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b03e00640 1 -- 172.21.15.64:0/2754229311 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6437 v70) ==== 95+0+0 (secure 0 0 0) 0x7f5af80164d0 con 0x7f5b0c072e20 2024-09-21T07:28:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 7233 2024-09-21T07:28:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6437 2024-09-21T07:28:18.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 msgr2=0x7f5aec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 0x7f5aec075740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000fe0 tx=0x7f5afc009040 comp rx=0 tx=0).stop 2024-09-21T07:28:18.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 msgr2=0x7f5b0c1509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b0040 tx=0x7f5af80a5600 comp rx=0 tx=0).stop 2024-09-21T07:28:18.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 msgr2=0x7f6870075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 0x7f6870075710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f68840af000 tx=0x7f688401afd0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 msgr2=0x7f68901fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 0x7f68901fc990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f688800ebf0 tx=0x7f688800c6a0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 shutdown_connections 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5aec073230 0x7f5aec075740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b0c0af610 0x7f5b0c0ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c072e20 0x7f5b0c1509d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 --2- 172.21.15.64:0/2754229311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b0c06fe90 0x7f5b0c1fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 >> 172.21.15.64:0/2754229311 conn(0x7f5b0c06d450 msgr2=0x7f5b0c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 shutdown_connections 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6870073200 0x7f6870075710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f689015f820 0x7f68901fc990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6890074ad0 0x7f68900b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 --2- 172.21.15.64:0/3905637185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f689006d330 0x7f68900b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.603+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 shutdown_connections 2024-09-21T07:28:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.599+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 >> 172.21.15.64:0/3905637185 conn(0x7f68900b2db0 msgr2=0x7f68901602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.603+0000 7f5b12a00640 1 -- 172.21.15.64:0/2754229311 wait complete. 2024-09-21T07:28:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.603+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 shutdown_connections 2024-09-21T07:28:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:18.603+0000 7f6898600640 1 -- 172.21.15.64:0/3905637185 wait complete. 2024-09-21T07:28:18.616 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:28:18.616 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:28:18.619 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:28:18.619 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:18.632 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:28:18.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:28:18.634 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:28:18.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:28:18.636 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:28:18.637 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:18.681 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:28:18.681 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:18.720 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:28:18.734 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:28:18.780 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:28:19.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.595+0000 7f723a000640 1 -- 172.21.15.64:0/3237575092 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6970 v71) ==== 95+0+0 (secure 0 0 0) 0x7f72340163d0 con 0x7f724406fe90 2024-09-21T07:28:19.597 INFO:teuthology.orchestra.run.smithi064.stderr:failed mds gid 6970 2024-09-21T07:28:19.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 msgr2=0x7f7224075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 0x7f7224075710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72300046c0 tx=0x7f7230007ea0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 msgr2=0x7f72440b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7234000c10 tx=0x7f72340a5720 comp rx=0 tx=0).stop 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 shutdown_connections 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7224073200 0x7f7224075710 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72440af610 0x7f7244143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7244072e20 0x7f72441433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 --2- 172.21.15.64:0/3237575092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f724406fe90 0x7f72440b22e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 >> 172.21.15.64:0/3237575092 conn(0x7f724406d450 msgr2=0x7f72440ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 shutdown_connections 2024-09-21T07:28:19.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.599+0000 7f7249200640 1 -- 172.21.15.64:0/3237575092 wait complete. 2024-09-21T07:28:19.629 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:28:19.629 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:28:19.633 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:28:19.633 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:19.633 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:19.727 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:28:19.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- 172.21.15.64:0/1179579711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 msgr2=0x7f85240b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 --2- 172.21.15.64:0/1179579711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f85240b1ff0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f85240cb050 tx=0x7f850c01c890 comp rx=0 tx=0).stop 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- 172.21.15.64:0/1179579711 shutdown_connections 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 --2- 172.21.15.64:0/1179579711 >> v2:172.21.15.90:3300/0 conn(0x7f85240cbcd0 0x7f85240cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 --2- 172.21.15.64:0/1179579711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f85240b1ff0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- 172.21.15.64:0/1179579711 >> 172.21.15.64:0/1179579711 conn(0x7f85240ccbe0 msgr2=0x7f85240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- 172.21.15.64:0/1179579711 shutdown_connections 2024-09-21T07:28:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- 172.21.15.64:0/1179579711 wait complete. 2024-09-21T07:28:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 Processor -- start 2024-09-21T07:28:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.831+0000 7f852a400640 1 -- start start 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85240cbcd0 0x7f85240ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852415cbd0 0x7f85240cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85240b41f0 con 0x7f85240b1be0 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85240b4070 con 0x7f852415cbd0 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f85240b4370 con 0x7f85240cbcd0 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46768/0 (socket says 172.21.15.64:46768) 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 -- 172.21.15.64:0/4018758986 learned_addr learned my addr 172.21.15.64:0/4018758986 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:19.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f851be00640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85240cbcd0 0x7f85240ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523e00640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852415cbd0 0x7f85240cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 -- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85240cbcd0 msgr2=0x7f85240ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85240cbcd0 0x7f85240ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 -- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852415cbd0 msgr2=0x7f85240cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852415cbd0 0x7f85240cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 -- 172.21.15.64:0/4018758986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85240c8730 con 0x7f85240b1be0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f8523400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f851400c3f0 tx=0x7f851400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514017070 con 0x7f85240b1be0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85140053c0 con 0x7f85240b1be0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514003860 con 0x7f85240b1be0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85240c8a10 con 0x7f85240b1be0 2024-09-21T07:28:19.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852414ee30 con 0x7f85240b1be0 2024-09-21T07:28:19.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.835+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85240b1ff0 con 0x7f85240b1be0 2024-09-21T07:28:19.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.839+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f851401a070 con 0x7f85240b1be0 2024-09-21T07:28:19.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.839+0000 7f851b400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 0x7f8500075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.839+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f8514093670 con 0x7f85240b1be0 2024-09-21T07:28:19.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.839+0000 7f851be00640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 0x7f8500075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.839+0000 7f851be00640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 0x7f8500075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f850c0af000 tx=0x7f850c0a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:19.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:19.843+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f85240b2530 con 0x7f85240b1be0 2024-09-21T07:28:20.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8524158520 con 0x7f85240b1be0 2024-09-21T07:28:20.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f851b400640 1 -- 172.21.15.64:0/4018758986 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+4392 (secure 0 0 0) 0x7f851405dee0 con 0x7f85240b1be0 2024-09-21T07:28:20.062 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:20.062 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":72,"btime":"2024-09-21T07:28:19:601320+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:19.601297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:replay","state_seq":1,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 72 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 msgr2=0x7f8500075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 0x7f8500075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f850c0af000 tx=0x7f850c0a7040 comp rx=0 tx=0).stop 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 msgr2=0x7f852414e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f851400c3f0 tx=0x7f851400c8b0 comp rx=0 tx=0).stop 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 shutdown_connections 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8500073200 0x7f8500075710 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852415cbd0 0x7f85240cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85240cbcd0 0x7f85240ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:20.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 --2- 172.21.15.64:0/4018758986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240b1be0 0x7f852414e8f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:20.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 >> 172.21.15.64:0/4018758986 conn(0x7f85240ccbe0 msgr2=0x7f85240af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:20.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 shutdown_connections 2024-09-21T07:28:20.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:20.059+0000 7f852a400640 1 -- 172.21.15.64:0/4018758986 wait complete. 2024-09-21T07:28:20.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:28:02.892207+0000', 'modified': '2024-09-21T07:28:19.601297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7470': {'gid': 7470, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/595883067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 595883067}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 595883067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:28:20.486 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7470:up:replay 2024-09-21T07:28:21.487 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:21.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- 172.21.15.64:0/4124580359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d910 msgr2=0x7fd0800b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 --2- 172.21.15.64:0/4124580359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d910 0x7fd0800b4230 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b4ba0 tx=0x7fd07801cd80 comp rx=0 tx=0).stop 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- 172.21.15.64:0/4124580359 shutdown_connections 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 --2- 172.21.15.64:0/4124580359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d910 0x7fd0800b4230 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 --2- 172.21.15.64:0/4124580359 >> v2:172.21.15.90:3300/0 conn(0x7fd08015d500 0x7fd0800b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- 172.21.15.64:0/4124580359 >> 172.21.15.64:0/4124580359 conn(0x7fd08006d530 msgr2=0x7fd0800d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- 172.21.15.64:0/4124580359 shutdown_connections 2024-09-21T07:28:21.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- 172.21.15.64:0/4124580359 wait complete. 2024-09-21T07:28:21.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 Processor -- start 2024-09-21T07:28:21.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.659+0000 7fd087c00640 1 -- start start 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd08015a330 0x7fd0800c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd08015d910 0x7fd0800b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd08016a4e0 con 0x7fd08015d500 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd08016a360 con 0x7fd08015a330 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd08016a660 con 0x7fd08015d910 2024-09-21T07:28:21.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46780/0 (socket says 172.21.15.64:46780) 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 -- 172.21.15.64:0/3752557989 learned_addr learned my addr 172.21.15.64:0/3752557989 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd085200640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd08015a330 0x7fd0800c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd085c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd08015d910 0x7fd0800b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 -- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd08015d910 msgr2=0x7fd0800b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd08015d910 0x7fd0800b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 -- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd08015a330 msgr2=0x7fd0800c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd08015a330 0x7fd0800c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 -- 172.21.15.64:0/3752557989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0800cc1a0 con 0x7fd08015d500 2024-09-21T07:28:21.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd077e00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d980 tx=0x7fd06800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068017070 con 0x7fd08015d500 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd068009d20 con 0x7fd08015d500 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0800b37d0 con 0x7fd08015d500 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068004280 con 0x7fd08015d500 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0800b3a70 con 0x7fd08015d500 2024-09-21T07:28:21.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.663+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0800b7df0 con 0x7fd08015d500 2024-09-21T07:28:21.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.667+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd068005020 con 0x7fd08015d500 2024-09-21T07:28:21.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.667+0000 7fd07d600640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 0x7fd05c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:21.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.667+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7fd0680944e0 con 0x7fd08015d500 2024-09-21T07:28:21.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.667+0000 7fd085200640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 0x7fd05c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:21.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.667+0000 7fd085200640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 0x7fd05c075740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd070007fd0 tx=0x7fd070009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:21.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.671+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd068020030 con 0x7fd08015d500 2024-09-21T07:28:21.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0800d1280 con 0x7fd08015d500 2024-09-21T07:28:21.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd07d600640 1 -- 172.21.15.64:0/3752557989 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5217 (secure 0 0 0) 0x7fd06805ec40 con 0x7fd08015d500 2024-09-21T07:28:21.889 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:21.889 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":74,"btime":"2024-09-21T07:28:21:610880+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:20.612679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-21T07:28:21.889 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 74 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 msgr2=0x7fd05c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 0x7fd05c075740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd070007fd0 tx=0x7fd070009040 comp rx=0 tx=0).stop 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 msgr2=0x7fd0800b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.887+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d980 tx=0x7fd06800de40 comp rx=0 tx=0).stop 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 shutdown_connections 2024-09-21T07:28:21.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd05c073230 0x7fd05c075740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd08015d910 0x7fd0800b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd08015d500 0x7fd0800b6b50 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 --2- 172.21.15.64:0/3752557989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd08015a330 0x7fd0800c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 >> 172.21.15.64:0/3752557989 conn(0x7fd08006d530 msgr2=0x7fd080166160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 shutdown_connections 2024-09-21T07:28:21.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:21.891+0000 7fd087c00640 1 -- 172.21.15.64:0/3752557989 wait complete. 2024-09-21T07:28:22.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:28:02.892207+0000', 'modified': '2024-09-21T07:28:20.612679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7470': {'gid': 7470, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.64:6835/595883067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 595883067}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 595883067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:28:22.315 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7470:up:rejoin 2024-09-21T07:28:23.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:23.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 -- 172.21.15.64:0/2475702053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 msgr2=0x7f0fc00040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2475702053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fc00040e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc006f90 tx=0x7f0fcc01ceb0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fde400640 1 -- 172.21.15.64:0/2475702053 reap_dead start 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 -- 172.21.15.64:0/2475702053 shutdown_connections 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 -- 172.21.15.64:0/2475702053 >> 172.21.15.64:0/2475702053 conn(0x7f0fd80d0de0 msgr2=0x7f0fd80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 -- 172.21.15.64:0/2475702053 shutdown_connections 2024-09-21T07:28:23.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.487+0000 7f0fe0400640 1 -- 172.21.15.64:0/2475702053 wait complete. 2024-09-21T07:28:23.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 Processor -- start 2024-09-21T07:28:23.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- start start 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 0x7f0fd81f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 0x7f0fd80c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd81672f0 con 0x7f0fc0003c90 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8167170 con 0x7f0fd81f9fd0 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd8167470 con 0x7f0fd8157f50 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:23.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46792/0 (socket says 172.21.15.64:46792) 2024-09-21T07:28:23.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 -- 172.21.15.64:0/2419640641 learned_addr learned my addr 172.21.15.64:0/2419640641 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:23.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fde400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 0x7f0fd80c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:23.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 -- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 msgr2=0x7f0fd81f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:23.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdd000640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 0x7f0fd81f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:23.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 0x7f0fd81f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 -- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 msgr2=0x7f0fd80c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 0x7f0fd80c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 -- 172.21.15.64:0/2419640641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd81fa3e0 con 0x7f0fc0003c90 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fde400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 0x7f0fd80c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdd000640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 0x7f0fd81f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fdda00640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc01c970 tx=0x7f0fcc006cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc006090 con 0x7f0fc0003c90 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fcc003620 con 0x7f0fc0003c90 2024-09-21T07:28:23.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc003a10 con 0x7f0fc0003c90 2024-09-21T07:28:23.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd80ca610 con 0x7f0fc0003c90 2024-09-21T07:28:23.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.491+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd8162a60 con 0x7f0fc0003c90 2024-09-21T07:28:23.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.495+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd80d0320 con 0x7f0fc0003c90 2024-09-21T07:28:23.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.495+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fcc003bb0 con 0x7f0fc0003c90 2024-09-21T07:28:23.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.495+0000 7f0fd5600640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 0x7f0fb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:23.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.495+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f0fcc12ec60 con 0x7f0fc0003c90 2024-09-21T07:28:23.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.495+0000 7f0fdd000640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 0x7f0fb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:23.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.499+0000 7f0fdd000640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 0x7f0fb8075710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40068e0 tx=0x7f0fc4006ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:23.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.503+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0fd81fa3e0 con 0x7f0fc0003c90 2024-09-21T07:28:23.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.715+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fd80ce590 con 0x7f0fc0003c90 2024-09-21T07:28:23.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.715+0000 7f0fd5600640 1 -- 172.21.15.64:0/2419640641 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f0fcc016c90 con 0x7f0fc0003c90 2024-09-21T07:28:23.719 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:23.719 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:23.719 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 msgr2=0x7f0fb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 0x7f0fb8075710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40068e0 tx=0x7f0fc4006ac0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 msgr2=0x7f0fd81635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc01c970 tx=0x7f0fcc006cd0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 shutdown_connections 2024-09-21T07:28:23.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0fb8073200 0x7f0fb8075710 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fd81f9fd0 0x7f0fd80c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fd8157f50 0x7f0fd81f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 --2- 172.21.15.64:0/2419640641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc0003c90 0x7f0fd81635e0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 >> 172.21.15.64:0/2419640641 conn(0x7f0fd80d0de0 msgr2=0x7f0fd8159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 shutdown_connections 2024-09-21T07:28:23.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:23.719+0000 7f0fe0400640 1 -- 172.21.15.64:0/2419640641 wait complete. 2024-09-21T07:28:24.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:28:02.892207+0000', 'modified': '2024-09-21T07:28:22.619716+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7470': {'gid': 7470, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6835/595883067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 595883067}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 595883067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7470, 'qdb_cluster': [7470]} 2024-09-21T07:28:24.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:28:24.146 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 -- 172.21.15.64:0/3026508648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 msgr2=0x7f05d40ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 --2- 172.21.15.64:0/3026508648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d40ce8e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f05d40b2ee0 tx=0x7f05cc01cb40 comp rx=0 tx=0).stop 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 -- 172.21.15.64:0/3026508648 shutdown_connections 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 --2- 172.21.15.64:0/3026508648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d40ce8e0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 --2- 172.21.15.64:0/3026508648 >> v2:172.21.15.90:3300/0 conn(0x7f05d40b3850 0x7f05d415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 -- 172.21.15.64:0/3026508648 >> 172.21.15.64:0/3026508648 conn(0x7f05d406d450 msgr2=0x7f05d40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 -- 172.21.15.64:0/3026508648 shutdown_connections 2024-09-21T07:28:24.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.307+0000 7f05db800640 1 -- 172.21.15.64:0/3026508648 wait complete. 2024-09-21T07:28:24.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 Processor -- start 2024-09-21T07:28:24.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- start start 2024-09-21T07:28:24.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05d40b3850 0x7f05d41501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d40cc960 0x7f05d409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4168d80 con 0x7f05d40ce4d0 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4168c00 con 0x7f05d40cc960 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f05d4168f00 con 0x7f05d40b3850 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46812/0 (socket says 172.21.15.64:46812) 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 -- 172.21.15.64:0/1737007504 learned_addr learned my addr 172.21.15.64:0/1737007504 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d3e00640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d40cc960 0x7f05d409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d8e00640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05d40b3850 0x7f05d41501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 -- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05d40b3850 msgr2=0x7f05d41501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05d40b3850 0x7f05d41501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 -- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d40cc960 msgr2=0x7f05d409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d40cc960 0x7f05d409ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 -- 172.21.15.64:0/1737007504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d40adf10 con 0x7f05d40ce4d0 2024-09-21T07:28:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d9800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f05cc01a770 tx=0x7f05cc0a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d0c00640 1 -- 172.21.15.64:0/1737007504 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0bb070 con 0x7f05d40ce4d0 2024-09-21T07:28:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d0c00640 1 -- 172.21.15.64:0/1737007504 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05cc004d40 con 0x7f05d40ce4d0 2024-09-21T07:28:24.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d40ae1b0 con 0x7f05d40ce4d0 2024-09-21T07:28:24.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05d0c00640 1 -- 172.21.15.64:0/1737007504 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0b2040 con 0x7f05d40ce4d0 2024-09-21T07:28:24.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.311+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d40ae770 con 0x7f05d40ce4d0 2024-09-21T07:28:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.315+0000 7f05d0c00640 1 -- 172.21.15.64:0/1737007504 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f05cc0be070 con 0x7f05d40ce4d0 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.315+0000 7f05d0c00640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 0x7f05b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.315+0000 7f05e2dc8000 1 Processor -- start 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.315+0000 7f05d0c00640 1 -- 172.21.15.64:0/1737007504 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f05cc12deb0 con 0x7f05d40ce4d0 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.315+0000 7f05e2dc8000 1 -- start start 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d8e00640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 0x7f05b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d8e00640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 0x7f05b4075710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001630 tx=0x7f05c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7a8ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a8b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5632d795b410 con 0x5632d7935950 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5632d7898b40 con 0x5632d7545460 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5632d7887f70 con 0x5632d791eca0 2024-09-21T07:28:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46818/0 (socket says 172.21.15.64:46818) 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 -- 172.21.15.64:0/1767091193 learned_addr learned my addr 172.21.15.64:0/1767091193 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d8e00640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7a8ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d9800640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a8b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 -- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 msgr2=0x5632d7a8b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a8b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 -- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 msgr2=0x5632d7a8ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7a8ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 -- 172.21.15.64:0/1767091193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d784f5b0 con 0x5632d7935950 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d8e00640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7a8ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d9800640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a8b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05d3e00640 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f05c000dc10 tx=0x7f05c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d015db2f55a0aec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05c5600640 1 -- 172.21.15.64:0/1767091193 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011440 con 0x5632d7935950 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05c5600640 1 -- 172.21.15.64:0/1767091193 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c0017070 con 0x5632d7935950 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05c5600640 1 -- 172.21.15.64:0/1767091193 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011950 con 0x5632d7935950 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- 172.21.15.64:0/1767091193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 msgr2=0x5632d7a8b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f05c000dc10 tx=0x7f05c000f730 comp rx=0 tx=0).stop 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- 172.21.15.64:0/1767091193 shutdown_connections 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a8b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7935950 0x5632d7a8b180 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/1767091193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7a8ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- 172.21.15.64:0/1767091193 >> 172.21.15.64:0/1767091193 conn(0x5632d7a0bd90 msgr2=0x5632d7a6e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- 172.21.15.64:0/1767091193 shutdown_connections 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.319+0000 7f05e2dc8000 1 -- 172.21.15.64:0/1767091193 wait complete. 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 -- start start 2024-09-21T07:28:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 Processor -- start 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a71130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5632d78225f0 con 0x5632d7545460 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5632d788bd80 con 0x5632d7935950 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5632d782e520 con 0x5632d791eca0 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 10 client.0 _ll_register_callbacks cb 0x5632d7832830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46828/0 (socket says 172.21.15.64:46828) 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 -- 172.21.15.64:0/4178001145 learned_addr learned my addr 172.21.15.64:0/4178001145 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d9800640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a71130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 -- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 msgr2=0x5632d7a70bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a70bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 -- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 msgr2=0x5632d7a71130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a71130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 -- 172.21.15.64:0/4178001145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d7826190 con 0x5632d7545460 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d9800640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a71130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001460 tx=0x7f05c8001010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7eba5e60009ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05ba000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8027060 con 0x5632d7545460 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f05c8010040 con 0x5632d7545460 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632d7820110 con 0x5632d7545460 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.323+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f05c80159c0 con 0x5632d7545460 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 10 client.7506 fetch_fsmap learned FSMap version 75 2024-09-21T07:28:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5632d790cf10 con 0x5632d7545460 2024-09-21T07:28:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5632d7820110 con 0x5632d7545460 2024-09-21T07:28:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f05c8015b60 con 0x5632d7545460 2024-09-21T07:28:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 10 client.7506 fetch_fsmap finished waiting for FSMap version 75 2024-09-21T07:28:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 10 client.7506 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 20 client.7506 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d752a7d0 0x5632d7a71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 4 client.7506 mds_command: new command op to 7470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 --> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632d789aa90 con 0x5632d752a7d0 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d752a7d0 0x5632d7a71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d752a7d0 0x5632d7a71b40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a057926529414f9 server_cookie=f5badc40a6bc7a56 in_seq=0 out_seq=0 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 10 client.7506 ms_handle_connect on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 1 -- 172.21.15.64:0/4178001145 <== mds.0 v2:172.21.15.64:6834/595883067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632d789aa90 con 0x5632d752a7d0 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 10 client.7506 handle_command_reply: tid=0 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 client.7506 shutdown 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 msgr2=0x5632d7a706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001460 tx=0x7f05c8001010 comp rx=0 tx=0).stop 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 shutdown_connections 2024-09-21T07:28:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d752a7d0 0x5632d7a71b40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a71130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7a70bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4178001145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7a706b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05ba000640 0 client.7506 ms_handle_reset on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 >> 172.21.15.64:0/4178001145 conn(0x5632d7a0bd90 msgr2=0x5632d7a40460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 shutdown_connections 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4178001145 wait complete. 2024-09-21T07:28:24.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.327+0000 7f05e2dc8000 20 client.7506 trim_cache size 0 max 16384 2024-09-21T07:28:24.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 Processor -- start 2024-09-21T07:28:24.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 -- start start 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7afc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d7935950 0x5632d7afd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4201590 con 0x5632d791eca0 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05d409c560 con 0x5632d7545460 2024-09-21T07:28:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f05d40b0780 con 0x5632d7935950 2024-09-21T07:28:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46838/0 (socket says 172.21.15.64:46838) 2024-09-21T07:28:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.347+0000 7f05d3e00640 1 -- 172.21.15.64:0/3574254487 learned_addr learned my addr 172.21.15.64:0/3574254487 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d9800640 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d7935950 0x5632d7afd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d8e00640 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7afc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 -- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d7935950 msgr2=0x5632d7afd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d7935950 0x5632d7afd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 -- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 msgr2=0x5632d7afc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7afc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 -- 172.21.15.64:0/3574254487 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d78e3db0 con 0x5632d791eca0 2024-09-21T07:28:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05d3e00640 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x5632d7839150 tx=0x7f05c0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dd0eabfc6b38b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05c4c00640 1 -- 172.21.15.64:0/3574254487 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0034070 con 0x5632d791eca0 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05c4c00640 1 -- 172.21.15.64:0/3574254487 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c0017040 con 0x5632d791eca0 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05c4c00640 1 -- 172.21.15.64:0/3574254487 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c001cc40 con 0x5632d791eca0 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- 172.21.15.64:0/3574254487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 msgr2=0x5632d7afcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x5632d7839150 tx=0x7f05c0004740 comp rx=0 tx=0).stop 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- 172.21.15.64:0/3574254487 shutdown_connections 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d7935950 0x5632d7afd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d791eca0 0x5632d7afcb00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/3574254487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7545460 0x5632d7afc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- 172.21.15.64:0/3574254487 >> 172.21.15.64:0/3574254487 conn(0x5632d7a0bd90 msgr2=0x5632d7a69b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- 172.21.15.64:0/3574254487 shutdown_connections 2024-09-21T07:28:24.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- 172.21.15.64:0/3574254487 wait complete. 2024-09-21T07:28:24.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 -- start start 2024-09-21T07:28:24.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.351+0000 7f05e2dc8000 1 Processor -- start 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7afcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a9d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05d409bf10 con 0x5632d7545460 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5632d7897910 con 0x5632d7935950 2024-09-21T07:28:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5632d78903b0 con 0x5632d791eca0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 10 client.0 _ll_register_callbacks cb 0x7f05c80050d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46852/0 (socket says 172.21.15.64:46852) 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 -- 172.21.15.64:0/4176897915 learned_addr learned my addr 172.21.15.64:0/4176897915 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7afcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d9800640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a9d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 -- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 msgr2=0x5632d7afcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7afcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 -- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 msgr2=0x5632d7a9d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a9d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 -- 172.21.15.64:0/4176897915 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d784eab0 con 0x5632d7545460 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d8e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001430 tx=0x7f05c8022640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4b2d7d90041721 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8022700 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f05c801e050 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c0017040 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f05c803e050 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 10 client.7512 fetch_fsmap learned FSMap version 75 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5632d782d070 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c0017040 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f05c8041020 con 0x5632d7545460 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 10 client.7512 fetch_fsmap finished waiting for FSMap version 75 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 10 client.7512 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 20 client.7512 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d7518830 0x5632d7a9e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 4 client.7512 mds_command: new command op to 7470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 --> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] -- command(tid 0: {"prefix": "status"}) -- 0x5632d7896540 con 0x5632d7518830 2024-09-21T07:28:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d7518830 0x5632d7a9e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05d3e00640 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d7518830 0x5632d7a9e450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b73a92b7f297e4 server_cookie=471a81841df14bb0 in_seq=0 out_seq=0 2024-09-21T07:28:24.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 10 client.7512 ms_handle_connect on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 1 -- 172.21.15.64:0/4176897915 <== mds.0 v2:172.21.15.64:6834/595883067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5632d7896540 con 0x5632d7518830 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05ba000640 10 client.7512 handle_command_reply: tid=0 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 client.7512 shutdown 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 msgr2=0x5632d7afc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001430 tx=0x7f05c8022640 comp rx=0 tx=0).stop 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 shutdown_connections 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.355+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x5632d7518830 0x5632d7a9e450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632d7935950 0x5632d7a9d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5632d791eca0 0x5632d7afcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 --2- 172.21.15.64:0/4176897915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5632d7545460 0x5632d7afc9e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05ba000640 0 client.7512 ms_handle_reset on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 >> 172.21.15.64:0/4176897915 conn(0x5632d7a0bd90 msgr2=0x5632d7a97640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 shutdown_connections 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 1 -- 172.21.15.64:0/4176897915 wait complete. 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05e2dc8000 20 client.7512 trim_cache size 0 max 16384 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 7470, 2024-09-21T07:28:24.363 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 4.7554046110000003, 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 75, 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 103, 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 103, 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 5.5753020080000004 2024-09-21T07:28:24.364 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 msgr2=0x7f05b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 0x7f05b4075710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001630 tx=0x7f05c8009040 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 msgr2=0x7f05d409d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f05cc01a770 tx=0x7f05cc0a5770 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 shutdown_connections 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f05b4073200 0x7f05b4075710 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05d40ce4d0 0x7f05d409d3d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d40cc960 0x7f05d409ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 --2- 172.21.15.64:0/1737007504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05d40b3850 0x7f05d41501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 >> 172.21.15.64:0/1737007504 conn(0x7f05d406d450 msgr2=0x7f05d40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 shutdown_connections 2024-09-21T07:28:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.359+0000 7f05db800640 1 -- 172.21.15.64:0/1737007504 wait complete. 2024-09-21T07:28:24.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-21T07:28:24.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 -- 172.21.15.64:0/3662418209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 msgr2=0x7f94a41660c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 --2- 172.21.15.64:0/3662418209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41660c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f949c009bc0 tx=0x7f949c01cba0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 -- 172.21.15.64:0/3662418209 shutdown_connections 2024-09-21T07:28:24.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 --2- 172.21.15.64:0/3662418209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41660c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 -- 172.21.15.64:0/3662418209 >> 172.21.15.64:0/3662418209 conn(0x7f94a406d450 msgr2=0x7f94a40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 -- 172.21.15.64:0/3662418209 shutdown_connections 2024-09-21T07:28:24.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.539+0000 7f94abc00640 1 -- 172.21.15.64:0/3662418209 wait complete. 2024-09-21T07:28:24.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 Processor -- start 2024-09-21T07:28:24.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 -- start start 2024-09-21T07:28:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94a40b4d40 0x7f94a40ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94a40cca80 0x7f94a40ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f94a4169420 con 0x7f94a4163ca0 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94a41692a0 con 0x7f94a40cca80 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94abc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f94a41695a0 con 0x7f94a40b4d40 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46868/0 (socket says 172.21.15.64:46868) 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 -- 172.21.15.64:0/3200441507 learned_addr learned my addr 172.21.15.64:0/3200441507 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9200640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94a40b4d40 0x7f94a40ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a3e00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94a40cca80 0x7f94a40ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 -- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94a40b4d40 msgr2=0x7f94a40ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94a40b4d40 0x7f94a40ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 -- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94a40cca80 msgr2=0x7f94a40ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94a40cca80 0x7f94a40ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 -- 172.21.15.64:0/3200441507 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a40b23f0 con 0x7f94a4163ca0 2024-09-21T07:28:24.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.543+0000 7f94a9c00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f949c0197b0 tx=0x7f949c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0bb070 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f949c004d40 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b2040 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a40b2670 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a40c32c0 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a409df80 con 0x7f94a4163ca0 2024-09-21T07:28:24.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f949c004260 con 0x7f94a4163ca0 2024-09-21T07:28:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 0x7f9484075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f949c12e190 con 0x7f94a4163ca0 2024-09-21T07:28:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.547+0000 7f94a9200640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 0x7f9484075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.551+0000 7f94a9200640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 0x7f9484075740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9494001640 tx=0x7f9494009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.551+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f949c0f2290 con 0x7f94a4163ca0 2024-09-21T07:28:24.612 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:28:24.611+0000 7f306de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:28:24.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.731+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f94a415f540 con 0x7f94a4163ca0 2024-09-21T07:28:24.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94a0c00640 1 -- 172.21.15.64:0/3200441507 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v46)=0 v46) ==== 117+0+0 (secure 0 0 0) 0x7f94a40b23f0 con 0x7f94a4163ca0 2024-09-21T07:28:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 msgr2=0x7f9484075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 0x7f9484075740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9494001640 tx=0x7f9494009040 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 msgr2=0x7f94a41f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f949c0197b0 tx=0x7f949c009260 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 shutdown_connections 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9484073230 0x7f9484075740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94a4163ca0 0x7f94a41f8ea0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94a40cca80 0x7f94a40ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 --2- 172.21.15.64:0/3200441507 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94a40b4d40 0x7f94a40ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 >> 172.21.15.64:0/3200441507 conn(0x7f94a406d450 msgr2=0x7f94a41554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 shutdown_connections 2024-09-21T07:28:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.739+0000 7f94abc00640 1 -- 172.21.15.64:0/3200441507 wait complete. 2024-09-21T07:28:24.762 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-21T07:28:24.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- 172.21.15.64:0/2964497250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e340b3910 msgr2=0x7f5e340ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 --2- 172.21.15.64:0/2964497250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e340b3910 0x7f5e340ce1f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5e34070f10 tx=0x7f5e1c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- 172.21.15.64:0/2964497250 shutdown_connections 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 --2- 172.21.15.64:0/2964497250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340ce730 0x7f5e340ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 --2- 172.21.15.64:0/2964497250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e340b3910 0x7f5e340ce1f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 --2- 172.21.15.64:0/2964497250 >> v2:172.21.15.90:3300/0 conn(0x7f5e3409df30 0x7f5e340b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- 172.21.15.64:0/2964497250 >> 172.21.15.64:0/2964497250 conn(0x7f5e3406d450 msgr2=0x7f5e340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- 172.21.15.64:0/2964497250 shutdown_connections 2024-09-21T07:28:24.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- 172.21.15.64:0/2964497250 wait complete. 2024-09-21T07:28:24.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 Processor -- start 2024-09-21T07:28:24.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.923+0000 7f5e38c00640 1 -- start start 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 0x7f5e34158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e340ce730 0x7f5e340afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340ccef0 con 0x7f5e3409df30 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340ccd70 con 0x7f5e340ce730 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340cd070 con 0x7f5e340b3910 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46894/0 (socket says 172.21.15.64:46894) 2024-09-21T07:28:24.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 -- 172.21.15.64:0/1870029621 learned_addr learned my addr 172.21.15.64:0/1870029621 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e32800640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e340ce730 0x7f5e340afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e29400640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 0x7f5e34158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 -- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 msgr2=0x7f5e34158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 0x7f5e34158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 -- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e340ce730 msgr2=0x7f5e340afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e340ce730 0x7f5e340afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 -- 172.21.15.64:0/1870029621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3409d6f0 con 0x7f5e3409df30 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e29400640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 0x7f5e34158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:24.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e31e00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400da10 tx=0x7f5e2400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24017070 con 0x7f5e3409df30 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e24010460 con 0x7f5e3409df30 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400be60 con 0x7f5e3409df30 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3415e060 con 0x7f5e3409df30 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3415e620 con 0x7f5e3409df30 2024-09-21T07:28:24.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.927+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e340ce1f0 con 0x7f5e3409df30 2024-09-21T07:28:24.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.931+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5e240108b0 con 0x7f5e3409df30 2024-09-21T07:28:24.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.931+0000 7f5e2aa00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 0x7f5e10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:24.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.931+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f5e24094a10 con 0x7f5e3409df30 2024-09-21T07:28:24.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.931+0000 7f5e29400640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 0x7f5e10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:24.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.931+0000 7f5e29400640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 0x7f5e10075710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0af000 tx=0x7f5e1c01b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:24.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:24.935+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5e2405f1f0 con 0x7f5e3409df30 2024-09-21T07:28:25.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.111+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f5e340cbde0 con 0x7f5e3409df30 2024-09-21T07:28:25.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.115+0000 7f5e2aa00640 1 -- 172.21.15.64:0/1870029621 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v47)=0 v47) ==== 116+0+0 (secure 0 0 0) 0x7f5e24063c20 con 0x7f5e3409df30 2024-09-21T07:28:25.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 msgr2=0x7f5e10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 0x7f5e10075710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0af000 tx=0x7f5e1c01b100 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 msgr2=0x7f5e341588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400da10 tx=0x7f5e2400ded0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 shutdown_connections 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e10073200 0x7f5e10075710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e340ce730 0x7f5e340afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e340b3910 0x7f5e34158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 --2- 172.21.15.64:0/1870029621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e3409df30 0x7f5e341588c0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 >> 172.21.15.64:0/1870029621 conn(0x7f5e3406d450 msgr2=0x7f5e34074770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 shutdown_connections 2024-09-21T07:28:25.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.119+0000 7f5e38c00640 1 -- 172.21.15.64:0/1870029621 wait complete. 2024-09-21T07:28:25.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-21T07:28:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 -- 172.21.15.64:0/1310808132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 msgr2=0x7f7ba80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 --2- 172.21.15.64:0/1310808132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba80ce1f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009840 tx=0x7f7b9401c820 comp rx=0 tx=0).stop 2024-09-21T07:28:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 -- 172.21.15.64:0/1310808132 shutdown_connections 2024-09-21T07:28:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 --2- 172.21.15.64:0/1310808132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba80ce1f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 --2- 172.21.15.64:0/1310808132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 -- 172.21.15.64:0/1310808132 >> 172.21.15.64:0/1310808132 conn(0x7f7ba806d450 msgr2=0x7f7ba80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 -- 172.21.15.64:0/1310808132 shutdown_connections 2024-09-21T07:28:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.299+0000 7f7bb0600640 1 -- 172.21.15.64:0/1310808132 wait complete. 2024-09-21T07:28:25.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 Processor -- start 2024-09-21T07:28:25.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- start start 2024-09-21T07:28:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8169160 con 0x7f7ba80ce730 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8168fe0 con 0x7f7ba80b3910 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba81692e0 con 0x7f7ba809df30 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7badc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bad200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43008/0 (socket says 172.21.15.64:43008) 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7badc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:36610/0 (socket says 172.21.15.64:36610) 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 -- 172.21.15.64:0/3575011252 learned_addr learned my addr 172.21.15.64:0/3575011252 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 -- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 msgr2=0x7f7ba815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 -- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 msgr2=0x7f7ba815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 -- 172.21.15.64:0/3575011252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba815ebf0 con 0x7f7ba80ce730 2024-09-21T07:28:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bae600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000cae0 tx=0x7f7ba000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0016020 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba000ab40 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba8074710 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000ce20 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.303+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba80afad0 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba8074540 con 0x7f7ba80ce730 2024-09-21T07:28:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7ba0019020 con 0x7f7ba80ce730 2024-09-21T07:28:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7ba5600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 0x7f7b88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f7ba0094610 con 0x7f7ba80ce730 2024-09-21T07:28:25.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7badc00640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 0x7f7b88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.307+0000 7f7badc00640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 0x7f7b88075710 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0095b0 tx=0x7f7b9c005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:25.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.311+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7ba0020020 con 0x7f7ba80ce730 2024-09-21T07:28:25.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.487+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f7ba80b33d0 con 0x7f7ba80ce730 2024-09-21T07:28:25.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.491+0000 7f7ba5600640 1 -- 172.21.15.64:0/3575011252 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v48)=0 v48) ==== 116+0+0 (secure 0 0 0) 0x7f7ba005ed60 con 0x7f7ba80ce730 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 msgr2=0x7f7b88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 0x7f7b88075710 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0095b0 tx=0x7f7b9c005f40 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 msgr2=0x7f7ba815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000cae0 tx=0x7f7ba000cbd0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 shutdown_connections 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b88073200 0x7f7b88075710 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ba80ce730 0x7f7ba815bbe0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ba80b3910 0x7f7ba815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 --2- 172.21.15.64:0/3575011252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ba809df30 0x7f7ba815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 >> 172.21.15.64:0/3575011252 conn(0x7f7ba806d450 msgr2=0x7f7ba80cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:25.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 shutdown_connections 2024-09-21T07:28:25.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.495+0000 7f7bb0600640 1 -- 172.21.15.64:0/3575011252 wait complete. 2024-09-21T07:28:25.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- 172.21.15.64:0/1887201895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8640004810 msgr2=0x7f8640004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 --2- 172.21.15.64:0/1887201895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8640004810 0x7f8640004c20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f864400c310 tx=0x7f864401cf60 comp rx=0 tx=0).stop 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- 172.21.15.64:0/1887201895 shutdown_connections 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 --2- 172.21.15.64:0/1887201895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8640004810 0x7f8640004c20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- 172.21.15.64:0/1887201895 >> 172.21.15.64:0/1887201895 conn(0x7f865c06d480 msgr2=0x7f865c0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- 172.21.15.64:0/1887201895 shutdown_connections 2024-09-21T07:28:25.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- 172.21.15.64:0/1887201895 wait complete. 2024-09-21T07:28:25.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 Processor -- start 2024-09-21T07:28:25.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.675+0000 7f8661c00640 1 -- start start 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8640004810 0x7f865c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f865c1e9830 0x7f865c1e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f865c0d1030 con 0x7f865c1e8680 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f865c0d0eb0 con 0x7f8640004810 2024-09-21T07:28:25.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f865c0710f0 con 0x7f865c1e9830 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43028/0 (socket says 172.21.15.64:43028) 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 -- 172.21.15.64:0/826610130 learned_addr learned my addr 172.21.15.64:0/826610130 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f865b400640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f865c1e9830 0x7f865c1e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f865aa00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8640004810 0x7f865c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 -- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f865c1e9830 msgr2=0x7f865c1e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f865c1e9830 0x7f865c1e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 -- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8640004810 msgr2=0x7f865c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8640004810 0x7f865c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 -- 172.21.15.64:0/826610130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c15e540 con 0x7f865c1e8680 2024-09-21T07:28:25.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8652000640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f864401b660 tx=0x7f8644001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:25.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440a7e30 con 0x7f865c1e8680 2024-09-21T07:28:25.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86440014c0 con 0x7f865c1e8680 2024-09-21T07:28:25.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c1ea180 con 0x7f865c1e8680 2024-09-21T07:28:25.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644006280 con 0x7f865c1e8680 2024-09-21T07:28:25.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c0c60d0 con 0x7f865c1e8680 2024-09-21T07:28:25.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.679+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865c0715c0 con 0x7f865c1e8680 2024-09-21T07:28:25.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.683+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8644006420 con 0x7f865c1e8680 2024-09-21T07:28:25.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.683+0000 7f8653400640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 0x7f8638075730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:25.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.683+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f864412df60 con 0x7f865c1e8680 2024-09-21T07:28:25.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.683+0000 7f865aa00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 0x7f8638075730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:25.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.683+0000 7f865aa00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 0x7f8638075730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f865c076ab0 tx=0x7f864c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:25.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.687+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f865c1ea180 con 0x7f865c1e8680 2024-09-21T07:28:25.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.899+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f865c15e7a0 con 0x7f865c1e8680 2024-09-21T07:28:25.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.899+0000 7f8653400640 1 -- 172.21.15.64:0/826610130 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f8644016d10 con 0x7f865c1e8680 2024-09-21T07:28:25.903 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:25.903 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:25.903 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 msgr2=0x7f8638075730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 0x7f8638075730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f865c076ab0 tx=0x7f864c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 msgr2=0x7f865c1e8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f864401b660 tx=0x7f8644001d00 comp rx=0 tx=0).stop 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 shutdown_connections 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8638073220 0x7f8638075730 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f865c1e9830 0x7f865c1e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1e8680 0x7f865c1e8a90 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 --2- 172.21.15.64:0/826610130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8640004810 0x7f865c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 >> 172.21.15.64:0/826610130 conn(0x7f865c06d480 msgr2=0x7f865c0b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 shutdown_connections 2024-09-21T07:28:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:25.903+0000 7f8661c00640 1 -- 172.21.15.64:0/826610130 wait complete. 2024-09-21T07:28:25.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:28:26.096 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:28:16.395430+0000","btime":"2024-09-21T07:28:15.483438+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:28:16.395430+0000","atime":"2024-09-21T07:28:15.483438+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:28:16.395430+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:28:26.097 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:28:15.483438+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:28:15.483438+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:28:16.395430+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-21T07:28:16.395430+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:28:16.395430+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:28:26.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:26.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 -- 172.21.15.64:0/1919198341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a281594c0 msgr2=0x7f8a280aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 --2- 172.21.15.64:0/1919198341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a281594c0 0x7f8a280aee20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8a28073fa0 tx=0x7f8a1001c820 comp rx=0 tx=0).stop 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 -- 172.21.15.64:0/1919198341 shutdown_connections 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 --2- 172.21.15.64:0/1919198341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a281594c0 0x7f8a280aee20 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 -- 172.21.15.64:0/1919198341 >> 172.21.15.64:0/1919198341 conn(0x7f8a280d0170 msgr2=0x7f8a280d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 -- 172.21.15.64:0/1919198341 shutdown_connections 2024-09-21T07:28:26.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.255+0000 7f8a2f200640 1 -- 172.21.15.64:0/1919198341 wait complete. 2024-09-21T07:28:26.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 Processor -- start 2024-09-21T07:28:26.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 -- start start 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a2806ec70 0x7f8a281559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a28156040 0x7f8a2815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2816a310 con 0x7f8a280af360 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2816a190 con 0x7f8a28156040 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a2f200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2816a490 con 0x7f8a2806ec70 2024-09-21T07:28:26.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43048/0 (socket says 172.21.15.64:43048) 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a1fe00640 1 -- 172.21.15.64:0/2735564133 learned_addr learned my addr 172.21.15.64:0/2735564133 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.259+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a2806ec70 0x7f8a281559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a2d200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a28156040 0x7f8a2815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 -- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a2806ec70 msgr2=0x7f8a281559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a2806ec70 0x7f8a281559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 -- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a28156040 msgr2=0x7f8a2815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a28156040 0x7f8a2815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 -- 172.21.15.64:0/2735564133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a280c98d0 con 0x7f8a280af360 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c10 tx=0x7f8a10004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a24c00640 1 -- 172.21.15.64:0/2735564133 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a100bb070 con 0x7f8a280af360 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a24c00640 1 -- 172.21.15.64:0/2735564133 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a10005030 con 0x7f8a280af360 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a280c9bb0 con 0x7f8a280af360 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a24c00640 1 -- 172.21.15.64:0/2735564133 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a100b2040 con 0x7f8a280af360 2024-09-21T07:28:26.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a280c95a0 con 0x7f8a280af360 2024-09-21T07:28:26.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.263+0000 7f8a24c00640 1 -- 172.21.15.64:0/2735564133 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a100be070 con 0x7f8a280af360 2024-09-21T07:28:26.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a24c00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 0x7f8a04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a24c00640 1 -- 172.21.15.64:0/2735564133 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f8a1012df20 con 0x7f8a280af360 2024-09-21T07:28:26.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 0x7f8a04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 Processor -- start 2024-09-21T07:28:26.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 -- start start 2024-09-21T07:28:26.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 0x7f8a04075710 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007fd0 tx=0x7f8a18009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff6ce0 0x562cde169b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde16a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cddf7ba60 con 0x562cde00a940 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562cddf6ae90 con 0x562cddff6ce0 2024-09-21T07:28:26.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562cddf6eca0 con 0x562cddff09a0 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43052/0 (socket says 172.21.15.64:43052) 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 -- 172.21.15.64:0/2975993064 learned_addr learned my addr 172.21.15.64:0/2975993064 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a2d200640 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde16a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff6ce0 0x562cde169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 -- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 msgr2=0x562cde16a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde16a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 -- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff6ce0 msgr2=0x562cde169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff6ce0 0x562cde169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 -- 172.21.15.64:0/2975993064 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cddfb4060 con 0x562cde00a940 2024-09-21T07:28:26.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a27e00640 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800f960 tx=0x7f8a18012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646e947e9df55754 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a1cc00640 1 -- 172.21.15.64:0/2975993064 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18025070 con 0x562cde00a940 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a1cc00640 1 -- 172.21.15.64:0/2975993064 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a1801b050 con 0x562cde00a940 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.267+0000 7f8a1cc00640 1 -- 172.21.15.64:0/2975993064 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18014e40 con 0x562cde00a940 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- 172.21.15.64:0/2975993064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 msgr2=0x562cde169620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800f960 tx=0x7f8a18012000 comp rx=0 tx=0).stop 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- 172.21.15.64:0/2975993064 shutdown_connections 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde16a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff6ce0 0x562cde169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- 172.21.15.64:0/2975993064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde169620 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- 172.21.15.64:0/2975993064 >> 172.21.15.64:0/2975993064 conn(0x562cddc29330 msgr2=0x562cde11e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- 172.21.15.64:0/2975993064 shutdown_connections 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- 172.21.15.64:0/2975993064 wait complete. 2024-09-21T07:28:26.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- start start 2024-09-21T07:28:26.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 Processor -- start 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde168e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde125410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cddfaeb80 con 0x562cde00a940 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562cddf14970 con 0x562cddff09a0 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562cddf20bd0 con 0x562cddff6ce0 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a36a64000 10 client.0 _ll_register_callbacks cb 0x562cddf11410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a2d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde125410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:36638/0 (socket says 172.21.15.64:36638) 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a1fe00640 1 -- 172.21.15.64:0/3617794600 learned_addr learned my addr 172.21.15.64:0/3617794600 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.271+0000 7f8a27e00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 -- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 msgr2=0x562cde168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 -- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 msgr2=0x562cde125410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde125410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 -- 172.21.15.64:0/3617794600 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x562cddf13b50 con 0x562cddff6ce0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009790 tx=0x7f8a100f7e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c483c5da3fd4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10101d50 con 0x562cddff6ce0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f8a10101040 con 0x562cddff6ce0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cddf03200 con 0x562cddff6ce0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f8a10117050 con 0x562cddff6ce0 2024-09-21T07:28:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 10 client.6677 fetch_fsmap learned FSMap version 75 2024-09-21T07:28:26.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x562cddf090c0 con 0x562cddff6ce0 2024-09-21T07:28:26.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562cddf03200 con 0x562cddff6ce0 2024-09-21T07:28:26.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f8a100b5030 con 0x562cddff6ce0 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 10 client.6677 fetch_fsmap finished waiting for FSMap version 75 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 10 client.6677 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 20 client.6677 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddc0db10 0x562cde12b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 4 client.6677 mds_command: new command op to 7470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 --> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cddf7d9b0 con 0x562cddc0db10 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a27e00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddc0db10 0x562cde12b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a27e00640 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddc0db10 0x562cde12b0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cddd7015d2610c04 server_cookie=a101bb9f6d854b4d in_seq=0 out_seq=0 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 10 client.6677 ms_handle_connect on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 1 -- 172.21.15.64:0/3617794600 <== mds.0 v2:172.21.15.64:6834/595883067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cddf7d9b0 con 0x562cddc0db10 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 10 client.6677 handle_command_reply: tid=0 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 client.6677 shutdown 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 msgr2=0x562cde124ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009790 tx=0x7f8a100f7e70 comp rx=0 tx=0).stop 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 shutdown_connections 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cde00a940 0x562cde125410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff6ce0 0x562cde124ed0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddc0db10 0x562cde12b0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 --2- 172.21.15.64:0/3617794600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a15600640 0 client.6677 ms_handle_reset on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 >> 172.21.15.64:0/3617794600 conn(0x562cddc29330 msgr2=0x562cde11e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 shutdown_connections 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.275+0000 7f8a36a64000 1 -- 172.21.15.64:0/3617794600 wait complete. 2024-09-21T07:28:26.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.279+0000 7f8a36a64000 20 client.6677 trim_cache size 0 max 16384 2024-09-21T07:28:26.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.295+0000 7f8a36a64000 1 Processor -- start 2024-09-21T07:28:26.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.295+0000 7f8a36a64000 1 -- start start 2024-09-21T07:28:26.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde1da1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 0x562cde1dac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28204f80 con 0x562cddff6ce0 2024-09-21T07:28:26.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a282042e0 con 0x562cde00a940 2024-09-21T07:28:26.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8a28204930 con 0x562cddff09a0 2024-09-21T07:28:26.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43066/0 (socket says 172.21.15.64:43066) 2024-09-21T07:28:26.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 -- 172.21.15.64:0/598645868 learned_addr learned my addr 172.21.15.64:0/598645868 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a27e00640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde1da1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a2d200640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 0x562cde1dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 -- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 msgr2=0x562cde1da1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde1da1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 -- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 msgr2=0x562cde1dac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 0x562cde1dac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 -- 172.21.15.64:0/598645868 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cddfefde0 con 0x562cddff6ce0 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a27e00640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde1da1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a2d200640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 0x562cde1dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8a100f4c80 tx=0x7f8a100f8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1056d8972a1c904 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a17e00640 1 -- 172.21.15.64:0/598645868 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a100f84d0 con 0x562cddff6ce0 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a17e00640 1 -- 172.21.15.64:0/598645868 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a100a58c0 con 0x562cddff6ce0 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a17e00640 1 -- 172.21.15.64:0/598645868 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a101012a0 con 0x562cddff6ce0 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- 172.21.15.64:0/598645868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 msgr2=0x562cde1da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8a100f4c80 tx=0x7f8a100f8840 comp rx=0 tx=0).stop 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- 172.21.15.64:0/598645868 shutdown_connections 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde00a940 0x562cde1dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1da710 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 --2- 172.21.15.64:0/598645868 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cddff09a0 0x562cde1da1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- 172.21.15.64:0/598645868 >> 172.21.15.64:0/598645868 conn(0x562cddc29330 msgr2=0x562cde179e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- 172.21.15.64:0/598645868 shutdown_connections 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- 172.21.15.64:0/598645868 wait complete. 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 -- start start 2024-09-21T07:28:26.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.299+0000 7f8a36a64000 1 Processor -- start 2024-09-21T07:28:26.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde1de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cde00a940 0x562cde1df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cddf36f60 con 0x562cddff6ce0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562cddf36780 con 0x562cddff09a0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x562cddf6dfb0 con 0x562cde00a940 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 10 client.0 _ll_register_callbacks cb 0x7f8a10005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43082/0 (socket says 172.21.15.64:43082) 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 -- 172.21.15.64:0/890802228 learned_addr learned my addr 172.21.15.64:0/890802228 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde1de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a2d200640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cde00a940 0x562cde1df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 -- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cde00a940 msgr2=0x562cde1df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cde00a940 0x562cde1df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 -- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 msgr2=0x562cde1ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 -- 172.21.15.64:0/890802228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cddf01640 con 0x562cddff09a0 2024-09-21T07:28:26.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a27e00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde1de7c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a18022000 tx=0x7f8a18007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b08e53545dcb1638 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18025040 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f8a18020410 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a100a58c0 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f8a18001410 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 10 client.7270 fetch_fsmap learned FSMap version 75 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x562cddf33b10 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a100a58c0 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f8a1802b620 con 0x562cddff09a0 2024-09-21T07:28:26.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 10 client.7270 fetch_fsmap finished waiting for FSMap version 75 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 10 client.7270 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 20 client.7270 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddbfbb70 0x562cde199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 4 client.7270 mds_command: new command op to 7470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 --> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x562cddf79460 con 0x562cddbfbb70 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddbfbb70 0x562cde199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a1fe00640 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddbfbb70 0x562cde199ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9bc04f4271b949 server_cookie=5fb6e7c8c37c43e1 in_seq=0 out_seq=0 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.303+0000 7f8a15600640 10 client.7270 ms_handle_connect on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a15600640 1 -- 172.21.15.64:0/890802228 <== mds.0 v2:172.21.15.64:6834/595883067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562cddf79460 con 0x562cddbfbb70 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a15600640 10 client.7270 handle_command_reply: tid=0 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 client.7270 shutdown 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 msgr2=0x562cde1de7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde1de7c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a18022000 tx=0x7f8a18007b60 comp rx=0 tx=0).stop 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 shutdown_connections 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x562cde00a940 0x562cde1df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cddff6ce0 0x562cde1ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.64:6834/595883067,v1:172.21.15.64:6835/595883067] conn(0x562cddbfbb70 0x562cde199ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 --2- 172.21.15.64:0/890802228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cddff09a0 0x562cde1de7c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 >> 172.21.15.64:0/890802228 conn(0x562cddc29330 msgr2=0x562cde11dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a15600640 0 client.7270 ms_handle_reset on v2:172.21.15.64:6834/595883067 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 shutdown_connections 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 1 -- 172.21.15.64:0/890802228 wait complete. 2024-09-21T07:28:26.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a36a64000 20 client.7270 trim_cache size 0 max 16384 2024-09-21T07:28:26.311 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:26.311 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:28:26.311 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "fdb2c1b1-0380-4782-856b-4ae5676821b1", 2024-09-21T07:28:26.311 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:28:26.311 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 msgr2=0x7f8a04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 0x7f8a04075710 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007fd0 tx=0x7f8a18009040 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 msgr2=0x7f8a281fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c10 tx=0x7f8a10004040 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 shutdown_connections 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a04073200 0x7f8a04075710 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a28156040 0x7f8a2815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a280af360 0x7f8a281fbd40 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 --2- 172.21.15.64:0/2735564133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a2806ec70 0x7f8a281559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 >> 172.21.15.64:0/2735564133 conn(0x7f8a280d0170 msgr2=0x7f8a280b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 shutdown_connections 2024-09-21T07:28:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.307+0000 7f8a2f200640 1 -- 172.21.15.64:0/2735564133 wait complete. 2024-09-21T07:28:26.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:26.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 -- 172.21.15.64:0/1122333447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c160c20 msgr2=0x7f630c0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 --2- 172.21.15.64:0/1122333447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c160c20 0x7f630c0706a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009840 tx=0x7f62fc01d280 comp rx=0 tx=0).stop 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 -- 172.21.15.64:0/1122333447 shutdown_connections 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 --2- 172.21.15.64:0/1122333447 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c06d500 0x7f630c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 --2- 172.21.15.64:0/1122333447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c160c20 0x7f630c0706a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 -- 172.21.15.64:0/1122333447 >> 172.21.15.64:0/1122333447 conn(0x7f630c0d0be0 msgr2=0x7f630c0d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 -- 172.21.15.64:0/1122333447 shutdown_connections 2024-09-21T07:28:26.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.487+0000 7f6313200640 1 -- 172.21.15.64:0/1122333447 wait complete. 2024-09-21T07:28:26.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 Processor -- start 2024-09-21T07:28:26.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 -- start start 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c160c20 0x7f630c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c1524c0 0x7f630c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f630c16a530 con 0x7f630c06f650 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f630c16a3b0 con 0x7f630c1524c0 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6313200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f630c16a6b0 con 0x7f630c160c20 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43092/0 (socket says 172.21.15.64:43092) 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 -- 172.21.15.64:0/541644206 learned_addr learned my addr 172.21.15.64:0/541644206 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630b400640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c160c20 0x7f630c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f6311200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c1524c0 0x7f630c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 -- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c160c20 msgr2=0x7f630c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c160c20 0x7f630c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 -- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c1524c0 msgr2=0x7f630c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c1524c0 0x7f630c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 -- 172.21.15.64:0/541644206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630c151d80 con 0x7f630c06f650 2024-09-21T07:28:26.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.491+0000 7f630be00640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009790 tx=0x7f62fc0a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0b2040 con 0x7f630c06f650 2024-09-21T07:28:26.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62fc004470 con 0x7f630c06f650 2024-09-21T07:28:26.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630c0b5f60 con 0x7f630c06f650 2024-09-21T07:28:26.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc005280 con 0x7f630c06f650 2024-09-21T07:28:26.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630c0b5c80 con 0x7f630c06f650 2024-09-21T07:28:26.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c06df40 con 0x7f630c06f650 2024-09-21T07:28:26.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.495+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f62fc005420 con 0x7f630c06f650 2024-09-21T07:28:26.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.499+0000 7f6303e00640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 0x7f62ec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:26.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.499+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6187+0+0 (secure 0 0 0) 0x7f62fc12db00 con 0x7f630c06f650 2024-09-21T07:28:26.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.499+0000 7f630b400640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 0x7f62ec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:26.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.499+0000 7f630b400640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 0x7f62ec075740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f630c15eb10 tx=0x7f62f8007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:26.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.503+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f62fc016410 con 0x7f630c06f650 2024-09-21T07:28:26.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f630c06b120 con 0x7f630c06f650 2024-09-21T07:28:26.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6303e00640 1 -- 172.21.15.64:0/541644206 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f62fc0f82f0 con 0x7f630c06f650 2024-09-21T07:28:26.716 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:26.716 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:26.716 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 msgr2=0x7f62ec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 0x7f62ec075740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f630c15eb10 tx=0x7f62f8007ea0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 msgr2=0x7f630c151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009790 tx=0x7f62fc0a5670 comp rx=0 tx=0).stop 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 shutdown_connections 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f62ec073230 0x7f62ec075740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f630c1524c0 0x7f630c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f630c160c20 0x7f630c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 --2- 172.21.15.64:0/541644206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f630c06f650 0x7f630c151840 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 >> 172.21.15.64:0/541644206 conn(0x7f630c0d0be0 msgr2=0x7f630c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 shutdown_connections 2024-09-21T07:28:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:26.715+0000 7f6313200640 1 -- 172.21.15.64:0/541644206 wait complete. 2024-09-21T07:28:26.739 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:28:26.908 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:28:16.395430+0000","btime":"2024-09-21T07:28:15.483438+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:28:16.395430+0000","atime":"2024-09-21T07:28:15.483438+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:28:16.395430+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:28:26.909 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:28:15.483438+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:28:15.483438+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:28:16.395430+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-21T07:28:16.395430+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:28:16.395430+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:28:26.909 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-21T07:28:31.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- 172.21.15.64:0/4008024573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 msgr2=0x7fb2d8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 --2- 172.21.15.64:0/4008024573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2d8003ef0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c750 tx=0x7fb2e401d300 comp rx=0 tx=0).stop 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f6600640 1 -- 172.21.15.64:0/4008024573 reap_dead start 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- 172.21.15.64:0/4008024573 shutdown_connections 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- 172.21.15.64:0/4008024573 >> 172.21.15.64:0/4008024573 conn(0x7fb2f00cdd00 msgr2=0x7fb2f00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- 172.21.15.64:0/4008024573 shutdown_connections 2024-09-21T07:28:32.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- 172.21.15.64:0/4008024573 wait complete. 2024-09-21T07:28:32.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 Processor -- start 2024-09-21T07:28:32.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.083+0000 7fb2f8600640 1 -- start start 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2f01f99c0 0x7fb2f01f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2f00ae750 0x7fb2f00aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0167030 con 0x7fb2d8003a80 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0166eb0 con 0x7fb2f00ae750 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f01671b0 con 0x7fb2f01f99c0 2024-09-21T07:28:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43124/0 (socket says 172.21.15.64:43124) 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 -- 172.21.15.64:0/3774396474 learned_addr learned my addr 172.21.15.64:0/3774396474 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5200640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2f01f99c0 0x7fb2f01f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f6600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2f00ae750 0x7fb2f00aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 -- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2f01f99c0 msgr2=0x7fb2f01f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2f01f99c0 0x7fb2f01f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 -- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2f00ae750 msgr2=0x7fb2f00aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2f00ae750 0x7fb2f00aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 -- 172.21.15.64:0/3774396474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f00af0a0 con 0x7fb2d8003a80 2024-09-21T07:28:32.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f5c00640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4002100 tx=0x7fb2e400c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4003a60 con 0x7fb2d8003a80 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2e40015d0 con 0x7fb2d8003a80 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01ec460 con 0x7fb2d8003a80 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40060b0 con 0x7fb2d8003a80 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01edca0 con 0x7fb2d8003a80 2024-09-21T07:28:32.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.087+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f00b56d0 con 0x7fb2d8003a80 2024-09-21T07:28:32.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.091+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb2e4006250 con 0x7fb2d8003a80 2024-09-21T07:28:32.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.091+0000 7fb2ed600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 0x7fb2d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.091+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7fb2e412ea00 con 0x7fb2d8003a80 2024-09-21T07:28:32.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.091+0000 7fb2f5200640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 0x7fb2d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.091+0000 7fb2f5200640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 0x7fb2d0075740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0073ed0 tx=0x7fb2dc005f60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:32.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.095+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2f00af0a0 con 0x7fb2d8003a80 2024-09-21T07:28:32.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2f00741a0 con 0x7fb2d8003a80 2024-09-21T07:28:32.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2ed600640 1 -- 172.21.15.64:0/3774396474 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7fb2f00b3650 con 0x7fb2d8003a80 2024-09-21T07:28:32.309 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:32.309 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:32.309 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 msgr2=0x7fb2d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 0x7fb2d0075740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0073ed0 tx=0x7fb2dc005f60 comp rx=0 tx=0).stop 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 msgr2=0x7fb2f00afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.307+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4002100 tx=0x7fb2e400c380 comp rx=0 tx=0).stop 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 shutdown_connections 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2d0073230 0x7fb2d0075740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2f00ae750 0x7fb2f00aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2f01f99c0 0x7fb2f01f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 --2- 172.21.15.64:0/3774396474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2d8003a80 0x7fb2f00afa30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 >> 172.21.15.64:0/3774396474 conn(0x7fb2f00cdd00 msgr2=0x7fb2f00749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:32.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 shutdown_connections 2024-09-21T07:28:32.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.311+0000 7fb2f8600640 1 -- 172.21.15.64:0/3774396474 wait complete. 2024-09-21T07:28:32.332 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-21T07:28:32.502 INFO:teuthology.orchestra.run.smithi064.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-21T07:28:16.395430+0000","btime":"2024-09-21T07:28:15.483438+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-21T07:28:16.395430+0000","atime":"2024-09-21T07:28:15.483438+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-21T07:28:16.395430+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-21T07:28:16.395430+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-21T07:28:26.309544+0000","last_scrub_version":128,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-21T07:28:32.503 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-21T07:28:15.483438+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-21T07:28:15.483438+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-21T07:28:16.395430+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-21T07:28:16.395430+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-21T07:28:26.309544+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-21T07:28:16.395430+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-21T07:28:16.395430+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-21T07:28:32.503 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T07:28:32.503 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:28:32.503 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:28:32.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:28:32.718 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:28:32.718 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:28:32.718 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:32.718 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:32.727 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:28:32.728 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:28:32.728 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:28:32.728 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:32.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:28:32.738 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:28:32.738 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:32.739 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:32.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:28:32.780 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:28:32.781 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:28:32.781 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:32.793 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:28:32.794 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:32.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 -- 172.21.15.64:0/3943306519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24004810 msgr2=0x7f4c24004ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 --2- 172.21.15.64:0/3943306519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24004810 0x7f4c24004ca0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4c28001860 tx=0x7f4c2801eff0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 -- 172.21.15.64:0/3943306519 shutdown_connections 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 --2- 172.21.15.64:0/3943306519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24004810 0x7f4c24004ca0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 -- 172.21.15.64:0/3943306519 >> 172.21.15.64:0/3943306519 conn(0x7f4c400ccbe0 msgr2=0x7f4c400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 -- 172.21.15.64:0/3943306519 shutdown_connections 2024-09-21T07:28:32.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.983+0000 7f4c45000640 1 -- 172.21.15.64:0/3943306519 wait complete. 2024-09-21T07:28:32.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 Processor -- start 2024-09-21T07:28:32.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- start start 2024-09-21T07:28:32.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c24004810 0x7f4c400c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 0x7f4c400c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40070600 con 0x7f4c401583f0 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40070480 con 0x7f4c24004810 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b41c0 con 0x7f4c400c9140 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43142/0 (socket says 172.21.15.64:43142) 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 -- 172.21.15.64:0/1054653645 learned_addr learned my addr 172.21.15.64:0/1054653645 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c3de00640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c24004810 0x7f4c400c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c3e800640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 0x7f4c400c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 -- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 msgr2=0x7f4c400c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 0x7f4c400c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 -- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c24004810 msgr2=0x7f4c400c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:32.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c24004810 0x7f4c400c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 -- 172.21.15.64:0/1054653645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400af150 con 0x7f4c401583f0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c3e800640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 0x7f4c400c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c35400640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4c2801d6f0 tx=0x7f4c28001480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28003600 con 0x7f4c401583f0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c280b7070 con 0x7f4c401583f0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c400c9a90 con 0x7f4c401583f0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28003b50 con 0x7f4c401583f0 2024-09-21T07:28:32.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.987+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4009ccf0 con 0x7f4c401583f0 2024-09-21T07:28:32.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c400b4720 con 0x7f4c401583f0 2024-09-21T07:28:32.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4c28003cf0 con 0x7f4c401583f0 2024-09-21T07:28:32.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c36a00640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 0x7f4c1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:32.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7f4c28131f80 con 0x7f4c401583f0 2024-09-21T07:28:32.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c3de00640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 0x7f4c1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:32.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.991+0000 7f4c3de00640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 0x7f4c1c075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c30006bf0 tx=0x7f4c30000bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:32.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:32.995+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4c400c9a90 con 0x7f4c401583f0 2024-09-21T07:28:33.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.211+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c40159c90 con 0x7f4c401583f0 2024-09-21T07:28:33.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.211+0000 7f4c36a00640 1 -- 172.21.15.64:0/1054653645 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f4c28018da0 con 0x7f4c401583f0 2024-09-21T07:28:33.215 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:33.215 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:33.215 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 msgr2=0x7f4c1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 0x7f4c1c075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c30006bf0 tx=0x7f4c30000bd0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 msgr2=0x7f4c4014b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4c2801d6f0 tx=0x7f4c28001480 comp rx=0 tx=0).stop 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 shutdown_connections 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c1c073200 0x7f4c1c075710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c400c9140 0x7f4c400c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c401583f0 0x7f4c4014b4a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 --2- 172.21.15.64:0/1054653645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c24004810 0x7f4c400c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 >> 172.21.15.64:0/1054653645 conn(0x7f4c400ccbe0 msgr2=0x7f4c400acf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 shutdown_connections 2024-09-21T07:28:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.215+0000 7f4c45000640 1 -- 172.21.15.64:0/1054653645 wait complete. 2024-09-21T07:28:33.238 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2978576335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 msgr2=0x7f7ed006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2978576335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006d020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009840 tx=0x7f7ec001c820 comp rx=0 tx=0).stop 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2978576335 shutdown_connections 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2978576335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006d020 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2978576335 >> 172.21.15.64:0/2978576335 conn(0x7f7ed00d0de0 msgr2=0x7f7ed00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2978576335 shutdown_connections 2024-09-21T07:28:33.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.395+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2978576335 wait complete. 2024-09-21T07:28:33.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 Processor -- start 2024-09-21T07:28:33.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- start start 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ed006d560 0x7f7ed0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed016ae00 con 0x7f7ed00c5b00 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed016ac80 con 0x7f7ed00cf8b0 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed016af80 con 0x7f7ed006d560 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43148/0 (socket says 172.21.15.64:43148) 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 -- 172.21.15.64:0/2101350721 learned_addr learned my addr 172.21.15.64:0/2101350721 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ecfe00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ed006d560 0x7f7ed0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed4e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 -- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ed006d560 msgr2=0x7f7ed0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ed006d560 0x7f7ed0153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 -- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 msgr2=0x7f7ed006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 -- 172.21.15.64:0/2101350721 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed01fc610 con 0x7f7ed00c5b00 2024-09-21T07:28:33.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ec7e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800c760 tx=0x7f7eb800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8006aa0 con 0x7f7ed00c5b00 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eb8017070 con 0x7f7ed00c5b00 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed01fc8f0 con 0x7f7ed00c5b00 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800ce10 con 0x7f7ed00c5b00 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.399+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed01fceb0 con 0x7f7ed00c5b00 2024-09-21T07:28:33.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed00af560 con 0x7f7ed00c5b00 2024-09-21T07:28:33.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7eb8007030 con 0x7f7ed00c5b00 2024-09-21T07:28:33.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7eccc00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 0x7f7eac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7f7eb8093f90 con 0x7f7ed00c5b00 2024-09-21T07:28:33.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7ecfe00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 0x7f7eac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.403+0000 7f7ecfe00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 0x7f7eac075710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00af000 tx=0x7f7ec001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:33.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.407+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7ed006d970 con 0x7f7ed00c5b00 2024-09-21T07:28:33.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.619+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ed006d020 con 0x7f7ed00c5b00 2024-09-21T07:28:33.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.619+0000 7f7eccc00640 1 -- 172.21.15.64:0/2101350721 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f7eb805e790 con 0x7f7ed00c5b00 2024-09-21T07:28:33.623 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:33.623 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:33.623 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 msgr2=0x7f7eac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 0x7f7eac075710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00af000 tx=0x7f7ec001b060 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 msgr2=0x7f7ed00aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800c760 tx=0x7f7eb800cc20 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 shutdown_connections 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7eac073200 0x7f7eac075710 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ed00cf8b0 0x7f7ed006fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed00c5b00 0x7f7ed00aeb30 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 --2- 172.21.15.64:0/2101350721 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ed006d560 0x7f7ed0153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 >> 172.21.15.64:0/2101350721 conn(0x7f7ed00d0de0 msgr2=0x7f7ed015bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:33.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 shutdown_connections 2024-09-21T07:28:33.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.623+0000 7f7ed6e00640 1 -- 172.21.15.64:0/2101350721 wait complete. 2024-09-21T07:28:33.645 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- 172.21.15.64:0/1715043838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a806d730 msgr2=0x7f89a80c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 --2- 172.21.15.64:0/1715043838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a806d730 0x7f89a80c4af0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f89a80c47e0 tx=0x7f899001c740 comp rx=0 tx=0).stop 2024-09-21T07:28:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- 172.21.15.64:0/1715043838 shutdown_connections 2024-09-21T07:28:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 --2- 172.21.15.64:0/1715043838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a806d730 0x7f89a80c4af0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- 172.21.15.64:0/1715043838 >> 172.21.15.64:0/1715043838 conn(0x7f89a80d0de0 msgr2=0x7f89a80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- 172.21.15.64:0/1715043838 shutdown_connections 2024-09-21T07:28:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- 172.21.15.64:0/1715043838 wait complete. 2024-09-21T07:28:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 Processor -- start 2024-09-21T07:28:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.803+0000 7f89aea00640 1 -- start start 2024-09-21T07:28:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a80c5030 0x7f89a815b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89a80cf8b0 0x7f89a8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f89a816b2d0 con 0x7f89a815fc90 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89a816b150 con 0x7f89a80c5030 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f89a816b450 con 0x7f89a80cf8b0 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43156/0 (socket says 172.21.15.64:43156) 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 -- 172.21.15.64:0/2747459939 learned_addr learned my addr 172.21.15.64:0/2747459939 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89a7e00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a80c5030 0x7f89a815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f899fe00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89a80cf8b0 0x7f89a8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 -- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89a80cf8b0 msgr2=0x7f89a8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89a80cf8b0 0x7f89a8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 -- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a80c5030 msgr2=0x7f89a815b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a80c5030 0x7f89a815b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:33.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 -- 172.21.15.64:0/2747459939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a815cec0 con 0x7f89a815fc90 2024-09-21T07:28:33.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aca00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f89a0001710 tx=0x7f89a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:33.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0016020 con 0x7f89a815fc90 2024-09-21T07:28:33.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89a000ab60 con 0x7f89a815fc90 2024-09-21T07:28:33.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0012420 con 0x7f89a815fc90 2024-09-21T07:28:33.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a815d1a0 con 0x7f89a815fc90 2024-09-21T07:28:33.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a8151990 con 0x7f89a815fc90 2024-09-21T07:28:33.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.807+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a80c4af0 con 0x7f89a815fc90 2024-09-21T07:28:33.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.811+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89a0019020 con 0x7f89a815fc90 2024-09-21T07:28:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.811+0000 7f89a4c00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 0x7f8984075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.811+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7f89a00946f0 con 0x7f89a815fc90 2024-09-21T07:28:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.811+0000 7f89a7e00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 0x7f8984075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:33.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.811+0000 7f89a7e00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 0x7f8984075710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8998007fd0 tx=0x7f8998009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.815+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f89a0020020 con 0x7f89a815fc90 2024-09-21T07:28:33.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.995+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89a81552f0 con 0x7f89a815fc90 2024-09-21T07:28:33.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.995+0000 7f89a4c00640 1 -- 172.21.15.64:0/2747459939 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+17224 (secure 0 0 0) 0x7f89a005ee70 con 0x7f89a815fc90 2024-09-21T07:28:33.997 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:33.997 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":105,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:29.750020+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:00.658026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:01.864625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.38","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6837/4106969991":"2024-09-22T07:28:18.591798+0000","172.21.15.90:6835/4106969991":"2024-09-22T07:28:18.591798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 msgr2=0x7f8984075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 0x7f8984075710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8998007fd0 tx=0x7f8998009040 comp rx=0 tx=0).stop 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 msgr2=0x7f89a80b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f89a0001710 tx=0x7f89a000cc80 comp rx=0 tx=0).stop 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 shutdown_connections 2024-09-21T07:28:33.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8984073200 0x7f8984075710 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89a815fc90 0x7f89a80b5820 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89a80cf8b0 0x7f89a8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 --2- 172.21.15.64:0/2747459939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a80c5030 0x7f89a815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 >> 172.21.15.64:0/2747459939 conn(0x7f89a80d0de0 msgr2=0x7f89a80c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 shutdown_connections 2024-09-21T07:28:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:33.999+0000 7f89aea00640 1 -- 172.21.15.64:0/2747459939 wait complete. 2024-09-21T07:28:34.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:28:34.020 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:34.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.175+0000 7ff983000640 1 -- 172.21.15.64:0/836958794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff960004810 msgr2=0x7ff960004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.175+0000 7ff983000640 1 --2- 172.21.15.64:0/836958794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff960004810 0x7ff960004c20 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0cdc60 tx=0x7ff96401d190 comp rx=0 tx=0).stop 2024-09-21T07:28:34.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff981000640 1 -- 172.21.15.64:0/836958794 reap_dead start 2024-09-21T07:28:34.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 -- 172.21.15.64:0/836958794 shutdown_connections 2024-09-21T07:28:34.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 -- 172.21.15.64:0/836958794 >> 172.21.15.64:0/836958794 conn(0x7ff97c0ccbe0 msgr2=0x7ff97c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:34.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 -- 172.21.15.64:0/836958794 shutdown_connections 2024-09-21T07:28:34.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 -- 172.21.15.64:0/836958794 wait complete. 2024-09-21T07:28:34.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 Processor -- start 2024-09-21T07:28:34.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.179+0000 7ff983000640 1 -- start start 2024-09-21T07:28:34.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff960004810 0x7ff97c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 0x7ff97c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0cb100 con 0x7ff97c0aebc0 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0b4390 con 0x7ff960004810 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c0cb280 con 0x7ff97c0b12d0 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff97be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff960004810 0x7ff97c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43166/0 (socket says 172.21.15.64:43166) 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 -- 172.21.15.64:0/4112644191 learned_addr learned my addr 172.21.15.64:0/4112644191 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff981000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 0x7ff97c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 -- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 msgr2=0x7ff97c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 0x7ff97c15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 -- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff960004810 msgr2=0x7ff97c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff960004810 0x7ff97c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 -- 172.21.15.64:0/4112644191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c15dfe0 con 0x7ff97c0aebc0 2024-09-21T07:28:34.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff981000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 0x7ff97c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:34.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff973e00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff96401cfc0 tx=0x7ff964005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:34.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640b1070 con 0x7ff97c0aebc0 2024-09-21T07:28:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9640be070 con 0x7ff97c0aebc0 2024-09-21T07:28:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c158580 con 0x7ff97c0aebc0 2024-09-21T07:28:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640acb40 con 0x7ff97c0aebc0 2024-09-21T07:28:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c15d710 con 0x7ff97c0aebc0 2024-09-21T07:28:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c15e250 con 0x7ff97c0aebc0 2024-09-21T07:28:34.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.183+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff9640acce0 con 0x7ff97c0aebc0 2024-09-21T07:28:34.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.187+0000 7ff978c00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 0x7ff958075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.187+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7ff96412fb30 con 0x7ff97c0aebc0 2024-09-21T07:28:34.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.187+0000 7ff97be00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 0x7ff958075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.187+0000 7ff97be00640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 0x7ff958075710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009ce0 tx=0x7ff96c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:34.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.191+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff964016ea0 con 0x7ff97c0aebc0 2024-09-21T07:28:34.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff97c15f640 con 0x7ff97c0aebc0 2024-09-21T07:28:34.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff978c00640 1 -- 172.21.15.64:0/4112644191 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7ff9640fa8f0 con 0x7ff97c0aebc0 2024-09-21T07:28:34.409 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:34.409 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:34.409 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 msgr2=0x7ff958075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 0x7ff958075710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009ce0 tx=0x7ff96c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 msgr2=0x7ff97c15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff96401cfc0 tx=0x7ff964005620 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 shutdown_connections 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff958073200 0x7ff958075710 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c0b12d0 0x7ff97c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97c0aebc0 0x7ff97c15c670 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 --2- 172.21.15.64:0/4112644191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff960004810 0x7ff97c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.407+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 >> 172.21.15.64:0/4112644191 conn(0x7ff97c0ccbe0 msgr2=0x7ff97c06ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:34.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.411+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 shutdown_connections 2024-09-21T07:28:34.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.411+0000 7ff983000640 1 -- 172.21.15.64:0/4112644191 wait complete. 2024-09-21T07:28:34.431 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 -- 172.21.15.64:0/4167919895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff354004240 msgr2=0x7ff354004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 --2- 172.21.15.64:0/4167919895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff354004240 0x7ff354004810 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff358009b40 tx=0x7ff35801d270 comp rx=0 tx=0).stop 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff371800640 1 -- 172.21.15.64:0/4167919895 reap_dead start 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 -- 172.21.15.64:0/4167919895 shutdown_connections 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 -- 172.21.15.64:0/4167919895 >> 172.21.15.64:0/4167919895 conn(0x7ff36c0ccbe0 msgr2=0x7ff36c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 -- 172.21.15.64:0/4167919895 shutdown_connections 2024-09-21T07:28:34.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 -- 172.21.15.64:0/4167919895 wait complete. 2024-09-21T07:28:34.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.591+0000 7ff373800640 1 Processor -- start 2024-09-21T07:28:34.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- start start 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 0x7ff36c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff36c15b980 0x7ff36c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b4550 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b43d0 con 0x7ff36c15b980 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c073530 con 0x7ff354004240 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43194/0 (socket says 172.21.15.64:43194) 2024-09-21T07:28:34.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 -- 172.21.15.64:0/262299614 learned_addr learned my addr 172.21.15.64:0/262299614 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff370e00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 0x7ff36c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff36be00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff36c15b980 0x7ff36c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 -- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 msgr2=0x7ff36c0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 0x7ff36c0b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 -- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff36c15b980 msgr2=0x7ff36c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff36c15b980 0x7ff36c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 -- 172.21.15.64:0/262299614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c0af1f0 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff370e00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 0x7ff36c0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff371800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0ceee0 tx=0x7ff364006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36400fa20 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff364018070 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c0b1a70 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36400fe80 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.595+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c1f9670 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36c0b1c40 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff36401d460 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff368c00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 0x7ff34c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:34.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7ff364094d60 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff370e00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 0x7ff34c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:34.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.599+0000 7ff370e00640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 0x7ff34c075710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff360006600 tx=0x7ff360006790 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:34.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.603+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff36c0af1f0 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff36c1f9120 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff368c00640 1 -- 172.21.15.64:0/262299614 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7ff36c0b4b10 con 0x7ff36c0ae8a0 2024-09-21T07:28:34.824 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:34.824 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":75,"btime":"2024-09-21T07:28:22:619723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:02.892207+0000","modified":"2024-09-21T07:28:22.619716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/595883067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":595883067},{"type":"v1","addr":"172.21.15.64:6835","nonce":595883067}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7470,"qdb_cluster":[7470]},"id":6}]} 2024-09-21T07:28:34.824 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 75 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 msgr2=0x7ff34c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 0x7ff34c075710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff360006600 tx=0x7ff360006790 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 msgr2=0x7ff36c0aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0ceee0 tx=0x7ff364006720 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 shutdown_connections 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff34c073200 0x7ff34c075710 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff36c0ae8a0 0x7ff36c0aecb0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff36c15b980 0x7ff36c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 --2- 172.21.15.64:0/262299614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff354004240 0x7ff36c0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 >> 172.21.15.64:0/262299614 conn(0x7ff36c0ccbe0 msgr2=0x7ff36c15d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:34.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 shutdown_connections 2024-09-21T07:28:34.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:34.823+0000 7ff373800640 1 -- 172.21.15.64:0/262299614 wait complete. 2024-09-21T07:28:34.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:35.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- 172.21.15.64:0/795859529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a40b22f0 msgr2=0x7ff7a40cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 --2- 172.21.15.64:0/795859529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a40b22f0 0x7ff7a40cbcd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009bf0 tx=0x7ff79c01cb70 comp rx=0 tx=0).stop 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- 172.21.15.64:0/795859529 shutdown_connections 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 --2- 172.21.15.64:0/795859529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a40b22f0 0x7ff7a40cbcd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 --2- 172.21.15.64:0/795859529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a415cbd0 0x7ff7a4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- 172.21.15.64:0/795859529 >> 172.21.15.64:0/795859529 conn(0x7ff7a40ccbe0 msgr2=0x7ff7a40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- 172.21.15.64:0/795859529 shutdown_connections 2024-09-21T07:28:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- 172.21.15.64:0/795859529 wait complete. 2024-09-21T07:28:35.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 Processor -- start 2024-09-21T07:28:35.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.003+0000 7ff7ac400640 1 -- start start 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a4070850 0x7ff7a40aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a415cbd0 0x7ff7a41551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a416a410 con 0x7ff7a409ce70 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a416a290 con 0x7ff7a415cbd0 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a416a590 con 0x7ff7a4070850 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45662/0 (socket says 172.21.15.64:45662) 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 -- 172.21.15.64:0/3313127330 learned_addr learned my addr 172.21.15.64:0/3313127330 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7a9a00640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a4070850 0x7ff7a40aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7a9000640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a415cbd0 0x7ff7a41551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 -- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a4070850 msgr2=0x7ff7a40aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a4070850 0x7ff7a40aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 -- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a415cbd0 msgr2=0x7ff7a41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a415cbd0 0x7ff7a41551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 -- 172.21.15.64:0/3313127330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a409d7c0 con 0x7ff7a409ce70 2024-09-21T07:28:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7aa400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009b10 tx=0x7ff79c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0bb070 con 0x7ff7a409ce70 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff79c004d40 con 0x7ff7a409ce70 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0b2040 con 0x7ff7a409ce70 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a41f8c40 con 0x7ff7a409ce70 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a41f91c0 con 0x7ff7a409ce70 2024-09-21T07:28:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.007+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a4155b70 con 0x7ff7a409ce70 2024-09-21T07:28:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.011+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff79c0be070 con 0x7ff7a409ce70 2024-09-21T07:28:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.011+0000 7ff7a1600640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 0x7ff784075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.011+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7ff79c12e410 con 0x7ff7a409ce70 2024-09-21T07:28:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.011+0000 7ff7a9a00640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 0x7ff784075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.011+0000 7ff7a9a00640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 0x7ff784075740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff798009ad0 tx=0x7ff7980091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.015+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff7a409d7c0 con 0x7ff7a409ce70 2024-09-21T07:28:35.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7a40cd2d0 con 0x7ff7a409ce70 2024-09-21T07:28:35.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7a1600640 1 -- 172.21.15.64:0/3313127330 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+17224 (secure 0 0 0) 0x7ff79c016790 con 0x7ff7a409ce70 2024-09-21T07:28:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:35.197 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":105,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:29.750020+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:00.658026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:01.864625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.38","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6837/4106969991":"2024-09-22T07:28:18.591798+0000","172.21.15.90:6835/4106969991":"2024-09-22T07:28:18.591798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 msgr2=0x7ff784075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 0x7ff784075740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff798009ad0 tx=0x7ff7980091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 msgr2=0x7ff7a409d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009b10 tx=0x7ff79c003f40 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 shutdown_connections 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff784073230 0x7ff784075740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7a409ce70 0x7ff7a409d280 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a415cbd0 0x7ff7a41551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.195+0000 7ff7ac400640 1 --2- 172.21.15.64:0/3313127330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a4070850 0x7ff7a40aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.199+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 >> 172.21.15.64:0/3313127330 conn(0x7ff7a40ccbe0 msgr2=0x7ff7a40ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:35.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.199+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 shutdown_connections 2024-09-21T07:28:35.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.199+0000 7ff7ac400640 1 -- 172.21.15.64:0/3313127330 wait complete. 2024-09-21T07:28:35.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 -- 172.21.15.64:0/3820733704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae409df30 msgr2=0x7f2ae40b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 --2- 172.21.15.64:0/3820733704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae409df30 0x7f2ae40b33d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8005fd0 tx=0x7f2ad801c820 comp rx=0 tx=0).stop 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 -- 172.21.15.64:0/3820733704 shutdown_connections 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 --2- 172.21.15.64:0/3820733704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae409df30 0x7f2ae40b33d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 -- 172.21.15.64:0/3820733704 >> 172.21.15.64:0/3820733704 conn(0x7f2ae406d450 msgr2=0x7f2ae40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 -- 172.21.15.64:0/3820733704 shutdown_connections 2024-09-21T07:28:35.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.379+0000 7f2aec800640 1 -- 172.21.15.64:0/3820733704 wait complete. 2024-09-21T07:28:35.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 Processor -- start 2024-09-21T07:28:35.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- start start 2024-09-21T07:28:35.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ae409df30 0x7f2ae414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 0x7f2ae40b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae416a440 con 0x7f2ae40b3910 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae416a2c0 con 0x7f2ae40ce900 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae416a5c0 con 0x7f2ae409df30 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ae409df30 0x7f2ae414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45680/0 (socket says 172.21.15.64:45680) 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 -- 172.21.15.64:0/2655526167 learned_addr learned my addr 172.21.15.64:0/2655526167 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aea800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 0x7f2ae40b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 -- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ae409df30 msgr2=0x7f2ae414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ae409df30 0x7f2ae414a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 -- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 msgr2=0x7f2ae40b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 0x7f2ae40b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 -- 172.21.15.64:0/2655526167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae4153250 con 0x7f2ae40b3910 2024-09-21T07:28:35.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aea800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 0x7f2ae40b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:35.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ae9400640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400c430 tx=0x7f2ad400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4011790 con 0x7f2ae40b3910 2024-09-21T07:28:35.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ad4017070 con 0x7f2ae40b3910 2024-09-21T07:28:35.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae40b2950 con 0x7f2ae40b3910 2024-09-21T07:28:35.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4011cc0 con 0x7f2ae40b3910 2024-09-21T07:28:35.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.383+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae40b2c30 con 0x7f2ae40b3910 2024-09-21T07:28:35.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae40b33d0 con 0x7f2ae40b3910 2024-09-21T07:28:35.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2ad401c460 con 0x7f2ae40b3910 2024-09-21T07:28:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2ade000640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 0x7f2ac8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6303+0+0 (secure 0 0 0) 0x7f2ad4093fe0 con 0x7f2ae40b3910 2024-09-21T07:28:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2ae9e00640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 0x7f2ac8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.387+0000 7f2ae9e00640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 0x7f2ac8075740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80ae000 tx=0x7f2ad801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.391+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2ad4021020 con 0x7f2ae40b3910 2024-09-21T07:28:35.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.607+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2ae40b26e0 con 0x7f2ae40b3910 2024-09-21T07:28:35.609 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:28:35.607+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:28:35.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2ade000640 1 -- 172.21.15.64:0/2655526167 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 161+0+0 (secure 0 0 0) 0x7f2ad405ecf0 con 0x7f2ae40b3910 2024-09-21T07:28:35.611 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:28:35.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 msgr2=0x7f2ac8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 0x7f2ac8075740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80ae000 tx=0x7f2ad801b060 comp rx=0 tx=0).stop 2024-09-21T07:28:35.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 msgr2=0x7f2ae40b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400c430 tx=0x7f2ad400c8f0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 shutdown_connections 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ac8073230 0x7f2ac8075740 secure :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80ae000 tx=0x7f2ad801b060 comp rx=0 tx=0).stop 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ae40ce900 0x7f2ae40b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae40b3910 0x7f2ae40b1000 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 --2- 172.21.15.64:0/2655526167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ae409df30 0x7f2ae414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 >> 172.21.15.64:0/2655526167 conn(0x7f2ae406d450 msgr2=0x7f2ae409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 shutdown_connections 2024-09-21T07:28:35.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.611+0000 7f2aec800640 1 -- 172.21.15.64:0/2655526167 wait complete. 2024-09-21T07:28:35.630 INFO:tasks.ceph.mds.c.smithi064.stderr: -3194> 2024-09-21T07:28:24.611+0000 7f306de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:28:35.636 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:28:35.759 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:28:35.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- 172.21.15.64:0/1830151807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac0b3230 msgr2=0x7f58ac073ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 --2- 172.21.15.64:0/1830151807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac0b3230 0x7f58ac073ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5894009840 tx=0x7f589401c790 comp rx=0 tx=0).stop 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- 172.21.15.64:0/1830151807 shutdown_connections 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 --2- 172.21.15.64:0/1830151807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac0b3230 0x7f58ac073ea0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- 172.21.15.64:0/1830151807 >> 172.21.15.64:0/1830151807 conn(0x7f58ac0cdb20 msgr2=0x7f58ac0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- 172.21.15.64:0/1830151807 shutdown_connections 2024-09-21T07:28:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- 172.21.15.64:0/1830151807 wait complete. 2024-09-21T07:28:35.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 Processor -- start 2024-09-21T07:28:35.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.799+0000 7f58b0a00640 1 -- start start 2024-09-21T07:28:35.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58ac15fb90 0x7f58ac0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac15b330 0x7f58ac151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac169ec0 con 0x7f58ac15f780 2024-09-21T07:28:35.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac169d40 con 0x7f58ac15b330 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac16a040 con 0x7f58ac15fb90 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45696/0 (socket says 172.21.15.64:45696) 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 -- 172.21.15.64:0/2133759874 learned_addr learned my addr 172.21.15.64:0/2133759874 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58a3e00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58ac15fb90 0x7f58ac0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58ab200640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac15b330 0x7f58ac151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 -- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58ac15fb90 msgr2=0x7f58ac0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58ac15fb90 0x7f58ac0c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 -- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac15b330 msgr2=0x7f58ac151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac15b330 0x7f58ac151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 -- 172.21.15.64:0/2133759874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0c4460 con 0x7f58ac15f780 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58aa800640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c400 tx=0x7f589c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c017070 con 0x7f58ac15f780 2024-09-21T07:28:35.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f589c003600 con 0x7f58ac15f780 2024-09-21T07:28:35.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c003a50 con 0x7f58ac15f780 2024-09-21T07:28:35.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac0c4180 con 0x7f58ac15f780 2024-09-21T07:28:35.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac0c6f60 con 0x7f58ac15f780 2024-09-21T07:28:35.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.803+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac0b2b20 con 0x7f58ac15f780 2024-09-21T07:28:35.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.807+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f589c01a070 con 0x7f58ac15f780 2024-09-21T07:28:35.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.807+0000 7f58a2a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 0x7f5888075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:35.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.807+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6389+0+0 (secure 0 0 0) 0x7f589c093810 con 0x7f58ac15f780 2024-09-21T07:28:35.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.807+0000 7f58a3e00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 0x7f5888075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:35.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.807+0000 7f58a3e00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 0x7f5888075710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f58940af000 tx=0x7f589401afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:35.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:35.811+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f589c05de90 con 0x7f58ac15f780 2024-09-21T07:28:36.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.023+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f58ac0c0eb0 con 0x7f58ac15f780 2024-09-21T07:28:36.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.611+0000 7f58a2a00640 1 -- 172.21.15.64:0/2133759874 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f589c0628c0 con 0x7f58ac15f780 2024-09-21T07:28:36.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 msgr2=0x7f5888075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:36.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 0x7f5888075710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f58940af000 tx=0x7f589401afd0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 msgr2=0x7f58ac06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c400 tx=0x7f589c00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 shutdown_connections 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5888073200 0x7f5888075710 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58ac15b330 0x7f58ac151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58ac15fb90 0x7f58ac0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 --2- 172.21.15.64:0/2133759874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ac15f780 0x7f58ac06d8c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 >> 172.21.15.64:0/2133759874 conn(0x7f58ac0cdb20 msgr2=0x7f58ac073e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:36.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 shutdown_connections 2024-09-21T07:28:36.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.615+0000 7f58b0a00640 1 -- 172.21.15.64:0/2133759874 wait complete. 2024-09-21T07:28:36.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- 172.21.15.64:0/95678222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3168003c20 msgr2=0x7f3168004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 --2- 172.21.15.64:0/95678222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3168003c20 0x7f3168004070 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3174001860 tx=0x7f317401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3182800640 1 -- 172.21.15.64:0/95678222 reap_dead start 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- 172.21.15.64:0/95678222 shutdown_connections 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- 172.21.15.64:0/95678222 >> 172.21.15.64:0/95678222 conn(0x7f318406d480 msgr2=0x7f31840710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:36.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- 172.21.15.64:0/95678222 shutdown_connections 2024-09-21T07:28:36.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- 172.21.15.64:0/95678222 wait complete. 2024-09-21T07:28:36.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 Processor -- start 2024-09-21T07:28:36.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.807+0000 7f3189000640 1 -- start start 2024-09-21T07:28:36.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3168003c20 0x7f318406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3184165800 0x7f3184165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3184168870 con 0x7f31840c9420 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31841686f0 con 0x7f3168003c20 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f31841689f0 con 0x7f3184165800 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45712/0 (socket says 172.21.15.64:45712) 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 -- 172.21.15.64:0/2636521483 learned_addr learned my addr 172.21.15.64:0/2636521483 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3181e00640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3168003c20 0x7f318406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3182800640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3184165800 0x7f3184165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 -- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3184165800 msgr2=0x7f3184165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:36.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3184165800 0x7f3184165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 -- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3168003c20 msgr2=0x7f318406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:36.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3168003c20 0x7f318406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:36.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 -- 172.21.15.64:0/2636521483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3184166150 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3179400640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e900 tx=0x7f316c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c015070 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f316c00ce00 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31840c9830 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0116c0 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841fbe80 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31840cebf0 con 0x7f31840c9420 2024-09-21T07:28:36.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.811+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f316c018070 con 0x7f31840c9420 2024-09-21T07:28:36.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.815+0000 7f317aa00640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 0x7f3160075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:36.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.815+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6389+0+0 (secure 0 0 0) 0x7f316c094e90 con 0x7f31840c9420 2024-09-21T07:28:36.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.815+0000 7f3181e00640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 0x7f3160075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:36.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.815+0000 7f3181e00640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 0x7f3160075740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3174001830 tx=0x7f3174019720 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:36.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.819+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3184166150 con 0x7f31840c9420 2024-09-21T07:28:36.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:36.995+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31840b4660 con 0x7f31840c9420 2024-09-21T07:28:37.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.803+0000 7f317aa00640 1 -- 172.21.15.64:0/2636521483 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7f316c096020 con 0x7f31840c9420 2024-09-21T07:28:37.806 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:28:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 msgr2=0x7f3160075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 0x7f3160075740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3174001830 tx=0x7f3174019720 comp rx=0 tx=0).stop 2024-09-21T07:28:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 msgr2=0x7f31841563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e900 tx=0x7f316c00edc0 comp rx=0 tx=0).stop 2024-09-21T07:28:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 shutdown_connections 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3160073230 0x7f3160075740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3184165800 0x7f3184165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31840c9420 0x7f31841563f0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 --2- 172.21.15.64:0/2636521483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3168003c20 0x7f318406f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 >> 172.21.15.64:0/2636521483 conn(0x7f318406d480 msgr2=0x7f31840b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 shutdown_connections 2024-09-21T07:28:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.807+0000 7f3189000640 1 -- 172.21.15.64:0/2636521483 wait complete. 2024-09-21T07:28:37.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:28:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 -- 172.21.15.64:0/3473844578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 msgr2=0x7f04a0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 --2- 172.21.15.64:0/3473844578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a0158db0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0490009900 tx=0x7f049001c820 comp rx=0 tx=0).stop 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 -- 172.21.15.64:0/3473844578 shutdown_connections 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 --2- 172.21.15.64:0/3473844578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 0x7f04a00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 --2- 172.21.15.64:0/3473844578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a0158db0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 -- 172.21.15.64:0/3473844578 >> 172.21.15.64:0/3473844578 conn(0x7f04a00d0170 msgr2=0x7f04a00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 -- 172.21.15.64:0/3473844578 shutdown_connections 2024-09-21T07:28:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:37.999+0000 7f04a5a00640 1 -- 172.21.15.64:0/3473844578 wait complete. 2024-09-21T07:28:38.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 Processor -- start 2024-09-21T07:28:38.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- start start 2024-09-21T07:28:38.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00af360 0x7f04a00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 0x7f04a00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04a015c850 con 0x7f04a006ec70 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04a015c6d0 con 0x7f04a00af360 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f04a015c9d0 con 0x7f04a01592f0 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45740/0 (socket says 172.21.15.64:45740) 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 -- 172.21.15.64:0/603613420 learned_addr learned my addr 172.21.15.64:0/603613420 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049f400640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 0x7f04a00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f0497e00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00af360 0x7f04a00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 -- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 msgr2=0x7f04a00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 0x7f04a00b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 -- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00af360 msgr2=0x7f04a00b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:38.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00af360 0x7f04a00b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 -- 172.21.15.64:0/603613420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01662d0 con 0x7f04a006ec70 2024-09-21T07:28:38.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f049ea00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0490009850 tx=0x7f04900a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:38.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b2040 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0490005070 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900044f0 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a0164a00 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.003+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a0164fc0 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a01647f0 con 0x7f04a006ec70 2024-09-21T07:28:38.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f04900054c0 con 0x7f04a006ec70 2024-09-21T07:28:38.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f0496a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:38.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5951+0+0 (secure 0 0 0) 0x7f049012d9e0 con 0x7f04a006ec70 2024-09-21T07:28:38.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f0497e00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:38.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.007+0000 7f0497e00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0488005fd0 tx=0x7f0488005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:38.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.011+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f04900164d0 con 0x7f04a006ec70 2024-09-21T07:28:38.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.187+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04a0158db0 con 0x7f04a006ec70 2024-09-21T07:28:38.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.807+0000 7f0496a00640 1 -- 172.21.15.64:0/603613420 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7f04900f8900 con 0x7f04a006ec70 2024-09-21T07:28:38.808 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:28:38.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 msgr2=0x7f047c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:38.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0488005fd0 tx=0x7f0488005e40 comp rx=0 tx=0).stop 2024-09-21T07:28:38.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 msgr2=0x7f04a01f9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:38.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0490009850 tx=0x7f04900a56e0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 shutdown_connections 2024-09-21T07:28:38.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f047c073200 0x7f047c075710 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04a01592f0 0x7f04a00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04a00af360 0x7f04a00b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 --2- 172.21.15.64:0/603613420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a006ec70 0x7f04a01f9630 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:38.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 >> 172.21.15.64:0/603613420 conn(0x7f04a00d0170 msgr2=0x7f04a015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:38.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 shutdown_connections 2024-09-21T07:28:38.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:38.815+0000 7f04a5a00640 1 -- 172.21.15.64:0/603613420 wait complete. 2024-09-21T07:28:38.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:28:39.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1071240774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 msgr2=0x7f3e1c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1071240774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e1c005160 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3e380d1370 tx=0x7f3e3001d0d0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e36800640 1 -- 172.21.15.64:0/1071240774 reap_dead start 2024-09-21T07:28:39.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1071240774 shutdown_connections 2024-09-21T07:28:39.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1071240774 >> 172.21.15.64:0/1071240774 conn(0x7f3e3806d450 msgr2=0x7f3e380d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:39.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1071240774 shutdown_connections 2024-09-21T07:28:39.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1071240774 wait complete. 2024-09-21T07:28:39.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 Processor -- start 2024-09-21T07:28:39.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.003+0000 7f3e3cc00640 1 -- start start 2024-09-21T07:28:39.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e380c90f0 0x7f3e380b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 0x7f3e380b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e380d0b80 con 0x7f3e1c004d50 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e380d0a00 con 0x7f3e3815a8d0 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e380d0d00 con 0x7f3e380c90f0 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45768/0 (socket says 172.21.15.64:45768) 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 -- 172.21.15.64:0/1354361149 learned_addr learned my addr 172.21.15.64:0/1354361149 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e2fe00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e380c90f0 0x7f3e380b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e36800640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 0x7f3e380b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 -- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e380c90f0 msgr2=0x7f3e380b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e380c90f0 0x7f3e380b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 -- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 msgr2=0x7f3e380b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 0x7f3e380b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 -- 172.21.15.64:0/1354361149 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e380c9640 con 0x7f3e1c004d50 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e36800640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 0x7f3e380b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e35e00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3e28011a80 tx=0x7f3e28011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800fe70 con 0x7f3e1c004d50 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e28004030 con 0x7f3e1c004d50 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e380c9920 con 0x7f3e1c004d50 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28004480 con 0x7f3e1c004d50 2024-09-21T07:28:39.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e380c9ee0 con 0x7f3e1c004d50 2024-09-21T07:28:39.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.007+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3815f540 con 0x7f3e1c004d50 2024-09-21T07:28:39.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.011+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e28003600 con 0x7f3e1c004d50 2024-09-21T07:28:39.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.011+0000 7f3e2e000640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 0x7f3e14075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.011+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f3e28094fc0 con 0x7f3e1c004d50 2024-09-21T07:28:39.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.011+0000 7f3e2fe00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 0x7f3e14075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.011+0000 7f3e2fe00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 0x7f3e14075740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e381e72b0 tx=0x7f3e20006040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:39.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.015+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3e2805fa10 con 0x7f3e1c004d50 2024-09-21T07:28:39.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.191+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f3e380b0260 con 0x7f3e1c004d50 2024-09-21T07:28:39.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.195+0000 7f3e2e000640 1 -- 172.21.15.64:0/1354361149 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f3e28064440 con 0x7f3e1c004d50 2024-09-21T07:28:39.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 msgr2=0x7f3e14075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 0x7f3e14075740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e381e72b0 tx=0x7f3e20006040 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 msgr2=0x7f3e380c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3e28011a80 tx=0x7f3e28011f40 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 shutdown_connections 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e14073230 0x7f3e14075740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e3815a8d0 0x7f3e380b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e380c90f0 0x7f3e380b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 --2- 172.21.15.64:0/1354361149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e1c004d50 0x7f3e380c8bb0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 >> 172.21.15.64:0/1354361149 conn(0x7f3e3806d450 msgr2=0x7f3e3815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 shutdown_connections 2024-09-21T07:28:39.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.199+0000 7f3e3cc00640 1 -- 172.21.15.64:0/1354361149 wait complete. 2024-09-21T07:28:39.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-21T07:28:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- 172.21.15.64:0/74111080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 msgr2=0x7f1fec0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/74111080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec0b41c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009840 tx=0x7f1fd401c820 comp rx=0 tx=0).stop 2024-09-21T07:28:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- 172.21.15.64:0/74111080 shutdown_connections 2024-09-21T07:28:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/74111080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 0x7f1fec072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/74111080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec0b41c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- 172.21.15.64:0/74111080 >> 172.21.15.64:0/74111080 conn(0x7f1fec0ccbe0 msgr2=0x7f1fec0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- 172.21.15.64:0/74111080 shutdown_connections 2024-09-21T07:28:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- 172.21.15.64:0/74111080 wait complete. 2024-09-21T07:28:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 Processor -- start 2024-09-21T07:28:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 -- start start 2024-09-21T07:28:39.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.387+0000 7f1ff0a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 0x7f1fec154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 0x7f1fec15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec168b90 con 0x7f1fec0709b0 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec168a10 con 0x7f1fec15edb0 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec168d10 con 0x7f1fec0b4700 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45788/0 (socket says 172.21.15.64:45788) 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 -- 172.21.15.64:0/1559108694 learned_addr learned my addr 172.21.15.64:0/1559108694 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe3e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 0x7f1fec154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fea800640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 0x7f1fec15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 -- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 msgr2=0x7f1fec154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 0x7f1fec154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 -- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 msgr2=0x7f1fec15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 0x7f1fec15de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 -- 172.21.15.64:0/1559108694 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec1f8990 con 0x7f1fec0709b0 2024-09-21T07:28:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fea800640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 0x7f1fec15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe9e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001ec0 tx=0x7f1fdc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc017070 con 0x7f1fec0709b0 2024-09-21T07:28:39.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fdc003600 con 0x7f1fec0709b0 2024-09-21T07:28:39.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc003a50 con 0x7f1fec0709b0 2024-09-21T07:28:39.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec1f8c70 con 0x7f1fec0709b0 2024-09-21T07:28:39.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec1f9230 con 0x7f1fec0709b0 2024-09-21T07:28:39.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec0b41c0 con 0x7f1fec0709b0 2024-09-21T07:28:39.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.391+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1fdc01a070 con 0x7f1fec0709b0 2024-09-21T07:28:39.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.395+0000 7f1fe2000640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 0x7f1fc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:39.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.395+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f1fdc093380 con 0x7f1fec0709b0 2024-09-21T07:28:39.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.395+0000 7f1fe3e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 0x7f1fc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:39.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.395+0000 7f1fe3e00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 0x7f1fc8075710 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40af000 tx=0x7f1fd401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:39.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.399+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1fec0b4b10 con 0x7f1fec0709b0 2024-09-21T07:28:39.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.639+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f1fec09da20 con 0x7f1fec0709b0 2024-09-21T07:28:39.664 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:39.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:39.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.815+0000 7f1fe2000640 1 -- 172.21.15.64:0/1559108694 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v307) ==== 151+0+0 (secure 0 0 0) 0x7f1fdc05de60 con 0x7f1fec0709b0 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 msgr2=0x7f1fc8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 0x7f1fc8075710 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40af000 tx=0x7f1fd401b060 comp rx=0 tx=0).stop 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 msgr2=0x7f1fec164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001ec0 tx=0x7f1fdc00c890 comp rx=0 tx=0).stop 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 shutdown_connections 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fc8073200 0x7f1fc8075710 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fec15edb0 0x7f1fec15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fec0b4700 0x7f1fec154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 --2- 172.21.15.64:0/1559108694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fec0709b0 0x7f1fec164210 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:39.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 >> 172.21.15.64:0/1559108694 conn(0x7f1fec0ccbe0 msgr2=0x7f1fec159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:39.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 shutdown_connections 2024-09-21T07:28:39.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.819+0000 7f1ff0a00640 1 -- 172.21.15.64:0/1559108694 wait complete. 2024-09-21T07:28:39.842 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-21T07:28:39.842 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-21T07:28:39.842 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-21T07:28:39.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 -- 172.21.15.64:0/694356267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 msgr2=0x7f99580b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 --2- 172.21.15.64:0/694356267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99580b41c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f9940009840 tx=0x7f994001c820 comp rx=0 tx=0).stop 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 -- 172.21.15.64:0/694356267 shutdown_connections 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 --2- 172.21.15.64:0/694356267 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99580b4700 0x7f9958072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 --2- 172.21.15.64:0/694356267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99580b41c0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 -- 172.21.15.64:0/694356267 >> 172.21.15.64:0/694356267 conn(0x7f99580ccbe0 msgr2=0x7f99580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 -- 172.21.15.64:0/694356267 shutdown_connections 2024-09-21T07:28:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:39.999+0000 7f995de00640 1 -- 172.21.15.64:0/694356267 wait complete. 2024-09-21T07:28:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 Processor -- start 2024-09-21T07:28:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- start start 2024-09-21T07:28:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99580b4700 0x7f99580c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995815edb0 0x7f99580c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9958168b90 con 0x7f99580709b0 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9958168a10 con 0x7f99580b4700 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9958168d10 con 0x7f995815edb0 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45810/0 (socket says 172.21.15.64:45810) 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 -- 172.21.15.64:0/94978092 learned_addr learned my addr 172.21.15.64:0/94978092 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9957400640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995815edb0 0x7f99580c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f994fe00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99580b4700 0x7f99580c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 -- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995815edb0 msgr2=0x7f99580c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995815edb0 0x7f99580c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 -- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99580b4700 msgr2=0x7f99580c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99580b4700 0x7f99580c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 -- 172.21.15.64:0/94978092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958163670 con 0x7f99580709b0 2024-09-21T07:28:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f9956a00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f994800c730 tx=0x7f994800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948016020 con 0x7f99580709b0 2024-09-21T07:28:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f994800a950 con 0x7f99580709b0 2024-09-21T07:28:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994800ada0 con 0x7f99580709b0 2024-09-21T07:28:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958163910 con 0x7f99580709b0 2024-09-21T07:28:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.003+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9958163ed0 con 0x7f99580709b0 2024-09-21T07:28:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99580b41c0 con 0x7f99580709b0 2024-09-21T07:28:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9948019020 con 0x7f99580709b0 2024-09-21T07:28:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f994f400640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 0x7f9934075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f9948093fe0 con 0x7f99580709b0 2024-09-21T07:28:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f994fe00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 0x7f9934075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.007+0000 7f994fe00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 0x7f9934075740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99400af000 tx=0x7f994001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.011+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9948020020 con 0x7f99580709b0 2024-09-21T07:28:40.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.191+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99580ca420 con 0x7f99580709b0 2024-09-21T07:28:40.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.191+0000 7f994f400640 1 -- 172.21.15.64:0/94978092 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+13390 (secure 0 0 0) 0x7f99580b4b10 con 0x7f99580709b0 2024-09-21T07:28:40.194 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:40.194 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":108,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:38.806306+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6834/595883067":"2024-09-22T07:28:35.610162+0000","172.21.15.90:6837/4106969991":"2024-09-22T07:28:18.591798+0000","172.21.15.64:6835/595883067":"2024-09-22T07:28:35.610162+0000","172.21.15.90:6835/4106969991":"2024-09-22T07:28:18.591798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:40.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 msgr2=0x7f9934075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 0x7f9934075740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99400af000 tx=0x7f994001b060 comp rx=0 tx=0).stop 2024-09-21T07:28:40.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 msgr2=0x7f99581643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f994800c730 tx=0x7f994800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 shutdown_connections 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9934073230 0x7f9934075740 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995815edb0 0x7f99580c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99580b4700 0x7f99580c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 --2- 172.21.15.64:0/94978092 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99580709b0 0x7f99581643f0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 >> 172.21.15.64:0/94978092 conn(0x7f99580ccbe0 msgr2=0x7f99580ad510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 shutdown_connections 2024-09-21T07:28:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.195+0000 7f995de00640 1 -- 172.21.15.64:0/94978092 wait complete. 2024-09-21T07:28:40.217 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:28:40.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:28:40.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- 172.21.15.64:0/4001872063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3100cf8a0 msgr2=0x7fb31015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 --2- 172.21.15.64:0/4001872063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3100cf8a0 0x7fb31015aee0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb308009bc0 tx=0x7fb30801cb10 comp rx=0 tx=0).stop 2024-09-21T07:28:40.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- 172.21.15.64:0/4001872063 shutdown_connections 2024-09-21T07:28:40.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 --2- 172.21.15.64:0/4001872063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3100cf8a0 0x7fb31015aee0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 --2- 172.21.15.64:0/4001872063 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb31006ff90 0x7fb310073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- 172.21.15.64:0/4001872063 >> 172.21.15.64:0/4001872063 conn(0x7fb3100cdd10 msgr2=0x7fb3100ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- 172.21.15.64:0/4001872063 shutdown_connections 2024-09-21T07:28:40.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- 172.21.15.64:0/4001872063 wait complete. 2024-09-21T07:28:40.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 Processor -- start 2024-09-21T07:28:40.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.379+0000 7fb314c00640 1 -- start start 2024-09-21T07:28:40.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3100b59e0 0x7fb31015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 0x7fb3101568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb310169790 con 0x7fb31006ff90 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb310169610 con 0x7fb310156490 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb310169910 con 0x7fb3100b59e0 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45816/0 (socket says 172.21.15.64:45816) 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 -- 172.21.15.64:0/3272756547 learned_addr learned my addr 172.21.15.64:0/3272756547 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30d400640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3100b59e0 0x7fb31015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30e800640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 0x7fb3101568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 -- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3100b59e0 msgr2=0x7fb31015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3100b59e0 0x7fb31015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 -- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 msgr2=0x7fb3101568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 0x7fb3101568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 -- 172.21.15.64:0/3272756547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb310156de0 con 0x7fb31006ff90 2024-09-21T07:28:40.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30e800640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 0x7fb3101568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:40.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb30de00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e9f0 tx=0x7fb30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000ccc0 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb300010430 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb310159930 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300010880 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3101f98c0 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.383+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb310073f30 con 0x7fb31006ff90 2024-09-21T07:28:40.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.387+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb300010a20 con 0x7fb31006ff90 2024-09-21T07:28:40.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.387+0000 7fb306000640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 0x7fb2f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.387+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7fb300095530 con 0x7fb31006ff90 2024-09-21T07:28:40.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.387+0000 7fb30d400640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 0x7fb2f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.387+0000 7fb30d400640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 0x7fb2f0075710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb310154fd0 tx=0x7fb2fc0013c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.391+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb310156de0 con 0x7fb31006ff90 2024-09-21T07:28:40.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3100b60c0 con 0x7fb31006ff90 2024-09-21T07:28:40.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb306000640 1 -- 172.21.15.64:0/3272756547 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7fb30005ff80 con 0x7fb31006ff90 2024-09-21T07:28:40.569 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 msgr2=0x7fb2f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 0x7fb2f0075710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb310154fd0 tx=0x7fb2fc0013c0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 msgr2=0x7fb310154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e9f0 tx=0x7fb30000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 shutdown_connections 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2f0073200 0x7fb2f0075710 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb310156490 0x7fb3101568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3100b59e0 0x7fb31015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 --2- 172.21.15.64:0/3272756547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb31006ff90 0x7fb310154400 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.567+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 >> 172.21.15.64:0/3272756547 conn(0x7fb3100cdd10 msgr2=0x7fb310157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.571+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 shutdown_connections 2024-09-21T07:28:40.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.571+0000 7fb314c00640 1 -- 172.21.15.64:0/3272756547 wait complete. 2024-09-21T07:28:40.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 -- 172.21.15.64:0/978552776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0b4700 msgr2=0x7f190c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 --2- 172.21.15.64:0/978552776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0b4700 0x7f190c072e20 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f190c0c3c60 tx=0x7f190401cd20 comp rx=0 tx=0).stop 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 -- 172.21.15.64:0/978552776 shutdown_connections 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 --2- 172.21.15.64:0/978552776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0b4700 0x7f190c072e20 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 --2- 172.21.15.64:0/978552776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c0709b0 0x7f190c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 --2- 172.21.15.64:0/978552776 >> v2:172.21.15.90:3300/0 conn(0x7f190c15edb0 0x7f190c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 -- 172.21.15.64:0/978552776 >> 172.21.15.64:0/978552776 conn(0x7f190c0ccbe0 msgr2=0x7f190c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 -- 172.21.15.64:0/978552776 shutdown_connections 2024-09-21T07:28:40.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.747+0000 7f1912800640 1 -- 172.21.15.64:0/978552776 wait complete. 2024-09-21T07:28:40.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 Processor -- start 2024-09-21T07:28:40.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- start start 2024-09-21T07:28:40.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f190c0b4700 0x7f190c163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 0x7f190c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0b23d0 con 0x7f190c0709b0 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0b2250 con 0x7f190c0b4700 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f190c0b2550 con 0x7f190c15edb0 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45824/0 (socket says 172.21.15.64:45824) 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 -- 172.21.15.64:0/300692138 learned_addr learned my addr 172.21.15.64:0/300692138 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190be00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 0x7f190c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1902a00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f190c0b4700 0x7f190c163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 -- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 msgr2=0x7f190c0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 0x7f190c0ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 -- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f190c0b4700 msgr2=0x7f190c163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f190c0b4700 0x7f190c163fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 -- 172.21.15.64:0/300692138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c164c50 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190be00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 0x7f190c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f190b400640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00d950 tx=0x7f18fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc017070 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18fc009d20 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0106c0 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c164f30 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c09ae70 con 0x7f190c0709b0 2024-09-21T07:28:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.751+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190c072e20 con 0x7f190c0709b0 2024-09-21T07:28:40.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.755+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f18fc01a070 con 0x7f190c0709b0 2024-09-21T07:28:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.755+0000 7f1903e00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 0x7f18e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.755+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f18fc0943d0 con 0x7f190c0709b0 2024-09-21T07:28:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.755+0000 7f1902a00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 0x7f18e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:40.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.755+0000 7f1902a00640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 0x7f18e8075710 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005fd0 tx=0x7f18f4005d80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:40.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.759+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f18fc05f470 con 0x7f190c0709b0 2024-09-21T07:28:41.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:40.999+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f190c165100 con 0x7f190c0709b0 2024-09-21T07:28:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.823+0000 7f1903e00640 1 -- 172.21.15.64:0/300692138 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v309) ==== 161+0+0 (secure 0 0 0) 0x7f18fc05ed70 con 0x7f190c0709b0 2024-09-21T07:28:41.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 msgr2=0x7f18e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:41.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 0x7f18e8075710 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005fd0 tx=0x7f18f4005d80 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 msgr2=0x7f190c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00d950 tx=0x7f18fc00de10 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 shutdown_connections 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18e8073200 0x7f18e8075710 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f190c15edb0 0x7f190c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f190c0b4700 0x7f190c163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 --2- 172.21.15.64:0/300692138 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f190c0709b0 0x7f190c15a770 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 >> 172.21.15.64:0/300692138 conn(0x7f190c0ccbe0 msgr2=0x7f190c15d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 shutdown_connections 2024-09-21T07:28:41.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:41.827+0000 7f1912800640 1 -- 172.21.15.64:0/300692138 wait complete. 2024-09-21T07:28:41.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- 172.21.15.64:0/1486572916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 msgr2=0x7f330c0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 --2- 172.21.15.64:0/1486572916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c0cb100 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f330c071d50 tx=0x7f32f401c800 comp rx=0 tx=0).stop 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- 172.21.15.64:0/1486572916 shutdown_connections 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 --2- 172.21.15.64:0/1486572916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c0cb100 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 --2- 172.21.15.64:0/1486572916 >> v2:172.21.15.90:3300/0 conn(0x7f330c0b24e0 0x7f330c0ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- 172.21.15.64:0/1486572916 >> 172.21.15.64:0/1486572916 conn(0x7f330c0ccbe0 msgr2=0x7f330c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- 172.21.15.64:0/1486572916 shutdown_connections 2024-09-21T07:28:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- 172.21.15.64:0/1486572916 wait complete. 2024-09-21T07:28:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 Processor -- start 2024-09-21T07:28:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.015+0000 7f3312800640 1 -- start start 2024-09-21T07:28:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f330c0b24e0 0x7f330c0aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f330c15e9b0 0x7f330c0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f330c168290 con 0x7f330c0cacf0 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f330c168110 con 0x7f330c0b24e0 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f330c168410 con 0x7f330c15e9b0 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45842/0 (socket says 172.21.15.64:45842) 2024-09-21T07:28:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 -- 172.21.15.64:0/1919365264 learned_addr learned my addr 172.21.15.64:0/1919365264 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f330b400640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f330c0b24e0 0x7f330c0aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f330be00640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f330c15e9b0 0x7f330c0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 -- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f330c15e9b0 msgr2=0x7f330c0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f330c15e9b0 0x7f330c0adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 -- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f330c0b24e0 msgr2=0x7f330c0aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f330c0b24e0 0x7f330c0aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 -- 172.21.15.64:0/1919365264 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c1fabb0 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303e00640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f32f40b0040 tx=0x7f32f40a6550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40be020 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f4004040 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4004470 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c1fae50 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c0ad2f0 con 0x7f330c0cacf0 2024-09-21T07:28:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.019+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c0ca7b0 con 0x7f330c0cacf0 2024-09-21T07:28:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.023+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f32f4003600 con 0x7f330c0cacf0 2024-09-21T07:28:42.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.023+0000 7f3303400640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 0x7f32e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.023+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f32f412e6d0 con 0x7f330c0cacf0 2024-09-21T07:28:42.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.023+0000 7f330b400640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 0x7f32e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.023+0000 7f330b400640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 0x7f32e8075710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00ab40 tx=0x7f32fc00a2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:42.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.027+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f330c1fabb0 con 0x7f330c0cacf0 2024-09-21T07:28:42.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.203+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f330c069000 con 0x7f330c0cacf0 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.203+0000 7f3303400640 1 -- 172.21.15.64:0/1919365264 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v49) ==== 59+0+2294 (secure 0 0 0) 0x7f32f40163f0 con 0x7f330c0cacf0 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:28:42.206 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:28:42.207 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:28:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 msgr2=0x7f32e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 0x7f32e8075710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00ab40 tx=0x7f32fc00a2f0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 msgr2=0x7f330c1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f32f40b0040 tx=0x7f32f40a6550 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 shutdown_connections 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f32e8073200 0x7f32e8075710 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f330c15e9b0 0x7f330c0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330c0cacf0 0x7f330c1513b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 --2- 172.21.15.64:0/1919365264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f330c0b24e0 0x7f330c0aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 >> 172.21.15.64:0/1919365264 conn(0x7f330c0ccbe0 msgr2=0x7f330c0b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 shutdown_connections 2024-09-21T07:28:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.207+0000 7f3312800640 1 -- 172.21.15.64:0/1919365264 wait complete. 2024-09-21T07:28:42.228 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 -- 172.21.15.64:0/1169710040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22040b59e0 msgr2=0x7f220415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 --2- 172.21.15.64:0/1169710040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22040b59e0 0x7f220415aee0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f22040c4d70 tx=0x7f21fc01caf0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 -- 172.21.15.64:0/1169710040 shutdown_connections 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 --2- 172.21.15.64:0/1169710040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22040b59e0 0x7f220415aee0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 --2- 172.21.15.64:0/1169710040 >> v2:172.21.15.90:3300/0 conn(0x7f22040cf8a0 0x7f2204073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 -- 172.21.15.64:0/1169710040 >> 172.21.15.64:0/1169710040 conn(0x7f22040cdd10 msgr2=0x7f22040ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 -- 172.21.15.64:0/1169710040 shutdown_connections 2024-09-21T07:28:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.387+0000 7f220c000640 1 -- 172.21.15.64:0/1169710040 wait complete. 2024-09-21T07:28:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 Processor -- start 2024-09-21T07:28:42.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 -- start start 2024-09-21T07:28:42.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22040b59e0 0x7f220414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22041f8230 0x7f22041f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2204169790 con 0x7f220406ff90 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2204169610 con 0x7f22040b59e0 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2204169910 con 0x7f22041f8230 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45866/0 (socket says 172.21.15.64:45866) 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 -- 172.21.15.64:0/295825665 learned_addr learned my addr 172.21.15.64:0/295825665 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f220a000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22041f8230 0x7f22041f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2208c00640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22040b59e0 0x7f220414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 -- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22041f8230 msgr2=0x7f22041f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22041f8230 0x7f22041f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 -- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22040b59e0 msgr2=0x7f220414afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22040b59e0 0x7f220414afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 -- 172.21.15.64:0/295825665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220414b4f0 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2209600640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c3f0 tx=0x7f21f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.391+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8017070 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f8003600 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8003a50 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220414ba00 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041f7f30 con 0x7f220406ff90 2024-09-21T07:28:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220415aee0 con 0x7f220406ff90 2024-09-21T07:28:42.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f21f801a070 con 0x7f220406ff90 2024-09-21T07:28:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2201600640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 0x7f21e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f21f8093350 con 0x7f220406ff90 2024-09-21T07:28:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.395+0000 7f2208c00640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 0x7f21e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:42.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.399+0000 7f2208c00640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 0x7f21e4075710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2204154a90 tx=0x7f21f00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:42.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.399+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f220414b4f0 con 0x7f220406ff90 2024-09-21T07:28:42.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.579+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f220414bc40 con 0x7f220406ff90 2024-09-21T07:28:42.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f2201600640 1 -- 172.21.15.64:0/295825665 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v50)=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7f21f805de30 con 0x7f220406ff90 2024-09-21T07:28:42.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 msgr2=0x7f21e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 0x7f21e4075710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2204154a90 tx=0x7f21f00091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 msgr2=0x7f22041fb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c3f0 tx=0x7f21f800c8b0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 shutdown_connections 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21e4073200 0x7f21e4075710 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22041f8230 0x7f22041f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22040b59e0 0x7f220414afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 --2- 172.21.15.64:0/295825665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f220406ff90 0x7f22041fb140 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 >> 172.21.15.64:0/295825665 conn(0x7f22040cdd10 msgr2=0x7f2204155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 shutdown_connections 2024-09-21T07:28:42.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:42.583+0000 7f220c000640 1 -- 172.21.15.64:0/295825665 wait complete. 2024-09-21T07:28:42.606 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:28:42.607 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:28:42.693 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:28:42.782 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:28:42.782 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:42.782 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:42.791 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:28:42.791 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:28:42.792 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:42.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:28:42.801 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:42.801 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:42.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:28:42.844 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:28:42.844 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:42.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:28:42.855 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:28:42.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 -- 172.21.15.64:0/1303848147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 msgr2=0x7f99440b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 --2- 172.21.15.64:0/1303848147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99440b41c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9930009900 tx=0x7f993001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 -- 172.21.15.64:0/1303848147 shutdown_connections 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 --2- 172.21.15.64:0/1303848147 >> v2:172.21.15.90:3300/0 conn(0x7f99440b4700 0x7f9944072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 --2- 172.21.15.64:0/1303848147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99440b41c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 -- 172.21.15.64:0/1303848147 >> 172.21.15.64:0/1303848147 conn(0x7f99440ccbe0 msgr2=0x7f99440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:43.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 -- 172.21.15.64:0/1303848147 shutdown_connections 2024-09-21T07:28:43.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.043+0000 7f994c200640 1 -- 172.21.15.64:0/1303848147 wait complete. 2024-09-21T07:28:43.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 Processor -- start 2024-09-21T07:28:43.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- start start 2024-09-21T07:28:43.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99441f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994415edb0 0x7f99441470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9944168b60 con 0x7f99440b4700 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99441689e0 con 0x7f994415edb0 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9944168ce0 con 0x7f99440709b0 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45872/0 (socket says 172.21.15.64:45872) 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 -- 172.21.15.64:0/1875294857 learned_addr learned my addr 172.21.15.64:0/1875294857 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:43.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9949800640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99441f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994a200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994415edb0 0x7f99441470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 -- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 msgr2=0x7f99441f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99441f9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 -- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994415edb0 msgr2=0x7f99441470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994415edb0 0x7f99441470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 -- 172.21.15.64:0/1875294857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9944148010 con 0x7f99440b4700 2024-09-21T07:28:43.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9948e00640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9930009850 tx=0x7f9930005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99300b2040 con 0x7f99440b4700 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9930004040 con 0x7f99440b4700 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930004470 con 0x7f99440b4700 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9944147d30 con 0x7f99440b4700 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.047+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441f9050 con 0x7f99440b4700 2024-09-21T07:28:43.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9944147aa0 con 0x7f99440b4700 2024-09-21T07:28:43.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99300bf020 con 0x7f99440b4700 2024-09-21T07:28:43.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f9941600640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 0x7f9924075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f993012e260 con 0x7f99440b4700 2024-09-21T07:28:43.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f9949800640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 0x7f9924075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.051+0000 7f9949800640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 0x7f9924075710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9938007fd0 tx=0x7f9938009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:43.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.055+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f99300c6020 con 0x7f99440b4700 2024-09-21T07:28:43.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99440b41c0 con 0x7f99440b4700 2024-09-21T07:28:43.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f9941600640 1 -- 172.21.15.64:0/1875294857 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+3911 (secure 0 0 0) 0x7f99300164d0 con 0x7f99440b4700 2024-09-21T07:28:43.280 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:43.280 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":77,"btime":"2024-09-21T07:28:36:612390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1926896433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1926896433},{"type":"v1","addr":"172.21.15.64:6833","nonce":1926896433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1748175023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1748175023},{"type":"v1","addr":"172.21.15.90:6837","nonce":1748175023}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7342,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2743029216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2743029216},{"type":"v1","addr":"172.21.15.64:6835","nonce":2743029216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7464,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3051748374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3051748374},{"type":"v1","addr":"172.21.15.90:6835","nonce":3051748374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-21T07:28:43.280 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 77 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 msgr2=0x7f9924075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 0x7f9924075710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9938007fd0 tx=0x7f9938009040 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 msgr2=0x7f99441f83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9930009850 tx=0x7f9930005780 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 shutdown_connections 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9924073200 0x7f9924075710 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994415edb0 0x7f99441470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99440b4700 0x7f99441f83b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 --2- 172.21.15.64:0/1875294857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99440709b0 0x7f99441f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 >> 172.21.15.64:0/1875294857 conn(0x7f99440ccbe0 msgr2=0x7f99441655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:43.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 shutdown_connections 2024-09-21T07:28:43.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.275+0000 7f994c200640 1 -- 172.21.15.64:0/1875294857 wait complete. 2024-09-21T07:28:43.298 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:28:43.299 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:28:43.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:28:43.299 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:43.299 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:28:43.299 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:28:43.299 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:28:43.299 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:43.299 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:28:43.300 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:28:43.300 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:28:43.300 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:43.300 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:28:43.300 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:28:43.300 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:28:43.300 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:28:43.315 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:28:43.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:28:43.322 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:28:43.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:28:43.323 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:28:43.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:28:43.323 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:28:43.324 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:28:43.336 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:28:43.336 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:43.338 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:28:43.338 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:43.369 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:28:43.369 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:43.371 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:28:43.372 DEBUG:teuthology.parallel:result is None 2024-09-21T07:28:43.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:28:43.439 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:28:43.439 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:28:43.474 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:28:43.478 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 -- 172.21.15.64:0/1974774568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c072e20 msgr2=0x7f264c0af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 --2- 172.21.15.64:0/1974774568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c072e20 0x7f264c0af610 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f264c09db40 tx=0x7f263c01c810 comp rx=0 tx=0).stop 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 -- 172.21.15.64:0/1974774568 shutdown_connections 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 --2- 172.21.15.64:0/1974774568 >> v2:172.21.15.90:3300/0 conn(0x7f264c06ee80 0x7f264c06f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 --2- 172.21.15.64:0/1974774568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c072e20 0x7f264c0af610 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 -- 172.21.15.64:0/1974774568 >> 172.21.15.64:0/1974774568 conn(0x7f264c06d450 msgr2=0x7f264c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 -- 172.21.15.64:0/1974774568 shutdown_connections 2024-09-21T07:28:43.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 -- 172.21.15.64:0/1974774568 wait complete. 2024-09-21T07:28:43.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.539+0000 7f2650e00640 1 Processor -- start 2024-09-21T07:28:43.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- start start 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c06ee80 0x7f264c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c072e20 0x7f264c146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f264c168110 con 0x7f264c0cc980 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f264c167f90 con 0x7f264c06ee80 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f264c168290 con 0x7f264c072e20 2024-09-21T07:28:43.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45920/0 (socket says 172.21.15.64:45920) 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 -- 172.21.15.64:0/2968075204 learned_addr learned my addr 172.21.15.64:0/2968075204 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2649e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c06ee80 0x7f264c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2649400640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c072e20 0x7f264c146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 -- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c072e20 msgr2=0x7f264c146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c072e20 0x7f264c146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 -- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c06ee80 msgr2=0x7f264c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c06ee80 0x7f264c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 -- 172.21.15.64:0/2968075204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c09c8a0 con 0x7f264c0cc980 2024-09-21T07:28:43.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f264a800640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f264400eb90 tx=0x7f264400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644004d30 con 0x7f264c0cc980 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f264400b570 con 0x7f264c0cc980 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c149f10 con 0x7f264c0cc980 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264400b980 con 0x7f264c0cc980 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.543+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c146c80 con 0x7f264c0cc980 2024-09-21T07:28:43.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c146710 con 0x7f264c0cc980 2024-09-21T07:28:43.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f264400bb20 con 0x7f264c0cc980 2024-09-21T07:28:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2642000640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 0x7f262c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5421+0+0 (secure 0 0 0) 0x7f2644094c60 con 0x7f264c0cc980 2024-09-21T07:28:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2649e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 0x7f262c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.547+0000 7f2649e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 0x7f262c075740 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af000 tx=0x7f263c01b050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.551+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f264405f6b0 con 0x7f264c0cc980 2024-09-21T07:28:43.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.739+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f264c06f290 con 0x7f264c0cc980 2024-09-21T07:28:43.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2642000640 1 -- 172.21.15.64:0/2968075204 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) ==== 97+0+0 (secure 0 0 0) 0x7f26440640e0 con 0x7f264c0cc980 2024-09-21T07:28:43.840 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 msgr2=0x7f262c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 0x7f262c075740 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af000 tx=0x7f263c01b050 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 msgr2=0x7f264c1499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f264400eb90 tx=0x7f264400c7a0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 shutdown_connections 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f262c073230 0x7f262c075740 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f264c0cc980 0x7f264c1499d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c072e20 0x7f264c146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 --2- 172.21.15.64:0/2968075204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c06ee80 0x7f264c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 >> 172.21.15.64:0/2968075204 conn(0x7f264c06d450 msgr2=0x7f264c0ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 shutdown_connections 2024-09-21T07:28:43.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:43.839+0000 7f2650e00640 1 -- 172.21.15.64:0/2968075204 wait complete. 2024-09-21T07:28:43.865 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:28:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 -- 172.21.15.64:0/2639372567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40b48d0 msgr2=0x7f0bd4072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/2639372567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40b48d0 0x7f0bd4072e20 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40c3c60 tx=0x7f0bcc01cd80 comp rx=0 tx=0).stop 2024-09-21T07:28:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 -- 172.21.15.64:0/2639372567 shutdown_connections 2024-09-21T07:28:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/2639372567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40b48d0 0x7f0bd4072e20 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/2639372567 >> v2:172.21.15.90:3300/0 conn(0x7f0bd415edb0 0x7f0bd40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 -- 172.21.15.64:0/2639372567 >> 172.21.15.64:0/2639372567 conn(0x7f0bd40ccbe0 msgr2=0x7f0bd40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 -- 172.21.15.64:0/2639372567 shutdown_connections 2024-09-21T07:28:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.019+0000 7f0bd8c00640 1 -- 172.21.15.64:0/2639372567 wait complete. 2024-09-21T07:28:44.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 Processor -- start 2024-09-21T07:28:44.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 -- start start 2024-09-21T07:28:44.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 0x7f0bd40cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bd40b2650 0x7f0bd40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4168c00 con 0x7f0bd40709b0 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4168a80 con 0x7f0bd415edb0 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd8c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd4168d80 con 0x7f0bd40b2650 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45942/0 (socket says 172.21.15.64:45942) 2024-09-21T07:28:44.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.023+0000 7f0bd1e00640 1 -- 172.21.15.64:0/1270300300 learned_addr learned my addr 172.21.15.64:0/1270300300 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bc9400640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 0x7f0bd40cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd2800640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bd40b2650 0x7f0bd40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 -- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bd40b2650 msgr2=0x7f0bd40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bd40b2650 0x7f0bd40cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 -- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 msgr2=0x7f0bd40cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 0x7f0bd40cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 -- 172.21.15.64:0/1270300300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd409abb0 con 0x7f0bd40709b0 2024-09-21T07:28:44.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bc9400640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 0x7f0bd40cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd1e00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c9f0 tx=0x7f0bc400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4007bb0 con 0x7f0bd40709b0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bc4007e40 con 0x7f0bd40709b0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400f690 con 0x7f0bd40709b0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd409ae90 con 0x7f0bd40709b0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd409b170 con 0x7f0bd40709b0 2024-09-21T07:28:44.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd4072e20 con 0x7f0bd40709b0 2024-09-21T07:28:44.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.027+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0bc400f830 con 0x7f0bd40709b0 2024-09-21T07:28:44.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.031+0000 7f0bcaa00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 0x7f0bb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.031+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7f0bc4094900 con 0x7f0bd40709b0 2024-09-21T07:28:44.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.031+0000 7f0bc9400640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 0x7f0bb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.031+0000 7f0bc9400640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 0x7f0bb0075710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0bd41525a0 tx=0x7f0bbc008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.035+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0bc4014030 con 0x7f0bd40709b0 2024-09-21T07:28:44.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0bd409da20 con 0x7f0bd40709b0 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bcaa00640 1 -- 172.21.15.64:0/1270300300 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7f0bc405fad0 con 0x7f0bd40709b0 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:28:44.272 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:28:44.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.274 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.276 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:28:44.277 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:28:44.278 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.279 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.280 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.281 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.282 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.283 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.285 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:28:44.286 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 msgr2=0x7f0bb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 0x7f0bb0075710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0bd41525a0 tx=0x7f0bbc008040 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 msgr2=0x7f0bd40b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c9f0 tx=0x7f0bc400ceb0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 shutdown_connections 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bb0073200 0x7f0bb0075710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bd40b2650 0x7f0bd40cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bd415edb0 0x7f0bd40cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 --2- 172.21.15.64:0/1270300300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bd40709b0 0x7f0bd40b1fc0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 >> 172.21.15.64:0/1270300300 conn(0x7f0bd40ccbe0 msgr2=0x7f0bd40ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 shutdown_connections 2024-09-21T07:28:44.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.271+0000 7f0bd8c00640 1 -- 172.21.15.64:0/1270300300 wait complete. 2024-09-21T07:28:44.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- 172.21.15.64:0/3636123547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 msgr2=0x7f7d6c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/3636123547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d6c003ef0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800bbe0 tx=0x7f7d7801ce50 comp rx=0 tx=0).stop 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ce00640 1 -- 172.21.15.64:0/3636123547 reap_dead start 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- 172.21.15.64:0/3636123547 shutdown_connections 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- 172.21.15.64:0/3636123547 >> 172.21.15.64:0/3636123547 conn(0x7f7d8806d1c0 msgr2=0x7f7d8806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- 172.21.15.64:0/3636123547 shutdown_connections 2024-09-21T07:28:44.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- 172.21.15.64:0/3636123547 wait complete. 2024-09-21T07:28:44.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 Processor -- start 2024-09-21T07:28:44.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.455+0000 7f7d8ee00640 1 -- start start 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d88157710 0x7f7d881f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d881f6fe0 0x7f7d8815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88167660 con 0x7f7d6c003a80 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881677e0 con 0x7f7d88157710 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d88167960 con 0x7f7d881f6fe0 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45972/0 (socket says 172.21.15.64:45972) 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 -- 172.21.15.64:0/2158362980 learned_addr learned my addr 172.21.15.64:0/2158362980 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ce00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d881f6fe0 0x7f7d8815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d7f400640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d88157710 0x7f7d881f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 -- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d881f6fe0 msgr2=0x7f7d8815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d881f6fe0 0x7f7d8815e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 -- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d88157710 msgr2=0x7f7d881f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d88157710 0x7f7d881f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 -- 172.21.15.64:0/2158362980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88157b20 con 0x7f7d6c003a80 2024-09-21T07:28:44.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d87e00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800bbe0 tx=0x7f7d78005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780be070 con 0x7f7d6c003a80 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d780047c0 con 0x7f7d6c003a80 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881f76d0 con 0x7f7d6c003a80 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780ab050 con 0x7f7d6c003a80 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d88156f10 con 0x7f7d6c003a80 2024-09-21T07:28:44.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d880d03f0 con 0x7f7d6c003a80 2024-09-21T07:28:44.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.459+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d780c1070 con 0x7f7d6c003a80 2024-09-21T07:28:44.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.463+0000 7f7d84c00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 0x7f7d64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.463+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7f7d7812e6a0 con 0x7f7d6c003a80 2024-09-21T07:28:44.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.463+0000 7f7d7f400640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 0x7f7d64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.463+0000 7f7d7f400640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 0x7f7d64075710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7d8814d1b0 tx=0x7f7d700067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.467+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7d78016b90 con 0x7f7d6c003a80 2024-09-21T07:28:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d88159910 con 0x7f7d6c003a80 2024-09-21T07:28:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d84c00640 1 -- 172.21.15.64:0/2158362980 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) ==== 84+0+65 (secure 0 0 0) 0x7f7d780f92b0 con 0x7f7d6c003a80 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:28:44.649 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:28:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 msgr2=0x7f7d64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 0x7f7d64075710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7d8814d1b0 tx=0x7f7d700067b0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 msgr2=0x7f7d8815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800bbe0 tx=0x7f7d78005650 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 shutdown_connections 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d64073200 0x7f7d64075710 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d881f6fe0 0x7f7d8815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d88157710 0x7f7d881f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 --2- 172.21.15.64:0/2158362980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d6c003a80 0x7f7d8815d310 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 >> 172.21.15.64:0/2158362980 conn(0x7f7d8806d1c0 msgr2=0x7f7d8814f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 shutdown_connections 2024-09-21T07:28:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.647+0000 7f7d8ee00640 1 -- 172.21.15.64:0/2158362980 wait complete. 2024-09-21T07:28:44.671 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:28:44.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 -- 172.21.15.64:0/4252944203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c1592f0 msgr2=0x7fc26c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 --2- 172.21.15.64:0/4252944203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c1592f0 0x7fc26c0aee20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc258009840 tx=0x7fc25801c760 comp rx=0 tx=0).stop 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 -- 172.21.15.64:0/4252944203 shutdown_connections 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 --2- 172.21.15.64:0/4252944203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c1592f0 0x7fc26c0aee20 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 --2- 172.21.15.64:0/4252944203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c06ec70 0x7fc26c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 -- 172.21.15.64:0/4252944203 >> 172.21.15.64:0/4252944203 conn(0x7fc26c0d0170 msgr2=0x7fc26c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 -- 172.21.15.64:0/4252944203 shutdown_connections 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.831+0000 7fc273600640 1 -- 172.21.15.64:0/4252944203 wait complete. 2024-09-21T07:28:44.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 Processor -- start 2024-09-21T07:28:44.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 -- start start 2024-09-21T07:28:44.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc26c06ec70 0x7fc26c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c1592f0 0x7fc26c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c15c6d0 con 0x7fc26c0af360 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c0af930 con 0x7fc26c06ec70 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc273600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c15c850 con 0x7fc26c1592f0 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45980/0 (socket says 172.21.15.64:45980) 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 -- 172.21.15.64:0/3785782849 learned_addr learned my addr 172.21.15.64:0/3785782849 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc270c00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc26c06ec70 0x7fc26c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc271600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c1592f0 0x7fc26c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 -- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c1592f0 msgr2=0x7fc26c09c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c1592f0 0x7fc26c09c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 -- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc26c06ec70 msgr2=0x7fc26c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc26c06ec70 0x7fc26c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.835+0000 7fc26be00640 1 -- 172.21.15.64:0/3785782849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c0b11e0 con 0x7fc26c0af360 2024-09-21T07:28:44.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc26be00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc25801cc40 tx=0x7fc258005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580b2040 con 0x7fc26c0af360 2024-09-21T07:28:44.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc258004040 con 0x7fc26c0af360 2024-09-21T07:28:44.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258004410 con 0x7fc26c0af360 2024-09-21T07:28:44.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c0b0940 con 0x7fc26c0af360 2024-09-21T07:28:44.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c0b0f00 con 0x7fc26c0af360 2024-09-21T07:28:44.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26c158db0 con 0x7fc26c0af360 2024-09-21T07:28:44.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.839+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2580bd030 con 0x7fc26c0af360 2024-09-21T07:28:44.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.843+0000 7fc268c00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 0x7fc24c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.843+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7fc25812dbd0 con 0x7fc26c0af360 2024-09-21T07:28:44.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.843+0000 7fc270c00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 0x7fc24c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.843+0000 7fc270c00640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 0x7fc24c075740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0cc8f0 tx=0x7fc26000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:44.847+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc2580c4020 con 0x7fc26c0af360 2024-09-21T07:28:45.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.023+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc26c0b60f0 con 0x7fc26c0af360 2024-09-21T07:28:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.859+0000 7fc268c00640 1 -- 172.21.15.64:0/3785782849 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) ==== 138+0+0 (secure 0 0 0) 0x7fc258016410 con 0x7fc26c0af360 2024-09-21T07:28:45.860 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:28:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 msgr2=0x7fc24c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 0x7fc24c075740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0cc8f0 tx=0x7fc26000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:28:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 msgr2=0x7fc26c09c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc25801cc40 tx=0x7fc258005d20 comp rx=0 tx=0).stop 2024-09-21T07:28:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 shutdown_connections 2024-09-21T07:28:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc24c073230 0x7fc24c075740 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc26c1592f0 0x7fc26c09c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc26c0af360 0x7fc26c09c4b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 --2- 172.21.15.64:0/3785782849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc26c06ec70 0x7fc26c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 >> 172.21.15.64:0/3785782849 conn(0x7fc26c0d0170 msgr2=0x7fc26c0ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:45.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 shutdown_connections 2024-09-21T07:28:45.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:45.863+0000 7fc273600640 1 -- 172.21.15.64:0/3785782849 wait complete. 2024-09-21T07:28:45.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:28:46.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- 172.21.15.64:0/2339482150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 msgr2=0x7fa38806ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 --2- 172.21.15.64:0/2339482150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa38806ffb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa388070eb0 tx=0x7fa37401c5c0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- 172.21.15.64:0/2339482150 shutdown_connections 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 --2- 172.21.15.64:0/2339482150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa38806ffb0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 --2- 172.21.15.64:0/2339482150 >> v2:172.21.15.90:3300/0 conn(0x7fa38815ec20 0x7fa3880ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- 172.21.15.64:0/2339482150 >> 172.21.15.64:0/2339482150 conn(0x7fa3880ccbe0 msgr2=0x7fa3880ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- 172.21.15.64:0/2339482150 shutdown_connections 2024-09-21T07:28:46.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- 172.21.15.64:0/2339482150 wait complete. 2024-09-21T07:28:46.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 Processor -- start 2024-09-21T07:28:46.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.055+0000 7fa390000640 1 -- start start 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3880704f0 0x7fa388156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38815ec20 0x7fa3880ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa388168fa0 con 0x7fa3880ca990 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa388168e20 con 0x7fa38815ec20 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa388169120 con 0x7fa3880704f0 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55336/0 (socket says 172.21.15.64:55336) 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 -- 172.21.15.64:0/3024989512 learned_addr learned my addr 172.21.15.64:0/3024989512 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38d600640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3880704f0 0x7fa388156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:46.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38e000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38815ec20 0x7fa3880ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 -- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3880704f0 msgr2=0x7fa388156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3880704f0 0x7fa388156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 -- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38815ec20 msgr2=0x7fa3880ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38815ec20 0x7fa3880ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 -- 172.21.15.64:0/3024989512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3881fd210 con 0x7fa3880ca990 2024-09-21T07:28:46.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa38cc00640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa37401ac70 tx=0x7fa3740a94e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3740ad070 con 0x7fa3880ca990 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3740a9d30 con 0x7fa3880ca990 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3881fc450 con 0x7fa3880ca990 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374005290 con 0x7fa3880ca990 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881fca10 con 0x7fa3880ca990 2024-09-21T07:28:46.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.059+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38806ffb0 con 0x7fa3880ca990 2024-09-21T07:28:46.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.063+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa3740b0070 con 0x7fa3880ca990 2024-09-21T07:28:46.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.063+0000 7fa385600640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 0x7fa368075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:46.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.063+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5619+0+0 (secure 0 0 0) 0x7fa37412eb60 con 0x7fa3880ca990 2024-09-21T07:28:46.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.063+0000 7fa38d600640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 0x7fa368075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:46.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.063+0000 7fa38d600640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 0x7fa368075710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa388072330 tx=0x7fa37c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:46.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.067+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa388070900 con 0x7fa3880ca990 2024-09-21T07:28:46.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.243+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa38815d6d0 con 0x7fa3880ca990 2024-09-21T07:28:46.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.863+0000 7fa385600640 1 -- 172.21.15.64:0/3024989512 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) ==== 170+0+0 (secure 0 0 0) 0x7fa3740f9600 con 0x7fa3880ca990 2024-09-21T07:28:46.863 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.863+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 msgr2=0x7fa368075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.863+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 0x7fa368075710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa388072330 tx=0x7fa37c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.863+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 msgr2=0x7fa3880adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.863+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa37401ac70 tx=0x7fa3740a94e0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 shutdown_connections 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa368073200 0x7fa368075710 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa38815ec20 0x7fa3880ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3880ca990 0x7fa3880adec0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 --2- 172.21.15.64:0/3024989512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3880704f0 0x7fa388156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:46.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 >> 172.21.15.64:0/3024989512 conn(0x7fa3880ccbe0 msgr2=0x7fa38815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:46.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 shutdown_connections 2024-09-21T07:28:46.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:46.867+0000 7fa390000640 1 -- 172.21.15.64:0/3024989512 wait complete. 2024-09-21T07:28:46.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:28:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- 172.21.15.64:0/1295913345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d409df30 msgr2=0x7f78d40b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 --2- 172.21.15.64:0/1295913345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d409df30 0x7f78d40b33d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f78c40098f0 tx=0x7f78c401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- 172.21.15.64:0/1295913345 shutdown_connections 2024-09-21T07:28:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 --2- 172.21.15.64:0/1295913345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d409df30 0x7f78d40b33d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- 172.21.15.64:0/1295913345 >> 172.21.15.64:0/1295913345 conn(0x7f78d406d450 msgr2=0x7f78d40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- 172.21.15.64:0/1295913345 shutdown_connections 2024-09-21T07:28:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- 172.21.15.64:0/1295913345 wait complete. 2024-09-21T07:28:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 Processor -- start 2024-09-21T07:28:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.075+0000 7f78d8c00640 1 -- start start 2024-09-21T07:28:47.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 0x7f78d4074750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:47.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40b3910 0x7f78d40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:47.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:47.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f78d416a430 con 0x7f78d40ce900 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78d416a2b0 con 0x7f78d40b3910 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f78d416a5b0 con 0x7f78d409df30 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55350/0 (socket says 172.21.15.64:55350) 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 -- 172.21.15.64:0/2735700271 learned_addr learned my addr 172.21.15.64:0/2735700271 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d1e00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 0x7f78d4074750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:47.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78cbe00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40b3910 0x7f78d40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:47.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 -- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 msgr2=0x7f78d4074750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:47.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 0x7f78d4074750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 -- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40b3910 msgr2=0x7f78d40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40b3910 0x7f78d40c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 -- 172.21.15.64:0/2735700271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d4074c90 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d1e00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 0x7f78d4074750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d2800640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c730 tx=0x7f78cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc003b80 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78cc003d20 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00aab0 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d4072e10 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40733d0 con 0x7f78d40ce900 2024-09-21T07:28:47.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.079+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d40b33d0 con 0x7f78d40ce900 2024-09-21T07:28:47.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.083+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f78cc00ac50 con 0x7f78d40ce900 2024-09-21T07:28:47.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.083+0000 7f78ca000640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 0x7f78b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:47.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.083+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6001+0+0 (secure 0 0 0) 0x7f78cc093ff0 con 0x7f78d40ce900 2024-09-21T07:28:47.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.083+0000 7f78d1e00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 0x7f78b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:47.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.083+0000 7f78d1e00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 0x7f78b0075710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f78c40af000 tx=0x7f78c401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:47.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.087+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f78cc05e880 con 0x7f78d40ce900 2024-09-21T07:28:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.299+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f78d40ca410 con 0x7f78d40ce900 2024-09-21T07:28:47.897 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 15 and data pool 16 2024-09-21T07:28:47.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.891+0000 7f78ca000640 1 -- 172.21.15.64:0/2735700271 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v80) ==== 174+0+0 (secure 0 0 0) 0x7f78cc0632b0 con 0x7f78d40ce900 2024-09-21T07:28:47.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 msgr2=0x7f78b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:47.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 0x7f78b0075710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f78c40af000 tx=0x7f78c401b120 comp rx=0 tx=0).stop 2024-09-21T07:28:47.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 msgr2=0x7f78d40c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:47.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c730 tx=0x7f78cc00cbf0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 shutdown_connections 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f78b0073200 0x7f78b0075710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78d40ce900 0x7f78d40c9e70 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40b3910 0x7f78d40c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 --2- 172.21.15.64:0/2735700271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78d409df30 0x7f78d4074750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:47.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.903+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 >> 172.21.15.64:0/2735700271 conn(0x7f78d406d450 msgr2=0x7f78d40ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:47.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.907+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 shutdown_connections 2024-09-21T07:28:47.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:47.907+0000 7f78d8c00640 1 -- 172.21.15.64:0/2735700271 wait complete. 2024-09-21T07:28:47.943 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:48.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- 172.21.15.64:0/736950758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 msgr2=0x7f9e40070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 --2- 172.21.15.64:0/736950758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e40070310 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009870 tx=0x7f9e3001c630 comp rx=0 tx=0).stop 2024-09-21T07:28:48.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- 172.21.15.64:0/736950758 shutdown_connections 2024-09-21T07:28:48.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 --2- 172.21.15.64:0/736950758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e40070310 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- 172.21.15.64:0/736950758 >> 172.21.15.64:0/736950758 conn(0x7f9e400ccbe0 msgr2=0x7f9e400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:48.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- 172.21.15.64:0/736950758 shutdown_connections 2024-09-21T07:28:48.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- 172.21.15.64:0/736950758 wait complete. 2024-09-21T07:28:48.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 Processor -- start 2024-09-21T07:28:48.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.103+0000 7f9e45000640 1 -- start start 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e40070850 0x7f9e4015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e401f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e400cc990 con 0x7f9e400b0f30 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e400cc810 con 0x7f9e4015cbd0 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9e40168280 con 0x7f9e40070850 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55362/0 (socket says 172.21.15.64:55362) 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 -- 172.21.15.64:0/2972999432 learned_addr learned my addr 172.21.15.64:0/2972999432 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:48.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3de00640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e40070850 0x7f9e4015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e37e00640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e401f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 -- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e40070850 msgr2=0x7f9e4015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e40070850 0x7f9e4015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 -- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 msgr2=0x7f9e401f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e401f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 -- 172.21.15.64:0/2972999432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e401f9fb0 con 0x7f9e400b0f30 2024-09-21T07:28:48.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e3e800640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c7d0 tx=0x7f9e3800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38017070 con 0x7f9e400b0f30 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e38005070 con 0x7f9e400b0f30 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e400b1880 con 0x7f9e400b0f30 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380054c0 con 0x7f9e400b0f30 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e401f60f0 con 0x7f9e400b0f30 2024-09-21T07:28:48.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e401f5b70 con 0x7f9e400b0f30 2024-09-21T07:28:48.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.107+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e3801a070 con 0x7f9e400b0f30 2024-09-21T07:28:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.111+0000 7f9e36000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 0x7f9e1c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.111+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f9e380939d0 con 0x7f9e400b0f30 2024-09-21T07:28:48.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.111+0000 7f9e3de00640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 0x7f9e1c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.111+0000 7f9e3de00640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 0x7f9e1c075740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9e300af000 tx=0x7f9e3001ae70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.115+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9e401f5b70 con 0x7f9e400b0f30 2024-09-21T07:28:48.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.291+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e40070310 con 0x7f9e400b0f30 2024-09-21T07:28:48.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e36000640 1 -- 172.21.15.64:0/2972999432 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16909 (secure 0 0 0) 0x7f9e400b1880 con 0x7f9e400b0f30 2024-09-21T07:28:48.296 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:48.296 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":115,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:47.303682+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:45.037291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:46.257472+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 msgr2=0x7f9e1c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 0x7f9e1c075740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9e300af000 tx=0x7f9e3001ae70 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 msgr2=0x7f9e400b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c7d0 tx=0x7f9e3800cc90 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 shutdown_connections 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e1c073230 0x7f9e1c075740 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e400b0f30 0x7f9e400b1340 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015cbd0 0x7f9e401f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 --2- 172.21.15.64:0/2972999432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e40070850 0x7f9e4015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 >> 172.21.15.64:0/2972999432 conn(0x7f9e400ccbe0 msgr2=0x7f9e40157850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 shutdown_connections 2024-09-21T07:28:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.295+0000 7f9e45000640 1 -- 172.21.15.64:0/2972999432 wait complete. 2024-09-21T07:28:48.318 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:48.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 -- 172.21.15.64:0/2791737736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b00003a80 msgr2=0x7f7b00003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 --2- 172.21.15.64:0/2791737736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b00003a80 0x7f7b00003ef0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009b60 tx=0x7f7b0c01d2b0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b1e600640 1 -- 172.21.15.64:0/2791737736 reap_dead start 2024-09-21T07:28:48.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 -- 172.21.15.64:0/2791737736 shutdown_connections 2024-09-21T07:28:48.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 -- 172.21.15.64:0/2791737736 >> 172.21.15.64:0/2791737736 conn(0x7f7b180ccbe0 msgr2=0x7f7b180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:48.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 -- 172.21.15.64:0/2791737736 shutdown_connections 2024-09-21T07:28:48.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.475+0000 7f7b20600640 1 -- 172.21.15.64:0/2791737736 wait complete. 2024-09-21T07:28:48.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 Processor -- start 2024-09-21T07:28:48.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 -- start start 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b00003a80 0x7f7b181f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b180c9770 0x7f7b180c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7b18072e20 con 0x7f7b1815d520 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7b180b4ae0 con 0x7f7b180c9770 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b20600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7b18072fa0 con 0x7f7b00003a80 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b1d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b1d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55388/0 (socket says 172.21.15.64:55388) 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b1d200640 1 -- 172.21.15.64:0/392246626 learned_addr learned my addr 172.21.15.64:0/392246626 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b1e600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b180c9770 0x7f7b180c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.479+0000 7f7b1dc00640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b00003a80 0x7f7b181f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 -- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b00003a80 msgr2=0x7f7b181f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b00003a80 0x7f7b181f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 -- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b180c9770 msgr2=0x7f7b180c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b180c9770 0x7f7b180c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 -- 172.21.15.64:0/392246626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b180c7ce0 con 0x7f7b1815d520 2024-09-21T07:28:48.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b1d200640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006600 tx=0x7f7b040039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04015070 con 0x7f7b1815d520 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b04011900 con 0x7f7b1815d520 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b180c7fc0 con 0x7f7b1815d520 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04011d50 con 0x7f7b1815d520 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b181e86f0 con 0x7f7b1815d520 2024-09-21T07:28:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b181e9c90 con 0x7f7b1815d520 2024-09-21T07:28:48.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.483+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7b04018070 con 0x7f7b1815d520 2024-09-21T07:28:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.487+0000 7f7b15600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.487+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f7b04095180 con 0x7f7b1815d520 2024-09-21T07:28:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.487+0000 7f7b1dc00640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.487+0000 7f7b1dc00640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0af000 tx=0x7f7b0c01a050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.491+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7b04060020 con 0x7f7b1815d520 2024-09-21T07:28:48.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.671+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b180ce520 con 0x7f7b1815d520 2024-09-21T07:28:48.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.671+0000 7f7b15600640 1 -- 172.21.15.64:0/392246626 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16909 (secure 0 0 0) 0x7f7b0405f920 con 0x7f7b1815d520 2024-09-21T07:28:48.673 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:48.673 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":115,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:47.303682+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:45.037291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:46.257472+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:48.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 msgr2=0x7f7af8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0af000 tx=0x7f7b0c01a050 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 msgr2=0x7f7b1815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006600 tx=0x7f7b040039d0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 shutdown_connections 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7af8073200 0x7f7af8075710 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b180c9770 0x7f7b180c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b1815d520 0x7f7b1815cb70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 --2- 172.21.15.64:0/392246626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b00003a80 0x7f7b181f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 >> 172.21.15.64:0/392246626 conn(0x7f7b180ccbe0 msgr2=0x7f7b1809a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 shutdown_connections 2024-09-21T07:28:48.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.675+0000 7f7b20600640 1 -- 172.21.15.64:0/392246626 wait complete. 2024-09-21T07:28:48.696 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:28:48.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 -- 172.21.15.64:0/2542316235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4015f9a0 msgr2=0x7efe4015fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 --2- 172.21.15.64:0/2542316235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4015f9a0 0x7efe4015fdb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efe400cfc10 tx=0x7efe2801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 -- 172.21.15.64:0/2542316235 shutdown_connections 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 --2- 172.21.15.64:0/2542316235 >> v2:172.21.15.90:3300/0 conn(0x7efe401602f0 0x7efe4006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 --2- 172.21.15.64:0/2542316235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4015f9a0 0x7efe4015fdb0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 -- 172.21.15.64:0/2542316235 >> 172.21.15.64:0/2542316235 conn(0x7efe4006d450 msgr2=0x7efe400d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 -- 172.21.15.64:0/2542316235 shutdown_connections 2024-09-21T07:28:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.855+0000 7efe46c00640 1 -- 172.21.15.64:0/2542316235 wait complete. 2024-09-21T07:28:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 Processor -- start 2024-09-21T07:28:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- start start 2024-09-21T07:28:48.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe4009df30 0x7efe4014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe4015f9a0 0x7efe400b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efe40168df0 con 0x7efe401602f0 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe40168c70 con 0x7efe4009df30 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efe40168f70 con 0x7efe4015f9a0 2024-09-21T07:28:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55414/0 (socket says 172.21.15.64:55414) 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 -- 172.21.15.64:0/3440317870 learned_addr learned my addr 172.21.15.64:0/3440317870 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe3fe00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe4009df30 0x7efe4014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe37400640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe4015f9a0 0x7efe400b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 -- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe4015f9a0 msgr2=0x7efe400b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe4015f9a0 0x7efe400b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 -- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe4009df30 msgr2=0x7efe4014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe4009df30 0x7efe4014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 -- 172.21.15.64:0/3440317870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe400b2cd0 con 0x7efe401602f0 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe44c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d660 tx=0x7efe3800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38017070 con 0x7efe401602f0 2024-09-21T07:28:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe38005310 con 0x7efe401602f0 2024-09-21T07:28:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38009820 con 0x7efe401602f0 2024-09-21T07:28:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4015ca80 con 0x7efe401602f0 2024-09-21T07:28:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.859+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4015d040 con 0x7efe401602f0 2024-09-21T07:28:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.863+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4015c7f0 con 0x7efe401602f0 2024-09-21T07:28:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.863+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe380099c0 con 0x7efe401602f0 2024-09-21T07:28:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.863+0000 7efe3cc00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 0x7efe1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.863+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7efe380943f0 con 0x7efe401602f0 2024-09-21T07:28:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.863+0000 7efe3fe00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 0x7efe1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.867+0000 7efe3fe00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 0x7efe1c075710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efe30001360 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:48.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:48.867+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efe3805ec20 con 0x7efe401602f0 2024-09-21T07:28:49.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.087+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efe4015fdb0 con 0x7efe401602f0 2024-09-21T07:28:49.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.903+0000 7efe3cc00640 1 -- 172.21.15.64:0/3440317870 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7efe38063650 con 0x7efe401602f0 2024-09-21T07:28:49.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 msgr2=0x7efe1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 0x7efe1c075710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efe30001360 tx=0x7efe30009040 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 msgr2=0x7efe400acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d660 tx=0x7efe3800db20 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 shutdown_connections 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe1c073200 0x7efe1c075710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe401602f0 0x7efe400acfc0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe4015f9a0 0x7efe400b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 --2- 172.21.15.64:0/3440317870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe4009df30 0x7efe4014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 >> 172.21.15.64:0/3440317870 conn(0x7efe4006d450 msgr2=0x7efe400cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 shutdown_connections 2024-09-21T07:28:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:49.907+0000 7efe46c00640 1 -- 172.21.15.64:0/3440317870 wait complete. 2024-09-21T07:28:49.934 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:28:49.934 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 -- 172.21.15.64:0/4070240630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c165510 msgr2=0x7ff58c167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 --2- 172.21.15.64:0/4070240630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c165510 0x7ff58c167930 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff584009c80 tx=0x7ff58401cd10 comp rx=0 tx=0).stop 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 -- 172.21.15.64:0/4070240630 shutdown_connections 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 --2- 172.21.15.64:0/4070240630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c165510 0x7ff58c167930 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 -- 172.21.15.64:0/4070240630 >> 172.21.15.64:0/4070240630 conn(0x7ff58c0cdd10 msgr2=0x7ff58c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 -- 172.21.15.64:0/4070240630 shutdown_connections 2024-09-21T07:28:50.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.103+0000 7ff592800640 1 -- 172.21.15.64:0/4070240630 wait complete. 2024-09-21T07:28:50.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 Processor -- start 2024-09-21T07:28:50.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- start start 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff58c15ca40 0x7ff58c1fc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c165510 0x7ff58c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c16aea0 con 0x7ff58c06cdf0 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c16ad20 con 0x7ff58c165510 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c16b020 con 0x7ff58c15ca40 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55436/0 (socket says 172.21.15.64:55436) 2024-09-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 -- 172.21.15.64:0/662252160 learned_addr learned my addr 172.21.15.64:0/662252160 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58be00640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c165510 0x7ff58c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff583e00640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff58c15ca40 0x7ff58c1fc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 -- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff58c15ca40 msgr2=0x7ff58c1fc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff58c15ca40 0x7ff58c1fc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 -- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c165510 msgr2=0x7ff58c158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c165510 0x7ff58c158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 -- 172.21.15.64:0/662252160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c0aefe0 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff58b400640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c3a0 tx=0x7ff57c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c017070 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c0053c0 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c0adf60 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0038b0 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.107+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c0ae520 con 0x7ff58c06cdf0 2024-09-21T07:28:50.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c157e10 con 0x7ff58c06cdf0 2024-09-21T07:28:50.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff57c01a070 con 0x7ff58c06cdf0 2024-09-21T07:28:50.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff583400640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 0x7ff568075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:50.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7ff57c093710 con 0x7ff58c06cdf0 2024-09-21T07:28:50.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff583e00640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 0x7ff568075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:50.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.111+0000 7ff583e00640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 0x7ff568075740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff58c155bf0 tx=0x7ff574009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:50.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.115+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff57c05df50 con 0x7ff58c06cdf0 2024-09-21T07:28:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.331+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff58c069300 con 0x7ff58c06cdf0 2024-09-21T07:28:50.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.911+0000 7ff583400640 1 -- 172.21.15.64:0/662252160 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7ff57c062980 con 0x7ff58c06cdf0 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 msgr2=0x7ff568075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 0x7ff568075740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff58c155bf0 tx=0x7ff574009040 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 msgr2=0x7ff58c151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c3a0 tx=0x7ff57c00c860 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 shutdown_connections 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff568073230 0x7ff568075740 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff58c165510 0x7ff58c158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff58c15ca40 0x7ff58c1fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 --2- 172.21.15.64:0/662252160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff58c06cdf0 0x7ff58c151240 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:50.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 >> 172.21.15.64:0/662252160 conn(0x7ff58c0cdd10 msgr2=0x7ff58c158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:50.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 shutdown_connections 2024-09-21T07:28:50.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:50.915+0000 7ff592800640 1 -- 172.21.15.64:0/662252160 wait complete. 2024-09-21T07:28:50.941 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:28:50.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:51.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- 172.21.15.64:0/954664379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 msgr2=0x7f92f0005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 --2- 172.21.15.64:0/954664379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f92f0005d30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c340 tx=0x7f92f801f720 comp rx=0 tx=0).stop 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f930b400640 1 -- 172.21.15.64:0/954664379 reap_dead start 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- 172.21.15.64:0/954664379 shutdown_connections 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- 172.21.15.64:0/954664379 >> 172.21.15.64:0/954664379 conn(0x7f930c0ccbe0 msgr2=0x7f930c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- 172.21.15.64:0/954664379 shutdown_connections 2024-09-21T07:28:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- 172.21.15.64:0/954664379 wait complete. 2024-09-21T07:28:51.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 Processor -- start 2024-09-21T07:28:51.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.103+0000 7f9311800640 1 -- start start 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 0x7f930c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c0c6110 0x7f930c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f930c0b1c50 con 0x7f92f0005920 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f930c0cb350 con 0x7f930c0c6110 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f930c0b1dd0 con 0x7f930c0c8f40 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55444/0 (socket says 172.21.15.64:55444) 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 -- 172.21.15.64:0/552617088 learned_addr learned my addr 172.21.15.64:0/552617088 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930a000640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 0x7f930c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930b400640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c0c6110 0x7f930c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 -- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 msgr2=0x7f930c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 0x7f930c0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 -- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c0c6110 msgr2=0x7f930c0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c0c6110 0x7f930c0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 -- 172.21.15.64:0/552617088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c0c6a60 con 0x7f92f0005920 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930a000640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 0x7f930c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f930aa00640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f92fc011b30 tx=0x7f92fc011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc01e070 con 0x7f92f0005920 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92fc00fd30 con 0x7f92f0005920 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc019650 con 0x7f92f0005920 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c0c4a40 con 0x7f92f0005920 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c0c5000 con 0x7f92f0005920 2024-09-21T07:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.107+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c0ca7b0 con 0x7f92f0005920 2024-09-21T07:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.111+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f92fc021070 con 0x7f92f0005920 2024-09-21T07:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.111+0000 7f9302a00640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 0x7f92ec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.111+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f92fc094cf0 con 0x7f92f0005920 2024-09-21T07:28:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.111+0000 7f930a000640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 0x7f92ec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.111+0000 7f930a000640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 0x7f92ec075740 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f801c560 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.115+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f930c0c6a60 con 0x7f92f0005920 2024-09-21T07:28:51.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.327+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f930c06ee80 con 0x7f92f0005920 2024-09-21T07:28:51.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.327+0000 7f9302a00640 1 -- 172.21.15.64:0/552617088 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5225 (secure 0 0 0) 0x7f92fc05f520 con 0x7f92f0005920 2024-09-21T07:28:51.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:51.330 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":84,"btime":"2024-09-21T07:28:50:907861+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:28:50.332785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:28:51.330 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 84 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 msgr2=0x7f92ec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 0x7f92ec075740 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f801c560 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 msgr2=0x7f930c158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f92fc011b30 tx=0x7f92fc011f30 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 shutdown_connections 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92ec073230 0x7f92ec075740 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c0c6110 0x7f930c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f930c0c8f40 0x7f930c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 --2- 172.21.15.64:0/552617088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005920 0x7f930c158800 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 >> 172.21.15.64:0/552617088 conn(0x7f930c0ccbe0 msgr2=0x7f930c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 shutdown_connections 2024-09-21T07:28:51.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.331+0000 7f9311800640 1 -- 172.21.15.64:0/552617088 wait complete. 2024-09-21T07:28:51.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 -- 172.21.15.64:0/3726277268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015a330 msgr2=0x7f9d00160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 --2- 172.21.15.64:0/3726277268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015a330 0x7f9d00160280 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9d00074e60 tx=0x7f9cf001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 -- 172.21.15.64:0/3726277268 shutdown_connections 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 --2- 172.21.15.64:0/3726277268 >> v2:172.21.15.90:3300/0 conn(0x7f9d0015d910 0x7f9d000b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 --2- 172.21.15.64:0/3726277268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 0x7f9d000b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 --2- 172.21.15.64:0/3726277268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015a330 0x7f9d00160280 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 -- 172.21.15.64:0/3726277268 >> 172.21.15.64:0/3726277268 conn(0x7f9d0006d530 msgr2=0x7f9d000d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:51.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.507+0000 7f9d04c00640 1 -- 172.21.15.64:0/3726277268 shutdown_connections 2024-09-21T07:28:51.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 -- 172.21.15.64:0/3726277268 wait complete. 2024-09-21T07:28:51.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 Processor -- start 2024-09-21T07:28:51.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 -- start start 2024-09-21T07:28:51.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 0x7f9d001fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 0x7f9d000cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00071ac0 con 0x7f9d0015d910 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00071940 con 0x7f9d0015a330 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.511+0000 7f9d04c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d00071c40 con 0x7f9d0015d500 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55464/0 (socket says 172.21.15.64:55464) 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 -- 172.21.15.64:0/876929709 learned_addr learned my addr 172.21.15.64:0/876929709 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cf5400640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 0x7f9d000cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfde00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 0x7f9d001fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 -- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 msgr2=0x7f9d000cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 0x7f9d000cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 -- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 msgr2=0x7f9d001fc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 0x7f9d001fc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 -- 172.21.15.64:0/876929709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d001fceb0 con 0x7f9d0015d910 2024-09-21T07:28:51.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfde00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 0x7f9d001fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:51.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cfe800640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800e940 tx=0x7f9cf800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8004d30 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf800cb20 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001fd190 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8005020 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d00157d90 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d00160280 con 0x7f9d0015d910 2024-09-21T07:28:51.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.515+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9cf80051c0 con 0x7f9d0015d910 2024-09-21T07:28:51.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.519+0000 7f9cf6a00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 0x7f9cdc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.519+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f9cf8094cf0 con 0x7f9d0015d910 2024-09-21T07:28:51.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.519+0000 7f9cfde00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 0x7f9cdc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.519+0000 7f9cfde00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 0x7f9cdc075710 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00af000 tx=0x7f9cf001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.523+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9cf8016030 con 0x7f9d0015d910 2024-09-21T07:28:51.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.699+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d001fcc40 con 0x7f9d0015d910 2024-09-21T07:28:51.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.699+0000 7f9cf6a00640 1 -- 172.21.15.64:0/876929709 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16896 (secure 0 0 0) 0x7f9cf805f4a0 con 0x7f9d0015d910 2024-09-21T07:28:51.702 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:51.702 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":116,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:28:48.894205+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:45.037291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:46.257472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 msgr2=0x7f9cdc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 0x7f9cdc075710 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00af000 tx=0x7f9cf001b100 comp rx=0 tx=0).stop 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 msgr2=0x7f9d00157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800e940 tx=0x7f9cf800ee00 comp rx=0 tx=0).stop 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 shutdown_connections 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9cdc073200 0x7f9cdc075710 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0015d910 0x7f9d00157850 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0015d500 0x7f9d000cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 --2- 172.21.15.64:0/876929709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0015a330 0x7f9d001fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 >> 172.21.15.64:0/876929709 conn(0x7f9d0006d530 msgr2=0x7f9d00159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:51.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 shutdown_connections 2024-09-21T07:28:51.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.703+0000 7f9d04c00640 1 -- 172.21.15.64:0/876929709 wait complete. 2024-09-21T07:28:51.725 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:28:51.725 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:51.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 -- 172.21.15.64:0/2335926491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0b3d60 msgr2=0x7f9dfc0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 --2- 172.21.15.64:0/2335926491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0b3d60 0x7f9dfc0b4170 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0d2290 tx=0x7f9de401c800 comp rx=0 tx=0).stop 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 -- 172.21.15.64:0/2335926491 shutdown_connections 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 --2- 172.21.15.64:0/2335926491 >> v2:172.21.15.90:3300/0 conn(0x7f9dfc0c5ea0 0x7f9dfc0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 --2- 172.21.15.64:0/2335926491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0b3d60 0x7f9dfc0b4170 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 -- 172.21.15.64:0/2335926491 >> 172.21.15.64:0/2335926491 conn(0x7f9dfc06d1c0 msgr2=0x7f9dfc06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 -- 172.21.15.64:0/2335926491 shutdown_connections 2024-09-21T07:28:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.879+0000 7f9e03200640 1 -- 172.21.15.64:0/2335926491 wait complete. 2024-09-21T07:28:51.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 Processor -- start 2024-09-21T07:28:51.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 -- start start 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 0x7f9dfc14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 0x7f9dfc157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc169e10 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc169c90 con 0x7f9dfc0c5ea0 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e03200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9dfc169f90 con 0x7f9dfc0b3d60 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e01200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e01200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55482/0 (socket says 172.21.15.64:55482) 2024-09-21T07:28:51.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9e01200640 1 -- 172.21.15.64:0/2887845269 learned_addr learned my addr 172.21.15.64:0/2887845269 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.883+0000 7f9df3400640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 0x7f9dfc157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9dfbe00640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 0x7f9dfc14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 -- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 msgr2=0x7f9dfc14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 0x7f9dfc14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 -- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 msgr2=0x7f9dfc157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 0x7f9dfc157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 -- 172.21.15.64:0/2887845269 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc14dc30 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9dfbe00640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 0x7f9dfc14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df3400640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 0x7f9dfc157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:51.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e01200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c970 tx=0x7f9df400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004230 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9df40044c0 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc1523c0 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4007c10 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc152980 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc0b4170 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9df4003600 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.887+0000 7f9df8c00640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 0x7f9dd8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:51.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.891+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f9df4094620 con 0x7f9dfc0d1d00 2024-09-21T07:28:51.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.891+0000 7f9dfbe00640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 0x7f9dd8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:51.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.891+0000 7f9dfbe00640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 0x7f9dd8075710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:51.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:51.895+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9df4014070 con 0x7f9dfc0d1d00 2024-09-21T07:28:52.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.067+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dfc0cca80 con 0x7f9dd8073200 2024-09-21T07:28:52.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.071+0000 7f9df8c00640 1 -- 172.21.15.64:0/2887845269 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247002 (secure 0 0 0) 0x7f9dfc0cca80 con 0x7f9dd8073200 2024-09-21T07:28:52.076 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:52.078 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 msgr2=0x7f9dd8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 0x7f9dd8075710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).stop 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 msgr2=0x7f9dfc1587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c970 tx=0x7f9df400ce30 comp rx=0 tx=0).stop 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 shutdown_connections 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9dd8073200 0x7f9dd8075710 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dfc0d1d00 0x7f9dfc1587f0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dfc0c5ea0 0x7f9dfc157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 --2- 172.21.15.64:0/2887845269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dfc0b3d60 0x7f9dfc14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 >> 172.21.15.64:0/2887845269 conn(0x7f9dfc06d1c0 msgr2=0x7f9dfc0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 shutdown_connections 2024-09-21T07:28:52.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.075+0000 7f9e03200640 1 -- 172.21.15.64:0/2887845269 wait complete. 2024-09-21T07:28:52.098 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-21T07:28:51.519802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315752,"kb_used_data":12140,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658968,"statfs":{"total":773094113280,"available":772770783232,"internally_reserved":0,"allocated":12431360,"data_stored":6440491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":310693427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657741"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874809+0000","last_change":"2024-09-21T07:28:46.874809+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874809+0000","last_undegraded":"2024-09-21T07:28:46.874809+0000","last_fullsized":"2024-09-21T07:28:46.874809+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879050+0000","last_change":"2024-09-21T07:28:46.879050+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879050+0000","last_undegraded":"2024-09-21T07:28:46.879050+0000","last_fullsized":"2024-09-21T07:28:46.879050+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903709+0000","last_change":"2024-09-21T07:28:47.905037+0000","last_active":"2024-09-21T07:28:48.903709+0000","last_peered":"2024-09-21T07:28:48.903709+0000","last_clean":"2024-09-21T07:28:48.903709+0000","last_became_active":"2024-09-21T07:28:47.904433+0000","last_became_peered":"2024-09-21T07:28:47.904433+0000","last_unstale":"2024-09-21T07:28:48.903709+0000","last_undegraded":"2024-09-21T07:28:48.903709+0000","last_fullsized":"2024-09-21T07:28:48.903709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:55.177373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877313+0000","last_change":"2024-09-21T07:28:46.877313+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877313+0000","last_undegraded":"2024-09-21T07:28:46.877313+0000","last_fullsized":"2024-09-21T07:28:46.877313+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874104+0000","last_change":"2024-09-21T07:28:46.874104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874104+0000","last_undegraded":"2024-09-21T07:28:46.874104+0000","last_fullsized":"2024-09-21T07:28:46.874104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874587+0000","last_change":"2024-09-21T07:28:46.874587+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874587+0000","last_undegraded":"2024-09-21T07:28:46.874587+0000","last_fullsized":"2024-09-21T07:28:46.874587+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873991+0000","last_change":"2024-09-21T07:28:46.873991+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873991+0000","last_undegraded":"2024-09-21T07:28:46.873991+0000","last_fullsized":"2024-09-21T07:28:46.873991+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874516+0000","last_change":"2024-09-21T07:28:46.874516+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874516+0000","last_undegraded":"2024-09-21T07:28:46.874516+0000","last_fullsized":"2024-09-21T07:28:46.874516+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877897+0000","last_change":"2024-09-21T07:28:46.877897+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877897+0000","last_undegraded":"2024-09-21T07:28:46.877897+0000","last_fullsized":"2024-09-21T07:28:46.877897+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881822+0000","last_change":"2024-09-21T07:28:46.881822+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881822+0000","last_undegraded":"2024-09-21T07:28:46.881822+0000","last_fullsized":"2024-09-21T07:28:46.881822+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869738+0000","last_change":"2024-09-21T07:28:46.869738+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869738+0000","last_undegraded":"2024-09-21T07:28:46.869738+0000","last_fullsized":"2024-09-21T07:28:46.869738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903544+0000","last_change":"2024-09-21T07:28:47.912349+0000","last_active":"2024-09-21T07:28:48.903544+0000","last_peered":"2024-09-21T07:28:48.903544+0000","last_clean":"2024-09-21T07:28:48.903544+0000","last_became_active":"2024-09-21T07:28:47.911807+0000","last_became_peered":"2024-09-21T07:28:47.911807+0000","last_unstale":"2024-09-21T07:28:48.903544+0000","last_undegraded":"2024-09-21T07:28:48.903544+0000","last_fullsized":"2024-09-21T07:28:48.903544+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878612+0000","last_change":"2024-09-21T07:28:46.878612+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878612+0000","last_undegraded":"2024-09-21T07:28:46.878612+0000","last_fullsized":"2024-09-21T07:28:46.878612+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874282+0000","last_change":"2024-09-21T07:28:46.874282+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874282+0000","last_undegraded":"2024-09-21T07:28:46.874282+0000","last_fullsized":"2024-09-21T07:28:46.874282+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878548+0000","last_change":"2024-09-21T07:28:46.878548+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878548+0000","last_undegraded":"2024-09-21T07:28:46.878548+0000","last_fullsized":"2024-09-21T07:28:46.878548+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869179+0000","last_change":"2024-09-21T07:28:46.869179+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869179+0000","last_undegraded":"2024-09-21T07:28:46.869179+0000","last_fullsized":"2024-09-21T07:28:46.869179+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871104+0000","last_change":"2024-09-21T07:28:46.871104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871104+0000","last_undegraded":"2024-09-21T07:28:46.871104+0000","last_fullsized":"2024-09-21T07:28:46.871104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877208+0000","last_change":"2024-09-21T07:28:46.877208+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877208+0000","last_undegraded":"2024-09-21T07:28:46.877208+0000","last_fullsized":"2024-09-21T07:28:46.877208+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876765+0000","last_change":"2024-09-21T07:28:46.876765+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876765+0000","last_undegraded":"2024-09-21T07:28:46.876765+0000","last_fullsized":"2024-09-21T07:28:46.876765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875828+0000","last_change":"2024-09-21T07:28:46.875828+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875828+0000","last_undegraded":"2024-09-21T07:28:46.875828+0000","last_fullsized":"2024-09-21T07:28:46.875828+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868465+0000","last_change":"2024-09-21T07:28:46.868465+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868465+0000","last_undegraded":"2024-09-21T07:28:46.868465+0000","last_fullsized":"2024-09-21T07:28:46.868465+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868171+0000","last_change":"2024-09-21T07:28:46.868171+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868171+0000","last_undegraded":"2024-09-21T07:28:46.868171+0000","last_fullsized":"2024-09-21T07:28:46.868171+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881330+0000","last_change":"2024-09-21T07:28:46.881330+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881330+0000","last_undegraded":"2024-09-21T07:28:46.881330+0000","last_fullsized":"2024-09-21T07:28:46.881330+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873249+0000","last_change":"2024-09-21T07:28:46.873249+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873249+0000","last_undegraded":"2024-09-21T07:28:46.873249+0000","last_fullsized":"2024-09-21T07:28:46.873249+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870533+0000","last_change":"2024-09-21T07:28:46.870533+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870533+0000","last_undegraded":"2024-09-21T07:28:46.870533+0000","last_fullsized":"2024-09-21T07:28:46.870533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868688+0000","last_change":"2024-09-21T07:28:46.868688+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868688+0000","last_undegraded":"2024-09-21T07:28:46.868688+0000","last_fullsized":"2024-09-21T07:28:46.868688+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874034+0000","last_change":"2024-09-21T07:28:46.874034+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874034+0000","last_undegraded":"2024-09-21T07:28:46.874034+0000","last_fullsized":"2024-09-21T07:28:46.874034+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871299+0000","last_change":"2024-09-21T07:28:46.871299+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871299+0000","last_undegraded":"2024-09-21T07:28:46.871299+0000","last_fullsized":"2024-09-21T07:28:46.871299+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877107+0000","last_change":"2024-09-21T07:28:46.877107+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877107+0000","last_undegraded":"2024-09-21T07:28:46.877107+0000","last_fullsized":"2024-09-21T07:28:46.877107+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904038+0000","last_change":"2024-09-21T07:28:46.888058+0000","last_active":"2024-09-21T07:28:48.904038+0000","last_peered":"2024-09-21T07:28:48.904038+0000","last_clean":"2024-09-21T07:28:48.904038+0000","last_became_active":"2024-09-21T07:28:46.887743+0000","last_became_peered":"2024-09-21T07:28:46.887743+0000","last_unstale":"2024-09-21T07:28:48.904038+0000","last_undegraded":"2024-09-21T07:28:48.904038+0000","last_fullsized":"2024-09-21T07:28:48.904038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:05.668245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868252+0000","last_change":"2024-09-21T07:28:46.868252+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868252+0000","last_undegraded":"2024-09-21T07:28:46.868252+0000","last_fullsized":"2024-09-21T07:28:46.868252+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891981+0000","last_change":"2024-09-21T07:28:46.891115+0000","last_active":"2024-09-21T07:28:46.891981+0000","last_peered":"2024-09-21T07:28:46.891981+0000","last_clean":"2024-09-21T07:28:46.891981+0000","last_became_active":"2024-09-21T07:28:46.888955+0000","last_became_peered":"2024-09-21T07:28:46.888955+0000","last_unstale":"2024-09-21T07:28:46.891981+0000","last_undegraded":"2024-09-21T07:28:46.891981+0000","last_fullsized":"2024-09-21T07:28:46.891981+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:54.986840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868002+0000","last_change":"2024-09-21T07:28:46.868002+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868002+0000","last_undegraded":"2024-09-21T07:28:46.868002+0000","last_fullsized":"2024-09-21T07:28:46.868002+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898001+0000","last_change":"2024-09-21T07:28:46.896939+0000","last_active":"2024-09-21T07:28:46.898001+0000","last_peered":"2024-09-21T07:28:46.898001+0000","last_clean":"2024-09-21T07:28:46.898001+0000","last_became_active":"2024-09-21T07:28:46.896614+0000","last_became_peered":"2024-09-21T07:28:46.896614+0000","last_unstale":"2024-09-21T07:28:46.898001+0000","last_undegraded":"2024-09-21T07:28:46.898001+0000","last_fullsized":"2024-09-21T07:28:46.898001+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:19.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880384+0000","last_change":"2024-09-21T07:28:46.880384+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880384+0000","last_undegraded":"2024-09-21T07:28:46.880384+0000","last_fullsized":"2024-09-21T07:28:46.880384+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893413+0000","last_change":"2024-09-21T07:28:46.892029+0000","last_active":"2024-09-21T07:28:46.893413+0000","last_peered":"2024-09-21T07:28:46.893413+0000","last_clean":"2024-09-21T07:28:46.893413+0000","last_became_active":"2024-09-21T07:28:46.890794+0000","last_became_peered":"2024-09-21T07:28:46.890794+0000","last_unstale":"2024-09-21T07:28:46.893413+0000","last_undegraded":"2024-09-21T07:28:46.893413+0000","last_fullsized":"2024-09-21T07:28:46.893413+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:55.883691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903757+0000","last_change":"2024-09-21T07:28:47.919719+0000","last_active":"2024-09-21T07:28:48.903757+0000","last_peered":"2024-09-21T07:28:48.903757+0000","last_clean":"2024-09-21T07:28:48.903757+0000","last_became_active":"2024-09-21T07:28:47.919401+0000","last_became_peered":"2024-09-21T07:28:47.919401+0000","last_unstale":"2024-09-21T07:28:48.903757+0000","last_undegraded":"2024-09-21T07:28:48.903757+0000","last_fullsized":"2024-09-21T07:28:48.903757+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:53.523564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.869111+0000","last_change":"2024-09-21T07:28:45.869111+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.869111+0000","last_undegraded":"2024-09-21T07:28:45.869111+0000","last_fullsized":"2024-09-21T07:28:45.869111+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877586+0000","last_change":"2024-09-21T07:28:46.877586+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877586+0000","last_undegraded":"2024-09-21T07:28:46.877586+0000","last_fullsized":"2024-09-21T07:28:46.877586+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.894612+0000","last_change":"2024-09-21T07:28:46.892076+0000","last_active":"2024-09-21T07:28:46.894612+0000","last_peered":"2024-09-21T07:28:46.894612+0000","last_clean":"2024-09-21T07:28:46.894612+0000","last_became_active":"2024-09-21T07:28:46.891776+0000","last_became_peered":"2024-09-21T07:28:46.891776+0000","last_unstale":"2024-09-21T07:28:46.894612+0000","last_undegraded":"2024-09-21T07:28:46.894612+0000","last_fullsized":"2024-09-21T07:28:46.894612+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:18.078317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873375+0000","last_change":"2024-09-21T07:28:46.873375+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873375+0000","last_undegraded":"2024-09-21T07:28:46.873375+0000","last_fullsized":"2024-09-21T07:28:46.873375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.897585+0000","last_change":"2024-09-21T07:28:46.896318+0000","last_active":"2024-09-21T07:28:46.897585+0000","last_peered":"2024-09-21T07:28:46.897585+0000","last_clean":"2024-09-21T07:28:46.897585+0000","last_became_active":"2024-09-21T07:28:46.895997+0000","last_became_peered":"2024-09-21T07:28:46.895997+0000","last_unstale":"2024-09-21T07:28:46.897585+0000","last_undegraded":"2024-09-21T07:28:46.897585+0000","last_fullsized":"2024-09-21T07:28:46.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:54.184304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904029+0000","last_change":"2024-09-21T07:28:47.912614+0000","last_active":"2024-09-21T07:28:48.904029+0000","last_peered":"2024-09-21T07:28:48.904029+0000","last_clean":"2024-09-21T07:28:48.904029+0000","last_became_active":"2024-09-21T07:28:47.911410+0000","last_became_peered":"2024-09-21T07:28:47.911410+0000","last_unstale":"2024-09-21T07:28:48.904029+0000","last_undegraded":"2024-09-21T07:28:48.904029+0000","last_fullsized":"2024-09-21T07:28:48.904029+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:52.493508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903262+0000","last_change":"2024-09-21T07:28:46.882654+0000","last_active":"2024-09-21T07:28:48.903262+0000","last_peered":"2024-09-21T07:28:48.903262+0000","last_clean":"2024-09-21T07:28:48.903262+0000","last_became_active":"2024-09-21T07:28:46.881217+0000","last_became_peered":"2024-09-21T07:28:46.881217+0000","last_unstale":"2024-09-21T07:28:48.903262+0000","last_undegraded":"2024-09-21T07:28:48.903262+0000","last_fullsized":"2024-09-21T07:28:48.903262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:05.000983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.896484+0000","last_change":"2024-09-21T07:28:46.893078+0000","last_active":"2024-09-21T07:28:46.896484+0000","last_peered":"2024-09-21T07:28:46.896484+0000","last_clean":"2024-09-21T07:28:46.896484+0000","last_became_active":"2024-09-21T07:28:46.890767+0000","last_became_peered":"2024-09-21T07:28:46.890767+0000","last_unstale":"2024-09-21T07:28:46.896484+0000","last_undegraded":"2024-09-21T07:28:46.896484+0000","last_fullsized":"2024-09-21T07:28:46.896484+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875961+0000","last_change":"2024-09-21T07:28:46.875961+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875961+0000","last_undegraded":"2024-09-21T07:28:46.875961+0000","last_fullsized":"2024-09-21T07:28:46.875961+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889914+0000","last_change":"2024-09-21T07:28:46.884544+0000","last_active":"2024-09-21T07:28:46.889914+0000","last_peered":"2024-09-21T07:28:46.889914+0000","last_clean":"2024-09-21T07:28:46.889914+0000","last_became_active":"2024-09-21T07:28:46.884216+0000","last_became_peered":"2024-09-21T07:28:46.884216+0000","last_unstale":"2024-09-21T07:28:46.889914+0000","last_undegraded":"2024-09-21T07:28:46.889914+0000","last_fullsized":"2024-09-21T07:28:46.889914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:55.903108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868098+0000","last_change":"2024-09-21T07:28:46.868098+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868098+0000","last_undegraded":"2024-09-21T07:28:46.868098+0000","last_fullsized":"2024-09-21T07:28:46.868098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.873407+0000","last_change":"2024-09-21T07:28:45.873407+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.873407+0000","last_undegraded":"2024-09-21T07:28:45.873407+0000","last_fullsized":"2024-09-21T07:28:45.873407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876302+0000","last_change":"2024-09-21T07:28:46.876302+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876302+0000","last_undegraded":"2024-09-21T07:28:46.876302+0000","last_fullsized":"2024-09-21T07:28:46.876302+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893972+0000","last_change":"2024-09-21T07:28:46.885717+0000","last_active":"2024-09-21T07:28:46.893972+0000","last_peered":"2024-09-21T07:28:46.893972+0000","last_clean":"2024-09-21T07:28:46.893972+0000","last_became_active":"2024-09-21T07:28:46.885274+0000","last_became_peered":"2024-09-21T07:28:46.885274+0000","last_unstale":"2024-09-21T07:28:46.893972+0000","last_undegraded":"2024-09-21T07:28:46.893972+0000","last_fullsized":"2024-09-21T07:28:46.893972+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879079+0000","last_change":"2024-09-21T07:28:46.879079+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879079+0000","last_undegraded":"2024-09-21T07:28:46.879079+0000","last_fullsized":"2024-09-21T07:28:46.879079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891570+0000","last_change":"2024-09-21T07:28:46.890803+0000","last_active":"2024-09-21T07:28:46.891570+0000","last_peered":"2024-09-21T07:28:46.891570+0000","last_clean":"2024-09-21T07:28:46.891570+0000","last_became_active":"2024-09-21T07:28:46.890473+0000","last_became_peered":"2024-09-21T07:28:46.890473+0000","last_unstale":"2024-09-21T07:28:46.891570+0000","last_undegraded":"2024-09-21T07:28:46.891570+0000","last_fullsized":"2024-09-21T07:28:46.891570+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:52.596397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872943+0000","last_change":"2024-09-21T07:28:46.872943+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872943+0000","last_undegraded":"2024-09-21T07:28:46.872943+0000","last_fullsized":"2024-09-21T07:28:46.872943+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903580+0000","last_change":"2024-09-21T07:28:46.884691+0000","last_active":"2024-09-21T07:28:48.903580+0000","last_peered":"2024-09-21T07:28:48.903580+0000","last_clean":"2024-09-21T07:28:48.903580+0000","last_became_active":"2024-09-21T07:28:46.884171+0000","last_became_peered":"2024-09-21T07:28:46.884171+0000","last_unstale":"2024-09-21T07:28:48.903580+0000","last_undegraded":"2024-09-21T07:28:48.903580+0000","last_fullsized":"2024-09-21T07:28:48.903580+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:25.992238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869676+0000","last_change":"2024-09-21T07:28:46.869676+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869676+0000","last_undegraded":"2024-09-21T07:28:46.869676+0000","last_fullsized":"2024-09-21T07:28:46.869676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886385+0000","last_change":"2024-09-21T07:28:46.876770+0000","last_active":"2024-09-21T07:28:46.886385+0000","last_peered":"2024-09-21T07:28:46.886385+0000","last_clean":"2024-09-21T07:28:46.886385+0000","last_became_active":"2024-09-21T07:28:46.875744+0000","last_became_peered":"2024-09-21T07:28:46.875744+0000","last_unstale":"2024-09-21T07:28:46.886385+0000","last_undegraded":"2024-09-21T07:28:46.886385+0000","last_fullsized":"2024-09-21T07:28:46.886385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:12.128936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878143+0000","last_change":"2024-09-21T07:28:46.878143+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878143+0000","last_undegraded":"2024-09-21T07:28:46.878143+0000","last_fullsized":"2024-09-21T07:28:46.878143+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898492+0000","last_change":"2024-09-21T07:28:46.897169+0000","last_active":"2024-09-21T07:28:46.898492+0000","last_peered":"2024-09-21T07:28:46.898492+0000","last_clean":"2024-09-21T07:28:46.898492+0000","last_became_active":"2024-09-21T07:28:46.896393+0000","last_became_peered":"2024-09-21T07:28:46.896393+0000","last_unstale":"2024-09-21T07:28:46.898492+0000","last_undegraded":"2024-09-21T07:28:46.898492+0000","last_fullsized":"2024-09-21T07:28:46.898492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:57.578325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868507+0000","last_change":"2024-09-21T07:28:46.868507+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868507+0000","last_undegraded":"2024-09-21T07:28:46.868507+0000","last_fullsized":"2024-09-21T07:28:46.868507+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.890964+0000","last_change":"2024-09-21T07:28:46.882380+0000","last_active":"2024-09-21T07:28:46.890964+0000","last_peered":"2024-09-21T07:28:46.890964+0000","last_clean":"2024-09-21T07:28:46.890964+0000","last_became_active":"2024-09-21T07:28:46.881937+0000","last_became_peered":"2024-09-21T07:28:46.881937+0000","last_unstale":"2024-09-21T07:28:46.890964+0000","last_undegraded":"2024-09-21T07:28:46.890964+0000","last_fullsized":"2024-09-21T07:28:46.890964+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:25.407796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872803+0000","last_change":"2024-09-21T07:28:46.872803+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872803+0000","last_undegraded":"2024-09-21T07:28:46.872803+0000","last_fullsized":"2024-09-21T07:28:46.872803+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.872865+0000","last_change":"2024-09-21T07:28:45.872865+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.872865+0000","last_undegraded":"2024-09-21T07:28:45.872865+0000","last_fullsized":"2024-09-21T07:28:45.872865+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876827+0000","last_change":"2024-09-21T07:28:46.876827+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876827+0000","last_undegraded":"2024-09-21T07:28:46.876827+0000","last_fullsized":"2024-09-21T07:28:46.876827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895855+0000","last_change":"2024-09-21T07:28:46.893222+0000","last_active":"2024-09-21T07:28:46.895855+0000","last_peered":"2024-09-21T07:28:46.895855+0000","last_clean":"2024-09-21T07:28:46.895855+0000","last_became_active":"2024-09-21T07:28:46.892871+0000","last_became_peered":"2024-09-21T07:28:46.892871+0000","last_unstale":"2024-09-21T07:28:46.895855+0000","last_undegraded":"2024-09-21T07:28:46.895855+0000","last_fullsized":"2024-09-21T07:28:46.895855+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:55.217021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879472+0000","last_change":"2024-09-21T07:28:46.879472+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879472+0000","last_undegraded":"2024-09-21T07:28:46.879472+0000","last_fullsized":"2024-09-21T07:28:46.879472+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886737+0000","last_change":"2024-09-21T07:28:46.874879+0000","last_active":"2024-09-21T07:28:46.886737+0000","last_peered":"2024-09-21T07:28:46.886737+0000","last_clean":"2024-09-21T07:28:46.886737+0000","last_became_active":"2024-09-21T07:28:46.874565+0000","last_became_peered":"2024-09-21T07:28:46.874565+0000","last_unstale":"2024-09-21T07:28:46.886737+0000","last_undegraded":"2024-09-21T07:28:46.886737+0000","last_fullsized":"2024-09-21T07:28:46.886737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:37.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878041+0000","last_change":"2024-09-21T07:28:46.878041+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878041+0000","last_undegraded":"2024-09-21T07:28:46.878041+0000","last_fullsized":"2024-09-21T07:28:46.878041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888827+0000","last_change":"2024-09-21T07:28:46.879572+0000","last_active":"2024-09-21T07:28:46.888827+0000","last_peered":"2024-09-21T07:28:46.888827+0000","last_clean":"2024-09-21T07:28:46.888827+0000","last_became_active":"2024-09-21T07:28:46.879265+0000","last_became_peered":"2024-09-21T07:28:46.879265+0000","last_unstale":"2024-09-21T07:28:46.888827+0000","last_undegraded":"2024-09-21T07:28:46.888827+0000","last_fullsized":"2024-09-21T07:28:46.888827+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.759406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903867+0000","last_change":"2024-09-21T07:28:47.908921+0000","last_active":"2024-09-21T07:28:48.903867+0000","last_peered":"2024-09-21T07:28:48.903867+0000","last_clean":"2024-09-21T07:28:48.903867+0000","last_became_active":"2024-09-21T07:28:47.907608+0000","last_became_peered":"2024-09-21T07:28:47.907608+0000","last_unstale":"2024-09-21T07:28:48.903867+0000","last_undegraded":"2024-09-21T07:28:48.903867+0000","last_fullsized":"2024-09-21T07:28:48.903867+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:32.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893654+0000","last_change":"2024-09-21T07:28:46.885919+0000","last_active":"2024-09-21T07:28:46.893654+0000","last_peered":"2024-09-21T07:28:46.893654+0000","last_clean":"2024-09-21T07:28:46.893654+0000","last_became_active":"2024-09-21T07:28:46.885595+0000","last_became_peered":"2024-09-21T07:28:46.885595+0000","last_unstale":"2024-09-21T07:28:46.893654+0000","last_undegraded":"2024-09-21T07:28:46.893654+0000","last_fullsized":"2024-09-21T07:28:46.893654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870223+0000","last_change":"2024-09-21T07:28:46.870223+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870223+0000","last_undegraded":"2024-09-21T07:28:46.870223+0000","last_fullsized":"2024-09-21T07:28:46.870223+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888715+0000","last_change":"2024-09-21T07:28:46.882372+0000","last_active":"2024-09-21T07:28:46.888715+0000","last_peered":"2024-09-21T07:28:46.888715+0000","last_clean":"2024-09-21T07:28:46.888715+0000","last_became_active":"2024-09-21T07:28:46.882005+0000","last_became_peered":"2024-09-21T07:28:46.882005+0000","last_unstale":"2024-09-21T07:28:46.888715+0000","last_undegraded":"2024-09-21T07:28:46.888715+0000","last_fullsized":"2024-09-21T07:28:46.888715+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:11.475973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880445+0000","last_change":"2024-09-21T07:28:46.880445+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880445+0000","last_undegraded":"2024-09-21T07:28:46.880445+0000","last_fullsized":"2024-09-21T07:28:46.880445+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893851+0000","last_change":"2024-09-21T07:28:46.893022+0000","last_active":"2024-09-21T07:28:46.893851+0000","last_peered":"2024-09-21T07:28:46.893851+0000","last_clean":"2024-09-21T07:28:46.893851+0000","last_became_active":"2024-09-21T07:28:46.892553+0000","last_became_peered":"2024-09-21T07:28:46.892553+0000","last_unstale":"2024-09-21T07:28:46.893851+0000","last_undegraded":"2024-09-21T07:28:46.893851+0000","last_fullsized":"2024-09-21T07:28:46.893851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.596884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868365+0000","last_change":"2024-09-21T07:28:46.868365+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868365+0000","last_undegraded":"2024-09-21T07:28:46.868365+0000","last_fullsized":"2024-09-21T07:28:46.868365+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891847+0000","last_change":"2024-09-21T07:28:46.889175+0000","last_active":"2024-09-21T07:28:46.891847+0000","last_peered":"2024-09-21T07:28:46.891847+0000","last_clean":"2024-09-21T07:28:46.891847+0000","last_became_active":"2024-09-21T07:28:46.888896+0000","last_became_peered":"2024-09-21T07:28:46.888896+0000","last_unstale":"2024-09-21T07:28:46.891847+0000","last_undegraded":"2024-09-21T07:28:46.891847+0000","last_fullsized":"2024-09-21T07:28:46.891847+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:43.401377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903518+0000","last_change":"2024-09-21T07:28:47.906846+0000","last_active":"2024-09-21T07:28:48.903518+0000","last_peered":"2024-09-21T07:28:48.903518+0000","last_clean":"2024-09-21T07:28:48.903518+0000","last_became_active":"2024-09-21T07:28:47.906481+0000","last_became_peered":"2024-09-21T07:28:47.906481+0000","last_unstale":"2024-09-21T07:28:48.903518+0000","last_undegraded":"2024-09-21T07:28:48.903518+0000","last_fullsized":"2024-09-21T07:28:48.903518+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:22.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888454+0000","last_change":"2024-09-21T07:28:46.883777+0000","last_active":"2024-09-21T07:28:46.888454+0000","last_peered":"2024-09-21T07:28:46.888454+0000","last_clean":"2024-09-21T07:28:46.888454+0000","last_became_active":"2024-09-21T07:28:46.883424+0000","last_became_peered":"2024-09-21T07:28:46.883424+0000","last_unstale":"2024-09-21T07:28:46.888454+0000","last_undegraded":"2024-09-21T07:28:46.888454+0000","last_fullsized":"2024-09-21T07:28:46.888454+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:53.288454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880898+0000","last_change":"2024-09-21T07:28:46.880898+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880898+0000","last_undegraded":"2024-09-21T07:28:46.880898+0000","last_fullsized":"2024-09-21T07:28:46.880898+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893443+0000","last_change":"2024-09-21T07:28:46.892079+0000","last_active":"2024-09-21T07:28:46.893443+0000","last_peered":"2024-09-21T07:28:46.893443+0000","last_clean":"2024-09-21T07:28:46.893443+0000","last_became_active":"2024-09-21T07:28:46.891517+0000","last_became_peered":"2024-09-21T07:28:46.891517+0000","last_unstale":"2024-09-21T07:28:46.893443+0000","last_undegraded":"2024-09-21T07:28:46.893443+0000","last_fullsized":"2024-09-21T07:28:46.893443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:54.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869793+0000","last_change":"2024-09-21T07:28:46.869793+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869793+0000","last_undegraded":"2024-09-21T07:28:46.869793+0000","last_fullsized":"2024-09-21T07:28:46.869793+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895482+0000","last_change":"2024-09-21T07:28:46.888820+0000","last_active":"2024-09-21T07:28:46.895482+0000","last_peered":"2024-09-21T07:28:46.895482+0000","last_clean":"2024-09-21T07:28:46.895482+0000","last_became_active":"2024-09-21T07:28:46.884193+0000","last_became_peered":"2024-09-21T07:28:46.884193+0000","last_unstale":"2024-09-21T07:28:46.895482+0000","last_undegraded":"2024-09-21T07:28:46.895482+0000","last_fullsized":"2024-09-21T07:28:46.895482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869758+0000","last_change":"2024-09-21T07:28:46.869758+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869758+0000","last_undegraded":"2024-09-21T07:28:46.869758+0000","last_fullsized":"2024-09-21T07:28:46.869758+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.885517+0000","last_change":"2024-09-21T07:28:46.875287+0000","last_active":"2024-09-21T07:28:46.885517+0000","last_peered":"2024-09-21T07:28:46.885517+0000","last_clean":"2024-09-21T07:28:46.885517+0000","last_became_active":"2024-09-21T07:28:46.874980+0000","last_became_peered":"2024-09-21T07:28:46.874980+0000","last_unstale":"2024-09-21T07:28:46.885517+0000","last_undegraded":"2024-09-21T07:28:46.885517+0000","last_fullsized":"2024-09-21T07:28:46.885517+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.610529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893616+0000","last_change":"2024-09-21T07:28:46.885131+0000","last_active":"2024-09-21T07:28:46.893616+0000","last_peered":"2024-09-21T07:28:46.893616+0000","last_clean":"2024-09-21T07:28:46.893616+0000","last_became_active":"2024-09-21T07:28:46.884760+0000","last_became_peered":"2024-09-21T07:28:46.884760+0000","last_unstale":"2024-09-21T07:28:46.893616+0000","last_undegraded":"2024-09-21T07:28:46.893616+0000","last_fullsized":"2024-09-21T07:28:46.893616+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:27.496058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880132+0000","last_change":"2024-09-21T07:28:46.880132+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880132+0000","last_undegraded":"2024-09-21T07:28:46.880132+0000","last_fullsized":"2024-09-21T07:28:46.880132+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889341+0000","last_change":"2024-09-21T07:28:46.887554+0000","last_active":"2024-09-21T07:28:46.889341+0000","last_peered":"2024-09-21T07:28:46.889341+0000","last_clean":"2024-09-21T07:28:46.889341+0000","last_became_active":"2024-09-21T07:28:46.887005+0000","last_became_peered":"2024-09-21T07:28:46.887005+0000","last_unstale":"2024-09-21T07:28:46.889341+0000","last_undegraded":"2024-09-21T07:28:46.889341+0000","last_fullsized":"2024-09-21T07:28:46.889341+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:45.571945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878814+0000","last_change":"2024-09-21T07:28:46.878814+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878814+0000","last_undegraded":"2024-09-21T07:28:46.878814+0000","last_fullsized":"2024-09-21T07:28:46.878814+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888765+0000","last_change":"2024-09-21T07:28:46.879025+0000","last_active":"2024-09-21T07:28:46.888765+0000","last_peered":"2024-09-21T07:28:46.888765+0000","last_clean":"2024-09-21T07:28:46.888765+0000","last_became_active":"2024-09-21T07:28:46.878672+0000","last_became_peered":"2024-09-21T07:28:46.878672+0000","last_unstale":"2024-09-21T07:28:46.888765+0000","last_undegraded":"2024-09-21T07:28:46.888765+0000","last_fullsized":"2024-09-21T07:28:46.888765+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-21T07:28:45.873742+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:45.873742+0000","last_peered":"2024-09-21T07:28:45.873742+0000","last_clean":"2024-09-21T07:28:45.873742+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:45.873742+0000","last_undegraded":"2024-09-21T07:28:45.873742+0000","last_fullsized":"2024-09-21T07:28:45.873742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1392640,"data_stored":650664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41464,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330376,"statfs":{"total":96636764160,"available":96594305024,"internally_reserved":0,"allocated":1998848,"data_stored":1247699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37288,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334552,"statfs":{"total":96636764160,"available":96598581248,"internally_reserved":0,"allocated":1986560,"data_stored":1241032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1433600,"data_stored":671772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:52.102 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 -- 172.21.15.64:0/819896694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff790074c70 msgr2=0x7ff7900b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 --2- 172.21.15.64:0/819896694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff790074c70 0x7ff7900b40c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7ff7900cab10 tx=0x7ff77c01c770 comp rx=0 tx=0).stop 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 -- 172.21.15.64:0/819896694 shutdown_connections 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 --2- 172.21.15.64:0/819896694 >> v2:172.21.15.90:3300/0 conn(0x7ff7900b4600 0x7ff7900b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 --2- 172.21.15.64:0/819896694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff790074c70 0x7ff7900b40c0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 -- 172.21.15.64:0/819896694 >> 172.21.15.64:0/819896694 conn(0x7ff7900b2020 msgr2=0x7ff7900b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 -- 172.21.15.64:0/819896694 shutdown_connections 2024-09-21T07:28:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 -- 172.21.15.64:0/819896694 wait complete. 2024-09-21T07:28:52.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.299+0000 7ff797e00640 1 Processor -- start 2024-09-21T07:28:52.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- start start 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7900b1b10 0x7ff7900989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7900c6dc0 0x7ff7900c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff79016a180 con 0x7ff7900b4600 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff79016a000 con 0x7ff7900b1b10 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff79016a300 con 0x7ff7900c6dc0 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55494/0 (socket says 172.21.15.64:55494) 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 -- 172.21.15.64:0/2845102354 learned_addr learned my addr 172.21.15.64:0/2845102354 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff795400640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7900b1b10 0x7ff7900989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff795e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7900c6dc0 0x7ff7900c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 -- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7900c6dc0 msgr2=0x7ff7900c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7900c6dc0 0x7ff7900c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 -- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7900b1b10 msgr2=0x7ff7900989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7900b1b10 0x7ff7900989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 -- 172.21.15.64:0/2845102354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff790099230 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff794a00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff77c01cc50 tx=0x7ff77c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0b2040 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790099510 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c004040 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c004490 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff790099ad0 con 0x7ff7900b4600 2024-09-21T07:28:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.303+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff790098fa0 con 0x7ff7900b4600 2024-09-21T07:28:52.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.307+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff77c0bd030 con 0x7ff7900b4600 2024-09-21T07:28:52.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.307+0000 7ff78d600640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 0x7ff770075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.307+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7ff77c12deb0 con 0x7ff7900b4600 2024-09-21T07:28:52.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.307+0000 7ff795400640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 0x7ff770075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.307+0000 7ff795400640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 0x7ff770075710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff784001770 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:52.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.311+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff77c0c4060 con 0x7ff7900b4600 2024-09-21T07:28:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.491+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7900b40c0 con 0x7ff770073200 2024-09-21T07:28:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.495+0000 7ff78d600640 1 -- 172.21.15.64:0/2845102354 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247002 (secure 0 0 0) 0x7ff7900b40c0 con 0x7ff770073200 2024-09-21T07:28:52.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:52.499 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 msgr2=0x7ff770075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 0x7ff770075710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff784001770 tx=0x7ff784009040 comp rx=0 tx=0).stop 2024-09-21T07:28:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 msgr2=0x7ff7900c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff77c01cc50 tx=0x7ff77c005ca0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 shutdown_connections 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff770073200 0x7ff770075710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7900c6dc0 0x7ff7900c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7900b4600 0x7ff7900c4270 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 --2- 172.21.15.64:0/2845102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7900b1b10 0x7ff7900989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 >> 172.21.15.64:0/2845102354 conn(0x7ff7900b2020 msgr2=0x7ff7900b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 shutdown_connections 2024-09-21T07:28:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.499+0000 7ff797e00640 1 -- 172.21.15.64:0/2845102354 wait complete. 2024-09-21T07:28:52.520 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-21T07:28:51.519802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315752,"kb_used_data":12140,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658968,"statfs":{"total":773094113280,"available":772770783232,"internally_reserved":0,"allocated":12431360,"data_stored":6440491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":310693427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657741"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874809+0000","last_change":"2024-09-21T07:28:46.874809+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874809+0000","last_undegraded":"2024-09-21T07:28:46.874809+0000","last_fullsized":"2024-09-21T07:28:46.874809+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879050+0000","last_change":"2024-09-21T07:28:46.879050+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879050+0000","last_undegraded":"2024-09-21T07:28:46.879050+0000","last_fullsized":"2024-09-21T07:28:46.879050+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903709+0000","last_change":"2024-09-21T07:28:47.905037+0000","last_active":"2024-09-21T07:28:48.903709+0000","last_peered":"2024-09-21T07:28:48.903709+0000","last_clean":"2024-09-21T07:28:48.903709+0000","last_became_active":"2024-09-21T07:28:47.904433+0000","last_became_peered":"2024-09-21T07:28:47.904433+0000","last_unstale":"2024-09-21T07:28:48.903709+0000","last_undegraded":"2024-09-21T07:28:48.903709+0000","last_fullsized":"2024-09-21T07:28:48.903709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:55.177373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877313+0000","last_change":"2024-09-21T07:28:46.877313+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877313+0000","last_undegraded":"2024-09-21T07:28:46.877313+0000","last_fullsized":"2024-09-21T07:28:46.877313+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874104+0000","last_change":"2024-09-21T07:28:46.874104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874104+0000","last_undegraded":"2024-09-21T07:28:46.874104+0000","last_fullsized":"2024-09-21T07:28:46.874104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874587+0000","last_change":"2024-09-21T07:28:46.874587+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874587+0000","last_undegraded":"2024-09-21T07:28:46.874587+0000","last_fullsized":"2024-09-21T07:28:46.874587+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873991+0000","last_change":"2024-09-21T07:28:46.873991+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873991+0000","last_undegraded":"2024-09-21T07:28:46.873991+0000","last_fullsized":"2024-09-21T07:28:46.873991+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874516+0000","last_change":"2024-09-21T07:28:46.874516+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874516+0000","last_undegraded":"2024-09-21T07:28:46.874516+0000","last_fullsized":"2024-09-21T07:28:46.874516+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877897+0000","last_change":"2024-09-21T07:28:46.877897+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877897+0000","last_undegraded":"2024-09-21T07:28:46.877897+0000","last_fullsized":"2024-09-21T07:28:46.877897+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881822+0000","last_change":"2024-09-21T07:28:46.881822+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881822+0000","last_undegraded":"2024-09-21T07:28:46.881822+0000","last_fullsized":"2024-09-21T07:28:46.881822+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869738+0000","last_change":"2024-09-21T07:28:46.869738+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869738+0000","last_undegraded":"2024-09-21T07:28:46.869738+0000","last_fullsized":"2024-09-21T07:28:46.869738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903544+0000","last_change":"2024-09-21T07:28:47.912349+0000","last_active":"2024-09-21T07:28:48.903544+0000","last_peered":"2024-09-21T07:28:48.903544+0000","last_clean":"2024-09-21T07:28:48.903544+0000","last_became_active":"2024-09-21T07:28:47.911807+0000","last_became_peered":"2024-09-21T07:28:47.911807+0000","last_unstale":"2024-09-21T07:28:48.903544+0000","last_undegraded":"2024-09-21T07:28:48.903544+0000","last_fullsized":"2024-09-21T07:28:48.903544+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878612+0000","last_change":"2024-09-21T07:28:46.878612+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878612+0000","last_undegraded":"2024-09-21T07:28:46.878612+0000","last_fullsized":"2024-09-21T07:28:46.878612+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874282+0000","last_change":"2024-09-21T07:28:46.874282+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874282+0000","last_undegraded":"2024-09-21T07:28:46.874282+0000","last_fullsized":"2024-09-21T07:28:46.874282+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878548+0000","last_change":"2024-09-21T07:28:46.878548+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878548+0000","last_undegraded":"2024-09-21T07:28:46.878548+0000","last_fullsized":"2024-09-21T07:28:46.878548+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869179+0000","last_change":"2024-09-21T07:28:46.869179+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869179+0000","last_undegraded":"2024-09-21T07:28:46.869179+0000","last_fullsized":"2024-09-21T07:28:46.869179+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871104+0000","last_change":"2024-09-21T07:28:46.871104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871104+0000","last_undegraded":"2024-09-21T07:28:46.871104+0000","last_fullsized":"2024-09-21T07:28:46.871104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877208+0000","last_change":"2024-09-21T07:28:46.877208+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877208+0000","last_undegraded":"2024-09-21T07:28:46.877208+0000","last_fullsized":"2024-09-21T07:28:46.877208+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876765+0000","last_change":"2024-09-21T07:28:46.876765+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876765+0000","last_undegraded":"2024-09-21T07:28:46.876765+0000","last_fullsized":"2024-09-21T07:28:46.876765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875828+0000","last_change":"2024-09-21T07:28:46.875828+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875828+0000","last_undegraded":"2024-09-21T07:28:46.875828+0000","last_fullsized":"2024-09-21T07:28:46.875828+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868465+0000","last_change":"2024-09-21T07:28:46.868465+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868465+0000","last_undegraded":"2024-09-21T07:28:46.868465+0000","last_fullsized":"2024-09-21T07:28:46.868465+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868171+0000","last_change":"2024-09-21T07:28:46.868171+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868171+0000","last_undegraded":"2024-09-21T07:28:46.868171+0000","last_fullsized":"2024-09-21T07:28:46.868171+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881330+0000","last_change":"2024-09-21T07:28:46.881330+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881330+0000","last_undegraded":"2024-09-21T07:28:46.881330+0000","last_fullsized":"2024-09-21T07:28:46.881330+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873249+0000","last_change":"2024-09-21T07:28:46.873249+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873249+0000","last_undegraded":"2024-09-21T07:28:46.873249+0000","last_fullsized":"2024-09-21T07:28:46.873249+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870533+0000","last_change":"2024-09-21T07:28:46.870533+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870533+0000","last_undegraded":"2024-09-21T07:28:46.870533+0000","last_fullsized":"2024-09-21T07:28:46.870533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868688+0000","last_change":"2024-09-21T07:28:46.868688+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868688+0000","last_undegraded":"2024-09-21T07:28:46.868688+0000","last_fullsized":"2024-09-21T07:28:46.868688+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874034+0000","last_change":"2024-09-21T07:28:46.874034+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874034+0000","last_undegraded":"2024-09-21T07:28:46.874034+0000","last_fullsized":"2024-09-21T07:28:46.874034+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871299+0000","last_change":"2024-09-21T07:28:46.871299+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871299+0000","last_undegraded":"2024-09-21T07:28:46.871299+0000","last_fullsized":"2024-09-21T07:28:46.871299+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877107+0000","last_change":"2024-09-21T07:28:46.877107+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877107+0000","last_undegraded":"2024-09-21T07:28:46.877107+0000","last_fullsized":"2024-09-21T07:28:46.877107+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904038+0000","last_change":"2024-09-21T07:28:46.888058+0000","last_active":"2024-09-21T07:28:48.904038+0000","last_peered":"2024-09-21T07:28:48.904038+0000","last_clean":"2024-09-21T07:28:48.904038+0000","last_became_active":"2024-09-21T07:28:46.887743+0000","last_became_peered":"2024-09-21T07:28:46.887743+0000","last_unstale":"2024-09-21T07:28:48.904038+0000","last_undegraded":"2024-09-21T07:28:48.904038+0000","last_fullsized":"2024-09-21T07:28:48.904038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:05.668245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868252+0000","last_change":"2024-09-21T07:28:46.868252+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868252+0000","last_undegraded":"2024-09-21T07:28:46.868252+0000","last_fullsized":"2024-09-21T07:28:46.868252+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891981+0000","last_change":"2024-09-21T07:28:46.891115+0000","last_active":"2024-09-21T07:28:46.891981+0000","last_peered":"2024-09-21T07:28:46.891981+0000","last_clean":"2024-09-21T07:28:46.891981+0000","last_became_active":"2024-09-21T07:28:46.888955+0000","last_became_peered":"2024-09-21T07:28:46.888955+0000","last_unstale":"2024-09-21T07:28:46.891981+0000","last_undegraded":"2024-09-21T07:28:46.891981+0000","last_fullsized":"2024-09-21T07:28:46.891981+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:54.986840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868002+0000","last_change":"2024-09-21T07:28:46.868002+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868002+0000","last_undegraded":"2024-09-21T07:28:46.868002+0000","last_fullsized":"2024-09-21T07:28:46.868002+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898001+0000","last_change":"2024-09-21T07:28:46.896939+0000","last_active":"2024-09-21T07:28:46.898001+0000","last_peered":"2024-09-21T07:28:46.898001+0000","last_clean":"2024-09-21T07:28:46.898001+0000","last_became_active":"2024-09-21T07:28:46.896614+0000","last_became_peered":"2024-09-21T07:28:46.896614+0000","last_unstale":"2024-09-21T07:28:46.898001+0000","last_undegraded":"2024-09-21T07:28:46.898001+0000","last_fullsized":"2024-09-21T07:28:46.898001+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:19.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880384+0000","last_change":"2024-09-21T07:28:46.880384+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880384+0000","last_undegraded":"2024-09-21T07:28:46.880384+0000","last_fullsized":"2024-09-21T07:28:46.880384+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893413+0000","last_change":"2024-09-21T07:28:46.892029+0000","last_active":"2024-09-21T07:28:46.893413+0000","last_peered":"2024-09-21T07:28:46.893413+0000","last_clean":"2024-09-21T07:28:46.893413+0000","last_became_active":"2024-09-21T07:28:46.890794+0000","last_became_peered":"2024-09-21T07:28:46.890794+0000","last_unstale":"2024-09-21T07:28:46.893413+0000","last_undegraded":"2024-09-21T07:28:46.893413+0000","last_fullsized":"2024-09-21T07:28:46.893413+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:55.883691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903757+0000","last_change":"2024-09-21T07:28:47.919719+0000","last_active":"2024-09-21T07:28:48.903757+0000","last_peered":"2024-09-21T07:28:48.903757+0000","last_clean":"2024-09-21T07:28:48.903757+0000","last_became_active":"2024-09-21T07:28:47.919401+0000","last_became_peered":"2024-09-21T07:28:47.919401+0000","last_unstale":"2024-09-21T07:28:48.903757+0000","last_undegraded":"2024-09-21T07:28:48.903757+0000","last_fullsized":"2024-09-21T07:28:48.903757+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:53.523564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.869111+0000","last_change":"2024-09-21T07:28:45.869111+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.869111+0000","last_undegraded":"2024-09-21T07:28:45.869111+0000","last_fullsized":"2024-09-21T07:28:45.869111+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877586+0000","last_change":"2024-09-21T07:28:46.877586+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877586+0000","last_undegraded":"2024-09-21T07:28:46.877586+0000","last_fullsized":"2024-09-21T07:28:46.877586+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.894612+0000","last_change":"2024-09-21T07:28:46.892076+0000","last_active":"2024-09-21T07:28:46.894612+0000","last_peered":"2024-09-21T07:28:46.894612+0000","last_clean":"2024-09-21T07:28:46.894612+0000","last_became_active":"2024-09-21T07:28:46.891776+0000","last_became_peered":"2024-09-21T07:28:46.891776+0000","last_unstale":"2024-09-21T07:28:46.894612+0000","last_undegraded":"2024-09-21T07:28:46.894612+0000","last_fullsized":"2024-09-21T07:28:46.894612+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:18.078317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873375+0000","last_change":"2024-09-21T07:28:46.873375+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873375+0000","last_undegraded":"2024-09-21T07:28:46.873375+0000","last_fullsized":"2024-09-21T07:28:46.873375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.897585+0000","last_change":"2024-09-21T07:28:46.896318+0000","last_active":"2024-09-21T07:28:46.897585+0000","last_peered":"2024-09-21T07:28:46.897585+0000","last_clean":"2024-09-21T07:28:46.897585+0000","last_became_active":"2024-09-21T07:28:46.895997+0000","last_became_peered":"2024-09-21T07:28:46.895997+0000","last_unstale":"2024-09-21T07:28:46.897585+0000","last_undegraded":"2024-09-21T07:28:46.897585+0000","last_fullsized":"2024-09-21T07:28:46.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:54.184304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904029+0000","last_change":"2024-09-21T07:28:47.912614+0000","last_active":"2024-09-21T07:28:48.904029+0000","last_peered":"2024-09-21T07:28:48.904029+0000","last_clean":"2024-09-21T07:28:48.904029+0000","last_became_active":"2024-09-21T07:28:47.911410+0000","last_became_peered":"2024-09-21T07:28:47.911410+0000","last_unstale":"2024-09-21T07:28:48.904029+0000","last_undegraded":"2024-09-21T07:28:48.904029+0000","last_fullsized":"2024-09-21T07:28:48.904029+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:52.493508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903262+0000","last_change":"2024-09-21T07:28:46.882654+0000","last_active":"2024-09-21T07:28:48.903262+0000","last_peered":"2024-09-21T07:28:48.903262+0000","last_clean":"2024-09-21T07:28:48.903262+0000","last_became_active":"2024-09-21T07:28:46.881217+0000","last_became_peered":"2024-09-21T07:28:46.881217+0000","last_unstale":"2024-09-21T07:28:48.903262+0000","last_undegraded":"2024-09-21T07:28:48.903262+0000","last_fullsized":"2024-09-21T07:28:48.903262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:05.000983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.896484+0000","last_change":"2024-09-21T07:28:46.893078+0000","last_active":"2024-09-21T07:28:46.896484+0000","last_peered":"2024-09-21T07:28:46.896484+0000","last_clean":"2024-09-21T07:28:46.896484+0000","last_became_active":"2024-09-21T07:28:46.890767+0000","last_became_peered":"2024-09-21T07:28:46.890767+0000","last_unstale":"2024-09-21T07:28:46.896484+0000","last_undegraded":"2024-09-21T07:28:46.896484+0000","last_fullsized":"2024-09-21T07:28:46.896484+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875961+0000","last_change":"2024-09-21T07:28:46.875961+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875961+0000","last_undegraded":"2024-09-21T07:28:46.875961+0000","last_fullsized":"2024-09-21T07:28:46.875961+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889914+0000","last_change":"2024-09-21T07:28:46.884544+0000","last_active":"2024-09-21T07:28:46.889914+0000","last_peered":"2024-09-21T07:28:46.889914+0000","last_clean":"2024-09-21T07:28:46.889914+0000","last_became_active":"2024-09-21T07:28:46.884216+0000","last_became_peered":"2024-09-21T07:28:46.884216+0000","last_unstale":"2024-09-21T07:28:46.889914+0000","last_undegraded":"2024-09-21T07:28:46.889914+0000","last_fullsized":"2024-09-21T07:28:46.889914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:55.903108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868098+0000","last_change":"2024-09-21T07:28:46.868098+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868098+0000","last_undegraded":"2024-09-21T07:28:46.868098+0000","last_fullsized":"2024-09-21T07:28:46.868098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.873407+0000","last_change":"2024-09-21T07:28:45.873407+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.873407+0000","last_undegraded":"2024-09-21T07:28:45.873407+0000","last_fullsized":"2024-09-21T07:28:45.873407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876302+0000","last_change":"2024-09-21T07:28:46.876302+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876302+0000","last_undegraded":"2024-09-21T07:28:46.876302+0000","last_fullsized":"2024-09-21T07:28:46.876302+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893972+0000","last_change":"2024-09-21T07:28:46.885717+0000","last_active":"2024-09-21T07:28:46.893972+0000","last_peered":"2024-09-21T07:28:46.893972+0000","last_clean":"2024-09-21T07:28:46.893972+0000","last_became_active":"2024-09-21T07:28:46.885274+0000","last_became_peered":"2024-09-21T07:28:46.885274+0000","last_unstale":"2024-09-21T07:28:46.893972+0000","last_undegraded":"2024-09-21T07:28:46.893972+0000","last_fullsized":"2024-09-21T07:28:46.893972+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879079+0000","last_change":"2024-09-21T07:28:46.879079+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879079+0000","last_undegraded":"2024-09-21T07:28:46.879079+0000","last_fullsized":"2024-09-21T07:28:46.879079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891570+0000","last_change":"2024-09-21T07:28:46.890803+0000","last_active":"2024-09-21T07:28:46.891570+0000","last_peered":"2024-09-21T07:28:46.891570+0000","last_clean":"2024-09-21T07:28:46.891570+0000","last_became_active":"2024-09-21T07:28:46.890473+0000","last_became_peered":"2024-09-21T07:28:46.890473+0000","last_unstale":"2024-09-21T07:28:46.891570+0000","last_undegraded":"2024-09-21T07:28:46.891570+0000","last_fullsized":"2024-09-21T07:28:46.891570+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:52.596397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872943+0000","last_change":"2024-09-21T07:28:46.872943+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872943+0000","last_undegraded":"2024-09-21T07:28:46.872943+0000","last_fullsized":"2024-09-21T07:28:46.872943+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903580+0000","last_change":"2024-09-21T07:28:46.884691+0000","last_active":"2024-09-21T07:28:48.903580+0000","last_peered":"2024-09-21T07:28:48.903580+0000","last_clean":"2024-09-21T07:28:48.903580+0000","last_became_active":"2024-09-21T07:28:46.884171+0000","last_became_peered":"2024-09-21T07:28:46.884171+0000","last_unstale":"2024-09-21T07:28:48.903580+0000","last_undegraded":"2024-09-21T07:28:48.903580+0000","last_fullsized":"2024-09-21T07:28:48.903580+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:25.992238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869676+0000","last_change":"2024-09-21T07:28:46.869676+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869676+0000","last_undegraded":"2024-09-21T07:28:46.869676+0000","last_fullsized":"2024-09-21T07:28:46.869676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886385+0000","last_change":"2024-09-21T07:28:46.876770+0000","last_active":"2024-09-21T07:28:46.886385+0000","last_peered":"2024-09-21T07:28:46.886385+0000","last_clean":"2024-09-21T07:28:46.886385+0000","last_became_active":"2024-09-21T07:28:46.875744+0000","last_became_peered":"2024-09-21T07:28:46.875744+0000","last_unstale":"2024-09-21T07:28:46.886385+0000","last_undegraded":"2024-09-21T07:28:46.886385+0000","last_fullsized":"2024-09-21T07:28:46.886385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:12.128936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878143+0000","last_change":"2024-09-21T07:28:46.878143+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878143+0000","last_undegraded":"2024-09-21T07:28:46.878143+0000","last_fullsized":"2024-09-21T07:28:46.878143+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898492+0000","last_change":"2024-09-21T07:28:46.897169+0000","last_active":"2024-09-21T07:28:46.898492+0000","last_peered":"2024-09-21T07:28:46.898492+0000","last_clean":"2024-09-21T07:28:46.898492+0000","last_became_active":"2024-09-21T07:28:46.896393+0000","last_became_peered":"2024-09-21T07:28:46.896393+0000","last_unstale":"2024-09-21T07:28:46.898492+0000","last_undegraded":"2024-09-21T07:28:46.898492+0000","last_fullsized":"2024-09-21T07:28:46.898492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:57.578325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868507+0000","last_change":"2024-09-21T07:28:46.868507+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868507+0000","last_undegraded":"2024-09-21T07:28:46.868507+0000","last_fullsized":"2024-09-21T07:28:46.868507+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.890964+0000","last_change":"2024-09-21T07:28:46.882380+0000","last_active":"2024-09-21T07:28:46.890964+0000","last_peered":"2024-09-21T07:28:46.890964+0000","last_clean":"2024-09-21T07:28:46.890964+0000","last_became_active":"2024-09-21T07:28:46.881937+0000","last_became_peered":"2024-09-21T07:28:46.881937+0000","last_unstale":"2024-09-21T07:28:46.890964+0000","last_undegraded":"2024-09-21T07:28:46.890964+0000","last_fullsized":"2024-09-21T07:28:46.890964+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:25.407796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872803+0000","last_change":"2024-09-21T07:28:46.872803+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872803+0000","last_undegraded":"2024-09-21T07:28:46.872803+0000","last_fullsized":"2024-09-21T07:28:46.872803+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.872865+0000","last_change":"2024-09-21T07:28:45.872865+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.872865+0000","last_undegraded":"2024-09-21T07:28:45.872865+0000","last_fullsized":"2024-09-21T07:28:45.872865+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876827+0000","last_change":"2024-09-21T07:28:46.876827+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876827+0000","last_undegraded":"2024-09-21T07:28:46.876827+0000","last_fullsized":"2024-09-21T07:28:46.876827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895855+0000","last_change":"2024-09-21T07:28:46.893222+0000","last_active":"2024-09-21T07:28:46.895855+0000","last_peered":"2024-09-21T07:28:46.895855+0000","last_clean":"2024-09-21T07:28:46.895855+0000","last_became_active":"2024-09-21T07:28:46.892871+0000","last_became_peered":"2024-09-21T07:28:46.892871+0000","last_unstale":"2024-09-21T07:28:46.895855+0000","last_undegraded":"2024-09-21T07:28:46.895855+0000","last_fullsized":"2024-09-21T07:28:46.895855+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:55.217021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879472+0000","last_change":"2024-09-21T07:28:46.879472+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879472+0000","last_undegraded":"2024-09-21T07:28:46.879472+0000","last_fullsized":"2024-09-21T07:28:46.879472+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886737+0000","last_change":"2024-09-21T07:28:46.874879+0000","last_active":"2024-09-21T07:28:46.886737+0000","last_peered":"2024-09-21T07:28:46.886737+0000","last_clean":"2024-09-21T07:28:46.886737+0000","last_became_active":"2024-09-21T07:28:46.874565+0000","last_became_peered":"2024-09-21T07:28:46.874565+0000","last_unstale":"2024-09-21T07:28:46.886737+0000","last_undegraded":"2024-09-21T07:28:46.886737+0000","last_fullsized":"2024-09-21T07:28:46.886737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:37.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878041+0000","last_change":"2024-09-21T07:28:46.878041+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878041+0000","last_undegraded":"2024-09-21T07:28:46.878041+0000","last_fullsized":"2024-09-21T07:28:46.878041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888827+0000","last_change":"2024-09-21T07:28:46.879572+0000","last_active":"2024-09-21T07:28:46.888827+0000","last_peered":"2024-09-21T07:28:46.888827+0000","last_clean":"2024-09-21T07:28:46.888827+0000","last_became_active":"2024-09-21T07:28:46.879265+0000","last_became_peered":"2024-09-21T07:28:46.879265+0000","last_unstale":"2024-09-21T07:28:46.888827+0000","last_undegraded":"2024-09-21T07:28:46.888827+0000","last_fullsized":"2024-09-21T07:28:46.888827+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.759406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903867+0000","last_change":"2024-09-21T07:28:47.908921+0000","last_active":"2024-09-21T07:28:48.903867+0000","last_peered":"2024-09-21T07:28:48.903867+0000","last_clean":"2024-09-21T07:28:48.903867+0000","last_became_active":"2024-09-21T07:28:47.907608+0000","last_became_peered":"2024-09-21T07:28:47.907608+0000","last_unstale":"2024-09-21T07:28:48.903867+0000","last_undegraded":"2024-09-21T07:28:48.903867+0000","last_fullsized":"2024-09-21T07:28:48.903867+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:32.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893654+0000","last_change":"2024-09-21T07:28:46.885919+0000","last_active":"2024-09-21T07:28:46.893654+0000","last_peered":"2024-09-21T07:28:46.893654+0000","last_clean":"2024-09-21T07:28:46.893654+0000","last_became_active":"2024-09-21T07:28:46.885595+0000","last_became_peered":"2024-09-21T07:28:46.885595+0000","last_unstale":"2024-09-21T07:28:46.893654+0000","last_undegraded":"2024-09-21T07:28:46.893654+0000","last_fullsized":"2024-09-21T07:28:46.893654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870223+0000","last_change":"2024-09-21T07:28:46.870223+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870223+0000","last_undegraded":"2024-09-21T07:28:46.870223+0000","last_fullsized":"2024-09-21T07:28:46.870223+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888715+0000","last_change":"2024-09-21T07:28:46.882372+0000","last_active":"2024-09-21T07:28:46.888715+0000","last_peered":"2024-09-21T07:28:46.888715+0000","last_clean":"2024-09-21T07:28:46.888715+0000","last_became_active":"2024-09-21T07:28:46.882005+0000","last_became_peered":"2024-09-21T07:28:46.882005+0000","last_unstale":"2024-09-21T07:28:46.888715+0000","last_undegraded":"2024-09-21T07:28:46.888715+0000","last_fullsized":"2024-09-21T07:28:46.888715+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:11.475973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880445+0000","last_change":"2024-09-21T07:28:46.880445+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880445+0000","last_undegraded":"2024-09-21T07:28:46.880445+0000","last_fullsized":"2024-09-21T07:28:46.880445+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893851+0000","last_change":"2024-09-21T07:28:46.893022+0000","last_active":"2024-09-21T07:28:46.893851+0000","last_peered":"2024-09-21T07:28:46.893851+0000","last_clean":"2024-09-21T07:28:46.893851+0000","last_became_active":"2024-09-21T07:28:46.892553+0000","last_became_peered":"2024-09-21T07:28:46.892553+0000","last_unstale":"2024-09-21T07:28:46.893851+0000","last_undegraded":"2024-09-21T07:28:46.893851+0000","last_fullsized":"2024-09-21T07:28:46.893851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.596884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868365+0000","last_change":"2024-09-21T07:28:46.868365+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868365+0000","last_undegraded":"2024-09-21T07:28:46.868365+0000","last_fullsized":"2024-09-21T07:28:46.868365+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891847+0000","last_change":"2024-09-21T07:28:46.889175+0000","last_active":"2024-09-21T07:28:46.891847+0000","last_peered":"2024-09-21T07:28:46.891847+0000","last_clean":"2024-09-21T07:28:46.891847+0000","last_became_active":"2024-09-21T07:28:46.888896+0000","last_became_peered":"2024-09-21T07:28:46.888896+0000","last_unstale":"2024-09-21T07:28:46.891847+0000","last_undegraded":"2024-09-21T07:28:46.891847+0000","last_fullsized":"2024-09-21T07:28:46.891847+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:43.401377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903518+0000","last_change":"2024-09-21T07:28:47.906846+0000","last_active":"2024-09-21T07:28:48.903518+0000","last_peered":"2024-09-21T07:28:48.903518+0000","last_clean":"2024-09-21T07:28:48.903518+0000","last_became_active":"2024-09-21T07:28:47.906481+0000","last_became_peered":"2024-09-21T07:28:47.906481+0000","last_unstale":"2024-09-21T07:28:48.903518+0000","last_undegraded":"2024-09-21T07:28:48.903518+0000","last_fullsized":"2024-09-21T07:28:48.903518+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:22.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888454+0000","last_change":"2024-09-21T07:28:46.883777+0000","last_active":"2024-09-21T07:28:46.888454+0000","last_peered":"2024-09-21T07:28:46.888454+0000","last_clean":"2024-09-21T07:28:46.888454+0000","last_became_active":"2024-09-21T07:28:46.883424+0000","last_became_peered":"2024-09-21T07:28:46.883424+0000","last_unstale":"2024-09-21T07:28:46.888454+0000","last_undegraded":"2024-09-21T07:28:46.888454+0000","last_fullsized":"2024-09-21T07:28:46.888454+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:53.288454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880898+0000","last_change":"2024-09-21T07:28:46.880898+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880898+0000","last_undegraded":"2024-09-21T07:28:46.880898+0000","last_fullsized":"2024-09-21T07:28:46.880898+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893443+0000","last_change":"2024-09-21T07:28:46.892079+0000","last_active":"2024-09-21T07:28:46.893443+0000","last_peered":"2024-09-21T07:28:46.893443+0000","last_clean":"2024-09-21T07:28:46.893443+0000","last_became_active":"2024-09-21T07:28:46.891517+0000","last_became_peered":"2024-09-21T07:28:46.891517+0000","last_unstale":"2024-09-21T07:28:46.893443+0000","last_undegraded":"2024-09-21T07:28:46.893443+0000","last_fullsized":"2024-09-21T07:28:46.893443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:54.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869793+0000","last_change":"2024-09-21T07:28:46.869793+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869793+0000","last_undegraded":"2024-09-21T07:28:46.869793+0000","last_fullsized":"2024-09-21T07:28:46.869793+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895482+0000","last_change":"2024-09-21T07:28:46.888820+0000","last_active":"2024-09-21T07:28:46.895482+0000","last_peered":"2024-09-21T07:28:46.895482+0000","last_clean":"2024-09-21T07:28:46.895482+0000","last_became_active":"2024-09-21T07:28:46.884193+0000","last_became_peered":"2024-09-21T07:28:46.884193+0000","last_unstale":"2024-09-21T07:28:46.895482+0000","last_undegraded":"2024-09-21T07:28:46.895482+0000","last_fullsized":"2024-09-21T07:28:46.895482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869758+0000","last_change":"2024-09-21T07:28:46.869758+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869758+0000","last_undegraded":"2024-09-21T07:28:46.869758+0000","last_fullsized":"2024-09-21T07:28:46.869758+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.885517+0000","last_change":"2024-09-21T07:28:46.875287+0000","last_active":"2024-09-21T07:28:46.885517+0000","last_peered":"2024-09-21T07:28:46.885517+0000","last_clean":"2024-09-21T07:28:46.885517+0000","last_became_active":"2024-09-21T07:28:46.874980+0000","last_became_peered":"2024-09-21T07:28:46.874980+0000","last_unstale":"2024-09-21T07:28:46.885517+0000","last_undegraded":"2024-09-21T07:28:46.885517+0000","last_fullsized":"2024-09-21T07:28:46.885517+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.610529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893616+0000","last_change":"2024-09-21T07:28:46.885131+0000","last_active":"2024-09-21T07:28:46.893616+0000","last_peered":"2024-09-21T07:28:46.893616+0000","last_clean":"2024-09-21T07:28:46.893616+0000","last_became_active":"2024-09-21T07:28:46.884760+0000","last_became_peered":"2024-09-21T07:28:46.884760+0000","last_unstale":"2024-09-21T07:28:46.893616+0000","last_undegraded":"2024-09-21T07:28:46.893616+0000","last_fullsized":"2024-09-21T07:28:46.893616+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:27.496058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880132+0000","last_change":"2024-09-21T07:28:46.880132+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880132+0000","last_undegraded":"2024-09-21T07:28:46.880132+0000","last_fullsized":"2024-09-21T07:28:46.880132+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889341+0000","last_change":"2024-09-21T07:28:46.887554+0000","last_active":"2024-09-21T07:28:46.889341+0000","last_peered":"2024-09-21T07:28:46.889341+0000","last_clean":"2024-09-21T07:28:46.889341+0000","last_became_active":"2024-09-21T07:28:46.887005+0000","last_became_peered":"2024-09-21T07:28:46.887005+0000","last_unstale":"2024-09-21T07:28:46.889341+0000","last_undegraded":"2024-09-21T07:28:46.889341+0000","last_fullsized":"2024-09-21T07:28:46.889341+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:45.571945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878814+0000","last_change":"2024-09-21T07:28:46.878814+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878814+0000","last_undegraded":"2024-09-21T07:28:46.878814+0000","last_fullsized":"2024-09-21T07:28:46.878814+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888765+0000","last_change":"2024-09-21T07:28:46.879025+0000","last_active":"2024-09-21T07:28:46.888765+0000","last_peered":"2024-09-21T07:28:46.888765+0000","last_clean":"2024-09-21T07:28:46.888765+0000","last_became_active":"2024-09-21T07:28:46.878672+0000","last_became_peered":"2024-09-21T07:28:46.878672+0000","last_unstale":"2024-09-21T07:28:46.888765+0000","last_undegraded":"2024-09-21T07:28:46.888765+0000","last_fullsized":"2024-09-21T07:28:46.888765+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-21T07:28:45.873742+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:45.873742+0000","last_peered":"2024-09-21T07:28:45.873742+0000","last_clean":"2024-09-21T07:28:45.873742+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:45.873742+0000","last_undegraded":"2024-09-21T07:28:45.873742+0000","last_fullsized":"2024-09-21T07:28:45.873742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1392640,"data_stored":650664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41464,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330376,"statfs":{"total":96636764160,"available":96594305024,"internally_reserved":0,"allocated":1998848,"data_stored":1247699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37288,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334552,"statfs":{"total":96636764160,"available":96598581248,"internally_reserved":0,"allocated":1986560,"data_stored":1241032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1433600,"data_stored":671772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:52.524 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 -- 172.21.15.64:0/1639223286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 msgr2=0x7f4818072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 --2- 172.21.15.64:0/1639223286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f4818072e20 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f48180c3c60 tx=0x7f481001cd20 comp rx=0 tx=0).stop 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 -- 172.21.15.64:0/1639223286 shutdown_connections 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 --2- 172.21.15.64:0/1639223286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f4818072e20 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 --2- 172.21.15.64:0/1639223286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 0x7f48180b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 --2- 172.21.15.64:0/1639223286 >> v2:172.21.15.90:3300/0 conn(0x7f481815edb0 0x7f48180700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 -- 172.21.15.64:0/1639223286 >> 172.21.15.64:0/1639223286 conn(0x7f48180ccbe0 msgr2=0x7f48180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 -- 172.21.15.64:0/1639223286 shutdown_connections 2024-09-21T07:28:52.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.719+0000 7f481e800640 1 -- 172.21.15.64:0/1639223286 wait complete. 2024-09-21T07:28:52.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 Processor -- start 2024-09-21T07:28:52.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- start start 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 0x7f48180adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f481815edb0 0x7f481815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f48180b23d0 con 0x7f48180b4700 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48180b2250 con 0x7f481815edb0 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f48180b2550 con 0x7f48180709b0 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55504/0 (socket says 172.21.15.64:55504) 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 -- 172.21.15.64:0/4081969429 learned_addr learned my addr 172.21.15.64:0/4081969429 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f4817400640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 0x7f48180adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f4817e00640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f481815edb0 0x7f481815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 -- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 msgr2=0x7f48180adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 0x7f48180adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 -- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f481815edb0 msgr2=0x7f481815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f481815edb0 0x7f481815c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 -- 172.21.15.64:0/4081969429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48181fa460 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480ea00640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f480000d6d0 tx=0x7f480000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800017070 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4800004310 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48181fa740 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800005280 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.723+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48181fad00 con 0x7f48180b4700 2024-09-21T07:28:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4818072e20 con 0x7f48180b4700 2024-09-21T07:28:52.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4800005420 con 0x7f48180b4700 2024-09-21T07:28:52.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f480fe00640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 0x7f47f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:52.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f4800094640 con 0x7f48180b4700 2024-09-21T07:28:52.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f4817400640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 0x7f47f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:52.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.727+0000 7f4817400640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 0x7f47f4075740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4808009b40 tx=0x7f48080091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:52.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.731+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4800020020 con 0x7f48180b4700 2024-09-21T07:28:52.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.907+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48180750e0 con 0x7f47f4073230 2024-09-21T07:28:52.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.911+0000 7f480fe00640 1 -- 172.21.15.64:0/4081969429 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247002 (secure 0 0 0) 0x7f48180750e0 con 0x7f47f4073230 2024-09-21T07:28:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:52.918 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 msgr2=0x7f47f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 0x7f47f4075740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4808009b40 tx=0x7f48080091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 msgr2=0x7f48180aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f480000d6d0 tx=0x7f480000db90 comp rx=0 tx=0).stop 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 shutdown_connections 2024-09-21T07:28:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47f4073230 0x7f47f4075740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f481815edb0 0x7f481815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48180b4700 0x7f48180aead0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 --2- 172.21.15.64:0/4081969429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48180709b0 0x7f48180adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 >> 172.21.15.64:0/4081969429 conn(0x7f48180ccbe0 msgr2=0x7f48180b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 shutdown_connections 2024-09-21T07:28:52.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:52.915+0000 7f481e800640 1 -- 172.21.15.64:0/4081969429 wait complete. 2024-09-21T07:28:52.940 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-21T07:28:51.519802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315752,"kb_used_data":12140,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658968,"statfs":{"total":773094113280,"available":772770783232,"internally_reserved":0,"allocated":12431360,"data_stored":6440491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":310693427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657741"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874809+0000","last_change":"2024-09-21T07:28:46.874809+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874809+0000","last_undegraded":"2024-09-21T07:28:46.874809+0000","last_fullsized":"2024-09-21T07:28:46.874809+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879050+0000","last_change":"2024-09-21T07:28:46.879050+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879050+0000","last_undegraded":"2024-09-21T07:28:46.879050+0000","last_fullsized":"2024-09-21T07:28:46.879050+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903709+0000","last_change":"2024-09-21T07:28:47.905037+0000","last_active":"2024-09-21T07:28:48.903709+0000","last_peered":"2024-09-21T07:28:48.903709+0000","last_clean":"2024-09-21T07:28:48.903709+0000","last_became_active":"2024-09-21T07:28:47.904433+0000","last_became_peered":"2024-09-21T07:28:47.904433+0000","last_unstale":"2024-09-21T07:28:48.903709+0000","last_undegraded":"2024-09-21T07:28:48.903709+0000","last_fullsized":"2024-09-21T07:28:48.903709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:55.177373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877313+0000","last_change":"2024-09-21T07:28:46.877313+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877313+0000","last_undegraded":"2024-09-21T07:28:46.877313+0000","last_fullsized":"2024-09-21T07:28:46.877313+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874104+0000","last_change":"2024-09-21T07:28:46.874104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874104+0000","last_undegraded":"2024-09-21T07:28:46.874104+0000","last_fullsized":"2024-09-21T07:28:46.874104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874587+0000","last_change":"2024-09-21T07:28:46.874587+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874587+0000","last_undegraded":"2024-09-21T07:28:46.874587+0000","last_fullsized":"2024-09-21T07:28:46.874587+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873991+0000","last_change":"2024-09-21T07:28:46.873991+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873991+0000","last_undegraded":"2024-09-21T07:28:46.873991+0000","last_fullsized":"2024-09-21T07:28:46.873991+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874516+0000","last_change":"2024-09-21T07:28:46.874516+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874516+0000","last_undegraded":"2024-09-21T07:28:46.874516+0000","last_fullsized":"2024-09-21T07:28:46.874516+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877897+0000","last_change":"2024-09-21T07:28:46.877897+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877897+0000","last_undegraded":"2024-09-21T07:28:46.877897+0000","last_fullsized":"2024-09-21T07:28:46.877897+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881822+0000","last_change":"2024-09-21T07:28:46.881822+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881822+0000","last_undegraded":"2024-09-21T07:28:46.881822+0000","last_fullsized":"2024-09-21T07:28:46.881822+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869738+0000","last_change":"2024-09-21T07:28:46.869738+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869738+0000","last_undegraded":"2024-09-21T07:28:46.869738+0000","last_fullsized":"2024-09-21T07:28:46.869738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903544+0000","last_change":"2024-09-21T07:28:47.912349+0000","last_active":"2024-09-21T07:28:48.903544+0000","last_peered":"2024-09-21T07:28:48.903544+0000","last_clean":"2024-09-21T07:28:48.903544+0000","last_became_active":"2024-09-21T07:28:47.911807+0000","last_became_peered":"2024-09-21T07:28:47.911807+0000","last_unstale":"2024-09-21T07:28:48.903544+0000","last_undegraded":"2024-09-21T07:28:48.903544+0000","last_fullsized":"2024-09-21T07:28:48.903544+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878612+0000","last_change":"2024-09-21T07:28:46.878612+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878612+0000","last_undegraded":"2024-09-21T07:28:46.878612+0000","last_fullsized":"2024-09-21T07:28:46.878612+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874282+0000","last_change":"2024-09-21T07:28:46.874282+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874282+0000","last_undegraded":"2024-09-21T07:28:46.874282+0000","last_fullsized":"2024-09-21T07:28:46.874282+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878548+0000","last_change":"2024-09-21T07:28:46.878548+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878548+0000","last_undegraded":"2024-09-21T07:28:46.878548+0000","last_fullsized":"2024-09-21T07:28:46.878548+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869179+0000","last_change":"2024-09-21T07:28:46.869179+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869179+0000","last_undegraded":"2024-09-21T07:28:46.869179+0000","last_fullsized":"2024-09-21T07:28:46.869179+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871104+0000","last_change":"2024-09-21T07:28:46.871104+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871104+0000","last_undegraded":"2024-09-21T07:28:46.871104+0000","last_fullsized":"2024-09-21T07:28:46.871104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877208+0000","last_change":"2024-09-21T07:28:46.877208+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877208+0000","last_undegraded":"2024-09-21T07:28:46.877208+0000","last_fullsized":"2024-09-21T07:28:46.877208+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876765+0000","last_change":"2024-09-21T07:28:46.876765+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876765+0000","last_undegraded":"2024-09-21T07:28:46.876765+0000","last_fullsized":"2024-09-21T07:28:46.876765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875828+0000","last_change":"2024-09-21T07:28:46.875828+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875828+0000","last_undegraded":"2024-09-21T07:28:46.875828+0000","last_fullsized":"2024-09-21T07:28:46.875828+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868465+0000","last_change":"2024-09-21T07:28:46.868465+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868465+0000","last_undegraded":"2024-09-21T07:28:46.868465+0000","last_fullsized":"2024-09-21T07:28:46.868465+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868171+0000","last_change":"2024-09-21T07:28:46.868171+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868171+0000","last_undegraded":"2024-09-21T07:28:46.868171+0000","last_fullsized":"2024-09-21T07:28:46.868171+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.881330+0000","last_change":"2024-09-21T07:28:46.881330+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.881330+0000","last_undegraded":"2024-09-21T07:28:46.881330+0000","last_fullsized":"2024-09-21T07:28:46.881330+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873249+0000","last_change":"2024-09-21T07:28:46.873249+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873249+0000","last_undegraded":"2024-09-21T07:28:46.873249+0000","last_fullsized":"2024-09-21T07:28:46.873249+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870533+0000","last_change":"2024-09-21T07:28:46.870533+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870533+0000","last_undegraded":"2024-09-21T07:28:46.870533+0000","last_fullsized":"2024-09-21T07:28:46.870533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868688+0000","last_change":"2024-09-21T07:28:46.868688+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868688+0000","last_undegraded":"2024-09-21T07:28:46.868688+0000","last_fullsized":"2024-09-21T07:28:46.868688+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.874034+0000","last_change":"2024-09-21T07:28:46.874034+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.874034+0000","last_undegraded":"2024-09-21T07:28:46.874034+0000","last_fullsized":"2024-09-21T07:28:46.874034+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.871299+0000","last_change":"2024-09-21T07:28:46.871299+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.871299+0000","last_undegraded":"2024-09-21T07:28:46.871299+0000","last_fullsized":"2024-09-21T07:28:46.871299+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877107+0000","last_change":"2024-09-21T07:28:46.877107+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877107+0000","last_undegraded":"2024-09-21T07:28:46.877107+0000","last_fullsized":"2024-09-21T07:28:46.877107+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904038+0000","last_change":"2024-09-21T07:28:46.888058+0000","last_active":"2024-09-21T07:28:48.904038+0000","last_peered":"2024-09-21T07:28:48.904038+0000","last_clean":"2024-09-21T07:28:48.904038+0000","last_became_active":"2024-09-21T07:28:46.887743+0000","last_became_peered":"2024-09-21T07:28:46.887743+0000","last_unstale":"2024-09-21T07:28:48.904038+0000","last_undegraded":"2024-09-21T07:28:48.904038+0000","last_fullsized":"2024-09-21T07:28:48.904038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:05.668245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868252+0000","last_change":"2024-09-21T07:28:46.868252+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868252+0000","last_undegraded":"2024-09-21T07:28:46.868252+0000","last_fullsized":"2024-09-21T07:28:46.868252+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891981+0000","last_change":"2024-09-21T07:28:46.891115+0000","last_active":"2024-09-21T07:28:46.891981+0000","last_peered":"2024-09-21T07:28:46.891981+0000","last_clean":"2024-09-21T07:28:46.891981+0000","last_became_active":"2024-09-21T07:28:46.888955+0000","last_became_peered":"2024-09-21T07:28:46.888955+0000","last_unstale":"2024-09-21T07:28:46.891981+0000","last_undegraded":"2024-09-21T07:28:46.891981+0000","last_fullsized":"2024-09-21T07:28:46.891981+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:54.986840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868002+0000","last_change":"2024-09-21T07:28:46.868002+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868002+0000","last_undegraded":"2024-09-21T07:28:46.868002+0000","last_fullsized":"2024-09-21T07:28:46.868002+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898001+0000","last_change":"2024-09-21T07:28:46.896939+0000","last_active":"2024-09-21T07:28:46.898001+0000","last_peered":"2024-09-21T07:28:46.898001+0000","last_clean":"2024-09-21T07:28:46.898001+0000","last_became_active":"2024-09-21T07:28:46.896614+0000","last_became_peered":"2024-09-21T07:28:46.896614+0000","last_unstale":"2024-09-21T07:28:46.898001+0000","last_undegraded":"2024-09-21T07:28:46.898001+0000","last_fullsized":"2024-09-21T07:28:46.898001+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:19.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880384+0000","last_change":"2024-09-21T07:28:46.880384+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880384+0000","last_undegraded":"2024-09-21T07:28:46.880384+0000","last_fullsized":"2024-09-21T07:28:46.880384+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893413+0000","last_change":"2024-09-21T07:28:46.892029+0000","last_active":"2024-09-21T07:28:46.893413+0000","last_peered":"2024-09-21T07:28:46.893413+0000","last_clean":"2024-09-21T07:28:46.893413+0000","last_became_active":"2024-09-21T07:28:46.890794+0000","last_became_peered":"2024-09-21T07:28:46.890794+0000","last_unstale":"2024-09-21T07:28:46.893413+0000","last_undegraded":"2024-09-21T07:28:46.893413+0000","last_fullsized":"2024-09-21T07:28:46.893413+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:55.883691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903757+0000","last_change":"2024-09-21T07:28:47.919719+0000","last_active":"2024-09-21T07:28:48.903757+0000","last_peered":"2024-09-21T07:28:48.903757+0000","last_clean":"2024-09-21T07:28:48.903757+0000","last_became_active":"2024-09-21T07:28:47.919401+0000","last_became_peered":"2024-09-21T07:28:47.919401+0000","last_unstale":"2024-09-21T07:28:48.903757+0000","last_undegraded":"2024-09-21T07:28:48.903757+0000","last_fullsized":"2024-09-21T07:28:48.903757+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:53.523564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.869111+0000","last_change":"2024-09-21T07:28:45.869111+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.869111+0000","last_undegraded":"2024-09-21T07:28:45.869111+0000","last_fullsized":"2024-09-21T07:28:45.869111+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.877586+0000","last_change":"2024-09-21T07:28:46.877586+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.877586+0000","last_undegraded":"2024-09-21T07:28:46.877586+0000","last_fullsized":"2024-09-21T07:28:46.877586+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.894612+0000","last_change":"2024-09-21T07:28:46.892076+0000","last_active":"2024-09-21T07:28:46.894612+0000","last_peered":"2024-09-21T07:28:46.894612+0000","last_clean":"2024-09-21T07:28:46.894612+0000","last_became_active":"2024-09-21T07:28:46.891776+0000","last_became_peered":"2024-09-21T07:28:46.891776+0000","last_unstale":"2024-09-21T07:28:46.894612+0000","last_undegraded":"2024-09-21T07:28:46.894612+0000","last_fullsized":"2024-09-21T07:28:46.894612+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:18.078317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.873375+0000","last_change":"2024-09-21T07:28:46.873375+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.873375+0000","last_undegraded":"2024-09-21T07:28:46.873375+0000","last_fullsized":"2024-09-21T07:28:46.873375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.897585+0000","last_change":"2024-09-21T07:28:46.896318+0000","last_active":"2024-09-21T07:28:46.897585+0000","last_peered":"2024-09-21T07:28:46.897585+0000","last_clean":"2024-09-21T07:28:46.897585+0000","last_became_active":"2024-09-21T07:28:46.895997+0000","last_became_peered":"2024-09-21T07:28:46.895997+0000","last_unstale":"2024-09-21T07:28:46.897585+0000","last_undegraded":"2024-09-21T07:28:46.897585+0000","last_fullsized":"2024-09-21T07:28:46.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:54.184304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904029+0000","last_change":"2024-09-21T07:28:47.912614+0000","last_active":"2024-09-21T07:28:48.904029+0000","last_peered":"2024-09-21T07:28:48.904029+0000","last_clean":"2024-09-21T07:28:48.904029+0000","last_became_active":"2024-09-21T07:28:47.911410+0000","last_became_peered":"2024-09-21T07:28:47.911410+0000","last_unstale":"2024-09-21T07:28:48.904029+0000","last_undegraded":"2024-09-21T07:28:48.904029+0000","last_fullsized":"2024-09-21T07:28:48.904029+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:52.493508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903262+0000","last_change":"2024-09-21T07:28:46.882654+0000","last_active":"2024-09-21T07:28:48.903262+0000","last_peered":"2024-09-21T07:28:48.903262+0000","last_clean":"2024-09-21T07:28:48.903262+0000","last_became_active":"2024-09-21T07:28:46.881217+0000","last_became_peered":"2024-09-21T07:28:46.881217+0000","last_unstale":"2024-09-21T07:28:48.903262+0000","last_undegraded":"2024-09-21T07:28:48.903262+0000","last_fullsized":"2024-09-21T07:28:48.903262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:05.000983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879119+0000","last_change":"2024-09-21T07:28:46.879119+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879119+0000","last_undegraded":"2024-09-21T07:28:46.879119+0000","last_fullsized":"2024-09-21T07:28:46.879119+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.896484+0000","last_change":"2024-09-21T07:28:46.893078+0000","last_active":"2024-09-21T07:28:46.896484+0000","last_peered":"2024-09-21T07:28:46.896484+0000","last_clean":"2024-09-21T07:28:46.896484+0000","last_became_active":"2024-09-21T07:28:46.890767+0000","last_became_peered":"2024-09-21T07:28:46.890767+0000","last_unstale":"2024-09-21T07:28:46.896484+0000","last_undegraded":"2024-09-21T07:28:46.896484+0000","last_fullsized":"2024-09-21T07:28:46.896484+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.875961+0000","last_change":"2024-09-21T07:28:46.875961+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.875961+0000","last_undegraded":"2024-09-21T07:28:46.875961+0000","last_fullsized":"2024-09-21T07:28:46.875961+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889914+0000","last_change":"2024-09-21T07:28:46.884544+0000","last_active":"2024-09-21T07:28:46.889914+0000","last_peered":"2024-09-21T07:28:46.889914+0000","last_clean":"2024-09-21T07:28:46.889914+0000","last_became_active":"2024-09-21T07:28:46.884216+0000","last_became_peered":"2024-09-21T07:28:46.884216+0000","last_unstale":"2024-09-21T07:28:46.889914+0000","last_undegraded":"2024-09-21T07:28:46.889914+0000","last_fullsized":"2024-09-21T07:28:46.889914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:55.903108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868098+0000","last_change":"2024-09-21T07:28:46.868098+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868098+0000","last_undegraded":"2024-09-21T07:28:46.868098+0000","last_fullsized":"2024-09-21T07:28:46.868098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.873407+0000","last_change":"2024-09-21T07:28:45.873407+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.873407+0000","last_undegraded":"2024-09-21T07:28:45.873407+0000","last_fullsized":"2024-09-21T07:28:45.873407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876302+0000","last_change":"2024-09-21T07:28:46.876302+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876302+0000","last_undegraded":"2024-09-21T07:28:46.876302+0000","last_fullsized":"2024-09-21T07:28:46.876302+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893972+0000","last_change":"2024-09-21T07:28:46.885717+0000","last_active":"2024-09-21T07:28:46.893972+0000","last_peered":"2024-09-21T07:28:46.893972+0000","last_clean":"2024-09-21T07:28:46.893972+0000","last_became_active":"2024-09-21T07:28:46.885274+0000","last_became_peered":"2024-09-21T07:28:46.885274+0000","last_unstale":"2024-09-21T07:28:46.893972+0000","last_undegraded":"2024-09-21T07:28:46.893972+0000","last_fullsized":"2024-09-21T07:28:46.893972+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879079+0000","last_change":"2024-09-21T07:28:46.879079+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879079+0000","last_undegraded":"2024-09-21T07:28:46.879079+0000","last_fullsized":"2024-09-21T07:28:46.879079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891570+0000","last_change":"2024-09-21T07:28:46.890803+0000","last_active":"2024-09-21T07:28:46.891570+0000","last_peered":"2024-09-21T07:28:46.891570+0000","last_clean":"2024-09-21T07:28:46.891570+0000","last_became_active":"2024-09-21T07:28:46.890473+0000","last_became_peered":"2024-09-21T07:28:46.890473+0000","last_unstale":"2024-09-21T07:28:46.891570+0000","last_undegraded":"2024-09-21T07:28:46.891570+0000","last_fullsized":"2024-09-21T07:28:46.891570+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:52.596397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872943+0000","last_change":"2024-09-21T07:28:46.872943+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872943+0000","last_undegraded":"2024-09-21T07:28:46.872943+0000","last_fullsized":"2024-09-21T07:28:46.872943+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903580+0000","last_change":"2024-09-21T07:28:46.884691+0000","last_active":"2024-09-21T07:28:48.903580+0000","last_peered":"2024-09-21T07:28:48.903580+0000","last_clean":"2024-09-21T07:28:48.903580+0000","last_became_active":"2024-09-21T07:28:46.884171+0000","last_became_peered":"2024-09-21T07:28:46.884171+0000","last_unstale":"2024-09-21T07:28:48.903580+0000","last_undegraded":"2024-09-21T07:28:48.903580+0000","last_fullsized":"2024-09-21T07:28:48.903580+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:25.992238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869676+0000","last_change":"2024-09-21T07:28:46.869676+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869676+0000","last_undegraded":"2024-09-21T07:28:46.869676+0000","last_fullsized":"2024-09-21T07:28:46.869676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886385+0000","last_change":"2024-09-21T07:28:46.876770+0000","last_active":"2024-09-21T07:28:46.886385+0000","last_peered":"2024-09-21T07:28:46.886385+0000","last_clean":"2024-09-21T07:28:46.886385+0000","last_became_active":"2024-09-21T07:28:46.875744+0000","last_became_peered":"2024-09-21T07:28:46.875744+0000","last_unstale":"2024-09-21T07:28:46.886385+0000","last_undegraded":"2024-09-21T07:28:46.886385+0000","last_fullsized":"2024-09-21T07:28:46.886385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:12.128936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878143+0000","last_change":"2024-09-21T07:28:46.878143+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878143+0000","last_undegraded":"2024-09-21T07:28:46.878143+0000","last_fullsized":"2024-09-21T07:28:46.878143+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.898492+0000","last_change":"2024-09-21T07:28:46.897169+0000","last_active":"2024-09-21T07:28:46.898492+0000","last_peered":"2024-09-21T07:28:46.898492+0000","last_clean":"2024-09-21T07:28:46.898492+0000","last_became_active":"2024-09-21T07:28:46.896393+0000","last_became_peered":"2024-09-21T07:28:46.896393+0000","last_unstale":"2024-09-21T07:28:46.898492+0000","last_undegraded":"2024-09-21T07:28:46.898492+0000","last_fullsized":"2024-09-21T07:28:46.898492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:57.578325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868507+0000","last_change":"2024-09-21T07:28:46.868507+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868507+0000","last_undegraded":"2024-09-21T07:28:46.868507+0000","last_fullsized":"2024-09-21T07:28:46.868507+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.890964+0000","last_change":"2024-09-21T07:28:46.882380+0000","last_active":"2024-09-21T07:28:46.890964+0000","last_peered":"2024-09-21T07:28:46.890964+0000","last_clean":"2024-09-21T07:28:46.890964+0000","last_became_active":"2024-09-21T07:28:46.881937+0000","last_became_peered":"2024-09-21T07:28:46.881937+0000","last_unstale":"2024-09-21T07:28:46.890964+0000","last_undegraded":"2024-09-21T07:28:46.890964+0000","last_fullsized":"2024-09-21T07:28:46.890964+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:25.407796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.872803+0000","last_change":"2024-09-21T07:28:46.872803+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.872803+0000","last_undegraded":"2024-09-21T07:28:46.872803+0000","last_fullsized":"2024-09-21T07:28:46.872803+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-21T07:28:45.872865+0000","last_change":"2024-09-21T07:28:45.872865+0000","last_active":"2024-09-21T07:28:45.849509+0000","last_peered":"2024-09-21T07:28:45.849509+0000","last_clean":"2024-09-21T07:28:45.849509+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:45.872865+0000","last_undegraded":"2024-09-21T07:28:45.872865+0000","last_fullsized":"2024-09-21T07:28:45.872865+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.876827+0000","last_change":"2024-09-21T07:28:46.876827+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.876827+0000","last_undegraded":"2024-09-21T07:28:46.876827+0000","last_fullsized":"2024-09-21T07:28:46.876827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895855+0000","last_change":"2024-09-21T07:28:46.893222+0000","last_active":"2024-09-21T07:28:46.895855+0000","last_peered":"2024-09-21T07:28:46.895855+0000","last_clean":"2024-09-21T07:28:46.895855+0000","last_became_active":"2024-09-21T07:28:46.892871+0000","last_became_peered":"2024-09-21T07:28:46.892871+0000","last_unstale":"2024-09-21T07:28:46.895855+0000","last_undegraded":"2024-09-21T07:28:46.895855+0000","last_fullsized":"2024-09-21T07:28:46.895855+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:55.217021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.879472+0000","last_change":"2024-09-21T07:28:46.879472+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.879472+0000","last_undegraded":"2024-09-21T07:28:46.879472+0000","last_fullsized":"2024-09-21T07:28:46.879472+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.886737+0000","last_change":"2024-09-21T07:28:46.874879+0000","last_active":"2024-09-21T07:28:46.886737+0000","last_peered":"2024-09-21T07:28:46.886737+0000","last_clean":"2024-09-21T07:28:46.886737+0000","last_became_active":"2024-09-21T07:28:46.874565+0000","last_became_peered":"2024-09-21T07:28:46.874565+0000","last_unstale":"2024-09-21T07:28:46.886737+0000","last_undegraded":"2024-09-21T07:28:46.886737+0000","last_fullsized":"2024-09-21T07:28:46.886737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:37.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878041+0000","last_change":"2024-09-21T07:28:46.878041+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878041+0000","last_undegraded":"2024-09-21T07:28:46.878041+0000","last_fullsized":"2024-09-21T07:28:46.878041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888827+0000","last_change":"2024-09-21T07:28:46.879572+0000","last_active":"2024-09-21T07:28:46.888827+0000","last_peered":"2024-09-21T07:28:46.888827+0000","last_clean":"2024-09-21T07:28:46.888827+0000","last_became_active":"2024-09-21T07:28:46.879265+0000","last_became_peered":"2024-09-21T07:28:46.879265+0000","last_unstale":"2024-09-21T07:28:46.888827+0000","last_undegraded":"2024-09-21T07:28:46.888827+0000","last_fullsized":"2024-09-21T07:28:46.888827+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.759406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903867+0000","last_change":"2024-09-21T07:28:47.908921+0000","last_active":"2024-09-21T07:28:48.903867+0000","last_peered":"2024-09-21T07:28:48.903867+0000","last_clean":"2024-09-21T07:28:48.903867+0000","last_became_active":"2024-09-21T07:28:47.907608+0000","last_became_peered":"2024-09-21T07:28:47.907608+0000","last_unstale":"2024-09-21T07:28:48.903867+0000","last_undegraded":"2024-09-21T07:28:48.903867+0000","last_fullsized":"2024-09-21T07:28:48.903867+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:32.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893654+0000","last_change":"2024-09-21T07:28:46.885919+0000","last_active":"2024-09-21T07:28:46.893654+0000","last_peered":"2024-09-21T07:28:46.893654+0000","last_clean":"2024-09-21T07:28:46.893654+0000","last_became_active":"2024-09-21T07:28:46.885595+0000","last_became_peered":"2024-09-21T07:28:46.885595+0000","last_unstale":"2024-09-21T07:28:46.893654+0000","last_undegraded":"2024-09-21T07:28:46.893654+0000","last_fullsized":"2024-09-21T07:28:46.893654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.355712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.870223+0000","last_change":"2024-09-21T07:28:46.870223+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.870223+0000","last_undegraded":"2024-09-21T07:28:46.870223+0000","last_fullsized":"2024-09-21T07:28:46.870223+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888715+0000","last_change":"2024-09-21T07:28:46.882372+0000","last_active":"2024-09-21T07:28:46.888715+0000","last_peered":"2024-09-21T07:28:46.888715+0000","last_clean":"2024-09-21T07:28:46.888715+0000","last_became_active":"2024-09-21T07:28:46.882005+0000","last_became_peered":"2024-09-21T07:28:46.882005+0000","last_unstale":"2024-09-21T07:28:46.888715+0000","last_undegraded":"2024-09-21T07:28:46.888715+0000","last_fullsized":"2024-09-21T07:28:46.888715+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:11.475973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880445+0000","last_change":"2024-09-21T07:28:46.880445+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880445+0000","last_undegraded":"2024-09-21T07:28:46.880445+0000","last_fullsized":"2024-09-21T07:28:46.880445+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893851+0000","last_change":"2024-09-21T07:28:46.893022+0000","last_active":"2024-09-21T07:28:46.893851+0000","last_peered":"2024-09-21T07:28:46.893851+0000","last_clean":"2024-09-21T07:28:46.893851+0000","last_became_active":"2024-09-21T07:28:46.892553+0000","last_became_peered":"2024-09-21T07:28:46.892553+0000","last_unstale":"2024-09-21T07:28:46.893851+0000","last_undegraded":"2024-09-21T07:28:46.893851+0000","last_fullsized":"2024-09-21T07:28:46.893851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.596884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.868365+0000","last_change":"2024-09-21T07:28:46.868365+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.868365+0000","last_undegraded":"2024-09-21T07:28:46.868365+0000","last_fullsized":"2024-09-21T07:28:46.868365+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.891847+0000","last_change":"2024-09-21T07:28:46.889175+0000","last_active":"2024-09-21T07:28:46.891847+0000","last_peered":"2024-09-21T07:28:46.891847+0000","last_clean":"2024-09-21T07:28:46.891847+0000","last_became_active":"2024-09-21T07:28:46.888896+0000","last_became_peered":"2024-09-21T07:28:46.888896+0000","last_unstale":"2024-09-21T07:28:46.891847+0000","last_undegraded":"2024-09-21T07:28:46.891847+0000","last_fullsized":"2024-09-21T07:28:46.891847+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:43.401377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903518+0000","last_change":"2024-09-21T07:28:47.906846+0000","last_active":"2024-09-21T07:28:48.903518+0000","last_peered":"2024-09-21T07:28:48.903518+0000","last_clean":"2024-09-21T07:28:48.903518+0000","last_became_active":"2024-09-21T07:28:47.906481+0000","last_became_peered":"2024-09-21T07:28:47.906481+0000","last_unstale":"2024-09-21T07:28:48.903518+0000","last_undegraded":"2024-09-21T07:28:48.903518+0000","last_fullsized":"2024-09-21T07:28:48.903518+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:22.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888454+0000","last_change":"2024-09-21T07:28:46.883777+0000","last_active":"2024-09-21T07:28:46.888454+0000","last_peered":"2024-09-21T07:28:46.888454+0000","last_clean":"2024-09-21T07:28:46.888454+0000","last_became_active":"2024-09-21T07:28:46.883424+0000","last_became_peered":"2024-09-21T07:28:46.883424+0000","last_unstale":"2024-09-21T07:28:46.888454+0000","last_undegraded":"2024-09-21T07:28:46.888454+0000","last_fullsized":"2024-09-21T07:28:46.888454+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:53.288454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880898+0000","last_change":"2024-09-21T07:28:46.880898+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880898+0000","last_undegraded":"2024-09-21T07:28:46.880898+0000","last_fullsized":"2024-09-21T07:28:46.880898+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893443+0000","last_change":"2024-09-21T07:28:46.892079+0000","last_active":"2024-09-21T07:28:46.893443+0000","last_peered":"2024-09-21T07:28:46.893443+0000","last_clean":"2024-09-21T07:28:46.893443+0000","last_became_active":"2024-09-21T07:28:46.891517+0000","last_became_peered":"2024-09-21T07:28:46.891517+0000","last_unstale":"2024-09-21T07:28:46.893443+0000","last_undegraded":"2024-09-21T07:28:46.893443+0000","last_fullsized":"2024-09-21T07:28:46.893443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:54.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869793+0000","last_change":"2024-09-21T07:28:46.869793+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869793+0000","last_undegraded":"2024-09-21T07:28:46.869793+0000","last_fullsized":"2024-09-21T07:28:46.869793+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.895482+0000","last_change":"2024-09-21T07:28:46.888820+0000","last_active":"2024-09-21T07:28:46.895482+0000","last_peered":"2024-09-21T07:28:46.895482+0000","last_clean":"2024-09-21T07:28:46.895482+0000","last_became_active":"2024-09-21T07:28:46.884193+0000","last_became_peered":"2024-09-21T07:28:46.884193+0000","last_unstale":"2024-09-21T07:28:46.895482+0000","last_undegraded":"2024-09-21T07:28:46.895482+0000","last_fullsized":"2024-09-21T07:28:46.895482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.056392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.869758+0000","last_change":"2024-09-21T07:28:46.869758+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.869758+0000","last_undegraded":"2024-09-21T07:28:46.869758+0000","last_fullsized":"2024-09-21T07:28:46.869758+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.885517+0000","last_change":"2024-09-21T07:28:46.875287+0000","last_active":"2024-09-21T07:28:46.885517+0000","last_peered":"2024-09-21T07:28:46.885517+0000","last_clean":"2024-09-21T07:28:46.885517+0000","last_became_active":"2024-09-21T07:28:46.874980+0000","last_became_peered":"2024-09-21T07:28:46.874980+0000","last_unstale":"2024-09-21T07:28:46.885517+0000","last_undegraded":"2024-09-21T07:28:46.885517+0000","last_fullsized":"2024-09-21T07:28:46.885517+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.610529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:28:46.860677+0000","last_change":"2024-09-21T07:28:46.860677+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.860677+0000","last_undegraded":"2024-09-21T07:28:46.860677+0000","last_fullsized":"2024-09-21T07:28:46.860677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.893616+0000","last_change":"2024-09-21T07:28:46.885131+0000","last_active":"2024-09-21T07:28:46.893616+0000","last_peered":"2024-09-21T07:28:46.893616+0000","last_clean":"2024-09-21T07:28:46.893616+0000","last_became_active":"2024-09-21T07:28:46.884760+0000","last_became_peered":"2024-09-21T07:28:46.884760+0000","last_unstale":"2024-09-21T07:28:46.893616+0000","last_undegraded":"2024-09-21T07:28:46.893616+0000","last_fullsized":"2024-09-21T07:28:46.893616+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:27.496058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.880132+0000","last_change":"2024-09-21T07:28:46.880132+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.880132+0000","last_undegraded":"2024-09-21T07:28:46.880132+0000","last_fullsized":"2024-09-21T07:28:46.880132+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.889341+0000","last_change":"2024-09-21T07:28:46.887554+0000","last_active":"2024-09-21T07:28:46.889341+0000","last_peered":"2024-09-21T07:28:46.889341+0000","last_clean":"2024-09-21T07:28:46.889341+0000","last_became_active":"2024-09-21T07:28:46.887005+0000","last_became_peered":"2024-09-21T07:28:46.887005+0000","last_unstale":"2024-09-21T07:28:46.889341+0000","last_undegraded":"2024-09-21T07:28:46.889341+0000","last_fullsized":"2024-09-21T07:28:46.889341+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:45.571945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-21T07:28:46.878814+0000","last_change":"2024-09-21T07:28:46.878814+0000","last_active":"2024-09-21T07:28:46.860677+0000","last_peered":"2024-09-21T07:28:46.860677+0000","last_clean":"2024-09-21T07:28:46.860677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:28:46.878814+0000","last_undegraded":"2024-09-21T07:28:46.878814+0000","last_fullsized":"2024-09-21T07:28:46.878814+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-21T07:28:46.888765+0000","last_change":"2024-09-21T07:28:46.879025+0000","last_active":"2024-09-21T07:28:46.888765+0000","last_peered":"2024-09-21T07:28:46.888765+0000","last_clean":"2024-09-21T07:28:46.888765+0000","last_became_active":"2024-09-21T07:28:46.878672+0000","last_became_peered":"2024-09-21T07:28:46.878672+0000","last_unstale":"2024-09-21T07:28:46.888765+0000","last_undegraded":"2024-09-21T07:28:46.888765+0000","last_fullsized":"2024-09-21T07:28:46.888765+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-21T07:28:45.873742+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:45.873742+0000","last_peered":"2024-09-21T07:28:45.873742+0000","last_clean":"2024-09-21T07:28:45.873742+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:45.873742+0000","last_undegraded":"2024-09-21T07:28:45.873742+0000","last_fullsized":"2024-09-21T07:28:45.873742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1392640,"data_stored":650664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1404928,"data_stored":657331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41464,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330376,"statfs":{"total":96636764160,"available":96594305024,"internally_reserved":0,"allocated":1998848,"data_stored":1247699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37288,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334552,"statfs":{"total":96636764160,"available":96598581248,"internally_reserved":0,"allocated":1986560,"data_stored":1241032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1433600,"data_stored":671772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:52.944 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3f is not active+clean 2024-09-21T07:28:52.944 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.879119+0000', 'last_change': '2024-09-21T07:28:46.879119+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.879119+0000', 'last_undegraded': '2024-09-21T07:28:46.879119+0000', 'last_fullsized': '2024-09-21T07:28:46.879119+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3e is not active+clean 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874809+0000', 'last_change': '2024-09-21T07:28:46.874809+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874809+0000', 'last_undegraded': '2024-09-21T07:28:46.874809+0000', 'last_fullsized': '2024-09-21T07:28:46.874809+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3d is not active+clean 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.879050+0000', 'last_change': '2024-09-21T07:28:46.879050+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.879050+0000', 'last_undegraded': '2024-09-21T07:28:46.879050+0000', 'last_fullsized': '2024-09-21T07:28:46.879050+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3b is not active+clean 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.877313+0000', 'last_change': '2024-09-21T07:28:46.877313+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.877313+0000', 'last_undegraded': '2024-09-21T07:28:46.877313+0000', 'last_fullsized': '2024-09-21T07:28:46.877313+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3a is not active+clean 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874104+0000', 'last_change': '2024-09-21T07:28:46.874104+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874104+0000', 'last_undegraded': '2024-09-21T07:28:46.874104+0000', 'last_fullsized': '2024-09-21T07:28:46.874104+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.39 is not active+clean 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874587+0000', 'last_change': '2024-09-21T07:28:46.874587+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874587+0000', 'last_undegraded': '2024-09-21T07:28:46.874587+0000', 'last_fullsized': '2024-09-21T07:28:46.874587+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.945 INFO:tasks.ceph.ceph_manager.ceph:PG 16.38 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.873991+0000', 'last_change': '2024-09-21T07:28:46.873991+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.873991+0000', 'last_undegraded': '2024-09-21T07:28:46.873991+0000', 'last_fullsized': '2024-09-21T07:28:46.873991+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:PG 16.37 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874516+0000', 'last_change': '2024-09-21T07:28:46.874516+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874516+0000', 'last_undegraded': '2024-09-21T07:28:46.874516+0000', 'last_fullsized': '2024-09-21T07:28:46.874516+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:PG 16.36 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.877897+0000', 'last_change': '2024-09-21T07:28:46.877897+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.877897+0000', 'last_undegraded': '2024-09-21T07:28:46.877897+0000', 'last_fullsized': '2024-09-21T07:28:46.877897+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:PG 16.35 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.881822+0000', 'last_change': '2024-09-21T07:28:46.881822+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.881822+0000', 'last_undegraded': '2024-09-21T07:28:46.881822+0000', 'last_fullsized': '2024-09-21T07:28:46.881822+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:PG 16.34 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.869738+0000', 'last_change': '2024-09-21T07:28:46.869738+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.869738+0000', 'last_undegraded': '2024-09-21T07:28:46.869738+0000', 'last_fullsized': '2024-09-21T07:28:46.869738+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:PG 16.32 is not active+clean 2024-09-21T07:28:52.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:28:46.860677+0000', 'last_change': '2024-09-21T07:28:46.860677+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.860677+0000', 'last_undegraded': '2024-09-21T07:28:46.860677+0000', 'last_fullsized': '2024-09-21T07:28:46.860677+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.31 is not active+clean 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:28:46.860677+0000', 'last_change': '2024-09-21T07:28:46.860677+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.860677+0000', 'last_undegraded': '2024-09-21T07:28:46.860677+0000', 'last_fullsized': '2024-09-21T07:28:46.860677+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.30 is not active+clean 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:28:46.860677+0000', 'last_change': '2024-09-21T07:28:46.860677+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.860677+0000', 'last_undegraded': '2024-09-21T07:28:46.860677+0000', 'last_fullsized': '2024-09-21T07:28:46.860677+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2f is not active+clean 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.878612+0000', 'last_change': '2024-09-21T07:28:46.878612+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.878612+0000', 'last_undegraded': '2024-09-21T07:28:46.878612+0000', 'last_fullsized': '2024-09-21T07:28:46.878612+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2e is not active+clean 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874282+0000', 'last_change': '2024-09-21T07:28:46.874282+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874282+0000', 'last_undegraded': '2024-09-21T07:28:46.874282+0000', 'last_fullsized': '2024-09-21T07:28:46.874282+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2d is not active+clean 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.878548+0000', 'last_change': '2024-09-21T07:28:46.878548+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.878548+0000', 'last_undegraded': '2024-09-21T07:28:46.878548+0000', 'last_fullsized': '2024-09-21T07:28:46.878548+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.947 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2c is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.869179+0000', 'last_change': '2024-09-21T07:28:46.869179+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.869179+0000', 'last_undegraded': '2024-09-21T07:28:46.869179+0000', 'last_fullsized': '2024-09-21T07:28:46.869179+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2b is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.871104+0000', 'last_change': '2024-09-21T07:28:46.871104+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.871104+0000', 'last_undegraded': '2024-09-21T07:28:46.871104+0000', 'last_fullsized': '2024-09-21T07:28:46.871104+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2a is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.877208+0000', 'last_change': '2024-09-21T07:28:46.877208+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.877208+0000', 'last_undegraded': '2024-09-21T07:28:46.877208+0000', 'last_fullsized': '2024-09-21T07:28:46.877208+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.29 is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.876765+0000', 'last_change': '2024-09-21T07:28:46.876765+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.876765+0000', 'last_undegraded': '2024-09-21T07:28:46.876765+0000', 'last_fullsized': '2024-09-21T07:28:46.876765+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.28 is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.875828+0000', 'last_change': '2024-09-21T07:28:46.875828+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.875828+0000', 'last_undegraded': '2024-09-21T07:28:46.875828+0000', 'last_fullsized': '2024-09-21T07:28:46.875828+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.27 is not active+clean 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868465+0000', 'last_change': '2024-09-21T07:28:46.868465+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868465+0000', 'last_undegraded': '2024-09-21T07:28:46.868465+0000', 'last_fullsized': '2024-09-21T07:28:46.868465+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.948 INFO:tasks.ceph.ceph_manager.ceph:PG 16.26 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868171+0000', 'last_change': '2024-09-21T07:28:46.868171+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868171+0000', 'last_undegraded': '2024-09-21T07:28:46.868171+0000', 'last_fullsized': '2024-09-21T07:28:46.868171+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:PG 16.25 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.881330+0000', 'last_change': '2024-09-21T07:28:46.881330+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.881330+0000', 'last_undegraded': '2024-09-21T07:28:46.881330+0000', 'last_fullsized': '2024-09-21T07:28:46.881330+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:PG 16.24 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.873249+0000', 'last_change': '2024-09-21T07:28:46.873249+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.873249+0000', 'last_undegraded': '2024-09-21T07:28:46.873249+0000', 'last_fullsized': '2024-09-21T07:28:46.873249+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:PG 16.23 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.870533+0000', 'last_change': '2024-09-21T07:28:46.870533+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.870533+0000', 'last_undegraded': '2024-09-21T07:28:46.870533+0000', 'last_fullsized': '2024-09-21T07:28:46.870533+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:PG 16.22 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868688+0000', 'last_change': '2024-09-21T07:28:46.868688+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868688+0000', 'last_undegraded': '2024-09-21T07:28:46.868688+0000', 'last_fullsized': '2024-09-21T07:28:46.868688+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:PG 16.21 is not active+clean 2024-09-21T07:28:52.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.874034+0000', 'last_change': '2024-09-21T07:28:46.874034+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.874034+0000', 'last_undegraded': '2024-09-21T07:28:46.874034+0000', 'last_fullsized': '2024-09-21T07:28:46.874034+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 16.20 is not active+clean 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.871299+0000', 'last_change': '2024-09-21T07:28:46.871299+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.871299+0000', 'last_undegraded': '2024-09-21T07:28:46.871299+0000', 'last_fullsized': '2024-09-21T07:28:46.871299+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.877107+0000', 'last_change': '2024-09-21T07:28:46.877107+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.877107+0000', 'last_undegraded': '2024-09-21T07:28:46.877107+0000', 'last_fullsized': '2024-09-21T07:28:46.877107+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1 is not active+clean 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868252+0000', 'last_change': '2024-09-21T07:28:46.868252+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868252+0000', 'last_undegraded': '2024-09-21T07:28:46.868252+0000', 'last_fullsized': '2024-09-21T07:28:46.868252+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2 is not active+clean 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868002+0000', 'last_change': '2024-09-21T07:28:46.868002+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868002+0000', 'last_undegraded': '2024-09-21T07:28:46.868002+0000', 'last_fullsized': '2024-09-21T07:28:46.868002+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.880384+0000', 'last_change': '2024-09-21T07:28:46.880384+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.880384+0000', 'last_undegraded': '2024-09-21T07:28:46.880384+0000', 'last_fullsized': '2024-09-21T07:28:46.880384+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.950 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:45.869111+0000', 'last_change': '2024-09-21T07:28:45.869111+0000', 'last_active': '2024-09-21T07:28:45.849509+0000', 'last_peered': '2024-09-21T07:28:45.849509+0000', 'last_clean': '2024-09-21T07:28:45.849509+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:45.869111+0000', 'last_undegraded': '2024-09-21T07:28:45.869111+0000', 'last_fullsized': '2024-09-21T07:28:45.869111+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.877586+0000', 'last_change': '2024-09-21T07:28:46.877586+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.877586+0000', 'last_undegraded': '2024-09-21T07:28:46.877586+0000', 'last_fullsized': '2024-09-21T07:28:46.877586+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.873375+0000', 'last_change': '2024-09-21T07:28:46.873375+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.873375+0000', 'last_undegraded': '2024-09-21T07:28:46.873375+0000', 'last_fullsized': '2024-09-21T07:28:46.873375+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.879119+0000', 'last_change': '2024-09-21T07:28:46.879119+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.879119+0000', 'last_undegraded': '2024-09-21T07:28:46.879119+0000', 'last_fullsized': '2024-09-21T07:28:46.879119+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:PG 16.9 is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.875961+0000', 'last_change': '2024-09-21T07:28:46.875961+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.875961+0000', 'last_undegraded': '2024-09-21T07:28:46.875961+0000', 'last_fullsized': '2024-09-21T07:28:46.875961+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:PG 16.a is not active+clean 2024-09-21T07:28:52.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868098+0000', 'last_change': '2024-09-21T07:28:46.868098+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868098+0000', 'last_undegraded': '2024-09-21T07:28:46.868098+0000', 'last_fullsized': '2024-09-21T07:28:46.868098+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:45.873407+0000', 'last_change': '2024-09-21T07:28:45.873407+0000', 'last_active': '2024-09-21T07:28:45.849509+0000', 'last_peered': '2024-09-21T07:28:45.849509+0000', 'last_clean': '2024-09-21T07:28:45.849509+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:45.873407+0000', 'last_undegraded': '2024-09-21T07:28:45.873407+0000', 'last_fullsized': '2024-09-21T07:28:45.873407+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:PG 16.b is not active+clean 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.876302+0000', 'last_change': '2024-09-21T07:28:46.876302+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.876302+0000', 'last_undegraded': '2024-09-21T07:28:46.876302+0000', 'last_fullsized': '2024-09-21T07:28:46.876302+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.879079+0000', 'last_change': '2024-09-21T07:28:46.879079+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.879079+0000', 'last_undegraded': '2024-09-21T07:28:46.879079+0000', 'last_fullsized': '2024-09-21T07:28:46.879079+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.872943+0000', 'last_change': '2024-09-21T07:28:46.872943+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.872943+0000', 'last_undegraded': '2024-09-21T07:28:46.872943+0000', 'last_fullsized': '2024-09-21T07:28:46.872943+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.952 INFO:tasks.ceph.ceph_manager.ceph:PG 16.e is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.869676+0000', 'last_change': '2024-09-21T07:28:46.869676+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.869676+0000', 'last_undegraded': '2024-09-21T07:28:46.869676+0000', 'last_fullsized': '2024-09-21T07:28:46.869676+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.878143+0000', 'last_change': '2024-09-21T07:28:46.878143+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.878143+0000', 'last_undegraded': '2024-09-21T07:28:46.878143+0000', 'last_fullsized': '2024-09-21T07:28:46.878143+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:PG 16.10 is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868507+0000', 'last_change': '2024-09-21T07:28:46.868507+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868507+0000', 'last_undegraded': '2024-09-21T07:28:46.868507+0000', 'last_fullsized': '2024-09-21T07:28:46.868507+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.872803+0000', 'last_change': '2024-09-21T07:28:46.872803+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.872803+0000', 'last_undegraded': '2024-09-21T07:28:46.872803+0000', 'last_fullsized': '2024-09-21T07:28:46.872803+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:45.872865+0000', 'last_change': '2024-09-21T07:28:45.872865+0000', 'last_active': '2024-09-21T07:28:45.849509+0000', 'last_peered': '2024-09-21T07:28:45.849509+0000', 'last_clean': '2024-09-21T07:28:45.849509+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:45.872865+0000', 'last_undegraded': '2024-09-21T07:28:45.872865+0000', 'last_fullsized': '2024-09-21T07:28:45.872865+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:45.849509+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:PG 16.13 is not active+clean 2024-09-21T07:28:52.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.876827+0000', 'last_change': '2024-09-21T07:28:46.876827+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.876827+0000', 'last_undegraded': '2024-09-21T07:28:46.876827+0000', 'last_fullsized': '2024-09-21T07:28:46.876827+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.879472+0000', 'last_change': '2024-09-21T07:28:46.879472+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.879472+0000', 'last_undegraded': '2024-09-21T07:28:46.879472+0000', 'last_fullsized': '2024-09-21T07:28:46.879472+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.878041+0000', 'last_change': '2024-09-21T07:28:46.878041+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.878041+0000', 'last_undegraded': '2024-09-21T07:28:46.878041+0000', 'last_fullsized': '2024-09-21T07:28:46.878041+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:PG 16.17 is not active+clean 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.870223+0000', 'last_change': '2024-09-21T07:28:46.870223+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.870223+0000', 'last_undegraded': '2024-09-21T07:28:46.870223+0000', 'last_fullsized': '2024-09-21T07:28:46.870223+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.880445+0000', 'last_change': '2024-09-21T07:28:46.880445+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.880445+0000', 'last_undegraded': '2024-09-21T07:28:46.880445+0000', 'last_fullsized': '2024-09-21T07:28:46.880445+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:PG 16.19 is not active+clean 2024-09-21T07:28:52.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.868365+0000', 'last_change': '2024-09-21T07:28:46.868365+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.868365+0000', 'last_undegraded': '2024-09-21T07:28:46.868365+0000', 'last_fullsized': '2024-09-21T07:28:46.868365+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.880898+0000', 'last_change': '2024-09-21T07:28:46.880898+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.880898+0000', 'last_undegraded': '2024-09-21T07:28:46.880898+0000', 'last_fullsized': '2024-09-21T07:28:46.880898+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1c is not active+clean 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.869793+0000', 'last_change': '2024-09-21T07:28:46.869793+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.869793+0000', 'last_undegraded': '2024-09-21T07:28:46.869793+0000', 'last_fullsized': '2024-09-21T07:28:46.869793+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1d is not active+clean 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.869758+0000', 'last_change': '2024-09-21T07:28:46.869758+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.869758+0000', 'last_undegraded': '2024-09-21T07:28:46.869758+0000', 'last_fullsized': '2024-09-21T07:28:46.869758+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:28:46.860677+0000', 'last_change': '2024-09-21T07:28:46.860677+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.860677+0000', 'last_undegraded': '2024-09-21T07:28:46.860677+0000', 'last_fullsized': '2024-09-21T07:28:46.860677+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.880132+0000', 'last_change': '2024-09-21T07:28:46.880132+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.880132+0000', 'last_undegraded': '2024-09-21T07:28:46.880132+0000', 'last_fullsized': '2024-09-21T07:28:46.880132+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.955 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-09-21T07:28:52.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:28:46.878814+0000', 'last_change': '2024-09-21T07:28:46.878814+0000', 'last_active': '2024-09-21T07:28:46.860677+0000', 'last_peered': '2024-09-21T07:28:46.860677+0000', 'last_clean': '2024-09-21T07:28:46.860677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:28:46.878814+0000', 'last_undegraded': '2024-09-21T07:28:46.878814+0000', 'last_fullsized': '2024-09-21T07:28:46.878814+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'last_clean_scrub_stamp': '2024-09-21T07:28:46.860677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:28:52.956 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:28:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 -- 172.21.15.64:0/2809459828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840709b0 msgr2=0x7f82840b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 --2- 172.21.15.64:0/2809459828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840709b0 0x7f82840b41c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f826c009840 tx=0x7f826c01c740 comp rx=0 tx=0).stop 2024-09-21T07:28:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 -- 172.21.15.64:0/2809459828 shutdown_connections 2024-09-21T07:28:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 --2- 172.21.15.64:0/2809459828 >> v2:172.21.15.90:3300/0 conn(0x7f82840b4700 0x7f8284072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 --2- 172.21.15.64:0/2809459828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840709b0 0x7f82840b41c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 -- 172.21.15.64:0/2809459828 >> 172.21.15.64:0/2809459828 conn(0x7f82840ccbe0 msgr2=0x7f82840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 -- 172.21.15.64:0/2809459828 shutdown_connections 2024-09-21T07:28:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.139+0000 7f828bc00640 1 -- 172.21.15.64:0/2809459828 wait complete. 2024-09-21T07:28:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 Processor -- start 2024-09-21T07:28:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- start start 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 0x7f82840c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840b4700 0x7f82841f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8284168bb0 con 0x7f828415edb0 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8284168a30 con 0x7f82840709b0 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8284168d30 con 0x7f82840b4700 2024-09-21T07:28:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55510/0 (socket says 172.21.15.64:55510) 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 -- 172.21.15.64:0/2664394515 learned_addr learned my addr 172.21.15.64:0/2664394515 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f827be00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840b4700 0x7f82841f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289200640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 0x7f82840c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 -- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840b4700 msgr2=0x7f82841f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840b4700 0x7f82841f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 -- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 msgr2=0x7f82840c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 0x7f82840c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 -- 172.21.15.64:0/2664394515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82840ca0e0 con 0x7f828415edb0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289200640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 0x7f82840c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8289c00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f827c00ec30 tx=0x7f827c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c003b80 con 0x7f828415edb0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f827c003e10 con 0x7f828415edb0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841f6980 con 0x7f828415edb0 2024-09-21T07:28:53.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c004280 con 0x7f828415edb0 2024-09-21T07:28:53.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.143+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82840c9e00 con 0x7f828415edb0 2024-09-21T07:28:53.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82840c9890 con 0x7f828415edb0 2024-09-21T07:28:53.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f827c004420 con 0x7f828415edb0 2024-09-21T07:28:53.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f8281600640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 0x7f8260075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f827c095230 con 0x7f828415edb0 2024-09-21T07:28:53.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f8289200640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 0x7f8260075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.147+0000 7f8289200640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 0x7f8260075740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8274007970 tx=0x7f8274009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:53.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.151+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f827c060020 con 0x7f828415edb0 2024-09-21T07:28:53.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.391+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f82840b41c0 con 0x7f828415edb0 2024-09-21T07:28:53.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.391+0000 7f8281600640 1 -- 172.21.15.64:0/2664394515 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1378 (secure 0 0 0) 0x7f827c05f920 con 0x7f828415edb0 2024-09-21T07:28:53.393 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:53.394 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":391,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":116,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":36},{"state_name":"unknown","count":4}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590950,"bytes_used":323330048,"bytes_avail":772770783232,"bytes_total":773094113280,"unknown_pgs_ratio":0.041237112134695053,"inactive_pgs_ratio":0.58762884140014648,"write_bytes_sec":180,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":84,"btime":"2024-09-21T07:28:50:907861+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7707}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-21T07:28:19.511144+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:28:53.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 msgr2=0x7f8260075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 0x7f8260075740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8274007970 tx=0x7f8274009040 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 msgr2=0x7f82840c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f827c00ec30 tx=0x7f827c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 shutdown_connections 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8260073230 0x7f8260075740 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f828415edb0 0x7f82840c7750 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82840b4700 0x7f82841f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 --2- 172.21.15.64:0/2664394515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82840709b0 0x7f82840c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 >> 172.21.15.64:0/2664394515 conn(0x7f82840ccbe0 msgr2=0x7f8284068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 shutdown_connections 2024-09-21T07:28:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.395+0000 7f828bc00640 1 -- 172.21.15.64:0/2664394515 wait complete. 2024-09-21T07:28:53.415 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:28:53.415 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:53.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 -- 172.21.15.64:0/3798313831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae00b3ec0 msgr2=0x7f8ae00cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3798313831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae00cdc30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009c80 tx=0x7f8ad801cda0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 -- 172.21.15.64:0/3798313831 shutdown_connections 2024-09-21T07:28:53.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3798313831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae00cdc30 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3798313831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae006d500 0x7f8ae0074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 -- 172.21.15.64:0/3798313831 >> 172.21.15.64:0/3798313831 conn(0x7f8ae00b2b80 msgr2=0x7f8ae00b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:53.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 -- 172.21.15.64:0/3798313831 shutdown_connections 2024-09-21T07:28:53.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.571+0000 7f8ae7000640 1 -- 172.21.15.64:0/3798313831 wait complete. 2024-09-21T07:28:53.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 Processor -- start 2024-09-21T07:28:53.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 -- start start 2024-09-21T07:28:53.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae0150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae015c3c0 0x7f8ae01fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0169aa0 con 0x7f8ae01539e0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0169920 con 0x7f8ae00b3ec0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae7000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae0169c20 con 0x7f8ae015c3c0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55524/0 (socket says 172.21.15.64:55524) 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 -- 172.21.15.64:0/3300626656 learned_addr learned my addr 172.21.15.64:0/3300626656 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae5c00640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae0150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae5200640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae015c3c0 0x7f8ae01fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 -- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae015c3c0 msgr2=0x7f8ae01fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae015c3c0 0x7f8ae01fc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 -- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae00b3ec0 msgr2=0x7f8ae0150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae0150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.575+0000 7f8ae6600640 1 -- 172.21.15.64:0/3300626656 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae00b6600 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8ae6600640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8ad801b450 tx=0x7f8ad8009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80bb070 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ad8004c50 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80b2040 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae00b68e0 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae00c4f90 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae0074690 con 0x7f8ae01539e0 2024-09-21T07:28:53.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8ad8004260 con 0x7f8ae01539e0 2024-09-21T07:28:53.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 0x7f8ac0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:53.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.579+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f8ad812df00 con 0x7f8ae01539e0 2024-09-21T07:28:53.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.583+0000 7f8ae5c00640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 0x7f8ac0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:53.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.583+0000 7f8ae5c00640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 0x7f8ac0075710 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4007fd0 tx=0x7f8ad4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:53.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.583+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8ad80f2290 con 0x7f8ae01539e0 2024-09-21T07:28:53.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.759+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ae00b32d0 con 0x7f8ac0073200 2024-09-21T07:28:53.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8add600640 1 -- 172.21.15.64:0/3300626656 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252475 (secure 0 0 0) 0x7f8ae00b32d0 con 0x7f8ac0073200 2024-09-21T07:28:53.769 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:53.770 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 msgr2=0x7f8ac0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 0x7f8ac0075710 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4007fd0 tx=0x7f8ad4009040 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 msgr2=0x7f8ae00ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8ad801b450 tx=0x7f8ad8009350 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 shutdown_connections 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ac0073200 0x7f8ac0075710 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ae01539e0 0x7f8ae00ae8c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ae015c3c0 0x7f8ae01fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 --2- 172.21.15.64:0/3300626656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae00b3ec0 0x7f8ae0150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 >> 172.21.15.64:0/3300626656 conn(0x7f8ae00b2b80 msgr2=0x7f8ae00b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 shutdown_connections 2024-09-21T07:28:53.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:53.767+0000 7f8ae7000640 1 -- 172.21.15.64:0/3300626656 wait complete. 2024-09-21T07:28:53.791 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T07:28:53.520255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315988,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658732,"statfs":{"total":773094113280,"available":772770541568,"internally_reserved":0,"allocated":12689408,"data_stored":6555076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":310693427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.654968"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910891+0000","last_change":"2024-09-21T07:28:47.909024+0000","last_active":"2024-09-21T07:28:48.910891+0000","last_peered":"2024-09-21T07:28:48.910891+0000","last_clean":"2024-09-21T07:28:48.910891+0000","last_became_active":"2024-09-21T07:28:47.908719+0000","last_became_peered":"2024-09-21T07:28:47.908719+0000","last_unstale":"2024-09-21T07:28:48.910891+0000","last_undegraded":"2024-09-21T07:28:48.910891+0000","last_fullsized":"2024-09-21T07:28:48.910891+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:20.953968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909341+0000","last_change":"2024-09-21T07:28:47.912734+0000","last_active":"2024-09-21T07:28:48.909341+0000","last_peered":"2024-09-21T07:28:48.909341+0000","last_clean":"2024-09-21T07:28:48.909341+0000","last_became_active":"2024-09-21T07:28:47.912401+0000","last_became_peered":"2024-09-21T07:28:47.912401+0000","last_unstale":"2024-09-21T07:28:48.909341+0000","last_undegraded":"2024-09-21T07:28:48.909341+0000","last_fullsized":"2024-09-21T07:28:48.909341+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.431983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910779+0000","last_change":"2024-09-21T07:28:47.919353+0000","last_active":"2024-09-21T07:28:48.910779+0000","last_peered":"2024-09-21T07:28:48.910779+0000","last_clean":"2024-09-21T07:28:48.910779+0000","last_became_active":"2024-09-21T07:28:47.919022+0000","last_became_peered":"2024-09-21T07:28:47.919022+0000","last_unstale":"2024-09-21T07:28:48.910779+0000","last_undegraded":"2024-09-21T07:28:48.910779+0000","last_fullsized":"2024-09-21T07:28:48.910779+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:56.752564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903709+0000","last_change":"2024-09-21T07:28:47.905037+0000","last_active":"2024-09-21T07:28:48.903709+0000","last_peered":"2024-09-21T07:28:48.903709+0000","last_clean":"2024-09-21T07:28:48.903709+0000","last_became_active":"2024-09-21T07:28:47.904433+0000","last_became_peered":"2024-09-21T07:28:47.904433+0000","last_unstale":"2024-09-21T07:28:48.903709+0000","last_undegraded":"2024-09-21T07:28:48.903709+0000","last_fullsized":"2024-09-21T07:28:48.903709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:55.177373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779715+0000","last_change":"2024-09-21T07:28:47.915825+0000","last_active":"2024-09-21T07:28:49.779715+0000","last_peered":"2024-09-21T07:28:49.779715+0000","last_clean":"2024-09-21T07:28:49.779715+0000","last_became_active":"2024-09-21T07:28:47.915509+0000","last_became_peered":"2024-09-21T07:28:47.915509+0000","last_unstale":"2024-09-21T07:28:49.779715+0000","last_undegraded":"2024-09-21T07:28:49.779715+0000","last_fullsized":"2024-09-21T07:28:49.779715+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:06.044469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907796+0000","last_change":"2024-09-21T07:28:47.919774+0000","last_active":"2024-09-21T07:28:48.907796+0000","last_peered":"2024-09-21T07:28:48.907796+0000","last_clean":"2024-09-21T07:28:48.907796+0000","last_became_active":"2024-09-21T07:28:47.918674+0000","last_became_peered":"2024-09-21T07:28:47.918674+0000","last_unstale":"2024-09-21T07:28:48.907796+0000","last_undegraded":"2024-09-21T07:28:48.907796+0000","last_fullsized":"2024-09-21T07:28:48.907796+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.255068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907645+0000","last_change":"2024-09-21T07:28:47.919808+0000","last_active":"2024-09-21T07:28:48.907645+0000","last_peered":"2024-09-21T07:28:48.907645+0000","last_clean":"2024-09-21T07:28:48.907645+0000","last_became_active":"2024-09-21T07:28:47.919278+0000","last_became_peered":"2024-09-21T07:28:47.919278+0000","last_unstale":"2024-09-21T07:28:48.907645+0000","last_undegraded":"2024-09-21T07:28:48.907645+0000","last_fullsized":"2024-09-21T07:28:48.907645+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:42.139423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780189+0000","last_change":"2024-09-21T07:28:47.905407+0000","last_active":"2024-09-21T07:28:49.780189+0000","last_peered":"2024-09-21T07:28:49.780189+0000","last_clean":"2024-09-21T07:28:49.780189+0000","last_became_active":"2024-09-21T07:28:47.904814+0000","last_became_peered":"2024-09-21T07:28:47.904814+0000","last_unstale":"2024-09-21T07:28:49.780189+0000","last_undegraded":"2024-09-21T07:28:49.780189+0000","last_fullsized":"2024-09-21T07:28:49.780189+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:00.299384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909529+0000","last_change":"2024-09-21T07:28:47.903457+0000","last_active":"2024-09-21T07:28:48.909529+0000","last_peered":"2024-09-21T07:28:48.909529+0000","last_clean":"2024-09-21T07:28:48.909529+0000","last_became_active":"2024-09-21T07:28:47.903111+0000","last_became_peered":"2024-09-21T07:28:47.903111+0000","last_unstale":"2024-09-21T07:28:48.909529+0000","last_undegraded":"2024-09-21T07:28:48.909529+0000","last_fullsized":"2024-09-21T07:28:48.909529+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:40.057588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780472+0000","last_change":"2024-09-21T07:28:47.919654+0000","last_active":"2024-09-21T07:28:49.780472+0000","last_peered":"2024-09-21T07:28:49.780472+0000","last_clean":"2024-09-21T07:28:49.780472+0000","last_became_active":"2024-09-21T07:28:47.919364+0000","last_became_peered":"2024-09-21T07:28:47.919364+0000","last_unstale":"2024-09-21T07:28:49.780472+0000","last_undegraded":"2024-09-21T07:28:49.780472+0000","last_fullsized":"2024-09-21T07:28:49.780472+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:04.803659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909169+0000","last_change":"2024-09-21T07:28:47.915358+0000","last_active":"2024-09-21T07:28:48.909169+0000","last_peered":"2024-09-21T07:28:48.909169+0000","last_clean":"2024-09-21T07:28:48.909169+0000","last_became_active":"2024-09-21T07:28:47.914541+0000","last_became_peered":"2024-09-21T07:28:47.914541+0000","last_unstale":"2024-09-21T07:28:48.909169+0000","last_undegraded":"2024-09-21T07:28:48.909169+0000","last_fullsized":"2024-09-21T07:28:48.909169+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:56.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780809+0000","last_change":"2024-09-21T07:28:47.902705+0000","last_active":"2024-09-21T07:28:49.780809+0000","last_peered":"2024-09-21T07:28:49.780809+0000","last_clean":"2024-09-21T07:28:49.780809+0000","last_became_active":"2024-09-21T07:28:47.902343+0000","last_became_peered":"2024-09-21T07:28:47.902343+0000","last_unstale":"2024-09-21T07:28:49.780809+0000","last_undegraded":"2024-09-21T07:28:49.780809+0000","last_fullsized":"2024-09-21T07:28:49.780809+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:04.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903544+0000","last_change":"2024-09-21T07:28:47.912349+0000","last_active":"2024-09-21T07:28:48.903544+0000","last_peered":"2024-09-21T07:28:48.903544+0000","last_clean":"2024-09-21T07:28:48.903544+0000","last_became_active":"2024-09-21T07:28:47.911807+0000","last_became_peered":"2024-09-21T07:28:47.911807+0000","last_unstale":"2024-09-21T07:28:48.903544+0000","last_undegraded":"2024-09-21T07:28:48.903544+0000","last_fullsized":"2024-09-21T07:28:48.903544+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780428+0000","last_change":"2024-09-21T07:28:47.906004+0000","last_active":"2024-09-21T07:28:49.780428+0000","last_peered":"2024-09-21T07:28:49.780428+0000","last_clean":"2024-09-21T07:28:49.780428+0000","last_became_active":"2024-09-21T07:28:47.905704+0000","last_became_peered":"2024-09-21T07:28:47.905704+0000","last_unstale":"2024-09-21T07:28:49.780428+0000","last_undegraded":"2024-09-21T07:28:49.780428+0000","last_fullsized":"2024-09-21T07:28:49.780428+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:04.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780190+0000","last_change":"2024-09-21T07:28:47.910497+0000","last_active":"2024-09-21T07:28:49.780190+0000","last_peered":"2024-09-21T07:28:49.780190+0000","last_clean":"2024-09-21T07:28:49.780190+0000","last_became_active":"2024-09-21T07:28:47.910194+0000","last_became_peered":"2024-09-21T07:28:47.910194+0000","last_unstale":"2024-09-21T07:28:49.780190+0000","last_undegraded":"2024-09-21T07:28:49.780190+0000","last_fullsized":"2024-09-21T07:28:49.780190+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:43.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780043+0000","last_change":"2024-09-21T07:28:47.904387+0000","last_active":"2024-09-21T07:28:49.780043+0000","last_peered":"2024-09-21T07:28:49.780043+0000","last_clean":"2024-09-21T07:28:49.780043+0000","last_became_active":"2024-09-21T07:28:47.903399+0000","last_became_peered":"2024-09-21T07:28:47.903399+0000","last_unstale":"2024-09-21T07:28:49.780043+0000","last_undegraded":"2024-09-21T07:28:49.780043+0000","last_fullsized":"2024-09-21T07:28:49.780043+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:44.790412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910988+0000","last_change":"2024-09-21T07:28:47.921645+0000","last_active":"2024-09-21T07:28:48.910988+0000","last_peered":"2024-09-21T07:28:48.910988+0000","last_clean":"2024-09-21T07:28:48.910988+0000","last_became_active":"2024-09-21T07:28:47.921029+0000","last_became_peered":"2024-09-21T07:28:47.921029+0000","last_unstale":"2024-09-21T07:28:48.910988+0000","last_undegraded":"2024-09-21T07:28:48.910988+0000","last_fullsized":"2024-09-21T07:28:48.910988+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:08.243397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909406+0000","last_change":"2024-09-21T07:28:47.919133+0000","last_active":"2024-09-21T07:28:48.909406+0000","last_peered":"2024-09-21T07:28:48.909406+0000","last_clean":"2024-09-21T07:28:48.909406+0000","last_became_active":"2024-09-21T07:28:47.918731+0000","last_became_peered":"2024-09-21T07:28:47.918731+0000","last_unstale":"2024-09-21T07:28:48.909406+0000","last_undegraded":"2024-09-21T07:28:48.909406+0000","last_fullsized":"2024-09-21T07:28:48.909406+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:19.328280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910768+0000","last_change":"2024-09-21T07:28:47.908196+0000","last_active":"2024-09-21T07:28:48.910768+0000","last_peered":"2024-09-21T07:28:48.910768+0000","last_clean":"2024-09-21T07:28:48.910768+0000","last_became_active":"2024-09-21T07:28:47.907827+0000","last_became_peered":"2024-09-21T07:28:47.907827+0000","last_unstale":"2024-09-21T07:28:48.910768+0000","last_undegraded":"2024-09-21T07:28:48.910768+0000","last_fullsized":"2024-09-21T07:28:48.910768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:10.112945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780913+0000","last_change":"2024-09-21T07:28:47.899779+0000","last_active":"2024-09-21T07:28:49.780913+0000","last_peered":"2024-09-21T07:28:49.780913+0000","last_clean":"2024-09-21T07:28:49.780913+0000","last_became_active":"2024-09-21T07:28:47.899402+0000","last_became_peered":"2024-09-21T07:28:47.899402+0000","last_unstale":"2024-09-21T07:28:49.780913+0000","last_undegraded":"2024-09-21T07:28:49.780913+0000","last_fullsized":"2024-09-21T07:28:49.780913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:19.670326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780550+0000","last_change":"2024-09-21T07:28:47.912682+0000","last_active":"2024-09-21T07:28:49.780550+0000","last_peered":"2024-09-21T07:28:49.780550+0000","last_clean":"2024-09-21T07:28:49.780550+0000","last_became_active":"2024-09-21T07:28:47.912412+0000","last_became_peered":"2024-09-21T07:28:47.912412+0000","last_unstale":"2024-09-21T07:28:49.780550+0000","last_undegraded":"2024-09-21T07:28:49.780550+0000","last_fullsized":"2024-09-21T07:28:49.780550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:19.749502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780555+0000","last_change":"2024-09-21T07:28:47.918827+0000","last_active":"2024-09-21T07:28:49.780555+0000","last_peered":"2024-09-21T07:28:49.780555+0000","last_clean":"2024-09-21T07:28:49.780555+0000","last_became_active":"2024-09-21T07:28:47.918452+0000","last_became_peered":"2024-09-21T07:28:47.918452+0000","last_unstale":"2024-09-21T07:28:49.780555+0000","last_undegraded":"2024-09-21T07:28:49.780555+0000","last_fullsized":"2024-09-21T07:28:49.780555+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:59.435533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910354+0000","last_change":"2024-09-21T07:28:47.928895+0000","last_active":"2024-09-21T07:28:48.910354+0000","last_peered":"2024-09-21T07:28:48.910354+0000","last_clean":"2024-09-21T07:28:48.910354+0000","last_became_active":"2024-09-21T07:28:47.923800+0000","last_became_peered":"2024-09-21T07:28:47.923800+0000","last_unstale":"2024-09-21T07:28:48.910354+0000","last_undegraded":"2024-09-21T07:28:48.910354+0000","last_fullsized":"2024-09-21T07:28:48.910354+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:42.155252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779453+0000","last_change":"2024-09-21T07:28:47.926237+0000","last_active":"2024-09-21T07:28:49.779453+0000","last_peered":"2024-09-21T07:28:49.779453+0000","last_clean":"2024-09-21T07:28:49.779453+0000","last_became_active":"2024-09-21T07:28:47.924576+0000","last_became_peered":"2024-09-21T07:28:47.924576+0000","last_unstale":"2024-09-21T07:28:49.779453+0000","last_undegraded":"2024-09-21T07:28:49.779453+0000","last_fullsized":"2024-09-21T07:28:49.779453+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:57.554632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781129+0000","last_change":"2024-09-21T07:28:47.911536+0000","last_active":"2024-09-21T07:28:49.781129+0000","last_peered":"2024-09-21T07:28:49.781129+0000","last_clean":"2024-09-21T07:28:49.781129+0000","last_became_active":"2024-09-21T07:28:47.911187+0000","last_became_peered":"2024-09-21T07:28:47.911187+0000","last_unstale":"2024-09-21T07:28:49.781129+0000","last_undegraded":"2024-09-21T07:28:49.781129+0000","last_fullsized":"2024-09-21T07:28:49.781129+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.431983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781055+0000","last_change":"2024-09-21T07:28:47.906411+0000","last_active":"2024-09-21T07:28:49.781055+0000","last_peered":"2024-09-21T07:28:49.781055+0000","last_clean":"2024-09-21T07:28:49.781055+0000","last_became_active":"2024-09-21T07:28:47.906067+0000","last_became_peered":"2024-09-21T07:28:47.906067+0000","last_unstale":"2024-09-21T07:28:49.781055+0000","last_undegraded":"2024-09-21T07:28:49.781055+0000","last_fullsized":"2024-09-21T07:28:49.781055+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:32.680868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909140+0000","last_change":"2024-09-21T07:28:47.915624+0000","last_active":"2024-09-21T07:28:48.909140+0000","last_peered":"2024-09-21T07:28:48.909140+0000","last_clean":"2024-09-21T07:28:48.909140+0000","last_became_active":"2024-09-21T07:28:47.915009+0000","last_became_peered":"2024-09-21T07:28:47.915009+0000","last_unstale":"2024-09-21T07:28:48.909140+0000","last_undegraded":"2024-09-21T07:28:48.909140+0000","last_fullsized":"2024-09-21T07:28:48.909140+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:12.286376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909148+0000","last_change":"2024-09-21T07:28:47.913354+0000","last_active":"2024-09-21T07:28:48.909148+0000","last_peered":"2024-09-21T07:28:48.909148+0000","last_clean":"2024-09-21T07:28:48.909148+0000","last_became_active":"2024-09-21T07:28:47.909474+0000","last_became_peered":"2024-09-21T07:28:47.909474+0000","last_unstale":"2024-09-21T07:28:48.909148+0000","last_undegraded":"2024-09-21T07:28:48.909148+0000","last_fullsized":"2024-09-21T07:28:48.909148+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:32.680868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780653+0000","last_change":"2024-09-21T07:28:47.900617+0000","last_active":"2024-09-21T07:28:49.780653+0000","last_peered":"2024-09-21T07:28:49.780653+0000","last_clean":"2024-09-21T07:28:49.780653+0000","last_became_active":"2024-09-21T07:28:47.900247+0000","last_became_peered":"2024-09-21T07:28:47.900247+0000","last_unstale":"2024-09-21T07:28:49.780653+0000","last_undegraded":"2024-09-21T07:28:49.780653+0000","last_fullsized":"2024-09-21T07:28:49.780653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:46.912649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780478+0000","last_change":"2024-09-21T07:28:47.910233+0000","last_active":"2024-09-21T07:28:49.780478+0000","last_peered":"2024-09-21T07:28:49.780478+0000","last_clean":"2024-09-21T07:28:49.780478+0000","last_became_active":"2024-09-21T07:28:47.909944+0000","last_became_peered":"2024-09-21T07:28:47.909944+0000","last_unstale":"2024-09-21T07:28:49.780478+0000","last_undegraded":"2024-09-21T07:28:49.780478+0000","last_fullsized":"2024-09-21T07:28:49.780478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.255068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907892+0000","last_change":"2024-09-21T07:28:47.908638+0000","last_active":"2024-09-21T07:28:48.907892+0000","last_peered":"2024-09-21T07:28:48.907892+0000","last_clean":"2024-09-21T07:28:48.907892+0000","last_became_active":"2024-09-21T07:28:47.908022+0000","last_became_peered":"2024-09-21T07:28:47.908022+0000","last_unstale":"2024-09-21T07:28:48.907892+0000","last_undegraded":"2024-09-21T07:28:48.907892+0000","last_fullsized":"2024-09-21T07:28:48.907892+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:39.286347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780461+0000","last_change":"2024-09-21T07:28:47.905122+0000","last_active":"2024-09-21T07:28:49.780461+0000","last_peered":"2024-09-21T07:28:49.780461+0000","last_clean":"2024-09-21T07:28:49.780461+0000","last_became_active":"2024-09-21T07:28:47.904400+0000","last_became_peered":"2024-09-21T07:28:47.904400+0000","last_unstale":"2024-09-21T07:28:49.780461+0000","last_undegraded":"2024-09-21T07:28:49.780461+0000","last_fullsized":"2024-09-21T07:28:49.780461+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.125120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910480+0000","last_change":"2024-09-21T07:28:47.910292+0000","last_active":"2024-09-21T07:28:48.910480+0000","last_peered":"2024-09-21T07:28:48.910480+0000","last_clean":"2024-09-21T07:28:48.910480+0000","last_became_active":"2024-09-21T07:28:47.908775+0000","last_became_peered":"2024-09-21T07:28:47.908775+0000","last_unstale":"2024-09-21T07:28:48.910480+0000","last_undegraded":"2024-09-21T07:28:48.910480+0000","last_fullsized":"2024-09-21T07:28:48.910480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:40.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904038+0000","last_change":"2024-09-21T07:28:46.888058+0000","last_active":"2024-09-21T07:28:48.904038+0000","last_peered":"2024-09-21T07:28:48.904038+0000","last_clean":"2024-09-21T07:28:48.904038+0000","last_became_active":"2024-09-21T07:28:46.887743+0000","last_became_peered":"2024-09-21T07:28:46.887743+0000","last_unstale":"2024-09-21T07:28:48.904038+0000","last_undegraded":"2024-09-21T07:28:48.904038+0000","last_fullsized":"2024-09-21T07:28:48.904038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:05.668245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779777+0000","last_change":"2024-09-21T07:28:47.907373+0000","last_active":"2024-09-21T07:28:49.779777+0000","last_peered":"2024-09-21T07:28:49.779777+0000","last_clean":"2024-09-21T07:28:49.779777+0000","last_became_active":"2024-09-21T07:28:47.907055+0000","last_became_peered":"2024-09-21T07:28:47.907055+0000","last_unstale":"2024-09-21T07:28:49.779777+0000","last_undegraded":"2024-09-21T07:28:49.779777+0000","last_fullsized":"2024-09-21T07:28:49.779777+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:12.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780925+0000","last_change":"2024-09-21T07:28:46.891115+0000","last_active":"2024-09-21T07:28:49.780925+0000","last_peered":"2024-09-21T07:28:49.780925+0000","last_clean":"2024-09-21T07:28:49.780925+0000","last_became_active":"2024-09-21T07:28:46.888955+0000","last_became_peered":"2024-09-21T07:28:46.888955+0000","last_unstale":"2024-09-21T07:28:49.780925+0000","last_undegraded":"2024-09-21T07:28:49.780925+0000","last_fullsized":"2024-09-21T07:28:49.780925+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:32.918833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780539+0000","last_change":"2024-09-21T07:28:47.911577+0000","last_active":"2024-09-21T07:28:49.780539+0000","last_peered":"2024-09-21T07:28:49.780539+0000","last_clean":"2024-09-21T07:28:49.780539+0000","last_became_active":"2024-09-21T07:28:47.911249+0000","last_became_peered":"2024-09-21T07:28:47.911249+0000","last_unstale":"2024-09-21T07:28:49.780539+0000","last_undegraded":"2024-09-21T07:28:49.780539+0000","last_fullsized":"2024-09-21T07:28:49.780539+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:39.286347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780777+0000","last_change":"2024-09-21T07:28:46.896939+0000","last_active":"2024-09-21T07:28:49.780777+0000","last_peered":"2024-09-21T07:28:49.780777+0000","last_clean":"2024-09-21T07:28:49.780777+0000","last_became_active":"2024-09-21T07:28:46.896614+0000","last_became_peered":"2024-09-21T07:28:46.896614+0000","last_unstale":"2024-09-21T07:28:49.780777+0000","last_undegraded":"2024-09-21T07:28:49.780777+0000","last_fullsized":"2024-09-21T07:28:49.780777+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:17.461355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908627+0000","last_change":"2024-09-21T07:28:47.911846+0000","last_active":"2024-09-21T07:28:48.908627+0000","last_peered":"2024-09-21T07:28:48.908627+0000","last_clean":"2024-09-21T07:28:48.908627+0000","last_became_active":"2024-09-21T07:28:47.911496+0000","last_became_peered":"2024-09-21T07:28:47.911496+0000","last_unstale":"2024-09-21T07:28:48.908627+0000","last_undegraded":"2024-09-21T07:28:48.908627+0000","last_fullsized":"2024-09-21T07:28:48.908627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:29.290949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779764+0000","last_change":"2024-09-21T07:28:46.892029+0000","last_active":"2024-09-21T07:28:49.779764+0000","last_peered":"2024-09-21T07:28:49.779764+0000","last_clean":"2024-09-21T07:28:49.779764+0000","last_became_active":"2024-09-21T07:28:46.890794+0000","last_became_peered":"2024-09-21T07:28:46.890794+0000","last_unstale":"2024-09-21T07:28:49.779764+0000","last_undegraded":"2024-09-21T07:28:49.779764+0000","last_fullsized":"2024-09-21T07:28:49.779764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:10.428281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903757+0000","last_change":"2024-09-21T07:28:47.919719+0000","last_active":"2024-09-21T07:28:48.903757+0000","last_peered":"2024-09-21T07:28:48.903757+0000","last_clean":"2024-09-21T07:28:48.903757+0000","last_became_active":"2024-09-21T07:28:47.919401+0000","last_became_peered":"2024-09-21T07:28:47.919401+0000","last_unstale":"2024-09-21T07:28:48.903757+0000","last_undegraded":"2024-09-21T07:28:48.903757+0000","last_fullsized":"2024-09-21T07:28:48.903757+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:53.523564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780163+0000","last_change":"2024-09-21T07:28:46.890476+0000","last_active":"2024-09-21T07:28:49.780163+0000","last_peered":"2024-09-21T07:28:49.780163+0000","last_clean":"2024-09-21T07:28:49.780163+0000","last_became_active":"2024-09-21T07:28:46.889808+0000","last_became_peered":"2024-09-21T07:28:46.889808+0000","last_unstale":"2024-09-21T07:28:49.780163+0000","last_undegraded":"2024-09-21T07:28:49.780163+0000","last_fullsized":"2024-09-21T07:28:49.780163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:00.328400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911040+0000","last_change":"2024-09-21T07:28:47.927957+0000","last_active":"2024-09-21T07:28:48.911040+0000","last_peered":"2024-09-21T07:28:48.911040+0000","last_clean":"2024-09-21T07:28:48.911040+0000","last_became_active":"2024-09-21T07:28:47.923536+0000","last_became_peered":"2024-09-21T07:28:47.923536+0000","last_unstale":"2024-09-21T07:28:48.911040+0000","last_undegraded":"2024-09-21T07:28:48.911040+0000","last_fullsized":"2024-09-21T07:28:48.911040+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:36.007477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907460+0000","last_change":"2024-09-21T07:28:46.892076+0000","last_active":"2024-09-21T07:28:48.907460+0000","last_peered":"2024-09-21T07:28:48.907460+0000","last_clean":"2024-09-21T07:28:48.907460+0000","last_became_active":"2024-09-21T07:28:46.891776+0000","last_became_peered":"2024-09-21T07:28:46.891776+0000","last_unstale":"2024-09-21T07:28:48.907460+0000","last_undegraded":"2024-09-21T07:28:48.907460+0000","last_fullsized":"2024-09-21T07:28:48.907460+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:50.841788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909626+0000","last_change":"2024-09-21T07:28:47.916369+0000","last_active":"2024-09-21T07:28:48.909626+0000","last_peered":"2024-09-21T07:28:48.909626+0000","last_clean":"2024-09-21T07:28:48.909626+0000","last_became_active":"2024-09-21T07:28:47.915960+0000","last_became_peered":"2024-09-21T07:28:47.915960+0000","last_unstale":"2024-09-21T07:28:48.909626+0000","last_undegraded":"2024-09-21T07:28:48.909626+0000","last_fullsized":"2024-09-21T07:28:48.909626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.803834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780232+0000","last_change":"2024-09-21T07:28:46.896318+0000","last_active":"2024-09-21T07:28:49.780232+0000","last_peered":"2024-09-21T07:28:49.780232+0000","last_clean":"2024-09-21T07:28:49.780232+0000","last_became_active":"2024-09-21T07:28:46.895997+0000","last_became_peered":"2024-09-21T07:28:46.895997+0000","last_unstale":"2024-09-21T07:28:49.780232+0000","last_undegraded":"2024-09-21T07:28:49.780232+0000","last_fullsized":"2024-09-21T07:28:49.780232+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:00.697429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904029+0000","last_change":"2024-09-21T07:28:47.912614+0000","last_active":"2024-09-21T07:28:48.904029+0000","last_peered":"2024-09-21T07:28:48.904029+0000","last_clean":"2024-09-21T07:28:48.904029+0000","last_became_active":"2024-09-21T07:28:47.911410+0000","last_became_peered":"2024-09-21T07:28:47.911410+0000","last_unstale":"2024-09-21T07:28:48.904029+0000","last_undegraded":"2024-09-21T07:28:48.904029+0000","last_fullsized":"2024-09-21T07:28:48.904029+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:52.493508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903262+0000","last_change":"2024-09-21T07:28:46.882654+0000","last_active":"2024-09-21T07:28:48.903262+0000","last_peered":"2024-09-21T07:28:48.903262+0000","last_clean":"2024-09-21T07:28:48.903262+0000","last_became_active":"2024-09-21T07:28:46.881217+0000","last_became_peered":"2024-09-21T07:28:46.881217+0000","last_unstale":"2024-09-21T07:28:48.903262+0000","last_undegraded":"2024-09-21T07:28:48.903262+0000","last_fullsized":"2024-09-21T07:28:48.903262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:05.000983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910285+0000","last_change":"2024-09-21T07:28:47.913294+0000","last_active":"2024-09-21T07:28:48.910285+0000","last_peered":"2024-09-21T07:28:48.910285+0000","last_clean":"2024-09-21T07:28:48.910285+0000","last_became_active":"2024-09-21T07:28:47.909820+0000","last_became_peered":"2024-09-21T07:28:47.909820+0000","last_unstale":"2024-09-21T07:28:48.910285+0000","last_undegraded":"2024-09-21T07:28:48.910285+0000","last_fullsized":"2024-09-21T07:28:48.910285+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:04.040732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781110+0000","last_change":"2024-09-21T07:28:46.893078+0000","last_active":"2024-09-21T07:28:49.781110+0000","last_peered":"2024-09-21T07:28:49.781110+0000","last_clean":"2024-09-21T07:28:49.781110+0000","last_became_active":"2024-09-21T07:28:46.890767+0000","last_became_peered":"2024-09-21T07:28:46.890767+0000","last_unstale":"2024-09-21T07:28:49.781110+0000","last_undegraded":"2024-09-21T07:28:49.781110+0000","last_fullsized":"2024-09-21T07:28:49.781110+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:40.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779672+0000","last_change":"2024-09-21T07:28:47.906017+0000","last_active":"2024-09-21T07:28:49.779672+0000","last_peered":"2024-09-21T07:28:49.779672+0000","last_clean":"2024-09-21T07:28:49.779672+0000","last_became_active":"2024-09-21T07:28:47.905718+0000","last_became_peered":"2024-09-21T07:28:47.905718+0000","last_unstale":"2024-09-21T07:28:49.779672+0000","last_undegraded":"2024-09-21T07:28:49.779672+0000","last_fullsized":"2024-09-21T07:28:49.779672+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:25.822107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910764+0000","last_change":"2024-09-21T07:28:46.884544+0000","last_active":"2024-09-21T07:28:48.910764+0000","last_peered":"2024-09-21T07:28:48.910764+0000","last_clean":"2024-09-21T07:28:48.910764+0000","last_became_active":"2024-09-21T07:28:46.884216+0000","last_became_peered":"2024-09-21T07:28:46.884216+0000","last_unstale":"2024-09-21T07:28:48.910764+0000","last_undegraded":"2024-09-21T07:28:48.910764+0000","last_fullsized":"2024-09-21T07:28:48.910764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:37.671638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780482+0000","last_change":"2024-09-21T07:28:47.906617+0000","last_active":"2024-09-21T07:28:49.780482+0000","last_peered":"2024-09-21T07:28:49.780482+0000","last_clean":"2024-09-21T07:28:49.780482+0000","last_became_active":"2024-09-21T07:28:47.906308+0000","last_became_peered":"2024-09-21T07:28:47.906308+0000","last_unstale":"2024-09-21T07:28:49.780482+0000","last_undegraded":"2024-09-21T07:28:49.780482+0000","last_fullsized":"2024-09-21T07:28:49.780482+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:27.194464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"115'3","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779835+0000","last_change":"2024-09-21T07:28:46.888079+0000","last_active":"2024-09-21T07:28:49.779835+0000","last_peered":"2024-09-21T07:28:49.779835+0000","last_clean":"2024-09-21T07:28:49.779835+0000","last_became_active":"2024-09-21T07:28:46.887510+0000","last_became_peered":"2024-09-21T07:28:46.887510+0000","last_unstale":"2024-09-21T07:28:49.779835+0000","last_undegraded":"2024-09-21T07:28:49.779835+0000","last_fullsized":"2024-09-21T07:28:49.779835+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:49.233064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780173+0000","last_change":"2024-09-21T07:28:47.917591+0000","last_active":"2024-09-21T07:28:49.780173+0000","last_peered":"2024-09-21T07:28:49.780173+0000","last_clean":"2024-09-21T07:28:49.780173+0000","last_became_active":"2024-09-21T07:28:47.917142+0000","last_became_peered":"2024-09-21T07:28:47.917142+0000","last_unstale":"2024-09-21T07:28:49.780173+0000","last_undegraded":"2024-09-21T07:28:49.780173+0000","last_fullsized":"2024-09-21T07:28:49.780173+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.528664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"115'6","reported_seq":21,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909318+0000","last_change":"2024-09-21T07:28:46.885717+0000","last_active":"2024-09-21T07:28:48.909318+0000","last_peered":"2024-09-21T07:28:48.909318+0000","last_clean":"2024-09-21T07:28:48.909318+0000","last_became_active":"2024-09-21T07:28:46.885274+0000","last_became_peered":"2024-09-21T07:28:46.885274+0000","last_unstale":"2024-09-21T07:28:48.909318+0000","last_undegraded":"2024-09-21T07:28:48.909318+0000","last_fullsized":"2024-09-21T07:28:48.909318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:57.578325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908837+0000","last_change":"2024-09-21T07:28:47.908901+0000","last_active":"2024-09-21T07:28:48.908837+0000","last_peered":"2024-09-21T07:28:48.908837+0000","last_clean":"2024-09-21T07:28:48.908837+0000","last_became_active":"2024-09-21T07:28:47.908583+0000","last_became_peered":"2024-09-21T07:28:47.908583+0000","last_unstale":"2024-09-21T07:28:48.908837+0000","last_undegraded":"2024-09-21T07:28:48.908837+0000","last_fullsized":"2024-09-21T07:28:48.908837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.625208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780036+0000","last_change":"2024-09-21T07:28:46.890803+0000","last_active":"2024-09-21T07:28:49.780036+0000","last_peered":"2024-09-21T07:28:49.780036+0000","last_clean":"2024-09-21T07:28:49.780036+0000","last_became_active":"2024-09-21T07:28:46.890473+0000","last_became_peered":"2024-09-21T07:28:46.890473+0000","last_unstale":"2024-09-21T07:28:49.780036+0000","last_undegraded":"2024-09-21T07:28:49.780036+0000","last_fullsized":"2024-09-21T07:28:49.780036+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:17.947450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908487+0000","last_change":"2024-09-21T07:28:47.904756+0000","last_active":"2024-09-21T07:28:48.908487+0000","last_peered":"2024-09-21T07:28:48.908487+0000","last_clean":"2024-09-21T07:28:48.908487+0000","last_became_active":"2024-09-21T07:28:47.904104+0000","last_became_peered":"2024-09-21T07:28:47.904104+0000","last_unstale":"2024-09-21T07:28:48.908487+0000","last_undegraded":"2024-09-21T07:28:48.908487+0000","last_fullsized":"2024-09-21T07:28:48.908487+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:17.280239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903580+0000","last_change":"2024-09-21T07:28:46.884691+0000","last_active":"2024-09-21T07:28:48.903580+0000","last_peered":"2024-09-21T07:28:48.903580+0000","last_clean":"2024-09-21T07:28:48.903580+0000","last_became_active":"2024-09-21T07:28:46.884171+0000","last_became_peered":"2024-09-21T07:28:46.884171+0000","last_unstale":"2024-09-21T07:28:48.903580+0000","last_undegraded":"2024-09-21T07:28:48.903580+0000","last_fullsized":"2024-09-21T07:28:48.903580+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:25.992238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780970+0000","last_change":"2024-09-21T07:28:47.912903+0000","last_active":"2024-09-21T07:28:49.780970+0000","last_peered":"2024-09-21T07:28:49.780970+0000","last_clean":"2024-09-21T07:28:49.780970+0000","last_became_active":"2024-09-21T07:28:47.911494+0000","last_became_peered":"2024-09-21T07:28:47.911494+0000","last_unstale":"2024-09-21T07:28:49.780970+0000","last_undegraded":"2024-09-21T07:28:49.780970+0000","last_fullsized":"2024-09-21T07:28:49.780970+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:03.071894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780065+0000","last_change":"2024-09-21T07:28:46.876770+0000","last_active":"2024-09-21T07:28:49.780065+0000","last_peered":"2024-09-21T07:28:49.780065+0000","last_clean":"2024-09-21T07:28:49.780065+0000","last_became_active":"2024-09-21T07:28:46.875744+0000","last_became_peered":"2024-09-21T07:28:46.875744+0000","last_unstale":"2024-09-21T07:28:49.780065+0000","last_undegraded":"2024-09-21T07:28:49.780065+0000","last_fullsized":"2024-09-21T07:28:49.780065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:50.218565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911117+0000","last_change":"2024-09-21T07:28:47.921326+0000","last_active":"2024-09-21T07:28:48.911117+0000","last_peered":"2024-09-21T07:28:48.911117+0000","last_clean":"2024-09-21T07:28:48.911117+0000","last_became_active":"2024-09-21T07:28:47.920667+0000","last_became_peered":"2024-09-21T07:28:47.920667+0000","last_unstale":"2024-09-21T07:28:48.911117+0000","last_undegraded":"2024-09-21T07:28:48.911117+0000","last_fullsized":"2024-09-21T07:28:48.911117+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.123531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"115'8","reported_seq":23,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779834+0000","last_change":"2024-09-21T07:28:46.897169+0000","last_active":"2024-09-21T07:28:49.779834+0000","last_peered":"2024-09-21T07:28:49.779834+0000","last_clean":"2024-09-21T07:28:49.779834+0000","last_became_active":"2024-09-21T07:28:46.896393+0000","last_became_peered":"2024-09-21T07:28:46.896393+0000","last_unstale":"2024-09-21T07:28:49.779834+0000","last_undegraded":"2024-09-21T07:28:49.779834+0000","last_fullsized":"2024-09-21T07:28:49.779834+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:23.843420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780740+0000","last_change":"2024-09-21T07:28:47.901836+0000","last_active":"2024-09-21T07:28:49.780740+0000","last_peered":"2024-09-21T07:28:49.780740+0000","last_clean":"2024-09-21T07:28:49.780740+0000","last_became_active":"2024-09-21T07:28:47.901364+0000","last_became_peered":"2024-09-21T07:28:47.901364+0000","last_unstale":"2024-09-21T07:28:49.780740+0000","last_undegraded":"2024-09-21T07:28:49.780740+0000","last_fullsized":"2024-09-21T07:28:49.780740+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:12.132687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909540+0000","last_change":"2024-09-21T07:28:46.882380+0000","last_active":"2024-09-21T07:28:48.909540+0000","last_peered":"2024-09-21T07:28:48.909540+0000","last_clean":"2024-09-21T07:28:48.909540+0000","last_became_active":"2024-09-21T07:28:46.881937+0000","last_became_peered":"2024-09-21T07:28:46.881937+0000","last_unstale":"2024-09-21T07:28:48.909540+0000","last_undegraded":"2024-09-21T07:28:48.909540+0000","last_fullsized":"2024-09-21T07:28:48.909540+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:14.166047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908074+0000","last_change":"2024-09-21T07:28:47.914022+0000","last_active":"2024-09-21T07:28:48.908074+0000","last_peered":"2024-09-21T07:28:48.908074+0000","last_clean":"2024-09-21T07:28:48.908074+0000","last_became_active":"2024-09-21T07:28:47.908127+0000","last_became_peered":"2024-09-21T07:28:47.908127+0000","last_unstale":"2024-09-21T07:28:48.908074+0000","last_undegraded":"2024-09-21T07:28:48.908074+0000","last_fullsized":"2024-09-21T07:28:48.908074+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:04.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779945+0000","last_change":"2024-09-21T07:28:46.886058+0000","last_active":"2024-09-21T07:28:49.779945+0000","last_peered":"2024-09-21T07:28:49.779945+0000","last_clean":"2024-09-21T07:28:49.779945+0000","last_became_active":"2024-09-21T07:28:46.885703+0000","last_became_peered":"2024-09-21T07:28:46.885703+0000","last_unstale":"2024-09-21T07:28:49.779945+0000","last_undegraded":"2024-09-21T07:28:49.779945+0000","last_fullsized":"2024-09-21T07:28:49.779945+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:46.703847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779825+0000","last_change":"2024-09-21T07:28:47.917850+0000","last_active":"2024-09-21T07:28:49.779825+0000","last_peered":"2024-09-21T07:28:49.779825+0000","last_clean":"2024-09-21T07:28:49.779825+0000","last_became_active":"2024-09-21T07:28:47.917553+0000","last_became_peered":"2024-09-21T07:28:47.917553+0000","last_unstale":"2024-09-21T07:28:49.779825+0000","last_undegraded":"2024-09-21T07:28:49.779825+0000","last_fullsized":"2024-09-21T07:28:49.779825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:37.604492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908898+0000","last_change":"2024-09-21T07:28:46.893222+0000","last_active":"2024-09-21T07:28:48.908898+0000","last_peered":"2024-09-21T07:28:48.908898+0000","last_clean":"2024-09-21T07:28:48.908898+0000","last_became_active":"2024-09-21T07:28:46.892871+0000","last_became_peered":"2024-09-21T07:28:46.892871+0000","last_unstale":"2024-09-21T07:28:48.908898+0000","last_undegraded":"2024-09-21T07:28:48.908898+0000","last_fullsized":"2024-09-21T07:28:48.908898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:02.655986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910653+0000","last_change":"2024-09-21T07:28:47.902101+0000","last_active":"2024-09-21T07:28:48.910653+0000","last_peered":"2024-09-21T07:28:48.910653+0000","last_clean":"2024-09-21T07:28:48.910653+0000","last_became_active":"2024-09-21T07:28:47.901808+0000","last_became_peered":"2024-09-21T07:28:47.901808+0000","last_unstale":"2024-09-21T07:28:48.910653+0000","last_undegraded":"2024-09-21T07:28:48.910653+0000","last_fullsized":"2024-09-21T07:28:48.910653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:14.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780787+0000","last_change":"2024-09-21T07:28:46.874879+0000","last_active":"2024-09-21T07:28:49.780787+0000","last_peered":"2024-09-21T07:28:49.780787+0000","last_clean":"2024-09-21T07:28:49.780787+0000","last_became_active":"2024-09-21T07:28:46.874565+0000","last_became_peered":"2024-09-21T07:28:46.874565+0000","last_unstale":"2024-09-21T07:28:49.780787+0000","last_undegraded":"2024-09-21T07:28:49.780787+0000","last_fullsized":"2024-09-21T07:28:49.780787+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:48.965066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911002+0000","last_change":"2024-09-21T07:28:47.919620+0000","last_active":"2024-09-21T07:28:48.911002+0000","last_peered":"2024-09-21T07:28:48.911002+0000","last_clean":"2024-09-21T07:28:48.911002+0000","last_became_active":"2024-09-21T07:28:47.919314+0000","last_became_peered":"2024-09-21T07:28:47.919314+0000","last_unstale":"2024-09-21T07:28:48.911002+0000","last_undegraded":"2024-09-21T07:28:48.911002+0000","last_fullsized":"2024-09-21T07:28:48.911002+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:52.894145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780076+0000","last_change":"2024-09-21T07:28:46.879572+0000","last_active":"2024-09-21T07:28:49.780076+0000","last_peered":"2024-09-21T07:28:49.780076+0000","last_clean":"2024-09-21T07:28:49.780076+0000","last_became_active":"2024-09-21T07:28:46.879265+0000","last_became_peered":"2024-09-21T07:28:46.879265+0000","last_unstale":"2024-09-21T07:28:49.780076+0000","last_undegraded":"2024-09-21T07:28:49.780076+0000","last_fullsized":"2024-09-21T07:28:49.780076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:10.068025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903867+0000","last_change":"2024-09-21T07:28:47.908921+0000","last_active":"2024-09-21T07:28:48.903867+0000","last_peered":"2024-09-21T07:28:48.903867+0000","last_clean":"2024-09-21T07:28:48.903867+0000","last_became_active":"2024-09-21T07:28:47.907608+0000","last_became_peered":"2024-09-21T07:28:47.907608+0000","last_unstale":"2024-09-21T07:28:48.903867+0000","last_undegraded":"2024-09-21T07:28:48.903867+0000","last_fullsized":"2024-09-21T07:28:48.903867+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:32.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908065+0000","last_change":"2024-09-21T07:28:46.885919+0000","last_active":"2024-09-21T07:28:48.908065+0000","last_peered":"2024-09-21T07:28:48.908065+0000","last_clean":"2024-09-21T07:28:48.908065+0000","last_became_active":"2024-09-21T07:28:46.885595+0000","last_became_peered":"2024-09-21T07:28:46.885595+0000","last_unstale":"2024-09-21T07:28:48.908065+0000","last_undegraded":"2024-09-21T07:28:48.908065+0000","last_fullsized":"2024-09-21T07:28:48.908065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:54.184304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781078+0000","last_change":"2024-09-21T07:28:47.922450+0000","last_active":"2024-09-21T07:28:49.781078+0000","last_peered":"2024-09-21T07:28:49.781078+0000","last_clean":"2024-09-21T07:28:49.781078+0000","last_became_active":"2024-09-21T07:28:47.922157+0000","last_became_peered":"2024-09-21T07:28:47.922157+0000","last_unstale":"2024-09-21T07:28:49.781078+0000","last_undegraded":"2024-09-21T07:28:49.781078+0000","last_fullsized":"2024-09-21T07:28:49.781078+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:27.064032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780857+0000","last_change":"2024-09-21T07:28:46.882372+0000","last_active":"2024-09-21T07:28:49.780857+0000","last_peered":"2024-09-21T07:28:49.780857+0000","last_clean":"2024-09-21T07:28:49.780857+0000","last_became_active":"2024-09-21T07:28:46.882005+0000","last_became_peered":"2024-09-21T07:28:46.882005+0000","last_unstale":"2024-09-21T07:28:49.780857+0000","last_undegraded":"2024-09-21T07:28:49.780857+0000","last_fullsized":"2024-09-21T07:28:49.780857+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:38.599732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910215+0000","last_change":"2024-09-21T07:28:47.903666+0000","last_active":"2024-09-21T07:28:48.910215+0000","last_peered":"2024-09-21T07:28:48.910215+0000","last_clean":"2024-09-21T07:28:48.910215+0000","last_became_active":"2024-09-21T07:28:47.903170+0000","last_became_peered":"2024-09-21T07:28:47.903170+0000","last_unstale":"2024-09-21T07:28:48.910215+0000","last_undegraded":"2024-09-21T07:28:48.910215+0000","last_fullsized":"2024-09-21T07:28:48.910215+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:43.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781077+0000","last_change":"2024-09-21T07:28:46.893022+0000","last_active":"2024-09-21T07:28:49.781077+0000","last_peered":"2024-09-21T07:28:49.781077+0000","last_clean":"2024-09-21T07:28:49.781077+0000","last_became_active":"2024-09-21T07:28:46.892553+0000","last_became_peered":"2024-09-21T07:28:46.892553+0000","last_unstale":"2024-09-21T07:28:49.781077+0000","last_undegraded":"2024-09-21T07:28:49.781077+0000","last_fullsized":"2024-09-21T07:28:49.781077+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:23.356753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779913+0000","last_change":"2024-09-21T07:28:47.902818+0000","last_active":"2024-09-21T07:28:49.779913+0000","last_peered":"2024-09-21T07:28:49.779913+0000","last_clean":"2024-09-21T07:28:49.779913+0000","last_became_active":"2024-09-21T07:28:47.902462+0000","last_became_peered":"2024-09-21T07:28:47.902462+0000","last_unstale":"2024-09-21T07:28:49.779913+0000","last_undegraded":"2024-09-21T07:28:49.779913+0000","last_fullsized":"2024-09-21T07:28:49.779913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:42.139423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"116'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910872+0000","last_change":"2024-09-21T07:28:46.889175+0000","last_active":"2024-09-21T07:28:48.910872+0000","last_peered":"2024-09-21T07:28:48.910872+0000","last_clean":"2024-09-21T07:28:48.910872+0000","last_became_active":"2024-09-21T07:28:46.888896+0000","last_became_peered":"2024-09-21T07:28:46.888896+0000","last_unstale":"2024-09-21T07:28:48.910872+0000","last_undegraded":"2024-09-21T07:28:48.910872+0000","last_fullsized":"2024-09-21T07:28:48.910872+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:58.169441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903518+0000","last_change":"2024-09-21T07:28:47.906846+0000","last_active":"2024-09-21T07:28:48.903518+0000","last_peered":"2024-09-21T07:28:48.903518+0000","last_clean":"2024-09-21T07:28:48.903518+0000","last_became_active":"2024-09-21T07:28:47.906481+0000","last_became_peered":"2024-09-21T07:28:47.906481+0000","last_unstale":"2024-09-21T07:28:48.903518+0000","last_undegraded":"2024-09-21T07:28:48.903518+0000","last_fullsized":"2024-09-21T07:28:48.903518+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:22.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908470+0000","last_change":"2024-09-21T07:28:46.883777+0000","last_active":"2024-09-21T07:28:48.908470+0000","last_peered":"2024-09-21T07:28:48.908470+0000","last_clean":"2024-09-21T07:28:48.908470+0000","last_became_active":"2024-09-21T07:28:46.883424+0000","last_became_peered":"2024-09-21T07:28:46.883424+0000","last_unstale":"2024-09-21T07:28:48.908470+0000","last_undegraded":"2024-09-21T07:28:48.908470+0000","last_fullsized":"2024-09-21T07:28:48.908470+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:00.697429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908420+0000","last_change":"2024-09-21T07:28:47.907315+0000","last_active":"2024-09-21T07:28:48.908420+0000","last_peered":"2024-09-21T07:28:48.908420+0000","last_clean":"2024-09-21T07:28:48.908420+0000","last_became_active":"2024-09-21T07:28:47.906988+0000","last_became_peered":"2024-09-21T07:28:47.906988+0000","last_unstale":"2024-09-21T07:28:48.908420+0000","last_undegraded":"2024-09-21T07:28:48.908420+0000","last_fullsized":"2024-09-21T07:28:48.908420+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:04.292694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779918+0000","last_change":"2024-09-21T07:28:46.892079+0000","last_active":"2024-09-21T07:28:49.779918+0000","last_peered":"2024-09-21T07:28:49.779918+0000","last_clean":"2024-09-21T07:28:49.779918+0000","last_became_active":"2024-09-21T07:28:46.891517+0000","last_became_peered":"2024-09-21T07:28:46.891517+0000","last_unstale":"2024-09-21T07:28:49.779918+0000","last_undegraded":"2024-09-21T07:28:49.779918+0000","last_fullsized":"2024-09-21T07:28:49.779918+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.145844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780474+0000","last_change":"2024-09-21T07:28:47.923145+0000","last_active":"2024-09-21T07:28:49.780474+0000","last_peered":"2024-09-21T07:28:49.780474+0000","last_clean":"2024-09-21T07:28:49.780474+0000","last_became_active":"2024-09-21T07:28:47.922854+0000","last_became_peered":"2024-09-21T07:28:47.922854+0000","last_unstale":"2024-09-21T07:28:49.780474+0000","last_undegraded":"2024-09-21T07:28:49.780474+0000","last_fullsized":"2024-09-21T07:28:49.780474+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.038794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780583+0000","last_change":"2024-09-21T07:28:46.888820+0000","last_active":"2024-09-21T07:28:49.780583+0000","last_peered":"2024-09-21T07:28:49.780583+0000","last_clean":"2024-09-21T07:28:49.780583+0000","last_became_active":"2024-09-21T07:28:46.884193+0000","last_became_peered":"2024-09-21T07:28:46.884193+0000","last_unstale":"2024-09-21T07:28:49.780583+0000","last_undegraded":"2024-09-21T07:28:49.780583+0000","last_fullsized":"2024-09-21T07:28:49.780583+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:14.166047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780788+0000","last_change":"2024-09-21T07:28:47.921885+0000","last_active":"2024-09-21T07:28:49.780788+0000","last_peered":"2024-09-21T07:28:49.780788+0000","last_clean":"2024-09-21T07:28:49.780788+0000","last_became_active":"2024-09-21T07:28:47.921491+0000","last_became_peered":"2024-09-21T07:28:47.921491+0000","last_unstale":"2024-09-21T07:28:49.780788+0000","last_undegraded":"2024-09-21T07:28:49.780788+0000","last_fullsized":"2024-09-21T07:28:49.780788+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:53.490752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780274+0000","last_change":"2024-09-21T07:28:46.875287+0000","last_active":"2024-09-21T07:28:49.780274+0000","last_peered":"2024-09-21T07:28:49.780274+0000","last_clean":"2024-09-21T07:28:49.780274+0000","last_became_active":"2024-09-21T07:28:46.874980+0000","last_became_peered":"2024-09-21T07:28:46.874980+0000","last_unstale":"2024-09-21T07:28:49.780274+0000","last_undegraded":"2024-09-21T07:28:49.780274+0000","last_fullsized":"2024-09-21T07:28:49.780274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:40.175060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780288+0000","last_change":"2024-09-21T07:28:47.918367+0000","last_active":"2024-09-21T07:28:49.780288+0000","last_peered":"2024-09-21T07:28:49.780288+0000","last_clean":"2024-09-21T07:28:49.780288+0000","last_became_active":"2024-09-21T07:28:47.917528+0000","last_became_peered":"2024-09-21T07:28:47.917528+0000","last_unstale":"2024-09-21T07:28:49.780288+0000","last_undegraded":"2024-09-21T07:28:49.780288+0000","last_fullsized":"2024-09-21T07:28:49.780288+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.020490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908185+0000","last_change":"2024-09-21T07:28:46.885131+0000","last_active":"2024-09-21T07:28:48.908185+0000","last_peered":"2024-09-21T07:28:48.908185+0000","last_clean":"2024-09-21T07:28:48.908185+0000","last_became_active":"2024-09-21T07:28:46.884760+0000","last_became_peered":"2024-09-21T07:28:46.884760+0000","last_unstale":"2024-09-21T07:28:48.908185+0000","last_undegraded":"2024-09-21T07:28:48.908185+0000","last_fullsized":"2024-09-21T07:28:48.908185+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:19.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909168+0000","last_change":"2024-09-21T07:28:47.917501+0000","last_active":"2024-09-21T07:28:48.909168+0000","last_peered":"2024-09-21T07:28:48.909168+0000","last_clean":"2024-09-21T07:28:48.909168+0000","last_became_active":"2024-09-21T07:28:47.917074+0000","last_became_peered":"2024-09-21T07:28:47.917074+0000","last_unstale":"2024-09-21T07:28:48.909168+0000","last_undegraded":"2024-09-21T07:28:48.909168+0000","last_fullsized":"2024-09-21T07:28:48.909168+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:14.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781002+0000","last_change":"2024-09-21T07:28:46.887554+0000","last_active":"2024-09-21T07:28:49.781002+0000","last_peered":"2024-09-21T07:28:49.781002+0000","last_clean":"2024-09-21T07:28:49.781002+0000","last_became_active":"2024-09-21T07:28:46.887005+0000","last_became_peered":"2024-09-21T07:28:46.887005+0000","last_unstale":"2024-09-21T07:28:49.781002+0000","last_undegraded":"2024-09-21T07:28:49.781002+0000","last_fullsized":"2024-09-21T07:28:49.781002+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:36.632995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907468+0000","last_change":"2024-09-21T07:28:47.922140+0000","last_active":"2024-09-21T07:28:48.907468+0000","last_peered":"2024-09-21T07:28:48.907468+0000","last_clean":"2024-09-21T07:28:48.907468+0000","last_became_active":"2024-09-21T07:28:47.921764+0000","last_became_peered":"2024-09-21T07:28:47.921764+0000","last_unstale":"2024-09-21T07:28:48.907468+0000","last_undegraded":"2024-09-21T07:28:48.907468+0000","last_fullsized":"2024-09-21T07:28:48.907468+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781094+0000","last_change":"2024-09-21T07:28:46.879025+0000","last_active":"2024-09-21T07:28:49.781094+0000","last_peered":"2024-09-21T07:28:49.781094+0000","last_clean":"2024-09-21T07:28:49.781094+0000","last_became_active":"2024-09-21T07:28:46.878672+0000","last_became_peered":"2024-09-21T07:28:46.878672+0000","last_unstale":"2024-09-21T07:28:49.781094+0000","last_undegraded":"2024-09-21T07:28:49.781094+0000","last_fullsized":"2024-09-21T07:28:49.781094+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:31.720531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":282,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779632+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:49.779632+0000","last_peered":"2024-09-21T07:28:49.779632+0000","last_clean":"2024-09-21T07:28:49.779632+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:49.779632+0000","last_undegraded":"2024-09-21T07:28:49.779632+0000","last_fullsized":"2024-09-21T07:28:49.779632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509519,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40924,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330916,"statfs":{"total":96636764160,"available":96594857984,"internally_reserved":0,"allocated":1449984,"data_stored":673406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":671190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":671282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509519,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":1433600,"data_stored":671224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1433600,"data_stored":671224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41500,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2039808,"data_stored":1263260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542223,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37332,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334508,"statfs":{"total":96636764160,"available":96598536192,"internally_reserved":0,"allocated":2031616,"data_stored":1261718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1433600,"data_stored":671772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:53.838 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:28:53.835+0000 7f269c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:28:56.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:28:56.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- 172.21.15.64:0/210347103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0b48d0 msgr2=0x7f69bc072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:56.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 --2- 172.21.15.64:0/210347103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0b48d0 0x7f69bc072e20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0c3c60 tx=0x7f69b401cd80 comp rx=0 tx=0).stop 2024-09-21T07:28:56.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- 172.21.15.64:0/210347103 shutdown_connections 2024-09-21T07:28:56.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 --2- 172.21.15.64:0/210347103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0b48d0 0x7f69bc072e20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:56.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 --2- 172.21.15.64:0/210347103 >> v2:172.21.15.90:3300/0 conn(0x7f69bc15edb0 0x7f69bc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:56.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- 172.21.15.64:0/210347103 >> 172.21.15.64:0/210347103 conn(0x7f69bc0ccbe0 msgr2=0x7f69bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:56.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- 172.21.15.64:0/210347103 shutdown_connections 2024-09-21T07:28:56.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- 172.21.15.64:0/210347103 wait complete. 2024-09-21T07:28:56.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 Processor -- start 2024-09-21T07:28:56.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.967+0000 7f69c3a00640 1 -- start start 2024-09-21T07:28:56.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:56.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 0x7f69bc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:56.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 0x7f69bc150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:56.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc168c00 con 0x7f69bc0709b0 2024-09-21T07:28:56.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc168a80 con 0x7f69bc1507b0 2024-09-21T07:28:56.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc168d80 con 0x7f69bc15edb0 2024-09-21T07:28:56.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:56.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42830/0 (socket says 172.21.15.64:42830) 2024-09-21T07:28:56.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 -- 172.21.15.64:0/3167340 learned_addr learned my addr 172.21.15.64:0/3167340 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69bbe00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 0x7f69bc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 0x7f69bc150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 -- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 msgr2=0x7f69bc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 0x7f69bc14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 -- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 msgr2=0x7f69bc150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 0x7f69bc150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 -- 172.21.15.64:0/3167340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc0ad150 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 0x7f69bc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69bbe00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 0x7f69bc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c1000640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f69b000e7a0 tx=0x7f69b000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b000ccc0 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69b0010430 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0010860 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc0ad430 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc0ad9f0 con 0x7f69bc0709b0 2024-09-21T07:28:56.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.971+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc072e20 con 0x7f69bc0709b0 2024-09-21T07:28:56.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.975+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f69b0010a00 con 0x7f69bc0709b0 2024-09-21T07:28:56.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.975+0000 7f69b8c00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 0x7f699c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:56.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.975+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f69b0094d40 con 0x7f69bc0709b0 2024-09-21T07:28:56.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.975+0000 7f69bbe00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 0x7f699c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:56.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.975+0000 7f69bbe00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 0x7f699c075740 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f69bc1f79c0 tx=0x7f69a8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:56.979+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f69b005fc40 con 0x7f69bc0709b0 2024-09-21T07:28:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.151+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69bc0ae730 con 0x7f699c073230 2024-09-21T07:28:57.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.155+0000 7f69b8c00640 1 -- 172.21.15.64:0/3167340 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252475 (secure 0 0 0) 0x7f69a80050d0 con 0x7f699c073230 2024-09-21T07:28:57.160 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:57.161 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:28:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 msgr2=0x7f699c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 0x7f699c075740 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f69bc1f79c0 tx=0x7f69a8009040 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 msgr2=0x7f69bc0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f69b000e7a0 tx=0x7f69b000ec60 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 shutdown_connections 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f699c073230 0x7f699c075740 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69bc1507b0 0x7f69bc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69bc15edb0 0x7f69bc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 --2- 172.21.15.64:0/3167340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69bc0709b0 0x7f69bc0ae1f0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 >> 172.21.15.64:0/3167340 conn(0x7f69bc0ccbe0 msgr2=0x7f69bc0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 shutdown_connections 2024-09-21T07:28:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.159+0000 7f69c3a00640 1 -- 172.21.15.64:0/3167340 wait complete. 2024-09-21T07:28:57.182 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T07:28:55.521074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315988,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658732,"statfs":{"total":773094113280,"available":772770541568,"internally_reserved":0,"allocated":12689408,"data_stored":6555076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":310693427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002209"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910891+0000","last_change":"2024-09-21T07:28:47.909024+0000","last_active":"2024-09-21T07:28:48.910891+0000","last_peered":"2024-09-21T07:28:48.910891+0000","last_clean":"2024-09-21T07:28:48.910891+0000","last_became_active":"2024-09-21T07:28:47.908719+0000","last_became_peered":"2024-09-21T07:28:47.908719+0000","last_unstale":"2024-09-21T07:28:48.910891+0000","last_undegraded":"2024-09-21T07:28:48.910891+0000","last_fullsized":"2024-09-21T07:28:48.910891+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:20.953968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909341+0000","last_change":"2024-09-21T07:28:47.912734+0000","last_active":"2024-09-21T07:28:48.909341+0000","last_peered":"2024-09-21T07:28:48.909341+0000","last_clean":"2024-09-21T07:28:48.909341+0000","last_became_active":"2024-09-21T07:28:47.912401+0000","last_became_peered":"2024-09-21T07:28:47.912401+0000","last_unstale":"2024-09-21T07:28:48.909341+0000","last_undegraded":"2024-09-21T07:28:48.909341+0000","last_fullsized":"2024-09-21T07:28:48.909341+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.431983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910779+0000","last_change":"2024-09-21T07:28:47.919353+0000","last_active":"2024-09-21T07:28:48.910779+0000","last_peered":"2024-09-21T07:28:48.910779+0000","last_clean":"2024-09-21T07:28:48.910779+0000","last_became_active":"2024-09-21T07:28:47.919022+0000","last_became_peered":"2024-09-21T07:28:47.919022+0000","last_unstale":"2024-09-21T07:28:48.910779+0000","last_undegraded":"2024-09-21T07:28:48.910779+0000","last_fullsized":"2024-09-21T07:28:48.910779+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:56.752564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903709+0000","last_change":"2024-09-21T07:28:47.905037+0000","last_active":"2024-09-21T07:28:48.903709+0000","last_peered":"2024-09-21T07:28:48.903709+0000","last_clean":"2024-09-21T07:28:48.903709+0000","last_became_active":"2024-09-21T07:28:47.904433+0000","last_became_peered":"2024-09-21T07:28:47.904433+0000","last_unstale":"2024-09-21T07:28:48.903709+0000","last_undegraded":"2024-09-21T07:28:48.903709+0000","last_fullsized":"2024-09-21T07:28:48.903709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:55.177373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779715+0000","last_change":"2024-09-21T07:28:47.915825+0000","last_active":"2024-09-21T07:28:49.779715+0000","last_peered":"2024-09-21T07:28:49.779715+0000","last_clean":"2024-09-21T07:28:49.779715+0000","last_became_active":"2024-09-21T07:28:47.915509+0000","last_became_peered":"2024-09-21T07:28:47.915509+0000","last_unstale":"2024-09-21T07:28:49.779715+0000","last_undegraded":"2024-09-21T07:28:49.779715+0000","last_fullsized":"2024-09-21T07:28:49.779715+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:06.044469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907796+0000","last_change":"2024-09-21T07:28:47.919774+0000","last_active":"2024-09-21T07:28:48.907796+0000","last_peered":"2024-09-21T07:28:48.907796+0000","last_clean":"2024-09-21T07:28:48.907796+0000","last_became_active":"2024-09-21T07:28:47.918674+0000","last_became_peered":"2024-09-21T07:28:47.918674+0000","last_unstale":"2024-09-21T07:28:48.907796+0000","last_undegraded":"2024-09-21T07:28:48.907796+0000","last_fullsized":"2024-09-21T07:28:48.907796+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.255068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907645+0000","last_change":"2024-09-21T07:28:47.919808+0000","last_active":"2024-09-21T07:28:48.907645+0000","last_peered":"2024-09-21T07:28:48.907645+0000","last_clean":"2024-09-21T07:28:48.907645+0000","last_became_active":"2024-09-21T07:28:47.919278+0000","last_became_peered":"2024-09-21T07:28:47.919278+0000","last_unstale":"2024-09-21T07:28:48.907645+0000","last_undegraded":"2024-09-21T07:28:48.907645+0000","last_fullsized":"2024-09-21T07:28:48.907645+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:42.139423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780189+0000","last_change":"2024-09-21T07:28:47.905407+0000","last_active":"2024-09-21T07:28:49.780189+0000","last_peered":"2024-09-21T07:28:49.780189+0000","last_clean":"2024-09-21T07:28:49.780189+0000","last_became_active":"2024-09-21T07:28:47.904814+0000","last_became_peered":"2024-09-21T07:28:47.904814+0000","last_unstale":"2024-09-21T07:28:49.780189+0000","last_undegraded":"2024-09-21T07:28:49.780189+0000","last_fullsized":"2024-09-21T07:28:49.780189+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:00.299384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909529+0000","last_change":"2024-09-21T07:28:47.903457+0000","last_active":"2024-09-21T07:28:48.909529+0000","last_peered":"2024-09-21T07:28:48.909529+0000","last_clean":"2024-09-21T07:28:48.909529+0000","last_became_active":"2024-09-21T07:28:47.903111+0000","last_became_peered":"2024-09-21T07:28:47.903111+0000","last_unstale":"2024-09-21T07:28:48.909529+0000","last_undegraded":"2024-09-21T07:28:48.909529+0000","last_fullsized":"2024-09-21T07:28:48.909529+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:40.057588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780472+0000","last_change":"2024-09-21T07:28:47.919654+0000","last_active":"2024-09-21T07:28:49.780472+0000","last_peered":"2024-09-21T07:28:49.780472+0000","last_clean":"2024-09-21T07:28:49.780472+0000","last_became_active":"2024-09-21T07:28:47.919364+0000","last_became_peered":"2024-09-21T07:28:47.919364+0000","last_unstale":"2024-09-21T07:28:49.780472+0000","last_undegraded":"2024-09-21T07:28:49.780472+0000","last_fullsized":"2024-09-21T07:28:49.780472+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:04.803659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909169+0000","last_change":"2024-09-21T07:28:47.915358+0000","last_active":"2024-09-21T07:28:48.909169+0000","last_peered":"2024-09-21T07:28:48.909169+0000","last_clean":"2024-09-21T07:28:48.909169+0000","last_became_active":"2024-09-21T07:28:47.914541+0000","last_became_peered":"2024-09-21T07:28:47.914541+0000","last_unstale":"2024-09-21T07:28:48.909169+0000","last_undegraded":"2024-09-21T07:28:48.909169+0000","last_fullsized":"2024-09-21T07:28:48.909169+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:56.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780809+0000","last_change":"2024-09-21T07:28:47.902705+0000","last_active":"2024-09-21T07:28:49.780809+0000","last_peered":"2024-09-21T07:28:49.780809+0000","last_clean":"2024-09-21T07:28:49.780809+0000","last_became_active":"2024-09-21T07:28:47.902343+0000","last_became_peered":"2024-09-21T07:28:47.902343+0000","last_unstale":"2024-09-21T07:28:49.780809+0000","last_undegraded":"2024-09-21T07:28:49.780809+0000","last_fullsized":"2024-09-21T07:28:49.780809+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:04.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903544+0000","last_change":"2024-09-21T07:28:47.912349+0000","last_active":"2024-09-21T07:28:48.903544+0000","last_peered":"2024-09-21T07:28:48.903544+0000","last_clean":"2024-09-21T07:28:48.903544+0000","last_became_active":"2024-09-21T07:28:47.911807+0000","last_became_peered":"2024-09-21T07:28:47.911807+0000","last_unstale":"2024-09-21T07:28:48.903544+0000","last_undegraded":"2024-09-21T07:28:48.903544+0000","last_fullsized":"2024-09-21T07:28:48.903544+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780428+0000","last_change":"2024-09-21T07:28:47.906004+0000","last_active":"2024-09-21T07:28:49.780428+0000","last_peered":"2024-09-21T07:28:49.780428+0000","last_clean":"2024-09-21T07:28:49.780428+0000","last_became_active":"2024-09-21T07:28:47.905704+0000","last_became_peered":"2024-09-21T07:28:47.905704+0000","last_unstale":"2024-09-21T07:28:49.780428+0000","last_undegraded":"2024-09-21T07:28:49.780428+0000","last_fullsized":"2024-09-21T07:28:49.780428+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:04.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780190+0000","last_change":"2024-09-21T07:28:47.910497+0000","last_active":"2024-09-21T07:28:49.780190+0000","last_peered":"2024-09-21T07:28:49.780190+0000","last_clean":"2024-09-21T07:28:49.780190+0000","last_became_active":"2024-09-21T07:28:47.910194+0000","last_became_peered":"2024-09-21T07:28:47.910194+0000","last_unstale":"2024-09-21T07:28:49.780190+0000","last_undegraded":"2024-09-21T07:28:49.780190+0000","last_fullsized":"2024-09-21T07:28:49.780190+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:43.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780043+0000","last_change":"2024-09-21T07:28:47.904387+0000","last_active":"2024-09-21T07:28:49.780043+0000","last_peered":"2024-09-21T07:28:49.780043+0000","last_clean":"2024-09-21T07:28:49.780043+0000","last_became_active":"2024-09-21T07:28:47.903399+0000","last_became_peered":"2024-09-21T07:28:47.903399+0000","last_unstale":"2024-09-21T07:28:49.780043+0000","last_undegraded":"2024-09-21T07:28:49.780043+0000","last_fullsized":"2024-09-21T07:28:49.780043+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:44.790412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910988+0000","last_change":"2024-09-21T07:28:47.921645+0000","last_active":"2024-09-21T07:28:48.910988+0000","last_peered":"2024-09-21T07:28:48.910988+0000","last_clean":"2024-09-21T07:28:48.910988+0000","last_became_active":"2024-09-21T07:28:47.921029+0000","last_became_peered":"2024-09-21T07:28:47.921029+0000","last_unstale":"2024-09-21T07:28:48.910988+0000","last_undegraded":"2024-09-21T07:28:48.910988+0000","last_fullsized":"2024-09-21T07:28:48.910988+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:08.243397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909406+0000","last_change":"2024-09-21T07:28:47.919133+0000","last_active":"2024-09-21T07:28:48.909406+0000","last_peered":"2024-09-21T07:28:48.909406+0000","last_clean":"2024-09-21T07:28:48.909406+0000","last_became_active":"2024-09-21T07:28:47.918731+0000","last_became_peered":"2024-09-21T07:28:47.918731+0000","last_unstale":"2024-09-21T07:28:48.909406+0000","last_undegraded":"2024-09-21T07:28:48.909406+0000","last_fullsized":"2024-09-21T07:28:48.909406+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:19.328280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910768+0000","last_change":"2024-09-21T07:28:47.908196+0000","last_active":"2024-09-21T07:28:48.910768+0000","last_peered":"2024-09-21T07:28:48.910768+0000","last_clean":"2024-09-21T07:28:48.910768+0000","last_became_active":"2024-09-21T07:28:47.907827+0000","last_became_peered":"2024-09-21T07:28:47.907827+0000","last_unstale":"2024-09-21T07:28:48.910768+0000","last_undegraded":"2024-09-21T07:28:48.910768+0000","last_fullsized":"2024-09-21T07:28:48.910768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:10.112945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780913+0000","last_change":"2024-09-21T07:28:47.899779+0000","last_active":"2024-09-21T07:28:49.780913+0000","last_peered":"2024-09-21T07:28:49.780913+0000","last_clean":"2024-09-21T07:28:49.780913+0000","last_became_active":"2024-09-21T07:28:47.899402+0000","last_became_peered":"2024-09-21T07:28:47.899402+0000","last_unstale":"2024-09-21T07:28:49.780913+0000","last_undegraded":"2024-09-21T07:28:49.780913+0000","last_fullsized":"2024-09-21T07:28:49.780913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:19.670326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780550+0000","last_change":"2024-09-21T07:28:47.912682+0000","last_active":"2024-09-21T07:28:49.780550+0000","last_peered":"2024-09-21T07:28:49.780550+0000","last_clean":"2024-09-21T07:28:49.780550+0000","last_became_active":"2024-09-21T07:28:47.912412+0000","last_became_peered":"2024-09-21T07:28:47.912412+0000","last_unstale":"2024-09-21T07:28:49.780550+0000","last_undegraded":"2024-09-21T07:28:49.780550+0000","last_fullsized":"2024-09-21T07:28:49.780550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:19.749502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780555+0000","last_change":"2024-09-21T07:28:47.918827+0000","last_active":"2024-09-21T07:28:49.780555+0000","last_peered":"2024-09-21T07:28:49.780555+0000","last_clean":"2024-09-21T07:28:49.780555+0000","last_became_active":"2024-09-21T07:28:47.918452+0000","last_became_peered":"2024-09-21T07:28:47.918452+0000","last_unstale":"2024-09-21T07:28:49.780555+0000","last_undegraded":"2024-09-21T07:28:49.780555+0000","last_fullsized":"2024-09-21T07:28:49.780555+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:59.435533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910354+0000","last_change":"2024-09-21T07:28:47.928895+0000","last_active":"2024-09-21T07:28:48.910354+0000","last_peered":"2024-09-21T07:28:48.910354+0000","last_clean":"2024-09-21T07:28:48.910354+0000","last_became_active":"2024-09-21T07:28:47.923800+0000","last_became_peered":"2024-09-21T07:28:47.923800+0000","last_unstale":"2024-09-21T07:28:48.910354+0000","last_undegraded":"2024-09-21T07:28:48.910354+0000","last_fullsized":"2024-09-21T07:28:48.910354+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:42.155252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779453+0000","last_change":"2024-09-21T07:28:47.926237+0000","last_active":"2024-09-21T07:28:49.779453+0000","last_peered":"2024-09-21T07:28:49.779453+0000","last_clean":"2024-09-21T07:28:49.779453+0000","last_became_active":"2024-09-21T07:28:47.924576+0000","last_became_peered":"2024-09-21T07:28:47.924576+0000","last_unstale":"2024-09-21T07:28:49.779453+0000","last_undegraded":"2024-09-21T07:28:49.779453+0000","last_fullsized":"2024-09-21T07:28:49.779453+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:57.554632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781129+0000","last_change":"2024-09-21T07:28:47.911536+0000","last_active":"2024-09-21T07:28:49.781129+0000","last_peered":"2024-09-21T07:28:49.781129+0000","last_clean":"2024-09-21T07:28:49.781129+0000","last_became_active":"2024-09-21T07:28:47.911187+0000","last_became_peered":"2024-09-21T07:28:47.911187+0000","last_unstale":"2024-09-21T07:28:49.781129+0000","last_undegraded":"2024-09-21T07:28:49.781129+0000","last_fullsized":"2024-09-21T07:28:49.781129+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.431983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781055+0000","last_change":"2024-09-21T07:28:47.906411+0000","last_active":"2024-09-21T07:28:49.781055+0000","last_peered":"2024-09-21T07:28:49.781055+0000","last_clean":"2024-09-21T07:28:49.781055+0000","last_became_active":"2024-09-21T07:28:47.906067+0000","last_became_peered":"2024-09-21T07:28:47.906067+0000","last_unstale":"2024-09-21T07:28:49.781055+0000","last_undegraded":"2024-09-21T07:28:49.781055+0000","last_fullsized":"2024-09-21T07:28:49.781055+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:32.680868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909140+0000","last_change":"2024-09-21T07:28:47.915624+0000","last_active":"2024-09-21T07:28:48.909140+0000","last_peered":"2024-09-21T07:28:48.909140+0000","last_clean":"2024-09-21T07:28:48.909140+0000","last_became_active":"2024-09-21T07:28:47.915009+0000","last_became_peered":"2024-09-21T07:28:47.915009+0000","last_unstale":"2024-09-21T07:28:48.909140+0000","last_undegraded":"2024-09-21T07:28:48.909140+0000","last_fullsized":"2024-09-21T07:28:48.909140+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:12.286376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909148+0000","last_change":"2024-09-21T07:28:47.913354+0000","last_active":"2024-09-21T07:28:48.909148+0000","last_peered":"2024-09-21T07:28:48.909148+0000","last_clean":"2024-09-21T07:28:48.909148+0000","last_became_active":"2024-09-21T07:28:47.909474+0000","last_became_peered":"2024-09-21T07:28:47.909474+0000","last_unstale":"2024-09-21T07:28:48.909148+0000","last_undegraded":"2024-09-21T07:28:48.909148+0000","last_fullsized":"2024-09-21T07:28:48.909148+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:32.680868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780653+0000","last_change":"2024-09-21T07:28:47.900617+0000","last_active":"2024-09-21T07:28:49.780653+0000","last_peered":"2024-09-21T07:28:49.780653+0000","last_clean":"2024-09-21T07:28:49.780653+0000","last_became_active":"2024-09-21T07:28:47.900247+0000","last_became_peered":"2024-09-21T07:28:47.900247+0000","last_unstale":"2024-09-21T07:28:49.780653+0000","last_undegraded":"2024-09-21T07:28:49.780653+0000","last_fullsized":"2024-09-21T07:28:49.780653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:46.912649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780478+0000","last_change":"2024-09-21T07:28:47.910233+0000","last_active":"2024-09-21T07:28:49.780478+0000","last_peered":"2024-09-21T07:28:49.780478+0000","last_clean":"2024-09-21T07:28:49.780478+0000","last_became_active":"2024-09-21T07:28:47.909944+0000","last_became_peered":"2024-09-21T07:28:47.909944+0000","last_unstale":"2024-09-21T07:28:49.780478+0000","last_undegraded":"2024-09-21T07:28:49.780478+0000","last_fullsized":"2024-09-21T07:28:49.780478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.255068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907892+0000","last_change":"2024-09-21T07:28:47.908638+0000","last_active":"2024-09-21T07:28:48.907892+0000","last_peered":"2024-09-21T07:28:48.907892+0000","last_clean":"2024-09-21T07:28:48.907892+0000","last_became_active":"2024-09-21T07:28:47.908022+0000","last_became_peered":"2024-09-21T07:28:47.908022+0000","last_unstale":"2024-09-21T07:28:48.907892+0000","last_undegraded":"2024-09-21T07:28:48.907892+0000","last_fullsized":"2024-09-21T07:28:48.907892+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:39.286347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780461+0000","last_change":"2024-09-21T07:28:47.905122+0000","last_active":"2024-09-21T07:28:49.780461+0000","last_peered":"2024-09-21T07:28:49.780461+0000","last_clean":"2024-09-21T07:28:49.780461+0000","last_became_active":"2024-09-21T07:28:47.904400+0000","last_became_peered":"2024-09-21T07:28:47.904400+0000","last_unstale":"2024-09-21T07:28:49.780461+0000","last_undegraded":"2024-09-21T07:28:49.780461+0000","last_fullsized":"2024-09-21T07:28:49.780461+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.125120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910480+0000","last_change":"2024-09-21T07:28:47.910292+0000","last_active":"2024-09-21T07:28:48.910480+0000","last_peered":"2024-09-21T07:28:48.910480+0000","last_clean":"2024-09-21T07:28:48.910480+0000","last_became_active":"2024-09-21T07:28:47.908775+0000","last_became_peered":"2024-09-21T07:28:47.908775+0000","last_unstale":"2024-09-21T07:28:48.910480+0000","last_undegraded":"2024-09-21T07:28:48.910480+0000","last_fullsized":"2024-09-21T07:28:48.910480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:40.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904038+0000","last_change":"2024-09-21T07:28:46.888058+0000","last_active":"2024-09-21T07:28:48.904038+0000","last_peered":"2024-09-21T07:28:48.904038+0000","last_clean":"2024-09-21T07:28:48.904038+0000","last_became_active":"2024-09-21T07:28:46.887743+0000","last_became_peered":"2024-09-21T07:28:46.887743+0000","last_unstale":"2024-09-21T07:28:48.904038+0000","last_undegraded":"2024-09-21T07:28:48.904038+0000","last_fullsized":"2024-09-21T07:28:48.904038+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:05.668245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779777+0000","last_change":"2024-09-21T07:28:47.907373+0000","last_active":"2024-09-21T07:28:49.779777+0000","last_peered":"2024-09-21T07:28:49.779777+0000","last_clean":"2024-09-21T07:28:49.779777+0000","last_became_active":"2024-09-21T07:28:47.907055+0000","last_became_peered":"2024-09-21T07:28:47.907055+0000","last_unstale":"2024-09-21T07:28:49.779777+0000","last_undegraded":"2024-09-21T07:28:49.779777+0000","last_fullsized":"2024-09-21T07:28:49.779777+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:12.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780925+0000","last_change":"2024-09-21T07:28:46.891115+0000","last_active":"2024-09-21T07:28:49.780925+0000","last_peered":"2024-09-21T07:28:49.780925+0000","last_clean":"2024-09-21T07:28:49.780925+0000","last_became_active":"2024-09-21T07:28:46.888955+0000","last_became_peered":"2024-09-21T07:28:46.888955+0000","last_unstale":"2024-09-21T07:28:49.780925+0000","last_undegraded":"2024-09-21T07:28:49.780925+0000","last_fullsized":"2024-09-21T07:28:49.780925+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:32.918833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780539+0000","last_change":"2024-09-21T07:28:47.911577+0000","last_active":"2024-09-21T07:28:49.780539+0000","last_peered":"2024-09-21T07:28:49.780539+0000","last_clean":"2024-09-21T07:28:49.780539+0000","last_became_active":"2024-09-21T07:28:47.911249+0000","last_became_peered":"2024-09-21T07:28:47.911249+0000","last_unstale":"2024-09-21T07:28:49.780539+0000","last_undegraded":"2024-09-21T07:28:49.780539+0000","last_fullsized":"2024-09-21T07:28:49.780539+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:39.286347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780777+0000","last_change":"2024-09-21T07:28:46.896939+0000","last_active":"2024-09-21T07:28:49.780777+0000","last_peered":"2024-09-21T07:28:49.780777+0000","last_clean":"2024-09-21T07:28:49.780777+0000","last_became_active":"2024-09-21T07:28:46.896614+0000","last_became_peered":"2024-09-21T07:28:46.896614+0000","last_unstale":"2024-09-21T07:28:49.780777+0000","last_undegraded":"2024-09-21T07:28:49.780777+0000","last_fullsized":"2024-09-21T07:28:49.780777+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:17.461355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908627+0000","last_change":"2024-09-21T07:28:47.911846+0000","last_active":"2024-09-21T07:28:48.908627+0000","last_peered":"2024-09-21T07:28:48.908627+0000","last_clean":"2024-09-21T07:28:48.908627+0000","last_became_active":"2024-09-21T07:28:47.911496+0000","last_became_peered":"2024-09-21T07:28:47.911496+0000","last_unstale":"2024-09-21T07:28:48.908627+0000","last_undegraded":"2024-09-21T07:28:48.908627+0000","last_fullsized":"2024-09-21T07:28:48.908627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:29.290949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779764+0000","last_change":"2024-09-21T07:28:46.892029+0000","last_active":"2024-09-21T07:28:49.779764+0000","last_peered":"2024-09-21T07:28:49.779764+0000","last_clean":"2024-09-21T07:28:49.779764+0000","last_became_active":"2024-09-21T07:28:46.890794+0000","last_became_peered":"2024-09-21T07:28:46.890794+0000","last_unstale":"2024-09-21T07:28:49.779764+0000","last_undegraded":"2024-09-21T07:28:49.779764+0000","last_fullsized":"2024-09-21T07:28:49.779764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:10.428281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903757+0000","last_change":"2024-09-21T07:28:47.919719+0000","last_active":"2024-09-21T07:28:48.903757+0000","last_peered":"2024-09-21T07:28:48.903757+0000","last_clean":"2024-09-21T07:28:48.903757+0000","last_became_active":"2024-09-21T07:28:47.919401+0000","last_became_peered":"2024-09-21T07:28:47.919401+0000","last_unstale":"2024-09-21T07:28:48.903757+0000","last_undegraded":"2024-09-21T07:28:48.903757+0000","last_fullsized":"2024-09-21T07:28:48.903757+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:53.523564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780163+0000","last_change":"2024-09-21T07:28:46.890476+0000","last_active":"2024-09-21T07:28:49.780163+0000","last_peered":"2024-09-21T07:28:49.780163+0000","last_clean":"2024-09-21T07:28:49.780163+0000","last_became_active":"2024-09-21T07:28:46.889808+0000","last_became_peered":"2024-09-21T07:28:46.889808+0000","last_unstale":"2024-09-21T07:28:49.780163+0000","last_undegraded":"2024-09-21T07:28:49.780163+0000","last_fullsized":"2024-09-21T07:28:49.780163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:00.328400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911040+0000","last_change":"2024-09-21T07:28:47.927957+0000","last_active":"2024-09-21T07:28:48.911040+0000","last_peered":"2024-09-21T07:28:48.911040+0000","last_clean":"2024-09-21T07:28:48.911040+0000","last_became_active":"2024-09-21T07:28:47.923536+0000","last_became_peered":"2024-09-21T07:28:47.923536+0000","last_unstale":"2024-09-21T07:28:48.911040+0000","last_undegraded":"2024-09-21T07:28:48.911040+0000","last_fullsized":"2024-09-21T07:28:48.911040+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:36.007477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907460+0000","last_change":"2024-09-21T07:28:46.892076+0000","last_active":"2024-09-21T07:28:48.907460+0000","last_peered":"2024-09-21T07:28:48.907460+0000","last_clean":"2024-09-21T07:28:48.907460+0000","last_became_active":"2024-09-21T07:28:46.891776+0000","last_became_peered":"2024-09-21T07:28:46.891776+0000","last_unstale":"2024-09-21T07:28:48.907460+0000","last_undegraded":"2024-09-21T07:28:48.907460+0000","last_fullsized":"2024-09-21T07:28:48.907460+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:50.841788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909626+0000","last_change":"2024-09-21T07:28:47.916369+0000","last_active":"2024-09-21T07:28:48.909626+0000","last_peered":"2024-09-21T07:28:48.909626+0000","last_clean":"2024-09-21T07:28:48.909626+0000","last_became_active":"2024-09-21T07:28:47.915960+0000","last_became_peered":"2024-09-21T07:28:47.915960+0000","last_unstale":"2024-09-21T07:28:48.909626+0000","last_undegraded":"2024-09-21T07:28:48.909626+0000","last_fullsized":"2024-09-21T07:28:48.909626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.803834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780232+0000","last_change":"2024-09-21T07:28:46.896318+0000","last_active":"2024-09-21T07:28:49.780232+0000","last_peered":"2024-09-21T07:28:49.780232+0000","last_clean":"2024-09-21T07:28:49.780232+0000","last_became_active":"2024-09-21T07:28:46.895997+0000","last_became_peered":"2024-09-21T07:28:46.895997+0000","last_unstale":"2024-09-21T07:28:49.780232+0000","last_undegraded":"2024-09-21T07:28:49.780232+0000","last_fullsized":"2024-09-21T07:28:49.780232+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:00.697429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.904029+0000","last_change":"2024-09-21T07:28:47.912614+0000","last_active":"2024-09-21T07:28:48.904029+0000","last_peered":"2024-09-21T07:28:48.904029+0000","last_clean":"2024-09-21T07:28:48.904029+0000","last_became_active":"2024-09-21T07:28:47.911410+0000","last_became_peered":"2024-09-21T07:28:47.911410+0000","last_unstale":"2024-09-21T07:28:48.904029+0000","last_undegraded":"2024-09-21T07:28:48.904029+0000","last_fullsized":"2024-09-21T07:28:48.904029+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:52.493508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903262+0000","last_change":"2024-09-21T07:28:46.882654+0000","last_active":"2024-09-21T07:28:48.903262+0000","last_peered":"2024-09-21T07:28:48.903262+0000","last_clean":"2024-09-21T07:28:48.903262+0000","last_became_active":"2024-09-21T07:28:46.881217+0000","last_became_peered":"2024-09-21T07:28:46.881217+0000","last_unstale":"2024-09-21T07:28:48.903262+0000","last_undegraded":"2024-09-21T07:28:48.903262+0000","last_fullsized":"2024-09-21T07:28:48.903262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:05.000983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910285+0000","last_change":"2024-09-21T07:28:47.913294+0000","last_active":"2024-09-21T07:28:48.910285+0000","last_peered":"2024-09-21T07:28:48.910285+0000","last_clean":"2024-09-21T07:28:48.910285+0000","last_became_active":"2024-09-21T07:28:47.909820+0000","last_became_peered":"2024-09-21T07:28:47.909820+0000","last_unstale":"2024-09-21T07:28:48.910285+0000","last_undegraded":"2024-09-21T07:28:48.910285+0000","last_fullsized":"2024-09-21T07:28:48.910285+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:04.040732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781110+0000","last_change":"2024-09-21T07:28:46.893078+0000","last_active":"2024-09-21T07:28:49.781110+0000","last_peered":"2024-09-21T07:28:49.781110+0000","last_clean":"2024-09-21T07:28:49.781110+0000","last_became_active":"2024-09-21T07:28:46.890767+0000","last_became_peered":"2024-09-21T07:28:46.890767+0000","last_unstale":"2024-09-21T07:28:49.781110+0000","last_undegraded":"2024-09-21T07:28:49.781110+0000","last_fullsized":"2024-09-21T07:28:49.781110+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:40.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779672+0000","last_change":"2024-09-21T07:28:47.906017+0000","last_active":"2024-09-21T07:28:49.779672+0000","last_peered":"2024-09-21T07:28:49.779672+0000","last_clean":"2024-09-21T07:28:49.779672+0000","last_became_active":"2024-09-21T07:28:47.905718+0000","last_became_peered":"2024-09-21T07:28:47.905718+0000","last_unstale":"2024-09-21T07:28:49.779672+0000","last_undegraded":"2024-09-21T07:28:49.779672+0000","last_fullsized":"2024-09-21T07:28:49.779672+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:25.822107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910764+0000","last_change":"2024-09-21T07:28:46.884544+0000","last_active":"2024-09-21T07:28:48.910764+0000","last_peered":"2024-09-21T07:28:48.910764+0000","last_clean":"2024-09-21T07:28:48.910764+0000","last_became_active":"2024-09-21T07:28:46.884216+0000","last_became_peered":"2024-09-21T07:28:46.884216+0000","last_unstale":"2024-09-21T07:28:48.910764+0000","last_undegraded":"2024-09-21T07:28:48.910764+0000","last_fullsized":"2024-09-21T07:28:48.910764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:37.671638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780482+0000","last_change":"2024-09-21T07:28:47.906617+0000","last_active":"2024-09-21T07:28:49.780482+0000","last_peered":"2024-09-21T07:28:49.780482+0000","last_clean":"2024-09-21T07:28:49.780482+0000","last_became_active":"2024-09-21T07:28:47.906308+0000","last_became_peered":"2024-09-21T07:28:47.906308+0000","last_unstale":"2024-09-21T07:28:49.780482+0000","last_undegraded":"2024-09-21T07:28:49.780482+0000","last_fullsized":"2024-09-21T07:28:49.780482+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:27.194464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"115'3","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779835+0000","last_change":"2024-09-21T07:28:46.888079+0000","last_active":"2024-09-21T07:28:49.779835+0000","last_peered":"2024-09-21T07:28:49.779835+0000","last_clean":"2024-09-21T07:28:49.779835+0000","last_became_active":"2024-09-21T07:28:46.887510+0000","last_became_peered":"2024-09-21T07:28:46.887510+0000","last_unstale":"2024-09-21T07:28:49.779835+0000","last_undegraded":"2024-09-21T07:28:49.779835+0000","last_fullsized":"2024-09-21T07:28:49.779835+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:49.233064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780173+0000","last_change":"2024-09-21T07:28:47.917591+0000","last_active":"2024-09-21T07:28:49.780173+0000","last_peered":"2024-09-21T07:28:49.780173+0000","last_clean":"2024-09-21T07:28:49.780173+0000","last_became_active":"2024-09-21T07:28:47.917142+0000","last_became_peered":"2024-09-21T07:28:47.917142+0000","last_unstale":"2024-09-21T07:28:49.780173+0000","last_undegraded":"2024-09-21T07:28:49.780173+0000","last_fullsized":"2024-09-21T07:28:49.780173+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.528664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"115'6","reported_seq":21,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909318+0000","last_change":"2024-09-21T07:28:46.885717+0000","last_active":"2024-09-21T07:28:48.909318+0000","last_peered":"2024-09-21T07:28:48.909318+0000","last_clean":"2024-09-21T07:28:48.909318+0000","last_became_active":"2024-09-21T07:28:46.885274+0000","last_became_peered":"2024-09-21T07:28:46.885274+0000","last_unstale":"2024-09-21T07:28:48.909318+0000","last_undegraded":"2024-09-21T07:28:48.909318+0000","last_fullsized":"2024-09-21T07:28:48.909318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:57.578325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908837+0000","last_change":"2024-09-21T07:28:47.908901+0000","last_active":"2024-09-21T07:28:48.908837+0000","last_peered":"2024-09-21T07:28:48.908837+0000","last_clean":"2024-09-21T07:28:48.908837+0000","last_became_active":"2024-09-21T07:28:47.908583+0000","last_became_peered":"2024-09-21T07:28:47.908583+0000","last_unstale":"2024-09-21T07:28:48.908837+0000","last_undegraded":"2024-09-21T07:28:48.908837+0000","last_fullsized":"2024-09-21T07:28:48.908837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:26.625208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780036+0000","last_change":"2024-09-21T07:28:46.890803+0000","last_active":"2024-09-21T07:28:49.780036+0000","last_peered":"2024-09-21T07:28:49.780036+0000","last_clean":"2024-09-21T07:28:49.780036+0000","last_became_active":"2024-09-21T07:28:46.890473+0000","last_became_peered":"2024-09-21T07:28:46.890473+0000","last_unstale":"2024-09-21T07:28:49.780036+0000","last_undegraded":"2024-09-21T07:28:49.780036+0000","last_fullsized":"2024-09-21T07:28:49.780036+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:17.947450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908487+0000","last_change":"2024-09-21T07:28:47.904756+0000","last_active":"2024-09-21T07:28:48.908487+0000","last_peered":"2024-09-21T07:28:48.908487+0000","last_clean":"2024-09-21T07:28:48.908487+0000","last_became_active":"2024-09-21T07:28:47.904104+0000","last_became_peered":"2024-09-21T07:28:47.904104+0000","last_unstale":"2024-09-21T07:28:48.908487+0000","last_undegraded":"2024-09-21T07:28:48.908487+0000","last_fullsized":"2024-09-21T07:28:48.908487+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:17.280239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903580+0000","last_change":"2024-09-21T07:28:46.884691+0000","last_active":"2024-09-21T07:28:48.903580+0000","last_peered":"2024-09-21T07:28:48.903580+0000","last_clean":"2024-09-21T07:28:48.903580+0000","last_became_active":"2024-09-21T07:28:46.884171+0000","last_became_peered":"2024-09-21T07:28:46.884171+0000","last_unstale":"2024-09-21T07:28:48.903580+0000","last_undegraded":"2024-09-21T07:28:48.903580+0000","last_fullsized":"2024-09-21T07:28:48.903580+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:25.992238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780970+0000","last_change":"2024-09-21T07:28:47.912903+0000","last_active":"2024-09-21T07:28:49.780970+0000","last_peered":"2024-09-21T07:28:49.780970+0000","last_clean":"2024-09-21T07:28:49.780970+0000","last_became_active":"2024-09-21T07:28:47.911494+0000","last_became_peered":"2024-09-21T07:28:47.911494+0000","last_unstale":"2024-09-21T07:28:49.780970+0000","last_undegraded":"2024-09-21T07:28:49.780970+0000","last_fullsized":"2024-09-21T07:28:49.780970+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:03.071894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780065+0000","last_change":"2024-09-21T07:28:46.876770+0000","last_active":"2024-09-21T07:28:49.780065+0000","last_peered":"2024-09-21T07:28:49.780065+0000","last_clean":"2024-09-21T07:28:49.780065+0000","last_became_active":"2024-09-21T07:28:46.875744+0000","last_became_peered":"2024-09-21T07:28:46.875744+0000","last_unstale":"2024-09-21T07:28:49.780065+0000","last_undegraded":"2024-09-21T07:28:49.780065+0000","last_fullsized":"2024-09-21T07:28:49.780065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:50.218565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911117+0000","last_change":"2024-09-21T07:28:47.921326+0000","last_active":"2024-09-21T07:28:48.911117+0000","last_peered":"2024-09-21T07:28:48.911117+0000","last_clean":"2024-09-21T07:28:48.911117+0000","last_became_active":"2024-09-21T07:28:47.920667+0000","last_became_peered":"2024-09-21T07:28:47.920667+0000","last_unstale":"2024-09-21T07:28:48.911117+0000","last_undegraded":"2024-09-21T07:28:48.911117+0000","last_fullsized":"2024-09-21T07:28:48.911117+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.123531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"115'8","reported_seq":23,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779834+0000","last_change":"2024-09-21T07:28:46.897169+0000","last_active":"2024-09-21T07:28:49.779834+0000","last_peered":"2024-09-21T07:28:49.779834+0000","last_clean":"2024-09-21T07:28:49.779834+0000","last_became_active":"2024-09-21T07:28:46.896393+0000","last_became_peered":"2024-09-21T07:28:46.896393+0000","last_unstale":"2024-09-21T07:28:49.779834+0000","last_undegraded":"2024-09-21T07:28:49.779834+0000","last_fullsized":"2024-09-21T07:28:49.779834+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:23.843420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780740+0000","last_change":"2024-09-21T07:28:47.901836+0000","last_active":"2024-09-21T07:28:49.780740+0000","last_peered":"2024-09-21T07:28:49.780740+0000","last_clean":"2024-09-21T07:28:49.780740+0000","last_became_active":"2024-09-21T07:28:47.901364+0000","last_became_peered":"2024-09-21T07:28:47.901364+0000","last_unstale":"2024-09-21T07:28:49.780740+0000","last_undegraded":"2024-09-21T07:28:49.780740+0000","last_fullsized":"2024-09-21T07:28:49.780740+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:12.132687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909540+0000","last_change":"2024-09-21T07:28:46.882380+0000","last_active":"2024-09-21T07:28:48.909540+0000","last_peered":"2024-09-21T07:28:48.909540+0000","last_clean":"2024-09-21T07:28:48.909540+0000","last_became_active":"2024-09-21T07:28:46.881937+0000","last_became_peered":"2024-09-21T07:28:46.881937+0000","last_unstale":"2024-09-21T07:28:48.909540+0000","last_undegraded":"2024-09-21T07:28:48.909540+0000","last_fullsized":"2024-09-21T07:28:48.909540+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:14.166047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908074+0000","last_change":"2024-09-21T07:28:47.914022+0000","last_active":"2024-09-21T07:28:48.908074+0000","last_peered":"2024-09-21T07:28:48.908074+0000","last_clean":"2024-09-21T07:28:48.908074+0000","last_became_active":"2024-09-21T07:28:47.908127+0000","last_became_peered":"2024-09-21T07:28:47.908127+0000","last_unstale":"2024-09-21T07:28:48.908074+0000","last_undegraded":"2024-09-21T07:28:48.908074+0000","last_fullsized":"2024-09-21T07:28:48.908074+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:04.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779945+0000","last_change":"2024-09-21T07:28:46.886058+0000","last_active":"2024-09-21T07:28:49.779945+0000","last_peered":"2024-09-21T07:28:49.779945+0000","last_clean":"2024-09-21T07:28:49.779945+0000","last_became_active":"2024-09-21T07:28:46.885703+0000","last_became_peered":"2024-09-21T07:28:46.885703+0000","last_unstale":"2024-09-21T07:28:49.779945+0000","last_undegraded":"2024-09-21T07:28:49.779945+0000","last_fullsized":"2024-09-21T07:28:49.779945+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:46.703847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779825+0000","last_change":"2024-09-21T07:28:47.917850+0000","last_active":"2024-09-21T07:28:49.779825+0000","last_peered":"2024-09-21T07:28:49.779825+0000","last_clean":"2024-09-21T07:28:49.779825+0000","last_became_active":"2024-09-21T07:28:47.917553+0000","last_became_peered":"2024-09-21T07:28:47.917553+0000","last_unstale":"2024-09-21T07:28:49.779825+0000","last_undegraded":"2024-09-21T07:28:49.779825+0000","last_fullsized":"2024-09-21T07:28:49.779825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:37.604492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908898+0000","last_change":"2024-09-21T07:28:46.893222+0000","last_active":"2024-09-21T07:28:48.908898+0000","last_peered":"2024-09-21T07:28:48.908898+0000","last_clean":"2024-09-21T07:28:48.908898+0000","last_became_active":"2024-09-21T07:28:46.892871+0000","last_became_peered":"2024-09-21T07:28:46.892871+0000","last_unstale":"2024-09-21T07:28:48.908898+0000","last_undegraded":"2024-09-21T07:28:48.908898+0000","last_fullsized":"2024-09-21T07:28:48.908898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:02.655986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910653+0000","last_change":"2024-09-21T07:28:47.902101+0000","last_active":"2024-09-21T07:28:48.910653+0000","last_peered":"2024-09-21T07:28:48.910653+0000","last_clean":"2024-09-21T07:28:48.910653+0000","last_became_active":"2024-09-21T07:28:47.901808+0000","last_became_peered":"2024-09-21T07:28:47.901808+0000","last_unstale":"2024-09-21T07:28:48.910653+0000","last_undegraded":"2024-09-21T07:28:48.910653+0000","last_fullsized":"2024-09-21T07:28:48.910653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:14.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780787+0000","last_change":"2024-09-21T07:28:46.874879+0000","last_active":"2024-09-21T07:28:49.780787+0000","last_peered":"2024-09-21T07:28:49.780787+0000","last_clean":"2024-09-21T07:28:49.780787+0000","last_became_active":"2024-09-21T07:28:46.874565+0000","last_became_peered":"2024-09-21T07:28:46.874565+0000","last_unstale":"2024-09-21T07:28:49.780787+0000","last_undegraded":"2024-09-21T07:28:49.780787+0000","last_fullsized":"2024-09-21T07:28:49.780787+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:48.965066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.911002+0000","last_change":"2024-09-21T07:28:47.919620+0000","last_active":"2024-09-21T07:28:48.911002+0000","last_peered":"2024-09-21T07:28:48.911002+0000","last_clean":"2024-09-21T07:28:48.911002+0000","last_became_active":"2024-09-21T07:28:47.919314+0000","last_became_peered":"2024-09-21T07:28:47.919314+0000","last_unstale":"2024-09-21T07:28:48.911002+0000","last_undegraded":"2024-09-21T07:28:48.911002+0000","last_fullsized":"2024-09-21T07:28:48.911002+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:52.894145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780076+0000","last_change":"2024-09-21T07:28:46.879572+0000","last_active":"2024-09-21T07:28:49.780076+0000","last_peered":"2024-09-21T07:28:49.780076+0000","last_clean":"2024-09-21T07:28:49.780076+0000","last_became_active":"2024-09-21T07:28:46.879265+0000","last_became_peered":"2024-09-21T07:28:46.879265+0000","last_unstale":"2024-09-21T07:28:49.780076+0000","last_undegraded":"2024-09-21T07:28:49.780076+0000","last_fullsized":"2024-09-21T07:28:49.780076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:10.068025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903867+0000","last_change":"2024-09-21T07:28:47.908921+0000","last_active":"2024-09-21T07:28:48.903867+0000","last_peered":"2024-09-21T07:28:48.903867+0000","last_clean":"2024-09-21T07:28:48.903867+0000","last_became_active":"2024-09-21T07:28:47.907608+0000","last_became_peered":"2024-09-21T07:28:47.907608+0000","last_unstale":"2024-09-21T07:28:48.903867+0000","last_undegraded":"2024-09-21T07:28:48.903867+0000","last_fullsized":"2024-09-21T07:28:48.903867+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:32.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908065+0000","last_change":"2024-09-21T07:28:46.885919+0000","last_active":"2024-09-21T07:28:48.908065+0000","last_peered":"2024-09-21T07:28:48.908065+0000","last_clean":"2024-09-21T07:28:48.908065+0000","last_became_active":"2024-09-21T07:28:46.885595+0000","last_became_peered":"2024-09-21T07:28:46.885595+0000","last_unstale":"2024-09-21T07:28:48.908065+0000","last_undegraded":"2024-09-21T07:28:48.908065+0000","last_fullsized":"2024-09-21T07:28:48.908065+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:54.184304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781078+0000","last_change":"2024-09-21T07:28:47.922450+0000","last_active":"2024-09-21T07:28:49.781078+0000","last_peered":"2024-09-21T07:28:49.781078+0000","last_clean":"2024-09-21T07:28:49.781078+0000","last_became_active":"2024-09-21T07:28:47.922157+0000","last_became_peered":"2024-09-21T07:28:47.922157+0000","last_unstale":"2024-09-21T07:28:49.781078+0000","last_undegraded":"2024-09-21T07:28:49.781078+0000","last_fullsized":"2024-09-21T07:28:49.781078+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:27.064032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780857+0000","last_change":"2024-09-21T07:28:46.882372+0000","last_active":"2024-09-21T07:28:49.780857+0000","last_peered":"2024-09-21T07:28:49.780857+0000","last_clean":"2024-09-21T07:28:49.780857+0000","last_became_active":"2024-09-21T07:28:46.882005+0000","last_became_peered":"2024-09-21T07:28:46.882005+0000","last_unstale":"2024-09-21T07:28:49.780857+0000","last_undegraded":"2024-09-21T07:28:49.780857+0000","last_fullsized":"2024-09-21T07:28:49.780857+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:38.599732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910215+0000","last_change":"2024-09-21T07:28:47.903666+0000","last_active":"2024-09-21T07:28:48.910215+0000","last_peered":"2024-09-21T07:28:48.910215+0000","last_clean":"2024-09-21T07:28:48.910215+0000","last_became_active":"2024-09-21T07:28:47.903170+0000","last_became_peered":"2024-09-21T07:28:47.903170+0000","last_unstale":"2024-09-21T07:28:48.910215+0000","last_undegraded":"2024-09-21T07:28:48.910215+0000","last_fullsized":"2024-09-21T07:28:48.910215+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:43.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781077+0000","last_change":"2024-09-21T07:28:46.893022+0000","last_active":"2024-09-21T07:28:49.781077+0000","last_peered":"2024-09-21T07:28:49.781077+0000","last_clean":"2024-09-21T07:28:49.781077+0000","last_became_active":"2024-09-21T07:28:46.892553+0000","last_became_peered":"2024-09-21T07:28:46.892553+0000","last_unstale":"2024-09-21T07:28:49.781077+0000","last_undegraded":"2024-09-21T07:28:49.781077+0000","last_fullsized":"2024-09-21T07:28:49.781077+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:23.356753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779913+0000","last_change":"2024-09-21T07:28:47.902818+0000","last_active":"2024-09-21T07:28:49.779913+0000","last_peered":"2024-09-21T07:28:49.779913+0000","last_clean":"2024-09-21T07:28:49.779913+0000","last_became_active":"2024-09-21T07:28:47.902462+0000","last_became_peered":"2024-09-21T07:28:47.902462+0000","last_unstale":"2024-09-21T07:28:49.779913+0000","last_undegraded":"2024-09-21T07:28:49.779913+0000","last_fullsized":"2024-09-21T07:28:49.779913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:42.139423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"116'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.910872+0000","last_change":"2024-09-21T07:28:46.889175+0000","last_active":"2024-09-21T07:28:48.910872+0000","last_peered":"2024-09-21T07:28:48.910872+0000","last_clean":"2024-09-21T07:28:48.910872+0000","last_became_active":"2024-09-21T07:28:46.888896+0000","last_became_peered":"2024-09-21T07:28:46.888896+0000","last_unstale":"2024-09-21T07:28:48.910872+0000","last_undegraded":"2024-09-21T07:28:48.910872+0000","last_fullsized":"2024-09-21T07:28:48.910872+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:58.169441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.903518+0000","last_change":"2024-09-21T07:28:47.906846+0000","last_active":"2024-09-21T07:28:48.903518+0000","last_peered":"2024-09-21T07:28:48.903518+0000","last_clean":"2024-09-21T07:28:48.903518+0000","last_became_active":"2024-09-21T07:28:47.906481+0000","last_became_peered":"2024-09-21T07:28:47.906481+0000","last_unstale":"2024-09-21T07:28:48.903518+0000","last_undegraded":"2024-09-21T07:28:48.903518+0000","last_fullsized":"2024-09-21T07:28:48.903518+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:22.833963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908470+0000","last_change":"2024-09-21T07:28:46.883777+0000","last_active":"2024-09-21T07:28:48.908470+0000","last_peered":"2024-09-21T07:28:48.908470+0000","last_clean":"2024-09-21T07:28:48.908470+0000","last_became_active":"2024-09-21T07:28:46.883424+0000","last_became_peered":"2024-09-21T07:28:46.883424+0000","last_unstale":"2024-09-21T07:28:48.908470+0000","last_undegraded":"2024-09-21T07:28:48.908470+0000","last_fullsized":"2024-09-21T07:28:48.908470+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:00.697429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908420+0000","last_change":"2024-09-21T07:28:47.907315+0000","last_active":"2024-09-21T07:28:48.908420+0000","last_peered":"2024-09-21T07:28:48.908420+0000","last_clean":"2024-09-21T07:28:48.908420+0000","last_became_active":"2024-09-21T07:28:47.906988+0000","last_became_peered":"2024-09-21T07:28:47.906988+0000","last_unstale":"2024-09-21T07:28:48.908420+0000","last_undegraded":"2024-09-21T07:28:48.908420+0000","last_fullsized":"2024-09-21T07:28:48.908420+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:04.292694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779918+0000","last_change":"2024-09-21T07:28:46.892079+0000","last_active":"2024-09-21T07:28:49.779918+0000","last_peered":"2024-09-21T07:28:49.779918+0000","last_clean":"2024-09-21T07:28:49.779918+0000","last_became_active":"2024-09-21T07:28:46.891517+0000","last_became_peered":"2024-09-21T07:28:46.891517+0000","last_unstale":"2024-09-21T07:28:49.779918+0000","last_undegraded":"2024-09-21T07:28:49.779918+0000","last_fullsized":"2024-09-21T07:28:49.779918+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.145844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780474+0000","last_change":"2024-09-21T07:28:47.923145+0000","last_active":"2024-09-21T07:28:49.780474+0000","last_peered":"2024-09-21T07:28:49.780474+0000","last_clean":"2024-09-21T07:28:49.780474+0000","last_became_active":"2024-09-21T07:28:47.922854+0000","last_became_peered":"2024-09-21T07:28:47.922854+0000","last_unstale":"2024-09-21T07:28:49.780474+0000","last_undegraded":"2024-09-21T07:28:49.780474+0000","last_fullsized":"2024-09-21T07:28:49.780474+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.038794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780583+0000","last_change":"2024-09-21T07:28:46.888820+0000","last_active":"2024-09-21T07:28:49.780583+0000","last_peered":"2024-09-21T07:28:49.780583+0000","last_clean":"2024-09-21T07:28:49.780583+0000","last_became_active":"2024-09-21T07:28:46.884193+0000","last_became_peered":"2024-09-21T07:28:46.884193+0000","last_unstale":"2024-09-21T07:28:49.780583+0000","last_undegraded":"2024-09-21T07:28:49.780583+0000","last_fullsized":"2024-09-21T07:28:49.780583+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:14.166047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780788+0000","last_change":"2024-09-21T07:28:47.921885+0000","last_active":"2024-09-21T07:28:49.780788+0000","last_peered":"2024-09-21T07:28:49.780788+0000","last_clean":"2024-09-21T07:28:49.780788+0000","last_became_active":"2024-09-21T07:28:47.921491+0000","last_became_peered":"2024-09-21T07:28:47.921491+0000","last_unstale":"2024-09-21T07:28:49.780788+0000","last_undegraded":"2024-09-21T07:28:49.780788+0000","last_fullsized":"2024-09-21T07:28:49.780788+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:53.490752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780274+0000","last_change":"2024-09-21T07:28:46.875287+0000","last_active":"2024-09-21T07:28:49.780274+0000","last_peered":"2024-09-21T07:28:49.780274+0000","last_clean":"2024-09-21T07:28:49.780274+0000","last_became_active":"2024-09-21T07:28:46.874980+0000","last_became_peered":"2024-09-21T07:28:46.874980+0000","last_unstale":"2024-09-21T07:28:49.780274+0000","last_undegraded":"2024-09-21T07:28:49.780274+0000","last_fullsized":"2024-09-21T07:28:49.780274+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:40.175060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.780288+0000","last_change":"2024-09-21T07:28:47.918367+0000","last_active":"2024-09-21T07:28:49.780288+0000","last_peered":"2024-09-21T07:28:49.780288+0000","last_clean":"2024-09-21T07:28:49.780288+0000","last_became_active":"2024-09-21T07:28:47.917528+0000","last_became_peered":"2024-09-21T07:28:47.917528+0000","last_unstale":"2024-09-21T07:28:49.780288+0000","last_undegraded":"2024-09-21T07:28:49.780288+0000","last_fullsized":"2024-09-21T07:28:49.780288+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.020490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.908185+0000","last_change":"2024-09-21T07:28:46.885131+0000","last_active":"2024-09-21T07:28:48.908185+0000","last_peered":"2024-09-21T07:28:48.908185+0000","last_clean":"2024-09-21T07:28:48.908185+0000","last_became_active":"2024-09-21T07:28:46.884760+0000","last_became_peered":"2024-09-21T07:28:46.884760+0000","last_unstale":"2024-09-21T07:28:48.908185+0000","last_undegraded":"2024-09-21T07:28:48.908185+0000","last_fullsized":"2024-09-21T07:28:48.908185+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:19.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.909168+0000","last_change":"2024-09-21T07:28:47.917501+0000","last_active":"2024-09-21T07:28:48.909168+0000","last_peered":"2024-09-21T07:28:48.909168+0000","last_clean":"2024-09-21T07:28:48.909168+0000","last_became_active":"2024-09-21T07:28:47.917074+0000","last_became_peered":"2024-09-21T07:28:47.917074+0000","last_unstale":"2024-09-21T07:28:48.909168+0000","last_undegraded":"2024-09-21T07:28:48.909168+0000","last_fullsized":"2024-09-21T07:28:48.909168+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:14.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781002+0000","last_change":"2024-09-21T07:28:46.887554+0000","last_active":"2024-09-21T07:28:49.781002+0000","last_peered":"2024-09-21T07:28:49.781002+0000","last_clean":"2024-09-21T07:28:49.781002+0000","last_became_active":"2024-09-21T07:28:46.887005+0000","last_became_peered":"2024-09-21T07:28:46.887005+0000","last_unstale":"2024-09-21T07:28:49.781002+0000","last_undegraded":"2024-09-21T07:28:49.781002+0000","last_fullsized":"2024-09-21T07:28:49.781002+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:36.632995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:48.907468+0000","last_change":"2024-09-21T07:28:47.922140+0000","last_active":"2024-09-21T07:28:48.907468+0000","last_peered":"2024-09-21T07:28:48.907468+0000","last_clean":"2024-09-21T07:28:48.907468+0000","last_became_active":"2024-09-21T07:28:47.921764+0000","last_became_peered":"2024-09-21T07:28:47.921764+0000","last_unstale":"2024-09-21T07:28:48.907468+0000","last_undegraded":"2024-09-21T07:28:48.907468+0000","last_fullsized":"2024-09-21T07:28:48.907468+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:46.860677+0000","last_clean_scrub_stamp":"2024-09-21T07:28:46.860677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.781094+0000","last_change":"2024-09-21T07:28:46.879025+0000","last_active":"2024-09-21T07:28:49.781094+0000","last_peered":"2024-09-21T07:28:49.781094+0000","last_clean":"2024-09-21T07:28:49.781094+0000","last_became_active":"2024-09-21T07:28:46.878672+0000","last_became_peered":"2024-09-21T07:28:46.878672+0000","last_unstale":"2024-09-21T07:28:49.781094+0000","last_undegraded":"2024-09-21T07:28:49.781094+0000","last_fullsized":"2024-09-21T07:28:49.781094+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:45.849509+0000","last_clean_scrub_stamp":"2024-09-21T07:28:45.849509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:31.720531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":282,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T07:28:49.779632+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:28:49.779632+0000","last_peered":"2024-09-21T07:28:49.779632+0000","last_clean":"2024-09-21T07:28:49.779632+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:28:49.779632+0000","last_undegraded":"2024-09-21T07:28:49.779632+0000","last_fullsized":"2024-09-21T07:28:49.779632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509519,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40924,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330916,"statfs":{"total":96636764160,"available":96594857984,"internally_reserved":0,"allocated":1449984,"data_stored":673406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":671190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":671282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509519,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":1433600,"data_stored":671224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1433600,"data_stored":671224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41500,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2039808,"data_stored":1263260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542223,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37332,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334508,"statfs":{"total":96636764160,"available":96598536192,"internally_reserved":0,"allocated":2031616,"data_stored":1261718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1433600,"data_stored":671772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:28:57.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:28:57.187 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 -- 172.21.15.64:0/1251423776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 msgr2=0x7ff32c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 --2- 172.21.15.64:0/1251423776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff32c003ef0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c470 tx=0x7ff33801cfa0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff346800640 1 -- 172.21.15.64:0/1251423776 reap_dead start 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 -- 172.21.15.64:0/1251423776 shutdown_connections 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 -- 172.21.15.64:0/1251423776 >> 172.21.15.64:0/1251423776 conn(0x7ff3480ccbe0 msgr2=0x7ff3480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 -- 172.21.15.64:0/1251423776 shutdown_connections 2024-09-21T07:28:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.391+0000 7ff34d200640 1 -- 172.21.15.64:0/1251423776 wait complete. 2024-09-21T07:28:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 Processor -- start 2024-09-21T07:28:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- start start 2024-09-21T07:28:57.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff34815c5e0 0x7ff3480c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348159400 0x7ff348074160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff34806eea0 con 0x7ff32c003a80 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3480afa40 con 0x7ff348159400 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff34806f020 con 0x7ff34815c5e0 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42850/0 (socket says 172.21.15.64:42850) 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 -- 172.21.15.64:0/3675203021 learned_addr learned my addr 172.21.15.64:0/3675203021 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff33fe00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff34815c5e0 0x7ff3480c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff346800640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348159400 0x7ff348074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 -- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff34815c5e0 msgr2=0x7ff3480c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff34815c5e0 0x7ff3480c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 -- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348159400 msgr2=0x7ff348074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348159400 0x7ff348074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 -- 172.21.15.64:0/3675203021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3481fc010 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff345e00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff33801d480 tx=0x7ff338006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338001690 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff338001920 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338003860 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3481fc2f0 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.395+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3481fc8b0 con 0x7ff32c003a80 2024-09-21T07:28:57.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3480c4220 con 0x7ff32c003a80 2024-09-21T07:28:57.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff338003a00 con 0x7ff32c003a80 2024-09-21T07:28:57.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff33e000640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 0x7ff324075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7ff33812e910 con 0x7ff32c003a80 2024-09-21T07:28:57.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff33fe00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 0x7ff324075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.399+0000 7ff33fe00640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 0x7ff324075740 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff3480c6b80 tx=0x7ff3300091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.403+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff3480b2530 con 0x7ff32c003a80 2024-09-21T07:28:57.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.647+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff3481f86f0 con 0x7ff32c003a80 2024-09-21T07:28:57.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.651+0000 7ff33e000640 1 -- 172.21.15.64:0/3675203021 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7ff3380f92a0 con 0x7ff32c003a80 2024-09-21T07:28:57.652 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:28:57.652 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:28:57.653 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:28:57.653 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:28:57.653 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:28:57.653 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 msgr2=0x7ff324075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 0x7ff324075740 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff3480c6b80 tx=0x7ff3300091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 msgr2=0x7ff34814c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff33801d480 tx=0x7ff338006f40 comp rx=0 tx=0).stop 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 shutdown_connections 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff324073230 0x7ff324075740 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348159400 0x7ff348074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff34815c5e0 0x7ff3480c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 --2- 172.21.15.64:0/3675203021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff32c003a80 0x7ff34814c740 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 >> 172.21.15.64:0/3675203021 conn(0x7ff3480ccbe0 msgr2=0x7ff3480ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 shutdown_connections 2024-09-21T07:28:57.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.655+0000 7ff34d200640 1 -- 172.21.15.64:0/3675203021 wait complete. 2024-09-21T07:28:57.675 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 -- 172.21.15.64:0/1604902682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380709b0 msgr2=0x7f7f380b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1604902682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380709b0 0x7f7f380b41c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f7f3806f220 tx=0x7f7f2001c7e0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 -- 172.21.15.64:0/1604902682 shutdown_connections 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1604902682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380709b0 0x7f7f380b41c0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1604902682 >> v2:172.21.15.90:3300/0 conn(0x7f7f3815edb0 0x7f7f380700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.831+0000 7f7f3e400640 1 -- 172.21.15.64:0/1604902682 >> 172.21.15.64:0/1604902682 conn(0x7f7f380ccbe0 msgr2=0x7f7f380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- 172.21.15.64:0/1604902682 shutdown_connections 2024-09-21T07:28:57.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- 172.21.15.64:0/1604902682 wait complete. 2024-09-21T07:28:57.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 Processor -- start 2024-09-21T07:28:57.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- start start 2024-09-21T07:28:57.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 0x7f7f3815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 0x7f7f3815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38168fc0 con 0x7f7f380b4700 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38168e40 con 0x7f7f3815edb0 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f3e400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7f38169140 con 0x7f7f380709b0 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.835+0000 7f7f2ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42880/0 (socket says 172.21.15.64:42880) 2024-09-21T07:28:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 -- 172.21.15.64:0/1220264062 learned_addr learned my addr 172.21.15.64:0/1220264062 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:57.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f37e00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 0x7f7f3815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 -- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 msgr2=0x7f7f3815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f37400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 0x7f7f3815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 0x7f7f3815a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 -- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 msgr2=0x7f7f3815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 0x7f7f3815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 -- 172.21.15.64:0/1220264062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f381fc840 con 0x7f7f380b4700 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f37e00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 0x7f7f3815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f37400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 0x7f7f3815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2ea00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f7f20000c10 tx=0x7f7f200a6b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:57.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200bd070 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f20004120 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20005030 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f381fcb20 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f381fd0e0 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f380b41c0 con 0x7f7f380b4700 2024-09-21T07:28:57.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.839+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f200051d0 con 0x7f7f380b4700 2024-09-21T07:28:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.843+0000 7f7f2fe00640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.843+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f7f2012e070 con 0x7f7f380b4700 2024-09-21T07:28:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.843+0000 7f7f37400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.843+0000 7f7f37400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f28005fd0 tx=0x7f7f28005dc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:57.847+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7f200163d0 con 0x7f7f380b4700 2024-09-21T07:28:58.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f3809da20 con 0x7f7f380b4700 2024-09-21T07:28:58.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f2fe00640 1 -- 172.21.15.64:0/1220264062 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5225 (secure 0 0 0) 0x7f7f200f8ef0 con 0x7f7f380b4700 2024-09-21T07:28:58.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:28:58.061 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":84,"btime":"2024-09-21T07:28:50:907861+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:28:50.332785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:28:58.061 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 84 2024-09-21T07:28:58.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 msgr2=0x7f7f14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f28005fd0 tx=0x7f7f28005dc0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 msgr2=0x7f7f3815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f7f20000c10 tx=0x7f7f200a6b70 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 shutdown_connections 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f14073200 0x7f7f14075710 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3815edb0 0x7f7f3815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f380b4700 0x7f7f3815c610 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 --2- 172.21.15.64:0/1220264062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f380709b0 0x7f7f3815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 >> 172.21.15.64:0/1220264062 conn(0x7f7f380ccbe0 msgr2=0x7f7f38159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.059+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 shutdown_connections 2024-09-21T07:28:58.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.063+0000 7f7f3e400640 1 -- 172.21.15.64:0/1220264062 wait complete. 2024-09-21T07:28:58.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:28:47.303639+0000', 'modified': '2024-09-21T07:28:50.332785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7707': {'gid': 7707, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/1340585715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 1340585715}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1340585715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7707, 'qdb_cluster': [7707]} 2024-09-21T07:28:58.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:28:58.486 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:28:58.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- 172.21.15.64:0/1996771233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 msgr2=0x7f39f80b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 --2- 172.21.15.64:0/1996771233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f80b33d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f39ec005fd0 tx=0x7f39ec01c820 comp rx=0 tx=0).stop 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- 172.21.15.64:0/1996771233 shutdown_connections 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 --2- 172.21.15.64:0/1996771233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80ce900 0x7f39f806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 --2- 172.21.15.64:0/1996771233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f80b33d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- 172.21.15.64:0/1996771233 >> 172.21.15.64:0/1996771233 conn(0x7f39f806d450 msgr2=0x7f39f80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- 172.21.15.64:0/1996771233 shutdown_connections 2024-09-21T07:28:58.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- 172.21.15.64:0/1996771233 wait complete. 2024-09-21T07:28:58.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 Processor -- start 2024-09-21T07:28:58.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.647+0000 7f3a00000640 1 -- start start 2024-09-21T07:28:58.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80b3910 0x7f39f81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f80ce900 0x7f39f815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8169000 con 0x7f39f809df30 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8168e80 con 0x7f39f80ce900 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f39f8169180 con 0x7f39f80b3910 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42900/0 (socket says 172.21.15.64:42900) 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 -- 172.21.15.64:0/750605922 learned_addr learned my addr 172.21.15.64:0/750605922 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fe000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f80ce900 0x7f39f815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fcc00640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80b3910 0x7f39f81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 -- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80b3910 msgr2=0x7f39f81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80b3910 0x7f39f81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 -- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f80ce900 msgr2=0x7f39f815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f80ce900 0x7f39f815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 -- 172.21.15.64:0/750605922 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f815ea40 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39fd600640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f39ec01d0c0 tx=0x7f39ec003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39f5600640 1 -- 172.21.15.64:0/750605922 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec005030 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39f5600640 1 -- 172.21.15.64:0/750605922 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39ec0052c0 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f81fc330 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39f5600640 1 -- 172.21.15.64:0/750605922 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0054b0 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f81f97e0 con 0x7f39f809df30 2024-09-21T07:28:58.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.651+0000 7f39f5600640 1 -- 172.21.15.64:0/750605922 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f39ec0bd020 con 0x7f39f809df30 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39f5600640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 0x7f39d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39f5600640 1 -- 172.21.15.64:0/750605922 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f39ec12e900 con 0x7f39f809df30 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fcc00640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 0x7f39d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 Processor -- start 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 -- start start 2024-09-21T07:28:58.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fcc00640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 0x7f39d8075710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39f80c8f70 tx=0x7f39e4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 0x55d99e24b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99e0fa950 0x55d99e24bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d99e120410 con 0x55d99e0e3ca0 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d99e05db40 con 0x55d99dd0a460 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d99e04cf70 con 0x55d99e0fa950 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 0x55d99e24b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42904/0 (socket says 172.21.15.64:42904) 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 -- 172.21.15.64:0/2649015276 learned_addr learned my addr 172.21.15.64:0/2649015276 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fcc00640 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99e0fa950 0x55d99e24bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 -- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99e0fa950 msgr2=0x55d99e24bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99e0fa950 0x55d99e24bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 -- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 msgr2=0x55d99e24b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 0x55d99e24b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 -- 172.21.15.64:0/2649015276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e0145b0 con 0x55d99e0e3ca0 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fd600640 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 0x55d99e24b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.655+0000 7f39fe000640 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009e30 tx=0x7f39f0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a810148ccf3275a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f39e9c00640 1 -- 172.21.15.64:0/2649015276 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0016070 con 0x55d99e0e3ca0 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f39e9c00640 1 -- 172.21.15.64:0/2649015276 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39f001b750 con 0x55d99e0e3ca0 2024-09-21T07:28:58.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f39e9c00640 1 -- 172.21.15.64:0/2649015276 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f001bb40 con 0x55d99e0e3ca0 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- 172.21.15.64:0/2649015276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 msgr2=0x55d99e24c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009e30 tx=0x7f39f0010740 comp rx=0 tx=0).stop 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- 172.21.15.64:0/2649015276 shutdown_connections 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e24c120 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99e0fa950 0x55d99e24bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- 172.21.15.64:0/2649015276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99dd0a460 0x55d99e24b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- 172.21.15.64:0/2649015276 >> 172.21.15.64:0/2649015276 conn(0x55d99e1d0d90 msgr2=0x55d99e200690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- 172.21.15.64:0/2649015276 shutdown_connections 2024-09-21T07:28:58.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- 172.21.15.64:0/2649015276 wait complete. 2024-09-21T07:28:58.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- start start 2024-09-21T07:28:58.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 Processor -- start 2024-09-21T07:28:58.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e252920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 0x55d99e252e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d99dfe75f0 con 0x55d99e0fa950 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d99e050d80 con 0x55d99e0e3ca0 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d99dff3520 con 0x55d99dd0a460 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.659+0000 7f3a0771a000 10 client.0 _ll_register_callbacks cb 0x55d99dff7830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42914/0 (socket says 172.21.15.64:42914) 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 -- 172.21.15.64:0/1691068300 learned_addr learned my addr 172.21.15.64:0/1691068300 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fcc00640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 0x55d99e252e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fd600640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e252920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 -- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 msgr2=0x55d99e252920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e252920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 -- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 msgr2=0x55d99e252e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 0x55d99e252e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 -- 172.21.15.64:0/1691068300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99dfeb190 con 0x55d99e0fa950 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fd600640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e252920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fcc00640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 0x55d99e252e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:28:58.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fe000640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x55d99e0577e0 tx=0x7f39f0013710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae9175f2e5a218e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0021070 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f39f0013d10 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d99dfe5110 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f39f002f050 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 10 client.7881 fetch_fsmap learned FSMap version 84 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d99e0d1f10 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d99dfe5110 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f39f0032020 con 0x55d99e0fa950 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 10 client.7881 fetch_fsmap finished waiting for FSMap version 84 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 10 client.7881 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 20 client.7881 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99dcef7d0 0x55d99e25cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 4 client.7881 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:28:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d99e05fa90 con 0x55d99dcef7d0 2024-09-21T07:28:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fd600640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99dcef7d0 0x55d99e25cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39fd600640 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99dcef7d0 0x55d99e25cd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152fab4c847000ff server_cookie=8a62ac33fea6bc86 in_seq=0 out_seq=0 2024-09-21T07:28:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 10 client.7881 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 1 -- 172.21.15.64:0/1691068300 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d99e05fa90 con 0x55d99dcef7d0 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f39de000640 10 client.7881 handle_command_reply: tid=0 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 client.7881 shutdown 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 msgr2=0x55d99e2533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.663+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x55d99e0577e0 tx=0x7f39f0013710 comp rx=0 tx=0).stop 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 shutdown_connections 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0fa950 0x55d99e2533a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0e3ca0 0x55d99e252e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99dcef7d0 0x55d99e25cd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1691068300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e252920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 >> 172.21.15.64:0/1691068300 conn(0x55d99e1d0d90 msgr2=0x55d99e207440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f39de000640 0 client.7881 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:28:58.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 shutdown_connections 2024-09-21T07:28:58.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 1 -- 172.21.15.64:0/1691068300 wait complete. 2024-09-21T07:28:58.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.667+0000 7f3a0771a000 20 client.7881 trim_cache size 0 max 16384 2024-09-21T07:28:58.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.683+0000 7f3a0771a000 1 Processor -- start 2024-09-21T07:28:58.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.683+0000 7f3a0771a000 1 -- start start 2024-09-21T07:28:58.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e2bd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e2be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8205780 con 0x55d99e0e3ca0 2024-09-21T07:28:58.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8204870 con 0x55d99e0fa950 2024-09-21T07:28:58.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f39f8073a30 con 0x55d99dd0a460 2024-09-21T07:28:58.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42920/0 (socket says 172.21.15.64:42920) 2024-09-21T07:28:58.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 -- 172.21.15.64:0/256095775 learned_addr learned my addr 172.21.15.64:0/256095775 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fe000640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e2be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fd600640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e2bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 -- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 msgr2=0x55d99e2bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e2bd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 -- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 msgr2=0x55d99e2be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e2be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 -- 172.21.15.64:0/256095775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e0a8db0 con 0x55d99e0e3ca0 2024-09-21T07:28:58.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fe000640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e2be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:58.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39fcc00640 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f39e40054f0 tx=0x7f39e4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0e36bdae201dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39e9200640 1 -- 172.21.15.64:0/256095775 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4029070 con 0x55d99e0e3ca0 2024-09-21T07:28:58.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39e9200640 1 -- 172.21.15.64:0/256095775 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39e400e7a0 con 0x55d99e0e3ca0 2024-09-21T07:28:58.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f39e9200640 1 -- 172.21.15.64:0/256095775 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e400e9b0 con 0x55d99e0e3ca0 2024-09-21T07:28:58.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- 172.21.15.64:0/256095775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 msgr2=0x55d99e2bdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f39e40054f0 tx=0x7f39e4012000 comp rx=0 tx=0).stop 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- 172.21.15.64:0/256095775 shutdown_connections 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e2be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99e0e3ca0 0x55d99e2bdb70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 --2- 172.21.15.64:0/256095775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e2bd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- 172.21.15.64:0/256095775 >> 172.21.15.64:0/256095775 conn(0x55d99e1d0d90 msgr2=0x55d99e1ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- 172.21.15.64:0/256095775 shutdown_connections 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.687+0000 7f3a0771a000 1 -- 172.21.15.64:0/256095775 wait complete. 2024-09-21T07:28:58.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- start start 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 Processor -- start 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e27cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e27d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d99e05c910 con 0x55d99dcdd830 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d99e0d1a80 con 0x55d99e0fa950 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d99e050090 con 0x55d99dd0a460 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 10 client.0 _ll_register_callbacks cb 0x7f39ec0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42936/0 (socket says 172.21.15.64:42936) 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 -- 172.21.15.64:0/1725793299 learned_addr learned my addr 172.21.15.64:0/1725793299 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fcc00640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e27d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fd600640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e27cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 -- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 msgr2=0x55d99e27cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e27cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 -- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 msgr2=0x55d99e27d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e27d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 -- 172.21.15.64:0/1725793299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99e013ab0 con 0x55d99dcdd830 2024-09-21T07:28:58.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39fe000640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f39f00256b0 tx=0x7f39f00256e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d44fbc242c6b3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037020 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f39f001b460 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e400e7a0 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f39f0041050 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 10 client.7887 fetch_fsmap learned FSMap version 84 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d99dff2070 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39e400e7a0 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f39f0044020 con 0x55d99dcdd830 2024-09-21T07:28:58.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 10 client.7887 fetch_fsmap finished waiting for FSMap version 84 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 10 client.7887 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 20 client.7887 populate_metadata read hostname 'smithi064' 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99e27e010 0x55d99e2c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 4 client.7887 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.691+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "status"}) -- 0x55d99e05b540 con 0x55d99e27e010 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39fd600640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99e27e010 0x55d99e2c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39fd600640 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99e27e010 0x55d99e2c96b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92683f8c2aa96430 server_cookie=ad965a221d983313 in_seq=0 out_seq=0 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39de000640 10 client.7887 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39de000640 1 -- 172.21.15.64:0/1725793299 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55d99e05b540 con 0x55d99e27e010 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39de000640 10 client.7887 handle_command_reply: tid=0 2024-09-21T07:28:58.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 client.7887 shutdown 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 msgr2=0x55d99e27d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f39f00256b0 tx=0x7f39f00256e0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 shutdown_connections 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d99dcdd830 0x55d99e27d6b0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d99e0fa950 0x55d99e27d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55d99e27e010 0x55d99e2c96b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 --2- 172.21.15.64:0/1725793299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d99dd0a460 0x55d99e27cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 >> 172.21.15.64:0/1725793299 conn(0x55d99e1d0d90 msgr2=0x55d99e200690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f39de000640 0 client.7887 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 shutdown_connections 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 1 -- 172.21.15.64:0/1725793299 wait complete. 2024-09-21T07:28:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a0771a000 20 client.7887 trim_cache size 0 max 16384 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 7707, 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.801465273, 2024-09-21T07:28:58.712 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 84, 2024-09-21T07:28:58.713 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 116, 2024-09-21T07:28:58.713 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 116, 2024-09-21T07:28:58.713 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.251843142 2024-09-21T07:28:58.713 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 msgr2=0x7f39d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 0x7f39d8075710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39f80c8f70 tx=0x7f39e4009040 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 msgr2=0x7f39f815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f39ec01d0c0 tx=0x7f39ec003de0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 shutdown_connections 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f39d8073200 0x7f39d8075710 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f80ce900 0x7f39f815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39f80b3910 0x7f39f81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 --2- 172.21.15.64:0/750605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39f809df30 0x7f39f815e210 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 >> 172.21.15.64:0/750605922 conn(0x7f39f806d450 msgr2=0x7f39f80c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 shutdown_connections 2024-09-21T07:28:58.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.695+0000 7f3a00000640 1 -- 172.21.15.64:0/750605922 wait complete. 2024-09-21T07:28:58.716 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 -- 172.21.15.64:0/3844434680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9874005160 msgr2=0x7f987400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 --2- 172.21.15.64:0/3844434680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9874005160 0x7f987400b9d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f98900afb50 tx=0x7f988801d610 comp rx=0 tx=0).stop 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f988f400640 1 -- 172.21.15.64:0/3844434680 reap_dead start 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 -- 172.21.15.64:0/3844434680 shutdown_connections 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 -- 172.21.15.64:0/3844434680 >> 172.21.15.64:0/3844434680 conn(0x7f98900ccbe0 msgr2=0x7f98900ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 -- 172.21.15.64:0/3844434680 shutdown_connections 2024-09-21T07:28:58.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 -- 172.21.15.64:0/3844434680 wait complete. 2024-09-21T07:28:58.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.875+0000 7f9895e00640 1 Processor -- start 2024-09-21T07:28:58.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- start start 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9874005160 0x7f98900c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98900b1f20 0x7f98900b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9890072e20 con 0x7f989015d830 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98900b4ae0 con 0x7f98900b1f20 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9890072fa0 con 0x7f9874005160 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42962/0 (socket says 172.21.15.64:42962) 2024-09-21T07:28:58.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 -- 172.21.15.64:0/4282762913 learned_addr learned my addr 172.21.15.64:0/4282762913 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f988ea00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9874005160 0x7f98900c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f988f400640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98900b1f20 0x7f98900b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 -- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9874005160 msgr2=0x7f98900c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9874005160 0x7f98900c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 -- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98900b1f20 msgr2=0x7f98900b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98900b1f20 0x7f98900b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 -- 172.21.15.64:0/4282762913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98900b2870 con 0x7f989015d830 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9886000640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9878001060 tx=0x7f98780066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878015070 con 0x7f989015d830 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9878011920 con 0x7f989015d830 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98900c7940 con 0x7f989015d830 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878011d70 con 0x7f989015d830 2024-09-21T07:28:58.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98900c7f00 con 0x7f989015d830 2024-09-21T07:28:58.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.879+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98900700b0 con 0x7f989015d830 2024-09-21T07:28:58.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.883+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9878018070 con 0x7f989015d830 2024-09-21T07:28:58.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.883+0000 7f9887e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 0x7f986c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:58.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.883+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f98780951e0 con 0x7f989015d830 2024-09-21T07:28:58.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.883+0000 7f988ea00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 0x7f986c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:58.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.883+0000 7f988ea00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 0x7f986c075710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9880009470 tx=0x7f98800091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:58.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:58.887+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f98900b2870 con 0x7f989015d830 2024-09-21T07:28:59.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f98900c76d0 con 0x7f989015d830 2024-09-21T07:28:59.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9887e00640 1 -- 172.21.15.64:0/4282762913 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7f987805fa30 con 0x7f989015d830 2024-09-21T07:28:59.104 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:28:59.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 msgr2=0x7f986c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:59.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 0x7f986c075710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9880009470 tx=0x7f98800091e0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 msgr2=0x7f989015cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:59.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9878001060 tx=0x7f98780066c0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 shutdown_connections 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f986c073200 0x7f986c075710 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98900b1f20 0x7f98900b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989015d830 0x7f989015cfb0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 --2- 172.21.15.64:0/4282762913 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9874005160 0x7f98900c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 >> 172.21.15.64:0/4282762913 conn(0x7f98900ccbe0 msgr2=0x7f98900cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 shutdown_connections 2024-09-21T07:28:59.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59.103+0000 7f9895e00640 1 -- 172.21.15.64:0/4282762913 wait complete. 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:28:59.127 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:59.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.127 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:28:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:28:59.136 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:28:59.136 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.137 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42044sec preferred_lft 42044sec 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.138 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:28:59.139 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:28:59.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.140 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:28:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:28:59.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.206 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:59.262 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:28:59.263 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:28:59.263 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:28:59.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:28:59.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:59.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.402 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:28:59.411 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:28:59.411 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:28:59.412 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:59.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.412 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:28:59.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:28:59.478 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:59.534 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:28:59.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:28:59.535 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:59.586 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:28:59.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:59.688 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:59.688 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:28:59.703 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:28:59.703 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:28:59.703 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:28:59.703 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:28:59.703 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:28:59.707 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:28:59.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:28:59.707 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:28:59.728 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:28:59.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:28:59.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:28:59.835 INFO:teuthology.orchestra.run.smithi064.stdout:client7896 2024-09-21T07:28:59.835 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:28:59.835 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:28:59.844 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-21T07:29:00.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- 172.21.15.64:0/4183893084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe10006ec70 msgr2=0x7fe100158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:00.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 --2- 172.21.15.64:0/4183893084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe10006ec70 0x7fe100158db0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe1000c3c50 tx=0x7fe0f001c800 comp rx=0 tx=0).stop 2024-09-21T07:29:00.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- 172.21.15.64:0/4183893084 shutdown_connections 2024-09-21T07:29:00.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 --2- 172.21.15.64:0/4183893084 >> v2:172.21.15.90:3300/0 conn(0x7fe1001592f0 0x7fe1000aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 --2- 172.21.15.64:0/4183893084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe10006ec70 0x7fe100158db0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- 172.21.15.64:0/4183893084 >> 172.21.15.64:0/4183893084 conn(0x7fe1000d0170 msgr2=0x7fe1000d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:00.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- 172.21.15.64:0/4183893084 shutdown_connections 2024-09-21T07:29:00.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- 172.21.15.64:0/4183893084 wait complete. 2024-09-21T07:29:00.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 Processor -- start 2024-09-21T07:29:00.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.047+0000 7fe107c00640 1 -- start start 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe10006ec70 0x7fe100155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1000af360 0x7fe10006f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe10015c810 con 0x7fe1001592f0 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe10015c690 con 0x7fe10006ec70 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe10015c990 con 0x7fe1000af360 2024-09-21T07:29:00.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:00.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42982/0 (socket says 172.21.15.64:42982) 2024-09-21T07:29:00.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 -- 172.21.15.64:0/3742999433 learned_addr learned my addr 172.21.15.64:0/3742999433 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:00.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105200640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe10006ec70 0x7fe100155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:00.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe0f7e00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1000af360 0x7fe10006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 -- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1000af360 msgr2=0x7fe10006f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1000af360 0x7fe10006f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 -- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe10006ec70 msgr2=0x7fe100155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe10006ec70 0x7fe100155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 -- 172.21.15.64:0/3742999433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1000caed0 con 0x7fe1001592f0 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe105c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c6b0 tx=0x7fe0f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003b80 con 0x7fe1001592f0 2024-09-21T07:29:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0f8003d40 con 0x7fe1001592f0 2024-09-21T07:29:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8005330 con 0x7fe1001592f0 2024-09-21T07:29:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1000cb340 con 0x7fe1001592f0 2024-09-21T07:29:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1001f9390 con 0x7fe1001592f0 2024-09-21T07:29:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.051+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe100158db0 con 0x7fe1001592f0 2024-09-21T07:29:00.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.055+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0f80054d0 con 0x7fe1001592f0 2024-09-21T07:29:00.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.055+0000 7fe0fd600640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 0x7fe0dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:00.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.055+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fe0f8094a20 con 0x7fe1001592f0 2024-09-21T07:29:00.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.055+0000 7fe105200640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 0x7fe0dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:00.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.055+0000 7fe105200640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 0x7fe0dc075710 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00af000 tx=0x7fe0f001b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:00.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.059+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe0f805f360 con 0x7fe1001592f0 2024-09-21T07:29:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.271+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe1000cb0a0 con 0x7fe1001592f0 2024-09-21T07:29:00.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.955+0000 7fe0fd600640 1 -- 172.21.15.64:0/3742999433 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v85) ==== 167+0+0 (secure 0 0 0) 0x7fe0f8063d90 con 0x7fe1001592f0 2024-09-21T07:29:00.957 INFO:teuthology.orchestra.run.smithi064.stderr:enabled new snapshots 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 msgr2=0x7fe0dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 0x7fe0dc075710 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00af000 tx=0x7fe0f001b040 comp rx=0 tx=0).stop 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 msgr2=0x7fe10006fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c6b0 tx=0x7fe0f800cb70 comp rx=0 tx=0).stop 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 shutdown_connections 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0dc073200 0x7fe0dc075710 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1001592f0 0x7fe10006fa40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1000af360 0x7fe10006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 --2- 172.21.15.64:0/3742999433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe10006ec70 0x7fe100155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:00.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 >> 172.21.15.64:0/3742999433 conn(0x7fe1000d0170 msgr2=0x7fe10015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:00.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 shutdown_connections 2024-09-21T07:29:00.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:00.959+0000 7fe107c00640 1 -- 172.21.15.64:0/3742999433 wait complete. 2024-09-21T07:29:00.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:00.984 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-21T07:29:01.002 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:29:01.002 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:29:01.055 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:29:01.055 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:29:01.055 DEBUG:teuthology.orchestra.run.smithi064:> import uuid 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> n = 2000 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = False 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> if 3 > 0: 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = True 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> dpath = os.path.dirname(path) 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> fnameprefix = os.path.basename(path) 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:29:01.056 DEBUG:teuthology.orchestra.run.smithi064:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> for i in range(n): 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> f.write(f"{i}") 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> f.flush() 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(f.fileno()) 2024-09-21T07:29:01.057 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> os.unlink(fpath) 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> if create_hard_links: 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> for j in range(3): 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> finally: 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> os.close(dirfd) 2024-09-21T07:29:01.058 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:29:09.723 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:09.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:25.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:29:25.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:25.430 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-21T07:29:25.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:25.667 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-21T07:29:39.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:39.795 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:56.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:56.626 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-21T07:29:56.658 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- 172.21.15.64:0/99170917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 msgr2=0x7fe0dc0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 --2- 172.21.15.64:0/99170917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc0b3ce0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc070eb0 tx=0x7fe0d801cc90 comp rx=0 tx=0).stop 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- 172.21.15.64:0/99170917 shutdown_connections 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 --2- 172.21.15.64:0/99170917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc0b3ce0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 --2- 172.21.15.64:0/99170917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0ca990 0x7fe0dc06ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 --2- 172.21.15.64:0/99170917 >> v2:172.21.15.90:3300/0 conn(0x7fe0dc15ec20 0x7fe0dc0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- 172.21.15.64:0/99170917 >> 172.21.15.64:0/99170917 conn(0x7fe0dc0ccbe0 msgr2=0x7fe0dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- 172.21.15.64:0/99170917 shutdown_connections 2024-09-21T07:29:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- 172.21.15.64:0/99170917 wait complete. 2024-09-21T07:29:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 Processor -- start 2024-09-21T07:29:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.866+0000 7fe0e4800640 1 -- start start 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0ca990 0x7fe0dc073640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc15ec20 0x7fe0dc073b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0b24c0 con 0x7fe0dc0704f0 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0b2340 con 0x7fe0dc0ca990 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc0b2640 con 0x7fe0dc15ec20 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49326/0 (socket says 172.21.15.64:49326) 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 -- 172.21.15.64:0/2439774814 learned_addr learned my addr 172.21.15.64:0/2439774814 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1400640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0ca990 0x7fe0dc073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e2800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc15ec20 0x7fe0dc073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 -- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc15ec20 msgr2=0x7fe0dc073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc15ec20 0x7fe0dc073b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 -- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0ca990 msgr2=0x7fe0dc073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0ca990 0x7fe0dc073640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 -- 172.21.15.64:0/2439774814 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc165040 con 0x7fe0dc0704f0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d750 tx=0x7fe0d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0d6000640 1 -- 172.21.15.64:0/2439774814 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0017070 con 0x7fe0dc0704f0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0d6000640 1 -- 172.21.15.64:0/2439774814 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d0009cc0 con 0x7fe0dc0704f0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc165320 con 0x7fe0dc0704f0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0d6000640 1 -- 172.21.15.64:0/2439774814 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000de60 con 0x7fe0dc0704f0 2024-09-21T07:29:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.870+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1658e0 con 0x7fe0dc0704f0 2024-09-21T07:29:56.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0d6000640 1 -- 172.21.15.64:0/2439774814 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0d001a070 con 0x7fe0dc0704f0 2024-09-21T07:29:56.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0d6000640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 0x7fe0c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0ebf23000 1 Processor -- start 2024-09-21T07:29:56.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0d6000640 1 -- 172.21.15.64:0/2439774814 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fe0d0094510 con 0x7fe0dc0704f0 2024-09-21T07:29:56.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0ebf23000 1 -- start start 2024-09-21T07:29:56.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0e1400640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 0x7fe0c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.874+0000 7fe0e1400640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 0x7fe0c0075710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5020 tx=0x7fe0cc00b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbf221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf22720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cbcd62e0 con 0x5610cbdd1630 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5610cbd33bb0 con 0x5610cbdaf170 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5610cbd22fe0 con 0x5610cbdc2ab0 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49328/0 (socket says 172.21.15.64:49328) 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 -- 172.21.15.64:0/316178190 learned_addr learned my addr 172.21.15.64:0/316178190 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1400640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbf221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e2800640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf22720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 -- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 msgr2=0x5610cbf221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbf221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 -- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 msgr2=0x5610cbf22720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf22720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 -- 172.21.15.64:0/316178190 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cbcc11c0 con 0x5610cbdd1630 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1400640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbf221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d720 tx=0x7fe0d005acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4425f5c71ffa283 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ca600640 1 -- 172.21.15.64:0/316178190 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0063070 con 0x5610cbdd1630 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ca600640 1 -- 172.21.15.64:0/316178190 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d0063750 con 0x5610cbdd1630 2024-09-21T07:29:56.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ca600640 1 -- 172.21.15.64:0/316178190 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0021070 con 0x5610cbdd1630 2024-09-21T07:29:56.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- 172.21.15.64:0/316178190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 msgr2=0x5610cbf21ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d720 tx=0x7fe0d005acf0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- 172.21.15.64:0/316178190 shutdown_connections 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf22720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbf221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/316178190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf21ca0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- 172.21.15.64:0/316178190 >> 172.21.15.64:0/316178190 conn(0x5610cb9e0d20 msgr2=0x5610cbed6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- 172.21.15.64:0/316178190 shutdown_connections 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- 172.21.15.64:0/316178190 wait complete. 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 -- start start 2024-09-21T07:29:56.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.878+0000 7fe0ebf23000 1 Processor -- start 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf0d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbf0def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cbcc84f0 con 0x5610cbdc2ab0 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5610cbd26df0 con 0x5610cbdaf170 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5610cb9e8620 con 0x5610cbdd1630 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 10 client.0 _ll_register_callbacks cb 0x5610cbcf9cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49330/0 (socket says 172.21.15.64:49330) 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 -- 172.21.15.64:0/1320233847 learned_addr learned my addr 172.21.15.64:0/1320233847 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e2800640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbf0def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf0d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 -- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 msgr2=0x5610cbf0def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbf0def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 -- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 msgr2=0x5610cbf0d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf0d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 -- 172.21.15.64:0/1320233847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cbdf2740 con 0x5610cbdc2ab0 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e2800640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbf0def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf0d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc011770 tx=0x7fe0cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e3bac5be690d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc01e700 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fe0cc029c90 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5610cbcbb300 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe0cc01e8a0 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 10 client.7914 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x5610cbda8440 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5610cbcbb300 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fe0cc030050 con 0x5610cbdc2ab0 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 10 client.7914 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 10 client.7914 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:56.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 20 client.7914 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9c58d0 0x5610cbf33260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 4 client.7914 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610cbd35b00 con 0x5610cb9c58d0 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.882+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9c58d0 0x5610cbf33260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9c58d0 0x5610cbf33260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe004b7f92e46c8 server_cookie=861766503c20d836 in_seq=0 out_seq=0 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0bea00640 10 client.7914 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0bea00640 1 -- 172.21.15.64:0/1320233847 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5610cbd35b00 con 0x5610cb9c58d0 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0bea00640 10 client.7914 handle_command_reply: tid=0 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 client.7914 shutdown 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 msgr2=0x5610cbf0d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc011770 tx=0x7fe0cc004740 comp rx=0 tx=0).stop 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 shutdown_connections 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9c58d0 0x5610cbf33260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbf0def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdc2ab0 0x5610cbf0d9b0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1320233847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbf0d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 >> 172.21.15.64:0/1320233847 conn(0x5610cb9e0d20 msgr2=0x5610cbed6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0bea00640 0 client.7914 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 shutdown_connections 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1320233847 wait complete. 2024-09-21T07:29:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.886+0000 7fe0ebf23000 20 client.7914 trim_cache size 0 max 16384 2024-09-21T07:29:56.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.902+0000 7fe0ebf23000 1 Processor -- start 2024-09-21T07:29:56.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.902+0000 7fe0ebf23000 1 -- start start 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdc2ab0 0x5610cbed6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbed67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cbedc710 con 0x5610cbdaf170 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc205a50 con 0x5610cbdc2ab0 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc204a90 con 0x5610cbdd1630 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49346/0 (socket says 172.21.15.64:49346) 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 -- 172.21.15.64:0/3820738439 learned_addr learned my addr 172.21.15.64:0/3820738439 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e2800640 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbed67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1400640 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdc2ab0 0x5610cbed6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 -- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 msgr2=0x5610cbed67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbed67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 -- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdc2ab0 msgr2=0x5610cbed6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdc2ab0 0x5610cbed6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 -- 172.21.15.64:0/3820738439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cbd7fb00 con 0x5610cbdaf170 2024-09-21T07:29:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe0d005ea20 tx=0x7fe0d000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf636fe6753f7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0c9c00640 1 -- 172.21.15.64:0/3820738439 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0021040 con 0x5610cbdaf170 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0c9c00640 1 -- 172.21.15.64:0/3820738439 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d004c400 con 0x5610cbdaf170 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0c9c00640 1 -- 172.21.15.64:0/3820738439 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0063040 con 0x5610cbdaf170 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- 172.21.15.64:0/3820738439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 msgr2=0x5610cbeda410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe0d005ea20 tx=0x7fe0d000b5b0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- 172.21.15.64:0/3820738439 shutdown_connections 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdd1630 0x5610cbed67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdc2ab0 0x5610cbed6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/3820738439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdaf170 0x5610cbeda410 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- 172.21.15.64:0/3820738439 >> 172.21.15.64:0/3820738439 conn(0x5610cb9e0d20 msgr2=0x5610cbf20c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- 172.21.15.64:0/3820738439 shutdown_connections 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- 172.21.15.64:0/3820738439 wait complete. 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 -- start start 2024-09-21T07:29:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.906+0000 7fe0ebf23000 1 Processor -- start 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbed9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbed98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cbd26df0 con 0x5610cbdd1630 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5610cbd26100 con 0x5610cbdaf170 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5610cbcce040 con 0x5610cbdc2ab0 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 10 client.0 _ll_register_callbacks cb 0x7fe0cc010ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:56.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbed9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49348/0 (socket says 172.21.15.64:49348) 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e2800640 1 -- 172.21.15.64:0/1529722744 learned_addr learned my addr 172.21.15.64:0/1529722744 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbed98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 -- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 msgr2=0x5610cbed98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbed98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 -- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 msgr2=0x5610cbf53780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 -- 172.21.15.64:0/1529722744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cbced060 con 0x5610cbdaf170 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e2800640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1e00640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbed9360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0d005eee0 tx=0x7fe0d005abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3daef5425c483ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0021040 con 0x5610cbdaf170 2024-09-21T07:29:56.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fe0d00940b0 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d004c400 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe0d005b370 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 10 client.7588 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x5610cbcb9640 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d004c400 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fe0d005df80 con 0x5610cbdaf170 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 10 client.7588 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 10 client.7588 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 20 client.7588 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9b3930 0x5610cbf54140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 4 client.7588 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5610cbd315b0 con 0x5610cb9b3930 2024-09-21T07:29:56.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9b3930 0x5610cbf54140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0e1400640 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9b3930 0x5610cbf54140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64bf3f95fcd3d2f2 server_cookie=bd984e083df7b7a0 in_seq=0 out_seq=0 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.910+0000 7fe0bea00640 10 client.7588 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0bea00640 1 -- 172.21.15.64:0/1529722744 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18084 (crc 0 0 0) 0x5610cbd315b0 con 0x5610cb9b3930 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0bea00640 10 client.7588 handle_command_reply: tid=0 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 client.7588 shutdown 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 msgr2=0x5610cbed9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbed9360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0d005eee0 tx=0x7fe0d005abc0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 shutdown_connections 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cbdd1630 0x5610cbf53780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x5610cb9b3930 0x5610cbf54140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610cbdc2ab0 0x5610cbed98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 --2- 172.21.15.64:0/1529722744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610cbdaf170 0x5610cbed9360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 >> 172.21.15.64:0/1529722744 conn(0x5610cb9e0d20 msgr2=0x5610cbf32c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0bea00640 0 client.7588 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 shutdown_connections 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 1 -- 172.21.15.64:0/1529722744 wait complete. 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0ebf23000 20 client.7588 trim_cache size 0 max 16384 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 940, 2024-09-21T07:29:56.918 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 941, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 421618, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 9588697, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 9, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 3, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.155529721, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.078599005, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.028938020, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.036929310, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 940, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.319062527, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000339428 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.919 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000364, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000182 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1694, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1687, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 535961, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 25895516, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-21T07:29:56.920 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.273121486, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.149120786, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.056681410, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.057557186, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1687, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.417226447, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000247318 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.921 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 127328, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 20208 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 29174, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 51509, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 10453490, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 70649929, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 8, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 5.764850410, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 3.664647922, 2024-09-21T07:29:56.922 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 3.323369010, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.081297188, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 51507, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.829543578, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000035520 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 72604, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.020127651, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000277 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 81888 2024-09-21T07:29:56.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1456, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 18.196653677, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.012497701 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-21T07:29:56.924 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1682, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.910220175, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000541153 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 25553, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 25553, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 25553, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 354.770299167, 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.013883704 2024-09-21T07:29:56.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 12, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 19820, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 19820, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 19819, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-21T07:29:56.926 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 135, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 135, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 46415, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 45830, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 108, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-21T07:29:56.927 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-09-21T07:29:56.928 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 1354, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 4045, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 3644, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 2654, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 40, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 14111 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-21T07:29:56.929 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 2000, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 165, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 4135, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 1704, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 2191, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:29:56.930 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 26867, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-21T07:29:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 26867, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 41, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 41, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 4, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 93120847, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2704, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 104.224764179, 2024-09-21T07:29:56.932 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.038544661 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 2014, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 2014, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 0, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 13, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 13, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 0, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 19820, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 19821, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 1, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 135, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 4994, 2024-09-21T07:29:56.933 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 4859, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 183316, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 407789568 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 28500, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 25553, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 4, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2000, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.774189516, 2024-09-21T07:29:56.934 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000887094 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 29, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.004557861, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000157167 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6000, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 7.631598690, 2024-09-21T07:29:56.935 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001271933 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7319, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 5.609769758, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000766466 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.936 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.937 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000077712, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000077712 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.004265319, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.004265319 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.938 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.210989031, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.210989031 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000094196, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000094196 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8, 2024-09-21T07:29:56.939 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.745722634, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.093215329 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2191, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 318.280699989, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.145267320 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-21T07:29:56.940 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.021122838, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.021122838 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.941 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000293863, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000293863 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.942 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.943 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8000, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 20.486917760, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002560864 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-21T07:29:56.944 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 1, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 1, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 17872, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 17872, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 53, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:29:56.945 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:29:56.946 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:29:56.947 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 16453494, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 4142, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 5520, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 78, 2024-09-21T07:29:56.948 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 19946366, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 830288, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 4627, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 89386696, 2024-09-21T07:29:56.949 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 29, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 4627, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4627, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 24.527780854, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.005301011 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 4627, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 4725 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 4627, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 40, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 4587, 2024-09-21T07:29:56.950 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 11, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 40, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 2744, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 27, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 1704, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 33, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-21T07:29:56.951 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 22, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-21T07:29:56.952 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 118, 2024-09-21T07:29:56.953 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 3, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 8, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 8, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 112, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 32 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-21T07:29:56.954 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 32, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 32, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 1704, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 1704, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 31804, 2024-09-21T07:29:56.955 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 8543687, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 31804, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 31804, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 8543687, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:29:56.956 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4627, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 89572432, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4627, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 89572432, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.957 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 4627, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 4627, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 4627, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 4627, 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:29:56.958 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 1704, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 185736, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 1704, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:29:56.959 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 40, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 185736, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x558ae8dab380": { 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 84, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 26867, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 88926543, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 26867, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:29:56.960 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2704, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 88926459, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 msgr2=0x7fe0c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 0x7fe0c0075710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5020 tx=0x7fe0cc00b260 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 msgr2=0x7fe0dc1f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d750 tx=0x7fe0d000dc10 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 shutdown_connections 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0c0073200 0x7fe0c0075710 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc15ec20 0x7fe0dc073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0ca990 0x7fe0dc073640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 --2- 172.21.15.64:0/2439774814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc0704f0 0x7fe0dc1f9260 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 >> 172.21.15.64:0/2439774814 conn(0x7fe0dc0ccbe0 msgr2=0x7fe0dc15b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 shutdown_connections 2024-09-21T07:29:56.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:56.914+0000 7fe0e4800640 1 -- 172.21.15.64:0/2439774814 wait complete. 2024-09-21T07:29:56.964 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-21T07:29:56.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:56.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 -- 172.21.15.64:0/2208394244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b51a0 msgr2=0x7f3e100b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 --2- 172.21.15.64:0/2208394244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b51a0 0x7f3e100b55b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009bf0 tx=0x7f3e0801cb00 comp rx=0 tx=0).stop 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 -- 172.21.15.64:0/2208394244 shutdown_connections 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 --2- 172.21.15.64:0/2208394244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b51a0 0x7f3e100b55b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 -- 172.21.15.64:0/2208394244 >> 172.21.15.64:0/2208394244 conn(0x7f3e1006d220 msgr2=0x7f3e1006d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 -- 172.21.15.64:0/2208394244 shutdown_connections 2024-09-21T07:29:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 -- 172.21.15.64:0/2208394244 wait complete. 2024-09-21T07:29:57.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.126+0000 7f3e15000640 1 Processor -- start 2024-09-21T07:29:57.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- start start 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e100b3dd0 0x7f3e100ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b7b50 0x7f3e1014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1016af60 con 0x7f3e100b51a0 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1016ade0 con 0x7f3e100b3dd0 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1016b0e0 con 0x7f3e100b7b50 2024-09-21T07:29:57.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49352/0 (socket says 172.21.15.64:49352) 2024-09-21T07:29:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 -- 172.21.15.64:0/2060764570 learned_addr learned my addr 172.21.15.64:0/2060764570 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e100b3dd0 0x7f3e100ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e0e800640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b7b50 0x7f3e1014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 -- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b7b50 msgr2=0x7f3e1014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b7b50 0x7f3e1014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 -- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e100b3dd0 msgr2=0x7f3e100ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e100b3dd0 0x7f3e100ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 -- 172.21.15.64:0/2060764570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101f92c0 con 0x7f3e100b51a0 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e07e00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3df8001230 tx=0x7f3df800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e06000640 1 -- 172.21.15.64:0/2060764570 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8016020 con 0x7f3e100b51a0 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101f95a0 con 0x7f3e100b51a0 2024-09-21T07:29:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e06000640 1 -- 172.21.15.64:0/2060764570 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3df8012920 con 0x7f3e100b51a0 2024-09-21T07:29:57.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e06000640 1 -- 172.21.15.64:0/2060764570 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8012d70 con 0x7f3e100b51a0 2024-09-21T07:29:57.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.130+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e100aefc0 con 0x7f3e100b51a0 2024-09-21T07:29:57.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.134+0000 7f3e06000640 1 -- 172.21.15.64:0/2060764570 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3df8019020 con 0x7f3e100b51a0 2024-09-21T07:29:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.134+0000 7f3e06000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 0x7f3dec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.134+0000 7f3e06000640 1 -- 172.21.15.64:0/2060764570 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f3df8094300 con 0x7f3e100b51a0 2024-09-21T07:29:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.134+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 0x7f3dec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 0x7f3dec075740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007fd0 tx=0x7f3e00009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 Processor -- start 2024-09-21T07:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 -- start start 2024-09-21T07:29:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 0x55e994c33620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c33b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 0x55e994c340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e994a45a60 con 0x55e994ad4940 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e994a34e90 con 0x55e994aba9a0 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e994a38ca0 con 0x55e994ac0ce0 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 0x55e994c33620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c33b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 0x55e994c33620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49366/0 (socket says 172.21.15.64:49366) 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0de00640 1 -- 172.21.15.64:0/1499298279 learned_addr learned my addr 172.21.15.64:0/1499298279 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 0x55e994c340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 -- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 msgr2=0x55e994c33b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c33b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 -- 172.21.15.64:0/1499298279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 msgr2=0x55e994c33620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 0x55e994c33620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 -- 172.21.15.64:0/1499298279 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e994a7e060 con 0x55e994aba9a0 2024-09-21T07:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e07e00640 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c33b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3e0e800640 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 0x55e994c340a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e080ac000 tx=0x7f3e080198a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694d2d4eee803a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.138+0000 7f3dfea00640 1 -- 172.21.15.64:0/1499298279 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080b2040 con 0x55e994aba9a0 2024-09-21T07:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3dfea00640 1 -- 172.21.15.64:0/1499298279 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e08004b40 con 0x55e994aba9a0 2024-09-21T07:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3dfea00640 1 -- 172.21.15.64:0/1499298279 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08003980 con 0x55e994aba9a0 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 msgr2=0x55e994c340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 0x55e994c340a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e080ac000 tx=0x7f3e080198a0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1499298279 shutdown_connections 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994aba9a0 0x55e994c340a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c33b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1499298279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ad4940 0x55e994c33620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1499298279 >> 172.21.15.64:0/1499298279 conn(0x55e9946f3330 msgr2=0x55e994be85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1499298279 shutdown_connections 2024-09-21T07:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1499298279 wait complete. 2024-09-21T07:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 -- start start 2024-09-21T07:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.142+0000 7f3e1c82c000 1 Processor -- start 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994aba9a0 0x55e994bef460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 0x55e994bef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994c22130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e994a78b80 con 0x55e994ac0ce0 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e9949de970 con 0x55e994ad4940 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e9949eabd0 con 0x55e994aba9a0 2024-09-21T07:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e1c82c000 10 client.0 _ll_register_callbacks cb 0x55e9949db410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e0e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994c22130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e0e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994c22130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54766/0 (socket says 172.21.15.64:54766) 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e0e800640 1 -- 172.21.15.64:0/1318985741 learned_addr learned my addr 172.21.15.64:0/1318985741 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e07e00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 0x55e994bef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.146+0000 7f3e0de00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994aba9a0 0x55e994bef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 -- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994aba9a0 msgr2=0x55e994bef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994aba9a0 0x55e994bef460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 -- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 msgr2=0x55e994c22130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994c22130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 -- 172.21.15.64:0/1318985741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9949ddb50 con 0x55e994ac0ce0 2024-09-21T07:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e07e00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 0x55e994bef9a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3df8092760 tx=0x7f3df805ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4389815ce32a289 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3df3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80800d0 con 0x55e994ac0ce0 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f3df8080270 con 0x55e994ac0ce0 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9949cd200 con 0x55e994ac0ce0 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3df8063100 con 0x55e994ac0ce0 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e1c82c000 10 client.7932 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.150+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55e9949d30c0 con 0x55e994ac0ce0 2024-09-21T07:29:57.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e9949cd200 con 0x55e994ac0ce0 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f3df805de20 con 0x55e994ac0ce0 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 10 client.7932 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 10 client.7932 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 20 client.7932 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946d7b10 0x55e994c3a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 4 client.7932 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e994a479b0 con 0x55e9946d7b10 2024-09-21T07:29:57.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.154+0000 7f3e0de00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946d7b10 0x55e994c3a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.158+0000 7f3df3400640 10 client.7932 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.158+0000 7f3e0de00640 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946d7b10 0x55e994c3a8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ebc471e3b0f172 server_cookie=94bc58e3dff0c204 in_seq=0 out_seq=0 2024-09-21T07:29:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.158+0000 7f3df3400640 1 -- 172.21.15.64:0/1318985741 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e994a479b0 con 0x55e9946d7b10 2024-09-21T07:29:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.158+0000 7f3df3400640 10 client.7932 handle_command_reply: tid=0 2024-09-21T07:29:57.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.158+0000 7f3e1c82c000 1 client.7932 shutdown 2024-09-21T07:29:57.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 msgr2=0x55e994bef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 0x55e994bef9a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3df8092760 tx=0x7f3df805ec90 comp rx=0 tx=0).stop 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 shutdown_connections 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994c22130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994ac0ce0 0x55e994bef9a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946d7b10 0x55e994c3a8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/1318985741 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994aba9a0 0x55e994bef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 >> 172.21.15.64:0/1318985741 conn(0x55e9946f3330 msgr2=0x55e994be8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.162+0000 7f3df3400640 0 client.7932 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.166+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 shutdown_connections 2024-09-21T07:29:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.166+0000 7f3e1c82c000 1 -- 172.21.15.64:0/1318985741 wait complete. 2024-09-21T07:29:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.166+0000 7f3e1c82c000 20 client.7932 trim_cache size 0 max 16384 2024-09-21T07:29:57.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 Processor -- start 2024-09-21T07:29:57.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 -- start start 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c46340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994be6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e102049c0 con 0x55e994aba9a0 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101fc9c0 con 0x55e994ad4940 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e102043f0 con 0x55e994ac0ce0 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49398/0 (socket says 172.21.15.64:49398) 2024-09-21T07:29:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 -- 172.21.15.64:0/2240586363 learned_addr learned my addr 172.21.15.64:0/2240586363 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e07e00640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c46340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 -- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 msgr2=0x55e994c46340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0e800640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994be6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c46340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 -- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 msgr2=0x55e994be6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994be6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 -- 172.21.15.64:0/2240586363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e994ab9de0 con 0x55e994aba9a0 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e07e00640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c46340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0e800640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994be6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000fd30 tx=0x7f3e0000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6905358c85ea1415 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3dfe000640 1 -- 172.21.15.64:0/2240586363 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00016e40 con 0x55e994aba9a0 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3dfe000640 1 -- 172.21.15.64:0/2240586363 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0001b040 con 0x55e994aba9a0 2024-09-21T07:29:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.194+0000 7f3dfe000640 1 -- 172.21.15.64:0/2240586363 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000fd60 con 0x55e994aba9a0 2024-09-21T07:29:57.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- 172.21.15.64:0/2240586363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 msgr2=0x55e994c45e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000fd30 tx=0x7f3e0000a000 comp rx=0 tx=0).stop 2024-09-21T07:29:57.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- 172.21.15.64:0/2240586363 shutdown_connections 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994be6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994c46340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/2240586363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994c45e00 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- 172.21.15.64:0/2240586363 >> 172.21.15.64:0/2240586363 conn(0x55e9946f3330 msgr2=0x55e994c21da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- 172.21.15.64:0/2240586363 shutdown_connections 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- 172.21.15.64:0/2240586363 wait complete. 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- start start 2024-09-21T07:29:57.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 Processor -- start 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994ca97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994ca9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e994a00f60 con 0x55e994aba9a0 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e994a00780 con 0x55e994ad4940 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e994a37fb0 con 0x55e994ac0ce0 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e1c82c000 10 client.0 _ll_register_callbacks cb 0x7f3df805e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49402/0 (socket says 172.21.15.64:49402) 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 -- 172.21.15.64:0/877792823 learned_addr learned my addr 172.21.15.64:0/877792823 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 -- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 msgr2=0x55e994ca97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994ca97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 -- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 msgr2=0x55e994ca9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994ca9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 -- 172.21.15.64:0/877792823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9949cb640 con 0x55e994aba9a0 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3e0de00640 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x55e994af8cc0 tx=0x7f3e00016350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3806612d75931c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.198+0000 7f3df3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0003a060 con 0x55e994aba9a0 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f3e000067e0 con 0x55e994aba9a0 2024-09-21T07:29:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0001b040 con 0x55e994aba9a0 2024-09-21T07:29:57.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3e00040050 con 0x55e994aba9a0 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 10 client.7938 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55e9949fdb10 con 0x55e994aba9a0 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0001b040 con 0x55e994aba9a0 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f3e00043020 con 0x55e994aba9a0 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 10 client.7938 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 10 client.7938 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 20 client.7938 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946c5b70 0x55e994bea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 4 client.7938 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-21T07:29:57.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55e994a43460 con 0x55e9946c5b70 2024-09-21T07:29:57.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e07e00640 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946c5b70 0x55e994bea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3df3400640 10 client.7938 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.202+0000 7f3e07e00640 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946c5b70 0x55e994bea5e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d30c726e61e14a server_cookie=6d421706e6e4f557 in_seq=0 out_seq=0 2024-09-21T07:29:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3df3400640 1 -- 172.21.15.64:0/877792823 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e994a43460 con 0x55e9946c5b70 2024-09-21T07:29:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3df3400640 10 client.7938 handle_command_reply: tid=0 2024-09-21T07:29:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 client.7938 shutdown 2024-09-21T07:29:57.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 msgr2=0x55e994ca9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x55e994af8cc0 tx=0x7f3e00016350 comp rx=0 tx=0).stop 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 shutdown_connections 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e994ad4940 0x55e994ca9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55e9946c5b70 0x55e994bea5e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e994ac0ce0 0x55e994ca97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 --2- 172.21.15.64:0/877792823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e994aba9a0 0x55e994ca9280 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 >> 172.21.15.64:0/877792823 conn(0x55e9946f3330 msgr2=0x55e994c45e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3df3400640 0 client.7938 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 shutdown_connections 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 1 -- 172.21.15.64:0/877792823 wait complete. 2024-09-21T07:29:57.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e1c82c000 20 client.7938 trim_cache size 0 max 16384 2024-09-21T07:29:57.214 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:29:57.214 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:29:57.214 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "205eaf30-74d2-408d-882e-552a07c44bc3", 2024-09-21T07:29:57.214 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:29:57.214 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 msgr2=0x7f3dec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 0x7f3dec075740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007fd0 tx=0x7f3e00009040 comp rx=0 tx=0).stop 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 msgr2=0x7f3e101f89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3df8001230 tx=0x7f3df800c980 comp rx=0 tx=0).stop 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 shutdown_connections 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073230 0x7f3dec075740 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e100b7b50 0x7f3e1014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e100b51a0 0x7f3e101f89f0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 --2- 172.21.15.64:0/2060764570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e100b3dd0 0x7f3e100ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 >> 172.21.15.64:0/2060764570 conn(0x7f3e1006d220 msgr2=0x7f3e100d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 shutdown_connections 2024-09-21T07:29:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.210+0000 7f3e15000640 1 -- 172.21.15.64:0/2060764570 wait complete. 2024-09-21T07:29:57.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:29:57.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-21T07:29:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 -- 172.21.15.64:0/1337602872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f006fba0 msgr2=0x7f47f006ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 --2- 172.21.15.64:0/1337602872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f006fba0 0x7f47f006ffb0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009bc0 tx=0x7f47e801ca10 comp rx=0 tx=0).stop 2024-09-21T07:29:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 -- 172.21.15.64:0/1337602872 shutdown_connections 2024-09-21T07:29:57.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 --2- 172.21.15.64:0/1337602872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f006fba0 0x7f47f006ffb0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 --2- 172.21.15.64:0/1337602872 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f015f100 0x7f47f015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 -- 172.21.15.64:0/1337602872 >> 172.21.15.64:0/1337602872 conn(0x7f47f00b2ca0 msgr2=0x7f47f00b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 -- 172.21.15.64:0/1337602872 shutdown_connections 2024-09-21T07:29:57.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.422+0000 7f47f6e00640 1 -- 172.21.15.64:0/1337602872 wait complete. 2024-09-21T07:29:57.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 Processor -- start 2024-09-21T07:29:57.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 -- start start 2024-09-21T07:29:57.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47f006fba0 0x7f47f01fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f00cd790 0x7f47f00afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00b69f0 con 0x7f47f015f100 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00b6870 con 0x7f47f006fba0 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00b6b70 con 0x7f47f00cd790 2024-09-21T07:29:57.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49422/0 (socket says 172.21.15.64:49422) 2024-09-21T07:29:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47f4e00640 1 -- 172.21.15.64:0/619624579 learned_addr learned my addr 172.21.15.64:0/619624579 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47ef400640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f00cd790 0x7f47f00afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.426+0000 7f47efe00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47f006fba0 0x7f47f01fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 -- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f00cd790 msgr2=0x7f47f00afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f00cd790 0x7f47f00afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 -- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47f006fba0 msgr2=0x7f47f01fc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47f006fba0 0x7f47f01fc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 -- 172.21.15.64:0/619624579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f015dc10 con 0x7f47f015f100 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f4e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f47e8019680 tx=0x7f47e80a5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47e7e00640 1 -- 172.21.15.64:0/619624579 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80bb070 con 0x7f47f015f100 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47e7e00640 1 -- 172.21.15.64:0/619624579 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e8004d40 con 0x7f47f015f100 2024-09-21T07:29:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47e7e00640 1 -- 172.21.15.64:0/619624579 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80b2040 con 0x7f47f015f100 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f01fd190 con 0x7f47f015f100 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.430+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f00a9670 con 0x7f47f015f100 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47e7e00640 1 -- 172.21.15.64:0/619624579 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f47e8004320 con 0x7f47f015f100 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47e7e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 0x7f47d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47e7e00640 1 -- 172.21.15.64:0/619624579 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f47e812e430 con 0x7f47f015f100 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47efe00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 0x7f47d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47fe661000 1 Processor -- start 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47fe661000 1 -- start start 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.434+0000 7f47efe00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 0x7f47d0075710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007fd0 tx=0x7f47e0007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05769470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555c05607cd0 con 0x555c05317aa0 2024-09-21T07:29:57.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555c0551d330 con 0x555c055fc6d0 2024-09-21T07:29:57.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555c0557abb0 con 0x555c05253890 2024-09-21T07:29:57.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05769470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:42698/0 (socket says 172.21.15.64:42698) 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 -- 172.21.15.64:0/600419443 learned_addr learned my addr 172.21.15.64:0/600419443 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 -- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 msgr2=0x555c057689f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057689f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 -- 172.21.15.64:0/600419443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 msgr2=0x555c05769470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05769470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 -- 172.21.15.64:0/600419443 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0551ec80 con 0x555c05253890 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47f4e00640 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05769470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47ef400640 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009920 tx=0x7f47dc009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd95f57b29fa49ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47e4c00640 1 -- 172.21.15.64:0/600419443 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc017070 con 0x555c05253890 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47e4c00640 1 -- 172.21.15.64:0/600419443 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47dc00eb70 con 0x555c05253890 2024-09-21T07:29:57.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47e4c00640 1 -- 172.21.15.64:0/600419443 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc013470 con 0x555c05253890 2024-09-21T07:29:57.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 msgr2=0x555c05768f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009920 tx=0x7f47dc009de0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- 172.21.15.64:0/600419443 shutdown_connections 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05769470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05253890 0x555c05768f30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 --2- 172.21.15.64:0/600419443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- 172.21.15.64:0/600419443 >> 172.21.15.64:0/600419443 conn(0x555c052275c0 msgr2=0x555c05725ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- 172.21.15.64:0/600419443 shutdown_connections 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.438+0000 7f47fe661000 1 -- 172.21.15.64:0/600419443 wait complete. 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 -- start start 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 Processor -- start 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05724f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c055fc6d0 0x555c0572b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555c0556ddf0 con 0x555c05317aa0 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555c05569fe0 con 0x555c05253890 2024-09-21T07:29:57.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555c0550f4d0 con 0x555c055fc6d0 2024-09-21T07:29:57.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.442+0000 7f47fe661000 10 client.0 _ll_register_callbacks cb 0x555c054ed7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:54804/0 (socket says 172.21.15.64:54804) 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 -- 172.21.15.64:0/2510336967 learned_addr learned my addr 172.21.15.64:0/2510336967 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47f4e00640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c055fc6d0 0x555c0572b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 -- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c055fc6d0 msgr2=0x555c0572b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c055fc6d0 0x555c0572b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 -- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 msgr2=0x555c05724f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47ef400640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05724f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05724f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 -- 172.21.15.64:0/2510336967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c05508210 con 0x555c05253890 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47ef400640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05724f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:29:57.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47efe00640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f47e00146d0 tx=0x7f47e0000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a1fec49a3488f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:29:57.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e001b050 con 0x555c05253890 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c05502350 con 0x555c05253890 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f47e0015790 con 0x555c05253890 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f47e002d050 con 0x555c05253890 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 10 client.7606 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x555c054eefc0 con 0x555c05253890 2024-09-21T07:29:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x555c05502350 con 0x555c05253890 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f47e0030020 con 0x555c05253890 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 10 client.7606 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 10 client.7606 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 20 client.7606 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c0520c930 0x555c0576fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 4 client.7606 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c0557cb00 con 0x555c0520c930 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47ef400640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c0520c930 0x555c0576fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47d9600640 10 client.7606 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.446+0000 7f47ef400640 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c0520c930 0x555c0576fe80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee693a16c33b920 server_cookie=e30e89799290a4a9 in_seq=0 out_seq=0 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47d9600640 1 -- 172.21.15.64:0/2510336967 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c0557cb00 con 0x555c0520c930 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47d9600640 10 client.7606 handle_command_reply: tid=0 2024-09-21T07:29:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 client.7606 shutdown 2024-09-21T07:29:57.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 msgr2=0x555c057249d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f47e00146d0 tx=0x7f47e0000ee0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 shutdown_connections 2024-09-21T07:29:57.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c0520c930 0x555c0576fe80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c055fc6d0 0x555c0572b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05317aa0 0x555c05724f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 --2- 172.21.15.64:0/2510336967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057249d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47d9600640 0 client.7606 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 >> 172.21.15.64:0/2510336967 conn(0x555c052275c0 msgr2=0x555c0571dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 shutdown_connections 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 1 -- 172.21.15.64:0/2510336967 wait complete. 2024-09-21T07:29:57.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.450+0000 7f47fe661000 20 client.7606 trim_cache size 0 max 16384 2024-09-21T07:29:57.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 Processor -- start 2024-09-21T07:29:57.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 -- start start 2024-09-21T07:29:57.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057da400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057da940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555c05723af0 con 0x555c055fc6d0 2024-09-21T07:29:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0205d20 con 0x555c05253890 2024-09-21T07:29:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.486+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f47f0204d60 con 0x555c05317aa0 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47ef400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057da940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47efe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057da400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49452/0 (socket says 172.21.15.64:49452) 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 -- 172.21.15.64:0/551746209 learned_addr learned my addr 172.21.15.64:0/551746209 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 -- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 msgr2=0x555c057da940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057da940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 -- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 msgr2=0x555c057da400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057da400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 -- 172.21.15.64:0/551746209 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c055c7680 con 0x555c055fc6d0 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47efe00640 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057da400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47f4e00640 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f47e80f8bd0 tx=0x7f47e80b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4464da7f61326da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47dbe00640 1 -- 172.21.15.64:0/551746209 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80f8c40 con 0x555c055fc6d0 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47dbe00640 1 -- 172.21.15.64:0/551746209 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e8102520 con 0x555c055fc6d0 2024-09-21T07:29:57.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47dbe00640 1 -- 172.21.15.64:0/551746209 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e812e0c0 con 0x555c055fc6d0 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 -- 172.21.15.64:0/551746209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 msgr2=0x555c057dae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f47e80f8bd0 tx=0x7f47e80b8040 comp rx=0 tx=0).stop 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 -- 172.21.15.64:0/551746209 shutdown_connections 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c055fc6d0 0x555c057dae80 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057da940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 --2- 172.21.15.64:0/551746209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c05253890 0x555c057da400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 -- 172.21.15.64:0/551746209 >> 172.21.15.64:0/551746209 conn(0x555c052275c0 msgr2=0x555c0577afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 -- 172.21.15.64:0/551746209 shutdown_connections 2024-09-21T07:29:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.490+0000 7f47fe661000 1 -- 172.21.15.64:0/551746209 wait complete. 2024-09-21T07:29:57.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 -- start start 2024-09-21T07:29:57.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 Processor -- start 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 0x555c057de440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00ab010 con 0x555c05253890 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00aa9c0 con 0x555c055fc6d0 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x555c0522f680 con 0x555c05317aa0 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47fe661000 10 client.0 _ll_register_callbacks cb 0x7f47e0001450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 0x555c057de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 0x555c057de440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49468/0 (socket says 172.21.15.64:49468) 2024-09-21T07:29:57.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47efe00640 1 -- 172.21.15.64:0/570646153 learned_addr learned my addr 172.21.15.64:0/570646153 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47f4e00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.494+0000 7f47ef400640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 -- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 msgr2=0x555c057de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057de980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 -- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 msgr2=0x555c057de440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 0x555c057de440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 -- 172.21.15.64:0/570646153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c055340b0 con 0x555c055fc6d0 2024-09-21T07:29:57.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47ef400640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:29:57.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47f4e00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057deec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f47e80f8940 tx=0x7f47e80f53a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ff126fe22ed56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:57.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:29:57.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80fd670 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f47e80f8ea0 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e8102520 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f47e811a3c0 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 10 client.7612 fetch_fsmap learned FSMap version 85 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x555c05500610 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e8102520 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f47e80b5030 con 0x555c055fc6d0 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 10 client.7612 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 10 client.7612 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 20 client.7612 populate_metadata read hostname 'smithi064' 2024-09-21T07:29:57.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c051fa990 0x555c0571f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:57.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 4 client.7612 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:29:57.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c055785b0 con 0x555c051fa990 2024-09-21T07:29:57.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47efe00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c051fa990 0x555c0571f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47d9600640 10 client.7612 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.498+0000 7f47efe00640 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c051fa990 0x555c0571f830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe80f62f8f68b2f server_cookie=110d992be3501ddd in_seq=0 out_seq=0 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47d9600640 1 -- 172.21.15.64:0/570646153 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+583 (crc 0 0 0) 0x555c055785b0 con 0x555c051fa990 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47d9600640 10 client.7612 handle_command_reply: tid=0 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 client.7612 shutdown 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 msgr2=0x555c057deec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057deec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f47e80f8940 tx=0x7f47e80f53a0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 shutdown_connections 2024-09-21T07:29:57.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c055fc6d0 0x555c057deec0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x555c051fa990 0x555c0571f830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x555c05317aa0 0x555c057de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 --2- 172.21.15.64:0/570646153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c05253890 0x555c057de440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47d9600640 0 client.7612 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 >> 172.21.15.64:0/570646153 conn(0x555c052275c0 msgr2=0x555c0572a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 shutdown_connections 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 1 -- 172.21.15.64:0/570646153 wait complete. 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47fe661000 20 client.7612 trim_cache size 0 max 16384 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:29:57.504 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "scrub active (1285 inodes in the stack)", 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "205eaf30-74d2-408d-882e-552a07c44bc3": { 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mds0", 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "205eaf30-74d2-408d-882e-552a07c44bc3", 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "205eaf30-74d2-408d-882e-552a07c44bc3": { 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:29:57.202530+0000", 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mdsdir", 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:29:57.505 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:29:57.506 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:57.506 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:29:57.506 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:29:57.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 msgr2=0x7f47d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 0x7f47d0075710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007fd0 tx=0x7f47e0007ea0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 msgr2=0x7f47f00c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f47e8019680 tx=0x7f47e80a5a40 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 shutdown_connections 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47d0073200 0x7f47d0075710 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f015f100 0x7f47f00c9e10 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47f00cd790 0x7f47f00afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 --2- 172.21.15.64:0/619624579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47f006fba0 0x7f47f01fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 >> 172.21.15.64:0/619624579 conn(0x7f47f00b2ca0 msgr2=0x7f47f0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 shutdown_connections 2024-09-21T07:29:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:29:57.502+0000 7f47f6e00640 1 -- 172.21.15.64:0/619624579 wait complete. 2024-09-21T07:29:57.526 INFO:tasks.cephfs.filesystem:scrub status for tag:205eaf30-74d2-408d-882e-552a07c44bc3 - {'path': '~mds0', 'tag': '205eaf30-74d2-408d-882e-552a07c44bc3', 'options': 'recursive'} 2024-09-21T07:30:09.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:09.847 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:27.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:27.527 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-21T07:30:27.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- 172.21.15.64:0/2352269101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8415b2d0 msgr2=0x7f3e8415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2352269101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8415b2d0 0x7f3e8415b6e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009c80 tx=0x7f3e7c01cda0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- 172.21.15.64:0/2352269101 shutdown_connections 2024-09-21T07:30:27.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2352269101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8415b2d0 0x7f3e8415b6e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2352269101 >> v2:172.21.15.90:3300/0 conn(0x7f3e8406f3b0 0x7f3e840af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- 172.21.15.64:0/2352269101 >> 172.21.15.64:0/2352269101 conn(0x7f3e840ccbe0 msgr2=0x7f3e840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- 172.21.15.64:0/2352269101 shutdown_connections 2024-09-21T07:30:27.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- 172.21.15.64:0/2352269101 wait complete. 2024-09-21T07:30:27.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 Processor -- start 2024-09-21T07:30:27.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.702+0000 7f3e8c400640 1 -- start start 2024-09-21T07:30:27.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8406f3b0 0x7f3e8415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e8415b2d0 0x7f3e84151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8415ed90 con 0x7f3e8406efa0 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8415ec10 con 0x7f3e8415b2d0 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8415ef10 con 0x7f3e8406f3b0 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48248/0 (socket says 172.21.15.64:48248) 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 -- 172.21.15.64:0/2129176679 learned_addr learned my addr 172.21.15.64:0/2129176679 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89000640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8406f3b0 0x7f3e8415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8a400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e8415b2d0 0x7f3e84151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 -- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8406f3b0 msgr2=0x7f3e8415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8406f3b0 0x7f3e8415d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 -- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e8415b2d0 msgr2=0x7f3e84151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e8415b2d0 0x7f3e84151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 -- 172.21.15.64:0/2129176679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e840ca030 con 0x7f3e8406efa0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3e78001ec0 tx=0x7f3e7800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e81600640 1 -- 172.21.15.64:0/2129176679 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78017070 con 0x7f3e8406efa0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e81600640 1 -- 172.21.15.64:0/2129176679 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e78003600 con 0x7f3e8406efa0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e841fc7a0 con 0x7f3e8406efa0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e81600640 1 -- 172.21.15.64:0/2129176679 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78003a50 con 0x7f3e8406efa0 2024-09-21T07:30:27.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.706+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e841fcd60 con 0x7f3e8406efa0 2024-09-21T07:30:27.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e81600640 1 -- 172.21.15.64:0/2129176679 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e7801a070 con 0x7f3e8406efa0 2024-09-21T07:30:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e81600640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 0x7f3e64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e81600640 1 -- 172.21.15.64:0/2129176679 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f3e78093690 con 0x7f3e8406efa0 2024-09-21T07:30:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 Processor -- start 2024-09-21T07:30:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89000640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 0x7f3e64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 -- start start 2024-09-21T07:30:27.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89000640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 0x7f3e64075710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000a710 tx=0x7f3e70010040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd870a06d0 0x55dd87215200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd87215c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dd870abcd0 con 0x55dd86cf7890 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd86fc1330 con 0x55dd86dbbaa0 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dd8701ebb0 con 0x55dd870a06d0 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48254/0 (socket says 172.21.15.64:48254) 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89000640 1 -- 172.21.15.64:0/3527025773 learned_addr learned my addr 172.21.15.64:0/3527025773 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e89a00640 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd870a06d0 0x55dd87215200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.710+0000 7f3e8a400640 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd87215c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 -- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd870a06d0 msgr2=0x55dd87215200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd870a06d0 0x55dd87215200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 -- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 msgr2=0x55dd87215c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd87215c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 -- 172.21.15.64:0/3527025773 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd86fc2c80 con 0x55dd86cf7890 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e89000640 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3e7001b450 tx=0x7f3e70014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e7d6a663dea97b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e76000640 1 -- 172.21.15.64:0/3527025773 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7001b0d0 con 0x55dd86cf7890 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e76000640 1 -- 172.21.15.64:0/3527025773 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e7001b270 con 0x55dd86cf7890 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e76000640 1 -- 172.21.15.64:0/3527025773 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70004020 con 0x55dd86cf7890 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- 172.21.15.64:0/3527025773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 msgr2=0x55dd87215740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3e7001b450 tx=0x7f3e70014000 comp rx=0 tx=0).stop 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- 172.21.15.64:0/3527025773 shutdown_connections 2024-09-21T07:30:27.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd87215c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd87215740 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 --2- 172.21.15.64:0/3527025773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd870a06d0 0x55dd87215200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- 172.21.15.64:0/3527025773 >> 172.21.15.64:0/3527025773 conn(0x55dd86ccb5c0 msgr2=0x55dd871c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- 172.21.15.64:0/3527025773 shutdown_connections 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- 172.21.15.64:0/3527025773 wait complete. 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 -- start start 2024-09-21T07:30:27.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.714+0000 7f3e93b41000 1 Processor -- start 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86dbbaa0 0x55dd8721c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd8721cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dd87011df0 con 0x55dd86cf7890 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd8700dfe0 con 0x55dd870a06d0 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dd86fb34d0 con 0x55dd86dbbaa0 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 10 client.0 _ll_register_callbacks cb 0x55dd86f917f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48262/0 (socket says 172.21.15.64:48262) 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 -- 172.21.15.64:0/137909678 learned_addr learned my addr 172.21.15.64:0/137909678 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89000640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86dbbaa0 0x55dd8721c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e8a400640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd8721cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 -- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86dbbaa0 msgr2=0x55dd8721c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86dbbaa0 0x55dd8721c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 -- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 msgr2=0x55dd8721cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd8721cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 -- 172.21.15.64:0/137909678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd86fac210 con 0x55dd86cf7890 2024-09-21T07:30:27.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e8a400640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd8721cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:27.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89a00640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3e7805a650 tx=0x7f3e78003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e5cbb14dac8119 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:27.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78078060 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f3e7805d0f0 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd86fa6350 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3e7807e050 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 10 client.7965 fetch_fsmap learned FSMap version 85 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55dd86f92fc0 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dd86fa6350 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f3e780597e0 con 0x55dd86cf7890 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 10 client.7965 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 10 client.7965 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 20 client.7965 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86cb0930 0x55dd87226860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 4 client.7965 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:30:27.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd87020b00 con 0x55dd86cb0930 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89000640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86cb0930 0x55dd87226860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e89000640 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86cb0930 0x55dd87226860 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f258d0fa80a062a2 server_cookie=4e00f11d87a921a3 in_seq=0 out_seq=0 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 10 client.7965 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 1 -- 172.21.15.64:0/137909678 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd87020b00 con 0x55dd86cb0930 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e6aa00640 10 client.7965 handle_command_reply: tid=0 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.718+0000 7f3e93b41000 1 client.7965 shutdown 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 msgr2=0x55dd8721c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3e7805a650 tx=0x7f3e78003f90 comp rx=0 tx=0).stop 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 shutdown_connections 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd8721cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86cb0930 0x55dd87226860 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86dbbaa0 0x55dd8721c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 --2- 172.21.15.64:0/137909678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86cf7890 0x55dd8721c480 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e6aa00640 0 client.7965 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 >> 172.21.15.64:0/137909678 conn(0x55dd86ccb5c0 msgr2=0x55dd871c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 shutdown_connections 2024-09-21T07:30:27.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 1 -- 172.21.15.64:0/137909678 wait complete. 2024-09-21T07:30:27.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.722+0000 7f3e93b41000 20 client.7965 trim_cache size 0 max 16384 2024-09-21T07:30:27.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.738+0000 7f3e93b41000 1 Processor -- start 2024-09-21T07:30:27.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.738+0000 7f3e93b41000 1 -- start start 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87222d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd8721c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dd871c77f0 con 0x55dd870a06d0 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e840c64f0 con 0x55dd86dbbaa0 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e840c5510 con 0x55dd86cf7890 2024-09-21T07:30:27.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48266/0 (socket says 172.21.15.64:48266) 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 -- 172.21.15.64:0/1506933283 learned_addr learned my addr 172.21.15.64:0/1506933283 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e89a00640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87222d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e89000640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd8721c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 -- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 msgr2=0x55dd87222d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87222d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 -- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 msgr2=0x55dd8721c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd8721c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 -- 172.21.15.64:0/1506933283 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd8706b680 con 0x55dd870a06d0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e89000640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd8721c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e8a400640 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0b0040 tx=0x7f3e7c019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bc61cc9a83544a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e75600640 1 -- 172.21.15.64:0/1506933283 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0b2040 con 0x55dd870a06d0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e75600640 1 -- 172.21.15.64:0/1506933283 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e7c0be070 con 0x55dd870a06d0 2024-09-21T07:30:27.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e75600640 1 -- 172.21.15.64:0/1506933283 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c003980 con 0x55dd870a06d0 2024-09-21T07:30:27.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- 172.21.15.64:0/1506933283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 msgr2=0x55dd8721c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0b0040 tx=0x7f3e7c019b40 comp rx=0 tx=0).stop 2024-09-21T07:30:27.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- 172.21.15.64:0/1506933283 shutdown_connections 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd870a06d0 0x55dd8721c990 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd86dbbaa0 0x55dd8721c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 --2- 172.21.15.64:0/1506933283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87222d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- 172.21.15.64:0/1506933283 >> 172.21.15.64:0/1506933283 conn(0x55dd86ccb5c0 msgr2=0x55dd872147d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- 172.21.15.64:0/1506933283 shutdown_connections 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- 172.21.15.64:0/1506933283 wait complete. 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 -- start start 2024-09-21T07:30:27.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.742+0000 7f3e93b41000 1 Processor -- start 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 0x55dd87220f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd872214b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e840c4ef0 con 0x55dd86dbbaa0 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e841f9c20 con 0x55dd870a06d0 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dd86cd3680 con 0x55dd86cf7890 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 10 client.0 _ll_register_callbacks cb 0x7f3e78059d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:27.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 0x55dd87220f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:49748/0 (socket says 172.21.15.64:49748) 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89a00640 1 -- 172.21.15.64:0/2157716414 learned_addr learned my addr 172.21.15.64:0/2157716414 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e8a400640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd872214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 -- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 msgr2=0x55dd87220a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 -- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 msgr2=0x55dd872214b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd872214b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 -- 172.21.15.64:0/2157716414 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd86fd80b0 con 0x55dd86dbbaa0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89000640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 0x55dd87220f70 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3e70025000 tx=0x7f3e7001bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526db01974d34f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70004250 con 0x55dd86dbbaa0 2024-09-21T07:30:27.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f3e7002a040 con 0x55dd86dbbaa0 2024-09-21T07:30:27.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e7c0be070 con 0x55dd86dbbaa0 2024-09-21T07:30:27.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3e700043f0 con 0x55dd86dbbaa0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 10 client.7971 fetch_fsmap learned FSMap version 85 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55dd86fa4610 con 0x55dd86dbbaa0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e7c0be070 con 0x55dd86dbbaa0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f3e70018070 con 0x55dd86dbbaa0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 10 client.7971 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 10 client.7971 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 20 client.7971 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86c9e990 0x55dd872219f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 4 client.7971 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd87203c00 con 0x55dd86c9e990 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.746+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86c9e990 0x55dd872219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e89a00640 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86c9e990 0x55dd872219f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9204063044db50 server_cookie=776e42c5720c2057 in_seq=0 out_seq=0 2024-09-21T07:30:27.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e6aa00640 10 client.7971 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e6aa00640 1 -- 172.21.15.64:0/2157716414 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x55dd87203c00 con 0x55dd86c9e990 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e6aa00640 10 client.7971 handle_command_reply: tid=0 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 client.7971 shutdown 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 msgr2=0x55dd87220f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 0x55dd87220f70 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3e70025000 tx=0x7f3e7001bd10 comp rx=0 tx=0).stop 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 shutdown_connections 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd870a06d0 0x55dd872214b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd86dbbaa0 0x55dd87220f70 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x55dd86c9e990 0x55dd872219f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 --2- 172.21.15.64:0/2157716414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dd86cf7890 0x55dd87220a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e6aa00640 0 client.7971 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 >> 172.21.15.64:0/2157716414 conn(0x55dd86ccb5c0 msgr2=0x55dd8721b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 shutdown_connections 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 1 -- 172.21.15.64:0/2157716414 wait complete. 2024-09-21T07:30:27.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e93b41000 20 client.7971 trim_cache size 0 max 16384 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "205eaf30-74d2-408d-882e-552a07c44bc3": { 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:29:57.202530+0000", 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mdsdir", 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:30:27.754 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:30:27.755 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:27.755 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:27.755 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:30:27.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 msgr2=0x7f3e64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 0x7f3e64075710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000a710 tx=0x7f3e70010040 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 msgr2=0x7f3e840c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3e78001ec0 tx=0x7f3e7800c890 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 shutdown_connections 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e64073200 0x7f3e64075710 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e8415b2d0 0x7f3e84151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e8406f3b0 0x7f3e8415d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 --2- 172.21.15.64:0/2129176679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e8406efa0 0x7f3e840c9830 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 >> 172.21.15.64:0/2129176679 conn(0x7f3e840ccbe0 msgr2=0x7f3e840af270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 shutdown_connections 2024-09-21T07:30:27.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.750+0000 7f3e8c400640 1 -- 172.21.15.64:0/2129176679 wait complete. 2024-09-21T07:30:27.771 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:30:27.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-21T07:30:27.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 -- 172.21.15.64:0/1080813584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c15cca0 msgr2=0x7f119c15d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 --2- 172.21.15.64:0/1080813584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c15cca0 0x7f119c15d0b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1184009840 tx=0x7f118401c790 comp rx=0 tx=0).stop 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 -- 172.21.15.64:0/1080813584 shutdown_connections 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 --2- 172.21.15.64:0/1080813584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c15cca0 0x7f119c15d0b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 --2- 172.21.15.64:0/1080813584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c159db0 0x7f119c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 -- 172.21.15.64:0/1080813584 >> 172.21.15.64:0/1080813584 conn(0x7f119c0ccbe0 msgr2=0x7f119c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 -- 172.21.15.64:0/1080813584 shutdown_connections 2024-09-21T07:30:27.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.930+0000 7f11a1800640 1 -- 172.21.15.64:0/1080813584 wait complete. 2024-09-21T07:30:27.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 Processor -- start 2024-09-21T07:30:27.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- start start 2024-09-21T07:30:27.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 0x7f119c148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c15cca0 0x7f119c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f119c06f5d0 con 0x7f119c159db0 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f119c06f450 con 0x7f119c0b1be0 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f119c06f750 con 0x7f119c15cca0 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48290/0 (socket says 172.21.15.64:48290) 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 -- 172.21.15.64:0/3945908176 learned_addr learned my addr 172.21.15.64:0/3945908176 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f119b400640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c15cca0 0x7f119c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f119aa00640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 0x7f119c148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 -- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c15cca0 msgr2=0x7f119c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c15cca0 0x7f119c159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 -- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 msgr2=0x7f119c148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 0x7f119c148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 -- 172.21.15.64:0/3945908176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c0c70a0 con 0x7f119c159db0 2024-09-21T07:30:27.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f119aa00640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 0x7f119c148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1192000640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1184000c10 tx=0x7f11840a64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1193400640 1 -- 172.21.15.64:0/3945908176 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840ac030 con 0x7f119c159db0 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1193400640 1 -- 172.21.15.64:0/3945908176 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11840053b0 con 0x7f119c159db0 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f1193400640 1 -- 172.21.15.64:0/3945908176 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840046d0 con 0x7f119c159db0 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c0c5c40 con 0x7f119c159db0 2024-09-21T07:30:27.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.934+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c0c6200 con 0x7f119c159db0 2024-09-21T07:30:27.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f1193400640 1 -- 172.21.15.64:0/3945908176 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f11840af070 con 0x7f119c159db0 2024-09-21T07:30:27.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f1193400640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 0x7f1178075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f1193400640 1 -- 172.21.15.64:0/3945908176 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f118412e510 con 0x7f119c159db0 2024-09-21T07:30:27.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f119aa00640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 0x7f1178075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f11a8ea0000 1 Processor -- start 2024-09-21T07:30:27.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.938+0000 7f11a8ea0000 1 -- start start 2024-09-21T07:30:27.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119aa00640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 0x7f1178075740 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f118c009b90 tx=0x7f118c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b330630 0x56072b485100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b321ab0 0x56072b485640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56072b2352e0 con 0x56072b30e170 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56072b292bb0 con 0x56072b321ab0 2024-09-21T07:30:27.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56072b281fe0 con 0x56072b330630 2024-09-21T07:30:27.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b330630 0x56072b485100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f1192000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b321ab0 0x56072b485640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48298/0 (socket says 172.21.15.64:48298) 2024-09-21T07:30:27.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 -- 172.21.15.64:0/1788100980 learned_addr learned my addr 172.21.15.64:0/1788100980 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 -- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b330630 msgr2=0x56072b485100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b330630 0x56072b485100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 -- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b321ab0 msgr2=0x56072b485640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b321ab0 0x56072b485640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 -- 172.21.15.64:0/1788100980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072b2201c0 con 0x56072b30e170 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f119b400640 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1194001de0 tx=0x7f119400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794b142c7b085f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f118b400640 1 -- 172.21.15.64:0/1788100980 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194001ed0 con 0x56072b30e170 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f118b400640 1 -- 172.21.15.64:0/1788100980 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1194018070 con 0x56072b30e170 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f118b400640 1 -- 172.21.15.64:0/1788100980 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194003be0 con 0x56072b30e170 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1788100980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 msgr2=0x56072b485b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1194001de0 tx=0x7f119400f5a0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1788100980 shutdown_connections 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b30e170 0x56072b485b80 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b321ab0 0x56072b485640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1788100980 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b330630 0x56072b485100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1788100980 >> 172.21.15.64:0/1788100980 conn(0x56072af3fd20 msgr2=0x56072b435c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1788100980 shutdown_connections 2024-09-21T07:30:27.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.942+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1788100980 wait complete. 2024-09-21T07:30:27.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 -- start start 2024-09-21T07:30:27.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 Processor -- start 2024-09-21T07:30:27.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b30e170 0x56072b46f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b321ab0 0x56072b46ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56072b2274f0 con 0x56072b330630 2024-09-21T07:30:27.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56072b285df0 con 0x56072b30e170 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56072af47620 con 0x56072b321ab0 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 10 client.0 _ll_register_callbacks cb 0x56072b258cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48312/0 (socket says 172.21.15.64:48312) 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 -- 172.21.15.64:0/1189923802 learned_addr learned my addr 172.21.15.64:0/1189923802 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f1192000640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b321ab0 0x56072b46ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119aa00640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b30e170 0x56072b46f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 -- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b321ab0 msgr2=0x56072b46ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b321ab0 0x56072b46ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 -- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b30e170 msgr2=0x56072b46f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b30e170 0x56072b46f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 -- 172.21.15.64:0/1189923802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072b351740 con 0x56072b330630 2024-09-21T07:30:27.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f119b400640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1194014000 tx=0x7f1194004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a980b5f35c52edf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f117fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:27.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194021070 con 0x56072b330630 2024-09-21T07:30:27.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f11940052d0 con 0x56072b330630 2024-09-21T07:30:27.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.946+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56072b21a300 con 0x56072b330630 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f119402e050 con 0x56072b330630 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 10 client.7986 fetch_fsmap learned FSMap version 85 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x56072b307440 con 0x56072b330630 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56072b21a300 con 0x56072b330630 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f1194031020 con 0x56072b330630 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 10 client.7986 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 10 client.7986 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 20 client.7986 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af248d0 0x56072b470ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 4 client.7986 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56072b294b00 con 0x56072af248d0 2024-09-21T07:30:27.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f119aa00640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af248d0 0x56072b470ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f119aa00640 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af248d0 0x56072b470ec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31e4c0d17acba789 server_cookie=688b0e8560a23692 in_seq=0 out_seq=0 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 10 client.7986 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 1 -- 172.21.15.64:0/1189923802 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56072b294b00 con 0x56072af248d0 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 10 client.7986 handle_command_reply: tid=0 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 client.7986 shutdown 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 msgr2=0x56072b4704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1194014000 tx=0x7f1194004bc0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 shutdown_connections 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b330630 0x56072b4704b0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af248d0 0x56072b470ec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b321ab0 0x56072b46ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/1189923802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b30e170 0x56072b46f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f117fe00640 0 client.7986 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 >> 172.21.15.64:0/1189923802 conn(0x56072af3fd20 msgr2=0x56072b43c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 shutdown_connections 2024-09-21T07:30:27.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 1 -- 172.21.15.64:0/1189923802 wait complete. 2024-09-21T07:30:27.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.950+0000 7f11a8ea0000 20 client.7986 trim_cache size 0 max 16384 2024-09-21T07:30:27.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.966+0000 7f11a8ea0000 1 Processor -- start 2024-09-21T07:30:27.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.966+0000 7f11a8ea0000 1 -- start start 2024-09-21T07:30:27.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b49bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b43d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f119c201460 con 0x56072b321ab0 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0cf6e0 con 0x56072b330630 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f119c1577f0 con 0x56072b30e170 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48326/0 (socket says 172.21.15.64:48326) 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 -- 172.21.15.64:0/995721795 learned_addr learned my addr 172.21.15.64:0/995721795 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f119aa00640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b49bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f119b400640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b43d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 -- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 msgr2=0x56072b49bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b49bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 -- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 msgr2=0x56072b43d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b43d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 -- 172.21.15.64:0/995721795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072b2deb00 con 0x56072b321ab0 2024-09-21T07:30:27.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f119b400640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b43d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:27.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f1192000640 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f118401cd00 tx=0x7f118412e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3973a447487ed166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f118aa00640 1 -- 172.21.15.64:0/995721795 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840bf040 con 0x56072b321ab0 2024-09-21T07:30:27.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f118aa00640 1 -- 172.21.15.64:0/995721795 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11840a6750 con 0x56072b321ab0 2024-09-21T07:30:27.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f118aa00640 1 -- 172.21.15.64:0/995721795 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118412e310 con 0x56072b321ab0 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- 172.21.15.64:0/995721795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 msgr2=0x56072b43ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f118401cd00 tx=0x7f118412e040 comp rx=0 tx=0).stop 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- 172.21.15.64:0/995721795 shutdown_connections 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b43d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b43ce50 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/995721795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b49bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- 172.21.15.64:0/995721795 >> 172.21.15.64:0/995721795 conn(0x56072af3fd20 msgr2=0x56072b43c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- 172.21.15.64:0/995721795 shutdown_connections 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.970+0000 7f11a8ea0000 1 -- 172.21.15.64:0/995721795 wait complete. 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- start start 2024-09-21T07:30:27.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 Processor -- start 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b4fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b4fab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0cf090 con 0x56072b321ab0 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56072b295720 con 0x56072b330630 2024-09-21T07:30:27.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56072b2482e0 con 0x56072b30e170 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 10 client.0 _ll_register_callbacks cb 0x7f1184009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48338/0 (socket says 172.21.15.64:48338) 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 -- 172.21.15.64:0/2564009357 learned_addr learned my addr 172.21.15.64:0/2564009357 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f119aa00640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b4fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f119b400640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b4fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 -- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 msgr2=0x56072b4fa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b4fa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 -- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 msgr2=0x56072b4fab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b4fab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 -- 172.21.15.64:0/2564009357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072b24c060 con 0x56072b321ab0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f1192000640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f118401cc70 tx=0x7f118412e2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f085752ad18ca848 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f117fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:27.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840bf040 con 0x56072b321ab0 2024-09-21T07:30:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f1184102170 con 0x56072b321ab0 2024-09-21T07:30:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11840a6750 con 0x56072b321ab0 2024-09-21T07:30:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f11840f8830 con 0x56072b321ab0 2024-09-21T07:30:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 10 client.7992 fetch_fsmap learned FSMap version 85 2024-09-21T07:30:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.974+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x56072b218640 con 0x56072b321ab0 2024-09-21T07:30:27.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11840a6750 con 0x56072b321ab0 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f11840e6070 con 0x56072b321ab0 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 10 client.7992 fetch_fsmap finished waiting for FSMap version 85 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 10 client.7992 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 20 client.7992 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af12930 0x56072b499620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 4 client.7992 mds_command: new command op to 7707 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 --> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] -- command(tid 0: {"prefix": "perf dump"}) -- 0x56072b2905b0 con 0x56072af12930 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f119aa00640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af12930 0x56072b499620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 10 client.7992 ms_handle_connect on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f119aa00640 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af12930 0x56072b499620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef918d20bb7635f server_cookie=bdd90023ebcf4655 in_seq=0 out_seq=0 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 1 -- 172.21.15.64:0/2564009357 <== mds.0 v2:172.21.15.64:6833/1340585715 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18096 (crc 0 0 0) 0x56072b2905b0 con 0x56072af12930 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 10 client.7992 handle_command_reply: tid=0 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 client.7992 shutdown 2024-09-21T07:30:27.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 msgr2=0x56072b4fa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f118401cc70 tx=0x7f118412e2e0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 shutdown_connections 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56072b330630 0x56072b4fab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56072b321ab0 0x56072b4fa630 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.64:6833/1340585715,v1:172.21.15.64:6835/1340585715] conn(0x56072af12930 0x56072b499620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 --2- 172.21.15.64:0/2564009357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56072b30e170 0x56072b4fa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f117fe00640 0 client.7992 ms_handle_reset on v2:172.21.15.64:6833/1340585715 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 >> 172.21.15.64:0/2564009357 conn(0x56072af3fd20 msgr2=0x56072b43c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 shutdown_connections 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 1 -- 172.21.15.64:0/2564009357 wait complete. 2024-09-21T07:30:27.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a8ea0000 20 client.7992 trim_cache size 0 max 16384 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 2274, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 2275, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 961588, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 11549828, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 17, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 6, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.319970586, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.149948995, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.063413662, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.079890008, 2024-09-21T07:30:27.983 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2274, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.648837413, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000285328 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 10, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000001667, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000166 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 3188, 2024-09-21T07:30:27.984 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 3181, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 916717, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 26389473, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.449127097, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.234521141, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.088823617, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.101518266, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 3181, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.709022183, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000222892 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:30:27.985 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 131632, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 27376 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 30282, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 52592, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 10742422, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 71015223, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 8, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-21T07:30:27.986 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 5.896447619, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 3.724190838, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 3.348063998, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.116461683, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 52590, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2.039906742, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000038788 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 72646, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.020139034, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000277 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:30:27.987 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 92976 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2048, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 19.155764835, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.009353400 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.988 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 3085, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.182711815, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000383374 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 25553, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 25553, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 25553, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 354.770299167, 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.013883704 2024-09-21T07:30:27.989 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 12, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 17820, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 17820, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 17819, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-21T07:30:27.990 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 2, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 2, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 48253, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 47668, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 108, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-21T07:30:27.991 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 1848, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 1848, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 11, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 1, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 10, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 1837, 2024-09-21T07:30:27.992 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 1363, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 4045, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 3644, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 2654, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 49, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 14111 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-21T07:30:27.993 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 4135, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 3704, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 2191, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-21T07:30:27.994 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 1, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_succeeded": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_write_failed": 0 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-21T07:30:27.995 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 28874, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 28874, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 43, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 43, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 4, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-21T07:30:27.996 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 94326055, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2708, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 104.273949619, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.038505889 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 14, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 2015, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 2001, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 13, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 13, 2024-09-21T07:30:27.997 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 0, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 17820, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 19821, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 2001, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 2, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 4994, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 4992, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 171104, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 407789568 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 28500, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 25553, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 5, 2024-09-21T07:30:27.998 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2000, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.774189516, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000887094 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 29, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.004557861, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000157167 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:27.999 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 6000, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 7.631598690, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001271933 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7319, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 5.609769758, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000766466 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.000 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.001 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000077712, 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000077712 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.002 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.004265319, 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.004265319 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.003 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.210989031, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.210989031 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000094196, 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000094196 2024-09-21T07:30:28.004 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.745722634, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.093215329 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2191, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 318.280699989, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.145267320 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.005 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.021122838, 2024-09-21T07:30:28.006 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.021122838 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000293863, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000293863 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.007 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.008 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8000, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 20.486917760, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002560864 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-21T07:30:28.009 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 1, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 0, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 1, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 17872, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 17872, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 83, 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-21T07:30:28.010 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:30:28.011 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:30:28.012 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 250494, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 86, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-21T07:30:28.013 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 5624, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 80, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 12997524, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 661036, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-21T07:30:28.014 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 8499, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 90805641, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 29, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 8499, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8499, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 39.075650901, 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.004597676 2024-09-21T07:30:28.015 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 8499, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 8600 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 8499, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 1896, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 6603, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 11, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 47, 2024-09-21T07:30:28.016 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 2754, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 30, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 1704, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 2033, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 1849, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 22, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-21T07:30:28.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-21T07:30:28.018 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 120, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 5, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 8, 2024-09-21T07:30:28.019 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 8, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 116, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 34 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-21T07:30:28.020 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 32, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 32, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 3704, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 3704, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 35740, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 9398390, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:30:28.021 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 35740, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 35740, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 9398390, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-21T07:30:28.022 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 8499, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 91193377, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 8499, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 91193377, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.023 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 8499, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 8499, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 8499, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 8499, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.024 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 3704, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 387736, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 3704, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 46, 2024-09-21T07:30:28.025 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 387736, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x558ae8dab380": { 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 28874, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 90131751, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 28874, 2024-09-21T07:30:28.026 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2708, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 90131751, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "trackedop": { 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:28.027 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 msgr2=0x7f1178075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 0x7f1178075740 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f118c009b90 tx=0x7f118c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 msgr2=0x7f119c159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1184000c10 tx=0x7f11840a64e0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 shutdown_connections 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1178073230 0x7f1178075740 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f119c15cca0 0x7f119c159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f119c159db0 0x7f119c159030 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 --2- 172.21.15.64:0/3945908176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f119c0b1be0 0x7f119c148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 >> 172.21.15.64:0/3945908176 conn(0x7f119c0ccbe0 msgr2=0x7f119c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:28.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 shutdown_connections 2024-09-21T07:30:28.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:27.978+0000 7f11a1800640 1 -- 172.21.15.64:0/3945908176 wait complete. 2024-09-21T07:30:28.030 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:30:28.031 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:30:28.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:30:28.197 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:30:28.197 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:30:28.197 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:28.197 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:28.206 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:28.206 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:28.258 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 -- 172.21.15.64:0/2078706049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080d0df0 msgr2=0x7f61080ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 --2- 172.21.15.64:0/2078706049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080d0df0 0x7f61080ce900 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6100009bc0 tx=0x7f610001cba0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 -- 172.21.15.64:0/2078706049 shutdown_connections 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 --2- 172.21.15.64:0/2078706049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080d0df0 0x7f61080ce900 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 -- 172.21.15.64:0/2078706049 >> 172.21.15.64:0/2078706049 conn(0x7f610806d450 msgr2=0x7f61080d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 -- 172.21.15.64:0/2078706049 shutdown_connections 2024-09-21T07:30:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.458+0000 7f610d200640 1 -- 172.21.15.64:0/2078706049 wait complete. 2024-09-21T07:30:28.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 Processor -- start 2024-09-21T07:30:28.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 -- start start 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61080d0df0 0x7f610814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f610809aa60 0x7f6108153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f610816b360 con 0x7f61080b4de0 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f610816b1e0 con 0x7f610809aa60 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f610816b4e0 con 0x7f61080d0df0 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48354/0 (socket says 172.21.15.64:48354) 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 -- 172.21.15.64:0/2989724345 learned_addr learned my addr 172.21.15.64:0/2989724345 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105400640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61080d0df0 0x7f610814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6106800640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f610809aa60 0x7f6108153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 -- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61080d0df0 msgr2=0x7f610814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61080d0df0 0x7f610814c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 -- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f610809aa60 msgr2=0x7f6108153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f610809aa60 0x7f6108153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 -- 172.21.15.64:0/2989724345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610809cfa0 con 0x7f61080b4de0 2024-09-21T07:30:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f6105e00640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f60f800b420 tx=0x7f60f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011830 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60f8016070 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011d80 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.462+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610809d280 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610809d840 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61080ccce0 con 0x7f61080b4de0 2024-09-21T07:30:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f60f801a410 con 0x7f61080b4de0 2024-09-21T07:30:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f60fe000640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 0x7f60e8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f60f8093cf0 con 0x7f61080b4de0 2024-09-21T07:30:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.466+0000 7f6105400640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 0x7f60e8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:28.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.470+0000 7f6105400640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 0x7f60e8075740 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60f40015f0 tx=0x7f60f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.470+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f60f805eb40 con 0x7f61080b4de0 2024-09-21T07:30:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.674+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61080adc90 con 0x7f61080b4de0 2024-09-21T07:30:28.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.674+0000 7f60fe000640 1 -- 172.21.15.64:0/2989724345 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v120) ==== 80+0+0 (secure 0 0 0) 0x7f60f805e440 con 0x7f61080b4de0 2024-09-21T07:30:28.676 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:30:28.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 msgr2=0x7f60e8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 0x7f60e8075740 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60f40015f0 tx=0x7f60f4009040 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 msgr2=0x7f6108150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f60f800b420 tx=0x7f60f800b8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 shutdown_connections 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f60e8073230 0x7f60e8075740 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f610809aa60 0x7f6108153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61080d0df0 0x7f610814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 --2- 172.21.15.64:0/2989724345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61080b4de0 0x7f6108150fc0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 >> 172.21.15.64:0/2989724345 conn(0x7f610806d450 msgr2=0x7f61080ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 shutdown_connections 2024-09-21T07:30:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:28.678+0000 7f610d200640 1 -- 172.21.15.64:0/2989724345 wait complete. 2024-09-21T07:30:28.698 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:30:28.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:28.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:30:28.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:30:28.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:28.748 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:30:28.798 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:30:28.798 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:30:28.798 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:28.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:30:28.807 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:30:28.807 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:28.807 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:28.850 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:30:28.850 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:30:28.850 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:30:28.850 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:28.858 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:30:28.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 -- 172.21.15.64:0/2508694220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 msgr2=0x7f9ba00ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2508694220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba00ce870 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009840 tx=0x7f9b8c01c700 comp rx=0 tx=0).stop 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 -- 172.21.15.64:0/2508694220 shutdown_connections 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2508694220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba00ce870 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 -- 172.21.15.64:0/2508694220 >> 172.21.15.64:0/2508694220 conn(0x7f9ba00cd310 msgr2=0x7f9ba00cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 -- 172.21.15.64:0/2508694220 shutdown_connections 2024-09-21T07:30:29.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.050+0000 7f9ba5400640 1 -- 172.21.15.64:0/2508694220 wait complete. 2024-09-21T07:30:29.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 Processor -- start 2024-09-21T07:30:29.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- start start 2024-09-21T07:30:29.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 0x7f9ba014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 0x7f9ba00b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0169d50 con 0x7f9ba00ce460 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0169bd0 con 0x7f9ba00afec0 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba0169ed0 con 0x7f9ba0073430 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48366/0 (socket says 172.21.15.64:48366) 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 -- 172.21.15.64:0/2892821519 learned_addr learned my addr 172.21.15.64:0/2892821519 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b9f400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 0x7f9ba00b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b9fe00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 0x7f9ba014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 -- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 msgr2=0x7f9ba014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 0x7f9ba014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 -- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 msgr2=0x7f9ba00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 0x7f9ba00b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 -- 172.21.15.64:0/2892821519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba015b390 con 0x7f9ba00ce460 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b9f400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 0x7f9ba00b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b9fe00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 0x7f9ba014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba4a00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c760 tx=0x7f9b9800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98003db0 con 0x7f9ba00ce460 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b9800ce10 con 0x7f9ba00ce460 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba015add0 con 0x7f9ba00ce460 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b980052d0 con 0x7f9ba00ce460 2024-09-21T07:30:29.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.054+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba0155ef0 con 0x7f9ba00ce460 2024-09-21T07:30:29.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.058+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba00ce870 con 0x7f9ba00ce460 2024-09-21T07:30:29.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.058+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9b98005470 con 0x7f9ba00ce460 2024-09-21T07:30:29.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.058+0000 7f9b97e00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 0x7f9b80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.058+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f9b98094190 con 0x7f9ba00ce460 2024-09-21T07:30:29.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.058+0000 7f9b9fe00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 0x7f9b80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.062+0000 7f9b9fe00640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 0x7f9b80075710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000f70 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.062+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9b9805efe0 con 0x7f9ba00ce460 2024-09-21T07:30:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ba01588c0 con 0x7f9ba00ce460 2024-09-21T07:30:29.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9b97e00640 1 -- 172.21.15.64:0/2892821519 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f9b9805e8e0 con 0x7f9ba00ce460 2024-09-21T07:30:29.287 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:29.287 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":85,"btime":"2024-09-21T07:29:00:956328+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:29:00.273601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:30:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 85 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 msgr2=0x7f9b80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 0x7f9b80075710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000f70 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 msgr2=0x7f9ba01fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c760 tx=0x7f9b9800cc20 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 shutdown_connections 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b80073200 0x7f9b80075710 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ba00ce460 0x7f9ba01fc3c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba00afec0 0x7f9ba00b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 --2- 172.21.15.64:0/2892821519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba0073430 0x7f9ba014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.286+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 >> 172.21.15.64:0/2892821519 conn(0x7f9ba00cd310 msgr2=0x7f9ba0068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.290+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 shutdown_connections 2024-09-21T07:30:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.290+0000 7f9ba5400640 1 -- 172.21.15.64:0/2892821519 wait complete. 2024-09-21T07:30:29.310 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 -- 172.21.15.64:0/3141108733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb26815cbd0 msgr2=0x7fb268070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 --2- 172.21.15.64:0/3141108733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb26815cbd0 0x7fb268070310 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fb258009930 tx=0x7fb25801c8b0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 -- 172.21.15.64:0/3141108733 shutdown_connections 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 --2- 172.21.15.64:0/3141108733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb268070850 0x7fb2680b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 --2- 172.21.15.64:0/3141108733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb26815cbd0 0x7fb268070310 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 -- 172.21.15.64:0/3141108733 >> 172.21.15.64:0/3141108733 conn(0x7fb2680ccbe0 msgr2=0x7fb2680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 -- 172.21.15.64:0/3141108733 shutdown_connections 2024-09-21T07:30:29.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.466+0000 7fb26ec00640 1 -- 172.21.15.64:0/3141108733 wait complete. 2024-09-21T07:30:29.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 Processor -- start 2024-09-21T07:30:29.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- start start 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2680b2120 0x7fb268150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb26815cbd0 0x7fb26815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680b4210 con 0x7fb268070850 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680b4090 con 0x7fb2680b2120 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb2680b4390 con 0x7fb26815cbd0 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48390/0 (socket says 172.21.15.64:48390) 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 -- 172.21.15.64:0/675308443 learned_addr learned my addr 172.21.15.64:0/675308443 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:29.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26cc00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb26815cbd0 0x7fb26815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb25fe00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2680b2120 0x7fb268150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 -- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb26815cbd0 msgr2=0x7fb26815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb26815cbd0 0x7fb26815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 -- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2680b2120 msgr2=0x7fb268150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2680b2120 0x7fb268150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 -- 172.21.15.64:0/675308443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2680c9ca0 con 0x7fb268070850 2024-09-21T07:30:29.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb267e00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb258009850 tx=0x7fb258005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580b2040 con 0x7fb268070850 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb258005320 con 0x7fb268070850 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2680c9f80 con 0x7fb268070850 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580046d0 con 0x7fb268070850 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb268151490 con 0x7fb268070850 2024-09-21T07:30:29.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.470+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb268069050 con 0x7fb268070850 2024-09-21T07:30:29.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.474+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb2580bd060 con 0x7fb268070850 2024-09-21T07:30:29.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.474+0000 7fb264c00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 0x7fb244075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.474+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7fb25812e640 con 0x7fb268070850 2024-09-21T07:30:29.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.474+0000 7fb25fe00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 0x7fb244075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.474+0000 7fb25fe00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 0x7fb244075740 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2500058d0 tx=0x7fb250005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.478+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2580164d0 con 0x7fb268070850 2024-09-21T07:30:29.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2680ca4a0 con 0x7fb268070850 2024-09-21T07:30:29.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb264c00640 1 -- 172.21.15.64:0/675308443 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7fb2580f9510 con 0x7fb268070850 2024-09-21T07:30:29.691 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:29.691 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":85,"btime":"2024-09-21T07:29:00:956328+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:29:00.273601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:30:29.691 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 85 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 msgr2=0x7fb244075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 0x7fb244075740 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2500058d0 tx=0x7fb250005860 comp rx=0 tx=0).stop 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 msgr2=0x7fb2680ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb258009850 tx=0x7fb258005760 comp rx=0 tx=0).stop 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 shutdown_connections 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb244073230 0x7fb244075740 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb26815cbd0 0x7fb26815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2680b2120 0x7fb268150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 --2- 172.21.15.64:0/675308443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb268070850 0x7fb2680ae8d0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 >> 172.21.15.64:0/675308443 conn(0x7fb2680ccbe0 msgr2=0x7fb2680af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:29.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 shutdown_connections 2024-09-21T07:30:29.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.690+0000 7fb26ec00640 1 -- 172.21.15.64:0/675308443 wait complete. 2024-09-21T07:30:29.712 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- 172.21.15.64:0/286281075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 msgr2=0x7fc0c40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 --2- 172.21.15.64:0/286281075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c40700b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009900 tx=0x7fc0b401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- 172.21.15.64:0/286281075 shutdown_connections 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 --2- 172.21.15.64:0/286281075 >> v2:172.21.15.90:3300/0 conn(0x7fc0c40b48d0 0x7fc0c4072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 --2- 172.21.15.64:0/286281075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c40700b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- 172.21.15.64:0/286281075 >> 172.21.15.64:0/286281075 conn(0x7fc0c40ccbe0 msgr2=0x7fc0c40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- 172.21.15.64:0/286281075 shutdown_connections 2024-09-21T07:30:29.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- 172.21.15.64:0/286281075 wait complete. 2024-09-21T07:30:29.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 Processor -- start 2024-09-21T07:30:29.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.870+0000 7fc0c9600640 1 -- start start 2024-09-21T07:30:29.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0c40709b0 0x7fc0c4165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4168cf0 con 0x7fc0c409ca40 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4168b70 con 0x7fc0c40709b0 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c4168e70 con 0x7fc0c415edb0 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48400/0 (socket says 172.21.15.64:48400) 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 -- 172.21.15.64:0/2342574558 learned_addr learned my addr 172.21.15.64:0/2342574558 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c2a00640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0c40709b0 0x7fc0c4165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0bbe00640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 -- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 msgr2=0x7fc0c41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c41533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 -- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0c40709b0 msgr2=0x7fc0c4165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0c40709b0 0x7fc0c4165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 -- 172.21.15.64:0/2342574558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c409d390 con 0x7fc0c409ca40 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c3400640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00eae0 tx=0x7fc0bc009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00ce40 con 0x7fc0c409ca40 2024-09-21T07:30:29.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0bc004c20 con 0x7fc0c409ca40 2024-09-21T07:30:29.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c40af120 con 0x7fc0c409ca40 2024-09-21T07:30:29.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc005020 con 0x7fc0c409ca40 2024-09-21T07:30:29.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41658b0 con 0x7fc0c409ca40 2024-09-21T07:30:29.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.874+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c4072e20 con 0x7fc0c409ca40 2024-09-21T07:30:29.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.878+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc0bc0051c0 con 0x7fc0c409ca40 2024-09-21T07:30:29.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.878+0000 7fc0baa00640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 0x7fc0a0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:29.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.878+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7fc0bc094fe0 con 0x7fc0c409ca40 2024-09-21T07:30:29.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.878+0000 7fc0c2a00640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 0x7fc0a0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:29.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.878+0000 7fc0c2a00640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 0x7fc0a0075740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40af000 tx=0x7fc0b401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:29.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:29.882+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc0bc05f8b0 con 0x7fc0c409ca40 2024-09-21T07:30:30.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.062+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0c4164aa0 con 0x7fc0c409ca40 2024-09-21T07:30:30.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.062+0000 7fc0baa00640 1 -- 172.21.15.64:0/2342574558 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17013 (secure 0 0 0) 0x7fc0c4164aa0 con 0x7fc0c409ca40 2024-09-21T07:30:30.065 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:06.993519+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:45.037291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:46.257472+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:30.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 msgr2=0x7fc0a0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 0x7fc0a0075740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40af000 tx=0x7fc0b401b120 comp rx=0 tx=0).stop 2024-09-21T07:30:30.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 msgr2=0x7fc0c409ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00eae0 tx=0x7fc0bc009f70 comp rx=0 tx=0).stop 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 shutdown_connections 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc0a0073230 0x7fc0a0075740 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c409ca40 0x7fc0c409ce50 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0c415edb0 0x7fc0c41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 --2- 172.21.15.64:0/2342574558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0c40709b0 0x7fc0c4165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 >> 172.21.15.64:0/2342574558 conn(0x7fc0c40ccbe0 msgr2=0x7fc0c40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 shutdown_connections 2024-09-21T07:30:30.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.066+0000 7fc0c9600640 1 -- 172.21.15.64:0/2342574558 wait complete. 2024-09-21T07:30:30.087 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:30:30.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:30.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- 172.21.15.64:0/1033285286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0cb2d0 msgr2=0x7f032c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 --2- 172.21.15.64:0/1033285286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0cb2d0 0x7f032c0b3830 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f032400acd0 tx=0x7f032401de10 comp rx=0 tx=0).stop 2024-09-21T07:30:30.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- 172.21.15.64:0/1033285286 shutdown_connections 2024-09-21T07:30:30.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 --2- 172.21.15.64:0/1033285286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0cb2d0 0x7f032c0b3830 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- 172.21.15.64:0/1033285286 >> 172.21.15.64:0/1033285286 conn(0x7f032c0ccbe0 msgr2=0x7f032c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:30.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- 172.21.15.64:0/1033285286 shutdown_connections 2024-09-21T07:30:30.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- 172.21.15.64:0/1033285286 wait complete. 2024-09-21T07:30:30.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 Processor -- start 2024-09-21T07:30:30.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.246+0000 7f0331000640 1 -- start start 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0b24e0 0x7f032c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f032c0caec0 0x7f032c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f032c1692c0 con 0x7f032c0cb2d0 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f032c169140 con 0x7f032c0b24e0 2024-09-21T07:30:30.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f032c169440 con 0x7f032c0caec0 2024-09-21T07:30:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48414/0 (socket says 172.21.15.64:48414) 2024-09-21T07:30:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 -- 172.21.15.64:0/4109822259 learned_addr learned my addr 172.21.15.64:0/4109822259 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0321400640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f032c0caec0 0x7f032c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0329e00640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0b24e0 0x7f032c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 -- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f032c0caec0 msgr2=0x7f032c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f032c0caec0 0x7f032c151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 -- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0b24e0 msgr2=0x7f032c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0b24e0 0x7f032c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 -- 172.21.15.64:0/4109822259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c06f970 con 0x7f032c0cb2d0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f032a800640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f032401aa20 tx=0x7f03240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03240bd070 con 0x7f032c0cb2d0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03240047d0 con 0x7f032c0cb2d0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03240b3040 con 0x7f032c0cb2d0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c06fc50 con 0x7f032c0cb2d0 2024-09-21T07:30:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c070210 con 0x7f032c0cb2d0 2024-09-21T07:30:30.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.250+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c0add40 con 0x7f032c0cb2d0 2024-09-21T07:30:30.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.254+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0324004cb0 con 0x7f032c0cb2d0 2024-09-21T07:30:30.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.254+0000 7f0322a00640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 0x7f0308075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.254+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f032412e830 con 0x7f032c0cb2d0 2024-09-21T07:30:30.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.254+0000 7f0329e00640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 0x7f0308075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.258+0000 7f0329e00640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 0x7f0308075740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f031c001870 tx=0x7f031c0016a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:30.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.258+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0324017a00 con 0x7f032c0cb2d0 2024-09-21T07:30:30.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.466+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f032c0ca7b0 con 0x7f032c0cb2d0 2024-09-21T07:30:30.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0322a00640 1 -- 172.21.15.64:0/4109822259 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f03240f91b0 con 0x7f032c0cb2d0 2024-09-21T07:30:30.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:30.471 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":85,"btime":"2024-09-21T07:29:00:956328+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:29:00.273601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:30:30.471 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 85 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 msgr2=0x7f0308075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 0x7f0308075740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f031c001870 tx=0x7f031c0016a0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 msgr2=0x7f032c1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f032401aa20 tx=0x7f03240042f0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 shutdown_connections 2024-09-21T07:30:30.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0308073230 0x7f0308075740 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f032c0cb2d0 0x7f032c1530f0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f032c0caec0 0x7f032c151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 --2- 172.21.15.64:0/4109822259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f032c0b24e0 0x7f032c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 >> 172.21.15.64:0/4109822259 conn(0x7f032c0ccbe0 msgr2=0x7f032c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 shutdown_connections 2024-09-21T07:30:30.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.470+0000 7f0331000640 1 -- 172.21.15.64:0/4109822259 wait complete. 2024-09-21T07:30:30.493 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- 172.21.15.64:0/4208163725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17015edb0 msgr2=0x7ff1700700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 --2- 172.21.15.64:0/4208163725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17015edb0 0x7ff1700700b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff17006f220 tx=0x7ff16001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- 172.21.15.64:0/4208163725 shutdown_connections 2024-09-21T07:30:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 --2- 172.21.15.64:0/4208163725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17015edb0 0x7ff1700700b0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- 172.21.15.64:0/4208163725 >> 172.21.15.64:0/4208163725 conn(0x7ff1700ccbe0 msgr2=0x7ff1700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- 172.21.15.64:0/4208163725 shutdown_connections 2024-09-21T07:30:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- 172.21.15.64:0/4208163725 wait complete. 2024-09-21T07:30:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 Processor -- start 2024-09-21T07:30:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.650+0000 7ff175200640 1 -- start start 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 0x7ff1701505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17015edb0 0x7ff17009c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff17016a1e0 con 0x7ff17009b670 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff17016a060 con 0x7ff17015edb0 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff17016a360 con 0x7ff1700709b0 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48428/0 (socket says 172.21.15.64:48428) 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 -- 172.21.15.64:0/462319823 learned_addr learned my addr 172.21.15.64:0/462319823 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16de00640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 0x7ff1701505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff167e00640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17015edb0 0x7ff17009c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 -- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 msgr2=0x7ff1701505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 0x7ff1701505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 -- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17015edb0 msgr2=0x7ff17009c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17015edb0 0x7ff17009c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 -- 172.21.15.64:0/462319823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17009d010 con 0x7ff17009b670 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16de00640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 0x7ff1701505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff16e800640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c6e0 tx=0x7ff16800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:30.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168003b80 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff168003d20 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168005330 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17009ab90 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17009b150 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1700700b0 con 0x7ff17009b670 2024-09-21T07:30:30.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.654+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1680054d0 con 0x7ff17009b670 2024-09-21T07:30:30.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.658+0000 7ff166000640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 0x7ff14c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:30.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.658+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7ff168094260 con 0x7ff17009b670 2024-09-21T07:30:30.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.658+0000 7ff16de00640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 0x7ff14c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:30.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.658+0000 7ff16de00640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 0x7ff14c075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff1600af000 tx=0x7ff16001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:30.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.662+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff16805f020 con 0x7ff17009b670 2024-09-21T07:30:30.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff17009da20 con 0x7ff17009b670 2024-09-21T07:30:30.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff166000640 1 -- 172.21.15.64:0/462319823 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7ff16805e920 con 0x7ff17009b670 2024-09-21T07:30:30.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:30.879 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":85,"btime":"2024-09-21T07:29:00:956328+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-21T07:28:47.303639+0000","modified":"2024-09-21T07:29:00.273601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1340585715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1340585715},{"type":"v1","addr":"172.21.15.64:6835","nonce":1340585715}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7707,"qdb_cluster":[7707]},"id":7}]} 2024-09-21T07:30:30.879 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 85 2024-09-21T07:30:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 msgr2=0x7ff14c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 0x7ff14c075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff1600af000 tx=0x7ff16001b120 comp rx=0 tx=0).stop 2024-09-21T07:30:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 msgr2=0x7ff170158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c6e0 tx=0x7ff16800cba0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 shutdown_connections 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff14c073200 0x7ff14c075710 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff17009b670 0x7ff170158d10 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17015edb0 0x7ff17009c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 --2- 172.21.15.64:0/462319823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1700709b0 0x7ff1701505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 >> 172.21.15.64:0/462319823 conn(0x7ff1700ccbe0 msgr2=0x7ff1700cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 shutdown_connections 2024-09-21T07:30:30.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:30.878+0000 7ff175200640 1 -- 172.21.15.64:0/462319823 wait complete. 2024-09-21T07:30:30.903 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:31.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- 172.21.15.64:0/2296842490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0712f0 msgr2=0x7f767c071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 --2- 172.21.15.64:0/2296842490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0712f0 0x7f767c071700 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f767c0cebf0 tx=0x7f767401cd80 comp rx=0 tx=0).stop 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- 172.21.15.64:0/2296842490 shutdown_connections 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 --2- 172.21.15.64:0/2296842490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0712f0 0x7f767c071700 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 --2- 172.21.15.64:0/2296842490 >> v2:172.21.15.90:3300/0 conn(0x7f767c06cdf0 0x7f767c06d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- 172.21.15.64:0/2296842490 >> 172.21.15.64:0/2296842490 conn(0x7f767c0cdbf0 msgr2=0x7f767c0ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- 172.21.15.64:0/2296842490 shutdown_connections 2024-09-21T07:30:31.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- 172.21.15.64:0/2296842490 wait complete. 2024-09-21T07:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 Processor -- start 2024-09-21T07:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.062+0000 7f7681e00640 1 -- start start 2024-09-21T07:30:31.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c06cdf0 0x7f767c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f767c0712f0 0x7f767c165650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f767c169db0 con 0x7f767c0748d0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f767c169c30 con 0x7f767c06cdf0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f767c169f30 con 0x7f767c0712f0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48448/0 (socket says 172.21.15.64:48448) 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 -- 172.21.15.64:0/2097508551 learned_addr learned my addr 172.21.15.64:0/2097508551 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f767be00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f767c0712f0 0x7f767c165650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7680a00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c06cdf0 0x7f767c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 -- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f767c0712f0 msgr2=0x7f767c165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f767c0712f0 0x7f767c165650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 -- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c06cdf0 msgr2=0x7f767c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c06cdf0 0x7f767c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 -- 172.21.15.64:0/2097508551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0ced40 con 0x7f767c0748d0 2024-09-21T07:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681400640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f7674019990 tx=0x7f76740092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740bb070 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7674004d40 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740b2040 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c1f9460 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c157880 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c0d0d60 con 0x7f767c0748d0 2024-09-21T07:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.066+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f76740be070 con 0x7f767c0748d0 2024-09-21T07:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.070+0000 7f7678c00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 0x7f765c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.070+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f767412ddb0 con 0x7f767c0748d0 2024-09-21T07:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.070+0000 7f7680a00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 0x7f765c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.070+0000 7f7680a00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 0x7f765c075710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7670001650 tx=0x7f7670009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.074+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7674016970 con 0x7f767c0748d0 2024-09-21T07:30:31.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.250+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f767c0d1eb0 con 0x7f767c0748d0 2024-09-21T07:30:31.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.250+0000 7f7678c00640 1 -- 172.21.15.64:0/2097508551 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17013 (secure 0 0 0) 0x7f76740f8760 con 0x7f767c0748d0 2024-09-21T07:30:31.252 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:31.252 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:06.993519+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:28:45.037291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-21T07:28:46.257472+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 msgr2=0x7f765c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 0x7f765c075710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7670001650 tx=0x7f7670009040 comp rx=0 tx=0).stop 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 msgr2=0x7f767c165b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f7674019990 tx=0x7f76740092c0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 shutdown_connections 2024-09-21T07:30:31.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f765c073200 0x7f765c075710 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f767c0748d0 0x7f767c165b90 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f767c0712f0 0x7f767c165650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 --2- 172.21.15.64:0/2097508551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c06cdf0 0x7f767c0cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 >> 172.21.15.64:0/2097508551 conn(0x7f767c0cdbf0 msgr2=0x7f767c15b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 shutdown_connections 2024-09-21T07:30:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.254+0000 7f7681e00640 1 -- 172.21.15.64:0/2097508551 wait complete. 2024-09-21T07:30:31.274 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:30:31.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- 172.21.15.64:0/2863325245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e015f290 msgr2=0x7f90e00aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2863325245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e015f290 0x7f90e00aefe0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009bc0 tx=0x7f90d801cb10 comp rx=0 tx=0).stop 2024-09-21T07:30:31.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- 172.21.15.64:0/2863325245 shutdown_connections 2024-09-21T07:30:31.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2863325245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e015f290 0x7f90e00aefe0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- 172.21.15.64:0/2863325245 >> 172.21.15.64:0/2863325245 conn(0x7f90e006d450 msgr2=0x7f90e00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:31.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- 172.21.15.64:0/2863325245 shutdown_connections 2024-09-21T07:30:31.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- 172.21.15.64:0/2863325245 wait complete. 2024-09-21T07:30:31.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 Processor -- start 2024-09-21T07:30:31.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 -- start start 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.434+0000 7f90e7a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e00d0a00 0x7f90e0141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 0x7f90e009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90e016a5f0 con 0x7f90e0155560 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90e016a470 con 0x7f90e00d0a00 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f90e016a770 con 0x7f90e009caa0 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48464/0 (socket says 172.21.15.64:48464) 2024-09-21T07:30:31.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 -- 172.21.15.64:0/2689841122 learned_addr learned my addr 172.21.15.64:0/2689841122 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:31.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e5000640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e00d0a00 0x7f90e0141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e5a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 0x7f90e009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 -- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 msgr2=0x7f90e009ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 0x7f90e009ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 -- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e00d0a00 msgr2=0x7f90e0141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e00d0a00 0x7f90e0141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 -- 172.21.15.64:0/2689841122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e00c69d0 con 0x7f90e0155560 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e5a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 0x7f90e009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90d7e00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c440 tx=0x7f90c800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8016020 con 0x7f90e0155560 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90c8012920 con 0x7f90e0155560 2024-09-21T07:30:31.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e00c4280 con 0x7f90e0155560 2024-09-21T07:30:31.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8012d70 con 0x7f90e0155560 2024-09-21T07:30:31.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e00c6c70 con 0x7f90e0155560 2024-09-21T07:30:31.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e009c380 con 0x7f90e0155560 2024-09-21T07:30:31.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.438+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f90c8019020 con 0x7f90e0155560 2024-09-21T07:30:31.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.442+0000 7f90dd600640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 0x7f90bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.442+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f90c8094180 con 0x7f90e0155560 2024-09-21T07:30:31.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.442+0000 7f90e5000640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 0x7f90bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.442+0000 7f90e5000640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 0x7f90bc075710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f90d0001180 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.446+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f90c8020030 con 0x7f90e0155560 2024-09-21T07:30:31.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.658+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f90e00c4010 con 0x7f90e0155560 2024-09-21T07:30:31.661 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:30:31.662+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:30:31.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.662+0000 7f90dd600640 1 -- 172.21.15.64:0/2689841122 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) ==== 161+0+0 (secure 0 0 0) 0x7f90c805efd0 con 0x7f90e0155560 2024-09-21T07:30:31.664 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:30:31.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 msgr2=0x7f90bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 0x7f90bc075710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f90d0001180 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2024-09-21T07:30:31.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 msgr2=0x7f90e009be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c440 tx=0x7f90c800c900 comp rx=0 tx=0).stop 2024-09-21T07:30:31.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 shutdown_connections 2024-09-21T07:30:31.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f90bc073200 0x7f90bc075710 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90e009caa0 0x7f90e009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0155560 0x7f90e009be40 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 --2- 172.21.15.64:0/2689841122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90e00d0a00 0x7f90e0141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.666+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 >> 172.21.15.64:0/2689841122 conn(0x7f90e006d450 msgr2=0x7f90e0167650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:31.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.670+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 shutdown_connections 2024-09-21T07:30:31.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.670+0000 7f90e7a00640 1 -- 172.21.15.64:0/2689841122 wait complete. 2024-09-21T07:30:31.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:30:31.812 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:30:31.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 -- 172.21.15.64:0/1143163414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340b3d60 msgr2=0x7f86340b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 --2- 172.21.15.64:0/1143163414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340b3d60 0x7f86340b4170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f861c009840 tx=0x7f861c01c760 comp rx=0 tx=0).stop 2024-09-21T07:30:31.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 -- 172.21.15.64:0/1143163414 shutdown_connections 2024-09-21T07:30:31.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 --2- 172.21.15.64:0/1143163414 >> v2:172.21.15.90:3300/0 conn(0x7f86340c5ea0 0x7f86340c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 --2- 172.21.15.64:0/1143163414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340b3d60 0x7f86340b4170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 -- 172.21.15.64:0/1143163414 >> 172.21.15.64:0/1143163414 conn(0x7f863406d1c0 msgr2=0x7f863406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:31.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 -- 172.21.15.64:0/1143163414 shutdown_connections 2024-09-21T07:30:31.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.854+0000 7f863a200640 1 -- 172.21.15.64:0/1143163414 wait complete. 2024-09-21T07:30:31.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 Processor -- start 2024-09-21T07:30:31.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- start start 2024-09-21T07:30:31.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86340b3d60 0x7f8634149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340d1d00 0x7f8634159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8634169f30 con 0x7f86340c5ea0 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8634169db0 con 0x7f86340b3d60 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f863416a0b0 con 0x7f86340d1d00 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48500/0 (socket says 172.21.15.64:48500) 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 -- 172.21.15.64:0/479774108 learned_addr learned my addr 172.21.15.64:0/479774108 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f8633e00640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340d1d00 0x7f8634159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f8633400640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86340b3d60 0x7f8634149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 -- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340d1d00 msgr2=0x7f8634159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340d1d00 0x7f8634159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 -- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86340b3d60 msgr2=0x7f8634149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:31.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86340b3d60 0x7f8634149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:31.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 -- 172.21.15.64:0/479774108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8634150bf0 con 0x7f86340c5ea0 2024-09-21T07:30:31.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862be00640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f861c009790 tx=0x7f861c0a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c0bb070 con 0x7f86340c5ea0 2024-09-21T07:30:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f861c004470 con 0x7f86340c5ea0 2024-09-21T07:30:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c0b2040 con 0x7f86340c5ea0 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8634150ed0 con 0x7f86340c5ea0 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.858+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8634151490 con 0x7f86340c5ea0 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86340b4170 con 0x7f86340c5ea0 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f861c005290 con 0x7f86340c5ea0 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f862b400640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 0x7f8610075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6216+0+0 (secure 0 0 0) 0x7f861c12dd70 con 0x7f86340c5ea0 2024-09-21T07:30:31.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f8633400640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 0x7f8610075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:31.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.862+0000 7f8633400640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 0x7f8610075710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8624007fd0 tx=0x7f8624009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:31.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:31.866+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f861c016410 con 0x7f86340c5ea0 2024-09-21T07:30:32.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.086+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8634150980 con 0x7f86340c5ea0 2024-09-21T07:30:32.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f862b400640 1 -- 172.21.15.64:0/479774108 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) ==== 104+0+0 (secure 0 0 0) 0x7f861c0f8540 con 0x7f86340c5ea0 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 msgr2=0x7f8610075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 0x7f8610075710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8624007fd0 tx=0x7f8624009040 comp rx=0 tx=0).stop 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 msgr2=0x7f8634158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f861c009790 tx=0x7f861c0a56a0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 shutdown_connections 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8610073200 0x7f8610075710 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f86340d1d00 0x7f8634159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86340c5ea0 0x7f8634158e20 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 --2- 172.21.15.64:0/479774108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86340b3d60 0x7f8634149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 >> 172.21.15.64:0/479774108 conn(0x7f863406d1c0 msgr2=0x7f86341529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 shutdown_connections 2024-09-21T07:30:32.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.666+0000 7f863a200640 1 -- 172.21.15.64:0/479774108 wait complete. 2024-09-21T07:30:32.694 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 -- 172.21.15.64:0/3829559272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5340af360 msgr2=0x7fa53415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 --2- 172.21.15.64:0/3829559272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5340af360 0x7fa53415f480 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa5340c3c50 tx=0x7fa52c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 -- 172.21.15.64:0/3829559272 shutdown_connections 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 --2- 172.21.15.64:0/3829559272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5340af360 0x7fa53415f480 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 --2- 172.21.15.64:0/3829559272 >> v2:172.21.15.90:3300/0 conn(0x7fa5341594c0 0x7fa5340aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 -- 172.21.15.64:0/3829559272 >> 172.21.15.64:0/3829559272 conn(0x7fa5340d0170 msgr2=0x7fa5340d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:32.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.858+0000 7fa539400640 1 -- 172.21.15.64:0/3829559272 shutdown_connections 2024-09-21T07:30:32.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 -- 172.21.15.64:0/3829559272 wait complete. 2024-09-21T07:30:32.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 Processor -- start 2024-09-21T07:30:32.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 -- start start 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa53406ec70 0x7fa5340b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5340af360 0x7fa5340afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa53415c3e0 con 0x7fa53415ecf0 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa53415c260 con 0x7fa5340af360 2024-09-21T07:30:32.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.862+0000 7fa539400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa53415c560 con 0x7fa53406ec70 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48524/0 (socket says 172.21.15.64:48524) 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 -- 172.21.15.64:0/1207134069 learned_addr learned my addr 172.21.15.64:0/1207134069 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa529e00640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5340af360 0x7fa5340afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa532800640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa53406ec70 0x7fa5340b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 -- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa53406ec70 msgr2=0x7fa5340b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa53406ec70 0x7fa5340b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 -- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5340af360 msgr2=0x7fa5340afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5340af360 0x7fa5340afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 -- 172.21.15.64:0/1207134069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5340b5040 con 0x7fa53415ecf0 2024-09-21T07:30:32.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa533200640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa52c098780 tx=0x7fa52c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0b2040 con 0x7fa53415ecf0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa52c0bb070 con 0x7fa53415ecf0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5340b5dc0 con 0x7fa53415ecf0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c004240 con 0x7fa53415ecf0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5340b55c0 con 0x7fa53415ecf0 2024-09-21T07:30:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53415ca80 con 0x7fa53415ecf0 2024-09-21T07:30:32.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.866+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa52c0043e0 con 0x7fa53415ecf0 2024-09-21T07:30:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.870+0000 7fa52b400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 0x7fa510075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.870+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6216+0+0 (secure 0 0 0) 0x7fa52c12eed0 con 0x7fa53415ecf0 2024-09-21T07:30:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.870+0000 7fa532800640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 0x7fa510075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.870+0000 7fa532800640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 0x7fa510075740 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f70 tx=0x7fa524009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:32.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:32.874+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa52c016970 con 0x7fa53415ecf0 2024-09-21T07:30:33.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.050+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa5340b60f0 con 0x7fa53415ecf0 2024-09-21T07:30:33.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.666+0000 7fa52b400640 1 -- 172.21.15.64:0/1207134069 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) ==== 181+0+0 (secure 0 0 0) 0x7fa52c0f9c60 con 0x7fa53415ecf0 2024-09-21T07:30:33.669 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 msgr2=0x7fa510075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 0x7fa510075740 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f70 tx=0x7fa524009040 comp rx=0 tx=0).stop 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 msgr2=0x7fa5340b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa52c098780 tx=0x7fa52c005c80 comp rx=0 tx=0).stop 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 shutdown_connections 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa510073230 0x7fa510075740 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa53415ecf0 0x7fa5340b0110 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5340af360 0x7fa5340afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 --2- 172.21.15.64:0/1207134069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa53406ec70 0x7fa5340b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.670+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 >> 172.21.15.64:0/1207134069 conn(0x7fa5340d0170 msgr2=0x7fa53415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:33.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.674+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 shutdown_connections 2024-09-21T07:30:33.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.674+0000 7fa539400640 1 -- 172.21.15.64:0/1207134069 wait complete. 2024-09-21T07:30:33.698 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 -- 172.21.15.64:0/4000598712 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77281592f0 msgr2=0x7f77280aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 --2- 172.21.15.64:0/4000598712 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77281592f0 0x7f77280aee20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f7728070fa0 tx=0x7f771001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 -- 172.21.15.64:0/4000598712 shutdown_connections 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 --2- 172.21.15.64:0/4000598712 >> v2:172.21.15.90:3300/0 conn(0x7f77280af360 0x7f772815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 --2- 172.21.15.64:0/4000598712 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77281592f0 0x7f77280aee20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 --2- 172.21.15.64:0/4000598712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 0x7f7728158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 -- 172.21.15.64:0/4000598712 >> 172.21.15.64:0/4000598712 conn(0x7f77280d0170 msgr2=0x7f77280d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 -- 172.21.15.64:0/4000598712 shutdown_connections 2024-09-21T07:30:33.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.874+0000 7f772de00640 1 -- 172.21.15.64:0/4000598712 wait complete. 2024-09-21T07:30:33.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 Processor -- start 2024-09-21T07:30:33.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- start start 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 0x7f77281fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77281592f0 0x7f772815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77280cae60 con 0x7f77280af360 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77280cace0 con 0x7f77281592f0 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f77280cafe0 con 0x7f772806ec70 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48542/0 (socket says 172.21.15.64:48542) 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 -- 172.21.15.64:0/3669947266 learned_addr learned my addr 172.21.15.64:0/3669947266 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f7726a00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 0x7f77281fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:33.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f7727400640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77281592f0 0x7f772815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:33.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 -- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 msgr2=0x7f77281fce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:33.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 0x7f77281fce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 -- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77281592f0 msgr2=0x7f772815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:33.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77281592f0 0x7f772815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:33.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 -- 172.21.15.64:0/3669947266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772809cd40 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771e000640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f77100b0040 tx=0x7f77100a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77100b2040 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7710004230 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710003600 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772809d020 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772809d5e0 con 0x7f77280af360 2024-09-21T07:30:33.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.878+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77280cb580 con 0x7f77280af360 2024-09-21T07:30:33.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.882+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f77100bd020 con 0x7f77280af360 2024-09-21T07:30:33.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.882+0000 7f771fe00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 0x7f7704075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:33.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.882+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5778+0+0 (secure 0 0 0) 0x7f771012e6d0 con 0x7f77280af360 2024-09-21T07:30:33.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.882+0000 7f7726a00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 0x7f7704075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:33.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.882+0000 7f7726a00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 0x7f7704075710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7718006fd0 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:33.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:33.886+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f77100c4020 con 0x7f77280af360 2024-09-21T07:30:34.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:34.062+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77280cf230 con 0x7f77280af360 2024-09-21T07:30:35.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f771fe00640 1 -- 172.21.15.64:0/3669947266 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) ==== 169+0+0 (secure 0 0 0) 0x7f77100164b0 con 0x7f77280af360 2024-09-21T07:30:35.066 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:30:35.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 msgr2=0x7f7704075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 0x7f7704075710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7718006fd0 tx=0x7f7718008040 comp rx=0 tx=0).stop 2024-09-21T07:30:35.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 msgr2=0x7f7728147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f77100b0040 tx=0x7f77100a5660 comp rx=0 tx=0).stop 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 shutdown_connections 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7704073200 0x7f7704075710 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77281592f0 0x7f772815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77280af360 0x7f7728147570 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 --2- 172.21.15.64:0/3669947266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f772806ec70 0x7f77281fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 >> 172.21.15.64:0/3669947266 conn(0x7f77280d0170 msgr2=0x7f7728158940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 shutdown_connections 2024-09-21T07:30:35.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.066+0000 7f772de00640 1 -- 172.21.15.64:0/3669947266 wait complete. 2024-09-21T07:30:35.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:30:35.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- 172.21.15.64:0/3025244991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b8004d50 msgr2=0x7fb8b80051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3025244991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8b8004d50 0x7fb8b80051e0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009eb0 tx=0x7fb8cc01d5d0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d2800640 1 -- 172.21.15.64:0/3025244991 reap_dead start 2024-09-21T07:30:35.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- 172.21.15.64:0/3025244991 shutdown_connections 2024-09-21T07:30:35.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- 172.21.15.64:0/3025244991 >> 172.21.15.64:0/3025244991 conn(0x7fb8d40b2510 msgr2=0x7fb8d40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:35.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- 172.21.15.64:0/3025244991 shutdown_connections 2024-09-21T07:30:35.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- 172.21.15.64:0/3025244991 wait complete. 2024-09-21T07:30:35.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 Processor -- start 2024-09-21T07:30:35.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.270+0000 7fb8d9000640 1 -- start start 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b8004d50 0x7fb8d40c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8d40c40d0 0x7fb8d40c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d40c5ab0 con 0x7fb8d4149af0 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d40c5930 con 0x7fb8b8004d50 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d40c5c30 con 0x7fb8d40c40d0 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36004/0 (socket says 172.21.15.64:36004) 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 -- 172.21.15.64:0/3198962780 learned_addr learned my addr 172.21.15.64:0/3198962780 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d1e00640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b8004d50 0x7fb8d40c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8cbe00640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8d40c40d0 0x7fb8d40c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 -- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8d40c40d0 msgr2=0x7fb8d40c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8d40c40d0 0x7fb8d40c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 -- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b8004d50 msgr2=0x7fb8d40c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b8004d50 0x7fb8d40c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 -- 172.21.15.64:0/3198962780 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d40a9600 con 0x7fb8d4149af0 2024-09-21T07:30:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d2800640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009eb0 tx=0x7fb8cc005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0039d0 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8cc004aa0 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc003f90 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d40c9630 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d40c9bf0 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.274+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d40c7310 con 0x7fb8d4149af0 2024-09-21T07:30:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.278+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb8cc004130 con 0x7fb8d4149af0 2024-09-21T07:30:35.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.278+0000 7fb8ca000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 0x7fb8b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.278+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fb8cc12eb10 con 0x7fb8d4149af0 2024-09-21T07:30:35.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.278+0000 7fb8d1e00640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 0x7fb8b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.278+0000 7fb8d1e00640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 0x7fb8b0075710 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001870 tx=0x7fb8c4006040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:35.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.282+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb8cc0ad030 con 0x7fb8d4149af0 2024-09-21T07:30:35.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.470+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fb8d40af910 con 0x7fb8d4149af0 2024-09-21T07:30:35.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8ca000640 1 -- 172.21.15.64:0/3198962780 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v51) ==== 71+0+0 (secure 0 0 0) 0x7fb8cc0172e0 con 0x7fb8d4149af0 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 msgr2=0x7fb8b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 0x7fb8b0075710 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001870 tx=0x7fb8c4006040 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 msgr2=0x7fb8d4148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009eb0 tx=0x7fb8cc005c70 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 shutdown_connections 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb8b0073200 0x7fb8b0075710 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d4149af0 0x7fb8d4148f60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8d40c40d0 0x7fb8d40c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.474+0000 7fb8d9000640 1 --2- 172.21.15.64:0/3198962780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8b8004d50 0x7fb8d40c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.478+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 >> 172.21.15.64:0/3198962780 conn(0x7fb8d40b2510 msgr2=0x7fb8d40b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:35.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.478+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 shutdown_connections 2024-09-21T07:30:35.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.478+0000 7fb8d9000640 1 -- 172.21.15.64:0/3198962780 wait complete. 2024-09-21T07:30:35.498 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 -- 172.21.15.64:0/1669099240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980caec0 msgr2=0x7f72980b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 --2- 172.21.15.64:0/1669099240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980caec0 0x7f72980b3120 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f72980cd8c0 tx=0x7f728001c800 comp rx=0 tx=0).stop 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 -- 172.21.15.64:0/1669099240 shutdown_connections 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 --2- 172.21.15.64:0/1669099240 >> v2:172.21.15.90:3300/0 conn(0x7f72980cb2d0 0x7f72980b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 --2- 172.21.15.64:0/1669099240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980caec0 0x7f72980b3120 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 -- 172.21.15.64:0/1669099240 >> 172.21.15.64:0/1669099240 conn(0x7f72980ccbe0 msgr2=0x7f72980ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 -- 172.21.15.64:0/1669099240 shutdown_connections 2024-09-21T07:30:35.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.654+0000 7f729dc00640 1 -- 172.21.15.64:0/1669099240 wait complete. 2024-09-21T07:30:35.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 Processor -- start 2024-09-21T07:30:35.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 -- start start 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 0x7f7298070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72980caec0 0x7f7298155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7298166050 con 0x7f72980cb2d0 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7298165ed0 con 0x7f72980b24e0 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f729dc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f72981661d0 con 0x7f72980caec0 2024-09-21T07:30:35.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36022/0 (socket says 172.21.15.64:36022) 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 -- 172.21.15.64:0/3134535581 learned_addr learned my addr 172.21.15.64:0/3134535581 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7296a00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 0x7f7298070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f728fe00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72980caec0 0x7f7298155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 -- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72980caec0 msgr2=0x7f7298155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72980caec0 0x7f7298155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 -- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 msgr2=0x7f7298070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 0x7f7298070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7297400640 1 -- 172.21.15.64:0/3134535581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72980c4da0 con 0x7f72980cb2d0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.658+0000 7f7296a00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 0x7f7298070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f7297400640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f729000e910 tx=0x7f729000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290004d30 con 0x7f72980cb2d0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f729000cb20 con 0x7f72980cb2d0 2024-09-21T07:30:35.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729809b2f0 con 0x7f72980cb2d0 2024-09-21T07:30:35.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290005020 con 0x7f72980cb2d0 2024-09-21T07:30:35.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729806fe00 con 0x7f72980cb2d0 2024-09-21T07:30:35.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72980c4b10 con 0x7f72980cb2d0 2024-09-21T07:30:35.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f72900051c0 con 0x7f72980cb2d0 2024-09-21T07:30:35.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 0x7f7274075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:35.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f7290094840 con 0x7f72980cb2d0 2024-09-21T07:30:35.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.662+0000 7f7296a00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 0x7f7274075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:35.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.666+0000 7f7296a00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 0x7f7274075710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7288000f70 tx=0x7f7288009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:35.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.666+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7290016030 con 0x7f72980cb2d0 2024-09-21T07:30:35.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:35.906+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f7298166e10 con 0x7f72980cb2d0 2024-09-21T07:30:36.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.066+0000 7f728ea00640 1 -- 172.21.15.64:0/3134535581 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v381) ==== 158+0+0 (secure 0 0 0) 0x7f729005fa60 con 0x7f72980cb2d0 2024-09-21T07:30:36.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.066+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 msgr2=0x7f7274075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.066+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 0x7f7274075710 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7288000f70 tx=0x7f7288009040 comp rx=0 tx=0).stop 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.066+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 msgr2=0x7f72980c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.066+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f729000e910 tx=0x7f729000edd0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 shutdown_connections 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7274073200 0x7f7274075710 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72980cb2d0 0x7f72980c5010 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72980caec0 0x7f7298155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 --2- 172.21.15.64:0/3134535581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72980b24e0 0x7f7298070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 >> 172.21.15.64:0/3134535581 conn(0x7f72980ccbe0 msgr2=0x7f72980aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:36.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 shutdown_connections 2024-09-21T07:30:36.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.070+0000 7f729dc00640 1 -- 172.21.15.64:0/3134535581 wait complete. 2024-09-21T07:30:36.091 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-21T07:30:36.091 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-21T07:30:36.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:36.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 -- 172.21.15.64:0/2758566804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440709b0 msgr2=0x7f2b440b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 --2- 172.21.15.64:0/2758566804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440709b0 0x7f2b440b41c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009900 tx=0x7f2b3001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 -- 172.21.15.64:0/2758566804 shutdown_connections 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 --2- 172.21.15.64:0/2758566804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440709b0 0x7f2b440b41c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 --2- 172.21.15.64:0/2758566804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4415edb0 0x7f2b440700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 -- 172.21.15.64:0/2758566804 >> 172.21.15.64:0/2758566804 conn(0x7f2b440ccbe0 msgr2=0x7f2b440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 -- 172.21.15.64:0/2758566804 shutdown_connections 2024-09-21T07:30:36.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.246+0000 7f2b49c00640 1 -- 172.21.15.64:0/2758566804 wait complete. 2024-09-21T07:30:36.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 Processor -- start 2024-09-21T07:30:36.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 -- start start 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b440709b0 0x7f2b44154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 0x7f2b441573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441690c0 con 0x7f2b440b4700 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44168f40 con 0x7f2b4415edb0 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b49c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2b44169240 con 0x7f2b440709b0 2024-09-21T07:30:36.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36042/0 (socket says 172.21.15.64:36042) 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 -- 172.21.15.64:0/1687267533 learned_addr learned my addr 172.21.15.64:0/1687267533 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42a00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b440709b0 0x7f2b44154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b43400640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 0x7f2b441573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 -- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b440709b0 msgr2=0x7f2b44154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b440709b0 0x7f2b44154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 -- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 msgr2=0x7f2b441573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 0x7f2b441573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 -- 172.21.15.64:0/1687267533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441f6f40 con 0x7f2b440b4700 2024-09-21T07:30:36.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b43400640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 0x7f2b441573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.250+0000 7f2b42000640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009850 tx=0x7f2b300a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b300b2040 con 0x7f2b440b4700 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b300043b0 con 0x7f2b440b4700 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30005290 con 0x7f2b440b4700 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441f7220 con 0x7f2b440b4700 2024-09-21T07:30:36.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4409cac0 con 0x7f2b440b4700 2024-09-21T07:30:36.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b440b41c0 con 0x7f2b440b4700 2024-09-21T07:30:36.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b300bd060 con 0x7f2b440b4700 2024-09-21T07:30:36.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 0x7f2b24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f2b3012da10 con 0x7f2b440b4700 2024-09-21T07:30:36.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.254+0000 7f2b42a00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 0x7f2b24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.258+0000 7f2b42a00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 0x7f2b24075710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b34004630 tx=0x7f2b3400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:36.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.258+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2b300164d0 con 0x7f2b440b4700 2024-09-21T07:30:36.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.438+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b4409da20 con 0x7f2b440b4700 2024-09-21T07:30:36.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b3aa00640 1 -- 172.21.15.64:0/1687267533 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+13267 (secure 0 0 0) 0x7f2b300f8b10 con 0x7f2b440b4700 2024-09-21T07:30:36.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:36.442 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":123,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:35.064420+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/1340585715":"2024-09-22T07:30:31.663846+0000","172.21.15.64:6833/1340585715":"2024-09-22T07:30:31.663846+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 msgr2=0x7f2b24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 0x7f2b24075710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b34004630 tx=0x7f2b3400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 msgr2=0x7f2b4415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009850 tx=0x7f2b300a5620 comp rx=0 tx=0).stop 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 shutdown_connections 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b24073200 0x7f2b24075710 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4415edb0 0x7f2b441573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b440b4700 0x7f2b4415b890 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 --2- 172.21.15.64:0/1687267533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b440709b0 0x7f2b44154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 >> 172.21.15.64:0/1687267533 conn(0x7f2b440ccbe0 msgr2=0x7f2b44072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:36.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 shutdown_connections 2024-09-21T07:30:36.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.442+0000 7f2b49c00640 1 -- 172.21.15.64:0/1687267533 wait complete. 2024-09-21T07:30:36.465 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:30:36.465 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 -- 172.21.15.64:0/3256398495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 msgr2=0x7f545c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 --2- 172.21.15.64:0/3256398495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c06d200 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f545c073940 tx=0x7f544801c620 comp rx=0 tx=0).stop 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 -- 172.21.15.64:0/3256398495 shutdown_connections 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 --2- 172.21.15.64:0/3256398495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c06d200 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 --2- 172.21.15.64:0/3256398495 >> v2:172.21.15.90:3300/0 conn(0x7f545c0b0570 0x7f545c15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 -- 172.21.15.64:0/3256398495 >> 172.21.15.64:0/3256398495 conn(0x7f545c0cdd10 msgr2=0x7f545c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:36.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 -- 172.21.15.64:0/3256398495 shutdown_connections 2024-09-21T07:30:36.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.630+0000 7f5464200640 1 -- 172.21.15.64:0/3256398495 wait complete. 2024-09-21T07:30:36.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 Processor -- start 2024-09-21T07:30:36.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 -- start start 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f545c0b0570 0x7f545c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f545c0b2d10 0x7f545c200470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f545c169f50 con 0x7f545c06cdf0 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f545c169dd0 con 0x7f545c0b0570 2024-09-21T07:30:36.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f545c16a0d0 con 0x7f545c0b2d10 2024-09-21T07:30:36.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36054/0 (socket says 172.21.15.64:36054) 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 -- 172.21.15.64:0/2024287745 learned_addr learned my addr 172.21.15.64:0/2024287745 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5460e00640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f545c0b0570 0x7f545c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5462200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f545c0b2d10 0x7f545c200470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 -- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f545c0b2d10 msgr2=0x7f545c200470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f545c0b2d10 0x7f545c200470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 -- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f545c0b0570 msgr2=0x7f545c0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f545c0b0570 0x7f545c0cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 -- 172.21.15.64:0/2024287745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c0cacf0 con 0x7f545c06cdf0 2024-09-21T07:30:36.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5461800640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f545000d770 tx=0x7f545000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450009c30 con 0x7f545c06cdf0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f545000de80 con 0x7f545c06cdf0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c0cafd0 con 0x7f545c06cdf0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.634+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450004280 con 0x7f545c06cdf0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c0c8460 con 0x7f545c06cdf0 2024-09-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c06d200 con 0x7f545c06cdf0 2024-09-21T07:30:36.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5450003600 con 0x7f545c06cdf0 2024-09-21T07:30:36.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5459600640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 0x7f543c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:36.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f5450094500 con 0x7f545c06cdf0 2024-09-21T07:30:36.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.638+0000 7f5460e00640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 0x7f543c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:36.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.642+0000 7f5460e00640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 0x7f543c075710 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f54480af000 tx=0x7f544801ae60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:36.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.642+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f545005f0c0 con 0x7f545c06cdf0 2024-09-21T07:30:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.818+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f545c0c6d40 con 0x7f545c06cdf0 2024-09-21T07:30:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.818+0000 7f5459600640 1 -- 172.21.15.64:0/2024287745 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) ==== 93+0+10 (secure 0 0 0) 0x7f5450063af0 con 0x7f545c06cdf0 2024-09-21T07:30:36.821 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:30:36.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 msgr2=0x7f543c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 0x7f543c075710 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f54480af000 tx=0x7f544801ae60 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 msgr2=0x7f545c0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f545000d770 tx=0x7f545000dc30 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 shutdown_connections 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f543c073200 0x7f543c075710 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f545c0b2d10 0x7f545c200470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f545c0b0570 0x7f545c0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 --2- 172.21.15.64:0/2024287745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f545c06cdf0 0x7f545c0cb8e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 >> 172.21.15.64:0/2024287745 conn(0x7f545c0cdd10 msgr2=0x7f545c159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 shutdown_connections 2024-09-21T07:30:36.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:36.822+0000 7f5464200640 1 -- 172.21.15.64:0/2024287745 wait complete. 2024-09-21T07:30:36.844 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- 172.21.15.64:0/1549984130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 msgr2=0x7fa7880cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 --2- 172.21.15.64:0/1549984130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7880cfb20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa7880d11a0 tx=0x7fa77801c7d0 comp rx=0 tx=0).stop 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- 172.21.15.64:0/1549984130 shutdown_connections 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 --2- 172.21.15.64:0/1549984130 >> v2:172.21.15.90:3300/0 conn(0x7fa7880ce410 0x7fa78815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 --2- 172.21.15.64:0/1549984130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7880cfb20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- 172.21.15.64:0/1549984130 >> 172.21.15.64:0/1549984130 conn(0x7fa78806e890 msgr2=0x7fa7880b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- 172.21.15.64:0/1549984130 shutdown_connections 2024-09-21T07:30:37.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- 172.21.15.64:0/1549984130 wait complete. 2024-09-21T07:30:37.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 Processor -- start 2024-09-21T07:30:37.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.002+0000 7fa78ec00640 1 -- start start 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 0x7fa78815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7880caad0 0x7fa7881f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa788168bc0 con 0x7fa78815b700 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa788168a40 con 0x7fa78806ff90 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa788168d40 con 0x7fa7880caad0 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36066/0 (socket says 172.21.15.64:36066) 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 -- 172.21.15.64:0/3605672937 learned_addr learned my addr 172.21.15.64:0/3605672937 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa787e00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 0x7fa78815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:37.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78cc00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7880caad0 0x7fa7881f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 -- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7880caad0 msgr2=0x7fa7881f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7880caad0 0x7fa7881f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 -- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 msgr2=0x7fa78815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 0x7fa78815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 -- 172.21.15.64:0/3605672937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa788159c30 con 0x7fa78815b700 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa787e00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 0x7fa78815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa77fe00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c3c0 tx=0x7fa77000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770017070 con 0x7fa78815b700 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7700053c0 con 0x7fa78815b700 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa788159ed0 con 0x7fa78815b700 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770003860 con 0x7fa78815b700 2024-09-21T07:30:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7880cb200 con 0x7fa78815b700 2024-09-21T07:30:37.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.006+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78815f250 con 0x7fa78815b700 2024-09-21T07:30:37.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.010+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa77001a070 con 0x7fa78815b700 2024-09-21T07:30:37.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.010+0000 7fa784c00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 0x7fa764075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:37.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.010+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fa770093390 con 0x7fa78815b700 2024-09-21T07:30:37.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.010+0000 7fa787e00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 0x7fa764075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.010+0000 7fa787e00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 0x7fa764075710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7780af000 tx=0x7fa77801b010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:37.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.014+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa77005e5a0 con 0x7fa78815b700 2024-09-21T07:30:37.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:37.258+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fa7880caf90 con 0x7fa78815b700 2024-09-21T07:30:38.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.074+0000 7fa784c00640 1 -- 172.21.15.64:0/3605672937 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v383) ==== 147+0+0 (secure 0 0 0) 0x7fa770001090 con 0x7fa78815b700 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 msgr2=0x7fa764075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 0x7fa764075710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7780af000 tx=0x7fa77801b010 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 msgr2=0x7fa7881fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c3c0 tx=0x7fa77000c880 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 shutdown_connections 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa764073200 0x7fa764075710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7880caad0 0x7fa7881f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa78815b700 0x7fa7881fcd30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 --2- 172.21.15.64:0/3605672937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa78806ff90 0x7fa78815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 >> 172.21.15.64:0/3605672937 conn(0x7fa78806e890 msgr2=0x7fa7880cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:38.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 shutdown_connections 2024-09-21T07:30:38.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.078+0000 7fa78ec00640 1 -- 172.21.15.64:0/3605672937 wait complete. 2024-09-21T07:30:38.103 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:30:38.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 -- 172.21.15.64:0/1054763021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415cbd0 msgr2=0x7f60a4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 --2- 172.21.15.64:0/1054763021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415cbd0 0x7f60a4070310 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6094009930 tx=0x7f609401c8b0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 -- 172.21.15.64:0/1054763021 shutdown_connections 2024-09-21T07:30:38.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 --2- 172.21.15.64:0/1054763021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a4070850 0x7f60a40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 --2- 172.21.15.64:0/1054763021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415cbd0 0x7f60a4070310 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 -- 172.21.15.64:0/1054763021 >> 172.21.15.64:0/1054763021 conn(0x7f60a40ccbe0 msgr2=0x7f60a40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:38.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 -- 172.21.15.64:0/1054763021 shutdown_connections 2024-09-21T07:30:38.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.266+0000 7f60aae00640 1 -- 172.21.15.64:0/1054763021 wait complete. 2024-09-21T07:30:38.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 Processor -- start 2024-09-21T07:30:38.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- start start 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a40b2120 0x7f60a414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 0x7f60a40744e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40b41f0 con 0x7f60a4070850 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40b4070 con 0x7f60a40b2120 2024-09-21T07:30:38.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f60a40b4370 con 0x7f60a415cbd0 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36072/0 (socket says 172.21.15.64:36072) 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 -- 172.21.15.64:0/1693247200 learned_addr learned my addr 172.21.15.64:0/1693247200 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f609be00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a40b2120 0x7f60a414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a8e00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 0x7f60a40744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 -- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 msgr2=0x7f60a40744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 0x7f60a40744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 -- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a40b2120 msgr2=0x7f60a414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a40b2120 0x7f60a414d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 -- 172.21.15.64:0/1693247200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a40adda0 con 0x7f60a4070850 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a8e00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 0x7f60a40744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a3e00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f60940b0040 tx=0x7f6094005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60940b2040 con 0x7f60a4070850 2024-09-21T07:30:38.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6094005320 con 0x7f60a4070850 2024-09-21T07:30:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a40ae080 con 0x7f60a4070850 2024-09-21T07:30:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60940046d0 con 0x7f60a4070850 2024-09-21T07:30:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.270+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a4158ff0 con 0x7f60a4070850 2024-09-21T07:30:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.274+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a4155600 con 0x7f60a4070850 2024-09-21T07:30:38.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.274+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f60940be060 con 0x7f60a4070850 2024-09-21T07:30:38.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.274+0000 7f60a0c00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.274+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f609412def0 con 0x7f60a4070850 2024-09-21T07:30:38.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.274+0000 7f609be00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.278+0000 7f609be00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ca0f0 tx=0x7f608c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:38.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.278+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f60940164d0 con 0x7f60a4070850 2024-09-21T07:30:38.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.454+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f60a40b1be0 con 0x7f60a4070850 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60a0c00640 1 -- 172.21.15.64:0/1693247200 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v51) ==== 59+0+2294 (secure 0 0 0) 0x7f60940f8fe0 con 0x7f60a4070850 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:30:38.458 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:30:38.459 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:30:38.460 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 msgr2=0x7f6080075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ca0f0 tx=0x7f608c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 msgr2=0x7f60a40ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f60940b0040 tx=0x7f6094005de0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 shutdown_connections 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a415cbd0 0x7f60a40744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a40b2120 0x7f60a414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 --2- 172.21.15.64:0/1693247200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a4070850 0x7f60a40ae7e0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 >> 172.21.15.64:0/1693247200 conn(0x7f60a40ccbe0 msgr2=0x7f60a40b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:38.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 shutdown_connections 2024-09-21T07:30:38.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.458+0000 7f60aae00640 1 -- 172.21.15.64:0/1693247200 wait complete. 2024-09-21T07:30:38.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- 172.21.15.64:0/1835299887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac0cd410 msgr2=0x7f1cac0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/1835299887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac0cd410 0x7f1cac0b4de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009870 tx=0x7f1c9401c780 comp rx=0 tx=0).stop 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- 172.21.15.64:0/1835299887 shutdown_connections 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/1835299887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac0cd410 0x7f1cac0b4de0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- 172.21.15.64:0/1835299887 >> 172.21.15.64:0/1835299887 conn(0x7f1cac06d450 msgr2=0x7f1cac0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:38.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- 172.21.15.64:0/1835299887 shutdown_connections 2024-09-21T07:30:38.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- 172.21.15.64:0/1835299887 wait complete. 2024-09-21T07:30:38.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 Processor -- start 2024-09-21T07:30:38.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.642+0000 7f1cb2a00640 1 -- start start 2024-09-21T07:30:38.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cac0d0e60 0x7f1cac15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 0x7f1cac0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac16b0b0 con 0x7f1cac06ee80 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac16af30 con 0x7f1cac0d0e60 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac16b230 con 0x7f1cac1624f0 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36080/0 (socket says 172.21.15.64:36080) 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 -- 172.21.15.64:0/3619664774 learned_addr learned my addr 172.21.15.64:0/3619664774 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1ca3400640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cac0d0e60 0x7f1cac15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb0a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 0x7f1cac0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 -- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 msgr2=0x7f1cac0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 0x7f1cac0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 -- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cac0d0e60 msgr2=0x7f1cac15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cac0d0e60 0x7f1cac15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 -- 172.21.15.64:0/3619664774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac161450 con 0x7f1cac06ee80 2024-09-21T07:30:38.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb0a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 0x7f1cac0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:38.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cabe00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b420 tx=0x7f1c9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:38.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c011830 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c9c016070 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c011d80 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac161730 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac161cf0 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac0b4de0 con 0x7f1cac06ee80 2024-09-21T07:30:38.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.646+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1c9c01a410 con 0x7f1cac06ee80 2024-09-21T07:30:38.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.650+0000 7f1ca8c00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 0x7f1c88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:38.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.650+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f1c9c093970 con 0x7f1cac06ee80 2024-09-21T07:30:38.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.650+0000 7f1ca3400640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 0x7f1c88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:38.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.650+0000 7f1ca3400640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 0x7f1c88075710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1c940ae000 tx=0x7f1c9401afc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:38.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.654+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1c9c05eaf0 con 0x7f1cac06ee80 2024-09-21T07:30:38.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.830+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1cac161150 con 0x7f1cac06ee80 2024-09-21T07:30:38.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1ca8c00640 1 -- 172.21.15.64:0/3619664774 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f1c9c05e3f0 con 0x7f1cac06ee80 2024-09-21T07:30:38.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 msgr2=0x7f1c88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 0x7f1c88075710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1c940ae000 tx=0x7f1c9401afc0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 msgr2=0x7f1cac162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b420 tx=0x7f1c9c00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 shutdown_connections 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1c88073200 0x7f1c88075710 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cac1624f0 0x7f1cac0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cac0d0e60 0x7f1cac15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 --2- 172.21.15.64:0/3619664774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac06ee80 0x7f1cac162b00 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 >> 172.21.15.64:0/3619664774 conn(0x7f1cac06d450 msgr2=0x7f1cac06f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 shutdown_connections 2024-09-21T07:30:38.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:38.834+0000 7f1cb2a00640 1 -- 172.21.15.64:0/3619664774 wait complete. 2024-09-21T07:30:38.858 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:30:38.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:30:38.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:30:39.049 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:30:39.049 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:39.049 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:39.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:30:39.059 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:30:39.059 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:39.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:30:39.068 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:39.068 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:39.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:30:39.113 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:30:39.114 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:39.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:30:39.122 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:30:39.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:39.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 -- 172.21.15.64:0/2940780024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 msgr2=0x7fd07c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 --2- 172.21.15.64:0/2940780024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd07c004c20 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd0800016f0 tx=0x7fd08001c750 comp rx=0 tx=0).stop 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 -- 172.21.15.64:0/2940780024 shutdown_connections 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 --2- 172.21.15.64:0/2940780024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd07c004c20 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 -- 172.21.15.64:0/2940780024 >> 172.21.15.64:0/2940780024 conn(0x7fd0940ccbe0 msgr2=0x7fd0940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 -- 172.21.15.64:0/2940780024 shutdown_connections 2024-09-21T07:30:39.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.314+0000 7fd09bc00640 1 -- 172.21.15.64:0/2940780024 wait complete. 2024-09-21T07:30:39.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 Processor -- start 2024-09-21T07:30:39.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- start start 2024-09-21T07:30:39.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0940c4120 0x7fd0940c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0940c4a70 0x7fd0941f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd094070440 con 0x7fd07c004810 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940702c0 con 0x7fd0940c4120 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd094072e20 con 0x7fd0940c4a70 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36088/0 (socket says 172.21.15.64:36088) 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 -- 172.21.15.64:0/3112890059 learned_addr learned my addr 172.21.15.64:0/3112890059 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 -- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0940c4a70 msgr2=0x7fd0941f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0940c4a70 0x7fd0941f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 -- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0940c4120 msgr2=0x7fd0940c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0940c4120 0x7fd0940c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 -- 172.21.15.64:0/3112890059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940b10b0 con 0x7fd07c004810 2024-09-21T07:30:39.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd099200640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd088011780 tx=0x7fd088011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:39.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08800fd50 con 0x7fd07c004810 2024-09-21T07:30:39.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd088011e90 con 0x7fd07c004810 2024-09-21T07:30:39.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088004290 con 0x7fd07c004810 2024-09-21T07:30:39.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0940c67c0 con 0x7fd07c004810 2024-09-21T07:30:39.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0940c51a0 con 0x7fd07c004810 2024-09-21T07:30:39.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.318+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd094073380 con 0x7fd07c004810 2024-09-21T07:30:39.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.322+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd088003600 con 0x7fd07c004810 2024-09-21T07:30:39.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.322+0000 7fd090c00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 0x7fd074075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.322+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fd088094d70 con 0x7fd07c004810 2024-09-21T07:30:39.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.322+0000 7fd093e00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 0x7fd074075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.322+0000 7fd093e00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 0x7fd074075710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd0800016c0 tx=0x7fd07c005840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:39.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.326+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd08805ff00 con 0x7fd07c004810 2024-09-21T07:30:39.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.538+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd09409da20 con 0x7fd07c004810 2024-09-21T07:30:39.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.538+0000 7fd090c00640 1 -- 172.21.15.64:0/3112890059 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+3908 (secure 0 0 0) 0x7fd08805f800 con 0x7fd07c004810 2024-09-21T07:30:39.541 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:39.541 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":87,"btime":"2024-09-21T07:30:32:666310+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6803,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1636797410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1636797410},{"type":"v1","addr":"172.21.15.90:6837","nonce":1636797410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4025606253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4025606253},{"type":"v1","addr":"172.21.15.90:6835","nonce":4025606253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2090963938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2090963938},{"type":"v1","addr":"172.21.15.64:6834","nonce":2090963938}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8058,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/173300299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":173300299},{"type":"v1","addr":"172.21.15.64:6835","nonce":173300299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[]} 2024-09-21T07:30:39.541 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 87 2024-09-21T07:30:39.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 msgr2=0x7fd074075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 0x7fd074075710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd0800016c0 tx=0x7fd07c005840 comp rx=0 tx=0).stop 2024-09-21T07:30:39.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 msgr2=0x7fd0941546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd088011780 tx=0x7fd088011c40 comp rx=0 tx=0).stop 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 shutdown_connections 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd074073200 0x7fd074075710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0940c4a70 0x7fd0941f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0940c4120 0x7fd0940c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 --2- 172.21.15.64:0/3112890059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07c004810 0x7fd0941546a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 >> 172.21.15.64:0/3112890059 conn(0x7fd0940ccbe0 msgr2=0x7fd0940b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 shutdown_connections 2024-09-21T07:30:39.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.542+0000 7fd09bc00640 1 -- 172.21.15.64:0/3112890059 wait complete. 2024-09-21T07:30:39.563 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:30:39.563 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:30:39.563 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:30:39.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:30:39.564 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:30:39.564 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:30:39.564 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:30:39.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:30:39.564 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:30:39.564 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:30:39.564 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:30:39.565 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:30:39.565 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:30:39.565 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:30:39.565 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:30:39.565 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:30:39.576 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:30:39.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:30:39.580 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:30:39.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:30:39.581 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:30:39.581 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:30:39.584 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:30:39.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:30:39.624 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:30:39.625 DEBUG:teuthology.parallel:result is None 2024-09-21T07:30:39.627 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:30:39.627 DEBUG:teuthology.parallel:result is None 2024-09-21T07:30:39.627 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:30:39.628 DEBUG:teuthology.parallel:result is None 2024-09-21T07:30:39.630 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:30:39.630 DEBUG:teuthology.parallel:result is None 2024-09-21T07:30:39.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:30:39.727 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:30:39.729 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:30:39.734 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:30:39.734 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 -- 172.21.15.64:0/1715298914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ce730 msgr2=0x7fb8600ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 --2- 172.21.15.64:0/1715298914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ce730 0x7fb8600ceb40 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fb8600711c0 tx=0x7fb85801cd80 comp rx=0 tx=0).stop 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 -- 172.21.15.64:0/1715298914 shutdown_connections 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 --2- 172.21.15.64:0/1715298914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ce730 0x7fb8600ceb40 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 --2- 172.21.15.64:0/1715298914 >> v2:172.21.15.90:3300/0 conn(0x7fb8600b3910 0x7fb8600ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 --2- 172.21.15.64:0/1715298914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb86009df30 0x7fb8600b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 -- 172.21.15.64:0/1715298914 >> 172.21.15.64:0/1715298914 conn(0x7fb86006d450 msgr2=0x7fb8600d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 -- 172.21.15.64:0/1715298914 shutdown_connections 2024-09-21T07:30:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.794+0000 7fb866600640 1 -- 172.21.15.64:0/1715298914 wait complete. 2024-09-21T07:30:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 Processor -- start 2024-09-21T07:30:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 -- start start 2024-09-21T07:30:39.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8600b3910 0x7fb860159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8600ce730 0x7fb86015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600ccef0 con 0x7fb86009df30 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600ccd70 con 0x7fb8600b3910 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb866600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb8600cd070 con 0x7fb8600ce730 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36128/0 (socket says 172.21.15.64:36128) 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 -- 172.21.15.64:0/38026295 learned_addr learned my addr 172.21.15.64:0/38026295 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85fe00640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8600ce730 0x7fb86015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85ea00640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8600b3910 0x7fb860159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 -- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8600ce730 msgr2=0x7fb86015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8600ce730 0x7fb86015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 -- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8600b3910 msgr2=0x7fb860159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8600b3910 0x7fb860159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.798+0000 7fb85f400640 1 -- 172.21.15.64:0/38026295 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8601f8b40 con 0x7fb86009df30 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb85f400640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ea20 tx=0x7fb85000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85000ccc0 con 0x7fb86009df30 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb850010430 con 0x7fb86009df30 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850010860 con 0x7fb86009df30 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601f8e20 con 0x7fb86009df30 2024-09-21T07:30:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601f93e0 con 0x7fb86009df30 2024-09-21T07:30:39.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8600ce1f0 con 0x7fb86009df30 2024-09-21T07:30:39.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb850010a00 con 0x7fb86009df30 2024-09-21T07:30:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 0x7fb840075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fb850094bb0 con 0x7fb86009df30 2024-09-21T07:30:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.802+0000 7fb85ea00640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 0x7fb840075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.806+0000 7fb85ea00640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 0x7fb840075710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009600 tx=0x7fb84c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:39.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.810+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb85005f650 con 0x7fb86009df30 2024-09-21T07:30:39.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:39.913 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:39.998+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb8600cb010 con 0x7fb86009df30 2024-09-21T07:30:40.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.086+0000 7fb857400640 1 -- 172.21.15.64:0/38026295 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) ==== 97+0+0 (secure 0 0 0) 0x7fb850064080 con 0x7fb86009df30 2024-09-21T07:30:40.090 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 msgr2=0x7fb840075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 0x7fb840075710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009600 tx=0x7fb84c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 msgr2=0x7fb86009d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ea20 tx=0x7fb85000eee0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 shutdown_connections 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb840073200 0x7fb840075710 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb8600ce730 0x7fb86015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8600b3910 0x7fb860159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 --2- 172.21.15.64:0/38026295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86009df30 0x7fb86009d180 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 >> 172.21.15.64:0/38026295 conn(0x7fb86006d450 msgr2=0x7fb8600ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 shutdown_connections 2024-09-21T07:30:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.090+0000 7fb866600640 1 -- 172.21.15.64:0/38026295 wait complete. 2024-09-21T07:30:40.115 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:30:40.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.318+0000 7f994fc00640 1 -- 172.21.15.64:0/2880915305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480cd330 msgr2=0x7f99480b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.318+0000 7f994fc00640 1 --2- 172.21.15.64:0/2880915305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480cd330 0x7f99480b5180 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9934009840 tx=0x7f993401c740 comp rx=0 tx=0).stop 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.318+0000 7f994fc00640 1 -- 172.21.15.64:0/2880915305 shutdown_connections 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.318+0000 7f994fc00640 1 --2- 172.21.15.64:0/2880915305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480b56c0 0x7f99480b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.318+0000 7f994fc00640 1 --2- 172.21.15.64:0/2880915305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480cd330 0x7f99480b5180 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- 172.21.15.64:0/2880915305 >> 172.21.15.64:0/2880915305 conn(0x7f99480d2330 msgr2=0x7f99480d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- 172.21.15.64:0/2880915305 shutdown_connections 2024-09-21T07:30:40.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- 172.21.15.64:0/2880915305 wait complete. 2024-09-21T07:30:40.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 Processor -- start 2024-09-21T07:30:40.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- start start 2024-09-21T07:30:40.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 0x7f99480cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 0x7f99480aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9948169ff0 con 0x7f99480b56c0 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9948169e70 con 0x7f99480c9370 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.322+0000 7f994fc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f994816a170 con 0x7f99480d1da0 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36140/0 (socket says 172.21.15.64:36140) 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 -- 172.21.15.64:0/2017494049 learned_addr learned my addr 172.21.15.64:0/2017494049 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:40.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994dc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 0x7f99480aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9947e00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 0x7f99480cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 -- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 msgr2=0x7f99480cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 0x7f99480cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 -- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 msgr2=0x7f99480aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 0x7f99480aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 -- 172.21.15.64:0/2017494049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99481f9760 con 0x7f99480b56c0 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9947e00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 0x7f99480cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994dc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 0x7f99480aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994d200640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c500 tx=0x7f993c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c016020 con 0x7f99480b56c0 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f993c012940 con 0x7f99480b56c0 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99480adf90 con 0x7f99480b56c0 2024-09-21T07:30:40.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c012d90 con 0x7f99480b56c0 2024-09-21T07:30:40.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99480ae550 con 0x7f99480b56c0 2024-09-21T07:30:40.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99480b5ad0 con 0x7f99480b56c0 2024-09-21T07:30:40.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.326+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f993c019020 con 0x7f99480b56c0 2024-09-21T07:30:40.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.330+0000 7f9944c00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 0x7f9928075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.330+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5249+0+0 (secure 0 0 0) 0x7f993c094170 con 0x7f99480b56c0 2024-09-21T07:30:40.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.330+0000 7f9947e00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 0x7f9928075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.330+0000 7f9947e00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 0x7f9928075740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f99340af000 tx=0x7f993401af80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:40.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.334+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f993c020020 con 0x7f99480b56c0 2024-09-21T07:30:40.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.570+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9948166d20 con 0x7f99480b56c0 2024-09-21T07:30:40.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.570+0000 7f9944c00640 1 -- 172.21.15.64:0/2017494049 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) ==== 80+0+5304 (secure 0 0 0) 0x7f993c05f350 con 0x7f99480b56c0 2024-09-21T07:30:40.572 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:40.572 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:30:40.572 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:30:40.573 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:30:40.574 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:30:40.575 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:30:40.576 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:30:40.577 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.578 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.579 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.580 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:30:40.581 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:30:40.582 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:30:40.583 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:30:40.584 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.585 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.586 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:30:40.586 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:30:40.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 msgr2=0x7f9928075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 0x7f9928075740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f99340af000 tx=0x7f993401af80 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 msgr2=0x7f99480ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c500 tx=0x7f993c00c9c0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 shutdown_connections 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9928073230 0x7f9928075740 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99480c9370 0x7f99480aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99480d1da0 0x7f99480cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 --2- 172.21.15.64:0/2017494049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99480b56c0 0x7f99480ca920 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 >> 172.21.15.64:0/2017494049 conn(0x7f99480d2330 msgr2=0x7f99480b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:40.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 shutdown_connections 2024-09-21T07:30:40.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.574+0000 7f994fc00640 1 -- 172.21.15.64:0/2017494049 wait complete. 2024-09-21T07:30:40.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 -- 172.21.15.64:0/2775308812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 msgr2=0x7fecb4167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 --2- 172.21.15.64:0/2775308812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb4167450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecac009bf0 tx=0x7fecac01cb20 comp rx=0 tx=0).stop 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 -- 172.21.15.64:0/2775308812 shutdown_connections 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 --2- 172.21.15.64:0/2775308812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb4167450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 -- 172.21.15.64:0/2775308812 >> 172.21.15.64:0/2775308812 conn(0x7fecb406d1c0 msgr2=0x7fecb406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.750+0000 7fecbbc00640 1 -- 172.21.15.64:0/2775308812 shutdown_connections 2024-09-21T07:30:40.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 -- 172.21.15.64:0/2775308812 wait complete. 2024-09-21T07:30:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 Processor -- start 2024-09-21T07:30:40.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 -- start start 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b3d60 0x7fecb41646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fecb416af50 con 0x7fecb40d1d00 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fecb416add0 con 0x7fecb40b3d60 2024-09-21T07:30:40.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.754+0000 7fecbbc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fecb416b0d0 con 0x7fecb40c6eb0 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36146/0 (socket says 172.21.15.64:36146) 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 -- 172.21.15.64:0/293319655 learned_addr learned my addr 172.21.15.64:0/293319655 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9200640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b3d60 0x7fecb41646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb3e00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 -- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 msgr2=0x7fecb41475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb41475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 -- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b3d60 msgr2=0x7fecb41646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b3d60 0x7fecb41646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 -- 172.21.15.64:0/293319655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb40b7800 con 0x7fecb40d1d00 2024-09-21T07:30:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb3e00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb41475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb9c00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fecac019730 tx=0x7fecac005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac0b2040 con 0x7fecb40d1d00 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecac004b40 con 0x7fecb40d1d00 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb40b7ae0 con 0x7fecb40d1d00 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac003fe0 con 0x7fecb40d1d00 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb415dc10 con 0x7fecb40d1d00 2024-09-21T07:30:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb4167460 con 0x7fecb40d1d00 2024-09-21T07:30:40.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.758+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fecac004180 con 0x7fecb40d1d00 2024-09-21T07:30:40.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.762+0000 7fecb0c00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 0x7fec94075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:40.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.762+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5249+0+0 (secure 0 0 0) 0x7fecac12e090 con 0x7fecb40d1d00 2024-09-21T07:30:40.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.762+0000 7fecb9200640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 0x7fec94075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.762+0000 7fecb9200640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 0x7fec94075740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feca80016c0 tx=0x7feca8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:40.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.766+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fecac0167d0 con 0x7fecb40d1d00 2024-09-21T07:30:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.942+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fecb40d03f0 con 0x7fecb40d1d00 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.942+0000 7fecb0c00640 1 -- 172.21.15.64:0/293319655 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) ==== 84+0+65 (secure 0 0 0) 0x7fecac0f91d0 con 0x7fecb40d1d00 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:30:40.945 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:30:40.946 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:30:40.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 msgr2=0x7fec94075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 0x7fec94075740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feca80016c0 tx=0x7feca8009040 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 msgr2=0x7fecb415e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fecac019730 tx=0x7fecac005aa0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 shutdown_connections 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073230 0x7fec94075740 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40d1d00 0x7fecb415e130 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fecb40c6eb0 0x7fecb41475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 --2- 172.21.15.64:0/293319655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b3d60 0x7fecb41646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 >> 172.21.15.64:0/293319655 conn(0x7fecb406d1c0 msgr2=0x7fecb40c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 shutdown_connections 2024-09-21T07:30:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:40.946+0000 7fecbbc00640 1 -- 172.21.15.64:0/293319655 wait complete. 2024-09-21T07:30:40.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:30:40.968 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 -- 172.21.15.64:0/3604702330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 msgr2=0x7f660815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 --2- 172.21.15.64:0/3604702330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f660815f2f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009840 tx=0x7f65f001c820 comp rx=0 tx=0).stop 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 -- 172.21.15.64:0/3604702330 shutdown_connections 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 --2- 172.21.15.64:0/3604702330 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 0x7f6608151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 --2- 172.21.15.64:0/3604702330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f660815f2f0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 -- 172.21.15.64:0/3604702330 >> 172.21.15.64:0/3604702330 conn(0x7f66080cfea0 msgr2=0x7f66080d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 -- 172.21.15.64:0/3604702330 shutdown_connections 2024-09-21T07:30:41.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.134+0000 7f6607e00640 1 -- 172.21.15.64:0/3604702330 wait complete. 2024-09-21T07:30:41.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 Processor -- start 2024-09-21T07:30:41.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- start start 2024-09-21T07:30:41.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 0x7f66081f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 0x7f66081500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66080cb220 con 0x7f660815eee0 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66080cb0a0 con 0x7f66080cbf90 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6608169290 con 0x7f6608151a70 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36154/0 (socket says 172.21.15.64:36154) 2024-09-21T07:30:41.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 -- 172.21.15.64:0/2502201669 learned_addr learned my addr 172.21.15.64:0/2502201669 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:41.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f65ffe00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 0x7f66081500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:41.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 -- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 msgr2=0x7f66081500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:41.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6606a00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 0x7f66081f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 0x7f66081500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 -- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 msgr2=0x7f66081f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 0x7f66081f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 -- 172.21.15.64:0/2502201669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66080b1900 con 0x7f660815eee0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6606a00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 0x7f66081f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607400640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f660000eae0 tx=0x7f6600009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660000ce40 con 0x7f660815eee0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6600004c20 con 0x7f660815eee0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600005020 con 0x7f660815eee0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66080b1340 con 0x7f660815eee0 2024-09-21T07:30:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.138+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081f9180 con 0x7f660815eee0 2024-09-21T07:30:41.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66080b4180 con 0x7f660815eee0 2024-09-21T07:30:41.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f66000051c0 con 0x7f660815eee0 2024-09-21T07:30:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f65fea00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 0x7f65e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5249+0+0 (secure 0 0 0) 0x7f6600094e00 con 0x7f660815eee0 2024-09-21T07:30:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f6606a00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 0x7f65e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:41.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.142+0000 7f6606a00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 0x7f65e4075710 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f65f8000f70 tx=0x7f65f8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:41.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.146+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6600060100 con 0x7f660815eee0 2024-09-21T07:30:41.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:41.326+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f66080af5e0 con 0x7f660815eee0 2024-09-21T07:30:42.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.098+0000 7f65fea00640 1 -- 172.21.15.64:0/2502201669 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) ==== 138+0+0 (secure 0 0 0) 0x7f660005fa00 con 0x7f660815eee0 2024-09-21T07:30:42.100 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:30:42.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 msgr2=0x7f65e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:42.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 0x7f65e4075710 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f65f8000f70 tx=0x7f65f8009040 comp rx=0 tx=0).stop 2024-09-21T07:30:42.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 msgr2=0x7f66080ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f660000eae0 tx=0x7f6600009f70 comp rx=0 tx=0).stop 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 shutdown_connections 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65e4073200 0x7f65e4075710 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660815eee0 0x7f66080ae890 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6608151a70 0x7f66081500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 --2- 172.21.15.64:0/2502201669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66080cbf90 0x7f66081f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 >> 172.21.15.64:0/2502201669 conn(0x7f66080cfea0 msgr2=0x7f6608150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:42.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 shutdown_connections 2024-09-21T07:30:42.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.102+0000 7f6607e00640 1 -- 172.21.15.64:0/2502201669 wait complete. 2024-09-21T07:30:42.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:30:42.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 -- 172.21.15.64:0/1679898097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 msgr2=0x7f816406ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 --2- 172.21.15.64:0/1679898097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816406ffb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f8164070eb0 tx=0x7f815001c7d0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 -- 172.21.15.64:0/1679898097 shutdown_connections 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 --2- 172.21.15.64:0/1679898097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81640704f0 0x7f81640b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 --2- 172.21.15.64:0/1679898097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816406ffb0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 --2- 172.21.15.64:0/1679898097 >> v2:172.21.15.90:3300/0 conn(0x7f816415ec20 0x7f81640ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 -- 172.21.15.64:0/1679898097 >> 172.21.15.64:0/1679898097 conn(0x7f81640ccbe0 msgr2=0x7f81640ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 -- 172.21.15.64:0/1679898097 shutdown_connections 2024-09-21T07:30:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.306+0000 7f816bc00640 1 -- 172.21.15.64:0/1679898097 wait complete. 2024-09-21T07:30:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 Processor -- start 2024-09-21T07:30:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 -- start start 2024-09-21T07:30:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81640704f0 0x7f81640c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f816415ec20 0x7f81641f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f81640b24a0 con 0x7f81640ca990 2024-09-21T07:30:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f81640b2320 con 0x7f81640704f0 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f816bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f81640b2620 con 0x7f816415ec20 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36158/0 (socket says 172.21.15.64:36158) 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 -- 172.21.15.64:0/81733837 learned_addr learned my addr 172.21.15.64:0/81733837 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8169200640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81640704f0 0x7f81640c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8169c00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f816415ec20 0x7f81641f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 -- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f816415ec20 msgr2=0x7f81641f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f816415ec20 0x7f81641f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 -- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81640704f0 msgr2=0x7f81640c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81640704f0 0x7f81640c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.310+0000 7f8163e00640 1 -- 172.21.15.64:0/81733837 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81640c7720 con 0x7f81640ca990 2024-09-21T07:30:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f8163e00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f81500b0040 tx=0x7f8150005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81500b2040 con 0x7f81640ca990 2024-09-21T07:30:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8150005310 con 0x7f81640ca990 2024-09-21T07:30:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81500a5890 con 0x7f81640ca990 2024-09-21T07:30:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81641f97f0 con 0x7f81640ca990 2024-09-21T07:30:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81640c5150 con 0x7f81640ca990 2024-09-21T07:30:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81641f9560 con 0x7f81640ca990 2024-09-21T07:30:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.314+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f81500bd060 con 0x7f81640ca990 2024-09-21T07:30:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.318+0000 7f8160c00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 0x7f8144075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.318+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5619+0+0 (secure 0 0 0) 0x7f815012dcd0 con 0x7f81640ca990 2024-09-21T07:30:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.318+0000 7f8169200640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 0x7f8144075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.318+0000 7f8169200640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 0x7f8144075740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8164072330 tx=0x7f815800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.322+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f81500164b0 con 0x7f81640ca990 2024-09-21T07:30:42.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:42.510+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f81640c4f40 con 0x7f81640ca990 2024-09-21T07:30:43.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.102+0000 7f8160c00640 1 -- 172.21.15.64:0/81733837 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) ==== 170+0+0 (secure 0 0 0) 0x7f81500f8770 con 0x7f81640ca990 2024-09-21T07:30:43.106 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:30:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 msgr2=0x7f8144075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 0x7f8144075740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8164072330 tx=0x7f815800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 msgr2=0x7f816415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f81500b0040 tx=0x7f8150005e00 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 shutdown_connections 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8144073230 0x7f8144075740 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f816415ec20 0x7f81641f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81640ca990 0x7f816415b350 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 --2- 172.21.15.64:0/81733837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81640704f0 0x7f81640c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 >> 172.21.15.64:0/81733837 conn(0x7f81640ccbe0 msgr2=0x7f816406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 shutdown_connections 2024-09-21T07:30:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.106+0000 7f816bc00640 1 -- 172.21.15.64:0/81733837 wait complete. 2024-09-21T07:30:43.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.318+0000 7f608ac00640 1 -- 172.21.15.64:0/1389639434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 msgr2=0x7f608406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.318+0000 7f608ac00640 1 --2- 172.21.15.64:0/1389639434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608406f190 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6074009900 tx=0x7f607401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- 172.21.15.64:0/1389639434 shutdown_connections 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 --2- 172.21.15.64:0/1389639434 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 0x7f60840ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 --2- 172.21.15.64:0/1389639434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608406f190 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- 172.21.15.64:0/1389639434 >> 172.21.15.64:0/1389639434 conn(0x7f608406d4e0 msgr2=0x7f60840ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- 172.21.15.64:0/1389639434 shutdown_connections 2024-09-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- 172.21.15.64:0/1389639434 wait complete. 2024-09-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 Processor -- start 2024-09-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- start start 2024-09-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60840b3d50 0x7f6084152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 0x7f60841f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f608416c1e0 con 0x7f60840d0870 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f608416c060 con 0x7f60840b3d50 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.322+0000 7f608ac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f608416c360 con 0x7f60840cc920 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6083e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60840b3d50 0x7f6084152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36180/0 (socket says 172.21.15.64:36180) 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 -- 172.21.15.64:0/1983239998 learned_addr learned my addr 172.21.15.64:0/1983239998 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f607be00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 0x7f60841f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 -- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 msgr2=0x7f60841f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 0x7f60841f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 -- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60840b3d50 msgr2=0x7f6084152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60840b3d50 0x7f6084152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 -- 172.21.15.64:0/1983239998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60841f9a40 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6088c00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f607c00e970 tx=0x7f607c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c004d30 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f607c00cb20 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c005020 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60841f9d20 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6084152480 con 0x7f60840d0870 2024-09-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.326+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60841f97b0 con 0x7f60840d0870 2024-09-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.330+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f607c0051c0 con 0x7f60840d0870 2024-09-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.330+0000 7f6080c00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 0x7f6060075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.330+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6001+0+0 (secure 0 0 0) 0x7f607c095140 con 0x7f60840d0870 2024-09-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.330+0000 7f6083e00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 0x7f6060075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.330+0000 7f6083e00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 0x7f6060075740 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60740af000 tx=0x7f607401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.334+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f607c016030 con 0x7f60840d0870 2024-09-21T07:30:43.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:43.550+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f60840ccd30 con 0x7f60840d0870 2024-09-21T07:30:44.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.122+0000 7f6080c00640 1 -- 172.21.15.64:0/1983239998 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v90) ==== 174+0+0 (secure 0 0 0) 0x7f607c05f940 con 0x7f60840d0870 2024-09-21T07:30:44.125 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 17 and data pool 18 2024-09-21T07:30:44.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.126+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 msgr2=0x7f6060075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.126+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 0x7f6060075740 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60740af000 tx=0x7f607401b120 comp rx=0 tx=0).stop 2024-09-21T07:30:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.126+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 msgr2=0x7f608414cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.126+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f607c00e970 tx=0x7f607c00ee30 comp rx=0 tx=0).stop 2024-09-21T07:30:44.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 shutdown_connections 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6060073230 0x7f6060075740 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60840d0870 0x7f608414cc00 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60840cc920 0x7f60841f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 --2- 172.21.15.64:0/1983239998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60840b3d50 0x7f6084152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 >> 172.21.15.64:0/1983239998 conn(0x7f608406d4e0 msgr2=0x7f60840cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 shutdown_connections 2024-09-21T07:30:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.130+0000 7f608ac00640 1 -- 172.21.15.64:0/1983239998 wait complete. 2024-09-21T07:30:44.179 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 -- 172.21.15.64:0/2954092593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 msgr2=0x7f65f80707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 --2- 172.21.15.64:0/2954092593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f80707c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f65f80d0d80 tx=0x7f65e801eff0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 -- 172.21.15.64:0/2954092593 shutdown_connections 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 --2- 172.21.15.64:0/2954092593 >> v2:172.21.15.90:3300/0 conn(0x7f65f80cfee0 0x7f65f80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 --2- 172.21.15.64:0/2954092593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f80707c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 -- 172.21.15.64:0/2954092593 >> 172.21.15.64:0/2954092593 conn(0x7f65f80cdcf0 msgr2=0x7f65f80ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 -- 172.21.15.64:0/2954092593 shutdown_connections 2024-09-21T07:30:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.338+0000 7f65fcc00640 1 -- 172.21.15.64:0/2954092593 wait complete. 2024-09-21T07:30:44.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 Processor -- start 2024-09-21T07:30:44.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 -- start start 2024-09-21T07:30:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 0x7f65f8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65f80d02f0 0x7f65f81f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80b3230 con 0x7f65f815ee20 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80b4cf0 con 0x7f65f80cfee0 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65fcc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f65f80b33b0 con 0x7f65f80d02f0 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65f6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.342+0000 7f65f6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36212/0 (socket says 172.21.15.64:36212) 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 -- 172.21.15.64:0/464001669 learned_addr learned my addr 172.21.15.64:0/464001669 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f5e00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 0x7f65f8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65efe00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65f80d02f0 0x7f65f81f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 -- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65f80d02f0 msgr2=0x7f65f81f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65f80d02f0 0x7f65f81f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 -- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 msgr2=0x7f65f8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 0x7f65f8156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 -- 172.21.15.64:0/464001669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f81575f0 con 0x7f65f815ee20 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f5e00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 0x7f65f8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65f6800640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f65f000cad0 tx=0x7f65f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0016020 con 0x7f65f815ee20 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f000ab40 con 0x7f65f815ee20 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f8147720 con 0x7f65f815ee20 2024-09-21T07:30:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000ce10 con 0x7f65f815ee20 2024-09-21T07:30:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f8147ce0 con 0x7f65f815ee20 2024-09-21T07:30:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f8147490 con 0x7f65f815ee20 2024-09-21T07:30:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.346+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f65f0019020 con 0x7f65f815ee20 2024-09-21T07:30:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.350+0000 7f65ee000640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 0x7f65d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.350+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6101+0+0 (secure 0 0 0) 0x7f65f0094610 con 0x7f65f815ee20 2024-09-21T07:30:44.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.350+0000 7f65f5e00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 0x7f65d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.350+0000 7f65f5e00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 0x7f65d4075710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f65e80b2000 tx=0x7f65e801d830 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.354+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f65f0020020 con 0x7f65f815ee20 2024-09-21T07:30:44.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.534+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65f80b2cf0 con 0x7f65f815ee20 2024-09-21T07:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.534+0000 7f65ee000640 1 -- 172.21.15.64:0/464001669 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16977 (secure 0 0 0) 0x7f65f005f400 con 0x7f65f815ee20 2024-09-21T07:30:44.537 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:44.537 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":130,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:43.555384+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:30:41.341081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-21T07:30:42.525982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 msgr2=0x7f65d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 0x7f65d4075710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f65e80b2000 tx=0x7f65e801d830 comp rx=0 tx=0).stop 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 msgr2=0x7f65f8146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f65f000cad0 tx=0x7f65f000cbc0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 shutdown_connections 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65d4073200 0x7f65d4075710 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f815ee20 0x7f65f8146bb0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65f80d02f0 0x7f65f81f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 --2- 172.21.15.64:0/464001669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65f80cfee0 0x7f65f8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 >> 172.21.15.64:0/464001669 conn(0x7f65f80cdcf0 msgr2=0x7f65f80d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 shutdown_connections 2024-09-21T07:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.538+0000 7f65fcc00640 1 -- 172.21.15.64:0/464001669 wait complete. 2024-09-21T07:30:44.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.718+0000 7f685e600640 1 -- 172.21.15.64:0/315012969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580d1d00 msgr2=0x7f68580d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.718+0000 7f685e600640 1 --2- 172.21.15.64:0/315012969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580d1d00 0x7f68580d03f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6848009870 tx=0x7f684801c7c0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- 172.21.15.64:0/315012969 shutdown_connections 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 --2- 172.21.15.64:0/315012969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580d1d00 0x7f68580d03f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- 172.21.15.64:0/315012969 >> 172.21.15.64:0/315012969 conn(0x7f685806d1c0 msgr2=0x7f685806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- 172.21.15.64:0/315012969 shutdown_connections 2024-09-21T07:30:44.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- 172.21.15.64:0/315012969 wait complete. 2024-09-21T07:30:44.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 Processor -- start 2024-09-21T07:30:44.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- start start 2024-09-21T07:30:44.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580b3d60 0x7f685814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580c5ea0 0x7f6858154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f685816b030 con 0x7f68580d1d00 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f685816aeb0 con 0x7f68580c5ea0 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.722+0000 7f685e600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f685816b1b0 con 0x7f68580b3d60 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36216/0 (socket says 172.21.15.64:36216) 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 -- 172.21.15.64:0/769624865 learned_addr learned my addr 172.21.15.64:0/769624865 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857400640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580b3d60 0x7f685814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f684ea00640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580c5ea0 0x7f6858154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 -- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580b3d60 msgr2=0x7f685814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580b3d60 0x7f685814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 -- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580c5ea0 msgr2=0x7f6858154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580c5ea0 0x7f6858154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 -- 172.21.15.64:0/769624865 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68581f8ba0 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f6857e00640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f685000cac0 tx=0x7f685000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850016020 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f685000a960 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685000adb0 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68581f8e60 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68581f9420 con 0x7f68580d1d00 2024-09-21T07:30:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6858155500 con 0x7f68580d1d00 2024-09-21T07:30:44.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.726+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6850019020 con 0x7f68580d1d00 2024-09-21T07:30:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.730+0000 7f684fe00640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 0x7f6834075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.730+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6101+0+0 (secure 0 0 0) 0x7f6850094690 con 0x7f68580d1d00 2024-09-21T07:30:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.730+0000 7f6857400640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 0x7f6834075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.730+0000 7f6857400640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 0x7f6834075740 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f68480af000 tx=0x7f684801b000 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:44.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.734+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6850020020 con 0x7f68580d1d00 2024-09-21T07:30:44.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.910+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68580d03f0 con 0x7f68580d1d00 2024-09-21T07:30:44.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.910+0000 7f684fe00640 1 -- 172.21.15.64:0/769624865 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16977 (secure 0 0 0) 0x7f685005f480 con 0x7f68580d1d00 2024-09-21T07:30:44.913 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:44.913 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":130,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:43.555384+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:30:41.341081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-21T07:30:42.525982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:44.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 msgr2=0x7f6834075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 0x7f6834075740 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f68480af000 tx=0x7f684801b000 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 msgr2=0x7f685806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f685000cac0 tx=0x7f685000cbb0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 shutdown_connections 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6834073230 0x7f6834075740 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68580d1d00 0x7f685806f080 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580c5ea0 0x7f6858154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 --2- 172.21.15.64:0/769624865 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68580b3d60 0x7f685814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 >> 172.21.15.64:0/769624865 conn(0x7f685806d1c0 msgr2=0x7f685815b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 shutdown_connections 2024-09-21T07:30:44.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:44.914+0000 7f685e600640 1 -- 172.21.15.64:0/769624865 wait complete. 2024-09-21T07:30:44.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:30:45.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 -- 172.21.15.64:0/1720198390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46841703d0 msgr2=0x7f46841727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 --2- 172.21.15.64:0/1720198390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46841703d0 0x7f46841727f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4684071d50 tx=0x7f467001d0b0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 -- 172.21.15.64:0/1720198390 shutdown_connections 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 --2- 172.21.15.64:0/1720198390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4684172d30 0x7f4684175150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 --2- 172.21.15.64:0/1720198390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46841703d0 0x7f46841727f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 --2- 172.21.15.64:0/1720198390 >> v2:172.21.15.90:3300/0 conn(0x7f468409a9f0 0x7f468416fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.338+0000 7f468b400640 1 -- 172.21.15.64:0/1720198390 >> 172.21.15.64:0/1720198390 conn(0x7f46840d02f0 msgr2=0x7f46840d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.342+0000 7f468b400640 1 -- 172.21.15.64:0/1720198390 shutdown_connections 2024-09-21T07:30:45.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.342+0000 7f468b400640 1 -- 172.21.15.64:0/1720198390 wait complete. 2024-09-21T07:30:45.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.342+0000 7f468b400640 1 Processor -- start 2024-09-21T07:30:45.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.342+0000 7f468b400640 1 -- start start 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f468409a9f0 0x7f468420b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46841703d0 0x7f468416e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f468408b4a0 con 0x7f4684172d30 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46840c3c10 con 0x7f468409a9f0 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f468408b620 con 0x7f46841703d0 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55520/0 (socket says 172.21.15.64:55520) 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 -- 172.21.15.64:0/915021675 learned_addr learned my addr 172.21.15.64:0/915021675 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4688a00640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f468409a9f0 0x7f468420b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:45.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4683e00640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46841703d0 0x7f468416e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:45.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 -- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46841703d0 msgr2=0x7f468416e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:45.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46841703d0 0x7f468416e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 -- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f468409a9f0 msgr2=0x7f468420b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f468409a9f0 0x7f468420b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 -- 172.21.15.64:0/915021675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46841752a0 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4689400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f467c00e910 tx=0x7f467c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c004d30 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f467c00cb20 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46840ad1d0 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c005020 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468416ead0 con 0x7f4684172d30 2024-09-21T07:30:45.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.346+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46840acfc0 con 0x7f4684172d30 2024-09-21T07:30:45.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.350+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f467c0051c0 con 0x7f4684172d30 2024-09-21T07:30:45.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.350+0000 7f4680c00640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 0x7f4664075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:45.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.350+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f467c094a90 con 0x7f4684172d30 2024-09-21T07:30:45.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.350+0000 7f4688a00640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 0x7f4664075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:45.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.350+0000 7f4688a00640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 0x7f4664075710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4678005e80 tx=0x7f4678005e10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:45.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.354+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f467c016030 con 0x7f4684172d30 2024-09-21T07:30:45.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:45.570+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f468416fe90 con 0x7f4684172d30 2024-09-21T07:30:46.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.150+0000 7f4680c00640 1 -- 172.21.15.64:0/915021675 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) ==== 118+0+0 (secure 0 0 0) 0x7f467c05f360 con 0x7f4684172d30 2024-09-21T07:30:46.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 msgr2=0x7f4664075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 0x7f4664075710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4678005e80 tx=0x7f4678005e10 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 msgr2=0x7f468416f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f467c00e910 tx=0x7f467c00edd0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 shutdown_connections 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4664073200 0x7f4664075710 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4684172d30 0x7f468416f2d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46841703d0 0x7f468416e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 --2- 172.21.15.64:0/915021675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f468409a9f0 0x7f468420b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 >> 172.21.15.64:0/915021675 conn(0x7f46840d02f0 msgr2=0x7f468409d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:46.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 shutdown_connections 2024-09-21T07:30:46.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.154+0000 7f468b400640 1 -- 172.21.15.64:0/915021675 wait complete. 2024-09-21T07:30:46.181 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:30:46.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:30:46.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- 172.21.15.64:0/2156317636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680ce730 msgr2=0x7f96680ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 --2- 172.21.15.64:0/2156317636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680ce730 0x7f96680ceb40 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f96680711c0 tx=0x7f966001cd80 comp rx=0 tx=0).stop 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- 172.21.15.64:0/2156317636 shutdown_connections 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 --2- 172.21.15.64:0/2156317636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680ce730 0x7f96680ceb40 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 --2- 172.21.15.64:0/2156317636 >> v2:172.21.15.90:3300/0 conn(0x7f96680b3910 0x7f96680ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 --2- 172.21.15.64:0/2156317636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- 172.21.15.64:0/2156317636 >> 172.21.15.64:0/2156317636 conn(0x7f966806d450 msgr2=0x7f96680d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- 172.21.15.64:0/2156317636 shutdown_connections 2024-09-21T07:30:46.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- 172.21.15.64:0/2156317636 wait complete. 2024-09-21T07:30:46.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 Processor -- start 2024-09-21T07:30:46.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.358+0000 7f9670400640 1 -- start start 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96680ce730 0x7f966806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f966806fa10 con 0x7f96680b3910 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f966806f890 con 0x7f96680ce730 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f966806fb90 con 0x7f966809df30 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55538/0 (socket says 172.21.15.64:55538) 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 -- 172.21.15.64:0/3850339056 learned_addr learned my addr 172.21.15.64:0/3850339056 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966e400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96680ce730 0x7f966806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966da00640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:46.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 -- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 msgr2=0x7f96680b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 -- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96680ce730 msgr2=0x7f966806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96680ce730 0x7f966806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 -- 172.21.15.64:0/3850339056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9668149f70 con 0x7f96680b3910 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966da00640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:46.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f966d000640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f965400d780 tx=0x7f965400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654017070 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f965400de90 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654010460 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96681491b0 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9668149770 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.362+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96680ce1f0 con 0x7f96680b3910 2024-09-21T07:30:46.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.366+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f965401a070 con 0x7f96680b3910 2024-09-21T07:30:46.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.366+0000 7f9665600640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 0x7f9648075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:46.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.366+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f9654094430 con 0x7f96680b3910 2024-09-21T07:30:46.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.366+0000 7f966da00640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 0x7f9648075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:46.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.366+0000 7f966da00640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 0x7f9648075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f965c00bb40 tx=0x7f965c005e50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:46.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.370+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f965405ecf0 con 0x7f96680b3910 2024-09-21T07:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:46.586+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f96680b2690 con 0x7f96680b3910 2024-09-21T07:30:47.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9665600640 1 -- 172.21.15.64:0/3850339056 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) ==== 122+0+0 (secure 0 0 0) 0x7f9654063720 con 0x7f96680b3910 2024-09-21T07:30:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 msgr2=0x7f9648075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 0x7f9648075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f965c00bb40 tx=0x7f965c005e50 comp rx=0 tx=0).stop 2024-09-21T07:30:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 msgr2=0x7f966809c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f965400d780 tx=0x7f965400dc40 comp rx=0 tx=0).stop 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 shutdown_connections 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9648073200 0x7f9648075710 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96680ce730 0x7f966806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96680b3910 0x7f966809c1e0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 --2- 172.21.15.64:0/3850339056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f966809df30 0x7f96680b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.166+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 >> 172.21.15.64:0/3850339056 conn(0x7f966806d450 msgr2=0x7f966815a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.170+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 shutdown_connections 2024-09-21T07:30:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.170+0000 7f9670400640 1 -- 172.21.15.64:0/3850339056 wait complete. 2024-09-21T07:30:47.195 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:30:47.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:47.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- 172.21.15.64:0/2780213445 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f815b700 msgr2=0x7f99f80cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2780213445 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f815b700 0x7f99f80cfb20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009840 tx=0x7f99ec01c680 comp rx=0 tx=0).stop 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- 172.21.15.64:0/2780213445 shutdown_connections 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2780213445 >> v2:172.21.15.90:3300/0 conn(0x7f99f806ff90 0x7f99f80cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2780213445 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f815b700 0x7f99f80cfb20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- 172.21.15.64:0/2780213445 >> 172.21.15.64:0/2780213445 conn(0x7f99f806e890 msgr2=0x7f99f80b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- 172.21.15.64:0/2780213445 shutdown_connections 2024-09-21T07:30:47.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- 172.21.15.64:0/2780213445 wait complete. 2024-09-21T07:30:47.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 Processor -- start 2024-09-21T07:30:47.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.358+0000 7f99ffe00640 1 -- start start 2024-09-21T07:30:47.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f806ff90 0x7f99f80b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99f80ce240 0x7f99f8164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8168f80 con 0x7f99f815b700 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8168e00 con 0x7f99f80ce240 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f99f8169100 con 0x7f99f806ff90 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55550/0 (socket says 172.21.15.64:55550) 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 -- 172.21.15.64:0/744224124 learned_addr learned my addr 172.21.15.64:0/744224124 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fd400640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f806ff90 0x7f99f80b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fca00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99f80ce240 0x7f99f8164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 -- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f806ff90 msgr2=0x7f99f80b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f806ff90 0x7f99f80b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 -- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99f80ce240 msgr2=0x7f99f8164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99f80ce240 0x7f99f8164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 -- 172.21.15.64:0/744224124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f80c4fe0 con 0x7f99f815b700 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99fde00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f99f000cbc0 tx=0x7f99f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0016020 con 0x7f99f815b700 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f000ab60 con 0x7f99f815b700 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f815cff0 con 0x7f99f815b700 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0012420 con 0x7f99f815b700 2024-09-21T07:30:47.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f815d570 con 0x7f99f815b700 2024-09-21T07:30:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.362+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f80cdd00 con 0x7f99f815b700 2024-09-21T07:30:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.366+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99f0019020 con 0x7f99f815b700 2024-09-21T07:30:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.366+0000 7f99f5600640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 0x7f99d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.366+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f99f0094880 con 0x7f99f815b700 2024-09-21T07:30:47.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.366+0000 7f99fd400640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 0x7f99d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.366+0000 7f99fd400640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 0x7f99d8075710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0ae000 tx=0x7f99ec01aec0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:47.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.370+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f99f0020020 con 0x7f99f815b700 2024-09-21T07:30:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.582+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99f80c4c00 con 0x7f99f815b700 2024-09-21T07:30:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.582+0000 7f99f5600640 1 -- 172.21.15.64:0/744224124 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7f99f80ce650 con 0x7f99f815b700 2024-09-21T07:30:47.585 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:47.585 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:30:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:30:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 msgr2=0x7f99d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 0x7f99d8075710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0ae000 tx=0x7f99ec01aec0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 msgr2=0x7f99f8156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f99f000cbc0 tx=0x7f99f000ccb0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 shutdown_connections 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99d8073200 0x7f99d8075710 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99f815b700 0x7f99f8156570 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99f80ce240 0x7f99f8164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 --2- 172.21.15.64:0/744224124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99f806ff90 0x7f99f80b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 >> 172.21.15.64:0/744224124 conn(0x7f99f806e890 msgr2=0x7f99f80cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:47.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 shutdown_connections 2024-09-21T07:30:47.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.586+0000 7f99ffe00640 1 -- 172.21.15.64:0/744224124 wait complete. 2024-09-21T07:30:47.607 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:30:47.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 -- 172.21.15.64:0/952024873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c0cd790 msgr2=0x7f761c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 --2- 172.21.15.64:0/952024873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c0cd790 0x7f761c15b320 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f761c0d0ed0 tx=0x7f761001c770 comp rx=0 tx=0).stop 2024-09-21T07:30:47.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 -- 172.21.15.64:0/952024873 shutdown_connections 2024-09-21T07:30:47.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 --2- 172.21.15.64:0/952024873 >> v2:172.21.15.90:3300/0 conn(0x7f761c06fba0 0x7f761c06ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 --2- 172.21.15.64:0/952024873 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c15f100 0x7f761c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 --2- 172.21.15.64:0/952024873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c0cd790 0x7f761c15b320 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 -- 172.21.15.64:0/952024873 >> 172.21.15.64:0/952024873 conn(0x7f761c0b2ca0 msgr2=0x7f761c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:47.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 -- 172.21.15.64:0/952024873 shutdown_connections 2024-09-21T07:30:47.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 -- 172.21.15.64:0/952024873 wait complete. 2024-09-21T07:30:47.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.766+0000 7f7624600640 1 Processor -- start 2024-09-21T07:30:47.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- start start 2024-09-21T07:30:47.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c0cd790 0x7f761c0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761c15f100 0x7f761c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0b6740 con 0x7f761c06fba0 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0b65c0 con 0x7f761c15f100 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f761c0b68c0 con 0x7f761c0cd790 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55564/0 (socket says 172.21.15.64:55564) 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 -- 172.21.15.64:0/311911846 learned_addr learned my addr 172.21.15.64:0/311911846 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7622600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761c15f100 0x7f761c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621200640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c0cd790 0x7f761c0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 -- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c0cd790 msgr2=0x7f761c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c0cd790 0x7f761c0affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 -- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761c15f100 msgr2=0x7f761c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761c15f100 0x7f761c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 -- 172.21.15.64:0/311911846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c0b1f70 con 0x7f761c06fba0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7621c00640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f76100b0040 tx=0x7f76100a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100b2040 con 0x7f761c06fba0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76100043b0 con 0x7f761c06fba0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c0b2250 con 0x7f761c06fba0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610005290 con 0x7f761c06fba0 2024-09-21T07:30:47.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.770+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c0b2810 con 0x7f761c06fba0 2024-09-21T07:30:47.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c15b320 con 0x7f761c06fba0 2024-09-21T07:30:47.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f76100bd060 con 0x7f761c06fba0 2024-09-21T07:30:47.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7619600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 0x7f75fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:47.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f761012d900 con 0x7f761c06fba0 2024-09-21T07:30:47.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7621200640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 0x7f75fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:47.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.774+0000 7f7621200640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 0x7f75fc075710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f76080058d0 tx=0x7f7608005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:47.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.778+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f76100164b0 con 0x7f761c06fba0 2024-09-21T07:30:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.958+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f761c0b3bb0 con 0x7f761c06fba0 2024-09-21T07:30:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7619600640 1 -- 172.21.15.64:0/311911846 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16964 (secure 0 0 0) 0x7f76100f8790 con 0x7f761c06fba0 2024-09-21T07:30:47.962 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:47.962 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":131,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:45.126736+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:30:41.341081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-21T07:30:42.525982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:30:47.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 msgr2=0x7f75fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 0x7f75fc075710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f76080058d0 tx=0x7f7608005860 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 msgr2=0x7f761c1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f76100b0040 tx=0x7f76100a5670 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 shutdown_connections 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75fc073200 0x7f75fc075710 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761c15f100 0x7f761c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f761c0cd790 0x7f761c0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 --2- 172.21.15.64:0/311911846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f761c06fba0 0x7f761c1581d0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 >> 172.21.15.64:0/311911846 conn(0x7f761c0b2ca0 msgr2=0x7f761c166c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 shutdown_connections 2024-09-21T07:30:47.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:47.962+0000 7f7624600640 1 -- 172.21.15.64:0/311911846 wait complete. 2024-09-21T07:30:47.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:30:47.987 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:30:48.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 -- 172.21.15.64:0/3947201518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900b4700 msgr2=0x7f2a90072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 --2- 172.21.15.64:0/3947201518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900b4700 0x7f2a90072e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009bc0 tx=0x7f2a8801cb40 comp rx=0 tx=0).stop 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 -- 172.21.15.64:0/3947201518 shutdown_connections 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 --2- 172.21.15.64:0/3947201518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900b4700 0x7f2a90072e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 --2- 172.21.15.64:0/3947201518 >> v2:172.21.15.90:3300/0 conn(0x7f2a900709b0 0x7f2a900b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 -- 172.21.15.64:0/3947201518 >> 172.21.15.64:0/3947201518 conn(0x7f2a900ccbe0 msgr2=0x7f2a900ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 -- 172.21.15.64:0/3947201518 shutdown_connections 2024-09-21T07:30:48.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.150+0000 7f2a97400640 1 -- 172.21.15.64:0/3947201518 wait complete. 2024-09-21T07:30:48.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 Processor -- start 2024-09-21T07:30:48.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- start start 2024-09-21T07:30:48.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900709b0 0x7f2a901fc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a9015edb0 0x7f2a9014a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90168bf0 con 0x7f2a900b4700 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90168a70 con 0x7f2a9015edb0 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2a90168d70 con 0x7f2a900709b0 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55576/0 (socket says 172.21.15.64:55576) 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 -- 172.21.15.64:0/1476242746 learned_addr learned my addr 172.21.15.64:0/1476242746 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a94a00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900709b0 0x7f2a901fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a95400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a9015edb0 0x7f2a9014a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 -- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900709b0 msgr2=0x7f2a901fc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900709b0 0x7f2a901fc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 -- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a9015edb0 msgr2=0x7f2a9014a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a9015edb0 0x7f2a9014a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 -- 172.21.15.64:0/1476242746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9014a7e0 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a87e00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800e970 tx=0x7f2a7800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800cd80 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a78004020 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a900c5590 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78004470 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.154+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a900c5b50 con 0x7f2a900b4700 2024-09-21T07:30:48.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.158+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a900b41c0 con 0x7f2a900b4700 2024-09-21T07:30:48.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.158+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2a780047d0 con 0x7f2a900b4700 2024-09-21T07:30:48.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.158+0000 7f2a8d600640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 0x7f2a6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.158+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f2a78094ff0 con 0x7f2a900b4700 2024-09-21T07:30:48.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.158+0000 7f2a94a00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 0x7f2a6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.162+0000 7f2a94a00640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 0x7f2a6c075740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2a80007d70 tx=0x7f2a80007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:48.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.162+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2a9014a7e0 con 0x7f2a900b4700 2024-09-21T07:30:48.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.342+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a900c5340 con 0x7f2a6c073230 2024-09-21T07:30:48.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.346+0000 7f2a8d600640 1 -- 172.21.15.64:0/1476242746 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244012 (secure 0 0 0) 0x7f2a900c5340 con 0x7f2a6c073230 2024-09-21T07:30:48.350 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:48.351 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 msgr2=0x7f2a6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 0x7f2a6c075740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2a80007d70 tx=0x7f2a80007d00 comp rx=0 tx=0).stop 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 msgr2=0x7f2a900c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800e970 tx=0x7f2a7800ee30 comp rx=0 tx=0).stop 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 shutdown_connections 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2a6c073230 0x7f2a6c075740 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a9015edb0 0x7f2a9014a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a900b4700 0x7f2a900c6630 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 --2- 172.21.15.64:0/1476242746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a900709b0 0x7f2a901fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 >> 172.21.15.64:0/1476242746 conn(0x7f2a900ccbe0 msgr2=0x7f2a9015def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:48.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 shutdown_connections 2024-09-21T07:30:48.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.350+0000 7f2a97400640 1 -- 172.21.15.64:0/1476242746 wait complete. 2024-09-21T07:30:48.371 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-21T07:30:47.553488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":104,"acting":104,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":367272,"kb_used_data":13600,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754607448,"statfs":{"total":773094113280,"available":772718026752,"internally_reserved":0,"allocated":13926400,"data_stored":7152486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.450333"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333522+0000","last_change":"2024-09-21T07:30:44.171380+0000","last_active":"2024-09-21T07:30:45.333522+0000","last_peered":"2024-09-21T07:30:45.333522+0000","last_clean":"2024-09-21T07:30:45.333522+0000","last_became_active":"2024-09-21T07:30:44.170753+0000","last_became_peered":"2024-09-21T07:30:44.170753+0000","last_unstale":"2024-09-21T07:30:45.333522+0000","last_undegraded":"2024-09-21T07:30:45.333522+0000","last_fullsized":"2024-09-21T07:30:45.333522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:14.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334560+0000","last_change":"2024-09-21T07:30:44.167425+0000","last_active":"2024-09-21T07:30:45.334560+0000","last_peered":"2024-09-21T07:30:45.334560+0000","last_clean":"2024-09-21T07:30:45.334560+0000","last_became_active":"2024-09-21T07:30:44.166377+0000","last_became_peered":"2024-09-21T07:30:44.166377+0000","last_unstale":"2024-09-21T07:30:45.334560+0000","last_undegraded":"2024-09-21T07:30:45.334560+0000","last_fullsized":"2024-09-21T07:30:45.334560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:53.872339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339251+0000","last_change":"2024-09-21T07:30:44.155212+0000","last_active":"2024-09-21T07:30:45.339251+0000","last_peered":"2024-09-21T07:30:45.339251+0000","last_clean":"2024-09-21T07:30:45.339251+0000","last_became_active":"2024-09-21T07:30:44.154732+0000","last_became_peered":"2024-09-21T07:30:44.154732+0000","last_unstale":"2024-09-21T07:30:45.339251+0000","last_undegraded":"2024-09-21T07:30:45.339251+0000","last_fullsized":"2024-09-21T07:30:45.339251+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:59.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131087+0000","last_change":"2024-09-21T07:30:44.169122+0000","last_active":"2024-09-21T07:30:45.131087+0000","last_peered":"2024-09-21T07:30:45.131087+0000","last_clean":"2024-09-21T07:30:45.131087+0000","last_became_active":"2024-09-21T07:30:44.168827+0000","last_became_peered":"2024-09-21T07:30:44.168827+0000","last_unstale":"2024-09-21T07:30:45.131087+0000","last_undegraded":"2024-09-21T07:30:45.131087+0000","last_fullsized":"2024-09-21T07:30:45.131087+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.361691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339544+0000","last_change":"2024-09-21T07:30:44.170676+0000","last_active":"2024-09-21T07:30:45.339544+0000","last_peered":"2024-09-21T07:30:45.339544+0000","last_clean":"2024-09-21T07:30:45.339544+0000","last_became_active":"2024-09-21T07:30:44.170330+0000","last_became_peered":"2024-09-21T07:30:44.170330+0000","last_unstale":"2024-09-21T07:30:45.339544+0000","last_undegraded":"2024-09-21T07:30:45.339544+0000","last_fullsized":"2024-09-21T07:30:45.339544+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131186+0000","last_change":"2024-09-21T07:30:44.169611+0000","last_active":"2024-09-21T07:30:45.131186+0000","last_peered":"2024-09-21T07:30:45.131186+0000","last_clean":"2024-09-21T07:30:45.131186+0000","last_became_active":"2024-09-21T07:30:44.169276+0000","last_became_peered":"2024-09-21T07:30:44.169276+0000","last_unstale":"2024-09-21T07:30:45.131186+0000","last_undegraded":"2024-09-21T07:30:45.131186+0000","last_fullsized":"2024-09-21T07:30:45.131186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:16.272379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334848+0000","last_change":"2024-09-21T07:30:44.171079+0000","last_active":"2024-09-21T07:30:45.334848+0000","last_peered":"2024-09-21T07:30:45.334848+0000","last_clean":"2024-09-21T07:30:45.334848+0000","last_became_active":"2024-09-21T07:30:44.170634+0000","last_became_peered":"2024-09-21T07:30:44.170634+0000","last_unstale":"2024-09-21T07:30:45.334848+0000","last_undegraded":"2024-09-21T07:30:45.334848+0000","last_fullsized":"2024-09-21T07:30:45.334848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.413012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338952+0000","last_change":"2024-09-21T07:30:44.161541+0000","last_active":"2024-09-21T07:30:45.338952+0000","last_peered":"2024-09-21T07:30:45.338952+0000","last_clean":"2024-09-21T07:30:45.338952+0000","last_became_active":"2024-09-21T07:30:44.158258+0000","last_became_peered":"2024-09-21T07:30:44.158258+0000","last_unstale":"2024-09-21T07:30:45.338952+0000","last_undegraded":"2024-09-21T07:30:45.338952+0000","last_fullsized":"2024-09-21T07:30:45.338952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.709605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338866+0000","last_change":"2024-09-21T07:30:44.171001+0000","last_active":"2024-09-21T07:30:45.338866+0000","last_peered":"2024-09-21T07:30:45.338866+0000","last_clean":"2024-09-21T07:30:45.338866+0000","last_became_active":"2024-09-21T07:30:44.170412+0000","last_became_peered":"2024-09-21T07:30:44.170412+0000","last_unstale":"2024-09-21T07:30:45.338866+0000","last_undegraded":"2024-09-21T07:30:45.338866+0000","last_fullsized":"2024-09-21T07:30:45.338866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:29.547247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131266+0000","last_change":"2024-09-21T07:30:44.158437+0000","last_active":"2024-09-21T07:30:45.131266+0000","last_peered":"2024-09-21T07:30:45.131266+0000","last_clean":"2024-09-21T07:30:45.131266+0000","last_became_active":"2024-09-21T07:30:44.157277+0000","last_became_peered":"2024-09-21T07:30:44.157277+0000","last_unstale":"2024-09-21T07:30:45.131266+0000","last_undegraded":"2024-09-21T07:30:45.131266+0000","last_fullsized":"2024-09-21T07:30:45.131266+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:19.353180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111427+0000","last_change":"2024-09-21T07:30:42.111427+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111427+0000","last_undegraded":"2024-09-21T07:30:42.111427+0000","last_fullsized":"2024-09-21T07:30:42.111427+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109057+0000","last_change":"2024-09-21T07:30:42.109057+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109057+0000","last_undegraded":"2024-09-21T07:30:42.109057+0000","last_fullsized":"2024-09-21T07:30:42.109057+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338779+0000","last_change":"2024-09-21T07:30:43.138630+0000","last_active":"2024-09-21T07:30:45.338779+0000","last_peered":"2024-09-21T07:30:45.338779+0000","last_clean":"2024-09-21T07:30:45.338779+0000","last_became_active":"2024-09-21T07:30:43.138290+0000","last_became_peered":"2024-09-21T07:30:43.138290+0000","last_unstale":"2024-09-21T07:30:45.338779+0000","last_undegraded":"2024-09-21T07:30:45.338779+0000","last_fullsized":"2024-09-21T07:30:45.338779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:06.977356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339588+0000","last_change":"2024-09-21T07:30:44.166923+0000","last_active":"2024-09-21T07:30:45.339588+0000","last_peered":"2024-09-21T07:30:45.339588+0000","last_clean":"2024-09-21T07:30:45.339588+0000","last_became_active":"2024-09-21T07:30:44.166577+0000","last_became_peered":"2024-09-21T07:30:44.166577+0000","last_unstale":"2024-09-21T07:30:45.339588+0000","last_undegraded":"2024-09-21T07:30:45.339588+0000","last_fullsized":"2024-09-21T07:30:45.339588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109574+0000","last_change":"2024-09-21T07:30:42.109574+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109574+0000","last_undegraded":"2024-09-21T07:30:42.109574+0000","last_fullsized":"2024-09-21T07:30:42.109574+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.106067+0000","last_change":"2024-09-21T07:30:42.106067+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.106067+0000","last_undegraded":"2024-09-21T07:30:42.106067+0000","last_fullsized":"2024-09-21T07:30:42.106067+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.112368+0000","last_change":"2024-09-21T07:30:42.112368+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.112368+0000","last_undegraded":"2024-09-21T07:30:42.112368+0000","last_fullsized":"2024-09-21T07:30:42.112368+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333718+0000","last_change":"2024-09-21T07:30:44.158316+0000","last_active":"2024-09-21T07:30:45.333718+0000","last_peered":"2024-09-21T07:30:45.333718+0000","last_clean":"2024-09-21T07:30:45.333718+0000","last_became_active":"2024-09-21T07:30:44.156920+0000","last_became_peered":"2024-09-21T07:30:44.156920+0000","last_unstale":"2024-09-21T07:30:45.333718+0000","last_undegraded":"2024-09-21T07:30:45.333718+0000","last_fullsized":"2024-09-21T07:30:45.333718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:30.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107503+0000","last_change":"2024-09-21T07:30:42.107503+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107503+0000","last_undegraded":"2024-09-21T07:30:42.107503+0000","last_fullsized":"2024-09-21T07:30:42.107503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110843+0000","last_change":"2024-09-21T07:30:42.110843+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110843+0000","last_undegraded":"2024-09-21T07:30:42.110843+0000","last_fullsized":"2024-09-21T07:30:42.110843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110249+0000","last_change":"2024-09-21T07:30:42.110249+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110249+0000","last_undegraded":"2024-09-21T07:30:42.110249+0000","last_fullsized":"2024-09-21T07:30:42.110249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107532+0000","last_change":"2024-09-21T07:30:42.107532+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107532+0000","last_undegraded":"2024-09-21T07:30:42.107532+0000","last_fullsized":"2024-09-21T07:30:42.107532+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335067+0000","last_change":"2024-09-21T07:30:44.170956+0000","last_active":"2024-09-21T07:30:45.335067+0000","last_peered":"2024-09-21T07:30:45.335067+0000","last_clean":"2024-09-21T07:30:45.335067+0000","last_became_active":"2024-09-21T07:30:44.170229+0000","last_became_peered":"2024-09-21T07:30:44.170229+0000","last_unstale":"2024-09-21T07:30:45.335067+0000","last_undegraded":"2024-09-21T07:30:45.335067+0000","last_fullsized":"2024-09-21T07:30:45.335067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:53.117607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107563+0000","last_change":"2024-09-21T07:30:42.107563+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107563+0000","last_undegraded":"2024-09-21T07:30:42.107563+0000","last_fullsized":"2024-09-21T07:30:42.107563+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"130'6","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131203+0000","last_change":"2024-09-21T07:30:43.121009+0000","last_active":"2024-09-21T07:30:45.131203+0000","last_peered":"2024-09-21T07:30:45.131203+0000","last_clean":"2024-09-21T07:30:45.131203+0000","last_became_active":"2024-09-21T07:30:43.120678+0000","last_became_peered":"2024-09-21T07:30:43.120678+0000","last_unstale":"2024-09-21T07:30:45.131203+0000","last_undegraded":"2024-09-21T07:30:45.131203+0000","last_fullsized":"2024-09-21T07:30:45.131203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.128293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335023+0000","last_change":"2024-09-21T07:30:43.133791+0000","last_active":"2024-09-21T07:30:45.335023+0000","last_peered":"2024-09-21T07:30:45.335023+0000","last_clean":"2024-09-21T07:30:45.335023+0000","last_became_active":"2024-09-21T07:30:43.133441+0000","last_became_peered":"2024-09-21T07:30:43.133441+0000","last_unstale":"2024-09-21T07:30:45.335023+0000","last_undegraded":"2024-09-21T07:30:45.335023+0000","last_fullsized":"2024-09-21T07:30:45.335023+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:06.475767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334102+0000","last_change":"2024-09-21T07:30:43.123257+0000","last_active":"2024-09-21T07:30:45.334102+0000","last_peered":"2024-09-21T07:30:45.334102+0000","last_clean":"2024-09-21T07:30:45.334102+0000","last_became_active":"2024-09-21T07:30:43.122875+0000","last_became_peered":"2024-09-21T07:30:43.122875+0000","last_unstale":"2024-09-21T07:30:45.334102+0000","last_undegraded":"2024-09-21T07:30:45.334102+0000","last_fullsized":"2024-09-21T07:30:45.334102+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:13.120467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131217+0000","last_change":"2024-09-21T07:30:43.123076+0000","last_active":"2024-09-21T07:30:45.131217+0000","last_peered":"2024-09-21T07:30:45.131217+0000","last_clean":"2024-09-21T07:30:45.131217+0000","last_became_active":"2024-09-21T07:30:43.122485+0000","last_became_peered":"2024-09-21T07:30:43.122485+0000","last_unstale":"2024-09-21T07:30:45.131217+0000","last_undegraded":"2024-09-21T07:30:45.131217+0000","last_fullsized":"2024-09-21T07:30:45.131217+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:46.303644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109032+0000","last_change":"2024-09-21T07:30:42.109032+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109032+0000","last_undegraded":"2024-09-21T07:30:42.109032+0000","last_fullsized":"2024-09-21T07:30:42.109032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105611+0000","last_change":"2024-09-21T07:30:42.105611+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105611+0000","last_undegraded":"2024-09-21T07:30:42.105611+0000","last_fullsized":"2024-09-21T07:30:42.105611+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338777+0000","last_change":"2024-09-21T07:30:43.138505+0000","last_active":"2024-09-21T07:30:45.338777+0000","last_peered":"2024-09-21T07:30:45.338777+0000","last_clean":"2024-09-21T07:30:45.338777+0000","last_became_active":"2024-09-21T07:30:43.138157+0000","last_became_peered":"2024-09-21T07:30:43.138157+0000","last_unstale":"2024-09-21T07:30:45.338777+0000","last_undegraded":"2024-09-21T07:30:45.338777+0000","last_fullsized":"2024-09-21T07:30:45.338777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:38.140550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339406+0000","last_change":"2024-09-21T07:30:43.141221+0000","last_active":"2024-09-21T07:30:45.339406+0000","last_peered":"2024-09-21T07:30:45.339406+0000","last_clean":"2024-09-21T07:30:45.339406+0000","last_became_active":"2024-09-21T07:30:43.140734+0000","last_became_peered":"2024-09-21T07:30:43.140734+0000","last_unstale":"2024-09-21T07:30:45.339406+0000","last_undegraded":"2024-09-21T07:30:45.339406+0000","last_fullsized":"2024-09-21T07:30:45.339406+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.604283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111844+0000","last_change":"2024-09-21T07:30:42.111844+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111844+0000","last_undegraded":"2024-09-21T07:30:42.111844+0000","last_fullsized":"2024-09-21T07:30:42.111844+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131078+0000","last_change":"2024-09-21T07:30:44.163520+0000","last_active":"2024-09-21T07:30:45.131078+0000","last_peered":"2024-09-21T07:30:45.131078+0000","last_clean":"2024-09-21T07:30:45.131078+0000","last_became_active":"2024-09-21T07:30:44.163065+0000","last_became_peered":"2024-09-21T07:30:44.163065+0000","last_unstale":"2024-09-21T07:30:45.131078+0000","last_undegraded":"2024-09-21T07:30:45.131078+0000","last_fullsized":"2024-09-21T07:30:45.131078+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338601+0000","last_change":"2024-09-21T07:30:43.133964+0000","last_active":"2024-09-21T07:30:45.338601+0000","last_peered":"2024-09-21T07:30:45.338601+0000","last_clean":"2024-09-21T07:30:45.338601+0000","last_became_active":"2024-09-21T07:30:43.133538+0000","last_became_peered":"2024-09-21T07:30:43.133538+0000","last_unstale":"2024-09-21T07:30:45.338601+0000","last_undegraded":"2024-09-21T07:30:45.338601+0000","last_fullsized":"2024-09-21T07:30:45.338601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:45.540022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333981+0000","last_change":"2024-09-21T07:30:44.167744+0000","last_active":"2024-09-21T07:30:45.333981+0000","last_peered":"2024-09-21T07:30:45.333981+0000","last_clean":"2024-09-21T07:30:45.333981+0000","last_became_active":"2024-09-21T07:30:44.167122+0000","last_became_peered":"2024-09-21T07:30:44.167122+0000","last_unstale":"2024-09-21T07:30:45.333981+0000","last_undegraded":"2024-09-21T07:30:45.333981+0000","last_fullsized":"2024-09-21T07:30:45.333981+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:05.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131289+0000","last_change":"2024-09-21T07:30:43.139312+0000","last_active":"2024-09-21T07:30:45.131289+0000","last_peered":"2024-09-21T07:30:45.131289+0000","last_clean":"2024-09-21T07:30:45.131289+0000","last_became_active":"2024-09-21T07:30:43.138937+0000","last_became_peered":"2024-09-21T07:30:43.138937+0000","last_unstale":"2024-09-21T07:30:45.131289+0000","last_undegraded":"2024-09-21T07:30:45.131289+0000","last_fullsized":"2024-09-21T07:30:45.131289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:01.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338207+0000","last_change":"2024-09-21T07:30:43.134252+0000","last_active":"2024-09-21T07:30:45.338207+0000","last_peered":"2024-09-21T07:30:45.338207+0000","last_clean":"2024-09-21T07:30:45.338207+0000","last_became_active":"2024-09-21T07:30:43.133449+0000","last_became_peered":"2024-09-21T07:30:43.133449+0000","last_unstale":"2024-09-21T07:30:45.338207+0000","last_undegraded":"2024-09-21T07:30:45.338207+0000","last_fullsized":"2024-09-21T07:30:45.338207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:17.110123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110232+0000","last_change":"2024-09-21T07:30:42.110232+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110232+0000","last_undegraded":"2024-09-21T07:30:42.110232+0000","last_fullsized":"2024-09-21T07:30:42.110232+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110224+0000","last_change":"2024-09-21T07:30:42.110224+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110224+0000","last_undegraded":"2024-09-21T07:30:42.110224+0000","last_fullsized":"2024-09-21T07:30:42.110224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339410+0000","last_change":"2024-09-21T07:30:44.153892+0000","last_active":"2024-09-21T07:30:45.339410+0000","last_peered":"2024-09-21T07:30:45.339410+0000","last_clean":"2024-09-21T07:30:45.339410+0000","last_became_active":"2024-09-21T07:30:44.153608+0000","last_became_peered":"2024-09-21T07:30:44.153608+0000","last_unstale":"2024-09-21T07:30:45.339410+0000","last_undegraded":"2024-09-21T07:30:45.339410+0000","last_fullsized":"2024-09-21T07:30:45.339410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:36.363132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110580+0000","last_change":"2024-09-21T07:30:42.110580+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110580+0000","last_undegraded":"2024-09-21T07:30:42.110580+0000","last_fullsized":"2024-09-21T07:30:42.110580+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111425+0000","last_change":"2024-09-21T07:30:42.111425+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111425+0000","last_undegraded":"2024-09-21T07:30:42.111425+0000","last_fullsized":"2024-09-21T07:30:42.111425+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131165+0000","last_change":"2024-09-21T07:30:44.166662+0000","last_active":"2024-09-21T07:30:45.131165+0000","last_peered":"2024-09-21T07:30:45.131165+0000","last_clean":"2024-09-21T07:30:45.131165+0000","last_became_active":"2024-09-21T07:30:44.166319+0000","last_became_peered":"2024-09-21T07:30:44.166319+0000","last_unstale":"2024-09-21T07:30:45.131165+0000","last_undegraded":"2024-09-21T07:30:45.131165+0000","last_fullsized":"2024-09-21T07:30:45.131165+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:12.710220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:44.167242+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:44.166797+0000","last_became_peered":"2024-09-21T07:30:44.166797+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:46.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111248+0000","last_change":"2024-09-21T07:30:42.111248+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111248+0000","last_undegraded":"2024-09-21T07:30:42.111248+0000","last_fullsized":"2024-09-21T07:30:42.111248+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338352+0000","last_change":"2024-09-21T07:30:43.134998+0000","last_active":"2024-09-21T07:30:45.338352+0000","last_peered":"2024-09-21T07:30:45.338352+0000","last_clean":"2024-09-21T07:30:45.338352+0000","last_became_active":"2024-09-21T07:30:43.134686+0000","last_became_peered":"2024-09-21T07:30:43.134686+0000","last_unstale":"2024-09-21T07:30:45.338352+0000","last_undegraded":"2024-09-21T07:30:45.338352+0000","last_fullsized":"2024-09-21T07:30:45.338352+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339232+0000","last_change":"2024-09-21T07:30:44.160640+0000","last_active":"2024-09-21T07:30:45.339232+0000","last_peered":"2024-09-21T07:30:45.339232+0000","last_clean":"2024-09-21T07:30:45.339232+0000","last_became_active":"2024-09-21T07:30:44.158316+0000","last_became_peered":"2024-09-21T07:30:44.158316+0000","last_unstale":"2024-09-21T07:30:45.339232+0000","last_undegraded":"2024-09-21T07:30:45.339232+0000","last_fullsized":"2024-09-21T07:30:45.339232+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:19.923244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"130'8","reported_seq":23,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131228+0000","last_change":"2024-09-21T07:30:43.129146+0000","last_active":"2024-09-21T07:30:45.131228+0000","last_peered":"2024-09-21T07:30:45.131228+0000","last_clean":"2024-09-21T07:30:45.131228+0000","last_became_active":"2024-09-21T07:30:43.128816+0000","last_became_peered":"2024-09-21T07:30:43.128816+0000","last_unstale":"2024-09-21T07:30:45.131228+0000","last_undegraded":"2024-09-21T07:30:45.131228+0000","last_fullsized":"2024-09-21T07:30:45.131228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:58.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338425+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:30:45.338425+0000","last_peered":"2024-09-21T07:30:45.338425+0000","last_clean":"2024-09-21T07:30:45.338425+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:30:45.338425+0000","last_undegraded":"2024-09-21T07:30:45.338425+0000","last_fullsized":"2024-09-21T07:30:45.338425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28572,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343268,"statfs":{"total":96636764160,"available":96607506432,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46612,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325228,"statfs":{"total":96636764160,"available":96589033472,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1585152,"data_stored":744139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47208,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324632,"statfs":{"total":96636764160,"available":96588423168,"internally_reserved":0,"allocated":2179072,"data_stored":1334507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41692,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330148,"statfs":{"total":96636764160,"available":96594071552,"internally_reserved":0,"allocated":2232320,"data_stored":1355809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1638400,"data_stored":766311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:30:48.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:30:48.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- 172.21.15.64:0/657973016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb40709b0 msgr2=0x7f1bb40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 --2- 172.21.15.64:0/657973016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb40709b0 0x7f1bb40b41c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1bb406f220 tx=0x7f1b9c01c7e0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- 172.21.15.64:0/657973016 shutdown_connections 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 --2- 172.21.15.64:0/657973016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb40709b0 0x7f1bb40b41c0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 --2- 172.21.15.64:0/657973016 >> v2:172.21.15.90:3300/0 conn(0x7f1bb415edb0 0x7f1bb40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- 172.21.15.64:0/657973016 >> 172.21.15.64:0/657973016 conn(0x7f1bb40ccbe0 msgr2=0x7f1bb40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- 172.21.15.64:0/657973016 shutdown_connections 2024-09-21T07:30:48.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- 172.21.15.64:0/657973016 wait complete. 2024-09-21T07:30:48.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 Processor -- start 2024-09-21T07:30:48.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.578+0000 7f1bbb800640 1 -- start start 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bb40709b0 0x7f1bb41f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 0x7f1bb409bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4168fb0 con 0x7f1bb415edb0 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4168e30 con 0x7f1bb40709b0 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb4169130 con 0x7f1bb40b4700 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55594/0 (socket says 172.21.15.64:55594) 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 -- 172.21.15.64:0/465329259 learned_addr learned my addr 172.21.15.64:0/465329259 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb8e00640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bb40709b0 0x7f1bb41f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1babe00640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 0x7f1bb409bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 -- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 msgr2=0x7f1bb409bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 0x7f1bb409bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 -- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bb40709b0 msgr2=0x7f1bb41f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bb40709b0 0x7f1bb41f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 -- 172.21.15.64:0/465329259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb41f9830 con 0x7f1bb415edb0 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1babe00640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 0x7f1bb409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb9800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00ca70 tx=0x7f1bac00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac016020 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bac00a930 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb41f9b10 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00ad80 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb409ac00 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.582+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb41f95a0 con 0x7f1bb415edb0 2024-09-21T07:30:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.586+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1bac019020 con 0x7f1bb415edb0 2024-09-21T07:30:48.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.586+0000 7f1bb1600640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 0x7f1b90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:48.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.586+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f1bac094550 con 0x7f1bb415edb0 2024-09-21T07:30:48.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.586+0000 7f1bb8e00640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 0x7f1b90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.586+0000 7f1bb8e00640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 0x7f1b90075710 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400bb50 tx=0x7f1ba400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:48.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.590+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1bac020020 con 0x7f1bb415edb0 2024-09-21T07:30:48.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.774+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bb40b41c0 con 0x7f1b90073200 2024-09-21T07:30:48.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.778+0000 7f1bb1600640 1 -- 172.21.15.64:0/465329259 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244012 (secure 0 0 0) 0x7f1bb40b41c0 con 0x7f1b90073200 2024-09-21T07:30:48.781 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:48.783 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:30:48.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 msgr2=0x7f1b90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 0x7f1b90075710 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400bb50 tx=0x7f1ba400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 msgr2=0x7f1bb4157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:48.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00ca70 tx=0x7f1bac00cb60 comp rx=0 tx=0).stop 2024-09-21T07:30:48.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 shutdown_connections 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1b90073200 0x7f1b90075710 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb415edb0 0x7f1bb4157b20 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1bb40b4700 0x7f1bb409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 --2- 172.21.15.64:0/465329259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bb40709b0 0x7f1bb41f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 >> 172.21.15.64:0/465329259 conn(0x7f1bb40ccbe0 msgr2=0x7f1bb40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 shutdown_connections 2024-09-21T07:30:48.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:48.782+0000 7f1bbb800640 1 -- 172.21.15.64:0/465329259 wait complete. 2024-09-21T07:30:48.804 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-21T07:30:47.553488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":104,"acting":104,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":367272,"kb_used_data":13600,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754607448,"statfs":{"total":773094113280,"available":772718026752,"internally_reserved":0,"allocated":13926400,"data_stored":7152486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.450333"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333522+0000","last_change":"2024-09-21T07:30:44.171380+0000","last_active":"2024-09-21T07:30:45.333522+0000","last_peered":"2024-09-21T07:30:45.333522+0000","last_clean":"2024-09-21T07:30:45.333522+0000","last_became_active":"2024-09-21T07:30:44.170753+0000","last_became_peered":"2024-09-21T07:30:44.170753+0000","last_unstale":"2024-09-21T07:30:45.333522+0000","last_undegraded":"2024-09-21T07:30:45.333522+0000","last_fullsized":"2024-09-21T07:30:45.333522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:14.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334560+0000","last_change":"2024-09-21T07:30:44.167425+0000","last_active":"2024-09-21T07:30:45.334560+0000","last_peered":"2024-09-21T07:30:45.334560+0000","last_clean":"2024-09-21T07:30:45.334560+0000","last_became_active":"2024-09-21T07:30:44.166377+0000","last_became_peered":"2024-09-21T07:30:44.166377+0000","last_unstale":"2024-09-21T07:30:45.334560+0000","last_undegraded":"2024-09-21T07:30:45.334560+0000","last_fullsized":"2024-09-21T07:30:45.334560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:53.872339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339251+0000","last_change":"2024-09-21T07:30:44.155212+0000","last_active":"2024-09-21T07:30:45.339251+0000","last_peered":"2024-09-21T07:30:45.339251+0000","last_clean":"2024-09-21T07:30:45.339251+0000","last_became_active":"2024-09-21T07:30:44.154732+0000","last_became_peered":"2024-09-21T07:30:44.154732+0000","last_unstale":"2024-09-21T07:30:45.339251+0000","last_undegraded":"2024-09-21T07:30:45.339251+0000","last_fullsized":"2024-09-21T07:30:45.339251+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:59.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131087+0000","last_change":"2024-09-21T07:30:44.169122+0000","last_active":"2024-09-21T07:30:45.131087+0000","last_peered":"2024-09-21T07:30:45.131087+0000","last_clean":"2024-09-21T07:30:45.131087+0000","last_became_active":"2024-09-21T07:30:44.168827+0000","last_became_peered":"2024-09-21T07:30:44.168827+0000","last_unstale":"2024-09-21T07:30:45.131087+0000","last_undegraded":"2024-09-21T07:30:45.131087+0000","last_fullsized":"2024-09-21T07:30:45.131087+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.361691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339544+0000","last_change":"2024-09-21T07:30:44.170676+0000","last_active":"2024-09-21T07:30:45.339544+0000","last_peered":"2024-09-21T07:30:45.339544+0000","last_clean":"2024-09-21T07:30:45.339544+0000","last_became_active":"2024-09-21T07:30:44.170330+0000","last_became_peered":"2024-09-21T07:30:44.170330+0000","last_unstale":"2024-09-21T07:30:45.339544+0000","last_undegraded":"2024-09-21T07:30:45.339544+0000","last_fullsized":"2024-09-21T07:30:45.339544+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131186+0000","last_change":"2024-09-21T07:30:44.169611+0000","last_active":"2024-09-21T07:30:45.131186+0000","last_peered":"2024-09-21T07:30:45.131186+0000","last_clean":"2024-09-21T07:30:45.131186+0000","last_became_active":"2024-09-21T07:30:44.169276+0000","last_became_peered":"2024-09-21T07:30:44.169276+0000","last_unstale":"2024-09-21T07:30:45.131186+0000","last_undegraded":"2024-09-21T07:30:45.131186+0000","last_fullsized":"2024-09-21T07:30:45.131186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:16.272379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334848+0000","last_change":"2024-09-21T07:30:44.171079+0000","last_active":"2024-09-21T07:30:45.334848+0000","last_peered":"2024-09-21T07:30:45.334848+0000","last_clean":"2024-09-21T07:30:45.334848+0000","last_became_active":"2024-09-21T07:30:44.170634+0000","last_became_peered":"2024-09-21T07:30:44.170634+0000","last_unstale":"2024-09-21T07:30:45.334848+0000","last_undegraded":"2024-09-21T07:30:45.334848+0000","last_fullsized":"2024-09-21T07:30:45.334848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.413012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338952+0000","last_change":"2024-09-21T07:30:44.161541+0000","last_active":"2024-09-21T07:30:45.338952+0000","last_peered":"2024-09-21T07:30:45.338952+0000","last_clean":"2024-09-21T07:30:45.338952+0000","last_became_active":"2024-09-21T07:30:44.158258+0000","last_became_peered":"2024-09-21T07:30:44.158258+0000","last_unstale":"2024-09-21T07:30:45.338952+0000","last_undegraded":"2024-09-21T07:30:45.338952+0000","last_fullsized":"2024-09-21T07:30:45.338952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.709605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338866+0000","last_change":"2024-09-21T07:30:44.171001+0000","last_active":"2024-09-21T07:30:45.338866+0000","last_peered":"2024-09-21T07:30:45.338866+0000","last_clean":"2024-09-21T07:30:45.338866+0000","last_became_active":"2024-09-21T07:30:44.170412+0000","last_became_peered":"2024-09-21T07:30:44.170412+0000","last_unstale":"2024-09-21T07:30:45.338866+0000","last_undegraded":"2024-09-21T07:30:45.338866+0000","last_fullsized":"2024-09-21T07:30:45.338866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:29.547247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131266+0000","last_change":"2024-09-21T07:30:44.158437+0000","last_active":"2024-09-21T07:30:45.131266+0000","last_peered":"2024-09-21T07:30:45.131266+0000","last_clean":"2024-09-21T07:30:45.131266+0000","last_became_active":"2024-09-21T07:30:44.157277+0000","last_became_peered":"2024-09-21T07:30:44.157277+0000","last_unstale":"2024-09-21T07:30:45.131266+0000","last_undegraded":"2024-09-21T07:30:45.131266+0000","last_fullsized":"2024-09-21T07:30:45.131266+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:19.353180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111427+0000","last_change":"2024-09-21T07:30:42.111427+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111427+0000","last_undegraded":"2024-09-21T07:30:42.111427+0000","last_fullsized":"2024-09-21T07:30:42.111427+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109057+0000","last_change":"2024-09-21T07:30:42.109057+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109057+0000","last_undegraded":"2024-09-21T07:30:42.109057+0000","last_fullsized":"2024-09-21T07:30:42.109057+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338779+0000","last_change":"2024-09-21T07:30:43.138630+0000","last_active":"2024-09-21T07:30:45.338779+0000","last_peered":"2024-09-21T07:30:45.338779+0000","last_clean":"2024-09-21T07:30:45.338779+0000","last_became_active":"2024-09-21T07:30:43.138290+0000","last_became_peered":"2024-09-21T07:30:43.138290+0000","last_unstale":"2024-09-21T07:30:45.338779+0000","last_undegraded":"2024-09-21T07:30:45.338779+0000","last_fullsized":"2024-09-21T07:30:45.338779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:06.977356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339588+0000","last_change":"2024-09-21T07:30:44.166923+0000","last_active":"2024-09-21T07:30:45.339588+0000","last_peered":"2024-09-21T07:30:45.339588+0000","last_clean":"2024-09-21T07:30:45.339588+0000","last_became_active":"2024-09-21T07:30:44.166577+0000","last_became_peered":"2024-09-21T07:30:44.166577+0000","last_unstale":"2024-09-21T07:30:45.339588+0000","last_undegraded":"2024-09-21T07:30:45.339588+0000","last_fullsized":"2024-09-21T07:30:45.339588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109574+0000","last_change":"2024-09-21T07:30:42.109574+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109574+0000","last_undegraded":"2024-09-21T07:30:42.109574+0000","last_fullsized":"2024-09-21T07:30:42.109574+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.106067+0000","last_change":"2024-09-21T07:30:42.106067+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.106067+0000","last_undegraded":"2024-09-21T07:30:42.106067+0000","last_fullsized":"2024-09-21T07:30:42.106067+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.112368+0000","last_change":"2024-09-21T07:30:42.112368+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.112368+0000","last_undegraded":"2024-09-21T07:30:42.112368+0000","last_fullsized":"2024-09-21T07:30:42.112368+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333718+0000","last_change":"2024-09-21T07:30:44.158316+0000","last_active":"2024-09-21T07:30:45.333718+0000","last_peered":"2024-09-21T07:30:45.333718+0000","last_clean":"2024-09-21T07:30:45.333718+0000","last_became_active":"2024-09-21T07:30:44.156920+0000","last_became_peered":"2024-09-21T07:30:44.156920+0000","last_unstale":"2024-09-21T07:30:45.333718+0000","last_undegraded":"2024-09-21T07:30:45.333718+0000","last_fullsized":"2024-09-21T07:30:45.333718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:30.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107503+0000","last_change":"2024-09-21T07:30:42.107503+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107503+0000","last_undegraded":"2024-09-21T07:30:42.107503+0000","last_fullsized":"2024-09-21T07:30:42.107503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110843+0000","last_change":"2024-09-21T07:30:42.110843+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110843+0000","last_undegraded":"2024-09-21T07:30:42.110843+0000","last_fullsized":"2024-09-21T07:30:42.110843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110249+0000","last_change":"2024-09-21T07:30:42.110249+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110249+0000","last_undegraded":"2024-09-21T07:30:42.110249+0000","last_fullsized":"2024-09-21T07:30:42.110249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107532+0000","last_change":"2024-09-21T07:30:42.107532+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107532+0000","last_undegraded":"2024-09-21T07:30:42.107532+0000","last_fullsized":"2024-09-21T07:30:42.107532+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335067+0000","last_change":"2024-09-21T07:30:44.170956+0000","last_active":"2024-09-21T07:30:45.335067+0000","last_peered":"2024-09-21T07:30:45.335067+0000","last_clean":"2024-09-21T07:30:45.335067+0000","last_became_active":"2024-09-21T07:30:44.170229+0000","last_became_peered":"2024-09-21T07:30:44.170229+0000","last_unstale":"2024-09-21T07:30:45.335067+0000","last_undegraded":"2024-09-21T07:30:45.335067+0000","last_fullsized":"2024-09-21T07:30:45.335067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:53.117607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107563+0000","last_change":"2024-09-21T07:30:42.107563+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107563+0000","last_undegraded":"2024-09-21T07:30:42.107563+0000","last_fullsized":"2024-09-21T07:30:42.107563+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"130'6","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131203+0000","last_change":"2024-09-21T07:30:43.121009+0000","last_active":"2024-09-21T07:30:45.131203+0000","last_peered":"2024-09-21T07:30:45.131203+0000","last_clean":"2024-09-21T07:30:45.131203+0000","last_became_active":"2024-09-21T07:30:43.120678+0000","last_became_peered":"2024-09-21T07:30:43.120678+0000","last_unstale":"2024-09-21T07:30:45.131203+0000","last_undegraded":"2024-09-21T07:30:45.131203+0000","last_fullsized":"2024-09-21T07:30:45.131203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.128293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335023+0000","last_change":"2024-09-21T07:30:43.133791+0000","last_active":"2024-09-21T07:30:45.335023+0000","last_peered":"2024-09-21T07:30:45.335023+0000","last_clean":"2024-09-21T07:30:45.335023+0000","last_became_active":"2024-09-21T07:30:43.133441+0000","last_became_peered":"2024-09-21T07:30:43.133441+0000","last_unstale":"2024-09-21T07:30:45.335023+0000","last_undegraded":"2024-09-21T07:30:45.335023+0000","last_fullsized":"2024-09-21T07:30:45.335023+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:06.475767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334102+0000","last_change":"2024-09-21T07:30:43.123257+0000","last_active":"2024-09-21T07:30:45.334102+0000","last_peered":"2024-09-21T07:30:45.334102+0000","last_clean":"2024-09-21T07:30:45.334102+0000","last_became_active":"2024-09-21T07:30:43.122875+0000","last_became_peered":"2024-09-21T07:30:43.122875+0000","last_unstale":"2024-09-21T07:30:45.334102+0000","last_undegraded":"2024-09-21T07:30:45.334102+0000","last_fullsized":"2024-09-21T07:30:45.334102+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:13.120467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131217+0000","last_change":"2024-09-21T07:30:43.123076+0000","last_active":"2024-09-21T07:30:45.131217+0000","last_peered":"2024-09-21T07:30:45.131217+0000","last_clean":"2024-09-21T07:30:45.131217+0000","last_became_active":"2024-09-21T07:30:43.122485+0000","last_became_peered":"2024-09-21T07:30:43.122485+0000","last_unstale":"2024-09-21T07:30:45.131217+0000","last_undegraded":"2024-09-21T07:30:45.131217+0000","last_fullsized":"2024-09-21T07:30:45.131217+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:46.303644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109032+0000","last_change":"2024-09-21T07:30:42.109032+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109032+0000","last_undegraded":"2024-09-21T07:30:42.109032+0000","last_fullsized":"2024-09-21T07:30:42.109032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105611+0000","last_change":"2024-09-21T07:30:42.105611+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105611+0000","last_undegraded":"2024-09-21T07:30:42.105611+0000","last_fullsized":"2024-09-21T07:30:42.105611+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338777+0000","last_change":"2024-09-21T07:30:43.138505+0000","last_active":"2024-09-21T07:30:45.338777+0000","last_peered":"2024-09-21T07:30:45.338777+0000","last_clean":"2024-09-21T07:30:45.338777+0000","last_became_active":"2024-09-21T07:30:43.138157+0000","last_became_peered":"2024-09-21T07:30:43.138157+0000","last_unstale":"2024-09-21T07:30:45.338777+0000","last_undegraded":"2024-09-21T07:30:45.338777+0000","last_fullsized":"2024-09-21T07:30:45.338777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:38.140550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339406+0000","last_change":"2024-09-21T07:30:43.141221+0000","last_active":"2024-09-21T07:30:45.339406+0000","last_peered":"2024-09-21T07:30:45.339406+0000","last_clean":"2024-09-21T07:30:45.339406+0000","last_became_active":"2024-09-21T07:30:43.140734+0000","last_became_peered":"2024-09-21T07:30:43.140734+0000","last_unstale":"2024-09-21T07:30:45.339406+0000","last_undegraded":"2024-09-21T07:30:45.339406+0000","last_fullsized":"2024-09-21T07:30:45.339406+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.604283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111844+0000","last_change":"2024-09-21T07:30:42.111844+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111844+0000","last_undegraded":"2024-09-21T07:30:42.111844+0000","last_fullsized":"2024-09-21T07:30:42.111844+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131078+0000","last_change":"2024-09-21T07:30:44.163520+0000","last_active":"2024-09-21T07:30:45.131078+0000","last_peered":"2024-09-21T07:30:45.131078+0000","last_clean":"2024-09-21T07:30:45.131078+0000","last_became_active":"2024-09-21T07:30:44.163065+0000","last_became_peered":"2024-09-21T07:30:44.163065+0000","last_unstale":"2024-09-21T07:30:45.131078+0000","last_undegraded":"2024-09-21T07:30:45.131078+0000","last_fullsized":"2024-09-21T07:30:45.131078+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338601+0000","last_change":"2024-09-21T07:30:43.133964+0000","last_active":"2024-09-21T07:30:45.338601+0000","last_peered":"2024-09-21T07:30:45.338601+0000","last_clean":"2024-09-21T07:30:45.338601+0000","last_became_active":"2024-09-21T07:30:43.133538+0000","last_became_peered":"2024-09-21T07:30:43.133538+0000","last_unstale":"2024-09-21T07:30:45.338601+0000","last_undegraded":"2024-09-21T07:30:45.338601+0000","last_fullsized":"2024-09-21T07:30:45.338601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:45.540022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333981+0000","last_change":"2024-09-21T07:30:44.167744+0000","last_active":"2024-09-21T07:30:45.333981+0000","last_peered":"2024-09-21T07:30:45.333981+0000","last_clean":"2024-09-21T07:30:45.333981+0000","last_became_active":"2024-09-21T07:30:44.167122+0000","last_became_peered":"2024-09-21T07:30:44.167122+0000","last_unstale":"2024-09-21T07:30:45.333981+0000","last_undegraded":"2024-09-21T07:30:45.333981+0000","last_fullsized":"2024-09-21T07:30:45.333981+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:05.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131289+0000","last_change":"2024-09-21T07:30:43.139312+0000","last_active":"2024-09-21T07:30:45.131289+0000","last_peered":"2024-09-21T07:30:45.131289+0000","last_clean":"2024-09-21T07:30:45.131289+0000","last_became_active":"2024-09-21T07:30:43.138937+0000","last_became_peered":"2024-09-21T07:30:43.138937+0000","last_unstale":"2024-09-21T07:30:45.131289+0000","last_undegraded":"2024-09-21T07:30:45.131289+0000","last_fullsized":"2024-09-21T07:30:45.131289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:01.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338207+0000","last_change":"2024-09-21T07:30:43.134252+0000","last_active":"2024-09-21T07:30:45.338207+0000","last_peered":"2024-09-21T07:30:45.338207+0000","last_clean":"2024-09-21T07:30:45.338207+0000","last_became_active":"2024-09-21T07:30:43.133449+0000","last_became_peered":"2024-09-21T07:30:43.133449+0000","last_unstale":"2024-09-21T07:30:45.338207+0000","last_undegraded":"2024-09-21T07:30:45.338207+0000","last_fullsized":"2024-09-21T07:30:45.338207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:17.110123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110232+0000","last_change":"2024-09-21T07:30:42.110232+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110232+0000","last_undegraded":"2024-09-21T07:30:42.110232+0000","last_fullsized":"2024-09-21T07:30:42.110232+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110224+0000","last_change":"2024-09-21T07:30:42.110224+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110224+0000","last_undegraded":"2024-09-21T07:30:42.110224+0000","last_fullsized":"2024-09-21T07:30:42.110224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339410+0000","last_change":"2024-09-21T07:30:44.153892+0000","last_active":"2024-09-21T07:30:45.339410+0000","last_peered":"2024-09-21T07:30:45.339410+0000","last_clean":"2024-09-21T07:30:45.339410+0000","last_became_active":"2024-09-21T07:30:44.153608+0000","last_became_peered":"2024-09-21T07:30:44.153608+0000","last_unstale":"2024-09-21T07:30:45.339410+0000","last_undegraded":"2024-09-21T07:30:45.339410+0000","last_fullsized":"2024-09-21T07:30:45.339410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:36.363132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110580+0000","last_change":"2024-09-21T07:30:42.110580+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110580+0000","last_undegraded":"2024-09-21T07:30:42.110580+0000","last_fullsized":"2024-09-21T07:30:42.110580+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111425+0000","last_change":"2024-09-21T07:30:42.111425+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111425+0000","last_undegraded":"2024-09-21T07:30:42.111425+0000","last_fullsized":"2024-09-21T07:30:42.111425+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131165+0000","last_change":"2024-09-21T07:30:44.166662+0000","last_active":"2024-09-21T07:30:45.131165+0000","last_peered":"2024-09-21T07:30:45.131165+0000","last_clean":"2024-09-21T07:30:45.131165+0000","last_became_active":"2024-09-21T07:30:44.166319+0000","last_became_peered":"2024-09-21T07:30:44.166319+0000","last_unstale":"2024-09-21T07:30:45.131165+0000","last_undegraded":"2024-09-21T07:30:45.131165+0000","last_fullsized":"2024-09-21T07:30:45.131165+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:12.710220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:44.167242+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:44.166797+0000","last_became_peered":"2024-09-21T07:30:44.166797+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:46.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111248+0000","last_change":"2024-09-21T07:30:42.111248+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111248+0000","last_undegraded":"2024-09-21T07:30:42.111248+0000","last_fullsized":"2024-09-21T07:30:42.111248+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338352+0000","last_change":"2024-09-21T07:30:43.134998+0000","last_active":"2024-09-21T07:30:45.338352+0000","last_peered":"2024-09-21T07:30:45.338352+0000","last_clean":"2024-09-21T07:30:45.338352+0000","last_became_active":"2024-09-21T07:30:43.134686+0000","last_became_peered":"2024-09-21T07:30:43.134686+0000","last_unstale":"2024-09-21T07:30:45.338352+0000","last_undegraded":"2024-09-21T07:30:45.338352+0000","last_fullsized":"2024-09-21T07:30:45.338352+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339232+0000","last_change":"2024-09-21T07:30:44.160640+0000","last_active":"2024-09-21T07:30:45.339232+0000","last_peered":"2024-09-21T07:30:45.339232+0000","last_clean":"2024-09-21T07:30:45.339232+0000","last_became_active":"2024-09-21T07:30:44.158316+0000","last_became_peered":"2024-09-21T07:30:44.158316+0000","last_unstale":"2024-09-21T07:30:45.339232+0000","last_undegraded":"2024-09-21T07:30:45.339232+0000","last_fullsized":"2024-09-21T07:30:45.339232+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:19.923244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"130'8","reported_seq":23,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131228+0000","last_change":"2024-09-21T07:30:43.129146+0000","last_active":"2024-09-21T07:30:45.131228+0000","last_peered":"2024-09-21T07:30:45.131228+0000","last_clean":"2024-09-21T07:30:45.131228+0000","last_became_active":"2024-09-21T07:30:43.128816+0000","last_became_peered":"2024-09-21T07:30:43.128816+0000","last_unstale":"2024-09-21T07:30:45.131228+0000","last_undegraded":"2024-09-21T07:30:45.131228+0000","last_fullsized":"2024-09-21T07:30:45.131228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:58.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338425+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:30:45.338425+0000","last_peered":"2024-09-21T07:30:45.338425+0000","last_clean":"2024-09-21T07:30:45.338425+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:30:45.338425+0000","last_undegraded":"2024-09-21T07:30:45.338425+0000","last_fullsized":"2024-09-21T07:30:45.338425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28572,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343268,"statfs":{"total":96636764160,"available":96607506432,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46612,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325228,"statfs":{"total":96636764160,"available":96589033472,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1585152,"data_stored":744139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47208,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324632,"statfs":{"total":96636764160,"available":96588423168,"internally_reserved":0,"allocated":2179072,"data_stored":1334507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41692,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330148,"statfs":{"total":96636764160,"available":96594071552,"internally_reserved":0,"allocated":2232320,"data_stored":1355809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1638400,"data_stored":766311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:30:48.808 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:30:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.006+0000 7f178c800640 1 -- 172.21.15.64:0/325909078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178406fba0 msgr2=0x7f178406ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.006+0000 7f178c800640 1 --2- 172.21.15.64:0/325909078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178406fba0 0x7f178406ffb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f17840b0980 tx=0x7f178001ca30 comp rx=0 tx=0).stop 2024-09-21T07:30:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.006+0000 7f178c800640 1 -- 172.21.15.64:0/325909078 shutdown_connections 2024-09-21T07:30:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.006+0000 7f178c800640 1 --2- 172.21.15.64:0/325909078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178406fba0 0x7f178406ffb0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.006+0000 7f178c800640 1 --2- 172.21.15.64:0/325909078 >> v2:172.21.15.90:3300/0 conn(0x7f178415f100 0x7f178415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.010+0000 7f178c800640 1 -- 172.21.15.64:0/325909078 >> 172.21.15.64:0/325909078 conn(0x7f17840b2ca0 msgr2=0x7f17840b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.010+0000 7f178c800640 1 -- 172.21.15.64:0/325909078 shutdown_connections 2024-09-21T07:30:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.010+0000 7f178c800640 1 -- 172.21.15.64:0/325909078 wait complete. 2024-09-21T07:30:49.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.010+0000 7f178c800640 1 Processor -- start 2024-09-21T07:30:49.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.010+0000 7f178c800640 1 -- start start 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f178406fba0 0x7f17841591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 0x7f178415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17840b6830 con 0x7f178415f100 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17840b66b0 con 0x7f178406fba0 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f17840b69b0 con 0x7f17840cd790 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55606/0 (socket says 172.21.15.64:55606) 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 -- 172.21.15.64:0/285338076 learned_addr learned my addr 172.21.15.64:0/285338076 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f1789400640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 0x7f178415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f1789e00640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f178406fba0 0x7f17841591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 -- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 msgr2=0x7f178415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 0x7f178415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 -- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f178406fba0 msgr2=0x7f17841591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f178406fba0 0x7f17841591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 -- 172.21.15.64:0/285338076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178415b3c0 con 0x7f178415f100 2024-09-21T07:30:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f1789400640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 0x7f178415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178a800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f178001c4a0 tx=0x7f1780009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800b2040 con 0x7f178415f100 2024-09-21T07:30:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17800bb070 con 0x7f178415f100 2024-09-21T07:30:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178415b6a0 con 0x7f178415f100 2024-09-21T07:30:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780004530 con 0x7f178415f100 2024-09-21T07:30:49.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178415bc60 con 0x7f178415f100 2024-09-21T07:30:49.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.014+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178415d7c0 con 0x7f178415f100 2024-09-21T07:30:49.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.018+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f17800046d0 con 0x7f178415f100 2024-09-21T07:30:49.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.018+0000 7f177e000640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 0x7f1768075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.018+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f178012ef50 con 0x7f178415f100 2024-09-21T07:30:49.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.018+0000 7f1789e00640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 0x7f1768075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.018+0000 7f1789e00640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 0x7f1768075740 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1778000f70 tx=0x7f1778009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.022+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1780016770 con 0x7f178415f100 2024-09-21T07:30:49.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.210+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f178406ffb0 con 0x7f1768073230 2024-09-21T07:30:49.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.214+0000 7f177e000640 1 -- 172.21.15.64:0/285338076 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244012 (secure 0 0 0) 0x7f178406ffb0 con 0x7f1768073230 2024-09-21T07:30:49.219 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:49.220 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:30:49.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 msgr2=0x7f1768075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 0x7f1768075740 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1778000f70 tx=0x7f1778009040 comp rx=0 tx=0).stop 2024-09-21T07:30:49.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 msgr2=0x7f178415c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f178001c4a0 tx=0x7f1780009200 comp rx=0 tx=0).stop 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 shutdown_connections 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1768073230 0x7f1768075740 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178415f100 0x7f178415c6c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17840cd790 0x7f178415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 --2- 172.21.15.64:0/285338076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f178406fba0 0x7f17841591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 >> 172.21.15.64:0/285338076 conn(0x7f17840b2ca0 msgr2=0x7f178415a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 shutdown_connections 2024-09-21T07:30:49.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.218+0000 7f178c800640 1 -- 172.21.15.64:0/285338076 wait complete. 2024-09-21T07:30:49.241 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-21T07:30:47.553488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":104,"acting":104,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":367272,"kb_used_data":13600,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754607448,"statfs":{"total":773094113280,"available":772718026752,"internally_reserved":0,"allocated":13926400,"data_stored":7152486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.450333"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333522+0000","last_change":"2024-09-21T07:30:44.171380+0000","last_active":"2024-09-21T07:30:45.333522+0000","last_peered":"2024-09-21T07:30:45.333522+0000","last_clean":"2024-09-21T07:30:45.333522+0000","last_became_active":"2024-09-21T07:30:44.170753+0000","last_became_peered":"2024-09-21T07:30:44.170753+0000","last_unstale":"2024-09-21T07:30:45.333522+0000","last_undegraded":"2024-09-21T07:30:45.333522+0000","last_fullsized":"2024-09-21T07:30:45.333522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:14.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334560+0000","last_change":"2024-09-21T07:30:44.167425+0000","last_active":"2024-09-21T07:30:45.334560+0000","last_peered":"2024-09-21T07:30:45.334560+0000","last_clean":"2024-09-21T07:30:45.334560+0000","last_became_active":"2024-09-21T07:30:44.166377+0000","last_became_peered":"2024-09-21T07:30:44.166377+0000","last_unstale":"2024-09-21T07:30:45.334560+0000","last_undegraded":"2024-09-21T07:30:45.334560+0000","last_fullsized":"2024-09-21T07:30:45.334560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:53.872339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339251+0000","last_change":"2024-09-21T07:30:44.155212+0000","last_active":"2024-09-21T07:30:45.339251+0000","last_peered":"2024-09-21T07:30:45.339251+0000","last_clean":"2024-09-21T07:30:45.339251+0000","last_became_active":"2024-09-21T07:30:44.154732+0000","last_became_peered":"2024-09-21T07:30:44.154732+0000","last_unstale":"2024-09-21T07:30:45.339251+0000","last_undegraded":"2024-09-21T07:30:45.339251+0000","last_fullsized":"2024-09-21T07:30:45.339251+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:59.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131087+0000","last_change":"2024-09-21T07:30:44.169122+0000","last_active":"2024-09-21T07:30:45.131087+0000","last_peered":"2024-09-21T07:30:45.131087+0000","last_clean":"2024-09-21T07:30:45.131087+0000","last_became_active":"2024-09-21T07:30:44.168827+0000","last_became_peered":"2024-09-21T07:30:44.168827+0000","last_unstale":"2024-09-21T07:30:45.131087+0000","last_undegraded":"2024-09-21T07:30:45.131087+0000","last_fullsized":"2024-09-21T07:30:45.131087+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.361691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339544+0000","last_change":"2024-09-21T07:30:44.170676+0000","last_active":"2024-09-21T07:30:45.339544+0000","last_peered":"2024-09-21T07:30:45.339544+0000","last_clean":"2024-09-21T07:30:45.339544+0000","last_became_active":"2024-09-21T07:30:44.170330+0000","last_became_peered":"2024-09-21T07:30:44.170330+0000","last_unstale":"2024-09-21T07:30:45.339544+0000","last_undegraded":"2024-09-21T07:30:45.339544+0000","last_fullsized":"2024-09-21T07:30:45.339544+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131186+0000","last_change":"2024-09-21T07:30:44.169611+0000","last_active":"2024-09-21T07:30:45.131186+0000","last_peered":"2024-09-21T07:30:45.131186+0000","last_clean":"2024-09-21T07:30:45.131186+0000","last_became_active":"2024-09-21T07:30:44.169276+0000","last_became_peered":"2024-09-21T07:30:44.169276+0000","last_unstale":"2024-09-21T07:30:45.131186+0000","last_undegraded":"2024-09-21T07:30:45.131186+0000","last_fullsized":"2024-09-21T07:30:45.131186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:16.272379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334848+0000","last_change":"2024-09-21T07:30:44.171079+0000","last_active":"2024-09-21T07:30:45.334848+0000","last_peered":"2024-09-21T07:30:45.334848+0000","last_clean":"2024-09-21T07:30:45.334848+0000","last_became_active":"2024-09-21T07:30:44.170634+0000","last_became_peered":"2024-09-21T07:30:44.170634+0000","last_unstale":"2024-09-21T07:30:45.334848+0000","last_undegraded":"2024-09-21T07:30:45.334848+0000","last_fullsized":"2024-09-21T07:30:45.334848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.413012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338952+0000","last_change":"2024-09-21T07:30:44.161541+0000","last_active":"2024-09-21T07:30:45.338952+0000","last_peered":"2024-09-21T07:30:45.338952+0000","last_clean":"2024-09-21T07:30:45.338952+0000","last_became_active":"2024-09-21T07:30:44.158258+0000","last_became_peered":"2024-09-21T07:30:44.158258+0000","last_unstale":"2024-09-21T07:30:45.338952+0000","last_undegraded":"2024-09-21T07:30:45.338952+0000","last_fullsized":"2024-09-21T07:30:45.338952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.709605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338866+0000","last_change":"2024-09-21T07:30:44.171001+0000","last_active":"2024-09-21T07:30:45.338866+0000","last_peered":"2024-09-21T07:30:45.338866+0000","last_clean":"2024-09-21T07:30:45.338866+0000","last_became_active":"2024-09-21T07:30:44.170412+0000","last_became_peered":"2024-09-21T07:30:44.170412+0000","last_unstale":"2024-09-21T07:30:45.338866+0000","last_undegraded":"2024-09-21T07:30:45.338866+0000","last_fullsized":"2024-09-21T07:30:45.338866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:29.547247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131266+0000","last_change":"2024-09-21T07:30:44.158437+0000","last_active":"2024-09-21T07:30:45.131266+0000","last_peered":"2024-09-21T07:30:45.131266+0000","last_clean":"2024-09-21T07:30:45.131266+0000","last_became_active":"2024-09-21T07:30:44.157277+0000","last_became_peered":"2024-09-21T07:30:44.157277+0000","last_unstale":"2024-09-21T07:30:45.131266+0000","last_undegraded":"2024-09-21T07:30:45.131266+0000","last_fullsized":"2024-09-21T07:30:45.131266+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:19.353180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111427+0000","last_change":"2024-09-21T07:30:42.111427+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111427+0000","last_undegraded":"2024-09-21T07:30:42.111427+0000","last_fullsized":"2024-09-21T07:30:42.111427+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109057+0000","last_change":"2024-09-21T07:30:42.109057+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109057+0000","last_undegraded":"2024-09-21T07:30:42.109057+0000","last_fullsized":"2024-09-21T07:30:42.109057+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338779+0000","last_change":"2024-09-21T07:30:43.138630+0000","last_active":"2024-09-21T07:30:45.338779+0000","last_peered":"2024-09-21T07:30:45.338779+0000","last_clean":"2024-09-21T07:30:45.338779+0000","last_became_active":"2024-09-21T07:30:43.138290+0000","last_became_peered":"2024-09-21T07:30:43.138290+0000","last_unstale":"2024-09-21T07:30:45.338779+0000","last_undegraded":"2024-09-21T07:30:45.338779+0000","last_fullsized":"2024-09-21T07:30:45.338779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:06.977356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339588+0000","last_change":"2024-09-21T07:30:44.166923+0000","last_active":"2024-09-21T07:30:45.339588+0000","last_peered":"2024-09-21T07:30:45.339588+0000","last_clean":"2024-09-21T07:30:45.339588+0000","last_became_active":"2024-09-21T07:30:44.166577+0000","last_became_peered":"2024-09-21T07:30:44.166577+0000","last_unstale":"2024-09-21T07:30:45.339588+0000","last_undegraded":"2024-09-21T07:30:45.339588+0000","last_fullsized":"2024-09-21T07:30:45.339588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109574+0000","last_change":"2024-09-21T07:30:42.109574+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109574+0000","last_undegraded":"2024-09-21T07:30:42.109574+0000","last_fullsized":"2024-09-21T07:30:42.109574+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.106067+0000","last_change":"2024-09-21T07:30:42.106067+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.106067+0000","last_undegraded":"2024-09-21T07:30:42.106067+0000","last_fullsized":"2024-09-21T07:30:42.106067+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.112368+0000","last_change":"2024-09-21T07:30:42.112368+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.112368+0000","last_undegraded":"2024-09-21T07:30:42.112368+0000","last_fullsized":"2024-09-21T07:30:42.112368+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333718+0000","last_change":"2024-09-21T07:30:44.158316+0000","last_active":"2024-09-21T07:30:45.333718+0000","last_peered":"2024-09-21T07:30:45.333718+0000","last_clean":"2024-09-21T07:30:45.333718+0000","last_became_active":"2024-09-21T07:30:44.156920+0000","last_became_peered":"2024-09-21T07:30:44.156920+0000","last_unstale":"2024-09-21T07:30:45.333718+0000","last_undegraded":"2024-09-21T07:30:45.333718+0000","last_fullsized":"2024-09-21T07:30:45.333718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:30.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107503+0000","last_change":"2024-09-21T07:30:42.107503+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107503+0000","last_undegraded":"2024-09-21T07:30:42.107503+0000","last_fullsized":"2024-09-21T07:30:42.107503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110843+0000","last_change":"2024-09-21T07:30:42.110843+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110843+0000","last_undegraded":"2024-09-21T07:30:42.110843+0000","last_fullsized":"2024-09-21T07:30:42.110843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110249+0000","last_change":"2024-09-21T07:30:42.110249+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110249+0000","last_undegraded":"2024-09-21T07:30:42.110249+0000","last_fullsized":"2024-09-21T07:30:42.110249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107532+0000","last_change":"2024-09-21T07:30:42.107532+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107532+0000","last_undegraded":"2024-09-21T07:30:42.107532+0000","last_fullsized":"2024-09-21T07:30:42.107532+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335067+0000","last_change":"2024-09-21T07:30:44.170956+0000","last_active":"2024-09-21T07:30:45.335067+0000","last_peered":"2024-09-21T07:30:45.335067+0000","last_clean":"2024-09-21T07:30:45.335067+0000","last_became_active":"2024-09-21T07:30:44.170229+0000","last_became_peered":"2024-09-21T07:30:44.170229+0000","last_unstale":"2024-09-21T07:30:45.335067+0000","last_undegraded":"2024-09-21T07:30:45.335067+0000","last_fullsized":"2024-09-21T07:30:45.335067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:53.117607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.107563+0000","last_change":"2024-09-21T07:30:42.107563+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.107563+0000","last_undegraded":"2024-09-21T07:30:42.107563+0000","last_fullsized":"2024-09-21T07:30:42.107563+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"130'6","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131203+0000","last_change":"2024-09-21T07:30:43.121009+0000","last_active":"2024-09-21T07:30:45.131203+0000","last_peered":"2024-09-21T07:30:45.131203+0000","last_clean":"2024-09-21T07:30:45.131203+0000","last_became_active":"2024-09-21T07:30:43.120678+0000","last_became_peered":"2024-09-21T07:30:43.120678+0000","last_unstale":"2024-09-21T07:30:45.131203+0000","last_undegraded":"2024-09-21T07:30:45.131203+0000","last_fullsized":"2024-09-21T07:30:45.131203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.128293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335023+0000","last_change":"2024-09-21T07:30:43.133791+0000","last_active":"2024-09-21T07:30:45.335023+0000","last_peered":"2024-09-21T07:30:45.335023+0000","last_clean":"2024-09-21T07:30:45.335023+0000","last_became_active":"2024-09-21T07:30:43.133441+0000","last_became_peered":"2024-09-21T07:30:43.133441+0000","last_unstale":"2024-09-21T07:30:45.335023+0000","last_undegraded":"2024-09-21T07:30:45.335023+0000","last_fullsized":"2024-09-21T07:30:45.335023+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:06.475767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334102+0000","last_change":"2024-09-21T07:30:43.123257+0000","last_active":"2024-09-21T07:30:45.334102+0000","last_peered":"2024-09-21T07:30:45.334102+0000","last_clean":"2024-09-21T07:30:45.334102+0000","last_became_active":"2024-09-21T07:30:43.122875+0000","last_became_peered":"2024-09-21T07:30:43.122875+0000","last_unstale":"2024-09-21T07:30:45.334102+0000","last_undegraded":"2024-09-21T07:30:45.334102+0000","last_fullsized":"2024-09-21T07:30:45.334102+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:13.120467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131217+0000","last_change":"2024-09-21T07:30:43.123076+0000","last_active":"2024-09-21T07:30:45.131217+0000","last_peered":"2024-09-21T07:30:45.131217+0000","last_clean":"2024-09-21T07:30:45.131217+0000","last_became_active":"2024-09-21T07:30:43.122485+0000","last_became_peered":"2024-09-21T07:30:43.122485+0000","last_unstale":"2024-09-21T07:30:45.131217+0000","last_undegraded":"2024-09-21T07:30:45.131217+0000","last_fullsized":"2024-09-21T07:30:45.131217+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:46.303644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.109032+0000","last_change":"2024-09-21T07:30:42.109032+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.109032+0000","last_undegraded":"2024-09-21T07:30:42.109032+0000","last_fullsized":"2024-09-21T07:30:42.109032+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105611+0000","last_change":"2024-09-21T07:30:42.105611+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105611+0000","last_undegraded":"2024-09-21T07:30:42.105611+0000","last_fullsized":"2024-09-21T07:30:42.105611+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338777+0000","last_change":"2024-09-21T07:30:43.138505+0000","last_active":"2024-09-21T07:30:45.338777+0000","last_peered":"2024-09-21T07:30:45.338777+0000","last_clean":"2024-09-21T07:30:45.338777+0000","last_became_active":"2024-09-21T07:30:43.138157+0000","last_became_peered":"2024-09-21T07:30:43.138157+0000","last_unstale":"2024-09-21T07:30:45.338777+0000","last_undegraded":"2024-09-21T07:30:45.338777+0000","last_fullsized":"2024-09-21T07:30:45.338777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:38.140550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339406+0000","last_change":"2024-09-21T07:30:43.141221+0000","last_active":"2024-09-21T07:30:45.339406+0000","last_peered":"2024-09-21T07:30:45.339406+0000","last_clean":"2024-09-21T07:30:45.339406+0000","last_became_active":"2024-09-21T07:30:43.140734+0000","last_became_peered":"2024-09-21T07:30:43.140734+0000","last_unstale":"2024-09-21T07:30:45.339406+0000","last_undegraded":"2024-09-21T07:30:45.339406+0000","last_fullsized":"2024-09-21T07:30:45.339406+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.604283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111844+0000","last_change":"2024-09-21T07:30:42.111844+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111844+0000","last_undegraded":"2024-09-21T07:30:42.111844+0000","last_fullsized":"2024-09-21T07:30:42.111844+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131078+0000","last_change":"2024-09-21T07:30:44.163520+0000","last_active":"2024-09-21T07:30:45.131078+0000","last_peered":"2024-09-21T07:30:45.131078+0000","last_clean":"2024-09-21T07:30:45.131078+0000","last_became_active":"2024-09-21T07:30:44.163065+0000","last_became_peered":"2024-09-21T07:30:44.163065+0000","last_unstale":"2024-09-21T07:30:45.131078+0000","last_undegraded":"2024-09-21T07:30:45.131078+0000","last_fullsized":"2024-09-21T07:30:45.131078+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338601+0000","last_change":"2024-09-21T07:30:43.133964+0000","last_active":"2024-09-21T07:30:45.338601+0000","last_peered":"2024-09-21T07:30:45.338601+0000","last_clean":"2024-09-21T07:30:45.338601+0000","last_became_active":"2024-09-21T07:30:43.133538+0000","last_became_peered":"2024-09-21T07:30:43.133538+0000","last_unstale":"2024-09-21T07:30:45.338601+0000","last_undegraded":"2024-09-21T07:30:45.338601+0000","last_fullsized":"2024-09-21T07:30:45.338601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:45.540022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333981+0000","last_change":"2024-09-21T07:30:44.167744+0000","last_active":"2024-09-21T07:30:45.333981+0000","last_peered":"2024-09-21T07:30:45.333981+0000","last_clean":"2024-09-21T07:30:45.333981+0000","last_became_active":"2024-09-21T07:30:44.167122+0000","last_became_peered":"2024-09-21T07:30:44.167122+0000","last_unstale":"2024-09-21T07:30:45.333981+0000","last_undegraded":"2024-09-21T07:30:45.333981+0000","last_fullsized":"2024-09-21T07:30:45.333981+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:05.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131289+0000","last_change":"2024-09-21T07:30:43.139312+0000","last_active":"2024-09-21T07:30:45.131289+0000","last_peered":"2024-09-21T07:30:45.131289+0000","last_clean":"2024-09-21T07:30:45.131289+0000","last_became_active":"2024-09-21T07:30:43.138937+0000","last_became_peered":"2024-09-21T07:30:43.138937+0000","last_unstale":"2024-09-21T07:30:45.131289+0000","last_undegraded":"2024-09-21T07:30:45.131289+0000","last_fullsized":"2024-09-21T07:30:45.131289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:01.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338207+0000","last_change":"2024-09-21T07:30:43.134252+0000","last_active":"2024-09-21T07:30:45.338207+0000","last_peered":"2024-09-21T07:30:45.338207+0000","last_clean":"2024-09-21T07:30:45.338207+0000","last_became_active":"2024-09-21T07:30:43.133449+0000","last_became_peered":"2024-09-21T07:30:43.133449+0000","last_unstale":"2024-09-21T07:30:45.338207+0000","last_undegraded":"2024-09-21T07:30:45.338207+0000","last_fullsized":"2024-09-21T07:30:45.338207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:17.110123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110232+0000","last_change":"2024-09-21T07:30:42.110232+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110232+0000","last_undegraded":"2024-09-21T07:30:42.110232+0000","last_fullsized":"2024-09-21T07:30:42.110232+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110224+0000","last_change":"2024-09-21T07:30:42.110224+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110224+0000","last_undegraded":"2024-09-21T07:30:42.110224+0000","last_fullsized":"2024-09-21T07:30:42.110224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339410+0000","last_change":"2024-09-21T07:30:44.153892+0000","last_active":"2024-09-21T07:30:45.339410+0000","last_peered":"2024-09-21T07:30:45.339410+0000","last_clean":"2024-09-21T07:30:45.339410+0000","last_became_active":"2024-09-21T07:30:44.153608+0000","last_became_peered":"2024-09-21T07:30:44.153608+0000","last_unstale":"2024-09-21T07:30:45.339410+0000","last_undegraded":"2024-09-21T07:30:45.339410+0000","last_fullsized":"2024-09-21T07:30:45.339410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:36.363132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.110580+0000","last_change":"2024-09-21T07:30:42.110580+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.110580+0000","last_undegraded":"2024-09-21T07:30:42.110580+0000","last_fullsized":"2024-09-21T07:30:42.110580+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111425+0000","last_change":"2024-09-21T07:30:42.111425+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111425+0000","last_undegraded":"2024-09-21T07:30:42.111425+0000","last_fullsized":"2024-09-21T07:30:42.111425+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131165+0000","last_change":"2024-09-21T07:30:44.166662+0000","last_active":"2024-09-21T07:30:45.131165+0000","last_peered":"2024-09-21T07:30:45.131165+0000","last_clean":"2024-09-21T07:30:45.131165+0000","last_became_active":"2024-09-21T07:30:44.166319+0000","last_became_peered":"2024-09-21T07:30:44.166319+0000","last_unstale":"2024-09-21T07:30:45.131165+0000","last_undegraded":"2024-09-21T07:30:45.131165+0000","last_fullsized":"2024-09-21T07:30:45.131165+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:12.710220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.105369+0000","last_change":"2024-09-21T07:30:42.105369+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.105369+0000","last_undegraded":"2024-09-21T07:30:42.105369+0000","last_fullsized":"2024-09-21T07:30:42.105369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:44.167242+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:44.166797+0000","last_became_peered":"2024-09-21T07:30:44.166797+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:46.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-21T07:30:42.111248+0000","last_change":"2024-09-21T07:30:42.111248+0000","last_active":"2024-09-21T07:30:42.095059+0000","last_peered":"2024-09-21T07:30:42.095059+0000","last_clean":"2024-09-21T07:30:42.095059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:42.111248+0000","last_undegraded":"2024-09-21T07:30:42.111248+0000","last_fullsized":"2024-09-21T07:30:42.111248+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:30:43.102244+0000","last_change":"2024-09-21T07:30:43.102244+0000","last_active":"2024-09-21T07:30:43.102244+0000","last_peered":"2024-09-21T07:30:43.102244+0000","last_clean":"2024-09-21T07:30:43.102244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:30:43.102244+0000","last_undegraded":"2024-09-21T07:30:43.102244+0000","last_fullsized":"2024-09-21T07:30:43.102244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338352+0000","last_change":"2024-09-21T07:30:43.134998+0000","last_active":"2024-09-21T07:30:45.338352+0000","last_peered":"2024-09-21T07:30:45.338352+0000","last_clean":"2024-09-21T07:30:45.338352+0000","last_became_active":"2024-09-21T07:30:43.134686+0000","last_became_peered":"2024-09-21T07:30:43.134686+0000","last_unstale":"2024-09-21T07:30:45.338352+0000","last_undegraded":"2024-09-21T07:30:45.338352+0000","last_fullsized":"2024-09-21T07:30:45.338352+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339232+0000","last_change":"2024-09-21T07:30:44.160640+0000","last_active":"2024-09-21T07:30:45.339232+0000","last_peered":"2024-09-21T07:30:45.339232+0000","last_clean":"2024-09-21T07:30:45.339232+0000","last_became_active":"2024-09-21T07:30:44.158316+0000","last_became_peered":"2024-09-21T07:30:44.158316+0000","last_unstale":"2024-09-21T07:30:45.339232+0000","last_undegraded":"2024-09-21T07:30:45.339232+0000","last_fullsized":"2024-09-21T07:30:45.339232+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:19.923244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"130'8","reported_seq":23,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131228+0000","last_change":"2024-09-21T07:30:43.129146+0000","last_active":"2024-09-21T07:30:45.131228+0000","last_peered":"2024-09-21T07:30:45.131228+0000","last_clean":"2024-09-21T07:30:45.131228+0000","last_became_active":"2024-09-21T07:30:43.128816+0000","last_became_peered":"2024-09-21T07:30:43.128816+0000","last_unstale":"2024-09-21T07:30:45.131228+0000","last_undegraded":"2024-09-21T07:30:45.131228+0000","last_fullsized":"2024-09-21T07:30:45.131228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:58.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338425+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:30:45.338425+0000","last_peered":"2024-09-21T07:30:45.338425+0000","last_clean":"2024-09-21T07:30:45.338425+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:30:45.338425+0000","last_undegraded":"2024-09-21T07:30:45.338425+0000","last_fullsized":"2024-09-21T07:30:45.338425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28572,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343268,"statfs":{"total":96636764160,"available":96607506432,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46612,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325228,"statfs":{"total":96636764160,"available":96589033472,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1585152,"data_stored":744139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50776,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321064,"statfs":{"total":96636764160,"available":96584769536,"internally_reserved":0,"allocated":1572864,"data_stored":737930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47208,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324632,"statfs":{"total":96636764160,"available":96588423168,"internally_reserved":0,"allocated":2179072,"data_stored":1334507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41692,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330148,"statfs":{"total":96636764160,"available":96594071552,"internally_reserved":0,"allocated":2232320,"data_stored":1355809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1638400,"data_stored":766311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:30:49.246 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3f is not active+clean 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3b is not active+clean 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3a is not active+clean 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:PG 18.39 is not active+clean 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:PG 18.36 is not active+clean 2024-09-21T07:30:49.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.35 is not active+clean 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.34 is not active+clean 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.33 is not active+clean 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.31 is not active+clean 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.30 is not active+clean 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.248 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2f is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2d is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2c is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2a is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.28 is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.27 is not active+clean 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.249 INFO:tasks.ceph.ceph_manager.ceph:PG 18.26 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:PG 18.25 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:PG 18.24 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:PG 18.23 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:PG 18.21 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:PG 18.20 is not active+clean 2024-09-21T07:30:49.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1f is not active+clean 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.111427+0000', 'last_change': '2024-09-21T07:30:42.111427+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.111427+0000', 'last_undegraded': '2024-09-21T07:30:42.111427+0000', 'last_fullsized': '2024-09-21T07:30:42.111427+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1d is not active+clean 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1e is not active+clean 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.109057+0000', 'last_change': '2024-09-21T07:30:42.109057+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.109057+0000', 'last_undegraded': '2024-09-21T07:30:42.109057+0000', 'last_fullsized': '2024-09-21T07:30:42.109057+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.251 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1c is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.109574+0000', 'last_change': '2024-09-21T07:30:42.109574+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.109574+0000', 'last_undegraded': '2024-09-21T07:30:42.109574+0000', 'last_fullsized': '2024-09-21T07:30:42.109574+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1b is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.106067+0000', 'last_change': '2024-09-21T07:30:42.106067+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.106067+0000', 'last_undegraded': '2024-09-21T07:30:42.106067+0000', 'last_fullsized': '2024-09-21T07:30:42.106067+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:PG 18.19 is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1a is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.112368+0000', 'last_change': '2024-09-21T07:30:42.112368+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.112368+0000', 'last_undegraded': '2024-09-21T07:30:42.112368+0000', 'last_fullsized': '2024-09-21T07:30:42.112368+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:PG 17.19 is not active+clean 2024-09-21T07:30:49.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.107503+0000', 'last_change': '2024-09-21T07:30:42.107503+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.107503+0000', 'last_undegraded': '2024-09-21T07:30:42.107503+0000', 'last_fullsized': '2024-09-21T07:30:42.107503+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.110843+0000', 'last_change': '2024-09-21T07:30:42.110843+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.110843+0000', 'last_undegraded': '2024-09-21T07:30:42.110843+0000', 'last_fullsized': '2024-09-21T07:30:42.110843+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 17.17 is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.110249+0000', 'last_change': '2024-09-21T07:30:42.110249+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.110249+0000', 'last_undegraded': '2024-09-21T07:30:42.110249+0000', 'last_fullsized': '2024-09-21T07:30:42.110249+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:PG 17.16 is not active+clean 2024-09-21T07:30:49.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.107532+0000', 'last_change': '2024-09-21T07:30:42.107532+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.107532+0000', 'last_undegraded': '2024-09-21T07:30:42.107532+0000', 'last_fullsized': '2024-09-21T07:30:42.107532+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 17.15 is not active+clean 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.107563+0000', 'last_change': '2024-09-21T07:30:42.107563+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.107563+0000', 'last_undegraded': '2024-09-21T07:30:42.107563+0000', 'last_fullsized': '2024-09-21T07:30:42.107563+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 18.12 is not active+clean 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.254 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:PG 17.f is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.109032+0000', 'last_change': '2024-09-21T07:30:42.109032+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.109032+0000', 'last_undegraded': '2024-09-21T07:30:42.109032+0000', 'last_fullsized': '2024-09-21T07:30:42.109032+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:PG 18.d is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:PG 17.e is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.105611+0000', 'last_change': '2024-09-21T07:30:42.105611+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.105611+0000', 'last_undegraded': '2024-09-21T07:30:42.105611+0000', 'last_fullsized': '2024-09-21T07:30:42.105611+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:PG 18.e is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-09-21T07:30:49.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:PG 18.8 is not active+clean 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.111844+0000', 'last_change': '2024-09-21T07:30:42.111844+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.111844+0000', 'last_undegraded': '2024-09-21T07:30:42.111844+0000', 'last_fullsized': '2024-09-21T07:30:42.111844+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.256 INFO:tasks.ceph.ceph_manager.ceph:PG 18.4 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.110232+0000', 'last_change': '2024-09-21T07:30:42.110232+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.110232+0000', 'last_undegraded': '2024-09-21T07:30:42.110232+0000', 'last_fullsized': '2024-09-21T07:30:42.110232+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:PG 17.6 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.110224+0000', 'last_change': '2024-09-21T07:30:42.110224+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.110224+0000', 'last_undegraded': '2024-09-21T07:30:42.110224+0000', 'last_fullsized': '2024-09-21T07:30:42.110224+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:PG 17.5 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.110580+0000', 'last_change': '2024-09-21T07:30:42.110580+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.110580+0000', 'last_undegraded': '2024-09-21T07:30:42.110580+0000', 'last_fullsized': '2024-09-21T07:30:42.110580+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:PG 18.7 is not active+clean 2024-09-21T07:30:49.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.111425+0000', 'last_change': '2024-09-21T07:30:42.111425+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.111425+0000', 'last_undegraded': '2024-09-21T07:30:42.111425+0000', 'last_fullsized': '2024-09-21T07:30:42.111425+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 18.0 is not active+clean 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3 is not active+clean 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.105369+0000', 'last_change': '2024-09-21T07:30:42.105369+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.105369+0000', 'last_undegraded': '2024-09-21T07:30:42.105369+0000', 'last_fullsized': '2024-09-21T07:30:42.105369+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2 is not active+clean 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.105369+0000', 'last_change': '2024-09-21T07:30:42.105369+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.105369+0000', 'last_undegraded': '2024-09-21T07:30:42.105369+0000', 'last_fullsized': '2024-09-21T07:30:42.105369+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:30:42.111248+0000', 'last_change': '2024-09-21T07:30:42.111248+0000', 'last_active': '2024-09-21T07:30:42.095059+0000', 'last_peered': '2024-09-21T07:30:42.095059+0000', 'last_clean': '2024-09-21T07:30:42.095059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:42.111248+0000', 'last_undegraded': '2024-09-21T07:30:42.111248+0000', 'last_fullsized': '2024-09-21T07:30:42.111248+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:42.095059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:30:49.258 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-09-21T07:30:49.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:30:43.102244+0000', 'last_change': '2024-09-21T07:30:43.102244+0000', 'last_active': '2024-09-21T07:30:43.102244+0000', 'last_peered': '2024-09-21T07:30:43.102244+0000', 'last_clean': '2024-09-21T07:30:43.102244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:30:43.102244+0000', 'last_undegraded': '2024-09-21T07:30:43.102244+0000', 'last_fullsized': '2024-09-21T07:30:43.102244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'last_clean_scrub_stamp': '2024-09-21T07:30:43.102244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:30:49.259 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:30:49.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 -- 172.21.15.64:0/812407942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100cbcd0 msgr2=0x7f64100cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 --2- 172.21.15.64:0/812407942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100cbcd0 0x7f64100cc0e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6408009c80 tx=0x7f640801cd70 comp rx=0 tx=0).stop 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 -- 172.21.15.64:0/812407942 shutdown_connections 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 --2- 172.21.15.64:0/812407942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100cbcd0 0x7f64100cc0e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 --2- 172.21.15.64:0/812407942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100b1be0 0x7f64100b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 -- 172.21.15.64:0/812407942 >> 172.21.15.64:0/812407942 conn(0x7f64100ccbe0 msgr2=0x7f64100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 -- 172.21.15.64:0/812407942 shutdown_connections 2024-09-21T07:30:49.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.442+0000 7f6417800640 1 -- 172.21.15.64:0/812407942 wait complete. 2024-09-21T07:30:49.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 Processor -- start 2024-09-21T07:30:49.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- start start 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100cbcd0 0x7f6410154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f641015cbd0 0x7f64100d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64100b42e0 con 0x7f64100b1be0 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64100b4160 con 0x7f641015cbd0 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f641016a290 con 0x7f64100cbcd0 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55638/0 (socket says 172.21.15.64:55638) 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 -- 172.21.15.64:0/2700467622 learned_addr learned my addr 172.21.15.64:0/2700467622 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:49.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6407e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100cbcd0 0x7f6410154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6415800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f641015cbd0 0x7f64100d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 -- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100cbcd0 msgr2=0x7f6410154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100cbcd0 0x7f6410154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 -- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f641015cbd0 msgr2=0x7f64100d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f641015cbd0 0x7f64100d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 -- 172.21.15.64:0/2700467622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641009ac40 con 0x7f64100b1be0 2024-09-21T07:30:49.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6414e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f640000c3c0 tx=0x7f640000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64000053c0 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641009af20 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400003860 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.446+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101fc7d0 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64100b1ff0 con 0x7f64100b1be0 2024-09-21T07:30:49.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f640001a070 con 0x7f64100b1be0 2024-09-21T07:30:49.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f640d600640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 0x7f63ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f6400093680 con 0x7f64100b1be0 2024-09-21T07:30:49.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f6407e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 0x7f63ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.450+0000 7f6407e00640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 0x7f63ec075710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f63f80058d0 tx=0x7f63f8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.458+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f64100b2530 con 0x7f64100b1be0 2024-09-21T07:30:49.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.698+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6410156740 con 0x7f64100b1be0 2024-09-21T07:30:49.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f640d600640 1 -- 172.21.15.64:0/2700467622 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1380 (secure 0 0 0) 0x7f640005e5a0 con 0x7f64100b1be0 2024-09-21T07:30:49.702 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:49.702 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":507,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":45},{"state_name":"active+clean","count":32},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":592084,"bytes_used":376086528,"bytes_avail":772718026752,"bytes_total":773094113280,"unknown_pgs_ratio":0.46391752362251282,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":2066,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8139}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-21T07:30:05.540333+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 msgr2=0x7f63ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 0x7f63ec075710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f63f80058d0 tx=0x7f63f8005860 comp rx=0 tx=0).stop 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 msgr2=0x7f64101fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f640000c3c0 tx=0x7f640000c880 comp rx=0 tx=0).stop 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 shutdown_connections 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63ec073200 0x7f63ec075710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f641015cbd0 0x7f64100d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64100cbcd0 0x7f6410154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 --2- 172.21.15.64:0/2700467622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64100b1be0 0x7f64101fccf0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 >> 172.21.15.64:0/2700467622 conn(0x7f64100ccbe0 msgr2=0x7f6410074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:49.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 shutdown_connections 2024-09-21T07:30:49.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.702+0000 7f6417800640 1 -- 172.21.15.64:0/2700467622 wait complete. 2024-09-21T07:30:49.724 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:30:49.724 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:30:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 -- 172.21.15.64:0/593129593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 msgr2=0x7fbc340ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 --2- 172.21.15.64:0/593129593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc340ca7b0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fbc34070eb0 tx=0x7fbc2801c800 comp rx=0 tx=0).stop 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 -- 172.21.15.64:0/593129593 shutdown_connections 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 --2- 172.21.15.64:0/593129593 >> v2:172.21.15.90:3300/0 conn(0x7fbc340cacf0 0x7fbc340cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 --2- 172.21.15.64:0/593129593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc340ca7b0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 -- 172.21.15.64:0/593129593 >> 172.21.15.64:0/593129593 conn(0x7fbc340ccbe0 msgr2=0x7fbc340ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 -- 172.21.15.64:0/593129593 shutdown_connections 2024-09-21T07:30:49.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.882+0000 7fbc3c400640 1 -- 172.21.15.64:0/593129593 wait complete. 2024-09-21T07:30:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 Processor -- start 2024-09-21T07:30:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- start start 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc340cacf0 0x7fbc340ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3415e9b0 0x7fbc34073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34168250 con 0x7fbc340b24e0 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341680d0 con 0x7fbc3415e9b0 2024-09-21T07:30:49.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbc341683d0 con 0x7fbc340cacf0 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55646/0 (socket says 172.21.15.64:55646) 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 -- 172.21.15.64:0/3053133405 learned_addr learned my addr 172.21.15.64:0/3053133405 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39000640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc340cacf0 0x7fbc340ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3a400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3415e9b0 0x7fbc34073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 -- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc340cacf0 msgr2=0x7fbc340ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc340cacf0 0x7fbc340ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 -- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3415e9b0 msgr2=0x7fbc34073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3415e9b0 0x7fbc34073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 -- 172.21.15.64:0/3053133405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc340c6370 con 0x7fbc340b24e0 2024-09-21T07:30:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc39a00640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fbc28019410 tx=0x7fbc28005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc280041c0 con 0x7fbc340b24e0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc280be070 con 0x7fbc340b24e0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc340c6650 con 0x7fbc340b24e0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28005030 con 0x7fbc340b24e0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.886+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc34147440 con 0x7fbc340b24e0 2024-09-21T07:30:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc340ca7b0 con 0x7fbc340b24e0 2024-09-21T07:30:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbc280051d0 con 0x7fbc340b24e0 2024-09-21T07:30:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc31600640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 0x7fbc14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fbc2812eab0 con 0x7fbc340b24e0 2024-09-21T07:30:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc39000640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 0x7fbc14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:49.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.890+0000 7fbc39000640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 0x7fbc14075710 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000bc50 tx=0x7fbc2000b3e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:49.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:49.894+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbc280c7020 con 0x7fbc340b24e0 2024-09-21T07:30:50.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.070+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc34147670 con 0x7fbc14073200 2024-09-21T07:30:50.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.074+0000 7fbc31600640 1 -- 172.21.15.64:0/3053133405 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7fbc34147670 con 0x7fbc14073200 2024-09-21T07:30:50.077 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:30:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 msgr2=0x7fbc14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 0x7fbc14075710 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000bc50 tx=0x7fbc2000b3e0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 msgr2=0x7fbc34155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fbc28019410 tx=0x7fbc28005da0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 shutdown_connections 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbc14073200 0x7fbc14075710 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3415e9b0 0x7fbc34073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc340cacf0 0x7fbc340ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 --2- 172.21.15.64:0/3053133405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc340b24e0 0x7fbc34155910 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 >> 172.21.15.64:0/3053133405 conn(0x7fbc340ccbe0 msgr2=0x7fbc34068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 shutdown_connections 2024-09-21T07:30:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:50.078+0000 7fbc3c400640 1 -- 172.21.15.64:0/3053133405 wait complete. 2024-09-21T07:30:50.094 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:30:50.094+0000 7fdda2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:30:50.099 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-09-21T07:30:49.554016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":367552,"kb_used_data":13896,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754607168,"statfs":{"total":773094113280,"available":772717740032,"internally_reserved":0,"allocated":14229504,"data_stored":7302876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.445080"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339094+0000","last_change":"2024-09-21T07:30:44.151528+0000","last_active":"2024-09-21T07:30:45.339094+0000","last_peered":"2024-09-21T07:30:45.339094+0000","last_clean":"2024-09-21T07:30:45.339094+0000","last_became_active":"2024-09-21T07:30:44.151210+0000","last_became_peered":"2024-09-21T07:30:44.151210+0000","last_unstale":"2024-09-21T07:30:45.339094+0000","last_undegraded":"2024-09-21T07:30:45.339094+0000","last_fullsized":"2024-09-21T07:30:45.339094+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:47.066767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333522+0000","last_change":"2024-09-21T07:30:44.171380+0000","last_active":"2024-09-21T07:30:45.333522+0000","last_peered":"2024-09-21T07:30:45.333522+0000","last_clean":"2024-09-21T07:30:45.333522+0000","last_became_active":"2024-09-21T07:30:44.170753+0000","last_became_peered":"2024-09-21T07:30:44.170753+0000","last_unstale":"2024-09-21T07:30:45.333522+0000","last_undegraded":"2024-09-21T07:30:45.333522+0000","last_fullsized":"2024-09-21T07:30:45.333522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:14.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334560+0000","last_change":"2024-09-21T07:30:44.167425+0000","last_active":"2024-09-21T07:30:45.334560+0000","last_peered":"2024-09-21T07:30:45.334560+0000","last_clean":"2024-09-21T07:30:45.334560+0000","last_became_active":"2024-09-21T07:30:44.166377+0000","last_became_peered":"2024-09-21T07:30:44.166377+0000","last_unstale":"2024-09-21T07:30:45.334560+0000","last_undegraded":"2024-09-21T07:30:45.334560+0000","last_fullsized":"2024-09-21T07:30:45.334560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:53.872339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339251+0000","last_change":"2024-09-21T07:30:44.155212+0000","last_active":"2024-09-21T07:30:45.339251+0000","last_peered":"2024-09-21T07:30:45.339251+0000","last_clean":"2024-09-21T07:30:45.339251+0000","last_became_active":"2024-09-21T07:30:44.154732+0000","last_became_peered":"2024-09-21T07:30:44.154732+0000","last_unstale":"2024-09-21T07:30:45.339251+0000","last_undegraded":"2024-09-21T07:30:45.339251+0000","last_fullsized":"2024-09-21T07:30:45.339251+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:59.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337975+0000","last_change":"2024-09-21T07:30:44.135844+0000","last_active":"2024-09-21T07:30:45.337975+0000","last_peered":"2024-09-21T07:30:45.337975+0000","last_clean":"2024-09-21T07:30:45.337975+0000","last_became_active":"2024-09-21T07:30:44.135515+0000","last_became_peered":"2024-09-21T07:30:44.135515+0000","last_unstale":"2024-09-21T07:30:45.337975+0000","last_undegraded":"2024-09-21T07:30:45.337975+0000","last_fullsized":"2024-09-21T07:30:45.337975+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:55.302248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338763+0000","last_change":"2024-09-21T07:30:44.167837+0000","last_active":"2024-09-21T07:30:45.338763+0000","last_peered":"2024-09-21T07:30:45.338763+0000","last_clean":"2024-09-21T07:30:45.338763+0000","last_became_active":"2024-09-21T07:30:44.167469+0000","last_became_peered":"2024-09-21T07:30:44.167469+0000","last_unstale":"2024-09-21T07:30:45.338763+0000","last_undegraded":"2024-09-21T07:30:45.338763+0000","last_fullsized":"2024-09-21T07:30:45.338763+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:14.150818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338402+0000","last_change":"2024-09-21T07:30:44.155878+0000","last_active":"2024-09-21T07:30:45.338402+0000","last_peered":"2024-09-21T07:30:45.338402+0000","last_clean":"2024-09-21T07:30:45.338402+0000","last_became_active":"2024-09-21T07:30:44.155555+0000","last_became_peered":"2024-09-21T07:30:44.155555+0000","last_unstale":"2024-09-21T07:30:45.338402+0000","last_undegraded":"2024-09-21T07:30:45.338402+0000","last_fullsized":"2024-09-21T07:30:45.338402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:31.088595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131087+0000","last_change":"2024-09-21T07:30:44.169122+0000","last_active":"2024-09-21T07:30:45.131087+0000","last_peered":"2024-09-21T07:30:45.131087+0000","last_clean":"2024-09-21T07:30:45.131087+0000","last_became_active":"2024-09-21T07:30:44.168827+0000","last_became_peered":"2024-09-21T07:30:44.168827+0000","last_unstale":"2024-09-21T07:30:45.131087+0000","last_undegraded":"2024-09-21T07:30:45.131087+0000","last_fullsized":"2024-09-21T07:30:45.131087+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.361691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339544+0000","last_change":"2024-09-21T07:30:44.170676+0000","last_active":"2024-09-21T07:30:45.339544+0000","last_peered":"2024-09-21T07:30:45.339544+0000","last_clean":"2024-09-21T07:30:45.339544+0000","last_became_active":"2024-09-21T07:30:44.170330+0000","last_became_peered":"2024-09-21T07:30:44.170330+0000","last_unstale":"2024-09-21T07:30:45.339544+0000","last_undegraded":"2024-09-21T07:30:45.339544+0000","last_fullsized":"2024-09-21T07:30:45.339544+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340513+0000","last_change":"2024-09-21T07:30:44.164416+0000","last_active":"2024-09-21T07:30:45.340513+0000","last_peered":"2024-09-21T07:30:45.340513+0000","last_clean":"2024-09-21T07:30:45.340513+0000","last_became_active":"2024-09-21T07:30:44.163747+0000","last_became_peered":"2024-09-21T07:30:44.163747+0000","last_unstale":"2024-09-21T07:30:45.340513+0000","last_undegraded":"2024-09-21T07:30:45.340513+0000","last_fullsized":"2024-09-21T07:30:45.340513+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:20.607808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338245+0000","last_change":"2024-09-21T07:30:44.146959+0000","last_active":"2024-09-21T07:30:45.338245+0000","last_peered":"2024-09-21T07:30:45.338245+0000","last_clean":"2024-09-21T07:30:45.338245+0000","last_became_active":"2024-09-21T07:30:44.146332+0000","last_became_peered":"2024-09-21T07:30:44.146332+0000","last_unstale":"2024-09-21T07:30:45.338245+0000","last_undegraded":"2024-09-21T07:30:45.338245+0000","last_fullsized":"2024-09-21T07:30:45.338245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:12.322756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341854+0000","last_change":"2024-09-21T07:30:44.139815+0000","last_active":"2024-09-21T07:30:45.341854+0000","last_peered":"2024-09-21T07:30:45.341854+0000","last_clean":"2024-09-21T07:30:45.341854+0000","last_became_active":"2024-09-21T07:30:44.139490+0000","last_became_peered":"2024-09-21T07:30:44.139490+0000","last_unstale":"2024-09-21T07:30:45.341854+0000","last_undegraded":"2024-09-21T07:30:45.341854+0000","last_fullsized":"2024-09-21T07:30:45.341854+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:15.000262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339399+0000","last_change":"2024-09-21T07:30:44.146637+0000","last_active":"2024-09-21T07:30:45.339399+0000","last_peered":"2024-09-21T07:30:45.339399+0000","last_clean":"2024-09-21T07:30:45.339399+0000","last_became_active":"2024-09-21T07:30:44.146304+0000","last_became_peered":"2024-09-21T07:30:44.146304+0000","last_unstale":"2024-09-21T07:30:45.339399+0000","last_undegraded":"2024-09-21T07:30:45.339399+0000","last_fullsized":"2024-09-21T07:30:45.339399+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.642332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131186+0000","last_change":"2024-09-21T07:30:44.169611+0000","last_active":"2024-09-21T07:30:45.131186+0000","last_peered":"2024-09-21T07:30:45.131186+0000","last_clean":"2024-09-21T07:30:45.131186+0000","last_became_active":"2024-09-21T07:30:44.169276+0000","last_became_peered":"2024-09-21T07:30:44.169276+0000","last_unstale":"2024-09-21T07:30:45.131186+0000","last_undegraded":"2024-09-21T07:30:45.131186+0000","last_fullsized":"2024-09-21T07:30:45.131186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:16.272379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337803+0000","last_change":"2024-09-21T07:30:44.147656+0000","last_active":"2024-09-21T07:30:45.337803+0000","last_peered":"2024-09-21T07:30:45.337803+0000","last_clean":"2024-09-21T07:30:45.337803+0000","last_became_active":"2024-09-21T07:30:44.146110+0000","last_became_peered":"2024-09-21T07:30:44.146110+0000","last_unstale":"2024-09-21T07:30:45.337803+0000","last_undegraded":"2024-09-21T07:30:45.337803+0000","last_fullsized":"2024-09-21T07:30:45.337803+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:34.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338419+0000","last_change":"2024-09-21T07:30:44.163189+0000","last_active":"2024-09-21T07:30:45.338419+0000","last_peered":"2024-09-21T07:30:45.338419+0000","last_clean":"2024-09-21T07:30:45.338419+0000","last_became_active":"2024-09-21T07:30:44.162691+0000","last_became_peered":"2024-09-21T07:30:44.162691+0000","last_unstale":"2024-09-21T07:30:45.338419+0000","last_undegraded":"2024-09-21T07:30:45.338419+0000","last_fullsized":"2024-09-21T07:30:45.338419+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:44.419732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340547+0000","last_change":"2024-09-21T07:30:44.149964+0000","last_active":"2024-09-21T07:30:45.340547+0000","last_peered":"2024-09-21T07:30:45.340547+0000","last_clean":"2024-09-21T07:30:45.340547+0000","last_became_active":"2024-09-21T07:30:44.149539+0000","last_became_peered":"2024-09-21T07:30:44.149539+0000","last_unstale":"2024-09-21T07:30:45.340547+0000","last_undegraded":"2024-09-21T07:30:45.340547+0000","last_fullsized":"2024-09-21T07:30:45.340547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:05.578044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334848+0000","last_change":"2024-09-21T07:30:44.171079+0000","last_active":"2024-09-21T07:30:45.334848+0000","last_peered":"2024-09-21T07:30:45.334848+0000","last_clean":"2024-09-21T07:30:45.334848+0000","last_became_active":"2024-09-21T07:30:44.170634+0000","last_became_peered":"2024-09-21T07:30:44.170634+0000","last_unstale":"2024-09-21T07:30:45.334848+0000","last_undegraded":"2024-09-21T07:30:45.334848+0000","last_fullsized":"2024-09-21T07:30:45.334848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.413012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132946+0000","last_change":"2024-09-21T07:30:44.151756+0000","last_active":"2024-09-21T07:30:45.132946+0000","last_peered":"2024-09-21T07:30:45.132946+0000","last_clean":"2024-09-21T07:30:45.132946+0000","last_became_active":"2024-09-21T07:30:44.151385+0000","last_became_peered":"2024-09-21T07:30:44.151385+0000","last_unstale":"2024-09-21T07:30:45.132946+0000","last_undegraded":"2024-09-21T07:30:45.132946+0000","last_fullsized":"2024-09-21T07:30:45.132946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:17.935718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339627+0000","last_change":"2024-09-21T07:30:44.169887+0000","last_active":"2024-09-21T07:30:45.339627+0000","last_peered":"2024-09-21T07:30:45.339627+0000","last_clean":"2024-09-21T07:30:45.339627+0000","last_became_active":"2024-09-21T07:30:44.169517+0000","last_became_peered":"2024-09-21T07:30:44.169517+0000","last_unstale":"2024-09-21T07:30:45.339627+0000","last_undegraded":"2024-09-21T07:30:45.339627+0000","last_fullsized":"2024-09-21T07:30:45.339627+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:09.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338952+0000","last_change":"2024-09-21T07:30:44.161541+0000","last_active":"2024-09-21T07:30:45.338952+0000","last_peered":"2024-09-21T07:30:45.338952+0000","last_clean":"2024-09-21T07:30:45.338952+0000","last_became_active":"2024-09-21T07:30:44.158258+0000","last_became_peered":"2024-09-21T07:30:44.158258+0000","last_unstale":"2024-09-21T07:30:45.338952+0000","last_undegraded":"2024-09-21T07:30:45.338952+0000","last_fullsized":"2024-09-21T07:30:45.338952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.709605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338073+0000","last_change":"2024-09-21T07:30:44.160404+0000","last_active":"2024-09-21T07:30:45.338073+0000","last_peered":"2024-09-21T07:30:45.338073+0000","last_clean":"2024-09-21T07:30:45.338073+0000","last_became_active":"2024-09-21T07:30:44.160094+0000","last_became_peered":"2024-09-21T07:30:44.160094+0000","last_unstale":"2024-09-21T07:30:45.338073+0000","last_undegraded":"2024-09-21T07:30:45.338073+0000","last_fullsized":"2024-09-21T07:30:45.338073+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:06.187588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338866+0000","last_change":"2024-09-21T07:30:44.171001+0000","last_active":"2024-09-21T07:30:45.338866+0000","last_peered":"2024-09-21T07:30:45.338866+0000","last_clean":"2024-09-21T07:30:45.338866+0000","last_became_active":"2024-09-21T07:30:44.170412+0000","last_became_peered":"2024-09-21T07:30:44.170412+0000","last_unstale":"2024-09-21T07:30:45.338866+0000","last_undegraded":"2024-09-21T07:30:45.338866+0000","last_fullsized":"2024-09-21T07:30:45.338866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:29.547247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131480+0000","last_change":"2024-09-21T07:30:44.149803+0000","last_active":"2024-09-21T07:30:45.131480+0000","last_peered":"2024-09-21T07:30:45.131480+0000","last_clean":"2024-09-21T07:30:45.131480+0000","last_became_active":"2024-09-21T07:30:44.149474+0000","last_became_peered":"2024-09-21T07:30:44.149474+0000","last_unstale":"2024-09-21T07:30:45.131480+0000","last_undegraded":"2024-09-21T07:30:45.131480+0000","last_fullsized":"2024-09-21T07:30:45.131480+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:59.003094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133046+0000","last_change":"2024-09-21T07:30:44.145340+0000","last_active":"2024-09-21T07:30:45.133046+0000","last_peered":"2024-09-21T07:30:45.133046+0000","last_clean":"2024-09-21T07:30:45.133046+0000","last_became_active":"2024-09-21T07:30:44.145041+0000","last_became_peered":"2024-09-21T07:30:44.145041+0000","last_unstale":"2024-09-21T07:30:45.133046+0000","last_undegraded":"2024-09-21T07:30:45.133046+0000","last_fullsized":"2024-09-21T07:30:45.133046+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:09.925320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341120+0000","last_change":"2024-09-21T07:30:44.152489+0000","last_active":"2024-09-21T07:30:45.341120+0000","last_peered":"2024-09-21T07:30:45.341120+0000","last_clean":"2024-09-21T07:30:45.341120+0000","last_became_active":"2024-09-21T07:30:44.152075+0000","last_became_peered":"2024-09-21T07:30:44.152075+0000","last_unstale":"2024-09-21T07:30:45.341120+0000","last_undegraded":"2024-09-21T07:30:45.341120+0000","last_fullsized":"2024-09-21T07:30:45.341120+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.146961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133018+0000","last_change":"2024-09-21T07:30:44.145833+0000","last_active":"2024-09-21T07:30:45.133018+0000","last_peered":"2024-09-21T07:30:45.133018+0000","last_clean":"2024-09-21T07:30:45.133018+0000","last_became_active":"2024-09-21T07:30:44.143963+0000","last_became_peered":"2024-09-21T07:30:44.143963+0000","last_unstale":"2024-09-21T07:30:45.133018+0000","last_undegraded":"2024-09-21T07:30:45.133018+0000","last_fullsized":"2024-09-21T07:30:45.133018+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:32.249044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341398+0000","last_change":"2024-09-21T07:30:44.161764+0000","last_active":"2024-09-21T07:30:45.341398+0000","last_peered":"2024-09-21T07:30:45.341398+0000","last_clean":"2024-09-21T07:30:45.341398+0000","last_became_active":"2024-09-21T07:30:44.154298+0000","last_became_peered":"2024-09-21T07:30:44.154298+0000","last_unstale":"2024-09-21T07:30:45.341398+0000","last_undegraded":"2024-09-21T07:30:45.341398+0000","last_fullsized":"2024-09-21T07:30:45.341398+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:56.501033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340024+0000","last_change":"2024-09-21T07:30:44.158818+0000","last_active":"2024-09-21T07:30:45.340024+0000","last_peered":"2024-09-21T07:30:45.340024+0000","last_clean":"2024-09-21T07:30:45.340024+0000","last_became_active":"2024-09-21T07:30:44.158484+0000","last_became_peered":"2024-09-21T07:30:44.158484+0000","last_unstale":"2024-09-21T07:30:45.340024+0000","last_undegraded":"2024-09-21T07:30:45.340024+0000","last_fullsized":"2024-09-21T07:30:45.340024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:09.216358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131266+0000","last_change":"2024-09-21T07:30:44.158437+0000","last_active":"2024-09-21T07:30:45.131266+0000","last_peered":"2024-09-21T07:30:45.131266+0000","last_clean":"2024-09-21T07:30:45.131266+0000","last_became_active":"2024-09-21T07:30:44.157277+0000","last_became_peered":"2024-09-21T07:30:44.157277+0000","last_unstale":"2024-09-21T07:30:45.131266+0000","last_undegraded":"2024-09-21T07:30:45.131266+0000","last_fullsized":"2024-09-21T07:30:45.131266+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:19.353180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131721+0000","last_change":"2024-09-21T07:30:44.154314+0000","last_active":"2024-09-21T07:30:45.131721+0000","last_peered":"2024-09-21T07:30:45.131721+0000","last_clean":"2024-09-21T07:30:45.131721+0000","last_became_active":"2024-09-21T07:30:44.152584+0000","last_became_peered":"2024-09-21T07:30:44.152584+0000","last_unstale":"2024-09-21T07:30:45.131721+0000","last_undegraded":"2024-09-21T07:30:45.131721+0000","last_fullsized":"2024-09-21T07:30:45.131721+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:23.142291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131638+0000","last_change":"2024-09-21T07:30:44.145302+0000","last_active":"2024-09-21T07:30:45.131638+0000","last_peered":"2024-09-21T07:30:45.131638+0000","last_clean":"2024-09-21T07:30:45.131638+0000","last_became_active":"2024-09-21T07:30:44.144183+0000","last_became_peered":"2024-09-21T07:30:44.144183+0000","last_unstale":"2024-09-21T07:30:45.131638+0000","last_undegraded":"2024-09-21T07:30:45.131638+0000","last_fullsized":"2024-09-21T07:30:45.131638+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:10.576763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340206+0000","last_change":"2024-09-21T07:30:44.164671+0000","last_active":"2024-09-21T07:30:45.340206+0000","last_peered":"2024-09-21T07:30:45.340206+0000","last_clean":"2024-09-21T07:30:45.340206+0000","last_became_active":"2024-09-21T07:30:44.164018+0000","last_became_peered":"2024-09-21T07:30:44.164018+0000","last_unstale":"2024-09-21T07:30:45.340206+0000","last_undegraded":"2024-09-21T07:30:45.340206+0000","last_fullsized":"2024-09-21T07:30:45.340206+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:15.470926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"130'4","reported_seq":19,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132201+0000","last_change":"2024-09-21T07:30:43.136660+0000","last_active":"2024-09-21T07:30:45.132201+0000","last_peered":"2024-09-21T07:30:45.132201+0000","last_clean":"2024-09-21T07:30:45.132201+0000","last_became_active":"2024-09-21T07:30:43.136292+0000","last_became_peered":"2024-09-21T07:30:43.136292+0000","last_unstale":"2024-09-21T07:30:45.132201+0000","last_undegraded":"2024-09-21T07:30:45.132201+0000","last_fullsized":"2024-09-21T07:30:45.132201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:39.197667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340831+0000","last_change":"2024-09-21T07:30:44.164705+0000","last_active":"2024-09-21T07:30:45.340831+0000","last_peered":"2024-09-21T07:30:45.340831+0000","last_clean":"2024-09-21T07:30:45.340831+0000","last_became_active":"2024-09-21T07:30:44.164399+0000","last_became_peered":"2024-09-21T07:30:44.164399+0000","last_unstale":"2024-09-21T07:30:45.340831+0000","last_undegraded":"2024-09-21T07:30:45.340831+0000","last_fullsized":"2024-09-21T07:30:45.340831+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:14.364393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340401+0000","last_change":"2024-09-21T07:30:43.132464+0000","last_active":"2024-09-21T07:30:45.340401+0000","last_peered":"2024-09-21T07:30:45.340401+0000","last_clean":"2024-09-21T07:30:45.340401+0000","last_became_active":"2024-09-21T07:30:43.132142+0000","last_became_peered":"2024-09-21T07:30:43.132142+0000","last_unstale":"2024-09-21T07:30:45.340401+0000","last_undegraded":"2024-09-21T07:30:45.340401+0000","last_fullsized":"2024-09-21T07:30:45.340401+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:00.715406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132114+0000","last_change":"2024-09-21T07:30:44.155730+0000","last_active":"2024-09-21T07:30:45.132114+0000","last_peered":"2024-09-21T07:30:45.132114+0000","last_clean":"2024-09-21T07:30:45.132114+0000","last_became_active":"2024-09-21T07:30:44.155396+0000","last_became_peered":"2024-09-21T07:30:44.155396+0000","last_unstale":"2024-09-21T07:30:45.132114+0000","last_undegraded":"2024-09-21T07:30:45.132114+0000","last_fullsized":"2024-09-21T07:30:45.132114+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:11.845575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338779+0000","last_change":"2024-09-21T07:30:43.138630+0000","last_active":"2024-09-21T07:30:45.338779+0000","last_peered":"2024-09-21T07:30:45.338779+0000","last_clean":"2024-09-21T07:30:45.338779+0000","last_became_active":"2024-09-21T07:30:43.138290+0000","last_became_peered":"2024-09-21T07:30:43.138290+0000","last_unstale":"2024-09-21T07:30:45.338779+0000","last_undegraded":"2024-09-21T07:30:45.338779+0000","last_fullsized":"2024-09-21T07:30:45.338779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:06.977356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339588+0000","last_change":"2024-09-21T07:30:44.166923+0000","last_active":"2024-09-21T07:30:45.339588+0000","last_peered":"2024-09-21T07:30:45.339588+0000","last_clean":"2024-09-21T07:30:45.339588+0000","last_became_active":"2024-09-21T07:30:44.166577+0000","last_became_peered":"2024-09-21T07:30:44.166577+0000","last_unstale":"2024-09-21T07:30:45.339588+0000","last_undegraded":"2024-09-21T07:30:45.339588+0000","last_fullsized":"2024-09-21T07:30:45.339588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340282+0000","last_change":"2024-09-21T07:30:43.139910+0000","last_active":"2024-09-21T07:30:45.340282+0000","last_peered":"2024-09-21T07:30:45.340282+0000","last_clean":"2024-09-21T07:30:45.340282+0000","last_became_active":"2024-09-21T07:30:43.139549+0000","last_became_peered":"2024-09-21T07:30:43.139549+0000","last_unstale":"2024-09-21T07:30:45.340282+0000","last_undegraded":"2024-09-21T07:30:45.340282+0000","last_fullsized":"2024-09-21T07:30:45.340282+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:30.128764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338253+0000","last_change":"2024-09-21T07:30:44.151122+0000","last_active":"2024-09-21T07:30:45.338253+0000","last_peered":"2024-09-21T07:30:45.338253+0000","last_clean":"2024-09-21T07:30:45.338253+0000","last_became_active":"2024-09-21T07:30:44.150778+0000","last_became_peered":"2024-09-21T07:30:44.150778+0000","last_unstale":"2024-09-21T07:30:45.338253+0000","last_undegraded":"2024-09-21T07:30:45.338253+0000","last_fullsized":"2024-09-21T07:30:45.338253+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:11.596404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338035+0000","last_change":"2024-09-21T07:30:43.127619+0000","last_active":"2024-09-21T07:30:45.338035+0000","last_peered":"2024-09-21T07:30:45.338035+0000","last_clean":"2024-09-21T07:30:45.338035+0000","last_became_active":"2024-09-21T07:30:43.127311+0000","last_became_peered":"2024-09-21T07:30:43.127311+0000","last_unstale":"2024-09-21T07:30:45.338035+0000","last_undegraded":"2024-09-21T07:30:45.338035+0000","last_fullsized":"2024-09-21T07:30:45.338035+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:47.708022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337963+0000","last_change":"2024-09-21T07:30:44.145536+0000","last_active":"2024-09-21T07:30:45.337963+0000","last_peered":"2024-09-21T07:30:45.337963+0000","last_clean":"2024-09-21T07:30:45.337963+0000","last_became_active":"2024-09-21T07:30:44.145047+0000","last_became_peered":"2024-09-21T07:30:44.145047+0000","last_unstale":"2024-09-21T07:30:45.337963+0000","last_undegraded":"2024-09-21T07:30:45.337963+0000","last_fullsized":"2024-09-21T07:30:45.337963+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:47.034088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338935+0000","last_change":"2024-09-21T07:30:43.136855+0000","last_active":"2024-09-21T07:30:45.338935+0000","last_peered":"2024-09-21T07:30:45.338935+0000","last_clean":"2024-09-21T07:30:45.338935+0000","last_became_active":"2024-09-21T07:30:43.136423+0000","last_became_peered":"2024-09-21T07:30:43.136423+0000","last_unstale":"2024-09-21T07:30:45.338935+0000","last_undegraded":"2024-09-21T07:30:45.338935+0000","last_fullsized":"2024-09-21T07:30:45.338935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:32.128337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333718+0000","last_change":"2024-09-21T07:30:44.158316+0000","last_active":"2024-09-21T07:30:45.333718+0000","last_peered":"2024-09-21T07:30:45.333718+0000","last_clean":"2024-09-21T07:30:45.333718+0000","last_became_active":"2024-09-21T07:30:44.156920+0000","last_became_peered":"2024-09-21T07:30:44.156920+0000","last_unstale":"2024-09-21T07:30:45.333718+0000","last_undegraded":"2024-09-21T07:30:45.333718+0000","last_fullsized":"2024-09-21T07:30:45.333718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:30.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131582+0000","last_change":"2024-09-21T07:30:43.134190+0000","last_active":"2024-09-21T07:30:45.131582+0000","last_peered":"2024-09-21T07:30:45.131582+0000","last_clean":"2024-09-21T07:30:45.131582+0000","last_became_active":"2024-09-21T07:30:43.133884+0000","last_became_peered":"2024-09-21T07:30:43.133884+0000","last_unstale":"2024-09-21T07:30:45.131582+0000","last_undegraded":"2024-09-21T07:30:45.131582+0000","last_fullsized":"2024-09-21T07:30:45.131582+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:41.645820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339501+0000","last_change":"2024-09-21T07:30:44.157655+0000","last_active":"2024-09-21T07:30:45.339501+0000","last_peered":"2024-09-21T07:30:45.339501+0000","last_clean":"2024-09-21T07:30:45.339501+0000","last_became_active":"2024-09-21T07:30:44.157257+0000","last_became_peered":"2024-09-21T07:30:44.157257+0000","last_unstale":"2024-09-21T07:30:45.339501+0000","last_undegraded":"2024-09-21T07:30:45.339501+0000","last_fullsized":"2024-09-21T07:30:45.339501+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:01.312867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338762+0000","last_change":"2024-09-21T07:30:43.140924+0000","last_active":"2024-09-21T07:30:45.338762+0000","last_peered":"2024-09-21T07:30:45.338762+0000","last_clean":"2024-09-21T07:30:45.338762+0000","last_became_active":"2024-09-21T07:30:43.140589+0000","last_became_peered":"2024-09-21T07:30:43.140589+0000","last_unstale":"2024-09-21T07:30:45.338762+0000","last_undegraded":"2024-09-21T07:30:45.338762+0000","last_fullsized":"2024-09-21T07:30:45.338762+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.262601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132090+0000","last_change":"2024-09-21T07:30:44.143957+0000","last_active":"2024-09-21T07:30:45.132090+0000","last_peered":"2024-09-21T07:30:45.132090+0000","last_clean":"2024-09-21T07:30:45.132090+0000","last_became_active":"2024-09-21T07:30:44.143653+0000","last_became_peered":"2024-09-21T07:30:44.143653+0000","last_unstale":"2024-09-21T07:30:45.132090+0000","last_undegraded":"2024-09-21T07:30:45.132090+0000","last_fullsized":"2024-09-21T07:30:45.132090+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:04.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132305+0000","last_change":"2024-09-21T07:30:43.143624+0000","last_active":"2024-09-21T07:30:45.132305+0000","last_peered":"2024-09-21T07:30:45.132305+0000","last_clean":"2024-09-21T07:30:45.132305+0000","last_became_active":"2024-09-21T07:30:43.143348+0000","last_became_peered":"2024-09-21T07:30:43.143348+0000","last_unstale":"2024-09-21T07:30:45.132305+0000","last_undegraded":"2024-09-21T07:30:45.132305+0000","last_fullsized":"2024-09-21T07:30:45.132305+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:37.389634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132342+0000","last_change":"2024-09-21T07:30:44.162205+0000","last_active":"2024-09-21T07:30:45.132342+0000","last_peered":"2024-09-21T07:30:45.132342+0000","last_clean":"2024-09-21T07:30:45.132342+0000","last_became_active":"2024-09-21T07:30:44.161831+0000","last_became_peered":"2024-09-21T07:30:44.161831+0000","last_unstale":"2024-09-21T07:30:45.132342+0000","last_undegraded":"2024-09-21T07:30:45.132342+0000","last_fullsized":"2024-09-21T07:30:45.132342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:04.930405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132590+0000","last_change":"2024-09-21T07:30:43.120286+0000","last_active":"2024-09-21T07:30:45.132590+0000","last_peered":"2024-09-21T07:30:45.132590+0000","last_clean":"2024-09-21T07:30:45.132590+0000","last_became_active":"2024-09-21T07:30:43.119954+0000","last_became_peered":"2024-09-21T07:30:43.119954+0000","last_unstale":"2024-09-21T07:30:45.132590+0000","last_undegraded":"2024-09-21T07:30:45.132590+0000","last_fullsized":"2024-09-21T07:30:45.132590+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:02.355617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335067+0000","last_change":"2024-09-21T07:30:44.170956+0000","last_active":"2024-09-21T07:30:45.335067+0000","last_peered":"2024-09-21T07:30:45.335067+0000","last_clean":"2024-09-21T07:30:45.335067+0000","last_became_active":"2024-09-21T07:30:44.170229+0000","last_became_peered":"2024-09-21T07:30:44.170229+0000","last_unstale":"2024-09-21T07:30:45.335067+0000","last_undegraded":"2024-09-21T07:30:45.335067+0000","last_fullsized":"2024-09-21T07:30:45.335067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:53.117607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"130'3","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132374+0000","last_change":"2024-09-21T07:30:43.126259+0000","last_active":"2024-09-21T07:30:45.132374+0000","last_peered":"2024-09-21T07:30:45.132374+0000","last_clean":"2024-09-21T07:30:45.132374+0000","last_became_active":"2024-09-21T07:30:43.125061+0000","last_became_peered":"2024-09-21T07:30:43.125061+0000","last_unstale":"2024-09-21T07:30:45.132374+0000","last_undegraded":"2024-09-21T07:30:45.132374+0000","last_fullsized":"2024-09-21T07:30:45.132374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:13.618288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133252+0000","last_change":"2024-09-21T07:30:44.147104+0000","last_active":"2024-09-21T07:30:45.133252+0000","last_peered":"2024-09-21T07:30:45.133252+0000","last_clean":"2024-09-21T07:30:45.133252+0000","last_became_active":"2024-09-21T07:30:44.146590+0000","last_became_peered":"2024-09-21T07:30:44.146590+0000","last_unstale":"2024-09-21T07:30:45.133252+0000","last_undegraded":"2024-09-21T07:30:45.133252+0000","last_fullsized":"2024-09-21T07:30:45.133252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:48.391796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"130'6","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131203+0000","last_change":"2024-09-21T07:30:43.121009+0000","last_active":"2024-09-21T07:30:45.131203+0000","last_peered":"2024-09-21T07:30:45.131203+0000","last_clean":"2024-09-21T07:30:45.131203+0000","last_became_active":"2024-09-21T07:30:43.120678+0000","last_became_peered":"2024-09-21T07:30:43.120678+0000","last_unstale":"2024-09-21T07:30:45.131203+0000","last_undegraded":"2024-09-21T07:30:45.131203+0000","last_fullsized":"2024-09-21T07:30:45.131203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.128293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133069+0000","last_change":"2024-09-21T07:30:44.160237+0000","last_active":"2024-09-21T07:30:45.133069+0000","last_peered":"2024-09-21T07:30:45.133069+0000","last_clean":"2024-09-21T07:30:45.133069+0000","last_became_active":"2024-09-21T07:30:44.159340+0000","last_became_peered":"2024-09-21T07:30:44.159340+0000","last_unstale":"2024-09-21T07:30:45.133069+0000","last_undegraded":"2024-09-21T07:30:45.133069+0000","last_fullsized":"2024-09-21T07:30:45.133069+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:31.365097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335023+0000","last_change":"2024-09-21T07:30:43.133791+0000","last_active":"2024-09-21T07:30:45.335023+0000","last_peered":"2024-09-21T07:30:45.335023+0000","last_clean":"2024-09-21T07:30:45.335023+0000","last_became_active":"2024-09-21T07:30:43.133441+0000","last_became_peered":"2024-09-21T07:30:43.133441+0000","last_unstale":"2024-09-21T07:30:45.335023+0000","last_undegraded":"2024-09-21T07:30:45.335023+0000","last_fullsized":"2024-09-21T07:30:45.335023+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:06.475767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338688+0000","last_change":"2024-09-21T07:30:44.147896+0000","last_active":"2024-09-21T07:30:45.338688+0000","last_peered":"2024-09-21T07:30:45.338688+0000","last_clean":"2024-09-21T07:30:45.338688+0000","last_became_active":"2024-09-21T07:30:44.147572+0000","last_became_peered":"2024-09-21T07:30:44.147572+0000","last_unstale":"2024-09-21T07:30:45.338688+0000","last_undegraded":"2024-09-21T07:30:45.338688+0000","last_fullsized":"2024-09-21T07:30:45.338688+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:57.096276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334102+0000","last_change":"2024-09-21T07:30:43.123257+0000","last_active":"2024-09-21T07:30:45.334102+0000","last_peered":"2024-09-21T07:30:45.334102+0000","last_clean":"2024-09-21T07:30:45.334102+0000","last_became_active":"2024-09-21T07:30:43.122875+0000","last_became_peered":"2024-09-21T07:30:43.122875+0000","last_unstale":"2024-09-21T07:30:45.334102+0000","last_undegraded":"2024-09-21T07:30:45.334102+0000","last_fullsized":"2024-09-21T07:30:45.334102+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:13.120467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338664+0000","last_change":"2024-09-21T07:30:44.154890+0000","last_active":"2024-09-21T07:30:45.338664+0000","last_peered":"2024-09-21T07:30:45.338664+0000","last_clean":"2024-09-21T07:30:45.338664+0000","last_became_active":"2024-09-21T07:30:44.154459+0000","last_became_peered":"2024-09-21T07:30:44.154459+0000","last_unstale":"2024-09-21T07:30:45.338664+0000","last_undegraded":"2024-09-21T07:30:45.338664+0000","last_fullsized":"2024-09-21T07:30:45.338664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:04.237559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131217+0000","last_change":"2024-09-21T07:30:43.123076+0000","last_active":"2024-09-21T07:30:45.131217+0000","last_peered":"2024-09-21T07:30:45.131217+0000","last_clean":"2024-09-21T07:30:45.131217+0000","last_became_active":"2024-09-21T07:30:43.122485+0000","last_became_peered":"2024-09-21T07:30:43.122485+0000","last_unstale":"2024-09-21T07:30:45.131217+0000","last_undegraded":"2024-09-21T07:30:45.131217+0000","last_fullsized":"2024-09-21T07:30:45.131217+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:46.303644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132074+0000","last_change":"2024-09-21T07:30:44.162942+0000","last_active":"2024-09-21T07:30:45.132074+0000","last_peered":"2024-09-21T07:30:45.132074+0000","last_clean":"2024-09-21T07:30:45.132074+0000","last_became_active":"2024-09-21T07:30:44.162615+0000","last_became_peered":"2024-09-21T07:30:44.162615+0000","last_unstale":"2024-09-21T07:30:45.132074+0000","last_undegraded":"2024-09-21T07:30:45.132074+0000","last_fullsized":"2024-09-21T07:30:45.132074+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:07.230091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340413+0000","last_change":"2024-09-21T07:30:43.144701+0000","last_active":"2024-09-21T07:30:45.340413+0000","last_peered":"2024-09-21T07:30:45.340413+0000","last_clean":"2024-09-21T07:30:45.340413+0000","last_became_active":"2024-09-21T07:30:43.144303+0000","last_became_peered":"2024-09-21T07:30:43.144303+0000","last_unstale":"2024-09-21T07:30:45.340413+0000","last_undegraded":"2024-09-21T07:30:45.340413+0000","last_fullsized":"2024-09-21T07:30:45.340413+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:21.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338502+0000","last_change":"2024-09-21T07:30:44.160262+0000","last_active":"2024-09-21T07:30:45.338502+0000","last_peered":"2024-09-21T07:30:45.338502+0000","last_clean":"2024-09-21T07:30:45.338502+0000","last_became_active":"2024-09-21T07:30:44.159904+0000","last_became_peered":"2024-09-21T07:30:44.159904+0000","last_unstale":"2024-09-21T07:30:45.338502+0000","last_undegraded":"2024-09-21T07:30:45.338502+0000","last_fullsized":"2024-09-21T07:30:45.338502+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.135711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341205+0000","last_change":"2024-09-21T07:30:43.140049+0000","last_active":"2024-09-21T07:30:45.341205+0000","last_peered":"2024-09-21T07:30:45.341205+0000","last_clean":"2024-09-21T07:30:45.341205+0000","last_became_active":"2024-09-21T07:30:43.139729+0000","last_became_peered":"2024-09-21T07:30:43.139729+0000","last_unstale":"2024-09-21T07:30:45.341205+0000","last_undegraded":"2024-09-21T07:30:45.341205+0000","last_fullsized":"2024-09-21T07:30:45.341205+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:35.291970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340843+0000","last_change":"2024-09-21T07:30:44.142720+0000","last_active":"2024-09-21T07:30:45.340843+0000","last_peered":"2024-09-21T07:30:45.340843+0000","last_clean":"2024-09-21T07:30:45.340843+0000","last_became_active":"2024-09-21T07:30:44.142289+0000","last_became_peered":"2024-09-21T07:30:44.142289+0000","last_unstale":"2024-09-21T07:30:45.340843+0000","last_undegraded":"2024-09-21T07:30:45.340843+0000","last_fullsized":"2024-09-21T07:30:45.340843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:21.003423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338777+0000","last_change":"2024-09-21T07:30:43.138505+0000","last_active":"2024-09-21T07:30:45.338777+0000","last_peered":"2024-09-21T07:30:45.338777+0000","last_clean":"2024-09-21T07:30:45.338777+0000","last_became_active":"2024-09-21T07:30:43.138157+0000","last_became_peered":"2024-09-21T07:30:43.138157+0000","last_unstale":"2024-09-21T07:30:45.338777+0000","last_undegraded":"2024-09-21T07:30:45.338777+0000","last_fullsized":"2024-09-21T07:30:45.338777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:38.140550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133336+0000","last_change":"2024-09-21T07:30:44.152808+0000","last_active":"2024-09-21T07:30:45.133336+0000","last_peered":"2024-09-21T07:30:45.133336+0000","last_clean":"2024-09-21T07:30:45.133336+0000","last_became_active":"2024-09-21T07:30:44.151397+0000","last_became_peered":"2024-09-21T07:30:44.151397+0000","last_unstale":"2024-09-21T07:30:45.133336+0000","last_undegraded":"2024-09-21T07:30:45.133336+0000","last_fullsized":"2024-09-21T07:30:45.133336+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:19.646561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339406+0000","last_change":"2024-09-21T07:30:43.141221+0000","last_active":"2024-09-21T07:30:45.339406+0000","last_peered":"2024-09-21T07:30:45.339406+0000","last_clean":"2024-09-21T07:30:45.339406+0000","last_became_active":"2024-09-21T07:30:43.140734+0000","last_became_peered":"2024-09-21T07:30:43.140734+0000","last_unstale":"2024-09-21T07:30:45.339406+0000","last_undegraded":"2024-09-21T07:30:45.339406+0000","last_fullsized":"2024-09-21T07:30:45.339406+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.604283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338679+0000","last_change":"2024-09-21T07:30:44.138837+0000","last_active":"2024-09-21T07:30:45.338679+0000","last_peered":"2024-09-21T07:30:45.338679+0000","last_clean":"2024-09-21T07:30:45.338679+0000","last_became_active":"2024-09-21T07:30:44.138479+0000","last_became_peered":"2024-09-21T07:30:44.138479+0000","last_unstale":"2024-09-21T07:30:45.338679+0000","last_undegraded":"2024-09-21T07:30:45.338679+0000","last_fullsized":"2024-09-21T07:30:45.338679+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:27.512199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339044+0000","last_change":"2024-09-21T07:30:43.136160+0000","last_active":"2024-09-21T07:30:45.339044+0000","last_peered":"2024-09-21T07:30:45.339044+0000","last_clean":"2024-09-21T07:30:45.339044+0000","last_became_active":"2024-09-21T07:30:43.135818+0000","last_became_peered":"2024-09-21T07:30:43.135818+0000","last_unstale":"2024-09-21T07:30:45.339044+0000","last_undegraded":"2024-09-21T07:30:45.339044+0000","last_fullsized":"2024-09-21T07:30:45.339044+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:47.535799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131078+0000","last_change":"2024-09-21T07:30:44.163520+0000","last_active":"2024-09-21T07:30:45.131078+0000","last_peered":"2024-09-21T07:30:45.131078+0000","last_clean":"2024-09-21T07:30:45.131078+0000","last_became_active":"2024-09-21T07:30:44.163065+0000","last_became_peered":"2024-09-21T07:30:44.163065+0000","last_unstale":"2024-09-21T07:30:45.131078+0000","last_undegraded":"2024-09-21T07:30:45.131078+0000","last_fullsized":"2024-09-21T07:30:45.131078+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338601+0000","last_change":"2024-09-21T07:30:43.133964+0000","last_active":"2024-09-21T07:30:45.338601+0000","last_peered":"2024-09-21T07:30:45.338601+0000","last_clean":"2024-09-21T07:30:45.338601+0000","last_became_active":"2024-09-21T07:30:43.133538+0000","last_became_peered":"2024-09-21T07:30:43.133538+0000","last_unstale":"2024-09-21T07:30:45.338601+0000","last_undegraded":"2024-09-21T07:30:45.338601+0000","last_fullsized":"2024-09-21T07:30:45.338601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:45.540022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333981+0000","last_change":"2024-09-21T07:30:44.167744+0000","last_active":"2024-09-21T07:30:45.333981+0000","last_peered":"2024-09-21T07:30:45.333981+0000","last_clean":"2024-09-21T07:30:45.333981+0000","last_became_active":"2024-09-21T07:30:44.167122+0000","last_became_peered":"2024-09-21T07:30:44.167122+0000","last_unstale":"2024-09-21T07:30:45.333981+0000","last_undegraded":"2024-09-21T07:30:45.333981+0000","last_fullsized":"2024-09-21T07:30:45.333981+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:05.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131289+0000","last_change":"2024-09-21T07:30:43.139312+0000","last_active":"2024-09-21T07:30:45.131289+0000","last_peered":"2024-09-21T07:30:45.131289+0000","last_clean":"2024-09-21T07:30:45.131289+0000","last_became_active":"2024-09-21T07:30:43.138937+0000","last_became_peered":"2024-09-21T07:30:43.138937+0000","last_unstale":"2024-09-21T07:30:45.131289+0000","last_undegraded":"2024-09-21T07:30:45.131289+0000","last_fullsized":"2024-09-21T07:30:45.131289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:01.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131865+0000","last_change":"2024-09-21T07:30:44.160502+0000","last_active":"2024-09-21T07:30:45.131865+0000","last_peered":"2024-09-21T07:30:45.131865+0000","last_clean":"2024-09-21T07:30:45.131865+0000","last_became_active":"2024-09-21T07:30:44.160204+0000","last_became_peered":"2024-09-21T07:30:44.160204+0000","last_unstale":"2024-09-21T07:30:45.131865+0000","last_undegraded":"2024-09-21T07:30:45.131865+0000","last_fullsized":"2024-09-21T07:30:45.131865+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:49.375293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338207+0000","last_change":"2024-09-21T07:30:43.134252+0000","last_active":"2024-09-21T07:30:45.338207+0000","last_peered":"2024-09-21T07:30:45.338207+0000","last_clean":"2024-09-21T07:30:45.338207+0000","last_became_active":"2024-09-21T07:30:43.133449+0000","last_became_peered":"2024-09-21T07:30:43.133449+0000","last_unstale":"2024-09-21T07:30:45.338207+0000","last_undegraded":"2024-09-21T07:30:45.338207+0000","last_fullsized":"2024-09-21T07:30:45.338207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:17.110123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341656+0000","last_change":"2024-09-21T07:30:44.163059+0000","last_active":"2024-09-21T07:30:45.341656+0000","last_peered":"2024-09-21T07:30:45.341656+0000","last_clean":"2024-09-21T07:30:45.341656+0000","last_became_active":"2024-09-21T07:30:44.162570+0000","last_became_peered":"2024-09-21T07:30:44.162570+0000","last_unstale":"2024-09-21T07:30:45.341656+0000","last_undegraded":"2024-09-21T07:30:45.341656+0000","last_fullsized":"2024-09-21T07:30:45.341656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:00.529908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341013+0000","last_change":"2024-09-21T07:30:43.143925+0000","last_active":"2024-09-21T07:30:45.341013+0000","last_peered":"2024-09-21T07:30:45.341013+0000","last_clean":"2024-09-21T07:30:45.341013+0000","last_became_active":"2024-09-21T07:30:43.143016+0000","last_became_peered":"2024-09-21T07:30:43.143016+0000","last_unstale":"2024-09-21T07:30:45.341013+0000","last_undegraded":"2024-09-21T07:30:45.341013+0000","last_fullsized":"2024-09-21T07:30:45.341013+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:07.128327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340109+0000","last_change":"2024-09-21T07:30:44.149277+0000","last_active":"2024-09-21T07:30:45.340109+0000","last_peered":"2024-09-21T07:30:45.340109+0000","last_clean":"2024-09-21T07:30:45.340109+0000","last_became_active":"2024-09-21T07:30:44.148969+0000","last_became_peered":"2024-09-21T07:30:44.148969+0000","last_unstale":"2024-09-21T07:30:45.340109+0000","last_undegraded":"2024-09-21T07:30:45.340109+0000","last_fullsized":"2024-09-21T07:30:45.340109+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:13.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"131'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132646+0000","last_change":"2024-09-21T07:30:43.141306+0000","last_active":"2024-09-21T07:30:45.132646+0000","last_peered":"2024-09-21T07:30:45.132646+0000","last_clean":"2024-09-21T07:30:45.132646+0000","last_became_active":"2024-09-21T07:30:43.140956+0000","last_became_peered":"2024-09-21T07:30:43.140956+0000","last_unstale":"2024-09-21T07:30:45.132646+0000","last_undegraded":"2024-09-21T07:30:45.132646+0000","last_fullsized":"2024-09-21T07:30:45.132646+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:02.355617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339410+0000","last_change":"2024-09-21T07:30:44.153892+0000","last_active":"2024-09-21T07:30:45.339410+0000","last_peered":"2024-09-21T07:30:45.339410+0000","last_clean":"2024-09-21T07:30:45.339410+0000","last_became_active":"2024-09-21T07:30:44.153608+0000","last_became_peered":"2024-09-21T07:30:44.153608+0000","last_unstale":"2024-09-21T07:30:45.339410+0000","last_undegraded":"2024-09-21T07:30:45.339410+0000","last_fullsized":"2024-09-21T07:30:45.339410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:36.363132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133028+0000","last_change":"2024-09-21T07:30:43.141409+0000","last_active":"2024-09-21T07:30:45.133028+0000","last_peered":"2024-09-21T07:30:45.133028+0000","last_clean":"2024-09-21T07:30:45.133028+0000","last_became_active":"2024-09-21T07:30:43.141062+0000","last_became_peered":"2024-09-21T07:30:43.141062+0000","last_unstale":"2024-09-21T07:30:45.133028+0000","last_undegraded":"2024-09-21T07:30:45.133028+0000","last_fullsized":"2024-09-21T07:30:45.133028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.367769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341460+0000","last_change":"2024-09-21T07:30:44.147762+0000","last_active":"2024-09-21T07:30:45.341460+0000","last_peered":"2024-09-21T07:30:45.341460+0000","last_clean":"2024-09-21T07:30:45.341460+0000","last_became_active":"2024-09-21T07:30:44.147435+0000","last_became_peered":"2024-09-21T07:30:44.147435+0000","last_unstale":"2024-09-21T07:30:45.341460+0000","last_undegraded":"2024-09-21T07:30:45.341460+0000","last_fullsized":"2024-09-21T07:30:45.341460+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.470867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341746+0000","last_change":"2024-09-21T07:30:43.143395+0000","last_active":"2024-09-21T07:30:45.341746+0000","last_peered":"2024-09-21T07:30:45.341746+0000","last_clean":"2024-09-21T07:30:45.341746+0000","last_became_active":"2024-09-21T07:30:43.143055+0000","last_became_peered":"2024-09-21T07:30:43.143055+0000","last_unstale":"2024-09-21T07:30:45.341746+0000","last_undegraded":"2024-09-21T07:30:45.341746+0000","last_fullsized":"2024-09-21T07:30:45.341746+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:18.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338771+0000","last_change":"2024-09-21T07:30:44.136164+0000","last_active":"2024-09-21T07:30:45.338771+0000","last_peered":"2024-09-21T07:30:45.338771+0000","last_clean":"2024-09-21T07:30:45.338771+0000","last_became_active":"2024-09-21T07:30:44.135779+0000","last_became_peered":"2024-09-21T07:30:44.135779+0000","last_unstale":"2024-09-21T07:30:45.338771+0000","last_undegraded":"2024-09-21T07:30:45.338771+0000","last_fullsized":"2024-09-21T07:30:45.338771+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:54.525857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338147+0000","last_change":"2024-09-21T07:30:43.131360+0000","last_active":"2024-09-21T07:30:45.338147+0000","last_peered":"2024-09-21T07:30:45.338147+0000","last_clean":"2024-09-21T07:30:45.338147+0000","last_became_active":"2024-09-21T07:30:43.130836+0000","last_became_peered":"2024-09-21T07:30:43.130836+0000","last_unstale":"2024-09-21T07:30:45.338147+0000","last_undegraded":"2024-09-21T07:30:45.338147+0000","last_fullsized":"2024-09-21T07:30:45.338147+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:25.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131165+0000","last_change":"2024-09-21T07:30:44.166662+0000","last_active":"2024-09-21T07:30:45.131165+0000","last_peered":"2024-09-21T07:30:45.131165+0000","last_clean":"2024-09-21T07:30:45.131165+0000","last_became_active":"2024-09-21T07:30:44.166319+0000","last_became_peered":"2024-09-21T07:30:44.166319+0000","last_unstale":"2024-09-21T07:30:45.131165+0000","last_undegraded":"2024-09-21T07:30:45.131165+0000","last_fullsized":"2024-09-21T07:30:45.131165+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:12.710220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338148+0000","last_change":"2024-09-21T07:30:43.124578+0000","last_active":"2024-09-21T07:30:45.338148+0000","last_peered":"2024-09-21T07:30:45.338148+0000","last_clean":"2024-09-21T07:30:45.338148+0000","last_became_active":"2024-09-21T07:30:43.123020+0000","last_became_peered":"2024-09-21T07:30:43.123020+0000","last_unstale":"2024-09-21T07:30:45.338148+0000","last_undegraded":"2024-09-21T07:30:45.338148+0000","last_fullsized":"2024-09-21T07:30:45.338148+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:26.393369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:44.167242+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:44.166797+0000","last_became_peered":"2024-09-21T07:30:44.166797+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:46.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:43.137745+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:43.137373+0000","last_became_peered":"2024-09-21T07:30:43.137373+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:09.108737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339642+0000","last_change":"2024-09-21T07:30:44.144251+0000","last_active":"2024-09-21T07:30:45.339642+0000","last_peered":"2024-09-21T07:30:45.339642+0000","last_clean":"2024-09-21T07:30:45.339642+0000","last_became_active":"2024-09-21T07:30:44.143905+0000","last_became_peered":"2024-09-21T07:30:44.143905+0000","last_unstale":"2024-09-21T07:30:45.339642+0000","last_undegraded":"2024-09-21T07:30:45.339642+0000","last_fullsized":"2024-09-21T07:30:45.339642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:51.961143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338352+0000","last_change":"2024-09-21T07:30:43.134998+0000","last_active":"2024-09-21T07:30:45.338352+0000","last_peered":"2024-09-21T07:30:45.338352+0000","last_clean":"2024-09-21T07:30:45.338352+0000","last_became_active":"2024-09-21T07:30:43.134686+0000","last_became_peered":"2024-09-21T07:30:43.134686+0000","last_unstale":"2024-09-21T07:30:45.338352+0000","last_undegraded":"2024-09-21T07:30:45.338352+0000","last_fullsized":"2024-09-21T07:30:45.338352+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339232+0000","last_change":"2024-09-21T07:30:44.160640+0000","last_active":"2024-09-21T07:30:45.339232+0000","last_peered":"2024-09-21T07:30:45.339232+0000","last_clean":"2024-09-21T07:30:45.339232+0000","last_became_active":"2024-09-21T07:30:44.158316+0000","last_became_peered":"2024-09-21T07:30:44.158316+0000","last_unstale":"2024-09-21T07:30:45.339232+0000","last_undegraded":"2024-09-21T07:30:45.339232+0000","last_fullsized":"2024-09-21T07:30:45.339232+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:19.923244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"130'8","reported_seq":23,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131228+0000","last_change":"2024-09-21T07:30:43.129146+0000","last_active":"2024-09-21T07:30:45.131228+0000","last_peered":"2024-09-21T07:30:45.131228+0000","last_clean":"2024-09-21T07:30:45.131228+0000","last_became_active":"2024-09-21T07:30:43.128816+0000","last_became_peered":"2024-09-21T07:30:43.128816+0000","last_unstale":"2024-09-21T07:30:45.131228+0000","last_undegraded":"2024-09-21T07:30:45.131228+0000","last_fullsized":"2024-09-21T07:30:45.131228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:58.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338425+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:30:45.338425+0000","last_peered":"2024-09-21T07:30:45.338425+0000","last_clean":"2024-09-21T07:30:45.338425+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:30:45.338425+0000","last_undegraded":"2024-09-21T07:30:45.338425+0000","last_fullsized":"2024-09-21T07:30:45.338425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28616,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343224,"statfs":{"total":96636764160,"available":96607461376,"internally_reserved":0,"allocated":1626112,"data_stored":765247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":1630208,"data_stored":764825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1634304,"data_stored":766277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509542,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1622016,"data_stored":764665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1626112,"data_stored":764687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47248,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324592,"statfs":{"total":96636764160,"available":96588382208,"internally_reserved":0,"allocated":2220032,"data_stored":1355055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41692,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330148,"statfs":{"total":96636764160,"available":96594071552,"internally_reserved":0,"allocated":2232320,"data_stored":1355809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1638400,"data_stored":766311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:30:53.103 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:30:53.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 -- 172.21.15.64:0/4040761261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 msgr2=0x7f5e100052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 --2- 172.21.15.64:0/4040761261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e100052b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400afd0 tx=0x7f5e2401f520 comp rx=0 tx=0).stop 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e2b400640 1 -- 172.21.15.64:0/4040761261 reap_dead start 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 -- 172.21.15.64:0/4040761261 shutdown_connections 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 -- 172.21.15.64:0/4040761261 >> 172.21.15.64:0/4040761261 conn(0x7f5e2c0ccbe0 msgr2=0x7f5e2c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 -- 172.21.15.64:0/4040761261 shutdown_connections 2024-09-21T07:30:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.274+0000 7f5e31e00640 1 -- 172.21.15.64:0/4040761261 wait complete. 2024-09-21T07:30:53.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 Processor -- start 2024-09-21T07:30:53.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- start start 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c1eb270 0x7f5e2c1f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 0x7f5e2c1f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0cbcc0 con 0x7f5e10004de0 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0cbb40 con 0x7f5e2c1eb270 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c0cbe40 con 0x7f5e2c1f8b80 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55656/0 (socket says 172.21.15.64:55656) 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 -- 172.21.15.64:0/3191743044 learned_addr learned my addr 172.21.15.64:0/3191743044 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e23e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c1eb270 0x7f5e2c1f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2b400640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 0x7f5e2c1f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 -- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 msgr2=0x7f5e2c1f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 0x7f5e2c1f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 -- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c1eb270 msgr2=0x7f5e2c1f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c1eb270 0x7f5e2c1f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 -- 172.21.15.64:0/3191743044 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0ae700 con 0x7f5e10004de0 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2b400640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 0x7f5e2c1f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e2aa00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003e80 tx=0x7f5e1c001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c015070 con 0x7f5e10004de0 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e1c011940 con 0x7f5e10004de0 2024-09-21T07:30:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c0ae9e0 con 0x7f5e10004de0 2024-09-21T07:30:53.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c011d90 con 0x7f5e10004de0 2024-09-21T07:30:53.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.278+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c0aecc0 con 0x7f5e10004de0 2024-09-21T07:30:53.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c0cb430 con 0x7f5e10004de0 2024-09-21T07:30:53.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5e1c018070 con 0x7f5e10004de0 2024-09-21T07:30:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e23400640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 0x7f5e08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f5e1c095220 con 0x7f5e10004de0 2024-09-21T07:30:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e23e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 0x7f5e08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.282+0000 7f5e23e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 0x7f5e08075710 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0b1360 tx=0x7f5e14001120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:53.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.286+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5e1c05f940 con 0x7f5e10004de0 2024-09-21T07:30:53.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.462+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e2c073640 con 0x7f5e08073200 2024-09-21T07:30:53.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e23400640 1 -- 172.21.15.64:0/3191743044 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252465 (secure 0 0 0) 0x7f5e2c073640 con 0x7f5e08073200 2024-09-21T07:30:53.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:53.472 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:30:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 msgr2=0x7f5e08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 0x7f5e08075710 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0b1360 tx=0x7f5e14001120 comp rx=0 tx=0).stop 2024-09-21T07:30:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 msgr2=0x7f5e2c157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003e80 tx=0x7f5e1c001810 comp rx=0 tx=0).stop 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 shutdown_connections 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e08073200 0x7f5e08075710 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5e2c1f8b80 0x7f5e2c1f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c1eb270 0x7f5e2c1f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 --2- 172.21.15.64:0/3191743044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e10004de0 0x7f5e2c157430 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 >> 172.21.15.64:0/3191743044 conn(0x7f5e2c0ccbe0 msgr2=0x7f5e2c15a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 shutdown_connections 2024-09-21T07:30:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.470+0000 7f5e31e00640 1 -- 172.21.15.64:0/3191743044 wait complete. 2024-09-21T07:30:53.494 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-21T07:30:51.554537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":367552,"kb_used_data":13896,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754607168,"statfs":{"total":773094113280,"available":772717740032,"internally_reserved":0,"allocated":14229504,"data_stored":7302876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001889"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339094+0000","last_change":"2024-09-21T07:30:44.151528+0000","last_active":"2024-09-21T07:30:45.339094+0000","last_peered":"2024-09-21T07:30:45.339094+0000","last_clean":"2024-09-21T07:30:45.339094+0000","last_became_active":"2024-09-21T07:30:44.151210+0000","last_became_peered":"2024-09-21T07:30:44.151210+0000","last_unstale":"2024-09-21T07:30:45.339094+0000","last_undegraded":"2024-09-21T07:30:45.339094+0000","last_fullsized":"2024-09-21T07:30:45.339094+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:47.066767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333522+0000","last_change":"2024-09-21T07:30:44.171380+0000","last_active":"2024-09-21T07:30:45.333522+0000","last_peered":"2024-09-21T07:30:45.333522+0000","last_clean":"2024-09-21T07:30:45.333522+0000","last_became_active":"2024-09-21T07:30:44.170753+0000","last_became_peered":"2024-09-21T07:30:44.170753+0000","last_unstale":"2024-09-21T07:30:45.333522+0000","last_undegraded":"2024-09-21T07:30:45.333522+0000","last_fullsized":"2024-09-21T07:30:45.333522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:14.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334560+0000","last_change":"2024-09-21T07:30:44.167425+0000","last_active":"2024-09-21T07:30:45.334560+0000","last_peered":"2024-09-21T07:30:45.334560+0000","last_clean":"2024-09-21T07:30:45.334560+0000","last_became_active":"2024-09-21T07:30:44.166377+0000","last_became_peered":"2024-09-21T07:30:44.166377+0000","last_unstale":"2024-09-21T07:30:45.334560+0000","last_undegraded":"2024-09-21T07:30:45.334560+0000","last_fullsized":"2024-09-21T07:30:45.334560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:53.872339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339251+0000","last_change":"2024-09-21T07:30:44.155212+0000","last_active":"2024-09-21T07:30:45.339251+0000","last_peered":"2024-09-21T07:30:45.339251+0000","last_clean":"2024-09-21T07:30:45.339251+0000","last_became_active":"2024-09-21T07:30:44.154732+0000","last_became_peered":"2024-09-21T07:30:44.154732+0000","last_unstale":"2024-09-21T07:30:45.339251+0000","last_undegraded":"2024-09-21T07:30:45.339251+0000","last_fullsized":"2024-09-21T07:30:45.339251+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:59.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337975+0000","last_change":"2024-09-21T07:30:44.135844+0000","last_active":"2024-09-21T07:30:45.337975+0000","last_peered":"2024-09-21T07:30:45.337975+0000","last_clean":"2024-09-21T07:30:45.337975+0000","last_became_active":"2024-09-21T07:30:44.135515+0000","last_became_peered":"2024-09-21T07:30:44.135515+0000","last_unstale":"2024-09-21T07:30:45.337975+0000","last_undegraded":"2024-09-21T07:30:45.337975+0000","last_fullsized":"2024-09-21T07:30:45.337975+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:55.302248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338763+0000","last_change":"2024-09-21T07:30:44.167837+0000","last_active":"2024-09-21T07:30:45.338763+0000","last_peered":"2024-09-21T07:30:45.338763+0000","last_clean":"2024-09-21T07:30:45.338763+0000","last_became_active":"2024-09-21T07:30:44.167469+0000","last_became_peered":"2024-09-21T07:30:44.167469+0000","last_unstale":"2024-09-21T07:30:45.338763+0000","last_undegraded":"2024-09-21T07:30:45.338763+0000","last_fullsized":"2024-09-21T07:30:45.338763+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:14.150818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338402+0000","last_change":"2024-09-21T07:30:44.155878+0000","last_active":"2024-09-21T07:30:45.338402+0000","last_peered":"2024-09-21T07:30:45.338402+0000","last_clean":"2024-09-21T07:30:45.338402+0000","last_became_active":"2024-09-21T07:30:44.155555+0000","last_became_peered":"2024-09-21T07:30:44.155555+0000","last_unstale":"2024-09-21T07:30:45.338402+0000","last_undegraded":"2024-09-21T07:30:45.338402+0000","last_fullsized":"2024-09-21T07:30:45.338402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:31.088595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131087+0000","last_change":"2024-09-21T07:30:44.169122+0000","last_active":"2024-09-21T07:30:45.131087+0000","last_peered":"2024-09-21T07:30:45.131087+0000","last_clean":"2024-09-21T07:30:45.131087+0000","last_became_active":"2024-09-21T07:30:44.168827+0000","last_became_peered":"2024-09-21T07:30:44.168827+0000","last_unstale":"2024-09-21T07:30:45.131087+0000","last_undegraded":"2024-09-21T07:30:45.131087+0000","last_fullsized":"2024-09-21T07:30:45.131087+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.361691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339544+0000","last_change":"2024-09-21T07:30:44.170676+0000","last_active":"2024-09-21T07:30:45.339544+0000","last_peered":"2024-09-21T07:30:45.339544+0000","last_clean":"2024-09-21T07:30:45.339544+0000","last_became_active":"2024-09-21T07:30:44.170330+0000","last_became_peered":"2024-09-21T07:30:44.170330+0000","last_unstale":"2024-09-21T07:30:45.339544+0000","last_undegraded":"2024-09-21T07:30:45.339544+0000","last_fullsized":"2024-09-21T07:30:45.339544+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340513+0000","last_change":"2024-09-21T07:30:44.164416+0000","last_active":"2024-09-21T07:30:45.340513+0000","last_peered":"2024-09-21T07:30:45.340513+0000","last_clean":"2024-09-21T07:30:45.340513+0000","last_became_active":"2024-09-21T07:30:44.163747+0000","last_became_peered":"2024-09-21T07:30:44.163747+0000","last_unstale":"2024-09-21T07:30:45.340513+0000","last_undegraded":"2024-09-21T07:30:45.340513+0000","last_fullsized":"2024-09-21T07:30:45.340513+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:20.607808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338245+0000","last_change":"2024-09-21T07:30:44.146959+0000","last_active":"2024-09-21T07:30:45.338245+0000","last_peered":"2024-09-21T07:30:45.338245+0000","last_clean":"2024-09-21T07:30:45.338245+0000","last_became_active":"2024-09-21T07:30:44.146332+0000","last_became_peered":"2024-09-21T07:30:44.146332+0000","last_unstale":"2024-09-21T07:30:45.338245+0000","last_undegraded":"2024-09-21T07:30:45.338245+0000","last_fullsized":"2024-09-21T07:30:45.338245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:12.322756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341854+0000","last_change":"2024-09-21T07:30:44.139815+0000","last_active":"2024-09-21T07:30:45.341854+0000","last_peered":"2024-09-21T07:30:45.341854+0000","last_clean":"2024-09-21T07:30:45.341854+0000","last_became_active":"2024-09-21T07:30:44.139490+0000","last_became_peered":"2024-09-21T07:30:44.139490+0000","last_unstale":"2024-09-21T07:30:45.341854+0000","last_undegraded":"2024-09-21T07:30:45.341854+0000","last_fullsized":"2024-09-21T07:30:45.341854+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:15.000262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339399+0000","last_change":"2024-09-21T07:30:44.146637+0000","last_active":"2024-09-21T07:30:45.339399+0000","last_peered":"2024-09-21T07:30:45.339399+0000","last_clean":"2024-09-21T07:30:45.339399+0000","last_became_active":"2024-09-21T07:30:44.146304+0000","last_became_peered":"2024-09-21T07:30:44.146304+0000","last_unstale":"2024-09-21T07:30:45.339399+0000","last_undegraded":"2024-09-21T07:30:45.339399+0000","last_fullsized":"2024-09-21T07:30:45.339399+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.642332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131186+0000","last_change":"2024-09-21T07:30:44.169611+0000","last_active":"2024-09-21T07:30:45.131186+0000","last_peered":"2024-09-21T07:30:45.131186+0000","last_clean":"2024-09-21T07:30:45.131186+0000","last_became_active":"2024-09-21T07:30:44.169276+0000","last_became_peered":"2024-09-21T07:30:44.169276+0000","last_unstale":"2024-09-21T07:30:45.131186+0000","last_undegraded":"2024-09-21T07:30:45.131186+0000","last_fullsized":"2024-09-21T07:30:45.131186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:16.272379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337803+0000","last_change":"2024-09-21T07:30:44.147656+0000","last_active":"2024-09-21T07:30:45.337803+0000","last_peered":"2024-09-21T07:30:45.337803+0000","last_clean":"2024-09-21T07:30:45.337803+0000","last_became_active":"2024-09-21T07:30:44.146110+0000","last_became_peered":"2024-09-21T07:30:44.146110+0000","last_unstale":"2024-09-21T07:30:45.337803+0000","last_undegraded":"2024-09-21T07:30:45.337803+0000","last_fullsized":"2024-09-21T07:30:45.337803+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:34.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338419+0000","last_change":"2024-09-21T07:30:44.163189+0000","last_active":"2024-09-21T07:30:45.338419+0000","last_peered":"2024-09-21T07:30:45.338419+0000","last_clean":"2024-09-21T07:30:45.338419+0000","last_became_active":"2024-09-21T07:30:44.162691+0000","last_became_peered":"2024-09-21T07:30:44.162691+0000","last_unstale":"2024-09-21T07:30:45.338419+0000","last_undegraded":"2024-09-21T07:30:45.338419+0000","last_fullsized":"2024-09-21T07:30:45.338419+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:44.419732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340547+0000","last_change":"2024-09-21T07:30:44.149964+0000","last_active":"2024-09-21T07:30:45.340547+0000","last_peered":"2024-09-21T07:30:45.340547+0000","last_clean":"2024-09-21T07:30:45.340547+0000","last_became_active":"2024-09-21T07:30:44.149539+0000","last_became_peered":"2024-09-21T07:30:44.149539+0000","last_unstale":"2024-09-21T07:30:45.340547+0000","last_undegraded":"2024-09-21T07:30:45.340547+0000","last_fullsized":"2024-09-21T07:30:45.340547+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:05.578044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334848+0000","last_change":"2024-09-21T07:30:44.171079+0000","last_active":"2024-09-21T07:30:45.334848+0000","last_peered":"2024-09-21T07:30:45.334848+0000","last_clean":"2024-09-21T07:30:45.334848+0000","last_became_active":"2024-09-21T07:30:44.170634+0000","last_became_peered":"2024-09-21T07:30:44.170634+0000","last_unstale":"2024-09-21T07:30:45.334848+0000","last_undegraded":"2024-09-21T07:30:45.334848+0000","last_fullsized":"2024-09-21T07:30:45.334848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.413012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132946+0000","last_change":"2024-09-21T07:30:44.151756+0000","last_active":"2024-09-21T07:30:45.132946+0000","last_peered":"2024-09-21T07:30:45.132946+0000","last_clean":"2024-09-21T07:30:45.132946+0000","last_became_active":"2024-09-21T07:30:44.151385+0000","last_became_peered":"2024-09-21T07:30:44.151385+0000","last_unstale":"2024-09-21T07:30:45.132946+0000","last_undegraded":"2024-09-21T07:30:45.132946+0000","last_fullsized":"2024-09-21T07:30:45.132946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:17.935718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339627+0000","last_change":"2024-09-21T07:30:44.169887+0000","last_active":"2024-09-21T07:30:45.339627+0000","last_peered":"2024-09-21T07:30:45.339627+0000","last_clean":"2024-09-21T07:30:45.339627+0000","last_became_active":"2024-09-21T07:30:44.169517+0000","last_became_peered":"2024-09-21T07:30:44.169517+0000","last_unstale":"2024-09-21T07:30:45.339627+0000","last_undegraded":"2024-09-21T07:30:45.339627+0000","last_fullsized":"2024-09-21T07:30:45.339627+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:09.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338952+0000","last_change":"2024-09-21T07:30:44.161541+0000","last_active":"2024-09-21T07:30:45.338952+0000","last_peered":"2024-09-21T07:30:45.338952+0000","last_clean":"2024-09-21T07:30:45.338952+0000","last_became_active":"2024-09-21T07:30:44.158258+0000","last_became_peered":"2024-09-21T07:30:44.158258+0000","last_unstale":"2024-09-21T07:30:45.338952+0000","last_undegraded":"2024-09-21T07:30:45.338952+0000","last_fullsized":"2024-09-21T07:30:45.338952+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.709605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338073+0000","last_change":"2024-09-21T07:30:44.160404+0000","last_active":"2024-09-21T07:30:45.338073+0000","last_peered":"2024-09-21T07:30:45.338073+0000","last_clean":"2024-09-21T07:30:45.338073+0000","last_became_active":"2024-09-21T07:30:44.160094+0000","last_became_peered":"2024-09-21T07:30:44.160094+0000","last_unstale":"2024-09-21T07:30:45.338073+0000","last_undegraded":"2024-09-21T07:30:45.338073+0000","last_fullsized":"2024-09-21T07:30:45.338073+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:06.187588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338866+0000","last_change":"2024-09-21T07:30:44.171001+0000","last_active":"2024-09-21T07:30:45.338866+0000","last_peered":"2024-09-21T07:30:45.338866+0000","last_clean":"2024-09-21T07:30:45.338866+0000","last_became_active":"2024-09-21T07:30:44.170412+0000","last_became_peered":"2024-09-21T07:30:44.170412+0000","last_unstale":"2024-09-21T07:30:45.338866+0000","last_undegraded":"2024-09-21T07:30:45.338866+0000","last_fullsized":"2024-09-21T07:30:45.338866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:29.547247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131480+0000","last_change":"2024-09-21T07:30:44.149803+0000","last_active":"2024-09-21T07:30:45.131480+0000","last_peered":"2024-09-21T07:30:45.131480+0000","last_clean":"2024-09-21T07:30:45.131480+0000","last_became_active":"2024-09-21T07:30:44.149474+0000","last_became_peered":"2024-09-21T07:30:44.149474+0000","last_unstale":"2024-09-21T07:30:45.131480+0000","last_undegraded":"2024-09-21T07:30:45.131480+0000","last_fullsized":"2024-09-21T07:30:45.131480+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:59.003094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133046+0000","last_change":"2024-09-21T07:30:44.145340+0000","last_active":"2024-09-21T07:30:45.133046+0000","last_peered":"2024-09-21T07:30:45.133046+0000","last_clean":"2024-09-21T07:30:45.133046+0000","last_became_active":"2024-09-21T07:30:44.145041+0000","last_became_peered":"2024-09-21T07:30:44.145041+0000","last_unstale":"2024-09-21T07:30:45.133046+0000","last_undegraded":"2024-09-21T07:30:45.133046+0000","last_fullsized":"2024-09-21T07:30:45.133046+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:09.925320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341120+0000","last_change":"2024-09-21T07:30:44.152489+0000","last_active":"2024-09-21T07:30:45.341120+0000","last_peered":"2024-09-21T07:30:45.341120+0000","last_clean":"2024-09-21T07:30:45.341120+0000","last_became_active":"2024-09-21T07:30:44.152075+0000","last_became_peered":"2024-09-21T07:30:44.152075+0000","last_unstale":"2024-09-21T07:30:45.341120+0000","last_undegraded":"2024-09-21T07:30:45.341120+0000","last_fullsized":"2024-09-21T07:30:45.341120+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.146961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133018+0000","last_change":"2024-09-21T07:30:44.145833+0000","last_active":"2024-09-21T07:30:45.133018+0000","last_peered":"2024-09-21T07:30:45.133018+0000","last_clean":"2024-09-21T07:30:45.133018+0000","last_became_active":"2024-09-21T07:30:44.143963+0000","last_became_peered":"2024-09-21T07:30:44.143963+0000","last_unstale":"2024-09-21T07:30:45.133018+0000","last_undegraded":"2024-09-21T07:30:45.133018+0000","last_fullsized":"2024-09-21T07:30:45.133018+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:32.249044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341398+0000","last_change":"2024-09-21T07:30:44.161764+0000","last_active":"2024-09-21T07:30:45.341398+0000","last_peered":"2024-09-21T07:30:45.341398+0000","last_clean":"2024-09-21T07:30:45.341398+0000","last_became_active":"2024-09-21T07:30:44.154298+0000","last_became_peered":"2024-09-21T07:30:44.154298+0000","last_unstale":"2024-09-21T07:30:45.341398+0000","last_undegraded":"2024-09-21T07:30:45.341398+0000","last_fullsized":"2024-09-21T07:30:45.341398+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:56.501033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340024+0000","last_change":"2024-09-21T07:30:44.158818+0000","last_active":"2024-09-21T07:30:45.340024+0000","last_peered":"2024-09-21T07:30:45.340024+0000","last_clean":"2024-09-21T07:30:45.340024+0000","last_became_active":"2024-09-21T07:30:44.158484+0000","last_became_peered":"2024-09-21T07:30:44.158484+0000","last_unstale":"2024-09-21T07:30:45.340024+0000","last_undegraded":"2024-09-21T07:30:45.340024+0000","last_fullsized":"2024-09-21T07:30:45.340024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:09.216358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131266+0000","last_change":"2024-09-21T07:30:44.158437+0000","last_active":"2024-09-21T07:30:45.131266+0000","last_peered":"2024-09-21T07:30:45.131266+0000","last_clean":"2024-09-21T07:30:45.131266+0000","last_became_active":"2024-09-21T07:30:44.157277+0000","last_became_peered":"2024-09-21T07:30:44.157277+0000","last_unstale":"2024-09-21T07:30:45.131266+0000","last_undegraded":"2024-09-21T07:30:45.131266+0000","last_fullsized":"2024-09-21T07:30:45.131266+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:19.353180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131721+0000","last_change":"2024-09-21T07:30:44.154314+0000","last_active":"2024-09-21T07:30:45.131721+0000","last_peered":"2024-09-21T07:30:45.131721+0000","last_clean":"2024-09-21T07:30:45.131721+0000","last_became_active":"2024-09-21T07:30:44.152584+0000","last_became_peered":"2024-09-21T07:30:44.152584+0000","last_unstale":"2024-09-21T07:30:45.131721+0000","last_undegraded":"2024-09-21T07:30:45.131721+0000","last_fullsized":"2024-09-21T07:30:45.131721+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:23.142291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131638+0000","last_change":"2024-09-21T07:30:44.145302+0000","last_active":"2024-09-21T07:30:45.131638+0000","last_peered":"2024-09-21T07:30:45.131638+0000","last_clean":"2024-09-21T07:30:45.131638+0000","last_became_active":"2024-09-21T07:30:44.144183+0000","last_became_peered":"2024-09-21T07:30:44.144183+0000","last_unstale":"2024-09-21T07:30:45.131638+0000","last_undegraded":"2024-09-21T07:30:45.131638+0000","last_fullsized":"2024-09-21T07:30:45.131638+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:10.576763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340206+0000","last_change":"2024-09-21T07:30:44.164671+0000","last_active":"2024-09-21T07:30:45.340206+0000","last_peered":"2024-09-21T07:30:45.340206+0000","last_clean":"2024-09-21T07:30:45.340206+0000","last_became_active":"2024-09-21T07:30:44.164018+0000","last_became_peered":"2024-09-21T07:30:44.164018+0000","last_unstale":"2024-09-21T07:30:45.340206+0000","last_undegraded":"2024-09-21T07:30:45.340206+0000","last_fullsized":"2024-09-21T07:30:45.340206+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:15.470926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"130'4","reported_seq":19,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132201+0000","last_change":"2024-09-21T07:30:43.136660+0000","last_active":"2024-09-21T07:30:45.132201+0000","last_peered":"2024-09-21T07:30:45.132201+0000","last_clean":"2024-09-21T07:30:45.132201+0000","last_became_active":"2024-09-21T07:30:43.136292+0000","last_became_peered":"2024-09-21T07:30:43.136292+0000","last_unstale":"2024-09-21T07:30:45.132201+0000","last_undegraded":"2024-09-21T07:30:45.132201+0000","last_fullsized":"2024-09-21T07:30:45.132201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:39.197667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340831+0000","last_change":"2024-09-21T07:30:44.164705+0000","last_active":"2024-09-21T07:30:45.340831+0000","last_peered":"2024-09-21T07:30:45.340831+0000","last_clean":"2024-09-21T07:30:45.340831+0000","last_became_active":"2024-09-21T07:30:44.164399+0000","last_became_peered":"2024-09-21T07:30:44.164399+0000","last_unstale":"2024-09-21T07:30:45.340831+0000","last_undegraded":"2024-09-21T07:30:45.340831+0000","last_fullsized":"2024-09-21T07:30:45.340831+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:14.364393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340401+0000","last_change":"2024-09-21T07:30:43.132464+0000","last_active":"2024-09-21T07:30:45.340401+0000","last_peered":"2024-09-21T07:30:45.340401+0000","last_clean":"2024-09-21T07:30:45.340401+0000","last_became_active":"2024-09-21T07:30:43.132142+0000","last_became_peered":"2024-09-21T07:30:43.132142+0000","last_unstale":"2024-09-21T07:30:45.340401+0000","last_undegraded":"2024-09-21T07:30:45.340401+0000","last_fullsized":"2024-09-21T07:30:45.340401+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:00.715406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132114+0000","last_change":"2024-09-21T07:30:44.155730+0000","last_active":"2024-09-21T07:30:45.132114+0000","last_peered":"2024-09-21T07:30:45.132114+0000","last_clean":"2024-09-21T07:30:45.132114+0000","last_became_active":"2024-09-21T07:30:44.155396+0000","last_became_peered":"2024-09-21T07:30:44.155396+0000","last_unstale":"2024-09-21T07:30:45.132114+0000","last_undegraded":"2024-09-21T07:30:45.132114+0000","last_fullsized":"2024-09-21T07:30:45.132114+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:11.845575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338779+0000","last_change":"2024-09-21T07:30:43.138630+0000","last_active":"2024-09-21T07:30:45.338779+0000","last_peered":"2024-09-21T07:30:45.338779+0000","last_clean":"2024-09-21T07:30:45.338779+0000","last_became_active":"2024-09-21T07:30:43.138290+0000","last_became_peered":"2024-09-21T07:30:43.138290+0000","last_unstale":"2024-09-21T07:30:45.338779+0000","last_undegraded":"2024-09-21T07:30:45.338779+0000","last_fullsized":"2024-09-21T07:30:45.338779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:06.977356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339588+0000","last_change":"2024-09-21T07:30:44.166923+0000","last_active":"2024-09-21T07:30:45.339588+0000","last_peered":"2024-09-21T07:30:45.339588+0000","last_clean":"2024-09-21T07:30:45.339588+0000","last_became_active":"2024-09-21T07:30:44.166577+0000","last_became_peered":"2024-09-21T07:30:44.166577+0000","last_unstale":"2024-09-21T07:30:45.339588+0000","last_undegraded":"2024-09-21T07:30:45.339588+0000","last_fullsized":"2024-09-21T07:30:45.339588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340282+0000","last_change":"2024-09-21T07:30:43.139910+0000","last_active":"2024-09-21T07:30:45.340282+0000","last_peered":"2024-09-21T07:30:45.340282+0000","last_clean":"2024-09-21T07:30:45.340282+0000","last_became_active":"2024-09-21T07:30:43.139549+0000","last_became_peered":"2024-09-21T07:30:43.139549+0000","last_unstale":"2024-09-21T07:30:45.340282+0000","last_undegraded":"2024-09-21T07:30:45.340282+0000","last_fullsized":"2024-09-21T07:30:45.340282+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:30.128764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338253+0000","last_change":"2024-09-21T07:30:44.151122+0000","last_active":"2024-09-21T07:30:45.338253+0000","last_peered":"2024-09-21T07:30:45.338253+0000","last_clean":"2024-09-21T07:30:45.338253+0000","last_became_active":"2024-09-21T07:30:44.150778+0000","last_became_peered":"2024-09-21T07:30:44.150778+0000","last_unstale":"2024-09-21T07:30:45.338253+0000","last_undegraded":"2024-09-21T07:30:45.338253+0000","last_fullsized":"2024-09-21T07:30:45.338253+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:11.596404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338035+0000","last_change":"2024-09-21T07:30:43.127619+0000","last_active":"2024-09-21T07:30:45.338035+0000","last_peered":"2024-09-21T07:30:45.338035+0000","last_clean":"2024-09-21T07:30:45.338035+0000","last_became_active":"2024-09-21T07:30:43.127311+0000","last_became_peered":"2024-09-21T07:30:43.127311+0000","last_unstale":"2024-09-21T07:30:45.338035+0000","last_undegraded":"2024-09-21T07:30:45.338035+0000","last_fullsized":"2024-09-21T07:30:45.338035+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:47.708022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.337963+0000","last_change":"2024-09-21T07:30:44.145536+0000","last_active":"2024-09-21T07:30:45.337963+0000","last_peered":"2024-09-21T07:30:45.337963+0000","last_clean":"2024-09-21T07:30:45.337963+0000","last_became_active":"2024-09-21T07:30:44.145047+0000","last_became_peered":"2024-09-21T07:30:44.145047+0000","last_unstale":"2024-09-21T07:30:45.337963+0000","last_undegraded":"2024-09-21T07:30:45.337963+0000","last_fullsized":"2024-09-21T07:30:45.337963+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:47.034088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338935+0000","last_change":"2024-09-21T07:30:43.136855+0000","last_active":"2024-09-21T07:30:45.338935+0000","last_peered":"2024-09-21T07:30:45.338935+0000","last_clean":"2024-09-21T07:30:45.338935+0000","last_became_active":"2024-09-21T07:30:43.136423+0000","last_became_peered":"2024-09-21T07:30:43.136423+0000","last_unstale":"2024-09-21T07:30:45.338935+0000","last_undegraded":"2024-09-21T07:30:45.338935+0000","last_fullsized":"2024-09-21T07:30:45.338935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:32.128337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333718+0000","last_change":"2024-09-21T07:30:44.158316+0000","last_active":"2024-09-21T07:30:45.333718+0000","last_peered":"2024-09-21T07:30:45.333718+0000","last_clean":"2024-09-21T07:30:45.333718+0000","last_became_active":"2024-09-21T07:30:44.156920+0000","last_became_peered":"2024-09-21T07:30:44.156920+0000","last_unstale":"2024-09-21T07:30:45.333718+0000","last_undegraded":"2024-09-21T07:30:45.333718+0000","last_fullsized":"2024-09-21T07:30:45.333718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:30.147727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131582+0000","last_change":"2024-09-21T07:30:43.134190+0000","last_active":"2024-09-21T07:30:45.131582+0000","last_peered":"2024-09-21T07:30:45.131582+0000","last_clean":"2024-09-21T07:30:45.131582+0000","last_became_active":"2024-09-21T07:30:43.133884+0000","last_became_peered":"2024-09-21T07:30:43.133884+0000","last_unstale":"2024-09-21T07:30:45.131582+0000","last_undegraded":"2024-09-21T07:30:45.131582+0000","last_fullsized":"2024-09-21T07:30:45.131582+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:41.645820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339501+0000","last_change":"2024-09-21T07:30:44.157655+0000","last_active":"2024-09-21T07:30:45.339501+0000","last_peered":"2024-09-21T07:30:45.339501+0000","last_clean":"2024-09-21T07:30:45.339501+0000","last_became_active":"2024-09-21T07:30:44.157257+0000","last_became_peered":"2024-09-21T07:30:44.157257+0000","last_unstale":"2024-09-21T07:30:45.339501+0000","last_undegraded":"2024-09-21T07:30:45.339501+0000","last_fullsized":"2024-09-21T07:30:45.339501+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:01.312867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338762+0000","last_change":"2024-09-21T07:30:43.140924+0000","last_active":"2024-09-21T07:30:45.338762+0000","last_peered":"2024-09-21T07:30:45.338762+0000","last_clean":"2024-09-21T07:30:45.338762+0000","last_became_active":"2024-09-21T07:30:43.140589+0000","last_became_peered":"2024-09-21T07:30:43.140589+0000","last_unstale":"2024-09-21T07:30:45.338762+0000","last_undegraded":"2024-09-21T07:30:45.338762+0000","last_fullsized":"2024-09-21T07:30:45.338762+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.262601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132090+0000","last_change":"2024-09-21T07:30:44.143957+0000","last_active":"2024-09-21T07:30:45.132090+0000","last_peered":"2024-09-21T07:30:45.132090+0000","last_clean":"2024-09-21T07:30:45.132090+0000","last_became_active":"2024-09-21T07:30:44.143653+0000","last_became_peered":"2024-09-21T07:30:44.143653+0000","last_unstale":"2024-09-21T07:30:45.132090+0000","last_undegraded":"2024-09-21T07:30:45.132090+0000","last_fullsized":"2024-09-21T07:30:45.132090+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:04.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132305+0000","last_change":"2024-09-21T07:30:43.143624+0000","last_active":"2024-09-21T07:30:45.132305+0000","last_peered":"2024-09-21T07:30:45.132305+0000","last_clean":"2024-09-21T07:30:45.132305+0000","last_became_active":"2024-09-21T07:30:43.143348+0000","last_became_peered":"2024-09-21T07:30:43.143348+0000","last_unstale":"2024-09-21T07:30:45.132305+0000","last_undegraded":"2024-09-21T07:30:45.132305+0000","last_fullsized":"2024-09-21T07:30:45.132305+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:37.389634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132342+0000","last_change":"2024-09-21T07:30:44.162205+0000","last_active":"2024-09-21T07:30:45.132342+0000","last_peered":"2024-09-21T07:30:45.132342+0000","last_clean":"2024-09-21T07:30:45.132342+0000","last_became_active":"2024-09-21T07:30:44.161831+0000","last_became_peered":"2024-09-21T07:30:44.161831+0000","last_unstale":"2024-09-21T07:30:45.132342+0000","last_undegraded":"2024-09-21T07:30:45.132342+0000","last_fullsized":"2024-09-21T07:30:45.132342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:04.930405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132590+0000","last_change":"2024-09-21T07:30:43.120286+0000","last_active":"2024-09-21T07:30:45.132590+0000","last_peered":"2024-09-21T07:30:45.132590+0000","last_clean":"2024-09-21T07:30:45.132590+0000","last_became_active":"2024-09-21T07:30:43.119954+0000","last_became_peered":"2024-09-21T07:30:43.119954+0000","last_unstale":"2024-09-21T07:30:45.132590+0000","last_undegraded":"2024-09-21T07:30:45.132590+0000","last_fullsized":"2024-09-21T07:30:45.132590+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:02.355617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335067+0000","last_change":"2024-09-21T07:30:44.170956+0000","last_active":"2024-09-21T07:30:45.335067+0000","last_peered":"2024-09-21T07:30:45.335067+0000","last_clean":"2024-09-21T07:30:45.335067+0000","last_became_active":"2024-09-21T07:30:44.170229+0000","last_became_peered":"2024-09-21T07:30:44.170229+0000","last_unstale":"2024-09-21T07:30:45.335067+0000","last_undegraded":"2024-09-21T07:30:45.335067+0000","last_fullsized":"2024-09-21T07:30:45.335067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:53.117607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"130'3","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132374+0000","last_change":"2024-09-21T07:30:43.126259+0000","last_active":"2024-09-21T07:30:45.132374+0000","last_peered":"2024-09-21T07:30:45.132374+0000","last_clean":"2024-09-21T07:30:45.132374+0000","last_became_active":"2024-09-21T07:30:43.125061+0000","last_became_peered":"2024-09-21T07:30:43.125061+0000","last_unstale":"2024-09-21T07:30:45.132374+0000","last_undegraded":"2024-09-21T07:30:45.132374+0000","last_fullsized":"2024-09-21T07:30:45.132374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:13.618288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133252+0000","last_change":"2024-09-21T07:30:44.147104+0000","last_active":"2024-09-21T07:30:45.133252+0000","last_peered":"2024-09-21T07:30:45.133252+0000","last_clean":"2024-09-21T07:30:45.133252+0000","last_became_active":"2024-09-21T07:30:44.146590+0000","last_became_peered":"2024-09-21T07:30:44.146590+0000","last_unstale":"2024-09-21T07:30:45.133252+0000","last_undegraded":"2024-09-21T07:30:45.133252+0000","last_fullsized":"2024-09-21T07:30:45.133252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:48.391796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"130'6","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131203+0000","last_change":"2024-09-21T07:30:43.121009+0000","last_active":"2024-09-21T07:30:45.131203+0000","last_peered":"2024-09-21T07:30:45.131203+0000","last_clean":"2024-09-21T07:30:45.131203+0000","last_became_active":"2024-09-21T07:30:43.120678+0000","last_became_peered":"2024-09-21T07:30:43.120678+0000","last_unstale":"2024-09-21T07:30:45.131203+0000","last_undegraded":"2024-09-21T07:30:45.131203+0000","last_fullsized":"2024-09-21T07:30:45.131203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.128293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133069+0000","last_change":"2024-09-21T07:30:44.160237+0000","last_active":"2024-09-21T07:30:45.133069+0000","last_peered":"2024-09-21T07:30:45.133069+0000","last_clean":"2024-09-21T07:30:45.133069+0000","last_became_active":"2024-09-21T07:30:44.159340+0000","last_became_peered":"2024-09-21T07:30:44.159340+0000","last_unstale":"2024-09-21T07:30:45.133069+0000","last_undegraded":"2024-09-21T07:30:45.133069+0000","last_fullsized":"2024-09-21T07:30:45.133069+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:31.365097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.335023+0000","last_change":"2024-09-21T07:30:43.133791+0000","last_active":"2024-09-21T07:30:45.335023+0000","last_peered":"2024-09-21T07:30:45.335023+0000","last_clean":"2024-09-21T07:30:45.335023+0000","last_became_active":"2024-09-21T07:30:43.133441+0000","last_became_peered":"2024-09-21T07:30:43.133441+0000","last_unstale":"2024-09-21T07:30:45.335023+0000","last_undegraded":"2024-09-21T07:30:45.335023+0000","last_fullsized":"2024-09-21T07:30:45.335023+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:06.475767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338688+0000","last_change":"2024-09-21T07:30:44.147896+0000","last_active":"2024-09-21T07:30:45.338688+0000","last_peered":"2024-09-21T07:30:45.338688+0000","last_clean":"2024-09-21T07:30:45.338688+0000","last_became_active":"2024-09-21T07:30:44.147572+0000","last_became_peered":"2024-09-21T07:30:44.147572+0000","last_unstale":"2024-09-21T07:30:45.338688+0000","last_undegraded":"2024-09-21T07:30:45.338688+0000","last_fullsized":"2024-09-21T07:30:45.338688+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:57.096276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.334102+0000","last_change":"2024-09-21T07:30:43.123257+0000","last_active":"2024-09-21T07:30:45.334102+0000","last_peered":"2024-09-21T07:30:45.334102+0000","last_clean":"2024-09-21T07:30:45.334102+0000","last_became_active":"2024-09-21T07:30:43.122875+0000","last_became_peered":"2024-09-21T07:30:43.122875+0000","last_unstale":"2024-09-21T07:30:45.334102+0000","last_undegraded":"2024-09-21T07:30:45.334102+0000","last_fullsized":"2024-09-21T07:30:45.334102+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:13.120467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338664+0000","last_change":"2024-09-21T07:30:44.154890+0000","last_active":"2024-09-21T07:30:45.338664+0000","last_peered":"2024-09-21T07:30:45.338664+0000","last_clean":"2024-09-21T07:30:45.338664+0000","last_became_active":"2024-09-21T07:30:44.154459+0000","last_became_peered":"2024-09-21T07:30:44.154459+0000","last_unstale":"2024-09-21T07:30:45.338664+0000","last_undegraded":"2024-09-21T07:30:45.338664+0000","last_fullsized":"2024-09-21T07:30:45.338664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:04.237559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131217+0000","last_change":"2024-09-21T07:30:43.123076+0000","last_active":"2024-09-21T07:30:45.131217+0000","last_peered":"2024-09-21T07:30:45.131217+0000","last_clean":"2024-09-21T07:30:45.131217+0000","last_became_active":"2024-09-21T07:30:43.122485+0000","last_became_peered":"2024-09-21T07:30:43.122485+0000","last_unstale":"2024-09-21T07:30:45.131217+0000","last_undegraded":"2024-09-21T07:30:45.131217+0000","last_fullsized":"2024-09-21T07:30:45.131217+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:46.303644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132074+0000","last_change":"2024-09-21T07:30:44.162942+0000","last_active":"2024-09-21T07:30:45.132074+0000","last_peered":"2024-09-21T07:30:45.132074+0000","last_clean":"2024-09-21T07:30:45.132074+0000","last_became_active":"2024-09-21T07:30:44.162615+0000","last_became_peered":"2024-09-21T07:30:44.162615+0000","last_unstale":"2024-09-21T07:30:45.132074+0000","last_undegraded":"2024-09-21T07:30:45.132074+0000","last_fullsized":"2024-09-21T07:30:45.132074+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:07.230091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340413+0000","last_change":"2024-09-21T07:30:43.144701+0000","last_active":"2024-09-21T07:30:45.340413+0000","last_peered":"2024-09-21T07:30:45.340413+0000","last_clean":"2024-09-21T07:30:45.340413+0000","last_became_active":"2024-09-21T07:30:43.144303+0000","last_became_peered":"2024-09-21T07:30:43.144303+0000","last_unstale":"2024-09-21T07:30:45.340413+0000","last_undegraded":"2024-09-21T07:30:45.340413+0000","last_fullsized":"2024-09-21T07:30:45.340413+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:21.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338502+0000","last_change":"2024-09-21T07:30:44.160262+0000","last_active":"2024-09-21T07:30:45.338502+0000","last_peered":"2024-09-21T07:30:45.338502+0000","last_clean":"2024-09-21T07:30:45.338502+0000","last_became_active":"2024-09-21T07:30:44.159904+0000","last_became_peered":"2024-09-21T07:30:44.159904+0000","last_unstale":"2024-09-21T07:30:45.338502+0000","last_undegraded":"2024-09-21T07:30:45.338502+0000","last_fullsized":"2024-09-21T07:30:45.338502+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.135711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341205+0000","last_change":"2024-09-21T07:30:43.140049+0000","last_active":"2024-09-21T07:30:45.341205+0000","last_peered":"2024-09-21T07:30:45.341205+0000","last_clean":"2024-09-21T07:30:45.341205+0000","last_became_active":"2024-09-21T07:30:43.139729+0000","last_became_peered":"2024-09-21T07:30:43.139729+0000","last_unstale":"2024-09-21T07:30:45.341205+0000","last_undegraded":"2024-09-21T07:30:45.341205+0000","last_fullsized":"2024-09-21T07:30:45.341205+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:35.291970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340843+0000","last_change":"2024-09-21T07:30:44.142720+0000","last_active":"2024-09-21T07:30:45.340843+0000","last_peered":"2024-09-21T07:30:45.340843+0000","last_clean":"2024-09-21T07:30:45.340843+0000","last_became_active":"2024-09-21T07:30:44.142289+0000","last_became_peered":"2024-09-21T07:30:44.142289+0000","last_unstale":"2024-09-21T07:30:45.340843+0000","last_undegraded":"2024-09-21T07:30:45.340843+0000","last_fullsized":"2024-09-21T07:30:45.340843+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:21.003423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"130'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338777+0000","last_change":"2024-09-21T07:30:43.138505+0000","last_active":"2024-09-21T07:30:45.338777+0000","last_peered":"2024-09-21T07:30:45.338777+0000","last_clean":"2024-09-21T07:30:45.338777+0000","last_became_active":"2024-09-21T07:30:43.138157+0000","last_became_peered":"2024-09-21T07:30:43.138157+0000","last_unstale":"2024-09-21T07:30:45.338777+0000","last_undegraded":"2024-09-21T07:30:45.338777+0000","last_fullsized":"2024-09-21T07:30:45.338777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:38.140550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133336+0000","last_change":"2024-09-21T07:30:44.152808+0000","last_active":"2024-09-21T07:30:45.133336+0000","last_peered":"2024-09-21T07:30:45.133336+0000","last_clean":"2024-09-21T07:30:45.133336+0000","last_became_active":"2024-09-21T07:30:44.151397+0000","last_became_peered":"2024-09-21T07:30:44.151397+0000","last_unstale":"2024-09-21T07:30:45.133336+0000","last_undegraded":"2024-09-21T07:30:45.133336+0000","last_fullsized":"2024-09-21T07:30:45.133336+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:19.646561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339406+0000","last_change":"2024-09-21T07:30:43.141221+0000","last_active":"2024-09-21T07:30:45.339406+0000","last_peered":"2024-09-21T07:30:45.339406+0000","last_clean":"2024-09-21T07:30:45.339406+0000","last_became_active":"2024-09-21T07:30:43.140734+0000","last_became_peered":"2024-09-21T07:30:43.140734+0000","last_unstale":"2024-09-21T07:30:45.339406+0000","last_undegraded":"2024-09-21T07:30:45.339406+0000","last_fullsized":"2024-09-21T07:30:45.339406+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.604283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338679+0000","last_change":"2024-09-21T07:30:44.138837+0000","last_active":"2024-09-21T07:30:45.338679+0000","last_peered":"2024-09-21T07:30:45.338679+0000","last_clean":"2024-09-21T07:30:45.338679+0000","last_became_active":"2024-09-21T07:30:44.138479+0000","last_became_peered":"2024-09-21T07:30:44.138479+0000","last_unstale":"2024-09-21T07:30:45.338679+0000","last_undegraded":"2024-09-21T07:30:45.338679+0000","last_fullsized":"2024-09-21T07:30:45.338679+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:27.512199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339044+0000","last_change":"2024-09-21T07:30:43.136160+0000","last_active":"2024-09-21T07:30:45.339044+0000","last_peered":"2024-09-21T07:30:45.339044+0000","last_clean":"2024-09-21T07:30:45.339044+0000","last_became_active":"2024-09-21T07:30:43.135818+0000","last_became_peered":"2024-09-21T07:30:43.135818+0000","last_unstale":"2024-09-21T07:30:45.339044+0000","last_undegraded":"2024-09-21T07:30:45.339044+0000","last_fullsized":"2024-09-21T07:30:45.339044+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:47.535799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131078+0000","last_change":"2024-09-21T07:30:44.163520+0000","last_active":"2024-09-21T07:30:45.131078+0000","last_peered":"2024-09-21T07:30:45.131078+0000","last_clean":"2024-09-21T07:30:45.131078+0000","last_became_active":"2024-09-21T07:30:44.163065+0000","last_became_peered":"2024-09-21T07:30:44.163065+0000","last_unstale":"2024-09-21T07:30:45.131078+0000","last_undegraded":"2024-09-21T07:30:45.131078+0000","last_fullsized":"2024-09-21T07:30:45.131078+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:00.121779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338601+0000","last_change":"2024-09-21T07:30:43.133964+0000","last_active":"2024-09-21T07:30:45.338601+0000","last_peered":"2024-09-21T07:30:45.338601+0000","last_clean":"2024-09-21T07:30:45.338601+0000","last_became_active":"2024-09-21T07:30:43.133538+0000","last_became_peered":"2024-09-21T07:30:43.133538+0000","last_unstale":"2024-09-21T07:30:45.338601+0000","last_undegraded":"2024-09-21T07:30:45.338601+0000","last_fullsized":"2024-09-21T07:30:45.338601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:45.540022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.333981+0000","last_change":"2024-09-21T07:30:44.167744+0000","last_active":"2024-09-21T07:30:45.333981+0000","last_peered":"2024-09-21T07:30:45.333981+0000","last_clean":"2024-09-21T07:30:45.333981+0000","last_became_active":"2024-09-21T07:30:44.167122+0000","last_became_peered":"2024-09-21T07:30:44.167122+0000","last_unstale":"2024-09-21T07:30:45.333981+0000","last_undegraded":"2024-09-21T07:30:45.333981+0000","last_fullsized":"2024-09-21T07:30:45.333981+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:05.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131289+0000","last_change":"2024-09-21T07:30:43.139312+0000","last_active":"2024-09-21T07:30:45.131289+0000","last_peered":"2024-09-21T07:30:45.131289+0000","last_clean":"2024-09-21T07:30:45.131289+0000","last_became_active":"2024-09-21T07:30:43.138937+0000","last_became_peered":"2024-09-21T07:30:43.138937+0000","last_unstale":"2024-09-21T07:30:45.131289+0000","last_undegraded":"2024-09-21T07:30:45.131289+0000","last_fullsized":"2024-09-21T07:30:45.131289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:01.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131865+0000","last_change":"2024-09-21T07:30:44.160502+0000","last_active":"2024-09-21T07:30:45.131865+0000","last_peered":"2024-09-21T07:30:45.131865+0000","last_clean":"2024-09-21T07:30:45.131865+0000","last_became_active":"2024-09-21T07:30:44.160204+0000","last_became_peered":"2024-09-21T07:30:44.160204+0000","last_unstale":"2024-09-21T07:30:45.131865+0000","last_undegraded":"2024-09-21T07:30:45.131865+0000","last_fullsized":"2024-09-21T07:30:45.131865+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:49.375293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338207+0000","last_change":"2024-09-21T07:30:43.134252+0000","last_active":"2024-09-21T07:30:45.338207+0000","last_peered":"2024-09-21T07:30:45.338207+0000","last_clean":"2024-09-21T07:30:45.338207+0000","last_became_active":"2024-09-21T07:30:43.133449+0000","last_became_peered":"2024-09-21T07:30:43.133449+0000","last_unstale":"2024-09-21T07:30:45.338207+0000","last_undegraded":"2024-09-21T07:30:45.338207+0000","last_fullsized":"2024-09-21T07:30:45.338207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:17.110123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341656+0000","last_change":"2024-09-21T07:30:44.163059+0000","last_active":"2024-09-21T07:30:45.341656+0000","last_peered":"2024-09-21T07:30:45.341656+0000","last_clean":"2024-09-21T07:30:45.341656+0000","last_became_active":"2024-09-21T07:30:44.162570+0000","last_became_peered":"2024-09-21T07:30:44.162570+0000","last_unstale":"2024-09-21T07:30:45.341656+0000","last_undegraded":"2024-09-21T07:30:45.341656+0000","last_fullsized":"2024-09-21T07:30:45.341656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:00.529908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"130'2","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341013+0000","last_change":"2024-09-21T07:30:43.143925+0000","last_active":"2024-09-21T07:30:45.341013+0000","last_peered":"2024-09-21T07:30:45.341013+0000","last_clean":"2024-09-21T07:30:45.341013+0000","last_became_active":"2024-09-21T07:30:43.143016+0000","last_became_peered":"2024-09-21T07:30:43.143016+0000","last_unstale":"2024-09-21T07:30:45.341013+0000","last_undegraded":"2024-09-21T07:30:45.341013+0000","last_fullsized":"2024-09-21T07:30:45.341013+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:07.128327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.340109+0000","last_change":"2024-09-21T07:30:44.149277+0000","last_active":"2024-09-21T07:30:45.340109+0000","last_peered":"2024-09-21T07:30:45.340109+0000","last_clean":"2024-09-21T07:30:45.340109+0000","last_became_active":"2024-09-21T07:30:44.148969+0000","last_became_peered":"2024-09-21T07:30:44.148969+0000","last_unstale":"2024-09-21T07:30:45.340109+0000","last_undegraded":"2024-09-21T07:30:45.340109+0000","last_fullsized":"2024-09-21T07:30:45.340109+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:13.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"131'1","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.132646+0000","last_change":"2024-09-21T07:30:43.141306+0000","last_active":"2024-09-21T07:30:45.132646+0000","last_peered":"2024-09-21T07:30:45.132646+0000","last_clean":"2024-09-21T07:30:45.132646+0000","last_became_active":"2024-09-21T07:30:43.140956+0000","last_became_peered":"2024-09-21T07:30:43.140956+0000","last_unstale":"2024-09-21T07:30:45.132646+0000","last_undegraded":"2024-09-21T07:30:45.132646+0000","last_fullsized":"2024-09-21T07:30:45.132646+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:02.355617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339410+0000","last_change":"2024-09-21T07:30:44.153892+0000","last_active":"2024-09-21T07:30:45.339410+0000","last_peered":"2024-09-21T07:30:45.339410+0000","last_clean":"2024-09-21T07:30:45.339410+0000","last_became_active":"2024-09-21T07:30:44.153608+0000","last_became_peered":"2024-09-21T07:30:44.153608+0000","last_unstale":"2024-09-21T07:30:45.339410+0000","last_undegraded":"2024-09-21T07:30:45.339410+0000","last_fullsized":"2024-09-21T07:30:45.339410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:36.363132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.133028+0000","last_change":"2024-09-21T07:30:43.141409+0000","last_active":"2024-09-21T07:30:45.133028+0000","last_peered":"2024-09-21T07:30:45.133028+0000","last_clean":"2024-09-21T07:30:45.133028+0000","last_became_active":"2024-09-21T07:30:43.141062+0000","last_became_peered":"2024-09-21T07:30:43.141062+0000","last_unstale":"2024-09-21T07:30:45.133028+0000","last_undegraded":"2024-09-21T07:30:45.133028+0000","last_fullsized":"2024-09-21T07:30:45.133028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.367769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341460+0000","last_change":"2024-09-21T07:30:44.147762+0000","last_active":"2024-09-21T07:30:45.341460+0000","last_peered":"2024-09-21T07:30:45.341460+0000","last_clean":"2024-09-21T07:30:45.341460+0000","last_became_active":"2024-09-21T07:30:44.147435+0000","last_became_peered":"2024-09-21T07:30:44.147435+0000","last_unstale":"2024-09-21T07:30:45.341460+0000","last_undegraded":"2024-09-21T07:30:45.341460+0000","last_fullsized":"2024-09-21T07:30:45.341460+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.470867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.341746+0000","last_change":"2024-09-21T07:30:43.143395+0000","last_active":"2024-09-21T07:30:45.341746+0000","last_peered":"2024-09-21T07:30:45.341746+0000","last_clean":"2024-09-21T07:30:45.341746+0000","last_became_active":"2024-09-21T07:30:43.143055+0000","last_became_peered":"2024-09-21T07:30:43.143055+0000","last_unstale":"2024-09-21T07:30:45.341746+0000","last_undegraded":"2024-09-21T07:30:45.341746+0000","last_fullsized":"2024-09-21T07:30:45.341746+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:18.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338771+0000","last_change":"2024-09-21T07:30:44.136164+0000","last_active":"2024-09-21T07:30:45.338771+0000","last_peered":"2024-09-21T07:30:45.338771+0000","last_clean":"2024-09-21T07:30:45.338771+0000","last_became_active":"2024-09-21T07:30:44.135779+0000","last_became_peered":"2024-09-21T07:30:44.135779+0000","last_unstale":"2024-09-21T07:30:45.338771+0000","last_undegraded":"2024-09-21T07:30:45.338771+0000","last_fullsized":"2024-09-21T07:30:45.338771+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:54.525857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338147+0000","last_change":"2024-09-21T07:30:43.131360+0000","last_active":"2024-09-21T07:30:45.338147+0000","last_peered":"2024-09-21T07:30:45.338147+0000","last_clean":"2024-09-21T07:30:45.338147+0000","last_became_active":"2024-09-21T07:30:43.130836+0000","last_became_peered":"2024-09-21T07:30:43.130836+0000","last_unstale":"2024-09-21T07:30:45.338147+0000","last_undegraded":"2024-09-21T07:30:45.338147+0000","last_fullsized":"2024-09-21T07:30:45.338147+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:25.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131165+0000","last_change":"2024-09-21T07:30:44.166662+0000","last_active":"2024-09-21T07:30:45.131165+0000","last_peered":"2024-09-21T07:30:45.131165+0000","last_clean":"2024-09-21T07:30:45.131165+0000","last_became_active":"2024-09-21T07:30:44.166319+0000","last_became_peered":"2024-09-21T07:30:44.166319+0000","last_unstale":"2024-09-21T07:30:45.131165+0000","last_undegraded":"2024-09-21T07:30:45.131165+0000","last_fullsized":"2024-09-21T07:30:45.131165+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:12.710220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338148+0000","last_change":"2024-09-21T07:30:43.124578+0000","last_active":"2024-09-21T07:30:45.338148+0000","last_peered":"2024-09-21T07:30:45.338148+0000","last_clean":"2024-09-21T07:30:45.338148+0000","last_became_active":"2024-09-21T07:30:43.123020+0000","last_became_peered":"2024-09-21T07:30:43.123020+0000","last_unstale":"2024-09-21T07:30:45.338148+0000","last_undegraded":"2024-09-21T07:30:45.338148+0000","last_fullsized":"2024-09-21T07:30:45.338148+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:26.393369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:44.167242+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:44.166797+0000","last_became_peered":"2024-09-21T07:30:44.166797+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:46.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338535+0000","last_change":"2024-09-21T07:30:43.137745+0000","last_active":"2024-09-21T07:30:45.338535+0000","last_peered":"2024-09-21T07:30:45.338535+0000","last_clean":"2024-09-21T07:30:45.338535+0000","last_became_active":"2024-09-21T07:30:43.137373+0000","last_became_peered":"2024-09-21T07:30:43.137373+0000","last_unstale":"2024-09-21T07:30:45.338535+0000","last_undegraded":"2024-09-21T07:30:45.338535+0000","last_fullsized":"2024-09-21T07:30:45.338535+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:09.108737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339642+0000","last_change":"2024-09-21T07:30:44.144251+0000","last_active":"2024-09-21T07:30:45.339642+0000","last_peered":"2024-09-21T07:30:45.339642+0000","last_clean":"2024-09-21T07:30:45.339642+0000","last_became_active":"2024-09-21T07:30:44.143905+0000","last_became_peered":"2024-09-21T07:30:44.143905+0000","last_unstale":"2024-09-21T07:30:45.339642+0000","last_undegraded":"2024-09-21T07:30:45.339642+0000","last_fullsized":"2024-09-21T07:30:45.339642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:51.961143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338352+0000","last_change":"2024-09-21T07:30:43.134998+0000","last_active":"2024-09-21T07:30:45.338352+0000","last_peered":"2024-09-21T07:30:45.338352+0000","last_clean":"2024-09-21T07:30:45.338352+0000","last_became_active":"2024-09-21T07:30:43.134686+0000","last_became_peered":"2024-09-21T07:30:43.134686+0000","last_unstale":"2024-09-21T07:30:45.338352+0000","last_undegraded":"2024-09-21T07:30:45.338352+0000","last_fullsized":"2024-09-21T07:30:45.338352+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:55.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.339232+0000","last_change":"2024-09-21T07:30:44.160640+0000","last_active":"2024-09-21T07:30:45.339232+0000","last_peered":"2024-09-21T07:30:45.339232+0000","last_clean":"2024-09-21T07:30:45.339232+0000","last_became_active":"2024-09-21T07:30:44.158316+0000","last_became_peered":"2024-09-21T07:30:44.158316+0000","last_unstale":"2024-09-21T07:30:45.339232+0000","last_undegraded":"2024-09-21T07:30:45.339232+0000","last_fullsized":"2024-09-21T07:30:45.339232+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:43.102244+0000","last_clean_scrub_stamp":"2024-09-21T07:30:43.102244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:19.923244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"130'8","reported_seq":23,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.131228+0000","last_change":"2024-09-21T07:30:43.129146+0000","last_active":"2024-09-21T07:30:45.131228+0000","last_peered":"2024-09-21T07:30:45.131228+0000","last_clean":"2024-09-21T07:30:45.131228+0000","last_became_active":"2024-09-21T07:30:43.128816+0000","last_became_peered":"2024-09-21T07:30:43.128816+0000","last_unstale":"2024-09-21T07:30:45.131228+0000","last_undegraded":"2024-09-21T07:30:45.131228+0000","last_fullsized":"2024-09-21T07:30:45.131228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:30:42.095059+0000","last_clean_scrub_stamp":"2024-09-21T07:30:42.095059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:58.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T07:30:45.338425+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:30:45.338425+0000","last_peered":"2024-09-21T07:30:45.338425+0000","last_clean":"2024-09-21T07:30:45.338425+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:30:45.338425+0000","last_undegraded":"2024-09-21T07:30:45.338425+0000","last_fullsized":"2024-09-21T07:30:45.338425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28616,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343224,"statfs":{"total":96636764160,"available":96607461376,"internally_reserved":0,"allocated":1626112,"data_stored":765247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":1630208,"data_stored":764825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1634304,"data_stored":766277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509542,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1622016,"data_stored":764665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1626112,"data_stored":764687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47248,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324592,"statfs":{"total":96636764160,"available":96588382208,"internally_reserved":0,"allocated":2220032,"data_stored":1355055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41692,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330148,"statfs":{"total":96636764160,"available":96594071552,"internally_reserved":0,"allocated":2232320,"data_stored":1355809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1638400,"data_stored":766311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:30:53.498 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:30:53.499 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:30:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 -- 172.21.15.64:0/1950902815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c15b2d0 msgr2=0x7ff51c15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 --2- 172.21.15.64:0/1950902815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c15b2d0 0x7ff51c15b6e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7ff514009c80 tx=0x7ff51401cda0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 -- 172.21.15.64:0/1950902815 shutdown_connections 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 --2- 172.21.15.64:0/1950902815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c15b2d0 0x7ff51c15b6e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 --2- 172.21.15.64:0/1950902815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c06efa0 0x7ff51c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 -- 172.21.15.64:0/1950902815 >> 172.21.15.64:0/1950902815 conn(0x7ff51c0ccbe0 msgr2=0x7ff51c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 -- 172.21.15.64:0/1950902815 shutdown_connections 2024-09-21T07:30:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.706+0000 7ff523200640 1 -- 172.21.15.64:0/1950902815 wait complete. 2024-09-21T07:30:53.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 Processor -- start 2024-09-21T07:30:53.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 -- start start 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c06f3b0 0x7ff51c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c15b2d0 0x7ff51c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c15ee70 con 0x7ff51c06efa0 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c15ecf0 con 0x7ff51c06f3b0 2024-09-21T07:30:53.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff523200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c15eff0 con 0x7ff51c15b2d0 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55676/0 (socket says 172.21.15.64:55676) 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 -- 172.21.15.64:0/1118404749 learned_addr learned my addr 172.21.15.64:0/1118404749 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff521200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c15b2d0 0x7ff51c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51b400640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c06f3b0 0x7ff51c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 -- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c15b2d0 msgr2=0x7ff51c151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c15b2d0 0x7ff51c151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 -- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c06f3b0 msgr2=0x7ff51c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c06f3b0 0x7ff51c150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 -- 172.21.15.64:0/1118404749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c140910 con 0x7ff51c06efa0 2024-09-21T07:30:53.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.710+0000 7ff51be00640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00db90 tx=0x7ff50c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c005020 con 0x7ff51c06efa0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff50c0052b0 con 0x7ff51c06efa0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c0c95c0 con 0x7ff51c06efa0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0047b0 con 0x7ff51c06efa0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1fca70 con 0x7ff51c06efa0 2024-09-21T07:30:53.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c15f4e0 con 0x7ff51c06efa0 2024-09-21T07:30:53.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff50c004950 con 0x7ff51c06efa0 2024-09-21T07:30:53.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 0x7ff4fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:53.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7ff50c094a10 con 0x7ff51c06efa0 2024-09-21T07:30:53.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.714+0000 7ff51b400640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 0x7ff4fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:53.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.718+0000 7ff51b400640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 0x7ff4fc075710 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0af570 tx=0x7ff508009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:53.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.718+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff50c05f890 con 0x7ff51c06efa0 2024-09-21T07:30:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.962+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff51c0d0840 con 0x7ff51c06efa0 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.962+0000 7ff513e00640 1 -- 172.21.15.64:0/1118404749 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) ==== 190+0+147 (secure 0 0 0) 0x7ff50c05f190 con 0x7ff51c06efa0 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:30:53.965 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:30:53.966 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:30:53.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 msgr2=0x7ff4fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 0x7ff4fc075710 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0af570 tx=0x7ff508009040 comp rx=0 tx=0).stop 2024-09-21T07:30:53.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 msgr2=0x7ff51c1403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00db90 tx=0x7ff50c00a620 comp rx=0 tx=0).stop 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 shutdown_connections 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff4fc073200 0x7ff4fc075710 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff51c15b2d0 0x7ff51c151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c06f3b0 0x7ff51c150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 --2- 172.21.15.64:0/1118404749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff51c06efa0 0x7ff51c1403d0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 >> 172.21.15.64:0/1118404749 conn(0x7ff51c0ccbe0 msgr2=0x7ff51c15dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 shutdown_connections 2024-09-21T07:30:53.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:53.966+0000 7ff523200640 1 -- 172.21.15.64:0/1118404749 wait complete. 2024-09-21T07:30:53.988 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:30:54.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 -- 172.21.15.64:0/856882443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde14004810 msgr2=0x7fde14004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 --2- 172.21.15.64:0/856882443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde14004810 0x7fde14004c20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fde18009b60 tx=0x7fde1801d2b0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde31e00640 1 -- 172.21.15.64:0/856882443 reap_dead start 2024-09-21T07:30:54.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 -- 172.21.15.64:0/856882443 shutdown_connections 2024-09-21T07:30:54.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 -- 172.21.15.64:0/856882443 >> 172.21.15.64:0/856882443 conn(0x7fde2c0ce0a0 msgr2=0x7fde2c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:54.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 -- 172.21.15.64:0/856882443 shutdown_connections 2024-09-21T07:30:54.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 -- 172.21.15.64:0/856882443 wait complete. 2024-09-21T07:30:54.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.146+0000 7fde32800640 1 Processor -- start 2024-09-21T07:30:54.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- start start 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde14004810 0x7fde2c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde2c09e400 0x7fde2c1f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c0cf620 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c0cf4a0 con 0x7fde2c09e400 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fde2c15bfd0 con 0x7fde14004810 2024-09-21T07:30:54.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55694/0 (socket says 172.21.15.64:55694) 2024-09-21T07:30:54.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 -- 172.21.15.64:0/4112584847 learned_addr learned my addr 172.21.15.64:0/4112584847 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:54.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31400640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde14004810 0x7fde2c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde30a00640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde2c09e400 0x7fde2c1f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 -- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde14004810 msgr2=0x7fde2c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde14004810 0x7fde2c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 -- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde2c09e400 msgr2=0x7fde2c1f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde2c09e400 0x7fde2c1f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 -- 172.21.15.64:0/4112584847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c157950 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde31e00640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0cb600 tx=0x7fde24011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24013920 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde24013bb0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c1568b0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240123e0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.150+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c156e70 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c156620 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fde24012580 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde29600640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 0x7fde0c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fde24097eb0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde31400640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 0x7fde0c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.154+0000 7fde31400640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 0x7fde0c075740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde20005ec0 tx=0x7fde200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.158+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fde24062cb0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.374+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde2c158c50 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.374+0000 7fde29600640 1 -- 172.21.15.64:0/4112584847 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7fde240625b0 con 0x7fde2c1f3fc0 2024-09-21T07:30:54.376 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:30:54.376 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:30:54.377 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 msgr2=0x7fde0c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 0x7fde0c075740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde20005ec0 tx=0x7fde200091e0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 msgr2=0x7fde2c1f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0cb600 tx=0x7fde24011970 comp rx=0 tx=0).stop 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 shutdown_connections 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fde0c073230 0x7fde0c075740 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde2c1f3fc0 0x7fde2c1f70b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde2c09e400 0x7fde2c1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 --2- 172.21.15.64:0/4112584847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde14004810 0x7fde2c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 >> 172.21.15.64:0/4112584847 conn(0x7fde2c0ce0a0 msgr2=0x7fde2c15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:54.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 shutdown_connections 2024-09-21T07:30:54.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.378+0000 7fde32800640 1 -- 172.21.15.64:0/4112584847 wait complete. 2024-09-21T07:30:54.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:30:43.555346+0000', 'modified': '2024-09-21T07:30:46.590833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8139}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8139': {'gid': 8139, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6833/158277074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 158277074}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 158277074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8139, 'qdb_cluster': [8139]} 2024-09-21T07:30:54.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:30:54.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:30:54.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 -- 172.21.15.64:0/2590147529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 msgr2=0x7f1ef806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 --2- 172.21.15.64:0/2590147529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef806f890 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8070f10 tx=0x7f1ef001cd80 comp rx=0 tx=0).stop 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 -- 172.21.15.64:0/2590147529 shutdown_connections 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 --2- 172.21.15.64:0/2590147529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef806f890 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 --2- 172.21.15.64:0/2590147529 >> v2:172.21.15.90:3300/0 conn(0x7f1ef809df30 0x7f1ef80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 -- 172.21.15.64:0/2590147529 >> 172.21.15.64:0/2590147529 conn(0x7f1ef806d450 msgr2=0x7f1ef80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 -- 172.21.15.64:0/2590147529 shutdown_connections 2024-09-21T07:30:54.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.962+0000 7f1f00600640 1 -- 172.21.15.64:0/2590147529 wait complete. 2024-09-21T07:30:54.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 Processor -- start 2024-09-21T07:30:54.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- start start 2024-09-21T07:30:54.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ef809df30 0x7f1ef80740b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ef80b3910 0x7f1ef8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8169000 con 0x7f1ef80ce900 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8168e80 con 0x7f1ef80b3910 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef8169180 con 0x7f1ef809df30 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55708/0 (socket says 172.21.15.64:55708) 2024-09-21T07:30:54.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 -- 172.21.15.64:0/1966876428 learned_addr learned my addr 172.21.15.64:0/1966876428 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ef809df30 0x7f1ef80740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 -- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ef809df30 msgr2=0x7f1ef80740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ef809df30 0x7f1ef80740b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 -- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ef80b3910 msgr2=0x7f1ef8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ef80b3910 0x7f1ef8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 -- 172.21.15.64:0/1966876428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80745f0 con 0x7f1ef80ce900 2024-09-21T07:30:54.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1efe600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001b430 tx=0x7f1ef0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1ef5600640 1 -- 172.21.15.64:0/1966876428 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00bb070 con 0x7f1ef80ce900 2024-09-21T07:30:54.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1ef5600640 1 -- 172.21.15.64:0/1966876428 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef0004b40 con 0x7f1ef80ce900 2024-09-21T07:30:54.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1ef5600640 1 -- 172.21.15.64:0/1966876428 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00b2040 con 0x7f1ef80ce900 2024-09-21T07:30:54.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef81566d0 con 0x7f1ef80ce900 2024-09-21T07:30:54.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.966+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef8156c90 con 0x7f1ef80ce900 2024-09-21T07:30:54.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.970+0000 7f1ef5600640 1 -- 172.21.15.64:0/1966876428 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ef00be070 con 0x7f1ef80ce900 2024-09-21T07:30:54.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.970+0000 7f1ef5600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 0x7f1ed8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.970+0000 7f1ef5600640 1 -- 172.21.15.64:0/1966876428 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f1ef012e3f0 con 0x7f1ef80ce900 2024-09-21T07:30:54.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.970+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 0x7f1ed8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.970+0000 7f1f07e70000 1 Processor -- start 2024-09-21T07:30:54.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- start start 2024-09-21T07:30:54.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 0x7f1ed8075710 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1eec005870 tx=0x7f1eec0057c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b468bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 0x55c3b468c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4560410 con 0x55c3b414a460 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b449db40 con 0x55c3b4523ca0 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b448cf70 con 0x55c3b453a950 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43104/0 (socket says 172.21.15.64:43104) 2024-09-21T07:30:54.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 -- 172.21.15.64:0/1791267518 learned_addr learned my addr 172.21.15.64:0/1791267518 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efd200640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b468bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efe600640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 0x55c3b468c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 -- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 msgr2=0x55c3b468bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b468bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 -- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 msgr2=0x55c3b468c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 0x55c3b468c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 -- 172.21.15.64:0/1791267518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b44545b0 con 0x55c3b414a460 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efd200640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b468bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efe600640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 0x55c3b468c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00ed30 tx=0x7f1eec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1f440694db5ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1eea000640 1 -- 172.21.15.64:0/1791267518 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01e440 con 0x55c3b414a460 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1eea000640 1 -- 172.21.15.64:0/1791267518 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eec023070 con 0x55c3b414a460 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1eea000640 1 -- 172.21.15.64:0/1791267518 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01e970 con 0x55c3b414a460 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- 172.21.15.64:0/1791267518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 msgr2=0x55c3b468b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00ed30 tx=0x7f1eec011000 comp rx=0 tx=0).stop 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- 172.21.15.64:0/1791267518 shutdown_connections 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b4523ca0 0x55c3b468c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b468bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1791267518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b468b6a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- 172.21.15.64:0/1791267518 >> 172.21.15.64:0/1791267518 conn(0x55c3b4610d90 msgr2=0x55c3b4640690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.974+0000 7f1f07e70000 1 -- 172.21.15.64:0/1791267518 shutdown_connections 2024-09-21T07:30:54.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 -- 172.21.15.64:0/1791267518 wait complete. 2024-09-21T07:30:54.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 -- start start 2024-09-21T07:30:54.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 Processor -- start 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 0x55c3b4692920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b46933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b44275f0 con 0x55c3b4523ca0 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4490d80 con 0x55c3b414a460 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b4433520 con 0x55c3b453a950 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1f07e70000 10 client.0 _ll_register_callbacks cb 0x55c3b4437830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:54.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43116/0 (socket says 172.21.15.64:43116) 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 -- 172.21.15.64:0/1689318505 learned_addr learned my addr 172.21.15.64:0/1689318505 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efe600640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b46933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 0x55c3b4692920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 -- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 msgr2=0x55c3b46933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b46933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 -- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 msgr2=0x55c3b4692920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 0x55c3b4692920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 -- 172.21.15.64:0/1689318505 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b442b190 con 0x55c3b4523ca0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 0x55c3b4692920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1efd200640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400af50 tx=0x7f1ee400c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3711c029007742a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1edea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.978+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4015070 con 0x55c3b4523ca0 2024-09-21T07:30:54.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f1ee4004220 con 0x55c3b4523ca0 2024-09-21T07:30:54.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3b4425110 con 0x55c3b4523ca0 2024-09-21T07:30:54.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f1ee401f050 con 0x55c3b4523ca0 2024-09-21T07:30:54.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 10 client.8292 fetch_fsmap learned FSMap version 94 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55c3b4511f10 con 0x55c3b4523ca0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c3b4425110 con 0x55c3b4523ca0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f1ee4022020 con 0x55c3b4523ca0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 10 client.8292 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 10 client.8292 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 20 client.8292 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b412f7d0 0x55c3b469cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 4 client.8292 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b449fa90 con 0x55c3b412f7d0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b412f7d0 0x55c3b469cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 10 client.8292 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1efdc00640 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b412f7d0 0x55c3b469cd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2582eb72da326d server_cookie=9a799876602d1fc0 in_seq=0 out_seq=0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 1 -- 172.21.15.64:0/1689318505 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3b449fa90 con 0x55c3b412f7d0 2024-09-21T07:30:54.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 10 client.8292 handle_command_reply: tid=0 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 client.8292 shutdown 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 msgr2=0x55c3b4692e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400af50 tx=0x7f1ee400c5e0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 shutdown_connections 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b453a950 0x55c3b46933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b412f7d0 0x55c3b469cd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b4523ca0 0x55c3b4692e60 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 --2- 172.21.15.64:0/1689318505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b414a460 0x55c3b4692920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1edea00640 0 client.8292 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 >> 172.21.15.64:0/1689318505 conn(0x55c3b4610d90 msgr2=0x55c3b4647440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 shutdown_connections 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 1 -- 172.21.15.64:0/1689318505 wait complete. 2024-09-21T07:30:54.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:54.982+0000 7f1f07e70000 20 client.8292 trim_cache size 0 max 16384 2024-09-21T07:30:55.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 Processor -- start 2024-09-21T07:30:55.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 -- start start 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8205ac0 con 0x55c3b414a460 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8204b40 con 0x55c3b453a950 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef81fd210 con 0x55c3b4523ca0 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43132/0 (socket says 172.21.15.64:43132) 2024-09-21T07:30:55.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.002+0000 7f1efdc00640 1 -- 172.21.15.64:0/3660393683 learned_addr learned my addr 172.21.15.64:0/3660393683 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efe600640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efd200640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 -- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 msgr2=0x55c3b46fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 -- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 msgr2=0x55c3b46fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 -- 172.21.15.64:0/3660393683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b44e8db0 con 0x55c3b414a460 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efe600640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1efdc00640 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1eec013040 tx=0x7f1eec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d251cb96c5a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1ee9600640 1 -- 172.21.15.64:0/3660393683 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01e7d0 con 0x55c3b414a460 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1ee9600640 1 -- 172.21.15.64:0/3660393683 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eec023040 con 0x55c3b414a460 2024-09-21T07:30:55.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1ee9600640 1 -- 172.21.15.64:0/3660393683 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01ebd0 con 0x55c3b414a460 2024-09-21T07:30:55.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- 172.21.15.64:0/3660393683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 msgr2=0x55c3b46fd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1eec013040 tx=0x7f1eec004740 comp rx=0 tx=0).stop 2024-09-21T07:30:55.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- 172.21.15.64:0/3660393683 shutdown_connections 2024-09-21T07:30:55.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 --2- 172.21.15.64:0/3660393683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46fd840 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- 172.21.15.64:0/3660393683 >> 172.21.15.64:0/3660393683 conn(0x55c3b4610d90 msgr2=0x55c3b463fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- 172.21.15.64:0/3660393683 shutdown_connections 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- 172.21.15.64:0/3660393683 wait complete. 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 -- start start 2024-09-21T07:30:55.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.006+0000 7f1f07e70000 1 Processor -- start 2024-09-21T07:30:55.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b449c910 con 0x55c3b414a460 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4458ee0 con 0x55c3b453a950 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b4490090 con 0x55c3b4523ca0 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 10 client.0 _ll_register_callbacks cb 0x7f1ee4006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43148/0 (socket says 172.21.15.64:43148) 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 -- 172.21.15.64:0/2392713762 learned_addr learned my addr 172.21.15.64:0/2392713762 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efd200640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efe600640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 -- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 msgr2=0x55c3b46bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 -- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 msgr2=0x55c3b46bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 -- 172.21.15.64:0/2392713762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b4453ab0 con 0x55c3b414a460 2024-09-21T07:30:55.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efe600640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efdc00640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00a010 tx=0x7f1eec009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09fedc7c4ea841e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01e700 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f1eec01e8a0 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eec023040 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f1eec04b050 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 10 client.8298 fetch_fsmap learned FSMap version 94 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55c3b4432070 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eec023040 con 0x55c3b414a460 2024-09-21T07:30:55.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f1eec04e020 con 0x55c3b414a460 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 10 client.8298 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 10 client.8298 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 20 client.8298 populate_metadata read hostname 'smithi064' 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b411d830 0x55c3b46bdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 4 client.8298 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "status"}) -- 0x55c3b449b540 con 0x55c3b411d830 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efd200640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b411d830 0x55c3b46bdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1efd200640 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b411d830 0x55c3b46bdbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a529ad3811cb0f1 server_cookie=97731432aa9c56a3 in_seq=0 out_seq=0 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 10 client.8298 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 1 -- 172.21.15.64:0/2392713762 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55c3b449b540 con 0x55c3b411d830 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 10 client.8298 handle_command_reply: tid=0 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 client.8298 shutdown 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 msgr2=0x55c3b46bcc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00a010 tx=0x7f1eec009830 comp rx=0 tx=0).stop 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 shutdown_connections 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b453a950 0x55c3b46bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b4523ca0 0x55c3b46bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55c3b411d830 0x55c3b46bdbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 --2- 172.21.15.64:0/2392713762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b414a460 0x55c3b46bcc30 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 >> 172.21.15.64:0/2392713762 conn(0x55c3b4610d90 msgr2=0x55c3b4640690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.010+0000 7f1edea00640 0 client.8298 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 shutdown_connections 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f07e70000 1 -- 172.21.15.64:0/2392713762 wait complete. 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f07e70000 20 client.8298 trim_cache size 0 max 16384 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:30:55.016 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 8139, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.887292211, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 94, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 131, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 131, 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.28217458 2024-09-21T07:30:55.017 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 msgr2=0x7f1ed8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 0x7f1ed8075710 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1eec005870 tx=0x7f1eec0057c0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 msgr2=0x7f1ef8072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001b430 tx=0x7f1ef0004270 comp rx=0 tx=0).stop 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 shutdown_connections 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ed8073200 0x7f1ed8075710 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ef80ce900 0x7f1ef8072c70 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ef80b3910 0x7f1ef8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 --2- 172.21.15.64:0/1966876428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ef809df30 0x7f1ef80740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 >> 172.21.15.64:0/1966876428 conn(0x7f1ef806d450 msgr2=0x7f1ef815b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 shutdown_connections 2024-09-21T07:30:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.014+0000 7f1f00600640 1 -- 172.21.15.64:0/1966876428 wait complete. 2024-09-21T07:30:55.034 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.190+0000 7f69bae00640 1 -- 172.21.15.64:0/3430361524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 msgr2=0x7f699c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.190+0000 7f69bae00640 1 --2- 172.21.15.64:0/3430361524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f699c004c20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f69b415eff0 tx=0x7f69a001cea0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 -- 172.21.15.64:0/3430361524 shutdown_connections 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 --2- 172.21.15.64:0/3430361524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f699c004c20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 -- 172.21.15.64:0/3430361524 >> 172.21.15.64:0/3430361524 conn(0x7f69b40b2b50 msgr2=0x7f69b40b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 -- 172.21.15.64:0/3430361524 shutdown_connections 2024-09-21T07:30:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 -- 172.21.15.64:0/3430361524 wait complete. 2024-09-21T07:30:55.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 Processor -- start 2024-09-21T07:30:55.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.194+0000 7f69bae00640 1 -- start start 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b40a95f0 0x7f69b414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 0x7f69b414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4074660 con 0x7f699c004810 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40744e0 con 0x7f69b40a95f0 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f69b40747e0 con 0x7f69b414bb00 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43158/0 (socket says 172.21.15.64:43158) 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 -- 172.21.15.64:0/3216458170 learned_addr learned my addr 172.21.15.64:0/3216458170 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:30:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9000640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b40a95f0 0x7f69b414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69ba400640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 0x7f69b414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 -- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 msgr2=0x7f69b414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 0x7f69b414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 -- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b40a95f0 msgr2=0x7f69b414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b40a95f0 0x7f69b414b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 -- 172.21.15.64:0/3216458170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b414bf10 con 0x7f699c004810 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69ba400640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 0x7f69b414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b9a00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f69a8004d70 tx=0x7f69a8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8001d50 con 0x7f699c004810 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69a8016070 con 0x7f699c004810 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8010b00 con 0x7f699c004810 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b4149660 con 0x7f699c004810 2024-09-21T07:30:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b4149c20 con 0x7f699c004810 2024-09-21T07:30:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b40cc9a0 con 0x7f699c004810 2024-09-21T07:30:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.198+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f69a8010ca0 con 0x7f699c004810 2024-09-21T07:30:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.202+0000 7f69b1600640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 0x7f6994075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.202+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f69a8094c30 con 0x7f699c004810 2024-09-21T07:30:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.202+0000 7f69b9000640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 0x7f6994075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.202+0000 7f69b9000640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 0x7f6994075710 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f69a00aa000 tx=0x7f69a0019ce0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.206+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f69b414bf10 con 0x7f699c004810 2024-09-21T07:30:55.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f69b40a9a30 con 0x7f699c004810 2024-09-21T07:30:55.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69b1600640 1 -- 172.21.15.64:0/3216458170 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) ==== 53+0+73 (secure 0 0 0) 0x7f69a805fa20 con 0x7f699c004810 2024-09-21T07:30:55.420 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:30:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 msgr2=0x7f6994075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 0x7f6994075710 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f69a00aa000 tx=0x7f69a0019ce0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 msgr2=0x7f69b4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f69a8004d70 tx=0x7f69a8001640 comp rx=0 tx=0).stop 2024-09-21T07:30:55.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.418+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 shutdown_connections 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6994073200 0x7f6994075710 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69b414bb00 0x7f69b414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b40a95f0 0x7f69b414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 --2- 172.21.15.64:0/3216458170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f699c004810 0x7f69b4148d60 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 >> 172.21.15.64:0/3216458170 conn(0x7f69b40b2b50 msgr2=0x7f69b40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 shutdown_connections 2024-09-21T07:30:55.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55.422+0000 7f69bae00640 1 -- 172.21.15.64:0/3216458170 wait complete. 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:30:55.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:30:55.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:30:55.443 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:30:55.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.443 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:30:55.452 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41928sec preferred_lft 41928sec 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:30:55.453 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:30:55.454 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:30:55.455 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:30:55.455 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:30:55.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.456 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:30:55.515 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:30:55.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.517 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:30:55.576 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:30:55.576 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:30:55.576 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:30:55.576 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:30:55.576 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:30:55.577 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:30:55.577 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:30:55.577 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:55.577 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:30:55.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:30:55.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:30:55.578 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:55.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:30:55.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:55.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.714 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:30:55.723 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:30:55.723 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:30:55.724 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:30:55.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.724 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:30:55.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:30:55.785 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:30:55.837 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:30:55.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:30:55.837 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:30:55.889 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:30:55.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:55.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:30:55.991 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:30:55.991 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:30:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:30:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:30:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:30:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:30:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:30:56.010 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:30:56.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:30:56.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:30:56.030 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:30:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:56.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:56.140 INFO:teuthology.orchestra.run.smithi064.stdout:client8307 2024-09-21T07:30:56.141 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:30:56.141 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:30:56.150 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.0 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:56.151 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:56.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:56.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.278 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.278 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195096 s, 53.7 MB/s 2024-09-21T07:30:56.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164552 s, 63.7 MB/s 2024-09-21T07:30:56.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176248 s, 59.5 MB/s 2024-09-21T07:30:56.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127694 s, 82.1 MB/s 2024-09-21T07:30:56.352 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.353 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158525 s, 66.1 MB/s 2024-09-21T07:30:56.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172709 s, 60.7 MB/s 2024-09-21T07:30:56.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.396 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019837 s, 52.9 MB/s 2024-09-21T07:30:56.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154814 s, 67.7 MB/s 2024-09-21T07:30:56.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.433 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154649 s, 67.8 MB/s 2024-09-21T07:30:56.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156919 s, 66.8 MB/s 2024-09-21T07:30:56.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144287 s, 72.7 MB/s 2024-09-21T07:30:56.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.487 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153047 s, 68.5 MB/s 2024-09-21T07:30:56.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185946 s, 56.4 MB/s 2024-09-21T07:30:56.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154821 s, 67.7 MB/s 2024-09-21T07:30:56.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140781 s, 74.5 MB/s 2024-09-21T07:30:56.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.564 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167763 s, 62.5 MB/s 2024-09-21T07:30:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209394 s, 50.1 MB/s 2024-09-21T07:30:56.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.607 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155676 s, 67.4 MB/s 2024-09-21T07:30:56.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.625 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146844 s, 71.4 MB/s 2024-09-21T07:30:56.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130112 s, 80.6 MB/s 2024-09-21T07:30:56.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153929 s, 68.1 MB/s 2024-09-21T07:30:56.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162177 s, 64.7 MB/s 2024-09-21T07:30:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015418 s, 68.0 MB/s 2024-09-21T07:30:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163577 s, 64.1 MB/s 2024-09-21T07:30:56.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146482 s, 71.6 MB/s 2024-09-21T07:30:56.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.754 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158718 s, 66.1 MB/s 2024-09-21T07:30:56.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141289 s, 74.2 MB/s 2024-09-21T07:30:56.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.788 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143038 s, 73.3 MB/s 2024-09-21T07:30:56.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136355 s, 76.9 MB/s 2024-09-21T07:30:56.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149732 s, 70.0 MB/s 2024-09-21T07:30:56.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148086 s, 70.8 MB/s 2024-09-21T07:30:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182105 s, 57.6 MB/s 2024-09-21T07:30:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:56.869 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:56.869 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:56.870 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.1 2024-09-21T07:30:56.870 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:56.870 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:56.870 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:56.870 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:56.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:56.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144042 s, 72.8 MB/s 2024-09-21T07:30:56.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178049 s, 58.9 MB/s 2024-09-21T07:30:56.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.979 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160277 s, 65.4 MB/s 2024-09-21T07:30:56.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:56.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:56.996 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141487 s, 74.1 MB/s 2024-09-21T07:30:57.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137948 s, 76.0 MB/s 2024-09-21T07:30:57.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153238 s, 68.4 MB/s 2024-09-21T07:30:57.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145717 s, 72.0 MB/s 2024-09-21T07:30:57.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133882 s, 78.3 MB/s 2024-09-21T07:30:57.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013732 s, 76.4 MB/s 2024-09-21T07:30:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016992 s, 61.7 MB/s 2024-09-21T07:30:57.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174398 s, 60.1 MB/s 2024-09-21T07:30:57.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141256 s, 74.2 MB/s 2024-09-21T07:30:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133451 s, 78.6 MB/s 2024-09-21T07:30:57.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.168 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135308 s, 77.5 MB/s 2024-09-21T07:30:57.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.186 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147732 s, 71.0 MB/s 2024-09-21T07:30:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.203 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144469 s, 72.6 MB/s 2024-09-21T07:30:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.219 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130816 s, 80.2 MB/s 2024-09-21T07:30:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125134 s, 83.8 MB/s 2024-09-21T07:30:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.250 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012973 s, 80.8 MB/s 2024-09-21T07:30:57.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185816 s, 56.4 MB/s 2024-09-21T07:30:57.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.293 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018654 s, 56.2 MB/s 2024-09-21T07:30:57.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.311 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.311 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153716 s, 68.2 MB/s 2024-09-21T07:30:57.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.331 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182056 s, 57.6 MB/s 2024-09-21T07:30:57.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.349 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.349 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144125 s, 72.8 MB/s 2024-09-21T07:30:57.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.366 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144161 s, 72.7 MB/s 2024-09-21T07:30:57.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138174 s, 75.9 MB/s 2024-09-21T07:30:57.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154141 s, 68.0 MB/s 2024-09-21T07:30:57.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145093 s, 72.3 MB/s 2024-09-21T07:30:57.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142888 s, 73.4 MB/s 2024-09-21T07:30:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138019 s, 76.0 MB/s 2024-09-21T07:30:57.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.467 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132847 s, 78.9 MB/s 2024-09-21T07:30:57.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.488 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.488 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178624 s, 58.7 MB/s 2024-09-21T07:30:57.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.2 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:57.495 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:57.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:57.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.564 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148348 s, 70.7 MB/s 2024-09-21T07:30:57.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120288 s, 87.2 MB/s 2024-09-21T07:30:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135064 s, 77.6 MB/s 2024-09-21T07:30:57.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.612 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139942 s, 74.9 MB/s 2024-09-21T07:30:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.630 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154815 s, 67.7 MB/s 2024-09-21T07:30:57.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.646 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-21T07:30:57.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144711 s, 72.5 MB/s 2024-09-21T07:30:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133814 s, 78.4 MB/s 2024-09-21T07:30:57.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144073 s, 72.8 MB/s 2024-09-21T07:30:57.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180931 s, 58.0 MB/s 2024-09-21T07:30:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133459 s, 78.6 MB/s 2024-09-21T07:30:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.751 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144401 s, 72.6 MB/s 2024-09-21T07:30:57.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.766 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131197 s, 79.9 MB/s 2024-09-21T07:30:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190393 s, 55.1 MB/s 2024-09-21T07:30:57.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129807 s, 80.8 MB/s 2024-09-21T07:30:57.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.821 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148107 s, 70.8 MB/s 2024-09-21T07:30:57.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.840 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163966 s, 64.0 MB/s 2024-09-21T07:30:57.861 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185121 s, 56.6 MB/s 2024-09-21T07:30:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014718 s, 71.2 MB/s 2024-09-21T07:30:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172321 s, 60.9 MB/s 2024-09-21T07:30:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135547 s, 77.4 MB/s 2024-09-21T07:30:57.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131465 s, 79.8 MB/s 2024-09-21T07:30:57.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144258 s, 72.7 MB/s 2024-09-21T07:30:57.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.965 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140175 s, 74.8 MB/s 2024-09-21T07:30:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134032 s, 78.2 MB/s 2024-09-21T07:30:57.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:57.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:57.996 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127634 s, 82.2 MB/s 2024-09-21T07:30:58.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133242 s, 78.7 MB/s 2024-09-21T07:30:58.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148207 s, 70.8 MB/s 2024-09-21T07:30:58.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013238 s, 79.2 MB/s 2024-09-21T07:30:58.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.062 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135138 s, 77.6 MB/s 2024-09-21T07:30:58.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146262 s, 71.7 MB/s 2024-09-21T07:30:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146483 s, 71.6 MB/s 2024-09-21T07:30:58.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.3 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:58.104 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:58.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:58.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146075 s, 71.8 MB/s 2024-09-21T07:30:58.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147326 s, 71.2 MB/s 2024-09-21T07:30:58.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.208 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139287 s, 75.3 MB/s 2024-09-21T07:30:58.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.224 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141623 s, 74.0 MB/s 2024-09-21T07:30:58.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175006 s, 59.9 MB/s 2024-09-21T07:30:58.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.260 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135566 s, 77.3 MB/s 2024-09-21T07:30:58.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.282 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186767 s, 56.1 MB/s 2024-09-21T07:30:58.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131547 s, 79.7 MB/s 2024-09-21T07:30:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140175 s, 74.8 MB/s 2024-09-21T07:30:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134867 s, 77.7 MB/s 2024-09-21T07:30:58.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.348 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150538 s, 69.7 MB/s 2024-09-21T07:30:58.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.369 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176098 s, 59.5 MB/s 2024-09-21T07:30:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171945 s, 61.0 MB/s 2024-09-21T07:30:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130747 s, 80.2 MB/s 2024-09-21T07:30:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153967 s, 68.1 MB/s 2024-09-21T07:30:58.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.440 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014384 s, 72.9 MB/s 2024-09-21T07:30:58.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179791 s, 58.3 MB/s 2024-09-21T07:30:58.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139348 s, 75.2 MB/s 2024-09-21T07:30:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016716 s, 62.7 MB/s 2024-09-21T07:30:58.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129704 s, 80.8 MB/s 2024-09-21T07:30:58.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.530 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150066 s, 69.9 MB/s 2024-09-21T07:30:58.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131359 s, 79.8 MB/s 2024-09-21T07:30:58.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.565 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167235 s, 62.7 MB/s 2024-09-21T07:30:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125531 s, 83.5 MB/s 2024-09-21T07:30:58.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165601 s, 63.3 MB/s 2024-09-21T07:30:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130504 s, 80.3 MB/s 2024-09-21T07:30:58.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172807 s, 60.7 MB/s 2024-09-21T07:30:58.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.652 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143668 s, 73.0 MB/s 2024-09-21T07:30:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135678 s, 77.3 MB/s 2024-09-21T07:30:58.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.686 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145882 s, 71.9 MB/s 2024-09-21T07:30:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135953 s, 77.1 MB/s 2024-09-21T07:30:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017495 s, 59.9 MB/s 2024-09-21T07:30:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.4 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:58.730 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:58.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:58.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.798 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134896 s, 77.7 MB/s 2024-09-21T07:30:58.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147049 s, 71.3 MB/s 2024-09-21T07:30:58.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.832 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143412 s, 73.1 MB/s 2024-09-21T07:30:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168997 s, 62.0 MB/s 2024-09-21T07:30:58.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.872 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172913 s, 60.6 MB/s 2024-09-21T07:30:58.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139782 s, 75.0 MB/s 2024-09-21T07:30:58.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148707 s, 70.5 MB/s 2024-09-21T07:30:58.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.923 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142134 s, 73.8 MB/s 2024-09-21T07:30:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145515 s, 72.1 MB/s 2024-09-21T07:30:58.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.956 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135244 s, 77.5 MB/s 2024-09-21T07:30:58.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.972 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130717 s, 80.2 MB/s 2024-09-21T07:30:58.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:58.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:58.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128952 s, 81.3 MB/s 2024-09-21T07:30:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133978 s, 78.3 MB/s 2024-09-21T07:30:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179041 s, 58.6 MB/s 2024-09-21T07:30:59.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.041 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141071 s, 74.3 MB/s 2024-09-21T07:30:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147376 s, 71.1 MB/s 2024-09-21T07:30:59.074 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.074 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.074 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135045 s, 77.6 MB/s 2024-09-21T07:30:59.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.090 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131481 s, 79.8 MB/s 2024-09-21T07:30:59.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130089 s, 80.6 MB/s 2024-09-21T07:30:59.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.123 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150315 s, 69.8 MB/s 2024-09-21T07:30:59.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.141 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152158 s, 68.9 MB/s 2024-09-21T07:30:59.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.161 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167174 s, 62.7 MB/s 2024-09-21T07:30:59.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134831 s, 77.8 MB/s 2024-09-21T07:30:59.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.195 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151006 s, 69.4 MB/s 2024-09-21T07:30:59.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138535 s, 75.7 MB/s 2024-09-21T07:30:59.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141974 s, 73.9 MB/s 2024-09-21T07:30:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.244 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013726 s, 76.4 MB/s 2024-09-21T07:30:59.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.260 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127909 s, 82.0 MB/s 2024-09-21T07:30:59.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147465 s, 71.1 MB/s 2024-09-21T07:30:59.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018392 s, 57.0 MB/s 2024-09-21T07:30:59.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139765 s, 75.0 MB/s 2024-09-21T07:30:59.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140338 s, 74.7 MB/s 2024-09-21T07:30:59.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:59.339 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:59.339 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:59.339 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.5 2024-09-21T07:30:59.340 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:59.340 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:59.340 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:59.340 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:30:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:30:59.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133352 s, 78.6 MB/s 2024-09-21T07:30:59.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136043 s, 77.1 MB/s 2024-09-21T07:30:59.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.442 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151886 s, 69.0 MB/s 2024-09-21T07:30:59.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.458 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138759 s, 75.6 MB/s 2024-09-21T07:30:59.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.476 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147002 s, 71.3 MB/s 2024-09-21T07:30:59.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.493 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147347 s, 71.2 MB/s 2024-09-21T07:30:59.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132672 s, 79.0 MB/s 2024-09-21T07:30:59.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126603 s, 82.8 MB/s 2024-09-21T07:30:59.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.541 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142355 s, 73.7 MB/s 2024-09-21T07:30:59.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01386 s, 75.7 MB/s 2024-09-21T07:30:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184006 s, 57.0 MB/s 2024-09-21T07:30:59.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.599 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177125 s, 59.2 MB/s 2024-09-21T07:30:59.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.616 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140098 s, 74.8 MB/s 2024-09-21T07:30:59.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138526 s, 75.7 MB/s 2024-09-21T07:30:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.649 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140642 s, 74.6 MB/s 2024-09-21T07:30:59.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134029 s, 78.2 MB/s 2024-09-21T07:30:59.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138545 s, 75.7 MB/s 2024-09-21T07:30:59.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.699 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142127 s, 73.8 MB/s 2024-09-21T07:30:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176365 s, 59.5 MB/s 2024-09-21T07:30:59.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134969 s, 77.7 MB/s 2024-09-21T07:30:59.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.763 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245816 s, 42.7 MB/s 2024-09-21T07:30:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211558 s, 49.6 MB/s 2024-09-21T07:30:59.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.806 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161285 s, 65.0 MB/s 2024-09-21T07:30:59.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134473 s, 78.0 MB/s 2024-09-21T07:30:59.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.840 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148407 s, 70.7 MB/s 2024-09-21T07:30:59.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144958 s, 72.3 MB/s 2024-09-21T07:30:59.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.875 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152164 s, 68.9 MB/s 2024-09-21T07:30:59.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.893 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147306 s, 71.2 MB/s 2024-09-21T07:30:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145033 s, 72.3 MB/s 2024-09-21T07:30:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.925 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129952 s, 80.7 MB/s 2024-09-21T07:30:59.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136492 s, 76.8 MB/s 2024-09-21T07:30:59.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:30:59.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:30:59.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141836 s, 73.9 MB/s 2024-09-21T07:30:59.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:30:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.6 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:30:59.966 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:00.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:00.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.035 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146984 s, 71.3 MB/s 2024-09-21T07:31:00.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129065 s, 81.2 MB/s 2024-09-21T07:31:00.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135231 s, 77.5 MB/s 2024-09-21T07:31:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017587 s, 59.6 MB/s 2024-09-21T07:31:00.103 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.104 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136925 s, 76.6 MB/s 2024-09-21T07:31:00.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013979 s, 75.0 MB/s 2024-09-21T07:31:00.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131153 s, 80.0 MB/s 2024-09-21T07:31:00.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160426 s, 65.4 MB/s 2024-09-21T07:31:00.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158494 s, 66.2 MB/s 2024-09-21T07:31:00.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148419 s, 70.6 MB/s 2024-09-21T07:31:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148748 s, 70.5 MB/s 2024-09-21T07:31:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143672 s, 73.0 MB/s 2024-09-21T07:31:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150468 s, 69.7 MB/s 2024-09-21T07:31:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.261 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141774 s, 74.0 MB/s 2024-09-21T07:31:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132701 s, 79.0 MB/s 2024-09-21T07:31:00.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.294 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135227 s, 77.5 MB/s 2024-09-21T07:31:00.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.310 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135284 s, 77.5 MB/s 2024-09-21T07:31:00.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.325 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130531 s, 80.3 MB/s 2024-09-21T07:31:00.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.343 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148236 s, 70.7 MB/s 2024-09-21T07:31:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136724 s, 76.7 MB/s 2024-09-21T07:31:00.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014456 s, 72.5 MB/s 2024-09-21T07:31:00.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.397 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183959 s, 57.0 MB/s 2024-09-21T07:31:00.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014597 s, 71.8 MB/s 2024-09-21T07:31:00.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018129 s, 57.8 MB/s 2024-09-21T07:31:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138702 s, 75.6 MB/s 2024-09-21T07:31:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.470 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148612 s, 70.6 MB/s 2024-09-21T07:31:00.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.486 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135996 s, 77.1 MB/s 2024-09-21T07:31:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130844 s, 80.1 MB/s 2024-09-21T07:31:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131387 s, 79.8 MB/s 2024-09-21T07:31:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150418 s, 69.7 MB/s 2024-09-21T07:31:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132511 s, 79.1 MB/s 2024-09-21T07:31:00.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.568 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139669 s, 75.1 MB/s 2024-09-21T07:31:00.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.7 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:00.575 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:00.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:00.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.686 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141991 s, 73.8 MB/s 2024-09-21T07:31:00.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151052 s, 69.4 MB/s 2024-09-21T07:31:00.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143876 s, 72.9 MB/s 2024-09-21T07:31:00.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.736 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134478 s, 78.0 MB/s 2024-09-21T07:31:00.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139068 s, 75.4 MB/s 2024-09-21T07:31:00.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148421 s, 70.6 MB/s 2024-09-21T07:31:00.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134316 s, 78.1 MB/s 2024-09-21T07:31:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136645 s, 76.7 MB/s 2024-09-21T07:31:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129929 s, 80.7 MB/s 2024-09-21T07:31:00.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136868 s, 76.6 MB/s 2024-09-21T07:31:00.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.851 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134319 s, 78.1 MB/s 2024-09-21T07:31:00.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141571 s, 74.1 MB/s 2024-09-21T07:31:00.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.885 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133623 s, 78.5 MB/s 2024-09-21T07:31:00.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.902 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151402 s, 69.3 MB/s 2024-09-21T07:31:00.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.917 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119312 s, 87.9 MB/s 2024-09-21T07:31:00.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.935 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152477 s, 68.8 MB/s 2024-09-21T07:31:00.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.951 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133889 s, 78.3 MB/s 2024-09-21T07:31:00.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.967 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127705 s, 82.1 MB/s 2024-09-21T07:31:00.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.983 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135693 s, 77.3 MB/s 2024-09-21T07:31:00.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:00.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:00.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135175 s, 77.6 MB/s 2024-09-21T07:31:01.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.015 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128147 s, 81.8 MB/s 2024-09-21T07:31:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148423 s, 70.6 MB/s 2024-09-21T07:31:01.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145456 s, 72.1 MB/s 2024-09-21T07:31:01.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148762 s, 70.5 MB/s 2024-09-21T07:31:01.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136633 s, 76.7 MB/s 2024-09-21T07:31:01.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146995 s, 71.3 MB/s 2024-09-21T07:31:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135965 s, 77.1 MB/s 2024-09-21T07:31:01.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136667 s, 76.7 MB/s 2024-09-21T07:31:01.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.148 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132867 s, 78.9 MB/s 2024-09-21T07:31:01.169 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.169 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.169 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181772 s, 57.7 MB/s 2024-09-21T07:31:01.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.186 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138477 s, 75.7 MB/s 2024-09-21T07:31:01.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.204 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137547 s, 76.2 MB/s 2024-09-21T07:31:01.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.8 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:01.211 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:01.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:01.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145063 s, 72.3 MB/s 2024-09-21T07:31:01.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142893 s, 73.4 MB/s 2024-09-21T07:31:01.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150084 s, 69.9 MB/s 2024-09-21T07:31:01.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131887 s, 79.5 MB/s 2024-09-21T07:31:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141545 s, 74.1 MB/s 2024-09-21T07:31:01.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.363 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137497 s, 76.3 MB/s 2024-09-21T07:31:01.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186105 s, 56.3 MB/s 2024-09-21T07:31:01.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.402 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144953 s, 72.3 MB/s 2024-09-21T07:31:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132957 s, 78.9 MB/s 2024-09-21T07:31:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128519 s, 81.6 MB/s 2024-09-21T07:31:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154641 s, 67.8 MB/s 2024-09-21T07:31:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148691 s, 70.5 MB/s 2024-09-21T07:31:01.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.485 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135987 s, 77.1 MB/s 2024-09-21T07:31:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.503 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148457 s, 70.6 MB/s 2024-09-21T07:31:01.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157894 s, 66.4 MB/s 2024-09-21T07:31:01.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139411 s, 75.2 MB/s 2024-09-21T07:31:01.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.553 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127431 s, 82.3 MB/s 2024-09-21T07:31:01.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.571 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147088 s, 71.3 MB/s 2024-09-21T07:31:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142944 s, 73.4 MB/s 2024-09-21T07:31:01.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.604 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137811 s, 76.1 MB/s 2024-09-21T07:31:01.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131433 s, 79.8 MB/s 2024-09-21T07:31:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137766 s, 76.1 MB/s 2024-09-21T07:31:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143663 s, 73.0 MB/s 2024-09-21T07:31:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014277 s, 73.4 MB/s 2024-09-21T07:31:01.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141534 s, 74.1 MB/s 2024-09-21T07:31:01.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150884 s, 69.5 MB/s 2024-09-21T07:31:01.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.726 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.726 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01818 s, 57.7 MB/s 2024-09-21T07:31:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140894 s, 74.4 MB/s 2024-09-21T07:31:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013293 s, 78.9 MB/s 2024-09-21T07:31:01.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013791 s, 76.0 MB/s 2024-09-21T07:31:01.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.790 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131422 s, 79.8 MB/s 2024-09-21T07:31:01.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.811 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180925 s, 58.0 MB/s 2024-09-21T07:31:01.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:01.818 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:01.818 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:01.819 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.9 2024-09-21T07:31:01.819 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:01.819 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:01.819 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:01.819 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:01.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149418 s, 70.2 MB/s 2024-09-21T07:31:01.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.905 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136851 s, 76.6 MB/s 2024-09-21T07:31:01.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143276 s, 73.2 MB/s 2024-09-21T07:31:01.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130698 s, 80.2 MB/s 2024-09-21T07:31:01.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.954 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133242 s, 78.7 MB/s 2024-09-21T07:31:01.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.975 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182724 s, 57.4 MB/s 2024-09-21T07:31:01.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:01.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:01.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133514 s, 78.5 MB/s 2024-09-21T07:31:02.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.006 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012366 s, 84.8 MB/s 2024-09-21T07:31:02.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171728 s, 61.1 MB/s 2024-09-21T07:31:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168727 s, 62.1 MB/s 2024-09-21T07:31:02.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145843 s, 71.9 MB/s 2024-09-21T07:31:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183569 s, 57.1 MB/s 2024-09-21T07:31:02.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147565 s, 71.1 MB/s 2024-09-21T07:31:02.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.117 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134136 s, 78.2 MB/s 2024-09-21T07:31:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013207 s, 79.4 MB/s 2024-09-21T07:31:02.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.155 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187772 s, 55.8 MB/s 2024-09-21T07:31:02.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177125 s, 59.2 MB/s 2024-09-21T07:31:02.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149551 s, 70.1 MB/s 2024-09-21T07:31:02.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014559 s, 72.0 MB/s 2024-09-21T07:31:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191154 s, 54.9 MB/s 2024-09-21T07:31:02.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143886 s, 72.9 MB/s 2024-09-21T07:31:02.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.266 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144747 s, 72.4 MB/s 2024-09-21T07:31:02.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148789 s, 70.5 MB/s 2024-09-21T07:31:02.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134227 s, 78.1 MB/s 2024-09-21T07:31:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127342 s, 82.3 MB/s 2024-09-21T07:31:02.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139882 s, 75.0 MB/s 2024-09-21T07:31:02.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013249 s, 79.1 MB/s 2024-09-21T07:31:02.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143125 s, 73.3 MB/s 2024-09-21T07:31:02.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.380 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130924 s, 80.1 MB/s 2024-09-21T07:31:02.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.397 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139976 s, 74.9 MB/s 2024-09-21T07:31:02.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.413 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013819 s, 75.9 MB/s 2024-09-21T07:31:02.429 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137064 s, 76.5 MB/s 2024-09-21T07:31:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.10 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:02.437 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:02.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152693 s, 68.7 MB/s 2024-09-21T07:31:02.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.566 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127381 s, 82.3 MB/s 2024-09-21T07:31:02.586 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01795 s, 58.4 MB/s 2024-09-21T07:31:02.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.603 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134606 s, 77.9 MB/s 2024-09-21T07:31:02.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.619 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136255 s, 77.0 MB/s 2024-09-21T07:31:02.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133402 s, 78.6 MB/s 2024-09-21T07:31:02.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148023 s, 70.8 MB/s 2024-09-21T07:31:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149386 s, 70.2 MB/s 2024-09-21T07:31:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137479 s, 76.3 MB/s 2024-09-21T07:31:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169491 s, 61.9 MB/s 2024-09-21T07:31:02.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175399 s, 59.8 MB/s 2024-09-21T07:31:02.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.743 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132634 s, 79.1 MB/s 2024-09-21T07:31:02.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.759 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131102 s, 80.0 MB/s 2024-09-21T07:31:02.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.780 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018042 s, 58.1 MB/s 2024-09-21T07:31:02.796 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.797 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.797 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142252 s, 73.7 MB/s 2024-09-21T07:31:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134557 s, 77.9 MB/s 2024-09-21T07:31:02.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.828 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127937 s, 82.0 MB/s 2024-09-21T07:31:02.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.846 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147157 s, 71.3 MB/s 2024-09-21T07:31:02.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150334 s, 69.7 MB/s 2024-09-21T07:31:02.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136329 s, 76.9 MB/s 2024-09-21T07:31:02.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.896 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134481 s, 78.0 MB/s 2024-09-21T07:31:02.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.914 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150111 s, 69.9 MB/s 2024-09-21T07:31:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149577 s, 70.1 MB/s 2024-09-21T07:31:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139183 s, 75.3 MB/s 2024-09-21T07:31:02.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.969 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185543 s, 56.5 MB/s 2024-09-21T07:31:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131666 s, 79.6 MB/s 2024-09-21T07:31:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176688 s, 59.3 MB/s 2024-09-21T07:31:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178809 s, 58.6 MB/s 2024-09-21T07:31:03.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.042 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132797 s, 79.0 MB/s 2024-09-21T07:31:03.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180008 s, 58.3 MB/s 2024-09-21T07:31:03.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137883 s, 76.0 MB/s 2024-09-21T07:31:03.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151695 s, 69.1 MB/s 2024-09-21T07:31:03.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:03.104 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:03.104 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.11 2024-09-21T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:03.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141099 s, 74.3 MB/s 2024-09-21T07:31:03.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158867 s, 66.0 MB/s 2024-09-21T07:31:03.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.208 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012614 s, 83.1 MB/s 2024-09-21T07:31:03.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145299 s, 72.2 MB/s 2024-09-21T07:31:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130997 s, 80.0 MB/s 2024-09-21T07:31:03.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136583 s, 76.8 MB/s 2024-09-21T07:31:03.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141572 s, 74.1 MB/s 2024-09-21T07:31:03.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.290 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013349 s, 78.6 MB/s 2024-09-21T07:31:03.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.306 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134363 s, 78.0 MB/s 2024-09-21T07:31:03.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139608 s, 75.1 MB/s 2024-09-21T07:31:03.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.338 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129135 s, 81.2 MB/s 2024-09-21T07:31:03.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183777 s, 57.1 MB/s 2024-09-21T07:31:03.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012824 s, 81.8 MB/s 2024-09-21T07:31:03.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139936 s, 74.9 MB/s 2024-09-21T07:31:03.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142238 s, 73.7 MB/s 2024-09-21T07:31:03.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132002 s, 79.4 MB/s 2024-09-21T07:31:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-09-21T07:31:03.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.458 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131739 s, 79.6 MB/s 2024-09-21T07:31:03.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.474 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133228 s, 78.7 MB/s 2024-09-21T07:31:03.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151029 s, 69.4 MB/s 2024-09-21T07:31:03.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017862 s, 58.7 MB/s 2024-09-21T07:31:03.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132997 s, 78.8 MB/s 2024-09-21T07:31:03.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143281 s, 73.2 MB/s 2024-09-21T07:31:03.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134374 s, 78.0 MB/s 2024-09-21T07:31:03.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.582 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178706 s, 58.7 MB/s 2024-09-21T07:31:03.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.599 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143315 s, 73.2 MB/s 2024-09-21T07:31:03.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.619 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174774 s, 60.0 MB/s 2024-09-21T07:31:03.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.640 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186811 s, 56.1 MB/s 2024-09-21T07:31:03.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145702 s, 72.0 MB/s 2024-09-21T07:31:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131933 s, 79.5 MB/s 2024-09-21T07:31:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147774 s, 71.0 MB/s 2024-09-21T07:31:03.709 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.709 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.709 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149258 s, 70.3 MB/s 2024-09-21T07:31:03.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:03.716 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:03.716 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:03.716 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.12 2024-09-21T07:31:03.717 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:03.717 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:03.717 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:03.717 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:03.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136951 s, 76.6 MB/s 2024-09-21T07:31:03.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136579 s, 76.8 MB/s 2024-09-21T07:31:03.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184314 s, 56.9 MB/s 2024-09-21T07:31:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012772 s, 82.1 MB/s 2024-09-21T07:31:03.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.856 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144255 s, 72.7 MB/s 2024-09-21T07:31:03.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.871 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133329 s, 78.6 MB/s 2024-09-21T07:31:03.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.889 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143992 s, 72.8 MB/s 2024-09-21T07:31:03.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125212 s, 83.7 MB/s 2024-09-21T07:31:03.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.919 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127456 s, 82.3 MB/s 2024-09-21T07:31:03.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.936 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132369 s, 79.2 MB/s 2024-09-21T07:31:03.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.953 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145791 s, 71.9 MB/s 2024-09-21T07:31:03.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143366 s, 73.1 MB/s 2024-09-21T07:31:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184659 s, 56.8 MB/s 2024-09-21T07:31:04.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143436 s, 73.1 MB/s 2024-09-21T07:31:04.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.028 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177343 s, 59.1 MB/s 2024-09-21T07:31:04.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.044 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133386 s, 78.6 MB/s 2024-09-21T07:31:04.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128959 s, 81.3 MB/s 2024-09-21T07:31:04.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142449 s, 73.6 MB/s 2024-09-21T07:31:04.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.093 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134023 s, 78.2 MB/s 2024-09-21T07:31:04.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.110 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147317 s, 71.2 MB/s 2024-09-21T07:31:04.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.127 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013976 s, 75.0 MB/s 2024-09-21T07:31:04.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.143 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133329 s, 78.6 MB/s 2024-09-21T07:31:04.159 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.160 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138523 s, 75.7 MB/s 2024-09-21T07:31:04.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.176 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132719 s, 79.0 MB/s 2024-09-21T07:31:04.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.197 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180636 s, 58.0 MB/s 2024-09-21T07:31:04.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128393 s, 81.7 MB/s 2024-09-21T07:31:04.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134296 s, 78.1 MB/s 2024-09-21T07:31:04.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013956 s, 75.1 MB/s 2024-09-21T07:31:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135191 s, 77.6 MB/s 2024-09-21T07:31:04.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.281 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175605 s, 59.7 MB/s 2024-09-21T07:31:04.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129369 s, 81.1 MB/s 2024-09-21T07:31:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137638 s, 76.2 MB/s 2024-09-21T07:31:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.13 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:04.321 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:04.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:04.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014988 s, 70.0 MB/s 2024-09-21T07:31:04.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131259 s, 79.9 MB/s 2024-09-21T07:31:04.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145378 s, 72.1 MB/s 2024-09-21T07:31:04.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.442 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015512 s, 67.6 MB/s 2024-09-21T07:31:04.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159621 s, 65.7 MB/s 2024-09-21T07:31:04.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013518 s, 77.6 MB/s 2024-09-21T07:31:04.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.495 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.495 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151211 s, 69.3 MB/s 2024-09-21T07:31:04.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143042 s, 73.3 MB/s 2024-09-21T07:31:04.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129909 s, 80.7 MB/s 2024-09-21T07:31:04.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132614 s, 79.1 MB/s 2024-09-21T07:31:04.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013039 s, 80.4 MB/s 2024-09-21T07:31:04.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.575 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135783 s, 77.2 MB/s 2024-09-21T07:31:04.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.592 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143014 s, 73.3 MB/s 2024-09-21T07:31:04.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.608 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138404 s, 75.8 MB/s 2024-09-21T07:31:04.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.629 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183316 s, 57.2 MB/s 2024-09-21T07:31:04.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.650 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179433 s, 58.4 MB/s 2024-09-21T07:31:04.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129401 s, 81.0 MB/s 2024-09-21T07:31:04.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142393 s, 73.6 MB/s 2024-09-21T07:31:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142255 s, 73.7 MB/s 2024-09-21T07:31:04.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132041 s, 79.4 MB/s 2024-09-21T07:31:04.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.731 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132635 s, 79.1 MB/s 2024-09-21T07:31:04.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176734 s, 59.3 MB/s 2024-09-21T07:31:04.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162895 s, 64.4 MB/s 2024-09-21T07:31:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127013 s, 82.6 MB/s 2024-09-21T07:31:04.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161718 s, 64.8 MB/s 2024-09-21T07:31:04.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.831 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204129 s, 51.4 MB/s 2024-09-21T07:31:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128081 s, 81.9 MB/s 2024-09-21T07:31:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147138 s, 71.3 MB/s 2024-09-21T07:31:04.882 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156537 s, 67.0 MB/s 2024-09-21T07:31:04.903 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186606 s, 56.2 MB/s 2024-09-21T07:31:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135982 s, 77.1 MB/s 2024-09-21T07:31:04.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:04.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:04.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151508 s, 69.2 MB/s 2024-09-21T07:31:04.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.14 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:04.945 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:05.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.018 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179886 s, 58.3 MB/s 2024-09-21T07:31:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162583 s, 64.5 MB/s 2024-09-21T07:31:05.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.057 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173473 s, 60.4 MB/s 2024-09-21T07:31:05.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176767 s, 59.3 MB/s 2024-09-21T07:31:05.098 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.098 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.098 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018728 s, 56.0 MB/s 2024-09-21T07:31:05.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140798 s, 74.5 MB/s 2024-09-21T07:31:05.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.131 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129139 s, 81.2 MB/s 2024-09-21T07:31:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014228 s, 73.7 MB/s 2024-09-21T07:31:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131473 s, 79.8 MB/s 2024-09-21T07:31:05.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184779 s, 56.7 MB/s 2024-09-21T07:31:05.201 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.202 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.202 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145722 s, 72.0 MB/s 2024-09-21T07:31:05.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181181 s, 57.9 MB/s 2024-09-21T07:31:05.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.240 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146412 s, 71.6 MB/s 2024-09-21T07:31:05.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138993 s, 75.4 MB/s 2024-09-21T07:31:05.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142945 s, 73.4 MB/s 2024-09-21T07:31:05.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129197 s, 81.2 MB/s 2024-09-21T07:31:05.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134715 s, 77.8 MB/s 2024-09-21T07:31:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130065 s, 80.6 MB/s 2024-09-21T07:31:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133914 s, 78.3 MB/s 2024-09-21T07:31:05.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144199 s, 72.7 MB/s 2024-09-21T07:31:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014733 s, 71.2 MB/s 2024-09-21T07:31:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133991 s, 78.3 MB/s 2024-09-21T07:31:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.405 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148281 s, 70.7 MB/s 2024-09-21T07:31:05.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149297 s, 70.2 MB/s 2024-09-21T07:31:05.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.438 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129516 s, 81.0 MB/s 2024-09-21T07:31:05.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180309 s, 58.2 MB/s 2024-09-21T07:31:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134787 s, 77.8 MB/s 2024-09-21T07:31:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115521 s, 90.8 MB/s 2024-09-21T07:31:05.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132975 s, 78.9 MB/s 2024-09-21T07:31:05.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129669 s, 80.9 MB/s 2024-09-21T07:31:05.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147929 s, 70.9 MB/s 2024-09-21T07:31:05.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012775 s, 82.1 MB/s 2024-09-21T07:31:05.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:05.561 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:05.561 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:05.561 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.15 2024-09-21T07:31:05.561 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:05.561 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:05.562 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:05.562 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:05.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135786 s, 77.2 MB/s 2024-09-21T07:31:05.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.646 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141291 s, 74.2 MB/s 2024-09-21T07:31:05.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133954 s, 78.3 MB/s 2024-09-21T07:31:05.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153245 s, 68.4 MB/s 2024-09-21T07:31:05.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134141 s, 78.2 MB/s 2024-09-21T07:31:05.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.714 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145053 s, 72.3 MB/s 2024-09-21T07:31:05.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.731 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014625 s, 71.7 MB/s 2024-09-21T07:31:05.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170074 s, 61.7 MB/s 2024-09-21T07:31:05.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145963 s, 71.8 MB/s 2024-09-21T07:31:05.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141306 s, 74.2 MB/s 2024-09-21T07:31:05.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148341 s, 70.7 MB/s 2024-09-21T07:31:05.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185711 s, 56.5 MB/s 2024-09-21T07:31:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129148 s, 81.2 MB/s 2024-09-21T07:31:05.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.855 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013942 s, 75.2 MB/s 2024-09-21T07:31:05.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.871 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130603 s, 80.3 MB/s 2024-09-21T07:31:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146928 s, 71.4 MB/s 2024-09-21T07:31:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132015 s, 79.4 MB/s 2024-09-21T07:31:05.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.919 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129949 s, 80.7 MB/s 2024-09-21T07:31:05.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.937 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144089 s, 72.8 MB/s 2024-09-21T07:31:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148474 s, 70.6 MB/s 2024-09-21T07:31:05.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135294 s, 77.5 MB/s 2024-09-21T07:31:05.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:05.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:05.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134076 s, 78.2 MB/s 2024-09-21T07:31:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.002 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132173 s, 79.3 MB/s 2024-09-21T07:31:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.018 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128126 s, 81.8 MB/s 2024-09-21T07:31:06.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.036 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151807 s, 69.1 MB/s 2024-09-21T07:31:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.054 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148814 s, 70.5 MB/s 2024-09-21T07:31:06.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149208 s, 70.3 MB/s 2024-09-21T07:31:06.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.089 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142934 s, 73.4 MB/s 2024-09-21T07:31:06.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.108 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176435 s, 59.4 MB/s 2024-09-21T07:31:06.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129061 s, 81.2 MB/s 2024-09-21T07:31:06.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.140 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133874 s, 78.3 MB/s 2024-09-21T07:31:06.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.155 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121488 s, 86.3 MB/s 2024-09-21T07:31:06.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.16 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:06.162 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:06.163 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:06.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145511 s, 72.1 MB/s 2024-09-21T07:31:06.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141609 s, 74.0 MB/s 2024-09-21T07:31:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136243 s, 77.0 MB/s 2024-09-21T07:31:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135473 s, 77.4 MB/s 2024-09-21T07:31:06.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141678 s, 74.0 MB/s 2024-09-21T07:31:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131139 s, 80.0 MB/s 2024-09-21T07:31:06.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135706 s, 77.3 MB/s 2024-09-21T07:31:06.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.348 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149256 s, 70.3 MB/s 2024-09-21T07:31:06.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.361 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010666 s, 98.3 MB/s 2024-09-21T07:31:06.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136311 s, 76.9 MB/s 2024-09-21T07:31:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132987 s, 78.8 MB/s 2024-09-21T07:31:06.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.411 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148653 s, 70.5 MB/s 2024-09-21T07:31:06.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185117 s, 56.6 MB/s 2024-09-21T07:31:06.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164952 s, 63.6 MB/s 2024-09-21T07:31:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147457 s, 71.1 MB/s 2024-09-21T07:31:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.486 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014461 s, 72.5 MB/s 2024-09-21T07:31:06.504 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.504 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.504 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153984 s, 68.1 MB/s 2024-09-21T07:31:06.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167219 s, 62.7 MB/s 2024-09-21T07:31:06.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.539 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130655 s, 80.3 MB/s 2024-09-21T07:31:06.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.556 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.556 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136887 s, 76.6 MB/s 2024-09-21T07:31:06.573 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.573 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.573 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145204 s, 72.2 MB/s 2024-09-21T07:31:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149076 s, 70.3 MB/s 2024-09-21T07:31:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127551 s, 82.2 MB/s 2024-09-21T07:31:06.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.622 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137742 s, 76.1 MB/s 2024-09-21T07:31:06.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193189 s, 54.3 MB/s 2024-09-21T07:31:06.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.661 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141921 s, 73.9 MB/s 2024-09-21T07:31:06.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-09-21T07:31:06.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131612 s, 79.7 MB/s 2024-09-21T07:31:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148613 s, 70.6 MB/s 2024-09-21T07:31:06.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129382 s, 81.0 MB/s 2024-09-21T07:31:06.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.744 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134642 s, 77.9 MB/s 2024-09-21T07:31:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142589 s, 73.5 MB/s 2024-09-21T07:31:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:06.768 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.17 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:06.769 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:06.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:06.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.837 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130457 s, 80.4 MB/s 2024-09-21T07:31:06.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129773 s, 80.8 MB/s 2024-09-21T07:31:06.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128738 s, 81.5 MB/s 2024-09-21T07:31:06.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.885 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151188 s, 69.4 MB/s 2024-09-21T07:31:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132699 s, 79.0 MB/s 2024-09-21T07:31:06.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175009 s, 59.9 MB/s 2024-09-21T07:31:06.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131122 s, 80.0 MB/s 2024-09-21T07:31:06.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143491 s, 73.1 MB/s 2024-09-21T07:31:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154258 s, 68.0 MB/s 2024-09-21T07:31:06.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:06.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:06.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132246 s, 79.3 MB/s 2024-09-21T07:31:07.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.004 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131018 s, 80.0 MB/s 2024-09-21T07:31:07.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.025 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176205 s, 59.5 MB/s 2024-09-21T07:31:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157802 s, 66.4 MB/s 2024-09-21T07:31:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133053 s, 78.8 MB/s 2024-09-21T07:31:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136427 s, 76.9 MB/s 2024-09-21T07:31:07.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147186 s, 71.2 MB/s 2024-09-21T07:31:07.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129167 s, 81.2 MB/s 2024-09-21T07:31:07.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129533 s, 81.0 MB/s 2024-09-21T07:31:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142677 s, 73.5 MB/s 2024-09-21T07:31:07.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110049 s, 95.3 MB/s 2024-09-21T07:31:07.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147668 s, 71.0 MB/s 2024-09-21T07:31:07.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.189 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129596 s, 80.9 MB/s 2024-09-21T07:31:07.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150626 s, 69.6 MB/s 2024-09-21T07:31:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.223 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134224 s, 78.1 MB/s 2024-09-21T07:31:07.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132889 s, 78.9 MB/s 2024-09-21T07:31:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182529 s, 57.4 MB/s 2024-09-21T07:31:07.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.275 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130941 s, 80.1 MB/s 2024-09-21T07:31:07.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.292 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013912 s, 75.4 MB/s 2024-09-21T07:31:07.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147889 s, 70.9 MB/s 2024-09-21T07:31:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140072 s, 74.9 MB/s 2024-09-21T07:31:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142627 s, 73.5 MB/s 2024-09-21T07:31:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175402 s, 59.8 MB/s 2024-09-21T07:31:07.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:07.370 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:07.370 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:07.370 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.18 2024-09-21T07:31:07.371 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:07.371 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:07.371 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:07.371 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:07.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:07.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.445 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197634 s, 53.1 MB/s 2024-09-21T07:31:07.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139187 s, 75.3 MB/s 2024-09-21T07:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135527 s, 77.4 MB/s 2024-09-21T07:31:07.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130691 s, 80.2 MB/s 2024-09-21T07:31:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181477 s, 57.8 MB/s 2024-09-21T07:31:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.531 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134647 s, 77.9 MB/s 2024-09-21T07:31:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.549 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157089 s, 66.8 MB/s 2024-09-21T07:31:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.566 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141563 s, 74.1 MB/s 2024-09-21T07:31:07.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131293 s, 79.9 MB/s 2024-09-21T07:31:07.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.598 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137141 s, 76.5 MB/s 2024-09-21T07:31:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145648 s, 72.0 MB/s 2024-09-21T07:31:07.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.631 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132307 s, 79.3 MB/s 2024-09-21T07:31:07.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.649 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148531 s, 70.6 MB/s 2024-09-21T07:31:07.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135872 s, 77.2 MB/s 2024-09-21T07:31:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.686 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185887 s, 56.4 MB/s 2024-09-21T07:31:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144747 s, 72.4 MB/s 2024-09-21T07:31:07.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.726 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.726 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018222 s, 57.5 MB/s 2024-09-21T07:31:07.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.743 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139574 s, 75.1 MB/s 2024-09-21T07:31:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012742 s, 82.3 MB/s 2024-09-21T07:31:07.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143689 s, 73.0 MB/s 2024-09-21T07:31:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133641 s, 78.5 MB/s 2024-09-21T07:31:07.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137945 s, 76.0 MB/s 2024-09-21T07:31:07.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137206 s, 76.4 MB/s 2024-09-21T07:31:07.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174058 s, 60.2 MB/s 2024-09-21T07:31:07.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134101 s, 78.2 MB/s 2024-09-21T07:31:07.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018611 s, 56.3 MB/s 2024-09-21T07:31:07.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.898 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132752 s, 79.0 MB/s 2024-09-21T07:31:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139967 s, 74.9 MB/s 2024-09-21T07:31:07.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.930 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132919 s, 78.9 MB/s 2024-09-21T07:31:07.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.952 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187511 s, 55.9 MB/s 2024-09-21T07:31:07.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151431 s, 69.2 MB/s 2024-09-21T07:31:07.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:07.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130806 s, 80.2 MB/s 2024-09-21T07:31:07.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.19 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:07.993 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:08.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:08.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145374 s, 72.1 MB/s 2024-09-21T07:31:08.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132153 s, 79.3 MB/s 2024-09-21T07:31:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145554 s, 72.0 MB/s 2024-09-21T07:31:08.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.117 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183886 s, 57.0 MB/s 2024-09-21T07:31:08.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131801 s, 79.6 MB/s 2024-09-21T07:31:08.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.151 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155466 s, 67.4 MB/s 2024-09-21T07:31:08.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193932 s, 54.1 MB/s 2024-09-21T07:31:08.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145582 s, 72.0 MB/s 2024-09-21T07:31:08.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131887 s, 79.5 MB/s 2024-09-21T07:31:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179401 s, 58.4 MB/s 2024-09-21T07:31:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143377 s, 73.1 MB/s 2024-09-21T07:31:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147471 s, 71.1 MB/s 2024-09-21T07:31:08.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.278 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.278 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137533 s, 76.2 MB/s 2024-09-21T07:31:08.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166766 s, 62.9 MB/s 2024-09-21T07:31:08.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144026 s, 72.8 MB/s 2024-09-21T07:31:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136709 s, 76.7 MB/s 2024-09-21T07:31:08.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.348 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145878 s, 71.9 MB/s 2024-09-21T07:31:08.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.365 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145781 s, 71.9 MB/s 2024-09-21T07:31:08.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.381 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126085 s, 83.2 MB/s 2024-09-21T07:31:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146619 s, 71.5 MB/s 2024-09-21T07:31:08.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012818 s, 81.8 MB/s 2024-09-21T07:31:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138562 s, 75.7 MB/s 2024-09-21T07:31:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137611 s, 76.2 MB/s 2024-09-21T07:31:08.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.463 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133935 s, 78.3 MB/s 2024-09-21T07:31:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150745 s, 69.6 MB/s 2024-09-21T07:31:08.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.496 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012982 s, 80.8 MB/s 2024-09-21T07:31:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131978 s, 79.5 MB/s 2024-09-21T07:31:08.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184432 s, 56.9 MB/s 2024-09-21T07:31:08.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148605 s, 70.6 MB/s 2024-09-21T07:31:08.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135259 s, 77.5 MB/s 2024-09-21T07:31:08.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138197 s, 75.9 MB/s 2024-09-21T07:31:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141208 s, 74.3 MB/s 2024-09-21T07:31:08.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.20 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:08.607 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:08.608 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:08.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:08.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.678 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153422 s, 68.3 MB/s 2024-09-21T07:31:08.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147226 s, 71.2 MB/s 2024-09-21T07:31:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013962 s, 75.1 MB/s 2024-09-21T07:31:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017785 s, 59.0 MB/s 2024-09-21T07:31:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148068 s, 70.8 MB/s 2024-09-21T07:31:08.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.766 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133561 s, 78.5 MB/s 2024-09-21T07:31:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142209 s, 73.7 MB/s 2024-09-21T07:31:08.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130373 s, 80.4 MB/s 2024-09-21T07:31:08.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.815 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132248 s, 79.3 MB/s 2024-09-21T07:31:08.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.832 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150267 s, 69.8 MB/s 2024-09-21T07:31:08.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.848 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129192 s, 81.2 MB/s 2024-09-21T07:31:08.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.866 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134975 s, 77.7 MB/s 2024-09-21T07:31:08.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139183 s, 75.3 MB/s 2024-09-21T07:31:08.898 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.898 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.898 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142201 s, 73.7 MB/s 2024-09-21T07:31:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01327 s, 79.0 MB/s 2024-09-21T07:31:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186594 s, 56.2 MB/s 2024-09-21T07:31:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136848 s, 76.6 MB/s 2024-09-21T07:31:08.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184439 s, 56.9 MB/s 2024-09-21T07:31:08.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:08.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:08.989 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129006 s, 81.3 MB/s 2024-09-21T07:31:09.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.005 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136728 s, 76.7 MB/s 2024-09-21T07:31:09.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187062 s, 56.1 MB/s 2024-09-21T07:31:09.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.043 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137415 s, 76.3 MB/s 2024-09-21T07:31:09.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181074 s, 57.9 MB/s 2024-09-21T07:31:09.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137105 s, 76.5 MB/s 2024-09-21T07:31:09.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.102 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193371 s, 54.2 MB/s 2024-09-21T07:31:09.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.118 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132536 s, 79.1 MB/s 2024-09-21T07:31:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.135 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138717 s, 75.6 MB/s 2024-09-21T07:31:09.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013992 s, 74.9 MB/s 2024-09-21T07:31:09.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.172 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181716 s, 57.7 MB/s 2024-09-21T07:31:09.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.189 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141069 s, 74.3 MB/s 2024-09-21T07:31:09.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.206 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136476 s, 76.8 MB/s 2024-09-21T07:31:09.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133402 s, 78.6 MB/s 2024-09-21T07:31:09.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.21 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:09.229 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:09.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:09.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.303 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184054 s, 57.0 MB/s 2024-09-21T07:31:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136936 s, 76.6 MB/s 2024-09-21T07:31:09.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014782 s, 70.9 MB/s 2024-09-21T07:31:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171675 s, 61.1 MB/s 2024-09-21T07:31:09.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179234 s, 58.5 MB/s 2024-09-21T07:31:09.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013474 s, 77.8 MB/s 2024-09-21T07:31:09.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144672 s, 72.5 MB/s 2024-09-21T07:31:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183732 s, 57.1 MB/s 2024-09-21T07:31:09.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014116 s, 74.3 MB/s 2024-09-21T07:31:09.465 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.465 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.465 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146634 s, 71.5 MB/s 2024-09-21T07:31:09.483 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158206 s, 66.3 MB/s 2024-09-21T07:31:09.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.500 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132854 s, 78.9 MB/s 2024-09-21T07:31:09.515 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.515 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131328 s, 79.8 MB/s 2024-09-21T07:31:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.533 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142447 s, 73.6 MB/s 2024-09-21T07:31:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135832 s, 77.2 MB/s 2024-09-21T07:31:09.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.565 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136456 s, 76.8 MB/s 2024-09-21T07:31:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132349 s, 79.2 MB/s 2024-09-21T07:31:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133223 s, 78.7 MB/s 2024-09-21T07:31:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131087 s, 80.0 MB/s 2024-09-21T07:31:09.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.628 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118402 s, 88.6 MB/s 2024-09-21T07:31:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146752 s, 71.5 MB/s 2024-09-21T07:31:09.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150357 s, 69.7 MB/s 2024-09-21T07:31:09.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136767 s, 76.7 MB/s 2024-09-21T07:31:09.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131397 s, 79.8 MB/s 2024-09-21T07:31:09.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142316 s, 73.7 MB/s 2024-09-21T07:31:09.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130671 s, 80.2 MB/s 2024-09-21T07:31:09.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144205 s, 72.7 MB/s 2024-09-21T07:31:09.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.764 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161798 s, 64.8 MB/s 2024-09-21T07:31:09.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161252 s, 65.0 MB/s 2024-09-21T07:31:09.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.800 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136739 s, 76.7 MB/s 2024-09-21T07:31:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134409 s, 78.0 MB/s 2024-09-21T07:31:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141651 s, 74.0 MB/s 2024-09-21T07:31:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.22 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:09.842 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:09.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145193 s, 72.2 MB/s 2024-09-21T07:31:09.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133559 s, 78.5 MB/s 2024-09-21T07:31:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131098 s, 80.0 MB/s 2024-09-21T07:31:09.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152263 s, 68.9 MB/s 2024-09-21T07:31:09.965 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:09.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:09.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130903 s, 80.1 MB/s 2024-09-21T07:31:09.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:09.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:09.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146834 s, 71.4 MB/s 2024-09-21T07:31:10.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134086 s, 78.2 MB/s 2024-09-21T07:31:10.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143878 s, 72.9 MB/s 2024-09-21T07:31:10.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132949 s, 78.9 MB/s 2024-09-21T07:31:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141192 s, 74.3 MB/s 2024-09-21T07:31:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180724 s, 58.0 MB/s 2024-09-21T07:31:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144569 s, 72.5 MB/s 2024-09-21T07:31:10.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134901 s, 77.7 MB/s 2024-09-21T07:31:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137402 s, 76.3 MB/s 2024-09-21T07:31:10.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133897 s, 78.3 MB/s 2024-09-21T07:31:10.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.168 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147671 s, 71.0 MB/s 2024-09-21T07:31:10.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141085 s, 74.3 MB/s 2024-09-21T07:31:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132312 s, 79.3 MB/s 2024-09-21T07:31:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144463 s, 72.6 MB/s 2024-09-21T07:31:10.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013347 s, 78.6 MB/s 2024-09-21T07:31:10.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122908 s, 85.3 MB/s 2024-09-21T07:31:10.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.264 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012873 s, 81.5 MB/s 2024-09-21T07:31:10.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135064 s, 77.6 MB/s 2024-09-21T07:31:10.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151465 s, 69.2 MB/s 2024-09-21T07:31:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133192 s, 78.7 MB/s 2024-09-21T07:31:10.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135287 s, 77.5 MB/s 2024-09-21T07:31:10.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131969 s, 79.5 MB/s 2024-09-21T07:31:10.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139805 s, 75.0 MB/s 2024-09-21T07:31:10.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.379 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142409 s, 73.6 MB/s 2024-09-21T07:31:10.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.396 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144838 s, 72.4 MB/s 2024-09-21T07:31:10.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131105 s, 80.0 MB/s 2024-09-21T07:31:10.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.428 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132215 s, 79.3 MB/s 2024-09-21T07:31:10.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.23 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:10.435 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:10.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140351 s, 74.7 MB/s 2024-09-21T07:31:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184381 s, 56.9 MB/s 2024-09-21T07:31:10.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147578 s, 71.1 MB/s 2024-09-21T07:31:10.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142947 s, 73.4 MB/s 2024-09-21T07:31:10.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.619 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155018 s, 67.6 MB/s 2024-09-21T07:31:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132645 s, 79.1 MB/s 2024-09-21T07:31:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148362 s, 70.7 MB/s 2024-09-21T07:31:10.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.668 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133718 s, 78.4 MB/s 2024-09-21T07:31:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01446 s, 72.5 MB/s 2024-09-21T07:31:10.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136257 s, 77.0 MB/s 2024-09-21T07:31:10.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167779 s, 62.5 MB/s 2024-09-21T07:31:10.737 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.737 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.737 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131083 s, 80.0 MB/s 2024-09-21T07:31:10.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132448 s, 79.2 MB/s 2024-09-21T07:31:10.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.774 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181451 s, 57.8 MB/s 2024-09-21T07:31:10.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014039 s, 74.7 MB/s 2024-09-21T07:31:10.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.808 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146934 s, 71.4 MB/s 2024-09-21T07:31:10.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136079 s, 77.1 MB/s 2024-09-21T07:31:10.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013605 s, 77.1 MB/s 2024-09-21T07:31:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130952 s, 80.1 MB/s 2024-09-21T07:31:10.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.872 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133183 s, 78.7 MB/s 2024-09-21T07:31:10.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.893 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176795 s, 59.3 MB/s 2024-09-21T07:31:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129752 s, 80.8 MB/s 2024-09-21T07:31:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129995 s, 80.7 MB/s 2024-09-21T07:31:10.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132736 s, 79.0 MB/s 2024-09-21T07:31:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-09-21T07:31:10.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131823 s, 79.5 MB/s 2024-09-21T07:31:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015163 s, 69.2 MB/s 2024-09-21T07:31:11.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017628 s, 59.5 MB/s 2024-09-21T07:31:11.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147909 s, 70.9 MB/s 2024-09-21T07:31:11.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141715 s, 74.0 MB/s 2024-09-21T07:31:11.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146652 s, 71.5 MB/s 2024-09-21T07:31:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133941 s, 78.3 MB/s 2024-09-21T07:31:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:11.086 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.24 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:11.087 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:11.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:11.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132859 s, 78.9 MB/s 2024-09-21T07:31:11.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.172 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146553 s, 71.5 MB/s 2024-09-21T07:31:11.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.189 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147685 s, 71.0 MB/s 2024-09-21T07:31:11.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143315 s, 73.2 MB/s 2024-09-21T07:31:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133497 s, 78.5 MB/s 2024-09-21T07:31:11.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134042 s, 78.2 MB/s 2024-09-21T07:31:11.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133702 s, 78.4 MB/s 2024-09-21T07:31:11.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137112 s, 76.5 MB/s 2024-09-21T07:31:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113259 s, 92.6 MB/s 2024-09-21T07:31:11.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.303 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149882 s, 70.0 MB/s 2024-09-21T07:31:11.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133007 s, 78.8 MB/s 2024-09-21T07:31:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182319 s, 57.5 MB/s 2024-09-21T07:31:11.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146821 s, 71.4 MB/s 2024-09-21T07:31:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143074 s, 73.3 MB/s 2024-09-21T07:31:11.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014721 s, 71.2 MB/s 2024-09-21T07:31:11.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.408 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146691 s, 71.5 MB/s 2024-09-21T07:31:11.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128778 s, 81.4 MB/s 2024-09-21T07:31:11.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140282 s, 74.7 MB/s 2024-09-21T07:31:11.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138696 s, 75.6 MB/s 2024-09-21T07:31:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134006 s, 78.2 MB/s 2024-09-21T07:31:11.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138212 s, 75.9 MB/s 2024-09-21T07:31:11.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144216 s, 72.7 MB/s 2024-09-21T07:31:11.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142761 s, 73.4 MB/s 2024-09-21T07:31:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137882 s, 76.0 MB/s 2024-09-21T07:31:11.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.557 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014192 s, 73.9 MB/s 2024-09-21T07:31:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126043 s, 83.2 MB/s 2024-09-21T07:31:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128463 s, 81.6 MB/s 2024-09-21T07:31:11.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.604 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137749 s, 76.1 MB/s 2024-09-21T07:31:11.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01337 s, 78.4 MB/s 2024-09-21T07:31:11.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.640 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174619 s, 60.0 MB/s 2024-09-21T07:31:11.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147525 s, 71.1 MB/s 2024-09-21T07:31:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131449 s, 79.8 MB/s 2024-09-21T07:31:11.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.25 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:11.681 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:11.682 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:11.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:11.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136041 s, 77.1 MB/s 2024-09-21T07:31:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014932 s, 70.2 MB/s 2024-09-21T07:31:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130154 s, 80.6 MB/s 2024-09-21T07:31:11.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.801 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149056 s, 70.3 MB/s 2024-09-21T07:31:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148684 s, 70.5 MB/s 2024-09-21T07:31:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146734 s, 71.5 MB/s 2024-09-21T07:31:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153997 s, 68.1 MB/s 2024-09-21T07:31:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132051 s, 79.4 MB/s 2024-09-21T07:31:11.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.887 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149248 s, 70.3 MB/s 2024-09-21T07:31:11.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.907 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175226 s, 59.8 MB/s 2024-09-21T07:31:11.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01465 s, 71.6 MB/s 2024-09-21T07:31:11.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134556 s, 77.9 MB/s 2024-09-21T07:31:11.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186895 s, 56.1 MB/s 2024-09-21T07:31:11.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.978 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013268 s, 79.0 MB/s 2024-09-21T07:31:11.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:11.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:11.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129534 s, 81.0 MB/s 2024-09-21T07:31:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014662 s, 71.5 MB/s 2024-09-21T07:31:12.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176174 s, 59.5 MB/s 2024-09-21T07:31:12.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169262 s, 61.9 MB/s 2024-09-21T07:31:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135688 s, 77.3 MB/s 2024-09-21T07:31:12.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013315 s, 78.8 MB/s 2024-09-21T07:31:12.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139275 s, 75.3 MB/s 2024-09-21T07:31:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148712 s, 70.5 MB/s 2024-09-21T07:31:12.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013576 s, 77.2 MB/s 2024-09-21T07:31:12.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154793 s, 67.7 MB/s 2024-09-21T07:31:12.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.168 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132533 s, 79.1 MB/s 2024-09-21T07:31:12.185 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.185 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.185 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150196 s, 69.8 MB/s 2024-09-21T07:31:12.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.203 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154553 s, 67.8 MB/s 2024-09-21T07:31:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148909 s, 70.4 MB/s 2024-09-21T07:31:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146401 s, 71.6 MB/s 2024-09-21T07:31:12.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.254 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127565 s, 82.2 MB/s 2024-09-21T07:31:12.270 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013653 s, 76.8 MB/s 2024-09-21T07:31:12.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.288 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147522 s, 71.1 MB/s 2024-09-21T07:31:12.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.26 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:12.296 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176852 s, 59.3 MB/s 2024-09-21T07:31:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134434 s, 78.0 MB/s 2024-09-21T07:31:12.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013009 s, 80.6 MB/s 2024-09-21T07:31:12.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.419 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147377 s, 71.1 MB/s 2024-09-21T07:31:12.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.437 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014765 s, 71.0 MB/s 2024-09-21T07:31:12.454 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.455 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148934 s, 70.4 MB/s 2024-09-21T07:31:12.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148449 s, 70.6 MB/s 2024-09-21T07:31:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137242 s, 76.4 MB/s 2024-09-21T07:31:12.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187289 s, 56.0 MB/s 2024-09-21T07:31:12.532 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.532 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.532 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190071 s, 55.2 MB/s 2024-09-21T07:31:12.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.549 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148027 s, 70.8 MB/s 2024-09-21T07:31:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179996 s, 58.3 MB/s 2024-09-21T07:31:12.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150436 s, 69.7 MB/s 2024-09-21T07:31:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013662 s, 76.8 MB/s 2024-09-21T07:31:12.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130239 s, 80.5 MB/s 2024-09-21T07:31:12.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018194 s, 57.6 MB/s 2024-09-21T07:31:12.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.659 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145607 s, 72.0 MB/s 2024-09-21T07:31:12.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.675 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-21T07:31:12.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136883 s, 76.6 MB/s 2024-09-21T07:31:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130872 s, 80.1 MB/s 2024-09-21T07:31:12.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143595 s, 73.0 MB/s 2024-09-21T07:31:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131797 s, 79.6 MB/s 2024-09-21T07:31:12.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:12.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:12.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109264 s, 96.0 MB/s 2024-09-21T07:31:12.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138624 s, 75.6 MB/s 2024-09-21T07:31:13.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142241 s, 73.7 MB/s 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142026 s, 73.8 MB/s 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132721 s, 79.0 MB/s 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132136 s, 79.4 MB/s 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132354 s, 79.2 MB/s 2024-09-21T07:31:13.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146919 s, 71.4 MB/s 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144809 s, 72.4 MB/s 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176807 s, 59.3 MB/s 2024-09-21T07:31:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:13.081 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:13.081 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:13.082 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.27 2024-09-21T07:31:13.082 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:13.082 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:13.082 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:13.082 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:13.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:13.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.155 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151307 s, 69.3 MB/s 2024-09-21T07:31:13.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174051 s, 60.2 MB/s 2024-09-21T07:31:13.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137377 s, 76.3 MB/s 2024-09-21T07:31:13.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134726 s, 77.8 MB/s 2024-09-21T07:31:13.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147579 s, 71.1 MB/s 2024-09-21T07:31:13.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147988 s, 70.9 MB/s 2024-09-21T07:31:13.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123597 s, 84.8 MB/s 2024-09-21T07:31:13.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142128 s, 73.8 MB/s 2024-09-21T07:31:13.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128228 s, 81.8 MB/s 2024-09-21T07:31:13.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.308 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146933 s, 71.4 MB/s 2024-09-21T07:31:13.320 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108631 s, 96.5 MB/s 2024-09-21T07:31:13.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.337 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-21T07:31:13.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147898 s, 70.9 MB/s 2024-09-21T07:31:13.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.370 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133433 s, 78.6 MB/s 2024-09-21T07:31:13.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188859 s, 55.5 MB/s 2024-09-21T07:31:13.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142445 s, 73.6 MB/s 2024-09-21T07:31:13.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129567 s, 80.9 MB/s 2024-09-21T07:31:13.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.445 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183319 s, 57.2 MB/s 2024-09-21T07:31:13.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142911 s, 73.4 MB/s 2024-09-21T07:31:13.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.479 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137849 s, 76.1 MB/s 2024-09-21T07:31:13.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129067 s, 81.2 MB/s 2024-09-21T07:31:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135062 s, 77.6 MB/s 2024-09-21T07:31:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128113 s, 81.8 MB/s 2024-09-21T07:31:13.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146089 s, 71.8 MB/s 2024-09-21T07:31:13.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147352 s, 71.2 MB/s 2024-09-21T07:31:13.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.576 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130386 s, 80.4 MB/s 2024-09-21T07:31:13.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.593 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136265 s, 77.0 MB/s 2024-09-21T07:31:13.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147269 s, 71.2 MB/s 2024-09-21T07:31:13.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132145 s, 79.4 MB/s 2024-09-21T07:31:13.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.643 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143919 s, 72.9 MB/s 2024-09-21T07:31:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.659 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132001 s, 79.4 MB/s 2024-09-21T07:31:13.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.677 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.677 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147096 s, 71.3 MB/s 2024-09-21T07:31:13.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.28 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:13.684 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:13.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135182 s, 77.6 MB/s 2024-09-21T07:31:13.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118586 s, 88.4 MB/s 2024-09-21T07:31:13.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.789 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183306 s, 57.2 MB/s 2024-09-21T07:31:13.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137858 s, 76.1 MB/s 2024-09-21T07:31:13.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.821 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013526 s, 77.5 MB/s 2024-09-21T07:31:13.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.837 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132438 s, 79.2 MB/s 2024-09-21T07:31:13.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176152 s, 59.5 MB/s 2024-09-21T07:31:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149257 s, 70.3 MB/s 2024-09-21T07:31:13.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.891 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131223 s, 79.9 MB/s 2024-09-21T07:31:13.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.907 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129119 s, 81.2 MB/s 2024-09-21T07:31:13.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145823 s, 71.9 MB/s 2024-09-21T07:31:13.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132218 s, 79.3 MB/s 2024-09-21T07:31:13.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166354 s, 63.0 MB/s 2024-09-21T07:31:13.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175907 s, 59.6 MB/s 2024-09-21T07:31:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128537 s, 81.6 MB/s 2024-09-21T07:31:14.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128828 s, 81.4 MB/s 2024-09-21T07:31:14.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138674 s, 75.6 MB/s 2024-09-21T07:31:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144615 s, 72.5 MB/s 2024-09-21T07:31:14.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130793 s, 80.2 MB/s 2024-09-21T07:31:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145952 s, 71.8 MB/s 2024-09-21T07:31:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147448 s, 71.1 MB/s 2024-09-21T07:31:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018026 s, 58.2 MB/s 2024-09-21T07:31:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147782 s, 71.0 MB/s 2024-09-21T07:31:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133956 s, 78.3 MB/s 2024-09-21T07:31:14.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.170 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182789 s, 57.4 MB/s 2024-09-21T07:31:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146984 s, 71.3 MB/s 2024-09-21T07:31:14.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.208 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173181 s, 60.5 MB/s 2024-09-21T07:31:14.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141926 s, 73.9 MB/s 2024-09-21T07:31:14.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143713 s, 73.0 MB/s 2024-09-21T07:31:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.259 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146318 s, 71.7 MB/s 2024-09-21T07:31:14.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.275 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013698 s, 76.5 MB/s 2024-09-21T07:31:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.291 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130497 s, 80.4 MB/s 2024-09-21T07:31:14.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:14.298 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:14.298 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:14.298 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.29 2024-09-21T07:31:14.298 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:14.299 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:14.299 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:14.299 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:14.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181464 s, 57.8 MB/s 2024-09-21T07:31:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132616 s, 79.1 MB/s 2024-09-21T07:31:14.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117103 s, 89.5 MB/s 2024-09-21T07:31:14.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012723 s, 82.4 MB/s 2024-09-21T07:31:14.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.433 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131759 s, 79.6 MB/s 2024-09-21T07:31:14.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012934 s, 81.1 MB/s 2024-09-21T07:31:14.464 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.464 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.464 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128108 s, 81.9 MB/s 2024-09-21T07:31:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136644 s, 76.7 MB/s 2024-09-21T07:31:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015702 s, 66.8 MB/s 2024-09-21T07:31:14.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.515 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132891 s, 78.9 MB/s 2024-09-21T07:31:14.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.531 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013741 s, 76.3 MB/s 2024-09-21T07:31:14.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.547 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013186 s, 79.5 MB/s 2024-09-21T07:31:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131723 s, 79.6 MB/s 2024-09-21T07:31:14.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131637 s, 79.7 MB/s 2024-09-21T07:31:14.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.596 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142497 s, 73.6 MB/s 2024-09-21T07:31:14.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.612 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135645 s, 77.3 MB/s 2024-09-21T07:31:14.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.628 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127728 s, 82.1 MB/s 2024-09-21T07:31:14.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174638 s, 60.0 MB/s 2024-09-21T07:31:14.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136746 s, 76.7 MB/s 2024-09-21T07:31:14.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186704 s, 56.2 MB/s 2024-09-21T07:31:14.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132533 s, 79.1 MB/s 2024-09-21T07:31:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175611 s, 59.7 MB/s 2024-09-21T07:31:14.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.738 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137957 s, 76.0 MB/s 2024-09-21T07:31:14.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.759 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176608 s, 59.4 MB/s 2024-09-21T07:31:14.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.774 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119309 s, 87.9 MB/s 2024-09-21T07:31:14.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.790 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136497 s, 76.8 MB/s 2024-09-21T07:31:14.812 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.812 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.812 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186765 s, 56.1 MB/s 2024-09-21T07:31:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141092 s, 74.3 MB/s 2024-09-21T07:31:14.849 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.849 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171169 s, 61.3 MB/s 2024-09-21T07:31:14.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177764 s, 59.0 MB/s 2024-09-21T07:31:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131613 s, 79.7 MB/s 2024-09-21T07:31:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013894 s, 75.5 MB/s 2024-09-21T07:31:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:14.910 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:14.910 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:14.910 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.30 2024-09-21T07:31:14.911 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:14.911 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:14.911 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:14.911 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:15.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:15.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.025 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178256 s, 58.8 MB/s 2024-09-21T07:31:15.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.042 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137446 s, 76.3 MB/s 2024-09-21T07:31:15.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0494505 s, 21.2 MB/s 2024-09-21T07:31:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013731 s, 76.4 MB/s 2024-09-21T07:31:15.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.126 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129727 s, 80.8 MB/s 2024-09-21T07:31:15.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.144 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159011 s, 65.9 MB/s 2024-09-21T07:31:15.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.160 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131554 s, 79.7 MB/s 2024-09-21T07:31:15.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138631 s, 75.6 MB/s 2024-09-21T07:31:15.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134608 s, 77.9 MB/s 2024-09-21T07:31:15.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.209 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131827 s, 79.5 MB/s 2024-09-21T07:31:15.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140511 s, 74.6 MB/s 2024-09-21T07:31:15.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173728 s, 60.4 MB/s 2024-09-21T07:31:15.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136682 s, 76.7 MB/s 2024-09-21T07:31:15.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.282 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174372 s, 60.1 MB/s 2024-09-21T07:31:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.296 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120782 s, 86.8 MB/s 2024-09-21T07:31:15.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128574 s, 81.6 MB/s 2024-09-21T07:31:15.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126661 s, 82.8 MB/s 2024-09-21T07:31:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.343 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128277 s, 81.7 MB/s 2024-09-21T07:31:15.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133558 s, 78.5 MB/s 2024-09-21T07:31:15.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129464 s, 81.0 MB/s 2024-09-21T07:31:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129703 s, 80.8 MB/s 2024-09-21T07:31:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136398 s, 76.9 MB/s 2024-09-21T07:31:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151244 s, 69.3 MB/s 2024-09-21T07:31:15.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139001 s, 75.4 MB/s 2024-09-21T07:31:15.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181114 s, 57.9 MB/s 2024-09-21T07:31:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139034 s, 75.4 MB/s 2024-09-21T07:31:15.495 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.496 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01522 s, 68.9 MB/s 2024-09-21T07:31:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129734 s, 80.8 MB/s 2024-09-21T07:31:15.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142859 s, 73.4 MB/s 2024-09-21T07:31:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01355 s, 77.4 MB/s 2024-09-21T07:31:15.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.562 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-09-21T07:31:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131008 s, 80.0 MB/s 2024-09-21T07:31:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:15.585 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.31 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:15.586 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:15.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:15.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.654 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137464 s, 76.3 MB/s 2024-09-21T07:31:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132613 s, 79.1 MB/s 2024-09-21T07:31:15.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135649 s, 77.3 MB/s 2024-09-21T07:31:15.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135438 s, 77.4 MB/s 2024-09-21T07:31:15.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149354 s, 70.2 MB/s 2024-09-21T07:31:15.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169712 s, 61.8 MB/s 2024-09-21T07:31:15.754 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.754 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.754 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108685 s, 96.5 MB/s 2024-09-21T07:31:15.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145381 s, 72.1 MB/s 2024-09-21T07:31:15.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.792 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183109 s, 57.3 MB/s 2024-09-21T07:31:15.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143488 s, 73.1 MB/s 2024-09-21T07:31:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143287 s, 73.2 MB/s 2024-09-21T07:31:15.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.842 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138214 s, 75.9 MB/s 2024-09-21T07:31:15.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133734 s, 78.4 MB/s 2024-09-21T07:31:15.874 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.875 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136988 s, 76.5 MB/s 2024-09-21T07:31:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150077 s, 69.9 MB/s 2024-09-21T07:31:15.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.908 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132203 s, 79.3 MB/s 2024-09-21T07:31:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014892 s, 70.4 MB/s 2024-09-21T07:31:15.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128417 s, 81.7 MB/s 2024-09-21T07:31:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141443 s, 74.1 MB/s 2024-09-21T07:31:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148549 s, 70.6 MB/s 2024-09-21T07:31:15.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:15.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:15.996 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176675 s, 59.4 MB/s 2024-09-21T07:31:16.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136429 s, 76.9 MB/s 2024-09-21T07:31:16.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149073 s, 70.3 MB/s 2024-09-21T07:31:16.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133107 s, 78.8 MB/s 2024-09-21T07:31:16.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185001 s, 56.7 MB/s 2024-09-21T07:31:16.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013072 s, 80.2 MB/s 2024-09-21T07:31:16.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139931 s, 74.9 MB/s 2024-09-21T07:31:16.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177171 s, 59.2 MB/s 2024-09-21T07:31:16.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134561 s, 77.9 MB/s 2024-09-21T07:31:16.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130661 s, 80.3 MB/s 2024-09-21T07:31:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.170 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149975 s, 69.9 MB/s 2024-09-21T07:31:16.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:16.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:16.187 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137958 s, 76.0 MB/s 2024-09-21T07:31:16.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:16.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:16.194 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-21T07:31:16.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.353+0000 7f5645800640 1 -- 172.21.15.64:0/1858243931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b51a0 msgr2=0x7f56400b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.353+0000 7f5645800640 1 --2- 172.21.15.64:0/1858243931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b51a0 0x7f56400b55b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f56400b1d10 tx=0x7f563801cb80 comp rx=0 tx=0).stop 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- 172.21.15.64:0/1858243931 shutdown_connections 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 --2- 172.21.15.64:0/1858243931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b51a0 0x7f56400b55b0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 --2- 172.21.15.64:0/1858243931 >> v2:172.21.15.90:3300/0 conn(0x7f56400b3dd0 0x7f56400b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- 172.21.15.64:0/1858243931 >> 172.21.15.64:0/1858243931 conn(0x7f564006d220 msgr2=0x7f564006d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- 172.21.15.64:0/1858243931 shutdown_connections 2024-09-21T07:31:16.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- 172.21.15.64:0/1858243931 wait complete. 2024-09-21T07:31:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 Processor -- start 2024-09-21T07:31:16.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- start start 2024-09-21T07:31:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56400b51a0 0x7f56400b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56400b7b50 0x7f564015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5640169c40 con 0x7f56400b3dd0 2024-09-21T07:31:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5640169ac0 con 0x7f56400b51a0 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.357+0000 7f5645800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5640169dc0 con 0x7f56400b7b50 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45920/0 (socket says 172.21.15.64:45920) 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 -- 172.21.15.64:0/2358062197 learned_addr learned my addr 172.21.15.64:0/2358062197 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563f400640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56400b7b50 0x7f564015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5637e00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56400b51a0 0x7f56400b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 -- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56400b7b50 msgr2=0x7f564015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56400b7b50 0x7f564015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 -- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56400b51a0 msgr2=0x7f56400b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56400b51a0 0x7f56400b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 -- 172.21.15.64:0/2358062197 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400cb490 con 0x7f56400b3dd0 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f563ea00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5630001ec0 tx=0x7f563000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5636a00640 1 -- 172.21.15.64:0/2358062197 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630017070 con 0x7f56400b3dd0 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5636a00640 1 -- 172.21.15.64:0/2358062197 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5630003600 con 0x7f56400b3dd0 2024-09-21T07:31:16.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5636a00640 1 -- 172.21.15.64:0/2358062197 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630003a50 con 0x7f56400b3dd0 2024-09-21T07:31:16.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56400cb900 con 0x7f56400b3dd0 2024-09-21T07:31:16.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56400cbec0 con 0x7f56400b3dd0 2024-09-21T07:31:16.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.361+0000 7f5636a00640 1 -- 172.21.15.64:0/2358062197 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f563001a070 con 0x7f56400b3dd0 2024-09-21T07:31:16.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f5636a00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 0x7f561c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f5636a00640 1 -- 172.21.15.64:0/2358062197 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f56300936b0 con 0x7f56400b3dd0 2024-09-21T07:31:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 Processor -- start 2024-09-21T07:31:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f5637e00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 0x7f561c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 -- start start 2024-09-21T07:31:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f5637e00640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 0x7f561c075740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5640166520 tx=0x7f562800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72aea7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e72acb9910 con 0x55e72ad349b0 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e72aca8d40 con 0x55e72ad28710 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e72acacb50 con 0x55e72ad27f00 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45934/0 (socket says 172.21.15.64:45934) 2024-09-21T07:31:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f563ea00640 1 -- 172.21.15.64:0/215071851 learned_addr learned my addr 172.21.15.64:0/215071851 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f5637e00640 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.365+0000 7f563f400640 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72aea7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 -- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 msgr2=0x55e72aea7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 -- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 msgr2=0x55e72aea7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72aea7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 -- 172.21.15.64:0/215071851 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ac472e0 con 0x55e72ad349b0 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f563ea00640 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f563005dde0 tx=0x7f563005d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a164d5c740b1bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f562f400640 1 -- 172.21.15.64:0/215071851 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630083020 con 0x55e72ad349b0 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f562f400640 1 -- 172.21.15.64:0/215071851 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5630062880 con 0x55e72ad349b0 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f562f400640 1 -- 172.21.15.64:0/215071851 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300677c0 con 0x55e72ad349b0 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- 172.21.15.64:0/215071851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 msgr2=0x55e72aea72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f563005dde0 tx=0x7f563005d680 comp rx=0 tx=0).stop 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- 172.21.15.64:0/215071851 shutdown_connections 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72aea7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 --2- 172.21.15.64:0/215071851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad349b0 0x55e72aea72c0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- 172.21.15.64:0/215071851 >> 172.21.15.64:0/215071851 conn(0x55e72ad63cb0 msgr2=0x55e72ae64120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- 172.21.15.64:0/215071851 shutdown_connections 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- 172.21.15.64:0/215071851 wait complete. 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 -- start start 2024-09-21T07:31:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.369+0000 7f564cf1a000 1 Processor -- start 2024-09-21T07:31:16.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72aea6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e72ac52d10 con 0x55e72ad28710 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e72ac542e0 con 0x55e72ad349b0 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e72acb86e0 con 0x55e72ad27f00 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 10 client.0 _ll_register_callbacks cb 0x55e72ae49790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45944/0 (socket says 172.21.15.64:45944) 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 -- 172.21.15.64:0/1104519262 learned_addr learned my addr 172.21.15.64:0/1104519262 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563f400640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72aea6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 -- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 msgr2=0x55e72aea6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72aea6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 -- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 msgr2=0x55e72aea67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 -- 172.21.15.64:0/1104519262 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55e72ac66250 con 0x55e72ad27f00 2024-09-21T07:31:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f563ea00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea6280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f563000cd90 tx=0x7f56300781d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514d545512833990 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630083040 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f563005d0b0 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e72ac41420 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f5630062880 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 10 client.7211 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55e72ac2e030 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e72ac41420 con 0x55e72ad27f00 2024-09-21T07:31:16.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f5630079070 con 0x55e72ad27f00 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 10 client.7211 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 10 client.7211 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 20 client.7211 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a94b8b0 0x55e72aeb8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 4 client.7211 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e72acbb860 con 0x55e72a94b8b0 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a94b8b0 0x55e72aeb8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5637e00640 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a94b8b0 0x55e72aeb8b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3640571f1b2ec6e8 server_cookie=d1afac75020b2065 in_seq=0 out_seq=0 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.373+0000 7f5623e00640 10 client.7211 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f5623e00640 1 -- 172.21.15.64:0/1104519262 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e72acbb860 con 0x55e72a94b8b0 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f5623e00640 10 client.7211 handle_command_reply: tid=0 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 client.7211 shutdown 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 msgr2=0x55e72aea6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea6280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f563000cd90 tx=0x7f56300781d0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 shutdown_connections 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72aea6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a94b8b0 0x55e72aeb8b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72aea67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 --2- 172.21.15.64:0/1104519262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72aea6280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f5623e00640 0 client.7211 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 >> 172.21.15.64:0/1104519262 conn(0x55e72ad63cb0 msgr2=0x55e72ae5caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 shutdown_connections 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 1 -- 172.21.15.64:0/1104519262 wait complete. 2024-09-21T07:31:16.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.377+0000 7f564cf1a000 20 client.7211 trim_cache size 0 max 16384 2024-09-21T07:31:16.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.393+0000 7f564cf1a000 1 Processor -- start 2024-09-21T07:31:16.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.393+0000 7f564cf1a000 1 -- start start 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72af19880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72af1a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56402049d0 con 0x55e72ad28710 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56400d1530 con 0x55e72ad349b0 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5640204380 con 0x55e72ad27f00 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45960/0 (socket says 172.21.15.64:45960) 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 -- 172.21.15.64:0/3342763528 learned_addr learned my addr 172.21.15.64:0/3342763528 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f563ea00640 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72af19880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f563f400640 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72af1a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 -- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 msgr2=0x55e72af19880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72af19880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 -- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 msgr2=0x55e72af1a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72af1a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 -- 172.21.15.64:0/3342763528 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ad05340 con 0x55e72ad28710 2024-09-21T07:31:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f5637e00640 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x55e72ac41060 tx=0x7f5628013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43164bcb4d3c1517 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f562ea00640 1 -- 172.21.15.64:0/3342763528 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562800b9c0 con 0x55e72ad28710 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f562ea00640 1 -- 172.21.15.64:0/3342763528 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56280200d0 con 0x55e72ad28710 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f562ea00640 1 -- 172.21.15.64:0/3342763528 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628005260 con 0x55e72ad28710 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- 172.21.15.64:0/3342763528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 msgr2=0x55e72af19dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x55e72ac41060 tx=0x7f5628013000 comp rx=0 tx=0).stop 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- 172.21.15.64:0/3342763528 shutdown_connections 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad349b0 0x55e72af1a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad28710 0x55e72af19dc0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 --2- 172.21.15.64:0/3342763528 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad27f00 0x55e72af19880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- 172.21.15.64:0/3342763528 >> 172.21.15.64:0/3342763528 conn(0x55e72ad63cb0 msgr2=0x55e72ae5cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- 172.21.15.64:0/3342763528 shutdown_connections 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.397+0000 7f564cf1a000 1 -- 172.21.15.64:0/3342763528 wait complete. 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- start start 2024-09-21T07:31:16.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 Processor -- start 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72af1dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad349b0 0x55e72af1e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e72acabe60 con 0x55e72ad27f00 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e72ac68850 con 0x55e72ad28710 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e72acb1180 con 0x55e72ad349b0 2024-09-21T07:31:16.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 10 client.0 _ll_register_callbacks cb 0x7f5630073f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45974/0 (socket says 172.21.15.64:45974) 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 -- 172.21.15.64:0/611146855 learned_addr learned my addr 172.21.15.64:0/611146855 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5637e00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72af1dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563f400640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad349b0 0x55e72af1e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 -- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad349b0 msgr2=0x55e72af1e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad349b0 0x55e72af1e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 -- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 msgr2=0x55e72af1dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72af1dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 -- 172.21.15.64:0/611146855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72ac71d80 con 0x55e72ad27f00 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f563ea00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f563005d730 tx=0x7f563005d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a5b020cb099aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630083040 con 0x55e72ad27f00 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f56300833e0 con 0x55e72ad27f00 2024-09-21T07:31:16.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56280200d0 con 0x55e72ad27f00 2024-09-21T07:31:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f563008a050 con 0x55e72ad27f00 2024-09-21T07:31:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 10 client.8328 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55e72a95f1a0 con 0x55e72ad27f00 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56280200d0 con 0x55e72ad27f00 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f5630073060 con 0x55e72ad27f00 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 10 client.8328 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 10 client.8328 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 20 client.8328 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a939910 0x55e72aed8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 4 client.8328 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.401+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55e72ae59ff0 con 0x55e72a939910 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5637e00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a939910 0x55e72aed8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5637e00640 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a939910 0x55e72aed8fc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a776426dec3036c3 server_cookie=af71d11174e524b6 in_seq=0 out_seq=0 2024-09-21T07:31:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5623e00640 10 client.8328 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5623e00640 1 -- 172.21.15.64:0/611146855 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e72ae59ff0 con 0x55e72a939910 2024-09-21T07:31:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5623e00640 10 client.8328 handle_command_reply: tid=0 2024-09-21T07:31:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 client.8328 shutdown 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 msgr2=0x55e72af1d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f563005d730 tx=0x7f563005d960 comp rx=0 tx=0).stop 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 shutdown_connections 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e72ad349b0 0x55e72af1e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e72ad28710 0x55e72af1dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55e72a939910 0x55e72aed8fc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 --2- 172.21.15.64:0/611146855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e72ad27f00 0x55e72af1d700 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f5623e00640 0 client.8328 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 >> 172.21.15.64:0/611146855 conn(0x55e72ad63cb0 msgr2=0x55e72ae5d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 shutdown_connections 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 1 -- 172.21.15.64:0/611146855 wait complete. 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.405+0000 7f564cf1a000 20 client.8328 trim_cache size 0 max 16384 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "8dd45231-b763-469d-b691-93cfd723f08d", 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:31:16.410 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 msgr2=0x7f561c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 0x7f561c075740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5640166520 tx=0x7f562800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 msgr2=0x7f5640147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5630001ec0 tx=0x7f563000c890 comp rx=0 tx=0).stop 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 shutdown_connections 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f561c073230 0x7f561c075740 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56400b7b50 0x7f564015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56400b51a0 0x7f56400b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 --2- 172.21.15.64:0/2358062197 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56400b3dd0 0x7f5640147250 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 >> 172.21.15.64:0/2358062197 conn(0x7f564006d220 msgr2=0x7f564006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 shutdown_connections 2024-09-21T07:31:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.409+0000 7f5645800640 1 -- 172.21.15.64:0/2358062197 wait complete. 2024-09-21T07:31:16.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:16.435 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.661+0000 7f51e9600640 1 -- 172.21.15.64:0/685964157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e415cad0 msgr2=0x7f51e41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.661+0000 7f51e9600640 1 --2- 172.21.15.64:0/685964157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e415cad0 0x7f51e41602c0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f51e4070650 tx=0x7f51dc01cb80 comp rx=0 tx=0).stop 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 -- 172.21.15.64:0/685964157 shutdown_connections 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 --2- 172.21.15.64:0/685964157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e415cad0 0x7f51e41602c0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 --2- 172.21.15.64:0/685964157 >> v2:172.21.15.90:3300/0 conn(0x7f51e406d500 0x7f51e415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 -- 172.21.15.64:0/685964157 >> 172.21.15.64:0/685964157 conn(0x7f51e40cdb10 msgr2=0x7f51e40cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 -- 172.21.15.64:0/685964157 shutdown_connections 2024-09-21T07:31:16.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 -- 172.21.15.64:0/685964157 wait complete. 2024-09-21T07:31:16.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.665+0000 7f51e9600640 1 Processor -- start 2024-09-21T07:31:16.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 -- start start 2024-09-21T07:31:16.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 0x7f51e414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e415cad0 0x7f51e415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 0x7f51e415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4153460 con 0x7f51e4074f10 2024-09-21T07:31:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51e41532e0 con 0x7f51e415cad0 2024-09-21T07:31:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e9600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f51e41535e0 con 0x7f51e415b920 2024-09-21T07:31:16.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 0x7f51e414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 0x7f51e414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45994/0 (socket says 172.21.15.64:45994) 2024-09-21T07:31:16.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e3e00640 1 -- 172.21.15.64:0/613653861 learned_addr learned my addr 172.21.15.64:0/613653861 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 0x7f51e415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e3400640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e415cad0 0x7f51e415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 -- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e415cad0 msgr2=0x7f51e415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e415cad0 0x7f51e415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 -- 172.21.15.64:0/613653861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 msgr2=0x7f51e414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 0x7f51e414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.669+0000 7f51e8c00640 1 -- 172.21.15.64:0/613653861 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e4074b30 con 0x7f51e415b920 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51e8c00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 0x7f51e415bd30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ac000 tx=0x7f51dc003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51dbe00640 1 -- 172.21.15.64:0/613653861 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b2040 con 0x7f51e415b920 2024-09-21T07:31:16.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51dbe00640 1 -- 172.21.15.64:0/613653861 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc004040 con 0x7f51e415b920 2024-09-21T07:31:16.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51dbe00640 1 -- 172.21.15.64:0/613653861 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc004470 con 0x7f51e415b920 2024-09-21T07:31:16.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e40b65f0 con 0x7f51e415b920 2024-09-21T07:31:16.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e40cb1f0 con 0x7f51e415b920 2024-09-21T07:31:16.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.673+0000 7f51dbe00640 1 -- 172.21.15.64:0/613653861 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f51dc0bd060 con 0x7f51e415b920 2024-09-21T07:31:16.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51dbe00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 0x7f51c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51dbe00640 1 -- 172.21.15.64:0/613653861 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f51dc12dd50 con 0x7f51e415b920 2024-09-21T07:31:16.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51e3e00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 0x7f51c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 Processor -- start 2024-09-21T07:31:16.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 -- start start 2024-09-21T07:31:16.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51e3e00640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 0x7f51c4075710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001930 tx=0x7f51d4001440 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a57a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 0x55f80a57a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a57af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f80a3262e0 con 0x55f80a3ff170 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f80a383bb0 con 0x55f80a412ab0 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.677+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f80a372fe0 con 0x55f80a421630 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a57a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 0x55f80a57a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a57a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:47228/0 (socket says 172.21.15.64:47228) 2024-09-21T07:31:16.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3e00640 1 -- 172.21.15.64:0/704530559 learned_addr learned my addr 172.21.15.64:0/704530559 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 -- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 msgr2=0x55f80a57a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a57a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 -- 172.21.15.64:0/704530559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 msgr2=0x55f80a57af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a57af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 -- 172.21.15.64:0/704530559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80a3111c0 con 0x55f80a412ab0 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51e3400640 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 0x55f80a57a9f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f51e4073ca0 tx=0x7f51d0011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509855b3bfe53b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51cfe00640 1 -- 172.21.15.64:0/704530559 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d001e070 con 0x55f80a412ab0 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51cfe00640 1 -- 172.21.15.64:0/704530559 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51d000e760 con 0x55f80a412ab0 2024-09-21T07:31:16.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51cfe00640 1 -- 172.21.15.64:0/704530559 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d000eb50 con 0x55f80a412ab0 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 -- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 msgr2=0x55f80a57a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 0x55f80a57a9f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f51e4073ca0 tx=0x7f51d0011440 comp rx=0 tx=0).stop 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 -- 172.21.15.64:0/704530559 shutdown_connections 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a57af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a412ab0 0x55f80a57a9f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 --2- 172.21.15.64:0/704530559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a57a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 -- 172.21.15.64:0/704530559 >> 172.21.15.64:0/704530559 conn(0x55f80a030d20 msgr2=0x55f80a526c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 -- 172.21.15.64:0/704530559 shutdown_connections 2024-09-21T07:31:16.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.681+0000 7f51f245f000 1 -- 172.21.15.64:0/704530559 wait complete. 2024-09-21T07:31:16.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 -- start start 2024-09-21T07:31:16.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 Processor -- start 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 0x55f80a568cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f80a3184f0 con 0x55f80a412ab0 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f80a376df0 con 0x55f80a421630 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f80a038620 con 0x55f80a3ff170 2024-09-21T07:31:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51f245f000 10 client.0 _ll_register_callbacks cb 0x55f80a349cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 0x55f80a568cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:56838/0 (socket says 172.21.15.64:56838) 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46010/0 (socket says 172.21.15.64:46010) 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 -- 172.21.15.64:0/3260376737 learned_addr learned my addr 172.21.15.64:0/3260376737 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 0x55f80a568cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:47230/0 (socket says 172.21.15.64:47230) 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 -- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 msgr2=0x55f80a568cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 0x55f80a568cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 -- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 msgr2=0x55f80a5691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.685+0000 7f51e8c00640 1 -- 172.21.15.64:0/3260376737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80a442740 con 0x55f80a421630 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51e8c00640 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0f86c0 tx=0x7f51dc0f8140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee075b2c11cba503 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0f8b90 con 0x55f80a421630 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f51dc101b80 con 0x55f80a421630 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f80a30b300 con 0x55f80a421630 2024-09-21T07:31:16.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f51dc117050 con 0x55f80a421630 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 10 client.7960 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55f80a3f8440 con 0x55f80a421630 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f80a30b300 con 0x55f80a421630 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f51dc11a080 con 0x55f80a421630 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 10 client.7960 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 10 client.7960 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 20 client.7960 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a0158d0 0x55f80a56a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 4 client.7960 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f80a385b00 con 0x55f80a0158d0 2024-09-21T07:31:16.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51e3e00640 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a0158d0 0x55f80a56a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51e3e00640 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a0158d0 0x55f80a56a140 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f59fe40bd4b92 server_cookie=fae44ba658b7e51e in_seq=0 out_seq=0 2024-09-21T07:31:16.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.689+0000 7f51ccc00640 10 client.7960 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51ccc00640 1 -- 172.21.15.64:0/3260376737 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f80a385b00 con 0x55f80a0158d0 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51ccc00640 10 client.7960 handle_command_reply: tid=0 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 client.7960 shutdown 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 msgr2=0x55f80a569730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0f86c0 tx=0x7f51dc0f8140 comp rx=0 tx=0).stop 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 shutdown_connections 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a569730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a0158d0 0x55f80a56a140 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 --2- 172.21.15.64:0/3260376737 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a3ff170 0x55f80a568cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51ccc00640 0 client.7960 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 >> 172.21.15.64:0/3260376737 conn(0x55f80a030d20 msgr2=0x55f80a526c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 shutdown_connections 2024-09-21T07:31:16.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 1 -- 172.21.15.64:0/3260376737 wait complete. 2024-09-21T07:31:16.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.693+0000 7f51f245f000 20 client.7960 trim_cache size 0 max 16384 2024-09-21T07:31:16.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 Processor -- start 2024-09-21T07:31:16.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 -- start start 2024-09-21T07:31:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a52e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a412ab0 0x55f80a52ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f80a52c650 con 0x55f80a3ff170 2024-09-21T07:31:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51e41565d0 con 0x55f80a421630 2024-09-21T07:31:16.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f51e4155650 con 0x55f80a412ab0 2024-09-21T07:31:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:56842/0 (socket says 172.21.15.64:56842) 2024-09-21T07:31:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 -- 172.21.15.64:0/1082323770 learned_addr learned my addr 172.21.15.64:0/1082323770 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e3400640 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a412ab0 0x55f80a52ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e3e00640 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a52e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 -- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a412ab0 msgr2=0x55f80a52ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a412ab0 0x55f80a52ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 -- 172.21.15.64:0/1082323770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 msgr2=0x55f80a52e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a52e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 -- 172.21.15.64:0/1082323770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80a3cfb00 con 0x55f80a421630 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51e8c00640 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0f4cb0 tx=0x7f51dc01cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35f959b6332e8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51cf400640 1 -- 172.21.15.64:0/1082323770 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0fd1b0 con 0x55f80a421630 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51cf400640 1 -- 172.21.15.64:0/1082323770 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc11d070 con 0x55f80a421630 2024-09-21T07:31:16.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.721+0000 7f51cf400640 1 -- 172.21.15.64:0/1082323770 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc101de0 con 0x55f80a421630 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 msgr2=0x55f80a526280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0f4cb0 tx=0x7f51dc01cdd0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- 172.21.15.64:0/1082323770 shutdown_connections 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a421630 0x55f80a526280 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a412ab0 0x55f80a52ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 --2- 172.21.15.64:0/1082323770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a3ff170 0x55f80a52e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- 172.21.15.64:0/1082323770 >> 172.21.15.64:0/1082323770 conn(0x55f80a030d20 msgr2=0x55f80a58a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- 172.21.15.64:0/1082323770 shutdown_connections 2024-09-21T07:31:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- 172.21.15.64:0/1082323770 wait complete. 2024-09-21T07:31:16.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 -- start start 2024-09-21T07:31:16.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.725+0000 7f51f245f000 1 Processor -- start 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 0x55f80a5efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f80a376df0 con 0x55f80a412ab0 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f80a31e040 con 0x55f80a3ff170 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f80a33ec70 con 0x55f80a421630 2024-09-21T07:31:16.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 10 client.0 _ll_register_callbacks cb 0x7f51dc0f4660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:47256/0 (socket says 172.21.15.64:47256) 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 -- 172.21.15.64:0/2517208243 learned_addr learned my addr 172.21.15.64:0/2517208243 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e3e00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 0x55f80a5efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 -- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 msgr2=0x55f80a5efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 0x55f80a5efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 -- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 msgr2=0x55f80a5f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 -- 172.21.15.64:0/2517208243 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f80a33d060 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e3400640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e3e00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 0x55f80a5efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51e8c00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f51dc01d060 tx=0x7f51dc101e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749e8422d371dafc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0fd1b0 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc11d070 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f51dc112b40 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f51dc10d050 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 10 client.7232 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55f80a309640 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc11d070 con 0x55f80a421630 2024-09-21T07:31:16.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f51dc11a040 con 0x55f80a421630 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 10 client.7232 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 10 client.7232 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.729+0000 7f51f245f000 20 client.7232 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a003930 0x55f80a5abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51f245f000 4 client.7232 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55f80a3815b0 con 0x55f80a003930 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51e3e00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a003930 0x55f80a5abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51ccc00640 10 client.7232 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.733+0000 7f51e3e00640 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a003930 0x55f80a5abf00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c4bdf6781464bc server_cookie=63e2f2bb81d1cb67 in_seq=0 out_seq=0 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51ccc00640 1 -- 172.21.15.64:0/2517208243 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f80a3815b0 con 0x55f80a003930 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51ccc00640 10 client.7232 handle_command_reply: tid=0 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 client.7232 shutdown 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 msgr2=0x55f80a5f0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f51dc01d060 tx=0x7f51dc101e30 comp rx=0 tx=0).stop 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 shutdown_connections 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f80a421630 0x55f80a5f0640 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55f80a003930 0x55f80a5abf00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f80a412ab0 0x55f80a5f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 --2- 172.21.15.64:0/2517208243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f80a3ff170 0x55f80a5efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 >> 172.21.15.64:0/2517208243 conn(0x55f80a030d20 msgr2=0x55f80a52d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51ccc00640 0 client.7232 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 shutdown_connections 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 1 -- 172.21.15.64:0/2517208243 wait complete. 2024-09-21T07:31:16.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51f245f000 20 client.7232 trim_cache size 0 max 16384 2024-09-21T07:31:16.754 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:16.754 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:31:16.754 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:31:16.754 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 msgr2=0x7f51c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 0x7f51c4075710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001930 tx=0x7f51d4001440 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 msgr2=0x7f51e415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 0x7f51e415bd30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ac000 tx=0x7f51dc003f60 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 shutdown_connections 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c4073200 0x7f51c4075710 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e415b920 0x7f51e415bd30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e415cad0 0x7f51e415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 --2- 172.21.15.64:0/613653861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e4074f10 0x7f51e414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.749+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 >> 172.21.15.64:0/613653861 conn(0x7f51e40cdb10 msgr2=0x7f51e40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.753+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 shutdown_connections 2024-09-21T07:31:16.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.753+0000 7f51e9600640 1 -- 172.21.15.64:0/613653861 wait complete. 2024-09-21T07:31:16.773 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:31:16.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- 172.21.15.64:0/2661735061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 msgr2=0x7f525c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 --2- 172.21.15.64:0/2661735061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c0b3ce0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f525c0b3130 tx=0x7f525401cc40 comp rx=0 tx=0).stop 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- 172.21.15.64:0/2661735061 shutdown_connections 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 --2- 172.21.15.64:0/2661735061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c0b3ce0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 --2- 172.21.15.64:0/2661735061 >> v2:172.21.15.90:3300/0 conn(0x7f525c0706c0 0x7f525c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- 172.21.15.64:0/2661735061 >> 172.21.15.64:0/2661735061 conn(0x7f525c0ccbe0 msgr2=0x7f525c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- 172.21.15.64:0/2661735061 shutdown_connections 2024-09-21T07:31:16.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- 172.21.15.64:0/2661735061 wait complete. 2024-09-21T07:31:16.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 Processor -- start 2024-09-21T07:31:16.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.933+0000 7f5260c00640 1 -- start start 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f525c15ec20 0x7f525c165b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f525c1fcb40 0x7f525c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f525c168d70 con 0x7f525c0ca990 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f525c168bf0 con 0x7f525c15ec20 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f525c168ef0 con 0x7f525c1fcb40 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46052/0 (socket says 172.21.15.64:46052) 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 -- 172.21.15.64:0/3932234735 learned_addr learned my addr 172.21.15.64:0/3932234735 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5251400640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f525c15ec20 0x7f525c165b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f525a800640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f525c1fcb40 0x7f525c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 -- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f525c1fcb40 msgr2=0x7f525c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f525c1fcb40 0x7f525c0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 -- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f525c15ec20 msgr2=0x7f525c165b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f525c15ec20 0x7f525c165b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 -- 172.21.15.64:0/3932234735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0ad150 con 0x7f525c0ca990 2024-09-21T07:31:16.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5259e00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c3c0 tx=0x7f524c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5252a00640 1 -- 172.21.15.64:0/3932234735 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c017070 con 0x7f525c0ca990 2024-09-21T07:31:16.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5252a00640 1 -- 172.21.15.64:0/3932234735 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f524c0053c0 con 0x7f525c0ca990 2024-09-21T07:31:16.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c0ad430 con 0x7f525c0ca990 2024-09-21T07:31:16.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5252a00640 1 -- 172.21.15.64:0/3932234735 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c003860 con 0x7f525c0ca990 2024-09-21T07:31:16.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.937+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c0ad9f0 con 0x7f525c0ca990 2024-09-21T07:31:16.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5252a00640 1 -- 172.21.15.64:0/3932234735 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f524c01a070 con 0x7f525c0ca990 2024-09-21T07:31:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5252a00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 0x7f5238075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5252a00640 1 -- 172.21.15.64:0/3932234735 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f524c093690 con 0x7f525c0ca990 2024-09-21T07:31:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 Processor -- start 2024-09-21T07:31:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 -- start start 2024-09-21T07:31:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5251400640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 0x7f5238075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5251400640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 0x7f5238075710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f525c09dc20 tx=0x7f524400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x5638959cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x5638959cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56389586acd0 con 0x56389585f6d0 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563895780330 con 0x56389557aaa0 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5638957ddbb0 con 0x5638954b6890 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46058/0 (socket says 172.21.15.64:46058) 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 -- 172.21.15.64:0/2269704559 learned_addr learned my addr 172.21.15.64:0/2269704559 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5251400640 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x5638959cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f525a800640 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x5638959cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 -- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 msgr2=0x5638959cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x5638959cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 -- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 msgr2=0x5638959cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x5638959cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 -- 172.21.15.64:0/2269704559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563895781c80 con 0x56389585f6d0 2024-09-21T07:31:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f5259e00640 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f524c05b130 tx=0x7f524c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ce151ecc61b37a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f524a600640 1 -- 172.21.15.64:0/2269704559 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0628f0 con 0x56389585f6d0 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f524a600640 1 -- 172.21.15.64:0/2269704559 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f524c05a130 con 0x56389585f6d0 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.941+0000 7f524a600640 1 -- 172.21.15.64:0/2269704559 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c05d380 con 0x56389585f6d0 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- 172.21.15.64:0/2269704559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 msgr2=0x5638959cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f524c05b130 tx=0x7f524c000ee0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- 172.21.15.64:0/2269704559 shutdown_connections 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x5638959cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x5638959cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- 172.21.15.64:0/2269704559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x5638959cb9f0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- 172.21.15.64:0/2269704559 >> 172.21.15.64:0/2269704559 conn(0x56389548a5c0 msgr2=0x563895988ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- 172.21.15.64:0/2269704559 shutdown_connections 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- 172.21.15.64:0/2269704559 wait complete. 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- start start 2024-09-21T07:31:16.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 Processor -- start 2024-09-21T07:31:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895987a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x56389598e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5638957d0df0 con 0x56389557aaa0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638957ccfe0 con 0x5638954b6890 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5638957724d0 con 0x56389585f6d0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f526830f000 10 client.0 _ll_register_callbacks cb 0x5638957507f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f5251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f5251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46062/0 (socket says 172.21.15.64:46062) 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f5251400640 1 -- 172.21.15.64:0/647452465 learned_addr learned my addr 172.21.15.64:0/647452465 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f5259e00640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895987a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.945+0000 7f525a800640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x56389598e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 -- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 msgr2=0x56389598e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x56389598e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 -- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 msgr2=0x563895987a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895987a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 -- 172.21.15.64:0/647452465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389576b210 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5259e00640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895987a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5251400640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f52440116f0 tx=0x7f5244004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7879f58d3fb485 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524401f9c0 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563895765350 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f524401fb60 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f5244030050 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 10 client.8352 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x563895751fc0 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563895765350 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f5244028470 con 0x56389557aaa0 2024-09-21T07:31:16.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 10 client.8352 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 10 client.8352 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 20 client.8352 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389546f930 0x5638959d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 4 client.8352 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638957dfb00 con 0x56389546f930 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5259e00640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389546f930 0x5638959d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 10 client.8352 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f5259e00640 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389546f930 0x5638959d2e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=900aac22192d871f server_cookie=37c2f674e279d951 in_seq=0 out_seq=0 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 1 -- 172.21.15.64:0/647452465 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638957dfb00 con 0x56389546f930 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 10 client.8352 handle_command_reply: tid=0 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 client.8352 shutdown 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 msgr2=0x563895987f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f52440116f0 tx=0x7f5244004740 comp rx=0 tx=0).stop 2024-09-21T07:31:16.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 shutdown_connections 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x56389598e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389546f930 0x5638959d2e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895987f40 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 --2- 172.21.15.64:0/647452465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895987a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f523ea00640 0 client.8352 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 >> 172.21.15.64:0/647452465 conn(0x56389548a5c0 msgr2=0x563895980d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 shutdown_connections 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 1 -- 172.21.15.64:0/647452465 wait complete. 2024-09-21T07:31:16.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.949+0000 7f526830f000 20 client.8352 trim_cache size 0 max 16384 2024-09-21T07:31:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 Processor -- start 2024-09-21T07:31:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 -- start start 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x563895a3d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x563895a3d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563895986b20 con 0x56389585f6d0 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f525c205aa0 con 0x56389557aaa0 2024-09-21T07:31:16.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f525c204ac0 con 0x5638954b6890 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f525a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f525a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46064/0 (socket says 172.21.15.64:46064) 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f525a800640 1 -- 172.21.15.64:0/4104019136 learned_addr learned my addr 172.21.15.64:0/4104019136 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.969+0000 7f5251400640 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x563895a3d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f5259e00640 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x563895a3d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 -- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 msgr2=0x563895a3d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x563895a3d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 -- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 msgr2=0x563895a3d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x563895a3d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 -- 172.21.15.64:0/4104019136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389582a680 con 0x56389585f6d0 2024-09-21T07:31:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f525a800640 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f525401a870 tx=0x7f52540199e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf6a05a895c7e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f5249c00640 1 -- 172.21.15.64:0/4104019136 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540bc070 con 0x56389585f6d0 2024-09-21T07:31:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f5249c00640 1 -- 172.21.15.64:0/4104019136 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5254004d40 con 0x56389585f6d0 2024-09-21T07:31:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f5249c00640 1 -- 172.21.15.64:0/4104019136 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540b2040 con 0x56389585f6d0 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- 172.21.15.64:0/4104019136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 msgr2=0x563895a3de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f525401a870 tx=0x7f52540199e0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- 172.21.15.64:0/4104019136 shutdown_connections 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389585f6d0 0x563895a3de80 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56389557aaa0 0x563895a3d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 --2- 172.21.15.64:0/4104019136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5638954b6890 0x563895a3d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- 172.21.15.64:0/4104019136 >> 172.21.15.64:0/4104019136 conn(0x56389548a5c0 msgr2=0x5638959ddfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- 172.21.15.64:0/4104019136 shutdown_connections 2024-09-21T07:31:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- 172.21.15.64:0/4104019136 wait complete. 2024-09-21T07:31:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 -- start start 2024-09-21T07:31:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.973+0000 7f526830f000 1 Processor -- start 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895a41650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x563895a420d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f525c204470 con 0x56389557aaa0 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1f9590 con 0x5638954b6890 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563895492680 con 0x56389585f6d0 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 10 client.0 _ll_register_callbacks cb 0x7f5244010b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46080/0 (socket says 172.21.15.64:46080) 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 -- 172.21.15.64:0/3188149983 learned_addr learned my addr 172.21.15.64:0/3188149983 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:16.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5259e00640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895a41650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f525a800640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x563895a420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 -- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 msgr2=0x563895a420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x563895a420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 -- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 msgr2=0x563895a41650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:16.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895a41650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 -- 172.21.15.64:0/3188149983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638957970b0 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5251400640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5244011fd0 tx=0x7f5244010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7152d0d6a2cfddfd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524401f9c0 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f524401fb60 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5254004d40 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f5244045050 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 10 client.8358 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x563895763610 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5254004d40 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f5244048020 con 0x56389557aaa0 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 10 client.8358 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 10 client.8358 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:16.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 20 client.8358 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389545d990 0x563895982bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 4 client.8358 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5638957db5b0 con 0x56389545d990 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5259e00640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389545d990 0x563895982bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f5259e00640 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389545d990 0x563895982bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce41daab51f25c22 server_cookie=5a566ee4d7bca075 in_seq=0 out_seq=0 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 10 client.8358 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 1 -- 172.21.15.64:0/3188149983 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x5638957db5b0 con 0x56389545d990 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 10 client.8358 handle_command_reply: tid=0 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 client.8358 shutdown 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 msgr2=0x563895a41b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5244011fd0 tx=0x7f5244010ca0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 shutdown_connections 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56389585f6d0 0x563895a420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x56389545d990 0x563895982bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56389557aaa0 0x563895a41b90 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 --2- 172.21.15.64:0/3188149983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638954b6890 0x563895a41650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 >> 172.21.15.64:0/3188149983 conn(0x56389548a5c0 msgr2=0x56389598d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.977+0000 7f523ea00640 0 client.8358 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 shutdown_connections 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f526830f000 1 -- 172.21.15.64:0/3188149983 wait complete. 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f526830f000 20 client.8358 trim_cache size 0 max 16384 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:31:16.984 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "8dd45231-b763-469d-b691-93cfd723f08d": { 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "8dd45231-b763-469d-b691-93cfd723f08d", 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "8dd45231-b763-469d-b691-93cfd723f08d": { 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:31:16.405822+0000", 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:31:16.985 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:31:16.986 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:16.986 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:16.986 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:16.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 msgr2=0x7f5238075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 0x7f5238075710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f525c09dc20 tx=0x7f524400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 msgr2=0x7f525c15bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c3c0 tx=0x7f524c00c880 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 shutdown_connections 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5238073200 0x7f5238075710 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f525c1fcb40 0x7f525c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f525c15ec20 0x7f525c165b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 --2- 172.21.15.64:0/3932234735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f525c0ca990 0x7f525c15bb60 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 >> 172.21.15.64:0/3932234735 conn(0x7f525c0ccbe0 msgr2=0x7f525c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 shutdown_connections 2024-09-21T07:31:16.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:16.981+0000 7f5260c00640 1 -- 172.21.15.64:0/3932234735 wait complete. 2024-09-21T07:31:22.001 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:31:22.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- 172.21.15.64:0/1099141287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 msgr2=0x7fad780ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1099141287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad780ce740 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fad780cc750 tx=0x7fad6801c7d0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- 172.21.15.64:0/1099141287 shutdown_connections 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1099141287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780704f0 0x7fad780b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1099141287 >> v2:172.21.15.90:3300/0 conn(0x7fad780ca990 0x7fad7806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1099141287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad780ce740 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- 172.21.15.64:0/1099141287 >> 172.21.15.64:0/1099141287 conn(0x7fad780ccbe0 msgr2=0x7fad780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- 172.21.15.64:0/1099141287 shutdown_connections 2024-09-21T07:31:22.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- 172.21.15.64:0/1099141287 wait complete. 2024-09-21T07:31:22.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 Processor -- start 2024-09-21T07:31:22.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.177+0000 7fad7ec00640 1 -- start start 2024-09-21T07:31:22.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad780704f0 0x7fad780c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780ca990 0x7fad780ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad780b2540 con 0x7fad7815ec20 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad780b23c0 con 0x7fad780704f0 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fad780b26c0 con 0x7fad780ca990 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46104/0 (socket says 172.21.15.64:46104) 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 -- 172.21.15.64:0/1648980872 learned_addr learned my addr 172.21.15.64:0/1648980872 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad77e00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad780704f0 0x7fad780c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad6f400640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780ca990 0x7fad780ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 -- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780ca990 msgr2=0x7fad780ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780ca990 0x7fad780ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 -- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad780704f0 msgr2=0x7fad780c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad780704f0 0x7fad780c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 -- 172.21.15.64:0/1648980872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad781f9dd0 con 0x7fad7815ec20 2024-09-21T07:31:22.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fad7000e960 tx=0x7fad7000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad74c00640 1 -- 172.21.15.64:0/1648980872 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70004d30 con 0x7fad7815ec20 2024-09-21T07:31:22.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad74c00640 1 -- 172.21.15.64:0/1648980872 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad7000cb20 con 0x7fad7815ec20 2024-09-21T07:31:22.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad780c69c0 con 0x7fad7815ec20 2024-09-21T07:31:22.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad74c00640 1 -- 172.21.15.64:0/1648980872 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70005020 con 0x7fad7815ec20 2024-09-21T07:31:22.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.181+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad781fc750 con 0x7fad7815ec20 2024-09-21T07:31:22.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad74c00640 1 -- 172.21.15.64:0/1648980872 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad700051c0 con 0x7fad7815ec20 2024-09-21T07:31:22.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad74c00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 0x7fad54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad74c00640 1 -- 172.21.15.64:0/1648980872 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fad70094bf0 con 0x7fad7815ec20 2024-09-21T07:31:22.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad77e00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 0x7fad54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 Processor -- start 2024-09-21T07:31:22.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 -- start start 2024-09-21T07:31:22.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad77e00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 0x7fad54075710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fad680af000 tx=0x7fad680a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 0x55d85cf9b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85cf9bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 0x55d85cf9c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d85ce3acd0 con 0x55d85cb4aaa0 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d85cd50330 con 0x55d85ca86890 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d85cdadbb0 con 0x55d85ce2f6d0 2024-09-21T07:31:22.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad77e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 0x55d85cf9b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 0x55d85cf9c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad77e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 0x55d85cf9b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:47342/0 (socket says 172.21.15.64:47342) 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad77e00640 1 -- 172.21.15.64:0/5103543 learned_addr learned my addr 172.21.15.64:0/5103543 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.185+0000 7fad6f400640 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85cf9bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 -- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 msgr2=0x55d85cf9b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 0x55d85cf9b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 -- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 msgr2=0x55d85cf9bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85cf9bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 -- 172.21.15.64:0/5103543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85cd51c80 con 0x55d85cb4aaa0 2024-09-21T07:31:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad7cc00640 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 0x55d85cf9c470 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fad7005c720 tx=0x7fad7005ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f2686fa388557 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad67e00640 1 -- 172.21.15.64:0/5103543 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70084070 con 0x55d85cb4aaa0 2024-09-21T07:31:22.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad67e00640 1 -- 172.21.15.64:0/5103543 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad70063ee0 con 0x55d85cb4aaa0 2024-09-21T07:31:22.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad67e00640 1 -- 172.21.15.64:0/5103543 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70080e60 con 0x55d85cb4aaa0 2024-09-21T07:31:22.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- 172.21.15.64:0/5103543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 msgr2=0x55d85cf9c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 0x55d85cf9c470 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fad7005c720 tx=0x7fad7005ef20 comp rx=0 tx=0).stop 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- 172.21.15.64:0/5103543 shutdown_connections 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85cb4aaa0 0x55d85cf9c470 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85cf9bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 --2- 172.21.15.64:0/5103543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ce2f6d0 0x55d85cf9b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- 172.21.15.64:0/5103543 >> 172.21.15.64:0/5103543 conn(0x55d85ca5a5c0 msgr2=0x55d85cf58ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- 172.21.15.64:0/5103543 shutdown_connections 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- 172.21.15.64:0/5103543 wait complete. 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 -- start start 2024-09-21T07:31:22.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.189+0000 7fad862a7000 1 Processor -- start 2024-09-21T07:31:22.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85cf57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 0x55d85cf5e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d85cda0df0 con 0x55d85ca86890 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d85cd9cfe0 con 0x55d85ce2f6d0 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d85cd424d0 con 0x55d85cb4aaa0 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 10 client.0 _ll_register_callbacks cb 0x55d85cd207f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46128/0 (socket says 172.21.15.64:46128) 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 -- 172.21.15.64:0/1067827410 learned_addr learned my addr 172.21.15.64:0/1067827410 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 0x55d85cf5e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad6f400640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85cf57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 -- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 msgr2=0x55d85cf57f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85cf57f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 -- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 msgr2=0x55d85cf5e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 0x55d85cf5e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 -- 172.21.15.64:0/1067827410 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85cd3b210 con 0x55d85ca86890 2024-09-21T07:31:22.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 0x55d85cf5e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad77e00640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fad6801aee0 tx=0x7fad6801b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fee719edf12f005 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680a5ce0 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fad68005020 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d85cd35350 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fad680d0050 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 10 client.8370 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55d85cd21fc0 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d85cd35350 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fad680d3020 con 0x55d85ca86890 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 10 client.8370 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 10 client.8370 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 20 client.8370 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca3f930 0x55d85cfa2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 4 client.8370 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:31:22.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d85cdafb00 con 0x55d85ca3f930 2024-09-21T07:31:22.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad6f400640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca3f930 0x55d85cfa2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad6f400640 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca3f930 0x55d85cfa2e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa81cba2d4d2621 server_cookie=512aaa89cb9b43bf in_seq=0 out_seq=0 2024-09-21T07:31:22.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 10 client.8370 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 1 -- 172.21.15.64:0/1067827410 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d85cdafb00 con 0x55d85ca3f930 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad64c00640 10 client.8370 handle_command_reply: tid=0 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.193+0000 7fad862a7000 1 client.8370 shutdown 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 msgr2=0x55d85cf57a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fad6801aee0 tx=0x7fad6801b070 comp rx=0 tx=0).stop 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 shutdown_connections 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ce2f6d0 0x55d85cf5e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85cf57f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca3f930 0x55d85cfa2e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 --2- 172.21.15.64:0/1067827410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ca86890 0x55d85cf57a00 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 >> 172.21.15.64:0/1067827410 conn(0x55d85ca5a5c0 msgr2=0x55d85cf50d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad64c00640 0 client.8370 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 shutdown_connections 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 1 -- 172.21.15.64:0/1067827410 wait complete. 2024-09-21T07:31:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.197+0000 7fad862a7000 20 client.8370 trim_cache size 0 max 16384 2024-09-21T07:31:22.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.213+0000 7fad862a7000 1 Processor -- start 2024-09-21T07:31:22.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.213+0000 7fad862a7000 1 -- start start 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85d00d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85d00d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d85cf56b20 con 0x55d85ce2f6d0 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad78205960 con 0x55d85ca86890 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fad782049d0 con 0x55d85cb4aaa0 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46130/0 (socket says 172.21.15.64:46130) 2024-09-21T07:31:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 -- 172.21.15.64:0/3014446937 learned_addr learned my addr 172.21.15.64:0/3014446937 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad77e00640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85d00d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad6f400640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85d00d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 -- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 msgr2=0x55d85d00d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85d00d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 -- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 msgr2=0x55d85d00d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85d00d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 -- 172.21.15.64:0/3014446937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85cdfa680 con 0x55d85ce2f6d0 2024-09-21T07:31:22.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad6f400640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85d00d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad77e00640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85d00d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad7cc00640 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c640 tx=0x7fad70009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cfe928086c9a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad67400640 1 -- 172.21.15.64:0/3014446937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7004c020 con 0x55d85ce2f6d0 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad67400640 1 -- 172.21.15.64:0/3014446937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad7005b720 con 0x55d85ce2f6d0 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad67400640 1 -- 172.21.15.64:0/3014446937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70084040 con 0x55d85ce2f6d0 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- 172.21.15.64:0/3014446937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 msgr2=0x55d85d00de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c640 tx=0x7fad70009720 comp rx=0 tx=0).stop 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- 172.21.15.64:0/3014446937 shutdown_connections 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85d00de80 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85cb4aaa0 0x55d85d00d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 --2- 172.21.15.64:0/3014446937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85ca86890 0x55d85d00d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- 172.21.15.64:0/3014446937 >> 172.21.15.64:0/3014446937 conn(0x55d85ca5a5c0 msgr2=0x55d85cfadfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- 172.21.15.64:0/3014446937 shutdown_connections 2024-09-21T07:31:22.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- 172.21.15.64:0/3014446937 wait complete. 2024-09-21T07:31:22.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.217+0000 7fad862a7000 1 -- start start 2024-09-21T07:31:22.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 Processor -- start 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ca86890 0x55d85d00d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85cb4aaa0 0x55d85d00dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad78165350 con 0x55d85ce2f6d0 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad781f9b40 con 0x55d85cb4aaa0 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55d85ca62680 con 0x55d85ca86890 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 10 client.0 _ll_register_callbacks cb 0x7fad68009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46144/0 (socket says 172.21.15.64:46144) 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 -- 172.21.15.64:0/1584061672 learned_addr learned my addr 172.21.15.64:0/1584061672 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad77e00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ca86890 0x55d85d00d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad6f400640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85cb4aaa0 0x55d85d00dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 -- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ca86890 msgr2=0x55d85d00d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ca86890 0x55d85d00d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 -- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85cb4aaa0 msgr2=0x55d85d00dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85cb4aaa0 0x55d85d00dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 -- 172.21.15.64:0/1584061672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85cd670b0 con 0x55d85ce2f6d0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad7cc00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fad7005f670 tx=0x7fad70066320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3229a663502fba04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7004c050 con 0x55d85ce2f6d0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fad70068040 con 0x55d85ce2f6d0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad7005b720 con 0x55d85ce2f6d0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fad70080e60 con 0x55d85ce2f6d0 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 10 client.8376 fetch_fsmap learned FSMap version 94 2024-09-21T07:31:22.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55d85cd33610 con 0x55d85ce2f6d0 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad7005b720 con 0x55d85ce2f6d0 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fad7000f040 con 0x55d85ce2f6d0 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 10 client.8376 fetch_fsmap finished waiting for FSMap version 94 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 10 client.8376 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 20 client.8376 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca2d990 0x55d85cf52da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 4 client.8376 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 --> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d85cdab5b0 con 0x55d85ca2d990 2024-09-21T07:31:22.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.221+0000 7fad77e00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca2d990 0x55d85cf52da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad77e00640 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca2d990 0x55d85cf52da0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb99c017e7c09c8f server_cookie=df29192909c4f7e5 in_seq=0 out_seq=0 2024-09-21T07:31:22.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad64c00640 10 client.8376 ms_handle_connect on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:22.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad64c00640 1 -- 172.21.15.64:0/1584061672 <== mds.0 v2:172.21.15.64:6832/158277074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x55d85cdab5b0 con 0x55d85ca2d990 2024-09-21T07:31:22.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad64c00640 10 client.8376 handle_command_reply: tid=0 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 client.8376 shutdown 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 msgr2=0x55d85cf52440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fad7005f670 tx=0x7fad70066320 comp rx=0 tx=0).stop 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 shutdown_connections 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:6832/158277074,v1:172.21.15.64:6833/158277074] conn(0x55d85ca2d990 0x55d85cf52da0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d85ce2f6d0 0x55d85cf52440 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d85cb4aaa0 0x55d85d00dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad64c00640 0 client.8376 ms_handle_reset on v2:172.21.15.64:6832/158277074 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 --2- 172.21.15.64:0/1584061672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d85ca86890 0x55d85d00d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 >> 172.21.15.64:0/1584061672 conn(0x55d85ca5a5c0 msgr2=0x55d85cf5d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 shutdown_connections 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 1 -- 172.21.15.64:0/1584061672 wait complete. 2024-09-21T07:31:22.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad862a7000 20 client.8376 trim_cache size 0 max 16384 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "8dd45231-b763-469d-b691-93cfd723f08d": { 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:31:16.405822+0000", 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:22.230 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:22.231 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:22.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 msgr2=0x7fad54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 0x7fad54075710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fad680af000 tx=0x7fad680a7040 comp rx=0 tx=0).stop 2024-09-21T07:31:22.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 msgr2=0x7fad7815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fad7000e960 tx=0x7fad7000ee20 comp rx=0 tx=0).stop 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 shutdown_connections 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad54073200 0x7fad54075710 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad7815ec20 0x7fad7815b310 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad780ca990 0x7fad780ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 --2- 172.21.15.64:0/1648980872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad780704f0 0x7fad780c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 >> 172.21.15.64:0/1648980872 conn(0x7fad780ccbe0 msgr2=0x7fad780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 shutdown_connections 2024-09-21T07:31:22.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.225+0000 7fad7ec00640 1 -- 172.21.15.64:0/1648980872 wait complete. 2024-09-21T07:31:22.246 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:31:22.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:22.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 -- 172.21.15.64:0/4281685550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac06f670 msgr2=0x7fceac15b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 --2- 172.21.15.64:0/4281685550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac06f670 0x7fceac15b5a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009840 tx=0x7fce9c01c7e0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 -- 172.21.15.64:0/4281685550 shutdown_connections 2024-09-21T07:31:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 --2- 172.21.15.64:0/4281685550 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac0cea30 0x7fceac0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 --2- 172.21.15.64:0/4281685550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac06f670 0x7fceac15b5a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 -- 172.21.15.64:0/4281685550 >> 172.21.15.64:0/4281685550 conn(0x7fceac0d0c50 msgr2=0x7fceac0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 -- 172.21.15.64:0/4281685550 shutdown_connections 2024-09-21T07:31:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.401+0000 7fceb1a00640 1 -- 172.21.15.64:0/4281685550 wait complete. 2024-09-21T07:31:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 Processor -- start 2024-09-21T07:31:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 -- start start 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac06f670 0x7fceac14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fceac0cea30 0x7fceac0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fceac168b30 con 0x7fceac073610 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1689b0 con 0x7fceac0cea30 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceb1a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fceac168cb0 con 0x7fceac06f670 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46172/0 (socket says 172.21.15.64:46172) 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 -- 172.21.15.64:0/979001068 learned_addr learned my addr 172.21.15.64:0/979001068 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceaaa00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac06f670 0x7fceac14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fceab400640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fceac0cea30 0x7fceac0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 -- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac06f670 msgr2=0x7fceac14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac06f670 0x7fceac14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 -- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fceac0cea30 msgr2=0x7fceac0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fceac0cea30 0x7fceac0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.405+0000 7fcea3e00640 1 -- 172.21.15.64:0/979001068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac0cad40 con 0x7fceac073610 2024-09-21T07:31:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea3e00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c3a0 tx=0x7fce9400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94017070 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce94003600 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac14dc30 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94003a50 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac14e1f0 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac14d9a0 con 0x7fceac073610 2024-09-21T07:31:22.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce9401a070 con 0x7fceac073610 2024-09-21T07:31:22.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.409+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fce94093600 con 0x7fceac073610 2024-09-21T07:31:22.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.413+0000 7fceaaa00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.413+0000 7fceaaa00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 0x7fce88075740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0af000 tx=0x7fce9c01b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.417+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fce9405de30 con 0x7fceac073610 2024-09-21T07:31:22.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.625+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fceac15ae20 con 0x7fceac073610 2024-09-21T07:31:22.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.625+0000 7fcea2a00640 1 -- 172.21.15.64:0/979001068 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7fce94062860 con 0x7fceac073610 2024-09-21T07:31:22.629 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:22.629 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:22.629 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 msgr2=0x7fce88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 0x7fce88075740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0af000 tx=0x7fce9c01b020 comp rx=0 tx=0).stop 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 msgr2=0x7fceac14ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c3a0 tx=0x7fce9400c860 comp rx=0 tx=0).stop 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 shutdown_connections 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fceac0cea30 0x7fceac0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceac073610 0x7fceac14ecd0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 --2- 172.21.15.64:0/979001068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fceac06f670 0x7fceac14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 >> 172.21.15.64:0/979001068 conn(0x7fceac0d0c50 msgr2=0x7fceac0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 shutdown_connections 2024-09-21T07:31:22.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.629+0000 7fceb1a00640 1 -- 172.21.15.64:0/979001068 wait complete. 2024-09-21T07:31:22.651 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:31:22.651 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 -- 172.21.15.64:0/1049951261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4806f010 msgr2=0x7fac48169520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 --2- 172.21.15.64:0/1049951261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4806f010 0x7fac48169520 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fac40009c80 tx=0x7fac4001cd10 comp rx=0 tx=0).stop 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 -- 172.21.15.64:0/1049951261 shutdown_connections 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 --2- 172.21.15.64:0/1049951261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4806f010 0x7fac48169520 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 -- 172.21.15.64:0/1049951261 >> 172.21.15.64:0/1049951261 conn(0x7fac4806d480 msgr2=0x7fac480d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 -- 172.21.15.64:0/1049951261 shutdown_connections 2024-09-21T07:31:22.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.805+0000 7fac4da00640 1 -- 172.21.15.64:0/1049951261 wait complete. 2024-09-21T07:31:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 Processor -- start 2024-09-21T07:31:22.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 -- start start 2024-09-21T07:31:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4806f010 0x7fac4814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac480d01d0 0x7fac480b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac4816d120 con 0x7fac480b3ce0 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac4816cfa0 con 0x7fac480d01d0 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac4da00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac4816d2a0 con 0x7fac4806f010 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46182/0 (socket says 172.21.15.64:46182) 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 -- 172.21.15.64:0/3366715710 learned_addr learned my addr 172.21.15.64:0/3366715710 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac46a00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4806f010 0x7fac4814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac47400640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac480d01d0 0x7fac480b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 -- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4806f010 msgr2=0x7fac4814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4806f010 0x7fac4814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 -- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac480d01d0 msgr2=0x7fac480b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac480d01d0 0x7fac480b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.809+0000 7fac3fe00640 1 -- 172.21.15.64:0/3366715710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac480c5d80 con 0x7fac480b3ce0 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3fe00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fac3000c420 tx=0x7fac3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30017070 con 0x7fac480b3ce0 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac300053c0 con 0x7fac480b3ce0 2024-09-21T07:31:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30003860 con 0x7fac480b3ce0 2024-09-21T07:31:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac481571f0 con 0x7fac480b3ce0 2024-09-21T07:31:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac480c6340 con 0x7fac480b3ce0 2024-09-21T07:31:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480d05e0 con 0x7fac480b3ce0 2024-09-21T07:31:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac3001a070 con 0x7fac480b3ce0 2024-09-21T07:31:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 0x7fac24075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.813+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fac30093670 con 0x7fac480b3ce0 2024-09-21T07:31:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.817+0000 7fac46a00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 0x7fac24075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:22.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.817+0000 7fac46a00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 0x7fac24075740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac38007fd0 tx=0x7fac38009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:22.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:22.821+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fac3005dea0 con 0x7fac480b3ce0 2024-09-21T07:31:23.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.057+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fac480b7820 con 0x7fac480b3ce0 2024-09-21T07:31:23.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.057+0000 7fac3ea00640 1 -- 172.21.15.64:0/3366715710 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1679 (secure 0 0 0) 0x7fac300628d0 con 0x7fac480b3ce0 2024-09-21T07:31:23.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:23.061 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":541,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076758939,"bytes_used":2555650048,"bytes_avail":770538463232,"bytes_total":773094113280,"write_bytes_sec":39531423,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8139}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-21T07:31:21.562342+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 msgr2=0x7fac24075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 0x7fac24075740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac38007fd0 tx=0x7fac38009040 comp rx=0 tx=0).stop 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 msgr2=0x7fac481579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fac3000c420 tx=0x7fac3000c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 shutdown_connections 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac24073230 0x7fac24075740 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:23.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac480d01d0 0x7fac480b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:23.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480b3ce0 0x7fac481579f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:23.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 --2- 172.21.15.64:0/3366715710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4806f010 0x7fac4814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:23.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 >> 172.21.15.64:0/3366715710 conn(0x7fac4806d480 msgr2=0x7fac480b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:23.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 shutdown_connections 2024-09-21T07:31:23.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:23.061+0000 7fac4da00640 1 -- 172.21.15.64:0/3366715710 wait complete. 2024-09-21T07:31:23.083 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-21T07:31:24.083 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 -- 172.21.15.64:0/1211377250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78400b48d0 msgr2=0x7f7840072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 --2- 172.21.15.64:0/1211377250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78400b48d0 0x7f7840072e20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7838009bc0 tx=0x7f783801cba0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 -- 172.21.15.64:0/1211377250 shutdown_connections 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 --2- 172.21.15.64:0/1211377250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78400b48d0 0x7f7840072e20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 --2- 172.21.15.64:0/1211377250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f784015edb0 0x7f78400700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 -- 172.21.15.64:0/1211377250 >> 172.21.15.64:0/1211377250 conn(0x7f78400ccbe0 msgr2=0x7f78400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:24.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 -- 172.21.15.64:0/1211377250 shutdown_connections 2024-09-21T07:31:24.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.257+0000 7f7848000640 1 -- 172.21.15.64:0/1211377250 wait complete. 2024-09-21T07:31:24.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 Processor -- start 2024-09-21T07:31:24.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 -- start start 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78400709b0 0x7f78400c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784009a9f0 0x7f784009ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7840168cf0 con 0x7f784015edb0 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7840168b70 con 0x7f784009a9f0 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7848000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7840168e70 con 0x7f78400709b0 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46196/0 (socket says 172.21.15.64:46196) 2024-09-21T07:31:24.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 -- 172.21.15.64:0/3714996591 learned_addr learned my addr 172.21.15.64:0/3714996591 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:24.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7846000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784009a9f0 0x7f784009ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7845600640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78400709b0 0x7f78400c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 -- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78400709b0 msgr2=0x7f78400c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78400709b0 0x7f78400c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 -- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784009a9f0 msgr2=0x7f784009ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784009a9f0 0x7f784009ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 -- 172.21.15.64:0/3714996591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78400c8070 con 0x7f784015edb0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f7844c00640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f782c001ec0 tx=0x7f782c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.261+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c011790 con 0x7f784015edb0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784009d1b0 con 0x7f784015edb0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f782c017070 con 0x7f784015edb0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c011d40 con 0x7f784015edb0 2024-09-21T07:31:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784009d770 con 0x7f784015edb0 2024-09-21T07:31:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78400af3d0 con 0x7f784015edb0 2024-09-21T07:31:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f782c01c460 con 0x7f784015edb0 2024-09-21T07:31:24.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f783d600640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 0x7f7820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f782c094090 con 0x7f784015edb0 2024-09-21T07:31:24.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.265+0000 7f7845600640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 0x7f7820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.269+0000 7f7845600640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 0x7f7820075710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7834009600 tx=0x7f78340091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:24.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.269+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f782c05e840 con 0x7f784015edb0 2024-09-21T07:31:24.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.481+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7840072e20 con 0x7f784015edb0 2024-09-21T07:31:24.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f783d600640 1 -- 172.21.15.64:0/3714996591 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7f782c063270 con 0x7f784015edb0 2024-09-21T07:31:24.485 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:24.485 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:24.486 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:24.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 msgr2=0x7f7820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 0x7f7820075710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7834009600 tx=0x7f78340091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 msgr2=0x7f784015b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f782c001ec0 tx=0x7f782c00c820 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 shutdown_connections 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7820073200 0x7f7820075710 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784009a9f0 0x7f784009ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784015edb0 0x7f784015b710 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 --2- 172.21.15.64:0/3714996591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78400709b0 0x7f78400c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 >> 172.21.15.64:0/3714996591 conn(0x7f78400ccbe0 msgr2=0x7f78400caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 shutdown_connections 2024-09-21T07:31:24.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.485+0000 7f7848000640 1 -- 172.21.15.64:0/3714996591 wait complete. 2024-09-21T07:31:24.507 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:31:24.508 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:31:24.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 -- 172.21.15.64:0/1934816681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42940cf740 msgr2=0x7f42940cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 --2- 172.21.15.64:0/1934816681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42940cf740 0x7f42940cfb50 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f4284009c80 tx=0x7f428401cd70 comp rx=0 tx=0).stop 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 -- 172.21.15.64:0/1934816681 shutdown_connections 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 --2- 172.21.15.64:0/1934816681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4294073450 0x7f4294073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 --2- 172.21.15.64:0/1934816681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42940cf740 0x7f42940cfb50 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 -- 172.21.15.64:0/1934816681 >> 172.21.15.64:0/1934816681 conn(0x7f42940cd2b0 msgr2=0x7f42940cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 -- 172.21.15.64:0/1934816681 shutdown_connections 2024-09-21T07:31:24.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.661+0000 7f4293200640 1 -- 172.21.15.64:0/1934816681 wait complete. 2024-09-21T07:31:24.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 Processor -- start 2024-09-21T07:31:24.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 -- start start 2024-09-21T07:31:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 0x7f4294151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42940cf740 0x7f4294152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4294168d30 con 0x7f4294073450 2024-09-21T07:31:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4294168bb0 con 0x7f42940cf740 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4293200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4294168eb0 con 0x7f42940ce400 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46206/0 (socket says 172.21.15.64:46206) 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 -- 172.21.15.64:0/1744745937 learned_addr learned my addr 172.21.15.64:0/1744745937 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4292800640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42940cf740 0x7f4294152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4289400640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 0x7f4294151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 -- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 msgr2=0x7f4294151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 0x7f4294151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 -- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42940cf740 msgr2=0x7f4294152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42940cf740 0x7f4294152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4291e00640 1 -- 172.21.15.64:0/1744745937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940b63a0 con 0x7f4294073450 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.665+0000 7f4289400640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 0x7f4294151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f4291e00640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4284000f90 tx=0x7f42840092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840bb070 con 0x7f4294073450 2024-09-21T07:31:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4284004d40 con 0x7f4294073450 2024-09-21T07:31:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840b2040 con 0x7f4294073450 2024-09-21T07:31:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429414c070 con 0x7f4294073450 2024-09-21T07:31:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42940b3660 con 0x7f4294073450 2024-09-21T07:31:24.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4294073860 con 0x7f4294073450 2024-09-21T07:31:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.669+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42840be070 con 0x7f4294073450 2024-09-21T07:31:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.673+0000 7f428aa00640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 0x7f4270075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.673+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f428412e830 con 0x7f4294073450 2024-09-21T07:31:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.673+0000 7f4289400640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 0x7f4270075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.673+0000 7f4289400640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 0x7f4270075740 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4294153fd0 tx=0x7f427c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.673+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f42840c5070 con 0x7f4294073450 2024-09-21T07:31:24.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.917+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f42940ce9b0 con 0x7f4294073450 2024-09-21T07:31:24.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.917+0000 7f428aa00640 1 -- 172.21.15.64:0/1744745937 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1679 (secure 0 0 0) 0x7f4284016990 con 0x7f4294073450 2024-09-21T07:31:24.920 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:24.920 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":542,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076758939,"bytes_used":2555650048,"bytes_avail":770538463232,"bytes_total":773094113280,"write_bytes_sec":36429910,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8139}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-21T07:31:21.562342+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:31:24.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 msgr2=0x7f4270075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 0x7f4270075740 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4294153fd0 tx=0x7f427c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 msgr2=0x7f429414aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4284000f90 tx=0x7f42840092c0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 shutdown_connections 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4270073230 0x7f4270075740 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42940cf740 0x7f4294152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42940ce400 0x7f4294151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 --2- 172.21.15.64:0/1744745937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4294073450 0x7f429414aff0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 >> 172.21.15.64:0/1744745937 conn(0x7f42940cd2b0 msgr2=0x7f429414cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 shutdown_connections 2024-09-21T07:31:24.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:24.921+0000 7f4293200640 1 -- 172.21.15.64:0/1744745937 wait complete. 2024-09-21T07:31:24.942 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-21T07:31:25.943 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:26.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- 172.21.15.64:0/3136494016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24000b48d0 msgr2=0x7f2400072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 --2- 172.21.15.64:0/3136494016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24000b48d0 0x7f2400072e20 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f24000c3c60 tx=0x7f23f801cd80 comp rx=0 tx=0).stop 2024-09-21T07:31:26.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- 172.21.15.64:0/3136494016 shutdown_connections 2024-09-21T07:31:26.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 --2- 172.21.15.64:0/3136494016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24000b48d0 0x7f2400072e20 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 --2- 172.21.15.64:0/3136494016 >> v2:172.21.15.90:3300/0 conn(0x7f240015edb0 0x7f24000700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- 172.21.15.64:0/3136494016 >> 172.21.15.64:0/3136494016 conn(0x7f24000ccbe0 msgr2=0x7f24000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:26.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- 172.21.15.64:0/3136494016 shutdown_connections 2024-09-21T07:31:26.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- 172.21.15.64:0/3136494016 wait complete. 2024-09-21T07:31:26.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 Processor -- start 2024-09-21T07:31:26.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.113+0000 7f2407200640 1 -- start start 2024-09-21T07:31:26.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24000709b0 0x7f24000ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240015edb0 0x7f2400158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2400168b60 con 0x7f240009c910 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24001689e0 con 0x7f240015edb0 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2400168ce0 con 0x7f24000709b0 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54552/0 (socket says 172.21.15.64:54552) 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 -- 172.21.15.64:0/2648355112 learned_addr learned my addr 172.21.15.64:0/2648355112 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 -- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24000709b0 msgr2=0x7f24000ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24000709b0 0x7f24000ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 -- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240015edb0 msgr2=0x7f2400158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240015edb0 0x7f2400158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 -- 172.21.15.64:0/2648355112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240009b400 con 0x7f240009c910 2024-09-21T07:31:26.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2405200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009bd0 tx=0x7f23f80a59d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80bb070 con 0x7f240009c910 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23f8004e00 con 0x7f240009c910 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80b2040 con 0x7f240009c910 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240009b870 con 0x7f240009c910 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240009be30 con 0x7f240009c910 2024-09-21T07:31:26.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.117+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2400072e20 con 0x7f240009c910 2024-09-21T07:31:26.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.121+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f23f8004320 con 0x7f240009c910 2024-09-21T07:31:26.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.121+0000 7f23f7e00640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 0x7f23e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.121+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f23f812e340 con 0x7f240009c910 2024-09-21T07:31:26.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.121+0000 7f23ffe00640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 0x7f23e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.121+0000 7f23ffe00640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 0x7f23e0075740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f23f000a910 tx=0x7f23f0005be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:26.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.125+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f23f8016970 con 0x7f240009c910 2024-09-21T07:31:26.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.337+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f240009dfd0 con 0x7f240009c910 2024-09-21T07:31:26.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.337+0000 7f23f7e00640 1 -- 172.21.15.64:0/2648355112 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7f23f80f9290 con 0x7f240009c910 2024-09-21T07:31:26.339 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:26.339 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:26.340 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 msgr2=0x7f23e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 0x7f23e0075740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f23f000a910 tx=0x7f23f0005be0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 msgr2=0x7f24001592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009bd0 tx=0x7f23f80a59d0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 shutdown_connections 2024-09-21T07:31:26.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f23e0073230 0x7f23e0075740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f240009c910 0x7f24001592d0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240015edb0 0x7f2400158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 --2- 172.21.15.64:0/2648355112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24000709b0 0x7f24000ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 >> 172.21.15.64:0/2648355112 conn(0x7f24000ccbe0 msgr2=0x7f2400156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 shutdown_connections 2024-09-21T07:31:26.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.341+0000 7f2407200640 1 -- 172.21.15.64:0/2648355112 wait complete. 2024-09-21T07:31:26.362 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:31:26.362 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 -- 172.21.15.64:0/3133001276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c073e80 msgr2=0x7f5b7c074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 --2- 172.21.15.64:0/3133001276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c073e80 0x7f5b7c074290 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0c8330 tx=0x7f5b7401cc60 comp rx=0 tx=0).stop 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 -- 172.21.15.64:0/3133001276 shutdown_connections 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 --2- 172.21.15.64:0/3133001276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c073e80 0x7f5b7c074290 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 --2- 172.21.15.64:0/3133001276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c0cc360 0x7f5b7c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 -- 172.21.15.64:0/3133001276 >> 172.21.15.64:0/3133001276 conn(0x7f5b7c0b2dc0 msgr2=0x7f5b7c0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 -- 172.21.15.64:0/3133001276 shutdown_connections 2024-09-21T07:31:26.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.517+0000 7f5b81a00640 1 -- 172.21.15.64:0/3133001276 wait complete. 2024-09-21T07:31:26.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 Processor -- start 2024-09-21T07:31:26.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 -- start start 2024-09-21T07:31:26.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7c073e80 0x7f5b7c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c154740 0x7f5b7c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c16a0e0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c169f60 con 0x7f5b7c073e80 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b81a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7c16a260 con 0x7f5b7c154740 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54580/0 (socket says 172.21.15.64:54580) 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 -- 172.21.15.64:0/2695844441 learned_addr learned my addr 172.21.15.64:0/2695844441 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7b400640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c154740 0x7f5b7c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7aa00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7c073e80 0x7f5b7c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 -- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c154740 msgr2=0x7f5b7c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c154740 0x7f5b7c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 -- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7c073e80 msgr2=0x7f5b7c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7c073e80 0x7f5b7c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 -- 172.21.15.64:0/2695844441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c15e0f0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.521+0000 7f5b7a000640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c9a0 tx=0x7f5b6800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:26.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68014070 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b680077a0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c0b5900 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007bd0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c158ca0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7c0b5670 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5b68017070 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 0x7f5b5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:26.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.525+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f5b68094700 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.529+0000 7f5b7aa00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 0x7f5b5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:26.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.529+0000 7f5b7aa00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 0x7f5b5c075710 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00b810 tx=0x7f5b6c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:26.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.529+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5b6805f4f0 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.769+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5b7c074290 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.769+0000 7f5b72a00640 1 -- 172.21.15.64:0/2695844441 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1617 (secure 0 0 0) 0x7f5b68092e20 con 0x7f5b7c0b6bb0 2024-09-21T07:31:26.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:26.773 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":544,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076758939,"bytes_used":2555650048,"bytes_avail":770538463232,"bytes_total":773094113280,"write_bytes_sec":18081708,"read_op_per_sec":0,"write_op_per_sec":31},"fsmap":{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8139}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-21T07:31:25.563578+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 msgr2=0x7f5b5c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 0x7f5b5c075710 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00b810 tx=0x7f5b6c008040 comp rx=0 tx=0).stop 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 msgr2=0x7f5b7c1475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c9a0 tx=0x7f5b6800ce60 comp rx=0 tx=0).stop 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 shutdown_connections 2024-09-21T07:31:26.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5b5c073200 0x7f5b5c075710 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b7c154740 0x7f5b7c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0b6bb0 0x7f5b7c1475c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 --2- 172.21.15.64:0/2695844441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7c073e80 0x7f5b7c15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 >> 172.21.15.64:0/2695844441 conn(0x7f5b7c0b2dc0 msgr2=0x7f5b7c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 shutdown_connections 2024-09-21T07:31:26.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:26.773+0000 7f5b81a00640 1 -- 172.21.15.64:0/2695844441 wait complete. 2024-09-21T07:31:26.795 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:31:26.795 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:31:26.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:31:26.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:31:26.953 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:31:26.953 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:31:26.953 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:26.953 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:26.963 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:26.963 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:27.013 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:31:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 -- 172.21.15.64:0/444071799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16fc004810 msgr2=0x7f16fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 --2- 172.21.15.64:0/444071799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16fc004810 0x7f16fc004c80 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1700009b60 tx=0x7f170001d290 comp rx=0 tx=0).stop 2024-09-21T07:31:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f1716800640 1 -- 172.21.15.64:0/444071799 reap_dead start 2024-09-21T07:31:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 -- 172.21.15.64:0/444071799 shutdown_connections 2024-09-21T07:31:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 -- 172.21.15.64:0/444071799 >> 172.21.15.64:0/444071799 conn(0x7f171806d450 msgr2=0x7f17180d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:27.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 -- 172.21.15.64:0/444071799 shutdown_connections 2024-09-21T07:31:27.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.217+0000 7f171d200640 1 -- 172.21.15.64:0/444071799 wait complete. 2024-09-21T07:31:27.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 Processor -- start 2024-09-21T07:31:27.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 -- start start 2024-09-21T07:31:27.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16fc004810 0x7f17180c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:27.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:27.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17181e9180 0x7f17180c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:27.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17180cd590 con 0x7f17181e7a00 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17180cd410 con 0x7f17181e9180 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f171d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f17180b4de0 con 0x7f16fc004810 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54600/0 (socket says 172.21.15.64:54600) 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 -- 172.21.15.64:0/3112701303 learned_addr learned my addr 172.21.15.64:0/3112701303 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f1715e00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16fc004810 0x7f17180c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f1716800640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17181e9180 0x7f17180c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 -- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16fc004810 msgr2=0x7f17180c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16fc004810 0x7f17180c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 -- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17181e9180 msgr2=0x7f17180c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17181e9180 0x7f17180c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 -- 172.21.15.64:0/3112701303 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17181e80e0 con 0x7f17181e7a00 2024-09-21T07:31:27.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.221+0000 7f170fe00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1700009b60 tx=0x7f17000ac400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:27.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000b1040 con 0x7f17181e7a00 2024-09-21T07:31:27.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17000bb070 con 0x7f17181e7a00 2024-09-21T07:31:27.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700005040 con 0x7f17181e7a00 2024-09-21T07:31:27.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17181e83c0 con 0x7f17181e7a00 2024-09-21T07:31:27.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17181e8980 con 0x7f17181e7a00 2024-09-21T07:31:27.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171806f290 con 0x7f17181e7a00 2024-09-21T07:31:27.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.225+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f17000051e0 con 0x7f17181e7a00 2024-09-21T07:31:27.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.229+0000 7f170e000640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 0x7f16f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:27.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.229+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f170012fb30 con 0x7f17181e7a00 2024-09-21T07:31:27.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.229+0000 7f1715e00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 0x7f16f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:27.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.229+0000 7f1715e00640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 0x7f16f4075740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f170800afd0 tx=0x7f17080067e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:27.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.229+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1700016fa0 con 0x7f17181e7a00 2024-09-21T07:31:27.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17181e7e70 con 0x7f17181e7a00 2024-09-21T07:31:27.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f170e000640 1 -- 172.21.15.64:0/3112701303 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v131) ==== 80+0+0 (secure 0 0 0) 0x7f17000faa30 con 0x7f17181e7a00 2024-09-21T07:31:27.422 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 msgr2=0x7f16f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 0x7f16f4075740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f170800afd0 tx=0x7f17080067e0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 msgr2=0x7f17180c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1700009b60 tx=0x7f17000ac400 comp rx=0 tx=0).stop 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 shutdown_connections 2024-09-21T07:31:27.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f16f4073230 0x7f16f4075740 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17181e9180 0x7f17180c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17181e7a00 0x7f17180c8d80 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 --2- 172.21.15.64:0/3112701303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16fc004810 0x7f17180c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 >> 172.21.15.64:0/3112701303 conn(0x7f171806d450 msgr2=0x7f1718072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 shutdown_connections 2024-09-21T07:31:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:27.421+0000 7f171d200640 1 -- 172.21.15.64:0/3112701303 wait complete. 2024-09-21T07:31:27.445 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:31:27.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:27.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:28.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:31:28.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:28.202 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:31:28.212 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:31:28.212 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:31:28.212 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:28.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:31:28.222 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:31:28.222 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:28.222 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:28.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:31:28.261 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:31:28.261 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:31:28.261 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:28.273 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:31:28.273 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 -- 172.21.15.64:0/1449690767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240709b0 msgr2=0x7f6f240b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/1449690767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240709b0 0x7f6f240b41c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009840 tx=0x7f6f1001c820 comp rx=0 tx=0).stop 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 -- 172.21.15.64:0/1449690767 shutdown_connections 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/1449690767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240709b0 0x7f6f240b41c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 -- 172.21.15.64:0/1449690767 >> 172.21.15.64:0/1449690767 conn(0x7f6f240ccbe0 msgr2=0x7f6f240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 -- 172.21.15.64:0/1449690767 shutdown_connections 2024-09-21T07:31:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.465+0000 7f6f2ba00640 1 -- 172.21.15.64:0/1449690767 wait complete. 2024-09-21T07:31:28.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 Processor -- start 2024-09-21T07:31:28.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 -- start start 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240b4700 0x7f6f2414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 0x7f6f2409a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240b38a0 con 0x7f6f240709b0 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240b3720 con 0x7f6f240b4700 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6f240b3a20 con 0x7f6f2415edb0 2024-09-21T07:31:28.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54606/0 (socket says 172.21.15.64:54606) 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 -- 172.21.15.64:0/2848840053 learned_addr learned my addr 172.21.15.64:0/2848840053 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f23e00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240b4700 0x7f6f2414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29a00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 0x7f6f2409a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 -- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 msgr2=0x7f6f2409a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 0x7f6f2409a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 -- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240b4700 msgr2=0x7f6f2414bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240b4700 0x7f6f2414bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 -- 172.21.15.64:0/2848840053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240ae710 con 0x7f6f240709b0 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29a00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 0x7f6f2409a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:28.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f29000640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c760 tx=0x7f6f1800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18016020 con 0x7f6f240709b0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f1800a8f0 con 0x7f6f240709b0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800ad40 con 0x7f6f240709b0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.469+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f240ace70 con 0x7f6f240709b0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f240aecd0 con 0x7f6f240709b0 2024-09-21T07:31:28.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24072e20 con 0x7f6f240709b0 2024-09-21T07:31:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f18019020 con 0x7f6f240709b0 2024-09-21T07:31:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f20c00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 0x7f6f04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f6f180943a0 con 0x7f6f240709b0 2024-09-21T07:31:28.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.473+0000 7f6f23e00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 0x7f6f04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.477+0000 7f6f23e00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 0x7f6f04075710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f100af000 tx=0x7f6f1001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:28.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.477+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6f18020020 con 0x7f6f240709b0 2024-09-21T07:31:28.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f24159c90 con 0x7f6f240709b0 2024-09-21T07:31:28.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f20c00640 1 -- 172.21.15.64:0/2848840053 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7f6f240b4b10 con 0x7f6f240709b0 2024-09-21T07:31:28.694 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:28.694 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:28.695 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:28.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 msgr2=0x7f6f04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 0x7f6f04075710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f100af000 tx=0x7f6f1001b060 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 msgr2=0x7f6f240af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c760 tx=0x7f6f1800cc20 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 shutdown_connections 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f04073200 0x7f6f04075710 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f2415edb0 0x7f6f2409a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f240b4700 0x7f6f2414bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 --2- 172.21.15.64:0/2848840053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f240709b0 0x7f6f240af000 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 >> 172.21.15.64:0/2848840053 conn(0x7f6f240ccbe0 msgr2=0x7f6f240cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 shutdown_connections 2024-09-21T07:31:28.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.693+0000 7f6f2ba00640 1 -- 172.21.15.64:0/2848840053 wait complete. 2024-09-21T07:31:28.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 -- 172.21.15.64:0/1920930241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75240b22f0 msgr2=0x7f75240cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 --2- 172.21.15.64:0/1920930241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75240b22f0 0x7f75240cbcd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f751c009cb0 tx=0x7f751c01cd90 comp rx=0 tx=0).stop 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 -- 172.21.15.64:0/1920930241 shutdown_connections 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 --2- 172.21.15.64:0/1920930241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75240b22f0 0x7f75240cbcd0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 --2- 172.21.15.64:0/1920930241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f752415cbd0 0x7f7524070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 -- 172.21.15.64:0/1920930241 >> 172.21.15.64:0/1920930241 conn(0x7f75240ccbe0 msgr2=0x7f75240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 -- 172.21.15.64:0/1920930241 shutdown_connections 2024-09-21T07:31:28.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 -- 172.21.15.64:0/1920930241 wait complete. 2024-09-21T07:31:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.873+0000 7f752a000640 1 Processor -- start 2024-09-21T07:31:28.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- start start 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7524070850 0x7f7524152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415cbd0 0x7f7524155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f752416a290 con 0x7f7524155850 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75240b4370 con 0x7f752415cbd0 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f752416a410 con 0x7f7524070850 2024-09-21T07:31:28.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54632/0 (socket says 172.21.15.64:54632) 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 -- 172.21.15.64:0/1207871542 learned_addr learned my addr 172.21.15.64:0/1207871542 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523400640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7524070850 0x7f7524152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f751aa00640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415cbd0 0x7f7524155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 -- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7524070850 msgr2=0x7f7524152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7524070850 0x7f7524152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 -- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415cbd0 msgr2=0x7f7524155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415cbd0 0x7f7524155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 -- 172.21.15.64:0/1207871542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7524156640 con 0x7f7524155850 2024-09-21T07:31:28.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f7523e00640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f751c01d270 tx=0x7f751c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:28.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0bb070 con 0x7f7524155850 2024-09-21T07:31:28.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f751c004510 con 0x7f7524155850 2024-09-21T07:31:28.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7524156080 con 0x7f7524155850 2024-09-21T07:31:28.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0b2040 con 0x7f7524155850 2024-09-21T07:31:28.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.877+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752409aa90 con 0x7f7524155850 2024-09-21T07:31:28.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75240cbcd0 con 0x7f7524155850 2024-09-21T07:31:28.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f751c0be070 con 0x7f7524155850 2024-09-21T07:31:28.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f751be00640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:28.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f751c12e690 con 0x7f7524155850 2024-09-21T07:31:28.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f7523400640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:28.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.881+0000 7f7523400640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 0x7f7500075710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f751400bb50 tx=0x7f751400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:28.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:28.885+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f751c0169b0 con 0x7f7524155850 2024-09-21T07:31:29.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.101+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7524159150 con 0x7f7524155850 2024-09-21T07:31:29.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.101+0000 7f751be00640 1 -- 172.21.15.64:0/1207871542 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7f751c0f8e30 con 0x7f7524155850 2024-09-21T07:31:29.104 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:29.104 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:29.104 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 msgr2=0x7f7500075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 0x7f7500075710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f751400bb50 tx=0x7f751400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 msgr2=0x7f752409ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f751c01d270 tx=0x7f751c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 shutdown_connections 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7524155850 0x7f752409ce70 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415cbd0 0x7f7524155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 --2- 172.21.15.64:0/1207871542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7524070850 0x7f7524152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 >> 172.21.15.64:0/1207871542 conn(0x7f75240ccbe0 msgr2=0x7f75240ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 shutdown_connections 2024-09-21T07:31:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.105+0000 7f752a000640 1 -- 172.21.15.64:0/1207871542 wait complete. 2024-09-21T07:31:29.127 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- 172.21.15.64:0/3072479965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a5015edb0 msgr2=0x7f1a500700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 --2- 172.21.15.64:0/3072479965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a5015edb0 0x7f1a500700b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009900 tx=0x7f1a4001c880 comp rx=0 tx=0).stop 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- 172.21.15.64:0/3072479965 shutdown_connections 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 --2- 172.21.15.64:0/3072479965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a500709b0 0x7f1a500b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 --2- 172.21.15.64:0/3072479965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a5015edb0 0x7f1a500700b0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- 172.21.15.64:0/3072479965 >> 172.21.15.64:0/3072479965 conn(0x7f1a500ccbe0 msgr2=0x7f1a500ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- 172.21.15.64:0/3072479965 shutdown_connections 2024-09-21T07:31:29.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- 172.21.15.64:0/3072479965 wait complete. 2024-09-21T07:31:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 Processor -- start 2024-09-21T07:31:29.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.285+0000 7f1a57600640 1 -- start start 2024-09-21T07:31:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 0x7f1a500b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5015edb0 0x7f1a500cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50169060 con 0x7f1a500709b0 2024-09-21T07:31:29.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50168ee0 con 0x7f1a500b4700 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1a501691e0 con 0x7f1a5015edb0 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54652/0 (socket says 172.21.15.64:54652) 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 -- 172.21.15.64:0/1293584364 learned_addr learned my addr 172.21.15.64:0/1293584364 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a47e00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 0x7f1a500b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a55600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5015edb0 0x7f1a500cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 -- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5015edb0 msgr2=0x7f1a500cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5015edb0 0x7f1a500cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 -- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 msgr2=0x7f1a500b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 0x7f1a500b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 -- 172.21.15.64:0/1293584364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a501fd160 con 0x7f1a500709b0 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a47e00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 0x7f1a500b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:29.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a54c00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009850 tx=0x7f1a400a5540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b2040 con 0x7f1a500709b0 2024-09-21T07:31:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a400043b0 con 0x7f1a500709b0 2024-09-21T07:31:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501f9280 con 0x7f1a500709b0 2024-09-21T07:31:29.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005260 con 0x7f1a500709b0 2024-09-21T07:31:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501f9840 con 0x7f1a500709b0 2024-09-21T07:31:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.289+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a500b41c0 con 0x7f1a500709b0 2024-09-21T07:31:29.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.293+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1a40005400 con 0x7f1a500709b0 2024-09-21T07:31:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.293+0000 7f1a4d600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 0x7f1a2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.293+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f1a4012df80 con 0x7f1a500709b0 2024-09-21T07:31:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.293+0000 7f1a47e00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 0x7f1a2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.293+0000 7f1a47e00640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 0x7f1a2c075710 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005fd0 tx=0x7f1a38005f00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:29.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.297+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1a400164d0 con 0x7f1a500709b0 2024-09-21T07:31:29.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.477+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a5009da20 con 0x7f1a500709b0 2024-09-21T07:31:29.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.477+0000 7f1a4d600640 1 -- 172.21.15.64:0/1293584364 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16964 (secure 0 0 0) 0x7f1a400f8e90 con 0x7f1a500709b0 2024-09-21T07:31:29.480 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:29.480 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":131,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:45.126736+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:30:41.341081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-21T07:30:42.525982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 msgr2=0x7f1a2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 0x7f1a2c075710 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005fd0 tx=0x7f1a38005f00 comp rx=0 tx=0).stop 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 msgr2=0x7f1a501fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009850 tx=0x7f1a400a5540 comp rx=0 tx=0).stop 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 shutdown_connections 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1a2c073200 0x7f1a2c075710 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5015edb0 0x7f1a500cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a500b4700 0x7f1a500b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 --2- 172.21.15.64:0/1293584364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a500709b0 0x7f1a501fcc20 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 >> 172.21.15.64:0/1293584364 conn(0x7f1a500ccbe0 msgr2=0x7f1a500caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:29.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 shutdown_connections 2024-09-21T07:31:29.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.481+0000 7f1a57600640 1 -- 172.21.15.64:0/1293584364 wait complete. 2024-09-21T07:31:29.503 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:31:29.503 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- 172.21.15.64:0/3557066025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 msgr2=0x7fb3240cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 --2- 172.21.15.64:0/3557066025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb3240cb100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009840 tx=0x7fb30c01c820 comp rx=0 tx=0).stop 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- 172.21.15.64:0/3557066025 shutdown_connections 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 --2- 172.21.15.64:0/3557066025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb3240cb100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 --2- 172.21.15.64:0/3557066025 >> v2:172.21.15.90:3300/0 conn(0x7fb3240b24e0 0x7fb3240ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- 172.21.15.64:0/3557066025 >> 172.21.15.64:0/3557066025 conn(0x7fb3240ccbe0 msgr2=0x7fb3240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- 172.21.15.64:0/3557066025 shutdown_connections 2024-09-21T07:31:29.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- 172.21.15.64:0/3557066025 wait complete. 2024-09-21T07:31:29.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 Processor -- start 2024-09-21T07:31:29.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.661+0000 7fb329200640 1 -- start start 2024-09-21T07:31:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb32409bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 0x7fb324159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb324168c00 con 0x7fb3240b24e0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb324168a80 con 0x7fb32415e9b0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb324168d80 con 0x7fb3240cacf0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54656/0 (socket says 172.21.15.64:54656) 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 -- 172.21.15.64:0/3387596558 learned_addr learned my addr 172.21.15.64:0/3387596558 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb31be00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb32409bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb322800640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 0x7fb324159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 -- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 msgr2=0x7fb32409bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb32409bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 -- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 msgr2=0x7fb324159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 0x7fb324159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 -- 172.21.15.64:0/3387596558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240c7d90 con 0x7fb3240b24e0 2024-09-21T07:31:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb322800640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 0x7fb324159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:29.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb321e00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e7a0 tx=0x7fb31400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:29.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31400ccc0 con 0x7fb3240b24e0 2024-09-21T07:31:29.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb314010430 con 0x7fb3240b24e0 2024-09-21T07:31:29.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314010860 con 0x7fb3240b24e0 2024-09-21T07:31:29.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3240c8070 con 0x7fb3240b24e0 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32415a080 con 0x7fb3240b24e0 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.665+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3240ca7b0 con 0x7fb3240b24e0 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.669+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb314010a00 con 0x7fb3240b24e0 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.669+0000 7fb31a000640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 0x7fb300075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.669+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fb314094dd0 con 0x7fb3240b24e0 2024-09-21T07:31:29.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.669+0000 7fb31be00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 0x7fb300075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:29.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.669+0000 7fb31be00640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 0x7fb300075710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0af000 tx=0x7fb30c01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:29.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.673+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb31405f570 con 0x7fb3240b24e0 2024-09-21T07:31:29.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.885+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3240b22c0 con 0x7fb3240b24e0 2024-09-21T07:31:29.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.885+0000 7fb31a000640 1 -- 172.21.15.64:0/3387596558 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7fb314063fa0 con 0x7fb3240b24e0 2024-09-21T07:31:29.889 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:29.889 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:29.889 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 msgr2=0x7fb300075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 0x7fb300075710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0af000 tx=0x7fb30c01b060 comp rx=0 tx=0).stop 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 msgr2=0x7fb3240c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e7a0 tx=0x7fb31400ec60 comp rx=0 tx=0).stop 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 shutdown_connections 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb300073200 0x7fb300075710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb32415e9b0 0x7fb324159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3240cacf0 0x7fb32409bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 --2- 172.21.15.64:0/3387596558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3240b24e0 0x7fb3240c71c0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 >> 172.21.15.64:0/3387596558 conn(0x7fb3240ccbe0 msgr2=0x7fb3240748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 shutdown_connections 2024-09-21T07:31:29.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:29.889+0000 7fb329200640 1 -- 172.21.15.64:0/3387596558 wait complete. 2024-09-21T07:31:29.911 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 -- 172.21.15.64:0/179220856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0200b4700 msgr2=0x7fc020072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 --2- 172.21.15.64:0/179220856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0200b4700 0x7fc020072e20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc02015f1c0 tx=0x7fc01801cd80 comp rx=0 tx=0).stop 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 -- 172.21.15.64:0/179220856 shutdown_connections 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 --2- 172.21.15.64:0/179220856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0200b4700 0x7fc020072e20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 --2- 172.21.15.64:0/179220856 >> v2:172.21.15.90:3300/0 conn(0x7fc0200709b0 0x7fc0200b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 -- 172.21.15.64:0/179220856 >> 172.21.15.64:0/179220856 conn(0x7fc0200ccbe0 msgr2=0x7fc0200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 -- 172.21.15.64:0/179220856 shutdown_connections 2024-09-21T07:31:30.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.069+0000 7fc027c00640 1 -- 172.21.15.64:0/179220856 wait complete. 2024-09-21T07:31:30.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 Processor -- start 2024-09-21T07:31:30.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 -- start start 2024-09-21T07:31:30.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 0x7fc02015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0200b4700 0x7fc0200b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc020168c30 con 0x7fc02015edb0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc020168ab0 con 0x7fc0200709b0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc027c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc020168db0 con 0x7fc0200b4700 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54674/0 (socket says 172.21.15.64:54674) 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 -- 172.21.15.64:0/1447249385 learned_addr learned my addr 172.21.15.64:0/1447249385 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc01fe00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0200b4700 0x7fc0200b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025200640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 0x7fc02015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 -- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0200b4700 msgr2=0x7fc0200b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0200b4700 0x7fc0200b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 -- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 msgr2=0x7fc02015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 0x7fc02015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 -- 172.21.15.64:0/1447249385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02009ab90 con 0x7fc02015edb0 2024-09-21T07:31:30.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025200640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 0x7fc02015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.073+0000 7fc025c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc01801a9b0 tx=0x7fc018005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180bb070 con 0x7fc02015edb0 2024-09-21T07:31:30.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc018004d40 con 0x7fc02015edb0 2024-09-21T07:31:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180b2040 con 0x7fc02015edb0 2024-09-21T07:31:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02009ae70 con 0x7fc02015edb0 2024-09-21T07:31:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02009b430 con 0x7fc02015edb0 2024-09-21T07:31:30.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0200b41c0 con 0x7fc02015edb0 2024-09-21T07:31:30.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc0180be070 con 0x7fc02015edb0 2024-09-21T07:31:30.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 0x7fc000075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.077+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7fc01812def0 con 0x7fc02015edb0 2024-09-21T07:31:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.081+0000 7fc025200640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 0x7fc000075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.081+0000 7fc025200640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 0x7fc000075740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc0140016b0 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.081+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc018016970 con 0x7fc02015edb0 2024-09-21T07:31:30.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.293+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc020070090 con 0x7fc02015edb0 2024-09-21T07:31:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc01cc00640 1 -- 172.21.15.64:0/1447249385 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5219 (secure 0 0 0) 0x7fc0180f87a0 con 0x7fc02015edb0 2024-09-21T07:31:30.297 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":94,"btime":"2024-09-21T07:30:47:156157+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:30:43.555346+0000","modified":"2024-09-21T07:30:46.590833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6833/158277074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":158277074},{"type":"v1","addr":"172.21.15.64:6833","nonce":158277074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8139,"qdb_cluster":[8139]},"id":8}]} 2024-09-21T07:31:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 94 2024-09-21T07:31:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 msgr2=0x7fc000075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 0x7fc000075740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc0140016b0 tx=0x7fc014009040 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 msgr2=0x7fc02009ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc01801a9b0 tx=0x7fc018005b00 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 shutdown_connections 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc000073230 0x7fc000075740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc02015edb0 0x7fc02009ce80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0200b4700 0x7fc0200b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 --2- 172.21.15.64:0/1447249385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0200709b0 0x7fc02015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 >> 172.21.15.64:0/1447249385 conn(0x7fc0200ccbe0 msgr2=0x7fc020165a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 shutdown_connections 2024-09-21T07:31:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.297+0000 7fc027c00640 1 -- 172.21.15.64:0/1447249385 wait complete. 2024-09-21T07:31:30.320 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:30.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- 172.21.15.64:0/2504867237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 msgr2=0x7f6c240b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 --2- 172.21.15.64:0/2504867237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c240b1be0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009930 tx=0x7f6c1001c6d0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- 172.21.15.64:0/2504867237 shutdown_connections 2024-09-21T07:31:30.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 --2- 172.21.15.64:0/2504867237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c240b1be0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 --2- 172.21.15.64:0/2504867237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c24070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- 172.21.15.64:0/2504867237 >> 172.21.15.64:0/2504867237 conn(0x7f6c240ccbe0 msgr2=0x7f6c240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- 172.21.15.64:0/2504867237 shutdown_connections 2024-09-21T07:31:30.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- 172.21.15.64:0/2504867237 wait complete. 2024-09-21T07:31:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 Processor -- start 2024-09-21T07:31:30.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.477+0000 7f6c2b400640 1 -- start start 2024-09-21T07:31:30.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c240b2120 0x7f6c240cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c241fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240b4150 con 0x7f6c24070850 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240b3fd0 con 0x7f6c240b2120 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240b42d0 con 0x7f6c2415cbd0 2024-09-21T07:31:30.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54692/0 (socket says 172.21.15.64:54692) 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 -- 172.21.15.64:0/767744984 learned_addr learned my addr 172.21.15.64:0/767744984 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c23e00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c240b2120 0x7f6c240cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c29400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c241fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 -- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 msgr2=0x7f6c241fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c241fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 -- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c240b2120 msgr2=0x7f6c240cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c240b2120 0x7f6c240cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 -- 172.21.15.64:0/767744984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2415e650 con 0x7f6c24070850 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c29400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c241fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c28a00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c9f0 tx=0x7f6c1800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18007bb0 con 0x7f6c24070850 2024-09-21T07:31:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c18007e40 con 0x7f6c24070850 2024-09-21T07:31:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800f690 con 0x7f6c24070850 2024-09-21T07:31:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c241fd2f0 con 0x7f6c24070850 2024-09-21T07:31:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2415a640 con 0x7f6c24070850 2024-09-21T07:31:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.481+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c240b1be0 con 0x7f6c24070850 2024-09-21T07:31:30.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.485+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6c1800f830 con 0x7f6c24070850 2024-09-21T07:31:30.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.485+0000 7f6c20c00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 0x7f6c04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.485+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f6c18094b30 con 0x7f6c24070850 2024-09-21T07:31:30.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.485+0000 7f6c23e00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 0x7f6c04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.485+0000 7f6c23e00640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 0x7f6c04075710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c100af000 tx=0x7f6c1001af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.489+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6c18014030 con 0x7f6c24070850 2024-09-21T07:31:30.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.665+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c24155fe0 con 0x7f6c24070850 2024-09-21T07:31:30.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c20c00640 1 -- 172.21.15.64:0/767744984 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16964 (secure 0 0 0) 0x7f6c1805f9a0 con 0x7f6c24070850 2024-09-21T07:31:30.669 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:30.670 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":131,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:30:45.126736+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:30:41.341081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-21T07:30:42.525982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:30.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 msgr2=0x7f6c04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 0x7f6c04075710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c100af000 tx=0x7f6c1001af10 comp rx=0 tx=0).stop 2024-09-21T07:31:30.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 msgr2=0x7f6c2415e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c9f0 tx=0x7f6c1800ceb0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 shutdown_connections 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c04073200 0x7f6c04075710 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c2415cbd0 0x7f6c241fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c240b2120 0x7f6c240cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 --2- 172.21.15.64:0/767744984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c24070850 0x7f6c2415e110 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 >> 172.21.15.64:0/767744984 conn(0x7f6c240ccbe0 msgr2=0x7f6c240d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 shutdown_connections 2024-09-21T07:31:30.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.669+0000 7f6c2b400640 1 -- 172.21.15.64:0/767744984 wait complete. 2024-09-21T07:31:30.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:31:30.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 -- 172.21.15.64:0/4001244304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c40ce730 msgr2=0x7f96c40ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 --2- 172.21.15.64:0/4001244304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c40ce730 0x7f96c40ceb40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f96c40711c0 tx=0x7f96bc01cd80 comp rx=0 tx=0).stop 2024-09-21T07:31:30.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 -- 172.21.15.64:0/4001244304 shutdown_connections 2024-09-21T07:31:30.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 --2- 172.21.15.64:0/4001244304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c40ce730 0x7f96c40ceb40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 --2- 172.21.15.64:0/4001244304 >> v2:172.21.15.90:3300/0 conn(0x7f96c40b3910 0x7f96c40ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 --2- 172.21.15.64:0/4001244304 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c409df30 0x7f96c40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 -- 172.21.15.64:0/4001244304 >> 172.21.15.64:0/4001244304 conn(0x7f96c406d450 msgr2=0x7f96c40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:30.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 -- 172.21.15.64:0/4001244304 shutdown_connections 2024-09-21T07:31:30.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.849+0000 7f96c9600640 1 -- 172.21.15.64:0/4001244304 wait complete. 2024-09-21T07:31:30.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 Processor -- start 2024-09-21T07:31:30.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 -- start start 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c40b3910 0x7f96c4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c40ce730 0x7f96c4159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96c406fa10 con 0x7f96c409df30 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96c406f890 con 0x7f96c40ce730 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c9600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f96c406fb90 con 0x7f96c40b3910 2024-09-21T07:31:30.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54716/0 (socket says 172.21.15.64:54716) 2024-09-21T07:31:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 -- 172.21.15.64:0/1980385469 learned_addr learned my addr 172.21.15.64:0/1980385469 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c3400640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c40ce730 0x7f96c4159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2000640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c40b3910 0x7f96c4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 -- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c40b3910 msgr2=0x7f96c4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c40b3910 0x7f96c4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 -- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c40ce730 msgr2=0x7f96c4159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c40ce730 0x7f96c4159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 -- 172.21.15.64:0/1980385469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c41583b0 con 0x7f96c409df30 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.853+0000 7f96c2a00640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009ca0 tx=0x7f96b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b401f070 con 0x7f96c409df30 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96b4012360 con 0x7f96c409df30 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c4156990 con 0x7f96c409df30 2024-09-21T07:31:30.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011750 con 0x7f96c409df30 2024-09-21T07:31:30.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c4158930 con 0x7f96c409df30 2024-09-21T07:31:30.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c40ce1f0 con 0x7f96c409df30 2024-09-21T07:31:30.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f96b4022070 con 0x7f96c409df30 2024-09-21T07:31:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 0x7f96a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:30.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f96b4098950 con 0x7f96c409df30 2024-09-21T07:31:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.857+0000 7f96c2000640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 0x7f96a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:30.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.861+0000 7f96c2000640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 0x7f96a4075710 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f96c40cc920 tx=0x7f96b00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:30.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:30.861+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f96b4063100 con 0x7f96c409df30 2024-09-21T07:31:31.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.073+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f96c40cc950 con 0x7f96c409df30 2024-09-21T07:31:31.079 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:31:31.077+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:31:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96baa00640 1 -- 172.21.15.64:0/1980385469 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) ==== 161+0+0 (secure 0 0 0) 0x7f96b406ae20 con 0x7f96c409df30 2024-09-21T07:31:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 msgr2=0x7f96a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 0x7f96a4075710 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f96c40cc920 tx=0x7f96b00091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 msgr2=0x7f96c40b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009ca0 tx=0x7f96b400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 shutdown_connections 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f96a4073200 0x7f96a4075710 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c40ce730 0x7f96c4159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96c40b3910 0x7f96c4158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 --2- 172.21.15.64:0/1980385469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96c409df30 0x7f96c40b26f0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 >> 172.21.15.64:0/1980385469 conn(0x7f96c406d450 msgr2=0x7f96c409d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 shutdown_connections 2024-09-21T07:31:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.081+0000 7f96c9600640 1 -- 172.21.15.64:0/1980385469 wait complete. 2024-09-21T07:31:31.108 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:31:31.229 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 -- 172.21.15.64:0/1266360478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 msgr2=0x7f63d40d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 --2- 172.21.15.64:0/1266360478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d40d03f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009840 tx=0x7f63c401c760 comp rx=0 tx=0).stop 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 -- 172.21.15.64:0/1266360478 shutdown_connections 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 --2- 172.21.15.64:0/1266360478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d40d03f0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 -- 172.21.15.64:0/1266360478 >> 172.21.15.64:0/1266360478 conn(0x7f63d406d1c0 msgr2=0x7f63d406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 -- 172.21.15.64:0/1266360478 shutdown_connections 2024-09-21T07:31:31.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.273+0000 7f63d9a00640 1 -- 172.21.15.64:0/1266360478 wait complete. 2024-09-21T07:31:31.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 Processor -- start 2024-09-21T07:31:31.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- start start 2024-09-21T07:31:31.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63d40b3d60 0x7f63d41f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63d40c5ea0 0x7f63d41f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63d416ae90 con 0x7f63d40d1d00 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63d416ad10 con 0x7f63d40b3d60 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f63d416b010 con 0x7f63d40c5ea0 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54746/0 (socket says 172.21.15.64:54746) 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 -- 172.21.15.64:0/989161802 learned_addr learned my addr 172.21.15.64:0/989161802 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d2a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63d40b3d60 0x7f63d41f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63cbe00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63d40c5ea0 0x7f63d41f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 -- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63d40c5ea0 msgr2=0x7f63d41f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63d40c5ea0 0x7f63d41f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 -- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63d40b3d60 msgr2=0x7f63d41f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63d40b3d60 0x7f63d41f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 -- 172.21.15.64:0/989161802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d41f99d0 con 0x7f63d40d1d00 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d3400640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c6e0 tx=0x7f63cc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc003b80 con 0x7f63d40d1d00 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63cc003d20 con 0x7f63d40d1d00 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d415d6f0 con 0x7f63d40d1d00 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc005330 con 0x7f63d40d1d00 2024-09-21T07:31:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.277+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d415dcb0 con 0x7f63d40d1d00 2024-09-21T07:31:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d415d460 con 0x7f63d40d1d00 2024-09-21T07:31:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63cc0054d0 con 0x7f63d40d1d00 2024-09-21T07:31:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63caa00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 0x7f63b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6187+0+0 (secure 0 0 0) 0x7f63cc093f80 con 0x7f63d40d1d00 2024-09-21T07:31:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63d2a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 0x7f63b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.281+0000 7f63d2a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 0x7f63b0075740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f63c40af000 tx=0x7f63c401afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:31.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.285+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f63cc05e7f0 con 0x7f63d40d1d00 2024-09-21T07:31:31.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:31.497+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f63d40d03f0 con 0x7f63d40d1d00 2024-09-21T07:31:32.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.089+0000 7f63caa00640 1 -- 172.21.15.64:0/989161802 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) ==== 104+0+0 (secure 0 0 0) 0x7f63cc063220 con 0x7f63d40d1d00 2024-09-21T07:31:32.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 msgr2=0x7f63b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:32.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 0x7f63b0075740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f63c40af000 tx=0x7f63c401afa0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 msgr2=0x7f63d415ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c6e0 tx=0x7f63cc00cba0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 shutdown_connections 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b0073230 0x7f63b0075740 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d40d1d00 0x7f63d415ec00 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63d40c5ea0 0x7f63d41f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 --2- 172.21.15.64:0/989161802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63d40b3d60 0x7f63d41f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 >> 172.21.15.64:0/989161802 conn(0x7f63d406d1c0 msgr2=0x7f63d41550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:32.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 shutdown_connections 2024-09-21T07:31:32.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.093+0000 7f63d9a00640 1 -- 172.21.15.64:0/989161802 wait complete. 2024-09-21T07:31:32.117 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:31:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 -- 172.21.15.64:0/266837937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 msgr2=0x7f93600cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 --2- 172.21.15.64:0/266837937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93600cc310 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9358009bc0 tx=0x7f935801cae0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 -- 172.21.15.64:0/266837937 shutdown_connections 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 --2- 172.21.15.64:0/266837937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93600cc310 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 --2- 172.21.15.64:0/266837937 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9360073320 0x7f9360073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 -- 172.21.15.64:0/266837937 >> 172.21.15.64:0/266837937 conn(0x7f93600cd2b0 msgr2=0x7f93600cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 -- 172.21.15.64:0/266837937 shutdown_connections 2024-09-21T07:31:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.281+0000 7f9365a00640 1 -- 172.21.15.64:0/266837937 wait complete. 2024-09-21T07:31:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 Processor -- start 2024-09-21T07:31:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 -- start start 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9360073320 0x7f93600b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f93600cf900 0x7f93600b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93601688f0 con 0x7f93600cbf00 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9360168770 con 0x7f9360073320 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9360168a70 con 0x7f93600cf900 2024-09-21T07:31:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9357e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9357e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54766/0 (socket says 172.21.15.64:54766) 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9357e00640 1 -- 172.21.15.64:0/2868284463 learned_addr learned my addr 172.21.15.64:0/2868284463 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f9365000640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f93600cf900 0x7f93600b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.285+0000 7f935fe00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9360073320 0x7f93600b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 -- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f93600cf900 msgr2=0x7f93600b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f93600cf900 0x7f93600b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 -- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9360073320 msgr2=0x7f93600b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9360073320 0x7f93600b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 -- 172.21.15.64:0/2868284463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600b1280 con 0x7f93600cbf00 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9357e00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f934800c730 tx=0x7f934800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348016020 con 0x7f93600cbf00 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f934800a950 con 0x7f93600cbf00 2024-09-21T07:31:32.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93600b1560 con 0x7f93600cbf00 2024-09-21T07:31:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934800ada0 con 0x7f93600cbf00 2024-09-21T07:31:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93600b1b20 con 0x7f93600cbf00 2024-09-21T07:31:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9360073730 con 0x7f93600cbf00 2024-09-21T07:31:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.289+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9348019020 con 0x7f93600cbf00 2024-09-21T07:31:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.293+0000 7f935cc00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 0x7f933c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.293+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6187+0+0 (secure 0 0 0) 0x7f9348094240 con 0x7f93600cbf00 2024-09-21T07:31:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.293+0000 7f935fe00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 0x7f933c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.293+0000 7f935fe00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 0x7f933c075740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9350009b40 tx=0x7f93500091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:32.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.297+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9348020020 con 0x7f93600cbf00 2024-09-21T07:31:32.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:32.473+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93600cfe40 con 0x7f93600cbf00 2024-09-21T07:31:33.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.089+0000 7f935cc00640 1 -- 172.21.15.64:0/2868284463 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) ==== 181+0+0 (secure 0 0 0) 0x7f9360073c70 con 0x7f93600cbf00 2024-09-21T07:31:33.093 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:31:33.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 msgr2=0x7f933c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:33.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 0x7f933c075740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9350009b40 tx=0x7f93500091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 msgr2=0x7f93601f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f934800c730 tx=0x7f934800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 shutdown_connections 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073230 0x7f933c075740 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f93600cf900 0x7f93600b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93600cbf00 0x7f93601f8350 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 --2- 172.21.15.64:0/2868284463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9360073320 0x7f93600b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 >> 172.21.15.64:0/2868284463 conn(0x7f93600cd2b0 msgr2=0x7f93600cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 shutdown_connections 2024-09-21T07:31:33.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.093+0000 7f9365a00640 1 -- 172.21.15.64:0/2868284463 wait complete. 2024-09-21T07:31:33.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:31:33.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- 172.21.15.64:0/2819655997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92100af530 msgr2=0x7f921015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 --2- 172.21.15.64:0/2819655997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92100af530 0x7f921015f480 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f9210073fa0 tx=0x7f920801cba0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- 172.21.15.64:0/2819655997 shutdown_connections 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 --2- 172.21.15.64:0/2819655997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92100af530 0x7f921015f480 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- 172.21.15.64:0/2819655997 >> 172.21.15.64:0/2819655997 conn(0x7f92100d0170 msgr2=0x7f92100d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- 172.21.15.64:0/2819655997 shutdown_connections 2024-09-21T07:31:33.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- 172.21.15.64:0/2819655997 wait complete. 2024-09-21T07:31:33.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 Processor -- start 2024-09-21T07:31:33.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.285+0000 7f9216c00640 1 -- start start 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 0x7f9210155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92101543d0 0x7f92101563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f921016a140 con 0x7f921006ec70 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9210169fc0 con 0x7f92100af530 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f921016a2c0 con 0x7f92101543d0 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54784/0 (socket says 172.21.15.64:54784) 2024-09-21T07:31:33.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 -- 172.21.15.64:0/2673563545 learned_addr learned my addr 172.21.15.64:0/2673563545 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9214c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92101543d0 0x7f92101563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9207400640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 0x7f9210155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 -- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92101543d0 msgr2=0x7f92101563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92101543d0 0x7f92101563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 -- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 msgr2=0x7f9210155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 0x7f9210155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 -- 172.21.15.64:0/2673563545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92101669a0 con 0x7f921006ec70 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9207400640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 0x7f9210155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:33.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920fe00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f920000c3c0 tx=0x7f920000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200017070 con 0x7f921006ec70 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92000053c0 con 0x7f921006ec70 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9210166c80 con 0x7f921006ec70 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200003860 con 0x7f921006ec70 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9210167240 con 0x7f921006ec70 2024-09-21T07:31:33.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.289+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921015f480 con 0x7f921006ec70 2024-09-21T07:31:33.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.293+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f920001a070 con 0x7f921006ec70 2024-09-21T07:31:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.293+0000 7f920cc00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 0x7f91ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.293+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5749+0+0 (secure 0 0 0) 0x7f92000935b0 con 0x7f921006ec70 2024-09-21T07:31:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.293+0000 7f9207400640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 0x7f91ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:33.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.293+0000 7f9207400640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 0x7f91ec075710 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3a40 tx=0x7f91f8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:33.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.297+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9200001090 con 0x7f921006ec70 2024-09-21T07:31:33.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:33.477+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f92100b60f0 con 0x7f921006ec70 2024-09-21T07:31:34.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.093+0000 7f920cc00640 1 -- 172.21.15.64:0/2673563545 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) ==== 169+0+0 (secure 0 0 0) 0x7f920005deb0 con 0x7f921006ec70 2024-09-21T07:31:34.096 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:31:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 msgr2=0x7f91ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 0x7f91ec075710 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3a40 tx=0x7f91f8009040 comp rx=0 tx=0).stop 2024-09-21T07:31:34.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 msgr2=0x7f9210164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f920000c3c0 tx=0x7f920000c880 comp rx=0 tx=0).stop 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 shutdown_connections 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f91ec073200 0x7f91ec075710 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92101543d0 0x7f92101563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92100af530 0x7f9210155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 --2- 172.21.15.64:0/2673563545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f921006ec70 0x7f9210164ca0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.097+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 >> 172.21.15.64:0/2673563545 conn(0x7f92100d0170 msgr2=0x7f921015c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.101+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 shutdown_connections 2024-09-21T07:31:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.101+0000 7f9216c00640 1 -- 172.21.15.64:0/2673563545 wait complete. 2024-09-21T07:31:34.136 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 -- 172.21.15.64:0/3157203777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 msgr2=0x7f26140cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 --2- 172.21.15.64:0/3157203777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f26140cd110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2604009840 tx=0x7f260401c820 comp rx=0 tx=0).stop 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 -- 172.21.15.64:0/3157203777 shutdown_connections 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 --2- 172.21.15.64:0/3157203777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f26140cd110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 --2- 172.21.15.64:0/3157203777 >> v2:172.21.15.90:3300/0 conn(0x7f26140d0e60 0x7f26140b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 -- 172.21.15.64:0/3157203777 >> 172.21.15.64:0/3157203777 conn(0x7f261406d450 msgr2=0x7f26140d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 -- 172.21.15.64:0/3157203777 shutdown_connections 2024-09-21T07:31:34.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.301+0000 7f261c800640 1 -- 172.21.15.64:0/3157203777 wait complete. 2024-09-21T07:31:34.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 Processor -- start 2024-09-21T07:31:34.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 -- start start 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f261415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26140d0e60 0x7f2614163e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2614169dc0 con 0x7f26140d0e60 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2614169c40 con 0x7f261406ee80 2024-09-21T07:31:34.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2614169f40 con 0x7f26140ccd00 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f2619400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f261415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f2619e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f2619e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:48450/0 (socket says 172.21.15.64:48450) 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f2619400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f261415c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:48772/0 (socket says 172.21.15.64:48772) 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f2619e00640 1 -- 172.21.15.64:0/2288735860 learned_addr learned my addr 172.21.15.64:0/2288735860 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.305+0000 7f261a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26140d0e60 0x7f2614163e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 -- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 msgr2=0x7f261415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f261415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 -- 172.21.15.64:0/2288735860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26140d0e60 msgr2=0x7f2614163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26140d0e60 0x7f2614163e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 -- 172.21.15.64:0/2288735860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26140b2bc0 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f2619e00640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f260800ea10 tx=0x7f260800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260800cde0 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2608004020 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261415cfd0 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608004470 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26140b28e0 con 0x7f261406ee80 2024-09-21T07:31:34.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26140cd110 con 0x7f261406ee80 2024-09-21T07:31:34.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2608005030 con 0x7f261406ee80 2024-09-21T07:31:34.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.309+0000 7f260e000640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 0x7f25f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.313+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f2608094970 con 0x7f261406ee80 2024-09-21T07:31:34.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.313+0000 7f2619400640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 0x7f25f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.313+0000 7f2619400640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 0x7f25f8075710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f26040af000 tx=0x7f260401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:34.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.317+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f260805f530 con 0x7f261406ee80 2024-09-21T07:31:34.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.493+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f2614160320 con 0x7f261406ee80 2024-09-21T07:31:34.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.501+0000 7f260e000640 1 -- 172.21.15.64:0/2288735860 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v53) ==== 71+0+0 (secure 0 0 0) 0x7f2608063f60 con 0x7f261406ee80 2024-09-21T07:31:34.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 msgr2=0x7f25f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 0x7f25f8075710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f26040af000 tx=0x7f260401b060 comp rx=0 tx=0).stop 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 msgr2=0x7f26140b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f260800ea10 tx=0x7f260800eed0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 shutdown_connections 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f25f8073200 0x7f25f8075710 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26140d0e60 0x7f2614163e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26140ccd00 0x7f261415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 --2- 172.21.15.64:0/2288735860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261406ee80 0x7f26140b0990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 >> 172.21.15.64:0/2288735860 conn(0x7f261406d450 msgr2=0x7f2614072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 shutdown_connections 2024-09-21T07:31:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.505+0000 7f261c800640 1 -- 172.21.15.64:0/2288735860 wait complete. 2024-09-21T07:31:34.527 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 -- 172.21.15.64:0/3208954902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0c5ea0 msgr2=0x7f44dc0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 --2- 172.21.15.64:0/3208954902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0c5ea0 0x7f44dc0c62b0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0b1cf0 tx=0x7f44d401c740 comp rx=0 tx=0).stop 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 -- 172.21.15.64:0/3208954902 shutdown_connections 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 --2- 172.21.15.64:0/3208954902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0c5ea0 0x7f44dc0c62b0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 --2- 172.21.15.64:0/3208954902 >> v2:172.21.15.90:3300/0 conn(0x7f44dc0b3d60 0x7f44dc0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.685+0000 7f44e1400640 1 -- 172.21.15.64:0/3208954902 >> 172.21.15.64:0/3208954902 conn(0x7f44dc06d1c0 msgr2=0x7f44dc06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:34.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.689+0000 7f44e1400640 1 -- 172.21.15.64:0/3208954902 shutdown_connections 2024-09-21T07:31:34.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.689+0000 7f44e1400640 1 -- 172.21.15.64:0/3208954902 wait complete. 2024-09-21T07:31:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 Processor -- start 2024-09-21T07:31:34.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 -- start start 2024-09-21T07:31:34.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 0x7f44dc1fd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44dc0c5ea0 0x7f44dc0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc169eb0 con 0x7f44dc0b3d60 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc169d30 con 0x7f44dc0d1d00 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.693+0000 7f44e1400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f44dc16a030 con 0x7f44dc0c5ea0 2024-09-21T07:31:34.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:48468/0 (socket says 172.21.15.64:48468) 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 -- 172.21.15.64:0/2841942775 learned_addr learned my addr 172.21.15.64:0/2841942775 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44da800640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 0x7f44dc1fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44d1e00640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44dc0c5ea0 0x7f44dc0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 -- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44dc0c5ea0 msgr2=0x7f44dc0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44dc0c5ea0 0x7f44dc0cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 -- 172.21.15.64:0/2841942775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 msgr2=0x7f44dc1fd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:34.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 0x7f44dc1fd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:34.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 -- 172.21.15.64:0/2841942775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc1fda40 con 0x7f44dc0d1d00 2024-09-21T07:31:34.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44da800640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 0x7f44dc1fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44db200640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009790 tx=0x7f44d4005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:34.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.697+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d40bb070 con 0x7f44dc0d1d00 2024-09-21T07:31:34.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.701+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44d40043e0 con 0x7f44dc0d1d00 2024-09-21T07:31:34.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.701+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d40b2040 con 0x7f44dc0d1d00 2024-09-21T07:31:34.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.701+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc0c9f20 con 0x7f44dc0d1d00 2024-09-21T07:31:34.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.701+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc157780 con 0x7f44dc0d1d00 2024-09-21T07:31:34.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.705+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f44d4003860 con 0x7f44dc0d1d00 2024-09-21T07:31:34.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.705+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44dc0b4170 con 0x7f44dc0d1d00 2024-09-21T07:31:34.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.705+0000 7f44d3400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 0x7f44b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:34.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.705+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f44d412bf90 con 0x7f44dc0d1d00 2024-09-21T07:31:34.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.709+0000 7f44da800640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 0x7f44b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:34.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.709+0000 7f44da800640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 0x7f44b8075740 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001780 tx=0x7f44cc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:34.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.713+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f44dc1fda40 con 0x7f44dc0d1d00 2024-09-21T07:31:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:34.977+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f44dc166de0 con 0x7f44dc0d1d00 2024-09-21T07:31:35.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44d3400640 1 -- 172.21.15.64:0/2841942775 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v425) ==== 144+0+0 (secure 0 0 0) 0x7f44d40163f0 con 0x7f44dc0d1d00 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 msgr2=0x7f44b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 0x7f44b8075740 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001780 tx=0x7f44cc009040 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 msgr2=0x7f44dc0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009790 tx=0x7f44d4005d90 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 shutdown_connections 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f44b8073230 0x7f44b8075740 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44dc0d1d00 0x7f44dc0cbe70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44dc0c5ea0 0x7f44dc0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 --2- 172.21.15.64:0/2841942775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44dc0b3d60 0x7f44dc1fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 >> 172.21.15.64:0/2841942775 conn(0x7f44dc06d1c0 msgr2=0x7f44dc071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 shutdown_connections 2024-09-21T07:31:35.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.109+0000 7f44e1400640 1 -- 172.21.15.64:0/2841942775 wait complete. 2024-09-21T07:31:35.133 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-21T07:31:35.133 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-21T07:31:35.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 -- 172.21.15.64:0/2118251439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b22f0 msgr2=0x7ff41c0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 --2- 172.21.15.64:0/2118251439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b22f0 0x7ff41c0cb430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff40400a950 tx=0x7ff40401dae0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 -- 172.21.15.64:0/2118251439 shutdown_connections 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 --2- 172.21.15.64:0/2118251439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b22f0 0x7ff41c0cb430 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 -- 172.21.15.64:0/2118251439 >> 172.21.15.64:0/2118251439 conn(0x7ff41c0ccbe0 msgr2=0x7ff41c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.289+0000 7ff421000640 1 -- 172.21.15.64:0/2118251439 shutdown_connections 2024-09-21T07:31:35.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 -- 172.21.15.64:0/2118251439 wait complete. 2024-09-21T07:31:35.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 Processor -- start 2024-09-21T07:31:35.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 -- start start 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b4170 0x7ff41c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 0x7ff41c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1692a0 con 0x7ff41c155a00 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c169120 con 0x7ff41c0b4170 2024-09-21T07:31:35.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.293+0000 7ff421000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c169420 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff41a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 0x7ff41c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff419e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b4170 0x7ff41c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff41a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45400/0 (socket says 172.21.15.64:45400) 2024-09-21T07:31:35.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff41a800640 1 -- 172.21.15.64:0/3793423606 learned_addr learned my addr 172.21.15.64:0/3793423606 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 -- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b4170 msgr2=0x7ff41c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b4170 0x7ff41c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 -- 172.21.15.64:0/3793423606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 msgr2=0x7ff41c1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 -- 172.21.15.64:0/3793423606 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c1f68a0 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff41a800640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:35.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff413e00640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 0x7ff41c15a300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ad000 tx=0x7ff4040038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4040b3040 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff404003b90 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404005020 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c144730 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1f6e40 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c1444a0 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.297+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff4040051c0 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.301+0000 7ff412000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 0x7ff3f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.301+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7ff40412e270 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.301+0000 7ff419e00640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 0x7ff3f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.301+0000 7ff419e00640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 0x7ff3f8075710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff40c007fd0 tx=0x7ff40c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:35.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.305+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff404017760 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.481+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff41c0b1be0 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.481+0000 7ff412000640 1 -- 172.21.15.64:0/3793423606 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+13265 (secure 0 0 0) 0x7ff4041173f0 con 0x7ff41c0cc4e0 2024-09-21T07:31:35.485 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:35.485 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":134,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:34.095785+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6833/158277074":"2024-09-22T07:31:31.081905+0000","172.21.15.64:6832/158277074":"2024-09-22T07:31:31.081905+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 msgr2=0x7ff3f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 0x7ff3f8075710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff40c007fd0 tx=0x7ff40c009040 comp rx=0 tx=0).stop 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 msgr2=0x7ff41c15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 0x7ff41c15a300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ad000 tx=0x7ff4040038b0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 shutdown_connections 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3f8073200 0x7ff3f8075710 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff41c155a00 0x7ff41c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff41c0cc4e0 0x7ff41c15a300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 --2- 172.21.15.64:0/3793423606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c0b4170 0x7ff41c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 >> 172.21.15.64:0/3793423606 conn(0x7ff41c0ccbe0 msgr2=0x7ff41c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 shutdown_connections 2024-09-21T07:31:35.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.485+0000 7ff421000640 1 -- 172.21.15.64:0/3793423606 wait complete. 2024-09-21T07:31:35.507 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:31:35.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:31:35.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- 172.21.15.64:0/3923253036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad380ce900 msgr2=0x7fad3806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 --2- 172.21.15.64:0/3923253036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad380ce900 0x7fad3806f890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad30009bc0 tx=0x7fad3001cac0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- 172.21.15.64:0/3923253036 shutdown_connections 2024-09-21T07:31:35.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 --2- 172.21.15.64:0/3923253036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad380ce900 0x7fad3806f890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 --2- 172.21.15.64:0/3923253036 >> v2:172.21.15.90:3300/0 conn(0x7fad3809df30 0x7fad380b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- 172.21.15.64:0/3923253036 >> 172.21.15.64:0/3923253036 conn(0x7fad3806d450 msgr2=0x7fad380d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- 172.21.15.64:0/3923253036 shutdown_connections 2024-09-21T07:31:35.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- 172.21.15.64:0/3923253036 wait complete. 2024-09-21T07:31:35.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 Processor -- start 2024-09-21T07:31:35.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.669+0000 7fad40000640 1 -- start start 2024-09-21T07:31:35.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad3809df30 0x7fad38074750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 0x7fad381f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad38169000 con 0x7fad380b3910 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad38168e80 con 0x7fad380ce900 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fad38169180 con 0x7fad3809df30 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45402/0 (socket says 172.21.15.64:45402) 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 -- 172.21.15.64:0/16672532 learned_addr learned my addr 172.21.15.64:0/16672532 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3d600640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad3809df30 0x7fad38074750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3e000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 0x7fad381f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 -- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad3809df30 msgr2=0x7fad38074750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad3809df30 0x7fad38074750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 -- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 msgr2=0x7fad381f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 0x7fad381f8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 -- 172.21.15.64:0/16672532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad380cda40 con 0x7fad380b3910 2024-09-21T07:31:35.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3e000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 0x7fad381f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:35.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad3cc00640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c530 tx=0x7fad2400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24016020 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad24012920 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3809ca80 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24012d70 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad381fc4e0 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.673+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad380b33d0 con 0x7fad380b3910 2024-09-21T07:31:35.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.677+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad24019020 con 0x7fad380b3910 2024-09-21T07:31:35.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.677+0000 7fad35600640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 0x7fad18075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:35.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.677+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7fad24093b00 con 0x7fad380b3910 2024-09-21T07:31:35.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.677+0000 7fad3d600640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 0x7fad18075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:35.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.677+0000 7fad3d600640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 0x7fad18075740 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0095b0 tx=0x7fad2c005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:35.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.681+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fad24020070 con 0x7fad380b3910 2024-09-21T07:31:35.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.857+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad3815b0d0 con 0x7fad380b3910 2024-09-21T07:31:35.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.857+0000 7fad35600640 1 -- 172.21.15.64:0/16672532 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) ==== 93+0+10 (secure 0 0 0) 0x7fad2405ec90 con 0x7fad380b3910 2024-09-21T07:31:35.860 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 msgr2=0x7fad18075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 0x7fad18075740 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0095b0 tx=0x7fad2c005f40 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 msgr2=0x7fad381fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c530 tx=0x7fad2400c9f0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 shutdown_connections 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad18073230 0x7fad18075740 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad380ce900 0x7fad381f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad380b3910 0x7fad381fcce0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 --2- 172.21.15.64:0/16672532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad3809df30 0x7fad38074750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 >> 172.21.15.64:0/16672532 conn(0x7fad3806d450 msgr2=0x7fad38156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 shutdown_connections 2024-09-21T07:31:35.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:35.861+0000 7fad40000640 1 -- 172.21.15.64:0/16672532 wait complete. 2024-09-21T07:31:35.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-21T07:31:36.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- 172.21.15.64:0/2979568032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19780b2120 msgr2=0x7f19780cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:36.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 --2- 172.21.15.64:0/2979568032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19780b2120 0x7f19780cbcd0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f1970009c80 tx=0x7f197001cd30 comp rx=0 tx=0).stop 2024-09-21T07:31:36.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- 172.21.15.64:0/2979568032 shutdown_connections 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 --2- 172.21.15.64:0/2979568032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19780b2120 0x7f19780cbcd0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 --2- 172.21.15.64:0/2979568032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1978070850 0x7f19780b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 --2- 172.21.15.64:0/2979568032 >> v2:172.21.15.90:3300/0 conn(0x7f197815cbd0 0x7f1978070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- 172.21.15.64:0/2979568032 >> 172.21.15.64:0/2979568032 conn(0x7f19780ccbe0 msgr2=0x7f19780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- 172.21.15.64:0/2979568032 shutdown_connections 2024-09-21T07:31:36.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- 172.21.15.64:0/2979568032 wait complete. 2024-09-21T07:31:36.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 Processor -- start 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.041+0000 7f197cc00640 1 -- start start 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1978070850 0x7f19781f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19780b2120 0x7f197809d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f197806fb20 con 0x7f197815cbd0 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f197806f9a0 con 0x7f1978070850 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f19780b2fb0 con 0x7f19780b2120 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45416/0 (socket says 172.21.15.64:45416) 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 -- 172.21.15.64:0/2669121524 learned_addr learned my addr 172.21.15.64:0/2669121524 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1975e00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1978070850 0x7f19781f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:36.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f196d400640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19780b2120 0x7f197809d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 -- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19780b2120 msgr2=0x7f197809d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19780b2120 0x7f197809d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 -- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1978070850 msgr2=0x7f19781f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1978070850 0x7f19781f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 -- 172.21.15.64:0/2669121524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19781f8970 con 0x7f197815cbd0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f1976800640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f197001d5d0 tx=0x7f1970003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19700bb070 con 0x7f197815cbd0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1970004b60 con 0x7f197815cbd0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19781471d0 con 0x7f197815cbd0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19700b2040 con 0x7f197815cbd0 2024-09-21T07:31:36.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19780b0b50 con 0x7f197815cbd0 2024-09-21T07:31:36.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.045+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1978159ed0 con 0x7f197815cbd0 2024-09-21T07:31:36.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.049+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19700be070 con 0x7f197815cbd0 2024-09-21T07:31:36.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.049+0000 7f196ea00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 0x7f1954075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:36.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.049+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f197012de40 con 0x7f197815cbd0 2024-09-21T07:31:36.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.049+0000 7f1975e00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 0x7f1954075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:36.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.049+0000 7f1975e00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 0x7f1954075710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1968009b40 tx=0x7f19680091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:36.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.053+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1978159ed0 con 0x7f197815cbd0 2024-09-21T07:31:36.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:36.297+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f19780d0ec0 con 0x7f197815cbd0 2024-09-21T07:31:37.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f196ea00640 1 -- 172.21.15.64:0/2669121524 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v427) ==== 158+0+0 (secure 0 0 0) 0x7f1970016950 con 0x7f197815cbd0 2024-09-21T07:31:37.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 msgr2=0x7f1954075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 0x7f1954075710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1968009b40 tx=0x7f19680091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 msgr2=0x7f19781463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f197001d5d0 tx=0x7f1970003f40 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 shutdown_connections 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1954073200 0x7f1954075710 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f197815cbd0 0x7f19781463c0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19780b2120 0x7f197809d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 --2- 172.21.15.64:0/2669121524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1978070850 0x7f19781f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 >> 172.21.15.64:0/2669121524 conn(0x7f19780ccbe0 msgr2=0x7f1978157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 shutdown_connections 2024-09-21T07:31:37.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.117+0000 7f197cc00640 1 -- 172.21.15.64:0/2669121524 wait complete. 2024-09-21T07:31:37.145 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 -- 172.21.15.64:0/1371759093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 msgr2=0x7f403c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 --2- 172.21.15.64:0/1371759093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c15b320 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f403c0b0980 tx=0x7f403001c6b0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 -- 172.21.15.64:0/1371759093 shutdown_connections 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 --2- 172.21.15.64:0/1371759093 >> v2:172.21.15.90:3300/0 conn(0x7f403c15f100 0x7f403c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 --2- 172.21.15.64:0/1371759093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c15b320 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 -- 172.21.15.64:0/1371759093 >> 172.21.15.64:0/1371759093 conn(0x7f403c0b2ca0 msgr2=0x7f403c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 -- 172.21.15.64:0/1371759093 shutdown_connections 2024-09-21T07:31:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.305+0000 7f4043e00640 1 -- 172.21.15.64:0/1371759093 wait complete. 2024-09-21T07:31:37.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 Processor -- start 2024-09-21T07:31:37.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 -- start start 2024-09-21T07:31:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f403c06fba0 0x7f403c1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c15f100 0x7f403c06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f403c0b6890 con 0x7f403c0cd790 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f403c0b6710 con 0x7f403c15f100 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4043e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f403c0b6a10 con 0x7f403c06fba0 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4040a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4040a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45430/0 (socket says 172.21.15.64:45430) 2024-09-21T07:31:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.309+0000 7f4040a00640 1 -- 172.21.15.64:0/1240660972 learned_addr learned my addr 172.21.15.64:0/1240660972 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4041e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c15f100 0x7f403c06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4041400640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f403c06fba0 0x7f403c1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 -- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f403c06fba0 msgr2=0x7f403c1470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f403c06fba0 0x7f403c1470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 -- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c15f100 msgr2=0x7f403c06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c15f100 0x7f403c06cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 -- 172.21.15.64:0/1240660972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c1f8e90 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4040a00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f402800e7c0 tx=0x7f402800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402800ccc0 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f402800ce80 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c1f9170 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028005280 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c1f9730 con 0x7f403c0cd790 2024-09-21T07:31:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c15b320 con 0x7f403c0cd790 2024-09-21T07:31:37.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.313+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4028005420 con 0x7f403c0cd790 2024-09-21T07:31:37.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.317+0000 7f4039600640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 0x7f401c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.317+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f4028094b00 con 0x7f403c0cd790 2024-09-21T07:31:37.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.317+0000 7f4041400640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 0x7f401c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.317+0000 7f4041400640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 0x7f401c075740 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f40300af000 tx=0x7f403001aef0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:37.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.321+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f402805fc80 con 0x7f403c0cd790 2024-09-21T07:31:37.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.497+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f403c0b3bb0 con 0x7f403c0cd790 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.497+0000 7f4039600640 1 -- 172.21.15.64:0/1240660972 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v53) ==== 59+0+2294 (secure 0 0 0) 0x7f4028094e20 con 0x7f403c0cd790 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:31:37.500 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:31:37.501 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:31:37.502 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:31:37.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 msgr2=0x7f401c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 0x7f401c075740 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f40300af000 tx=0x7f403001aef0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 msgr2=0x7f403c1fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f402800e7c0 tx=0x7f402800ec80 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 shutdown_connections 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f401c073230 0x7f401c075740 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c15f100 0x7f403c06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f403c0cd790 0x7f403c1fc8c0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 --2- 172.21.15.64:0/1240660972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f403c06fba0 0x7f403c1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 >> 172.21.15.64:0/1240660972 conn(0x7f403c0b2ca0 msgr2=0x7f403c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 shutdown_connections 2024-09-21T07:31:37.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.501+0000 7f4043e00640 1 -- 172.21.15.64:0/1240660972 wait complete. 2024-09-21T07:31:37.523 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 -- 172.21.15.64:0/3288860410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0cc960 msgr2=0x7f6ddc15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 --2- 172.21.15.64:0/3288860410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0cc960 0x7f6ddc15ee70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009840 tx=0x7f6dcc01c7e0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 -- 172.21.15.64:0/3288860410 shutdown_connections 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 --2- 172.21.15.64:0/3288860410 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0ce4d0 0x7f6ddc0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 --2- 172.21.15.64:0/3288860410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0cc960 0x7f6ddc15ee70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 -- 172.21.15.64:0/3288860410 >> 172.21.15.64:0/3288860410 conn(0x7f6ddc06d450 msgr2=0x7f6ddc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 -- 172.21.15.64:0/3288860410 shutdown_connections 2024-09-21T07:31:37.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.681+0000 7f6de3800640 1 -- 172.21.15.64:0/3288860410 wait complete. 2024-09-21T07:31:37.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 Processor -- start 2024-09-21T07:31:37.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 -- start start 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 0x7f6ddc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0cc960 0x7f6ddc0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc168e00 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc168c80 con 0x7f6ddc0b3140 2024-09-21T07:31:37.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de3800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc168f80 con 0x7f6ddc0cc960 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45446/0 (socket says 172.21.15.64:45446) 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.685+0000 7f6de1800640 1 -- 172.21.15.64:0/3715399673 learned_addr learned my addr 172.21.15.64:0/3715399673 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de0e00640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 0x7f6ddc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6dd3e00640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0cc960 0x7f6ddc0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 -- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0cc960 msgr2=0x7f6ddc0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0cc960 0x7f6ddc0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 -- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 msgr2=0x7f6ddc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 0x7f6ddc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 -- 172.21.15.64:0/3715399673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc1fc4c0 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de0e00640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 0x7f6ddc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:37.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de1800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400ebd0 tx=0x7f6dd400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4010630 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd40107d0 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc1fc7a0 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4010be0 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc1fcd60 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc0cbea0 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.689+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6dd4004b50 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.693+0000 7f6dd9600640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 0x7f6db8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:37.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.693+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f6dd4095350 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.693+0000 7f6de0e00640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 0x7f6db8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:37.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.693+0000 7f6de0e00640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 0x7f6db8075740 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0ae000 tx=0x7f6dcc0aa040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:37.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.693+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6dd4060550 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.869+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6ddc15ee70 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6dd9600640 1 -- 172.21.15.64:0/3715399673 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v54)=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7f6dd405fe50 con 0x7f6ddc0ce4d0 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 msgr2=0x7f6db8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 0x7f6db8075740 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0ae000 tx=0x7f6dcc0aa040 comp rx=0 tx=0).stop 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 msgr2=0x7f6ddc164ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400ebd0 tx=0x7f6dd400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 shutdown_connections 2024-09-21T07:31:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6db8073230 0x7f6db8075740 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ddc0ce4d0 0x7f6ddc164ef0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ddc0cc960 0x7f6ddc0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 --2- 172.21.15.64:0/3715399673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc0b3140 0x7f6ddc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 >> 172.21.15.64:0/3715399673 conn(0x7f6ddc06d450 msgr2=0x7f6ddc0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 shutdown_connections 2024-09-21T07:31:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:37.877+0000 7f6de3800640 1 -- 172.21.15.64:0/3715399673 wait complete. 2024-09-21T07:31:37.899 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:31:37.899 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:31:38.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:31:38.105 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:31:38.105 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:38.105 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:38.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:31:38.114 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:31:38.115 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:38.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:31:38.125 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:38.125 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:38.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:31:38.165 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:31:38.165 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:38.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:31:38.174 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:31:38.174 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- 172.21.15.64:0/866336297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 msgr2=0x7f5a440b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 --2- 172.21.15.64:0/866336297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a440b41c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009840 tx=0x7f5a3001c820 comp rx=0 tx=0).stop 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- 172.21.15.64:0/866336297 shutdown_connections 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 --2- 172.21.15.64:0/866336297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a440b41c0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- 172.21.15.64:0/866336297 >> 172.21.15.64:0/866336297 conn(0x7f5a440ccbe0 msgr2=0x7f5a440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:38.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- 172.21.15.64:0/866336297 shutdown_connections 2024-09-21T07:31:38.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- 172.21.15.64:0/866336297 wait complete. 2024-09-21T07:31:38.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 Processor -- start 2024-09-21T07:31:38.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.365+0000 7f5a4b600640 1 -- start start 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a440b4700 0x7f5a44153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a4415edb0 0x7f5a44154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4416a290 con 0x7f5a440709b0 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4416a110 con 0x7f5a440b4700 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4416a410 con 0x7f5a4415edb0 2024-09-21T07:31:38.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45460/0 (socket says 172.21.15.64:45460) 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 -- 172.21.15.64:0/2819058387 learned_addr learned my addr 172.21.15.64:0/2819058387 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a43e00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a440b4700 0x7f5a44153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a49600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a4415edb0 0x7f5a44154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 -- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a4415edb0 msgr2=0x7f5a44154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a4415edb0 0x7f5a44154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 -- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a440b4700 msgr2=0x7f5a44153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a440b4700 0x7f5a44153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 -- 172.21.15.64:0/2819058387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a441549c0 con 0x7f5a440709b0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a48c00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c760 tx=0x7f5a3800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38016020 con 0x7f5a440709b0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a3800a950 con 0x7f5a440709b0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800ada0 con 0x7f5a440709b0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a440cc200 con 0x7f5a440709b0 2024-09-21T07:31:38.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a44166af0 con 0x7f5a440709b0 2024-09-21T07:31:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.369+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a440b41c0 con 0x7f5a440709b0 2024-09-21T07:31:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.373+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a38019020 con 0x7f5a440709b0 2024-09-21T07:31:38.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.373+0000 7f5a40c00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 0x7f5a24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.373+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7f5a38093f10 con 0x7f5a440709b0 2024-09-21T07:31:38.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.373+0000 7f5a43e00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 0x7f5a24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.373+0000 7f5a43e00640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 0x7f5a24075710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5a300af000 tx=0x7f5a3001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.377+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5a38020020 con 0x7f5a440709b0 2024-09-21T07:31:38.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.589+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a4409da20 con 0x7f5a440709b0 2024-09-21T07:31:38.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.589+0000 7f5a40c00640 1 -- 172.21.15.64:0/2819058387 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+3908 (secure 0 0 0) 0x7f5a440b4b10 con 0x7f5a440709b0 2024-09-21T07:31:38.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:38.592 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":96,"btime":"2024-09-21T07:31:32:085473+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2538035547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2538035547},{"type":"v1","addr":"172.21.15.64:6835","nonce":2538035547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7088,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2433320218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2433320218},{"type":"v1","addr":"172.21.15.90:6836","nonce":2433320218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7091,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/836020678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":836020678},{"type":"v1","addr":"172.21.15.90:6837","nonce":836020678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2639600775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2639600775},{"type":"v1","addr":"172.21.15.64:6833","nonce":2639600775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[]} 2024-09-21T07:31:38.592 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 96 2024-09-21T07:31:38.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 msgr2=0x7f5a24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 0x7f5a24075710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5a300af000 tx=0x7f5a3001b060 comp rx=0 tx=0).stop 2024-09-21T07:31:38.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 msgr2=0x7f5a4409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c760 tx=0x7f5a3800cc20 comp rx=0 tx=0).stop 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 shutdown_connections 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a24073200 0x7f5a24075710 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a4415edb0 0x7f5a44154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a440b4700 0x7f5a44153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 --2- 172.21.15.64:0/2819058387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a440709b0 0x7f5a4409aa60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 >> 172.21.15.64:0/2819058387 conn(0x7f5a440ccbe0 msgr2=0x7f5a4415dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 shutdown_connections 2024-09-21T07:31:38.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.593+0000 7f5a4b600640 1 -- 172.21.15.64:0/2819058387 wait complete. 2024-09-21T07:31:38.615 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:31:38.615 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:31:38.616 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:31:38.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:31:38.616 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:31:38.616 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:31:38.616 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:31:38.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:31:38.616 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:31:38.617 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:31:38.617 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:31:38.617 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:31:38.617 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:31:38.617 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:31:38.617 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:31:38.617 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:31:38.630 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:31:38.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:31:38.631 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:31:38.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:31:38.632 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:31:38.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:31:38.637 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:31:38.638 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:31:38.681 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:31:38.681 DEBUG:teuthology.parallel:result is None 2024-09-21T07:31:38.682 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:31:38.682 DEBUG:teuthology.parallel:result is None 2024-09-21T07:31:38.683 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:31:38.683 DEBUG:teuthology.parallel:result is None 2024-09-21T07:31:38.685 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:31:38.685 DEBUG:teuthology.parallel:result is None 2024-09-21T07:31:38.686 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:31:38.785 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:31:38.787 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:31:38.787 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:31:38.787 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:31:38.788 INFO:tasks.ceph.mds.b.smithi090.stderr:2024-09-21T07:31:38.787+0000 7f81c6400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T07:31:38.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 -- 172.21.15.64:0/3400822006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 msgr2=0x7fd30415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 --2- 172.21.15.64:0/3400822006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415aee0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd3040b4420 tx=0x7fd2fc01ccd0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 -- 172.21.15.64:0/3400822006 shutdown_connections 2024-09-21T07:31:38.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 --2- 172.21.15.64:0/3400822006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415aee0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 --2- 172.21.15.64:0/3400822006 >> v2:172.21.15.90:3300/0 conn(0x7fd3040b59e0 0x7fd3040cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 --2- 172.21.15.64:0/3400822006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd30406ff90 0x7fd304073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 -- 172.21.15.64:0/3400822006 >> 172.21.15.64:0/3400822006 conn(0x7fd3040cdd10 msgr2=0x7fd3040ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:38.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 -- 172.21.15.64:0/3400822006 shutdown_connections 2024-09-21T07:31:38.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.849+0000 7fd30b000640 1 -- 172.21.15.64:0/3400822006 wait complete. 2024-09-21T07:31:38.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 Processor -- start 2024-09-21T07:31:38.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 -- start start 2024-09-21T07:31:38.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd30406ff90 0x7fd304154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd30415fc70 con 0x7fd3040cf6d0 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd30415faf0 con 0x7fd30406ff90 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd30b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd30415fdf0 con 0x7fd3040b59e0 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd309000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:44856/0 (socket says 172.21.15.64:44856) 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd303e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd30406ff90 0x7fd304154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 -- 172.21.15.64:0/3182364760 learned_addr learned my addr 172.21.15.64:0/3182364760 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 -- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd30406ff90 msgr2=0x7fd304154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd30406ff90 0x7fd304154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 -- 172.21.15.64:0/3182364760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 msgr2=0x7fd30415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:38.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:38.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 -- 172.21.15.64:0/3182364760 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041554d0 con 0x7fd3040b59e0 2024-09-21T07:31:38.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.853+0000 7fd2fb400640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e770 tx=0x7fd2ec00ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:38.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00ccc0 con 0x7fd3040b59e0 2024-09-21T07:31:38.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2ec00ee80 con 0x7fd3040b59e0 2024-09-21T07:31:38.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec010670 con 0x7fd3040b59e0 2024-09-21T07:31:38.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3040b0da0 con 0x7fd3040b59e0 2024-09-21T07:31:38.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3040b1360 con 0x7fd3040b59e0 2024-09-21T07:31:38.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3040b0b90 con 0x7fd3040b59e0 2024-09-21T07:31:38.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd2ec010810 con 0x7fd3040b59e0 2024-09-21T07:31:38.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 0x7fd2e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:38.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(134..134 src has 1..134) ==== 5335+0+0 (secure 0 0 0) 0x7fd2ec094d00 con 0x7fd3040b59e0 2024-09-21T07:31:38.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.857+0000 7fd303e00640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 0x7fd2e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:38.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.861+0000 7fd303e00640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 0x7fd2e0075710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005fd0 tx=0x7fd2f4005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:38.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:38.861+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd2ec05f920 con 0x7fd3040b59e0 2024-09-21T07:31:39.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.049+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd304155260 con 0x7fd3040b59e0 2024-09-21T07:31:39.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.149+0000 7fd300c00640 1 -- 172.21.15.64:0/3182364760 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v136) ==== 97+0+0 (secure 0 0 0) 0x7fd2ec064350 con 0x7fd3040b59e0 2024-09-21T07:31:39.151 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:31:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 msgr2=0x7fd2e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 0x7fd2e0075710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005fd0 tx=0x7fd2f4005f40 comp rx=0 tx=0).stop 2024-09-21T07:31:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 msgr2=0x7fd3041f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e770 tx=0x7fd2ec00ec30 comp rx=0 tx=0).stop 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 shutdown_connections 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd2e0073200 0x7fd2e0075710 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3040cf6d0 0x7fd30415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3040b59e0 0x7fd3041f89e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 --2- 172.21.15.64:0/3182364760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd30406ff90 0x7fd304154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 >> 172.21.15.64:0/3182364760 conn(0x7fd3040cdd10 msgr2=0x7fd30415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 shutdown_connections 2024-09-21T07:31:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.153+0000 7fd30b000640 1 -- 172.21.15.64:0/3182364760 wait complete. 2024-09-21T07:31:39.176 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 -- 172.21.15.64:0/676638446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 msgr2=0x7fd8300b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 --2- 172.21.15.64:0/676638446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b3d50 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd830074400 tx=0x7fd82001c830 comp rx=0 tx=0).stop 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 -- 172.21.15.64:0/676638446 shutdown_connections 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 --2- 172.21.15.64:0/676638446 >> v2:172.21.15.90:3300/0 conn(0x7fd8300b4290 0x7fd8300711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 --2- 172.21.15.64:0/676638446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b3d50 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 -- 172.21.15.64:0/676638446 >> 172.21.15.64:0/676638446 conn(0x7fd83006d220 msgr2=0x7fd83006d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 -- 172.21.15.64:0/676638446 shutdown_connections 2024-09-21T07:31:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.333+0000 7fd836000640 1 -- 172.21.15.64:0/676638446 wait complete. 2024-09-21T07:31:39.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 Processor -- start 2024-09-21T07:31:39.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 -- start start 2024-09-21T07:31:39.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 0x7fd8301f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8300b4290 0x7fd8300afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300c6f70 con 0x7fd83015c7e0 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300c6df0 con 0x7fd8300716f0 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd836000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300c70f0 con 0x7fd8300b4290 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45518/0 (socket says 172.21.15.64:45518) 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 -- 172.21.15.64:0/379046775 learned_addr learned my addr 172.21.15.64:0/379046775 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:39.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82f400640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 0x7fd8301f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82ea00640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8300b4290 0x7fd8300afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 -- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8300b4290 msgr2=0x7fd8300afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8300b4290 0x7fd8300afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 -- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 msgr2=0x7fd8301f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 0x7fd8301f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82fe00640 1 -- 172.21.15.64:0/379046775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300ce1a0 con 0x7fd83015c7e0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.337+0000 7fd82f400640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 0x7fd8301f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd82fe00640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c730 tx=0x7fd82800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828003b80 con 0x7fd83015c7e0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd828003d40 con 0x7fd83015c7e0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280052d0 con 0x7fd83015c7e0 2024-09-21T07:31:39.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83015a7a0 con 0x7fd83015c7e0 2024-09-21T07:31:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83015ad60 con 0x7fd83015c7e0 2024-09-21T07:31:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8300b0c40 con 0x7fd83015c7e0 2024-09-21T07:31:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd828005680 con 0x7fd83015c7e0 2024-09-21T07:31:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 0x7fd810075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5249+0+0 (secure 0 0 0) 0x7fd828093ff0 con 0x7fd83015c7e0 2024-09-21T07:31:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.341+0000 7fd82f400640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 0x7fd810075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.345+0000 7fd82f400640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 0x7fd810075710 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af000 tx=0x7fd82001b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.349+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd8300b46a0 con 0x7fd83015c7e0 2024-09-21T07:31:39.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd8301552a0 con 0x7fd83015c7e0 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd827400640 1 -- 172.21.15.64:0/379046775 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) ==== 80+0+5304 (secure 0 0 0) 0x7fd82805f1e0 con 0x7fd83015c7e0 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:31:39.586 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.587 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:31:39.588 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.589 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.590 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:31:39.591 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.592 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.593 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:31:39.594 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:31:39.595 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.596 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:31:39.597 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:31:39.598 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:31:39.599 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:31:39.600 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:31:39.601 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:39.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 msgr2=0x7fd810075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 0x7fd810075710 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af000 tx=0x7fd82001b070 comp rx=0 tx=0).stop 2024-09-21T07:31:39.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 msgr2=0x7fd8300b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c730 tx=0x7fd82800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 shutdown_connections 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd810073200 0x7fd810075710 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83015c7e0 0x7fd8300b0400 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8300b4290 0x7fd8300afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 --2- 172.21.15.64:0/379046775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8300716f0 0x7fd8301f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 >> 172.21.15.64:0/379046775 conn(0x7fd83006d220 msgr2=0x7fd83006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 shutdown_connections 2024-09-21T07:31:39.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.585+0000 7fd836000640 1 -- 172.21.15.64:0/379046775 wait complete. 2024-09-21T07:31:39.609 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:31:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- 172.21.15.64:0/2255907375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0b4700 msgr2=0x7fe2bc072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 --2- 172.21.15.64:0/2255907375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0b4700 0x7fe2bc072e20 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc15f1c0 tx=0x7fe2b401cd80 comp rx=0 tx=0).stop 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- 172.21.15.64:0/2255907375 shutdown_connections 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 --2- 172.21.15.64:0/2255907375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0b4700 0x7fe2bc072e20 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 --2- 172.21.15.64:0/2255907375 >> v2:172.21.15.90:3300/0 conn(0x7fe2bc0709b0 0x7fe2bc0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- 172.21.15.64:0/2255907375 >> 172.21.15.64:0/2255907375 conn(0x7fe2bc0ccbe0 msgr2=0x7fe2bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- 172.21.15.64:0/2255907375 shutdown_connections 2024-09-21T07:31:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- 172.21.15.64:0/2255907375 wait complete. 2024-09-21T07:31:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 Processor -- start 2024-09-21T07:31:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.765+0000 7fe2c1600640 1 -- start start 2024-09-21T07:31:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2bc0b4700 0x7fe2bc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc15edb0 0x7fe2bc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc168b90 con 0x7fe2bc0709b0 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc168a10 con 0x7fe2bc15edb0 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc168d10 con 0x7fe2bc0b4700 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45522/0 (socket says 172.21.15.64:45522) 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 -- 172.21.15.64:0/1277638553 learned_addr learned my addr 172.21.15.64:0/1277638553 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2bb400640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc15edb0 0x7fe2bc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2b3e00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2bc0b4700 0x7fe2bc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 -- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2bc0b4700 msgr2=0x7fe2bc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2bc0b4700 0x7fe2bc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 -- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc15edb0 msgr2=0x7fe2bc1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc15edb0 0x7fe2bc1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 -- 172.21.15.64:0/1277638553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc1537a0 con 0x7fe2bc0709b0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2baa00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c400 tx=0x7fe2ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac017070 con 0x7fe2bc0709b0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2ac003600 con 0x7fe2bc0709b0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac003a50 con 0x7fe2bc0709b0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc0c7bd0 con 0x7fe2bc0709b0 2024-09-21T07:31:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc165bb0 con 0x7fe2bc0709b0 2024-09-21T07:31:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.769+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc0b41c0 con 0x7fe2bc0709b0 2024-09-21T07:31:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.773+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe2ac01a070 con 0x7fe2bc0709b0 2024-09-21T07:31:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.773+0000 7fe2b2a00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 0x7fe298075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.773+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5249+0+0 (secure 0 0 0) 0x7fe2ac093270 con 0x7fe2bc0709b0 2024-09-21T07:31:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.773+0000 7fe2b3e00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 0x7fe298075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.773+0000 7fe2b3e00640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 0x7fe298075710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0cb620 tx=0x7fe2a40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.777+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe2bc0b4b10 con 0x7fe2bc0709b0 2024-09-21T07:31:39.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.957+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe2bc159c90 con 0x7fe2bc0709b0 2024-09-21T07:31:39.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.957+0000 7fe2b2a00640 1 -- 172.21.15.64:0/1277638553 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) ==== 84+0+65 (secure 0 0 0) 0x7fe2ac05de80 con 0x7fe2bc0709b0 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:31:39.960 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:31:39.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 msgr2=0x7fe298075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 0x7fe298075710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0cb620 tx=0x7fe2a40091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 msgr2=0x7fe2bc0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c400 tx=0x7fe2ac00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 shutdown_connections 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe298073200 0x7fe298075710 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc15edb0 0x7fe2bc1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2bc0b4700 0x7fe2bc153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 --2- 172.21.15.64:0/1277638553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2bc0709b0 0x7fe2bc0c7660 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 >> 172.21.15.64:0/1277638553 conn(0x7fe2bc0ccbe0 msgr2=0x7fe2bc159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 shutdown_connections 2024-09-21T07:31:39.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:39.961+0000 7fe2c1600640 1 -- 172.21.15.64:0/1277638553 wait complete. 2024-09-21T07:31:39.982 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:31:39.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:31:40.021 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:40.031 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 -- 172.21.15.64:0/2828742606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc074880 msgr2=0x7f55dc15c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 --2- 172.21.15.64:0/2828742606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc074880 0x7f55dc15c910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009870 tx=0x7f55d001c780 comp rx=0 tx=0).stop 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 -- 172.21.15.64:0/2828742606 shutdown_connections 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 --2- 172.21.15.64:0/2828742606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc074880 0x7f55dc15c910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 -- 172.21.15.64:0/2828742606 >> 172.21.15.64:0/2828742606 conn(0x7f55dc0b2d30 msgr2=0x7f55dc0b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 -- 172.21.15.64:0/2828742606 shutdown_connections 2024-09-21T07:31:40.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.145+0000 7f55e4800640 1 -- 172.21.15.64:0/2828742606 wait complete. 2024-09-21T07:31:40.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 Processor -- start 2024-09-21T07:31:40.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 -- start start 2024-09-21T07:31:40.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 0x7f55dc1fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 0x7f55dc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc16b5e0 con 0x7f55dc074880 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc16b460 con 0x7f55dc1603e0 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc16b760 con 0x7f55dc15b1f0 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45536/0 (socket says 172.21.15.64:45536) 2024-09-21T07:31:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 -- 172.21.15.64:0/3559228046 learned_addr learned my addr 172.21.15.64:0/3559228046 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1400640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 0x7f55dc1fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e2800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 0x7f55dc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 -- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 msgr2=0x7f55dc15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 0x7f55dc15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 -- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 msgr2=0x7f55dc1fccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 0x7f55dc1fccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 -- 172.21.15.64:0/3559228046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc1f96d0 con 0x7f55dc074880 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1400640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 0x7f55dc1fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e2800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 0x7f55dc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e1e00640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f55d001a3b0 tx=0x7f55d0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d00047d0 con 0x7f55dc074880 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d0004970 con 0x7f55dc074880 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.149+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc1fd740 con 0x7f55dc074880 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0004dc0 con 0x7f55dc074880 2024-09-21T07:31:40.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc1f9990 con 0x7f55dc074880 2024-09-21T07:31:40.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc15c910 con 0x7f55dc074880 2024-09-21T07:31:40.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f55d00a8520 con 0x7f55dc074880 2024-09-21T07:31:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55d6000640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 0x7f55c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5249+0+0 (secure 0 0 0) 0x7f55d012e130 con 0x7f55dc074880 2024-09-21T07:31:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.153+0000 7f55e1400640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 0x7f55c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.157+0000 7f55e1400640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 0x7f55c0075710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000f70 tx=0x7f55cc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:40.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.157+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f55d00c1030 con 0x7f55dc074880 2024-09-21T07:31:40.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:40.337+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f55dc06d920 con 0x7f55dc074880 2024-09-21T07:31:41.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.161+0000 7f55d6000640 1 -- 172.21.15.64:0/3559228046 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) ==== 138+0+0 (secure 0 0 0) 0x7f55d00ac030 con 0x7f55dc074880 2024-09-21T07:31:41.165 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:31:41.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 msgr2=0x7f55c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:41.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 0x7f55c0075710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000f70 tx=0x7f55cc009040 comp rx=0 tx=0).stop 2024-09-21T07:31:41.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 msgr2=0x7f55dc1fa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:41.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f55d001a3b0 tx=0x7f55d0005780 comp rx=0 tx=0).stop 2024-09-21T07:31:41.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 shutdown_connections 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55c0073200 0x7f55c0075710 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55dc15b1f0 0x7f55dc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55dc1603e0 0x7f55dc1fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 --2- 172.21.15.64:0/3559228046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55dc074880 0x7f55dc1fa170 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 >> 172.21.15.64:0/3559228046 conn(0x7f55dc0b2d30 msgr2=0x7f55dc15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 shutdown_connections 2024-09-21T07:31:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.165+0000 7f55e4800640 1 -- 172.21.15.64:0/3559228046 wait complete. 2024-09-21T07:31:41.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 -- 172.21.15.64:0/1172277824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8768003cb0 msgr2=0x7f8768004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 --2- 172.21.15.64:0/1172277824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8768003cb0 0x7f8768004100 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f8774009b40 tx=0x7f877401d220 comp rx=0 tx=0).stop 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 -- 172.21.15.64:0/1172277824 shutdown_connections 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 --2- 172.21.15.64:0/1172277824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8768003cb0 0x7f8768004100 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 -- 172.21.15.64:0/1172277824 >> 172.21.15.64:0/1172277824 conn(0x7f87840b1bf0 msgr2=0x7f87840b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:41.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 -- 172.21.15.64:0/1172277824 shutdown_connections 2024-09-21T07:31:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.365+0000 7f8783200640 1 -- 172.21.15.64:0/1172277824 wait complete. 2024-09-21T07:31:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 Processor -- start 2024-09-21T07:31:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 -- start start 2024-09-21T07:31:41.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8768003cb0 0x7f878414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87840ae890 0x7f878415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f878415c060 con 0x7f87841f96a0 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f878415bee0 con 0x7f8768003cb0 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.369+0000 7f8783200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f878415c1e0 con 0x7f87840ae890 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45550/0 (socket says 172.21.15.64:45550) 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 -- 172.21.15.64:0/3471139320 learned_addr learned my addr 172.21.15.64:0/3471139320 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f8781e00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8768003cb0 0x7f878414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f8782800640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87840ae890 0x7f878415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 -- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87840ae890 msgr2=0x7f878415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87840ae890 0x7f878415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 -- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8768003cb0 msgr2=0x7f878414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:41.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8768003cb0 0x7f878414fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:41.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 -- 172.21.15.64:0/3471139320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878415d420 con 0x7f87841f96a0 2024-09-21T07:31:41.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877be00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f876c006de0 tx=0x7f876c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c015020 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f876c011890 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c011ce0 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878415d700 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8784151780 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87840ca520 con 0x7f87841f96a0 2024-09-21T07:31:41.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.373+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f876c018020 con 0x7f87841f96a0 2024-09-21T07:31:41.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.377+0000 7f877a000640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 0x7f8760075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:41.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.377+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5619+0+0 (secure 0 0 0) 0x7f876c0951a0 con 0x7f87841f96a0 2024-09-21T07:31:41.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.377+0000 7f8781e00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 0x7f8760075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:41.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.377+0000 7f8781e00640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 0x7f8760075710 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f87740ad000 tx=0x7f8774019fc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:41.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.381+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f876c01f020 con 0x7f87841f96a0 2024-09-21T07:31:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:41.557+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f878414f8d0 con 0x7f87841f96a0 2024-09-21T07:31:42.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f877a000640 1 -- 172.21.15.64:0/3471139320 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) ==== 170+0+0 (secure 0 0 0) 0x7f878415fe50 con 0x7f87841f96a0 2024-09-21T07:31:42.174 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:31:42.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 msgr2=0x7f8760075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:42.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 0x7f8760075710 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f87740ad000 tx=0x7f8774019fc0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 msgr2=0x7f878415cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f876c006de0 tx=0x7f876c0049e0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 shutdown_connections 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.173+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8760073200 0x7f8760075710 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87840ae890 0x7f878415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87841f96a0 0x7f878415cb60 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 --2- 172.21.15.64:0/3471139320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8768003cb0 0x7f878414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 >> 172.21.15.64:0/3471139320 conn(0x7f87840b1bf0 msgr2=0x7f87840b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:42.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 shutdown_connections 2024-09-21T07:31:42.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.177+0000 7f8783200640 1 -- 172.21.15.64:0/3471139320 wait complete. 2024-09-21T07:31:42.212 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:31:42.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 -- 172.21.15.64:0/3202585013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a000b4d40 msgr2=0x7f9a0015f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 --2- 172.21.15.64:0/3202585013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a000b4d40 0x7f9a0015f540 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f99f00098f0 tx=0x7f99f001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 -- 172.21.15.64:0/3202585013 shutdown_connections 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 --2- 172.21.15.64:0/3202585013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000cca80 0x7f9a000cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 --2- 172.21.15.64:0/3202585013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a000b4d40 0x7f9a0015f540 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 -- 172.21.15.64:0/3202585013 >> 172.21.15.64:0/3202585013 conn(0x7f9a0006d450 msgr2=0x7f9a000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 -- 172.21.15.64:0/3202585013 shutdown_connections 2024-09-21T07:31:42.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.369+0000 7f9a06e00640 1 -- 172.21.15.64:0/3202585013 wait complete. 2024-09-21T07:31:42.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 Processor -- start 2024-09-21T07:31:42.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 -- start start 2024-09-21T07:31:42.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000b4d40 0x7f9a00159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:42.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a000cca80 0x7f9a000b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:42.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:42.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00166040 con 0x7f9a0015b4f0 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00165ec0 con 0x7f9a000cca80 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a06e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9a001661c0 con 0x7f9a000b4d40 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a04e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a04e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45568/0 (socket says 172.21.15.64:45568) 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f9a04e00640 1 -- 172.21.15.64:0/677772522 learned_addr learned my addr 172.21.15.64:0/677772522 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f99ffe00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000b4d40 0x7f9a00159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:42.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.373+0000 7f99f7400640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a000cca80 0x7f9a000b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 -- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000b4d40 msgr2=0x7f9a00159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000b4d40 0x7f9a00159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 -- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a000cca80 msgr2=0x7f9a000b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a000cca80 0x7f9a000b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 -- 172.21.15.64:0/677772522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0009bba0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a04e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c730 tx=0x7f99f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8003ba0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f8003d60 con 0x7f9a0015b4f0 2024-09-21T07:31:42.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0009be40 con 0x7f9a0015b4f0 2024-09-21T07:31:42.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8005330 con 0x7f9a0015b4f0 2024-09-21T07:31:42.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a001f7b50 con 0x7f9a0015b4f0 2024-09-21T07:31:42.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a000b2ce0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.377+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99f80056e0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.381+0000 7f99fcc00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 0x7f99dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:42.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.381+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6001+0+0 (secure 0 0 0) 0x7f99f8094ce0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.381+0000 7f99ffe00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 0x7f99dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:42.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.381+0000 7f99ffe00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 0x7f99dc075710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f99f00af000 tx=0x7f99f001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:42.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.385+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9a000b2ce0 con 0x7f9a0015b4f0 2024-09-21T07:31:42.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:42.597+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9a0015f540 con 0x7f9a0015b4f0 2024-09-21T07:31:43.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.173+0000 7f99fcc00640 1 -- 172.21.15.64:0/677772522 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v99) ==== 174+0+0 (secure 0 0 0) 0x7f99f805f560 con 0x7f9a0015b4f0 2024-09-21T07:31:43.176 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 19 and data pool 20 2024-09-21T07:31:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.177+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 msgr2=0x7f99dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.177+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 0x7f99dc075710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f99f00af000 tx=0x7f99f001b120 comp rx=0 tx=0).stop 2024-09-21T07:31:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.177+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 msgr2=0x7f9a000b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.177+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c730 tx=0x7f99f800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.181+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 shutdown_connections 2024-09-21T07:31:43.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99dc073200 0x7f99dc075710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a0015b4f0 0x7f9a000b1880 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a000cca80 0x7f9a000b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 --2- 172.21.15.64:0/677772522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a000b4d40 0x7f9a00159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 >> 172.21.15.64:0/677772522 conn(0x7f9a0006d450 msgr2=0x7f9a00166650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:43.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 shutdown_connections 2024-09-21T07:31:43.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.185+0000 7f9a06e00640 1 -- 172.21.15.64:0/677772522 wait complete. 2024-09-21T07:31:43.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 -- 172.21.15.64:0/1361859085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0709b0 msgr2=0x7fd8ac0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 --2- 172.21.15.64:0/1361859085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac0b41c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd894009840 tx=0x7fd89401c820 comp rx=0 tx=0).stop 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 -- 172.21.15.64:0/1361859085 shutdown_connections 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 --2- 172.21.15.64:0/1361859085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac0b41c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 --2- 172.21.15.64:0/1361859085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 0x7fd8ac0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 -- 172.21.15.64:0/1361859085 >> 172.21.15.64:0/1361859085 conn(0x7fd8ac0ccbe0 msgr2=0x7fd8ac0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 -- 172.21.15.64:0/1361859085 shutdown_connections 2024-09-21T07:31:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.389+0000 7fd8b1400640 1 -- 172.21.15.64:0/1361859085 wait complete. 2024-09-21T07:31:43.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 Processor -- start 2024-09-21T07:31:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- start start 2024-09-21T07:31:43.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0b4700 0x7fd8ac0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 0x7fd8ac165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac169070 con 0x7fd8ac0709b0 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac168ef0 con 0x7fd8ac0b4700 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac1691f0 con 0x7fd8ac15edb0 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45580/0 (socket says 172.21.15.64:45580) 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 -- 172.21.15.64:0/2993591352 learned_addr learned my addr 172.21.15.64:0/2993591352 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8a3e00640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0b4700 0x7fd8ac0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8ab200640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 0x7fd8ac165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 -- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 msgr2=0x7fd8ac165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 0x7fd8ac165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 -- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0b4700 msgr2=0x7fd8ac0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0b4700 0x7fd8ac0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 -- 172.21.15.64:0/2993591352 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac163700 con 0x7fd8ac0709b0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8aa800640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e970 tx=0x7fd89c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00cd20 con 0x7fd8ac0709b0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd89c004020 con 0x7fd8ac0709b0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004470 con 0x7fd8ac0709b0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ac1639e0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.393+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ac156ad0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.397+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ac0b41c0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.397+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd89c003600 con 0x7fd8ac0709b0 2024-09-21T07:31:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.397+0000 7fd8a2a00640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 0x7fd888075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.397+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fd89c094ba0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.397+0000 7fd8a3e00640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 0x7fd888075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.401+0000 7fd8a3e00640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 0x7fd888075740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd8940af000 tx=0x7fd89401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.401+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd89c05fac0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.577+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8ac155800 con 0x7fd8ac0709b0 2024-09-21T07:31:43.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8a2a00640 1 -- 172.21.15.64:0/2993591352 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16925 (secure 0 0 0) 0x7fd89c05f3c0 con 0x7fd8ac0709b0 2024-09-21T07:31:43.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:43.582 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":141,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:42.604202+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:31:40.351070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-21T07:31:41.571750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 msgr2=0x7fd888075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 0x7fd888075740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd8940af000 tx=0x7fd89401b060 comp rx=0 tx=0).stop 2024-09-21T07:31:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 msgr2=0x7fd8ac158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e970 tx=0x7fd89c00ee30 comp rx=0 tx=0).stop 2024-09-21T07:31:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 shutdown_connections 2024-09-21T07:31:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd888073230 0x7fd888075740 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd8ac15edb0 0x7fd8ac165210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8ac0b4700 0x7fd8ac0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 --2- 172.21.15.64:0/2993591352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8ac0709b0 0x7fd8ac158900 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 >> 172.21.15.64:0/2993591352 conn(0x7fd8ac0ccbe0 msgr2=0x7fd8ac0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:43.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 shutdown_connections 2024-09-21T07:31:43.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.581+0000 7fd8b1400640 1 -- 172.21.15.64:0/2993591352 wait complete. 2024-09-21T07:31:43.606 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 -- 172.21.15.64:0/1090953626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b10a0 msgr2=0x7f83880b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 --2- 172.21.15.64:0/1090953626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b10a0 0x7f83880b14b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8378009840 tx=0x7f837801f010 comp rx=0 tx=0).stop 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 -- 172.21.15.64:0/1090953626 shutdown_connections 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 --2- 172.21.15.64:0/1090953626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b10a0 0x7f83880b14b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 --2- 172.21.15.64:0/1090953626 >> v2:172.21.15.90:3300/0 conn(0x7f83880b5ba0 0x7f838815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 -- 172.21.15.64:0/1090953626 >> 172.21.15.64:0/1090953626 conn(0x7f83880b2020 msgr2=0x7f83880b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 -- 172.21.15.64:0/1090953626 shutdown_connections 2024-09-21T07:31:43.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.761+0000 7f8390800640 1 -- 172.21.15.64:0/1090953626 wait complete. 2024-09-21T07:31:43.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 Processor -- start 2024-09-21T07:31:43.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- start start 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83880b10a0 0x7f8388099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b5ba0 0x7f83881e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8388075000 con 0x7f83880b19f0 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8388074e80 con 0x7f83880b10a0 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8388075180 con 0x7f83880b5ba0 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45586/0 (socket says 172.21.15.64:45586) 2024-09-21T07:31:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 -- 172.21.15.64:0/1063208992 learned_addr learned my addr 172.21.15.64:0/1063208992 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838de00640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83880b10a0 0x7f8388099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838e800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b5ba0 0x7f83881e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 -- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b5ba0 msgr2=0x7f83881e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b5ba0 0x7f83881e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 -- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83880b10a0 msgr2=0x7f8388099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83880b10a0 0x7f8388099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 -- 172.21.15.64:0/1063208992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880c4280 con 0x7f83880b19f0 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f838d400640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8378009790 tx=0x7f8378005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780be070 con 0x7f83880b19f0 2024-09-21T07:31:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83780052f0 con 0x7f83880b19f0 2024-09-21T07:31:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780b5040 con 0x7f83880b19f0 2024-09-21T07:31:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83880c4560 con 0x7f83880b19f0 2024-09-21T07:31:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.765+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83880ae3b0 con 0x7f83880b19f0 2024-09-21T07:31:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.769+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83880b14b0 con 0x7f83880b19f0 2024-09-21T07:31:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.769+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f83780046d0 con 0x7f83880b19f0 2024-09-21T07:31:43.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.769+0000 7f8382000640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 0x7f836c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:43.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.769+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f83781313b0 con 0x7f83880b19f0 2024-09-21T07:31:43.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.769+0000 7f838de00640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 0x7f836c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.773+0000 7f838de00640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 0x7f836c075710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f837c005fd0 tx=0x7f837c005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.773+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8378018b70 con 0x7f83880b19f0 2024-09-21T07:31:43.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83880c4730 con 0x7f83880b19f0 2024-09-21T07:31:43.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8382000640 1 -- 172.21.15.64:0/1063208992 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16925 (secure 0 0 0) 0x7f83780fbbe0 con 0x7f83880b19f0 2024-09-21T07:31:43.954 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:43.955 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":141,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:42.604202+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:31:40.351070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-21T07:31:41.571750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 msgr2=0x7f836c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 0x7f836c075710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f837c005fd0 tx=0x7f837c005f40 comp rx=0 tx=0).stop 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 msgr2=0x7f83881e9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8378009790 tx=0x7f8378005db0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 shutdown_connections 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f836c073200 0x7f836c075710 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83880b5ba0 0x7f83881e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880b19f0 0x7f83881e9980 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 --2- 172.21.15.64:0/1063208992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83880b10a0 0x7f8388099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:43.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 >> 172.21.15.64:0/1063208992 conn(0x7f83880b2020 msgr2=0x7f83880b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:43.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 shutdown_connections 2024-09-21T07:31:43.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:43.953+0000 7f8390800640 1 -- 172.21.15.64:0/1063208992 wait complete. 2024-09-21T07:31:43.978 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:31:44.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 -- 172.21.15.64:0/3240893382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 msgr2=0x7fdb280cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:44.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3240893382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb280cd140 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fdb28074700 tx=0x7fdb1801c7a0 comp rx=0 tx=0).stop 2024-09-21T07:31:44.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 -- 172.21.15.64:0/3240893382 shutdown_connections 2024-09-21T07:31:44.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3240893382 >> v2:172.21.15.90:3300/0 conn(0x7fdb280b3d50 0x7fdb280b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:44.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3240893382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb280cd140 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:44.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 -- 172.21.15.64:0/3240893382 >> 172.21.15.64:0/3240893382 conn(0x7fdb2806d4e0 msgr2=0x7fdb280ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:44.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 -- 172.21.15.64:0/3240893382 shutdown_connections 2024-09-21T07:31:44.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.137+0000 7fdb2d800640 1 -- 172.21.15.64:0/3240893382 wait complete. 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 Processor -- start 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 -- start start 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb28071180 0x7fdb2815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb280b3d50 0x7fdb281644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2816a3e0 con 0x7fdb280ccd30 2024-09-21T07:31:44.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2816a260 con 0x7fdb28071180 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb2d800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2816a560 con 0x7fdb280b3d50 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45602/0 (socket says 172.21.15.64:45602) 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 -- 172.21.15.64:0/3424485349 learned_addr learned my addr 172.21.15.64:0/3424485349 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb26a00640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb28071180 0x7fdb2815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb1e000640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb280b3d50 0x7fdb281644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 -- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb280b3d50 msgr2=0x7fdb281644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb280b3d50 0x7fdb281644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 -- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb28071180 msgr2=0x7fdb2815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb28071180 0x7fdb2815a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.141+0000 7fdb27400640 1 -- 172.21.15.64:0/3424485349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb280cab60 con 0x7fdb280ccd30 2024-09-21T07:31:44.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb27400640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c6b0 tx=0x7fdb2000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20003b80 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb20003d40 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb280cae40 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20005330 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb280cb400 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb280b4160 con 0x7fdb280ccd30 2024-09-21T07:31:44.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb200054d0 con 0x7fdb280ccd30 2024-09-21T07:31:44.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 0x7fdb04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:44.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.145+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fdb200940f0 con 0x7fdb280ccd30 2024-09-21T07:31:44.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.149+0000 7fdb26a00640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 0x7fdb04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:44.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.149+0000 7fdb26a00640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 0x7fdb04075710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb180af000 tx=0x7fdb180a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:44.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.153+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdb280b46a0 con 0x7fdb280ccd30 2024-09-21T07:31:44.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:44.369+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdb280ca8f0 con 0x7fdb280ccd30 2024-09-21T07:31:45.147 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:31:45.145+0000 7fc7c1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:31:45.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb1f400640 1 -- 172.21.15.64:0/3424485349 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v102) ==== 118+0+0 (secure 0 0 0) 0x7fdb2005e890 con 0x7fdb280ccd30 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 msgr2=0x7fdb04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 0x7fdb04075710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb180af000 tx=0x7fdb180a7040 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 msgr2=0x7fdb28164a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c6b0 tx=0x7fdb2000cb70 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 shutdown_connections 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb04073200 0x7fdb04075710 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb280ccd30 0x7fdb28164a00 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb280b3d50 0x7fdb281644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 --2- 172.21.15.64:0/3424485349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb28071180 0x7fdb2815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 >> 172.21.15.64:0/3424485349 conn(0x7fdb2806d4e0 msgr2=0x7fdb280ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 shutdown_connections 2024-09-21T07:31:45.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.205+0000 7fdb2d800640 1 -- 172.21.15.64:0/3424485349 wait complete. 2024-09-21T07:31:45.230 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:31:45.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 -- 172.21.15.64:0/3853978002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec15eb80 msgr2=0x7f28ec15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 --2- 172.21.15.64:0/3853978002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec15eb80 0x7f28ec15ef90 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0728d0 tx=0x7f28d801c800 comp rx=0 tx=0).stop 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 -- 172.21.15.64:0/3853978002 shutdown_connections 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 --2- 172.21.15.64:0/3853978002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec15eb80 0x7f28ec15ef90 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 --2- 172.21.15.64:0/3853978002 >> v2:172.21.15.90:3300/0 conn(0x7f28ec155560 0x7f28ec0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 -- 172.21.15.64:0/3853978002 >> 172.21.15.64:0/3853978002 conn(0x7f28ec06d450 msgr2=0x7f28ec0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 -- 172.21.15.64:0/3853978002 shutdown_connections 2024-09-21T07:31:45.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.389+0000 7f28f4200640 1 -- 172.21.15.64:0/3853978002 wait complete. 2024-09-21T07:31:45.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 Processor -- start 2024-09-21T07:31:45.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 -- start start 2024-09-21T07:31:45.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0aefe0 0x7f28ec14ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:45.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:45.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 0x7f28ec14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1672f0 con 0x7f28ec155560 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec167170 con 0x7f28ec0aefe0 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f4200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec167470 con 0x7f28ec15eb80 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47540/0 (socket says 172.21.15.64:47540) 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f0e00640 1 -- 172.21.15.64:0/1908979475 learned_addr learned my addr 172.21.15.64:0/1908979475 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f1800640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0aefe0 0x7f28ec14ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:45.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.393+0000 7f28f2200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 0x7f28ec14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 -- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 msgr2=0x7f28ec14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 0x7f28ec14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 -- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0aefe0 msgr2=0x7f28ec14ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0aefe0 0x7f28ec14ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 -- 172.21.15.64:0/1908979475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec072e10 con 0x7f28ec155560 2024-09-21T07:31:45.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f2200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 0x7f28ec14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f0e00640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f28d8019410 tx=0x7f28d80a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80bc070 con 0x7f28ec155560 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28d8004430 con 0x7f28ec155560 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec0730f0 con 0x7f28ec155560 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80b2040 con 0x7f28ec155560 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec14df10 con 0x7f28ec155560 2024-09-21T07:31:45.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec0b4cd0 con 0x7f28ec155560 2024-09-21T07:31:45.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.397+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f28d8005290 con 0x7f28ec155560 2024-09-21T07:31:45.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.401+0000 7f28e9600640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 0x7f28cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:45.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.401+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f28d812dd10 con 0x7f28ec155560 2024-09-21T07:31:45.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.401+0000 7f28f1800640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 0x7f28cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:45.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.401+0000 7f28f1800640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 0x7f28cc075710 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f28e0005fd0 tx=0x7f28e000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:45.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.401+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f28ec15f4d0 con 0x7f28ec155560 2024-09-21T07:31:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:45.617+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f28ec0704c0 con 0x7f28ec155560 2024-09-21T07:31:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.209+0000 7f28e9600640 1 -- 172.21.15.64:0/1908979475 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v103) ==== 122+0+0 (secure 0 0 0) 0x7f28d80164b0 con 0x7f28ec155560 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 msgr2=0x7f28cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 0x7f28cc075710 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f28e0005fd0 tx=0x7f28e000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 msgr2=0x7f28ec14e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f28d8019410 tx=0x7f28d80a5750 comp rx=0 tx=0).stop 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 shutdown_connections 2024-09-21T07:31:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f28cc073200 0x7f28cc075710 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28ec15eb80 0x7f28ec14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28ec155560 0x7f28ec14e590 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 --2- 172.21.15.64:0/1908979475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0aefe0 0x7f28ec14ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 >> 172.21.15.64:0/1908979475 conn(0x7f28ec06d450 msgr2=0x7f28ec15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 shutdown_connections 2024-09-21T07:31:46.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.213+0000 7f28f4200640 1 -- 172.21.15.64:0/1908979475 wait complete. 2024-09-21T07:31:46.238 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:31:46.238 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- 172.21.15.64:0/2753962007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 msgr2=0x7fa5140700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 --2- 172.21.15.64:0/2753962007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa5140700b0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa508009900 tx=0x7fa50801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- 172.21.15.64:0/2753962007 shutdown_connections 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 --2- 172.21.15.64:0/2753962007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5140b48d0 0x7fa514072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 --2- 172.21.15.64:0/2753962007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa5140700b0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- 172.21.15.64:0/2753962007 >> 172.21.15.64:0/2753962007 conn(0x7fa5140ccbe0 msgr2=0x7fa5140ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:46.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- 172.21.15.64:0/2753962007 shutdown_connections 2024-09-21T07:31:46.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- 172.21.15.64:0/2753962007 wait complete. 2024-09-21T07:31:46.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 Processor -- start 2024-09-21T07:31:46.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.397+0000 7fa51c200640 1 -- start start 2024-09-21T07:31:46.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 0x7fa51409b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa514164a70 0x7fa514164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa514168bf0 con 0x7fa51415edb0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa514168a70 con 0x7fa5140709b0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa514168d70 con 0x7fa514164a70 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47558/0 (socket says 172.21.15.64:47558) 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 -- 172.21.15.64:0/2744560387 learned_addr learned my addr 172.21.15.64:0/2744560387 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa519800640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 0x7fa51409b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51a200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa514164a70 0x7fa514164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 -- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa514164a70 msgr2=0x7fa514164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa514164a70 0x7fa514164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 -- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 msgr2=0x7fa51409b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 0x7fa51409b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 -- 172.21.15.64:0/2744560387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51409d800 con 0x7fa51415edb0 2024-09-21T07:31:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa519800640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 0x7fa51409b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:46.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa518e00640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa50000b440 tx=0x7fa50000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:46.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500015020 con 0x7fa51415edb0 2024-09-21T07:31:46.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa500011980 con 0x7fa51415edb0 2024-09-21T07:31:46.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500011dd0 con 0x7fa51415edb0 2024-09-21T07:31:46.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51409a9f0 con 0x7fa51415edb0 2024-09-21T07:31:46.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51409af70 con 0x7fa51415edb0 2024-09-21T07:31:46.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.401+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514072e20 con 0x7fa51415edb0 2024-09-21T07:31:46.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.405+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa500018020 con 0x7fa51415edb0 2024-09-21T07:31:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.405+0000 7fa511600640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 0x7fa4f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.405+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fa5000945d0 con 0x7fa51415edb0 2024-09-21T07:31:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.405+0000 7fa519800640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 0x7fa4f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.405+0000 7fa519800640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 0x7fa4f4075710 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5080af000 tx=0x7fa50801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:46.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.409+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa50001f030 con 0x7fa51415edb0 2024-09-21T07:31:46.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.617+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa51409b9e0 con 0x7fa51415edb0 2024-09-21T07:31:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.617+0000 7fa511600640 1 -- 172.21.15.64:0/2744560387 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7fa50000d040 con 0x7fa51415edb0 2024-09-21T07:31:46.620 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:46.620 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:31:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:31:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 msgr2=0x7fa4f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 0x7fa4f4075710 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5080af000 tx=0x7fa50801b120 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 msgr2=0x7fa51414dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa50000b440 tx=0x7fa50000b900 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 shutdown_connections 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa4f4073200 0x7fa4f4075710 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa514164a70 0x7fa514164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51415edb0 0x7fa51414dec0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 --2- 172.21.15.64:0/2744560387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5140709b0 0x7fa51409b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 >> 172.21.15.64:0/2744560387 conn(0x7fa5140ccbe0 msgr2=0x7fa51415e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 shutdown_connections 2024-09-21T07:31:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.621+0000 7fa51c200640 1 -- 172.21.15.64:0/2744560387 wait complete. 2024-09-21T07:31:46.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:31:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 -- 172.21.15.64:0/1945890520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 msgr2=0x7f0eb40052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 --2- 172.21.15.64:0/1945890520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0eb40052a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009e90 tx=0x7f0ec401d5d0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed1e00640 1 -- 172.21.15.64:0/1945890520 reap_dead start 2024-09-21T07:31:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 -- 172.21.15.64:0/1945890520 shutdown_connections 2024-09-21T07:31:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 -- 172.21.15.64:0/1945890520 >> 172.21.15.64:0/1945890520 conn(0x7f0ecc0b2be0 msgr2=0x7f0ecc0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:46.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 -- 172.21.15.64:0/1945890520 shutdown_connections 2024-09-21T07:31:46.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.801+0000 7f0ed2800640 1 -- 172.21.15.64:0/1945890520 wait complete. 2024-09-21T07:31:46.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 Processor -- start 2024-09-21T07:31:46.805 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- start start 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ecc0c8b20 0x7f0ecc14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ecc0c6f00 0x7f0ecc0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc072140 con 0x7f0eb4004e10 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc071fc0 con 0x7f0ecc0c6f00 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc0722c0 con 0x7f0ecc0c8b20 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47570/0 (socket says 172.21.15.64:47570) 2024-09-21T07:31:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 -- 172.21.15.64:0/3396019786 learned_addr learned my addr 172.21.15.64:0/3396019786 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed0a00640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ecc0c8b20 0x7f0ecc14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1e00640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ecc0c6f00 0x7f0ecc0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 -- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ecc0c8b20 msgr2=0x7f0ecc14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ecc0c8b20 0x7f0ecc14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 -- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ecc0c6f00 msgr2=0x7f0ecc0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ecc0c6f00 0x7f0ecc0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 -- 172.21.15.64:0/3396019786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc0c7850 con 0x7f0eb4004e10 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed1400640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006330 tx=0x7f0ec00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0015070 con 0x7f0eb4004e10 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ec0011840 con 0x7f0eb4004e10 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011c90 con 0x7f0eb4004e10 2024-09-21T07:31:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc0c8240 con 0x7f0eb4004e10 2024-09-21T07:31:46.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.805+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc0c8800 con 0x7f0eb4004e10 2024-09-21T07:31:46.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc0cc340 con 0x7f0eb4004e10 2024-09-21T07:31:46.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0ec0018070 con 0x7f0eb4004e10 2024-09-21T07:31:46.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ec9600640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 0x7f0eac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:46.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f0ec0094e40 con 0x7f0eb4004e10 2024-09-21T07:31:46.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ed0a00640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 0x7f0eac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:46.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.809+0000 7f0ed0a00640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 0x7f0eac075710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000c10 tx=0x7f0eb800ac20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:46.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.813+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0ecc0c7850 con 0x7f0eb4004e10 2024-09-21T07:31:46.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ecc06d550 con 0x7f0eb4004e10 2024-09-21T07:31:46.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ec9600640 1 -- 172.21.15.64:0/3396019786 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16912 (secure 0 0 0) 0x7f0ec005f710 con 0x7f0eb4004e10 2024-09-21T07:31:46.995 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:46.995 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":142,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:44.192168+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:31:40.351070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-21T07:31:41.571750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 msgr2=0x7f0eac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 0x7f0eac075710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000c10 tx=0x7f0eb800ac20 comp rx=0 tx=0).stop 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 msgr2=0x7f0ecc15a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006330 tx=0x7f0ec00039d0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 shutdown_connections 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0eac073200 0x7f0eac075710 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ecc0c6f00 0x7f0ecc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ecc0c8b20 0x7f0ecc14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 --2- 172.21.15.64:0/3396019786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0eb4004e10 0x7f0ecc15a9f0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:46.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 >> 172.21.15.64:0/3396019786 conn(0x7f0ecc0b2be0 msgr2=0x7f0ecc0b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:46.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 shutdown_connections 2024-09-21T07:31:46.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:46.993+0000 7f0ed2800640 1 -- 172.21.15.64:0/3396019786 wait complete. 2024-09-21T07:31:47.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:31:47.020 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:31:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- 172.21.15.64:0/2475109116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 msgr2=0x7f17d815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 --2- 172.21.15.64:0/2475109116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d815edc0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f17d806b090 tx=0x7f17d001cd80 comp rx=0 tx=0).stop 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- 172.21.15.64:0/2475109116 shutdown_connections 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 --2- 172.21.15.64:0/2475109116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d815edc0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 --2- 172.21.15.64:0/2475109116 >> v2:172.21.15.90:3300/0 conn(0x7f17d80cacf0 0x7f17d80cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 --2- 172.21.15.64:0/2475109116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80b24e0 0x7f17d80ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- 172.21.15.64:0/2475109116 >> 172.21.15.64:0/2475109116 conn(0x7f17d80ccbe0 msgr2=0x7f17d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- 172.21.15.64:0/2475109116 shutdown_connections 2024-09-21T07:31:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- 172.21.15.64:0/2475109116 wait complete. 2024-09-21T07:31:47.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 Processor -- start 2024-09-21T07:31:47.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.177+0000 7f17dd200640 1 -- start start 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17d80b24e0 0x7f17d8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80cacf0 0x7f17d8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f17d8167ed0 con 0x7f17d815e9b0 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17d8167d50 con 0x7f17d80b24e0 2024-09-21T07:31:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f17d8168050 con 0x7f17d80cacf0 2024-09-21T07:31:47.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47586/0 (socket says 172.21.15.64:47586) 2024-09-21T07:31:47.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 -- 172.21.15.64:0/1709886413 learned_addr learned my addr 172.21.15.64:0/1709886413 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:47.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d5e00640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17d80b24e0 0x7f17d8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17cd400640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80cacf0 0x7f17d8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 -- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80cacf0 msgr2=0x7f17d8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80cacf0 0x7f17d8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 -- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17d80b24e0 msgr2=0x7f17d8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17d80b24e0 0x7f17d8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 -- 172.21.15.64:0/1709886413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d809bf80 con 0x7f17d815e9b0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17d6800640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009bd0 tx=0x7f17d0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d00bc070 con 0x7f17d815e9b0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17d00042f0 con 0x7f17d815e9b0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d809c260 con 0x7f17d815e9b0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d00b2040 con 0x7f17d815e9b0 2024-09-21T07:31:47.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d809c820 con 0x7f17d815e9b0 2024-09-21T07:31:47.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.181+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d80cb100 con 0x7f17d815e9b0 2024-09-21T07:31:47.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.185+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f17d00bf070 con 0x7f17d815e9b0 2024-09-21T07:31:47.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.185+0000 7f17cea00640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 0x7f17b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.185+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f17d012e110 con 0x7f17d815e9b0 2024-09-21T07:31:47.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.185+0000 7f17d5e00640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 0x7f17b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.185+0000 7f17d5e00640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 0x7f17b4075740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005950 tx=0x7f17c8005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:47.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.189+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f17d0016970 con 0x7f17d815e9b0 2024-09-21T07:31:47.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.365+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17d815e620 con 0x7f17b4073230 2024-09-21T07:31:47.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.373+0000 7f17cea00640 1 -- 172.21.15.64:0/1709886413 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244246 (secure 0 0 0) 0x7f17d815e620 con 0x7f17b4073230 2024-09-21T07:31:47.376 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:47.377 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.373+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 msgr2=0x7f17b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.373+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 0x7f17b4075740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005950 tx=0x7f17c8005f90 comp rx=0 tx=0).stop 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.373+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 msgr2=0x7f17d80c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.373+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009bd0 tx=0x7f17d0005b10 comp rx=0 tx=0).stop 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 shutdown_connections 2024-09-21T07:31:47.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f17b4073230 0x7f17b4075740 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17d815e9b0 0x7f17d80c4b90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17d80cacf0 0x7f17d8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 --2- 172.21.15.64:0/1709886413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17d80b24e0 0x7f17d8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 >> 172.21.15.64:0/1709886413 conn(0x7f17d80ccbe0 msgr2=0x7f17d80af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 shutdown_connections 2024-09-21T07:31:47.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.377+0000 7f17dd200640 1 -- 172.21.15.64:0/1709886413 wait complete. 2024-09-21T07:31:47.398 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-09-21T07:31:45.568652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":382216,"kb_used_data":14652,"kb_used_omap":12,"kb_used_meta":367347,"kb_avail":754592504,"statfs":{"total":773094113280,"available":772702724096,"internally_reserved":0,"allocated":15003648,"data_stored":7668185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":376163891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.396983"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187737+0000","last_change":"2024-09-21T07:31:42.187737+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187737+0000","last_undegraded":"2024-09-21T07:31:42.187737+0000","last_fullsized":"2024-09-21T07:31:42.187737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193271+0000","last_change":"2024-09-21T07:31:42.193271+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193271+0000","last_undegraded":"2024-09-21T07:31:42.193271+0000","last_fullsized":"2024-09-21T07:31:42.193271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192796+0000","last_change":"2024-09-21T07:31:42.192796+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192796+0000","last_undegraded":"2024-09-21T07:31:42.192796+0000","last_fullsized":"2024-09-21T07:31:42.192796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189386+0000","last_change":"2024-09-21T07:31:42.189386+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189386+0000","last_undegraded":"2024-09-21T07:31:42.189386+0000","last_fullsized":"2024-09-21T07:31:42.189386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186772+0000","last_change":"2024-09-21T07:31:42.186772+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186772+0000","last_undegraded":"2024-09-21T07:31:42.186772+0000","last_fullsized":"2024-09-21T07:31:42.186772+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181235+0000","last_change":"2024-09-21T07:31:42.181235+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181235+0000","last_undegraded":"2024-09-21T07:31:42.181235+0000","last_fullsized":"2024-09-21T07:31:42.181235+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192895+0000","last_change":"2024-09-21T07:31:42.192895+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192895+0000","last_undegraded":"2024-09-21T07:31:42.192895+0000","last_fullsized":"2024-09-21T07:31:42.192895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189153+0000","last_change":"2024-09-21T07:31:42.189153+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189153+0000","last_undegraded":"2024-09-21T07:31:42.189153+0000","last_fullsized":"2024-09-21T07:31:42.189153+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188683+0000","last_change":"2024-09-21T07:31:42.188683+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188683+0000","last_undegraded":"2024-09-21T07:31:42.188683+0000","last_fullsized":"2024-09-21T07:31:42.188683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185450+0000","last_change":"2024-09-21T07:31:42.185450+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185450+0000","last_undegraded":"2024-09-21T07:31:42.185450+0000","last_fullsized":"2024-09-21T07:31:42.185450+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193908+0000","last_change":"2024-09-21T07:31:42.193908+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193908+0000","last_undegraded":"2024-09-21T07:31:42.193908+0000","last_fullsized":"2024-09-21T07:31:42.193908+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184913+0000","last_change":"2024-09-21T07:31:42.184913+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184913+0000","last_undegraded":"2024-09-21T07:31:42.184913+0000","last_fullsized":"2024-09-21T07:31:42.184913+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185323+0000","last_change":"2024-09-21T07:31:42.185323+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185323+0000","last_undegraded":"2024-09-21T07:31:42.185323+0000","last_fullsized":"2024-09-21T07:31:42.185323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186142+0000","last_change":"2024-09-21T07:31:42.186142+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186142+0000","last_undegraded":"2024-09-21T07:31:42.186142+0000","last_fullsized":"2024-09-21T07:31:42.186142+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192385+0000","last_change":"2024-09-21T07:31:42.192385+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192385+0000","last_undegraded":"2024-09-21T07:31:42.192385+0000","last_fullsized":"2024-09-21T07:31:42.192385+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189304+0000","last_change":"2024-09-21T07:31:42.189304+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189304+0000","last_undegraded":"2024-09-21T07:31:42.189304+0000","last_fullsized":"2024-09-21T07:31:42.189304+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185412+0000","last_change":"2024-09-21T07:31:42.185412+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185412+0000","last_undegraded":"2024-09-21T07:31:42.185412+0000","last_fullsized":"2024-09-21T07:31:42.185412+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190790+0000","last_change":"2024-09-21T07:31:42.190790+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190790+0000","last_undegraded":"2024-09-21T07:31:42.190790+0000","last_fullsized":"2024-09-21T07:31:42.190790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185588+0000","last_change":"2024-09-21T07:31:42.185588+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185588+0000","last_undegraded":"2024-09-21T07:31:42.185588+0000","last_fullsized":"2024-09-21T07:31:42.185588+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190184+0000","last_change":"2024-09-21T07:31:42.190184+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190184+0000","last_undegraded":"2024-09-21T07:31:42.190184+0000","last_fullsized":"2024-09-21T07:31:42.190184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185780+0000","last_change":"2024-09-21T07:31:42.185780+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185780+0000","last_undegraded":"2024-09-21T07:31:42.185780+0000","last_fullsized":"2024-09-21T07:31:42.185780+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187675+0000","last_change":"2024-09-21T07:31:42.187675+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187675+0000","last_undegraded":"2024-09-21T07:31:42.187675+0000","last_fullsized":"2024-09-21T07:31:42.187675+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184259+0000","last_change":"2024-09-21T07:31:42.184259+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184259+0000","last_undegraded":"2024-09-21T07:31:42.184259+0000","last_fullsized":"2024-09-21T07:31:42.184259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190103+0000","last_change":"2024-09-21T07:31:42.190103+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190103+0000","last_undegraded":"2024-09-21T07:31:42.190103+0000","last_fullsized":"2024-09-21T07:31:42.190103+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181805+0000","last_change":"2024-09-21T07:31:42.181805+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181805+0000","last_undegraded":"2024-09-21T07:31:42.181805+0000","last_fullsized":"2024-09-21T07:31:42.181805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186241+0000","last_change":"2024-09-21T07:31:42.186241+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186241+0000","last_undegraded":"2024-09-21T07:31:42.186241+0000","last_fullsized":"2024-09-21T07:31:42.186241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.180567+0000","last_change":"2024-09-21T07:31:42.180567+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.180567+0000","last_undegraded":"2024-09-21T07:31:42.180567+0000","last_fullsized":"2024-09-21T07:31:42.180567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204162+0000","last_change":"2024-09-21T07:31:42.200172+0000","last_active":"2024-09-21T07:31:42.204162+0000","last_peered":"2024-09-21T07:31:42.204162+0000","last_clean":"2024-09-21T07:31:42.204162+0000","last_became_active":"2024-09-21T07:31:42.196709+0000","last_became_peered":"2024-09-21T07:31:42.196709+0000","last_unstale":"2024-09-21T07:31:42.204162+0000","last_undegraded":"2024-09-21T07:31:42.204162+0000","last_fullsized":"2024-09-21T07:31:42.204162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:38.781035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184755+0000","last_change":"2024-09-21T07:31:42.184755+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184755+0000","last_undegraded":"2024-09-21T07:31:42.184755+0000","last_fullsized":"2024-09-21T07:31:42.184755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189542+0000","last_change":"2024-09-21T07:31:42.189542+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189542+0000","last_undegraded":"2024-09-21T07:31:42.189542+0000","last_fullsized":"2024-09-21T07:31:42.189542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185705+0000","last_change":"2024-09-21T07:31:42.185705+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185705+0000","last_undegraded":"2024-09-21T07:31:42.185705+0000","last_fullsized":"2024-09-21T07:31:42.185705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181695+0000","last_change":"2024-09-21T07:31:42.181695+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181695+0000","last_undegraded":"2024-09-21T07:31:42.181695+0000","last_fullsized":"2024-09-21T07:31:42.181695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.205505+0000","last_change":"2024-09-21T07:31:42.204257+0000","last_active":"2024-09-21T07:31:42.205505+0000","last_peered":"2024-09-21T07:31:42.205505+0000","last_clean":"2024-09-21T07:31:42.205505+0000","last_became_active":"2024-09-21T07:31:42.201713+0000","last_became_peered":"2024-09-21T07:31:42.201713+0000","last_unstale":"2024-09-21T07:31:42.205505+0000","last_undegraded":"2024-09-21T07:31:42.205505+0000","last_fullsized":"2024-09-21T07:31:42.205505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:32.747547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181351+0000","last_change":"2024-09-21T07:31:42.181351+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181351+0000","last_undegraded":"2024-09-21T07:31:42.181351+0000","last_fullsized":"2024-09-21T07:31:42.181351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203574+0000","last_change":"2024-09-21T07:31:42.200226+0000","last_active":"2024-09-21T07:31:42.203574+0000","last_peered":"2024-09-21T07:31:42.203574+0000","last_clean":"2024-09-21T07:31:42.203574+0000","last_became_active":"2024-09-21T07:31:42.199918+0000","last_became_peered":"2024-09-21T07:31:42.199918+0000","last_unstale":"2024-09-21T07:31:42.203574+0000","last_undegraded":"2024-09-21T07:31:42.203574+0000","last_fullsized":"2024-09-21T07:31:42.203574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.762517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.199985+0000","last_change":"2024-09-21T07:31:42.195562+0000","last_active":"2024-09-21T07:31:42.199985+0000","last_peered":"2024-09-21T07:31:42.199985+0000","last_clean":"2024-09-21T07:31:42.199985+0000","last_became_active":"2024-09-21T07:31:42.194585+0000","last_became_peered":"2024-09-21T07:31:42.194585+0000","last_unstale":"2024-09-21T07:31:42.199985+0000","last_undegraded":"2024-09-21T07:31:42.199985+0000","last_fullsized":"2024-09-21T07:31:42.199985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:58.654276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188019+0000","last_change":"2024-09-21T07:31:42.188019+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188019+0000","last_undegraded":"2024-09-21T07:31:42.188019+0000","last_fullsized":"2024-09-21T07:31:42.188019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207328+0000","last_change":"2024-09-21T07:31:42.199145+0000","last_active":"2024-09-21T07:31:42.207328+0000","last_peered":"2024-09-21T07:31:42.207328+0000","last_clean":"2024-09-21T07:31:42.207328+0000","last_became_active":"2024-09-21T07:31:42.198831+0000","last_became_peered":"2024-09-21T07:31:42.198831+0000","last_unstale":"2024-09-21T07:31:42.207328+0000","last_undegraded":"2024-09-21T07:31:42.207328+0000","last_fullsized":"2024-09-21T07:31:42.207328+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.032044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190740+0000","last_change":"2024-09-21T07:31:42.190740+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190740+0000","last_undegraded":"2024-09-21T07:31:42.190740+0000","last_fullsized":"2024-09-21T07:31:42.190740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204035+0000","last_change":"2024-09-21T07:31:42.201351+0000","last_active":"2024-09-21T07:31:42.204035+0000","last_peered":"2024-09-21T07:31:42.204035+0000","last_clean":"2024-09-21T07:31:42.204035+0000","last_became_active":"2024-09-21T07:31:42.200685+0000","last_became_peered":"2024-09-21T07:31:42.200685+0000","last_unstale":"2024-09-21T07:31:42.204035+0000","last_undegraded":"2024-09-21T07:31:42.204035+0000","last_fullsized":"2024-09-21T07:31:42.204035+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:59.706593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.182930+0000","last_change":"2024-09-21T07:31:42.182930+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.182930+0000","last_undegraded":"2024-09-21T07:31:42.182930+0000","last_fullsized":"2024-09-21T07:31:42.182930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183734+0000","last_change":"2024-09-21T07:31:42.183734+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183734+0000","last_undegraded":"2024-09-21T07:31:42.183734+0000","last_fullsized":"2024-09-21T07:31:42.183734+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187156+0000","last_change":"2024-09-21T07:31:42.187156+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187156+0000","last_undegraded":"2024-09-21T07:31:42.187156+0000","last_fullsized":"2024-09-21T07:31:42.187156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203940+0000","last_change":"2024-09-21T07:31:42.201759+0000","last_active":"2024-09-21T07:31:42.203940+0000","last_peered":"2024-09-21T07:31:42.203940+0000","last_clean":"2024-09-21T07:31:42.203940+0000","last_became_active":"2024-09-21T07:31:42.201481+0000","last_became_peered":"2024-09-21T07:31:42.201481+0000","last_unstale":"2024-09-21T07:31:42.203940+0000","last_undegraded":"2024-09-21T07:31:42.203940+0000","last_fullsized":"2024-09-21T07:31:42.203940+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:12.953100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.202591+0000","last_change":"2024-09-21T07:31:42.197621+0000","last_active":"2024-09-21T07:31:42.202591+0000","last_peered":"2024-09-21T07:31:42.202591+0000","last_clean":"2024-09-21T07:31:42.202591+0000","last_became_active":"2024-09-21T07:31:42.197293+0000","last_became_peered":"2024-09-21T07:31:42.197293+0000","last_unstale":"2024-09-21T07:31:42.202591+0000","last_undegraded":"2024-09-21T07:31:42.202591+0000","last_fullsized":"2024-09-21T07:31:42.202591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:51.032018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207453+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:42.207453+0000","last_peered":"2024-09-21T07:31:42.207453+0000","last_clean":"2024-09-21T07:31:42.207453+0000","last_became_active":"2024-09-21T07:31:42.205957+0000","last_became_peered":"2024-09-21T07:31:42.205957+0000","last_unstale":"2024-09-21T07:31:42.207453+0000","last_undegraded":"2024-09-21T07:31:42.207453+0000","last_fullsized":"2024-09-21T07:31:42.207453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:07.468690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183802+0000","last_change":"2024-09-21T07:31:42.183802+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183802+0000","last_undegraded":"2024-09-21T07:31:42.183802+0000","last_fullsized":"2024-09-21T07:31:42.183802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.208144+0000","last_change":"2024-09-21T07:31:42.206979+0000","last_active":"2024-09-21T07:31:42.208144+0000","last_peered":"2024-09-21T07:31:42.208144+0000","last_clean":"2024-09-21T07:31:42.208144+0000","last_became_active":"2024-09-21T07:31:42.205033+0000","last_became_peered":"2024-09-21T07:31:42.205033+0000","last_unstale":"2024-09-21T07:31:42.208144+0000","last_undegraded":"2024-09-21T07:31:42.208144+0000","last_fullsized":"2024-09-21T07:31:42.208144+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:44.523590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201127+0000","last_change":"2024-09-21T07:31:42.197122+0000","last_active":"2024-09-21T07:31:42.201127+0000","last_peered":"2024-09-21T07:31:42.201127+0000","last_clean":"2024-09-21T07:31:42.201127+0000","last_became_active":"2024-09-21T07:31:42.196623+0000","last_became_peered":"2024-09-21T07:31:42.196623+0000","last_unstale":"2024-09-21T07:31:42.201127+0000","last_undegraded":"2024-09-21T07:31:42.201127+0000","last_fullsized":"2024-09-21T07:31:42.201127+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.200588+0000","last_change":"2024-09-21T07:31:42.198827+0000","last_active":"2024-09-21T07:31:42.200588+0000","last_peered":"2024-09-21T07:31:42.200588+0000","last_clean":"2024-09-21T07:31:42.200588+0000","last_became_active":"2024-09-21T07:31:42.198504+0000","last_became_peered":"2024-09-21T07:31:42.198504+0000","last_unstale":"2024-09-21T07:31:42.200588+0000","last_undegraded":"2024-09-21T07:31:42.200588+0000","last_fullsized":"2024-09-21T07:31:42.200588+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:28.634850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188792+0000","last_change":"2024-09-21T07:31:42.188792+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188792+0000","last_undegraded":"2024-09-21T07:31:42.188792+0000","last_fullsized":"2024-09-21T07:31:42.188792+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204847+0000","last_change":"2024-09-21T07:31:42.200966+0000","last_active":"2024-09-21T07:31:42.204847+0000","last_peered":"2024-09-21T07:31:42.204847+0000","last_clean":"2024-09-21T07:31:42.204847+0000","last_became_active":"2024-09-21T07:31:42.200644+0000","last_became_peered":"2024-09-21T07:31:42.200644+0000","last_unstale":"2024-09-21T07:31:42.204847+0000","last_undegraded":"2024-09-21T07:31:42.204847+0000","last_fullsized":"2024-09-21T07:31:42.204847+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188476+0000","last_change":"2024-09-21T07:31:42.188476+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188476+0000","last_undegraded":"2024-09-21T07:31:42.188476+0000","last_fullsized":"2024-09-21T07:31:42.188476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201186+0000","last_change":"2024-09-21T07:31:42.198900+0000","last_active":"2024-09-21T07:31:42.201186+0000","last_peered":"2024-09-21T07:31:42.201186+0000","last_clean":"2024-09-21T07:31:42.201186+0000","last_became_active":"2024-09-21T07:31:42.198609+0000","last_became_peered":"2024-09-21T07:31:42.198609+0000","last_unstale":"2024-09-21T07:31:42.201186+0000","last_undegraded":"2024-09-21T07:31:42.201186+0000","last_fullsized":"2024-09-21T07:31:42.201186+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:16.198758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190804+0000","last_change":"2024-09-21T07:31:42.190804+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190804+0000","last_undegraded":"2024-09-21T07:31:42.190804+0000","last_fullsized":"2024-09-21T07:31:42.190804+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204594+0000","last_change":"2024-09-21T07:31:42.203033+0000","last_active":"2024-09-21T07:31:42.204594+0000","last_peered":"2024-09-21T07:31:42.204594+0000","last_clean":"2024-09-21T07:31:42.204594+0000","last_became_active":"2024-09-21T07:31:42.201986+0000","last_became_peered":"2024-09-21T07:31:42.201986+0000","last_unstale":"2024-09-21T07:31:42.204594+0000","last_undegraded":"2024-09-21T07:31:42.204594+0000","last_fullsized":"2024-09-21T07:31:42.204594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:37.207801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203906+0000","last_change":"2024-09-21T07:31:42.201119+0000","last_active":"2024-09-21T07:31:42.203906+0000","last_peered":"2024-09-21T07:31:42.203906+0000","last_clean":"2024-09-21T07:31:42.203906+0000","last_became_active":"2024-09-21T07:31:42.200597+0000","last_became_peered":"2024-09-21T07:31:42.200597+0000","last_unstale":"2024-09-21T07:31:42.203906+0000","last_undegraded":"2024-09-21T07:31:42.203906+0000","last_fullsized":"2024-09-21T07:31:42.203906+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:25.014890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183339+0000","last_change":"2024-09-21T07:31:42.183339+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183339+0000","last_undegraded":"2024-09-21T07:31:42.183339+0000","last_fullsized":"2024-09-21T07:31:42.183339+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204843+0000","last_change":"2024-09-21T07:31:42.201192+0000","last_active":"2024-09-21T07:31:42.204843+0000","last_peered":"2024-09-21T07:31:42.204843+0000","last_clean":"2024-09-21T07:31:42.204843+0000","last_became_active":"2024-09-21T07:31:42.200812+0000","last_became_peered":"2024-09-21T07:31:42.200812+0000","last_unstale":"2024-09-21T07:31:42.204843+0000","last_undegraded":"2024-09-21T07:31:42.204843+0000","last_fullsized":"2024-09-21T07:31:42.204843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:17.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.194969+0000","last_change":"2024-09-21T07:31:42.191103+0000","last_active":"2024-09-21T07:31:42.194969+0000","last_peered":"2024-09-21T07:31:42.194969+0000","last_clean":"2024-09-21T07:31:42.194969+0000","last_became_active":"2024-09-21T07:31:42.190771+0000","last_became_peered":"2024-09-21T07:31:42.190771+0000","last_unstale":"2024-09-21T07:31:42.194969+0000","last_undegraded":"2024-09-21T07:31:42.194969+0000","last_fullsized":"2024-09-21T07:31:42.194969+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:46.454272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188325+0000","last_change":"2024-09-21T07:31:42.188325+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188325+0000","last_undegraded":"2024-09-21T07:31:42.188325+0000","last_fullsized":"2024-09-21T07:31:42.188325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204675+0000","last_change":"2024-09-21T07:31:42.203052+0000","last_active":"2024-09-21T07:31:42.204675+0000","last_peered":"2024-09-21T07:31:42.204675+0000","last_clean":"2024-09-21T07:31:42.204675+0000","last_became_active":"2024-09-21T07:31:42.202728+0000","last_became_peered":"2024-09-21T07:31:42.202728+0000","last_unstale":"2024-09-21T07:31:42.204675+0000","last_undegraded":"2024-09-21T07:31:42.204675+0000","last_fullsized":"2024-09-21T07:31:42.204675+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:42.407838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187165+0000","last_change":"2024-09-21T07:31:42.187165+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187165+0000","last_undegraded":"2024-09-21T07:31:42.187165+0000","last_fullsized":"2024-09-21T07:31:42.187165+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.206393+0000","last_change":"2024-09-21T07:31:42.203098+0000","last_active":"2024-09-21T07:31:42.206393+0000","last_peered":"2024-09-21T07:31:42.206393+0000","last_clean":"2024-09-21T07:31:42.206393+0000","last_became_active":"2024-09-21T07:31:42.202765+0000","last_became_peered":"2024-09-21T07:31:42.202765+0000","last_unstale":"2024-09-21T07:31:42.206393+0000","last_undegraded":"2024-09-21T07:31:42.206393+0000","last_fullsized":"2024-09-21T07:31:42.206393+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:10.570724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189548+0000","last_change":"2024-09-21T07:31:42.189548+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189548+0000","last_undegraded":"2024-09-21T07:31:42.189548+0000","last_fullsized":"2024-09-21T07:31:42.189548+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192010+0000","last_change":"2024-09-21T07:31:42.192010+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192010+0000","last_undegraded":"2024-09-21T07:31:42.192010+0000","last_fullsized":"2024-09-21T07:31:42.192010+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207395+0000","last_change":"2024-09-21T07:31:42.205335+0000","last_active":"2024-09-21T07:31:42.207395+0000","last_peered":"2024-09-21T07:31:42.207395+0000","last_clean":"2024-09-21T07:31:42.207395+0000","last_became_active":"2024-09-21T07:31:42.204950+0000","last_became_peered":"2024-09-21T07:31:42.204950+0000","last_unstale":"2024-09-21T07:31:42.207395+0000","last_undegraded":"2024-09-21T07:31:42.207395+0000","last_fullsized":"2024-09-21T07:31:42.207395+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:42.167651+0000","last_change":"2024-09-21T07:31:42.167651+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.167651+0000","last_undegraded":"2024-09-21T07:31:42.167651+0000","last_fullsized":"2024-09-21T07:31:42.167651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190263+0000","last_change":"2024-09-21T07:31:42.190263+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190263+0000","last_undegraded":"2024-09-21T07:31:42.190263+0000","last_fullsized":"2024-09-21T07:31:42.190263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:31:41.164720+0000","last_change":"2024-09-21T07:31:41.164720+0000","last_active":"2024-09-21T07:31:41.164720+0000","last_peered":"2024-09-21T07:31:41.164720+0000","last_clean":"2024-09-21T07:31:41.164720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:41.164720+0000","last_undegraded":"2024-09-21T07:31:41.164720+0000","last_fullsized":"2024-09-21T07:31:41.164720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":321,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-21T07:31:39.246320+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:31:39.246320+0000","last_peered":"2024-09-21T07:31:39.246320+0000","last_clean":"2024-09-21T07:31:39.246320+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:31:39.246320+0000","last_undegraded":"2024-09-21T07:31:39.246320+0000","last_fullsized":"2024-09-21T07:31:39.246320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46776,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325064,"statfs":{"total":96636764160,"available":96588865536,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1740800,"data_stored":818310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50924,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2322432,"data_stored":1402019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542257,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1395810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50924,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1716224,"data_stored":805442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:31:47.402 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:31:47.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 -- 172.21.15.64:0/2808999966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00709b0 msgr2=0x7f3ce00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/2808999966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00709b0 0x7f3ce00b41c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009900 tx=0x7f3cc801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 -- 172.21.15.64:0/2808999966 shutdown_connections 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/2808999966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00709b0 0x7f3ce00b41c0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/2808999966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 -- 172.21.15.64:0/2808999966 >> 172.21.15.64:0/2808999966 conn(0x7f3ce00ccbe0 msgr2=0x7f3ce00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 -- 172.21.15.64:0/2808999966 shutdown_connections 2024-09-21T07:31:47.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.597+0000 7f3ce4c00640 1 -- 172.21.15.64:0/2808999966 wait complete. 2024-09-21T07:31:47.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 Processor -- start 2024-09-21T07:31:47.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 -- start start 2024-09-21T07:31:47.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 0x7f3ce014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0169020 con 0x7f3ce00b4700 2024-09-21T07:31:47.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0168ea0 con 0x7f3ce00709b0 2024-09-21T07:31:47.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce01691a0 con 0x7f3ce015edb0 2024-09-21T07:31:47.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47596/0 (socket says 172.21.15.64:47596) 2024-09-21T07:31:47.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 -- 172.21.15.64:0/93649272 learned_addr learned my addr 172.21.15.64:0/93649272 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cdde00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 0x7f3ce014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cde800640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 -- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 msgr2=0x7f3ce00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 -- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 msgr2=0x7f3ce014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 0x7f3ce014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 -- 172.21.15.64:0/93649272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01f8d00 con 0x7f3ce00b4700 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cdde00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 0x7f3ce014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cde800640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd7e00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009850 tx=0x7f3cc8005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80bc070 con 0x7f3ce00b4700 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cc8004330 con 0x7f3ce00b4700 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80b2040 con 0x7f3ce00b4700 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.601+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce014a9b0 con 0x7f3ce00b4700 2024-09-21T07:31:47.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce00c5fb0 con 0x7f3ce00b4700 2024-09-21T07:31:47.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce00b41c0 con 0x7f3ce00b4700 2024-09-21T07:31:47.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3cc8005280 con 0x7f3ce00b4700 2024-09-21T07:31:47.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3cd6000640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 0x7f3cbc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:47.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f3cc812e3e0 con 0x7f3ce00b4700 2024-09-21T07:31:47.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.605+0000 7f3cdde00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 0x7f3cbc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:47.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.609+0000 7f3cdde00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 0x7f3cbc075740 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009ac0 tx=0x7f3cd00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:47.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.609+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3cc80164d0 con 0x7f3ce00b4700 2024-09-21T07:31:47.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.785+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ce0051000 con 0x7f3cbc073230 2024-09-21T07:31:47.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.789+0000 7f3cd6000640 1 -- 172.21.15.64:0/93649272 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248555 (secure 0 0 0) 0x7f3ce0051000 con 0x7f3cbc073230 2024-09-21T07:31:47.794 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:47.795 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 msgr2=0x7f3cbc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 0x7f3cbc075740 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009ac0 tx=0x7f3cd00091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 msgr2=0x7f3ce00cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009850 tx=0x7f3cc8005e00 comp rx=0 tx=0).stop 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 shutdown_connections 2024-09-21T07:31:47.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3cbc073230 0x7f3cbc075740 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce015edb0 0x7f3ce00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce00b4700 0x7f3ce00cb210 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 --2- 172.21.15.64:0/93649272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ce00709b0 0x7f3ce014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 >> 172.21.15.64:0/93649272 conn(0x7f3ce00ccbe0 msgr2=0x7f3ce015df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 shutdown_connections 2024-09-21T07:31:47.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:47.793+0000 7f3ce4c00640 1 -- 172.21.15.64:0/93649272 wait complete. 2024-09-21T07:31:47.816 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-21T07:31:47.569239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":382352,"kb_used_data":14780,"kb_used_omap":12,"kb_used_meta":367347,"kb_avail":754592368,"statfs":{"total":773094113280,"available":772702584832,"internally_reserved":0,"allocated":15134720,"data_stored":7725023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":376163891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001460"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187737+0000","last_change":"2024-09-21T07:31:42.187737+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187737+0000","last_undegraded":"2024-09-21T07:31:42.187737+0000","last_fullsized":"2024-09-21T07:31:42.187737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193271+0000","last_change":"2024-09-21T07:31:42.193271+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193271+0000","last_undegraded":"2024-09-21T07:31:42.193271+0000","last_fullsized":"2024-09-21T07:31:42.193271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192796+0000","last_change":"2024-09-21T07:31:42.192796+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192796+0000","last_undegraded":"2024-09-21T07:31:42.192796+0000","last_fullsized":"2024-09-21T07:31:42.192796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189386+0000","last_change":"2024-09-21T07:31:42.189386+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189386+0000","last_undegraded":"2024-09-21T07:31:42.189386+0000","last_fullsized":"2024-09-21T07:31:42.189386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201175+0000","last_change":"2024-09-21T07:31:43.200761+0000","last_active":"2024-09-21T07:31:44.201175+0000","last_peered":"2024-09-21T07:31:44.201175+0000","last_clean":"2024-09-21T07:31:44.201175+0000","last_became_active":"2024-09-21T07:31:43.200461+0000","last_became_peered":"2024-09-21T07:31:43.200461+0000","last_unstale":"2024-09-21T07:31:44.201175+0000","last_undegraded":"2024-09-21T07:31:44.201175+0000","last_fullsized":"2024-09-21T07:31:44.201175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:09.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186772+0000","last_change":"2024-09-21T07:31:42.186772+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186772+0000","last_undegraded":"2024-09-21T07:31:42.186772+0000","last_fullsized":"2024-09-21T07:31:42.186772+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.202958+0000","last_change":"2024-09-21T07:31:43.209415+0000","last_active":"2024-09-21T07:31:44.202958+0000","last_peered":"2024-09-21T07:31:44.202958+0000","last_clean":"2024-09-21T07:31:44.202958+0000","last_became_active":"2024-09-21T07:31:43.209019+0000","last_became_peered":"2024-09-21T07:31:43.209019+0000","last_unstale":"2024-09-21T07:31:44.202958+0000","last_undegraded":"2024-09-21T07:31:44.202958+0000","last_fullsized":"2024-09-21T07:31:44.202958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:04.949348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181235+0000","last_change":"2024-09-21T07:31:42.181235+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181235+0000","last_undegraded":"2024-09-21T07:31:42.181235+0000","last_fullsized":"2024-09-21T07:31:42.181235+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192895+0000","last_change":"2024-09-21T07:31:42.192895+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192895+0000","last_undegraded":"2024-09-21T07:31:42.192895+0000","last_fullsized":"2024-09-21T07:31:42.192895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189153+0000","last_change":"2024-09-21T07:31:42.189153+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189153+0000","last_undegraded":"2024-09-21T07:31:42.189153+0000","last_fullsized":"2024-09-21T07:31:42.189153+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188683+0000","last_change":"2024-09-21T07:31:42.188683+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188683+0000","last_undegraded":"2024-09-21T07:31:42.188683+0000","last_fullsized":"2024-09-21T07:31:42.188683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185450+0000","last_change":"2024-09-21T07:31:42.185450+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185450+0000","last_undegraded":"2024-09-21T07:31:42.185450+0000","last_fullsized":"2024-09-21T07:31:42.185450+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193908+0000","last_change":"2024-09-21T07:31:42.193908+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193908+0000","last_undegraded":"2024-09-21T07:31:42.193908+0000","last_fullsized":"2024-09-21T07:31:42.193908+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184913+0000","last_change":"2024-09-21T07:31:42.184913+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184913+0000","last_undegraded":"2024-09-21T07:31:42.184913+0000","last_fullsized":"2024-09-21T07:31:42.184913+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185323+0000","last_change":"2024-09-21T07:31:42.185323+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185323+0000","last_undegraded":"2024-09-21T07:31:42.185323+0000","last_fullsized":"2024-09-21T07:31:42.185323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186142+0000","last_change":"2024-09-21T07:31:42.186142+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186142+0000","last_undegraded":"2024-09-21T07:31:42.186142+0000","last_fullsized":"2024-09-21T07:31:42.186142+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192385+0000","last_change":"2024-09-21T07:31:42.192385+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192385+0000","last_undegraded":"2024-09-21T07:31:42.192385+0000","last_fullsized":"2024-09-21T07:31:42.192385+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201512+0000","last_change":"2024-09-21T07:31:43.202618+0000","last_active":"2024-09-21T07:31:44.201512+0000","last_peered":"2024-09-21T07:31:44.201512+0000","last_clean":"2024-09-21T07:31:44.201512+0000","last_became_active":"2024-09-21T07:31:43.202314+0000","last_became_peered":"2024-09-21T07:31:43.202314+0000","last_unstale":"2024-09-21T07:31:44.201512+0000","last_undegraded":"2024-09-21T07:31:44.201512+0000","last_fullsized":"2024-09-21T07:31:44.201512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:10.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204673+0000","last_change":"2024-09-21T07:31:43.207404+0000","last_active":"2024-09-21T07:31:44.204673+0000","last_peered":"2024-09-21T07:31:44.204673+0000","last_clean":"2024-09-21T07:31:44.204673+0000","last_became_active":"2024-09-21T07:31:43.204954+0000","last_became_peered":"2024-09-21T07:31:43.204954+0000","last_unstale":"2024-09-21T07:31:44.204673+0000","last_undegraded":"2024-09-21T07:31:44.204673+0000","last_fullsized":"2024-09-21T07:31:44.204673+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201328+0000","last_change":"2024-09-21T07:31:43.202155+0000","last_active":"2024-09-21T07:31:44.201328+0000","last_peered":"2024-09-21T07:31:44.201328+0000","last_clean":"2024-09-21T07:31:44.201328+0000","last_became_active":"2024-09-21T07:31:43.197776+0000","last_became_peered":"2024-09-21T07:31:43.197776+0000","last_unstale":"2024-09-21T07:31:44.201328+0000","last_undegraded":"2024-09-21T07:31:44.201328+0000","last_fullsized":"2024-09-21T07:31:44.201328+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:17.327164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189304+0000","last_change":"2024-09-21T07:31:42.189304+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189304+0000","last_undegraded":"2024-09-21T07:31:42.189304+0000","last_fullsized":"2024-09-21T07:31:42.189304+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185412+0000","last_change":"2024-09-21T07:31:42.185412+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185412+0000","last_undegraded":"2024-09-21T07:31:42.185412+0000","last_fullsized":"2024-09-21T07:31:42.185412+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190790+0000","last_change":"2024-09-21T07:31:42.190790+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190790+0000","last_undegraded":"2024-09-21T07:31:42.190790+0000","last_fullsized":"2024-09-21T07:31:42.190790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185588+0000","last_change":"2024-09-21T07:31:42.185588+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185588+0000","last_undegraded":"2024-09-21T07:31:42.185588+0000","last_fullsized":"2024-09-21T07:31:42.185588+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190184+0000","last_change":"2024-09-21T07:31:42.190184+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190184+0000","last_undegraded":"2024-09-21T07:31:42.190184+0000","last_fullsized":"2024-09-21T07:31:42.190184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185780+0000","last_change":"2024-09-21T07:31:42.185780+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185780+0000","last_undegraded":"2024-09-21T07:31:42.185780+0000","last_fullsized":"2024-09-21T07:31:42.185780+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204102+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.204102+0000","last_peered":"2024-09-21T07:31:44.204102+0000","last_clean":"2024-09-21T07:31:44.204102+0000","last_became_active":"2024-09-21T07:31:43.198205+0000","last_became_peered":"2024-09-21T07:31:43.198205+0000","last_unstale":"2024-09-21T07:31:44.204102+0000","last_undegraded":"2024-09-21T07:31:44.204102+0000","last_fullsized":"2024-09-21T07:31:44.204102+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:19.294694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187675+0000","last_change":"2024-09-21T07:31:42.187675+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187675+0000","last_undegraded":"2024-09-21T07:31:42.187675+0000","last_fullsized":"2024-09-21T07:31:42.187675+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184259+0000","last_change":"2024-09-21T07:31:42.184259+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184259+0000","last_undegraded":"2024-09-21T07:31:42.184259+0000","last_fullsized":"2024-09-21T07:31:42.184259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190103+0000","last_change":"2024-09-21T07:31:42.190103+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190103+0000","last_undegraded":"2024-09-21T07:31:42.190103+0000","last_fullsized":"2024-09-21T07:31:42.190103+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181805+0000","last_change":"2024-09-21T07:31:42.181805+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181805+0000","last_undegraded":"2024-09-21T07:31:42.181805+0000","last_fullsized":"2024-09-21T07:31:42.181805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186241+0000","last_change":"2024-09-21T07:31:42.186241+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186241+0000","last_undegraded":"2024-09-21T07:31:42.186241+0000","last_fullsized":"2024-09-21T07:31:42.186241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.180567+0000","last_change":"2024-09-21T07:31:42.180567+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.180567+0000","last_undegraded":"2024-09-21T07:31:42.180567+0000","last_fullsized":"2024-09-21T07:31:42.180567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204162+0000","last_change":"2024-09-21T07:31:42.200172+0000","last_active":"2024-09-21T07:31:42.204162+0000","last_peered":"2024-09-21T07:31:42.204162+0000","last_clean":"2024-09-21T07:31:42.204162+0000","last_became_active":"2024-09-21T07:31:42.196709+0000","last_became_peered":"2024-09-21T07:31:42.196709+0000","last_unstale":"2024-09-21T07:31:42.204162+0000","last_undegraded":"2024-09-21T07:31:42.204162+0000","last_fullsized":"2024-09-21T07:31:42.204162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:38.781035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184755+0000","last_change":"2024-09-21T07:31:42.184755+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184755+0000","last_undegraded":"2024-09-21T07:31:42.184755+0000","last_fullsized":"2024-09-21T07:31:42.184755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201866+0000","last_change":"2024-09-21T07:31:42.201555+0000","last_active":"2024-09-21T07:31:44.201866+0000","last_peered":"2024-09-21T07:31:44.201866+0000","last_clean":"2024-09-21T07:31:44.201866+0000","last_became_active":"2024-09-21T07:31:42.201250+0000","last_became_peered":"2024-09-21T07:31:42.201250+0000","last_unstale":"2024-09-21T07:31:44.201866+0000","last_undegraded":"2024-09-21T07:31:44.201866+0000","last_fullsized":"2024-09-21T07:31:44.201866+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:29.864925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189542+0000","last_change":"2024-09-21T07:31:42.189542+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189542+0000","last_undegraded":"2024-09-21T07:31:42.189542+0000","last_fullsized":"2024-09-21T07:31:42.189542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204259+0000","last_change":"2024-09-21T07:31:42.204438+0000","last_active":"2024-09-21T07:31:44.204259+0000","last_peered":"2024-09-21T07:31:44.204259+0000","last_clean":"2024-09-21T07:31:44.204259+0000","last_became_active":"2024-09-21T07:31:42.204073+0000","last_became_peered":"2024-09-21T07:31:42.204073+0000","last_unstale":"2024-09-21T07:31:44.204259+0000","last_undegraded":"2024-09-21T07:31:44.204259+0000","last_fullsized":"2024-09-21T07:31:44.204259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185705+0000","last_change":"2024-09-21T07:31:42.185705+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185705+0000","last_undegraded":"2024-09-21T07:31:42.185705+0000","last_fullsized":"2024-09-21T07:31:42.185705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203566+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:44.203566+0000","last_peered":"2024-09-21T07:31:44.203566+0000","last_clean":"2024-09-21T07:31:44.203566+0000","last_became_active":"2024-09-21T07:31:42.205885+0000","last_became_peered":"2024-09-21T07:31:42.205885+0000","last_unstale":"2024-09-21T07:31:44.203566+0000","last_undegraded":"2024-09-21T07:31:44.203566+0000","last_fullsized":"2024-09-21T07:31:44.203566+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.055545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181695+0000","last_change":"2024-09-21T07:31:42.181695+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181695+0000","last_undegraded":"2024-09-21T07:31:42.181695+0000","last_fullsized":"2024-09-21T07:31:42.181695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.205505+0000","last_change":"2024-09-21T07:31:42.204257+0000","last_active":"2024-09-21T07:31:42.205505+0000","last_peered":"2024-09-21T07:31:42.205505+0000","last_clean":"2024-09-21T07:31:42.205505+0000","last_became_active":"2024-09-21T07:31:42.201713+0000","last_became_peered":"2024-09-21T07:31:42.201713+0000","last_unstale":"2024-09-21T07:31:42.205505+0000","last_undegraded":"2024-09-21T07:31:42.205505+0000","last_fullsized":"2024-09-21T07:31:42.205505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:32.747547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181351+0000","last_change":"2024-09-21T07:31:42.181351+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181351+0000","last_undegraded":"2024-09-21T07:31:42.181351+0000","last_fullsized":"2024-09-21T07:31:42.181351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200914+0000","last_change":"2024-09-21T07:31:42.193287+0000","last_active":"2024-09-21T07:31:44.200914+0000","last_peered":"2024-09-21T07:31:44.200914+0000","last_clean":"2024-09-21T07:31:44.200914+0000","last_became_active":"2024-09-21T07:31:42.191431+0000","last_became_peered":"2024-09-21T07:31:42.191431+0000","last_unstale":"2024-09-21T07:31:44.200914+0000","last_undegraded":"2024-09-21T07:31:44.200914+0000","last_fullsized":"2024-09-21T07:31:44.200914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:39.061656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201764+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.201764+0000","last_peered":"2024-09-21T07:31:44.201764+0000","last_clean":"2024-09-21T07:31:44.201764+0000","last_became_active":"2024-09-21T07:31:43.198244+0000","last_became_peered":"2024-09-21T07:31:43.198244+0000","last_unstale":"2024-09-21T07:31:44.201764+0000","last_undegraded":"2024-09-21T07:31:44.201764+0000","last_fullsized":"2024-09-21T07:31:44.201764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:17.104799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203574+0000","last_change":"2024-09-21T07:31:42.200226+0000","last_active":"2024-09-21T07:31:42.203574+0000","last_peered":"2024-09-21T07:31:42.203574+0000","last_clean":"2024-09-21T07:31:42.203574+0000","last_became_active":"2024-09-21T07:31:42.199918+0000","last_became_peered":"2024-09-21T07:31:42.199918+0000","last_unstale":"2024-09-21T07:31:42.203574+0000","last_undegraded":"2024-09-21T07:31:42.203574+0000","last_fullsized":"2024-09-21T07:31:42.203574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.762517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204212+0000","last_change":"2024-09-21T07:31:43.204756+0000","last_active":"2024-09-21T07:31:44.204212+0000","last_peered":"2024-09-21T07:31:44.204212+0000","last_clean":"2024-09-21T07:31:44.204212+0000","last_became_active":"2024-09-21T07:31:43.204410+0000","last_became_peered":"2024-09-21T07:31:43.204410+0000","last_unstale":"2024-09-21T07:31:44.204212+0000","last_undegraded":"2024-09-21T07:31:44.204212+0000","last_fullsized":"2024-09-21T07:31:44.204212+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.450486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.199985+0000","last_change":"2024-09-21T07:31:42.195562+0000","last_active":"2024-09-21T07:31:42.199985+0000","last_peered":"2024-09-21T07:31:42.199985+0000","last_clean":"2024-09-21T07:31:42.199985+0000","last_became_active":"2024-09-21T07:31:42.194585+0000","last_became_peered":"2024-09-21T07:31:42.194585+0000","last_unstale":"2024-09-21T07:31:42.199985+0000","last_undegraded":"2024-09-21T07:31:42.199985+0000","last_fullsized":"2024-09-21T07:31:42.199985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:58.654276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188019+0000","last_change":"2024-09-21T07:31:42.188019+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188019+0000","last_undegraded":"2024-09-21T07:31:42.188019+0000","last_fullsized":"2024-09-21T07:31:42.188019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207328+0000","last_change":"2024-09-21T07:31:42.199145+0000","last_active":"2024-09-21T07:31:42.207328+0000","last_peered":"2024-09-21T07:31:42.207328+0000","last_clean":"2024-09-21T07:31:42.207328+0000","last_became_active":"2024-09-21T07:31:42.198831+0000","last_became_peered":"2024-09-21T07:31:42.198831+0000","last_unstale":"2024-09-21T07:31:42.207328+0000","last_undegraded":"2024-09-21T07:31:42.207328+0000","last_fullsized":"2024-09-21T07:31:42.207328+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.032044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190740+0000","last_change":"2024-09-21T07:31:42.190740+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190740+0000","last_undegraded":"2024-09-21T07:31:42.190740+0000","last_fullsized":"2024-09-21T07:31:42.190740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204035+0000","last_change":"2024-09-21T07:31:42.201351+0000","last_active":"2024-09-21T07:31:42.204035+0000","last_peered":"2024-09-21T07:31:42.204035+0000","last_clean":"2024-09-21T07:31:42.204035+0000","last_became_active":"2024-09-21T07:31:42.200685+0000","last_became_peered":"2024-09-21T07:31:42.200685+0000","last_unstale":"2024-09-21T07:31:42.204035+0000","last_undegraded":"2024-09-21T07:31:42.204035+0000","last_fullsized":"2024-09-21T07:31:42.204035+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:59.706593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.182930+0000","last_change":"2024-09-21T07:31:42.182930+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.182930+0000","last_undegraded":"2024-09-21T07:31:42.182930+0000","last_fullsized":"2024-09-21T07:31:42.182930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204430+0000","last_change":"2024-09-21T07:31:42.206037+0000","last_active":"2024-09-21T07:31:44.204430+0000","last_peered":"2024-09-21T07:31:44.204430+0000","last_clean":"2024-09-21T07:31:44.204430+0000","last_became_active":"2024-09-21T07:31:42.203832+0000","last_became_peered":"2024-09-21T07:31:42.203832+0000","last_unstale":"2024-09-21T07:31:44.204430+0000","last_undegraded":"2024-09-21T07:31:44.204430+0000","last_fullsized":"2024-09-21T07:31:44.204430+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:38.570431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183734+0000","last_change":"2024-09-21T07:31:42.183734+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183734+0000","last_undegraded":"2024-09-21T07:31:42.183734+0000","last_fullsized":"2024-09-21T07:31:42.183734+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'6","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203701+0000","last_change":"2024-09-21T07:31:42.205466+0000","last_active":"2024-09-21T07:31:44.203701+0000","last_peered":"2024-09-21T07:31:44.203701+0000","last_clean":"2024-09-21T07:31:44.203701+0000","last_became_active":"2024-09-21T07:31:42.205141+0000","last_became_peered":"2024-09-21T07:31:42.205141+0000","last_unstale":"2024-09-21T07:31:44.203701+0000","last_undegraded":"2024-09-21T07:31:44.203701+0000","last_fullsized":"2024-09-21T07:31:44.203701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:30.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187156+0000","last_change":"2024-09-21T07:31:42.187156+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187156+0000","last_undegraded":"2024-09-21T07:31:42.187156+0000","last_fullsized":"2024-09-21T07:31:42.187156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203940+0000","last_change":"2024-09-21T07:31:42.201759+0000","last_active":"2024-09-21T07:31:42.203940+0000","last_peered":"2024-09-21T07:31:42.203940+0000","last_clean":"2024-09-21T07:31:42.203940+0000","last_became_active":"2024-09-21T07:31:42.201481+0000","last_became_peered":"2024-09-21T07:31:42.201481+0000","last_unstale":"2024-09-21T07:31:42.203940+0000","last_undegraded":"2024-09-21T07:31:42.203940+0000","last_fullsized":"2024-09-21T07:31:42.203940+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:12.953100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204410+0000","last_change":"2024-09-21T07:31:43.200818+0000","last_active":"2024-09-21T07:31:44.204410+0000","last_peered":"2024-09-21T07:31:44.204410+0000","last_clean":"2024-09-21T07:31:44.204410+0000","last_became_active":"2024-09-21T07:31:43.197016+0000","last_became_peered":"2024-09-21T07:31:43.197016+0000","last_unstale":"2024-09-21T07:31:44.204410+0000","last_undegraded":"2024-09-21T07:31:44.204410+0000","last_fullsized":"2024-09-21T07:31:44.204410+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:07.329545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.202591+0000","last_change":"2024-09-21T07:31:42.197621+0000","last_active":"2024-09-21T07:31:42.202591+0000","last_peered":"2024-09-21T07:31:42.202591+0000","last_clean":"2024-09-21T07:31:42.202591+0000","last_became_active":"2024-09-21T07:31:42.197293+0000","last_became_peered":"2024-09-21T07:31:42.197293+0000","last_unstale":"2024-09-21T07:31:42.202591+0000","last_undegraded":"2024-09-21T07:31:42.202591+0000","last_fullsized":"2024-09-21T07:31:42.202591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:51.032018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201893+0000","last_change":"2024-09-21T07:31:43.203200+0000","last_active":"2024-09-21T07:31:44.201893+0000","last_peered":"2024-09-21T07:31:44.201893+0000","last_clean":"2024-09-21T07:31:44.201893+0000","last_became_active":"2024-09-21T07:31:43.202799+0000","last_became_peered":"2024-09-21T07:31:43.202799+0000","last_unstale":"2024-09-21T07:31:44.201893+0000","last_undegraded":"2024-09-21T07:31:44.201893+0000","last_fullsized":"2024-09-21T07:31:44.201893+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:54.217026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207453+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:42.207453+0000","last_peered":"2024-09-21T07:31:42.207453+0000","last_clean":"2024-09-21T07:31:42.207453+0000","last_became_active":"2024-09-21T07:31:42.205957+0000","last_became_peered":"2024-09-21T07:31:42.205957+0000","last_unstale":"2024-09-21T07:31:42.207453+0000","last_undegraded":"2024-09-21T07:31:42.207453+0000","last_fullsized":"2024-09-21T07:31:42.207453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:07.468690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183802+0000","last_change":"2024-09-21T07:31:42.183802+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183802+0000","last_undegraded":"2024-09-21T07:31:42.183802+0000","last_fullsized":"2024-09-21T07:31:42.183802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.208144+0000","last_change":"2024-09-21T07:31:42.206979+0000","last_active":"2024-09-21T07:31:42.208144+0000","last_peered":"2024-09-21T07:31:42.208144+0000","last_clean":"2024-09-21T07:31:42.208144+0000","last_became_active":"2024-09-21T07:31:42.205033+0000","last_became_peered":"2024-09-21T07:31:42.205033+0000","last_unstale":"2024-09-21T07:31:42.208144+0000","last_undegraded":"2024-09-21T07:31:42.208144+0000","last_fullsized":"2024-09-21T07:31:42.208144+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:44.523590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203201+0000","last_change":"2024-09-21T07:31:43.208386+0000","last_active":"2024-09-21T07:31:44.203201+0000","last_peered":"2024-09-21T07:31:44.203201+0000","last_clean":"2024-09-21T07:31:44.203201+0000","last_became_active":"2024-09-21T07:31:43.198413+0000","last_became_peered":"2024-09-21T07:31:43.198413+0000","last_unstale":"2024-09-21T07:31:44.203201+0000","last_undegraded":"2024-09-21T07:31:44.203201+0000","last_fullsized":"2024-09-21T07:31:44.203201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:36.237710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201127+0000","last_change":"2024-09-21T07:31:42.197122+0000","last_active":"2024-09-21T07:31:42.201127+0000","last_peered":"2024-09-21T07:31:42.201127+0000","last_clean":"2024-09-21T07:31:42.201127+0000","last_became_active":"2024-09-21T07:31:42.196623+0000","last_became_peered":"2024-09-21T07:31:42.196623+0000","last_unstale":"2024-09-21T07:31:42.201127+0000","last_undegraded":"2024-09-21T07:31:42.201127+0000","last_fullsized":"2024-09-21T07:31:42.201127+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203399+0000","last_change":"2024-09-21T07:31:43.199077+0000","last_active":"2024-09-21T07:31:44.203399+0000","last_peered":"2024-09-21T07:31:44.203399+0000","last_clean":"2024-09-21T07:31:44.203399+0000","last_became_active":"2024-09-21T07:31:43.197979+0000","last_became_peered":"2024-09-21T07:31:43.197979+0000","last_unstale":"2024-09-21T07:31:44.203399+0000","last_undegraded":"2024-09-21T07:31:44.203399+0000","last_fullsized":"2024-09-21T07:31:44.203399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.777821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.200588+0000","last_change":"2024-09-21T07:31:42.198827+0000","last_active":"2024-09-21T07:31:42.200588+0000","last_peered":"2024-09-21T07:31:42.200588+0000","last_clean":"2024-09-21T07:31:42.200588+0000","last_became_active":"2024-09-21T07:31:42.198504+0000","last_became_peered":"2024-09-21T07:31:42.198504+0000","last_unstale":"2024-09-21T07:31:42.200588+0000","last_undegraded":"2024-09-21T07:31:42.200588+0000","last_fullsized":"2024-09-21T07:31:42.200588+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:28.634850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188792+0000","last_change":"2024-09-21T07:31:42.188792+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188792+0000","last_undegraded":"2024-09-21T07:31:42.188792+0000","last_fullsized":"2024-09-21T07:31:42.188792+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201428+0000","last_change":"2024-09-21T07:31:42.193312+0000","last_active":"2024-09-21T07:31:44.201428+0000","last_peered":"2024-09-21T07:31:44.201428+0000","last_clean":"2024-09-21T07:31:44.201428+0000","last_became_active":"2024-09-21T07:31:42.193006+0000","last_became_peered":"2024-09-21T07:31:42.193006+0000","last_unstale":"2024-09-21T07:31:44.201428+0000","last_undegraded":"2024-09-21T07:31:44.201428+0000","last_fullsized":"2024-09-21T07:31:44.201428+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.543073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201332+0000","last_change":"2024-09-21T07:31:43.218832+0000","last_active":"2024-09-21T07:31:44.201332+0000","last_peered":"2024-09-21T07:31:44.201332+0000","last_clean":"2024-09-21T07:31:44.201332+0000","last_became_active":"2024-09-21T07:31:43.218460+0000","last_became_peered":"2024-09-21T07:31:43.218460+0000","last_unstale":"2024-09-21T07:31:44.201332+0000","last_undegraded":"2024-09-21T07:31:44.201332+0000","last_fullsized":"2024-09-21T07:31:44.201332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204847+0000","last_change":"2024-09-21T07:31:42.200966+0000","last_active":"2024-09-21T07:31:42.204847+0000","last_peered":"2024-09-21T07:31:42.204847+0000","last_clean":"2024-09-21T07:31:42.204847+0000","last_became_active":"2024-09-21T07:31:42.200644+0000","last_became_peered":"2024-09-21T07:31:42.200644+0000","last_unstale":"2024-09-21T07:31:42.204847+0000","last_undegraded":"2024-09-21T07:31:42.204847+0000","last_fullsized":"2024-09-21T07:31:42.204847+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188476+0000","last_change":"2024-09-21T07:31:42.188476+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188476+0000","last_undegraded":"2024-09-21T07:31:42.188476+0000","last_fullsized":"2024-09-21T07:31:42.188476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201186+0000","last_change":"2024-09-21T07:31:42.198900+0000","last_active":"2024-09-21T07:31:42.201186+0000","last_peered":"2024-09-21T07:31:42.201186+0000","last_clean":"2024-09-21T07:31:42.201186+0000","last_became_active":"2024-09-21T07:31:42.198609+0000","last_became_peered":"2024-09-21T07:31:42.198609+0000","last_unstale":"2024-09-21T07:31:42.201186+0000","last_undegraded":"2024-09-21T07:31:42.201186+0000","last_fullsized":"2024-09-21T07:31:42.201186+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:16.198758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201800+0000","last_change":"2024-09-21T07:31:43.223681+0000","last_active":"2024-09-21T07:31:44.201800+0000","last_peered":"2024-09-21T07:31:44.201800+0000","last_clean":"2024-09-21T07:31:44.201800+0000","last_became_active":"2024-09-21T07:31:43.223168+0000","last_became_peered":"2024-09-21T07:31:43.223168+0000","last_unstale":"2024-09-21T07:31:44.201800+0000","last_undegraded":"2024-09-21T07:31:44.201800+0000","last_fullsized":"2024-09-21T07:31:44.201800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.192072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203313+0000","last_change":"2024-09-21T07:31:42.202955+0000","last_active":"2024-09-21T07:31:44.203313+0000","last_peered":"2024-09-21T07:31:44.203313+0000","last_clean":"2024-09-21T07:31:44.203313+0000","last_became_active":"2024-09-21T07:31:42.202131+0000","last_became_peered":"2024-09-21T07:31:42.202131+0000","last_unstale":"2024-09-21T07:31:44.203313+0000","last_undegraded":"2024-09-21T07:31:44.203313+0000","last_fullsized":"2024-09-21T07:31:44.203313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:53.777898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190804+0000","last_change":"2024-09-21T07:31:42.190804+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190804+0000","last_undegraded":"2024-09-21T07:31:42.190804+0000","last_fullsized":"2024-09-21T07:31:42.190804+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204594+0000","last_change":"2024-09-21T07:31:42.203033+0000","last_active":"2024-09-21T07:31:42.204594+0000","last_peered":"2024-09-21T07:31:42.204594+0000","last_clean":"2024-09-21T07:31:42.204594+0000","last_became_active":"2024-09-21T07:31:42.201986+0000","last_became_peered":"2024-09-21T07:31:42.201986+0000","last_unstale":"2024-09-21T07:31:42.204594+0000","last_undegraded":"2024-09-21T07:31:42.204594+0000","last_fullsized":"2024-09-21T07:31:42.204594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:37.207801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201005+0000","last_change":"2024-09-21T07:31:43.198116+0000","last_active":"2024-09-21T07:31:44.201005+0000","last_peered":"2024-09-21T07:31:44.201005+0000","last_clean":"2024-09-21T07:31:44.201005+0000","last_became_active":"2024-09-21T07:31:43.197788+0000","last_became_peered":"2024-09-21T07:31:43.197788+0000","last_unstale":"2024-09-21T07:31:44.201005+0000","last_undegraded":"2024-09-21T07:31:44.201005+0000","last_fullsized":"2024-09-21T07:31:44.201005+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:43.668645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203906+0000","last_change":"2024-09-21T07:31:42.201119+0000","last_active":"2024-09-21T07:31:42.203906+0000","last_peered":"2024-09-21T07:31:42.203906+0000","last_clean":"2024-09-21T07:31:42.203906+0000","last_became_active":"2024-09-21T07:31:42.200597+0000","last_became_peered":"2024-09-21T07:31:42.200597+0000","last_unstale":"2024-09-21T07:31:42.203906+0000","last_undegraded":"2024-09-21T07:31:42.203906+0000","last_fullsized":"2024-09-21T07:31:42.203906+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:25.014890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183339+0000","last_change":"2024-09-21T07:31:42.183339+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183339+0000","last_undegraded":"2024-09-21T07:31:42.183339+0000","last_fullsized":"2024-09-21T07:31:42.183339+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204843+0000","last_change":"2024-09-21T07:31:42.201192+0000","last_active":"2024-09-21T07:31:42.204843+0000","last_peered":"2024-09-21T07:31:42.204843+0000","last_clean":"2024-09-21T07:31:42.204843+0000","last_became_active":"2024-09-21T07:31:42.200812+0000","last_became_peered":"2024-09-21T07:31:42.200812+0000","last_unstale":"2024-09-21T07:31:42.204843+0000","last_undegraded":"2024-09-21T07:31:42.204843+0000","last_fullsized":"2024-09-21T07:31:42.204843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:17.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203045+0000","last_change":"2024-09-21T07:31:43.211386+0000","last_active":"2024-09-21T07:31:44.203045+0000","last_peered":"2024-09-21T07:31:44.203045+0000","last_clean":"2024-09-21T07:31:44.203045+0000","last_became_active":"2024-09-21T07:31:43.210997+0000","last_became_peered":"2024-09-21T07:31:43.210997+0000","last_unstale":"2024-09-21T07:31:44.203045+0000","last_undegraded":"2024-09-21T07:31:44.203045+0000","last_fullsized":"2024-09-21T07:31:44.203045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:07.022916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.194969+0000","last_change":"2024-09-21T07:31:42.191103+0000","last_active":"2024-09-21T07:31:42.194969+0000","last_peered":"2024-09-21T07:31:42.194969+0000","last_clean":"2024-09-21T07:31:42.194969+0000","last_became_active":"2024-09-21T07:31:42.190771+0000","last_became_peered":"2024-09-21T07:31:42.190771+0000","last_unstale":"2024-09-21T07:31:42.194969+0000","last_undegraded":"2024-09-21T07:31:42.194969+0000","last_fullsized":"2024-09-21T07:31:42.194969+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:46.454272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188325+0000","last_change":"2024-09-21T07:31:42.188325+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188325+0000","last_undegraded":"2024-09-21T07:31:42.188325+0000","last_fullsized":"2024-09-21T07:31:42.188325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204675+0000","last_change":"2024-09-21T07:31:42.203052+0000","last_active":"2024-09-21T07:31:42.204675+0000","last_peered":"2024-09-21T07:31:42.204675+0000","last_clean":"2024-09-21T07:31:42.204675+0000","last_became_active":"2024-09-21T07:31:42.202728+0000","last_became_peered":"2024-09-21T07:31:42.202728+0000","last_unstale":"2024-09-21T07:31:42.204675+0000","last_undegraded":"2024-09-21T07:31:42.204675+0000","last_fullsized":"2024-09-21T07:31:42.204675+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:42.407838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187165+0000","last_change":"2024-09-21T07:31:42.187165+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187165+0000","last_undegraded":"2024-09-21T07:31:42.187165+0000","last_fullsized":"2024-09-21T07:31:42.187165+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.206393+0000","last_change":"2024-09-21T07:31:42.203098+0000","last_active":"2024-09-21T07:31:42.206393+0000","last_peered":"2024-09-21T07:31:42.206393+0000","last_clean":"2024-09-21T07:31:42.206393+0000","last_became_active":"2024-09-21T07:31:42.202765+0000","last_became_peered":"2024-09-21T07:31:42.202765+0000","last_unstale":"2024-09-21T07:31:42.206393+0000","last_undegraded":"2024-09-21T07:31:42.206393+0000","last_fullsized":"2024-09-21T07:31:42.206393+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:10.570724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189548+0000","last_change":"2024-09-21T07:31:42.189548+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189548+0000","last_undegraded":"2024-09-21T07:31:42.189548+0000","last_fullsized":"2024-09-21T07:31:42.189548+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203480+0000","last_change":"2024-09-21T07:31:42.202533+0000","last_active":"2024-09-21T07:31:44.203480+0000","last_peered":"2024-09-21T07:31:44.203480+0000","last_clean":"2024-09-21T07:31:44.203480+0000","last_became_active":"2024-09-21T07:31:42.202197+0000","last_became_peered":"2024-09-21T07:31:42.202197+0000","last_unstale":"2024-09-21T07:31:44.203480+0000","last_undegraded":"2024-09-21T07:31:44.203480+0000","last_fullsized":"2024-09-21T07:31:44.203480+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:37.553016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192010+0000","last_change":"2024-09-21T07:31:42.192010+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192010+0000","last_undegraded":"2024-09-21T07:31:42.192010+0000","last_fullsized":"2024-09-21T07:31:42.192010+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207395+0000","last_change":"2024-09-21T07:31:42.205335+0000","last_active":"2024-09-21T07:31:42.207395+0000","last_peered":"2024-09-21T07:31:42.207395+0000","last_clean":"2024-09-21T07:31:42.207395+0000","last_became_active":"2024-09-21T07:31:42.204950+0000","last_became_peered":"2024-09-21T07:31:42.204950+0000","last_unstale":"2024-09-21T07:31:42.207395+0000","last_undegraded":"2024-09-21T07:31:42.207395+0000","last_fullsized":"2024-09-21T07:31:42.207395+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204871+0000","last_change":"2024-09-21T07:31:43.222761+0000","last_active":"2024-09-21T07:31:44.204871+0000","last_peered":"2024-09-21T07:31:44.204871+0000","last_clean":"2024-09-21T07:31:44.204871+0000","last_became_active":"2024-09-21T07:31:43.222402+0000","last_became_peered":"2024-09-21T07:31:43.222402+0000","last_unstale":"2024-09-21T07:31:44.204871+0000","last_undegraded":"2024-09-21T07:31:44.204871+0000","last_fullsized":"2024-09-21T07:31:44.204871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:53.219206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200936+0000","last_change":"2024-09-21T07:31:42.191216+0000","last_active":"2024-09-21T07:31:44.200936+0000","last_peered":"2024-09-21T07:31:44.200936+0000","last_clean":"2024-09-21T07:31:44.200936+0000","last_became_active":"2024-09-21T07:31:42.188915+0000","last_became_peered":"2024-09-21T07:31:42.188915+0000","last_unstale":"2024-09-21T07:31:44.200936+0000","last_undegraded":"2024-09-21T07:31:44.200936+0000","last_fullsized":"2024-09-21T07:31:44.200936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:17.056742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190263+0000","last_change":"2024-09-21T07:31:42.190263+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190263+0000","last_undegraded":"2024-09-21T07:31:42.190263+0000","last_fullsized":"2024-09-21T07:31:42.190263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203188+0000","last_change":"2024-09-21T07:31:42.203466+0000","last_active":"2024-09-21T07:31:44.203188+0000","last_peered":"2024-09-21T07:31:44.203188+0000","last_clean":"2024-09-21T07:31:44.203188+0000","last_became_active":"2024-09-21T07:31:42.202670+0000","last_became_peered":"2024-09-21T07:31:42.202670+0000","last_unstale":"2024-09-21T07:31:44.203188+0000","last_undegraded":"2024-09-21T07:31:44.203188+0000","last_fullsized":"2024-09-21T07:31:44.203188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201989+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:31:44.201989+0000","last_peered":"2024-09-21T07:31:44.201989+0000","last_clean":"2024-09-21T07:31:44.201989+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:31:44.201989+0000","last_undegraded":"2024-09-21T07:31:44.201989+0000","last_fullsized":"2024-09-21T07:31:44.201989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46776,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325064,"statfs":{"total":96636764160,"available":96588865536,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1740800,"data_stored":818310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50924,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2322432,"data_stored":1402019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2375680,"data_stored":1424239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1781760,"data_stored":833851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:31:47.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- 172.21.15.64:0/1380604210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 msgr2=0x7f81000ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 --2- 172.21.15.64:0/1380604210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f81000ca7b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009900 tx=0x7f80f001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- 172.21.15.64:0/1380604210 shutdown_connections 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 --2- 172.21.15.64:0/1380604210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81000cacf0 0x7f81000cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 --2- 172.21.15.64:0/1380604210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f81000ca7b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- 172.21.15.64:0/1380604210 >> 172.21.15.64:0/1380604210 conn(0x7f81000ccbe0 msgr2=0x7f81000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:48.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- 172.21.15.64:0/1380604210 shutdown_connections 2024-09-21T07:31:48.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- 172.21.15.64:0/1380604210 wait complete. 2024-09-21T07:31:48.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 Processor -- start 2024-09-21T07:31:48.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.013+0000 7f8104a00640 1 -- start start 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81000cacf0 0x7f81001fc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810015e9b0 0x7f81001fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f81001683f0 con 0x7f81000b24e0 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8100168270 con 0x7f81000cacf0 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8100168570 con 0x7f810015e9b0 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47612/0 (socket says 172.21.15.64:47612) 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 -- 172.21.15.64:0/2882770904 learned_addr learned my addr 172.21.15.64:0/2882770904 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80f7e00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81000cacf0 0x7f81001fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fe800640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810015e9b0 0x7f81001fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 -- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810015e9b0 msgr2=0x7f81001fcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810015e9b0 0x7f81001fcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 -- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81000cacf0 msgr2=0x7f81001fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81000cacf0 0x7f81001fc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 -- 172.21.15.64:0/2882770904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001fd360 con 0x7f81000b24e0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80fde00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009850 tx=0x7f80f00a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00b2040 con 0x7f81000b24e0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f00043b0 con 0x7f81000b24e0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0005280 con 0x7f81000b24e0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810015d3c0 con 0x7f81000b24e0 2024-09-21T07:31:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810015d980 con 0x7f81000b24e0 2024-09-21T07:31:48.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.017+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81000ca7b0 con 0x7f81000b24e0 2024-09-21T07:31:48.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.021+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f80f0005420 con 0x7f81000b24e0 2024-09-21T07:31:48.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.021+0000 7f80f6000640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 0x7f80dc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.021+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f80f012db50 con 0x7f81000b24e0 2024-09-21T07:31:48.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.021+0000 7f80f7e00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 0x7f80dc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.021+0000 7f80f7e00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 0x7f80dc075740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81000c3b20 tx=0x7f80e8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.025+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f80f00164d0 con 0x7f81000b24e0 2024-09-21T07:31:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.197+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81000cd240 con 0x7f80dc073230 2024-09-21T07:31:48.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f80f6000640 1 -- 172.21.15.64:0/2882770904 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248555 (secure 0 0 0) 0x7f81000cd240 con 0x7f80dc073230 2024-09-21T07:31:48.207 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:48.208 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:31:48.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 msgr2=0x7f80dc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 0x7f80dc075740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81000c3b20 tx=0x7f80e8005860 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 msgr2=0x7f810015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009850 tx=0x7f80f00a5620 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 shutdown_connections 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f80dc073230 0x7f80dc075740 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f810015e9b0 0x7f81001fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81000cacf0 0x7f81001fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 --2- 172.21.15.64:0/2882770904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81000b24e0 0x7f810015bb60 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.205+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 >> 172.21.15.64:0/2882770904 conn(0x7f81000ccbe0 msgr2=0x7f810015a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.209+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 shutdown_connections 2024-09-21T07:31:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.209+0000 7f8104a00640 1 -- 172.21.15.64:0/2882770904 wait complete. 2024-09-21T07:31:48.230 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-21T07:31:47.569239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":382352,"kb_used_data":14780,"kb_used_omap":12,"kb_used_meta":367347,"kb_avail":754592368,"statfs":{"total":773094113280,"available":772702584832,"internally_reserved":0,"allocated":15134720,"data_stored":7725023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":376163891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001460"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187737+0000","last_change":"2024-09-21T07:31:42.187737+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187737+0000","last_undegraded":"2024-09-21T07:31:42.187737+0000","last_fullsized":"2024-09-21T07:31:42.187737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193271+0000","last_change":"2024-09-21T07:31:42.193271+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193271+0000","last_undegraded":"2024-09-21T07:31:42.193271+0000","last_fullsized":"2024-09-21T07:31:42.193271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192796+0000","last_change":"2024-09-21T07:31:42.192796+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192796+0000","last_undegraded":"2024-09-21T07:31:42.192796+0000","last_fullsized":"2024-09-21T07:31:42.192796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189386+0000","last_change":"2024-09-21T07:31:42.189386+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189386+0000","last_undegraded":"2024-09-21T07:31:42.189386+0000","last_fullsized":"2024-09-21T07:31:42.189386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201175+0000","last_change":"2024-09-21T07:31:43.200761+0000","last_active":"2024-09-21T07:31:44.201175+0000","last_peered":"2024-09-21T07:31:44.201175+0000","last_clean":"2024-09-21T07:31:44.201175+0000","last_became_active":"2024-09-21T07:31:43.200461+0000","last_became_peered":"2024-09-21T07:31:43.200461+0000","last_unstale":"2024-09-21T07:31:44.201175+0000","last_undegraded":"2024-09-21T07:31:44.201175+0000","last_fullsized":"2024-09-21T07:31:44.201175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:09.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186772+0000","last_change":"2024-09-21T07:31:42.186772+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186772+0000","last_undegraded":"2024-09-21T07:31:42.186772+0000","last_fullsized":"2024-09-21T07:31:42.186772+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.202958+0000","last_change":"2024-09-21T07:31:43.209415+0000","last_active":"2024-09-21T07:31:44.202958+0000","last_peered":"2024-09-21T07:31:44.202958+0000","last_clean":"2024-09-21T07:31:44.202958+0000","last_became_active":"2024-09-21T07:31:43.209019+0000","last_became_peered":"2024-09-21T07:31:43.209019+0000","last_unstale":"2024-09-21T07:31:44.202958+0000","last_undegraded":"2024-09-21T07:31:44.202958+0000","last_fullsized":"2024-09-21T07:31:44.202958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:04.949348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181235+0000","last_change":"2024-09-21T07:31:42.181235+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181235+0000","last_undegraded":"2024-09-21T07:31:42.181235+0000","last_fullsized":"2024-09-21T07:31:42.181235+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192895+0000","last_change":"2024-09-21T07:31:42.192895+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192895+0000","last_undegraded":"2024-09-21T07:31:42.192895+0000","last_fullsized":"2024-09-21T07:31:42.192895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189153+0000","last_change":"2024-09-21T07:31:42.189153+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189153+0000","last_undegraded":"2024-09-21T07:31:42.189153+0000","last_fullsized":"2024-09-21T07:31:42.189153+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188683+0000","last_change":"2024-09-21T07:31:42.188683+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188683+0000","last_undegraded":"2024-09-21T07:31:42.188683+0000","last_fullsized":"2024-09-21T07:31:42.188683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185450+0000","last_change":"2024-09-21T07:31:42.185450+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185450+0000","last_undegraded":"2024-09-21T07:31:42.185450+0000","last_fullsized":"2024-09-21T07:31:42.185450+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193908+0000","last_change":"2024-09-21T07:31:42.193908+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193908+0000","last_undegraded":"2024-09-21T07:31:42.193908+0000","last_fullsized":"2024-09-21T07:31:42.193908+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184913+0000","last_change":"2024-09-21T07:31:42.184913+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184913+0000","last_undegraded":"2024-09-21T07:31:42.184913+0000","last_fullsized":"2024-09-21T07:31:42.184913+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185323+0000","last_change":"2024-09-21T07:31:42.185323+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185323+0000","last_undegraded":"2024-09-21T07:31:42.185323+0000","last_fullsized":"2024-09-21T07:31:42.185323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186142+0000","last_change":"2024-09-21T07:31:42.186142+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186142+0000","last_undegraded":"2024-09-21T07:31:42.186142+0000","last_fullsized":"2024-09-21T07:31:42.186142+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192385+0000","last_change":"2024-09-21T07:31:42.192385+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192385+0000","last_undegraded":"2024-09-21T07:31:42.192385+0000","last_fullsized":"2024-09-21T07:31:42.192385+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201512+0000","last_change":"2024-09-21T07:31:43.202618+0000","last_active":"2024-09-21T07:31:44.201512+0000","last_peered":"2024-09-21T07:31:44.201512+0000","last_clean":"2024-09-21T07:31:44.201512+0000","last_became_active":"2024-09-21T07:31:43.202314+0000","last_became_peered":"2024-09-21T07:31:43.202314+0000","last_unstale":"2024-09-21T07:31:44.201512+0000","last_undegraded":"2024-09-21T07:31:44.201512+0000","last_fullsized":"2024-09-21T07:31:44.201512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:10.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204673+0000","last_change":"2024-09-21T07:31:43.207404+0000","last_active":"2024-09-21T07:31:44.204673+0000","last_peered":"2024-09-21T07:31:44.204673+0000","last_clean":"2024-09-21T07:31:44.204673+0000","last_became_active":"2024-09-21T07:31:43.204954+0000","last_became_peered":"2024-09-21T07:31:43.204954+0000","last_unstale":"2024-09-21T07:31:44.204673+0000","last_undegraded":"2024-09-21T07:31:44.204673+0000","last_fullsized":"2024-09-21T07:31:44.204673+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201328+0000","last_change":"2024-09-21T07:31:43.202155+0000","last_active":"2024-09-21T07:31:44.201328+0000","last_peered":"2024-09-21T07:31:44.201328+0000","last_clean":"2024-09-21T07:31:44.201328+0000","last_became_active":"2024-09-21T07:31:43.197776+0000","last_became_peered":"2024-09-21T07:31:43.197776+0000","last_unstale":"2024-09-21T07:31:44.201328+0000","last_undegraded":"2024-09-21T07:31:44.201328+0000","last_fullsized":"2024-09-21T07:31:44.201328+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:17.327164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189304+0000","last_change":"2024-09-21T07:31:42.189304+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189304+0000","last_undegraded":"2024-09-21T07:31:42.189304+0000","last_fullsized":"2024-09-21T07:31:42.189304+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185412+0000","last_change":"2024-09-21T07:31:42.185412+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185412+0000","last_undegraded":"2024-09-21T07:31:42.185412+0000","last_fullsized":"2024-09-21T07:31:42.185412+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190790+0000","last_change":"2024-09-21T07:31:42.190790+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190790+0000","last_undegraded":"2024-09-21T07:31:42.190790+0000","last_fullsized":"2024-09-21T07:31:42.190790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185588+0000","last_change":"2024-09-21T07:31:42.185588+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185588+0000","last_undegraded":"2024-09-21T07:31:42.185588+0000","last_fullsized":"2024-09-21T07:31:42.185588+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190184+0000","last_change":"2024-09-21T07:31:42.190184+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190184+0000","last_undegraded":"2024-09-21T07:31:42.190184+0000","last_fullsized":"2024-09-21T07:31:42.190184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185780+0000","last_change":"2024-09-21T07:31:42.185780+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185780+0000","last_undegraded":"2024-09-21T07:31:42.185780+0000","last_fullsized":"2024-09-21T07:31:42.185780+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204102+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.204102+0000","last_peered":"2024-09-21T07:31:44.204102+0000","last_clean":"2024-09-21T07:31:44.204102+0000","last_became_active":"2024-09-21T07:31:43.198205+0000","last_became_peered":"2024-09-21T07:31:43.198205+0000","last_unstale":"2024-09-21T07:31:44.204102+0000","last_undegraded":"2024-09-21T07:31:44.204102+0000","last_fullsized":"2024-09-21T07:31:44.204102+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:19.294694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187675+0000","last_change":"2024-09-21T07:31:42.187675+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187675+0000","last_undegraded":"2024-09-21T07:31:42.187675+0000","last_fullsized":"2024-09-21T07:31:42.187675+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184259+0000","last_change":"2024-09-21T07:31:42.184259+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184259+0000","last_undegraded":"2024-09-21T07:31:42.184259+0000","last_fullsized":"2024-09-21T07:31:42.184259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190103+0000","last_change":"2024-09-21T07:31:42.190103+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190103+0000","last_undegraded":"2024-09-21T07:31:42.190103+0000","last_fullsized":"2024-09-21T07:31:42.190103+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181805+0000","last_change":"2024-09-21T07:31:42.181805+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181805+0000","last_undegraded":"2024-09-21T07:31:42.181805+0000","last_fullsized":"2024-09-21T07:31:42.181805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186241+0000","last_change":"2024-09-21T07:31:42.186241+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186241+0000","last_undegraded":"2024-09-21T07:31:42.186241+0000","last_fullsized":"2024-09-21T07:31:42.186241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.180567+0000","last_change":"2024-09-21T07:31:42.180567+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.180567+0000","last_undegraded":"2024-09-21T07:31:42.180567+0000","last_fullsized":"2024-09-21T07:31:42.180567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204162+0000","last_change":"2024-09-21T07:31:42.200172+0000","last_active":"2024-09-21T07:31:42.204162+0000","last_peered":"2024-09-21T07:31:42.204162+0000","last_clean":"2024-09-21T07:31:42.204162+0000","last_became_active":"2024-09-21T07:31:42.196709+0000","last_became_peered":"2024-09-21T07:31:42.196709+0000","last_unstale":"2024-09-21T07:31:42.204162+0000","last_undegraded":"2024-09-21T07:31:42.204162+0000","last_fullsized":"2024-09-21T07:31:42.204162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:38.781035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184755+0000","last_change":"2024-09-21T07:31:42.184755+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184755+0000","last_undegraded":"2024-09-21T07:31:42.184755+0000","last_fullsized":"2024-09-21T07:31:42.184755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201866+0000","last_change":"2024-09-21T07:31:42.201555+0000","last_active":"2024-09-21T07:31:44.201866+0000","last_peered":"2024-09-21T07:31:44.201866+0000","last_clean":"2024-09-21T07:31:44.201866+0000","last_became_active":"2024-09-21T07:31:42.201250+0000","last_became_peered":"2024-09-21T07:31:42.201250+0000","last_unstale":"2024-09-21T07:31:44.201866+0000","last_undegraded":"2024-09-21T07:31:44.201866+0000","last_fullsized":"2024-09-21T07:31:44.201866+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:29.864925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189542+0000","last_change":"2024-09-21T07:31:42.189542+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189542+0000","last_undegraded":"2024-09-21T07:31:42.189542+0000","last_fullsized":"2024-09-21T07:31:42.189542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204259+0000","last_change":"2024-09-21T07:31:42.204438+0000","last_active":"2024-09-21T07:31:44.204259+0000","last_peered":"2024-09-21T07:31:44.204259+0000","last_clean":"2024-09-21T07:31:44.204259+0000","last_became_active":"2024-09-21T07:31:42.204073+0000","last_became_peered":"2024-09-21T07:31:42.204073+0000","last_unstale":"2024-09-21T07:31:44.204259+0000","last_undegraded":"2024-09-21T07:31:44.204259+0000","last_fullsized":"2024-09-21T07:31:44.204259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185705+0000","last_change":"2024-09-21T07:31:42.185705+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185705+0000","last_undegraded":"2024-09-21T07:31:42.185705+0000","last_fullsized":"2024-09-21T07:31:42.185705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203566+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:44.203566+0000","last_peered":"2024-09-21T07:31:44.203566+0000","last_clean":"2024-09-21T07:31:44.203566+0000","last_became_active":"2024-09-21T07:31:42.205885+0000","last_became_peered":"2024-09-21T07:31:42.205885+0000","last_unstale":"2024-09-21T07:31:44.203566+0000","last_undegraded":"2024-09-21T07:31:44.203566+0000","last_fullsized":"2024-09-21T07:31:44.203566+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.055545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181695+0000","last_change":"2024-09-21T07:31:42.181695+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181695+0000","last_undegraded":"2024-09-21T07:31:42.181695+0000","last_fullsized":"2024-09-21T07:31:42.181695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.205505+0000","last_change":"2024-09-21T07:31:42.204257+0000","last_active":"2024-09-21T07:31:42.205505+0000","last_peered":"2024-09-21T07:31:42.205505+0000","last_clean":"2024-09-21T07:31:42.205505+0000","last_became_active":"2024-09-21T07:31:42.201713+0000","last_became_peered":"2024-09-21T07:31:42.201713+0000","last_unstale":"2024-09-21T07:31:42.205505+0000","last_undegraded":"2024-09-21T07:31:42.205505+0000","last_fullsized":"2024-09-21T07:31:42.205505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:32.747547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181351+0000","last_change":"2024-09-21T07:31:42.181351+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181351+0000","last_undegraded":"2024-09-21T07:31:42.181351+0000","last_fullsized":"2024-09-21T07:31:42.181351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200914+0000","last_change":"2024-09-21T07:31:42.193287+0000","last_active":"2024-09-21T07:31:44.200914+0000","last_peered":"2024-09-21T07:31:44.200914+0000","last_clean":"2024-09-21T07:31:44.200914+0000","last_became_active":"2024-09-21T07:31:42.191431+0000","last_became_peered":"2024-09-21T07:31:42.191431+0000","last_unstale":"2024-09-21T07:31:44.200914+0000","last_undegraded":"2024-09-21T07:31:44.200914+0000","last_fullsized":"2024-09-21T07:31:44.200914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:39.061656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201764+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.201764+0000","last_peered":"2024-09-21T07:31:44.201764+0000","last_clean":"2024-09-21T07:31:44.201764+0000","last_became_active":"2024-09-21T07:31:43.198244+0000","last_became_peered":"2024-09-21T07:31:43.198244+0000","last_unstale":"2024-09-21T07:31:44.201764+0000","last_undegraded":"2024-09-21T07:31:44.201764+0000","last_fullsized":"2024-09-21T07:31:44.201764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:17.104799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203574+0000","last_change":"2024-09-21T07:31:42.200226+0000","last_active":"2024-09-21T07:31:42.203574+0000","last_peered":"2024-09-21T07:31:42.203574+0000","last_clean":"2024-09-21T07:31:42.203574+0000","last_became_active":"2024-09-21T07:31:42.199918+0000","last_became_peered":"2024-09-21T07:31:42.199918+0000","last_unstale":"2024-09-21T07:31:42.203574+0000","last_undegraded":"2024-09-21T07:31:42.203574+0000","last_fullsized":"2024-09-21T07:31:42.203574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.762517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204212+0000","last_change":"2024-09-21T07:31:43.204756+0000","last_active":"2024-09-21T07:31:44.204212+0000","last_peered":"2024-09-21T07:31:44.204212+0000","last_clean":"2024-09-21T07:31:44.204212+0000","last_became_active":"2024-09-21T07:31:43.204410+0000","last_became_peered":"2024-09-21T07:31:43.204410+0000","last_unstale":"2024-09-21T07:31:44.204212+0000","last_undegraded":"2024-09-21T07:31:44.204212+0000","last_fullsized":"2024-09-21T07:31:44.204212+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.450486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.199985+0000","last_change":"2024-09-21T07:31:42.195562+0000","last_active":"2024-09-21T07:31:42.199985+0000","last_peered":"2024-09-21T07:31:42.199985+0000","last_clean":"2024-09-21T07:31:42.199985+0000","last_became_active":"2024-09-21T07:31:42.194585+0000","last_became_peered":"2024-09-21T07:31:42.194585+0000","last_unstale":"2024-09-21T07:31:42.199985+0000","last_undegraded":"2024-09-21T07:31:42.199985+0000","last_fullsized":"2024-09-21T07:31:42.199985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:58.654276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188019+0000","last_change":"2024-09-21T07:31:42.188019+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188019+0000","last_undegraded":"2024-09-21T07:31:42.188019+0000","last_fullsized":"2024-09-21T07:31:42.188019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207328+0000","last_change":"2024-09-21T07:31:42.199145+0000","last_active":"2024-09-21T07:31:42.207328+0000","last_peered":"2024-09-21T07:31:42.207328+0000","last_clean":"2024-09-21T07:31:42.207328+0000","last_became_active":"2024-09-21T07:31:42.198831+0000","last_became_peered":"2024-09-21T07:31:42.198831+0000","last_unstale":"2024-09-21T07:31:42.207328+0000","last_undegraded":"2024-09-21T07:31:42.207328+0000","last_fullsized":"2024-09-21T07:31:42.207328+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.032044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190740+0000","last_change":"2024-09-21T07:31:42.190740+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190740+0000","last_undegraded":"2024-09-21T07:31:42.190740+0000","last_fullsized":"2024-09-21T07:31:42.190740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204035+0000","last_change":"2024-09-21T07:31:42.201351+0000","last_active":"2024-09-21T07:31:42.204035+0000","last_peered":"2024-09-21T07:31:42.204035+0000","last_clean":"2024-09-21T07:31:42.204035+0000","last_became_active":"2024-09-21T07:31:42.200685+0000","last_became_peered":"2024-09-21T07:31:42.200685+0000","last_unstale":"2024-09-21T07:31:42.204035+0000","last_undegraded":"2024-09-21T07:31:42.204035+0000","last_fullsized":"2024-09-21T07:31:42.204035+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:59.706593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.182930+0000","last_change":"2024-09-21T07:31:42.182930+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.182930+0000","last_undegraded":"2024-09-21T07:31:42.182930+0000","last_fullsized":"2024-09-21T07:31:42.182930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204430+0000","last_change":"2024-09-21T07:31:42.206037+0000","last_active":"2024-09-21T07:31:44.204430+0000","last_peered":"2024-09-21T07:31:44.204430+0000","last_clean":"2024-09-21T07:31:44.204430+0000","last_became_active":"2024-09-21T07:31:42.203832+0000","last_became_peered":"2024-09-21T07:31:42.203832+0000","last_unstale":"2024-09-21T07:31:44.204430+0000","last_undegraded":"2024-09-21T07:31:44.204430+0000","last_fullsized":"2024-09-21T07:31:44.204430+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:38.570431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183734+0000","last_change":"2024-09-21T07:31:42.183734+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183734+0000","last_undegraded":"2024-09-21T07:31:42.183734+0000","last_fullsized":"2024-09-21T07:31:42.183734+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'6","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203701+0000","last_change":"2024-09-21T07:31:42.205466+0000","last_active":"2024-09-21T07:31:44.203701+0000","last_peered":"2024-09-21T07:31:44.203701+0000","last_clean":"2024-09-21T07:31:44.203701+0000","last_became_active":"2024-09-21T07:31:42.205141+0000","last_became_peered":"2024-09-21T07:31:42.205141+0000","last_unstale":"2024-09-21T07:31:44.203701+0000","last_undegraded":"2024-09-21T07:31:44.203701+0000","last_fullsized":"2024-09-21T07:31:44.203701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:30.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187156+0000","last_change":"2024-09-21T07:31:42.187156+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187156+0000","last_undegraded":"2024-09-21T07:31:42.187156+0000","last_fullsized":"2024-09-21T07:31:42.187156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203940+0000","last_change":"2024-09-21T07:31:42.201759+0000","last_active":"2024-09-21T07:31:42.203940+0000","last_peered":"2024-09-21T07:31:42.203940+0000","last_clean":"2024-09-21T07:31:42.203940+0000","last_became_active":"2024-09-21T07:31:42.201481+0000","last_became_peered":"2024-09-21T07:31:42.201481+0000","last_unstale":"2024-09-21T07:31:42.203940+0000","last_undegraded":"2024-09-21T07:31:42.203940+0000","last_fullsized":"2024-09-21T07:31:42.203940+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:12.953100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204410+0000","last_change":"2024-09-21T07:31:43.200818+0000","last_active":"2024-09-21T07:31:44.204410+0000","last_peered":"2024-09-21T07:31:44.204410+0000","last_clean":"2024-09-21T07:31:44.204410+0000","last_became_active":"2024-09-21T07:31:43.197016+0000","last_became_peered":"2024-09-21T07:31:43.197016+0000","last_unstale":"2024-09-21T07:31:44.204410+0000","last_undegraded":"2024-09-21T07:31:44.204410+0000","last_fullsized":"2024-09-21T07:31:44.204410+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:07.329545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.202591+0000","last_change":"2024-09-21T07:31:42.197621+0000","last_active":"2024-09-21T07:31:42.202591+0000","last_peered":"2024-09-21T07:31:42.202591+0000","last_clean":"2024-09-21T07:31:42.202591+0000","last_became_active":"2024-09-21T07:31:42.197293+0000","last_became_peered":"2024-09-21T07:31:42.197293+0000","last_unstale":"2024-09-21T07:31:42.202591+0000","last_undegraded":"2024-09-21T07:31:42.202591+0000","last_fullsized":"2024-09-21T07:31:42.202591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:51.032018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201893+0000","last_change":"2024-09-21T07:31:43.203200+0000","last_active":"2024-09-21T07:31:44.201893+0000","last_peered":"2024-09-21T07:31:44.201893+0000","last_clean":"2024-09-21T07:31:44.201893+0000","last_became_active":"2024-09-21T07:31:43.202799+0000","last_became_peered":"2024-09-21T07:31:43.202799+0000","last_unstale":"2024-09-21T07:31:44.201893+0000","last_undegraded":"2024-09-21T07:31:44.201893+0000","last_fullsized":"2024-09-21T07:31:44.201893+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:54.217026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207453+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:42.207453+0000","last_peered":"2024-09-21T07:31:42.207453+0000","last_clean":"2024-09-21T07:31:42.207453+0000","last_became_active":"2024-09-21T07:31:42.205957+0000","last_became_peered":"2024-09-21T07:31:42.205957+0000","last_unstale":"2024-09-21T07:31:42.207453+0000","last_undegraded":"2024-09-21T07:31:42.207453+0000","last_fullsized":"2024-09-21T07:31:42.207453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:07.468690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183802+0000","last_change":"2024-09-21T07:31:42.183802+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183802+0000","last_undegraded":"2024-09-21T07:31:42.183802+0000","last_fullsized":"2024-09-21T07:31:42.183802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.208144+0000","last_change":"2024-09-21T07:31:42.206979+0000","last_active":"2024-09-21T07:31:42.208144+0000","last_peered":"2024-09-21T07:31:42.208144+0000","last_clean":"2024-09-21T07:31:42.208144+0000","last_became_active":"2024-09-21T07:31:42.205033+0000","last_became_peered":"2024-09-21T07:31:42.205033+0000","last_unstale":"2024-09-21T07:31:42.208144+0000","last_undegraded":"2024-09-21T07:31:42.208144+0000","last_fullsized":"2024-09-21T07:31:42.208144+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:44.523590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203201+0000","last_change":"2024-09-21T07:31:43.208386+0000","last_active":"2024-09-21T07:31:44.203201+0000","last_peered":"2024-09-21T07:31:44.203201+0000","last_clean":"2024-09-21T07:31:44.203201+0000","last_became_active":"2024-09-21T07:31:43.198413+0000","last_became_peered":"2024-09-21T07:31:43.198413+0000","last_unstale":"2024-09-21T07:31:44.203201+0000","last_undegraded":"2024-09-21T07:31:44.203201+0000","last_fullsized":"2024-09-21T07:31:44.203201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:36.237710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201127+0000","last_change":"2024-09-21T07:31:42.197122+0000","last_active":"2024-09-21T07:31:42.201127+0000","last_peered":"2024-09-21T07:31:42.201127+0000","last_clean":"2024-09-21T07:31:42.201127+0000","last_became_active":"2024-09-21T07:31:42.196623+0000","last_became_peered":"2024-09-21T07:31:42.196623+0000","last_unstale":"2024-09-21T07:31:42.201127+0000","last_undegraded":"2024-09-21T07:31:42.201127+0000","last_fullsized":"2024-09-21T07:31:42.201127+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203399+0000","last_change":"2024-09-21T07:31:43.199077+0000","last_active":"2024-09-21T07:31:44.203399+0000","last_peered":"2024-09-21T07:31:44.203399+0000","last_clean":"2024-09-21T07:31:44.203399+0000","last_became_active":"2024-09-21T07:31:43.197979+0000","last_became_peered":"2024-09-21T07:31:43.197979+0000","last_unstale":"2024-09-21T07:31:44.203399+0000","last_undegraded":"2024-09-21T07:31:44.203399+0000","last_fullsized":"2024-09-21T07:31:44.203399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.777821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.200588+0000","last_change":"2024-09-21T07:31:42.198827+0000","last_active":"2024-09-21T07:31:42.200588+0000","last_peered":"2024-09-21T07:31:42.200588+0000","last_clean":"2024-09-21T07:31:42.200588+0000","last_became_active":"2024-09-21T07:31:42.198504+0000","last_became_peered":"2024-09-21T07:31:42.198504+0000","last_unstale":"2024-09-21T07:31:42.200588+0000","last_undegraded":"2024-09-21T07:31:42.200588+0000","last_fullsized":"2024-09-21T07:31:42.200588+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:28.634850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188792+0000","last_change":"2024-09-21T07:31:42.188792+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188792+0000","last_undegraded":"2024-09-21T07:31:42.188792+0000","last_fullsized":"2024-09-21T07:31:42.188792+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201428+0000","last_change":"2024-09-21T07:31:42.193312+0000","last_active":"2024-09-21T07:31:44.201428+0000","last_peered":"2024-09-21T07:31:44.201428+0000","last_clean":"2024-09-21T07:31:44.201428+0000","last_became_active":"2024-09-21T07:31:42.193006+0000","last_became_peered":"2024-09-21T07:31:42.193006+0000","last_unstale":"2024-09-21T07:31:44.201428+0000","last_undegraded":"2024-09-21T07:31:44.201428+0000","last_fullsized":"2024-09-21T07:31:44.201428+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.543073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201332+0000","last_change":"2024-09-21T07:31:43.218832+0000","last_active":"2024-09-21T07:31:44.201332+0000","last_peered":"2024-09-21T07:31:44.201332+0000","last_clean":"2024-09-21T07:31:44.201332+0000","last_became_active":"2024-09-21T07:31:43.218460+0000","last_became_peered":"2024-09-21T07:31:43.218460+0000","last_unstale":"2024-09-21T07:31:44.201332+0000","last_undegraded":"2024-09-21T07:31:44.201332+0000","last_fullsized":"2024-09-21T07:31:44.201332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204847+0000","last_change":"2024-09-21T07:31:42.200966+0000","last_active":"2024-09-21T07:31:42.204847+0000","last_peered":"2024-09-21T07:31:42.204847+0000","last_clean":"2024-09-21T07:31:42.204847+0000","last_became_active":"2024-09-21T07:31:42.200644+0000","last_became_peered":"2024-09-21T07:31:42.200644+0000","last_unstale":"2024-09-21T07:31:42.204847+0000","last_undegraded":"2024-09-21T07:31:42.204847+0000","last_fullsized":"2024-09-21T07:31:42.204847+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188476+0000","last_change":"2024-09-21T07:31:42.188476+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188476+0000","last_undegraded":"2024-09-21T07:31:42.188476+0000","last_fullsized":"2024-09-21T07:31:42.188476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201186+0000","last_change":"2024-09-21T07:31:42.198900+0000","last_active":"2024-09-21T07:31:42.201186+0000","last_peered":"2024-09-21T07:31:42.201186+0000","last_clean":"2024-09-21T07:31:42.201186+0000","last_became_active":"2024-09-21T07:31:42.198609+0000","last_became_peered":"2024-09-21T07:31:42.198609+0000","last_unstale":"2024-09-21T07:31:42.201186+0000","last_undegraded":"2024-09-21T07:31:42.201186+0000","last_fullsized":"2024-09-21T07:31:42.201186+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:16.198758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201800+0000","last_change":"2024-09-21T07:31:43.223681+0000","last_active":"2024-09-21T07:31:44.201800+0000","last_peered":"2024-09-21T07:31:44.201800+0000","last_clean":"2024-09-21T07:31:44.201800+0000","last_became_active":"2024-09-21T07:31:43.223168+0000","last_became_peered":"2024-09-21T07:31:43.223168+0000","last_unstale":"2024-09-21T07:31:44.201800+0000","last_undegraded":"2024-09-21T07:31:44.201800+0000","last_fullsized":"2024-09-21T07:31:44.201800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.192072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203313+0000","last_change":"2024-09-21T07:31:42.202955+0000","last_active":"2024-09-21T07:31:44.203313+0000","last_peered":"2024-09-21T07:31:44.203313+0000","last_clean":"2024-09-21T07:31:44.203313+0000","last_became_active":"2024-09-21T07:31:42.202131+0000","last_became_peered":"2024-09-21T07:31:42.202131+0000","last_unstale":"2024-09-21T07:31:44.203313+0000","last_undegraded":"2024-09-21T07:31:44.203313+0000","last_fullsized":"2024-09-21T07:31:44.203313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:53.777898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190804+0000","last_change":"2024-09-21T07:31:42.190804+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190804+0000","last_undegraded":"2024-09-21T07:31:42.190804+0000","last_fullsized":"2024-09-21T07:31:42.190804+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204594+0000","last_change":"2024-09-21T07:31:42.203033+0000","last_active":"2024-09-21T07:31:42.204594+0000","last_peered":"2024-09-21T07:31:42.204594+0000","last_clean":"2024-09-21T07:31:42.204594+0000","last_became_active":"2024-09-21T07:31:42.201986+0000","last_became_peered":"2024-09-21T07:31:42.201986+0000","last_unstale":"2024-09-21T07:31:42.204594+0000","last_undegraded":"2024-09-21T07:31:42.204594+0000","last_fullsized":"2024-09-21T07:31:42.204594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:37.207801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201005+0000","last_change":"2024-09-21T07:31:43.198116+0000","last_active":"2024-09-21T07:31:44.201005+0000","last_peered":"2024-09-21T07:31:44.201005+0000","last_clean":"2024-09-21T07:31:44.201005+0000","last_became_active":"2024-09-21T07:31:43.197788+0000","last_became_peered":"2024-09-21T07:31:43.197788+0000","last_unstale":"2024-09-21T07:31:44.201005+0000","last_undegraded":"2024-09-21T07:31:44.201005+0000","last_fullsized":"2024-09-21T07:31:44.201005+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:43.668645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203906+0000","last_change":"2024-09-21T07:31:42.201119+0000","last_active":"2024-09-21T07:31:42.203906+0000","last_peered":"2024-09-21T07:31:42.203906+0000","last_clean":"2024-09-21T07:31:42.203906+0000","last_became_active":"2024-09-21T07:31:42.200597+0000","last_became_peered":"2024-09-21T07:31:42.200597+0000","last_unstale":"2024-09-21T07:31:42.203906+0000","last_undegraded":"2024-09-21T07:31:42.203906+0000","last_fullsized":"2024-09-21T07:31:42.203906+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:25.014890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183339+0000","last_change":"2024-09-21T07:31:42.183339+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183339+0000","last_undegraded":"2024-09-21T07:31:42.183339+0000","last_fullsized":"2024-09-21T07:31:42.183339+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204843+0000","last_change":"2024-09-21T07:31:42.201192+0000","last_active":"2024-09-21T07:31:42.204843+0000","last_peered":"2024-09-21T07:31:42.204843+0000","last_clean":"2024-09-21T07:31:42.204843+0000","last_became_active":"2024-09-21T07:31:42.200812+0000","last_became_peered":"2024-09-21T07:31:42.200812+0000","last_unstale":"2024-09-21T07:31:42.204843+0000","last_undegraded":"2024-09-21T07:31:42.204843+0000","last_fullsized":"2024-09-21T07:31:42.204843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:17.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203045+0000","last_change":"2024-09-21T07:31:43.211386+0000","last_active":"2024-09-21T07:31:44.203045+0000","last_peered":"2024-09-21T07:31:44.203045+0000","last_clean":"2024-09-21T07:31:44.203045+0000","last_became_active":"2024-09-21T07:31:43.210997+0000","last_became_peered":"2024-09-21T07:31:43.210997+0000","last_unstale":"2024-09-21T07:31:44.203045+0000","last_undegraded":"2024-09-21T07:31:44.203045+0000","last_fullsized":"2024-09-21T07:31:44.203045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:07.022916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.194969+0000","last_change":"2024-09-21T07:31:42.191103+0000","last_active":"2024-09-21T07:31:42.194969+0000","last_peered":"2024-09-21T07:31:42.194969+0000","last_clean":"2024-09-21T07:31:42.194969+0000","last_became_active":"2024-09-21T07:31:42.190771+0000","last_became_peered":"2024-09-21T07:31:42.190771+0000","last_unstale":"2024-09-21T07:31:42.194969+0000","last_undegraded":"2024-09-21T07:31:42.194969+0000","last_fullsized":"2024-09-21T07:31:42.194969+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:46.454272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188325+0000","last_change":"2024-09-21T07:31:42.188325+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188325+0000","last_undegraded":"2024-09-21T07:31:42.188325+0000","last_fullsized":"2024-09-21T07:31:42.188325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204675+0000","last_change":"2024-09-21T07:31:42.203052+0000","last_active":"2024-09-21T07:31:42.204675+0000","last_peered":"2024-09-21T07:31:42.204675+0000","last_clean":"2024-09-21T07:31:42.204675+0000","last_became_active":"2024-09-21T07:31:42.202728+0000","last_became_peered":"2024-09-21T07:31:42.202728+0000","last_unstale":"2024-09-21T07:31:42.204675+0000","last_undegraded":"2024-09-21T07:31:42.204675+0000","last_fullsized":"2024-09-21T07:31:42.204675+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:42.407838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187165+0000","last_change":"2024-09-21T07:31:42.187165+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187165+0000","last_undegraded":"2024-09-21T07:31:42.187165+0000","last_fullsized":"2024-09-21T07:31:42.187165+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.206393+0000","last_change":"2024-09-21T07:31:42.203098+0000","last_active":"2024-09-21T07:31:42.206393+0000","last_peered":"2024-09-21T07:31:42.206393+0000","last_clean":"2024-09-21T07:31:42.206393+0000","last_became_active":"2024-09-21T07:31:42.202765+0000","last_became_peered":"2024-09-21T07:31:42.202765+0000","last_unstale":"2024-09-21T07:31:42.206393+0000","last_undegraded":"2024-09-21T07:31:42.206393+0000","last_fullsized":"2024-09-21T07:31:42.206393+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:10.570724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189548+0000","last_change":"2024-09-21T07:31:42.189548+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189548+0000","last_undegraded":"2024-09-21T07:31:42.189548+0000","last_fullsized":"2024-09-21T07:31:42.189548+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203480+0000","last_change":"2024-09-21T07:31:42.202533+0000","last_active":"2024-09-21T07:31:44.203480+0000","last_peered":"2024-09-21T07:31:44.203480+0000","last_clean":"2024-09-21T07:31:44.203480+0000","last_became_active":"2024-09-21T07:31:42.202197+0000","last_became_peered":"2024-09-21T07:31:42.202197+0000","last_unstale":"2024-09-21T07:31:44.203480+0000","last_undegraded":"2024-09-21T07:31:44.203480+0000","last_fullsized":"2024-09-21T07:31:44.203480+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:37.553016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192010+0000","last_change":"2024-09-21T07:31:42.192010+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192010+0000","last_undegraded":"2024-09-21T07:31:42.192010+0000","last_fullsized":"2024-09-21T07:31:42.192010+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207395+0000","last_change":"2024-09-21T07:31:42.205335+0000","last_active":"2024-09-21T07:31:42.207395+0000","last_peered":"2024-09-21T07:31:42.207395+0000","last_clean":"2024-09-21T07:31:42.207395+0000","last_became_active":"2024-09-21T07:31:42.204950+0000","last_became_peered":"2024-09-21T07:31:42.204950+0000","last_unstale":"2024-09-21T07:31:42.207395+0000","last_undegraded":"2024-09-21T07:31:42.207395+0000","last_fullsized":"2024-09-21T07:31:42.207395+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204871+0000","last_change":"2024-09-21T07:31:43.222761+0000","last_active":"2024-09-21T07:31:44.204871+0000","last_peered":"2024-09-21T07:31:44.204871+0000","last_clean":"2024-09-21T07:31:44.204871+0000","last_became_active":"2024-09-21T07:31:43.222402+0000","last_became_peered":"2024-09-21T07:31:43.222402+0000","last_unstale":"2024-09-21T07:31:44.204871+0000","last_undegraded":"2024-09-21T07:31:44.204871+0000","last_fullsized":"2024-09-21T07:31:44.204871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:53.219206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200936+0000","last_change":"2024-09-21T07:31:42.191216+0000","last_active":"2024-09-21T07:31:44.200936+0000","last_peered":"2024-09-21T07:31:44.200936+0000","last_clean":"2024-09-21T07:31:44.200936+0000","last_became_active":"2024-09-21T07:31:42.188915+0000","last_became_peered":"2024-09-21T07:31:42.188915+0000","last_unstale":"2024-09-21T07:31:44.200936+0000","last_undegraded":"2024-09-21T07:31:44.200936+0000","last_fullsized":"2024-09-21T07:31:44.200936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:17.056742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190263+0000","last_change":"2024-09-21T07:31:42.190263+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190263+0000","last_undegraded":"2024-09-21T07:31:42.190263+0000","last_fullsized":"2024-09-21T07:31:42.190263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203188+0000","last_change":"2024-09-21T07:31:42.203466+0000","last_active":"2024-09-21T07:31:44.203188+0000","last_peered":"2024-09-21T07:31:44.203188+0000","last_clean":"2024-09-21T07:31:44.203188+0000","last_became_active":"2024-09-21T07:31:42.202670+0000","last_became_peered":"2024-09-21T07:31:42.202670+0000","last_unstale":"2024-09-21T07:31:44.203188+0000","last_undegraded":"2024-09-21T07:31:44.203188+0000","last_fullsized":"2024-09-21T07:31:44.203188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201989+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:31:44.201989+0000","last_peered":"2024-09-21T07:31:44.201989+0000","last_clean":"2024-09-21T07:31:44.201989+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:31:44.201989+0000","last_undegraded":"2024-09-21T07:31:44.201989+0000","last_fullsized":"2024-09-21T07:31:44.201989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46776,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325064,"statfs":{"total":96636764160,"available":96588865536,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1740800,"data_stored":818310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50924,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2322432,"data_stored":1402019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2375680,"data_stored":1424239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1781760,"data_stored":833851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3f is not active+clean 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.187737+0000', 'last_change': '2024-09-21T07:31:42.187737+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.187737+0000', 'last_undegraded': '2024-09-21T07:31:42.187737+0000', 'last_fullsized': '2024-09-21T07:31:42.187737+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3e is not active+clean 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.193271+0000', 'last_change': '2024-09-21T07:31:42.193271+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.193271+0000', 'last_undegraded': '2024-09-21T07:31:42.193271+0000', 'last_fullsized': '2024-09-21T07:31:42.193271+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3d is not active+clean 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.192796+0000', 'last_change': '2024-09-21T07:31:42.192796+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.192796+0000', 'last_undegraded': '2024-09-21T07:31:42.192796+0000', 'last_fullsized': '2024-09-21T07:31:42.192796+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3c is not active+clean 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.189386+0000', 'last_change': '2024-09-21T07:31:42.189386+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.189386+0000', 'last_undegraded': '2024-09-21T07:31:42.189386+0000', 'last_fullsized': '2024-09-21T07:31:42.189386+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3a is not active+clean 2024-09-21T07:31:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.186772+0000', 'last_change': '2024-09-21T07:31:42.186772+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.186772+0000', 'last_undegraded': '2024-09-21T07:31:42.186772+0000', 'last_fullsized': '2024-09-21T07:31:42.186772+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.38 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.181235+0000', 'last_change': '2024-09-21T07:31:42.181235+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.181235+0000', 'last_undegraded': '2024-09-21T07:31:42.181235+0000', 'last_fullsized': '2024-09-21T07:31:42.181235+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.37 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.192895+0000', 'last_change': '2024-09-21T07:31:42.192895+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.192895+0000', 'last_undegraded': '2024-09-21T07:31:42.192895+0000', 'last_fullsized': '2024-09-21T07:31:42.192895+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.36 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.189153+0000', 'last_change': '2024-09-21T07:31:42.189153+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.189153+0000', 'last_undegraded': '2024-09-21T07:31:42.189153+0000', 'last_fullsized': '2024-09-21T07:31:42.189153+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.35 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.188683+0000', 'last_change': '2024-09-21T07:31:42.188683+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.188683+0000', 'last_undegraded': '2024-09-21T07:31:42.188683+0000', 'last_fullsized': '2024-09-21T07:31:42.188683+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.34 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185450+0000', 'last_change': '2024-09-21T07:31:42.185450+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185450+0000', 'last_undegraded': '2024-09-21T07:31:42.185450+0000', 'last_fullsized': '2024-09-21T07:31:42.185450+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 20.33 is not active+clean 2024-09-21T07:31:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.193908+0000', 'last_change': '2024-09-21T07:31:42.193908+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.193908+0000', 'last_undegraded': '2024-09-21T07:31:42.193908+0000', 'last_fullsized': '2024-09-21T07:31:42.193908+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.32 is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.184913+0000', 'last_change': '2024-09-21T07:31:42.184913+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.184913+0000', 'last_undegraded': '2024-09-21T07:31:42.184913+0000', 'last_fullsized': '2024-09-21T07:31:42.184913+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.31 is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185323+0000', 'last_change': '2024-09-21T07:31:42.185323+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185323+0000', 'last_undegraded': '2024-09-21T07:31:42.185323+0000', 'last_fullsized': '2024-09-21T07:31:42.185323+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.30 is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.186142+0000', 'last_change': '2024-09-21T07:31:42.186142+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.186142+0000', 'last_undegraded': '2024-09-21T07:31:42.186142+0000', 'last_fullsized': '2024-09-21T07:31:42.186142+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2f is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.192385+0000', 'last_change': '2024-09-21T07:31:42.192385+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.192385+0000', 'last_undegraded': '2024-09-21T07:31:42.192385+0000', 'last_fullsized': '2024-09-21T07:31:42.192385+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2b is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.189304+0000', 'last_change': '2024-09-21T07:31:42.189304+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.189304+0000', 'last_undegraded': '2024-09-21T07:31:42.189304+0000', 'last_fullsized': '2024-09-21T07:31:42.189304+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2a is not active+clean 2024-09-21T07:31:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185412+0000', 'last_change': '2024-09-21T07:31:42.185412+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185412+0000', 'last_undegraded': '2024-09-21T07:31:42.185412+0000', 'last_fullsized': '2024-09-21T07:31:42.185412+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.29 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190790+0000', 'last_change': '2024-09-21T07:31:42.190790+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190790+0000', 'last_undegraded': '2024-09-21T07:31:42.190790+0000', 'last_fullsized': '2024-09-21T07:31:42.190790+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.28 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185588+0000', 'last_change': '2024-09-21T07:31:42.185588+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185588+0000', 'last_undegraded': '2024-09-21T07:31:42.185588+0000', 'last_fullsized': '2024-09-21T07:31:42.185588+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.27 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190184+0000', 'last_change': '2024-09-21T07:31:42.190184+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190184+0000', 'last_undegraded': '2024-09-21T07:31:42.190184+0000', 'last_fullsized': '2024-09-21T07:31:42.190184+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.26 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185780+0000', 'last_change': '2024-09-21T07:31:42.185780+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185780+0000', 'last_undegraded': '2024-09-21T07:31:42.185780+0000', 'last_fullsized': '2024-09-21T07:31:42.185780+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.24 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.187675+0000', 'last_change': '2024-09-21T07:31:42.187675+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.187675+0000', 'last_undegraded': '2024-09-21T07:31:42.187675+0000', 'last_fullsized': '2024-09-21T07:31:42.187675+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 20.23 is not active+clean 2024-09-21T07:31:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.184259+0000', 'last_change': '2024-09-21T07:31:42.184259+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.184259+0000', 'last_undegraded': '2024-09-21T07:31:42.184259+0000', 'last_fullsized': '2024-09-21T07:31:42.184259+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.22 is not active+clean 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190103+0000', 'last_change': '2024-09-21T07:31:42.190103+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190103+0000', 'last_undegraded': '2024-09-21T07:31:42.190103+0000', 'last_fullsized': '2024-09-21T07:31:42.190103+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.21 is not active+clean 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.181805+0000', 'last_change': '2024-09-21T07:31:42.181805+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.181805+0000', 'last_undegraded': '2024-09-21T07:31:42.181805+0000', 'last_fullsized': '2024-09-21T07:31:42.181805+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.20 is not active+clean 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.186241+0000', 'last_change': '2024-09-21T07:31:42.186241+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.186241+0000', 'last_undegraded': '2024-09-21T07:31:42.186241+0000', 'last_fullsized': '2024-09-21T07:31:42.186241+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.180567+0000', 'last_change': '2024-09-21T07:31:42.180567+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.180567+0000', 'last_undegraded': '2024-09-21T07:31:42.180567+0000', 'last_fullsized': '2024-09-21T07:31:42.180567+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.184755+0000', 'last_change': '2024-09-21T07:31:42.184755+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.184755+0000', 'last_undegraded': '2024-09-21T07:31:42.184755+0000', 'last_fullsized': '2024-09-21T07:31:42.184755+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.238 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.189542+0000', 'last_change': '2024-09-21T07:31:42.189542+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.189542+0000', 'last_undegraded': '2024-09-21T07:31:42.189542+0000', 'last_fullsized': '2024-09-21T07:31:42.189542+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1b is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.185705+0000', 'last_change': '2024-09-21T07:31:42.185705+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.185705+0000', 'last_undegraded': '2024-09-21T07:31:42.185705+0000', 'last_fullsized': '2024-09-21T07:31:42.185705+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.181695+0000', 'last_change': '2024-09-21T07:31:42.181695+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.181695+0000', 'last_undegraded': '2024-09-21T07:31:42.181695+0000', 'last_fullsized': '2024-09-21T07:31:42.181695+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.181351+0000', 'last_change': '2024-09-21T07:31:42.181351+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.181351+0000', 'last_undegraded': '2024-09-21T07:31:42.181351+0000', 'last_fullsized': '2024-09-21T07:31:42.181351+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.10 is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.188019+0000', 'last_change': '2024-09-21T07:31:42.188019+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.188019+0000', 'last_undegraded': '2024-09-21T07:31:42.188019+0000', 'last_fullsized': '2024-09-21T07:31:42.188019+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190740+0000', 'last_change': '2024-09-21T07:31:42.190740+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190740+0000', 'last_undegraded': '2024-09-21T07:31:42.190740+0000', 'last_fullsized': '2024-09-21T07:31:42.190740+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.239 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.182930+0000', 'last_change': '2024-09-21T07:31:42.182930+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.182930+0000', 'last_undegraded': '2024-09-21T07:31:42.182930+0000', 'last_fullsized': '2024-09-21T07:31:42.182930+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.183734+0000', 'last_change': '2024-09-21T07:31:42.183734+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.183734+0000', 'last_undegraded': '2024-09-21T07:31:42.183734+0000', 'last_fullsized': '2024-09-21T07:31:42.183734+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.14 is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.187156+0000', 'last_change': '2024-09-21T07:31:42.187156+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.187156+0000', 'last_undegraded': '2024-09-21T07:31:42.187156+0000', 'last_fullsized': '2024-09-21T07:31:42.187156+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.183802+0000', 'last_change': '2024-09-21T07:31:42.183802+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.183802+0000', 'last_undegraded': '2024-09-21T07:31:42.183802+0000', 'last_fullsized': '2024-09-21T07:31:42.183802+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.b is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.188792+0000', 'last_change': '2024-09-21T07:31:42.188792+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.188792+0000', 'last_undegraded': '2024-09-21T07:31:42.188792+0000', 'last_fullsized': '2024-09-21T07:31:42.188792+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.188476+0000', 'last_change': '2024-09-21T07:31:42.188476+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.188476+0000', 'last_undegraded': '2024-09-21T07:31:42.188476+0000', 'last_fullsized': '2024-09-21T07:31:42.188476+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:31:48.240 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190804+0000', 'last_change': '2024-09-21T07:31:42.190804+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190804+0000', 'last_undegraded': '2024-09-21T07:31:42.190804+0000', 'last_fullsized': '2024-09-21T07:31:42.190804+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.183339+0000', 'last_change': '2024-09-21T07:31:42.183339+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.183339+0000', 'last_undegraded': '2024-09-21T07:31:42.183339+0000', 'last_fullsized': '2024-09-21T07:31:42.183339+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3 is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.188325+0000', 'last_change': '2024-09-21T07:31:42.188325+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.188325+0000', 'last_undegraded': '2024-09-21T07:31:42.188325+0000', 'last_fullsized': '2024-09-21T07:31:42.188325+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.187165+0000', 'last_change': '2024-09-21T07:31:42.187165+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.187165+0000', 'last_undegraded': '2024-09-21T07:31:42.187165+0000', 'last_fullsized': '2024-09-21T07:31:42.187165+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.189548+0000', 'last_change': '2024-09-21T07:31:42.189548+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.189548+0000', 'last_undegraded': '2024-09-21T07:31:42.189548+0000', 'last_fullsized': '2024-09-21T07:31:42.189548+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-21T07:31:48.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.192010+0000', 'last_change': '2024-09-21T07:31:42.192010+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.192010+0000', 'last_undegraded': '2024-09-21T07:31:42.192010+0000', 'last_fullsized': '2024-09-21T07:31:42.192010+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:31:48.242 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-21T07:31:48.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:31:42.190263+0000', 'last_change': '2024-09-21T07:31:42.190263+0000', 'last_active': '2024-09-21T07:31:42.167651+0000', 'last_peered': '2024-09-21T07:31:42.167651+0000', 'last_clean': '2024-09-21T07:31:42.167651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:31:42.190263+0000', 'last_undegraded': '2024-09-21T07:31:42.190263+0000', 'last_fullsized': '2024-09-21T07:31:42.190263+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'last_clean_scrub_stamp': '2024-09-21T07:31:42.167651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:31:48.242 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- 172.21.15.64:0/2726868125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc00cacf0 msgr2=0x7facc00cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 --2- 172.21.15.64:0/2726868125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc00cacf0 0x7facc00cb100 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7faca8009900 tx=0x7faca801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- 172.21.15.64:0/2726868125 shutdown_connections 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 --2- 172.21.15.64:0/2726868125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc00cacf0 0x7facc00cb100 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 --2- 172.21.15.64:0/2726868125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 0x7facc00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- 172.21.15.64:0/2726868125 >> 172.21.15.64:0/2726868125 conn(0x7facc00ccbe0 msgr2=0x7facc00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:48.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- 172.21.15.64:0/2726868125 shutdown_connections 2024-09-21T07:31:48.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- 172.21.15.64:0/2726868125 wait complete. 2024-09-21T07:31:48.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 Processor -- start 2024-09-21T07:31:48.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.433+0000 7facc5400640 1 -- start start 2024-09-21T07:31:48.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 0x7facc00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc00cacf0 0x7facc014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7facc0166410 con 0x7facc015e9b0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7facc0166290 con 0x7facc00cacf0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7facc0166590 con 0x7facc00b24e0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47632/0 (socket says 172.21.15.64:47632) 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 -- 172.21.15.64:0/2177937284 learned_addr learned my addr 172.21.15.64:0/2177937284 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbe800640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 0x7facc00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facb5e00640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc00cacf0 0x7facc014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 -- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 msgr2=0x7facc00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 0x7facc00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 -- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc00cacf0 msgr2=0x7facc014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc00cacf0 0x7facc014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 -- 172.21.15.64:0/2177937284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00c4f80 con 0x7facc015e9b0 2024-09-21T07:31:48.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facbf200640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7facb800c6b0 tx=0x7facb800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8003b80 con 0x7facc015e9b0 2024-09-21T07:31:48.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facb8003d20 con 0x7facc015e9b0 2024-09-21T07:31:48.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8005330 con 0x7facc015e9b0 2024-09-21T07:31:48.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc00c5260 con 0x7facc015e9b0 2024-09-21T07:31:48.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc00c7f00 con 0x7facc015e9b0 2024-09-21T07:31:48.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.437+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc00ca7b0 con 0x7facc015e9b0 2024-09-21T07:31:48.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.441+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7facb80054d0 con 0x7facc015e9b0 2024-09-21T07:31:48.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.441+0000 7facb7400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 0x7fac9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.441+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7facb8094070 con 0x7facc015e9b0 2024-09-21T07:31:48.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.441+0000 7facbe800640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 0x7fac9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.441+0000 7facbe800640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 0x7fac9c075710 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7facb0009b40 tx=0x7facb00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.445+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7facb805e8a0 con 0x7facc015e9b0 2024-09-21T07:31:48.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.685+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7facc0074da0 con 0x7facc015e9b0 2024-09-21T07:31:48.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.685+0000 7facb7400640 1 -- 172.21.15.64:0/2177937284 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1562 (secure 0 0 0) 0x7facb80632d0 con 0x7facc015e9b0 2024-09-21T07:31:48.688 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:48.688 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":566,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"creating+peering","count":47}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":592070,"bytes_used":391528448,"bytes_avail":772702584832,"bytes_total":773094113280,"inactive_pgs_ratio":0.48453608155250549,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-21T07:31:31.565355+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 msgr2=0x7fac9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 0x7fac9c075710 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7facb0009b40 tx=0x7facb00091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 msgr2=0x7facc00c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7facb800c6b0 tx=0x7facb800cb70 comp rx=0 tx=0).stop 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 shutdown_connections 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac9c073200 0x7fac9c075710 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facc015e9b0 0x7facc00c5da0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc00cacf0 0x7facc014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 --2- 172.21.15.64:0/2177937284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7facc00b24e0 0x7facc00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 >> 172.21.15.64:0/2177937284 conn(0x7facc00ccbe0 msgr2=0x7facc015edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:48.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 shutdown_connections 2024-09-21T07:31:48.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.689+0000 7facc5400640 1 -- 172.21.15.64:0/2177937284 wait complete. 2024-09-21T07:31:48.710 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:31:48.711 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:31:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 -- 172.21.15.64:0/1874756612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc0b22f0 msgr2=0x7f63dc0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 --2- 172.21.15.64:0/1874756612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc0b22f0 0x7f63dc0cb430 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f63dc072000 tx=0x7f63c401c830 comp rx=0 tx=0).stop 2024-09-21T07:31:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 -- 172.21.15.64:0/1874756612 shutdown_connections 2024-09-21T07:31:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 --2- 172.21.15.64:0/1874756612 >> v2:172.21.15.90:3300/0 conn(0x7f63dc0cc4e0 0x7f63dc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 --2- 172.21.15.64:0/1874756612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc0b22f0 0x7f63dc0cb430 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 -- 172.21.15.64:0/1874756612 >> 172.21.15.64:0/1874756612 conn(0x7f63dc0ccbe0 msgr2=0x7f63dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:48.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 -- 172.21.15.64:0/1874756612 shutdown_connections 2024-09-21T07:31:48.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.865+0000 7f63e2600640 1 -- 172.21.15.64:0/1874756612 wait complete. 2024-09-21T07:31:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 Processor -- start 2024-09-21T07:31:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 -- start start 2024-09-21T07:31:48.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63dc0b4170 0x7f63dc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63dc0cc4e0 0x7f63dc09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc1661d0 con 0x7f63dc1506b0 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc166050 con 0x7f63dc0b4170 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63e2600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc166350 con 0x7f63dc0cc4e0 2024-09-21T07:31:48.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47646/0 (socket says 172.21.15.64:47646) 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63dbe00640 1 -- 172.21.15.64:0/3298256468 learned_addr learned my addr 172.21.15.64:0/3298256468 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63db400640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63dc0b4170 0x7f63dc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.869+0000 7f63d2a00640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63dc0cc4e0 0x7f63dc09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 -- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63dc0cc4e0 msgr2=0x7f63dc09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63dc0cc4e0 0x7f63dc09d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 -- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63dc0b4170 msgr2=0x7f63dc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63dc0b4170 0x7f63dc150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 -- 172.21.15.64:0/3298256468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc15ac80 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63dbe00640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f63d400daf0 tx=0x7f63d4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4017070 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d4004b30 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc1fb110 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4003980 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc1fa630 con 0x7f63dc1506b0 2024-09-21T07:31:48.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc09b7e0 con 0x7f63dc1506b0 2024-09-21T07:31:48.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.873+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63d4003b20 con 0x7f63dc1506b0 2024-09-21T07:31:48.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.877+0000 7f63d3e00640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 0x7f63b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:48.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.877+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f63d4094f70 con 0x7f63dc1506b0 2024-09-21T07:31:48.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.877+0000 7f63db400640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 0x7f63b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:48.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.877+0000 7f63db400640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 0x7f63b8075710 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007fd0 tx=0x7f63cc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:48.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:48.877+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f63d4020020 con 0x7f63dc1506b0 2024-09-21T07:31:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.053+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63dc156830 con 0x7f63b8073200 2024-09-21T07:31:49.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.057+0000 7f63d3e00640 1 -- 172.21.15.64:0/3298256468 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248555 (secure 0 0 0) 0x7f63dc156830 con 0x7f63b8073200 2024-09-21T07:31:49.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 msgr2=0x7f63b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 0x7f63b8075710 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007fd0 tx=0x7f63cc009040 comp rx=0 tx=0).stop 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 msgr2=0x7f63dc09d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f63d400daf0 tx=0x7f63d4009f60 comp rx=0 tx=0).stop 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 shutdown_connections 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63b8073200 0x7f63b8075710 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63dc1506b0 0x7f63dc09d560 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63dc0cc4e0 0x7f63dc09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 --2- 172.21.15.64:0/3298256468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63dc0b4170 0x7f63dc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 >> 172.21.15.64:0/3298256468 conn(0x7f63dc0ccbe0 msgr2=0x7f63dc073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 shutdown_connections 2024-09-21T07:31:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:49.061+0000 7f63e2600640 1 -- 172.21.15.64:0/3298256468 wait complete. 2024-09-21T07:31:49.083 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-21T07:31:47.569239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":382352,"kb_used_data":14780,"kb_used_omap":12,"kb_used_meta":367347,"kb_avail":754592368,"statfs":{"total":773094113280,"available":772702584832,"internally_reserved":0,"allocated":15134720,"data_stored":7725023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":376163891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001460"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187737+0000","last_change":"2024-09-21T07:31:42.187737+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187737+0000","last_undegraded":"2024-09-21T07:31:42.187737+0000","last_fullsized":"2024-09-21T07:31:42.187737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193271+0000","last_change":"2024-09-21T07:31:42.193271+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193271+0000","last_undegraded":"2024-09-21T07:31:42.193271+0000","last_fullsized":"2024-09-21T07:31:42.193271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192796+0000","last_change":"2024-09-21T07:31:42.192796+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192796+0000","last_undegraded":"2024-09-21T07:31:42.192796+0000","last_fullsized":"2024-09-21T07:31:42.192796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189386+0000","last_change":"2024-09-21T07:31:42.189386+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189386+0000","last_undegraded":"2024-09-21T07:31:42.189386+0000","last_fullsized":"2024-09-21T07:31:42.189386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201175+0000","last_change":"2024-09-21T07:31:43.200761+0000","last_active":"2024-09-21T07:31:44.201175+0000","last_peered":"2024-09-21T07:31:44.201175+0000","last_clean":"2024-09-21T07:31:44.201175+0000","last_became_active":"2024-09-21T07:31:43.200461+0000","last_became_peered":"2024-09-21T07:31:43.200461+0000","last_unstale":"2024-09-21T07:31:44.201175+0000","last_undegraded":"2024-09-21T07:31:44.201175+0000","last_fullsized":"2024-09-21T07:31:44.201175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:09.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186772+0000","last_change":"2024-09-21T07:31:42.186772+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186772+0000","last_undegraded":"2024-09-21T07:31:42.186772+0000","last_fullsized":"2024-09-21T07:31:42.186772+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.202958+0000","last_change":"2024-09-21T07:31:43.209415+0000","last_active":"2024-09-21T07:31:44.202958+0000","last_peered":"2024-09-21T07:31:44.202958+0000","last_clean":"2024-09-21T07:31:44.202958+0000","last_became_active":"2024-09-21T07:31:43.209019+0000","last_became_peered":"2024-09-21T07:31:43.209019+0000","last_unstale":"2024-09-21T07:31:44.202958+0000","last_undegraded":"2024-09-21T07:31:44.202958+0000","last_fullsized":"2024-09-21T07:31:44.202958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:04.949348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181235+0000","last_change":"2024-09-21T07:31:42.181235+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181235+0000","last_undegraded":"2024-09-21T07:31:42.181235+0000","last_fullsized":"2024-09-21T07:31:42.181235+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192895+0000","last_change":"2024-09-21T07:31:42.192895+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192895+0000","last_undegraded":"2024-09-21T07:31:42.192895+0000","last_fullsized":"2024-09-21T07:31:42.192895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189153+0000","last_change":"2024-09-21T07:31:42.189153+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189153+0000","last_undegraded":"2024-09-21T07:31:42.189153+0000","last_fullsized":"2024-09-21T07:31:42.189153+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188683+0000","last_change":"2024-09-21T07:31:42.188683+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188683+0000","last_undegraded":"2024-09-21T07:31:42.188683+0000","last_fullsized":"2024-09-21T07:31:42.188683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185450+0000","last_change":"2024-09-21T07:31:42.185450+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185450+0000","last_undegraded":"2024-09-21T07:31:42.185450+0000","last_fullsized":"2024-09-21T07:31:42.185450+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.193908+0000","last_change":"2024-09-21T07:31:42.193908+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.193908+0000","last_undegraded":"2024-09-21T07:31:42.193908+0000","last_fullsized":"2024-09-21T07:31:42.193908+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184913+0000","last_change":"2024-09-21T07:31:42.184913+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184913+0000","last_undegraded":"2024-09-21T07:31:42.184913+0000","last_fullsized":"2024-09-21T07:31:42.184913+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185323+0000","last_change":"2024-09-21T07:31:42.185323+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185323+0000","last_undegraded":"2024-09-21T07:31:42.185323+0000","last_fullsized":"2024-09-21T07:31:42.185323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186142+0000","last_change":"2024-09-21T07:31:42.186142+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186142+0000","last_undegraded":"2024-09-21T07:31:42.186142+0000","last_fullsized":"2024-09-21T07:31:42.186142+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192385+0000","last_change":"2024-09-21T07:31:42.192385+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192385+0000","last_undegraded":"2024-09-21T07:31:42.192385+0000","last_fullsized":"2024-09-21T07:31:42.192385+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201512+0000","last_change":"2024-09-21T07:31:43.202618+0000","last_active":"2024-09-21T07:31:44.201512+0000","last_peered":"2024-09-21T07:31:44.201512+0000","last_clean":"2024-09-21T07:31:44.201512+0000","last_became_active":"2024-09-21T07:31:43.202314+0000","last_became_peered":"2024-09-21T07:31:43.202314+0000","last_unstale":"2024-09-21T07:31:44.201512+0000","last_undegraded":"2024-09-21T07:31:44.201512+0000","last_fullsized":"2024-09-21T07:31:44.201512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:10.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204673+0000","last_change":"2024-09-21T07:31:43.207404+0000","last_active":"2024-09-21T07:31:44.204673+0000","last_peered":"2024-09-21T07:31:44.204673+0000","last_clean":"2024-09-21T07:31:44.204673+0000","last_became_active":"2024-09-21T07:31:43.204954+0000","last_became_peered":"2024-09-21T07:31:43.204954+0000","last_unstale":"2024-09-21T07:31:44.204673+0000","last_undegraded":"2024-09-21T07:31:44.204673+0000","last_fullsized":"2024-09-21T07:31:44.204673+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201328+0000","last_change":"2024-09-21T07:31:43.202155+0000","last_active":"2024-09-21T07:31:44.201328+0000","last_peered":"2024-09-21T07:31:44.201328+0000","last_clean":"2024-09-21T07:31:44.201328+0000","last_became_active":"2024-09-21T07:31:43.197776+0000","last_became_peered":"2024-09-21T07:31:43.197776+0000","last_unstale":"2024-09-21T07:31:44.201328+0000","last_undegraded":"2024-09-21T07:31:44.201328+0000","last_fullsized":"2024-09-21T07:31:44.201328+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:17.327164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189304+0000","last_change":"2024-09-21T07:31:42.189304+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189304+0000","last_undegraded":"2024-09-21T07:31:42.189304+0000","last_fullsized":"2024-09-21T07:31:42.189304+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185412+0000","last_change":"2024-09-21T07:31:42.185412+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185412+0000","last_undegraded":"2024-09-21T07:31:42.185412+0000","last_fullsized":"2024-09-21T07:31:42.185412+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190790+0000","last_change":"2024-09-21T07:31:42.190790+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190790+0000","last_undegraded":"2024-09-21T07:31:42.190790+0000","last_fullsized":"2024-09-21T07:31:42.190790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185588+0000","last_change":"2024-09-21T07:31:42.185588+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185588+0000","last_undegraded":"2024-09-21T07:31:42.185588+0000","last_fullsized":"2024-09-21T07:31:42.185588+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190184+0000","last_change":"2024-09-21T07:31:42.190184+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190184+0000","last_undegraded":"2024-09-21T07:31:42.190184+0000","last_fullsized":"2024-09-21T07:31:42.190184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185780+0000","last_change":"2024-09-21T07:31:42.185780+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185780+0000","last_undegraded":"2024-09-21T07:31:42.185780+0000","last_fullsized":"2024-09-21T07:31:42.185780+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204102+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.204102+0000","last_peered":"2024-09-21T07:31:44.204102+0000","last_clean":"2024-09-21T07:31:44.204102+0000","last_became_active":"2024-09-21T07:31:43.198205+0000","last_became_peered":"2024-09-21T07:31:43.198205+0000","last_unstale":"2024-09-21T07:31:44.204102+0000","last_undegraded":"2024-09-21T07:31:44.204102+0000","last_fullsized":"2024-09-21T07:31:44.204102+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:19.294694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187675+0000","last_change":"2024-09-21T07:31:42.187675+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187675+0000","last_undegraded":"2024-09-21T07:31:42.187675+0000","last_fullsized":"2024-09-21T07:31:42.187675+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184259+0000","last_change":"2024-09-21T07:31:42.184259+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184259+0000","last_undegraded":"2024-09-21T07:31:42.184259+0000","last_fullsized":"2024-09-21T07:31:42.184259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190103+0000","last_change":"2024-09-21T07:31:42.190103+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190103+0000","last_undegraded":"2024-09-21T07:31:42.190103+0000","last_fullsized":"2024-09-21T07:31:42.190103+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181805+0000","last_change":"2024-09-21T07:31:42.181805+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181805+0000","last_undegraded":"2024-09-21T07:31:42.181805+0000","last_fullsized":"2024-09-21T07:31:42.181805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.186241+0000","last_change":"2024-09-21T07:31:42.186241+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.186241+0000","last_undegraded":"2024-09-21T07:31:42.186241+0000","last_fullsized":"2024-09-21T07:31:42.186241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.180567+0000","last_change":"2024-09-21T07:31:42.180567+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.180567+0000","last_undegraded":"2024-09-21T07:31:42.180567+0000","last_fullsized":"2024-09-21T07:31:42.180567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204162+0000","last_change":"2024-09-21T07:31:42.200172+0000","last_active":"2024-09-21T07:31:42.204162+0000","last_peered":"2024-09-21T07:31:42.204162+0000","last_clean":"2024-09-21T07:31:42.204162+0000","last_became_active":"2024-09-21T07:31:42.196709+0000","last_became_peered":"2024-09-21T07:31:42.196709+0000","last_unstale":"2024-09-21T07:31:42.204162+0000","last_undegraded":"2024-09-21T07:31:42.204162+0000","last_fullsized":"2024-09-21T07:31:42.204162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:38.781035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.184755+0000","last_change":"2024-09-21T07:31:42.184755+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.184755+0000","last_undegraded":"2024-09-21T07:31:42.184755+0000","last_fullsized":"2024-09-21T07:31:42.184755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201866+0000","last_change":"2024-09-21T07:31:42.201555+0000","last_active":"2024-09-21T07:31:44.201866+0000","last_peered":"2024-09-21T07:31:44.201866+0000","last_clean":"2024-09-21T07:31:44.201866+0000","last_became_active":"2024-09-21T07:31:42.201250+0000","last_became_peered":"2024-09-21T07:31:42.201250+0000","last_unstale":"2024-09-21T07:31:44.201866+0000","last_undegraded":"2024-09-21T07:31:44.201866+0000","last_fullsized":"2024-09-21T07:31:44.201866+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:29.864925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189542+0000","last_change":"2024-09-21T07:31:42.189542+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189542+0000","last_undegraded":"2024-09-21T07:31:42.189542+0000","last_fullsized":"2024-09-21T07:31:42.189542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204259+0000","last_change":"2024-09-21T07:31:42.204438+0000","last_active":"2024-09-21T07:31:44.204259+0000","last_peered":"2024-09-21T07:31:44.204259+0000","last_clean":"2024-09-21T07:31:44.204259+0000","last_became_active":"2024-09-21T07:31:42.204073+0000","last_became_peered":"2024-09-21T07:31:42.204073+0000","last_unstale":"2024-09-21T07:31:44.204259+0000","last_undegraded":"2024-09-21T07:31:44.204259+0000","last_fullsized":"2024-09-21T07:31:44.204259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.185705+0000","last_change":"2024-09-21T07:31:42.185705+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.185705+0000","last_undegraded":"2024-09-21T07:31:42.185705+0000","last_fullsized":"2024-09-21T07:31:42.185705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203566+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:44.203566+0000","last_peered":"2024-09-21T07:31:44.203566+0000","last_clean":"2024-09-21T07:31:44.203566+0000","last_became_active":"2024-09-21T07:31:42.205885+0000","last_became_peered":"2024-09-21T07:31:42.205885+0000","last_unstale":"2024-09-21T07:31:44.203566+0000","last_undegraded":"2024-09-21T07:31:44.203566+0000","last_fullsized":"2024-09-21T07:31:44.203566+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.055545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181695+0000","last_change":"2024-09-21T07:31:42.181695+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181695+0000","last_undegraded":"2024-09-21T07:31:42.181695+0000","last_fullsized":"2024-09-21T07:31:42.181695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.205505+0000","last_change":"2024-09-21T07:31:42.204257+0000","last_active":"2024-09-21T07:31:42.205505+0000","last_peered":"2024-09-21T07:31:42.205505+0000","last_clean":"2024-09-21T07:31:42.205505+0000","last_became_active":"2024-09-21T07:31:42.201713+0000","last_became_peered":"2024-09-21T07:31:42.201713+0000","last_unstale":"2024-09-21T07:31:42.205505+0000","last_undegraded":"2024-09-21T07:31:42.205505+0000","last_fullsized":"2024-09-21T07:31:42.205505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:32.747547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.181351+0000","last_change":"2024-09-21T07:31:42.181351+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.181351+0000","last_undegraded":"2024-09-21T07:31:42.181351+0000","last_fullsized":"2024-09-21T07:31:42.181351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200914+0000","last_change":"2024-09-21T07:31:42.193287+0000","last_active":"2024-09-21T07:31:44.200914+0000","last_peered":"2024-09-21T07:31:44.200914+0000","last_clean":"2024-09-21T07:31:44.200914+0000","last_became_active":"2024-09-21T07:31:42.191431+0000","last_became_peered":"2024-09-21T07:31:42.191431+0000","last_unstale":"2024-09-21T07:31:44.200914+0000","last_undegraded":"2024-09-21T07:31:44.200914+0000","last_fullsized":"2024-09-21T07:31:44.200914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:39.061656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201764+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.201764+0000","last_peered":"2024-09-21T07:31:44.201764+0000","last_clean":"2024-09-21T07:31:44.201764+0000","last_became_active":"2024-09-21T07:31:43.198244+0000","last_became_peered":"2024-09-21T07:31:43.198244+0000","last_unstale":"2024-09-21T07:31:44.201764+0000","last_undegraded":"2024-09-21T07:31:44.201764+0000","last_fullsized":"2024-09-21T07:31:44.201764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:17.104799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203574+0000","last_change":"2024-09-21T07:31:42.200226+0000","last_active":"2024-09-21T07:31:42.203574+0000","last_peered":"2024-09-21T07:31:42.203574+0000","last_clean":"2024-09-21T07:31:42.203574+0000","last_became_active":"2024-09-21T07:31:42.199918+0000","last_became_peered":"2024-09-21T07:31:42.199918+0000","last_unstale":"2024-09-21T07:31:42.203574+0000","last_undegraded":"2024-09-21T07:31:42.203574+0000","last_fullsized":"2024-09-21T07:31:42.203574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.762517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204212+0000","last_change":"2024-09-21T07:31:43.204756+0000","last_active":"2024-09-21T07:31:44.204212+0000","last_peered":"2024-09-21T07:31:44.204212+0000","last_clean":"2024-09-21T07:31:44.204212+0000","last_became_active":"2024-09-21T07:31:43.204410+0000","last_became_peered":"2024-09-21T07:31:43.204410+0000","last_unstale":"2024-09-21T07:31:44.204212+0000","last_undegraded":"2024-09-21T07:31:44.204212+0000","last_fullsized":"2024-09-21T07:31:44.204212+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.450486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.199985+0000","last_change":"2024-09-21T07:31:42.195562+0000","last_active":"2024-09-21T07:31:42.199985+0000","last_peered":"2024-09-21T07:31:42.199985+0000","last_clean":"2024-09-21T07:31:42.199985+0000","last_became_active":"2024-09-21T07:31:42.194585+0000","last_became_peered":"2024-09-21T07:31:42.194585+0000","last_unstale":"2024-09-21T07:31:42.199985+0000","last_undegraded":"2024-09-21T07:31:42.199985+0000","last_fullsized":"2024-09-21T07:31:42.199985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:58.654276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188019+0000","last_change":"2024-09-21T07:31:42.188019+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188019+0000","last_undegraded":"2024-09-21T07:31:42.188019+0000","last_fullsized":"2024-09-21T07:31:42.188019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207328+0000","last_change":"2024-09-21T07:31:42.199145+0000","last_active":"2024-09-21T07:31:42.207328+0000","last_peered":"2024-09-21T07:31:42.207328+0000","last_clean":"2024-09-21T07:31:42.207328+0000","last_became_active":"2024-09-21T07:31:42.198831+0000","last_became_peered":"2024-09-21T07:31:42.198831+0000","last_unstale":"2024-09-21T07:31:42.207328+0000","last_undegraded":"2024-09-21T07:31:42.207328+0000","last_fullsized":"2024-09-21T07:31:42.207328+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.032044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190740+0000","last_change":"2024-09-21T07:31:42.190740+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190740+0000","last_undegraded":"2024-09-21T07:31:42.190740+0000","last_fullsized":"2024-09-21T07:31:42.190740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204035+0000","last_change":"2024-09-21T07:31:42.201351+0000","last_active":"2024-09-21T07:31:42.204035+0000","last_peered":"2024-09-21T07:31:42.204035+0000","last_clean":"2024-09-21T07:31:42.204035+0000","last_became_active":"2024-09-21T07:31:42.200685+0000","last_became_peered":"2024-09-21T07:31:42.200685+0000","last_unstale":"2024-09-21T07:31:42.204035+0000","last_undegraded":"2024-09-21T07:31:42.204035+0000","last_fullsized":"2024-09-21T07:31:42.204035+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:59.706593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.182930+0000","last_change":"2024-09-21T07:31:42.182930+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.182930+0000","last_undegraded":"2024-09-21T07:31:42.182930+0000","last_fullsized":"2024-09-21T07:31:42.182930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204430+0000","last_change":"2024-09-21T07:31:42.206037+0000","last_active":"2024-09-21T07:31:44.204430+0000","last_peered":"2024-09-21T07:31:44.204430+0000","last_clean":"2024-09-21T07:31:44.204430+0000","last_became_active":"2024-09-21T07:31:42.203832+0000","last_became_peered":"2024-09-21T07:31:42.203832+0000","last_unstale":"2024-09-21T07:31:44.204430+0000","last_undegraded":"2024-09-21T07:31:44.204430+0000","last_fullsized":"2024-09-21T07:31:44.204430+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:38.570431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183734+0000","last_change":"2024-09-21T07:31:42.183734+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183734+0000","last_undegraded":"2024-09-21T07:31:42.183734+0000","last_fullsized":"2024-09-21T07:31:42.183734+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'6","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203701+0000","last_change":"2024-09-21T07:31:42.205466+0000","last_active":"2024-09-21T07:31:44.203701+0000","last_peered":"2024-09-21T07:31:44.203701+0000","last_clean":"2024-09-21T07:31:44.203701+0000","last_became_active":"2024-09-21T07:31:42.205141+0000","last_became_peered":"2024-09-21T07:31:42.205141+0000","last_unstale":"2024-09-21T07:31:44.203701+0000","last_undegraded":"2024-09-21T07:31:44.203701+0000","last_fullsized":"2024-09-21T07:31:44.203701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:30.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187156+0000","last_change":"2024-09-21T07:31:42.187156+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187156+0000","last_undegraded":"2024-09-21T07:31:42.187156+0000","last_fullsized":"2024-09-21T07:31:42.187156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203940+0000","last_change":"2024-09-21T07:31:42.201759+0000","last_active":"2024-09-21T07:31:42.203940+0000","last_peered":"2024-09-21T07:31:42.203940+0000","last_clean":"2024-09-21T07:31:42.203940+0000","last_became_active":"2024-09-21T07:31:42.201481+0000","last_became_peered":"2024-09-21T07:31:42.201481+0000","last_unstale":"2024-09-21T07:31:42.203940+0000","last_undegraded":"2024-09-21T07:31:42.203940+0000","last_fullsized":"2024-09-21T07:31:42.203940+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:12.953100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204410+0000","last_change":"2024-09-21T07:31:43.200818+0000","last_active":"2024-09-21T07:31:44.204410+0000","last_peered":"2024-09-21T07:31:44.204410+0000","last_clean":"2024-09-21T07:31:44.204410+0000","last_became_active":"2024-09-21T07:31:43.197016+0000","last_became_peered":"2024-09-21T07:31:43.197016+0000","last_unstale":"2024-09-21T07:31:44.204410+0000","last_undegraded":"2024-09-21T07:31:44.204410+0000","last_fullsized":"2024-09-21T07:31:44.204410+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:07.329545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.202591+0000","last_change":"2024-09-21T07:31:42.197621+0000","last_active":"2024-09-21T07:31:42.202591+0000","last_peered":"2024-09-21T07:31:42.202591+0000","last_clean":"2024-09-21T07:31:42.202591+0000","last_became_active":"2024-09-21T07:31:42.197293+0000","last_became_peered":"2024-09-21T07:31:42.197293+0000","last_unstale":"2024-09-21T07:31:42.202591+0000","last_undegraded":"2024-09-21T07:31:42.202591+0000","last_fullsized":"2024-09-21T07:31:42.202591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:51.032018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201893+0000","last_change":"2024-09-21T07:31:43.203200+0000","last_active":"2024-09-21T07:31:44.201893+0000","last_peered":"2024-09-21T07:31:44.201893+0000","last_clean":"2024-09-21T07:31:44.201893+0000","last_became_active":"2024-09-21T07:31:43.202799+0000","last_became_peered":"2024-09-21T07:31:43.202799+0000","last_unstale":"2024-09-21T07:31:44.201893+0000","last_undegraded":"2024-09-21T07:31:44.201893+0000","last_fullsized":"2024-09-21T07:31:44.201893+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:54.217026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207453+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:42.207453+0000","last_peered":"2024-09-21T07:31:42.207453+0000","last_clean":"2024-09-21T07:31:42.207453+0000","last_became_active":"2024-09-21T07:31:42.205957+0000","last_became_peered":"2024-09-21T07:31:42.205957+0000","last_unstale":"2024-09-21T07:31:42.207453+0000","last_undegraded":"2024-09-21T07:31:42.207453+0000","last_fullsized":"2024-09-21T07:31:42.207453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:07.468690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183802+0000","last_change":"2024-09-21T07:31:42.183802+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183802+0000","last_undegraded":"2024-09-21T07:31:42.183802+0000","last_fullsized":"2024-09-21T07:31:42.183802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.208144+0000","last_change":"2024-09-21T07:31:42.206979+0000","last_active":"2024-09-21T07:31:42.208144+0000","last_peered":"2024-09-21T07:31:42.208144+0000","last_clean":"2024-09-21T07:31:42.208144+0000","last_became_active":"2024-09-21T07:31:42.205033+0000","last_became_peered":"2024-09-21T07:31:42.205033+0000","last_unstale":"2024-09-21T07:31:42.208144+0000","last_undegraded":"2024-09-21T07:31:42.208144+0000","last_fullsized":"2024-09-21T07:31:42.208144+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:44.523590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203201+0000","last_change":"2024-09-21T07:31:43.208386+0000","last_active":"2024-09-21T07:31:44.203201+0000","last_peered":"2024-09-21T07:31:44.203201+0000","last_clean":"2024-09-21T07:31:44.203201+0000","last_became_active":"2024-09-21T07:31:43.198413+0000","last_became_peered":"2024-09-21T07:31:43.198413+0000","last_unstale":"2024-09-21T07:31:44.203201+0000","last_undegraded":"2024-09-21T07:31:44.203201+0000","last_fullsized":"2024-09-21T07:31:44.203201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:36.237710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201127+0000","last_change":"2024-09-21T07:31:42.197122+0000","last_active":"2024-09-21T07:31:42.201127+0000","last_peered":"2024-09-21T07:31:42.201127+0000","last_clean":"2024-09-21T07:31:42.201127+0000","last_became_active":"2024-09-21T07:31:42.196623+0000","last_became_peered":"2024-09-21T07:31:42.196623+0000","last_unstale":"2024-09-21T07:31:42.201127+0000","last_undegraded":"2024-09-21T07:31:42.201127+0000","last_fullsized":"2024-09-21T07:31:42.201127+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203399+0000","last_change":"2024-09-21T07:31:43.199077+0000","last_active":"2024-09-21T07:31:44.203399+0000","last_peered":"2024-09-21T07:31:44.203399+0000","last_clean":"2024-09-21T07:31:44.203399+0000","last_became_active":"2024-09-21T07:31:43.197979+0000","last_became_peered":"2024-09-21T07:31:43.197979+0000","last_unstale":"2024-09-21T07:31:44.203399+0000","last_undegraded":"2024-09-21T07:31:44.203399+0000","last_fullsized":"2024-09-21T07:31:44.203399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.777821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.200588+0000","last_change":"2024-09-21T07:31:42.198827+0000","last_active":"2024-09-21T07:31:42.200588+0000","last_peered":"2024-09-21T07:31:42.200588+0000","last_clean":"2024-09-21T07:31:42.200588+0000","last_became_active":"2024-09-21T07:31:42.198504+0000","last_became_peered":"2024-09-21T07:31:42.198504+0000","last_unstale":"2024-09-21T07:31:42.200588+0000","last_undegraded":"2024-09-21T07:31:42.200588+0000","last_fullsized":"2024-09-21T07:31:42.200588+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:28.634850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188792+0000","last_change":"2024-09-21T07:31:42.188792+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188792+0000","last_undegraded":"2024-09-21T07:31:42.188792+0000","last_fullsized":"2024-09-21T07:31:42.188792+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201428+0000","last_change":"2024-09-21T07:31:42.193312+0000","last_active":"2024-09-21T07:31:44.201428+0000","last_peered":"2024-09-21T07:31:44.201428+0000","last_clean":"2024-09-21T07:31:44.201428+0000","last_became_active":"2024-09-21T07:31:42.193006+0000","last_became_peered":"2024-09-21T07:31:42.193006+0000","last_unstale":"2024-09-21T07:31:44.201428+0000","last_undegraded":"2024-09-21T07:31:44.201428+0000","last_fullsized":"2024-09-21T07:31:44.201428+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.543073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201332+0000","last_change":"2024-09-21T07:31:43.218832+0000","last_active":"2024-09-21T07:31:44.201332+0000","last_peered":"2024-09-21T07:31:44.201332+0000","last_clean":"2024-09-21T07:31:44.201332+0000","last_became_active":"2024-09-21T07:31:43.218460+0000","last_became_peered":"2024-09-21T07:31:43.218460+0000","last_unstale":"2024-09-21T07:31:44.201332+0000","last_undegraded":"2024-09-21T07:31:44.201332+0000","last_fullsized":"2024-09-21T07:31:44.201332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204847+0000","last_change":"2024-09-21T07:31:42.200966+0000","last_active":"2024-09-21T07:31:42.204847+0000","last_peered":"2024-09-21T07:31:42.204847+0000","last_clean":"2024-09-21T07:31:42.204847+0000","last_became_active":"2024-09-21T07:31:42.200644+0000","last_became_peered":"2024-09-21T07:31:42.200644+0000","last_unstale":"2024-09-21T07:31:42.204847+0000","last_undegraded":"2024-09-21T07:31:42.204847+0000","last_fullsized":"2024-09-21T07:31:42.204847+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188476+0000","last_change":"2024-09-21T07:31:42.188476+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188476+0000","last_undegraded":"2024-09-21T07:31:42.188476+0000","last_fullsized":"2024-09-21T07:31:42.188476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.201186+0000","last_change":"2024-09-21T07:31:42.198900+0000","last_active":"2024-09-21T07:31:42.201186+0000","last_peered":"2024-09-21T07:31:42.201186+0000","last_clean":"2024-09-21T07:31:42.201186+0000","last_became_active":"2024-09-21T07:31:42.198609+0000","last_became_peered":"2024-09-21T07:31:42.198609+0000","last_unstale":"2024-09-21T07:31:42.201186+0000","last_undegraded":"2024-09-21T07:31:42.201186+0000","last_fullsized":"2024-09-21T07:31:42.201186+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:16.198758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201800+0000","last_change":"2024-09-21T07:31:43.223681+0000","last_active":"2024-09-21T07:31:44.201800+0000","last_peered":"2024-09-21T07:31:44.201800+0000","last_clean":"2024-09-21T07:31:44.201800+0000","last_became_active":"2024-09-21T07:31:43.223168+0000","last_became_peered":"2024-09-21T07:31:43.223168+0000","last_unstale":"2024-09-21T07:31:44.201800+0000","last_undegraded":"2024-09-21T07:31:44.201800+0000","last_fullsized":"2024-09-21T07:31:44.201800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.192072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203313+0000","last_change":"2024-09-21T07:31:42.202955+0000","last_active":"2024-09-21T07:31:44.203313+0000","last_peered":"2024-09-21T07:31:44.203313+0000","last_clean":"2024-09-21T07:31:44.203313+0000","last_became_active":"2024-09-21T07:31:42.202131+0000","last_became_peered":"2024-09-21T07:31:42.202131+0000","last_unstale":"2024-09-21T07:31:44.203313+0000","last_undegraded":"2024-09-21T07:31:44.203313+0000","last_fullsized":"2024-09-21T07:31:44.203313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:53.777898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190804+0000","last_change":"2024-09-21T07:31:42.190804+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190804+0000","last_undegraded":"2024-09-21T07:31:42.190804+0000","last_fullsized":"2024-09-21T07:31:42.190804+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204594+0000","last_change":"2024-09-21T07:31:42.203033+0000","last_active":"2024-09-21T07:31:42.204594+0000","last_peered":"2024-09-21T07:31:42.204594+0000","last_clean":"2024-09-21T07:31:42.204594+0000","last_became_active":"2024-09-21T07:31:42.201986+0000","last_became_peered":"2024-09-21T07:31:42.201986+0000","last_unstale":"2024-09-21T07:31:42.204594+0000","last_undegraded":"2024-09-21T07:31:42.204594+0000","last_fullsized":"2024-09-21T07:31:42.204594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:37.207801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201005+0000","last_change":"2024-09-21T07:31:43.198116+0000","last_active":"2024-09-21T07:31:44.201005+0000","last_peered":"2024-09-21T07:31:44.201005+0000","last_clean":"2024-09-21T07:31:44.201005+0000","last_became_active":"2024-09-21T07:31:43.197788+0000","last_became_peered":"2024-09-21T07:31:43.197788+0000","last_unstale":"2024-09-21T07:31:44.201005+0000","last_undegraded":"2024-09-21T07:31:44.201005+0000","last_fullsized":"2024-09-21T07:31:44.201005+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:43.668645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.203906+0000","last_change":"2024-09-21T07:31:42.201119+0000","last_active":"2024-09-21T07:31:42.203906+0000","last_peered":"2024-09-21T07:31:42.203906+0000","last_clean":"2024-09-21T07:31:42.203906+0000","last_became_active":"2024-09-21T07:31:42.200597+0000","last_became_peered":"2024-09-21T07:31:42.200597+0000","last_unstale":"2024-09-21T07:31:42.203906+0000","last_undegraded":"2024-09-21T07:31:42.203906+0000","last_fullsized":"2024-09-21T07:31:42.203906+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:25.014890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.183339+0000","last_change":"2024-09-21T07:31:42.183339+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.183339+0000","last_undegraded":"2024-09-21T07:31:42.183339+0000","last_fullsized":"2024-09-21T07:31:42.183339+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204843+0000","last_change":"2024-09-21T07:31:42.201192+0000","last_active":"2024-09-21T07:31:42.204843+0000","last_peered":"2024-09-21T07:31:42.204843+0000","last_clean":"2024-09-21T07:31:42.204843+0000","last_became_active":"2024-09-21T07:31:42.200812+0000","last_became_peered":"2024-09-21T07:31:42.200812+0000","last_unstale":"2024-09-21T07:31:42.204843+0000","last_undegraded":"2024-09-21T07:31:42.204843+0000","last_fullsized":"2024-09-21T07:31:42.204843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:17.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203045+0000","last_change":"2024-09-21T07:31:43.211386+0000","last_active":"2024-09-21T07:31:44.203045+0000","last_peered":"2024-09-21T07:31:44.203045+0000","last_clean":"2024-09-21T07:31:44.203045+0000","last_became_active":"2024-09-21T07:31:43.210997+0000","last_became_peered":"2024-09-21T07:31:43.210997+0000","last_unstale":"2024-09-21T07:31:44.203045+0000","last_undegraded":"2024-09-21T07:31:44.203045+0000","last_fullsized":"2024-09-21T07:31:44.203045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:07.022916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.194969+0000","last_change":"2024-09-21T07:31:42.191103+0000","last_active":"2024-09-21T07:31:42.194969+0000","last_peered":"2024-09-21T07:31:42.194969+0000","last_clean":"2024-09-21T07:31:42.194969+0000","last_became_active":"2024-09-21T07:31:42.190771+0000","last_became_peered":"2024-09-21T07:31:42.190771+0000","last_unstale":"2024-09-21T07:31:42.194969+0000","last_undegraded":"2024-09-21T07:31:42.194969+0000","last_fullsized":"2024-09-21T07:31:42.194969+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:46.454272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.188325+0000","last_change":"2024-09-21T07:31:42.188325+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.188325+0000","last_undegraded":"2024-09-21T07:31:42.188325+0000","last_fullsized":"2024-09-21T07:31:42.188325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.204675+0000","last_change":"2024-09-21T07:31:42.203052+0000","last_active":"2024-09-21T07:31:42.204675+0000","last_peered":"2024-09-21T07:31:42.204675+0000","last_clean":"2024-09-21T07:31:42.204675+0000","last_became_active":"2024-09-21T07:31:42.202728+0000","last_became_peered":"2024-09-21T07:31:42.202728+0000","last_unstale":"2024-09-21T07:31:42.204675+0000","last_undegraded":"2024-09-21T07:31:42.204675+0000","last_fullsized":"2024-09-21T07:31:42.204675+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:42.407838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.187165+0000","last_change":"2024-09-21T07:31:42.187165+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.187165+0000","last_undegraded":"2024-09-21T07:31:42.187165+0000","last_fullsized":"2024-09-21T07:31:42.187165+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.206393+0000","last_change":"2024-09-21T07:31:42.203098+0000","last_active":"2024-09-21T07:31:42.206393+0000","last_peered":"2024-09-21T07:31:42.206393+0000","last_clean":"2024-09-21T07:31:42.206393+0000","last_became_active":"2024-09-21T07:31:42.202765+0000","last_became_peered":"2024-09-21T07:31:42.202765+0000","last_unstale":"2024-09-21T07:31:42.206393+0000","last_undegraded":"2024-09-21T07:31:42.206393+0000","last_fullsized":"2024-09-21T07:31:42.206393+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:10.570724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.189548+0000","last_change":"2024-09-21T07:31:42.189548+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.189548+0000","last_undegraded":"2024-09-21T07:31:42.189548+0000","last_fullsized":"2024-09-21T07:31:42.189548+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203480+0000","last_change":"2024-09-21T07:31:42.202533+0000","last_active":"2024-09-21T07:31:44.203480+0000","last_peered":"2024-09-21T07:31:44.203480+0000","last_clean":"2024-09-21T07:31:44.203480+0000","last_became_active":"2024-09-21T07:31:42.202197+0000","last_became_peered":"2024-09-21T07:31:42.202197+0000","last_unstale":"2024-09-21T07:31:44.203480+0000","last_undegraded":"2024-09-21T07:31:44.203480+0000","last_fullsized":"2024-09-21T07:31:44.203480+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:37.553016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.192010+0000","last_change":"2024-09-21T07:31:42.192010+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.192010+0000","last_undegraded":"2024-09-21T07:31:42.192010+0000","last_fullsized":"2024-09-21T07:31:42.192010+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T07:31:42.207395+0000","last_change":"2024-09-21T07:31:42.205335+0000","last_active":"2024-09-21T07:31:42.207395+0000","last_peered":"2024-09-21T07:31:42.207395+0000","last_clean":"2024-09-21T07:31:42.207395+0000","last_became_active":"2024-09-21T07:31:42.204950+0000","last_became_peered":"2024-09-21T07:31:42.204950+0000","last_unstale":"2024-09-21T07:31:42.207395+0000","last_undegraded":"2024-09-21T07:31:42.207395+0000","last_fullsized":"2024-09-21T07:31:42.207395+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204871+0000","last_change":"2024-09-21T07:31:43.222761+0000","last_active":"2024-09-21T07:31:44.204871+0000","last_peered":"2024-09-21T07:31:44.204871+0000","last_clean":"2024-09-21T07:31:44.204871+0000","last_became_active":"2024-09-21T07:31:43.222402+0000","last_became_peered":"2024-09-21T07:31:43.222402+0000","last_unstale":"2024-09-21T07:31:44.204871+0000","last_undegraded":"2024-09-21T07:31:44.204871+0000","last_fullsized":"2024-09-21T07:31:44.204871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:53.219206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200936+0000","last_change":"2024-09-21T07:31:42.191216+0000","last_active":"2024-09-21T07:31:44.200936+0000","last_peered":"2024-09-21T07:31:44.200936+0000","last_clean":"2024-09-21T07:31:44.200936+0000","last_became_active":"2024-09-21T07:31:42.188915+0000","last_became_peered":"2024-09-21T07:31:42.188915+0000","last_unstale":"2024-09-21T07:31:44.200936+0000","last_undegraded":"2024-09-21T07:31:44.200936+0000","last_fullsized":"2024-09-21T07:31:44.200936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:17.056742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-21T07:31:42.190263+0000","last_change":"2024-09-21T07:31:42.190263+0000","last_active":"2024-09-21T07:31:42.167651+0000","last_peered":"2024-09-21T07:31:42.167651+0000","last_clean":"2024-09-21T07:31:42.167651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:31:42.190263+0000","last_undegraded":"2024-09-21T07:31:42.190263+0000","last_fullsized":"2024-09-21T07:31:42.190263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203188+0000","last_change":"2024-09-21T07:31:42.203466+0000","last_active":"2024-09-21T07:31:44.203188+0000","last_peered":"2024-09-21T07:31:44.203188+0000","last_clean":"2024-09-21T07:31:44.203188+0000","last_became_active":"2024-09-21T07:31:42.202670+0000","last_became_peered":"2024-09-21T07:31:42.202670+0000","last_unstale":"2024-09-21T07:31:44.203188+0000","last_undegraded":"2024-09-21T07:31:44.203188+0000","last_fullsized":"2024-09-21T07:31:44.203188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201989+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:31:44.201989+0000","last_peered":"2024-09-21T07:31:44.201989+0000","last_clean":"2024-09-21T07:31:44.201989+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:31:44.201989+0000","last_undegraded":"2024-09-21T07:31:44.201989+0000","last_fullsized":"2024-09-21T07:31:44.201989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46776,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325064,"statfs":{"total":96636764160,"available":96588865536,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1740800,"data_stored":818310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50924,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1728512,"data_stored":811651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2322432,"data_stored":1402019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2375680,"data_stored":1424239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1781760,"data_stored":833851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:31:52.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- 172.21.15.64:0/1961447677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 msgr2=0x7f8bc40b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1961447677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b1be0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009840 tx=0x7f8bb801c6b0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- 172.21.15.64:0/1961447677 shutdown_connections 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1961447677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 0x7f8bc40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1961447677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b1be0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- 172.21.15.64:0/1961447677 >> 172.21.15.64:0/1961447677 conn(0x7f8bc40ccbe0 msgr2=0x7f8bc40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- 172.21.15.64:0/1961447677 shutdown_connections 2024-09-21T07:31:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- 172.21.15.64:0/1961447677 wait complete. 2024-09-21T07:31:52.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 Processor -- start 2024-09-21T07:31:52.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.261+0000 7f8bcc800640 1 -- start start 2024-09-21T07:31:52.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 0x7f8bc409d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc40b3ad0 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4071120 con 0x7f8bc40b4170 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc40b3c50 con 0x7f8bc40cc4e0 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47648/0 (socket says 172.21.15.64:47648) 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 -- 172.21.15.64:0/1139531534 learned_addr learned my addr 172.21.15.64:0/1139531534 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9400640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bca800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 0x7f8bc409d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 -- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 msgr2=0x7f8bc409d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 0x7f8bc409d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 -- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 msgr2=0x7f8bc40b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 -- 172.21.15.64:0/1139531534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc4152440 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9400640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bc9e00640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8bb801cf50 tx=0x7f8bb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8003a10 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bb80bd070 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc40b1130 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80044e0 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc40ae4c0 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.265+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc40b33c0 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.269+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8bb80b7480 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.269+0000 7f8bbe000640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 0x7f8ba80758e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.269+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f8bb812f750 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.269+0000 7f8bc9400640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 0x7f8ba80758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.269+0000 7f8bc9400640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 0x7f8ba80758e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8bc409cfd0 tx=0x7f8bb40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.273+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8bb80c7020 con 0x7f8bc40b2fb0 2024-09-21T07:31:52.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.449+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bc4164f00 con 0x7f8ba80733d0 2024-09-21T07:31:52.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.453+0000 7f8bbe000640 1 -- 172.21.15.64:0/1139531534 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252463 (secure 0 0 0) 0x7f8bc4164f00 con 0x7f8ba80733d0 2024-09-21T07:31:52.458 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:31:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 msgr2=0x7f8ba80758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 0x7f8ba80758e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8bc409cfd0 tx=0x7f8bb40091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 msgr2=0x7f8bc4151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8bb801cf50 tx=0x7f8bb80042f0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 shutdown_connections 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba80733d0 0x7f8ba80758e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc40cc4e0 0x7f8bc409d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc40b4170 0x7f8bc40b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 --2- 172.21.15.64:0/1139531534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc40b2fb0 0x7f8bc4151f00 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 >> 172.21.15.64:0/1139531534 conn(0x7f8bc40ccbe0 msgr2=0x7f8bc4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 shutdown_connections 2024-09-21T07:31:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.457+0000 7f8bcc800640 1 -- 172.21.15.64:0/1139531534 wait complete. 2024-09-21T07:31:52.479 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-09-21T07:31:51.570373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":382584,"kb_used_data":15016,"kb_used_omap":12,"kb_used_meta":367347,"kb_avail":754592136,"statfs":{"total":773094113280,"available":772702347264,"internally_reserved":0,"allocated":15376384,"data_stored":7842908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":376163891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.390452"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456441+0000","last_change":"2024-09-21T07:31:43.211998+0000","last_active":"2024-09-21T07:31:44.456441+0000","last_peered":"2024-09-21T07:31:44.456441+0000","last_clean":"2024-09-21T07:31:44.456441+0000","last_became_active":"2024-09-21T07:31:43.211533+0000","last_became_peered":"2024-09-21T07:31:43.211533+0000","last_unstale":"2024-09-21T07:31:44.456441+0000","last_undegraded":"2024-09-21T07:31:44.456441+0000","last_fullsized":"2024-09-21T07:31:44.456441+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:56.469710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454119+0000","last_change":"2024-09-21T07:31:43.206204+0000","last_active":"2024-09-21T07:31:44.454119+0000","last_peered":"2024-09-21T07:31:44.454119+0000","last_clean":"2024-09-21T07:31:44.454119+0000","last_became_active":"2024-09-21T07:31:43.205782+0000","last_became_peered":"2024-09-21T07:31:43.205782+0000","last_unstale":"2024-09-21T07:31:44.454119+0000","last_undegraded":"2024-09-21T07:31:44.454119+0000","last_fullsized":"2024-09-21T07:31:44.454119+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.202386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455318+0000","last_change":"2024-09-21T07:31:43.210779+0000","last_active":"2024-09-21T07:31:44.455318+0000","last_peered":"2024-09-21T07:31:44.455318+0000","last_clean":"2024-09-21T07:31:44.455318+0000","last_became_active":"2024-09-21T07:31:43.210040+0000","last_became_peered":"2024-09-21T07:31:43.210040+0000","last_unstale":"2024-09-21T07:31:44.455318+0000","last_undegraded":"2024-09-21T07:31:44.455318+0000","last_fullsized":"2024-09-21T07:31:44.455318+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:54.542451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454325+0000","last_change":"2024-09-21T07:31:43.196813+0000","last_active":"2024-09-21T07:31:44.454325+0000","last_peered":"2024-09-21T07:31:44.454325+0000","last_clean":"2024-09-21T07:31:44.454325+0000","last_became_active":"2024-09-21T07:31:43.196475+0000","last_became_peered":"2024-09-21T07:31:43.196475+0000","last_unstale":"2024-09-21T07:31:44.454325+0000","last_undegraded":"2024-09-21T07:31:44.454325+0000","last_fullsized":"2024-09-21T07:31:44.454325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:59.960142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201175+0000","last_change":"2024-09-21T07:31:43.200761+0000","last_active":"2024-09-21T07:31:44.201175+0000","last_peered":"2024-09-21T07:31:44.201175+0000","last_clean":"2024-09-21T07:31:44.201175+0000","last_became_active":"2024-09-21T07:31:43.200461+0000","last_became_peered":"2024-09-21T07:31:43.200461+0000","last_unstale":"2024-09-21T07:31:44.201175+0000","last_undegraded":"2024-09-21T07:31:44.201175+0000","last_fullsized":"2024-09-21T07:31:44.201175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:15:09.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455392+0000","last_change":"2024-09-21T07:31:43.216115+0000","last_active":"2024-09-21T07:31:44.455392+0000","last_peered":"2024-09-21T07:31:44.455392+0000","last_clean":"2024-09-21T07:31:44.455392+0000","last_became_active":"2024-09-21T07:31:43.211351+0000","last_became_peered":"2024-09-21T07:31:43.211351+0000","last_unstale":"2024-09-21T07:31:44.455392+0000","last_undegraded":"2024-09-21T07:31:44.455392+0000","last_fullsized":"2024-09-21T07:31:44.455392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:51.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.202958+0000","last_change":"2024-09-21T07:31:43.209415+0000","last_active":"2024-09-21T07:31:44.202958+0000","last_peered":"2024-09-21T07:31:44.202958+0000","last_clean":"2024-09-21T07:31:44.202958+0000","last_became_active":"2024-09-21T07:31:43.209019+0000","last_became_peered":"2024-09-21T07:31:43.209019+0000","last_unstale":"2024-09-21T07:31:44.202958+0000","last_undegraded":"2024-09-21T07:31:44.202958+0000","last_fullsized":"2024-09-21T07:31:44.202958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:04.949348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201807+0000","last_change":"2024-09-21T07:31:43.198531+0000","last_active":"2024-09-21T07:31:44.201807+0000","last_peered":"2024-09-21T07:31:44.201807+0000","last_clean":"2024-09-21T07:31:44.201807+0000","last_became_active":"2024-09-21T07:31:43.198230+0000","last_became_peered":"2024-09-21T07:31:43.198230+0000","last_unstale":"2024-09-21T07:31:44.201807+0000","last_undegraded":"2024-09-21T07:31:44.201807+0000","last_fullsized":"2024-09-21T07:31:44.201807+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:47.585361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456367+0000","last_change":"2024-09-21T07:31:43.201134+0000","last_active":"2024-09-21T07:31:44.456367+0000","last_peered":"2024-09-21T07:31:44.456367+0000","last_clean":"2024-09-21T07:31:44.456367+0000","last_became_active":"2024-09-21T07:31:43.200592+0000","last_became_peered":"2024-09-21T07:31:43.200592+0000","last_unstale":"2024-09-21T07:31:44.456367+0000","last_undegraded":"2024-09-21T07:31:44.456367+0000","last_fullsized":"2024-09-21T07:31:44.456367+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:23.322020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455617+0000","last_change":"2024-09-21T07:31:43.208352+0000","last_active":"2024-09-21T07:31:44.455617+0000","last_peered":"2024-09-21T07:31:44.455617+0000","last_clean":"2024-09-21T07:31:44.455617+0000","last_became_active":"2024-09-21T07:31:43.207338+0000","last_became_peered":"2024-09-21T07:31:43.207338+0000","last_unstale":"2024-09-21T07:31:44.455617+0000","last_undegraded":"2024-09-21T07:31:44.455617+0000","last_fullsized":"2024-09-21T07:31:44.455617+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:10.684410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454325+0000","last_change":"2024-09-21T07:31:43.219212+0000","last_active":"2024-09-21T07:31:44.454325+0000","last_peered":"2024-09-21T07:31:44.454325+0000","last_clean":"2024-09-21T07:31:44.454325+0000","last_became_active":"2024-09-21T07:31:43.218879+0000","last_became_peered":"2024-09-21T07:31:43.218879+0000","last_unstale":"2024-09-21T07:31:44.454325+0000","last_undegraded":"2024-09-21T07:31:44.454325+0000","last_fullsized":"2024-09-21T07:31:44.454325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:54.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456017+0000","last_change":"2024-09-21T07:31:43.213764+0000","last_active":"2024-09-21T07:31:44.456017+0000","last_peered":"2024-09-21T07:31:44.456017+0000","last_clean":"2024-09-21T07:31:44.456017+0000","last_became_active":"2024-09-21T07:31:43.213435+0000","last_became_peered":"2024-09-21T07:31:43.213435+0000","last_unstale":"2024-09-21T07:31:44.456017+0000","last_undegraded":"2024-09-21T07:31:44.456017+0000","last_fullsized":"2024-09-21T07:31:44.456017+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:46.132174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456765+0000","last_change":"2024-09-21T07:31:43.220749+0000","last_active":"2024-09-21T07:31:44.456765+0000","last_peered":"2024-09-21T07:31:44.456765+0000","last_clean":"2024-09-21T07:31:44.456765+0000","last_became_active":"2024-09-21T07:31:43.220374+0000","last_became_peered":"2024-09-21T07:31:43.220374+0000","last_unstale":"2024-09-21T07:31:44.456765+0000","last_undegraded":"2024-09-21T07:31:44.456765+0000","last_fullsized":"2024-09-21T07:31:44.456765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:11.442189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454869+0000","last_change":"2024-09-21T07:31:43.213936+0000","last_active":"2024-09-21T07:31:44.454869+0000","last_peered":"2024-09-21T07:31:44.454869+0000","last_clean":"2024-09-21T07:31:44.454869+0000","last_became_active":"2024-09-21T07:31:43.213620+0000","last_became_peered":"2024-09-21T07:31:43.213620+0000","last_unstale":"2024-09-21T07:31:44.454869+0000","last_undegraded":"2024-09-21T07:31:44.454869+0000","last_fullsized":"2024-09-21T07:31:44.454869+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:05.252995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454305+0000","last_change":"2024-09-21T07:31:43.218216+0000","last_active":"2024-09-21T07:31:44.454305+0000","last_peered":"2024-09-21T07:31:44.454305+0000","last_clean":"2024-09-21T07:31:44.454305+0000","last_became_active":"2024-09-21T07:31:43.217893+0000","last_became_peered":"2024-09-21T07:31:43.217893+0000","last_unstale":"2024-09-21T07:31:44.454305+0000","last_undegraded":"2024-09-21T07:31:44.454305+0000","last_fullsized":"2024-09-21T07:31:44.454305+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:33.631559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456621+0000","last_change":"2024-09-21T07:31:43.196720+0000","last_active":"2024-09-21T07:31:44.456621+0000","last_peered":"2024-09-21T07:31:44.456621+0000","last_clean":"2024-09-21T07:31:44.456621+0000","last_became_active":"2024-09-21T07:31:43.196410+0000","last_became_peered":"2024-09-21T07:31:43.196410+0000","last_unstale":"2024-09-21T07:31:44.456621+0000","last_undegraded":"2024-09-21T07:31:44.456621+0000","last_fullsized":"2024-09-21T07:31:44.456621+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:52.681457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456414+0000","last_change":"2024-09-21T07:31:43.204737+0000","last_active":"2024-09-21T07:31:44.456414+0000","last_peered":"2024-09-21T07:31:44.456414+0000","last_clean":"2024-09-21T07:31:44.456414+0000","last_became_active":"2024-09-21T07:31:43.200146+0000","last_became_peered":"2024-09-21T07:31:43.200146+0000","last_unstale":"2024-09-21T07:31:44.456414+0000","last_undegraded":"2024-09-21T07:31:44.456414+0000","last_fullsized":"2024-09-21T07:31:44.456414+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:52.259325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201512+0000","last_change":"2024-09-21T07:31:43.202618+0000","last_active":"2024-09-21T07:31:44.201512+0000","last_peered":"2024-09-21T07:31:44.201512+0000","last_clean":"2024-09-21T07:31:44.201512+0000","last_became_active":"2024-09-21T07:31:43.202314+0000","last_became_peered":"2024-09-21T07:31:43.202314+0000","last_unstale":"2024-09-21T07:31:44.201512+0000","last_undegraded":"2024-09-21T07:31:44.201512+0000","last_fullsized":"2024-09-21T07:31:44.201512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:10.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204673+0000","last_change":"2024-09-21T07:31:43.207404+0000","last_active":"2024-09-21T07:31:44.204673+0000","last_peered":"2024-09-21T07:31:44.204673+0000","last_clean":"2024-09-21T07:31:44.204673+0000","last_became_active":"2024-09-21T07:31:43.204954+0000","last_became_peered":"2024-09-21T07:31:43.204954+0000","last_unstale":"2024-09-21T07:31:44.204673+0000","last_undegraded":"2024-09-21T07:31:44.204673+0000","last_fullsized":"2024-09-21T07:31:44.204673+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201328+0000","last_change":"2024-09-21T07:31:43.202155+0000","last_active":"2024-09-21T07:31:44.201328+0000","last_peered":"2024-09-21T07:31:44.201328+0000","last_clean":"2024-09-21T07:31:44.201328+0000","last_became_active":"2024-09-21T07:31:43.197776+0000","last_became_peered":"2024-09-21T07:31:43.197776+0000","last_unstale":"2024-09-21T07:31:44.201328+0000","last_undegraded":"2024-09-21T07:31:44.201328+0000","last_fullsized":"2024-09-21T07:31:44.201328+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:17.327164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.453949+0000","last_change":"2024-09-21T07:31:43.200434+0000","last_active":"2024-09-21T07:31:44.453949+0000","last_peered":"2024-09-21T07:31:44.453949+0000","last_clean":"2024-09-21T07:31:44.453949+0000","last_became_active":"2024-09-21T07:31:43.199527+0000","last_became_peered":"2024-09-21T07:31:43.199527+0000","last_unstale":"2024-09-21T07:31:44.453949+0000","last_undegraded":"2024-09-21T07:31:44.453949+0000","last_fullsized":"2024-09-21T07:31:44.453949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:22.675127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454644+0000","last_change":"2024-09-21T07:31:43.209340+0000","last_active":"2024-09-21T07:31:44.454644+0000","last_peered":"2024-09-21T07:31:44.454644+0000","last_clean":"2024-09-21T07:31:44.454644+0000","last_became_active":"2024-09-21T07:31:43.209005+0000","last_became_peered":"2024-09-21T07:31:43.209005+0000","last_unstale":"2024-09-21T07:31:44.454644+0000","last_undegraded":"2024-09-21T07:31:44.454644+0000","last_fullsized":"2024-09-21T07:31:44.454644+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.453621+0000","last_change":"2024-09-21T07:31:43.217288+0000","last_active":"2024-09-21T07:31:44.453621+0000","last_peered":"2024-09-21T07:31:44.453621+0000","last_clean":"2024-09-21T07:31:44.453621+0000","last_became_active":"2024-09-21T07:31:43.216915+0000","last_became_peered":"2024-09-21T07:31:43.216915+0000","last_unstale":"2024-09-21T07:31:44.453621+0000","last_undegraded":"2024-09-21T07:31:44.453621+0000","last_fullsized":"2024-09-21T07:31:44.453621+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:59.448490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454736+0000","last_change":"2024-09-21T07:31:43.201318+0000","last_active":"2024-09-21T07:31:44.454736+0000","last_peered":"2024-09-21T07:31:44.454736+0000","last_clean":"2024-09-21T07:31:44.454736+0000","last_became_active":"2024-09-21T07:31:43.200959+0000","last_became_peered":"2024-09-21T07:31:43.200959+0000","last_unstale":"2024-09-21T07:31:44.454736+0000","last_undegraded":"2024-09-21T07:31:44.454736+0000","last_fullsized":"2024-09-21T07:31:44.454736+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:30.591201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455250+0000","last_change":"2024-09-21T07:31:43.216530+0000","last_active":"2024-09-21T07:31:44.455250+0000","last_peered":"2024-09-21T07:31:44.455250+0000","last_clean":"2024-09-21T07:31:44.455250+0000","last_became_active":"2024-09-21T07:31:43.216100+0000","last_became_peered":"2024-09-21T07:31:43.216100+0000","last_unstale":"2024-09-21T07:31:44.455250+0000","last_undegraded":"2024-09-21T07:31:44.455250+0000","last_fullsized":"2024-09-21T07:31:44.455250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:22.675127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455190+0000","last_change":"2024-09-21T07:31:43.220501+0000","last_active":"2024-09-21T07:31:44.455190+0000","last_peered":"2024-09-21T07:31:44.455190+0000","last_clean":"2024-09-21T07:31:44.455190+0000","last_became_active":"2024-09-21T07:31:43.220176+0000","last_became_peered":"2024-09-21T07:31:43.220176+0000","last_unstale":"2024-09-21T07:31:44.455190+0000","last_undegraded":"2024-09-21T07:31:44.455190+0000","last_fullsized":"2024-09-21T07:31:44.455190+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:28.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204102+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.204102+0000","last_peered":"2024-09-21T07:31:44.204102+0000","last_clean":"2024-09-21T07:31:44.204102+0000","last_became_active":"2024-09-21T07:31:43.198205+0000","last_became_peered":"2024-09-21T07:31:43.198205+0000","last_unstale":"2024-09-21T07:31:44.204102+0000","last_undegraded":"2024-09-21T07:31:44.204102+0000","last_fullsized":"2024-09-21T07:31:44.204102+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:19.294694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455085+0000","last_change":"2024-09-21T07:31:43.205699+0000","last_active":"2024-09-21T07:31:44.455085+0000","last_peered":"2024-09-21T07:31:44.455085+0000","last_clean":"2024-09-21T07:31:44.455085+0000","last_became_active":"2024-09-21T07:31:43.205385+0000","last_became_peered":"2024-09-21T07:31:43.205385+0000","last_unstale":"2024-09-21T07:31:44.455085+0000","last_undegraded":"2024-09-21T07:31:44.455085+0000","last_fullsized":"2024-09-21T07:31:44.455085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:09.429866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455088+0000","last_change":"2024-09-21T07:31:43.213229+0000","last_active":"2024-09-21T07:31:44.455088+0000","last_peered":"2024-09-21T07:31:44.455088+0000","last_clean":"2024-09-21T07:31:44.455088+0000","last_became_active":"2024-09-21T07:31:43.211965+0000","last_became_peered":"2024-09-21T07:31:43.211965+0000","last_unstale":"2024-09-21T07:31:44.455088+0000","last_undegraded":"2024-09-21T07:31:44.455088+0000","last_fullsized":"2024-09-21T07:31:44.455088+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:59.960142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454830+0000","last_change":"2024-09-21T07:31:43.204690+0000","last_active":"2024-09-21T07:31:44.454830+0000","last_peered":"2024-09-21T07:31:44.454830+0000","last_clean":"2024-09-21T07:31:44.454830+0000","last_became_active":"2024-09-21T07:31:43.204335+0000","last_became_peered":"2024-09-21T07:31:43.204335+0000","last_unstale":"2024-09-21T07:31:44.454830+0000","last_undegraded":"2024-09-21T07:31:44.454830+0000","last_fullsized":"2024-09-21T07:31:44.454830+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:48.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201958+0000","last_change":"2024-09-21T07:31:43.206145+0000","last_active":"2024-09-21T07:31:44.201958+0000","last_peered":"2024-09-21T07:31:44.201958+0000","last_clean":"2024-09-21T07:31:44.201958+0000","last_became_active":"2024-09-21T07:31:43.205833+0000","last_became_peered":"2024-09-21T07:31:43.205833+0000","last_unstale":"2024-09-21T07:31:44.201958+0000","last_undegraded":"2024-09-21T07:31:44.201958+0000","last_fullsized":"2024-09-21T07:31:44.201958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:49.319149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454769+0000","last_change":"2024-09-21T07:31:43.206805+0000","last_active":"2024-09-21T07:31:44.454769+0000","last_peered":"2024-09-21T07:31:44.454769+0000","last_clean":"2024-09-21T07:31:44.454769+0000","last_became_active":"2024-09-21T07:31:43.206494+0000","last_became_peered":"2024-09-21T07:31:43.206494+0000","last_unstale":"2024-09-21T07:31:44.454769+0000","last_undegraded":"2024-09-21T07:31:44.454769+0000","last_fullsized":"2024-09-21T07:31:44.454769+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.805963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201810+0000","last_change":"2024-09-21T07:31:43.213575+0000","last_active":"2024-09-21T07:31:44.201810+0000","last_peered":"2024-09-21T07:31:44.201810+0000","last_clean":"2024-09-21T07:31:44.201810+0000","last_became_active":"2024-09-21T07:31:43.212759+0000","last_became_peered":"2024-09-21T07:31:43.212759+0000","last_unstale":"2024-09-21T07:31:44.201810+0000","last_undegraded":"2024-09-21T07:31:44.201810+0000","last_fullsized":"2024-09-21T07:31:44.201810+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:58.818570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"141'4","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455279+0000","last_change":"2024-09-21T07:31:42.200172+0000","last_active":"2024-09-21T07:31:44.455279+0000","last_peered":"2024-09-21T07:31:44.455279+0000","last_clean":"2024-09-21T07:31:44.455279+0000","last_became_active":"2024-09-21T07:31:42.196709+0000","last_became_peered":"2024-09-21T07:31:42.196709+0000","last_unstale":"2024-09-21T07:31:44.455279+0000","last_undegraded":"2024-09-21T07:31:44.455279+0000","last_fullsized":"2024-09-21T07:31:44.455279+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:21.878937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454412+0000","last_change":"2024-09-21T07:31:43.205319+0000","last_active":"2024-09-21T07:31:44.454412+0000","last_peered":"2024-09-21T07:31:44.454412+0000","last_clean":"2024-09-21T07:31:44.454412+0000","last_became_active":"2024-09-21T07:31:43.205013+0000","last_became_peered":"2024-09-21T07:31:43.205013+0000","last_unstale":"2024-09-21T07:31:44.454412+0000","last_undegraded":"2024-09-21T07:31:44.454412+0000","last_fullsized":"2024-09-21T07:31:44.454412+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:11.388163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201866+0000","last_change":"2024-09-21T07:31:42.201555+0000","last_active":"2024-09-21T07:31:44.201866+0000","last_peered":"2024-09-21T07:31:44.201866+0000","last_clean":"2024-09-21T07:31:44.201866+0000","last_became_active":"2024-09-21T07:31:42.201250+0000","last_became_peered":"2024-09-21T07:31:42.201250+0000","last_unstale":"2024-09-21T07:31:44.201866+0000","last_undegraded":"2024-09-21T07:31:44.201866+0000","last_fullsized":"2024-09-21T07:31:44.201866+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:29.864925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454460+0000","last_change":"2024-09-21T07:31:43.216404+0000","last_active":"2024-09-21T07:31:44.454460+0000","last_peered":"2024-09-21T07:31:44.454460+0000","last_clean":"2024-09-21T07:31:44.454460+0000","last_became_active":"2024-09-21T07:31:43.216020+0000","last_became_peered":"2024-09-21T07:31:43.216020+0000","last_unstale":"2024-09-21T07:31:44.454460+0000","last_undegraded":"2024-09-21T07:31:44.454460+0000","last_fullsized":"2024-09-21T07:31:44.454460+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:15.986112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204259+0000","last_change":"2024-09-21T07:31:42.204438+0000","last_active":"2024-09-21T07:31:44.204259+0000","last_peered":"2024-09-21T07:31:44.204259+0000","last_clean":"2024-09-21T07:31:44.204259+0000","last_became_active":"2024-09-21T07:31:42.204073+0000","last_became_peered":"2024-09-21T07:31:42.204073+0000","last_unstale":"2024-09-21T07:31:44.204259+0000","last_undegraded":"2024-09-21T07:31:44.204259+0000","last_fullsized":"2024-09-21T07:31:44.204259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455200+0000","last_change":"2024-09-21T07:31:43.217921+0000","last_active":"2024-09-21T07:31:44.455200+0000","last_peered":"2024-09-21T07:31:44.455200+0000","last_clean":"2024-09-21T07:31:44.455200+0000","last_became_active":"2024-09-21T07:31:43.217499+0000","last_became_peered":"2024-09-21T07:31:43.217499+0000","last_unstale":"2024-09-21T07:31:44.455200+0000","last_undegraded":"2024-09-21T07:31:44.455200+0000","last_fullsized":"2024-09-21T07:31:44.455200+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:48.201118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203566+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:44.203566+0000","last_peered":"2024-09-21T07:31:44.203566+0000","last_clean":"2024-09-21T07:31:44.203566+0000","last_became_active":"2024-09-21T07:31:42.205885+0000","last_became_peered":"2024-09-21T07:31:42.205885+0000","last_unstale":"2024-09-21T07:31:44.203566+0000","last_undegraded":"2024-09-21T07:31:44.203566+0000","last_fullsized":"2024-09-21T07:31:44.203566+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.055545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203589+0000","last_change":"2024-09-21T07:31:43.201773+0000","last_active":"2024-09-21T07:31:44.203589+0000","last_peered":"2024-09-21T07:31:44.203589+0000","last_clean":"2024-09-21T07:31:44.203589+0000","last_became_active":"2024-09-21T07:31:43.201474+0000","last_became_peered":"2024-09-21T07:31:43.201474+0000","last_unstale":"2024-09-21T07:31:44.203589+0000","last_undegraded":"2024-09-21T07:31:44.203589+0000","last_fullsized":"2024-09-21T07:31:44.203589+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:45.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203097+0000","last_change":"2024-09-21T07:31:42.204257+0000","last_active":"2024-09-21T07:31:44.203097+0000","last_peered":"2024-09-21T07:31:44.203097+0000","last_clean":"2024-09-21T07:31:44.203097+0000","last_became_active":"2024-09-21T07:31:42.201713+0000","last_became_peered":"2024-09-21T07:31:42.201713+0000","last_unstale":"2024-09-21T07:31:44.203097+0000","last_undegraded":"2024-09-21T07:31:44.203097+0000","last_fullsized":"2024-09-21T07:31:44.203097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:02.177061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204142+0000","last_change":"2024-09-21T07:31:43.205554+0000","last_active":"2024-09-21T07:31:44.204142+0000","last_peered":"2024-09-21T07:31:44.204142+0000","last_clean":"2024-09-21T07:31:44.204142+0000","last_became_active":"2024-09-21T07:31:43.201245+0000","last_became_peered":"2024-09-21T07:31:43.201245+0000","last_unstale":"2024-09-21T07:31:44.204142+0000","last_undegraded":"2024-09-21T07:31:44.204142+0000","last_fullsized":"2024-09-21T07:31:44.204142+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200914+0000","last_change":"2024-09-21T07:31:42.193287+0000","last_active":"2024-09-21T07:31:44.200914+0000","last_peered":"2024-09-21T07:31:44.200914+0000","last_clean":"2024-09-21T07:31:44.200914+0000","last_became_active":"2024-09-21T07:31:42.191431+0000","last_became_peered":"2024-09-21T07:31:42.191431+0000","last_unstale":"2024-09-21T07:31:44.200914+0000","last_undegraded":"2024-09-21T07:31:44.200914+0000","last_fullsized":"2024-09-21T07:31:44.200914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:39.061656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201764+0000","last_change":"2024-09-21T07:31:43.198547+0000","last_active":"2024-09-21T07:31:44.201764+0000","last_peered":"2024-09-21T07:31:44.201764+0000","last_clean":"2024-09-21T07:31:44.201764+0000","last_became_active":"2024-09-21T07:31:43.198244+0000","last_became_peered":"2024-09-21T07:31:43.198244+0000","last_unstale":"2024-09-21T07:31:44.201764+0000","last_undegraded":"2024-09-21T07:31:44.201764+0000","last_fullsized":"2024-09-21T07:31:44.201764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:17.104799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454585+0000","last_change":"2024-09-21T07:31:42.200226+0000","last_active":"2024-09-21T07:31:44.454585+0000","last_peered":"2024-09-21T07:31:44.454585+0000","last_clean":"2024-09-21T07:31:44.454585+0000","last_became_active":"2024-09-21T07:31:42.199918+0000","last_became_peered":"2024-09-21T07:31:42.199918+0000","last_unstale":"2024-09-21T07:31:44.454585+0000","last_undegraded":"2024-09-21T07:31:44.454585+0000","last_fullsized":"2024-09-21T07:31:44.454585+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:22.280352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204212+0000","last_change":"2024-09-21T07:31:43.204756+0000","last_active":"2024-09-21T07:31:44.204212+0000","last_peered":"2024-09-21T07:31:44.204212+0000","last_clean":"2024-09-21T07:31:44.204212+0000","last_became_active":"2024-09-21T07:31:43.204410+0000","last_became_peered":"2024-09-21T07:31:43.204410+0000","last_unstale":"2024-09-21T07:31:44.204212+0000","last_undegraded":"2024-09-21T07:31:44.204212+0000","last_fullsized":"2024-09-21T07:31:44.204212+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.450486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454254+0000","last_change":"2024-09-21T07:31:42.195562+0000","last_active":"2024-09-21T07:31:44.454254+0000","last_peered":"2024-09-21T07:31:44.454254+0000","last_clean":"2024-09-21T07:31:44.454254+0000","last_became_active":"2024-09-21T07:31:42.194585+0000","last_became_peered":"2024-09-21T07:31:42.194585+0000","last_unstale":"2024-09-21T07:31:44.454254+0000","last_undegraded":"2024-09-21T07:31:44.454254+0000","last_fullsized":"2024-09-21T07:31:44.454254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:06.141605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454353+0000","last_change":"2024-09-21T07:31:43.215071+0000","last_active":"2024-09-21T07:31:44.454353+0000","last_peered":"2024-09-21T07:31:44.454353+0000","last_clean":"2024-09-21T07:31:44.454353+0000","last_became_active":"2024-09-21T07:31:43.214533+0000","last_became_peered":"2024-09-21T07:31:43.214533+0000","last_unstale":"2024-09-21T07:31:44.454353+0000","last_undegraded":"2024-09-21T07:31:44.454353+0000","last_fullsized":"2024-09-21T07:31:44.454353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:46.099494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454168+0000","last_change":"2024-09-21T07:31:42.199145+0000","last_active":"2024-09-21T07:31:44.454168+0000","last_peered":"2024-09-21T07:31:44.454168+0000","last_clean":"2024-09-21T07:31:44.454168+0000","last_became_active":"2024-09-21T07:31:42.198831+0000","last_became_peered":"2024-09-21T07:31:42.198831+0000","last_unstale":"2024-09-21T07:31:44.454168+0000","last_undegraded":"2024-09-21T07:31:44.454168+0000","last_fullsized":"2024-09-21T07:31:44.454168+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:13.405487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454819+0000","last_change":"2024-09-21T07:31:43.195614+0000","last_active":"2024-09-21T07:31:44.454819+0000","last_peered":"2024-09-21T07:31:44.454819+0000","last_clean":"2024-09-21T07:31:44.454819+0000","last_became_active":"2024-09-21T07:31:43.195303+0000","last_became_peered":"2024-09-21T07:31:43.195303+0000","last_unstale":"2024-09-21T07:31:44.454819+0000","last_undegraded":"2024-09-21T07:31:44.454819+0000","last_fullsized":"2024-09-21T07:31:44.454819+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:05.177194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456269+0000","last_change":"2024-09-21T07:31:42.201351+0000","last_active":"2024-09-21T07:31:44.456269+0000","last_peered":"2024-09-21T07:31:44.456269+0000","last_clean":"2024-09-21T07:31:44.456269+0000","last_became_active":"2024-09-21T07:31:42.200685+0000","last_became_peered":"2024-09-21T07:31:42.200685+0000","last_unstale":"2024-09-21T07:31:44.456269+0000","last_undegraded":"2024-09-21T07:31:44.456269+0000","last_fullsized":"2024-09-21T07:31:44.456269+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:40.715480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454975+0000","last_change":"2024-09-21T07:31:43.222136+0000","last_active":"2024-09-21T07:31:44.454975+0000","last_peered":"2024-09-21T07:31:44.454975+0000","last_clean":"2024-09-21T07:31:44.454975+0000","last_became_active":"2024-09-21T07:31:43.221240+0000","last_became_peered":"2024-09-21T07:31:43.221240+0000","last_unstale":"2024-09-21T07:31:44.454975+0000","last_undegraded":"2024-09-21T07:31:44.454975+0000","last_fullsized":"2024-09-21T07:31:44.454975+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.202386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204430+0000","last_change":"2024-09-21T07:31:42.206037+0000","last_active":"2024-09-21T07:31:44.204430+0000","last_peered":"2024-09-21T07:31:44.204430+0000","last_clean":"2024-09-21T07:31:44.204430+0000","last_became_active":"2024-09-21T07:31:42.203832+0000","last_became_peered":"2024-09-21T07:31:42.203832+0000","last_unstale":"2024-09-21T07:31:44.204430+0000","last_undegraded":"2024-09-21T07:31:44.204430+0000","last_fullsized":"2024-09-21T07:31:44.204430+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:38.570431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455060+0000","last_change":"2024-09-21T07:31:43.210102+0000","last_active":"2024-09-21T07:31:44.455060+0000","last_peered":"2024-09-21T07:31:44.455060+0000","last_clean":"2024-09-21T07:31:44.455060+0000","last_became_active":"2024-09-21T07:31:43.209714+0000","last_became_peered":"2024-09-21T07:31:43.209714+0000","last_unstale":"2024-09-21T07:31:44.455060+0000","last_undegraded":"2024-09-21T07:31:44.455060+0000","last_fullsized":"2024-09-21T07:31:44.455060+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:34.221433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'6","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203701+0000","last_change":"2024-09-21T07:31:42.205466+0000","last_active":"2024-09-21T07:31:44.203701+0000","last_peered":"2024-09-21T07:31:44.203701+0000","last_clean":"2024-09-21T07:31:44.203701+0000","last_became_active":"2024-09-21T07:31:42.205141+0000","last_became_peered":"2024-09-21T07:31:42.205141+0000","last_unstale":"2024-09-21T07:31:44.203701+0000","last_undegraded":"2024-09-21T07:31:44.203701+0000","last_fullsized":"2024-09-21T07:31:44.203701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:30.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455085+0000","last_change":"2024-09-21T07:31:43.217086+0000","last_active":"2024-09-21T07:31:44.455085+0000","last_peered":"2024-09-21T07:31:44.455085+0000","last_clean":"2024-09-21T07:31:44.455085+0000","last_became_active":"2024-09-21T07:31:43.216770+0000","last_became_peered":"2024-09-21T07:31:43.216770+0000","last_unstale":"2024-09-21T07:31:44.455085+0000","last_undegraded":"2024-09-21T07:31:44.455085+0000","last_fullsized":"2024-09-21T07:31:44.455085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:33.203500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456248+0000","last_change":"2024-09-21T07:31:42.201759+0000","last_active":"2024-09-21T07:31:44.456248+0000","last_peered":"2024-09-21T07:31:44.456248+0000","last_clean":"2024-09-21T07:31:44.456248+0000","last_became_active":"2024-09-21T07:31:42.201481+0000","last_became_peered":"2024-09-21T07:31:42.201481+0000","last_unstale":"2024-09-21T07:31:44.456248+0000","last_undegraded":"2024-09-21T07:31:44.456248+0000","last_fullsized":"2024-09-21T07:31:44.456248+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:46.777682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204410+0000","last_change":"2024-09-21T07:31:43.200818+0000","last_active":"2024-09-21T07:31:44.204410+0000","last_peered":"2024-09-21T07:31:44.204410+0000","last_clean":"2024-09-21T07:31:44.204410+0000","last_became_active":"2024-09-21T07:31:43.197016+0000","last_became_peered":"2024-09-21T07:31:43.197016+0000","last_unstale":"2024-09-21T07:31:44.204410+0000","last_undegraded":"2024-09-21T07:31:44.204410+0000","last_fullsized":"2024-09-21T07:31:44.204410+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:07.329545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454602+0000","last_change":"2024-09-21T07:31:42.197621+0000","last_active":"2024-09-21T07:31:44.454602+0000","last_peered":"2024-09-21T07:31:44.454602+0000","last_clean":"2024-09-21T07:31:44.454602+0000","last_became_active":"2024-09-21T07:31:42.197293+0000","last_became_peered":"2024-09-21T07:31:42.197293+0000","last_unstale":"2024-09-21T07:31:44.454602+0000","last_undegraded":"2024-09-21T07:31:44.454602+0000","last_fullsized":"2024-09-21T07:31:44.454602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:40.167532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201893+0000","last_change":"2024-09-21T07:31:43.203200+0000","last_active":"2024-09-21T07:31:44.201893+0000","last_peered":"2024-09-21T07:31:44.201893+0000","last_clean":"2024-09-21T07:31:44.201893+0000","last_became_active":"2024-09-21T07:31:43.202799+0000","last_became_peered":"2024-09-21T07:31:43.202799+0000","last_unstale":"2024-09-21T07:31:44.201893+0000","last_undegraded":"2024-09-21T07:31:44.201893+0000","last_fullsized":"2024-09-21T07:31:44.201893+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:54.217026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"141'8","reported_seq":23,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454921+0000","last_change":"2024-09-21T07:31:42.206249+0000","last_active":"2024-09-21T07:31:44.454921+0000","last_peered":"2024-09-21T07:31:44.454921+0000","last_clean":"2024-09-21T07:31:44.454921+0000","last_became_active":"2024-09-21T07:31:42.205957+0000","last_became_peered":"2024-09-21T07:31:42.205957+0000","last_unstale":"2024-09-21T07:31:44.454921+0000","last_undegraded":"2024-09-21T07:31:44.454921+0000","last_fullsized":"2024-09-21T07:31:44.454921+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:14.351804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454367+0000","last_change":"2024-09-21T07:31:43.206673+0000","last_active":"2024-09-21T07:31:44.454367+0000","last_peered":"2024-09-21T07:31:44.454367+0000","last_clean":"2024-09-21T07:31:44.454367+0000","last_became_active":"2024-09-21T07:31:43.206338+0000","last_became_peered":"2024-09-21T07:31:43.206338+0000","last_unstale":"2024-09-21T07:31:44.454367+0000","last_undegraded":"2024-09-21T07:31:44.454367+0000","last_fullsized":"2024-09-21T07:31:44.454367+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:20.378194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454303+0000","last_change":"2024-09-21T07:31:42.206979+0000","last_active":"2024-09-21T07:31:44.454303+0000","last_peered":"2024-09-21T07:31:44.454303+0000","last_clean":"2024-09-21T07:31:44.454303+0000","last_became_active":"2024-09-21T07:31:42.205033+0000","last_became_peered":"2024-09-21T07:31:42.205033+0000","last_unstale":"2024-09-21T07:31:44.454303+0000","last_undegraded":"2024-09-21T07:31:44.454303+0000","last_fullsized":"2024-09-21T07:31:44.454303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:53.605750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203201+0000","last_change":"2024-09-21T07:31:43.208386+0000","last_active":"2024-09-21T07:31:44.203201+0000","last_peered":"2024-09-21T07:31:44.203201+0000","last_clean":"2024-09-21T07:31:44.203201+0000","last_became_active":"2024-09-21T07:31:43.198413+0000","last_became_peered":"2024-09-21T07:31:43.198413+0000","last_unstale":"2024-09-21T07:31:44.203201+0000","last_undegraded":"2024-09-21T07:31:44.203201+0000","last_fullsized":"2024-09-21T07:31:44.203201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:36.237710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455071+0000","last_change":"2024-09-21T07:31:42.197122+0000","last_active":"2024-09-21T07:31:44.455071+0000","last_peered":"2024-09-21T07:31:44.455071+0000","last_clean":"2024-09-21T07:31:44.455071+0000","last_became_active":"2024-09-21T07:31:42.196623+0000","last_became_peered":"2024-09-21T07:31:42.196623+0000","last_unstale":"2024-09-21T07:31:44.455071+0000","last_undegraded":"2024-09-21T07:31:44.455071+0000","last_fullsized":"2024-09-21T07:31:44.455071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:43.828685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203399+0000","last_change":"2024-09-21T07:31:43.199077+0000","last_active":"2024-09-21T07:31:44.203399+0000","last_peered":"2024-09-21T07:31:44.203399+0000","last_clean":"2024-09-21T07:31:44.203399+0000","last_became_active":"2024-09-21T07:31:43.197979+0000","last_became_peered":"2024-09-21T07:31:43.197979+0000","last_unstale":"2024-09-21T07:31:44.203399+0000","last_undegraded":"2024-09-21T07:31:44.203399+0000","last_fullsized":"2024-09-21T07:31:44.203399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:30.777821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"141'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456003+0000","last_change":"2024-09-21T07:31:42.198827+0000","last_active":"2024-09-21T07:31:44.456003+0000","last_peered":"2024-09-21T07:31:44.456003+0000","last_clean":"2024-09-21T07:31:44.456003+0000","last_became_active":"2024-09-21T07:31:42.198504+0000","last_became_peered":"2024-09-21T07:31:42.198504+0000","last_unstale":"2024-09-21T07:31:44.456003+0000","last_undegraded":"2024-09-21T07:31:44.456003+0000","last_fullsized":"2024-09-21T07:31:44.456003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:26.895765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455081+0000","last_change":"2024-09-21T07:31:43.212424+0000","last_active":"2024-09-21T07:31:44.455081+0000","last_peered":"2024-09-21T07:31:44.455081+0000","last_clean":"2024-09-21T07:31:44.455081+0000","last_became_active":"2024-09-21T07:31:43.212022+0000","last_became_peered":"2024-09-21T07:31:43.212022+0000","last_unstale":"2024-09-21T07:31:44.455081+0000","last_undegraded":"2024-09-21T07:31:44.455081+0000","last_fullsized":"2024-09-21T07:31:44.455081+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:45.131312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201428+0000","last_change":"2024-09-21T07:31:42.193312+0000","last_active":"2024-09-21T07:31:44.201428+0000","last_peered":"2024-09-21T07:31:44.201428+0000","last_clean":"2024-09-21T07:31:44.201428+0000","last_became_active":"2024-09-21T07:31:42.193006+0000","last_became_peered":"2024-09-21T07:31:42.193006+0000","last_unstale":"2024-09-21T07:31:44.201428+0000","last_undegraded":"2024-09-21T07:31:44.201428+0000","last_fullsized":"2024-09-21T07:31:44.201428+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.543073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201332+0000","last_change":"2024-09-21T07:31:43.218832+0000","last_active":"2024-09-21T07:31:44.201332+0000","last_peered":"2024-09-21T07:31:44.201332+0000","last_clean":"2024-09-21T07:31:44.201332+0000","last_became_active":"2024-09-21T07:31:43.218460+0000","last_became_peered":"2024-09-21T07:31:43.218460+0000","last_unstale":"2024-09-21T07:31:44.201332+0000","last_undegraded":"2024-09-21T07:31:44.201332+0000","last_fullsized":"2024-09-21T07:31:44.201332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:13.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203241+0000","last_change":"2024-09-21T07:31:42.200966+0000","last_active":"2024-09-21T07:31:44.203241+0000","last_peered":"2024-09-21T07:31:44.203241+0000","last_clean":"2024-09-21T07:31:44.203241+0000","last_became_active":"2024-09-21T07:31:42.200644+0000","last_became_peered":"2024-09-21T07:31:42.200644+0000","last_unstale":"2024-09-21T07:31:44.203241+0000","last_undegraded":"2024-09-21T07:31:44.203241+0000","last_fullsized":"2024-09-21T07:31:44.203241+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:25.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456008+0000","last_change":"2024-09-21T07:31:43.218434+0000","last_active":"2024-09-21T07:31:44.456008+0000","last_peered":"2024-09-21T07:31:44.456008+0000","last_clean":"2024-09-21T07:31:44.456008+0000","last_became_active":"2024-09-21T07:31:43.217634+0000","last_became_peered":"2024-09-21T07:31:43.217634+0000","last_unstale":"2024-09-21T07:31:44.456008+0000","last_undegraded":"2024-09-21T07:31:44.456008+0000","last_fullsized":"2024-09-21T07:31:44.456008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:58.068501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455182+0000","last_change":"2024-09-21T07:31:42.198900+0000","last_active":"2024-09-21T07:31:44.455182+0000","last_peered":"2024-09-21T07:31:44.455182+0000","last_clean":"2024-09-21T07:31:44.455182+0000","last_became_active":"2024-09-21T07:31:42.198609+0000","last_became_peered":"2024-09-21T07:31:42.198609+0000","last_unstale":"2024-09-21T07:31:44.455182+0000","last_undegraded":"2024-09-21T07:31:44.455182+0000","last_fullsized":"2024-09-21T07:31:44.455182+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:39.462075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201800+0000","last_change":"2024-09-21T07:31:43.223681+0000","last_active":"2024-09-21T07:31:44.201800+0000","last_peered":"2024-09-21T07:31:44.201800+0000","last_clean":"2024-09-21T07:31:44.201800+0000","last_became_active":"2024-09-21T07:31:43.223168+0000","last_became_peered":"2024-09-21T07:31:43.223168+0000","last_unstale":"2024-09-21T07:31:44.201800+0000","last_undegraded":"2024-09-21T07:31:44.201800+0000","last_fullsized":"2024-09-21T07:31:44.201800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.192072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203313+0000","last_change":"2024-09-21T07:31:42.202955+0000","last_active":"2024-09-21T07:31:44.203313+0000","last_peered":"2024-09-21T07:31:44.203313+0000","last_clean":"2024-09-21T07:31:44.203313+0000","last_became_active":"2024-09-21T07:31:42.202131+0000","last_became_peered":"2024-09-21T07:31:42.202131+0000","last_unstale":"2024-09-21T07:31:44.203313+0000","last_undegraded":"2024-09-21T07:31:44.203313+0000","last_fullsized":"2024-09-21T07:31:44.203313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:53.777898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454145+0000","last_change":"2024-09-21T07:31:43.219689+0000","last_active":"2024-09-21T07:31:44.454145+0000","last_peered":"2024-09-21T07:31:44.454145+0000","last_clean":"2024-09-21T07:31:44.454145+0000","last_became_active":"2024-09-21T07:31:43.219102+0000","last_became_peered":"2024-09-21T07:31:43.219102+0000","last_unstale":"2024-09-21T07:31:44.454145+0000","last_undegraded":"2024-09-21T07:31:44.454145+0000","last_fullsized":"2024-09-21T07:31:44.454145+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:54.542451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455044+0000","last_change":"2024-09-21T07:31:42.203033+0000","last_active":"2024-09-21T07:31:44.455044+0000","last_peered":"2024-09-21T07:31:44.455044+0000","last_clean":"2024-09-21T07:31:44.455044+0000","last_became_active":"2024-09-21T07:31:42.201986+0000","last_became_peered":"2024-09-21T07:31:42.201986+0000","last_unstale":"2024-09-21T07:31:44.455044+0000","last_undegraded":"2024-09-21T07:31:44.455044+0000","last_fullsized":"2024-09-21T07:31:44.455044+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:18.148419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201005+0000","last_change":"2024-09-21T07:31:43.198116+0000","last_active":"2024-09-21T07:31:44.201005+0000","last_peered":"2024-09-21T07:31:44.201005+0000","last_clean":"2024-09-21T07:31:44.201005+0000","last_became_active":"2024-09-21T07:31:43.197788+0000","last_became_peered":"2024-09-21T07:31:43.197788+0000","last_unstale":"2024-09-21T07:31:44.201005+0000","last_undegraded":"2024-09-21T07:31:44.201005+0000","last_fullsized":"2024-09-21T07:31:44.201005+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:43.668645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"141'2","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.456250+0000","last_change":"2024-09-21T07:31:42.201119+0000","last_active":"2024-09-21T07:31:44.456250+0000","last_peered":"2024-09-21T07:31:44.456250+0000","last_clean":"2024-09-21T07:31:44.456250+0000","last_became_active":"2024-09-21T07:31:42.200597+0000","last_became_peered":"2024-09-21T07:31:42.200597+0000","last_unstale":"2024-09-21T07:31:44.456250+0000","last_undegraded":"2024-09-21T07:31:44.456250+0000","last_fullsized":"2024-09-21T07:31:44.456250+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:12.687949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.454336+0000","last_change":"2024-09-21T07:31:43.204962+0000","last_active":"2024-09-21T07:31:44.454336+0000","last_peered":"2024-09-21T07:31:44.454336+0000","last_clean":"2024-09-21T07:31:44.454336+0000","last_became_active":"2024-09-21T07:31:43.204549+0000","last_became_peered":"2024-09-21T07:31:43.204549+0000","last_unstale":"2024-09-21T07:31:44.454336+0000","last_undegraded":"2024-09-21T07:31:44.454336+0000","last_fullsized":"2024-09-21T07:31:44.454336+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"142'1","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.205016+0000","last_change":"2024-09-21T07:31:42.201192+0000","last_active":"2024-09-21T07:31:44.205016+0000","last_peered":"2024-09-21T07:31:44.205016+0000","last_clean":"2024-09-21T07:31:44.205016+0000","last_became_active":"2024-09-21T07:31:42.200812+0000","last_became_peered":"2024-09-21T07:31:42.200812+0000","last_unstale":"2024-09-21T07:31:44.205016+0000","last_undegraded":"2024-09-21T07:31:44.205016+0000","last_fullsized":"2024-09-21T07:31:44.205016+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:50.224050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203045+0000","last_change":"2024-09-21T07:31:43.211386+0000","last_active":"2024-09-21T07:31:44.203045+0000","last_peered":"2024-09-21T07:31:44.203045+0000","last_clean":"2024-09-21T07:31:44.203045+0000","last_became_active":"2024-09-21T07:31:43.210997+0000","last_became_peered":"2024-09-21T07:31:43.210997+0000","last_unstale":"2024-09-21T07:31:44.203045+0000","last_undegraded":"2024-09-21T07:31:44.203045+0000","last_fullsized":"2024-09-21T07:31:44.203045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:07.022916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204396+0000","last_change":"2024-09-21T07:31:42.191103+0000","last_active":"2024-09-21T07:31:44.204396+0000","last_peered":"2024-09-21T07:31:44.204396+0000","last_clean":"2024-09-21T07:31:44.204396+0000","last_became_active":"2024-09-21T07:31:42.190771+0000","last_became_peered":"2024-09-21T07:31:42.190771+0000","last_unstale":"2024-09-21T07:31:44.204396+0000","last_undegraded":"2024-09-21T07:31:44.204396+0000","last_fullsized":"2024-09-21T07:31:44.204396+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:54.404438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455324+0000","last_change":"2024-09-21T07:31:43.207472+0000","last_active":"2024-09-21T07:31:44.455324+0000","last_peered":"2024-09-21T07:31:44.455324+0000","last_clean":"2024-09-21T07:31:44.455324+0000","last_became_active":"2024-09-21T07:31:43.207146+0000","last_became_peered":"2024-09-21T07:31:43.207146+0000","last_unstale":"2024-09-21T07:31:44.455324+0000","last_undegraded":"2024-09-21T07:31:44.455324+0000","last_fullsized":"2024-09-21T07:31:44.455324+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:22.476820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455590+0000","last_change":"2024-09-21T07:31:42.203052+0000","last_active":"2024-09-21T07:31:44.455590+0000","last_peered":"2024-09-21T07:31:44.455590+0000","last_clean":"2024-09-21T07:31:44.455590+0000","last_became_active":"2024-09-21T07:31:42.202728+0000","last_became_peered":"2024-09-21T07:31:42.202728+0000","last_unstale":"2024-09-21T07:31:44.455590+0000","last_undegraded":"2024-09-21T07:31:44.455590+0000","last_fullsized":"2024-09-21T07:31:44.455590+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:03.768411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455442+0000","last_change":"2024-09-21T07:31:43.219491+0000","last_active":"2024-09-21T07:31:44.455442+0000","last_peered":"2024-09-21T07:31:44.455442+0000","last_clean":"2024-09-21T07:31:44.455442+0000","last_became_active":"2024-09-21T07:31:43.219149+0000","last_became_peered":"2024-09-21T07:31:43.219149+0000","last_unstale":"2024-09-21T07:31:44.455442+0000","last_undegraded":"2024-09-21T07:31:44.455442+0000","last_fullsized":"2024-09-21T07:31:44.455442+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:16.091656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.453894+0000","last_change":"2024-09-21T07:31:42.203098+0000","last_active":"2024-09-21T07:31:44.453894+0000","last_peered":"2024-09-21T07:31:44.453894+0000","last_clean":"2024-09-21T07:31:44.453894+0000","last_became_active":"2024-09-21T07:31:42.202765+0000","last_became_peered":"2024-09-21T07:31:42.202765+0000","last_unstale":"2024-09-21T07:31:44.453894+0000","last_undegraded":"2024-09-21T07:31:44.453894+0000","last_fullsized":"2024-09-21T07:31:44.453894+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:34.359937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455812+0000","last_change":"2024-09-21T07:31:43.216691+0000","last_active":"2024-09-21T07:31:44.455812+0000","last_peered":"2024-09-21T07:31:44.455812+0000","last_clean":"2024-09-21T07:31:44.455812+0000","last_became_active":"2024-09-21T07:31:43.210843+0000","last_became_peered":"2024-09-21T07:31:43.210843+0000","last_unstale":"2024-09-21T07:31:44.455812+0000","last_undegraded":"2024-09-21T07:31:44.455812+0000","last_fullsized":"2024-09-21T07:31:44.455812+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:53.565012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203480+0000","last_change":"2024-09-21T07:31:42.202533+0000","last_active":"2024-09-21T07:31:44.203480+0000","last_peered":"2024-09-21T07:31:44.203480+0000","last_clean":"2024-09-21T07:31:44.203480+0000","last_became_active":"2024-09-21T07:31:42.202197+0000","last_became_peered":"2024-09-21T07:31:42.202197+0000","last_unstale":"2024-09-21T07:31:44.203480+0000","last_undegraded":"2024-09-21T07:31:44.203480+0000","last_fullsized":"2024-09-21T07:31:44.203480+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:37.553016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455859+0000","last_change":"2024-09-21T07:31:43.209542+0000","last_active":"2024-09-21T07:31:44.455859+0000","last_peered":"2024-09-21T07:31:44.455859+0000","last_clean":"2024-09-21T07:31:44.455859+0000","last_became_active":"2024-09-21T07:31:43.209156+0000","last_became_peered":"2024-09-21T07:31:43.209156+0000","last_unstale":"2024-09-21T07:31:44.455859+0000","last_undegraded":"2024-09-21T07:31:44.455859+0000","last_fullsized":"2024-09-21T07:31:44.455859+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:22.256732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455035+0000","last_change":"2024-09-21T07:31:42.205335+0000","last_active":"2024-09-21T07:31:44.455035+0000","last_peered":"2024-09-21T07:31:44.455035+0000","last_clean":"2024-09-21T07:31:44.455035+0000","last_became_active":"2024-09-21T07:31:42.204950+0000","last_became_peered":"2024-09-21T07:31:42.204950+0000","last_unstale":"2024-09-21T07:31:44.455035+0000","last_undegraded":"2024-09-21T07:31:44.455035+0000","last_fullsized":"2024-09-21T07:31:44.455035+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:51.824143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.204871+0000","last_change":"2024-09-21T07:31:43.222761+0000","last_active":"2024-09-21T07:31:44.204871+0000","last_peered":"2024-09-21T07:31:44.204871+0000","last_clean":"2024-09-21T07:31:44.204871+0000","last_became_active":"2024-09-21T07:31:43.222402+0000","last_became_peered":"2024-09-21T07:31:43.222402+0000","last_unstale":"2024-09-21T07:31:44.204871+0000","last_undegraded":"2024-09-21T07:31:44.204871+0000","last_fullsized":"2024-09-21T07:31:44.204871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:53.219206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.200936+0000","last_change":"2024-09-21T07:31:42.191216+0000","last_active":"2024-09-21T07:31:44.200936+0000","last_peered":"2024-09-21T07:31:44.200936+0000","last_clean":"2024-09-21T07:31:44.200936+0000","last_became_active":"2024-09-21T07:31:42.188915+0000","last_became_peered":"2024-09-21T07:31:42.188915+0000","last_unstale":"2024-09-21T07:31:44.200936+0000","last_undegraded":"2024-09-21T07:31:44.200936+0000","last_fullsized":"2024-09-21T07:31:44.200936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:17.056742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.455205+0000","last_change":"2024-09-21T07:31:43.211962+0000","last_active":"2024-09-21T07:31:44.455205+0000","last_peered":"2024-09-21T07:31:44.455205+0000","last_clean":"2024-09-21T07:31:44.455205+0000","last_became_active":"2024-09-21T07:31:43.210463+0000","last_became_peered":"2024-09-21T07:31:43.210463+0000","last_unstale":"2024-09-21T07:31:44.455205+0000","last_undegraded":"2024-09-21T07:31:44.455205+0000","last_fullsized":"2024-09-21T07:31:44.455205+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:42.167651+0000","last_clean_scrub_stamp":"2024-09-21T07:31:42.167651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:14.935671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.203188+0000","last_change":"2024-09-21T07:31:42.203466+0000","last_active":"2024-09-21T07:31:44.203188+0000","last_peered":"2024-09-21T07:31:44.203188+0000","last_clean":"2024-09-21T07:31:44.203188+0000","last_became_active":"2024-09-21T07:31:42.202670+0000","last_became_peered":"2024-09-21T07:31:42.202670+0000","last_unstale":"2024-09-21T07:31:44.203188+0000","last_undegraded":"2024-09-21T07:31:44.203188+0000","last_fullsized":"2024-09-21T07:31:44.203188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:31:41.164720+0000","last_clean_scrub_stamp":"2024-09-21T07:31:41.164720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.404373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T07:31:44.201989+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:31:44.201989+0000","last_peered":"2024-09-21T07:31:44.201989+0000","last_clean":"2024-09-21T07:31:44.201989+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:31:44.201989+0000","last_undegraded":"2024-09-21T07:31:44.201989+0000","last_fullsized":"2024-09-21T07:31:44.201989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46816,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325024,"statfs":{"total":96636764160,"available":96588824576,"internally_reserved":0,"allocated":1773568,"data_stored":832841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509554,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46812,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325028,"statfs":{"total":96636764160,"available":96588828672,"internally_reserved":0,"allocated":1769472,"data_stored":832191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55128,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316712,"statfs":{"total":96636764160,"available":96580313088,"internally_reserved":0,"allocated":1765376,"data_stored":832169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509554,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50968,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320872,"statfs":{"total":96636764160,"available":96584572928,"internally_reserved":0,"allocated":1773568,"data_stored":832785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50968,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320872,"statfs":{"total":96636764160,"available":96584572928,"internally_reserved":0,"allocated":1769472,"data_stored":832239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509554,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51548,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320292,"statfs":{"total":96636764160,"available":96583979008,"internally_reserved":0,"allocated":2367488,"data_stored":1422593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2375680,"data_stored":1424239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1781760,"data_stored":833851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:31:52.483 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:31:52.483 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:31:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 -- 172.21.15.64:0/1721721229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 msgr2=0x7fd8400b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 --2- 172.21.15.64:0/1721721229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8400b3ce0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd8400b3130 tx=0x7fd83801ca40 comp rx=0 tx=0).stop 2024-09-21T07:31:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 -- 172.21.15.64:0/1721721229 shutdown_connections 2024-09-21T07:31:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 --2- 172.21.15.64:0/1721721229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8400b3ce0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 --2- 172.21.15.64:0/1721721229 >> v2:172.21.15.90:3300/0 conn(0x7fd8400706c0 0x7fd8400ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 -- 172.21.15.64:0/1721721229 >> 172.21.15.64:0/1721721229 conn(0x7fd8400ccbe0 msgr2=0x7fd8400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:52.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 -- 172.21.15.64:0/1721721229 shutdown_connections 2024-09-21T07:31:52.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.685+0000 7fd848400640 1 -- 172.21.15.64:0/1721721229 wait complete. 2024-09-21T07:31:52.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 Processor -- start 2024-09-21T07:31:52.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- start start 2024-09-21T07:31:52.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd84015ec20 0x7fd8401fc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd840154b10 0x7fd840154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd840168cd0 con 0x7fd8400ca990 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd840168b50 con 0x7fd840154b10 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd840168e50 con 0x7fd84015ec20 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47664/0 (socket says 172.21.15.64:47664) 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 -- 172.21.15.64:0/3654496670 learned_addr learned my addr 172.21.15.64:0/3654496670 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 -- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd84015ec20 msgr2=0x7fd8401fc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd84015ec20 0x7fd8401fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 -- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd840154b10 msgr2=0x7fd840154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd840154b10 0x7fd840154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 -- 172.21.15.64:0/3654496670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8400cc8a0 con 0x7fd8400ca990 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd845a00640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c400 tx=0x7fd83400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834011790 con 0x7fd8400ca990 2024-09-21T07:31:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd834017070 con 0x7fd8400ca990 2024-09-21T07:31:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8401fca90 con 0x7fd8400ca990 2024-09-21T07:31:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834011cc0 con 0x7fd8400ca990 2024-09-21T07:31:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.689+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd840157390 con 0x7fd8400ca990 2024-09-21T07:31:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8400ce740 con 0x7fd8400ca990 2024-09-21T07:31:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd83401c460 con 0x7fd8400ca990 2024-09-21T07:31:52.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd83d600640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 0x7fd820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:52.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fd8340942a0 con 0x7fd8400ca990 2024-09-21T07:31:52.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd845000640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 0x7fd820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:52.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.693+0000 7fd845000640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 0x7fd820075710 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd8400c7180 tx=0x7fd82c005cf0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:52.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.697+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd83405f090 con 0x7fd8400ca990 2024-09-21T07:31:52.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.937+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd840154840 con 0x7fd8400ca990 2024-09-21T07:31:52.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd83d600640 1 -- 172.21.15.64:0/3654496670 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) ==== 190+0+147 (secure 0 0 0) 0x7fd83405e990 con 0x7fd8400ca990 2024-09-21T07:31:52.942 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:31:52.942 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:31:52.942 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:31:52.943 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:31:52.943 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:31:52.943 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:31:52.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 msgr2=0x7fd820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 0x7fd820075710 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd8400c7180 tx=0x7fd82c005cf0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 msgr2=0x7fd8401567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c400 tx=0x7fd83400c8c0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 shutdown_connections 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd820073200 0x7fd820075710 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd840154b10 0x7fd840154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd84015ec20 0x7fd8401fc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 --2- 172.21.15.64:0/3654496670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8400ca990 0x7fd8401567d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 >> 172.21.15.64:0/3654496670 conn(0x7fd8400ccbe0 msgr2=0x7fd8400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 shutdown_connections 2024-09-21T07:31:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:52.941+0000 7fd848400640 1 -- 172.21.15.64:0/3654496670 wait complete. 2024-09-21T07:31:52.966 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 -- 172.21.15.64:0/3678203236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180b3d60 msgr2=0x7fbf180b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 --2- 172.21.15.64:0/3678203236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180b3d60 0x7fbf180b4170 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fbf180d2290 tx=0x7fbf0401c640 comp rx=0 tx=0).stop 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 -- 172.21.15.64:0/3678203236 shutdown_connections 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 --2- 172.21.15.64:0/3678203236 >> v2:172.21.15.90:3300/0 conn(0x7fbf180c5ea0 0x7fbf180c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 --2- 172.21.15.64:0/3678203236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180b3d60 0x7fbf180b4170 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 -- 172.21.15.64:0/3678203236 >> 172.21.15.64:0/3678203236 conn(0x7fbf1806d1c0 msgr2=0x7fbf1806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 -- 172.21.15.64:0/3678203236 shutdown_connections 2024-09-21T07:31:53.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.121+0000 7fbf1f800640 1 -- 172.21.15.64:0/3678203236 wait complete. 2024-09-21T07:31:53.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 Processor -- start 2024-09-21T07:31:53.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 -- start start 2024-09-21T07:31:53.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf180b3d60 0x7fbf1815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 0x7fbf18151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18169e90 con 0x7fbf180d1d00 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18169d10 con 0x7fbf180c5ea0 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1816a010 con 0x7fbf180b3d60 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47678/0 (socket says 172.21.15.64:47678) 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 -- 172.21.15.64:0/315484003 learned_addr learned my addr 172.21.15.64:0/315484003 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf17e00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 0x7fbf18151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1ce00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf180b3d60 0x7fbf1815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 -- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf180b3d60 msgr2=0x7fbf1815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf180b3d60 0x7fbf1815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 -- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 msgr2=0x7fbf18151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 0x7fbf18151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 -- 172.21.15.64:0/315484003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1815fb00 con 0x7fbf180d1d00 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf17e00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 0x7fbf18151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1d800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000ba10 tx=0x7fbf1000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10019070 con 0x7fbf180d1d00 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf1000cc10 con 0x7fbf180d1d00 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1815db20 con 0x7fbf180d1d00 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.125+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10014440 con 0x7fbf180d1d00 2024-09-21T07:31:53.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1815e0e0 con 0x7fbf180d1d00 2024-09-21T07:31:53.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf180b4170 con 0x7fbf180d1d00 2024-09-21T07:31:53.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf1001c070 con 0x7fbf180d1d00 2024-09-21T07:31:53.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf14c00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 0x7fbef8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fbf10094060 con 0x7fbf180d1d00 2024-09-21T07:31:53.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.129+0000 7fbf1ce00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 0x7fbef8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.133+0000 7fbf1ce00640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 0x7fbef8075710 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00b810 tx=0x7fbf0c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.133+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbf1005eee0 con 0x7fbf180d1d00 2024-09-21T07:31:53.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf18157870 con 0x7fbf180d1d00 2024-09-21T07:31:53.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf14c00640 1 -- 172.21.15.64:0/315484003 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7fbf1005e7e0 con 0x7fbf180d1d00 2024-09-21T07:31:53.350 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:31:53.350 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:31:53.350 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:31:53.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 msgr2=0x7fbef8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 0x7fbef8075710 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00b810 tx=0x7fbf0c008040 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 msgr2=0x7fbf181521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000ba10 tx=0x7fbf1000bed0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 shutdown_connections 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbef8073200 0x7fbef8075710 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf180d1d00 0x7fbf181521c0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf180c5ea0 0x7fbf18151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 --2- 172.21.15.64:0/315484003 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf180b3d60 0x7fbf1815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 >> 172.21.15.64:0/315484003 conn(0x7fbf1806d1c0 msgr2=0x7fbf1806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 shutdown_connections 2024-09-21T07:31:53.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.349+0000 7fbf1f800640 1 -- 172.21.15.64:0/315484003 wait complete. 2024-09-21T07:31:53.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:31:42.604148+0000', 'modified': '2024-09-21T07:31:45.620499+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8574}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8574': {'gid': 8574, 'name': 'c', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/264252124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 264252124}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 264252124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8574, 'qdb_cluster': [8574]} 2024-09-21T07:31:53.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:31:53.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:31:53.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 -- 172.21.15.64:0/348727331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0d0e60 msgr2=0x7f31dc0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 --2- 172.21.15.64:0/348727331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0b4de0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f31dc075260 tx=0x7f31d001c8a0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 -- 172.21.15.64:0/348727331 shutdown_connections 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 --2- 172.21.15.64:0/348727331 >> v2:172.21.15.90:3300/0 conn(0x7f31dc06ee80 0x7f31dc06f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 --2- 172.21.15.64:0/348727331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0b4de0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 -- 172.21.15.64:0/348727331 >> 172.21.15.64:0/348727331 conn(0x7f31dc06d450 msgr2=0x7f31dc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 -- 172.21.15.64:0/348727331 shutdown_connections 2024-09-21T07:31:53.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.937+0000 7f31e3600640 1 -- 172.21.15.64:0/348727331 wait complete. 2024-09-21T07:31:53.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 Processor -- start 2024-09-21T07:31:53.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 -- start start 2024-09-21T07:31:53.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc06ee80 0x7f31dc0c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc16a1f0 con 0x7f31dc0ccd00 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc16a070 con 0x7f31dc0d0e60 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e3600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc16a370 con 0x7f31dc06ee80 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47696/0 (socket says 172.21.15.64:47696) 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 -- 172.21.15.64:0/3216975827 learned_addr learned my addr 172.21.15.64:0/3216975827 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc06ee80 0x7f31dc0c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31e1600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 -- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc06ee80 msgr2=0x7f31dc0c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc06ee80 0x7f31dc0c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 -- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0d0e60 msgr2=0x7f31dc0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.941+0000 7f31dbe00640 1 -- 172.21.15.64:0/3216975827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc0cc730 con 0x7f31dc0ccd00 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f31c800c390 tx=0x7f31c800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31d8c00640 1 -- 172.21.15.64:0/3216975827 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8017070 con 0x7f31dc0ccd00 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31d8c00640 1 -- 172.21.15.64:0/3216975827 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31c80053c0 con 0x7f31dc0ccd00 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31d8c00640 1 -- 172.21.15.64:0/3216975827 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8003840 con 0x7f31dc0ccd00 2024-09-21T07:31:53.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc0caae0 con 0x7f31dc0ccd00 2024-09-21T07:31:53.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc0cb0a0 con 0x7f31dc0ccd00 2024-09-21T07:31:53.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.945+0000 7f31d8c00640 1 -- 172.21.15.64:0/3216975827 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f31c801a070 con 0x7f31dc0ccd00 2024-09-21T07:31:53.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31d8c00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 0x7f31bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31d8c00640 1 -- 172.21.15.64:0/3216975827 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f31c8093670 con 0x7f31dc0ccd00 2024-09-21T07:31:53.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 0x7f31bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 Processor -- start 2024-09-21T07:31:53.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 -- start start 2024-09-21T07:31:53.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 0x7f31bc075740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f31d00af000 tx=0x7f31d001b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 0x55c71f35bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f35c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c71f230410 con 0x55c71ee1a460 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c71f16db40 con 0x55c71f1f3ca0 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c71f15cf70 con 0x55c71f20a950 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47706/0 (socket says 172.21.15.64:47706) 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 -- 172.21.15.64:0/4077034947 learned_addr learned my addr 172.21.15.64:0/4077034947 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 0x55c71f35bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e1600640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f35c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 -- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 msgr2=0x55c71f35c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f35c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 -- 172.21.15.64:0/4077034947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 msgr2=0x55c71f35b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 -- 172.21.15.64:0/4077034947 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c71f1245b0 con 0x55c71f20a950 2024-09-21T07:31:53.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e1600640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f35c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:53.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31e0c00640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:31:53.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31dbe00640 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 0x55c71f35bbe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31c805db10 tx=0x7f31c8001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e37a7f8b70d66d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31cd200640 1 -- 172.21.15.64:0/4077034947 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c805de10 con 0x55c71f20a950 2024-09-21T07:31:53.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31cd200640 1 -- 172.21.15.64:0/4077034947 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31c8062840 con 0x55c71f20a950 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.949+0000 7f31cd200640 1 -- 172.21.15.64:0/4077034947 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c805d270 con 0x55c71f20a950 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 msgr2=0x55c71f35bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 0x55c71f35bbe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31c805db10 tx=0x7f31c8001090 comp rx=0 tx=0).stop 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- 172.21.15.64:0/4077034947 shutdown_connections 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f35c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f20a950 0x55c71f35bbe0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- 172.21.15.64:0/4077034947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f35b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- 172.21.15.64:0/4077034947 >> 172.21.15.64:0/4077034947 conn(0x55c71f2e0d90 msgr2=0x55c71f310690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- 172.21.15.64:0/4077034947 shutdown_connections 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- 172.21.15.64:0/4077034947 wait complete. 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- start start 2024-09-21T07:31:53.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 Processor -- start 2024-09-21T07:31:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f362e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f3633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c71f0f75f0 con 0x55c71ee1a460 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c71f160d80 con 0x55c71f20a950 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c71f103520 con 0x55c71f1f3ca0 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31eacfd000 10 client.0 _ll_register_callbacks cb 0x55c71f107830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47710/0 (socket says 172.21.15.64:47710) 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31e0c00640 1 -- 172.21.15.64:0/3038669620 learned_addr learned my addr 172.21.15.64:0/3038669620 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f362e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.953+0000 7f31e1600640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f3633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 -- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 msgr2=0x55c71f362e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f362e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 -- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 msgr2=0x55c71f3633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f3633a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 -- 172.21.15.64:0/3038669620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c71f0fb190 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009840 tx=0x7f31d00091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86d249cc94c08d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b2040 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c71f0f5110 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f31d0005240 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f31d00d2050 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 10 client.8715 fetch_fsmap learned FSMap version 103 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55c71f1e1f10 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c71f0f5110 con 0x55c71ee1a460 2024-09-21T07:31:53.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f31d00d5020 con 0x55c71ee1a460 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 10 client.8715 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 10 client.8715 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 20 client.8715 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71edff7d0 0x55c71f36cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 4 client.8715 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c71f16fa90 con 0x55c71edff7d0 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71edff7d0 0x55c71f36cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71edff7d0 0x55c71f36cd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f17523c2bd48599 server_cookie=6f3e482d06f19e5c in_seq=0 out_seq=0 2024-09-21T07:31:53.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 10 client.8715 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:31:53.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 1 -- 172.21.15.64:0/3038669620 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c71f16fa90 con 0x55c71edff7d0 2024-09-21T07:31:53.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 10 client.8715 handle_command_reply: tid=0 2024-09-21T07:31:53.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 client.8715 shutdown 2024-09-21T07:31:53.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 msgr2=0x55c71f362920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009840 tx=0x7f31d00091e0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 shutdown_connections 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71edff7d0 0x55c71f36cd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f3633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f362e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3038669620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f362920 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31c1600640 0 client.8715 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 >> 172.21.15.64:0/3038669620 conn(0x55c71f2e0d90 msgr2=0x55c71f317440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 shutdown_connections 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.957+0000 7f31eacfd000 1 -- 172.21.15.64:0/3038669620 wait complete. 2024-09-21T07:31:53.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.961+0000 7f31eacfd000 20 client.8715 trim_cache size 0 max 16384 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.977+0000 7f31eacfd000 1 Processor -- start 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.977+0000 7f31eacfd000 1 -- start start 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 0x55c71f3cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f3cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc205e10 con 0x55c71f20a950 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc204e50 con 0x55c71f1f3ca0 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc1fce80 con 0x55c71ee1a460 2024-09-21T07:31:53.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47718/0 (socket says 172.21.15.64:47718) 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 -- 172.21.15.64:0/3703586986 learned_addr learned my addr 172.21.15.64:0/3703586986 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31dbe00640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f3cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 0x55c71f3cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 -- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 msgr2=0x55c71f3cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 0x55c71f3cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 -- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 msgr2=0x55c71f3cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f3cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 -- 172.21.15.64:0/3703586986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c71f1b8db0 con 0x55c71f20a950 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e0c00640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 0x55c71f3cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31e1600640 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f31d4003cd0 tx=0x7f31d4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec428f34da8948cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31c3e00640 1 -- 172.21.15.64:0/3703586986 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4012450 con 0x55c71f20a950 2024-09-21T07:31:53.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31c3e00640 1 -- 172.21.15.64:0/3703586986 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31d40125f0 con 0x55c71f20a950 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31c3e00640 1 -- 172.21.15.64:0/3703586986 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4012a20 con 0x55c71f20a950 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- 172.21.15.64:0/3703586986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 msgr2=0x55c71f3ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f31d4003cd0 tx=0x7f31d4004410 comp rx=0 tx=0).stop 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- 172.21.15.64:0/3703586986 shutdown_connections 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71f20a950 0x55c71f3ce2c0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f1f3ca0 0x55c71f3cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 --2- 172.21.15.64:0/3703586986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71ee1a460 0x55c71f3cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- 172.21.15.64:0/3703586986 >> 172.21.15.64:0/3703586986 conn(0x55c71f2e0d90 msgr2=0x55c71f30fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- 172.21.15.64:0/3703586986 shutdown_connections 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- 172.21.15.64:0/3703586986 wait complete. 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 -- start start 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.981+0000 7f31eacfd000 1 Processor -- start 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f38d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f38d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c71f1653b0 con 0x55c71ee1a460 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c71f1e1a80 con 0x55c71f20a950 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c71f21c750 con 0x55c71f1f3ca0 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 10 client.0 _ll_register_callbacks cb 0x7f31d00bc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47720/0 (socket says 172.21.15.64:47720) 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 -- 172.21.15.64:0/400382518 learned_addr learned my addr 172.21.15.64:0/400382518 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31dbe00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f38d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e1600640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f38d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 -- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 msgr2=0x55c71f38d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f38d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 -- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 msgr2=0x55c71f38d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f38d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 -- 172.21.15.64:0/400382518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c71f123ab0 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e1600640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f38d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31e0c00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f31d001cd80 tx=0x7f31d0003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01b7d3d190bc02d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003e50 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f31d00c7920 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31d40125f0 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f31d00043e0 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 10 client.8721 fetch_fsmap learned FSMap version 103 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55c71f102070 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31d40125f0 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f31d00d5040 con 0x55c71ee1a460 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 10 client.8721 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:31:53.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 10 client.8721 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:31:53.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 20 client.8721 populate_metadata read hostname 'smithi064' 2024-09-21T07:31:53.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71eded830 0x55c71f3d98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:53.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 4 client.8721 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:31:53.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "status"}) -- 0x55c71f16b540 con 0x55c71eded830 2024-09-21T07:31:53.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.985+0000 7f31dbe00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71eded830 0x55c71f3d98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:53.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31dbe00640 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71eded830 0x55c71f3d98c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da9e6684404d642 server_cookie=ed96684524d938c9 in_seq=0 out_seq=0 2024-09-21T07:31:53.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31c1600640 10 client.8721 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:31:53.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31c1600640 1 -- 172.21.15.64:0/400382518 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55c71f16b540 con 0x55c71eded830 2024-09-21T07:31:53.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31c1600640 10 client.8721 handle_command_reply: tid=0 2024-09-21T07:31:53.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 client.8721 shutdown 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 msgr2=0x55c71f38cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f31d001cd80 tx=0x7f31d0003c60 comp rx=0 tx=0).stop 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 shutdown_connections 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55c71eded830 0x55c71f3d98c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c71f20a950 0x55c71f38d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c71f1f3ca0 0x55c71f38d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31c1600640 0 client.8721 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 --2- 172.21.15.64:0/400382518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c71ee1a460 0x55c71f38cc30 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 >> 172.21.15.64:0/400382518 conn(0x55c71f2e0d90 msgr2=0x55c71f310690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 shutdown_connections 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 1 -- 172.21.15.64:0/400382518 wait complete. 2024-09-21T07:31:53.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31eacfd000 20 client.8721 trim_cache size 0 max 16384 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 8574, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.812170603, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 103, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 142, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 142, 2024-09-21T07:31:53.996 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.197853113000001 2024-09-21T07:31:53.997 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:31:53.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 msgr2=0x7f31bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 0x7f31bc075740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f31d00af000 tx=0x7f31d001b0e0 comp rx=0 tx=0).stop 2024-09-21T07:31:53.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 msgr2=0x7f31dc0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:53.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f31c800c390 tx=0x7f31c800c850 comp rx=0 tx=0).stop 2024-09-21T07:31:53.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 shutdown_connections 2024-09-21T07:31:54.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31bc073230 0x7f31bc075740 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31dc0d0e60 0x7f31dc0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0ccd00 0x7f31dc0cba70 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 --2- 172.21.15.64:0/3216975827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31dc06ee80 0x7f31dc0c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 >> 172.21.15.64:0/3216975827 conn(0x7f31dc06d450 msgr2=0x7f31dc0cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:54.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 shutdown_connections 2024-09-21T07:31:54.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:53.989+0000 7f31e3600640 1 -- 172.21.15.64:0/3216975827 wait complete. 2024-09-21T07:31:54.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:31:54.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 -- 172.21.15.64:0/439597618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b43f0 msgr2=0x7feaec0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:54.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 --2- 172.21.15.64:0/439597618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b43f0 0x7feaec0cd1c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fead4009900 tx=0x7fead401c850 comp rx=0 tx=0).stop 2024-09-21T07:31:54.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 -- 172.21.15.64:0/439597618 shutdown_connections 2024-09-21T07:31:54.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 --2- 172.21.15.64:0/439597618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b43f0 0x7feaec0cd1c0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 -- 172.21.15.64:0/439597618 >> 172.21.15.64:0/439597618 conn(0x7feaec06d480 msgr2=0x7feaec0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:54.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 -- 172.21.15.64:0/439597618 shutdown_connections 2024-09-21T07:31:54.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.165+0000 7feaf2600640 1 -- 172.21.15.64:0/439597618 wait complete. 2024-09-21T07:31:54.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 Processor -- start 2024-09-21T07:31:54.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 -- start start 2024-09-21T07:31:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feaec0d0080 0x7feaec157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec1578b0 0x7feaec1f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feaec16b110 con 0x7feaec0b7a60 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaec16af90 con 0x7feaec1578b0 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaf2600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feaec16b290 con 0x7feaec0d0080 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47740/0 (socket says 172.21.15.64:47740) 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 -- 172.21.15.64:0/2210735242 learned_addr learned my addr 172.21.15.64:0/2210735242 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaebe00640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec1578b0 0x7feaec1f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feae3e00640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feaec0d0080 0x7feaec157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 -- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feaec0d0080 msgr2=0x7feaec157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feaec0d0080 0x7feaec157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 -- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec1578b0 msgr2=0x7feaec1f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.169+0000 7feaeb400640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec1578b0 0x7feaec1f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feaeb400640 1 -- 172.21.15.64:0/2210735242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec15eeb0 con 0x7feaec0b7a60 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feaeb400640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c3f0 tx=0x7feadc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc017070 con 0x7feaec0b7a60 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feadc0053c0 con 0x7feaec0b7a60 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc003860 con 0x7feaec0b7a60 2024-09-21T07:31:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec166a90 con 0x7feaec0b7a60 2024-09-21T07:31:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec166d70 con 0x7feaec0b7a60 2024-09-21T07:31:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec0cfa50 con 0x7feaec0b7a60 2024-09-21T07:31:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.173+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feadc01a070 con 0x7feaec0b7a60 2024-09-21T07:31:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.177+0000 7feae3400640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 0x7feac8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:54.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.177+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7feadc0936c0 con 0x7feaec0b7a60 2024-09-21T07:31:54.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.177+0000 7feae3e00640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 0x7feac8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:54.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.177+0000 7feae3e00640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 0x7feac8075740 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fead40af000 tx=0x7fead401b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:54.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.181+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7feadc05de70 con 0x7feaec0b7a60 2024-09-21T07:31:54.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.393+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feaec0cf770 con 0x7feaec0b7a60 2024-09-21T07:31:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.393+0000 7feae3400640 1 -- 172.21.15.64:0/2210735242 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) ==== 53+0+73 (secure 0 0 0) 0x7feadc0628a0 con 0x7feaec0b7a60 2024-09-21T07:31:54.395 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:31:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 msgr2=0x7feac8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 0x7feac8075740 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fead40af000 tx=0x7fead401b090 comp rx=0 tx=0).stop 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 msgr2=0x7feaec14f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c3f0 tx=0x7feadc00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 shutdown_connections 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feac8073230 0x7feac8075740 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec1578b0 0x7feaec1f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feaec0d0080 0x7feaec157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 --2- 172.21.15.64:0/2210735242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaec0b7a60 0x7feaec14f370 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 >> 172.21.15.64:0/2210735242 conn(0x7feaec06d480 msgr2=0x7feaec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 shutdown_connections 2024-09-21T07:31:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54.397+0000 7feaf2600640 1 -- 172.21.15.64:0/2210735242 wait complete. 2024-09-21T07:31:54.418 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:31:54.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:31:54.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:31:54.418 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:31:54.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:54.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:31:54.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:31:54.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:31:54.419 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:31:54.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.419 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:31:54.428 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.429 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41869sec preferred_lft 41869sec 2024-09-21T07:31:54.430 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:31:54.431 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:31:54.432 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.433 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:31:54.433 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:31:54.433 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:31:54.433 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:31:54.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.434 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:31:54.490 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:31:54.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.492 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:31:54.551 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:31:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:31:54.553 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:31:54.553 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:31:54.553 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:54.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:31:54.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:54.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.693 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:31:54.702 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:31:54.702 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:31:54.703 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:31:54.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.704 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:31:54.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:31:54.769 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:54.822 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:31:54.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:31:54.822 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:54.876 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:31:54.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:54.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:31:54.984 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:31:54.985 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:31:54.998 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:31:54.998 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:31:54.998 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:31:54.998 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:31:54.998 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:31:55.002 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:31:55.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:31:55.002 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:55.022 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:31:55.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:55.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:55.134 INFO:teuthology.orchestra.run.smithi064.stdout:client8733 2024-09-21T07:31:55.134 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:31:55.135 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:31:55.144 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:31:55.144 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.0 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:55.145 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:55.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:55.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170061 s, 61.7 MB/s 2024-09-21T07:31:55.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182133 s, 57.6 MB/s 2024-09-21T07:31:55.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154127 s, 68.0 MB/s 2024-09-21T07:31:55.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154146 s, 68.0 MB/s 2024-09-21T07:31:55.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131462 s, 79.8 MB/s 2024-09-21T07:31:55.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.370 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153719 s, 68.2 MB/s 2024-09-21T07:31:55.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155098 s, 67.6 MB/s 2024-09-21T07:31:55.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150177 s, 69.8 MB/s 2024-09-21T07:31:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140498 s, 74.6 MB/s 2024-09-21T07:31:55.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.446 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191746 s, 54.7 MB/s 2024-09-21T07:31:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136539 s, 76.8 MB/s 2024-09-21T07:31:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157226 s, 66.7 MB/s 2024-09-21T07:31:55.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170879 s, 61.4 MB/s 2024-09-21T07:31:55.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195144 s, 53.7 MB/s 2024-09-21T07:31:55.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134676 s, 77.9 MB/s 2024-09-21T07:31:55.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153413 s, 68.3 MB/s 2024-09-21T07:31:55.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.576 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140453 s, 74.7 MB/s 2024-09-21T07:31:55.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.594 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155361 s, 67.5 MB/s 2024-09-21T07:31:55.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157933 s, 66.4 MB/s 2024-09-21T07:31:55.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159621 s, 65.7 MB/s 2024-09-21T07:31:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131169 s, 79.9 MB/s 2024-09-21T07:31:55.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128963 s, 81.3 MB/s 2024-09-21T07:31:55.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156846 s, 66.9 MB/s 2024-09-21T07:31:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01491 s, 70.3 MB/s 2024-09-21T07:31:55.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149684 s, 70.1 MB/s 2024-09-21T07:31:55.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133872 s, 78.3 MB/s 2024-09-21T07:31:55.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149501 s, 70.1 MB/s 2024-09-21T07:31:55.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130985 s, 80.1 MB/s 2024-09-21T07:31:55.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146391 s, 71.6 MB/s 2024-09-21T07:31:55.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158746 s, 66.1 MB/s 2024-09-21T07:31:55.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140595 s, 74.6 MB/s 2024-09-21T07:31:55.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.839 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127452 s, 82.3 MB/s 2024-09-21T07:31:55.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.1 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:55.846 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:55.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:55.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135959 s, 77.1 MB/s 2024-09-21T07:31:55.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.932 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014316 s, 73.2 MB/s 2024-09-21T07:31:55.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.950 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149728 s, 70.0 MB/s 2024-09-21T07:31:55.967 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.967 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.967 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143085 s, 73.3 MB/s 2024-09-21T07:31:55.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.983 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134237 s, 78.1 MB/s 2024-09-21T07:31:55.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:55.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:55.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133981 s, 78.3 MB/s 2024-09-21T07:31:56.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129101 s, 81.2 MB/s 2024-09-21T07:31:56.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131137 s, 80.0 MB/s 2024-09-21T07:31:56.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017328 s, 60.5 MB/s 2024-09-21T07:31:56.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.069 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161953 s, 64.7 MB/s 2024-09-21T07:31:56.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.089 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175598 s, 59.7 MB/s 2024-09-21T07:31:56.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.106 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138344 s, 75.8 MB/s 2024-09-21T07:31:56.121 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133752 s, 78.4 MB/s 2024-09-21T07:31:56.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.139 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147021 s, 71.3 MB/s 2024-09-21T07:31:56.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.155 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131563 s, 79.7 MB/s 2024-09-21T07:31:56.169 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.169 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.169 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114446 s, 91.6 MB/s 2024-09-21T07:31:56.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.190 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186051 s, 56.4 MB/s 2024-09-21T07:31:56.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137744 s, 76.1 MB/s 2024-09-21T07:31:56.223 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.223 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.223 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133067 s, 78.8 MB/s 2024-09-21T07:31:56.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156598 s, 67.0 MB/s 2024-09-21T07:31:56.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.263 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175992 s, 59.6 MB/s 2024-09-21T07:31:56.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132429 s, 79.2 MB/s 2024-09-21T07:31:56.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155935 s, 67.2 MB/s 2024-09-21T07:31:56.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142362 s, 73.7 MB/s 2024-09-21T07:31:56.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133216 s, 78.7 MB/s 2024-09-21T07:31:56.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.350 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149894 s, 70.0 MB/s 2024-09-21T07:31:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.367 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134853 s, 77.8 MB/s 2024-09-21T07:31:56.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131263 s, 79.9 MB/s 2024-09-21T07:31:56.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.404 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179763 s, 58.3 MB/s 2024-09-21T07:31:56.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016352 s, 64.1 MB/s 2024-09-21T07:31:56.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145958 s, 71.8 MB/s 2024-09-21T07:31:56.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.458 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137768 s, 76.1 MB/s 2024-09-21T07:31:56.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:56.465 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:56.465 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:56.465 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.2 2024-09-21T07:31:56.466 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:56.466 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:56.466 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:56.466 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:56.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:56.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.536 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148504 s, 70.6 MB/s 2024-09-21T07:31:56.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.553 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148488 s, 70.6 MB/s 2024-09-21T07:31:56.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140813 s, 74.5 MB/s 2024-09-21T07:31:56.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014401 s, 72.8 MB/s 2024-09-21T07:31:56.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.605 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148004 s, 70.8 MB/s 2024-09-21T07:31:56.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183132 s, 57.3 MB/s 2024-09-21T07:31:56.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.642 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140118 s, 74.8 MB/s 2024-09-21T07:31:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180694 s, 58.0 MB/s 2024-09-21T07:31:56.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139615 s, 75.1 MB/s 2024-09-21T07:31:56.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147778 s, 71.0 MB/s 2024-09-21T07:31:56.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134478 s, 78.0 MB/s 2024-09-21T07:31:56.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018278 s, 57.4 MB/s 2024-09-21T07:31:56.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134618 s, 77.9 MB/s 2024-09-21T07:31:56.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016557 s, 63.3 MB/s 2024-09-21T07:31:56.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144131 s, 72.8 MB/s 2024-09-21T07:31:56.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141365 s, 74.2 MB/s 2024-09-21T07:31:56.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139718 s, 75.0 MB/s 2024-09-21T07:31:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018209 s, 57.6 MB/s 2024-09-21T07:31:56.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.857 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138054 s, 76.0 MB/s 2024-09-21T07:31:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.873 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131413 s, 79.8 MB/s 2024-09-21T07:31:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.890 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141318 s, 74.2 MB/s 2024-09-21T07:31:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.908 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153122 s, 68.5 MB/s 2024-09-21T07:31:56.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134024 s, 78.2 MB/s 2024-09-21T07:31:56.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.941 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141324 s, 74.2 MB/s 2024-09-21T07:31:56.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.956 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132728 s, 79.0 MB/s 2024-09-21T07:31:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136917 s, 76.6 MB/s 2024-09-21T07:31:56.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:56.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:56.989 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132382 s, 79.2 MB/s 2024-09-21T07:31:57.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.004 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128056 s, 81.9 MB/s 2024-09-21T07:31:57.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130614 s, 80.3 MB/s 2024-09-21T07:31:57.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134857 s, 77.8 MB/s 2024-09-21T07:31:57.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.054 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144776 s, 72.4 MB/s 2024-09-21T07:31:57.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166977 s, 62.8 MB/s 2024-09-21T07:31:57.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.3 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:57.081 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:57.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133743 s, 78.4 MB/s 2024-09-21T07:31:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01475 s, 71.1 MB/s 2024-09-21T07:31:57.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.182 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013188 s, 79.5 MB/s 2024-09-21T07:31:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013069 s, 80.2 MB/s 2024-09-21T07:31:57.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.216 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142096 s, 73.8 MB/s 2024-09-21T07:31:57.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.236 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180389 s, 58.1 MB/s 2024-09-21T07:31:57.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.256 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171082 s, 61.3 MB/s 2024-09-21T07:31:57.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.272 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129027 s, 81.3 MB/s 2024-09-21T07:31:57.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.291 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164068 s, 63.9 MB/s 2024-09-21T07:31:57.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.307 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137513 s, 76.3 MB/s 2024-09-21T07:31:57.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129309 s, 81.1 MB/s 2024-09-21T07:31:57.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133634 s, 78.5 MB/s 2024-09-21T07:31:57.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140033 s, 74.9 MB/s 2024-09-21T07:31:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139557 s, 75.1 MB/s 2024-09-21T07:31:57.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.390 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151129 s, 69.4 MB/s 2024-09-21T07:31:57.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.408 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142598 s, 73.5 MB/s 2024-09-21T07:31:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013315 s, 78.8 MB/s 2024-09-21T07:31:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134105 s, 78.2 MB/s 2024-09-21T07:31:57.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133816 s, 78.4 MB/s 2024-09-21T07:31:57.471 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134906 s, 77.7 MB/s 2024-09-21T07:31:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162318 s, 64.6 MB/s 2024-09-21T07:31:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141626 s, 74.0 MB/s 2024-09-21T07:31:57.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138735 s, 75.6 MB/s 2024-09-21T07:31:57.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017944 s, 58.4 MB/s 2024-09-21T07:31:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191245 s, 54.8 MB/s 2024-09-21T07:31:57.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143138 s, 73.3 MB/s 2024-09-21T07:31:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149852 s, 70.0 MB/s 2024-09-21T07:31:57.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01359 s, 77.2 MB/s 2024-09-21T07:31:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015255 s, 68.7 MB/s 2024-09-21T07:31:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130035 s, 80.6 MB/s 2024-09-21T07:31:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135399 s, 77.4 MB/s 2024-09-21T07:31:57.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133182 s, 78.7 MB/s 2024-09-21T07:31:57.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.4 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:57.691 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:57.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:57.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.760 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152292 s, 68.9 MB/s 2024-09-21T07:31:57.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.778 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151684 s, 69.1 MB/s 2024-09-21T07:31:57.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.793 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116948 s, 89.7 MB/s 2024-09-21T07:31:57.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147955 s, 70.9 MB/s 2024-09-21T07:31:57.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138842 s, 75.5 MB/s 2024-09-21T07:31:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017633 s, 59.5 MB/s 2024-09-21T07:31:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135583 s, 77.3 MB/s 2024-09-21T07:31:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132994 s, 78.8 MB/s 2024-09-21T07:31:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128151 s, 81.8 MB/s 2024-09-21T07:31:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131942 s, 79.5 MB/s 2024-09-21T07:31:57.925 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.925 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.925 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011524 s, 91.0 MB/s 2024-09-21T07:31:57.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143575 s, 73.0 MB/s 2024-09-21T07:31:57.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155728 s, 67.3 MB/s 2024-09-21T07:31:57.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134885 s, 77.7 MB/s 2024-09-21T07:31:57.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:57.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:57.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133126 s, 78.8 MB/s 2024-09-21T07:31:58.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129965 s, 80.7 MB/s 2024-09-21T07:31:58.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181085 s, 57.9 MB/s 2024-09-21T07:31:58.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135791 s, 77.2 MB/s 2024-09-21T07:31:58.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129501 s, 81.0 MB/s 2024-09-21T07:31:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134117 s, 78.2 MB/s 2024-09-21T07:31:58.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141975 s, 73.9 MB/s 2024-09-21T07:31:58.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.111 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150714 s, 69.6 MB/s 2024-09-21T07:31:58.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174823 s, 60.0 MB/s 2024-09-21T07:31:58.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148886 s, 70.4 MB/s 2024-09-21T07:31:58.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.165 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131429 s, 79.8 MB/s 2024-09-21T07:31:58.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.181 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013135 s, 79.8 MB/s 2024-09-21T07:31:58.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.199 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149803 s, 70.0 MB/s 2024-09-21T07:31:58.218 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.218 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.218 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166634 s, 62.9 MB/s 2024-09-21T07:31:58.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.237 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155142 s, 67.6 MB/s 2024-09-21T07:31:58.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.254 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148571 s, 70.6 MB/s 2024-09-21T07:31:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149082 s, 70.3 MB/s 2024-09-21T07:31:58.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144441 s, 72.6 MB/s 2024-09-21T07:31:58.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.5 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:58.297 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:58.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:58.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.366 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148831 s, 70.5 MB/s 2024-09-21T07:31:58.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132005 s, 79.4 MB/s 2024-09-21T07:31:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.402 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180172 s, 58.2 MB/s 2024-09-21T07:31:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144943 s, 72.3 MB/s 2024-09-21T07:31:58.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134333 s, 78.1 MB/s 2024-09-21T07:31:58.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140195 s, 74.8 MB/s 2024-09-21T07:31:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132604 s, 79.1 MB/s 2024-09-21T07:31:58.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012759 s, 82.2 MB/s 2024-09-21T07:31:58.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014253 s, 73.6 MB/s 2024-09-21T07:31:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189963 s, 55.2 MB/s 2024-09-21T07:31:58.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131697 s, 79.6 MB/s 2024-09-21T07:31:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.555 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140602 s, 74.6 MB/s 2024-09-21T07:31:58.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140867 s, 74.4 MB/s 2024-09-21T07:31:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132374 s, 79.2 MB/s 2024-09-21T07:31:58.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.603 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132065 s, 79.4 MB/s 2024-09-21T07:31:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013272 s, 79.0 MB/s 2024-09-21T07:31:58.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.637 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014564 s, 72.0 MB/s 2024-09-21T07:31:58.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136262 s, 77.0 MB/s 2024-09-21T07:31:58.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153775 s, 68.2 MB/s 2024-09-21T07:31:58.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.688 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139081 s, 75.4 MB/s 2024-09-21T07:31:58.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131184 s, 79.9 MB/s 2024-09-21T07:31:58.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144315 s, 72.7 MB/s 2024-09-21T07:31:58.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.738 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147047 s, 71.3 MB/s 2024-09-21T07:31:58.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.755 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141214 s, 74.3 MB/s 2024-09-21T07:31:58.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148326 s, 70.7 MB/s 2024-09-21T07:31:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.792 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173647 s, 60.4 MB/s 2024-09-21T07:31:58.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135506 s, 77.4 MB/s 2024-09-21T07:31:58.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.827 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140542 s, 74.6 MB/s 2024-09-21T07:31:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151975 s, 69.0 MB/s 2024-09-21T07:31:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130803 s, 80.2 MB/s 2024-09-21T07:31:58.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149262 s, 70.3 MB/s 2024-09-21T07:31:58.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128701 s, 81.5 MB/s 2024-09-21T07:31:58.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.6 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:58.902 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:58.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:58.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.971 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147189 s, 71.2 MB/s 2024-09-21T07:31:58.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:58.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:58.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137317 s, 76.4 MB/s 2024-09-21T07:31:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126586 s, 82.8 MB/s 2024-09-21T07:31:59.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014451 s, 72.6 MB/s 2024-09-21T07:31:59.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.035 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128575 s, 81.6 MB/s 2024-09-21T07:31:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133461 s, 78.6 MB/s 2024-09-21T07:31:59.068 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.068 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.068 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139586 s, 75.1 MB/s 2024-09-21T07:31:59.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128636 s, 81.5 MB/s 2024-09-21T07:31:59.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.099 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129992 s, 80.7 MB/s 2024-09-21T07:31:59.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129055 s, 81.3 MB/s 2024-09-21T07:31:59.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013912 s, 75.4 MB/s 2024-09-21T07:31:59.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.148 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133764 s, 78.4 MB/s 2024-09-21T07:31:59.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116242 s, 90.2 MB/s 2024-09-21T07:31:59.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184426 s, 56.9 MB/s 2024-09-21T07:31:59.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142741 s, 73.5 MB/s 2024-09-21T07:31:59.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185073 s, 56.7 MB/s 2024-09-21T07:31:59.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.238 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133897 s, 78.3 MB/s 2024-09-21T07:31:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.253 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128874 s, 81.4 MB/s 2024-09-21T07:31:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177967 s, 58.9 MB/s 2024-09-21T07:31:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122296 s, 85.7 MB/s 2024-09-21T07:31:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172733 s, 60.7 MB/s 2024-09-21T07:31:59.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.325 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134754 s, 77.8 MB/s 2024-09-21T07:31:59.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.341 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126277 s, 83.0 MB/s 2024-09-21T07:31:59.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133152 s, 78.8 MB/s 2024-09-21T07:31:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131525 s, 79.7 MB/s 2024-09-21T07:31:59.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.390 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145984 s, 71.8 MB/s 2024-09-21T07:31:59.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175652 s, 59.7 MB/s 2024-09-21T07:31:59.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.430 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177298 s, 59.1 MB/s 2024-09-21T07:31:59.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.446 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134589 s, 77.9 MB/s 2024-09-21T07:31:59.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187869 s, 55.8 MB/s 2024-09-21T07:31:59.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.485 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013946 s, 75.2 MB/s 2024-09-21T07:31:59.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141626 s, 74.0 MB/s 2024-09-21T07:31:59.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:31:59.509 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:31:59.509 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:31:59.509 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.7 2024-09-21T07:31:59.509 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:31:59.510 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:31:59.510 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:31:59.510 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:31:59.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:31:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:31:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.578 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136805 s, 76.6 MB/s 2024-09-21T07:31:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149271 s, 70.2 MB/s 2024-09-21T07:31:59.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.612 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143769 s, 72.9 MB/s 2024-09-21T07:31:59.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.629 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141217 s, 74.3 MB/s 2024-09-21T07:31:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156092 s, 67.2 MB/s 2024-09-21T07:31:59.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.666 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016556 s, 63.3 MB/s 2024-09-21T07:31:59.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136606 s, 76.8 MB/s 2024-09-21T07:31:59.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147956 s, 70.9 MB/s 2024-09-21T07:31:59.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012725 s, 82.4 MB/s 2024-09-21T07:31:59.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141512 s, 74.1 MB/s 2024-09-21T07:31:59.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172652 s, 60.7 MB/s 2024-09-21T07:31:59.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129147 s, 81.2 MB/s 2024-09-21T07:31:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132913 s, 78.9 MB/s 2024-09-21T07:31:59.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128697 s, 81.5 MB/s 2024-09-21T07:31:59.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141449 s, 74.1 MB/s 2024-09-21T07:31:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129653 s, 80.9 MB/s 2024-09-21T07:31:59.849 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.849 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.849 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145927 s, 71.9 MB/s 2024-09-21T07:31:59.866 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.866 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.866 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146849 s, 71.4 MB/s 2024-09-21T07:31:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152001 s, 69.0 MB/s 2024-09-21T07:31:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133907 s, 78.3 MB/s 2024-09-21T07:31:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.916 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135048 s, 77.6 MB/s 2024-09-21T07:31:59.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.932 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125783 s, 83.4 MB/s 2024-09-21T07:31:59.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.949 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145608 s, 72.0 MB/s 2024-09-21T07:31:59.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.967 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.967 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152305 s, 68.8 MB/s 2024-09-21T07:31:59.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:31:59.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:31:59.984 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143385 s, 73.1 MB/s 2024-09-21T07:32:00.000 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.000 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.000 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132297 s, 79.3 MB/s 2024-09-21T07:32:00.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.016 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135511 s, 77.4 MB/s 2024-09-21T07:32:00.034 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.034 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.034 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151874 s, 69.0 MB/s 2024-09-21T07:32:00.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.055 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173976 s, 60.3 MB/s 2024-09-21T07:32:00.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.069 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01328 s, 79.0 MB/s 2024-09-21T07:32:00.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.087 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142787 s, 73.4 MB/s 2024-09-21T07:32:00.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.107 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182845 s, 57.3 MB/s 2024-09-21T07:32:00.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:00.114 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.8 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:00.115 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:00.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:00.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145713 s, 72.0 MB/s 2024-09-21T07:32:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142136 s, 73.8 MB/s 2024-09-21T07:32:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01678 s, 62.5 MB/s 2024-09-21T07:32:00.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142577 s, 73.5 MB/s 2024-09-21T07:32:00.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.295 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134148 s, 78.2 MB/s 2024-09-21T07:32:00.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144914 s, 72.4 MB/s 2024-09-21T07:32:00.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.328 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136178 s, 77.0 MB/s 2024-09-21T07:32:00.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.344 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127696 s, 82.1 MB/s 2024-09-21T07:32:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126346 s, 83.0 MB/s 2024-09-21T07:32:00.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.376 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145745 s, 71.9 MB/s 2024-09-21T07:32:00.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014404 s, 72.8 MB/s 2024-09-21T07:32:00.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134705 s, 77.8 MB/s 2024-09-21T07:32:00.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.427 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146543 s, 71.6 MB/s 2024-09-21T07:32:00.444 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.444 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.444 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148615 s, 70.6 MB/s 2024-09-21T07:32:00.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014721 s, 71.2 MB/s 2024-09-21T07:32:00.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.478 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135575 s, 77.3 MB/s 2024-09-21T07:32:00.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135351 s, 77.5 MB/s 2024-09-21T07:32:00.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013243 s, 79.2 MB/s 2024-09-21T07:32:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140135 s, 74.8 MB/s 2024-09-21T07:32:00.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143856 s, 72.9 MB/s 2024-09-21T07:32:00.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133434 s, 78.6 MB/s 2024-09-21T07:32:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.576 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01422 s, 73.7 MB/s 2024-09-21T07:32:00.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.593 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141307 s, 74.2 MB/s 2024-09-21T07:32:00.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142471 s, 73.6 MB/s 2024-09-21T07:32:00.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130848 s, 80.1 MB/s 2024-09-21T07:32:00.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.643 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148534 s, 70.6 MB/s 2024-09-21T07:32:00.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.659 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135037 s, 77.7 MB/s 2024-09-21T07:32:00.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177713 s, 59.0 MB/s 2024-09-21T07:32:00.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133827 s, 78.4 MB/s 2024-09-21T07:32:00.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145369 s, 72.1 MB/s 2024-09-21T07:32:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138672 s, 75.6 MB/s 2024-09-21T07:32:00.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179041 s, 58.6 MB/s 2024-09-21T07:32:00.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:00.757 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.9 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:00.758 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:00.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:00.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.869 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138928 s, 75.5 MB/s 2024-09-21T07:32:00.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.885 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138052 s, 76.0 MB/s 2024-09-21T07:32:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134597 s, 77.9 MB/s 2024-09-21T07:32:00.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.917 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135031 s, 77.7 MB/s 2024-09-21T07:32:00.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.934 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01408 s, 74.5 MB/s 2024-09-21T07:32:00.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.952 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149767 s, 70.0 MB/s 2024-09-21T07:32:00.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.971 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016159 s, 64.9 MB/s 2024-09-21T07:32:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146467 s, 71.6 MB/s 2024-09-21T07:32:01.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.005 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141768 s, 74.0 MB/s 2024-09-21T07:32:01.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.023 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152133 s, 68.9 MB/s 2024-09-21T07:32:01.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149487 s, 70.1 MB/s 2024-09-21T07:32:01.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.059 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152287 s, 68.9 MB/s 2024-09-21T07:32:01.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.076 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149487 s, 70.1 MB/s 2024-09-21T07:32:01.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.092 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132291 s, 79.3 MB/s 2024-09-21T07:32:01.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.107 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125512 s, 83.5 MB/s 2024-09-21T07:32:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146643 s, 71.5 MB/s 2024-09-21T07:32:01.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142736 s, 73.5 MB/s 2024-09-21T07:32:01.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.158 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134887 s, 77.7 MB/s 2024-09-21T07:32:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135193 s, 77.6 MB/s 2024-09-21T07:32:01.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151861 s, 69.0 MB/s 2024-09-21T07:32:01.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178703 s, 58.7 MB/s 2024-09-21T07:32:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.230 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142531 s, 73.6 MB/s 2024-09-21T07:32:01.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134236 s, 78.1 MB/s 2024-09-21T07:32:01.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.261 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134778 s, 77.8 MB/s 2024-09-21T07:32:01.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133833 s, 78.3 MB/s 2024-09-21T07:32:01.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201418 s, 52.1 MB/s 2024-09-21T07:32:01.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136723 s, 76.7 MB/s 2024-09-21T07:32:01.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.333 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141651 s, 74.0 MB/s 2024-09-21T07:32:01.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015161 s, 69.2 MB/s 2024-09-21T07:32:01.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.367 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136381 s, 76.9 MB/s 2024-09-21T07:32:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130394 s, 80.4 MB/s 2024-09-21T07:32:01.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138195 s, 75.9 MB/s 2024-09-21T07:32:01.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.10 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:01.407 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:01.408 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:01.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:01.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146477 s, 71.6 MB/s 2024-09-21T07:32:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180285 s, 58.2 MB/s 2024-09-21T07:32:01.513 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.513 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.514 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138875 s, 75.5 MB/s 2024-09-21T07:32:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017633 s, 59.5 MB/s 2024-09-21T07:32:01.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145673 s, 72.0 MB/s 2024-09-21T07:32:01.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130782 s, 80.2 MB/s 2024-09-21T07:32:01.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133755 s, 78.4 MB/s 2024-09-21T07:32:01.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137455 s, 76.3 MB/s 2024-09-21T07:32:01.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.618 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135184 s, 77.6 MB/s 2024-09-21T07:32:01.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.634 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136037 s, 77.1 MB/s 2024-09-21T07:32:01.655 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.656 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178679 s, 58.7 MB/s 2024-09-21T07:32:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118213 s, 88.7 MB/s 2024-09-21T07:32:01.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.688 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141667 s, 74.0 MB/s 2024-09-21T07:32:01.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.706 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148941 s, 70.4 MB/s 2024-09-21T07:32:01.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014438 s, 72.6 MB/s 2024-09-21T07:32:01.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.744 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174161 s, 60.2 MB/s 2024-09-21T07:32:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144444 s, 72.6 MB/s 2024-09-21T07:32:01.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.778 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134726 s, 77.8 MB/s 2024-09-21T07:32:01.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135849 s, 77.2 MB/s 2024-09-21T07:32:01.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012214 s, 85.9 MB/s 2024-09-21T07:32:01.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.825 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131527 s, 79.7 MB/s 2024-09-21T07:32:01.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.842 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143212 s, 73.2 MB/s 2024-09-21T07:32:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131053 s, 80.0 MB/s 2024-09-21T07:32:01.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147589 s, 71.0 MB/s 2024-09-21T07:32:01.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137874 s, 76.1 MB/s 2024-09-21T07:32:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179106 s, 58.5 MB/s 2024-09-21T07:32:01.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137781 s, 76.1 MB/s 2024-09-21T07:32:01.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145639 s, 72.0 MB/s 2024-09-21T07:32:01.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145707 s, 72.0 MB/s 2024-09-21T07:32:01.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135627 s, 77.3 MB/s 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149249 s, 70.3 MB/s 2024-09-21T07:32:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130803 s, 80.2 MB/s 2024-09-21T07:32:02.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:02.020 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.11 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:02.021 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:02.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172728 s, 60.7 MB/s 2024-09-21T07:32:02.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.110 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148149 s, 70.8 MB/s 2024-09-21T07:32:02.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.126 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137088 s, 76.5 MB/s 2024-09-21T07:32:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171044 s, 61.3 MB/s 2024-09-21T07:32:02.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180214 s, 58.2 MB/s 2024-09-21T07:32:02.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136621 s, 76.8 MB/s 2024-09-21T07:32:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138552 s, 75.7 MB/s 2024-09-21T07:32:02.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133169 s, 78.7 MB/s 2024-09-21T07:32:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126499 s, 82.9 MB/s 2024-09-21T07:32:02.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134116 s, 78.2 MB/s 2024-09-21T07:32:02.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.265 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132071 s, 79.4 MB/s 2024-09-21T07:32:02.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.281 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131505 s, 79.7 MB/s 2024-09-21T07:32:02.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151222 s, 69.3 MB/s 2024-09-21T07:32:02.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146976 s, 71.3 MB/s 2024-09-21T07:32:02.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.337 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177671 s, 59.0 MB/s 2024-09-21T07:32:02.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132948 s, 78.9 MB/s 2024-09-21T07:32:02.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183117 s, 57.3 MB/s 2024-09-21T07:32:02.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147879 s, 70.9 MB/s 2024-09-21T07:32:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178142 s, 58.9 MB/s 2024-09-21T07:32:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141676 s, 74.0 MB/s 2024-09-21T07:32:02.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183565 s, 57.1 MB/s 2024-09-21T07:32:02.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134808 s, 77.8 MB/s 2024-09-21T07:32:02.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.486 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136231 s, 77.0 MB/s 2024-09-21T07:32:02.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132094 s, 79.4 MB/s 2024-09-21T07:32:02.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.520 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143292 s, 73.2 MB/s 2024-09-21T07:32:02.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147521 s, 71.1 MB/s 2024-09-21T07:32:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132348 s, 79.2 MB/s 2024-09-21T07:32:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143446 s, 73.1 MB/s 2024-09-21T07:32:02.586 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.586 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.586 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133844 s, 78.3 MB/s 2024-09-21T07:32:02.602 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.602 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.602 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131119 s, 80.0 MB/s 2024-09-21T07:32:02.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146049 s, 71.8 MB/s 2024-09-21T07:32:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131397 s, 79.8 MB/s 2024-09-21T07:32:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.12 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:02.643 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:02.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:02.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150272 s, 69.8 MB/s 2024-09-21T07:32:02.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.729 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136228 s, 77.0 MB/s 2024-09-21T07:32:02.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131256 s, 79.9 MB/s 2024-09-21T07:32:02.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.761 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130969 s, 80.1 MB/s 2024-09-21T07:32:02.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014145 s, 74.1 MB/s 2024-09-21T07:32:02.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.796 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.796 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136148 s, 77.0 MB/s 2024-09-21T07:32:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148488 s, 70.6 MB/s 2024-09-21T07:32:02.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.829 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127873 s, 82.0 MB/s 2024-09-21T07:32:02.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147266 s, 71.2 MB/s 2024-09-21T07:32:02.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.864 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133742 s, 78.4 MB/s 2024-09-21T07:32:02.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141888 s, 73.9 MB/s 2024-09-21T07:32:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147942 s, 70.9 MB/s 2024-09-21T07:32:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134237 s, 78.1 MB/s 2024-09-21T07:32:02.933 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.933 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.933 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142789 s, 73.4 MB/s 2024-09-21T07:32:02.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.950 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140001 s, 74.9 MB/s 2024-09-21T07:32:02.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.968 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149756 s, 70.0 MB/s 2024-09-21T07:32:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137851 s, 76.1 MB/s 2024-09-21T07:32:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144648 s, 72.5 MB/s 2024-09-21T07:32:03.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.021 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.021 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147795 s, 70.9 MB/s 2024-09-21T07:32:03.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.038 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142641 s, 73.5 MB/s 2024-09-21T07:32:03.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.056 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142959 s, 73.3 MB/s 2024-09-21T07:32:03.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140642 s, 74.6 MB/s 2024-09-21T07:32:03.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.091 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014625 s, 71.7 MB/s 2024-09-21T07:32:03.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.107 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134209 s, 78.1 MB/s 2024-09-21T07:32:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132757 s, 79.0 MB/s 2024-09-21T07:32:03.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.140 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136591 s, 76.8 MB/s 2024-09-21T07:32:03.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.158 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147773 s, 71.0 MB/s 2024-09-21T07:32:03.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147825 s, 70.9 MB/s 2024-09-21T07:32:03.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018272 s, 57.4 MB/s 2024-09-21T07:32:03.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132049 s, 79.4 MB/s 2024-09-21T07:32:03.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.229 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134352 s, 78.0 MB/s 2024-09-21T07:32:03.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148616 s, 70.6 MB/s 2024-09-21T07:32:03.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.13 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:03.254 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:03.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:03.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142265 s, 73.7 MB/s 2024-09-21T07:32:03.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.340 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148586 s, 70.6 MB/s 2024-09-21T07:32:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142433 s, 73.6 MB/s 2024-09-21T07:32:03.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.374 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144201 s, 72.7 MB/s 2024-09-21T07:32:03.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01441 s, 72.8 MB/s 2024-09-21T07:32:03.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126806 s, 82.7 MB/s 2024-09-21T07:32:03.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146195 s, 71.7 MB/s 2024-09-21T07:32:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129103 s, 81.2 MB/s 2024-09-21T07:32:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146171 s, 71.7 MB/s 2024-09-21T07:32:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153957 s, 68.1 MB/s 2024-09-21T07:32:03.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133124 s, 78.8 MB/s 2024-09-21T07:32:03.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132804 s, 79.0 MB/s 2024-09-21T07:32:03.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.525 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149426 s, 70.2 MB/s 2024-09-21T07:32:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136544 s, 76.8 MB/s 2024-09-21T07:32:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129891 s, 80.7 MB/s 2024-09-21T07:32:03.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.575 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150253 s, 69.8 MB/s 2024-09-21T07:32:03.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.592 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143717 s, 73.0 MB/s 2024-09-21T07:32:03.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.611 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159316 s, 65.8 MB/s 2024-09-21T07:32:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145492 s, 72.1 MB/s 2024-09-21T07:32:03.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139175 s, 75.3 MB/s 2024-09-21T07:32:03.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.661 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134142 s, 78.2 MB/s 2024-09-21T07:32:03.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.678 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147583 s, 71.0 MB/s 2024-09-21T07:32:03.694 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.694 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013255 s, 79.1 MB/s 2024-09-21T07:32:03.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145079 s, 72.3 MB/s 2024-09-21T07:32:03.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135116 s, 77.6 MB/s 2024-09-21T07:32:03.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.744 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.744 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135021 s, 77.7 MB/s 2024-09-21T07:32:03.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.761 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138503 s, 75.7 MB/s 2024-09-21T07:32:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138239 s, 75.9 MB/s 2024-09-21T07:32:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144977 s, 72.3 MB/s 2024-09-21T07:32:03.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.811 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137162 s, 76.4 MB/s 2024-09-21T07:32:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116816 s, 89.8 MB/s 2024-09-21T07:32:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244264 s, 42.9 MB/s 2024-09-21T07:32:03.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:03.864 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.14 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:03.865 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:03.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:03.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:03.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:03.982 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140978 s, 74.4 MB/s 2024-09-21T07:32:04.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018678 s, 56.1 MB/s 2024-09-21T07:32:04.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180704 s, 58.0 MB/s 2024-09-21T07:32:04.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132336 s, 79.2 MB/s 2024-09-21T07:32:04.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.057 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133894 s, 78.3 MB/s 2024-09-21T07:32:04.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.074 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144537 s, 72.5 MB/s 2024-09-21T07:32:04.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.090 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01399 s, 75.0 MB/s 2024-09-21T07:32:04.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.106 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129547 s, 80.9 MB/s 2024-09-21T07:32:04.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.122 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138176 s, 75.9 MB/s 2024-09-21T07:32:04.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.140 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146755 s, 71.5 MB/s 2024-09-21T07:32:04.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.161 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183308 s, 57.2 MB/s 2024-09-21T07:32:04.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136563 s, 76.8 MB/s 2024-09-21T07:32:04.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.195 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148573 s, 70.6 MB/s 2024-09-21T07:32:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176627 s, 59.4 MB/s 2024-09-21T07:32:04.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147155 s, 71.3 MB/s 2024-09-21T07:32:04.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.254 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.254 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181275 s, 57.8 MB/s 2024-09-21T07:32:04.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138222 s, 75.9 MB/s 2024-09-21T07:32:04.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133082 s, 78.8 MB/s 2024-09-21T07:32:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179061 s, 58.6 MB/s 2024-09-21T07:32:04.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.329 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177856 s, 59.0 MB/s 2024-09-21T07:32:04.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146132 s, 71.8 MB/s 2024-09-21T07:32:04.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.367 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182484 s, 57.5 MB/s 2024-09-21T07:32:04.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139802 s, 75.0 MB/s 2024-09-21T07:32:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146139 s, 71.8 MB/s 2024-09-21T07:32:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135029 s, 77.7 MB/s 2024-09-21T07:32:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149309 s, 70.2 MB/s 2024-09-21T07:32:04.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182198 s, 57.6 MB/s 2024-09-21T07:32:04.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140692 s, 74.5 MB/s 2024-09-21T07:32:04.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135756 s, 77.2 MB/s 2024-09-21T07:32:04.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182613 s, 57.4 MB/s 2024-09-21T07:32:04.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139373 s, 75.2 MB/s 2024-09-21T07:32:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141083 s, 74.3 MB/s 2024-09-21T07:32:04.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.15 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:04.551 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:04.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:04.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154228 s, 68.0 MB/s 2024-09-21T07:32:04.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.637 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013785 s, 76.1 MB/s 2024-09-21T07:32:04.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129163 s, 81.2 MB/s 2024-09-21T07:32:04.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148899 s, 70.4 MB/s 2024-09-21T07:32:04.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182345 s, 57.5 MB/s 2024-09-21T07:32:04.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182133 s, 57.6 MB/s 2024-09-21T07:32:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130239 s, 80.5 MB/s 2024-09-21T07:32:04.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.744 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131402 s, 79.8 MB/s 2024-09-21T07:32:04.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.761 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136182 s, 77.0 MB/s 2024-09-21T07:32:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.776 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134563 s, 77.9 MB/s 2024-09-21T07:32:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137394 s, 76.3 MB/s 2024-09-21T07:32:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130072 s, 80.6 MB/s 2024-09-21T07:32:04.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.825 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129244 s, 81.1 MB/s 2024-09-21T07:32:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.846 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186831 s, 56.1 MB/s 2024-09-21T07:32:04.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140003 s, 74.9 MB/s 2024-09-21T07:32:04.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147051 s, 71.3 MB/s 2024-09-21T07:32:04.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.896 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130692 s, 80.2 MB/s 2024-09-21T07:32:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01242 s, 84.4 MB/s 2024-09-21T07:32:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136581 s, 76.8 MB/s 2024-09-21T07:32:04.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141183 s, 74.3 MB/s 2024-09-21T07:32:04.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136469 s, 76.8 MB/s 2024-09-21T07:32:04.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.983 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189591 s, 55.3 MB/s 2024-09-21T07:32:04.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:04.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:04.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137031 s, 76.5 MB/s 2024-09-21T07:32:05.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122635 s, 85.5 MB/s 2024-09-21T07:32:05.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134347 s, 78.0 MB/s 2024-09-21T07:32:05.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183481 s, 57.1 MB/s 2024-09-21T07:32:05.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133904 s, 78.3 MB/s 2024-09-21T07:32:05.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.088 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174182 s, 60.2 MB/s 2024-09-21T07:32:05.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183167 s, 57.2 MB/s 2024-09-21T07:32:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154318 s, 67.9 MB/s 2024-09-21T07:32:05.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.144 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134182 s, 78.1 MB/s 2024-09-21T07:32:05.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.161 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144575 s, 72.5 MB/s 2024-09-21T07:32:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.16 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:05.169 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:05.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:05.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134434 s, 78.0 MB/s 2024-09-21T07:32:05.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146212 s, 71.7 MB/s 2024-09-21T07:32:05.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.313 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132235 s, 79.3 MB/s 2024-09-21T07:32:05.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128075 s, 81.9 MB/s 2024-09-21T07:32:05.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146191 s, 71.7 MB/s 2024-09-21T07:32:05.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.361 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130592 s, 80.3 MB/s 2024-09-21T07:32:05.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127761 s, 82.1 MB/s 2024-09-21T07:32:05.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.395 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149584 s, 70.1 MB/s 2024-09-21T07:32:05.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118379 s, 88.6 MB/s 2024-09-21T07:32:05.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142489 s, 73.6 MB/s 2024-09-21T07:32:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131855 s, 79.5 MB/s 2024-09-21T07:32:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130761 s, 80.2 MB/s 2024-09-21T07:32:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130532 s, 80.3 MB/s 2024-09-21T07:32:05.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138508 s, 75.7 MB/s 2024-09-21T07:32:05.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186065 s, 56.4 MB/s 2024-09-21T07:32:05.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139244 s, 75.3 MB/s 2024-09-21T07:32:05.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126171 s, 83.1 MB/s 2024-09-21T07:32:05.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122902 s, 85.3 MB/s 2024-09-21T07:32:05.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190062 s, 55.2 MB/s 2024-09-21T07:32:05.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146113 s, 71.8 MB/s 2024-09-21T07:32:05.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150863 s, 69.5 MB/s 2024-09-21T07:32:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139541 s, 75.1 MB/s 2024-09-21T07:32:05.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130629 s, 80.3 MB/s 2024-09-21T07:32:05.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138074 s, 75.9 MB/s 2024-09-21T07:32:05.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183166 s, 57.2 MB/s 2024-09-21T07:32:05.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171195 s, 61.3 MB/s 2024-09-21T07:32:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148853 s, 70.4 MB/s 2024-09-21T07:32:05.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.738 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143921 s, 72.9 MB/s 2024-09-21T07:32:05.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.756 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149705 s, 70.0 MB/s 2024-09-21T07:32:05.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.773 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142495 s, 73.6 MB/s 2024-09-21T07:32:05.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.794 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182911 s, 57.3 MB/s 2024-09-21T07:32:05.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139389 s, 75.2 MB/s 2024-09-21T07:32:05.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:05.817 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.17 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:05.818 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:05.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:05.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113215 s, 92.6 MB/s 2024-09-21T07:32:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178939 s, 58.6 MB/s 2024-09-21T07:32:05.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140712 s, 74.5 MB/s 2024-09-21T07:32:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182686 s, 57.4 MB/s 2024-09-21T07:32:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149258 s, 70.3 MB/s 2024-09-21T07:32:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.982 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190653 s, 55.0 MB/s 2024-09-21T07:32:05.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135588 s, 77.3 MB/s 2024-09-21T07:32:06.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130121 s, 80.6 MB/s 2024-09-21T07:32:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014576 s, 71.9 MB/s 2024-09-21T07:32:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150215 s, 69.8 MB/s 2024-09-21T07:32:06.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117657 s, 89.1 MB/s 2024-09-21T07:32:06.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132709 s, 79.0 MB/s 2024-09-21T07:32:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.095 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131212 s, 79.9 MB/s 2024-09-21T07:32:06.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.112 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144697 s, 72.5 MB/s 2024-09-21T07:32:06.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.128 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136121 s, 77.0 MB/s 2024-09-21T07:32:06.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-21T07:32:06.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150321 s, 69.8 MB/s 2024-09-21T07:32:06.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125968 s, 83.2 MB/s 2024-09-21T07:32:06.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130474 s, 80.4 MB/s 2024-09-21T07:32:06.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145787 s, 71.9 MB/s 2024-09-21T07:32:06.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.226 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130483 s, 80.4 MB/s 2024-09-21T07:32:06.243 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.243 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.243 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136455 s, 76.8 MB/s 2024-09-21T07:32:06.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.259 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135234 s, 77.5 MB/s 2024-09-21T07:32:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181507 s, 57.8 MB/s 2024-09-21T07:32:06.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142213 s, 73.7 MB/s 2024-09-21T07:32:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.311 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114775 s, 91.4 MB/s 2024-09-21T07:32:06.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.331 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180852 s, 58.0 MB/s 2024-09-21T07:32:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111177 s, 94.3 MB/s 2024-09-21T07:32:06.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.363 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155327 s, 67.5 MB/s 2024-09-21T07:32:06.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176754 s, 59.3 MB/s 2024-09-21T07:32:06.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147849 s, 70.9 MB/s 2024-09-21T07:32:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134779 s, 77.8 MB/s 2024-09-21T07:32:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:06.424 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:06.424 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:06.425 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.18 2024-09-21T07:32:06.425 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:06.425 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:06.425 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:06.425 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:06.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014158 s, 74.1 MB/s 2024-09-21T07:32:06.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140652 s, 74.6 MB/s 2024-09-21T07:32:06.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142099 s, 73.8 MB/s 2024-09-21T07:32:06.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125986 s, 83.2 MB/s 2024-09-21T07:32:06.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.560 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154253 s, 68.0 MB/s 2024-09-21T07:32:06.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178482 s, 58.7 MB/s 2024-09-21T07:32:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139681 s, 75.1 MB/s 2024-09-21T07:32:06.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138446 s, 75.7 MB/s 2024-09-21T07:32:06.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.634 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173443 s, 60.5 MB/s 2024-09-21T07:32:06.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.649 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126773 s, 82.7 MB/s 2024-09-21T07:32:06.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.668 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154893 s, 67.7 MB/s 2024-09-21T07:32:06.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133396 s, 78.6 MB/s 2024-09-21T07:32:06.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142338 s, 73.7 MB/s 2024-09-21T07:32:06.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141902 s, 73.9 MB/s 2024-09-21T07:32:06.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013057 s, 80.3 MB/s 2024-09-21T07:32:06.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146194 s, 71.7 MB/s 2024-09-21T07:32:06.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.766 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133524 s, 78.5 MB/s 2024-09-21T07:32:06.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013665 s, 76.7 MB/s 2024-09-21T07:32:06.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136924 s, 76.6 MB/s 2024-09-21T07:32:06.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.817 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014878 s, 70.5 MB/s 2024-09-21T07:32:06.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.834 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147873 s, 70.9 MB/s 2024-09-21T07:32:06.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.851 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142469 s, 73.6 MB/s 2024-09-21T07:32:06.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143289 s, 73.2 MB/s 2024-09-21T07:32:06.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132539 s, 79.1 MB/s 2024-09-21T07:32:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.899 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129234 s, 81.1 MB/s 2024-09-21T07:32:06.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188227 s, 55.7 MB/s 2024-09-21T07:32:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148668 s, 70.5 MB/s 2024-09-21T07:32:06.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135842 s, 77.2 MB/s 2024-09-21T07:32:06.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188518 s, 55.6 MB/s 2024-09-21T07:32:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134858 s, 77.8 MB/s 2024-09-21T07:32:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013394 s, 78.3 MB/s 2024-09-21T07:32:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144993 s, 72.3 MB/s 2024-09-21T07:32:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.19 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:07.034 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:07.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124997 s, 83.9 MB/s 2024-09-21T07:32:07.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120631 s, 86.9 MB/s 2024-09-21T07:32:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140165 s, 74.8 MB/s 2024-09-21T07:32:07.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140995 s, 74.4 MB/s 2024-09-21T07:32:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155038 s, 67.6 MB/s 2024-09-21T07:32:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.185 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.185 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147491 s, 71.1 MB/s 2024-09-21T07:32:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165667 s, 63.3 MB/s 2024-09-21T07:32:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158251 s, 66.3 MB/s 2024-09-21T07:32:07.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.240 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148458 s, 70.6 MB/s 2024-09-21T07:32:07.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145992 s, 71.8 MB/s 2024-09-21T07:32:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133602 s, 78.5 MB/s 2024-09-21T07:32:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149458 s, 70.2 MB/s 2024-09-21T07:32:07.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148718 s, 70.5 MB/s 2024-09-21T07:32:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186476 s, 56.2 MB/s 2024-09-21T07:32:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139717 s, 75.0 MB/s 2024-09-21T07:32:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128704 s, 81.5 MB/s 2024-09-21T07:32:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.379 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145957 s, 71.8 MB/s 2024-09-21T07:32:07.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.397 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151363 s, 69.3 MB/s 2024-09-21T07:32:07.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.418 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179508 s, 58.4 MB/s 2024-09-21T07:32:07.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142142 s, 73.8 MB/s 2024-09-21T07:32:07.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184659 s, 56.8 MB/s 2024-09-21T07:32:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147257 s, 71.2 MB/s 2024-09-21T07:32:07.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139542 s, 75.1 MB/s 2024-09-21T07:32:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135295 s, 77.5 MB/s 2024-09-21T07:32:07.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143372 s, 73.1 MB/s 2024-09-21T07:32:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129963 s, 80.7 MB/s 2024-09-21T07:32:07.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176573 s, 59.4 MB/s 2024-09-21T07:32:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156005 s, 67.2 MB/s 2024-09-21T07:32:07.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.594 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137904 s, 76.0 MB/s 2024-09-21T07:32:07.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.611 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014152 s, 74.1 MB/s 2024-09-21T07:32:07.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141777 s, 74.0 MB/s 2024-09-21T07:32:07.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142731 s, 73.5 MB/s 2024-09-21T07:32:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.20 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:07.652 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140513 s, 74.6 MB/s 2024-09-21T07:32:07.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.739 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157896 s, 66.4 MB/s 2024-09-21T07:32:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.755 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134575 s, 77.9 MB/s 2024-09-21T07:32:07.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139064 s, 75.4 MB/s 2024-09-21T07:32:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.788 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132409 s, 79.2 MB/s 2024-09-21T07:32:07.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144694 s, 72.5 MB/s 2024-09-21T07:32:07.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147 s, 71.3 MB/s 2024-09-21T07:32:07.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.840 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014369 s, 73.0 MB/s 2024-09-21T07:32:07.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.857 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140356 s, 74.7 MB/s 2024-09-21T07:32:07.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.877 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184998 s, 56.7 MB/s 2024-09-21T07:32:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144541 s, 72.5 MB/s 2024-09-21T07:32:07.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127603 s, 82.2 MB/s 2024-09-21T07:32:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137009 s, 76.5 MB/s 2024-09-21T07:32:07.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.943 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142386 s, 73.6 MB/s 2024-09-21T07:32:07.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140529 s, 74.6 MB/s 2024-09-21T07:32:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139009 s, 75.4 MB/s 2024-09-21T07:32:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014082 s, 74.5 MB/s 2024-09-21T07:32:08.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134325 s, 78.1 MB/s 2024-09-21T07:32:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150631 s, 69.6 MB/s 2024-09-21T07:32:08.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014944 s, 70.2 MB/s 2024-09-21T07:32:08.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140753 s, 74.5 MB/s 2024-09-21T07:32:08.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171509 s, 61.1 MB/s 2024-09-21T07:32:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013678 s, 76.7 MB/s 2024-09-21T07:32:08.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.114 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135207 s, 77.6 MB/s 2024-09-21T07:32:08.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128547 s, 81.6 MB/s 2024-09-21T07:32:08.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138977 s, 75.4 MB/s 2024-09-21T07:32:08.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149904 s, 69.9 MB/s 2024-09-21T07:32:08.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.180 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137947 s, 76.0 MB/s 2024-09-21T07:32:08.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-09-21T07:32:08.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116076 s, 90.3 MB/s 2024-09-21T07:32:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.230 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147497 s, 71.1 MB/s 2024-09-21T07:32:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018178 s, 57.7 MB/s 2024-09-21T07:32:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.21 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:08.259 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:08.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:08.326 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134347 s, 78.0 MB/s 2024-09-21T07:32:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174507 s, 60.1 MB/s 2024-09-21T07:32:08.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139447 s, 75.2 MB/s 2024-09-21T07:32:08.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015977 s, 65.6 MB/s 2024-09-21T07:32:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.398 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133995 s, 78.3 MB/s 2024-09-21T07:32:08.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131904 s, 79.5 MB/s 2024-09-21T07:32:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190514 s, 55.0 MB/s 2024-09-21T07:32:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177939 s, 58.9 MB/s 2024-09-21T07:32:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139236 s, 75.3 MB/s 2024-09-21T07:32:08.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.495 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.495 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186405 s, 56.3 MB/s 2024-09-21T07:32:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146023 s, 71.8 MB/s 2024-09-21T07:32:08.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132266 s, 79.3 MB/s 2024-09-21T07:32:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134127 s, 78.2 MB/s 2024-09-21T07:32:08.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140837 s, 74.5 MB/s 2024-09-21T07:32:08.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179878 s, 58.3 MB/s 2024-09-21T07:32:08.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.599 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015453 s, 67.9 MB/s 2024-09-21T07:32:08.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.616 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136725 s, 76.7 MB/s 2024-09-21T07:32:08.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013244 s, 79.2 MB/s 2024-09-21T07:32:08.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133539 s, 78.5 MB/s 2024-09-21T07:32:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144742 s, 72.4 MB/s 2024-09-21T07:32:08.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131501 s, 79.7 MB/s 2024-09-21T07:32:08.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013785 s, 76.1 MB/s 2024-09-21T07:32:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176961 s, 59.3 MB/s 2024-09-21T07:32:08.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148674 s, 70.5 MB/s 2024-09-21T07:32:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01395 s, 75.2 MB/s 2024-09-21T07:32:08.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148822 s, 70.5 MB/s 2024-09-21T07:32:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127797 s, 82.1 MB/s 2024-09-21T07:32:08.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150653 s, 69.6 MB/s 2024-09-21T07:32:08.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.819 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134968 s, 77.7 MB/s 2024-09-21T07:32:08.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151443 s, 69.2 MB/s 2024-09-21T07:32:08.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192565 s, 54.5 MB/s 2024-09-21T07:32:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175253 s, 59.8 MB/s 2024-09-21T07:32:08.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:08.887 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:08.887 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:08.887 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.22 2024-09-21T07:32:08.888 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:08.888 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:08.888 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:08.888 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:08.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013154 s, 79.7 MB/s 2024-09-21T07:32:08.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.974 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154044 s, 68.1 MB/s 2024-09-21T07:32:08.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:08.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:08.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146677 s, 71.5 MB/s 2024-09-21T07:32:09.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.010 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149852 s, 70.0 MB/s 2024-09-21T07:32:09.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180118 s, 58.2 MB/s 2024-09-21T07:32:09.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.053 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182355 s, 57.5 MB/s 2024-09-21T07:32:09.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153437 s, 68.3 MB/s 2024-09-21T07:32:09.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.087 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124249 s, 84.4 MB/s 2024-09-21T07:32:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.108 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177346 s, 59.1 MB/s 2024-09-21T07:32:09.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.123 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130544 s, 80.3 MB/s 2024-09-21T07:32:09.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149692 s, 70.0 MB/s 2024-09-21T07:32:09.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.158 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132866 s, 78.9 MB/s 2024-09-21T07:32:09.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.176 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141799 s, 73.9 MB/s 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154473 s, 67.9 MB/s 2024-09-21T07:32:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014754 s, 71.1 MB/s 2024-09-21T07:32:09.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133477 s, 78.6 MB/s 2024-09-21T07:32:09.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147101 s, 71.3 MB/s 2024-09-21T07:32:09.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140633 s, 74.6 MB/s 2024-09-21T07:32:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147426 s, 71.1 MB/s 2024-09-21T07:32:09.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.295 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133995 s, 78.3 MB/s 2024-09-21T07:32:09.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135069 s, 77.6 MB/s 2024-09-21T07:32:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140727 s, 74.5 MB/s 2024-09-21T07:32:09.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.343 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115272 s, 91.0 MB/s 2024-09-21T07:32:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140194 s, 74.8 MB/s 2024-09-21T07:32:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013194 s, 79.5 MB/s 2024-09-21T07:32:09.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.396 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185132 s, 56.6 MB/s 2024-09-21T07:32:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132186 s, 79.3 MB/s 2024-09-21T07:32:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139265 s, 75.3 MB/s 2024-09-21T07:32:09.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.450 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185058 s, 56.7 MB/s 2024-09-21T07:32:09.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163022 s, 64.3 MB/s 2024-09-21T07:32:09.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.486 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134384 s, 78.0 MB/s 2024-09-21T07:32:09.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.503 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145703 s, 72.0 MB/s 2024-09-21T07:32:09.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.23 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:09.511 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142461 s, 73.6 MB/s 2024-09-21T07:32:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145913 s, 71.9 MB/s 2024-09-21T07:32:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133386 s, 78.6 MB/s 2024-09-21T07:32:09.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171693 s, 61.1 MB/s 2024-09-21T07:32:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184106 s, 57.0 MB/s 2024-09-21T07:32:09.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.670 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138849 s, 75.5 MB/s 2024-09-21T07:32:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136543 s, 76.8 MB/s 2024-09-21T07:32:09.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140126 s, 74.8 MB/s 2024-09-21T07:32:09.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.720 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133415 s, 78.6 MB/s 2024-09-21T07:32:09.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118454 s, 88.5 MB/s 2024-09-21T07:32:09.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148294 s, 70.7 MB/s 2024-09-21T07:32:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147594 s, 71.0 MB/s 2024-09-21T07:32:09.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141736 s, 74.0 MB/s 2024-09-21T07:32:09.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146145 s, 71.7 MB/s 2024-09-21T07:32:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.821 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154467 s, 67.9 MB/s 2024-09-21T07:32:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138727 s, 75.6 MB/s 2024-09-21T07:32:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129859 s, 80.7 MB/s 2024-09-21T07:32:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013502 s, 77.7 MB/s 2024-09-21T07:32:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014514 s, 72.2 MB/s 2024-09-21T07:32:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138187 s, 75.9 MB/s 2024-09-21T07:32:09.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.919 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130168 s, 80.6 MB/s 2024-09-21T07:32:09.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.939 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174595 s, 60.1 MB/s 2024-09-21T07:32:09.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.956 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144595 s, 72.5 MB/s 2024-09-21T07:32:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014893 s, 70.4 MB/s 2024-09-21T07:32:09.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:09.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:09.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137191 s, 76.4 MB/s 2024-09-21T07:32:10.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174432 s, 60.1 MB/s 2024-09-21T07:32:10.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.032 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018102 s, 57.9 MB/s 2024-09-21T07:32:10.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141514 s, 74.1 MB/s 2024-09-21T07:32:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132275 s, 79.3 MB/s 2024-09-21T07:32:10.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132912 s, 78.9 MB/s 2024-09-21T07:32:10.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:10.092 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131364 s, 79.8 MB/s 2024-09-21T07:32:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150031 s, 69.9 MB/s 2024-09-21T07:32:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:10.122 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.24 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:10.129 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:10.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:10.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124577 s, 84.2 MB/s 2024-09-21T07:32:10.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.269 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137507 s, 76.3 MB/s 2024-09-21T07:32:10.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176567 s, 59.4 MB/s 2024-09-21T07:32:10.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174423 s, 60.1 MB/s 2024-09-21T07:32:10.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150686 s, 69.6 MB/s 2024-09-21T07:32:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116611 s, 89.9 MB/s 2024-09-21T07:32:10.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.358 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013913 s, 75.4 MB/s 2024-09-21T07:32:10.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132493 s, 79.1 MB/s 2024-09-21T07:32:10.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154102 s, 68.0 MB/s 2024-09-21T07:32:10.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136875 s, 76.6 MB/s 2024-09-21T07:32:10.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134168 s, 78.2 MB/s 2024-09-21T07:32:10.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.445 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154687 s, 67.8 MB/s 2024-09-21T07:32:10.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132845 s, 78.9 MB/s 2024-09-21T07:32:10.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154361 s, 67.9 MB/s 2024-09-21T07:32:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135833 s, 77.2 MB/s 2024-09-21T07:32:10.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133356 s, 78.6 MB/s 2024-09-21T07:32:10.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146951 s, 71.4 MB/s 2024-09-21T07:32:10.548 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.549 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185274 s, 56.6 MB/s 2024-09-21T07:32:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151574 s, 69.2 MB/s 2024-09-21T07:32:10.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131759 s, 79.6 MB/s 2024-09-21T07:32:10.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153498 s, 68.3 MB/s 2024-09-21T07:32:10.618 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.618 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.618 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139973 s, 74.9 MB/s 2024-09-21T07:32:10.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134621 s, 77.9 MB/s 2024-09-21T07:32:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153364 s, 68.4 MB/s 2024-09-21T07:32:10.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159475 s, 65.8 MB/s 2024-09-21T07:32:10.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014186 s, 73.9 MB/s 2024-09-21T07:32:10.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.707 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145803 s, 71.9 MB/s 2024-09-21T07:32:10.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137015 s, 76.5 MB/s 2024-09-21T07:32:10.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013625 s, 77.0 MB/s 2024-09-21T07:32:10.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180114 s, 58.2 MB/s 2024-09-21T07:32:10.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.780 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151082 s, 69.4 MB/s 2024-09-21T07:32:10.797 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.798 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148708 s, 70.5 MB/s 2024-09-21T07:32:10.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.25 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:10.805 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:10.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:10.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188525 s, 55.6 MB/s 2024-09-21T07:32:10.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.898 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.898 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014813 s, 70.8 MB/s 2024-09-21T07:32:10.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116631 s, 89.9 MB/s 2024-09-21T07:32:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139174 s, 75.3 MB/s 2024-09-21T07:32:10.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138774 s, 75.6 MB/s 2024-09-21T07:32:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137734 s, 76.1 MB/s 2024-09-21T07:32:10.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136398 s, 76.9 MB/s 2024-09-21T07:32:10.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:10.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:10.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141915 s, 73.9 MB/s 2024-09-21T07:32:11.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.018 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018791 s, 55.8 MB/s 2024-09-21T07:32:11.034 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.034 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.034 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129996 s, 80.7 MB/s 2024-09-21T07:32:11.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139652 s, 75.1 MB/s 2024-09-21T07:32:11.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130709 s, 80.2 MB/s 2024-09-21T07:32:11.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134022 s, 78.2 MB/s 2024-09-21T07:32:11.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153057 s, 68.5 MB/s 2024-09-21T07:32:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148438 s, 70.6 MB/s 2024-09-21T07:32:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148993 s, 70.4 MB/s 2024-09-21T07:32:11.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.153 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014711 s, 71.3 MB/s 2024-09-21T07:32:11.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177125 s, 59.2 MB/s 2024-09-21T07:32:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014793 s, 70.9 MB/s 2024-09-21T07:32:11.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.206 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129361 s, 81.1 MB/s 2024-09-21T07:32:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143703 s, 73.0 MB/s 2024-09-21T07:32:11.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.241 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141231 s, 74.2 MB/s 2024-09-21T07:32:11.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135722 s, 77.3 MB/s 2024-09-21T07:32:11.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.275 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149361 s, 70.2 MB/s 2024-09-21T07:32:11.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.292 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148826 s, 70.5 MB/s 2024-09-21T07:32:11.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140329 s, 74.7 MB/s 2024-09-21T07:32:11.325 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014334 s, 73.2 MB/s 2024-09-21T07:32:11.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.342 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138236 s, 75.9 MB/s 2024-09-21T07:32:11.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.363 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181337 s, 57.8 MB/s 2024-09-21T07:32:11.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.379 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013793 s, 76.0 MB/s 2024-09-21T07:32:11.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124104 s, 84.5 MB/s 2024-09-21T07:32:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157286 s, 66.7 MB/s 2024-09-21T07:32:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.26 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:11.420 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:11.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:11.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156961 s, 66.8 MB/s 2024-09-21T07:32:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145607 s, 72.0 MB/s 2024-09-21T07:32:11.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135689 s, 77.3 MB/s 2024-09-21T07:32:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013805 s, 76.0 MB/s 2024-09-21T07:32:11.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153795 s, 68.2 MB/s 2024-09-21T07:32:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152992 s, 68.5 MB/s 2024-09-21T07:32:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146538 s, 71.6 MB/s 2024-09-21T07:32:11.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177765 s, 59.0 MB/s 2024-09-21T07:32:11.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.630 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135538 s, 77.4 MB/s 2024-09-21T07:32:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124452 s, 84.3 MB/s 2024-09-21T07:32:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139246 s, 75.3 MB/s 2024-09-21T07:32:11.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152723 s, 68.7 MB/s 2024-09-21T07:32:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150297 s, 69.8 MB/s 2024-09-21T07:32:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132475 s, 79.2 MB/s 2024-09-21T07:32:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.730 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136569 s, 76.8 MB/s 2024-09-21T07:32:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144687 s, 72.5 MB/s 2024-09-21T07:32:11.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131216 s, 79.9 MB/s 2024-09-21T07:32:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124131 s, 84.5 MB/s 2024-09-21T07:32:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150406 s, 69.7 MB/s 2024-09-21T07:32:11.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015229 s, 68.9 MB/s 2024-09-21T07:32:11.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145789 s, 71.9 MB/s 2024-09-21T07:32:11.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01405 s, 74.6 MB/s 2024-09-21T07:32:11.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.864 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140937 s, 74.4 MB/s 2024-09-21T07:32:11.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135582 s, 77.3 MB/s 2024-09-21T07:32:11.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140938 s, 74.4 MB/s 2024-09-21T07:32:11.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129077 s, 81.2 MB/s 2024-09-21T07:32:11.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.932 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016645 s, 63.0 MB/s 2024-09-21T07:32:11.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.949 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140948 s, 74.4 MB/s 2024-09-21T07:32:11.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.965 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132977 s, 78.9 MB/s 2024-09-21T07:32:11.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.981 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013789 s, 76.0 MB/s 2024-09-21T07:32:11.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:11.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:11.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141409 s, 74.2 MB/s 2024-09-21T07:32:12.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133248 s, 78.7 MB/s 2024-09-21T07:32:12.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.27 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:12.022 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:12.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:12.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153557 s, 68.3 MB/s 2024-09-21T07:32:12.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182509 s, 57.5 MB/s 2024-09-21T07:32:12.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138155 s, 75.9 MB/s 2024-09-21T07:32:12.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014644 s, 71.6 MB/s 2024-09-21T07:32:12.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126383 s, 83.0 MB/s 2024-09-21T07:32:12.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131438 s, 79.8 MB/s 2024-09-21T07:32:12.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.195 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143011 s, 73.3 MB/s 2024-09-21T07:32:12.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168641 s, 62.2 MB/s 2024-09-21T07:32:12.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146777 s, 71.4 MB/s 2024-09-21T07:32:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137378 s, 76.3 MB/s 2024-09-21T07:32:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013594 s, 77.1 MB/s 2024-09-21T07:32:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175785 s, 59.7 MB/s 2024-09-21T07:32:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136395 s, 76.9 MB/s 2024-09-21T07:32:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147705 s, 71.0 MB/s 2024-09-21T07:32:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180677 s, 58.0 MB/s 2024-09-21T07:32:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152378 s, 68.8 MB/s 2024-09-21T07:32:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147683 s, 71.0 MB/s 2024-09-21T07:32:12.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.397 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186468 s, 56.2 MB/s 2024-09-21T07:32:12.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136226 s, 77.0 MB/s 2024-09-21T07:32:12.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.430 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012937 s, 81.1 MB/s 2024-09-21T07:32:12.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140848 s, 74.4 MB/s 2024-09-21T07:32:12.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.467 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165905 s, 63.2 MB/s 2024-09-21T07:32:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018365 s, 57.1 MB/s 2024-09-21T07:32:12.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.506 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128917 s, 81.3 MB/s 2024-09-21T07:32:12.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145747 s, 71.9 MB/s 2024-09-21T07:32:12.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.539 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127083 s, 82.5 MB/s 2024-09-21T07:32:12.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.555 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130141 s, 80.6 MB/s 2024-09-21T07:32:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.571 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013394 s, 78.3 MB/s 2024-09-21T07:32:12.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148474 s, 70.6 MB/s 2024-09-21T07:32:12.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.612 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186348 s, 56.3 MB/s 2024-09-21T07:32:12.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.630 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150721 s, 69.6 MB/s 2024-09-21T07:32:12.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118213 s, 88.7 MB/s 2024-09-21T07:32:12.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.28 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:12.652 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:12.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:12.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.723 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149899 s, 70.0 MB/s 2024-09-21T07:32:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134579 s, 77.9 MB/s 2024-09-21T07:32:12.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.757 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144115 s, 72.8 MB/s 2024-09-21T07:32:12.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.777 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176666 s, 59.4 MB/s 2024-09-21T07:32:12.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.792 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125753 s, 83.4 MB/s 2024-09-21T07:32:12.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116936 s, 89.7 MB/s 2024-09-21T07:32:12.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.828 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183996 s, 57.0 MB/s 2024-09-21T07:32:12.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.848 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175661 s, 59.7 MB/s 2024-09-21T07:32:12.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.865 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137599 s, 76.2 MB/s 2024-09-21T07:32:12.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150032 s, 69.9 MB/s 2024-09-21T07:32:12.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013632 s, 76.9 MB/s 2024-09-21T07:32:12.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177991 s, 58.9 MB/s 2024-09-21T07:32:12.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.939 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146677 s, 71.5 MB/s 2024-09-21T07:32:12.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.958 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163343 s, 64.2 MB/s 2024-09-21T07:32:12.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144845 s, 72.4 MB/s 2024-09-21T07:32:12.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:12.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:12.994 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152885 s, 68.6 MB/s 2024-09-21T07:32:13.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140125 s, 74.8 MB/s 2024-09-21T07:32:13.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.028 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132818 s, 78.9 MB/s 2024-09-21T07:32:13.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150577 s, 69.6 MB/s 2024-09-21T07:32:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153419 s, 68.3 MB/s 2024-09-21T07:32:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148479 s, 70.6 MB/s 2024-09-21T07:32:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135653 s, 77.3 MB/s 2024-09-21T07:32:13.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190129 s, 55.2 MB/s 2024-09-21T07:32:13.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.135 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136048 s, 77.1 MB/s 2024-09-21T07:32:13.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145705 s, 72.0 MB/s 2024-09-21T07:32:13.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.172 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168864 s, 62.1 MB/s 2024-09-21T07:32:13.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130569 s, 80.3 MB/s 2024-09-21T07:32:13.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147938 s, 70.9 MB/s 2024-09-21T07:32:13.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142717 s, 73.5 MB/s 2024-09-21T07:32:13.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.240 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.240 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151526 s, 69.2 MB/s 2024-09-21T07:32:13.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.258 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.258 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148112 s, 70.8 MB/s 2024-09-21T07:32:13.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192749 s, 54.4 MB/s 2024-09-21T07:32:13.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.29 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:13.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:13.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150748 s, 69.6 MB/s 2024-09-21T07:32:13.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133942 s, 78.3 MB/s 2024-09-21T07:32:13.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179447 s, 58.4 MB/s 2024-09-21T07:32:13.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136223 s, 77.0 MB/s 2024-09-21T07:32:13.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137823 s, 76.1 MB/s 2024-09-21T07:32:13.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140132 s, 74.8 MB/s 2024-09-21T07:32:13.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138028 s, 76.0 MB/s 2024-09-21T07:32:13.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144326 s, 72.7 MB/s 2024-09-21T07:32:13.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129953 s, 80.7 MB/s 2024-09-21T07:32:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018218 s, 57.6 MB/s 2024-09-21T07:32:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148191 s, 70.8 MB/s 2024-09-21T07:32:13.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.549 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.549 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153237 s, 68.4 MB/s 2024-09-21T07:32:13.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.565 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133623 s, 78.5 MB/s 2024-09-21T07:32:13.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138146 s, 75.9 MB/s 2024-09-21T07:32:13.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.598 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137463 s, 76.3 MB/s 2024-09-21T07:32:13.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187506 s, 55.9 MB/s 2024-09-21T07:32:13.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.636 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134759 s, 77.8 MB/s 2024-09-21T07:32:13.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.652 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.652 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133432 s, 78.6 MB/s 2024-09-21T07:32:13.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.668 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136543 s, 76.8 MB/s 2024-09-21T07:32:13.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144344 s, 72.6 MB/s 2024-09-21T07:32:13.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132895 s, 78.9 MB/s 2024-09-21T07:32:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150422 s, 69.7 MB/s 2024-09-21T07:32:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137935 s, 76.0 MB/s 2024-09-21T07:32:13.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142007 s, 73.8 MB/s 2024-09-21T07:32:13.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136707 s, 76.7 MB/s 2024-09-21T07:32:13.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146796 s, 71.4 MB/s 2024-09-21T07:32:13.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155664 s, 67.4 MB/s 2024-09-21T07:32:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181116 s, 57.9 MB/s 2024-09-21T07:32:13.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252801 s, 41.5 MB/s 2024-09-21T07:32:13.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139108 s, 75.4 MB/s 2024-09-21T07:32:13.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206108 s, 50.9 MB/s 2024-09-21T07:32:13.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142681 s, 73.5 MB/s 2024-09-21T07:32:13.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:13.918 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:13.918 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:13.918 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.30 2024-09-21T07:32:13.919 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:13.919 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:13.919 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:13.919 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:13.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:13.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:13.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:13.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139672 s, 75.1 MB/s 2024-09-21T07:32:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147049 s, 71.3 MB/s 2024-09-21T07:32:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187766 s, 55.8 MB/s 2024-09-21T07:32:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148752 s, 70.5 MB/s 2024-09-21T07:32:14.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188777 s, 55.5 MB/s 2024-09-21T07:32:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147002 s, 71.3 MB/s 2024-09-21T07:32:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154332 s, 67.9 MB/s 2024-09-21T07:32:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136097 s, 77.0 MB/s 2024-09-21T07:32:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131126 s, 80.0 MB/s 2024-09-21T07:32:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014813 s, 70.8 MB/s 2024-09-21T07:32:14.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137393 s, 76.3 MB/s 2024-09-21T07:32:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132392 s, 79.2 MB/s 2024-09-21T07:32:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147882 s, 70.9 MB/s 2024-09-21T07:32:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136626 s, 76.7 MB/s 2024-09-21T07:32:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145578 s, 72.0 MB/s 2024-09-21T07:32:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131983 s, 79.4 MB/s 2024-09-21T07:32:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013625 s, 77.0 MB/s 2024-09-21T07:32:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175549 s, 59.7 MB/s 2024-09-21T07:32:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141105 s, 74.3 MB/s 2024-09-21T07:32:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137556 s, 76.2 MB/s 2024-09-21T07:32:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140369 s, 74.7 MB/s 2024-09-21T07:32:14.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180546 s, 58.1 MB/s 2024-09-21T07:32:14.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.372 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136015 s, 77.1 MB/s 2024-09-21T07:32:14.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147942 s, 70.9 MB/s 2024-09-21T07:32:14.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133427 s, 78.6 MB/s 2024-09-21T07:32:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132337 s, 79.2 MB/s 2024-09-21T07:32:14.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145806 s, 71.9 MB/s 2024-09-21T07:32:14.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182662 s, 57.4 MB/s 2024-09-21T07:32:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.481 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183871 s, 57.0 MB/s 2024-09-21T07:32:14.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.497 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135632 s, 77.3 MB/s 2024-09-21T07:32:14.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.514 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148498 s, 70.6 MB/s 2024-09-21T07:32:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120094 s, 87.3 MB/s 2024-09-21T07:32:14.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:14.536 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:14.536 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:14.537 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.31 2024-09-21T07:32:14.537 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:14.537 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:14.537 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:14.537 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:14.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:14.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.604 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.604 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130264 s, 80.5 MB/s 2024-09-21T07:32:14.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137155 s, 76.5 MB/s 2024-09-21T07:32:14.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.639 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152412 s, 68.8 MB/s 2024-09-21T07:32:14.655 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.655 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.655 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134599 s, 77.9 MB/s 2024-09-21T07:32:14.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138163 s, 75.9 MB/s 2024-09-21T07:32:14.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145426 s, 72.1 MB/s 2024-09-21T07:32:14.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015123 s, 69.3 MB/s 2024-09-21T07:32:14.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176856 s, 59.3 MB/s 2024-09-21T07:32:14.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151131 s, 69.4 MB/s 2024-09-21T07:32:14.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.765 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176287 s, 59.5 MB/s 2024-09-21T07:32:14.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.782 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144304 s, 72.7 MB/s 2024-09-21T07:32:14.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.800 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152182 s, 68.9 MB/s 2024-09-21T07:32:14.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136548 s, 76.8 MB/s 2024-09-21T07:32:14.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.834 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151475 s, 69.2 MB/s 2024-09-21T07:32:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132738 s, 79.0 MB/s 2024-09-21T07:32:14.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.867 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142265 s, 73.7 MB/s 2024-09-21T07:32:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135342 s, 77.5 MB/s 2024-09-21T07:32:14.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150867 s, 69.5 MB/s 2024-09-21T07:32:14.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017817 s, 58.9 MB/s 2024-09-21T07:32:14.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.936 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118799 s, 88.3 MB/s 2024-09-21T07:32:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140315 s, 74.7 MB/s 2024-09-21T07:32:14.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.971 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147715 s, 71.0 MB/s 2024-09-21T07:32:14.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:14.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:14.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135853 s, 77.2 MB/s 2024-09-21T07:32:15.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186858 s, 56.1 MB/s 2024-09-21T07:32:15.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133104 s, 78.8 MB/s 2024-09-21T07:32:15.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.041 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139417 s, 75.2 MB/s 2024-09-21T07:32:15.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.057 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132252 s, 79.3 MB/s 2024-09-21T07:32:15.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132742 s, 79.0 MB/s 2024-09-21T07:32:15.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.089 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013998 s, 74.9 MB/s 2024-09-21T07:32:15.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.106 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139201 s, 75.3 MB/s 2024-09-21T07:32:15.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.122 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136542 s, 76.8 MB/s 2024-09-21T07:32:15.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:15.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:15.140 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143807 s, 72.9 MB/s 2024-09-21T07:32:15.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:15.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:15.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-21T07:32:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 -- 172.21.15.64:0/2692711438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50041592f0 msgr2=0x7f50040aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 --2- 172.21.15.64:0/2692711438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50041592f0 0x7f50040aee20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f5004072880 tx=0x7f4fec01c800 comp rx=0 tx=0).stop 2024-09-21T07:32:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 -- 172.21.15.64:0/2692711438 shutdown_connections 2024-09-21T07:32:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 --2- 172.21.15.64:0/2692711438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50041592f0 0x7f50040aee20 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 --2- 172.21.15.64:0/2692711438 >> v2:172.21.15.90:3300/0 conn(0x7f500406ec70 0x7f5004158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.353+0000 7f500ae00640 1 -- 172.21.15.64:0/2692711438 >> 172.21.15.64:0/2692711438 conn(0x7f50040d0170 msgr2=0x7f50040d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- 172.21.15.64:0/2692711438 shutdown_connections 2024-09-21T07:32:15.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- 172.21.15.64:0/2692711438 wait complete. 2024-09-21T07:32:15.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 Processor -- start 2024-09-21T07:32:15.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- start start 2024-09-21T07:32:15.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 0x7f50040b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50041592f0 0x7f50040b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f500415c810 con 0x7f50040af360 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f500415c690 con 0x7f500406ec70 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.357+0000 7f500ae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f500415c990 con 0x7f50041592f0 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52020/0 (socket says 172.21.15.64:52020) 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2956188834 learned_addr learned my addr 172.21.15.64:0/2956188834 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5003e00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 0x7f50040b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5008e00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50041592f0 0x7f50040b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50041592f0 msgr2=0x7f50040b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50041592f0 0x7f50040b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 msgr2=0x7f50040b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 0x7f50040b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2956188834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040b5ed0 con 0x7f50040af360 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5003e00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 0x7f50040b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:15.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4fec019410 tx=0x7f4fec005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5000c00640 1 -- 172.21.15.64:0/2956188834 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0b2040 con 0x7f50040af360 2024-09-21T07:32:15.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5000c00640 1 -- 172.21.15.64:0/2956188834 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec004040 con 0x7f50040af360 2024-09-21T07:32:15.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50041fd0a0 con 0x7f50040af360 2024-09-21T07:32:15.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5000c00640 1 -- 172.21.15.64:0/2956188834 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec004490 con 0x7f50040af360 2024-09-21T07:32:15.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040b06b0 con 0x7f50040af360 2024-09-21T07:32:15.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.361+0000 7f5000c00640 1 -- 172.21.15.64:0/2956188834 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4fec0bf020 con 0x7f50040af360 2024-09-21T07:32:15.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5000c00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 0x7f4fe0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5000c00640 1 -- 172.21.15.64:0/2956188834 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4fec12e640 con 0x7f50040af360 2024-09-21T07:32:15.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 Processor -- start 2024-09-21T07:32:15.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5003e00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 0x7f4fe0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 -- start start 2024-09-21T07:32:15.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5003e00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 0x7f4fe0075710 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f50040cc8f0 tx=0x7f4ff40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d5687800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d5687d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5584d5499910 con 0x5584d55149b0 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584d5488d40 con 0x5584d5508710 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5584d548cb50 con 0x5584d5507f00 2024-09-21T07:32:15.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5003e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5003e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52030/0 (socket says 172.21.15.64:52030) 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.365+0000 7f5003e00640 1 -- 172.21.15.64:0/938468147 learned_addr learned my addr 172.21.15.64:0/938468147 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5008e00640 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d5687d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d5687800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 -- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 msgr2=0x5584d5687800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d5687800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 -- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 msgr2=0x5584d5687d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d5687d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 -- 172.21.15.64:0/938468147 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d54272e0 con 0x5584d55149b0 2024-09-21T07:32:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f5003e00640 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009610 tx=0x7f4ff4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68755b24bf91b971 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f4ff8c00640 1 -- 172.21.15.64:0/938468147 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4003d80 con 0x5584d55149b0 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f4ff8c00640 1 -- 172.21.15.64:0/938468147 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ff4025070 con 0x5584d55149b0 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f4ff8c00640 1 -- 172.21.15.64:0/938468147 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4012650 con 0x5584d55149b0 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- 172.21.15.64:0/938468147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 msgr2=0x5584d56872c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009610 tx=0x7f4ff4014000 comp rx=0 tx=0).stop 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- 172.21.15.64:0/938468147 shutdown_connections 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d5687d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d5687800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 --2- 172.21.15.64:0/938468147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56872c0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- 172.21.15.64:0/938468147 >> 172.21.15.64:0/938468147 conn(0x5584d5543cb0 msgr2=0x5584d5644120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- 172.21.15.64:0/938468147 shutdown_connections 2024-09-21T07:32:15.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- 172.21.15.64:0/938468147 wait complete. 2024-09-21T07:32:15.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 -- start start 2024-09-21T07:32:15.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.369+0000 7f501262e000 1 Processor -- start 2024-09-21T07:32:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 0x5584d56867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d5686d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5584d5432d10 con 0x5584d5507f00 2024-09-21T07:32:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584d54342e0 con 0x5584d55149b0 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5584d54986e0 con 0x5584d5508710 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 10 client.0 _ll_register_callbacks cb 0x5584d5629790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 0x5584d56867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52046/0 (socket says 172.21.15.64:52046) 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 0x5584d56867c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51472/0 (socket says 172.21.15.64:51472) 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 -- 172.21.15.64:0/3781378588 learned_addr learned my addr 172.21.15.64:0/3781378588 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5008e00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d5686d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 -- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 msgr2=0x5584d56867c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 0x5584d56867c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 -- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 msgr2=0x5584d5686d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d5686d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 -- 172.21.15.64:0/3781378588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d5446250 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f5003e00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40095e0 tx=0x7f4ff4012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef719305d514597b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4012d00 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4ff4035470 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584d5421420 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f4ff403d050 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 10 client.8745 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5584d540e030 con 0x5584d5507f00 2024-09-21T07:32:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5584d5421420 con 0x5584d5507f00 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f4ff4040020 con 0x5584d5507f00 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 10 client.8745 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 10 client.8745 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 20 client.8745 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d512b8b0 0x5584d5698b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 4 client.8745 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584d549b860 con 0x5584d512b8b0 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d512b8b0 0x5584d5698b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d512b8b0 0x5584d5698b30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5bf65865a49a1f0 server_cookie=76e2a6a7d8cde6c1 in_seq=0 out_seq=0 2024-09-21T07:32:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.373+0000 7f4ff1600640 10 client.8745 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f4ff1600640 1 -- 172.21.15.64:0/3781378588 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584d549b860 con 0x5584d512b8b0 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f4ff1600640 10 client.8745 handle_command_reply: tid=0 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 client.8745 shutdown 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 msgr2=0x5584d5686280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40095e0 tx=0x7f4ff4012700 comp rx=0 tx=0).stop 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 shutdown_connections 2024-09-21T07:32:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d512b8b0 0x5584d5698b30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d5686d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5508710 0x5584d56867c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f4ff1600640 0 client.8745 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 --2- 172.21.15.64:0/3781378588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5507f00 0x5584d5686280 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 >> 172.21.15.64:0/3781378588 conn(0x5584d5543cb0 msgr2=0x5584d563caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 shutdown_connections 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 1 -- 172.21.15.64:0/3781378588 wait complete. 2024-09-21T07:32:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.377+0000 7f501262e000 20 client.8745 trim_cache size 0 max 16384 2024-09-21T07:32:15.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.393+0000 7f501262e000 1 Processor -- start 2024-09-21T07:32:15.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.393+0000 7f501262e000 1 -- start start 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5004204c60 con 0x5584d55149b0 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50041f9720 con 0x5584d5508710 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5004204600 con 0x5584d5507f00 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f5008e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f5008e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52048/0 (socket says 172.21.15.64:52048) 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:45586/0 (socket says 172.21.15.64:45586) 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f5008e00640 1 -- 172.21.15.64:0/2180729409 learned_addr learned my addr 172.21.15.64:0/2180729409 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f5003e00640 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 msgr2=0x5584d56f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2180729409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 msgr2=0x5584d56fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2180729409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d54e5340 con 0x5584d5508710 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f5008e00640 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4fec12c940 tx=0x7f4fec0ba040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6fc68128e3b5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ff3e00640 1 -- 172.21.15.64:0/2180729409 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec113070 con 0x5584d5508710 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ff3e00640 1 -- 172.21.15.64:0/2180729409 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec0f9430 con 0x5584d5508710 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f4ff3e00640 1 -- 172.21.15.64:0/2180729409 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0f8d30 con 0x5584d5508710 2024-09-21T07:32:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 msgr2=0x5584d56f9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4fec12c940 tx=0x7f4fec0ba040 comp rx=0 tx=0).stop 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- 172.21.15.64:0/2180729409 shutdown_connections 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d55149b0 0x5584d56fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d5508710 0x5584d56f9dc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 --2- 172.21.15.64:0/2180729409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- 172.21.15.64:0/2180729409 >> 172.21.15.64:0/2180729409 conn(0x5584d5543cb0 msgr2=0x5584d563cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- 172.21.15.64:0/2180729409 shutdown_connections 2024-09-21T07:32:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- 172.21.15.64:0/2180729409 wait complete. 2024-09-21T07:32:15.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.397+0000 7f501262e000 1 -- start start 2024-09-21T07:32:15.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 Processor -- start 2024-09-21T07:32:15.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56fd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d56fdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5584d548be60 con 0x5584d5508710 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584d5448850 con 0x5584d55149b0 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5584d5491180 con 0x5584d5507f00 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 10 client.0 _ll_register_callbacks cb 0x7f4ff4011f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52054/0 (socket says 172.21.15.64:52054) 2024-09-21T07:32:15.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2248483696 learned_addr learned my addr 172.21.15.64:0/2248483696 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f5008e00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d56fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f5003e00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56fd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 msgr2=0x5584d56fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56fd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 msgr2=0x5584d56fdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d56fdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 -- 172.21.15.64:0/2248483696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d5451d80 con 0x5584d5508710 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f5008e00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d56fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ffbe00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005f80 tx=0x7f4fec0f5490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c7a331963ae981 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec113070 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4fec0f8f90 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec0f9430 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f4fec102750 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 10 client.8751 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5584d513f1a0 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec0f9430 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f4fec1022c0 con 0x5584d5508710 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 10 client.8751 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 10 client.8751 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 20 client.8751 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d5119910 0x5584d56b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 4 client.8751 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-21T07:32:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5584d5639ff0 con 0x5584d5119910 2024-09-21T07:32:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.401+0000 7f5003e00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d5119910 0x5584d56b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f4ff1600640 10 client.8751 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f5003e00640 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d5119910 0x5584d56b8f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2398e24685fc23b1 server_cookie=7bcfea17aee5ba2f in_seq=0 out_seq=0 2024-09-21T07:32:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f4ff1600640 1 -- 172.21.15.64:0/2248483696 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5584d5639ff0 con 0x5584d5119910 2024-09-21T07:32:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f4ff1600640 10 client.8751 handle_command_reply: tid=0 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 client.8751 shutdown 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 msgr2=0x5584d56fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005f80 tx=0x7f4fec0f5490 comp rx=0 tx=0).stop 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 shutdown_connections 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5584d5119910 0x5584d56b8f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584d55149b0 0x5584d56fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5584d5508710 0x5584d56fda30 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 --2- 172.21.15.64:0/2248483696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5584d5507f00 0x5584d56fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 >> 172.21.15.64:0/2248483696 conn(0x5584d5543cb0 msgr2=0x5584d563d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f4ff1600640 0 client.8751 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 shutdown_connections 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 1 -- 172.21.15.64:0/2248483696 wait complete. 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.405+0000 7f501262e000 20 client.8751 trim_cache size 0 max 16384 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "9b14dbec-9b51-47df-a814-640bd078d5b2", 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:32:15.411 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:15.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 msgr2=0x7f4fe0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 0x7f4fe0075710 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f50040cc8f0 tx=0x7f4ff40091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 msgr2=0x7f50041fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4fec019410 tx=0x7f4fec005d60 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 shutdown_connections 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe0073200 0x7f4fe0075710 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50041592f0 0x7f50040b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040af360 0x7f50041fcb60 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 --2- 172.21.15.64:0/2956188834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f500406ec70 0x7f50040b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 >> 172.21.15.64:0/2956188834 conn(0x7f50040d0170 msgr2=0x7f50040acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 shutdown_connections 2024-09-21T07:32:15.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.409+0000 7f500ae00640 1 -- 172.21.15.64:0/2956188834 wait complete. 2024-09-21T07:32:15.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:15.433 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 -- 172.21.15.64:0/3393377064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0cccc0 msgr2=0x7f139c0cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 --2- 172.21.15.64:0/3393377064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0cccc0 0x7f139c0cd0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f138c009840 tx=0x7f138c01c820 comp rx=0 tx=0).stop 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 -- 172.21.15.64:0/3393377064 shutdown_connections 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 --2- 172.21.15.64:0/3393377064 >> v2:172.21.15.90:3300/0 conn(0x7f139c0b3d30 0x7f139c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 --2- 172.21.15.64:0/3393377064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0cccc0 0x7f139c0cd0d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.641+0000 7f13a2a00640 1 -- 172.21.15.64:0/3393377064 >> 172.21.15.64:0/3393377064 conn(0x7f139c06d510 msgr2=0x7f139c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.645+0000 7f13a2a00640 1 -- 172.21.15.64:0/3393377064 shutdown_connections 2024-09-21T07:32:15.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.645+0000 7f13a2a00640 1 -- 172.21.15.64:0/3393377064 wait complete. 2024-09-21T07:32:15.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.645+0000 7f13a2a00640 1 Processor -- start 2024-09-21T07:32:15.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.645+0000 7f13a2a00640 1 -- start start 2024-09-21T07:32:15.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 0x7f139c156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f139c0cccc0 0x7f139c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f139c16a3a0 con 0x7f139c071140 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f139c16a220 con 0x7f139c0cccc0 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f139c16a520 con 0x7f139c0b3d30 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52066/0 (socket says 172.21.15.64:52066) 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 -- 172.21.15.64:0/1038777863 learned_addr learned my addr 172.21.15.64:0/1038777863 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a0a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f139c0cccc0 0x7f139c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 0x7f139c156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 -- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 msgr2=0x7f139c156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 0x7f139c156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 -- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f139c0cccc0 msgr2=0x7f139c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f139c0cccc0 0x7f139c1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 -- 172.21.15.64:0/1038777863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c155b80 con 0x7f139c071140 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139b400640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 0x7f139c156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f139be00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f138c009790 tx=0x7f138c0a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f1393e00640 1 -- 172.21.15.64:0/1038777863 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0bb070 con 0x7f139c071140 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f1393e00640 1 -- 172.21.15.64:0/1038777863 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f138c004470 con 0x7f139c071140 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c155e60 con 0x7f139c071140 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f1393e00640 1 -- 172.21.15.64:0/1038777863 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0b2040 con 0x7f139c071140 2024-09-21T07:32:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.649+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c156420 con 0x7f139c071140 2024-09-21T07:32:15.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.653+0000 7f1393e00640 1 -- 172.21.15.64:0/1038777863 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f138c0be070 con 0x7f139c071140 2024-09-21T07:32:15.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 Processor -- start 2024-09-21T07:32:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 -- start start 2024-09-21T07:32:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f1393e00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 0x7f137c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f1393e00640 1 -- 172.21.15.64:0/1038777863 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f138c12d9d0 con 0x7f139c071140 2024-09-21T07:32:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a0a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 0x7f137c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a0a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 0x7f137c075740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f13940012f0 tx=0x7f1394009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12991e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1299720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55feb104d2e0 con 0x55feb1139ab0 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55feb10aabb0 con 0x55feb1148630 2024-09-21T07:32:15.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55feb1099fe0 con 0x55feb1126170 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:45632/0 (socket says 172.21.15.64:45632) 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 -- 172.21.15.64:0/2344849631 learned_addr learned my addr 172.21.15.64:0/2344849631 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f13a0a00640 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1299720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 -- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 msgr2=0x55feb1299720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1299720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 -- 172.21.15.64:0/2344849631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 msgr2=0x55feb12991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 -- 172.21.15.64:0/2344849631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feb10381c0 con 0x55feb1148630 2024-09-21T07:32:15.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f139be00640 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f138c0f81b0 tx=0x7f138c0f4160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89929122c4a4f421 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f1387e00640 1 -- 172.21.15.64:0/2344849631 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0f7d30 con 0x55feb1148630 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f1387e00640 1 -- 172.21.15.64:0/2344849631 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f138c0fcc50 con 0x55feb1148630 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.657+0000 7f1387e00640 1 -- 172.21.15.64:0/2344849631 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c101b00 con 0x55feb1148630 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 msgr2=0x55feb1298ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f138c0f81b0 tx=0x7f138c0f4160 comp rx=0 tx=0).stop 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- 172.21.15.64:0/2344849631 shutdown_connections 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1299720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 --2- 172.21.15.64:0/2344849631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb1298ca0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- 172.21.15.64:0/2344849631 >> 172.21.15.64:0/2344849631 conn(0x55feb0d57d20 msgr2=0x55feb124dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- 172.21.15.64:0/2344849631 shutdown_connections 2024-09-21T07:32:15.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- 172.21.15.64:0/2344849631 wait complete. 2024-09-21T07:32:15.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 -- start start 2024-09-21T07:32:15.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.661+0000 7f13a9f59000 1 Processor -- start 2024-09-21T07:32:15.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1284470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 0x55feb1284ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55feb103f4f0 con 0x55feb1148630 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55feb109ddf0 con 0x55feb1139ab0 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55feb0d5f620 con 0x55feb1126170 2024-09-21T07:32:15.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 10 client.0 _ll_register_callbacks cb 0x55feb1070cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 0x55feb1284ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:45648/0 (socket says 172.21.15.64:45648) 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 -- 172.21.15.64:0/3573077377 learned_addr learned my addr 172.21.15.64:0/3573077377 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139be00640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1284470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 -- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 msgr2=0x55feb1284470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1284470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 -- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 msgr2=0x55feb1284ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 0x55feb1284ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 -- 172.21.15.64:0/3573077377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feb1169740 con 0x55feb1139ab0 2024-09-21T07:32:15.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139be00640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1284470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:15.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a0a00640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 0x55feb1284ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:15.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f139b400640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1388012a10 tx=0x7f1388012ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb81d229821b648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f1384c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138800fa40 con 0x55feb1139ab0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f138801dc60 con 0x55feb1139ab0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55feb1032300 con 0x55feb1139ab0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f138801de60 con 0x55feb1139ab0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 10 client.8347 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55feb111f440 con 0x55feb1139ab0 2024-09-21T07:32:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.665+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55feb1032300 con 0x55feb1139ab0 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f138800fbe0 con 0x55feb1139ab0 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 10 client.8347 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 10 client.8347 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 20 client.8347 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d3c8d0 0x55feb12aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 4 client.8347 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55feb10acb00 con 0x55feb0d3c8d0 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f139be00640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d3c8d0 0x55feb12aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f139be00640 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d3c8d0 0x55feb12aa260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee8fe2a296ba655 server_cookie=e19625550a85031a in_seq=0 out_seq=0 2024-09-21T07:32:15.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f1384c00640 10 client.8347 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f1384c00640 1 -- 172.21.15.64:0/3573077377 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55feb10acb00 con 0x55feb0d3c8d0 2024-09-21T07:32:15.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.669+0000 7f1384c00640 10 client.8347 handle_command_reply: tid=0 2024-09-21T07:32:15.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 client.8347 shutdown 2024-09-21T07:32:15.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 msgr2=0x55feb12849b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1388012a10 tx=0x7f1388012ed0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 shutdown_connections 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d3c8d0 0x55feb12aa260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1148630 0x55feb1284ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1139ab0 0x55feb12849b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3573077377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb1284470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 >> 172.21.15.64:0/3573077377 conn(0x55feb0d57d20 msgr2=0x55feb124dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f1384c00640 0 client.8347 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 shutdown_connections 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 1 -- 172.21.15.64:0/3573077377 wait complete. 2024-09-21T07:32:15.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.673+0000 7f13a9f59000 20 client.8347 trim_cache size 0 max 16384 2024-09-21T07:32:15.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 Processor -- start 2024-09-21T07:32:15.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 -- start start 2024-09-21T07:32:15.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1126170 0x55feb1284260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12847a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 0x55feb12825e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55feb1253750 con 0x55feb1139ab0 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f137400ceb0 con 0x55feb1126170 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f137400be90 con 0x55feb1148630 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f139b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.701+0000 7f139be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1126170 0x55feb1284260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f139b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12847a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52088/0 (socket says 172.21.15.64:52088) 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f139b400640 1 -- 172.21.15.64:0/3454453672 learned_addr learned my addr 172.21.15.64:0/3454453672 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 0x55feb12825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 -- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1126170 msgr2=0x55feb1284260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1126170 0x55feb1284260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 -- 172.21.15.64:0/3454453672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 msgr2=0x55feb12847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 -- 172.21.15.64:0/3454453672 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feb10f6b00 con 0x55feb1148630 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a0a00640 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 0x55feb12825e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f139400f5a0 tx=0x7f1394012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b6a14653536ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f1387400640 1 -- 172.21.15.64:0/3454453672 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394028070 con 0x55feb1148630 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f1387400640 1 -- 172.21.15.64:0/3454453672 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f139401b070 con 0x55feb1148630 2024-09-21T07:32:15.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f1387400640 1 -- 172.21.15.64:0/3454453672 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394023680 con 0x55feb1148630 2024-09-21T07:32:15.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 -- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 msgr2=0x55feb12825e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 0x55feb12825e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f139400f5a0 tx=0x7f1394012000 comp rx=0 tx=0).stop 2024-09-21T07:32:15.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 -- 172.21.15.64:0/3454453672 shutdown_connections 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1148630 0x55feb12825e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb12847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 --2- 172.21.15.64:0/3454453672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1126170 0x55feb1284260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 -- 172.21.15.64:0/3454453672 >> 172.21.15.64:0/3454453672 conn(0x55feb0d57d20 msgr2=0x55feb1254630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 -- 172.21.15.64:0/3454453672 shutdown_connections 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.705+0000 7f13a9f59000 1 -- 172.21.15.64:0/3454453672 wait complete. 2024-09-21T07:32:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 -- start start 2024-09-21T07:32:15.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 Processor -- start 2024-09-21T07:32:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb130e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb130ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55feb1065c70 con 0x55feb1139ab0 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55feb10aabb0 con 0x55feb1148630 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55feb10a2420 con 0x55feb1126170 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a9f59000 10 client.0 _ll_register_callbacks cb 0x7f1388009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb130e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51546/0 (socket says 172.21.15.64:51546) 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 -- 172.21.15.64:0/1133263827 learned_addr learned my addr 172.21.15.64:0/1133263827 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f13a0a00640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb130ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 -- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 msgr2=0x55feb130ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb130ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 -- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 msgr2=0x55feb130e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb130e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 -- 172.21.15.64:0/1133263827 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55feb1064060 con 0x55feb1126170 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f139be00640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f138c01cd90 tx=0x7f138c12bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00cbbeee7dd6874 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f1384c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.709+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0f8220 con 0x55feb1126170 2024-09-21T07:32:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f138c101670 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f139401b070 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f138c101b00 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 10 client.7529 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55feb1030640 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f139401b070 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f138c119ce0 con 0x55feb1126170 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 10 client.7529 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 10 client.7529 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 20 client.7529 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d2a930 0x55feb124e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 4 client.7529 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55feb10a85b0 con 0x55feb0d2a930 2024-09-21T07:32:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f139b400640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d2a930 0x55feb124e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f1384c00640 10 client.7529 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.713+0000 7f139b400640 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d2a930 0x55feb124e720 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e128bcbd6e5efeb9 server_cookie=a78449001d9ad305 in_seq=0 out_seq=0 2024-09-21T07:32:15.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f1384c00640 1 -- 172.21.15.64:0/1133263827 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55feb10a85b0 con 0x55feb0d2a930 2024-09-21T07:32:15.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f1384c00640 10 client.7529 handle_command_reply: tid=0 2024-09-21T07:32:15.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 client.7529 shutdown 2024-09-21T07:32:15.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 msgr2=0x55feb130e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f138c01cd90 tx=0x7f138c12bc40 comp rx=0 tx=0).stop 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 shutdown_connections 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55feb0d2a930 0x55feb124e720 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb1148630 0x55feb130ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55feb1139ab0 0x55feb130e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f1384c00640 0 client.7529 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 --2- 172.21.15.64:0/1133263827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55feb1126170 0x55feb130e1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 >> 172.21.15.64:0/1133263827 conn(0x55feb0d57d20 msgr2=0x55feb12845f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 shutdown_connections 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 1 -- 172.21.15.64:0/1133263827 wait complete. 2024-09-21T07:32:15.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a9f59000 20 client.7529 trim_cache size 0 max 16384 2024-09-21T07:32:15.733 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:15.733 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:32:15.733 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:32:15.733 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:15.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 msgr2=0x7f137c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 0x7f137c075740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f13940012f0 tx=0x7f1394009040 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 msgr2=0x7f139c0b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f138c009790 tx=0x7f138c0a5650 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 shutdown_connections 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f137c073230 0x7f137c075740 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f139c0cccc0 0x7f139c1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f139c0b3d30 0x7f139c156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 --2- 172.21.15.64:0/1038777863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139c071140 0x7f139c0b56d0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.729+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 >> 172.21.15.64:0/1038777863 conn(0x7f139c06d510 msgr2=0x7f139c166740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.733+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 shutdown_connections 2024-09-21T07:32:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.733+0000 7f13a2a00640 1 -- 172.21.15.64:0/1038777863 wait complete. 2024-09-21T07:32:15.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:15.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- 172.21.15.64:0/4290991611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840d09a0 msgr2=0x7fea840d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- 172.21.15.64:0/4290991611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840d09a0 0x7fea840d0db0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009c80 tx=0x7fea7c01cb90 comp rx=0 tx=0).stop 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- 172.21.15.64:0/4290991611 shutdown_connections 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- 172.21.15.64:0/4290991611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840d09a0 0x7fea840d0db0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- 172.21.15.64:0/4290991611 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840b44c0 0x7fea8415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- 172.21.15.64:0/4290991611 >> 172.21.15.64:0/4290991611 conn(0x7fea8406d1f0 msgr2=0x7fea8406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- 172.21.15.64:0/4290991611 shutdown_connections 2024-09-21T07:32:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- 172.21.15.64:0/4290991611 wait complete. 2024-09-21T07:32:15.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 Processor -- start 2024-09-21T07:32:15.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- start start 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840d09a0 0x7fea840cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea840d1d70 0x7fea840c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea84169e40 con 0x7fea841fc810 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea84169cc0 con 0x7fea840d1d70 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.913+0000 7fea88e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea84169fc0 con 0x7fea840d09a0 2024-09-21T07:32:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52110/0 (socket says 172.21.15.64:52110) 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 -- 172.21.15.64:0/3743962508 learned_addr learned my addr 172.21.15.64:0/3743962508 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea7be00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea840d1d70 0x7fea840c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea81e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840d09a0 0x7fea840cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 -- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840d09a0 msgr2=0x7fea840cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840d09a0 0x7fea840cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 -- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea840d1d70 msgr2=0x7fea840c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea840d1d70 0x7fea840c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 -- 172.21.15.64:0/3743962508 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea840b4060 con 0x7fea841fc810 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea82800640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fea7c01b240 tx=0x7fea7c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea7a000640 1 -- 172.21.15.64:0/3743962508 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0bc070 con 0x7fea841fc810 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea7a000640 1 -- 172.21.15.64:0/3743962508 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7c0040c0 con 0x7fea841fc810 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea840b4340 con 0x7fea841fc810 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea7a000640 1 -- 172.21.15.64:0/3743962508 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0b2040 con 0x7fea841fc810 2024-09-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.917+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841fc2f0 con 0x7fea841fc810 2024-09-21T07:32:15.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea7a000640 1 -- 172.21.15.64:0/3743962508 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea7c0bf070 con 0x7fea841fc810 2024-09-21T07:32:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea7a000640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea7a000640 1 -- 172.21.15.64:0/3743962508 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fea7c12dfb0 con 0x7fea841fc810 2024-09-21T07:32:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 Processor -- start 2024-09-21T07:32:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea81e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 -- start start 2024-09-21T07:32:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea81e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fea74007fd0 tx=0x7fea74009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf569c890 0x55dbf5bb1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5bb2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dbf5a50cd0 con 0x55dbf569c890 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dbf5966330 con 0x55dbf5760aa0 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.921+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dbf59c3bb0 con 0x55dbf5a456d0 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51578/0 (socket says 172.21.15.64:51578) 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 -- 172.21.15.64:0/2383599858 learned_addr learned my addr 172.21.15.64:0/2383599858 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea7be00640 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf569c890 0x55dbf5bb1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea82800640 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5bb2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 -- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 msgr2=0x55dbf5bb2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5bb2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 -- 172.21.15.64:0/2383599858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf569c890 msgr2=0x55dbf5bb1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf569c890 0x55dbf5bb1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 -- 172.21.15.64:0/2383599858 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf5967c80 con 0x55dbf5a456d0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea81e00640 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea7400f990 tx=0x7fea74012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c961e1374cb07e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea72a00640 1 -- 172.21.15.64:0/2383599858 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74025070 con 0x55dbf5a456d0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea72a00640 1 -- 172.21.15.64:0/2383599858 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7401b050 con 0x55dbf5a456d0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea72a00640 1 -- 172.21.15.64:0/2383599858 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74014e40 con 0x55dbf5a456d0 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 msgr2=0x55dbf5bb19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea7400f990 tx=0x7fea74012000 comp rx=0 tx=0).stop 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- 172.21.15.64:0/2383599858 shutdown_connections 2024-09-21T07:32:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5bb2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf569c890 0x55dbf5bb1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 --2- 172.21.15.64:0/2383599858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5bb19f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- 172.21.15.64:0/2383599858 >> 172.21.15.64:0/2383599858 conn(0x55dbf56705c0 msgr2=0x55dbf5b6eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- 172.21.15.64:0/2383599858 shutdown_connections 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- 172.21.15.64:0/2383599858 wait complete. 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 -- start start 2024-09-21T07:32:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.925+0000 7fea90669000 1 Processor -- start 2024-09-21T07:32:15.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5b6da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5b745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dbf59b6df0 con 0x55dbf5760aa0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dbf59b2fe0 con 0x55dbf569c890 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dbf59584d0 con 0x55dbf5a456d0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 10 client.0 _ll_register_callbacks cb 0x55dbf59367f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52128/0 (socket says 172.21.15.64:52128) 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 -- 172.21.15.64:0/283622953 learned_addr learned my addr 172.21.15.64:0/283622953 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea82800640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5b745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea81e00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5b6da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 -- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 msgr2=0x55dbf5b745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5b745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 -- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 msgr2=0x55dbf5b6da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5b6da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 -- 172.21.15.64:0/283622953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf5951210 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea7be00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fea6c012700 tx=0x7fea6c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a8f64422deb3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c004030 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fea6c0041d0 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbf594b350 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fea6c024050 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 10 client.8781 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55dbf5937fc0 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dbf594b350 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7fea6c027020 con 0x55dbf5760aa0 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 10 client.8781 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 10 client.8781 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 20 client.8781 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5655930 0x55dbf5bb8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 4 client.8781 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:15.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf59c5b00 con 0x55dbf5655930 2024-09-21T07:32:15.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea81e00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5655930 0x55dbf5bb8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea81e00640 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5655930 0x55dbf5bb8e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=823975dd8beebba6 server_cookie=10a02c7d4511677c in_seq=0 out_seq=0 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.929+0000 7fea67400640 10 client.8781 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea67400640 1 -- 172.21.15.64:0/283622953 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbf59c5b00 con 0x55dbf5655930 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea67400640 10 client.8781 handle_command_reply: tid=0 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 client.8781 shutdown 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 msgr2=0x55dbf5b6df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fea6c012700 tx=0x7fea6c009f90 comp rx=0 tx=0).stop 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 shutdown_connections 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5655930 0x55dbf5bb8e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5b745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5b6df40 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea67400640 0 client.8781 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 --2- 172.21.15.64:0/283622953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5b6da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 >> 172.21.15.64:0/283622953 conn(0x55dbf56705c0 msgr2=0x55dbf5b66d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 shutdown_connections 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 1 -- 172.21.15.64:0/283622953 wait complete. 2024-09-21T07:32:15.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.933+0000 7fea90669000 20 client.8781 trim_cache size 0 max 16384 2024-09-21T07:32:15.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.949+0000 7fea90669000 1 Processor -- start 2024-09-21T07:32:15.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.949+0000 7fea90669000 1 -- start start 2024-09-21T07:32:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5c231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5c23c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dbf5b6cb20 con 0x55dbf5760aa0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea842059e0 con 0x55dbf569c890 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea84204a60 con 0x55dbf5a456d0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52130/0 (socket says 172.21.15.64:52130) 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 -- 172.21.15.64:0/2684010604 learned_addr learned my addr 172.21.15.64:0/2684010604 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea81e00640 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5c231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea82800640 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5c23c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 -- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 msgr2=0x55dbf5c23c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5c23c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 -- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 msgr2=0x55dbf5c231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5c231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 -- 172.21.15.64:0/2684010604 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf5a10680 con 0x55dbf5760aa0 2024-09-21T07:32:15.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea7be00640 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fea6c000c10 tx=0x7fea6c00fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe79ae6bd375e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea72000640 1 -- 172.21.15.64:0/2684010604 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c02d070 con 0x55dbf5760aa0 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea72000640 1 -- 172.21.15.64:0/2684010604 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea6c000e50 con 0x55dbf5760aa0 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea72000640 1 -- 172.21.15.64:0/2684010604 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c010690 con 0x55dbf5760aa0 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- 172.21.15.64:0/2684010604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 msgr2=0x55dbf5c23730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fea6c000c10 tx=0x7fea6c00fca0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- 172.21.15.64:0/2684010604 shutdown_connections 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf5a456d0 0x55dbf5c23c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5760aa0 0x55dbf5c23730 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 --2- 172.21.15.64:0/2684010604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf569c890 0x55dbf5c231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- 172.21.15.64:0/2684010604 >> 172.21.15.64:0/2684010604 conn(0x55dbf56705c0 msgr2=0x55dbf5bc3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- 172.21.15.64:0/2684010604 shutdown_connections 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.953+0000 7fea90669000 1 -- 172.21.15.64:0/2684010604 wait complete. 2024-09-21T07:32:15.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- start start 2024-09-21T07:32:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 Processor -- start 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5c27980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 0x55dbf5c27ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea84204410 con 0x55dbf5a456d0 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea841f94f0 con 0x55dbf5760aa0 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55dbf5678680 con 0x55dbf569c890 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 10 client.0 _ll_register_callbacks cb 0x7fea6c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea82800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 0x55dbf5c27ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51612/0 (socket says 172.21.15.64:51612) 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 -- 172.21.15.64:0/1501295283 learned_addr learned my addr 172.21.15.64:0/1501295283 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea7be00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5c27980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 -- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 msgr2=0x55dbf5c27980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5c27980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 -- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 msgr2=0x55dbf5c27ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 0x55dbf5c27ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 -- 172.21.15.64:0/1501295283 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf597d0b0 con 0x55dbf569c890 2024-09-21T07:32:15.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea82800640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 0x55dbf5c27ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:15.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea81e00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea74023040 tx=0x7fea74007e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b72d3c791bcf8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74025040 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fea74020710 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea6c000e50 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fea7403d050 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 10 client.7547 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55dbf5949610 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea6c000e50 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7fea74040020 con 0x55dbf569c890 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 10 client.7547 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 10 client.7547 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 20 client.7547 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5643990 0x55dbf5b68800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 4 client.7547 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.957+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbf59c15b0 con 0x55dbf5643990 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea7be00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5643990 0x55dbf5b68800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea67400640 10 client.7547 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea7be00640 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5643990 0x55dbf5b68800 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fc0819a70168d6 server_cookie=104c5b9ec8f52b55 in_seq=0 out_seq=0 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea67400640 1 -- 172.21.15.64:0/1501295283 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55dbf59c15b0 con 0x55dbf5643990 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea67400640 10 client.7547 handle_command_reply: tid=0 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 client.7547 shutdown 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 msgr2=0x55dbf5c27440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea74023040 tx=0x7fea74007e40 comp rx=0 tx=0).stop 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 shutdown_connections 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x55dbf5643990 0x55dbf5b68800 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dbf5a456d0 0x55dbf5c27ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbf5760aa0 0x55dbf5c27980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 --2- 172.21.15.64:0/1501295283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55dbf569c890 0x55dbf5c27440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea67400640 0 client.7547 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 >> 172.21.15.64:0/1501295283 conn(0x55dbf56705c0 msgr2=0x55dbf5b735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 shutdown_connections 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 1 -- 172.21.15.64:0/1501295283 wait complete. 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea90669000 20 client.7547 trim_cache size 0 max 16384 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "PAUSED (813 inodes in the stack)", 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "9b14dbec-9b51-47df-a814-640bd078d5b2": { 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "9b14dbec-9b51-47df-a814-640bd078d5b2", 2024-09-21T07:32:15.965 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "9b14dbec-9b51-47df-a814-640bd078d5b2": { 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:32:15.405183+0000", 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:15.966 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 msgr2=0x7fea60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fea74007fd0 tx=0x7fea74009040 comp rx=0 tx=0).stop 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 msgr2=0x7fea84165830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fea7c01b240 tx=0x7fea7c005ae0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 shutdown_connections 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea841fc810 0x7fea84165830 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea840d1d70 0x7fea840c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 --2- 172.21.15.64:0/3743962508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea840d09a0 0x7fea840cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:15.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 >> 172.21.15.64:0/3743962508 conn(0x7fea8406d1f0 msgr2=0x7fea840b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:15.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 shutdown_connections 2024-09-21T07:32:15.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:15.961+0000 7fea88e00640 1 -- 172.21.15.64:0/3743962508 wait complete. 2024-09-21T07:32:15.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:16.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- 172.21.15.64:0/2509714921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0709b0 msgr2=0x7f0f6c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 --2- 172.21.15.64:0/2509714921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0709b0 0x7f0f6c0b41c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0af810 tx=0x7f0f5401c800 comp rx=0 tx=0).stop 2024-09-21T07:32:16.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- 172.21.15.64:0/2509714921 shutdown_connections 2024-09-21T07:32:16.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 --2- 172.21.15.64:0/2509714921 >> v2:172.21.15.90:3300/0 conn(0x7f0f6c0b4700 0x7f0f6c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 --2- 172.21.15.64:0/2509714921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0709b0 0x7f0f6c0b41c0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- 172.21.15.64:0/2509714921 >> 172.21.15.64:0/2509714921 conn(0x7f0f6c0ccbe0 msgr2=0x7f0f6c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:16.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- 172.21.15.64:0/2509714921 shutdown_connections 2024-09-21T07:32:16.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- 172.21.15.64:0/2509714921 wait complete. 2024-09-21T07:32:16.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 Processor -- start 2024-09-21T07:32:16.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.141+0000 7f0f70a00640 1 -- start start 2024-09-21T07:32:16.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f6c0709b0 0x7f0f6c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 0x7f0f6c1fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c168be0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c168a60 con 0x7f0f6c0b4700 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c168d60 con 0x7f0f6c0709b0 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52150/0 (socket says 172.21.15.64:52150) 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 -- 172.21.15.64:0/404218318 learned_addr learned my addr 172.21.15.64:0/404218318 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f69e00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f6c0709b0 0x7f0f6c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f61400640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 0x7f0f6c1fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 -- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f6c0709b0 msgr2=0x7f0f6c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f6c0709b0 0x7f0f6c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 -- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 msgr2=0x7f0f6c1fc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 0x7f0f6c1fc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 -- 172.21.15.64:0/404218318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c1fd650 con 0x7f0f6c15edb0 2024-09-21T07:32:16.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f61400640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 0x7f0f6c1fc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:16.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f6a800640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400eae0 tx=0x7f0f64009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:16.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400ce40 con 0x7f0f6c15edb0 2024-09-21T07:32:16.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f64004c20 con 0x7f0f6c15edb0 2024-09-21T07:32:16.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64005020 con 0x7f0f6c15edb0 2024-09-21T07:32:16.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c0c7260 con 0x7f0f6c15edb0 2024-09-21T07:32:16.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c0c7500 con 0x7f0f6c15edb0 2024-09-21T07:32:16.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.145+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c0b41c0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.149+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f640051c0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.149+0000 7f0f62a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 0x7f0f48075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.149+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f0f640951c0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.149+0000 7f0f69e00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 0x7f0f48075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.149+0000 7f0f69e00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 0x7f0f48075710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000f70 tx=0x7f0f5c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:16.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.153+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0f6405ffb0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.365+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f6c072f70 con 0x7f0f6c15edb0 2024-09-21T07:32:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f62a00640 1 -- 172.21.15.64:0/404218318 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f0f6405f8b0 con 0x7f0f6c15edb0 2024-09-21T07:32:16.369 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:16.369 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:16.369 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 msgr2=0x7f0f48075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 0x7f0f48075710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000f70 tx=0x7f0f5c009040 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 msgr2=0x7f0f6c1fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400eae0 tx=0x7f0f64009f70 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 shutdown_connections 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f48073200 0x7f0f48075710 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15edb0 0x7f0f6c1fcce0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f6c0b4700 0x7f0f6c1fc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 --2- 172.21.15.64:0/404218318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f6c0709b0 0x7f0f6c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 >> 172.21.15.64:0/404218318 conn(0x7f0f6c0ccbe0 msgr2=0x7f0f6c0aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 shutdown_connections 2024-09-21T07:32:16.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.369+0000 7f0f70a00640 1 -- 172.21.15.64:0/404218318 wait complete. 2024-09-21T07:32:16.391 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:16.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:16.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- 172.21.15.64:0/789099148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb040b3400 msgr2=0x7fdb04167490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 --2- 172.21.15.64:0/789099148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb040b3400 0x7fdb04167490 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fdb040d2310 tx=0x7fdafc01ccf0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- 172.21.15.64:0/789099148 shutdown_connections 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 --2- 172.21.15.64:0/789099148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb040b3400 0x7fdb04167490 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 --2- 172.21.15.64:0/789099148 >> v2:172.21.15.90:3300/0 conn(0x7fdb040cce40 0x7fdb0406cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- 172.21.15.64:0/789099148 >> 172.21.15.64:0/789099148 conn(0x7fdb040cdcf0 msgr2=0x7fdb040ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- 172.21.15.64:0/789099148 shutdown_connections 2024-09-21T07:32:16.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- 172.21.15.64:0/789099148 wait complete. 2024-09-21T07:32:16.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 Processor -- start 2024-09-21T07:32:16.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.549+0000 7fdb09800640 1 -- start start 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb040b3400 0x7fdb041f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb040cce40 0x7fdb040c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb040b04d0 con 0x7fdb0406d330 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0416a1f0 con 0x7fdb040cce40 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0416a370 con 0x7fdb040b3400 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52164/0 (socket says 172.21.15.64:52164) 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 -- 172.21.15.64:0/1129479224 learned_addr learned my addr 172.21.15.64:0/1129479224 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdafa000640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb040b3400 0x7fdb041f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb03400640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb040cce40 0x7fdb040c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 -- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb040b3400 msgr2=0x7fdb041f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb040b3400 0x7fdb041f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 -- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb040cce40 msgr2=0x7fdb040c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb040cce40 0x7fdb040c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 -- 172.21.15.64:0/1129479224 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb040cfda0 con 0x7fdb0406d330 2024-09-21T07:32:16.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb02a00640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e7f0 tx=0x7fdaf400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400ccc0 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaf400ce80 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb040d0080 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4005280 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb040d0640 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0406cdf0 con 0x7fdb0406d330 2024-09-21T07:32:16.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.553+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdaf4005420 con 0x7fdb0406d330 2024-09-21T07:32:16.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.557+0000 7fdafb400640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 0x7fdae0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:16.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.557+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fdaf4094c50 con 0x7fdb0406d330 2024-09-21T07:32:16.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.557+0000 7fdafa000640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 0x7fdae0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:16.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.557+0000 7fdafa000640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 0x7fdae0075740 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb040cc180 tx=0x7fdaec009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.561+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdaf405f480 con 0x7fdb0406d330 2024-09-21T07:32:16.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.797+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdb040cc1b0 con 0x7fdb0406d330 2024-09-21T07:32:16.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.797+0000 7fdafb400640 1 -- 172.21.15.64:0/1129479224 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7fdaf4063eb0 con 0x7fdb0406d330 2024-09-21T07:32:16.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:16.802 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":594,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":906,"data_bytes":926877214,"bytes_used":2174189568,"bytes_avail":770919923712,"bytes_total":773094113280,"write_bytes_sec":45695715,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-21T07:31:31.565355+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 msgr2=0x7fdae0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 0x7fdae0075740 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb040cc180 tx=0x7fdaec009040 comp rx=0 tx=0).stop 2024-09-21T07:32:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 msgr2=0x7fdb040c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e7f0 tx=0x7fdaf400ecb0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 shutdown_connections 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdae0073230 0x7fdae0075740 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb040cce40 0x7fdb040c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb040b3400 0x7fdb041f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 --2- 172.21.15.64:0/1129479224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb0406d330 0x7fdb040c7b30 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 >> 172.21.15.64:0/1129479224 conn(0x7fdb040cdcf0 msgr2=0x7fdb04159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 shutdown_connections 2024-09-21T07:32:16.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:16.801+0000 7fdb09800640 1 -- 172.21.15.64:0/1129479224 wait complete. 2024-09-21T07:32:16.823 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:32:17.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.993+0000 7f0cd7200640 1 -- 172.21.15.64:0/2393860467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 msgr2=0x7f0cd006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.993+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2393860467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd006cdf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00cbf70 tx=0x7f0cc001c6e0 comp rx=0 tx=0).stop 2024-09-21T07:32:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 -- 172.21.15.64:0/2393860467 shutdown_connections 2024-09-21T07:32:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2393860467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd006cdf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2393860467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd0073cd0 0x7f0cd00740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:17.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 -- 172.21.15.64:0/2393860467 >> 172.21.15.64:0/2393860467 conn(0x7f0cd00b2b50 msgr2=0x7f0cd00b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:17.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 -- 172.21.15.64:0/2393860467 shutdown_connections 2024-09-21T07:32:17.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 -- 172.21.15.64:0/2393860467 wait complete. 2024-09-21T07:32:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 Processor -- start 2024-09-21T07:32:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:17.997+0000 7f0cd7200640 1 -- start start 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 0x7f0cd014f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd0155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd016a590 con 0x7f0cd0073cd0 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd016a410 con 0x7f0cd0074620 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd016a710 con 0x7f0cd006d330 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52178/0 (socket says 172.21.15.64:52178) 2024-09-21T07:32:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 0x7f0cd014f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd6800640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd0155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 -- 172.21.15.64:0/2412500048 learned_addr learned my addr 172.21.15.64:0/2412500048 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 -- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 msgr2=0x7f0cd014f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 0x7f0cd014f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 -- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 msgr2=0x7f0cd0155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd0155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 -- 172.21.15.64:0/2412500048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd01fd730 con 0x7f0cd0073cd0 2024-09-21T07:32:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5e00640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 0x7f0cd014f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd6800640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd0155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd5400640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001cf80 tx=0x7f0cc0005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00ad070 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cc0004310 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd01fcb20 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00aaa00 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01fd0e0 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.001+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd00740e0 con 0x7f0cd0073cd0 2024-09-21T07:32:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.005+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0cc00b0070 con 0x7f0cd0073cd0 2024-09-21T07:32:18.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.005+0000 7f0cca000640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 0x7f0cb4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.005+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f0cc012e770 con 0x7f0cd0073cd0 2024-09-21T07:32:18.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.005+0000 7f0cd5e00640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 0x7f0cb4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.005+0000 7f0cd5e00640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 0x7f0cb4075710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00cce40 tx=0x7f0cc40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.009+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0cc0016330 con 0x7f0cd0073cd0 2024-09-21T07:32:18.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd00ced50 con 0x7f0cd0073cd0 2024-09-21T07:32:18.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cca000640 1 -- 172.21.15.64:0/2412500048 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f0cc00f8fa0 con 0x7f0cd0073cd0 2024-09-21T07:32:18.227 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:18.227 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:18.227 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 msgr2=0x7f0cb4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 0x7f0cb4075710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00cce40 tx=0x7f0cc40091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 msgr2=0x7f0cd01599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001cf80 tx=0x7f0cc0005750 comp rx=0 tx=0).stop 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 shutdown_connections 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0cb4073200 0x7f0cb4075710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cd0074620 0x7f0cd0155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cd0073cd0 0x7f0cd01599b0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 --2- 172.21.15.64:0/2412500048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cd006d330 0x7f0cd014f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 >> 172.21.15.64:0/2412500048 conn(0x7f0cd00b2b50 msgr2=0x7f0cd0153900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:18.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 shutdown_connections 2024-09-21T07:32:18.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.225+0000 7f0cd7200640 1 -- 172.21.15.64:0/2412500048 wait complete. 2024-09-21T07:32:18.249 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:18.249 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:18.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- 172.21.15.64:0/341825419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 msgr2=0x7f53140700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 --2- 172.21.15.64:0/341825419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140700b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f53140afb50 tx=0x7f530401c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- 172.21.15.64:0/341825419 shutdown_connections 2024-09-21T07:32:18.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 --2- 172.21.15.64:0/341825419 >> v2:172.21.15.90:3300/0 conn(0x7f53140b48d0 0x7f5314072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 --2- 172.21.15.64:0/341825419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140700b0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- 172.21.15.64:0/341825419 >> 172.21.15.64:0/341825419 conn(0x7f53140ccbe0 msgr2=0x7f53140ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:18.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- 172.21.15.64:0/341825419 shutdown_connections 2024-09-21T07:32:18.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- 172.21.15.64:0/341825419 wait complete. 2024-09-21T07:32:18.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 Processor -- start 2024-09-21T07:32:18.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.405+0000 7f531a200640 1 -- start start 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53140709b0 0x7f53140ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53140cc520 0x7f531414de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5314168c00 con 0x7f531415edb0 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5314168a80 con 0x7f53140cc520 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5314168d80 con 0x7f53140709b0 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52186/0 (socket says 172.21.15.64:52186) 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 -- 172.21.15.64:0/198326014 learned_addr learned my addr 172.21.15.64:0/198326014 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f5313e00640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53140cc520 0x7f531414de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f5313400640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53140709b0 0x7f53140ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 -- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53140709b0 msgr2=0x7f53140ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53140709b0 0x7f53140ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 -- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53140cc520 msgr2=0x7f531414de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53140cc520 0x7f531414de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 -- 172.21.15.64:0/198326014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5314165b40 con 0x7f531415edb0 2024-09-21T07:32:18.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530be00640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c3c0 tx=0x7f52fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc017070 con 0x7f531415edb0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52fc0053c0 con 0x7f531415edb0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5314165e20 con 0x7f531415edb0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc003860 con 0x7f531415edb0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531414d960 con 0x7f531415edb0 2024-09-21T07:32:18.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.409+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5314166060 con 0x7f531415edb0 2024-09-21T07:32:18.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.413+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f52fc01a070 con 0x7f531415edb0 2024-09-21T07:32:18.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.413+0000 7f530b400640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 0x7f52f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.413+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f52fc093830 con 0x7f531415edb0 2024-09-21T07:32:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.413+0000 7f5313400640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 0x7f52f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.413+0000 7f5313400640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 0x7f52f0075710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f53040af000 tx=0x7f530401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.417+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5314166060 con 0x7f531415edb0 2024-09-21T07:32:18.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.653+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5314072e20 con 0x7f531415edb0 2024-09-21T07:32:18.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f530b400640 1 -- 172.21.15.64:0/198326014 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f52fc05e620 con 0x7f531415edb0 2024-09-21T07:32:18.657 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:18.657 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":596,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":952,"data_bytes":976066037,"bytes_used":2331525120,"bytes_avail":770762588160,"bytes_total":773094113280,"write_bytes_sec":49795992,"read_op_per_sec":0,"write_op_per_sec":62},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-21T07:31:31.565355+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 msgr2=0x7f52f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 0x7f52f0075710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f53040af000 tx=0x7f530401b100 comp rx=0 tx=0).stop 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 msgr2=0x7f53140cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c3c0 tx=0x7f52fc00c880 comp rx=0 tx=0).stop 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 shutdown_connections 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f52f0073200 0x7f52f0075710 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53140cc520 0x7f531414de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f531415edb0 0x7f53140cbfe0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 --2- 172.21.15.64:0/198326014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53140709b0 0x7f53140ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 >> 172.21.15.64:0/198326014 conn(0x7f53140ccbe0 msgr2=0x7f531415cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 shutdown_connections 2024-09-21T07:32:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:18.657+0000 7f531a200640 1 -- 172.21.15.64:0/198326014 wait complete. 2024-09-21T07:32:18.679 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:32:19.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:19.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 -- 172.21.15.64:0/3819685877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80709b0 msgr2=0x7f8bc80b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 --2- 172.21.15.64:0/3819685877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80709b0 0x7f8bc80b41c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80b5130 tx=0x7f8bb001c860 comp rx=0 tx=0).stop 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 -- 172.21.15.64:0/3819685877 shutdown_connections 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 --2- 172.21.15.64:0/3819685877 >> v2:172.21.15.90:3300/0 conn(0x7f8bc80b4700 0x7f8bc8072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 --2- 172.21.15.64:0/3819685877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80709b0 0x7f8bc80b41c0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 --2- 172.21.15.64:0/3819685877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc815edb0 0x7f8bc80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 -- 172.21.15.64:0/3819685877 >> 172.21.15.64:0/3819685877 conn(0x7f8bc80ccbe0 msgr2=0x7f8bc80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 -- 172.21.15.64:0/3819685877 shutdown_connections 2024-09-21T07:32:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.849+0000 7f8bcf600640 1 -- 172.21.15.64:0/3819685877 wait complete. 2024-09-21T07:32:19.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 Processor -- start 2024-09-21T07:32:19.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 -- start start 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc80709b0 0x7f8bc80c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc815edb0 0x7f8bc81f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc80b23d0 con 0x7f8bc80b4700 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc80b2250 con 0x7f8bc815edb0 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcf600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc80b2550 con 0x7f8bc80709b0 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52216/0 (socket says 172.21.15.64:52216) 2024-09-21T07:32:19.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 -- 172.21.15.64:0/993736277 learned_addr learned my addr 172.21.15.64:0/993736277 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bcd600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc815edb0 0x7f8bc81f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bccc00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc80709b0 0x7f8bc80c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 -- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc80709b0 msgr2=0x7f8bc80c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc80709b0 0x7f8bc80c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 -- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc815edb0 msgr2=0x7f8bc81f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc815edb0 0x7f8bc81f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:19.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 -- 172.21.15.64:0/993736277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc80c3c90 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.853+0000 7f8bbfe00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8bb001af70 tx=0x7f8bb00a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00bd070 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bb0004470 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc80c6a10 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0005290 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc80c4210 con 0x7f8bc80b4700 2024-09-21T07:32:19.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc8075820 con 0x7f8bc80b4700 2024-09-21T07:32:19.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8bb00c0070 con 0x7f8bc80b4700 2024-09-21T07:32:19.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 0x7f8ba4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:19.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.857+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f8bb012e3a0 con 0x7f8bc80b4700 2024-09-21T07:32:19.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.861+0000 7f8bccc00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 0x7f8ba4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:19.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.861+0000 7f8bccc00640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 0x7f8ba4075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8004630 tx=0x7f8bb800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:19.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:19.861+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8bb00164b0 con 0x7f8bc80b4700 2024-09-21T07:32:20.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.077+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bc809da20 con 0x7f8bc80b4700 2024-09-21T07:32:20.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bc5600640 1 -- 172.21.15.64:0/993736277 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f8bb00f8c70 con 0x7f8bc80b4700 2024-09-21T07:32:20.081 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:20.081 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:20.081 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 msgr2=0x7f8ba4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 0x7f8ba4075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8004630 tx=0x7f8bb800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 msgr2=0x7f8bc8154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8bb001af70 tx=0x7f8bb00a66d0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 shutdown_connections 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8ba4073200 0x7f8ba4075710 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc815edb0 0x7f8bc81f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bc80b4700 0x7f8bc8154150 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 --2- 172.21.15.64:0/993736277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc80709b0 0x7f8bc80c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 >> 172.21.15.64:0/993736277 conn(0x7f8bc80ccbe0 msgr2=0x7f8bc8159380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:20.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 shutdown_connections 2024-09-21T07:32:20.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.081+0000 7f8bcf600640 1 -- 172.21.15.64:0/993736277 wait complete. 2024-09-21T07:32:20.103 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:20.103 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.257+0000 7fe3c1c00640 1 -- 172.21.15.64:0/319559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3a0005360 msgr2=0x7fe3a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.257+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/319559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3a0005360 0x7fe3a000b9d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc071330 tx=0x7fe3b401cad0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.257+0000 7fe3c1c00640 1 -- 172.21.15.64:0/319559901 shutdown_connections 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.257+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/319559901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3a0005360 0x7fe3a000b9d0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.257+0000 7fe3c1c00640 1 -- 172.21.15.64:0/319559901 >> 172.21.15.64:0/319559901 conn(0x7fe3bc0ccbe0 msgr2=0x7fe3bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- 172.21.15.64:0/319559901 shutdown_connections 2024-09-21T07:32:20.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- 172.21.15.64:0/319559901 wait complete. 2024-09-21T07:32:20.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 Processor -- start 2024-09-21T07:32:20.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- start start 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a0005360 0x7fe3bc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3bc0c7a90 0x7fe3bc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc070440 con 0x7fe3bc0c6520 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0702c0 con 0x7fe3a0005360 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3c1c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc0705c0 con 0x7fe3bc0c7a90 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.261+0000 7fe3b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:20.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52238/0 (socket says 172.21.15.64:52238) 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 -- 172.21.15.64:0/429738548 learned_addr learned my addr 172.21.15.64:0/429738548 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3baa00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a0005360 0x7fe3bc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3bb400640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3bc0c7a90 0x7fe3bc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 -- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3bc0c7a90 msgr2=0x7fe3bc0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3bc0c7a90 0x7fe3bc0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 -- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a0005360 msgr2=0x7fe3bc157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a0005360 0x7fe3bc157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 -- 172.21.15.64:0/429738548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0c9290 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b3e00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4011730 tx=0x7fe3a4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a401f070 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a400fb50 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4012450 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc0afba0 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc0c8fb0 con 0x7fe3bc0c6520 2024-09-21T07:32:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3bc0730a0 con 0x7fe3bc0c6520 2024-09-21T07:32:20.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.265+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe3a4022070 con 0x7fe3bc0c6520 2024-09-21T07:32:20.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.269+0000 7fe3b2a00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 0x7fe398075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:20.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.269+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fe3a4094e30 con 0x7fe3bc0c6520 2024-09-21T07:32:20.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.269+0000 7fe3baa00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 0x7fe398075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:20.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.269+0000 7fe3baa00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 0x7fe398075710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000fc0 tx=0x7fe3ac006960 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:20.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.273+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe3a405f5d0 con 0x7fe3bc0c6520 2024-09-21T07:32:20.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.509+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe3bc0749b0 con 0x7fe3bc0c6520 2024-09-21T07:32:20.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.509+0000 7fe3b2a00640 1 -- 172.21.15.64:0/429738548 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7fe3a4064000 con 0x7fe3bc0c6520 2024-09-21T07:32:20.512 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:20.512 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":598,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076729333,"bytes_used":2570600448,"bytes_avail":770523512832,"bytes_total":773094113280,"write_bytes_sec":52722830,"read_op_per_sec":0,"write_op_per_sec":65},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-21T07:31:31.565355+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 msgr2=0x7fe398075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 0x7fe398075710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000fc0 tx=0x7fe3ac006960 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 msgr2=0x7fe3bc1578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4011730 tx=0x7fe3a4011bf0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 shutdown_connections 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe398073200 0x7fe398075710 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3bc0c7a90 0x7fe3bc0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3bc0c6520 0x7fe3bc1578d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 --2- 172.21.15.64:0/429738548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a0005360 0x7fe3bc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 >> 172.21.15.64:0/429738548 conn(0x7fe3bc0ccbe0 msgr2=0x7fe3bc159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 shutdown_connections 2024-09-21T07:32:20.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:20.513+0000 7fe3c1c00640 1 -- 172.21.15.64:0/429738548 wait complete. 2024-09-21T07:32:20.535 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:32:21.536 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 -- 172.21.15.64:0/212928620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8070850 msgr2=0x7ff5a80b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 --2- 172.21.15.64:0/212928620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8070850 0x7ff5a80b1be0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ff5a806ad60 tx=0x7ff59401c8b0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 -- 172.21.15.64:0/212928620 shutdown_connections 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 --2- 172.21.15.64:0/212928620 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 0x7ff5a80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 --2- 172.21.15.64:0/212928620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a8070850 0x7ff5a80b1be0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 --2- 172.21.15.64:0/212928620 >> v2:172.21.15.90:3300/0 conn(0x7ff5a815cbd0 0x7ff5a8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 -- 172.21.15.64:0/212928620 >> 172.21.15.64:0/212928620 conn(0x7ff5a80ccbe0 msgr2=0x7ff5a80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.705+0000 7ff5b0000640 1 -- 172.21.15.64:0/212928620 shutdown_connections 2024-09-21T07:32:21.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 -- 172.21.15.64:0/212928620 wait complete. 2024-09-21T07:32:21.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 Processor -- start 2024-09-21T07:32:21.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 -- start start 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5a8070850 0x7ff5a80c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 0x7ff5a80b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806fa30 con 0x7ff5a815cbd0 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806f8b0 con 0x7ff5a8070850 2024-09-21T07:32:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5b0000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a806fbb0 con 0x7ff5a80b2120 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.709+0000 7ff5ae000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52254/0 (socket says 172.21.15.64:52254) 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 -- 172.21.15.64:0/2069295015 learned_addr learned my addr 172.21.15.64:0/2069295015 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5acc00640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 0x7ff5a80b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ad600640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5a8070850 0x7ff5a80c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 -- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 msgr2=0x7ff5a80b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 0x7ff5a80b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 -- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5a8070850 msgr2=0x7ff5a80c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5a8070850 0x7ff5a80c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 -- 172.21.15.64:0/2069295015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a80c8040 con 0x7ff5a815cbd0 2024-09-21T07:32:21.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5ae000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000b9e0 tx=0x7ff5a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0019070 con 0x7ff5a815cbd0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5a000cbb0 con 0x7ff5a815cbd0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a81fc410 con 0x7ff5a815cbd0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0014440 con 0x7ff5a815cbd0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a81fc9d0 con 0x7ff5a815cbd0 2024-09-21T07:32:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a80c8210 con 0x7ff5a815cbd0 2024-09-21T07:32:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.713+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff5a001c070 con 0x7ff5a815cbd0 2024-09-21T07:32:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.717+0000 7ff5a5600640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 0x7ff588075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.717+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7ff5a00941f0 con 0x7ff5a815cbd0 2024-09-21T07:32:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.717+0000 7ff5ad600640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 0x7ff588075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.717+0000 7ff5ad600640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 0x7ff588075710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff59c005fd0 tx=0x7ff59c005d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.721+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff5a005ef60 con 0x7ff5a815cbd0 2024-09-21T07:32:21.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.937+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5a80cbcd0 con 0x7ff5a815cbd0 2024-09-21T07:32:21.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.937+0000 7ff5a5600640 1 -- 172.21.15.64:0/2069295015 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7ff5a005e860 con 0x7ff5a815cbd0 2024-09-21T07:32:21.939 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:21.939 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:21.939 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:21.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 msgr2=0x7ff588075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:21.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 0x7ff588075710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff59c005fd0 tx=0x7ff59c005d10 comp rx=0 tx=0).stop 2024-09-21T07:32:21.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 msgr2=0x7ff5a80b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000b9e0 tx=0x7ff5a000bea0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 shutdown_connections 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff588073200 0x7ff588075710 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a815cbd0 0x7ff5a80b1030 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5a80b2120 0x7ff5a80b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 --2- 172.21.15.64:0/2069295015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5a8070850 0x7ff5a80c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 >> 172.21.15.64:0/2069295015 conn(0x7ff5a80ccbe0 msgr2=0x7ff5a815ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 shutdown_connections 2024-09-21T07:32:21.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:21.941+0000 7ff5b0000640 1 -- 172.21.15.64:0/2069295015 wait complete. 2024-09-21T07:32:21.962 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:21.962 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 -- 172.21.15.64:0/1012818183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 msgr2=0x7f01d0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 --2- 172.21.15.64:0/1012818183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d0074af0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f01d0071300 tx=0x7f01c001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 -- 172.21.15.64:0/1012818183 shutdown_connections 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 --2- 172.21.15.64:0/1012818183 >> v2:172.21.15.90:3300/0 conn(0x7f01d00cdd90 0x7f01d00ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 --2- 172.21.15.64:0/1012818183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d0074af0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 -- 172.21.15.64:0/1012818183 >> 172.21.15.64:0/1012818183 conn(0x7f01d00b2b80 msgr2=0x7f01d00b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.117+0000 7f01cfe00640 1 -- 172.21.15.64:0/1012818183 shutdown_connections 2024-09-21T07:32:22.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 -- 172.21.15.64:0/1012818183 wait complete. 2024-09-21T07:32:22.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 Processor -- start 2024-09-21T07:32:22.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 -- start start 2024-09-21T07:32:22.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d006ff20 0x7f01d01554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 0x7f01d014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01d00cfcd0 con 0x7f01d0152250 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f01d00cfb50 con 0x7f01d006ff20 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.121+0000 7f01cfe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f01d00cfe50 con 0x7f01d00cdd90 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52280/0 (socket says 172.21.15.64:52280) 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 -- 172.21.15.64:0/3215391282 learned_addr learned my addr 172.21.15.64:0/3215391282 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cea00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d006ff20 0x7f01d01554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c6000640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 0x7f01d014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 -- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 msgr2=0x7f01d014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 0x7f01d014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 -- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d006ff20 msgr2=0x7f01d01554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d006ff20 0x7f01d01554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 -- 172.21.15.64:0/3215391282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d0153910 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c6000640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 0x7f01d014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cf400640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f01c800cae0 tx=0x7f01c800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c800ae30 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01c800f560 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c800f9b0 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d00b6ab0 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d0152bd0 con 0x7f01d0152250 2024-09-21T07:32:22.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d00b6820 con 0x7f01d0152250 2024-09-21T07:32:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.125+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f01c800fb50 con 0x7f01d0152250 2024-09-21T07:32:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.129+0000 7f01c7e00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 0x7f01ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.129+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f01c8094e30 con 0x7f01d0152250 2024-09-21T07:32:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.129+0000 7f01cea00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 0x7f01ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.129+0000 7f01cea00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 0x7f01ac075710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f01c00af000 tx=0x7f01c001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.133+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f01c8014030 con 0x7f01d0152250 2024-09-21T07:32:22.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f01d00ce1a0 con 0x7f01d0152250 2024-09-21T07:32:22.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01c7e00640 1 -- 172.21.15.64:0/3215391282 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f01c805fcb0 con 0x7f01d0152250 2024-09-21T07:32:22.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:22.378 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":600,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076729333,"bytes_used":2575212544,"bytes_avail":770518900736,"bytes_total":773094113280,"write_bytes_sec":35597092,"read_op_per_sec":0,"write_op_per_sec":48},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-21T07:32:21.577632+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 msgr2=0x7f01ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 0x7f01ac075710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f01c00af000 tx=0x7f01c001b100 comp rx=0 tx=0).stop 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 msgr2=0x7f01d01533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f01c800cae0 tx=0x7f01c800a250 comp rx=0 tx=0).stop 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 shutdown_connections 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f01ac073200 0x7f01ac075710 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01d0152250 0x7f01d01533d0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f01d00cdd90 0x7f01d014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 --2- 172.21.15.64:0/3215391282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01d006ff20 0x7f01d01554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 >> 172.21.15.64:0/3215391282 conn(0x7f01d00b2b80 msgr2=0x7f01d01518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 shutdown_connections 2024-09-21T07:32:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.377+0000 7f01cfe00640 1 -- 172.21.15.64:0/3215391282 wait complete. 2024-09-21T07:32:22.400 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-21T07:32:22.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:22.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-21T07:32:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- 172.21.15.64:0/1409027377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6cc003cb0 msgr2=0x7fb6cc004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1409027377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6cc003cb0 0x7fb6cc004100 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8001890 tx=0x7fb6d801efd0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- 172.21.15.64:0/1409027377 shutdown_connections 2024-09-21T07:32:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1409027377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6cc003cb0 0x7fb6cc004100 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- 172.21.15.64:0/1409027377 >> 172.21.15.64:0/1409027377 conn(0x7fb6e80cdcf0 msgr2=0x7fb6e80ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- 172.21.15.64:0/1409027377 shutdown_connections 2024-09-21T07:32:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- 172.21.15.64:0/1409027377 wait complete. 2024-09-21T07:32:22.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 Processor -- start 2024-09-21T07:32:22.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.561+0000 7fb6ee200640 1 -- start start 2024-09-21T07:32:22.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc003cb0 0x7fb6e81f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 0x7fb6e81e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8070c00 con 0x7fb6e8149cb0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8070a80 con 0x7fb6cc003cb0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e80b2cf0 con 0x7fb6e81e41d0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52294/0 (socket says 172.21.15.64:52294) 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 -- 172.21.15.64:0/1339287487 learned_addr learned my addr 172.21.15.64:0/1339287487 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6e7400640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc003cb0 0x7fb6e81f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 0x7fb6e81e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 -- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 msgr2=0x7fb6e81e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 0x7fb6e81e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 -- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc003cb0 msgr2=0x7fb6e81f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc003cb0 0x7fb6e81f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 -- 172.21.15.64:0/1339287487 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e81f7580 con 0x7fb6e8149cb0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 0x7fb6e81e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000e590 tx=0x7fb6d000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6df400640 1 -- 172.21.15.64:0/1339287487 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0015020 con 0x7fb6e8149cb0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6df400640 1 -- 172.21.15.64:0/1339287487 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6d0010980 con 0x7fb6e8149cb0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6df400640 1 -- 172.21.15.64:0/1339287487 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0010dd0 con 0x7fb6e8149cb0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e809ac90 con 0x7fb6e8149cb0 2024-09-21T07:32:22.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.565+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e809b250 con 0x7fb6e8149cb0 2024-09-21T07:32:22.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6df400640 1 -- 172.21.15.64:0/1339287487 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6d0018020 con 0x7fb6e8149cb0 2024-09-21T07:32:22.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6f5a29000 1 Processor -- start 2024-09-21T07:32:22.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6df400640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 0x7fb6c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6f5a29000 1 -- start start 2024-09-21T07:32:22.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6df400640 1 -- 172.21.15.64:0/1339287487 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fb6d0094bf0 con 0x7fb6e8149cb0 2024-09-21T07:32:22.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.569+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 0x7fb6c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 0x7fb6c4075710 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80d22d0 tx=0x7fb6e0009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cc18ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc19530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56291cab3cd0 con 0x56291c7c3aa0 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56291c9c9330 con 0x56291c6ff890 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56291ca26bb0 con 0x56291caa86d0 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52300/0 (socket says 172.21.15.64:52300) 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 -- 172.21.15.64:0/1344594911 learned_addr learned my addr 172.21.15.64:0/1344594911 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc19530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7400640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cc18ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 -- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 msgr2=0x56291cc18ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cc18ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 -- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 msgr2=0x56291cc19530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc19530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 -- 172.21.15.64:0/1344594911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56291c9cac80 con 0x56291c7c3aa0 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc19530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b0ca0 tx=0x7fb6e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc7acae3d175352 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6d7400640 1 -- 172.21.15.64:0/1344594911 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0013e60 con 0x56291c7c3aa0 2024-09-21T07:32:22.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6d7400640 1 -- 172.21.15.64:0/1344594911 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e001e540 con 0x56291c7c3aa0 2024-09-21T07:32:22.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6d7400640 1 -- 172.21.15.64:0/1344594911 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e001e950 con 0x56291c7c3aa0 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- 172.21.15.64:0/1344594911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 msgr2=0x56291cc19a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b0ca0 tx=0x7fb6e0016000 comp rx=0 tx=0).stop 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- 172.21.15.64:0/1344594911 shutdown_connections 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc19a70 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc19530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/1344594911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cc18ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- 172.21.15.64:0/1344594911 >> 172.21.15.64:0/1344594911 conn(0x56291c6d35c0 msgr2=0x56291cbd1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- 172.21.15.64:0/1344594911 shutdown_connections 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.573+0000 7fb6f5a29000 1 -- 172.21.15.64:0/1344594911 wait complete. 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- start start 2024-09-21T07:32:22.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 Processor -- start 2024-09-21T07:32:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cbdac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cbdb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56291ca19df0 con 0x56291caa86d0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56291ca15fe0 con 0x56291c6ff890 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56291c9bb4d0 con 0x56291c7c3aa0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 10 client.0 _ll_register_callbacks cb 0x56291c9997f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52304/0 (socket says 172.21.15.64:52304) 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 -- 172.21.15.64:0/3513924236 learned_addr learned my addr 172.21.15.64:0/3513924236 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cbdb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 -- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 msgr2=0x56291cbdb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cbdb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7400640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cbdac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 -- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 msgr2=0x56291cbdac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cbdac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 -- 172.21.15.64:0/3513924236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56291c9b4210 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cbdb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7400640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cbdac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0028040 tx=0x7fb6e001fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b2728e7834bffe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0034020 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fb6e001c670 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56291c9ae350 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fb6e003e050 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 10 client.8853 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.577+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x56291c99afc0 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56291c9ae350 con 0x56291caa86d0 2024-09-21T07:32:22.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7fb6e0041020 con 0x56291caa86d0 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 10 client.8853 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 10 client.8853 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 20 client.8853 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6b8930 0x56291cc2a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 4 client.8853 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56291ca28b00 con 0x56291c6b8930 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6e7400640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6b8930 0x56291cc2a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6e7400640 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6b8930 0x56291cc2a5b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aced3ce762d3886 server_cookie=cc7bf0be08083329 in_seq=0 out_seq=0 2024-09-21T07:32:22.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 10 client.8853 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 1 -- 172.21.15.64:0/3513924236 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56291ca28b00 con 0x56291c6b8930 2024-09-21T07:32:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 10 client.8853 handle_command_reply: tid=0 2024-09-21T07:32:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 client.8853 shutdown 2024-09-21T07:32:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 msgr2=0x56291cbdb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0028040 tx=0x7fb6e001fc90 comp rx=0 tx=0).stop 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 shutdown_connections 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6b8930 0x56291cc2a5b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291caa86d0 0x56291cbdb6f0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cbdb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/3513924236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cbdac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6cbe00640 0 client.8853 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 >> 172.21.15.64:0/3513924236 conn(0x56291c6d35c0 msgr2=0x56291cbc9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 shutdown_connections 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 1 -- 172.21.15.64:0/3513924236 wait complete. 2024-09-21T07:32:22.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.581+0000 7fb6f5a29000 20 client.8853 trim_cache size 0 max 16384 2024-09-21T07:32:22.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 Processor -- start 2024-09-21T07:32:22.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 -- start start 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc2d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cbcf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56291cbd8d40 con 0x56291c7c3aa0 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81fe960 con 0x56291c6ff890 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e80af280 con 0x56291caa86d0 2024-09-21T07:32:22.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52314/0 (socket says 172.21.15.64:52314) 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 -- 172.21.15.64:0/2673402423 learned_addr learned my addr 172.21.15.64:0/2673402423 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6e7400640 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc2d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cbcf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 -- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 msgr2=0x56291cbcf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cbcf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 -- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 msgr2=0x56291cc2d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc2d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 -- 172.21.15.64:0/2673402423 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56291ca73680 con 0x56291c7c3aa0 2024-09-21T07:32:22.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0092e60 tx=0x7fb6d005ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffda3844a01ea85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6d6a00640 1 -- 172.21.15.64:0/2673402423 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0080e60 con 0x56291c7c3aa0 2024-09-21T07:32:22.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6d6a00640 1 -- 172.21.15.64:0/2673402423 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6d0063dd0 con 0x56291c7c3aa0 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6d6a00640 1 -- 172.21.15.64:0/2673402423 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00689f0 con 0x56291c7c3aa0 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 -- 172.21.15.64:0/2673402423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 msgr2=0x56291cc2db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.601+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0092e60 tx=0x7fb6d005ed50 comp rx=0 tx=0).stop 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- 172.21.15.64:0/2673402423 shutdown_connections 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291caa86d0 0x56291cbcf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c7c3aa0 0x56291cc2db20 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/2673402423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291c6ff890 0x56291cc2d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- 172.21.15.64:0/2673402423 >> 172.21.15.64:0/2673402423 conn(0x56291c6d35c0 msgr2=0x56291cbd97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- 172.21.15.64:0/2673402423 shutdown_connections 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- 172.21.15.64:0/2673402423 wait complete. 2024-09-21T07:32:22.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- start start 2024-09-21T07:32:22.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 Processor -- start 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cc8e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291caa86d0 0x56291cc8eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e814c8e0 con 0x56291c6ff890 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81f2d80 con 0x56291caa86d0 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56291c6db680 con 0x56291c7c3aa0 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 10 client.0 _ll_register_callbacks cb 0x7fb6cc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:22.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52322/0 (socket says 172.21.15.64:52322) 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 -- 172.21.15.64:0/4029192501 learned_addr learned my addr 172.21.15.64:0/4029192501 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cc8e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7e00640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291caa86d0 0x56291cc8eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 -- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 msgr2=0x56291cc8e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cc8e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 -- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291caa86d0 msgr2=0x56291cc8eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291caa86d0 0x56291cc8eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 -- 172.21.15.64:0/4029192501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56291c9e00b0 con 0x56291c6ff890 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6e7400640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80aa010 tx=0x7fb6cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1acf1975ba11fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80cb060 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fb6d8006140 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.605+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6d0063dd0 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fb6d80d1050 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 10 client.8859 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x56291c9ac610 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6d0063dd0 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7fb6d80d4020 con 0x56291c6ff890 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 10 client.8859 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 10 client.8859 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 20 client.8859 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6a6990 0x56291cc2bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 4 client.8859 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-21T07:32:22.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x56291ca245b0 con 0x56291c6a6990 2024-09-21T07:32:22.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6a6990 0x56291cc2bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6dfe00640 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6a6990 0x56291cc2bdd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0f3e8eb36b4fbc0 server_cookie=b0b97b2c7fa822d4 in_seq=0 out_seq=0 2024-09-21T07:32:22.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 10 client.8859 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 1 -- 172.21.15.64:0/4029192501 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56291ca245b0 con 0x56291c6a6990 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 10 client.8859 handle_command_reply: tid=0 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 client.8859 shutdown 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 msgr2=0x56291cc8e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80aa010 tx=0x7fb6cc005840 comp rx=0 tx=0).stop 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 shutdown_connections 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x56291c6a6990 0x56291cc2bdd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56291caa86d0 0x56291cc8eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56291c7c3aa0 0x56291cc8e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 --2- 172.21.15.64:0/4029192501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56291c6ff890 0x56291cc8e100 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 >> 172.21.15.64:0/4029192501 conn(0x56291c6d35c0 msgr2=0x56291cbda1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6cbe00640 0 client.8859 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 shutdown_connections 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.609+0000 7fb6f5a29000 1 -- 172.21.15.64:0/4029192501 wait complete. 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6f5a29000 20 client.8859 trim_cache size 0 max 16384 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:22.614 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:32:22.615 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:22.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 msgr2=0x7fb6c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 0x7fb6c4075710 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80d22d0 tx=0x7fb6e0009500 comp rx=0 tx=0).stop 2024-09-21T07:32:22.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 msgr2=0x7fb6e809bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000e590 tx=0x7fb6d000ea50 comp rx=0 tx=0).stop 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 shutdown_connections 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6c4073200 0x7fb6c4075710 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6e81e41d0 0x7fb6e81e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8149cb0 0x7fb6e809bd30 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 --2- 172.21.15.64:0/1339287487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc003cb0 0x7fb6e81f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 >> 172.21.15.64:0/1339287487 conn(0x7fb6e80cdcf0 msgr2=0x7fb6e806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 shutdown_connections 2024-09-21T07:32:22.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.613+0000 7fb6ee200640 1 -- 172.21.15.64:0/1339287487 wait complete. 2024-09-21T07:32:22.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:22.639 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 -- 172.21.15.64:0/2414240875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b040cd790 msgr2=0x7f6b0415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/2414240875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b040cd790 0x7f6b0415b320 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f6b040b0980 tx=0x7f6af801c770 comp rx=0 tx=0).stop 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 -- 172.21.15.64:0/2414240875 shutdown_connections 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/2414240875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b0406fba0 0x7f6b0406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/2414240875 >> v2:172.21.15.90:3300/0 conn(0x7f6b0415f100 0x7f6b0415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/2414240875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b040cd790 0x7f6b0415b320 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 -- 172.21.15.64:0/2414240875 >> 172.21.15.64:0/2414240875 conn(0x7f6b040b2ca0 msgr2=0x7f6b040b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 -- 172.21.15.64:0/2414240875 shutdown_connections 2024-09-21T07:32:22.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.861+0000 7f6b0bc00640 1 -- 172.21.15.64:0/2414240875 wait complete. 2024-09-21T07:32:22.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 Processor -- start 2024-09-21T07:32:22.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 -- start start 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 0x7f6b041f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b0415f100 0x7f6b0415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b040b6680 con 0x7f6b0415f100 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b040b6500 con 0x7f6b0406fba0 2024-09-21T07:32:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b0bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b040b6800 con 0x7f6b040cd790 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:45876/0 (socket says 172.21.15.64:45876) 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b09200640 1 -- 172.21.15.64:0/4174660917 learned_addr learned my addr 172.21.15.64:0/4174660917 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b09c00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b0415f100 0x7f6b0415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 0x7f6b041f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.865+0000 7f6b09200640 1 -- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 msgr2=0x7f6b041f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b09200640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 0x7f6b041f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b09200640 1 -- 172.21.15.64:0/4174660917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b0415f100 msgr2=0x7f6b0415e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b09200640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b0415f100 0x7f6b0415e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b09200640 1 -- 172.21.15.64:0/4174660917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0415e9b0 con 0x7f6b0406fba0 2024-09-21T07:32:22.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 0x7f6b041f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b09200640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6af801ae20 tx=0x7f6af8005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b00c00640 1 -- 172.21.15.64:0/4174660917 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80b2040 con 0x7f6b0406fba0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b00c00640 1 -- 172.21.15.64:0/4174660917 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af8004340 con 0x7f6b0406fba0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b00c00640 1 -- 172.21.15.64:0/4174660917 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80052d0 con 0x7f6b0406fba0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0414b680 con 0x7f6b0406fba0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.869+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b040b5c40 con 0x7f6b0406fba0 2024-09-21T07:32:22.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b00c00640 1 -- 172.21.15.64:0/4174660917 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6af80bd060 con 0x7f6b0406fba0 2024-09-21T07:32:22.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b00c00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 0x7f6ae4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b00c00640 1 -- 172.21.15.64:0/4174660917 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f6af812da00 con 0x7f6b0406fba0 2024-09-21T07:32:22.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 0x7f6ae4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b132df000 1 Processor -- start 2024-09-21T07:32:22.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b132df000 1 -- start start 2024-09-21T07:32:22.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.873+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 0x7f6ae4075710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6b04157ed0 tx=0x7f6af00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c75f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 0x5588c75f4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5588c7492cd0 con 0x5588c71a2aa0 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5588c73a8330 con 0x5588c74876d0 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5588c7405bb0 con 0x5588c70de890 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:45878/0 (socket says 172.21.15.64:45878) 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 -- 172.21.15.64:0/3134926921 learned_addr learned my addr 172.21.15.64:0/3134926921 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b03e00640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c75f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09c00640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 0x5588c75f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 -- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 msgr2=0x5588c75f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c75f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 -- 172.21.15.64:0/3134926921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 msgr2=0x5588c75f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 0x5588c75f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 -- 172.21.15.64:0/3134926921 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c73a9c80 con 0x5588c74876d0 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09c00640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 0x5588c75f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b09200640 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6af801cce0 tx=0x7f6af80f4140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f741dc542ce76a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6af5600640 1 -- 172.21.15.64:0/3134926921 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80f7db0 con 0x5588c74876d0 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6af5600640 1 -- 172.21.15.64:0/3134926921 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af80f8910 con 0x5588c74876d0 2024-09-21T07:32:22.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6af5600640 1 -- 172.21.15.64:0/3134926921 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80fccf0 con 0x5588c74876d0 2024-09-21T07:32:22.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 msgr2=0x5588c75f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6af801cce0 tx=0x7f6af80f4140 comp rx=0 tx=0).stop 2024-09-21T07:32:22.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- 172.21.15.64:0/3134926921 shutdown_connections 2024-09-21T07:32:22.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c71a2aa0 0x5588c75f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c75f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 --2- 172.21.15.64:0/3134926921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75f39f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.877+0000 7f6b132df000 1 -- 172.21.15.64:0/3134926921 >> 172.21.15.64:0/3134926921 conn(0x5588c70b25c0 msgr2=0x5588c75b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.881+0000 7f6b132df000 1 -- 172.21.15.64:0/3134926921 shutdown_connections 2024-09-21T07:32:22.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.881+0000 7f6b132df000 1 -- 172.21.15.64:0/3134926921 wait complete. 2024-09-21T07:32:22.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.881+0000 7f6b132df000 1 -- start start 2024-09-21T07:32:22.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.881+0000 7f6b132df000 1 Processor -- start 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c75fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c74876d0 0x5588c75fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5588c73f8df0 con 0x5588c70de890 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5588c73f4fe0 con 0x5588c71a2aa0 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5588c739a4d0 con 0x5588c74876d0 2024-09-21T07:32:22.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 10 client.0 _ll_register_callbacks cb 0x5588c73787f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52352/0 (socket says 172.21.15.64:52352) 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 -- 172.21.15.64:0/4103521764 learned_addr learned my addr 172.21.15.64:0/4103521764 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09c00640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c74876d0 0x5588c75fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c75fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 -- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c74876d0 msgr2=0x5588c75fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c74876d0 0x5588c75fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 -- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 msgr2=0x5588c75fb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c75fb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 -- 172.21.15.64:0/4103521764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c7393210 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b09200640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6af801cce0 tx=0x7f6af8005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4afa7f41dd0b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8117060 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f6af8101710 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588c738d350 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f6af8101990 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 10 client.8871 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5588c7379fc0 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5588c738d350 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f6af80f7500 con 0x5588c70de890 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 10 client.8871 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:22.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 10 client.8871 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 20 client.8871 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7097930 0x5588c7605260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 4 client.8871 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588c7407b00 con 0x5588c7097930 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.885+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7097930 0x5588c7605260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.889+0000 7f6b03e00640 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7097930 0x5588c7605260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cdca694410890df server_cookie=69afe7ee10898973 in_seq=0 out_seq=0 2024-09-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.889+0000 7f6aea000640 10 client.8871 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6aea000640 1 -- 172.21.15.64:0/4103521764 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588c7407b00 con 0x5588c7097930 2024-09-21T07:32:22.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6aea000640 10 client.8871 handle_command_reply: tid=0 2024-09-21T07:32:22.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 client.8871 shutdown 2024-09-21T07:32:22.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 msgr2=0x5588c75fae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6af801cce0 tx=0x7f6af8005ed0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 shutdown_connections 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7097930 0x5588c7605260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c74876d0 0x5588c75fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c75fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 --2- 172.21.15.64:0/4103521764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c75fae80 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 >> 172.21.15.64:0/4103521764 conn(0x5588c70b25c0 msgr2=0x5588c75f1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6aea000640 0 client.8871 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 shutdown_connections 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 1 -- 172.21.15.64:0/4103521764 wait complete. 2024-09-21T07:32:22.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.893+0000 7f6b132df000 20 client.8871 trim_cache size 0 max 16384 2024-09-21T07:32:22.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.917+0000 7f6b132df000 1 Processor -- start 2024-09-21T07:32:22.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.917+0000 7f6b132df000 1 -- start start 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c76012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5588c75acae0 con 0x5588c70de890 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04205a40 con 0x5588c74876d0 2024-09-21T07:32:22.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b04204a60 con 0x5588c71a2aa0 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51814/0 (socket says 172.21.15.64:51814) 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 -- 172.21.15.64:0/617339856 learned_addr learned my addr 172.21.15.64:0/617339856 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b09c00640 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b09200640 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c76012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 -- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 msgr2=0x5588c75adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 -- 172.21.15.64:0/617339856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 msgr2=0x5588c76012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c76012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 -- 172.21.15.64:0/617339856 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c7452680 con 0x5588c71a2aa0 2024-09-21T07:32:22.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b03e00640 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009970 tx=0x7f6af0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653d91bcc5614614 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6af4c00640 1 -- 172.21.15.64:0/617339856 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0003860 con 0x5588c71a2aa0 2024-09-21T07:32:22.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6af4c00640 1 -- 172.21.15.64:0/617339856 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af0016070 con 0x5588c71a2aa0 2024-09-21T07:32:22.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6af4c00640 1 -- 172.21.15.64:0/617339856 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0003c80 con 0x5588c71a2aa0 2024-09-21T07:32:22.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 msgr2=0x5588c7601830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009970 tx=0x7f6af0014000 comp rx=0 tx=0).stop 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- 172.21.15.64:0/617339856 shutdown_connections 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c74876d0 0x5588c75adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c71a2aa0 0x5588c7601830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 --2- 172.21.15.64:0/617339856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c70de890 0x5588c76012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- 172.21.15.64:0/617339856 >> 172.21.15.64:0/617339856 conn(0x5588c70b25c0 msgr2=0x5588c75a6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- 172.21.15.64:0/617339856 shutdown_connections 2024-09-21T07:32:22.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.921+0000 7f6b132df000 1 -- 172.21.15.64:0/617339856 wait complete. 2024-09-21T07:32:22.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 -- start start 2024-09-21T07:32:22.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 Processor -- start 2024-09-21T07:32:22.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c7600ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c74876d0 0x5588c7625780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04166dc0 con 0x5588c74876d0 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b041fd1f0 con 0x5588c71a2aa0 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5588c70ba680 con 0x5588c70de890 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b132df000 10 client.0 _ll_register_callbacks cb 0x7f6af0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b09200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51822/0 (socket says 172.21.15.64:51822) 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.925+0000 7f6b09200640 1 -- 172.21.15.64:0/516818140 learned_addr learned my addr 172.21.15.64:0/516818140 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09c00640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c74876d0 0x5588c7625780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b03e00640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c7600ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 -- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 msgr2=0x5588c7600ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c7600ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 -- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c74876d0 msgr2=0x5588c7625780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c74876d0 0x5588c7625780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 -- 172.21.15.64:0/516818140 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5588c73bf0b0 con 0x5588c70de890 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b09200640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000c10 tx=0x7f6af80f8070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace5727ce3ebcdac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8101910 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f6af810ac30 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6af0016070 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f6af80f7db0 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 10 client.7604 fetch_fsmap learned FSMap version 103 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5588c738b610 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af0016070 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f6af8108070 con 0x5588c70de890 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 10 client.7604 fetch_fsmap finished waiting for FSMap version 103 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 10 client.7604 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-21T07:32:22.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 20 client.7604 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7085990 0x5588c7626140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 4 client.7604 mds_command: new command op to 8574 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 --> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5588c74035b0 con 0x5588c7085990 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b03e00640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7085990 0x5588c7626140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6b03e00640 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7085990 0x5588c7626140 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2adb6706a924caa3 server_cookie=52b84703b59cee9b in_seq=0 out_seq=0 2024-09-21T07:32:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.929+0000 7f6aea000640 10 client.7604 ms_handle_connect on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6aea000640 1 -- 172.21.15.64:0/516818140 <== mds.0 v2:172.21.15.64:6834/264252124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+618 (crc 0 0 0) 0x5588c74035b0 con 0x5588c7085990 2024-09-21T07:32:22.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6aea000640 10 client.7604 handle_command_reply: tid=0 2024-09-21T07:32:22.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 client.7604 shutdown 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 msgr2=0x5588c7600990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000c10 tx=0x7f6af80f8070 comp rx=0 tx=0).stop 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 shutdown_connections 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:6834/264252124,v1:172.21.15.64:6835/264252124] conn(0x5588c7085990 0x5588c7626140 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5588c74876d0 0x5588c7625780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588c71a2aa0 0x5588c7600ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 --2- 172.21.15.64:0/516818140 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5588c70de890 0x5588c7600990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.933+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 >> 172.21.15.64:0/516818140 conn(0x5588c70b25c0 msgr2=0x5588c75adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6aea000640 0 client.7604 ms_handle_reset on v2:172.21.15.64:6834/264252124 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 shutdown_connections 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b132df000 1 -- 172.21.15.64:0/516818140 wait complete. 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b132df000 20 client.7604 trim_cache size 0 max 16384 2024-09-21T07:32:22.938 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "scrub active (637 inodes in the stack)", 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "9b14dbec-9b51-47df-a814-640bd078d5b2": { 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "9b14dbec-9b51-47df-a814-640bd078d5b2", 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "9b14dbec-9b51-47df-a814-640bd078d5b2": { 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:32:15.405183+0000", 2024-09-21T07:32:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:22.940 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:22.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 msgr2=0x7f6ae4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 0x7f6ae4075710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6b04157ed0 tx=0x7f6af00091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 msgr2=0x7f6b041649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6af801ae20 tx=0x7f6af8005de0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 shutdown_connections 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6ae4073200 0x7f6ae4075710 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b0415f100 0x7f6b0415e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b040cd790 0x7f6b041f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 --2- 172.21.15.64:0/4174660917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b0406fba0 0x7f6b041649e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 >> 172.21.15.64:0/4174660917 conn(0x7f6b040b2ca0 msgr2=0x7f6b040b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 shutdown_connections 2024-09-21T07:32:22.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:22.937+0000 7f6b0bc00640 1 -- 172.21.15.64:0/4174660917 wait complete. 2024-09-21T07:32:22.963 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- 172.21.15.64:0/1865953023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40cd1c0 msgr2=0x7f4fa40d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 --2- 172.21.15.64:0/1865953023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40cd1c0 0x7f4fa40d0790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009bc0 tx=0x7f4f9c01cb10 comp rx=0 tx=0).stop 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- 172.21.15.64:0/1865953023 shutdown_connections 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 --2- 172.21.15.64:0/1865953023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40cd1c0 0x7f4fa40d0790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- 172.21.15.64:0/1865953023 >> 172.21.15.64:0/1865953023 conn(0x7f4fa406d480 msgr2=0x7f4fa40d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:23.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- 172.21.15.64:0/1865953023 shutdown_connections 2024-09-21T07:32:23.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- 172.21.15.64:0/1865953023 wait complete. 2024-09-21T07:32:23.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 Processor -- start 2024-09-21T07:32:23.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.185+0000 7f4fab400640 1 -- start start 2024-09-21T07:32:23.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40b7a60 0x7f4fa4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 0x7f4fa4166030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa416b2a0 con 0x7f4fa4152c80 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa416b120 con 0x7f4fa40b7a60 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa416b420 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40b7a60 0x7f4fa4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 0x7f4fa4166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51826/0 (socket says 172.21.15.64:51826) 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 -- 172.21.15.64:0/3507915837 learned_addr learned my addr 172.21.15.64:0/3507915837 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 -- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40b7a60 msgr2=0x7f4fa4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40b7a60 0x7f4fa4151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 -- 172.21.15.64:0/3507915837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 msgr2=0x7f4fa4166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 0x7f4fa4166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 -- 172.21.15.64:0/3507915837 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa40b6be0 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa9400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 0x7f4fa4166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa3e00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c440 tx=0x7f4f9000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90016020 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f90012920 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012d70 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa415a3f0 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.189+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa40b6900 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.193+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa40b6390 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.193+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4f90019020 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.197+0000 7f4fa0c00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 0x7f4f84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.197+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4f90093cd0 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.197+0000 7f4fa8a00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 0x7f4f84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.197+0000 7f4fa8a00640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 0x7f4f84075710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f98007fd0 tx=0x7f4f98009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:23.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.201+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4f90020070 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.541+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fa40b3ce0 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fa0c00640 1 -- 172.21.15.64:0/3507915837 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f4f9005e500 con 0x7f4fa40cd1c0 2024-09-21T07:32:23.545 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:23.545 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 msgr2=0x7f4f84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 0x7f4f84075710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f98007fd0 tx=0x7f4f98009040 comp rx=0 tx=0).stop 2024-09-21T07:32:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 msgr2=0x7f4fa4159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c440 tx=0x7f4f9000c900 comp rx=0 tx=0).stop 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 shutdown_connections 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f84073200 0x7f4f84075710 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fa4152c80 0x7f4fa4166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fa40cd1c0 0x7f4fa4159eb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 --2- 172.21.15.64:0/3507915837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa40b7a60 0x7f4fa4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 >> 172.21.15.64:0/3507915837 conn(0x7f4fa406d480 msgr2=0x7f4fa40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 shutdown_connections 2024-09-21T07:32:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.545+0000 7f4fab400640 1 -- 172.21.15.64:0/3507915837 wait complete. 2024-09-21T07:32:23.574 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:23.574 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:23.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 -- 172.21.15.64:0/3988179744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec40d09a0 msgr2=0x7feec40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 --2- 172.21.15.64:0/3988179744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec40d09a0 0x7feec40b3130 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7feeac009840 tx=0x7feeac01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 -- 172.21.15.64:0/3988179744 shutdown_connections 2024-09-21T07:32:23.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 --2- 172.21.15.64:0/3988179744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec40d09a0 0x7feec40b3130 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 --2- 172.21.15.64:0/3988179744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec40b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 -- 172.21.15.64:0/3988179744 >> 172.21.15.64:0/3988179744 conn(0x7feec40cdbf0 msgr2=0x7feec40ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:23.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 -- 172.21.15.64:0/3988179744 shutdown_connections 2024-09-21T07:32:23.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.805+0000 7feec8e00640 1 -- 172.21.15.64:0/3988179744 wait complete. 2024-09-21T07:32:23.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.809+0000 7feec8e00640 1 Processor -- start 2024-09-21T07:32:23.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.809+0000 7feec8e00640 1 -- start start 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec4151d30 0x7feec40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec4154d20 0x7feec4155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feec40cd2b0 con 0x7feec4151d30 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feec40723f0 con 0x7feec4154d20 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feec40cd430 con 0x7feec40d0590 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feebbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec4151d30 0x7feec40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51836/0 (socket says 172.21.15.64:51836) 2024-09-21T07:32:23.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec4154d20 0x7feec4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 -- 172.21.15.64:0/2464426218 learned_addr learned my addr 172.21.15.64:0/2464426218 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:23.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 -- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec4154d20 msgr2=0x7feec4155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec4154d20 0x7feec4155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 -- 172.21.15.64:0/2464426218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec4151d30 msgr2=0x7feec40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec4151d30 0x7feec40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 -- 172.21.15.64:0/2464426218 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec4155670 con 0x7feec40d0590 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec3400640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb400e970 tx=0x7feeb400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb400cd80 con 0x7feec40d0590 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb4004020 con 0x7feec40d0590 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004470 con 0x7feec40d0590 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41fcc50 con 0x7feec40d0590 2024-09-21T07:32:23.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.813+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41fc170 con 0x7feec40d0590 2024-09-21T07:32:23.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec4050f70 con 0x7feec40d0590 2024-09-21T07:32:23.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feeb4003600 con 0x7feec40d0590 2024-09-21T07:32:23.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feebb400640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 0x7feea0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:23.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7feeb4094bc0 con 0x7feec40d0590 2024-09-21T07:32:23.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feebbe00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 0x7feea0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:23.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.817+0000 7feebbe00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 0x7feea0075710 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feeac0af000 tx=0x7feeac01b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:23.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:23.821+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7feec4155670 con 0x7feec40d0590 2024-09-21T07:32:24.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.181+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7feec40cd890 con 0x7feec40d0590 2024-09-21T07:32:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.181+0000 7feebb400640 1 -- 172.21.15.64:0/2464426218 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7feeb4068030 con 0x7feec40d0590 2024-09-21T07:32:24.184 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:24.184 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":602,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076729333,"bytes_used":2575212544,"bytes_avail":770518900736,"bytes_total":773094113280,"write_bytes_sec":33326336,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-21T07:32:21.577632+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 msgr2=0x7feea0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 0x7feea0075710 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feeac0af000 tx=0x7feeac01b030 comp rx=0 tx=0).stop 2024-09-21T07:32:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 msgr2=0x7feec4150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb400e970 tx=0x7feeb400ee30 comp rx=0 tx=0).stop 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 shutdown_connections 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feea0073200 0x7feea0075710 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec4154d20 0x7feec4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feec4151d30 0x7feec40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 --2- 172.21.15.64:0/2464426218 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feec40d0590 0x7feec4150ef0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 >> 172.21.15.64:0/2464426218 conn(0x7feec40cdbf0 msgr2=0x7feec406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 shutdown_connections 2024-09-21T07:32:24.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:24.185+0000 7feec8e00640 1 -- 172.21.15.64:0/2464426218 wait complete. 2024-09-21T07:32:24.206 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-21T07:32:25.207 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:25.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 -- 172.21.15.64:0/861565557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 msgr2=0x7f4828003aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 --2- 172.21.15.64:0/861565557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 0x7f4828003aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4834009b60 tx=0x7f483401d2b0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4846600640 1 -- 172.21.15.64:0/861565557 reap_dead start 2024-09-21T07:32:25.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 -- 172.21.15.64:0/861565557 shutdown_connections 2024-09-21T07:32:25.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 -- 172.21.15.64:0/861565557 >> 172.21.15.64:0/861565557 conn(0x7f48400ccbe0 msgr2=0x7f48400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:25.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 -- 172.21.15.64:0/861565557 shutdown_connections 2024-09-21T07:32:25.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.376+0000 7f4848600640 1 -- 172.21.15.64:0/861565557 wait complete. 2024-09-21T07:32:25.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 Processor -- start 2024-09-21T07:32:25.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- start start 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 0x7f4840150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48400cf410 0x7f48401e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f48400cc7a0 con 0x7f48400cf820 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48400cc620 con 0x7f48400cf410 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f48400cc920 con 0x7f4840070850 2024-09-21T07:32:25.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48064/0 (socket says 172.21.15.64:48064) 2024-09-21T07:32:25.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 -- 172.21.15.64:0/1841384930 learned_addr learned my addr 172.21.15.64:0/1841384930 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:25.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4845c00640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 0x7f4840150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4845200640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48400cf410 0x7f48401e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 -- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 msgr2=0x7f4840150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 0x7f4840150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 -- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48400cf410 msgr2=0x7f48401e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48400cf410 0x7f48401e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 -- 172.21.15.64:0/1841384930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4840150650 con 0x7f48400cf820 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4846600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4840160190 tx=0x7f483800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c009730 con 0x7f48400cf820 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4838019070 con 0x7f48400cf820 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48400cde60 con 0x7f48400cf820 2024-09-21T07:32:25.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838003e60 con 0x7f48400cf820 2024-09-21T07:32:25.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.380+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48400ce420 con 0x7f48400cf820 2024-09-21T07:32:25.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4840070310 con 0x7f48400cf820 2024-09-21T07:32:25.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f483801e460 con 0x7f48400cf820 2024-09-21T07:32:25.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f483d600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4838097430 con 0x7f48400cf820 2024-09-21T07:32:25.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f4845c00640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.384+0000 7f4845c00640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 0x7f4820075710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f48340af000 tx=0x7f483401a050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:25.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.388+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f48400b2530 con 0x7f48400cf820 2024-09-21T07:32:25.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.600+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48400b0c70 con 0x7f48400cf820 2024-09-21T07:32:25.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.600+0000 7f483d600640 1 -- 172.21.15.64:0/1841384930 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f48380622b0 con 0x7f48400cf820 2024-09-21T07:32:25.604 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:25.604 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:25.604 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 msgr2=0x7f4820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 0x7f4820075710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f48340af000 tx=0x7f483401a050 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 msgr2=0x7f48401e9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4840160190 tx=0x7f483800cf20 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 shutdown_connections 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48400cf820 0x7f48401e9820 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48400cf410 0x7f48401e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 --2- 172.21.15.64:0/1841384930 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4840070850 0x7f4840150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 >> 172.21.15.64:0/1841384930 conn(0x7f48400ccbe0 msgr2=0x7f48400afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 shutdown_connections 2024-09-21T07:32:25.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.604+0000 7f4848600640 1 -- 172.21.15.64:0/1841384930 wait complete. 2024-09-21T07:32:25.626 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:25.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:25.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- 172.21.15.64:0/574581664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 msgr2=0x7fb1a0073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- 172.21.15.64:0/574581664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a0073d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb198009bc0 tx=0x7fb19801cba0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- 172.21.15.64:0/574581664 shutdown_connections 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- 172.21.15.64:0/574581664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a0073d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- 172.21.15.64:0/574581664 >> v2:172.21.15.90:3300/0 conn(0x7fb1a00cf8b0 0x7fb1a006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- 172.21.15.64:0/574581664 >> 172.21.15.64:0/574581664 conn(0x7fb1a00d0de0 msgr2=0x7fb1a00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- 172.21.15.64:0/574581664 shutdown_connections 2024-09-21T07:32:25.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- 172.21.15.64:0/574581664 wait complete. 2024-09-21T07:32:25.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 Processor -- start 2024-09-21T07:32:25.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- start start 2024-09-21T07:32:25.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 0x7fb1a01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a00b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0169df0 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0169c70 con 0x7fb1a006d560 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.784+0000 7fb1a7000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a0169f70 con 0x7fb1a00c5b00 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb19fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 0x7fb1a01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48072/0 (socket says 172.21.15.64:48072) 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 -- 172.21.15.64:0/3384545297 learned_addr learned my addr 172.21.15.64:0/3384545297 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb197400640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a00b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 -- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 msgr2=0x7fb1a00b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a00b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 -- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 msgr2=0x7fb1a01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:25.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 0x7fb1a01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:25.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 -- 172.21.15.64:0/3384545297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01556a0 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb19fe00640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 0x7fb1a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:25.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a5000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb19801a7d0 tx=0x7fb198009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:25.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980bb070 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb198004d40 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a0155120 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980b2040 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a0155cd0 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.788+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a006d020 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.792+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb1980be070 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.792+0000 7fb19cc00640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 0x7fb17c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:25.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.792+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fb19812e240 con 0x7fb1a00cf8b0 2024-09-21T07:32:25.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.792+0000 7fb19fe00640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 0x7fb17c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:25.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.792+0000 7fb19fe00640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 0x7fb17c075710 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb190009600 tx=0x7fb1900091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:25.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:25.796+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb198016790 con 0x7fb1a00cf8b0 2024-09-21T07:32:26.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.052+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb1a0158d00 con 0x7fb1a00cf8b0 2024-09-21T07:32:26.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.052+0000 7fb19cc00640 1 -- 172.21.15.64:0/3384545297 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fb1980f8bf0 con 0x7fb1a00cf8b0 2024-09-21T07:32:26.055 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:26.055 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":604,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076729333,"bytes_used":2575212544,"bytes_avail":770518900736,"bytes_total":773094113280,"write_bytes_sec":12488615,"read_op_per_sec":0,"write_op_per_sec":25},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-21T07:32:25.578546+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 msgr2=0x7fb17c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 0x7fb17c075710 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb190009600 tx=0x7fb1900091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 msgr2=0x7fb1a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb19801a7d0 tx=0x7fb198009260 comp rx=0 tx=0).stop 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 shutdown_connections 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb17c073200 0x7fb17c075710 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1a00cf8b0 0x7fb1a00b6090 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1a00c5b00 0x7fb1a00b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 --2- 172.21.15.64:0/3384545297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1a006d560 0x7fb1a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 >> 172.21.15.64:0/3384545297 conn(0x7fb1a00d0de0 msgr2=0x7fb1a00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:26.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 shutdown_connections 2024-09-21T07:32:26.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:26.056+0000 7fb1a7000640 1 -- 172.21.15.64:0/3384545297 wait complete. 2024-09-21T07:32:26.077 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-21T07:32:27.078 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 -- 172.21.15.64:0/1021972258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca4004810 msgr2=0x7f4ca4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/1021972258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca4004810 0x7f4ca4004c20 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0072af0 tx=0x7f4ca801d250 comp rx=0 tx=0).stop 2024-09-21T07:32:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cbe800640 1 -- 172.21.15.64:0/1021972258 reap_dead start 2024-09-21T07:32:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 -- 172.21.15.64:0/1021972258 shutdown_connections 2024-09-21T07:32:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 -- 172.21.15.64:0/1021972258 >> 172.21.15.64:0/1021972258 conn(0x7f4cc00d0de0 msgr2=0x7f4cc00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:27.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 -- 172.21.15.64:0/1021972258 shutdown_connections 2024-09-21T07:32:27.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.248+0000 7f4cc4e00640 1 -- 172.21.15.64:0/1021972258 wait complete. 2024-09-21T07:32:27.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 Processor -- start 2024-09-21T07:32:27.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- start start 2024-09-21T07:32:27.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4004810 0x7f4cc01f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4cc01582a0 0x7f4cc01586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce730 con 0x7f4cc00b3810 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce5b0 con 0x7f4ca4004810 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce8b0 con 0x7f4cc01582a0 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48094/0 (socket says 172.21.15.64:48094) 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 -- 172.21.15.64:0/2464871715 learned_addr learned my addr 172.21.15.64:0/2464871715 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cbde00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4004810 0x7f4cc01f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cbe800640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4cc01582a0 0x7f4cc01586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 -- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4cc01582a0 msgr2=0x7f4cc01586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4cc01582a0 0x7f4cc01586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 -- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4004810 msgr2=0x7f4cc01f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4004810 0x7f4cc01f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 -- 172.21.15.64:0/2464871715 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc0158bf0 con 0x7f4cc00b3810 2024-09-21T07:32:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb7e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009a80 tx=0x7f4ca80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80b1040 con 0x7f4cc00b3810 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ca80bb070 con 0x7f4cc00b3810 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc01f9df0 con 0x7f4cc00b3810 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8009730 con 0x7f4cc00b3810 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.252+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc00c9aa0 con 0x7f4cc00b3810 2024-09-21T07:32:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc01f9b60 con 0x7f4cc00b3810 2024-09-21T07:32:27.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ca8004270 con 0x7f4cc00b3810 2024-09-21T07:32:27.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cb6000640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 0x7f4c9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f4ca812fe80 con 0x7f4cc00b3810 2024-09-21T07:32:27.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cbde00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 0x7f4c9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.256+0000 7f4cbde00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 0x7f4c9c075710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009b40 tx=0x7f4cb00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:27.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.260+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4cc0158bf0 con 0x7f4cc00b3810 2024-09-21T07:32:27.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cc00ccda0 con 0x7f4cc00b3810 2024-09-21T07:32:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cb6000640 1 -- 172.21.15.64:0/2464871715 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f4ca8016f60 con 0x7f4cc00b3810 2024-09-21T07:32:27.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:27.474 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:27.474 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 msgr2=0x7f4c9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 0x7f4c9c075710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009b40 tx=0x7f4cb00091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 msgr2=0x7f4cc014fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009a80 tx=0x7f4ca80055d0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 shutdown_connections 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4c9c073200 0x7f4c9c075710 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4cc01582a0 0x7f4cc01586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cc00b3810 0x7f4cc014fdd0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 --2- 172.21.15.64:0/2464871715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4004810 0x7f4cc01f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 >> 172.21.15.64:0/2464871715 conn(0x7f4cc00d0de0 msgr2=0x7f4cc00b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 shutdown_connections 2024-09-21T07:32:27.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.472+0000 7f4cc4e00640 1 -- 172.21.15.64:0/2464871715 wait complete. 2024-09-21T07:32:27.497 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:27.497 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:27.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- 172.21.15.64:0/4090698381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 msgr2=0x7fe8e00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/4090698381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e00b41c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009c80 tx=0x7fe8c801cda0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- 172.21.15.64:0/4090698381 shutdown_connections 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/4090698381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e00b41c0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- 172.21.15.64:0/4090698381 >> 172.21.15.64:0/4090698381 conn(0x7fe8e00ccbe0 msgr2=0x7fe8e00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- 172.21.15.64:0/4090698381 shutdown_connections 2024-09-21T07:32:27.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- 172.21.15.64:0/4090698381 wait complete. 2024-09-21T07:32:27.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 Processor -- start 2024-09-21T07:32:27.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.652+0000 7fe8e5a00640 1 -- start start 2024-09-21T07:32:27.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e00b4700 0x7fe8e01635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e015edb0 0x7fe8e0156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e016a2e0 con 0x7fe8e00709b0 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e016a160 con 0x7fe8e00b4700 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e016a460 con 0x7fe8e015edb0 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48118/0 (socket says 172.21.15.64:48118) 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 -- 172.21.15.64:0/1812746693 learned_addr learned my addr 172.21.15.64:0/1812746693 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8df400640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e015edb0 0x7fe8e0156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8d6000640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e00b4700 0x7fe8e01635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 -- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e015edb0 msgr2=0x7fe8e0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e015edb0 0x7fe8e0156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 -- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e00b4700 msgr2=0x7fe8e01635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e00b4700 0x7fe8e01635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 -- 172.21.15.64:0/1812746693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e01566b0 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8dea00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000b410 tx=0x7fe8d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0015030 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8d0004020 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01fcc10 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0004470 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e009d1c0 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.656+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e00b41c0 con 0x7fe8e00709b0 2024-09-21T07:32:27.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.660+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8d0018070 con 0x7fe8e00709b0 2024-09-21T07:32:27.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.660+0000 7fe8d7400640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 0x7fe8bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:27.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.660+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fe8d0093e80 con 0x7fe8e00709b0 2024-09-21T07:32:27.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.660+0000 7fe8d6000640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 0x7fe8bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:27.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.660+0000 7fe8d6000640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 0x7fe8bc075710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80af000 tx=0x7fe8c801b5e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:27.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.664+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe8d005e6a0 con 0x7fe8e00709b0 2024-09-21T07:32:27.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8e015d020 con 0x7fe8e00709b0 2024-09-21T07:32:27.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8d7400640 1 -- 172.21.15.64:0/1812746693 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fe8d00630d0 con 0x7fe8e00709b0 2024-09-21T07:32:27.905 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:27.905 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":605,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076729333,"bytes_used":2575212544,"bytes_avail":770518900736,"bytes_total":773094113280,"write_bytes_sec":12488615,"read_op_per_sec":0,"write_op_per_sec":25},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-21T07:32:25.578546+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:27.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 msgr2=0x7fe8bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 0x7fe8bc075710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80af000 tx=0x7fe8c801b5e0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 msgr2=0x7fe8e009c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000b410 tx=0x7fe8d000b8d0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 shutdown_connections 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8bc073200 0x7fe8bc075710 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8e015edb0 0x7fe8e0156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8e00b4700 0x7fe8e01635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 --2- 172.21.15.64:0/1812746693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8e00709b0 0x7fe8e009c8b0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 >> 172.21.15.64:0/1812746693 conn(0x7fe8e00ccbe0 msgr2=0x7fe8e015e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 shutdown_connections 2024-09-21T07:32:27.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:27.904+0000 7fe8e5a00640 1 -- 172.21.15.64:0/1812746693 wait complete. 2024-09-21T07:32:27.927 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-21T07:32:28.928 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- 172.21.15.64:0/1122226355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c8003cb0 msgr2=0x7fe5c8004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/1122226355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c8003cb0 0x7fe5c8004100 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006fc0 tx=0x7fe5d401cf20 comp rx=0 tx=0).stop 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- 172.21.15.64:0/1122226355 shutdown_connections 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/1122226355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c8003cb0 0x7fe5c8004100 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- 172.21.15.64:0/1122226355 >> 172.21.15.64:0/1122226355 conn(0x7fe5e406d220 msgr2=0x7fe5e406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- 172.21.15.64:0/1122226355 shutdown_connections 2024-09-21T07:32:29.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- 172.21.15.64:0/1122226355 wait complete. 2024-09-21T07:32:29.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 Processor -- start 2024-09-21T07:32:29.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.100+0000 7fe5e9a00640 1 -- start start 2024-09-21T07:32:29.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5c8003cb0 0x7fe5e41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e41ec540 0x7fe5e41ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e40c6bb0 con 0x7fe5e4159c10 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e40c6a30 con 0x7fe5e41ec540 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e40c6d30 con 0x7fe5c8003cb0 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48136/0 (socket says 172.21.15.64:48136) 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 -- 172.21.15.64:0/376040788 learned_addr learned my addr 172.21.15.64:0/376040788 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e2a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5c8003cb0 0x7fe5e41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e3400640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e41ec540 0x7fe5e41ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 -- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5c8003cb0 msgr2=0x7fe5e41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5c8003cb0 0x7fe5e41528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 -- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e41ec540 msgr2=0x7fe5e41ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e41ec540 0x7fe5e41ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 -- 172.21.15.64:0/376040788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e41ece90 con 0x7fe5e4159c10 2024-09-21T07:32:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5dbe00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc011ab0 tx=0x7fe5cc011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc01e070 con 0x7fe5e4159c10 2024-09-21T07:32:29.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5cc00fcb0 con 0x7fe5e4159c10 2024-09-21T07:32:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc019670 con 0x7fe5e4159c10 2024-09-21T07:32:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e406e4e0 con 0x7fe5e4159c10 2024-09-21T07:32:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e41f93e0 con 0x7fe5e4159c10 2024-09-21T07:32:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e41f9140 con 0x7fe5e4159c10 2024-09-21T07:32:29.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.104+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe5cc021070 con 0x7fe5e4159c10 2024-09-21T07:32:29.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.108+0000 7fe5daa00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 0x7fe5c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.108+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fe5cc094d90 con 0x7fe5e4159c10 2024-09-21T07:32:29.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.108+0000 7fe5e2a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 0x7fe5c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.108+0000 7fe5e2a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 0x7fe5c0075710 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ac000 tx=0x7fe5d4005040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:29.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.112+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe5e41f9140 con 0x7fe5e4159c10 2024-09-21T07:32:29.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.324+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5e40c8140 con 0x7fe5e4159c10 2024-09-21T07:32:29.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.324+0000 7fe5daa00640 1 -- 172.21.15.64:0/376040788 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7fe5e41ece90 con 0x7fe5e4159c10 2024-09-21T07:32:29.327 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:29.327 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:29.328 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 msgr2=0x7fe5c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 0x7fe5c0075710 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ac000 tx=0x7fe5d4005040 comp rx=0 tx=0).stop 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 msgr2=0x7fe5e415a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc011ab0 tx=0x7fe5cc011f70 comp rx=0 tx=0).stop 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 shutdown_connections 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5c0073200 0x7fe5c0075710 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e41ec540 0x7fe5e41ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5e4159c10 0x7fe5e415a020 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 --2- 172.21.15.64:0/376040788 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5c8003cb0 0x7fe5e41528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 >> 172.21.15.64:0/376040788 conn(0x7fe5e406d220 msgr2=0x7fe5e40713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:29.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 shutdown_connections 2024-09-21T07:32:29.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.328+0000 7fe5e9a00640 1 -- 172.21.15.64:0/376040788 wait complete. 2024-09-21T07:32:29.349 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:29.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 -- 172.21.15.64:0/2320064986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0b48d0 msgr2=0x7f3a7c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 --2- 172.21.15.64:0/2320064986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0b48d0 0x7f3a7c072e20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009c80 tx=0x7f3a7401cda0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 -- 172.21.15.64:0/2320064986 shutdown_connections 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 --2- 172.21.15.64:0/2320064986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0b48d0 0x7f3a7c072e20 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 --2- 172.21.15.64:0/2320064986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c15edb0 0x7f3a7c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 -- 172.21.15.64:0/2320064986 >> 172.21.15.64:0/2320064986 conn(0x7f3a7c0ccbe0 msgr2=0x7f3a7c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 -- 172.21.15.64:0/2320064986 shutdown_connections 2024-09-21T07:32:29.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.504+0000 7f3a82e00640 1 -- 172.21.15.64:0/2320064986 wait complete. 2024-09-21T07:32:29.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 Processor -- start 2024-09-21T07:32:29.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- start start 2024-09-21T07:32:29.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7c15edb0 0x7f3a7c1f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c09d1d0 0x7f3a7c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c168cf0 con 0x7f3a7c0709b0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c168b70 con 0x7f3a7c15edb0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c168e70 con 0x7f3a7c09d1d0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48152/0 (socket says 172.21.15.64:48152) 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 -- 172.21.15.64:0/1463447291 learned_addr learned my addr 172.21.15.64:0/1463447291 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a73400640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7c15edb0 0x7f3a7c1f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a80e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c09d1d0 0x7f3a7c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 -- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c09d1d0 msgr2=0x7f3a7c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c09d1d0 0x7f3a7c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 -- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7c15edb0 msgr2=0x7f3a7c1f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7c15edb0 0x7f3a7c1f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 -- 172.21.15.64:0/1463447291 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c0b2530 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a7be00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00e7f0 tx=0x7f3a6c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00ccc0 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6c00ce80 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c005280 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c0b2810 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.508+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7c1f81e0 con 0x7f3a7c0709b0 2024-09-21T07:32:29.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7c0b2a50 con 0x7f3a7c0709b0 2024-09-21T07:32:29.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3a6c005420 con 0x7f3a7c0709b0 2024-09-21T07:32:29.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a78c00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 0x7f3a58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:29.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f3a6c094c60 con 0x7f3a7c0709b0 2024-09-21T07:32:29.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a73400640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 0x7f3a58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:29.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.512+0000 7f3a73400640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 0x7f3a58075710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0c6d00 tx=0x7f3a64009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:29.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.516+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3a7c0b2a50 con 0x7f3a7c0709b0 2024-09-21T07:32:29.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.752+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a7c072e20 con 0x7f3a7c0709b0 2024-09-21T07:32:29.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a78c00640 1 -- 172.21.15.64:0/1463447291 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f3a6c05f480 con 0x7f3a7c0709b0 2024-09-21T07:32:29.757 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:29.757 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":607,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078316092,"bytes_used":2582650880,"bytes_avail":770511462400,"bytes_total":773094113280,"write_bytes_sec":12628476,"read_op_per_sec":0,"write_op_per_sec":93},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-21T07:32:25.578546+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 msgr2=0x7f3a58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 0x7f3a58075710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0c6d00 tx=0x7f3a64009040 comp rx=0 tx=0).stop 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 msgr2=0x7f3a7c1fab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00e7f0 tx=0x7f3a6c00ecb0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 shutdown_connections 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3a58073200 0x7f3a58075710 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a7c09d1d0 0x7f3a7c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7c15edb0 0x7f3a7c1f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 --2- 172.21.15.64:0/1463447291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a7c0709b0 0x7f3a7c1fab20 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 >> 172.21.15.64:0/1463447291 conn(0x7f3a7c0ccbe0 msgr2=0x7f3a7c0acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 shutdown_connections 2024-09-21T07:32:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:29.756+0000 7f3a82e00640 1 -- 172.21.15.64:0/1463447291 wait complete. 2024-09-21T07:32:29.779 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-21T07:32:30.780 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:30.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 -- 172.21.15.64:0/4227197158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f104815edb0 msgr2=0x7f10480700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 --2- 172.21.15.64:0/4227197158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f104815edb0 0x7f10480700b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f104815f1c0 tx=0x7f103801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 -- 172.21.15.64:0/4227197158 shutdown_connections 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 --2- 172.21.15.64:0/4227197158 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10480b4700 0x7f1048072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 --2- 172.21.15.64:0/4227197158 >> v2:172.21.15.90:3300/0 conn(0x7f10480709b0 0x7f10480b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 --2- 172.21.15.64:0/4227197158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f104815edb0 0x7f10480700b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 -- 172.21.15.64:0/4227197158 >> 172.21.15.64:0/4227197158 conn(0x7f10480ccbe0 msgr2=0x7f10480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:30.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 -- 172.21.15.64:0/4227197158 shutdown_connections 2024-09-21T07:32:30.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.948+0000 7f104fa00640 1 -- 172.21.15.64:0/4227197158 wait complete. 2024-09-21T07:32:30.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 Processor -- start 2024-09-21T07:32:30.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 -- start start 2024-09-21T07:32:30.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10480b4700 0x7f10480c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f104815edb0 0x7f10480adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10480b2320 con 0x7f10480709b0 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10480b21a0 con 0x7f10480b4700 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104fa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f10480b24a0 con 0x7f104815edb0 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48180/0 (socket says 172.21.15.64:48180) 2024-09-21T07:32:30.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.952+0000 7f104d000640 1 -- 172.21.15.64:0/1042077006 learned_addr learned my addr 172.21.15.64:0/1042077006 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f103fe00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10480b4700 0x7f10480c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104da00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f104815edb0 0x7f10480adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 -- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f104815edb0 msgr2=0x7f10480adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f104815edb0 0x7f10480adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 -- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10480b4700 msgr2=0x7f10480c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10480b4700 0x7f10480c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 -- 172.21.15.64:0/1042077006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104815cdf0 con 0x7f10480709b0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104d000640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f103801d160 tx=0x7f10380a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10380bd070 con 0x7f10480709b0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1038004490 con 0x7f10480709b0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038005290 con 0x7f10480709b0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10481fc430 con 0x7f10480709b0 2024-09-21T07:32:30.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10481fc9f0 con 0x7f10480709b0 2024-09-21T07:32:30.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1048072e20 con 0x7f10480709b0 2024-09-21T07:32:30.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.956+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1038005430 con 0x7f10480709b0 2024-09-21T07:32:30.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.960+0000 7f1045600640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 0x7f1024075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.960+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f103812e5b0 con 0x7f10480709b0 2024-09-21T07:32:30.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.960+0000 7f103fe00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 0x7f1024075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.960+0000 7f103fe00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 0x7f1024075740 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f10480c6e40 tx=0x7f103000b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:30.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:30.964+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f10380164b0 con 0x7f10480709b0 2024-09-21T07:32:31.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.180+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f104809da20 con 0x7f10480709b0 2024-09-21T07:32:31.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.180+0000 7f1045600640 1 -- 172.21.15.64:0/1042077006 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f10380f8de0 con 0x7f10480709b0 2024-09-21T07:32:31.184 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:31.184 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:31.185 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:31.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 msgr2=0x7f1024075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 0x7f1024075740 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f10480c6e40 tx=0x7f103000b260 comp rx=0 tx=0).stop 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 msgr2=0x7f104815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f103801d160 tx=0x7f10380a66d0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 shutdown_connections 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1024073230 0x7f1024075740 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f104815edb0 0x7f10480adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10480b4700 0x7f10480c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 --2- 172.21.15.64:0/1042077006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10480709b0 0x7f104815c8b0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 >> 172.21.15.64:0/1042077006 conn(0x7f10480ccbe0 msgr2=0x7f10480afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:31.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 shutdown_connections 2024-09-21T07:32:31.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.184+0000 7f104fa00640 1 -- 172.21.15.64:0/1042077006 wait complete. 2024-09-21T07:32:31.207 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:31.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:31.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 -- 172.21.15.64:0/3604206627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c159280 msgr2=0x7fd83c0d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 --2- 172.21.15.64:0/3604206627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c159280 0x7fd83c0d08b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0754c0 tx=0x7fd82c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 -- 172.21.15.64:0/3604206627 shutdown_connections 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 --2- 172.21.15.64:0/3604206627 >> v2:172.21.15.90:3300/0 conn(0x7fd83c0cf3b0 0x7fd83c071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 --2- 172.21.15.64:0/3604206627 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c0cefa0 0x7fd83c070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 --2- 172.21.15.64:0/3604206627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c159280 0x7fd83c0d08b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 -- 172.21.15.64:0/3604206627 >> 172.21.15.64:0/3604206627 conn(0x7fd83c0d10a0 msgr2=0x7fd83c0d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 -- 172.21.15.64:0/3604206627 shutdown_connections 2024-09-21T07:32:31.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.364+0000 7fd83be00640 1 -- 172.21.15.64:0/3604206627 wait complete. 2024-09-21T07:32:31.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 Processor -- start 2024-09-21T07:32:31.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- start start 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0cefa0 0x7fd83c143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c159280 0x7fd83c1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0b03c0 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0b0240 con 0x7fd83c0cefa0 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c0b0540 con 0x7fd83c159280 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:31.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48198/0 (socket says 172.21.15.64:48198) 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 -- 172.21.15.64:0/682318083 learned_addr learned my addr 172.21.15.64:0/682318083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83aa00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0cefa0 0x7fd83c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83b400640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c159280 0x7fd83c1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 -- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c159280 msgr2=0x7fd83c1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c159280 0x7fd83c1514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 -- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0cefa0 msgr2=0x7fd83c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0cefa0 0x7fd83c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 -- 172.21.15.64:0/682318083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c15ac90 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd833e00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e6c0 tx=0x7fd82400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82400cab0 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd82400cc50 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824005280 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c15af70 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.368+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c152460 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c0b7020 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd824005420 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd832a00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 0x7fd818075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:31.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fd824094a60 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd83aa00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 0x7fd818075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:31.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.372+0000 7fd83aa00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 0x7fd818075740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c01b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:31.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.376+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd82405f3c0 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.616+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd83c0add30 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.616+0000 7fd832a00640 1 -- 172.21.15.64:0/682318083 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fd824063df0 con 0x7fd83c0cf3b0 2024-09-21T07:32:31.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:31.619 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":609,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078316092,"bytes_used":2582650880,"bytes_avail":770511462400,"bytes_total":773094113280,"write_bytes_sec":8528677,"read_op_per_sec":0,"write_op_per_sec":77},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-21T07:32:25.578546+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:31.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 msgr2=0x7fd818075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 0x7fd818075740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c01b100 comp rx=0 tx=0).stop 2024-09-21T07:32:31.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 msgr2=0x7fd83c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e6c0 tx=0x7fd82400eb80 comp rx=0 tx=0).stop 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 shutdown_connections 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd818073230 0x7fd818075740 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd83c159280 0x7fd83c1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83c0cf3b0 0x7fd83c154720 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 --2- 172.21.15.64:0/682318083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0cefa0 0x7fd83c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 >> 172.21.15.64:0/682318083 conn(0x7fd83c0d10a0 msgr2=0x7fd83c158380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 shutdown_connections 2024-09-21T07:32:31.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:31.620+0000 7fd83be00640 1 -- 172.21.15.64:0/682318083 wait complete. 2024-09-21T07:32:31.641 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-21T07:32:32.642 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 -- 172.21.15.64:0/356952051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80b48d0 msgr2=0x7f3cb8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 --2- 172.21.15.64:0/356952051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80b48d0 0x7f3cb8072e20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009c80 tx=0x7f3cb001cda0 comp rx=0 tx=0).stop 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 -- 172.21.15.64:0/356952051 shutdown_connections 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 --2- 172.21.15.64:0/356952051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80b48d0 0x7f3cb8072e20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 --2- 172.21.15.64:0/356952051 >> v2:172.21.15.90:3300/0 conn(0x7f3cb815edb0 0x7f3cb80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:32.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 -- 172.21.15.64:0/356952051 >> 172.21.15.64:0/356952051 conn(0x7f3cb80ccbe0 msgr2=0x7f3cb80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:32.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 -- 172.21.15.64:0/356952051 shutdown_connections 2024-09-21T07:32:32.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.804+0000 7f3cbe400640 1 -- 172.21.15.64:0/356952051 wait complete. 2024-09-21T07:32:32.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 Processor -- start 2024-09-21T07:32:32.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 -- start start 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80709b0 0x7f3cb8163600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815edb0 0x7f3cb80af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8168b60 con 0x7f3cb809d340 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb81689e0 con 0x7f3cb815edb0 2024-09-21T07:32:32.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cbe400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb8168ce0 con 0x7f3cb80709b0 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48200/0 (socket says 172.21.15.64:48200) 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 -- 172.21.15.64:0/1607236061 learned_addr learned my addr 172.21.15.64:0/1607236061 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80709b0 0x7f3cb8163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cafe00640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815edb0 0x7f3cb80af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 -- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80709b0 msgr2=0x7f3cb8163600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80709b0 0x7f3cb8163600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 -- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815edb0 msgr2=0x7f3cb80af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815edb0 0x7f3cb80af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:32.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.808+0000 7f3cb7e00640 1 -- 172.21.15.64:0/1607236061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb8163df0 con 0x7f3cb809d340 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3cb7e00640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0098750 tx=0x7f3cb0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00b2040 con 0x7f3cb809d340 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb00bb070 con 0x7f3cb809d340 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0004330 con 0x7f3cb809d340 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb81640d0 con 0x7f3cb809d340 2024-09-21T07:32:32.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb80ca790 con 0x7f3cb809d340 2024-09-21T07:32:32.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8072e20 con 0x7f3cb809d340 2024-09-21T07:32:32.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.812+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3cb00044d0 con 0x7f3cb809d340 2024-09-21T07:32:32.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.816+0000 7f3caf400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 0x7f3c94075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:32.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.816+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f3cb012ea40 con 0x7f3cb809d340 2024-09-21T07:32:32.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.816+0000 7f3cb7400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 0x7f3c94075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:32.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.816+0000 7f3cb7400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 0x7f3c94075740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009b40 tx=0x7f3ca80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:32.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:32.820+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3cb0130e20 con 0x7f3cb809d340 2024-09-21T07:32:33.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cb8163b80 con 0x7f3cb809d340 2024-09-21T07:32:33.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3caf400640 1 -- 172.21.15.64:0/1607236061 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f3cb0016990 con 0x7f3cb809d340 2024-09-21T07:32:33.038 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:33.038 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:33.038 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 msgr2=0x7f3c94075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 0x7f3c94075740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009b40 tx=0x7f3ca80091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 msgr2=0x7f3cb80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0098750 tx=0x7f3cb0003f40 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 shutdown_connections 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c94073230 0x7f3c94075740 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cb809d340 0x7f3cb80adf10 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb815edb0 0x7f3cb80af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 --2- 172.21.15.64:0/1607236061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3cb80709b0 0x7f3cb8163600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 >> 172.21.15.64:0/1607236061 conn(0x7f3cb80ccbe0 msgr2=0x7f3cb80b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:33.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 shutdown_connections 2024-09-21T07:32:33.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.036+0000 7f3cbe400640 1 -- 172.21.15.64:0/1607236061 wait complete. 2024-09-21T07:32:33.061 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-21T07:32:33.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:32:33.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 -- 172.21.15.64:0/2777835471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c00709b0 msgr2=0x7f43c00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 --2- 172.21.15.64:0/2777835471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c00709b0 0x7f43c00b41c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009900 tx=0x7f43a801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 -- 172.21.15.64:0/2777835471 shutdown_connections 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 --2- 172.21.15.64:0/2777835471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c00709b0 0x7f43c00b41c0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 -- 172.21.15.64:0/2777835471 >> 172.21.15.64:0/2777835471 conn(0x7f43c00ccbe0 msgr2=0x7f43c00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 -- 172.21.15.64:0/2777835471 shutdown_connections 2024-09-21T07:32:33.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.216+0000 7f43c7600640 1 -- 172.21.15.64:0/2777835471 wait complete. 2024-09-21T07:32:33.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 Processor -- start 2024-09-21T07:32:33.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- start start 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c00709b0 0x7f43c00b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43c00b4700 0x7f43c0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f43c016a240 con 0x7f43c015edb0 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43c016a0c0 con 0x7f43c00709b0 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f43c016a3c0 con 0x7f43c00b4700 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48216/0 (socket says 172.21.15.64:48216) 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 -- 172.21.15.64:0/1579832963 learned_addr learned my addr 172.21.15.64:0/1579832963 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43b7e00640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43c00b4700 0x7f43c0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c4c00640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c00709b0 0x7f43c00b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 -- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43c00b4700 msgr2=0x7f43c0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43c00b4700 0x7f43c0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 -- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c00709b0 msgr2=0x7f43c00b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c00709b0 0x7f43c00b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 -- 172.21.15.64:0/1579832963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01f7310 con 0x7f43c015edb0 2024-09-21T07:32:33.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c5600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c6e0 tx=0x7f43b800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8003b80 con 0x7f43c015edb0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43b8003d20 con 0x7f43c015edb0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8005330 con 0x7f43c015edb0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c01f75f0 con 0x7f43c015edb0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.220+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c01f7bb0 con 0x7f43c015edb0 2024-09-21T07:32:33.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c0155af0 con 0x7f43c015edb0 2024-09-21T07:32:33.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f43b80054d0 con 0x7f43c015edb0 2024-09-21T07:32:33.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43bd600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 0x7f439c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f43b8093fc0 con 0x7f43c015edb0 2024-09-21T07:32:33.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43c4c00640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 0x7f439c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.224+0000 7f43c4c00640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 0x7f439c075710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43b0007fd0 tx=0x7f43b0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:33.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.228+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f43c00b4b10 con 0x7f43c015edb0 2024-09-21T07:32:33.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.468+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f43c01f70a0 con 0x7f43c015edb0 2024-09-21T07:32:33.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.468+0000 7f43bd600640 1 -- 172.21.15.64:0/1579832963 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1616 (secure 0 0 0) 0x7f43b805e7f0 con 0x7f43c015edb0 2024-09-21T07:32:33.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:33.471 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":611,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078316092,"bytes_used":2582650880,"bytes_avail":770511462400,"bytes_total":773094113280,"write_bytes_sec":139823,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-21T07:32:31.580284+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 msgr2=0x7f439c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 0x7f439c075710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43b0007fd0 tx=0x7f43b0009040 comp rx=0 tx=0).stop 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 msgr2=0x7f43c015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c6e0 tx=0x7f43b800cba0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 shutdown_connections 2024-09-21T07:32:33.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f439c073200 0x7f439c075710 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43c015edb0 0x7f43c015de60 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43c00b4700 0x7f43c0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 --2- 172.21.15.64:0/1579832963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c00709b0 0x7f43c00b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 >> 172.21.15.64:0/1579832963 conn(0x7f43c00ccbe0 msgr2=0x7f43c00ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 shutdown_connections 2024-09-21T07:32:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.472+0000 7f43c7600640 1 -- 172.21.15.64:0/1579832963 wait complete. 2024-09-21T07:32:33.493 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:32:33.493 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:32:33.493 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:32:33.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:32:33.696 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:32:33.697 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:32:33.697 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:33.697 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:33.705 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:33.706 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:33.756 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:32:33.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 -- 172.21.15.64:0/4133993975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 msgr2=0x7fa82406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 --2- 172.21.15.64:0/4133993975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa82406f290 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fa8240ccb50 tx=0x7fa81c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 -- 172.21.15.64:0/4133993975 shutdown_connections 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 --2- 172.21.15.64:0/4133993975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa82406f290 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 --2- 172.21.15.64:0/4133993975 >> v2:172.21.15.90:3300/0 conn(0x7fa8240d0e60 0x7fa8240b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 -- 172.21.15.64:0/4133993975 >> 172.21.15.64:0/4133993975 conn(0x7fa82406d450 msgr2=0x7fa8240d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 -- 172.21.15.64:0/4133993975 shutdown_connections 2024-09-21T07:32:33.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.956+0000 7fa82bc00640 1 -- 172.21.15.64:0/4133993975 wait complete. 2024-09-21T07:32:33.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 Processor -- start 2024-09-21T07:32:33.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- start start 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8240ccd00 0x7fa8241f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8240d0e60 0x7fa8241fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa82416a1f0 con 0x7fa82406ee80 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa82416a070 con 0x7fa8240ccd00 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa82416a370 con 0x7fa8240d0e60 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48230/0 (socket says 172.21.15.64:48230) 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 -- 172.21.15.64:0/831846173 learned_addr learned my addr 172.21.15.64:0/831846173 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:33.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa823e00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8240ccd00 0x7fa8241f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829c00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8240d0e60 0x7fa8241fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 -- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8240d0e60 msgr2=0x7fa8241fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8240d0e60 0x7fa8241fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 -- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8240ccd00 msgr2=0x7fa8241f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8240ccd00 0x7fa8241f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 -- 172.21.15.64:0/831846173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8240b2700 con 0x7fa82406ee80 2024-09-21T07:32:33.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa829200640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa81800d700 tx=0x7fa81800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818017070 con 0x7fa82406ee80 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa818009d20 con 0x7fa82406ee80 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8240b29e0 con 0x7fa82406ee80 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8180106c0 con 0x7fa82406ee80 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.960+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8240c3e20 con 0x7fa82406ee80 2024-09-21T07:32:33.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.964+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82406f290 con 0x7fa82406ee80 2024-09-21T07:32:33.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.964+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa81801a070 con 0x7fa82406ee80 2024-09-21T07:32:33.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.964+0000 7fa820c00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 0x7fa804075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:33.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.964+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fa818094540 con 0x7fa82406ee80 2024-09-21T07:32:33.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.964+0000 7fa823e00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 0x7fa804075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:33.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.968+0000 7fa823e00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 0x7fa804075740 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa8240ca840 tx=0x7fa810009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:33.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:33.968+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa81805f3c0 con 0x7fa82406ee80 2024-09-21T07:32:34.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.160+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8240c3a20 con 0x7fa82406ee80 2024-09-21T07:32:34.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.160+0000 7fa820c00640 1 -- 172.21.15.64:0/831846173 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7fa81805ecc0 con 0x7fa82406ee80 2024-09-21T07:32:34.163 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 msgr2=0x7fa804075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 0x7fa804075740 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa8240ca840 tx=0x7fa810009040 comp rx=0 tx=0).stop 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 msgr2=0x7fa8240c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa81800d700 tx=0x7fa81800dbc0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 shutdown_connections 2024-09-21T07:32:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa804073230 0x7fa804075740 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8240d0e60 0x7fa8241fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8240ccd00 0x7fa8241f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 --2- 172.21.15.64:0/831846173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa82406ee80 0x7fa8240c6760 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 >> 172.21.15.64:0/831846173 conn(0x7fa82406d450 msgr2=0x7fa824072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 shutdown_connections 2024-09-21T07:32:34.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.164+0000 7fa82bc00640 1 -- 172.21.15.64:0/831846173 wait complete. 2024-09-21T07:32:34.186 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:32:34.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:34.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:32:34.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:32:34.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:34.544 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:32:34.554 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:32:34.554 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:32:34.554 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:34.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:32:34.563 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:32:34.563 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:34.563 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:34.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:32:34.608 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:32:34.608 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:32:34.609 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:34.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:32:34.618 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:34.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- 172.21.15.64:0/2205463595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9415edb0 msgr2=0x7f7c940700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 --2- 172.21.15.64:0/2205463595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9415edb0 0x7f7c940700b0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009840 tx=0x7f7c8801c820 comp rx=0 tx=0).stop 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- 172.21.15.64:0/2205463595 shutdown_connections 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 --2- 172.21.15.64:0/2205463595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b48d0 0x7f7c94072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 --2- 172.21.15.64:0/2205463595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9415edb0 0x7f7c940700b0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- 172.21.15.64:0/2205463595 >> 172.21.15.64:0/2205463595 conn(0x7f7c940ccbe0 msgr2=0x7f7c940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- 172.21.15.64:0/2205463595 shutdown_connections 2024-09-21T07:32:34.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- 172.21.15.64:0/2205463595 wait complete. 2024-09-21T07:32:34.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 Processor -- start 2024-09-21T07:32:34.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.808+0000 7f7c9b600640 1 -- start start 2024-09-21T07:32:34.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 0x7f7c940b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 0x7f7c94156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94168bb0 con 0x7f7c940709b0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94168a30 con 0x7f7c9415edb0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7c94168d30 con 0x7f7c940b0ba0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48254/0 (socket says 172.21.15.64:48254) 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 -- 172.21.15.64:0/525164337 learned_addr learned my addr 172.21.15.64:0/525164337 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c99600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 0x7f7c94156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 -- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 msgr2=0x7f7c94156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 0x7f7c94156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c93e00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 0x7f7c940b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 -- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 msgr2=0x7f7c940b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 0x7f7c940b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 -- 172.21.15.64:0/525164337 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941fc290 con 0x7f7c940709b0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c99600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 0x7f7c94156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c93e00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 0x7f7c940b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c98c00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801c650 tx=0x7f7c880a67d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004040 con 0x7f7c940709b0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c880042d0 con 0x7f7c940709b0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88005280 con 0x7f7c940709b0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c941fc570 con 0x7f7c940709b0 2024-09-21T07:32:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.812+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c941fcb30 con 0x7f7c940709b0 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c94072e20 con 0x7f7c940709b0 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7c880c0060 con 0x7f7c940709b0 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c90c00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 0x7f7c74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f7c8812e580 con 0x7f7c940709b0 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c93e00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 0x7f7c74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.816+0000 7f7c93e00640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 0x7f7c74075710 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b0250 tx=0x7f7c80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:34.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:34.820+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7c88016410 con 0x7f7c940709b0 2024-09-21T07:32:35.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9415bf10 con 0x7f7c940709b0 2024-09-21T07:32:35.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c90c00640 1 -- 172.21.15.64:0/525164337 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f7c880f9400 con 0x7f7c940709b0 2024-09-21T07:32:35.038 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:35.038 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:35.038 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:35.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 msgr2=0x7f7c74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 0x7f7c74075710 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b0250 tx=0x7f7c80009040 comp rx=0 tx=0).stop 2024-09-21T07:32:35.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 msgr2=0x7f7c940b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801c650 tx=0x7f7c880a67d0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 shutdown_connections 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7c74073200 0x7f7c74075710 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c940b0ba0 0x7f7c94156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9415edb0 0x7f7c940b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 --2- 172.21.15.64:0/525164337 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c940709b0 0x7f7c940b2440 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 >> 172.21.15.64:0/525164337 conn(0x7f7c940ccbe0 msgr2=0x7f7c941577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 shutdown_connections 2024-09-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.036+0000 7f7c9b600640 1 -- 172.21.15.64:0/525164337 wait complete. 2024-09-21T07:32:35.064 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 -- 172.21.15.64:0/2895088404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800b13e0 msgr2=0x7f09800d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 --2- 172.21.15.64:0/2895088404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800b13e0 0x7f09800d2a60 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0980074b70 tx=0x7f097401c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 -- 172.21.15.64:0/2895088404 shutdown_connections 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 --2- 172.21.15.64:0/2895088404 >> v2:172.21.15.90:3300/0 conn(0x7f09800b1f20 0x7f09800b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 --2- 172.21.15.64:0/2895088404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800b13e0 0x7f09800d2a60 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 -- 172.21.15.64:0/2895088404 >> 172.21.15.64:0/2895088404 conn(0x7f098008bf80 msgr2=0x7f09800d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 -- 172.21.15.64:0/2895088404 shutdown_connections 2024-09-21T07:32:35.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.220+0000 7f0986000640 1 -- 172.21.15.64:0/2895088404 wait complete. 2024-09-21T07:32:35.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 Processor -- start 2024-09-21T07:32:35.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- start start 2024-09-21T07:32:35.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09800b13e0 0x7f098015fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 0x7f098015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f098016a410 con 0x7f09800ceb50 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f098016a290 con 0x7f09800b13e0 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f098016a590 con 0x7f09800b1f20 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59596/0 (socket says 172.21.15.64:59596) 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 -- 172.21.15.64:0/3670156958 learned_addr learned my addr 172.21.15.64:0/3670156958 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0984c00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09800b13e0 0x7f098015fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f097fe00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 0x7f098015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 -- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 msgr2=0x7f098015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 0x7f098015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 -- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09800b13e0 msgr2=0x7f098015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09800b13e0 0x7f098015fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 -- 172.21.15.64:0/3670156958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0980160070 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f097fe00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 0x7f098015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0985600640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f097800eab0 tx=0x7f097800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097800cea0 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0978004b30 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098015f120 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978005020 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.224+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09800ca050 con 0x7f09800ceb50 2024-09-21T07:32:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09800d2a60 con 0x7f09800ceb50 2024-09-21T07:32:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f09780051c0 con 0x7f09800ceb50 2024-09-21T07:32:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f097cc00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 0x7f0960075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f09780950a0 con 0x7f09800ceb50 2024-09-21T07:32:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f0984c00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 0x7f0960075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.228+0000 7f0984c00640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 0x7f0960075710 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09740af000 tx=0x7f097401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:35.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.232+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f097805feb0 con 0x7f09800ceb50 2024-09-21T07:32:35.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0980071370 con 0x7f09800ceb50 2024-09-21T07:32:35.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f097cc00640 1 -- 172.21.15.64:0/3670156958 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f097805f7b0 con 0x7f09800ceb50 2024-09-21T07:32:35.446 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:35.446 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:35.446 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 msgr2=0x7f0960075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 0x7f0960075710 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09740af000 tx=0x7f097401b100 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 msgr2=0x7f09800b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f097800eab0 tx=0x7f097800ef70 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 shutdown_connections 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0960073200 0x7f0960075710 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ceb50 0x7f09800b5980 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09800b1f20 0x7f098015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 --2- 172.21.15.64:0/3670156958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09800b13e0 0x7f098015fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 >> 172.21.15.64:0/3670156958 conn(0x7f098008bf80 msgr2=0x7f0980068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 shutdown_connections 2024-09-21T07:32:35.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.444+0000 7f0986000640 1 -- 172.21.15.64:0/3670156958 wait complete. 2024-09-21T07:32:35.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:35.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 -- 172.21.15.64:0/1016288116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d815edb0 msgr2=0x7f31d80700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 --2- 172.21.15.64:0/1016288116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d815edb0 0x7f31d80700b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009840 tx=0x7f31c801c820 comp rx=0 tx=0).stop 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 -- 172.21.15.64:0/1016288116 shutdown_connections 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 --2- 172.21.15.64:0/1016288116 >> v2:172.21.15.90:3300/0 conn(0x7f31d80709b0 0x7f31d80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 --2- 172.21.15.64:0/1016288116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d815edb0 0x7f31d80700b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 -- 172.21.15.64:0/1016288116 >> 172.21.15.64:0/1016288116 conn(0x7f31d80ccbe0 msgr2=0x7f31d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 -- 172.21.15.64:0/1016288116 shutdown_connections 2024-09-21T07:32:35.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.624+0000 7f31de400640 1 -- 172.21.15.64:0/1016288116 wait complete. 2024-09-21T07:32:35.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 Processor -- start 2024-09-21T07:32:35.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- start start 2024-09-21T07:32:35.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d80709b0 0x7f31d8145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d815edb0 0x7f31d80b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8169070 con 0x7f31d80b4700 2024-09-21T07:32:35.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8168ef0 con 0x7f31d815edb0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f31d81691f0 con 0x7f31d80709b0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59602/0 (socket says 172.21.15.64:59602) 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 -- 172.21.15.64:0/3912613547 learned_addr learned my addr 172.21.15.64:0/3912613547 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31d7400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d80709b0 0x7f31d8145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31d7e00640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d815edb0 0x7f31d80b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 -- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d80709b0 msgr2=0x7f31d8145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d80709b0 0x7f31d8145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 -- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d815edb0 msgr2=0x7f31d80b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d815edb0 0x7f31d80b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 -- 172.21.15.64:0/3912613547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81f7800 con 0x7f31d80b4700 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cfe00640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f31c000e710 tx=0x7f31c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004220 con 0x7f31d80b4700 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31c00043c0 con 0x7f31d80b4700 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c000cb10 con 0x7f31d80b4700 2024-09-21T07:32:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81468b0 con 0x7f31d80b4700 2024-09-21T07:32:35.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.628+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d8146b90 con 0x7f31d80b4700 2024-09-21T07:32:35.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.632+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d80b41c0 con 0x7f31d80b4700 2024-09-21T07:32:35.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.632+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f31c0003600 con 0x7f31d80b4700 2024-09-21T07:32:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.632+0000 7f31cf400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 0x7f31b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.632+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f31c0094dc0 con 0x7f31d80b4700 2024-09-21T07:32:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.636+0000 7f31d7400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 0x7f31b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.636+0000 7f31d7400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 0x7f31b4075710 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f31c80af000 tx=0x7f31c801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.640+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f31c005f600 con 0x7f31d80b4700 2024-09-21T07:32:35.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31d80c7510 con 0x7f31d80b4700 2024-09-21T07:32:35.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31cf400640 1 -- 172.21.15.64:0/3912613547 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16912 (secure 0 0 0) 0x7f31c0064030 con 0x7f31d80b4700 2024-09-21T07:32:35.818 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:35.818 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":142,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:44.192168+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:31:40.351070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-21T07:31:41.571750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 msgr2=0x7f31b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 0x7f31b4075710 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f31c80af000 tx=0x7f31c801b060 comp rx=0 tx=0).stop 2024-09-21T07:32:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 msgr2=0x7f31d8146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f31c000e710 tx=0x7f31c000ebd0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 shutdown_connections 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f31b4073200 0x7f31b4075710 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d815edb0 0x7f31d80b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31d80b4700 0x7f31d8146220 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 --2- 172.21.15.64:0/3912613547 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31d80709b0 0x7f31d8145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 >> 172.21.15.64:0/3912613547 conn(0x7f31d80ccbe0 msgr2=0x7f31d8158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 shutdown_connections 2024-09-21T07:32:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.816+0000 7f31de400640 1 -- 172.21.15.64:0/3912613547 wait complete. 2024-09-21T07:32:35.841 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:32:35.841 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 -- 172.21.15.64:0/4193719024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c0709b0 msgr2=0x7f9f3c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 --2- 172.21.15.64:0/4193719024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c0b41c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009900 tx=0x7f9f2401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 -- 172.21.15.64:0/4193719024 shutdown_connections 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 --2- 172.21.15.64:0/4193719024 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 0x7f9f3c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 --2- 172.21.15.64:0/4193719024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c0b41c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 -- 172.21.15.64:0/4193719024 >> 172.21.15.64:0/4193719024 conn(0x7f9f3c0ccbe0 msgr2=0x7f9f3c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:35.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 -- 172.21.15.64:0/4193719024 shutdown_connections 2024-09-21T07:32:36.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:35.996+0000 7f9f41600640 1 -- 172.21.15.64:0/4193719024 wait complete. 2024-09-21T07:32:36.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 Processor -- start 2024-09-21T07:32:36.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- start start 2024-09-21T07:32:36.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c1fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 0x7f9f3c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c168c90 con 0x7f9f3c15edb0 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c168b10 con 0x7f9f3c0709b0 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c168e10 con 0x7f9f3c0b4700 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59618/0 (socket says 172.21.15.64:59618) 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 -- 172.21.15.64:0/925423583 learned_addr learned my addr 172.21.15.64:0/925423583 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f33e00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 0x7f9f3c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3aa00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c1fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 -- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 msgr2=0x7f9f3c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 0x7f9f3c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 -- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 msgr2=0x7f9f3c1fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c1fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 -- 172.21.15.64:0/925423583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c0c9580 con 0x7f9f3c15edb0 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3aa00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c1fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f3b400640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400d970 tx=0x7f9f3400de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34017070 con 0x7f9f3c15edb0 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f3400be00 con 0x7f9f3c15edb0 2024-09-21T07:32:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34003be0 con 0x7f9f3c15edb0 2024-09-21T07:32:36.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c1f8e60 con 0x7f9f3c15edb0 2024-09-21T07:32:36.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.000+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c0c7e20 con 0x7f9f3c15edb0 2024-09-21T07:32:36.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c1f8c50 con 0x7f9f3c15edb0 2024-09-21T07:32:36.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f34010460 con 0x7f9f3c15edb0 2024-09-21T07:32:36.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f32a00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 0x7f9f18075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f9f34094790 con 0x7f9f3c15edb0 2024-09-21T07:32:36.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f3aa00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 0x7f9f18075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.004+0000 7f9f3aa00640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 0x7f9f18075740 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0016b0 tx=0x7f9f2c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.008+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9f3405ef30 con 0x7f9f3c15edb0 2024-09-21T07:32:36.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.224+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f3c0b41c0 con 0x7f9f3c15edb0 2024-09-21T07:32:36.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f32a00640 1 -- 172.21.15.64:0/925423583 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7f9f34063960 con 0x7f9f3c15edb0 2024-09-21T07:32:36.233 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:36.235 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 msgr2=0x7f9f18075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 0x7f9f18075740 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0016b0 tx=0x7f9f2c009040 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 msgr2=0x7f9f3c09bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400d970 tx=0x7f9f3400de30 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 shutdown_connections 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f18073230 0x7f9f18075740 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f3c15edb0 0x7f9f3c09bfc0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f3c0b4700 0x7f9f3c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 --2- 172.21.15.64:0/925423583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f3c0709b0 0x7f9f3c1fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 >> 172.21.15.64:0/925423583 conn(0x7f9f3c0ccbe0 msgr2=0x7f9f3c0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:36.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 shutdown_connections 2024-09-21T07:32:36.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.228+0000 7f9f41600640 1 -- 172.21.15.64:0/925423583 wait complete. 2024-09-21T07:32:36.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:36.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 -- 172.21.15.64:0/1142354478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1180b22f0 msgr2=0x7fb1180cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 --2- 172.21.15.64:0/1142354478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1180b22f0 0x7fb1180cbcd0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb110009c80 tx=0x7fb11001cd30 comp rx=0 tx=0).stop 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 -- 172.21.15.64:0/1142354478 shutdown_connections 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 --2- 172.21.15.64:0/1142354478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1180b22f0 0x7fb1180cbcd0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 --2- 172.21.15.64:0/1142354478 >> v2:172.21.15.90:3300/0 conn(0x7fb11815cbd0 0x7fb118070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 -- 172.21.15.64:0/1142354478 >> 172.21.15.64:0/1142354478 conn(0x7fb1180ccbe0 msgr2=0x7fb1180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 -- 172.21.15.64:0/1142354478 shutdown_connections 2024-09-21T07:32:36.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 -- 172.21.15.64:0/1142354478 wait complete. 2024-09-21T07:32:36.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.412+0000 7fb11cc00640 1 Processor -- start 2024-09-21T07:32:36.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- start start 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb118070850 0x7fb11809cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1181f6da0 0x7fb1181f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb11816a290 con 0x7fb11815cbd0 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180b4320 con 0x7fb1181f6da0 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb11816a410 con 0x7fb118070850 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59638/0 (socket says 172.21.15.64:59638) 2024-09-21T07:32:36.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 -- 172.21.15.64:0/4029746765 learned_addr learned my addr 172.21.15.64:0/4029746765 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb115e00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb118070850 0x7fb11809cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb116800640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1181f6da0 0x7fb1181f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 -- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb118070850 msgr2=0x7fb11809cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb118070850 0x7fb11809cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 -- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1181f6da0 msgr2=0x7fb1181f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1181f6da0 0x7fb1181f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 -- 172.21.15.64:0/4029746765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb118051060 con 0x7fb11815cbd0 2024-09-21T07:32:36.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10d400640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c420 tx=0x7fb10000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100017070 con 0x7fb11815cbd0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1000053c0 con 0x7fb11815cbd0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11815bdd0 con 0x7fb11815cbd0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100003860 con 0x7fb11815cbd0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.416+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11809bdc0 con 0x7fb11815cbd0 2024-09-21T07:32:36.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1180cbcd0 con 0x7fb11815cbd0 2024-09-21T07:32:36.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb10001a070 con 0x7fb11815cbd0 2024-09-21T07:32:36.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb10ea00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 0x7fb0f4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fb100093750 con 0x7fb11815cbd0 2024-09-21T07:32:36.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb115e00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 0x7fb0f4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.420+0000 7fb115e00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 0x7fb0f4075740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb108004630 tx=0x7fb10800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.424+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb10005df00 con 0x7fb11815cbd0 2024-09-21T07:32:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.636+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb11809c820 con 0x7fb11815cbd0 2024-09-21T07:32:36.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.636+0000 7fb10ea00640 1 -- 172.21.15.64:0/4029746765 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5221 (secure 0 0 0) 0x7fb100062930 con 0x7fb11815cbd0 2024-09-21T07:32:36.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:36.641 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":103,"btime":"2024-09-21T07:31:46:208309+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:31:42.604148+0000","modified":"2024-09-21T07:31:45.620499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8574":{"gid":8574,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/264252124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":264252124},{"type":"v1","addr":"172.21.15.64:6835","nonce":264252124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8574,"qdb_cluster":[8574]},"id":9}]} 2024-09-21T07:32:36.641 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 103 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 msgr2=0x7fb0f4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 0x7fb0f4075740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb108004630 tx=0x7fb10800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 msgr2=0x7fb11815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c420 tx=0x7fb10000c8e0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 shutdown_connections 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0f4073230 0x7fb0f4075740 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1181f6da0 0x7fb1181f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb11815cbd0 0x7fb11815b890 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 --2- 172.21.15.64:0/4029746765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb118070850 0x7fb11809cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 >> 172.21.15.64:0/4029746765 conn(0x7fb1180ccbe0 msgr2=0x7fb1180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:36.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 shutdown_connections 2024-09-21T07:32:36.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.640+0000 7fb11cc00640 1 -- 172.21.15.64:0/4029746765 wait complete. 2024-09-21T07:32:36.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 -- 172.21.15.64:0/2660291852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 msgr2=0x7fac4c15f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 --2- 172.21.15.64:0/2660291852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c15f800 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009840 tx=0x7fac3c01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 -- 172.21.15.64:0/2660291852 shutdown_connections 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 --2- 172.21.15.64:0/2660291852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162450 0x7fac4c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 --2- 172.21.15.64:0/2660291852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c15f800 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 -- 172.21.15.64:0/2660291852 >> 172.21.15.64:0/2660291852 conn(0x7fac4c06d1c0 msgr2=0x7fac4c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 -- 172.21.15.64:0/2660291852 shutdown_connections 2024-09-21T07:32:36.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.816+0000 7fac52600640 1 -- 172.21.15.64:0/2660291852 wait complete. 2024-09-21T07:32:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 Processor -- start 2024-09-21T07:32:36.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 -- start start 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4c162450 0x7fac4c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 0x7fac4c1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c16c5b0 con 0x7fac4c06e8d0 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c16c430 con 0x7fac4c162450 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac52600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c16c730 con 0x7fac4c162860 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac4b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59662/0 (socket says 172.21.15.64:59662) 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac4b400640 1 -- 172.21.15.64:0/3643132318 learned_addr learned my addr 172.21.15.64:0/3643132318 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac42a00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4c162450 0x7fac4c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.820+0000 7fac4be00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 0x7fac4c1458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 -- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 msgr2=0x7fac4c1458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 0x7fac4c1458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 -- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4c162450 msgr2=0x7fac4c0b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4c162450 0x7fac4c0b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 -- 172.21.15.64:0/3643132318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c0b8270 con 0x7fac4c06e8d0 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4be00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 0x7fac4c1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:36.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac4b400640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009790 tx=0x7fac3c0a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0b2040 con 0x7fac4c06e8d0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac3c0043b0 con 0x7fac4c06e8d0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c003820 con 0x7fac4c06e8d0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c157aa0 con 0x7fac4c06e8d0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4c0b7f90 con 0x7fac4c06e8d0 2024-09-21T07:32:36.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c15f800 con 0x7fac4c06e8d0 2024-09-21T07:32:36.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.824+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac3c0bd060 con 0x7fac4c06e8d0 2024-09-21T07:32:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.828+0000 7fac43e00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 0x7fac28075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.828+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7fac3c12dbb0 con 0x7fac4c06e8d0 2024-09-21T07:32:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.828+0000 7fac42a00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 0x7fac28075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:36.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.828+0000 7fac42a00640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 0x7fac28075740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0cf220 tx=0x7fac34005ec0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:36.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:36.828+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fac3c016410 con 0x7fac4c06e8d0 2024-09-21T07:32:37.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac4c15be90 con 0x7fac4c06e8d0 2024-09-21T07:32:37.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac43e00640 1 -- 172.21.15.64:0/3643132318 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16912 (secure 0 0 0) 0x7fac3c0f8b40 con 0x7fac4c06e8d0 2024-09-21T07:32:37.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:37.010 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":142,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:31:44.192168+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:31:40.351070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-21T07:31:41.571750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 msgr2=0x7fac28075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 0x7fac28075740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0cf220 tx=0x7fac34005ec0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 msgr2=0x7fac4c0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009790 tx=0x7fac3c0a55c0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 shutdown_connections 2024-09-21T07:32:37.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac28073230 0x7fac28075740 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac4c162860 0x7fac4c1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4c162450 0x7fac4c0b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 --2- 172.21.15.64:0/3643132318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac4c06e8d0 0x7fac4c0b53d0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 >> 172.21.15.64:0/3643132318 conn(0x7fac4c06d1c0 msgr2=0x7fac4c161c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 shutdown_connections 2024-09-21T07:32:37.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.008+0000 7fac52600640 1 -- 172.21.15.64:0/3643132318 wait complete. 2024-09-21T07:32:37.033 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:32:37.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 -- 172.21.15.64:0/2175705219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d0072e20 msgr2=0x7f87d00af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 --2- 172.21.15.64:0/2175705219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d0072e20 0x7f87d00af610 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f87d009db40 tx=0x7f87c001c810 comp rx=0 tx=0).stop 2024-09-21T07:32:37.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 -- 172.21.15.64:0/2175705219 shutdown_connections 2024-09-21T07:32:37.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 --2- 172.21.15.64:0/2175705219 >> v2:172.21.15.90:3300/0 conn(0x7f87d006ee80 0x7f87d006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 --2- 172.21.15.64:0/2175705219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d0072e20 0x7f87d00af610 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 -- 172.21.15.64:0/2175705219 >> 172.21.15.64:0/2175705219 conn(0x7f87d006d450 msgr2=0x7f87d00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:37.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 -- 172.21.15.64:0/2175705219 shutdown_connections 2024-09-21T07:32:37.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.188+0000 7f87d7000640 1 -- 172.21.15.64:0/2175705219 wait complete. 2024-09-21T07:32:37.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 Processor -- start 2024-09-21T07:32:37.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 -- start start 2024-09-21T07:32:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 0x7f87d00b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87d00cc980 0x7f87d00b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01681c0 con 0x7f87d006ee80 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0168040 con 0x7f87d0072e20 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87d7000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f87d0168340 con 0x7f87d00cc980 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59686/0 (socket says 172.21.15.64:59686) 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 -- 172.21.15.64:0/1486599400 learned_addr learned my addr 172.21.15.64:0/1486599400 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 -- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87d00cc980 msgr2=0x7f87d00b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87d00cc980 0x7f87d00b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87cfe00640 1 -- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 msgr2=0x7f87d00b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.192+0000 7f87c7e00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 0x7f87d00b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87cfe00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 0x7f87d00b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87cfe00640 1 -- 172.21.15.64:0/1486599400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00ca4d0 con 0x7f87d006ee80 2024-09-21T07:32:37.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87c7e00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 0x7f87d00b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:37.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87cfe00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f87c0019420 tx=0x7f87c0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:37.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00b2040 con 0x7f87d006ee80 2024-09-21T07:32:37.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87c0004330 con 0x7f87d006ee80 2024-09-21T07:32:37.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d0155da0 con 0x7f87d006ee80 2024-09-21T07:32:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0005280 con 0x7f87d006ee80 2024-09-21T07:32:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d0156320 con 0x7f87d006ee80 2024-09-21T07:32:37.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d006f290 con 0x7f87d006ee80 2024-09-21T07:32:37.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.196+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f87c00be060 con 0x7f87d006ee80 2024-09-21T07:32:37.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.200+0000 7f87ccc00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 0x7f87ac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.200+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f87c012df00 con 0x7f87d006ee80 2024-09-21T07:32:37.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.200+0000 7f87c7e00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 0x7f87ac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.200+0000 7f87c7e00640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 0x7f87ac075740 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87d00cec70 tx=0x7f87b8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:37.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.204+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f87c0016490 con 0x7f87d006ee80 2024-09-21T07:32:37.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.416+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87d00cef40 con 0x7f87d006ee80 2024-09-21T07:32:37.419 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:32:37.416+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:32:37.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87ccc00640 1 -- 172.21.15.64:0/1486599400 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v104) ==== 161+0+0 (secure 0 0 0) 0x7f87c00f8d70 con 0x7f87d006ee80 2024-09-21T07:32:37.421 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 msgr2=0x7f87ac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 0x7f87ac075740 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87d00cec70 tx=0x7f87b8009040 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 msgr2=0x7f87d0157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f87c0019420 tx=0x7f87c0005e10 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 shutdown_connections 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f87ac073230 0x7f87ac075740 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87d00cc980 0x7f87d00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d0072e20 0x7f87d00b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 --2- 172.21.15.64:0/1486599400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87d006ee80 0x7f87d0157e60 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 >> 172.21.15.64:0/1486599400 conn(0x7f87d006d450 msgr2=0x7f87d00acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:37.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.420+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 shutdown_connections 2024-09-21T07:32:37.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.424+0000 7f87d7000640 1 -- 172.21.15.64:0/1486599400 wait complete. 2024-09-21T07:32:37.448 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:32:37.566 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:32:37.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 -- 172.21.15.64:0/535826336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feafc003ad0 msgr2=0x7feafc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 --2- 172.21.15.64:0/535826336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feafc003ad0 0x7feafc003f40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c260 tx=0x7feb0801ced0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 -- 172.21.15.64:0/535826336 shutdown_connections 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 --2- 172.21.15.64:0/535826336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feafc003ad0 0x7feafc003f40 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 -- 172.21.15.64:0/535826336 >> 172.21.15.64:0/535826336 conn(0x7feb1406d1c0 msgr2=0x7feb1406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 -- 172.21.15.64:0/535826336 shutdown_connections 2024-09-21T07:32:37.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.612+0000 7feb1c400640 1 -- 172.21.15.64:0/535826336 wait complete. 2024-09-21T07:32:37.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 Processor -- start 2024-09-21T07:32:37.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- start start 2024-09-21T07:32:37.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feafc003ad0 0x7feb140ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 0x7feb1415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb14071de0 con 0x7feb1415fa00 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb14071c60 con 0x7feafc003ad0 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feb14071f60 con 0x7feb1415e590 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59714/0 (socket says 172.21.15.64:59714) 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 -- 172.21.15.64:0/1021853301 learned_addr learned my addr 172.21.15.64:0/1021853301 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19a00640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feafc003ad0 0x7feb140ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1a400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 0x7feb1415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 -- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 msgr2=0x7feb1415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 0x7feb1415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 -- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feafc003ad0 msgr2=0x7feb140ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feafc003ad0 0x7feb140ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 -- 172.21.15.64:0/1021853301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb14159670 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1a400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 0x7feb1415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb19000640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7feb000066c0 tx=0x7feb00001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00011640 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb00016020 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1415eee0 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00011a60 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.616+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb140b6250 con 0x7feb1415fa00 2024-09-21T07:32:37.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb140c6200 con 0x7feb1415fa00 2024-09-21T07:32:37.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feb00011c00 con 0x7feb1415fa00 2024-09-21T07:32:37.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb11600640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 0x7feaf4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:37.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6187+0+0 (secure 0 0 0) 0x7feb00094fc0 con 0x7feb1415fa00 2024-09-21T07:32:37.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb19a00640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 0x7feaf4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:37.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.620+0000 7feb19a00640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 0x7feaf4075740 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7feb080ab000 tx=0x7feb08019d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:37.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.624+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7feb00020020 con 0x7feb1415fa00 2024-09-21T07:32:37.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:37.836+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb140c7510 con 0x7feb1415fa00 2024-09-21T07:32:38.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.424+0000 7feb11600640 1 -- 172.21.15.64:0/1021853301 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v105) ==== 104+0+0 (secure 0 0 0) 0x7feb1415eee0 con 0x7feb1415fa00 2024-09-21T07:32:38.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 msgr2=0x7feaf4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 0x7feaf4075740 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7feb080ab000 tx=0x7feb08019d10 comp rx=0 tx=0).stop 2024-09-21T07:32:38.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 msgr2=0x7feb1414f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7feb000066c0 tx=0x7feb00001640 comp rx=0 tx=0).stop 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 shutdown_connections 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feaf4073230 0x7feaf4075740 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb1415e590 0x7feb1415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb1415fa00 0x7feb1414f720 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 --2- 172.21.15.64:0/1021853301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feafc003ad0 0x7feb140ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 >> 172.21.15.64:0/1021853301 conn(0x7feb1406d1c0 msgr2=0x7feb1415b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 shutdown_connections 2024-09-21T07:32:38.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.428+0000 7feb1c400640 1 -- 172.21.15.64:0/1021853301 wait complete. 2024-09-21T07:32:38.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.612+0000 7f54b9e00640 1 -- 172.21.15.64:0/3112304039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b415f660 msgr2=0x7f54b406f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.612+0000 7f54b9e00640 1 --2- 172.21.15.64:0/3112304039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b415f660 0x7f54b406f500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54a400a980 tx=0x7f54a401da20 comp rx=0 tx=0).stop 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 -- 172.21.15.64:0/3112304039 shutdown_connections 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 --2- 172.21.15.64:0/3112304039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b415f660 0x7f54b406f500 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 -- 172.21.15.64:0/3112304039 >> 172.21.15.64:0/3112304039 conn(0x7f54b40d0170 msgr2=0x7f54b40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:38.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 -- 172.21.15.64:0/3112304039 shutdown_connections 2024-09-21T07:32:38.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 -- 172.21.15.64:0/3112304039 wait complete. 2024-09-21T07:32:38.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 Processor -- start 2024-09-21T07:32:38.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 -- start start 2024-09-21T07:32:38.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.616+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b406fa40 0x7f54b40b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54b415f660 0x7f54b4158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4169570 con 0x7f54b4074580 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41693f0 con 0x7f54b415f660 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f54b41696f0 con 0x7f54b406fa40 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59724/0 (socket says 172.21.15.64:59724) 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 -- 172.21.15.64:0/4060209307 learned_addr learned my addr 172.21.15.64:0/4060209307 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b2a00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b406fa40 0x7f54b40b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b3400640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54b415f660 0x7f54b4158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 -- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b406fa40 msgr2=0x7f54b40b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b406fa40 0x7f54b40b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 -- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54b415f660 msgr2=0x7f54b4158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54b415f660 0x7f54b4158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 -- 172.21.15.64:0/4060209307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b41fd250 con 0x7f54b4074580 2024-09-21T07:32:38.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54aa000640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c400 tx=0x7f549c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:38.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c017070 con 0x7f54b4074580 2024-09-21T07:32:38.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f549c0053e0 con 0x7f54b4074580 2024-09-21T07:32:38.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c003860 con 0x7f54b4074580 2024-09-21T07:32:38.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b41fd530 con 0x7f54b4074580 2024-09-21T07:32:38.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b41fdaf0 con 0x7f54b4074580 2024-09-21T07:32:38.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.620+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b406f500 con 0x7f54b4074580 2024-09-21T07:32:38.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.624+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f549c01a070 con 0x7f54b4074580 2024-09-21T07:32:38.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.624+0000 7f54abe00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 0x7f5490075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.624+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6187+0+0 (secure 0 0 0) 0x7f549c093e20 con 0x7f54b4074580 2024-09-21T07:32:38.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.624+0000 7f54b2a00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 0x7f5490075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.624+0000 7f54b2a00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 0x7f5490075740 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b0000 tx=0x7f54a401c260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:38.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.628+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f54b406fe50 con 0x7f54b4074580 2024-09-21T07:32:38.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:38.808+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f54b41fcfe0 con 0x7f54b4074580 2024-09-21T07:32:39.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.428+0000 7f54abe00640 1 -- 172.21.15.64:0/4060209307 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) ==== 181+0+0 (secure 0 0 0) 0x7f549c05e710 con 0x7f54b4074580 2024-09-21T07:32:39.430 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:32:39.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 msgr2=0x7f5490075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:39.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 0x7f5490075740 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b0000 tx=0x7f54a401c260 comp rx=0 tx=0).stop 2024-09-21T07:32:39.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 msgr2=0x7f54b4158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:39.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c400 tx=0x7f549c00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 shutdown_connections 2024-09-21T07:32:39.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5490073230 0x7f5490075740 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54b415f660 0x7f54b4158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54b4074580 0x7f54b4158300 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 --2- 172.21.15.64:0/4060209307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54b406fa40 0x7f54b40b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 >> 172.21.15.64:0/4060209307 conn(0x7f54b40d0170 msgr2=0x7f54b41667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 shutdown_connections 2024-09-21T07:32:39.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.432+0000 7f54b9e00640 1 -- 172.21.15.64:0/4060209307 wait complete. 2024-09-21T07:32:39.460 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 -- 172.21.15.64:0/3272652690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f04073d80 msgr2=0x7f1f040ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 --2- 172.21.15.64:0/3272652690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f04073d80 0x7f1f040ce650 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1f040c7b00 tx=0x7f1efc01c7d0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 -- 172.21.15.64:0/3272652690 shutdown_connections 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 --2- 172.21.15.64:0/3272652690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f04073d80 0x7f1f040ce650 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 --2- 172.21.15.64:0/3272652690 >> v2:172.21.15.90:3300/0 conn(0x7f1f040b6570 0x7f1f04070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.620+0000 7f1f08c00640 1 -- 172.21.15.64:0/3272652690 >> 172.21.15.64:0/3272652690 conn(0x7f1f040d0c50 msgr2=0x7f1f040d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- 172.21.15.64:0/3272652690 shutdown_connections 2024-09-21T07:32:39.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- 172.21.15.64:0/3272652690 wait complete. 2024-09-21T07:32:39.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 Processor -- start 2024-09-21T07:32:39.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- start start 2024-09-21T07:32:39.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 0x7f1f0414b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:39.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:39.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 0x7f1f040b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:39.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04168d80 con 0x7f1f0415b9c0 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04168c00 con 0x7f1f040b6570 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.624+0000 7f1f08c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1f04168f00 con 0x7f1f041f7760 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59748/0 (socket says 172.21.15.64:59748) 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 -- 172.21.15.64:0/1511482693 learned_addr learned my addr 172.21.15.64:0/1511482693 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f02800640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 0x7f1f040b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f01e00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 0x7f1f0414b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 -- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 msgr2=0x7f1f040b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 0x7f1f040b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 -- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 msgr2=0x7f1f0414b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 0x7f1f0414b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 -- 172.21.15.64:0/1511482693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f040b0b90 con 0x7f1f0415b9c0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f01e00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 0x7f1f0414b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f02800640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 0x7f1f040b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1ef9400640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00cbf0 tx=0x7f1eec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec016020 con 0x7f1f0415b9c0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eec00ab40 con 0x7f1f0415b9c0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0414bd50 con 0x7f1f0415b9c0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec012420 con 0x7f1f0415b9c0 2024-09-21T07:32:39.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f040b08b0 con 0x7f1f0415b9c0 2024-09-21T07:32:39.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f040ce630 con 0x7f1f0415b9c0 2024-09-21T07:32:39.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.628+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1eec019020 con 0x7f1f0415b9c0 2024-09-21T07:32:39.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.632+0000 7f1efaa00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 0x7f1ee0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:39.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.632+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5749+0+0 (secure 0 0 0) 0x7f1eec094510 con 0x7f1f0415b9c0 2024-09-21T07:32:39.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.632+0000 7f1f01e00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 0x7f1ee0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:39.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.632+0000 7f1f01e00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 0x7f1ee0075740 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009ac0 tx=0x7f1ef40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:39.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.636+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1eec020020 con 0x7f1f0415b9c0 2024-09-21T07:32:39.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:39.808+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f041f7320 con 0x7f1f0415b9c0 2024-09-21T07:32:40.156 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:40.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:40.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1efaa00640 1 -- 172.21.15.64:0/1511482693 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) ==== 169+0+0 (secure 0 0 0) 0x7f1eec05f500 con 0x7f1f0415b9c0 2024-09-21T07:32:40.437 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:32:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 msgr2=0x7f1ee0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 0x7f1ee0075740 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009ac0 tx=0x7f1ef40091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 msgr2=0x7f1f040b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00cbf0 tx=0x7f1eec00cc20 comp rx=0 tx=0).stop 2024-09-21T07:32:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 shutdown_connections 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1ee0073230 0x7f1ee0075740 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f041f7760 0x7f1f040b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f0415b9c0 0x7f1f040b2c00 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 --2- 172.21.15.64:0/1511482693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f040b6570 0x7f1f0414b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 >> 172.21.15.64:0/1511482693 conn(0x7f1f040d0c50 msgr2=0x7f1f04158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 shutdown_connections 2024-09-21T07:32:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.436+0000 7f1f08c00640 1 -- 172.21.15.64:0/1511482693 wait complete. 2024-09-21T07:32:40.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 -- 172.21.15.64:0/906435652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 msgr2=0x7fcad00b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 --2- 172.21.15.64:0/906435652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00b3550 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009840 tx=0x7fcabc01c820 comp rx=0 tx=0).stop 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 -- 172.21.15.64:0/906435652 shutdown_connections 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 --2- 172.21.15.64:0/906435652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00b3550 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 --2- 172.21.15.64:0/906435652 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 0x7fcad015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 -- 172.21.15.64:0/906435652 >> 172.21.15.64:0/906435652 conn(0x7fcad006d450 msgr2=0x7fcad00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 -- 172.21.15.64:0/906435652 shutdown_connections 2024-09-21T07:32:40.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.640+0000 7fcad6e00640 1 -- 172.21.15.64:0/906435652 wait complete. 2024-09-21T07:32:40.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 Processor -- start 2024-09-21T07:32:40.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 -- start start 2024-09-21T07:32:40.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:40.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 0x7fcad00b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:40.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad014c950 0x7fcad0073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:40.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0169020 con 0x7fcad00b3140 2024-09-21T07:32:40.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0168ea0 con 0x7fcad014c950 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad6e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcad01691a0 con 0x7fcad00cc960 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59760/0 (socket says 172.21.15.64:59760) 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 -- 172.21.15.64:0/692502911 learned_addr learned my addr 172.21.15.64:0/692502911 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacf400640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 0x7fcad00b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcad4e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad014c950 0x7fcad0073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 -- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 msgr2=0x7fcad00b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 0x7fcad00b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 -- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad014c950 msgr2=0x7fcad0073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad014c950 0x7fcad0073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.644+0000 7fcacfe00640 1 -- 172.21.15.64:0/692502911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad0155d50 con 0x7fcad00b3140 2024-09-21T07:32:40.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcacfe00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcac000d770 tx=0x7fcac000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0009c30 con 0x7fcad00b3140 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcac000de80 con 0x7fcad00b3140 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0004280 con 0x7fcad00b3140 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad0156030 con 0x7fcad00b3140 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad0072f50 con 0x7fcad00b3140 2024-09-21T07:32:40.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad015ee70 con 0x7fcad00b3140 2024-09-21T07:32:40.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcac0003600 con 0x7fcad00b3140 2024-09-21T07:32:40.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 0x7fcab0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:40.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.648+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7fcac0094580 con 0x7fcad00b3140 2024-09-21T07:32:40.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.652+0000 7fcacf400640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 0x7fcab0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:40.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.652+0000 7fcacf400640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 0x7fcab0075740 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0af000 tx=0x7fcabc01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:40.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.656+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcac005f0b0 con 0x7fcad00b3140 2024-09-21T07:32:40.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.832+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fcad014cf10 con 0x7fcad00b3140 2024-09-21T07:32:40.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.836+0000 7fcac7e00640 1 -- 172.21.15.64:0/692502911 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v55) ==== 71+0+0 (secure 0 0 0) 0x7fcac0063ae0 con 0x7fcad00b3140 2024-09-21T07:32:40.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 msgr2=0x7fcab0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 0x7fcab0075740 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0af000 tx=0x7fcabc01b060 comp rx=0 tx=0).stop 2024-09-21T07:32:40.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 msgr2=0x7fcad00afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:40.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcac000d770 tx=0x7fcac000dc30 comp rx=0 tx=0).stop 2024-09-21T07:32:40.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 shutdown_connections 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcab0073230 0x7fcab0075740 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad014c950 0x7fcad0073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcad00cc960 0x7fcad00b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 --2- 172.21.15.64:0/692502911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcad00b3140 0x7fcad00afdd0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 >> 172.21.15.64:0/692502911 conn(0x7fcad006d450 msgr2=0x7fcad01598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 shutdown_connections 2024-09-21T07:32:40.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:40.840+0000 7fcad6e00640 1 -- 172.21.15.64:0/692502911 wait complete. 2024-09-21T07:32:40.863 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-21T07:32:41.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 -- 172.21.15.64:0/1927622015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea380b1670 msgr2=0x7fea380d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 --2- 172.21.15.64:0/1927622015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea380b1670 0x7fea380d0400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea30009900 tx=0x7fea3001c790 comp rx=0 tx=0).stop 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 -- 172.21.15.64:0/1927622015 shutdown_connections 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 --2- 172.21.15.64:0/1927622015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea380b1670 0x7fea380d0400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 --2- 172.21.15.64:0/1927622015 >> v2:172.21.15.90:3300/0 conn(0x7fea380b4400 0x7fea380c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 -- 172.21.15.64:0/1927622015 >> 172.21.15.64:0/1927622015 conn(0x7fea3806d480 msgr2=0x7fea380d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 -- 172.21.15.64:0/1927622015 shutdown_connections 2024-09-21T07:32:41.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.020+0000 7fea3de00640 1 -- 172.21.15.64:0/1927622015 wait complete. 2024-09-21T07:32:41.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 Processor -- start 2024-09-21T07:32:41.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- start start 2024-09-21T07:32:41.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea3815c8a0 0x7fea3814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea38151760 0x7fea3815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea38169d20 con 0x7fea380b1670 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea38169ba0 con 0x7fea38151760 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea38169ea0 con 0x7fea3815c8a0 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59776/0 (socket says 172.21.15.64:59776) 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 -- 172.21.15.64:0/912845735 learned_addr learned my addr 172.21.15.64:0/912845735 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea37400640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea38151760 0x7fea3815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea2e000640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea3815c8a0 0x7fea3814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 -- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea3815c8a0 msgr2=0x7fea3814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea3815c8a0 0x7fea3814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 -- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea38151760 msgr2=0x7fea3815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea38151760 0x7fea3815d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 -- 172.21.15.64:0/912845735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea38158bc0 con 0x7fea380b1670 2024-09-21T07:32:41.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea36a00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c730 tx=0x7fea2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28003b80 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea38159c00 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea28003d40 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2800aab0 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.024+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea38159120 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.028+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea380d0400 con 0x7fea380b1670 2024-09-21T07:32:41.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.028+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea2800ac50 con 0x7fea380b1670 2024-09-21T07:32:41.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.028+0000 7fea2fe00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 0x7fea14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.028+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7fea28093eb0 con 0x7fea380b1670 2024-09-21T07:32:41.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.028+0000 7fea2e000640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 0x7fea14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.032+0000 7fea2e000640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 0x7fea14075710 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fea380c5980 tx=0x7fea200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:41.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.032+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fea38158bc0 con 0x7fea380b1670 2024-09-21T07:32:41.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.272+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fea380b4430 con 0x7fea380b1670 2024-09-21T07:32:41.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.436+0000 7fea2fe00640 1 -- 172.21.15.64:0/912845735 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v477) ==== 155+0+0 (secure 0 0 0) 0x7fea2805f050 con 0x7fea380b1670 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 msgr2=0x7fea14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 0x7fea14075710 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fea380c5980 tx=0x7fea200091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 msgr2=0x7fea3815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c730 tx=0x7fea2800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 shutdown_connections 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea14073200 0x7fea14075710 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea38151760 0x7fea3815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea3815c8a0 0x7fea3814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 --2- 172.21.15.64:0/912845735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea380b1670 0x7fea3815f500 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 >> 172.21.15.64:0/912845735 conn(0x7fea3806d480 msgr2=0x7fea38068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:41.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 shutdown_connections 2024-09-21T07:32:41.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.440+0000 7fea3de00640 1 -- 172.21.15.64:0/912845735 wait complete. 2024-09-21T07:32:41.468 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-21T07:32:41.469 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-21T07:32:41.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- 172.21.15.64:0/1414468311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 msgr2=0x7f41bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 --2- 172.21.15.64:0/1414468311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41bc004810 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009b60 tx=0x7f41c001d2b0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41d7e00640 1 -- 172.21.15.64:0/1414468311 reap_dead start 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- 172.21.15.64:0/1414468311 shutdown_connections 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- 172.21.15.64:0/1414468311 >> 172.21.15.64:0/1414468311 conn(0x7f41d80ccbe0 msgr2=0x7f41d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:41.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- 172.21.15.64:0/1414468311 shutdown_connections 2024-09-21T07:32:41.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- 172.21.15.64:0/1414468311 wait complete. 2024-09-21T07:32:41.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 Processor -- start 2024-09-21T07:32:41.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.640+0000 7f41de600640 1 -- start start 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41d809bbc0 0x7f41d80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41d8157010 0x7f41d8157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80b4000 con 0x7f41bc004050 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80b3e80 con 0x7f41d809bbc0 2024-09-21T07:32:41.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f41d80b4180 con 0x7f41d8157010 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59800/0 (socket says 172.21.15.64:59800) 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 -- 172.21.15.64:0/2816996562 learned_addr learned my addr 172.21.15.64:0/2816996562 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41cea00640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41d809bbc0 0x7f41d80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7e00640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41d8157010 0x7f41d8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 -- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41d8157010 msgr2=0x7f41d8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41d8157010 0x7f41d8157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 -- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41d809bbc0 msgr2=0x7f41d80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41d809bbc0 0x7f41d80c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 -- 172.21.15.64:0/2816996562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80c4c50 con 0x7f41bc004050 2024-09-21T07:32:41.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41d7400640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001230 tx=0x7f41c80127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:41.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8010950 con 0x7f41bc004050 2024-09-21T07:32:41.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41c8010af0 con 0x7f41bc004050 2024-09-21T07:32:41.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8013450 con 0x7f41bc004050 2024-09-21T07:32:41.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d8157960 con 0x7f41bc004050 2024-09-21T07:32:41.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d809b0e0 con 0x7f41bc004050 2024-09-21T07:32:41.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.644+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d80b3530 con 0x7f41bc004050 2024-09-21T07:32:41.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.648+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f41c80135f0 con 0x7f41bc004050 2024-09-21T07:32:41.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.648+0000 7f41cfe00640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 0x7f41b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:41.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.648+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7f41c8097f00 con 0x7f41bc004050 2024-09-21T07:32:41.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.648+0000 7f41cea00640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 0x7f41b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:41.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.648+0000 7f41cea00640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 0x7f41b4075710 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f41c00ae000 tx=0x7f41c001a050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:41.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.652+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f41d8157960 con 0x7f41bc004050 2024-09-21T07:32:41.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.828+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41d80b23a0 con 0x7f41bc004050 2024-09-21T07:32:41.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41cfe00640 1 -- 172.21.15.64:0/2816996562 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+13265 (secure 0 0 0) 0x7f41d80c4c50 con 0x7f41bc004050 2024-09-21T07:32:41.833 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:41.833 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":145,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:32:40.433469+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/264252124":"2024-09-22T07:32:37.422401+0000","172.21.15.64:6834/264252124":"2024-09-22T07:32:37.422401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 msgr2=0x7f41b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 0x7f41b4075710 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f41c00ae000 tx=0x7f41c001a050 comp rx=0 tx=0).stop 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 msgr2=0x7f41d80c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001230 tx=0x7f41c80127b0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 shutdown_connections 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f41b4073200 0x7f41b4075710 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41d8157010 0x7f41d8157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41d809bbc0 0x7f41d80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 --2- 172.21.15.64:0/2816996562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41bc004050 0x7f41d80c4710 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:41.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 >> 172.21.15.64:0/2816996562 conn(0x7f41d80ccbe0 msgr2=0x7f41d80b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:41.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 shutdown_connections 2024-09-21T07:32:41.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:41.832+0000 7f41de600640 1 -- 172.21.15.64:0/2816996562 wait complete. 2024-09-21T07:32:41.854 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:32:41.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 -- 172.21.15.64:0/2175118804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b77d0 msgr2=0x7f4c040d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 --2- 172.21.15.64:0/2175118804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b77d0 0x7f4c040d08d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009840 tx=0x7f4bf401c7c0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 -- 172.21.15.64:0/2175118804 shutdown_connections 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 --2- 172.21.15.64:0/2175118804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b1a40 0x7f4c040ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 --2- 172.21.15.64:0/2175118804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b77d0 0x7f4c040d08d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 -- 172.21.15.64:0/2175118804 >> 172.21.15.64:0/2175118804 conn(0x7f4c0408bf80 msgr2=0x7f4c040d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 -- 172.21.15.64:0/2175118804 shutdown_connections 2024-09-21T07:32:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.012+0000 7f4c09000640 1 -- 172.21.15.64:0/2175118804 wait complete. 2024-09-21T07:32:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 Processor -- start 2024-09-21T07:32:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 -- start start 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 0x7f4c0415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b77d0 0x7f4c040b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04169f60 con 0x7f4c040cf000 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04169de0 con 0x7f4c040b1a40 2024-09-21T07:32:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c09000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0416a0e0 con 0x7f4c040b77d0 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.016+0000 7f4c03400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 0x7f4c0415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59816/0 (socket says 172.21.15.64:59816) 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03e00640 1 -- 172.21.15.64:0/2952393799 learned_addr learned my addr 172.21.15.64:0/2952393799 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4bfaa00640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b77d0 0x7f4c040b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 -- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b77d0 msgr2=0x7f4c040b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b77d0 0x7f4c040b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 -- 172.21.15.64:0/2952393799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 msgr2=0x7f4c04071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 -- 172.21.15.64:0/2952393799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0415baf0 con 0x7f4c040b1a40 2024-09-21T07:32:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03e00640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c03400640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 0x7f4c0415b1c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4c0406ad50 tx=0x7f4bf4005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40b2040 con 0x7f4c040b1a40 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bf4004320 con 0x7f4c040b1a40 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40044f0 con 0x7f4c040b1a40 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c041f90a0 con 0x7f4c040b1a40 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041f9660 con 0x7f4c040b1a40 2024-09-21T07:32:42.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c040ceac0 con 0x7f4c040b1a40 2024-09-21T07:32:42.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.020+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4bf40052d0 con 0x7f4c040b1a40 2024-09-21T07:32:42.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.024+0000 7f4bfbe00640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 0x7f4be0075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.024+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7f4bf412dd00 con 0x7f4c040b1a40 2024-09-21T07:32:42.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.024+0000 7f4bfaa00640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 0x7f4be0075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.024+0000 7f4bfaa00640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 0x7f4be0075760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4c04159850 tx=0x7f4bec0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.028+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4bf40bd060 con 0x7f4c040b1a40 2024-09-21T07:32:42.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.204+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4c040b4fb0 con 0x7f4c040b1a40 2024-09-21T07:32:42.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.204+0000 7f4bfbe00640 1 -- 172.21.15.64:0/2952393799 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) ==== 93+0+10 (secure 0 0 0) 0x7f4c040cf410 con 0x7f4c040b1a40 2024-09-21T07:32:42.208 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:32:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 msgr2=0x7f4be0075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 0x7f4be0075760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4c04159850 tx=0x7f4bec0091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 msgr2=0x7f4c0415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 0x7f4c0415b1c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4c0406ad50 tx=0x7f4bf4005d20 comp rx=0 tx=0).stop 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 shutdown_connections 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4be0073250 0x7f4be0075760 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c040cf000 0x7f4c04071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4c040b77d0 0x7f4c040b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 --2- 172.21.15.64:0/2952393799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c040b1a40 0x7f4c0415b1c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 >> 172.21.15.64:0/2952393799 conn(0x7f4c0408bf80 msgr2=0x7f4c0415e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 shutdown_connections 2024-09-21T07:32:42.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.208+0000 7f4c09000640 1 -- 172.21.15.64:0/2952393799 wait complete. 2024-09-21T07:32:42.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-21T07:32:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- 172.21.15.64:0/1621142961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f00cd790 msgr2=0x7f18f015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 --2- 172.21.15.64:0/1621142961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f00cd790 0x7f18f015b320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009840 tx=0x7f18e001c6d0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- 172.21.15.64:0/1621142961 shutdown_connections 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 --2- 172.21.15.64:0/1621142961 >> v2:172.21.15.90:3300/0 conn(0x7f18f015f100 0x7f18f015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 --2- 172.21.15.64:0/1621142961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f00cd790 0x7f18f015b320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- 172.21.15.64:0/1621142961 >> 172.21.15.64:0/1621142961 conn(0x7f18f00b2ca0 msgr2=0x7f18f00b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- 172.21.15.64:0/1621142961 shutdown_connections 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- 172.21.15.64:0/1621142961 wait complete. 2024-09-21T07:32:42.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 Processor -- start 2024-09-21T07:32:42.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.388+0000 7f18f7800640 1 -- start start 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f006fba0 0x7f18f01f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f015f100 0x7f18f0154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f18f00b6a60 con 0x7f18f00cd790 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18f00b68e0 con 0x7f18f006fba0 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f18f00b6be0 con 0x7f18f015f100 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59828/0 (socket says 172.21.15.64:59828) 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 -- 172.21.15.64:0/3123475491 learned_addr learned my addr 172.21.15.64:0/3123475491 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:42.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f5800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f015f100 0x7f18f0154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f4e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f006fba0 0x7f18f01f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 -- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f015f100 msgr2=0x7f18f0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f015f100 0x7f18f0154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 -- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f006fba0 msgr2=0x7f18f01f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f006fba0 0x7f18f01f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 -- 172.21.15.64:0/3123475491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f015e570 con 0x7f18f00cd790 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18e7e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9f0 tx=0x7f18d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cd80 con 0x7f18f00cd790 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18d8004020 con 0x7f18f00cd790 2024-09-21T07:32:42.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f015e850 con 0x7f18f00cd790 2024-09-21T07:32:42.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004450 con 0x7f18f00cd790 2024-09-21T07:32:42.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f0152de0 con 0x7f18f00cd790 2024-09-21T07:32:42.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.392+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f015b320 con 0x7f18f00cd790 2024-09-21T07:32:42.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.396+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f18d80047b0 con 0x7f18f00cd790 2024-09-21T07:32:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.396+0000 7f18ed600640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 0x7f18cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.396+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7f18d8094650 con 0x7f18f00cd790 2024-09-21T07:32:42.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.396+0000 7f18f4e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 0x7f18cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.396+0000 7f18f4e00640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 0x7f18cc075710 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f18e00af000 tx=0x7f18e001af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.400+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f18d805f0f0 con 0x7f18f00cd790 2024-09-21T07:32:42.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:42.644+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f18f00b3bb0 con 0x7f18f00cd790 2024-09-21T07:32:43.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.444+0000 7f18ed600640 1 -- 172.21.15.64:0/3123475491 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v479) ==== 169+0+0 (secure 0 0 0) 0x7f18d8063b20 con 0x7f18f00cd790 2024-09-21T07:32:43.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 msgr2=0x7f18cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 0x7f18cc075710 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f18e00af000 tx=0x7f18e001af10 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 msgr2=0x7f18f0153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9f0 tx=0x7f18d800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 shutdown_connections 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f18cc073200 0x7f18cc075710 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18f015f100 0x7f18f0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18f00cd790 0x7f18f0153d00 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 --2- 172.21.15.64:0/3123475491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f006fba0 0x7f18f01f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 >> 172.21.15.64:0/3123475491 conn(0x7f18f00b2ca0 msgr2=0x7f18f00b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 shutdown_connections 2024-09-21T07:32:43.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.448+0000 7f18f7800640 1 -- 172.21.15.64:0/3123475491 wait complete. 2024-09-21T07:32:43.474 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:32:43.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- 172.21.15.64:0/4023010415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb0003a60 msgr2=0x7f8eb0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 --2- 172.21.15.64:0/4023010415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb0003a60 0x7f8eb0003e90 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c4a0 tx=0x7f8ebc01cf30 comp rx=0 tx=0).stop 2024-09-21T07:32:43.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ece800640 1 -- 172.21.15.64:0/4023010415 reap_dead start 2024-09-21T07:32:43.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- 172.21.15.64:0/4023010415 shutdown_connections 2024-09-21T07:32:43.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- 172.21.15.64:0/4023010415 >> 172.21.15.64:0/4023010415 conn(0x7f8ec80ccbe0 msgr2=0x7f8ec80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:43.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- 172.21.15.64:0/4023010415 shutdown_connections 2024-09-21T07:32:43.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- 172.21.15.64:0/4023010415 wait complete. 2024-09-21T07:32:43.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 Processor -- start 2024-09-21T07:32:43.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.636+0000 7f8ed0800640 1 -- start start 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8eb0003a60 0x7f8ec81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ec809d4b0 0x7f8ec809d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec8169040 con 0x7f8ec80ace70 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec8168ec0 con 0x7f8eb0003a60 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec81691c0 con 0x7f8ec809d4b0 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59848/0 (socket says 172.21.15.64:59848) 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 -- 172.21.15.64:0/3083829827 learned_addr learned my addr 172.21.15.64:0/3083829827 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ecde00640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8eb0003a60 0x7f8ec81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ecd400640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ec809d4b0 0x7f8ec809d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:43.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 -- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ec809d4b0 msgr2=0x7f8ec809d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ec809d4b0 0x7f8ec809d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 -- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8eb0003a60 msgr2=0x7f8ec81551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8eb0003a60 0x7f8ec81551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 -- 172.21.15.64:0/3083829827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec809de00 con 0x7f8ec80ace70 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ece800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8072dd0 tx=0x7f8ec4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:43.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4011870 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ec4017070 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec81586d0 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4011de0 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec8158c50 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.640+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec80cc0e0 con 0x7f8ec80ace70 2024-09-21T07:32:43.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.644+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8ec401c460 con 0x7f8ec80ace70 2024-09-21T07:32:43.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.644+0000 7f8ec2000640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 0x7f8eac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:43.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.644+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7f8ec4094d10 con 0x7f8ec80ace70 2024-09-21T07:32:43.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.644+0000 7f8ecde00640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 0x7f8eac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:43.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.644+0000 7f8ecde00640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 0x7f8eac075740 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0aa000 tx=0x7f8ebc0b1040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:43.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.648+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8ec809de00 con 0x7f8ec80ace70 2024-09-21T07:32:43.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.824+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8ec80d0830 con 0x7f8ec80ace70 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.824+0000 7f8ec2000640 1 -- 172.21.15.64:0/3083829827 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v55) ==== 59+0+2294 (secure 0 0 0) 0x7f8ec405f830 con 0x7f8ec80ace70 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:32:43.827 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:32:43.828 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:32:43.829 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:32:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 msgr2=0x7f8eac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 0x7f8eac075740 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0aa000 tx=0x7f8ebc0b1040 comp rx=0 tx=0).stop 2024-09-21T07:32:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 msgr2=0x7f8ec80ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8072dd0 tx=0x7f8ec4001aa0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 shutdown_connections 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8eac073230 0x7f8eac075740 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ec80ace70 0x7f8ec80ad280 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8ec809d4b0 0x7f8ec809d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 --2- 172.21.15.64:0/3083829827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8eb0003a60 0x7f8ec81551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 >> 172.21.15.64:0/3083829827 conn(0x7f8ec80ccbe0 msgr2=0x7f8ec8072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 shutdown_connections 2024-09-21T07:32:43.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:43.828+0000 7f8ed0800640 1 -- 172.21.15.64:0/3083829827 wait complete. 2024-09-21T07:32:43.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 -- 172.21.15.64:0/3929625905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfe0004d50 msgr2=0x7fcfe0005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 --2- 172.21.15.64:0/3929625905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfe0004d50 0x7fcfe0005160 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fcffc09dd80 tx=0x7fcfec01d210 comp rx=0 tx=0).stop 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd002000640 1 -- 172.21.15.64:0/3929625905 reap_dead start 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 -- 172.21.15.64:0/3929625905 shutdown_connections 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 -- 172.21.15.64:0/3929625905 >> 172.21.15.64:0/3929625905 conn(0x7fcffc06d450 msgr2=0x7fcffc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 -- 172.21.15.64:0/3929625905 shutdown_connections 2024-09-21T07:32:44.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.008+0000 7fd004000640 1 -- 172.21.15.64:0/3929625905 wait complete. 2024-09-21T07:32:44.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 Processor -- start 2024-09-21T07:32:44.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 -- start start 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe0004d50 0x7fcffc15e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcffc09bd20 0x7fcffc09c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc06f290 con 0x7fcffc0cf370 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc071120 con 0x7fcfe0004d50 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd004000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc06f410 con 0x7fcffc09bd20 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59874/0 (socket says 172.21.15.64:59874) 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 -- 172.21.15.64:0/2117870213 learned_addr learned my addr 172.21.15.64:0/2117870213 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd002000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcffc09bd20 0x7fcffc09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd001600640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe0004d50 0x7fcffc15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 -- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcffc09bd20 msgr2=0x7fcffc09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcffc09bd20 0x7fcffc09c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 -- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe0004d50 msgr2=0x7fcffc15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe0004d50 0x7fcffc15e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 -- 172.21.15.64:0/2117870213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0cfcc0 con 0x7fcffc0cf370 2024-09-21T07:32:44.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.012+0000 7fd000c00640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8011ae0 tx=0x7fcfe8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe801e070 con 0x7fcffc0cf370 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe800fc70 con 0x7fcffc0cf370 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc1f8f70 con 0x7fcffc0cf370 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004030 con 0x7fcffc0cf370 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc1f9530 con 0x7fcffc0cf370 2024-09-21T07:32:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc0af610 con 0x7fcffc0cf370 2024-09-21T07:32:44.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcfe8021070 con 0x7fcffc0cf370 2024-09-21T07:32:44.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 0x7fcfdc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7fcfe80949e0 con 0x7fcffc0cf370 2024-09-21T07:32:44.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.016+0000 7fd001600640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 0x7fcfdc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.020+0000 7fd001600640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 0x7fcfdc075710 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4001320 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:44.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.024+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcffc0cfcc0 con 0x7fcffc0cf370 2024-09-21T07:32:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.200+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcffc1f8cc0 con 0x7fcffc0cf370 2024-09-21T07:32:44.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.204+0000 7fcff9600640 1 -- 172.21.15.64:0/2117870213 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7fcfe8068030 con 0x7fcffc0cf370 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 msgr2=0x7fcfdc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 0x7fcfdc075710 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4001320 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 msgr2=0x7fcffc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8011ae0 tx=0x7fcfe8009ec0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 shutdown_connections 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfdc073200 0x7fcfdc075710 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcffc09bd20 0x7fcffc09c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcffc0cf370 0x7fcffc0cf780 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 --2- 172.21.15.64:0/2117870213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe0004d50 0x7fcffc15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 >> 172.21.15.64:0/2117870213 conn(0x7fcffc06d450 msgr2=0x7fcffc073230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 shutdown_connections 2024-09-21T07:32:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.208+0000 7fd004000640 1 -- 172.21.15.64:0/2117870213 wait complete. 2024-09-21T07:32:44.229 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:32:44.229 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:32:44.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:32:44.380 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:32:44.381 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:44.381 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:44.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:32:44.390 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:32:44.390 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:44.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:32:44.399 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:44.399 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:44.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:32:44.440 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:32:44.440 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:44.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:32:44.455 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:32:44.456 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 -- 172.21.15.64:0/3275854051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcc4004810 msgr2=0x7efcc4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 --2- 172.21.15.64:0/3275854051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcc4004810 0x7efcc4004c20 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009b40 tx=0x7efcc801d250 comp rx=0 tx=0).stop 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 -- 172.21.15.64:0/3275854051 shutdown_connections 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 --2- 172.21.15.64:0/3275854051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcc4004810 0x7efcc4004c20 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 -- 172.21.15.64:0/3275854051 >> 172.21.15.64:0/3275854051 conn(0x7efcdc06d480 msgr2=0x7efcdc0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 -- 172.21.15.64:0/3275854051 shutdown_connections 2024-09-21T07:32:44.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.640+0000 7efce4200640 1 -- 172.21.15.64:0/3275854051 wait complete. 2024-09-21T07:32:44.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 Processor -- start 2024-09-21T07:32:44.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 -- start start 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcc4004810 0x7efcdc0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcdc1576f0 0x7efcdc157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0d0880 con 0x7efcdc158c20 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0d0700 con 0x7efcc4004810 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce4200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efcdc0d0a00 con 0x7efcdc1576f0 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59898/0 (socket says 172.21.15.64:59898) 2024-09-21T07:32:44.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 -- 172.21.15.64:0/2343517343 learned_addr learned my addr 172.21.15.64:0/2343517343 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce1800640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcc4004810 0x7efcdc0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce2200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcdc1576f0 0x7efcdc157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 -- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcdc1576f0 msgr2=0x7efcdc157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcdc1576f0 0x7efcdc157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 -- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcc4004810 msgr2=0x7efcdc0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcc4004810 0x7efcdc0b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 -- 172.21.15.64:0/2343517343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc15fcb0 con 0x7efcdc158c20 2024-09-21T07:32:44.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.644+0000 7efce0e00640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7efcc801d080 tx=0x7efcc80050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80bb030 con 0x7efcdc158c20 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcc8004900 con 0x7efcdc158c20 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8004d50 con 0x7efcdc158c20 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcdc0b7330 con 0x7efcdc158c20 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc1fbdd0 con 0x7efcdc158c20 2024-09-21T07:32:44.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcdc0d0f60 con 0x7efcdc158c20 2024-09-21T07:32:44.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.648+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efcc80be030 con 0x7efcdc158c20 2024-09-21T07:32:44.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.652+0000 7efcd9600640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 0x7efcbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:44.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.652+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7efcc812f870 con 0x7efcdc158c20 2024-09-21T07:32:44.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.652+0000 7efce1800640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 0x7efcbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:44.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.652+0000 7efce1800640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 0x7efcbc075710 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006fd0 tx=0x7efcd0006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:44.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.652+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efcc8016f60 con 0x7efcdc158c20 2024-09-21T07:32:44.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcdc0b5130 con 0x7efcdc158c20 2024-09-21T07:32:44.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efcd9600640 1 -- 172.21.15.64:0/2343517343 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) ==== 95+0+3910 (secure 0 0 0) 0x7efcc80fa430 con 0x7efcdc158c20 2024-09-21T07:32:44.870 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:44.870 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":105,"btime":"2024-09-21T07:32:38:425110+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2412293817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2412293817},{"type":"v1","addr":"172.21.15.64:6833","nonce":2412293817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7391,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/708621988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":708621988},{"type":"v1","addr":"172.21.15.90:6836","nonce":708621988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1812611826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1812611826},{"type":"v1","addr":"172.21.15.90:6837","nonce":1812611826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98},{"gid":9021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3951740072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3951740072},{"type":"v1","addr":"172.21.15.64:6835","nonce":3951740072}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[]} 2024-09-21T07:32:44.870 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 105 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 msgr2=0x7efcbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 0x7efcbc075710 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006fd0 tx=0x7efcd0006b80 comp rx=0 tx=0).stop 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 msgr2=0x7efcdc159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7efcc801d080 tx=0x7efcc80050a0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 shutdown_connections 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efcbc073200 0x7efcbc075710 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcdc1576f0 0x7efcdc157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc158c20 0x7efcdc159030 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 --2- 172.21.15.64:0/2343517343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcc4004810 0x7efcdc0b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:44.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 >> 172.21.15.64:0/2343517343 conn(0x7efcdc06d480 msgr2=0x7efcdc1582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:44.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 shutdown_connections 2024-09-21T07:32:44.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:44.868+0000 7efce4200640 1 -- 172.21.15.64:0/2343517343 wait complete. 2024-09-21T07:32:44.893 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:32:44.893 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:32:44.893 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:32:44.893 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:32:44.893 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:32:44.893 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:32:44.894 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:32:44.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:32:44.894 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:32:44.894 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:32:44.894 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:32:44.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:32:44.895 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:32:44.895 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:32:44.895 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:32:44.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:32:44.905 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:32:44.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:32:44.909 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:32:44.909 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:32:44.910 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:32:44.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:32:44.914 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:32:44.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:32:44.956 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:32:44.956 DEBUG:teuthology.parallel:result is None 2024-09-21T07:32:44.958 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:32:44.958 DEBUG:teuthology.parallel:result is None 2024-09-21T07:32:44.963 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:32:44.963 DEBUG:teuthology.parallel:result is None 2024-09-21T07:32:44.965 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:32:44.965 DEBUG:teuthology.parallel:result is None 2024-09-21T07:32:44.965 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:32:45.063 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:32:45.063 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:32:45.067 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:32:45.067 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:32:45.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 -- 172.21.15.64:0/126955855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c15fa60 msgr2=0x7fb25c0ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 --2- 172.21.15.64:0/126955855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c15fa60 0x7fb25c0ce400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009840 tx=0x7fb24c01c6d0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 -- 172.21.15.64:0/126955855 shutdown_connections 2024-09-21T07:32:45.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 --2- 172.21.15.64:0/126955855 >> v2:172.21.15.90:3300/0 conn(0x7fb25c0cc910 0x7fb25c0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 --2- 172.21.15.64:0/126955855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c15fa60 0x7fb25c0ce400 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 -- 172.21.15.64:0/126955855 >> 172.21.15.64:0/126955855 conn(0x7fb25c0b1c60 msgr2=0x7fb25c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:45.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 -- 172.21.15.64:0/126955855 shutdown_connections 2024-09-21T07:32:45.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.128+0000 7fb25b200640 1 -- 172.21.15.64:0/126955855 wait complete. 2024-09-21T07:32:45.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 Processor -- start 2024-09-21T07:32:45.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- start start 2024-09-21T07:32:45.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c073ea0 0x7fb25c1fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 0x7fb25c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0cf000 con 0x7fb25c0cc910 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0ceb50 con 0x7fb25c15fa60 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c1689f0 con 0x7fb25c073ea0 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57548/0 (socket says 172.21.15.64:57548) 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 -- 172.21.15.64:0/1482800240 learned_addr learned my addr 172.21.15.64:0/1482800240 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb259e00640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c073ea0 0x7fb25c1fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25a800640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 0x7fb25c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 -- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c073ea0 msgr2=0x7fb25c1fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c073ea0 0x7fb25c1fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 -- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 msgr2=0x7fb25c1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 0x7fb25c1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 -- 172.21.15.64:0/1482800240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c14e660 con 0x7fb25c0cc910 2024-09-21T07:32:45.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25a800640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 0x7fb25c1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb251400640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb24400e6f0 tx=0x7fb24400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244004230 con 0x7fb25c0cc910 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb244004410 con 0x7fb25c0cc910 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c0cb4c0 con 0x7fb25c0cc910 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24400cb10 con 0x7fb25c0cc910 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.132+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c1fbb30 con 0x7fb25c0cc910 2024-09-21T07:32:45.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c14eb60 con 0x7fb25c0cc910 2024-09-21T07:32:45.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb24400ccb0 con 0x7fb25c0cc910 2024-09-21T07:32:45.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb252a00640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 0x7fb238075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5335+0+0 (secure 0 0 0) 0x7fb2440949d0 con 0x7fb25c0cc910 2024-09-21T07:32:45.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb259e00640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 0x7fb238075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.136+0000 7fb259e00640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 0x7fb238075710 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0af000 tx=0x7fb24c01af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:45.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.140+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb25c14eb60 con 0x7fb25c0cc910 2024-09-21T07:32:45.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.328+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb25c1fb950 con 0x7fb25c0cc910 2024-09-21T07:32:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.468+0000 7fb252a00640 1 -- 172.21.15.64:0/1482800240 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) ==== 97+0+0 (secure 0 0 0) 0x7fb25c1fb950 con 0x7fb25c0cc910 2024-09-21T07:32:45.471 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 msgr2=0x7fb238075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 0x7fb238075710 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0af000 tx=0x7fb24c01af10 comp rx=0 tx=0).stop 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 msgr2=0x7fb25c14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb24400e6f0 tx=0x7fb24400ebb0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 shutdown_connections 2024-09-21T07:32:45.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb238073200 0x7fb238075710 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25c15fa60 0x7fb25c1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb25c0cc910 0x7fb25c14e120 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 --2- 172.21.15.64:0/1482800240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb25c073ea0 0x7fb25c1fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 >> 172.21.15.64:0/1482800240 conn(0x7fb25c0b1c60 msgr2=0x7fb25c06ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 shutdown_connections 2024-09-21T07:32:45.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.472+0000 7fb25b200640 1 -- 172.21.15.64:0/1482800240 wait complete. 2024-09-21T07:32:45.497 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:32:45.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 -- 172.21.15.64:0/1935146224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4540005310 msgr2=0x7f454000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 --2- 172.21.15.64:0/1935146224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4540005310 0x7f454000b9d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f4558072dd0 tx=0x7f455001d770 comp rx=0 tx=0).stop 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 -- 172.21.15.64:0/1935146224 shutdown_connections 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 --2- 172.21.15.64:0/1935146224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4540005310 0x7f454000b9d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 -- 172.21.15.64:0/1935146224 >> 172.21.15.64:0/1935146224 conn(0x7f45580ccbe0 msgr2=0x7f45580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 -- 172.21.15.64:0/1935146224 shutdown_connections 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.652+0000 7f455fe00640 1 -- 172.21.15.64:0/1935146224 wait complete. 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 Processor -- start 2024-09-21T07:32:45.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 -- start start 2024-09-21T07:32:45.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 0x7f4558154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 0x7f45580c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4558070490 con 0x7f455815ee30 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4558070310 con 0x7f45580c7c80 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4558070610 con 0x7f4540005310 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57558/0 (socket says 172.21.15.64:57558) 2024-09-21T07:32:45.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.656+0000 7f455de00640 1 -- 172.21.15.64:0/2747864331 learned_addr learned my addr 172.21.15.64:0/2747864331 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 -- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 msgr2=0x7f4558154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455d400640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 0x7f4558154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455ca00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 0x7f45580c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 0x7f4558154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 -- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 msgr2=0x7f45580c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 0x7f45580c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 -- 172.21.15.64:0/2747864331 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4558151bd0 con 0x7f455815ee30 2024-09-21T07:32:45.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455d400640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 0x7f4558154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455ca00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 0x7f45580c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455de00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f455001d5a0 tx=0x7f4550009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500b3040 con 0x7f455815ee30 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45500a6ce0 con 0x7f455815ee30 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550003be0 con 0x7f455815ee30 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455815f780 con 0x7f455815ee30 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45581512a0 con 0x7f455815ee30 2024-09-21T07:32:45.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45580cbcd0 con 0x7f455815ee30 2024-09-21T07:32:45.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.660+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f45500bf060 con 0x7f455815ee30 2024-09-21T07:32:45.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.664+0000 7f4555600640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 0x7f4538075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:45.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.664+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7f455012e690 con 0x7f455815ee30 2024-09-21T07:32:45.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.664+0000 7f455d400640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 0x7f4538075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:45.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.664+0000 7f455d400640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 0x7f4538075710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f454c001250 tx=0x7f454c006730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:45.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.668+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f455815f780 con 0x7f455815ee30 2024-09-21T07:32:45.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f45581f8e60 con 0x7f455815ee30 2024-09-21T07:32:45.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f4555600640 1 -- 172.21.15.64:0/2747864331 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) ==== 80+0+5304 (secure 0 0 0) 0x7f4550017480 con 0x7f455815ee30 2024-09-21T07:32:45.909 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:45.909 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:45.909 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:32:45.910 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.911 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:32:45.912 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.913 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.914 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:32:45.915 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.916 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:32:45.917 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.918 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:32:45.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.920 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:32:45.921 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.922 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:45.922 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:32:45.922 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:45.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 msgr2=0x7f4538075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 0x7f4538075710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f454c001250 tx=0x7f454c006730 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 msgr2=0x7f455815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f455001d5a0 tx=0x7f4550009ce0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 shutdown_connections 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4538073200 0x7f4538075710 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f455815ee30 0x7f455815f240 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45580c7c80 0x7f45580c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 --2- 172.21.15.64:0/2747864331 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4540005310 0x7f4558154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 >> 172.21.15.64:0/2747864331 conn(0x7f45580ccbe0 msgr2=0x7f45580739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 shutdown_connections 2024-09-21T07:32:45.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:45.908+0000 7f455fe00640 1 -- 172.21.15.64:0/2747864331 wait complete. 2024-09-21T07:32:45.932 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- 172.21.15.64:0/121402457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f066015e9b0 msgr2=0x7f066015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 --2- 172.21.15.64:0/121402457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f066015e9b0 0x7f066015edc0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f066006b090 tx=0x7f065801dc70 comp rx=0 tx=0).stop 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- 172.21.15.64:0/121402457 shutdown_connections 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 --2- 172.21.15.64:0/121402457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f066015e9b0 0x7f066015edc0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 --2- 172.21.15.64:0/121402457 >> v2:172.21.15.90:3300/0 conn(0x7f06600cacf0 0x7f06600cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 --2- 172.21.15.64:0/121402457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600b24e0 0x7f06600ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- 172.21.15.64:0/121402457 >> 172.21.15.64:0/121402457 conn(0x7f06600ccbe0 msgr2=0x7f06600ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:46.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- 172.21.15.64:0/121402457 shutdown_connections 2024-09-21T07:32:46.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- 172.21.15.64:0/121402457 wait complete. 2024-09-21T07:32:46.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 Processor -- start 2024-09-21T07:32:46.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 -- start start 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.088+0000 7f0666000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 0x7f06601640c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015e9b0 0x7f0660152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f06600b38c0 con 0x7f06600b24e0 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06600b3740 con 0x7f066015e9b0 2024-09-21T07:32:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f06600b3a40 con 0x7f06600cacf0 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 0x7f06601640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57584/0 (socket says 172.21.15.64:57584) 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 -- 172.21.15.64:0/2040143921 learned_addr learned my addr 172.21.15.64:0/2040143921 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065fe00640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015e9b0 0x7f0660152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 -- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 msgr2=0x7f06601640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 0x7f06601640c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 -- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015e9b0 msgr2=0x7f0660152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015e9b0 0x7f0660152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 -- 172.21.15.64:0/2040143921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06601fc5d0 con 0x7f06600b24e0 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657e00640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 0x7f06601640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f065f400640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f065000d6a0 tx=0x7f065000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650017070 con 0x7f06600b24e0 2024-09-21T07:32:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0650004310 con 0x7f06600b24e0 2024-09-21T07:32:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06601f94f0 con 0x7f06600b24e0 2024-09-21T07:32:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650005280 con 0x7f06600b24e0 2024-09-21T07:32:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06601f9ab0 con 0x7f06600b24e0 2024-09-21T07:32:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06600cb100 con 0x7f06600b24e0 2024-09-21T07:32:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.092+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0650005420 con 0x7f06600b24e0 2024-09-21T07:32:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.096+0000 7f0657400640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 0x7f063c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.096+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7f06500942e0 con 0x7f06600b24e0 2024-09-21T07:32:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.096+0000 7f0657e00640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 0x7f063c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.096+0000 7f0657e00640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 0x7f063c075710 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f066006eef0 tx=0x7f06480091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.100+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0650020020 con 0x7f06600b24e0 2024-09-21T07:32:46.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f06600caad0 con 0x7f06600b24e0 2024-09-21T07:32:46.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0657400640 1 -- 172.21.15.64:0/2040143921 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) ==== 84+0+65 (secure 0 0 0) 0x7f065005ee60 con 0x7f06600b24e0 2024-09-21T07:32:46.503 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:46.503 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:32:46.503 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:32:46.504 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:32:46.504 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:32:46.504 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:32:46.504 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 msgr2=0x7f063c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 0x7f063c075710 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f066006eef0 tx=0x7f06480091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 msgr2=0x7f066009d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f065000d6a0 tx=0x7f065000db60 comp rx=0 tx=0).stop 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 shutdown_connections 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f063c073200 0x7f063c075710 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015e9b0 0x7f0660152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06600cacf0 0x7f06601640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 --2- 172.21.15.64:0/2040143921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06600b24e0 0x7f066009d1b0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 >> 172.21.15.64:0/2040143921 conn(0x7f06600ccbe0 msgr2=0x7f06600b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:46.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 shutdown_connections 2024-09-21T07:32:46.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.280+0000 7f0666000640 1 -- 172.21.15.64:0/2040143921 wait complete. 2024-09-21T07:32:46.506 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:32:46.506 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:32:46.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- 172.21.15.64:0/3848241035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e8006ec70 msgr2=0x7f9e80158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 --2- 172.21.15.64:0/3848241035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e8006ec70 0x7f9e80158db0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f9e800c3c50 tx=0x7f9e7001c760 comp rx=0 tx=0).stop 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- 172.21.15.64:0/3848241035 shutdown_connections 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 --2- 172.21.15.64:0/3848241035 >> v2:172.21.15.90:3300/0 conn(0x7f9e801592f0 0x7f9e800aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 --2- 172.21.15.64:0/3848241035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e8006ec70 0x7f9e80158db0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- 172.21.15.64:0/3848241035 >> 172.21.15.64:0/3848241035 conn(0x7f9e800d0170 msgr2=0x7f9e800d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- 172.21.15.64:0/3848241035 shutdown_connections 2024-09-21T07:32:46.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- 172.21.15.64:0/3848241035 wait complete. 2024-09-21T07:32:46.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 Processor -- start 2024-09-21T07:32:46.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.672+0000 7f9e87000640 1 -- start start 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e8006ec70 0x7f9e8014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e801592f0 0x7f9e8015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8015c810 con 0x7f9e800af360 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8015c690 con 0x7f9e801592f0 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8015c990 con 0x7f9e8006ec70 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57598/0 (socket says 172.21.15.64:57598) 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 -- 172.21.15.64:0/3964439247 learned_addr learned my addr 172.21.15.64:0/3964439247 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e85000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e801592f0 0x7f9e8015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e7fe00640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e8006ec70 0x7f9e8014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 -- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e8006ec70 msgr2=0x7f9e8014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e8006ec70 0x7f9e8014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 -- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e801592f0 msgr2=0x7f9e8015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e801592f0 0x7f9e8015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 -- 172.21.15.64:0/3964439247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8009cb70 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e77400640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b3c0 tx=0x7f9e6800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68015020 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e68011940 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68011d90 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8009ce50 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8009d410 con 0x7f9e800af360 2024-09-21T07:32:46.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.676+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e80158db0 con 0x7f9e800af360 2024-09-21T07:32:46.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.680+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e68018020 con 0x7f9e800af360 2024-09-21T07:32:46.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.680+0000 7f9e7cc00640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 0x7f9e5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.680+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7f9e68093e90 con 0x7f9e800af360 2024-09-21T07:32:46.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.680+0000 7f9e7fe00640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 0x7f9e5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.680+0000 7f9e7fe00640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 0x7f9e5c075710 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9e700af000 tx=0x7f9e7001afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.684+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9e6801f020 con 0x7f9e800af360 2024-09-21T07:32:46.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:46.860+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9e800b60f0 con 0x7f9e800af360 2024-09-21T07:32:47.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e7cc00640 1 -- 172.21.15.64:0/3964439247 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) ==== 138+0+0 (secure 0 0 0) 0x7f9e6805ea10 con 0x7f9e800af360 2024-09-21T07:32:47.493 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 msgr2=0x7f9e5c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 0x7f9e5c075710 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9e700af000 tx=0x7f9e7001afa0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 msgr2=0x7f9e800b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b3c0 tx=0x7f9e6800b880 comp rx=0 tx=0).stop 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 shutdown_connections 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e5c073200 0x7f9e5c075710 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e801592f0 0x7f9e8015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800af360 0x7f9e800b49a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 --2- 172.21.15.64:0/3964439247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e8006ec70 0x7f9e8014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 >> 172.21.15.64:0/3964439247 conn(0x7f9e800d0170 msgr2=0x7f9e8015b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:47.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 shutdown_connections 2024-09-21T07:32:47.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.492+0000 7f9e87000640 1 -- 172.21.15.64:0/3964439247 wait complete. 2024-09-21T07:32:47.521 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 -- 172.21.15.64:0/4081728657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23580cdef0 msgr2=0x7f2358073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 --2- 172.21.15.64:0/4081728657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23580cdef0 0x7f2358073cd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2344009840 tx=0x7f234401c700 comp rx=0 tx=0).stop 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 -- 172.21.15.64:0/4081728657 shutdown_connections 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 --2- 172.21.15.64:0/4081728657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23580cdef0 0x7f2358073cd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 -- 172.21.15.64:0/4081728657 >> 172.21.15.64:0/4081728657 conn(0x7f23580b2c60 msgr2=0x7f23580b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 -- 172.21.15.64:0/4081728657 shutdown_connections 2024-09-21T07:32:47.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.684+0000 7f235e000640 1 -- 172.21.15.64:0/4081728657 wait complete. 2024-09-21T07:32:47.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 Processor -- start 2024-09-21T07:32:47.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 -- start start 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2358070e90 0x7f2358153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23580cdef0 0x7f23580caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2358169f50 con 0x7f2358074210 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2358169dd0 con 0x7f2358070e90 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f235816a0d0 con 0x7f23580cdef0 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57604/0 (socket says 172.21.15.64:57604) 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 -- 172.21.15.64:0/2282274286 learned_addr learned my addr 172.21.15.64:0/2282274286 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235cc00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2358070e90 0x7f2358153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:47.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f235d600640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23580cdef0 0x7f23580caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:47.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 -- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23580cdef0 msgr2=0x7f23580caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:47.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23580cdef0 0x7f23580caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 -- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2358070e90 msgr2=0x7f2358153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2358070e90 0x7f2358153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 -- 172.21.15.64:0/2282274286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2358152bb0 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.688+0000 7f2357e00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f234401cbe0 tx=0x7f2344005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440a85f0 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23440a8a70 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440a8e60 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2358154280 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23580b62d0 con 0x7f2358074210 2024-09-21T07:32:47.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2358073cd0 con 0x7f2358074210 2024-09-21T07:32:47.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2344004030 con 0x7f2358074210 2024-09-21T07:32:47.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.692+0000 7f2354c00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 0x7f2338075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:47.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.696+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5619+0+0 (secure 0 0 0) 0x7f234412e700 con 0x7f2358074210 2024-09-21T07:32:47.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.696+0000 7f235cc00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 0x7f2338075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:47.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.696+0000 7f235cc00640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 0x7f2338075740 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f234c007fd0 tx=0x7f234c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.696+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f23440ac030 con 0x7f2358074210 2024-09-21T07:32:47.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:47.876+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f23581518d0 con 0x7f2358074210 2024-09-21T07:32:48.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f2354c00640 1 -- 172.21.15.64:0/2282274286 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) ==== 170+0+0 (secure 0 0 0) 0x7f2344016410 con 0x7f2358074210 2024-09-21T07:32:48.501 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 msgr2=0x7f2338075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 0x7f2338075740 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f234c007fd0 tx=0x7f234c009040 comp rx=0 tx=0).stop 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 msgr2=0x7f23580b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f234401cbe0 tx=0x7f2344005d30 comp rx=0 tx=0).stop 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 shutdown_connections 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2338073230 0x7f2338075740 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23580cdef0 0x7f23580caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2358074210 0x7f23580b4970 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 --2- 172.21.15.64:0/2282274286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2358070e90 0x7f2358153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 >> 172.21.15.64:0/2282274286 conn(0x7f23580b2c60 msgr2=0x7f23580b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 shutdown_connections 2024-09-21T07:32:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.500+0000 7f235e000640 1 -- 172.21.15.64:0/2282274286 wait complete. 2024-09-21T07:32:48.541 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:32:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 -- 172.21.15.64:0/2422510109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00717d0 msgr2=0x7fafd015c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 --2- 172.21.15.64:0/2422510109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00717d0 0x7fafd015c760 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009840 tx=0x7fafbc01c560 comp rx=0 tx=0).stop 2024-09-21T07:32:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 -- 172.21.15.64:0/2422510109 shutdown_connections 2024-09-21T07:32:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 --2- 172.21.15.64:0/2422510109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 0x7fafd00b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 --2- 172.21.15.64:0/2422510109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00717d0 0x7fafd015c760 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 -- 172.21.15.64:0/2422510109 >> 172.21.15.64:0/2422510109 conn(0x7fafd00d23f0 msgr2=0x7fafd00d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 -- 172.21.15.64:0/2422510109 shutdown_connections 2024-09-21T07:32:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.700+0000 7fafd7e00640 1 -- 172.21.15.64:0/2422510109 wait complete. 2024-09-21T07:32:48.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 Processor -- start 2024-09-21T07:32:48.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 -- start start 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 0x7fafd01fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd01fc9b0 0x7fafd01fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0169dc0 con 0x7fafd00ccbc0 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0169c40 con 0x7fafd01fc9b0 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fafd0169f40 con 0x7fafd00b5240 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57618/0 (socket says 172.21.15.64:57618) 2024-09-21T07:32:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 -- 172.21.15.64:0/1967613894 learned_addr learned my addr 172.21.15.64:0/1967613894 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd5400640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 0x7fafd01fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd5e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd01fc9b0 0x7fafd01fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 -- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 msgr2=0x7fafd01fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 0x7fafd01fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 -- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd01fc9b0 msgr2=0x7fafd01fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd01fc9b0 0x7fafd01fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 -- 172.21.15.64:0/1967613894 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01fbb40 con 0x7fafd00ccbc0 2024-09-21T07:32:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd4a00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fafbc01ce00 tx=0x7fafbc0aaa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0ad070 con 0x7fafd00ccbc0 2024-09-21T07:32:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafbc005040 con 0x7fafd00ccbc0 2024-09-21T07:32:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd00b6530 con 0x7fafd00ccbc0 2024-09-21T07:32:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.704+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc005430 con 0x7fafd00ccbc0 2024-09-21T07:32:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.708+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd00b6af0 con 0x7fafd00ccbc0 2024-09-21T07:32:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.708+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd015c760 con 0x7fafd00ccbc0 2024-09-21T07:32:48.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.708+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fafbc0b0070 con 0x7fafd00ccbc0 2024-09-21T07:32:48.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.708+0000 7fafcd600640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 0x7fafb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.708+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 6001+0+0 (secure 0 0 0) 0x7fafbc12ec60 con 0x7fafd00ccbc0 2024-09-21T07:32:48.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.712+0000 7fafd5400640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 0x7fafb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.712+0000 7fafd5400640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 0x7fafb0075710 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000f70 tx=0x7fafc4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.712+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fafbc016410 con 0x7fafd00ccbc0 2024-09-21T07:32:48.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:48.924+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fafd00b62c0 con 0x7fafd00ccbc0 2024-09-21T07:32:49.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.500+0000 7fafcd600640 1 -- 172.21.15.64:0/1967613894 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v108) ==== 174+0+0 (secure 0 0 0) 0x7fafbc0f9bc0 con 0x7fafd00ccbc0 2024-09-21T07:32:49.503 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 21 and data pool 22 2024-09-21T07:32:49.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 msgr2=0x7fafb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 0x7fafb0075710 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000f70 tx=0x7fafc4009040 comp rx=0 tx=0).stop 2024-09-21T07:32:49.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 msgr2=0x7fafd01fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fafbc01ce00 tx=0x7fafbc0aaa30 comp rx=0 tx=0).stop 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 shutdown_connections 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fafb0073200 0x7fafb0075710 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd01fc9b0 0x7fafd01fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafd00ccbc0 0x7fafd01fbd80 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 --2- 172.21.15.64:0/1967613894 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fafd00b5240 0x7fafd01fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.504+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 >> 172.21.15.64:0/1967613894 conn(0x7fafd00d23f0 msgr2=0x7fafd00b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:49.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.508+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 shutdown_connections 2024-09-21T07:32:49.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.508+0000 7fafd7e00640 1 -- 172.21.15.64:0/1967613894 wait complete. 2024-09-21T07:32:49.556 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:49.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- 172.21.15.64:0/1191005243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415a330 msgr2=0x7f3c34160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 --2- 172.21.15.64:0/1191005243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415a330 0x7f3c34160280 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009900 tx=0x7f3c2801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- 172.21.15.64:0/1191005243 shutdown_connections 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 --2- 172.21.15.64:0/1191005243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 0x7f3c340b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 --2- 172.21.15.64:0/1191005243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415a330 0x7f3c34160280 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- 172.21.15.64:0/1191005243 >> 172.21.15.64:0/1191005243 conn(0x7f3c3406d530 msgr2=0x7f3c340d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- 172.21.15.64:0/1191005243 shutdown_connections 2024-09-21T07:32:49.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- 172.21.15.64:0/1191005243 wait complete. 2024-09-21T07:32:49.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 Processor -- start 2024-09-21T07:32:49.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.712+0000 7f3c3c400640 1 -- start start 2024-09-21T07:32:49.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 0x7f3c34148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415d910 0x7f3c340c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3416a430 con 0x7f3c3415d910 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3416a2b0 con 0x7f3c3415a330 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3416a5b0 con 0x7f3c3415d500 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 0x7f3c34148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:37840/0 (socket says 172.21.15.64:37840) 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 -- 172.21.15.64:0/3998138249 learned_addr learned my addr 172.21.15.64:0/3998138249 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:49.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3a400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415d910 0x7f3c340c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 -- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 msgr2=0x7f3c34148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 0x7f3c34148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 -- 172.21.15.64:0/3998138249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415d910 msgr2=0x7f3c340c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415d910 0x7f3c340c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 -- 172.21.15.64:0/3998138249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c34148ca0 con 0x7f3c3415a330 2024-09-21T07:32:49.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c39a00640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009850 tx=0x7f3c280a5630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280bb070 con 0x7f3c3415a330 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c28004430 con 0x7f3c3415a330 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280b2040 con 0x7f3c3415a330 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c340c70e0 con 0x7f3c3415a330 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.716+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c340c76a0 con 0x7f3c3415a330 2024-09-21T07:32:49.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c34160280 con 0x7f3c3415a330 2024-09-21T07:32:49.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3c28003860 con 0x7f3c3415a330 2024-09-21T07:32:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c31600640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 0x7f3c14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f3c2812dd40 con 0x7f3c3415a330 2024-09-21T07:32:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c39000640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 0x7f3c14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.720+0000 7f3c39000640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 0x7f3c14075710 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c34166a70 tx=0x7f3c2000a250 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.724+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3c280164d0 con 0x7f3c3415a330 2024-09-21T07:32:49.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.904+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c3415c620 con 0x7f3c3415a330 2024-09-21T07:32:49.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.904+0000 7f3c31600640 1 -- 172.21.15.64:0/3998138249 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16917 (secure 0 0 0) 0x7f3c280f86c0 con 0x7f3c3415a330 2024-09-21T07:32:49.908 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:49.908 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:32:48.930895+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:46.878179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:47.893039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:49.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 msgr2=0x7f3c14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 0x7f3c14075710 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c34166a70 tx=0x7f3c2000a250 comp rx=0 tx=0).stop 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 msgr2=0x7f3c340b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009850 tx=0x7f3c280a5630 comp rx=0 tx=0).stop 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 shutdown_connections 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3c14073200 0x7f3c14075710 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c3415d910 0x7f3c340c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c3415d500 0x7f3c34148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 --2- 172.21.15.64:0/3998138249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c3415a330 0x7f3c340b5250 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 >> 172.21.15.64:0/3998138249 conn(0x7f3c3406d530 msgr2=0x7f3c34068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:49.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 shutdown_connections 2024-09-21T07:32:49.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:49.908+0000 7f3c3c400640 1 -- 172.21.15.64:0/3998138249 wait complete. 2024-09-21T07:32:49.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 -- 172.21.15.64:0/3445030579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000caec0 msgr2=0x7f3c000b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 --2- 172.21.15.64:0/3445030579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000caec0 0x7f3c000b3120 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00a950 tx=0x7f3bec01da00 comp rx=0 tx=0).stop 2024-09-21T07:32:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 -- 172.21.15.64:0/3445030579 shutdown_connections 2024-09-21T07:32:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 --2- 172.21.15.64:0/3445030579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000caec0 0x7f3c000b3120 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 -- 172.21.15.64:0/3445030579 >> 172.21.15.64:0/3445030579 conn(0x7f3c000ccbe0 msgr2=0x7f3c000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 -- 172.21.15.64:0/3445030579 shutdown_connections 2024-09-21T07:32:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.136+0000 7f3c08000640 1 -- 172.21.15.64:0/3445030579 wait complete. 2024-09-21T07:32:50.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 Processor -- start 2024-09-21T07:32:50.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- start start 2024-09-21T07:32:50.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000b24e0 0x7f3c001f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c000caec0 0x7f3c001462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c000b41f0 con 0x7f3c000cb2d0 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c000b4070 con 0x7f3c000b24e0 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3c000b4370 con 0x7f3c000caec0 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57660/0 (socket says 172.21.15.64:57660) 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 -- 172.21.15.64:0/130961392 learned_addr learned my addr 172.21.15.64:0/130961392 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c04c00640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c000caec0 0x7f3c001462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c05600640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000b24e0 0x7f3c001f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 -- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c000caec0 msgr2=0x7f3c001462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c000caec0 0x7f3c001462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 -- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000b24e0 msgr2=0x7f3c001f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000b24e0 0x7f3c001f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 -- 172.21.15.64:0/130961392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00146d60 con 0x7f3c000cb2d0 2024-09-21T07:32:50.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c06000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800fc70 tx=0x7f3bf800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf801a070 con 0x7f3c000cb2d0 2024-09-21T07:32:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bf8006aa0 con 0x7f3c000cb2d0 2024-09-21T07:32:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c00147040 con 0x7f3c000cb2d0 2024-09-21T07:32:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8008070 con 0x7f3c000cb2d0 2024-09-21T07:32:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.140+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c001f7690 con 0x7f3c000cb2d0 2024-09-21T07:32:50.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.144+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c00146ad0 con 0x7f3c000cb2d0 2024-09-21T07:32:50.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.144+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3bf801d070 con 0x7f3c000cb2d0 2024-09-21T07:32:50.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.144+0000 7f3bfd600640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 0x7f3be0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.144+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f3bf8096ea0 con 0x7f3c000cb2d0 2024-09-21T07:32:50.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.144+0000 7f3c05600640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 0x7f3be0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.148+0000 7f3c05600640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 0x7f3be0075740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007fd0 tx=0x7f3bf4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:50.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.148+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3bf80616d0 con 0x7f3c000cb2d0 2024-09-21T07:32:50.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.328+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c000b1f10 con 0x7f3c000cb2d0 2024-09-21T07:32:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.328+0000 7f3bfd600640 1 -- 172.21.15.64:0/130961392 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16917 (secure 0 0 0) 0x7f3bf8066100 con 0x7f3c000cb2d0 2024-09-21T07:32:50.331 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:50.331 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:32:48.930895+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:46.878179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:47.893039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 msgr2=0x7f3be0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 0x7f3be0075740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007fd0 tx=0x7f3bf4009040 comp rx=0 tx=0).stop 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 msgr2=0x7f3c0009d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800fc70 tx=0x7f3bf800d430 comp rx=0 tx=0).stop 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 shutdown_connections 2024-09-21T07:32:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3be0073230 0x7f3be0075740 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c000cb2d0 0x7f3c0009d220 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c000caec0 0x7f3c001462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 --2- 172.21.15.64:0/130961392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000b24e0 0x7f3c001f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 >> 172.21.15.64:0/130961392 conn(0x7f3c000ccbe0 msgr2=0x7f3c00155920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 shutdown_connections 2024-09-21T07:32:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.332+0000 7f3c08000640 1 -- 172.21.15.64:0/130961392 wait complete. 2024-09-21T07:32:50.354 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- 172.21.15.64:0/1559291944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 msgr2=0x7f97bc003a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 --2- 172.21.15.64:0/1559291944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97bc003a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009b50 tx=0x7f97c801d290 comp rx=0 tx=0).stop 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97d9600640 1 -- 172.21.15.64:0/1559291944 reap_dead start 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- 172.21.15.64:0/1559291944 shutdown_connections 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- 172.21.15.64:0/1559291944 >> 172.21.15.64:0/1559291944 conn(0x7f97d406d450 msgr2=0x7f97d40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- 172.21.15.64:0/1559291944 shutdown_connections 2024-09-21T07:32:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- 172.21.15.64:0/1559291944 wait complete. 2024-09-21T07:32:50.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 Processor -- start 2024-09-21T07:32:50.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.516+0000 7f97db600640 1 -- start start 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d41f96c0 0x7f97d41f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40b33d0 con 0x7f97d41f96c0 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40cef70 con 0x7f97d415b4f0 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97db600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f97d40b3550 con 0x7f97d409df30 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51260/0 (socket says 172.21.15.64:51260) 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:37882/0 (socket says 172.21.15.64:37882) 2024-09-21T07:32:50.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 -- 172.21.15.64:0/399832443 learned_addr learned my addr 172.21.15.64:0/399832443 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d41f96c0 0x7f97d41f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 -- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 msgr2=0x7f97d415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 -- 172.21.15.64:0/399832443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d41f96c0 msgr2=0x7f97d41f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d41f96c0 0x7f97d41f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 -- 172.21.15.64:0/399832443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41f9e40 con 0x7f97d415b4f0 2024-09-21T07:32:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d8c00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.520+0000 7f97d3e00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006600 tx=0x7f97c00039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:50.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.524+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0015070 con 0x7f97d415b4f0 2024-09-21T07:32:50.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.524+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97c0011920 con 0x7f97d415b4f0 2024-09-21T07:32:50.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.524+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0011d70 con 0x7f97d415b4f0 2024-09-21T07:32:50.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.524+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41f5da0 con 0x7f97d415b4f0 2024-09-21T07:32:50.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.524+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41f6860 con 0x7f97d415b4f0 2024-09-21T07:32:50.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d406f870 con 0x7f97d415b4f0 2024-09-21T07:32:50.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f97c0018070 con 0x7f97d415b4f0 2024-09-21T07:32:50.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97d0c00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 0x7f97b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:50.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f97c00950b0 con 0x7f97d415b4f0 2024-09-21T07:32:50.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97d8c00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 0x7f97b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:50.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.528+0000 7f97d8c00640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 0x7f97b4075710 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f97c80ad000 tx=0x7f97c801a030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:50.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.536+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f97c005f980 con 0x7f97d415b4f0 2024-09-21T07:32:50.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:50.748+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97d40cc010 con 0x7f97d415b4f0 2024-09-21T07:32:51.478 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:32:51.476+0000 7f3cd5800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:32:51.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.532+0000 7f97d0c00640 1 -- 172.21.15.64:0/399832443 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v111) ==== 118+0+0 (secure 0 0 0) 0x7f97c00643b0 con 0x7f97d415b4f0 2024-09-21T07:32:51.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 msgr2=0x7f97b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 0x7f97b4075710 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f97c80ad000 tx=0x7f97c801a030 comp rx=0 tx=0).stop 2024-09-21T07:32:51.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 msgr2=0x7f97d41f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006600 tx=0x7f97c00039d0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 shutdown_connections 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97b4073200 0x7f97b4075710 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d41f96c0 0x7f97d41f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d415b4f0 0x7f97d41f9180 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 --2- 172.21.15.64:0/399832443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d409df30 0x7f97d415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 >> 172.21.15.64:0/399832443 conn(0x7f97d406d450 msgr2=0x7f97d4072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 shutdown_connections 2024-09-21T07:32:51.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.536+0000 7f97db600640 1 -- 172.21.15.64:0/399832443 wait complete. 2024-09-21T07:32:51.560 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:32:51.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 -- 172.21.15.64:0/97634730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 msgr2=0x7f9bfc0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 --2- 172.21.15.64:0/97634730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc0ceb40 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc070f10 tx=0x7f9bf401cd80 comp rx=0 tx=0).stop 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 -- 172.21.15.64:0/97634730 shutdown_connections 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 --2- 172.21.15.64:0/97634730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc0ceb40 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 --2- 172.21.15.64:0/97634730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 0x7f9bfc0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 --2- 172.21.15.64:0/97634730 >> v2:172.21.15.90:3300/0 conn(0x7f9bfc09df30 0x7f9bfc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 -- 172.21.15.64:0/97634730 >> 172.21.15.64:0/97634730 conn(0x7f9bfc06d450 msgr2=0x7f9bfc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:51.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 -- 172.21.15.64:0/97634730 shutdown_connections 2024-09-21T07:32:51.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.720+0000 7f9c02a00640 1 -- 172.21.15.64:0/97634730 wait complete. 2024-09-21T07:32:51.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 Processor -- start 2024-09-21T07:32:51.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 -- start start 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 0x7f9bfc15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 0x7f9bfc1fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0ccef0 con 0x7f9bfc0ce730 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0ccd70 con 0x7f9bfc09df30 2024-09-21T07:32:51.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c02a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc0cd070 con 0x7f9bfc0b3910 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57700/0 (socket says 172.21.15.64:57700) 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 -- 172.21.15.64:0/135338403 learned_addr learned my addr 172.21.15.64:0/135338403 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9bf3400640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 0x7f9bfc1fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9bfbe00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 0x7f9bfc15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 -- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 msgr2=0x7f9bfc1fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 0x7f9bfc1fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 -- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 msgr2=0x7f9bfc15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 0x7f9bfc15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9c00a00640 1 -- 172.21.15.64:0/135338403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc15b540 con 0x7f9bfc0ce730 2024-09-21T07:32:51.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.724+0000 7f9bfbe00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 0x7f9bfc15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9c00a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009bd0 tx=0x7f9bf4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40bc070 con 0x7f9bfc0ce730 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bf40042f0 con 0x7f9bfc0ce730 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40b2040 con 0x7f9bfc0ce730 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc15b820 con 0x7f9bfc0ce730 2024-09-21T07:32:51.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc15bde0 con 0x7f9bfc0ce730 2024-09-21T07:32:51.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc15b2b0 con 0x7f9bfc0ce730 2024-09-21T07:32:51.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9bf40bf070 con 0x7f9bfc0ce730 2024-09-21T07:32:51.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 0x7f9bd8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.728+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f9bf412e210 con 0x7f9bfc0ce730 2024-09-21T07:32:51.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.732+0000 7f9bfbe00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 0x7f9bd8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.732+0000 7f9bfbe00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 0x7f9bd8075710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009a20 tx=0x7f9bec005cd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:51.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.732+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9bf4016970 con 0x7f9bfc0ce730 2024-09-21T07:32:51.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:51.960+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9bfc0ce1f0 con 0x7f9bfc0ce730 2024-09-21T07:32:52.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.536+0000 7f9bf8c00640 1 -- 172.21.15.64:0/135338403 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v112) ==== 122+0+0 (secure 0 0 0) 0x7f9bf40f9000 con 0x7f9bfc0ce730 2024-09-21T07:32:52.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 msgr2=0x7f9bd8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 0x7f9bd8075710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009a20 tx=0x7f9bec005cd0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 msgr2=0x7f9bfc1fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009bd0 tx=0x7f9bf4005b10 comp rx=0 tx=0).stop 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 shutdown_connections 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9bd8073200 0x7f9bd8075710 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bfc0ce730 0x7f9bfc1fc5b0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9bfc0b3910 0x7f9bfc1fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 --2- 172.21.15.64:0/135338403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bfc09df30 0x7f9bfc15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 >> 172.21.15.64:0/135338403 conn(0x7f9bfc06d450 msgr2=0x7f9bfc0cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 shutdown_connections 2024-09-21T07:32:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.540+0000 7f9c02a00640 1 -- 172.21.15.64:0/135338403 wait complete. 2024-09-21T07:32:52.567 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:32:52.567 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 -- 172.21.15.64:0/3119516627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 msgr2=0x7f06680b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 --2- 172.21.15.64:0/3119516627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680b3660 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0660009bc0 tx=0x7f066001cba0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 -- 172.21.15.64:0/3119516627 shutdown_connections 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 --2- 172.21.15.64:0/3119516627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680b3660 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 --2- 172.21.15.64:0/3119516627 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680caec0 0x7f06680b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 -- 172.21.15.64:0/3119516627 >> 172.21.15.64:0/3119516627 conn(0x7f06680ccbe0 msgr2=0x7f06680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:52.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 -- 172.21.15.64:0/3119516627 shutdown_connections 2024-09-21T07:32:52.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.728+0000 7f066e800640 1 -- 172.21.15.64:0/3119516627 wait complete. 2024-09-21T07:32:52.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 Processor -- start 2024-09-21T07:32:52.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- start start 2024-09-21T07:32:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680b24e0 0x7f0668153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0668166180 con 0x7f06680caec0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0668166000 con 0x7f06680cb2d0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0668166300 con 0x7f06680b24e0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57714/0 (socket says 172.21.15.64:57714) 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 -- 172.21.15.64:0/3753502998 learned_addr learned my addr 172.21.15.64:0/3753502998 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f0667e00640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f0667400640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680b24e0 0x7f0668153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 -- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680b24e0 msgr2=0x7f0668153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680b24e0 0x7f0668153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 -- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 msgr2=0x7f06680adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 -- 172.21.15.64:0/3753502998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680aefd0 con 0x7f06680caec0 2024-09-21T07:32:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065fe00640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f065000e6c0 tx=0x7f065000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:52.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650004220 con 0x7f06680caec0 2024-09-21T07:32:52.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06500043c0 con 0x7f06680caec0 2024-09-21T07:32:52.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066809aa90 con 0x7f06680caec0 2024-09-21T07:32:52.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065000cb10 con 0x7f06680caec0 2024-09-21T07:32:52.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.732+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06680ad490 con 0x7f06680caec0 2024-09-21T07:32:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06681667a0 con 0x7f06680caec0 2024-09-21T07:32:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f065000ccb0 con 0x7f06680caec0 2024-09-21T07:32:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f065f400640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 0x7f0644075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f0650094b70 con 0x7f06680caec0 2024-09-21T07:32:52.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f0667400640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 0x7f0644075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:52.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.736+0000 7f0667400640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 0x7f0644075740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0658001870 tx=0x7f0658001380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:52.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.740+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f06680aefd0 con 0x7f06680caec0 2024-09-21T07:32:52.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.952+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f066809b9c0 con 0x7f06680caec0 2024-09-21T07:32:52.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.952+0000 7f065f400640 1 -- 172.21.15.64:0/3753502998 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f065005f320 con 0x7f06680caec0 2024-09-21T07:32:52.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:52.956 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:32:52.956 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 msgr2=0x7f0644075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 0x7f0644075740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0658001870 tx=0x7f0658001380 comp rx=0 tx=0).stop 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 msgr2=0x7f066809b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f065000e6c0 tx=0x7f065000eb80 comp rx=0 tx=0).stop 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 shutdown_connections 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0644073230 0x7f0644075740 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06680cb2d0 0x7f06680adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06680caec0 0x7f066809b400 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 --2- 172.21.15.64:0/3753502998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06680b24e0 0x7f0668153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 >> 172.21.15.64:0/3753502998 conn(0x7f06680ccbe0 msgr2=0x7f06680744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 shutdown_connections 2024-09-21T07:32:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:52.956+0000 7f066e800640 1 -- 172.21.15.64:0/3753502998 wait complete. 2024-09-21T07:32:52.979 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:32:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- 172.21.15.64:0/965226119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 msgr2=0x7fed580700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- 172.21.15.64:0/965226119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed580700b0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fed580afb50 tx=0x7fed4c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- 172.21.15.64:0/965226119 shutdown_connections 2024-09-21T07:32:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- 172.21.15.64:0/965226119 >> v2:172.21.15.90:3300/0 conn(0x7fed580b48d0 0x7fed58072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- 172.21.15.64:0/965226119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed580700b0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- 172.21.15.64:0/965226119 >> 172.21.15.64:0/965226119 conn(0x7fed580ccbe0 msgr2=0x7fed580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- 172.21.15.64:0/965226119 shutdown_connections 2024-09-21T07:32:53.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- 172.21.15.64:0/965226119 wait complete. 2024-09-21T07:32:53.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 Processor -- start 2024-09-21T07:32:53.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 -- start start 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 0x7fed5809a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.136+0000 7fed5f600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed580ca010 0x7fed580b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fed58168b60 con 0x7fed5815edb0 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed581689e0 con 0x7fed580ca010 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fed58168ce0 con 0x7fed580709b0 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57738/0 (socket says 172.21.15.64:57738) 2024-09-21T07:32:53.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 -- 172.21.15.64:0/2944716593 learned_addr learned my addr 172.21.15.64:0/2944716593 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5cc00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 0x7fed5809a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5d600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed580ca010 0x7fed580b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 -- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 msgr2=0x7fed5809a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 0x7fed5809a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 -- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed580ca010 msgr2=0x7fed580b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed580ca010 0x7fed580b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 -- 172.21.15.64:0/2944716593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed581f91b0 con 0x7fed5815edb0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5cc00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 0x7fed5809a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed57e00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c3c0 tx=0x7fed4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44017070 con 0x7fed5815edb0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed440053c0 con 0x7fed5815edb0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44003860 con 0x7fed5815edb0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed581f9490 con 0x7fed5815edb0 2024-09-21T07:32:53.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed581f9a50 con 0x7fed5815edb0 2024-09-21T07:32:53.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed58072e20 con 0x7fed5815edb0 2024-09-21T07:32:53.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.140+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fed4401a070 con 0x7fed5815edb0 2024-09-21T07:32:53.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.144+0000 7fed54c00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 0x7fed38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.144+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fed44093690 con 0x7fed5815edb0 2024-09-21T07:32:53.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.144+0000 7fed5cc00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 0x7fed38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.144+0000 7fed5cc00640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 0x7fed38075710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0af000 tx=0x7fed4c01b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.148+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fed4405e510 con 0x7fed5815edb0 2024-09-21T07:32:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.324+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed5809da20 con 0x7fed5815edb0 2024-09-21T07:32:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed54c00640 1 -- 172.21.15.64:0/2944716593 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16904 (secure 0 0 0) 0x7fed4405de10 con 0x7fed5815edb0 2024-09-21T07:32:53.329 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:53.329 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":153,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:32:50.515725+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:46.878179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:47.893039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 msgr2=0x7fed38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 0x7fed38075710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0af000 tx=0x7fed4c01b100 comp rx=0 tx=0).stop 2024-09-21T07:32:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 msgr2=0x7fed5809b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c3c0 tx=0x7fed4400c880 comp rx=0 tx=0).stop 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 shutdown_connections 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fed38073200 0x7fed38075710 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed580ca010 0x7fed580b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed5815edb0 0x7fed5809b410 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 --2- 172.21.15.64:0/2944716593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed580709b0 0x7fed5809a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 >> 172.21.15.64:0/2944716593 conn(0x7fed580ccbe0 msgr2=0x7fed580d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 shutdown_connections 2024-09-21T07:32:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.328+0000 7fed5f600640 1 -- 172.21.15.64:0/2944716593 wait complete. 2024-09-21T07:32:53.352 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:32:53.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:32:53.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 -- 172.21.15.64:0/944509080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380cbcd0 msgr2=0x7f07380cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 --2- 172.21.15.64:0/944509080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380cbcd0 0x7f07380cc0e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0730009bc0 tx=0x7f073001ca90 comp rx=0 tx=0).stop 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 -- 172.21.15.64:0/944509080 shutdown_connections 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 --2- 172.21.15.64:0/944509080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380cbcd0 0x7f07380cc0e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 --2- 172.21.15.64:0/944509080 >> v2:172.21.15.90:3300/0 conn(0x7f07380b1be0 0x7f07380b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 -- 172.21.15.64:0/944509080 >> 172.21.15.64:0/944509080 conn(0x7f07380ccbe0 msgr2=0x7f07380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 -- 172.21.15.64:0/944509080 shutdown_connections 2024-09-21T07:32:53.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.508+0000 7f073f800640 1 -- 172.21.15.64:0/944509080 wait complete. 2024-09-21T07:32:53.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 Processor -- start 2024-09-21T07:32:53.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- start start 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 0x7f073814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 0x7f07381fc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f07380b4170 con 0x7f07380cbcd0 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07380b3ff0 con 0x7f073815cbd0 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f07380b42f0 con 0x7f07380b1be0 2024-09-21T07:32:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57742/0 (socket says 172.21.15.64:57742) 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 -- 172.21.15.64:0/1904099083 learned_addr learned my addr 172.21.15.64:0/1904099083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073d800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 0x7f07381fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 -- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 msgr2=0x7f073814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073ce00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 0x7f073814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 0x7f073814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 -- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 msgr2=0x7f07381fc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 0x7f07381fc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 -- 172.21.15.64:0/1904099083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07380cf760 con 0x7f07380cbcd0 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073d800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 0x7f07381fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073ce00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 0x7f073814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0737e00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f072400e7a0 tx=0x7f072400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072400cc60 con 0x7f07380cbcd0 2024-09-21T07:32:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07380cfa20 con 0x7f07380cbcd0 2024-09-21T07:32:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0724010430 con 0x7f07380cbcd0 2024-09-21T07:32:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724010860 con 0x7f07380cbcd0 2024-09-21T07:32:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.512+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07380c96c0 con 0x7f07380cbcd0 2024-09-21T07:32:53.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07381fd2d0 con 0x7f07380cbcd0 2024-09-21T07:32:53.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0724010a00 con 0x7f07380cbcd0 2024-09-21T07:32:53.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f0734c00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f0724094e00 con 0x7f07380cbcd0 2024-09-21T07:32:53.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f073ce00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.516+0000 7f073ce00640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f072c001ec0 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.520+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f072405fc00 con 0x7f07380cbcd0 2024-09-21T07:32:53.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.696+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0738155e60 con 0x7f0718073200 2024-09-21T07:32:53.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.700+0000 7f0734c00640 1 -- 172.21.15.64:0/1904099083 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f0738155e60 con 0x7f0718073200 2024-09-21T07:32:53.705 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:53.707 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 msgr2=0x7f0718075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f072c001ec0 tx=0x7f072c009040 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 msgr2=0x7f07381fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f072400e7a0 tx=0x7f072400ec60 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 shutdown_connections 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0718073200 0x7f0718075710 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f073815cbd0 0x7f07381fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07380cbcd0 0x7f07381fc450 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 --2- 172.21.15.64:0/1904099083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07380b1be0 0x7f073814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 >> 172.21.15.64:0/1904099083 conn(0x7f07380ccbe0 msgr2=0x7f07380d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 shutdown_connections 2024-09-21T07:32:53.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.704+0000 7f073f800640 1 -- 172.21.15.64:0/1904099083 wait complete. 2024-09-21T07:32:53.727 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-09-21T07:32:53.586140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430832,"kb_used_data":16124,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754543888,"statfs":{"total":773094113280,"available":772652941312,"internally_reserved":0,"allocated":16510976,"data_stored":8376312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":424463923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001747"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500797+0000","last_change":"2024-09-21T07:32:49.533433+0000","last_active":"2024-09-21T07:32:51.500797+0000","last_peered":"2024-09-21T07:32:51.500797+0000","last_clean":"2024-09-21T07:32:51.500797+0000","last_became_active":"2024-09-21T07:32:49.531638+0000","last_became_peered":"2024-09-21T07:32:49.531638+0000","last_unstale":"2024-09-21T07:32:51.500797+0000","last_undegraded":"2024-09-21T07:32:51.500797+0000","last_fullsized":"2024-09-21T07:32:51.500797+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:35.852564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958724+0000","last_change":"2024-09-21T07:32:49.538781+0000","last_active":"2024-09-21T07:32:51.958724+0000","last_peered":"2024-09-21T07:32:51.958724+0000","last_clean":"2024-09-21T07:32:51.958724+0000","last_became_active":"2024-09-21T07:32:49.538172+0000","last_became_peered":"2024-09-21T07:32:49.538172+0000","last_unstale":"2024-09-21T07:32:51.958724+0000","last_undegraded":"2024-09-21T07:32:51.958724+0000","last_fullsized":"2024-09-21T07:32:51.958724+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:04.638263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958223+0000","last_change":"2024-09-21T07:32:49.535553+0000","last_active":"2024-09-21T07:32:51.958223+0000","last_peered":"2024-09-21T07:32:51.958223+0000","last_clean":"2024-09-21T07:32:51.958223+0000","last_became_active":"2024-09-21T07:32:49.535207+0000","last_became_peered":"2024-09-21T07:32:49.535207+0000","last_unstale":"2024-09-21T07:32:51.958223+0000","last_undegraded":"2024-09-21T07:32:51.958223+0000","last_fullsized":"2024-09-21T07:32:51.958223+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:55.012724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957777+0000","last_change":"2024-09-21T07:32:49.525365+0000","last_active":"2024-09-21T07:32:51.957777+0000","last_peered":"2024-09-21T07:32:51.957777+0000","last_clean":"2024-09-21T07:32:51.957777+0000","last_became_active":"2024-09-21T07:32:49.525017+0000","last_became_peered":"2024-09-21T07:32:49.525017+0000","last_unstale":"2024-09-21T07:32:51.957777+0000","last_undegraded":"2024-09-21T07:32:51.957777+0000","last_fullsized":"2024-09-21T07:32:51.957777+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:20.404643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528531+0000","last_change":"2024-09-21T07:32:49.548091+0000","last_active":"2024-09-21T07:32:50.528531+0000","last_peered":"2024-09-21T07:32:50.528531+0000","last_clean":"2024-09-21T07:32:50.528531+0000","last_became_active":"2024-09-21T07:32:49.547331+0000","last_became_peered":"2024-09-21T07:32:49.547331+0000","last_unstale":"2024-09-21T07:32:50.528531+0000","last_undegraded":"2024-09-21T07:32:50.528531+0000","last_fullsized":"2024-09-21T07:32:50.528531+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:33.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527764+0000","last_change":"2024-09-21T07:32:49.533219+0000","last_active":"2024-09-21T07:32:50.527764+0000","last_peered":"2024-09-21T07:32:50.527764+0000","last_clean":"2024-09-21T07:32:50.527764+0000","last_became_active":"2024-09-21T07:32:49.532739+0000","last_became_peered":"2024-09-21T07:32:49.532739+0000","last_unstale":"2024-09-21T07:32:50.527764+0000","last_undegraded":"2024-09-21T07:32:50.527764+0000","last_fullsized":"2024-09-21T07:32:50.527764+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:04.432478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500190+0000","last_change":"2024-09-21T07:32:49.535151+0000","last_active":"2024-09-21T07:32:51.500190+0000","last_peered":"2024-09-21T07:32:51.500190+0000","last_clean":"2024-09-21T07:32:51.500190+0000","last_became_active":"2024-09-21T07:32:49.534847+0000","last_became_peered":"2024-09-21T07:32:49.534847+0000","last_unstale":"2024-09-21T07:32:51.500190+0000","last_undegraded":"2024-09-21T07:32:51.500190+0000","last_fullsized":"2024-09-21T07:32:51.500190+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:40.567255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527972+0000","last_change":"2024-09-21T07:32:49.523036+0000","last_active":"2024-09-21T07:32:50.527972+0000","last_peered":"2024-09-21T07:32:50.527972+0000","last_clean":"2024-09-21T07:32:50.527972+0000","last_became_active":"2024-09-21T07:32:49.522382+0000","last_became_peered":"2024-09-21T07:32:49.522382+0000","last_unstale":"2024-09-21T07:32:50.527972+0000","last_undegraded":"2024-09-21T07:32:50.527972+0000","last_fullsized":"2024-09-21T07:32:50.527972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:26.516670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527921+0000","last_change":"2024-09-21T07:32:49.543090+0000","last_active":"2024-09-21T07:32:50.527921+0000","last_peered":"2024-09-21T07:32:50.527921+0000","last_clean":"2024-09-21T07:32:50.527921+0000","last_became_active":"2024-09-21T07:32:49.542092+0000","last_became_peered":"2024-09-21T07:32:49.542092+0000","last_unstale":"2024-09-21T07:32:50.527921+0000","last_undegraded":"2024-09-21T07:32:50.527921+0000","last_fullsized":"2024-09-21T07:32:50.527921+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:02.045049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528049+0000","last_change":"2024-09-21T07:32:49.547596+0000","last_active":"2024-09-21T07:32:50.528049+0000","last_peered":"2024-09-21T07:32:50.528049+0000","last_clean":"2024-09-21T07:32:50.528049+0000","last_became_active":"2024-09-21T07:32:49.547275+0000","last_became_peered":"2024-09-21T07:32:49.547275+0000","last_unstale":"2024-09-21T07:32:50.528049+0000","last_undegraded":"2024-09-21T07:32:50.528049+0000","last_fullsized":"2024-09-21T07:32:50.528049+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:24.433604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958975+0000","last_change":"2024-09-21T07:32:49.536059+0000","last_active":"2024-09-21T07:32:51.958975+0000","last_peered":"2024-09-21T07:32:51.958975+0000","last_clean":"2024-09-21T07:32:51.958975+0000","last_became_active":"2024-09-21T07:32:49.535737+0000","last_became_peered":"2024-09-21T07:32:49.535737+0000","last_unstale":"2024-09-21T07:32:51.958975+0000","last_undegraded":"2024-09-21T07:32:51.958975+0000","last_fullsized":"2024-09-21T07:32:51.958975+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.321919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957687+0000","last_change":"2024-09-21T07:32:49.546155+0000","last_active":"2024-09-21T07:32:51.957687+0000","last_peered":"2024-09-21T07:32:51.957687+0000","last_clean":"2024-09-21T07:32:51.957687+0000","last_became_active":"2024-09-21T07:32:49.545822+0000","last_became_peered":"2024-09-21T07:32:49.545822+0000","last_unstale":"2024-09-21T07:32:51.957687+0000","last_undegraded":"2024-09-21T07:32:51.957687+0000","last_fullsized":"2024-09-21T07:32:51.957687+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:47.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528403+0000","last_change":"2024-09-21T07:32:49.548414+0000","last_active":"2024-09-21T07:32:50.528403+0000","last_peered":"2024-09-21T07:32:50.528403+0000","last_clean":"2024-09-21T07:32:50.528403+0000","last_became_active":"2024-09-21T07:32:49.547688+0000","last_became_peered":"2024-09-21T07:32:49.547688+0000","last_unstale":"2024-09-21T07:32:50.528403+0000","last_undegraded":"2024-09-21T07:32:50.528403+0000","last_fullsized":"2024-09-21T07:32:50.528403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:25.154260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957998+0000","last_change":"2024-09-21T07:32:49.539357+0000","last_active":"2024-09-21T07:32:51.957998+0000","last_peered":"2024-09-21T07:32:51.957998+0000","last_clean":"2024-09-21T07:32:51.957998+0000","last_became_active":"2024-09-21T07:32:49.536945+0000","last_became_peered":"2024-09-21T07:32:49.536945+0000","last_unstale":"2024-09-21T07:32:51.957998+0000","last_undegraded":"2024-09-21T07:32:51.957998+0000","last_fullsized":"2024-09-21T07:32:51.957998+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:31.532470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957208+0000","last_change":"2024-09-21T07:32:49.542316+0000","last_active":"2024-09-21T07:32:51.957208+0000","last_peered":"2024-09-21T07:32:51.957208+0000","last_clean":"2024-09-21T07:32:51.957208+0000","last_became_active":"2024-09-21T07:32:49.541568+0000","last_became_peered":"2024-09-21T07:32:49.541568+0000","last_unstale":"2024-09-21T07:32:51.957208+0000","last_undegraded":"2024-09-21T07:32:51.957208+0000","last_fullsized":"2024-09-21T07:32:51.957208+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:53.152222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527641+0000","last_change":"2024-09-21T07:32:49.529616+0000","last_active":"2024-09-21T07:32:50.527641+0000","last_peered":"2024-09-21T07:32:50.527641+0000","last_clean":"2024-09-21T07:32:50.527641+0000","last_became_active":"2024-09-21T07:32:49.529302+0000","last_became_peered":"2024-09-21T07:32:49.529302+0000","last_unstale":"2024-09-21T07:32:50.527641+0000","last_undegraded":"2024-09-21T07:32:50.527641+0000","last_fullsized":"2024-09-21T07:32:50.527641+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:14.350958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958213+0000","last_change":"2024-09-21T07:32:49.532464+0000","last_active":"2024-09-21T07:32:51.958213+0000","last_peered":"2024-09-21T07:32:51.958213+0000","last_clean":"2024-09-21T07:32:51.958213+0000","last_became_active":"2024-09-21T07:32:49.532097+0000","last_became_peered":"2024-09-21T07:32:49.532097+0000","last_unstale":"2024-09-21T07:32:51.958213+0000","last_undegraded":"2024-09-21T07:32:51.958213+0000","last_fullsized":"2024-09-21T07:32:51.958213+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:24.420090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959277+0000","last_change":"2024-09-21T07:32:49.531992+0000","last_active":"2024-09-21T07:32:51.959277+0000","last_peered":"2024-09-21T07:32:51.959277+0000","last_clean":"2024-09-21T07:32:51.959277+0000","last_became_active":"2024-09-21T07:32:49.531626+0000","last_became_peered":"2024-09-21T07:32:49.531626+0000","last_unstale":"2024-09-21T07:32:51.959277+0000","last_undegraded":"2024-09-21T07:32:51.959277+0000","last_fullsized":"2024-09-21T07:32:51.959277+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:26.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530045+0000","last_change":"2024-09-21T07:32:49.546402+0000","last_active":"2024-09-21T07:32:50.530045+0000","last_peered":"2024-09-21T07:32:50.530045+0000","last_clean":"2024-09-21T07:32:50.530045+0000","last_became_active":"2024-09-21T07:32:49.545682+0000","last_became_peered":"2024-09-21T07:32:49.545682+0000","last_unstale":"2024-09-21T07:32:50.530045+0000","last_undegraded":"2024-09-21T07:32:50.530045+0000","last_fullsized":"2024-09-21T07:32:50.530045+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:06.056072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957791+0000","last_change":"2024-09-21T07:32:49.531867+0000","last_active":"2024-09-21T07:32:51.957791+0000","last_peered":"2024-09-21T07:32:51.957791+0000","last_clean":"2024-09-21T07:32:51.957791+0000","last_became_active":"2024-09-21T07:32:49.531519+0000","last_became_peered":"2024-09-21T07:32:49.531519+0000","last_unstale":"2024-09-21T07:32:51.957791+0000","last_undegraded":"2024-09-21T07:32:51.957791+0000","last_fullsized":"2024-09-21T07:32:51.957791+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:00.179890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528290+0000","last_change":"2024-09-21T07:32:49.538114+0000","last_active":"2024-09-21T07:32:50.528290+0000","last_peered":"2024-09-21T07:32:50.528290+0000","last_clean":"2024-09-21T07:32:50.528290+0000","last_became_active":"2024-09-21T07:32:49.537791+0000","last_became_peered":"2024-09-21T07:32:49.537791+0000","last_unstale":"2024-09-21T07:32:50.528290+0000","last_undegraded":"2024-09-21T07:32:50.528290+0000","last_fullsized":"2024-09-21T07:32:50.528290+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:40.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500143+0000","last_change":"2024-09-21T07:32:49.539442+0000","last_active":"2024-09-21T07:32:51.500143+0000","last_peered":"2024-09-21T07:32:51.500143+0000","last_clean":"2024-09-21T07:32:51.500143+0000","last_became_active":"2024-09-21T07:32:49.535735+0000","last_became_peered":"2024-09-21T07:32:49.535735+0000","last_unstale":"2024-09-21T07:32:51.500143+0000","last_undegraded":"2024-09-21T07:32:51.500143+0000","last_fullsized":"2024-09-21T07:32:51.500143+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:20.253679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528025+0000","last_change":"2024-09-21T07:32:49.529193+0000","last_active":"2024-09-21T07:32:50.528025+0000","last_peered":"2024-09-21T07:32:50.528025+0000","last_clean":"2024-09-21T07:32:50.528025+0000","last_became_active":"2024-09-21T07:32:49.528363+0000","last_became_peered":"2024-09-21T07:32:49.528363+0000","last_unstale":"2024-09-21T07:32:50.528025+0000","last_undegraded":"2024-09-21T07:32:50.528025+0000","last_fullsized":"2024-09-21T07:32:50.528025+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:14.847817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958281+0000","last_change":"2024-09-21T07:32:49.539058+0000","last_active":"2024-09-21T07:32:51.958281+0000","last_peered":"2024-09-21T07:32:51.958281+0000","last_clean":"2024-09-21T07:32:51.958281+0000","last_became_active":"2024-09-21T07:32:49.537800+0000","last_became_peered":"2024-09-21T07:32:49.537800+0000","last_unstale":"2024-09-21T07:32:51.958281+0000","last_undegraded":"2024-09-21T07:32:51.958281+0000","last_fullsized":"2024-09-21T07:32:51.958281+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:00.938091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500728+0000","last_change":"2024-09-21T07:32:49.525513+0000","last_active":"2024-09-21T07:32:51.500728+0000","last_peered":"2024-09-21T07:32:51.500728+0000","last_clean":"2024-09-21T07:32:51.500728+0000","last_became_active":"2024-09-21T07:32:49.525195+0000","last_became_peered":"2024-09-21T07:32:49.525195+0000","last_unstale":"2024-09-21T07:32:51.500728+0000","last_undegraded":"2024-09-21T07:32:51.500728+0000","last_fullsized":"2024-09-21T07:32:51.500728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:04.761385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500709+0000","last_change":"2024-09-21T07:32:49.528486+0000","last_active":"2024-09-21T07:32:51.500709+0000","last_peered":"2024-09-21T07:32:51.500709+0000","last_clean":"2024-09-21T07:32:51.500709+0000","last_became_active":"2024-09-21T07:32:49.528093+0000","last_became_peered":"2024-09-21T07:32:49.528093+0000","last_unstale":"2024-09-21T07:32:51.500709+0000","last_undegraded":"2024-09-21T07:32:51.500709+0000","last_fullsized":"2024-09-21T07:32:51.500709+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:56.453673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528066+0000","last_change":"2024-09-21T07:32:49.537416+0000","last_active":"2024-09-21T07:32:50.528066+0000","last_peered":"2024-09-21T07:32:50.528066+0000","last_clean":"2024-09-21T07:32:50.528066+0000","last_became_active":"2024-09-21T07:32:49.537098+0000","last_became_peered":"2024-09-21T07:32:49.537098+0000","last_unstale":"2024-09-21T07:32:50.528066+0000","last_undegraded":"2024-09-21T07:32:50.528066+0000","last_fullsized":"2024-09-21T07:32:50.528066+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:01.332950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958970+0000","last_change":"2024-09-21T07:32:49.520499+0000","last_active":"2024-09-21T07:32:51.958970+0000","last_peered":"2024-09-21T07:32:51.958970+0000","last_clean":"2024-09-21T07:32:51.958970+0000","last_became_active":"2024-09-21T07:32:49.519608+0000","last_became_peered":"2024-09-21T07:32:49.519608+0000","last_unstale":"2024-09-21T07:32:51.958970+0000","last_undegraded":"2024-09-21T07:32:51.958970+0000","last_fullsized":"2024-09-21T07:32:51.958970+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:32.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528763+0000","last_change":"2024-09-21T07:32:49.533297+0000","last_active":"2024-09-21T07:32:50.528763+0000","last_peered":"2024-09-21T07:32:50.528763+0000","last_clean":"2024-09-21T07:32:50.528763+0000","last_became_active":"2024-09-21T07:32:49.532979+0000","last_became_peered":"2024-09-21T07:32:49.532979+0000","last_unstale":"2024-09-21T07:32:50.528763+0000","last_undegraded":"2024-09-21T07:32:50.528763+0000","last_fullsized":"2024-09-21T07:32:50.528763+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:53.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958703+0000","last_change":"2024-09-21T07:32:49.522471+0000","last_active":"2024-09-21T07:32:51.958703+0000","last_peered":"2024-09-21T07:32:51.958703+0000","last_clean":"2024-09-21T07:32:51.958703+0000","last_became_active":"2024-09-21T07:32:49.522165+0000","last_became_peered":"2024-09-21T07:32:49.522165+0000","last_unstale":"2024-09-21T07:32:51.958703+0000","last_undegraded":"2024-09-21T07:32:51.958703+0000","last_fullsized":"2024-09-21T07:32:51.958703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:41.692278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527684+0000","last_change":"2024-09-21T07:32:49.530583+0000","last_active":"2024-09-21T07:32:50.527684+0000","last_peered":"2024-09-21T07:32:50.527684+0000","last_clean":"2024-09-21T07:32:50.527684+0000","last_became_active":"2024-09-21T07:32:49.530202+0000","last_became_peered":"2024-09-21T07:32:49.530202+0000","last_unstale":"2024-09-21T07:32:50.527684+0000","last_undegraded":"2024-09-21T07:32:50.527684+0000","last_fullsized":"2024-09-21T07:32:50.527684+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:25.595680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528035+0000","last_change":"2024-09-21T07:32:49.522695+0000","last_active":"2024-09-21T07:32:50.528035+0000","last_peered":"2024-09-21T07:32:50.528035+0000","last_clean":"2024-09-21T07:32:50.528035+0000","last_became_active":"2024-09-21T07:32:49.522001+0000","last_became_peered":"2024-09-21T07:32:49.522001+0000","last_unstale":"2024-09-21T07:32:50.528035+0000","last_undegraded":"2024-09-21T07:32:50.528035+0000","last_fullsized":"2024-09-21T07:32:50.528035+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:19.545635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957905+0000","last_change":"2024-09-21T07:32:49.537443+0000","last_active":"2024-09-21T07:32:51.957905+0000","last_peered":"2024-09-21T07:32:51.957905+0000","last_clean":"2024-09-21T07:32:51.957905+0000","last_became_active":"2024-09-21T07:32:49.534813+0000","last_became_peered":"2024-09-21T07:32:49.534813+0000","last_unstale":"2024-09-21T07:32:51.957905+0000","last_undegraded":"2024-09-21T07:32:51.957905+0000","last_fullsized":"2024-09-21T07:32:51.957905+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.251108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"152'4","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528221+0000","last_change":"2024-09-21T07:32:48.529610+0000","last_active":"2024-09-21T07:32:50.528221+0000","last_peered":"2024-09-21T07:32:50.528221+0000","last_clean":"2024-09-21T07:32:50.528221+0000","last_became_active":"2024-09-21T07:32:48.529270+0000","last_became_peered":"2024-09-21T07:32:48.529270+0000","last_unstale":"2024-09-21T07:32:50.528221+0000","last_undegraded":"2024-09-21T07:32:50.528221+0000","last_fullsized":"2024-09-21T07:32:50.528221+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:05.053428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958435+0000","last_change":"2024-09-21T07:32:49.539455+0000","last_active":"2024-09-21T07:32:51.958435+0000","last_peered":"2024-09-21T07:32:51.958435+0000","last_clean":"2024-09-21T07:32:51.958435+0000","last_became_active":"2024-09-21T07:32:49.538184+0000","last_became_peered":"2024-09-21T07:32:49.538184+0000","last_unstale":"2024-09-21T07:32:51.958435+0000","last_undegraded":"2024-09-21T07:32:51.958435+0000","last_fullsized":"2024-09-21T07:32:51.958435+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:02.572091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529381+0000","last_change":"2024-09-21T07:32:48.537107+0000","last_active":"2024-09-21T07:32:50.529381+0000","last_peered":"2024-09-21T07:32:50.529381+0000","last_clean":"2024-09-21T07:32:50.529381+0000","last_became_active":"2024-09-21T07:32:48.536791+0000","last_became_peered":"2024-09-21T07:32:48.536791+0000","last_unstale":"2024-09-21T07:32:50.529381+0000","last_undegraded":"2024-09-21T07:32:50.529381+0000","last_fullsized":"2024-09-21T07:32:50.529381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:19.331021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529750+0000","last_change":"2024-09-21T07:32:49.520926+0000","last_active":"2024-09-21T07:32:50.529750+0000","last_peered":"2024-09-21T07:32:50.529750+0000","last_clean":"2024-09-21T07:32:50.529750+0000","last_became_active":"2024-09-21T07:32:49.520585+0000","last_became_peered":"2024-09-21T07:32:49.520585+0000","last_unstale":"2024-09-21T07:32:50.529750+0000","last_undegraded":"2024-09-21T07:32:50.529750+0000","last_fullsized":"2024-09-21T07:32:50.529750+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:43.395563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530290+0000","last_change":"2024-09-21T07:32:48.536568+0000","last_active":"2024-09-21T07:32:50.530290+0000","last_peered":"2024-09-21T07:32:50.530290+0000","last_clean":"2024-09-21T07:32:50.530290+0000","last_became_active":"2024-09-21T07:32:48.536154+0000","last_became_peered":"2024-09-21T07:32:48.536154+0000","last_unstale":"2024-09-21T07:32:50.530290+0000","last_undegraded":"2024-09-21T07:32:50.530290+0000","last_fullsized":"2024-09-21T07:32:50.530290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:00.648174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530375+0000","last_change":"2024-09-21T07:32:49.544305+0000","last_active":"2024-09-21T07:32:50.530375+0000","last_peered":"2024-09-21T07:32:50.530375+0000","last_clean":"2024-09-21T07:32:50.530375+0000","last_became_active":"2024-09-21T07:32:49.543995+0000","last_became_peered":"2024-09-21T07:32:49.543995+0000","last_unstale":"2024-09-21T07:32:50.530375+0000","last_undegraded":"2024-09-21T07:32:50.530375+0000","last_fullsized":"2024-09-21T07:32:50.530375+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:22.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958109+0000","last_change":"2024-09-21T07:32:48.527067+0000","last_active":"2024-09-21T07:32:51.958109+0000","last_peered":"2024-09-21T07:32:51.958109+0000","last_clean":"2024-09-21T07:32:51.958109+0000","last_became_active":"2024-09-21T07:32:48.525802+0000","last_became_peered":"2024-09-21T07:32:48.525802+0000","last_unstale":"2024-09-21T07:32:51.958109+0000","last_undegraded":"2024-09-21T07:32:51.958109+0000","last_fullsized":"2024-09-21T07:32:51.958109+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.971670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957262+0000","last_change":"2024-09-21T07:32:49.522575+0000","last_active":"2024-09-21T07:32:51.957262+0000","last_peered":"2024-09-21T07:32:51.957262+0000","last_clean":"2024-09-21T07:32:51.957262+0000","last_became_active":"2024-09-21T07:32:49.522260+0000","last_became_peered":"2024-09-21T07:32:49.522260+0000","last_unstale":"2024-09-21T07:32:51.957262+0000","last_undegraded":"2024-09-21T07:32:51.957262+0000","last_fullsized":"2024-09-21T07:32:51.957262+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.253040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528827+0000","last_change":"2024-09-21T07:32:48.531752+0000","last_active":"2024-09-21T07:32:50.528827+0000","last_peered":"2024-09-21T07:32:50.528827+0000","last_clean":"2024-09-21T07:32:50.528827+0000","last_became_active":"2024-09-21T07:32:48.531374+0000","last_became_peered":"2024-09-21T07:32:48.531374+0000","last_unstale":"2024-09-21T07:32:50.528827+0000","last_undegraded":"2024-09-21T07:32:50.528827+0000","last_fullsized":"2024-09-21T07:32:50.528827+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:17.675625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957720+0000","last_change":"2024-09-21T07:32:49.538671+0000","last_active":"2024-09-21T07:32:51.957720+0000","last_peered":"2024-09-21T07:32:51.957720+0000","last_clean":"2024-09-21T07:32:51.957720+0000","last_became_active":"2024-09-21T07:32:49.538080+0000","last_became_peered":"2024-09-21T07:32:49.538080+0000","last_unstale":"2024-09-21T07:32:51.957720+0000","last_undegraded":"2024-09-21T07:32:51.957720+0000","last_fullsized":"2024-09-21T07:32:51.957720+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:40.789341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527915+0000","last_change":"2024-09-21T07:32:48.530711+0000","last_active":"2024-09-21T07:32:50.527915+0000","last_peered":"2024-09-21T07:32:50.527915+0000","last_clean":"2024-09-21T07:32:50.527915+0000","last_became_active":"2024-09-21T07:32:48.530357+0000","last_became_peered":"2024-09-21T07:32:48.530357+0000","last_unstale":"2024-09-21T07:32:50.527915+0000","last_undegraded":"2024-09-21T07:32:50.527915+0000","last_fullsized":"2024-09-21T07:32:50.527915+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.029081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957546+0000","last_change":"2024-09-21T07:32:49.531924+0000","last_active":"2024-09-21T07:32:51.957546+0000","last_peered":"2024-09-21T07:32:51.957546+0000","last_clean":"2024-09-21T07:32:51.957546+0000","last_became_active":"2024-09-21T07:32:49.531297+0000","last_became_peered":"2024-09-21T07:32:49.531297+0000","last_unstale":"2024-09-21T07:32:51.957546+0000","last_undegraded":"2024-09-21T07:32:51.957546+0000","last_fullsized":"2024-09-21T07:32:51.957546+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:13.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.499942+0000","last_change":"2024-09-21T07:32:48.528999+0000","last_active":"2024-09-21T07:32:51.499942+0000","last_peered":"2024-09-21T07:32:51.499942+0000","last_clean":"2024-09-21T07:32:51.499942+0000","last_became_active":"2024-09-21T07:32:48.528681+0000","last_became_peered":"2024-09-21T07:32:48.528681+0000","last_unstale":"2024-09-21T07:32:51.499942+0000","last_undegraded":"2024-09-21T07:32:51.499942+0000","last_fullsized":"2024-09-21T07:32:51.499942+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:33.787348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500306+0000","last_change":"2024-09-21T07:32:49.530662+0000","last_active":"2024-09-21T07:32:51.500306+0000","last_peered":"2024-09-21T07:32:51.500306+0000","last_clean":"2024-09-21T07:32:51.500306+0000","last_became_active":"2024-09-21T07:32:49.530315+0000","last_became_peered":"2024-09-21T07:32:49.530315+0000","last_unstale":"2024-09-21T07:32:51.500306+0000","last_undegraded":"2024-09-21T07:32:51.500306+0000","last_fullsized":"2024-09-21T07:32:51.500306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:58.307161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527614+0000","last_change":"2024-09-21T07:32:48.533369+0000","last_active":"2024-09-21T07:32:50.527614+0000","last_peered":"2024-09-21T07:32:50.527614+0000","last_clean":"2024-09-21T07:32:50.527614+0000","last_became_active":"2024-09-21T07:32:48.533042+0000","last_became_peered":"2024-09-21T07:32:48.533042+0000","last_unstale":"2024-09-21T07:32:50.527614+0000","last_undegraded":"2024-09-21T07:32:50.527614+0000","last_fullsized":"2024-09-21T07:32:50.527614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:05.450728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528898+0000","last_change":"2024-09-21T07:32:49.537150+0000","last_active":"2024-09-21T07:32:50.528898+0000","last_peered":"2024-09-21T07:32:50.528898+0000","last_clean":"2024-09-21T07:32:50.528898+0000","last_became_active":"2024-09-21T07:32:49.536777+0000","last_became_peered":"2024-09-21T07:32:49.536777+0000","last_unstale":"2024-09-21T07:32:50.528898+0000","last_undegraded":"2024-09-21T07:32:50.528898+0000","last_fullsized":"2024-09-21T07:32:50.528898+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:34.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530381+0000","last_change":"2024-09-21T07:32:48.532342+0000","last_active":"2024-09-21T07:32:50.530381+0000","last_peered":"2024-09-21T07:32:50.530381+0000","last_clean":"2024-09-21T07:32:50.530381+0000","last_became_active":"2024-09-21T07:32:48.532002+0000","last_became_peered":"2024-09-21T07:32:48.532002+0000","last_unstale":"2024-09-21T07:32:50.530381+0000","last_undegraded":"2024-09-21T07:32:50.530381+0000","last_fullsized":"2024-09-21T07:32:50.530381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:42.461557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959023+0000","last_change":"2024-09-21T07:32:49.535888+0000","last_active":"2024-09-21T07:32:51.959023+0000","last_peered":"2024-09-21T07:32:51.959023+0000","last_clean":"2024-09-21T07:32:51.959023+0000","last_became_active":"2024-09-21T07:32:49.535305+0000","last_became_peered":"2024-09-21T07:32:49.535305+0000","last_unstale":"2024-09-21T07:32:51.959023+0000","last_undegraded":"2024-09-21T07:32:51.959023+0000","last_fullsized":"2024-09-21T07:32:51.959023+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:02.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500798+0000","last_change":"2024-09-21T07:32:48.529159+0000","last_active":"2024-09-21T07:32:51.500798+0000","last_peered":"2024-09-21T07:32:51.500798+0000","last_clean":"2024-09-21T07:32:51.500798+0000","last_became_active":"2024-09-21T07:32:48.528659+0000","last_became_peered":"2024-09-21T07:32:48.528659+0000","last_unstale":"2024-09-21T07:32:51.500798+0000","last_undegraded":"2024-09-21T07:32:51.500798+0000","last_fullsized":"2024-09-21T07:32:51.500798+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:25.286273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959334+0000","last_change":"2024-09-21T07:32:49.526431+0000","last_active":"2024-09-21T07:32:51.959334+0000","last_peered":"2024-09-21T07:32:51.959334+0000","last_clean":"2024-09-21T07:32:51.959334+0000","last_became_active":"2024-09-21T07:32:49.526105+0000","last_became_peered":"2024-09-21T07:32:49.526105+0000","last_unstale":"2024-09-21T07:32:51.959334+0000","last_undegraded":"2024-09-21T07:32:51.959334+0000","last_fullsized":"2024-09-21T07:32:51.959334+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:54.389862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"152'3","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959043+0000","last_change":"2024-09-21T07:32:48.528147+0000","last_active":"2024-09-21T07:32:51.959043+0000","last_peered":"2024-09-21T07:32:51.959043+0000","last_clean":"2024-09-21T07:32:51.959043+0000","last_became_active":"2024-09-21T07:32:48.527843+0000","last_became_peered":"2024-09-21T07:32:48.527843+0000","last_unstale":"2024-09-21T07:32:51.959043+0000","last_undegraded":"2024-09-21T07:32:51.959043+0000","last_fullsized":"2024-09-21T07:32:51.959043+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:50.158382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528148+0000","last_change":"2024-09-21T07:32:49.530447+0000","last_active":"2024-09-21T07:32:50.528148+0000","last_peered":"2024-09-21T07:32:50.528148+0000","last_clean":"2024-09-21T07:32:50.528148+0000","last_became_active":"2024-09-21T07:32:49.530050+0000","last_became_peered":"2024-09-21T07:32:49.530050+0000","last_unstale":"2024-09-21T07:32:50.528148+0000","last_undegraded":"2024-09-21T07:32:50.528148+0000","last_fullsized":"2024-09-21T07:32:50.528148+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.217052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528537+0000","last_change":"2024-09-21T07:32:48.526875+0000","last_active":"2024-09-21T07:32:50.528537+0000","last_peered":"2024-09-21T07:32:50.528537+0000","last_clean":"2024-09-21T07:32:50.528537+0000","last_became_active":"2024-09-21T07:32:48.525139+0000","last_became_peered":"2024-09-21T07:32:48.525139+0000","last_unstale":"2024-09-21T07:32:50.528537+0000","last_undegraded":"2024-09-21T07:32:50.528537+0000","last_fullsized":"2024-09-21T07:32:50.528537+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:56.747604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957270+0000","last_change":"2024-09-21T07:32:49.541944+0000","last_active":"2024-09-21T07:32:51.957270+0000","last_peered":"2024-09-21T07:32:51.957270+0000","last_clean":"2024-09-21T07:32:51.957270+0000","last_became_active":"2024-09-21T07:32:49.541144+0000","last_became_peered":"2024-09-21T07:32:49.541144+0000","last_unstale":"2024-09-21T07:32:51.957270+0000","last_undegraded":"2024-09-21T07:32:51.957270+0000","last_fullsized":"2024-09-21T07:32:51.957270+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:33.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957341+0000","last_change":"2024-09-21T07:32:48.528524+0000","last_active":"2024-09-21T07:32:51.957341+0000","last_peered":"2024-09-21T07:32:51.957341+0000","last_clean":"2024-09-21T07:32:51.957341+0000","last_became_active":"2024-09-21T07:32:48.528203+0000","last_became_peered":"2024-09-21T07:32:48.528203+0000","last_unstale":"2024-09-21T07:32:51.957341+0000","last_undegraded":"2024-09-21T07:32:51.957341+0000","last_fullsized":"2024-09-21T07:32:51.957341+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:36.219708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527913+0000","last_change":"2024-09-21T07:32:49.526016+0000","last_active":"2024-09-21T07:32:50.527913+0000","last_peered":"2024-09-21T07:32:50.527913+0000","last_clean":"2024-09-21T07:32:50.527913+0000","last_became_active":"2024-09-21T07:32:49.525695+0000","last_became_peered":"2024-09-21T07:32:49.525695+0000","last_unstale":"2024-09-21T07:32:50.527913+0000","last_undegraded":"2024-09-21T07:32:50.527913+0000","last_fullsized":"2024-09-21T07:32:50.527913+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:21.254601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957761+0000","last_change":"2024-09-21T07:32:48.527969+0000","last_active":"2024-09-21T07:32:51.957761+0000","last_peered":"2024-09-21T07:32:51.957761+0000","last_clean":"2024-09-21T07:32:51.957761+0000","last_became_active":"2024-09-21T07:32:48.527659+0000","last_became_peered":"2024-09-21T07:32:48.527659+0000","last_unstale":"2024-09-21T07:32:51.957761+0000","last_undegraded":"2024-09-21T07:32:51.957761+0000","last_fullsized":"2024-09-21T07:32:51.957761+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:17.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957865+0000","last_change":"2024-09-21T07:32:49.543492+0000","last_active":"2024-09-21T07:32:51.957865+0000","last_peered":"2024-09-21T07:32:51.957865+0000","last_clean":"2024-09-21T07:32:51.957865+0000","last_became_active":"2024-09-21T07:32:49.543195+0000","last_became_peered":"2024-09-21T07:32:49.543195+0000","last_unstale":"2024-09-21T07:32:51.957865+0000","last_undegraded":"2024-09-21T07:32:51.957865+0000","last_fullsized":"2024-09-21T07:32:51.957865+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:32.634615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"152'8","reported_seq":23,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.499802+0000","last_change":"2024-09-21T07:32:48.536189+0000","last_active":"2024-09-21T07:32:51.499802+0000","last_peered":"2024-09-21T07:32:51.499802+0000","last_clean":"2024-09-21T07:32:51.499802+0000","last_became_active":"2024-09-21T07:32:48.535866+0000","last_became_peered":"2024-09-21T07:32:48.535866+0000","last_unstale":"2024-09-21T07:32:51.499802+0000","last_undegraded":"2024-09-21T07:32:51.499802+0000","last_fullsized":"2024-09-21T07:32:51.499802+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:55.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529480+0000","last_change":"2024-09-21T07:32:49.551375+0000","last_active":"2024-09-21T07:32:50.529480+0000","last_peered":"2024-09-21T07:32:50.529480+0000","last_clean":"2024-09-21T07:32:50.529480+0000","last_became_active":"2024-09-21T07:32:49.549734+0000","last_became_peered":"2024-09-21T07:32:49.549734+0000","last_unstale":"2024-09-21T07:32:50.529480+0000","last_undegraded":"2024-09-21T07:32:50.529480+0000","last_fullsized":"2024-09-21T07:32:50.529480+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:39.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959178+0000","last_change":"2024-09-21T07:32:48.533769+0000","last_active":"2024-09-21T07:32:51.959178+0000","last_peered":"2024-09-21T07:32:51.959178+0000","last_clean":"2024-09-21T07:32:51.959178+0000","last_became_active":"2024-09-21T07:32:48.533300+0000","last_became_peered":"2024-09-21T07:32:48.533300+0000","last_unstale":"2024-09-21T07:32:51.959178+0000","last_undegraded":"2024-09-21T07:32:51.959178+0000","last_fullsized":"2024-09-21T07:32:51.959178+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:46.497229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530081+0000","last_change":"2024-09-21T07:32:49.547246+0000","last_active":"2024-09-21T07:32:50.530081+0000","last_peered":"2024-09-21T07:32:50.530081+0000","last_clean":"2024-09-21T07:32:50.530081+0000","last_became_active":"2024-09-21T07:32:49.546462+0000","last_became_peered":"2024-09-21T07:32:49.546462+0000","last_unstale":"2024-09-21T07:32:50.530081+0000","last_undegraded":"2024-09-21T07:32:50.530081+0000","last_fullsized":"2024-09-21T07:32:50.530081+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:22.473239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529499+0000","last_change":"2024-09-21T07:32:48.530017+0000","last_active":"2024-09-21T07:32:50.529499+0000","last_peered":"2024-09-21T07:32:50.529499+0000","last_clean":"2024-09-21T07:32:50.529499+0000","last_became_active":"2024-09-21T07:32:48.529711+0000","last_became_peered":"2024-09-21T07:32:48.529711+0000","last_unstale":"2024-09-21T07:32:50.529499+0000","last_undegraded":"2024-09-21T07:32:50.529499+0000","last_fullsized":"2024-09-21T07:32:50.529499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:05.045200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500738+0000","last_change":"2024-09-21T07:32:49.541990+0000","last_active":"2024-09-21T07:32:51.500738+0000","last_peered":"2024-09-21T07:32:51.500738+0000","last_clean":"2024-09-21T07:32:51.500738+0000","last_became_active":"2024-09-21T07:32:49.541622+0000","last_became_peered":"2024-09-21T07:32:49.541622+0000","last_unstale":"2024-09-21T07:32:51.500738+0000","last_undegraded":"2024-09-21T07:32:51.500738+0000","last_fullsized":"2024-09-21T07:32:51.500738+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:06.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958293+0000","last_change":"2024-09-21T07:32:48.527939+0000","last_active":"2024-09-21T07:32:51.958293+0000","last_peered":"2024-09-21T07:32:51.958293+0000","last_clean":"2024-09-21T07:32:51.958293+0000","last_became_active":"2024-09-21T07:32:48.526482+0000","last_became_peered":"2024-09-21T07:32:48.526482+0000","last_unstale":"2024-09-21T07:32:51.958293+0000","last_undegraded":"2024-09-21T07:32:51.958293+0000","last_fullsized":"2024-09-21T07:32:51.958293+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:17.692988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500933+0000","last_change":"2024-09-21T07:32:49.536201+0000","last_active":"2024-09-21T07:32:51.500933+0000","last_peered":"2024-09-21T07:32:51.500933+0000","last_clean":"2024-09-21T07:32:51.500933+0000","last_became_active":"2024-09-21T07:32:49.530993+0000","last_became_peered":"2024-09-21T07:32:49.530993+0000","last_unstale":"2024-09-21T07:32:51.500933+0000","last_undegraded":"2024-09-21T07:32:51.500933+0000","last_fullsized":"2024-09-21T07:32:51.500933+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:40.435135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957779+0000","last_change":"2024-09-21T07:32:48.527756+0000","last_active":"2024-09-21T07:32:51.957779+0000","last_peered":"2024-09-21T07:32:51.957779+0000","last_clean":"2024-09-21T07:32:51.957779+0000","last_became_active":"2024-09-21T07:32:48.527117+0000","last_became_peered":"2024-09-21T07:32:48.527117+0000","last_unstale":"2024-09-21T07:32:51.957779+0000","last_undegraded":"2024-09-21T07:32:51.957779+0000","last_fullsized":"2024-09-21T07:32:51.957779+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:58.085932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529271+0000","last_change":"2024-09-21T07:32:49.538978+0000","last_active":"2024-09-21T07:32:50.529271+0000","last_peered":"2024-09-21T07:32:50.529271+0000","last_clean":"2024-09-21T07:32:50.529271+0000","last_became_active":"2024-09-21T07:32:49.538673+0000","last_became_peered":"2024-09-21T07:32:49.538673+0000","last_unstale":"2024-09-21T07:32:50.529271+0000","last_undegraded":"2024-09-21T07:32:50.529271+0000","last_fullsized":"2024-09-21T07:32:50.529271+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:00.918830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957577+0000","last_change":"2024-09-21T07:32:48.520778+0000","last_active":"2024-09-21T07:32:51.957577+0000","last_peered":"2024-09-21T07:32:51.957577+0000","last_clean":"2024-09-21T07:32:51.957577+0000","last_became_active":"2024-09-21T07:32:48.520476+0000","last_became_peered":"2024-09-21T07:32:48.520476+0000","last_unstale":"2024-09-21T07:32:51.957577+0000","last_undegraded":"2024-09-21T07:32:51.957577+0000","last_fullsized":"2024-09-21T07:32:51.957577+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:04.277591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957428+0000","last_change":"2024-09-21T07:32:49.537747+0000","last_active":"2024-09-21T07:32:51.957428+0000","last_peered":"2024-09-21T07:32:51.957428+0000","last_clean":"2024-09-21T07:32:51.957428+0000","last_became_active":"2024-09-21T07:32:49.536896+0000","last_became_peered":"2024-09-21T07:32:49.536896+0000","last_unstale":"2024-09-21T07:32:51.957428+0000","last_undegraded":"2024-09-21T07:32:51.957428+0000","last_fullsized":"2024-09-21T07:32:51.957428+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:15.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528392+0000","last_change":"2024-09-21T07:32:48.526249+0000","last_active":"2024-09-21T07:32:50.528392+0000","last_peered":"2024-09-21T07:32:50.528392+0000","last_clean":"2024-09-21T07:32:50.528392+0000","last_became_active":"2024-09-21T07:32:48.525953+0000","last_became_peered":"2024-09-21T07:32:48.525953+0000","last_unstale":"2024-09-21T07:32:50.528392+0000","last_undegraded":"2024-09-21T07:32:50.528392+0000","last_fullsized":"2024-09-21T07:32:50.528392+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:42.458271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529149+0000","last_change":"2024-09-21T07:32:49.539273+0000","last_active":"2024-09-21T07:32:50.529149+0000","last_peered":"2024-09-21T07:32:50.529149+0000","last_clean":"2024-09-21T07:32:50.529149+0000","last_became_active":"2024-09-21T07:32:49.537553+0000","last_became_peered":"2024-09-21T07:32:49.537553+0000","last_unstale":"2024-09-21T07:32:50.529149+0000","last_undegraded":"2024-09-21T07:32:50.529149+0000","last_fullsized":"2024-09-21T07:32:50.529149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:57.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958005+0000","last_change":"2024-09-21T07:32:48.520006+0000","last_active":"2024-09-21T07:32:51.958005+0000","last_peered":"2024-09-21T07:32:51.958005+0000","last_clean":"2024-09-21T07:32:51.958005+0000","last_became_active":"2024-09-21T07:32:48.519666+0000","last_became_peered":"2024-09-21T07:32:48.519666+0000","last_unstale":"2024-09-21T07:32:51.958005+0000","last_undegraded":"2024-09-21T07:32:51.958005+0000","last_fullsized":"2024-09-21T07:32:51.958005+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.107846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958011+0000","last_change":"2024-09-21T07:32:49.543685+0000","last_active":"2024-09-21T07:32:51.958011+0000","last_peered":"2024-09-21T07:32:51.958011+0000","last_clean":"2024-09-21T07:32:51.958011+0000","last_became_active":"2024-09-21T07:32:49.543396+0000","last_became_peered":"2024-09-21T07:32:49.543396+0000","last_unstale":"2024-09-21T07:32:51.958011+0000","last_undegraded":"2024-09-21T07:32:51.958011+0000","last_fullsized":"2024-09-21T07:32:51.958011+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:12.974104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528211+0000","last_change":"2024-09-21T07:32:48.523234+0000","last_active":"2024-09-21T07:32:50.528211+0000","last_peered":"2024-09-21T07:32:50.528211+0000","last_clean":"2024-09-21T07:32:50.528211+0000","last_became_active":"2024-09-21T07:32:48.522912+0000","last_became_peered":"2024-09-21T07:32:48.522912+0000","last_unstale":"2024-09-21T07:32:50.528211+0000","last_undegraded":"2024-09-21T07:32:50.528211+0000","last_fullsized":"2024-09-21T07:32:50.528211+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:07.332953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528083+0000","last_change":"2024-09-21T07:32:49.546859+0000","last_active":"2024-09-21T07:32:50.528083+0000","last_peered":"2024-09-21T07:32:50.528083+0000","last_clean":"2024-09-21T07:32:50.528083+0000","last_became_active":"2024-09-21T07:32:49.546525+0000","last_became_peered":"2024-09-21T07:32:49.546525+0000","last_unstale":"2024-09-21T07:32:50.528083+0000","last_undegraded":"2024-09-21T07:32:50.528083+0000","last_fullsized":"2024-09-21T07:32:50.528083+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:22.234805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958045+0000","last_change":"2024-09-21T07:32:48.530785+0000","last_active":"2024-09-21T07:32:51.958045+0000","last_peered":"2024-09-21T07:32:51.958045+0000","last_clean":"2024-09-21T07:32:51.958045+0000","last_became_active":"2024-09-21T07:32:48.530171+0000","last_became_peered":"2024-09-21T07:32:48.530171+0000","last_unstale":"2024-09-21T07:32:51.958045+0000","last_undegraded":"2024-09-21T07:32:51.958045+0000","last_fullsized":"2024-09-21T07:32:51.958045+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:25.514027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957833+0000","last_change":"2024-09-21T07:32:49.537292+0000","last_active":"2024-09-21T07:32:51.957833+0000","last_peered":"2024-09-21T07:32:51.957833+0000","last_clean":"2024-09-21T07:32:51.957833+0000","last_became_active":"2024-09-21T07:32:49.536943+0000","last_became_peered":"2024-09-21T07:32:49.536943+0000","last_unstale":"2024-09-21T07:32:51.957833+0000","last_undegraded":"2024-09-21T07:32:51.957833+0000","last_fullsized":"2024-09-21T07:32:51.957833+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:35.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"153'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500933+0000","last_change":"2024-09-21T07:32:48.534626+0000","last_active":"2024-09-21T07:32:51.500933+0000","last_peered":"2024-09-21T07:32:51.500933+0000","last_clean":"2024-09-21T07:32:51.500933+0000","last_became_active":"2024-09-21T07:32:48.534312+0000","last_became_peered":"2024-09-21T07:32:48.534312+0000","last_unstale":"2024-09-21T07:32:51.500933+0000","last_undegraded":"2024-09-21T07:32:51.500933+0000","last_fullsized":"2024-09-21T07:32:51.500933+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.432302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500956+0000","last_change":"2024-09-21T07:32:49.532054+0000","last_active":"2024-09-21T07:32:51.500956+0000","last_peered":"2024-09-21T07:32:51.500956+0000","last_clean":"2024-09-21T07:32:51.500956+0000","last_became_active":"2024-09-21T07:32:49.530843+0000","last_became_peered":"2024-09-21T07:32:49.530843+0000","last_unstale":"2024-09-21T07:32:51.500956+0000","last_undegraded":"2024-09-21T07:32:51.500956+0000","last_fullsized":"2024-09-21T07:32:51.500956+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:43.851694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958413+0000","last_change":"2024-09-21T07:32:48.531905+0000","last_active":"2024-09-21T07:32:51.958413+0000","last_peered":"2024-09-21T07:32:51.958413+0000","last_clean":"2024-09-21T07:32:51.958413+0000","last_became_active":"2024-09-21T07:32:48.531352+0000","last_became_peered":"2024-09-21T07:32:48.531352+0000","last_unstale":"2024-09-21T07:32:51.958413+0000","last_undegraded":"2024-09-21T07:32:51.958413+0000","last_fullsized":"2024-09-21T07:32:51.958413+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:42.128667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528189+0000","last_change":"2024-09-21T07:32:49.545756+0000","last_active":"2024-09-21T07:32:50.528189+0000","last_peered":"2024-09-21T07:32:50.528189+0000","last_clean":"2024-09-21T07:32:50.528189+0000","last_became_active":"2024-09-21T07:32:49.545444+0000","last_became_peered":"2024-09-21T07:32:49.545444+0000","last_unstale":"2024-09-21T07:32:50.528189+0000","last_undegraded":"2024-09-21T07:32:50.528189+0000","last_fullsized":"2024-09-21T07:32:50.528189+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:53.064872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528102+0000","last_change":"2024-09-21T07:32:48.526416+0000","last_active":"2024-09-21T07:32:50.528102+0000","last_peered":"2024-09-21T07:32:50.528102+0000","last_clean":"2024-09-21T07:32:50.528102+0000","last_became_active":"2024-09-21T07:32:48.525689+0000","last_became_peered":"2024-09-21T07:32:48.525689+0000","last_unstale":"2024-09-21T07:32:50.528102+0000","last_undegraded":"2024-09-21T07:32:50.528102+0000","last_fullsized":"2024-09-21T07:32:50.528102+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:59.916186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528279+0000","last_change":"2024-09-21T07:32:49.520290+0000","last_active":"2024-09-21T07:32:50.528279+0000","last_peered":"2024-09-21T07:32:50.528279+0000","last_clean":"2024-09-21T07:32:50.528279+0000","last_became_active":"2024-09-21T07:32:49.519968+0000","last_became_peered":"2024-09-21T07:32:49.519968+0000","last_unstale":"2024-09-21T07:32:50.528279+0000","last_undegraded":"2024-09-21T07:32:50.528279+0000","last_fullsized":"2024-09-21T07:32:50.528279+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:26.288917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500231+0000","last_change":"2024-09-21T07:32:48.532269+0000","last_active":"2024-09-21T07:32:51.500231+0000","last_peered":"2024-09-21T07:32:51.500231+0000","last_clean":"2024-09-21T07:32:51.500231+0000","last_became_active":"2024-09-21T07:32:48.531937+0000","last_became_peered":"2024-09-21T07:32:48.531937+0000","last_unstale":"2024-09-21T07:32:51.500231+0000","last_undegraded":"2024-09-21T07:32:51.500231+0000","last_fullsized":"2024-09-21T07:32:51.500231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:58.918030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957663+0000","last_change":"2024-09-21T07:32:49.547828+0000","last_active":"2024-09-21T07:32:51.957663+0000","last_peered":"2024-09-21T07:32:51.957663+0000","last_clean":"2024-09-21T07:32:51.957663+0000","last_became_active":"2024-09-21T07:32:49.547522+0000","last_became_peered":"2024-09-21T07:32:49.547522+0000","last_unstale":"2024-09-21T07:32:51.957663+0000","last_undegraded":"2024-09-21T07:32:51.957663+0000","last_fullsized":"2024-09-21T07:32:51.957663+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:33.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958587+0000","last_change":"2024-09-21T07:32:48.523852+0000","last_active":"2024-09-21T07:32:51.958587+0000","last_peered":"2024-09-21T07:32:51.958587+0000","last_clean":"2024-09-21T07:32:51.958587+0000","last_became_active":"2024-09-21T07:32:48.523545+0000","last_became_peered":"2024-09-21T07:32:48.523545+0000","last_unstale":"2024-09-21T07:32:51.958587+0000","last_undegraded":"2024-09-21T07:32:51.958587+0000","last_fullsized":"2024-09-21T07:32:51.958587+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:12.471302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957757+0000","last_change":"2024-09-21T07:32:49.546338+0000","last_active":"2024-09-21T07:32:51.957757+0000","last_peered":"2024-09-21T07:32:51.957757+0000","last_clean":"2024-09-21T07:32:51.957757+0000","last_became_active":"2024-09-21T07:32:49.544466+0000","last_became_peered":"2024-09-21T07:32:49.544466+0000","last_unstale":"2024-09-21T07:32:51.957757+0000","last_undegraded":"2024-09-21T07:32:51.957757+0000","last_fullsized":"2024-09-21T07:32:51.957757+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:10.483312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500057+0000","last_change":"2024-09-21T07:32:48.526101+0000","last_active":"2024-09-21T07:32:51.500057+0000","last_peered":"2024-09-21T07:32:51.500057+0000","last_clean":"2024-09-21T07:32:51.500057+0000","last_became_active":"2024-09-21T07:32:48.525807+0000","last_became_peered":"2024-09-21T07:32:48.525807+0000","last_unstale":"2024-09-21T07:32:51.500057+0000","last_undegraded":"2024-09-21T07:32:51.500057+0000","last_fullsized":"2024-09-21T07:32:51.500057+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:42.392920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529792+0000","last_change":"2024-09-21T07:32:49.538001+0000","last_active":"2024-09-21T07:32:50.529792+0000","last_peered":"2024-09-21T07:32:50.529792+0000","last_clean":"2024-09-21T07:32:50.529792+0000","last_became_active":"2024-09-21T07:32:49.537606+0000","last_became_peered":"2024-09-21T07:32:49.537606+0000","last_unstale":"2024-09-21T07:32:50.529792+0000","last_undegraded":"2024-09-21T07:32:50.529792+0000","last_fullsized":"2024-09-21T07:32:50.529792+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:10.468288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529281+0000","last_change":"2024-09-21T07:32:48.534141+0000","last_active":"2024-09-21T07:32:50.529281+0000","last_peered":"2024-09-21T07:32:50.529281+0000","last_clean":"2024-09-21T07:32:50.529281+0000","last_became_active":"2024-09-21T07:32:48.533349+0000","last_became_peered":"2024-09-21T07:32:48.533349+0000","last_unstale":"2024-09-21T07:32:50.529281+0000","last_undegraded":"2024-09-21T07:32:50.529281+0000","last_fullsized":"2024-09-21T07:32:50.529281+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:51.811326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529924+0000","last_change":"2024-09-21T07:32:49.529981+0000","last_active":"2024-09-21T07:32:50.529924+0000","last_peered":"2024-09-21T07:32:50.529924+0000","last_clean":"2024-09-21T07:32:50.529924+0000","last_became_active":"2024-09-21T07:32:49.529615+0000","last_became_peered":"2024-09-21T07:32:49.529615+0000","last_unstale":"2024-09-21T07:32:50.529924+0000","last_undegraded":"2024-09-21T07:32:50.529924+0000","last_fullsized":"2024-09-21T07:32:50.529924+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:52.272833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"152'6","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957753+0000","last_change":"2024-09-21T07:32:48.526383+0000","last_active":"2024-09-21T07:32:51.957753+0000","last_peered":"2024-09-21T07:32:51.957753+0000","last_clean":"2024-09-21T07:32:51.957753+0000","last_became_active":"2024-09-21T07:32:48.526040+0000","last_became_peered":"2024-09-21T07:32:48.526040+0000","last_unstale":"2024-09-21T07:32:51.957753+0000","last_undegraded":"2024-09-21T07:32:51.957753+0000","last_fullsized":"2024-09-21T07:32:51.957753+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:39.548031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":350,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529355+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:32:50.529355+0000","last_peered":"2024-09-21T07:32:50.529355+0000","last_clean":"2024-09-21T07:32:50.529355+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:32:50.529355+0000","last_undegraded":"2024-09-21T07:32:50.529355+0000","last_fullsized":"2024-09-21T07:32:50.529355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509567,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51104,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320736,"statfs":{"total":96636764160,"available":96584433664,"internally_reserved":0,"allocated":1912832,"data_stored":899751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509567,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51100,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320740,"statfs":{"total":96636764160,"available":96584437760,"internally_reserved":0,"allocated":1908736,"data_stored":899681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509567,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":1921024,"data_stored":901293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1916928,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1912832,"data_stored":899751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509567,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":2527232,"data_stored":1492367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51692,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320148,"statfs":{"total":96636764160,"available":96583831552,"internally_reserved":0,"allocated":2506752,"data_stored":1490071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":1904640,"data_stored":893605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:32:53.731 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- 172.21.15.64:0/2291462102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d806f620 msgr2=0x7f84d806fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 --2- 172.21.15.64:0/2291462102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d806f620 0x7f84d806fa30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f84d8072af0 tx=0x7f84d001cb50 comp rx=0 tx=0).stop 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- 172.21.15.64:0/2291462102 shutdown_connections 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 --2- 172.21.15.64:0/2291462102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d806f620 0x7f84d806fa30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 --2- 172.21.15.64:0/2291462102 >> v2:172.21.15.90:3300/0 conn(0x7f84d806d020 0x7f84d806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- 172.21.15.64:0/2291462102 >> 172.21.15.64:0/2291462102 conn(0x7f84d80d0de0 msgr2=0x7f84d80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- 172.21.15.64:0/2291462102 shutdown_connections 2024-09-21T07:32:53.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- 172.21.15.64:0/2291462102 wait complete. 2024-09-21T07:32:53.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 Processor -- start 2024-09-21T07:32:53.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.924+0000 7f84df200640 1 -- start start 2024-09-21T07:32:53.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84d806d020 0x7f84d80ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84d806f620 0x7f84d8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8168be0 con 0x7f84d815b810 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8168a60 con 0x7f84d806f620 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f84d8168d60 con 0x7f84d806d020 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57774/0 (socket says 172.21.15.64:57774) 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 -- 172.21.15.64:0/836552155 learned_addr learned my addr 172.21.15.64:0/836552155 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84cfe00640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84d806f620 0x7f84d8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84d7e00640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84d806d020 0x7f84d80ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 -- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84d806d020 msgr2=0x7f84d80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84d806d020 0x7f84d80ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 -- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84d806f620 msgr2=0x7f84d8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84d806f620 0x7f84d8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 -- 172.21.15.64:0/836552155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d81564f0 con 0x7f84d815b810 2024-09-21T07:32:53.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84dd200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f84d001a780 tx=0x7f84d0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00bc070 con 0x7f84d815b810 2024-09-21T07:32:53.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84d00042f0 con 0x7f84d815b810 2024-09-21T07:32:53.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d8144aa0 con 0x7f84d815b810 2024-09-21T07:32:53.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00b2040 con 0x7f84d815b810 2024-09-21T07:32:53.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d8156a70 con 0x7f84d815b810 2024-09-21T07:32:53.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d806d430 con 0x7f84d815b810 2024-09-21T07:32:53.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.928+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f84d00bf070 con 0x7f84d815b810 2024-09-21T07:32:53.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.932+0000 7f84d4c00640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 0x7f84b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.932+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f84d012e3d0 con 0x7f84d815b810 2024-09-21T07:32:53.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.932+0000 7f84d7e00640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 0x7f84b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.932+0000 7f84d7e00640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 0x7f84b4075710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f84c80015f0 tx=0x7f84c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:53.936+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f84d8144aa0 con 0x7f84d815b810 2024-09-21T07:32:54.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.108+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84d80b5c10 con 0x7f84b4073200 2024-09-21T07:32:54.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.112+0000 7f84d4c00640 1 -- 172.21.15.64:0/836552155 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f84d80b5c10 con 0x7f84b4073200 2024-09-21T07:32:54.117 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:54.118 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:32:54.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 msgr2=0x7f84b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 0x7f84b4075710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f84c80015f0 tx=0x7f84c8009040 comp rx=0 tx=0).stop 2024-09-21T07:32:54.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 msgr2=0x7f84d8143bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f84d001a780 tx=0x7f84d0009310 comp rx=0 tx=0).stop 2024-09-21T07:32:54.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 shutdown_connections 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84b4073200 0x7f84b4075710 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84d815b810 0x7f84d8143bd0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84d806f620 0x7f84d8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 --2- 172.21.15.64:0/836552155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84d806d020 0x7f84d80ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 >> 172.21.15.64:0/836552155 conn(0x7f84d80d0de0 msgr2=0x7f84d815ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 shutdown_connections 2024-09-21T07:32:54.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.116+0000 7f84df200640 1 -- 172.21.15.64:0/836552155 wait complete. 2024-09-21T07:32:54.139 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-09-21T07:32:53.586140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430832,"kb_used_data":16124,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754543888,"statfs":{"total":773094113280,"available":772652941312,"internally_reserved":0,"allocated":16510976,"data_stored":8376312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":424463923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001747"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500797+0000","last_change":"2024-09-21T07:32:49.533433+0000","last_active":"2024-09-21T07:32:51.500797+0000","last_peered":"2024-09-21T07:32:51.500797+0000","last_clean":"2024-09-21T07:32:51.500797+0000","last_became_active":"2024-09-21T07:32:49.531638+0000","last_became_peered":"2024-09-21T07:32:49.531638+0000","last_unstale":"2024-09-21T07:32:51.500797+0000","last_undegraded":"2024-09-21T07:32:51.500797+0000","last_fullsized":"2024-09-21T07:32:51.500797+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:35.852564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958724+0000","last_change":"2024-09-21T07:32:49.538781+0000","last_active":"2024-09-21T07:32:51.958724+0000","last_peered":"2024-09-21T07:32:51.958724+0000","last_clean":"2024-09-21T07:32:51.958724+0000","last_became_active":"2024-09-21T07:32:49.538172+0000","last_became_peered":"2024-09-21T07:32:49.538172+0000","last_unstale":"2024-09-21T07:32:51.958724+0000","last_undegraded":"2024-09-21T07:32:51.958724+0000","last_fullsized":"2024-09-21T07:32:51.958724+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:04.638263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958223+0000","last_change":"2024-09-21T07:32:49.535553+0000","last_active":"2024-09-21T07:32:51.958223+0000","last_peered":"2024-09-21T07:32:51.958223+0000","last_clean":"2024-09-21T07:32:51.958223+0000","last_became_active":"2024-09-21T07:32:49.535207+0000","last_became_peered":"2024-09-21T07:32:49.535207+0000","last_unstale":"2024-09-21T07:32:51.958223+0000","last_undegraded":"2024-09-21T07:32:51.958223+0000","last_fullsized":"2024-09-21T07:32:51.958223+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:55.012724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957777+0000","last_change":"2024-09-21T07:32:49.525365+0000","last_active":"2024-09-21T07:32:51.957777+0000","last_peered":"2024-09-21T07:32:51.957777+0000","last_clean":"2024-09-21T07:32:51.957777+0000","last_became_active":"2024-09-21T07:32:49.525017+0000","last_became_peered":"2024-09-21T07:32:49.525017+0000","last_unstale":"2024-09-21T07:32:51.957777+0000","last_undegraded":"2024-09-21T07:32:51.957777+0000","last_fullsized":"2024-09-21T07:32:51.957777+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:20.404643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528531+0000","last_change":"2024-09-21T07:32:49.548091+0000","last_active":"2024-09-21T07:32:50.528531+0000","last_peered":"2024-09-21T07:32:50.528531+0000","last_clean":"2024-09-21T07:32:50.528531+0000","last_became_active":"2024-09-21T07:32:49.547331+0000","last_became_peered":"2024-09-21T07:32:49.547331+0000","last_unstale":"2024-09-21T07:32:50.528531+0000","last_undegraded":"2024-09-21T07:32:50.528531+0000","last_fullsized":"2024-09-21T07:32:50.528531+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:33.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527764+0000","last_change":"2024-09-21T07:32:49.533219+0000","last_active":"2024-09-21T07:32:50.527764+0000","last_peered":"2024-09-21T07:32:50.527764+0000","last_clean":"2024-09-21T07:32:50.527764+0000","last_became_active":"2024-09-21T07:32:49.532739+0000","last_became_peered":"2024-09-21T07:32:49.532739+0000","last_unstale":"2024-09-21T07:32:50.527764+0000","last_undegraded":"2024-09-21T07:32:50.527764+0000","last_fullsized":"2024-09-21T07:32:50.527764+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:04.432478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500190+0000","last_change":"2024-09-21T07:32:49.535151+0000","last_active":"2024-09-21T07:32:51.500190+0000","last_peered":"2024-09-21T07:32:51.500190+0000","last_clean":"2024-09-21T07:32:51.500190+0000","last_became_active":"2024-09-21T07:32:49.534847+0000","last_became_peered":"2024-09-21T07:32:49.534847+0000","last_unstale":"2024-09-21T07:32:51.500190+0000","last_undegraded":"2024-09-21T07:32:51.500190+0000","last_fullsized":"2024-09-21T07:32:51.500190+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:40.567255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527972+0000","last_change":"2024-09-21T07:32:49.523036+0000","last_active":"2024-09-21T07:32:50.527972+0000","last_peered":"2024-09-21T07:32:50.527972+0000","last_clean":"2024-09-21T07:32:50.527972+0000","last_became_active":"2024-09-21T07:32:49.522382+0000","last_became_peered":"2024-09-21T07:32:49.522382+0000","last_unstale":"2024-09-21T07:32:50.527972+0000","last_undegraded":"2024-09-21T07:32:50.527972+0000","last_fullsized":"2024-09-21T07:32:50.527972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:26.516670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527921+0000","last_change":"2024-09-21T07:32:49.543090+0000","last_active":"2024-09-21T07:32:50.527921+0000","last_peered":"2024-09-21T07:32:50.527921+0000","last_clean":"2024-09-21T07:32:50.527921+0000","last_became_active":"2024-09-21T07:32:49.542092+0000","last_became_peered":"2024-09-21T07:32:49.542092+0000","last_unstale":"2024-09-21T07:32:50.527921+0000","last_undegraded":"2024-09-21T07:32:50.527921+0000","last_fullsized":"2024-09-21T07:32:50.527921+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:02.045049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528049+0000","last_change":"2024-09-21T07:32:49.547596+0000","last_active":"2024-09-21T07:32:50.528049+0000","last_peered":"2024-09-21T07:32:50.528049+0000","last_clean":"2024-09-21T07:32:50.528049+0000","last_became_active":"2024-09-21T07:32:49.547275+0000","last_became_peered":"2024-09-21T07:32:49.547275+0000","last_unstale":"2024-09-21T07:32:50.528049+0000","last_undegraded":"2024-09-21T07:32:50.528049+0000","last_fullsized":"2024-09-21T07:32:50.528049+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:24.433604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958975+0000","last_change":"2024-09-21T07:32:49.536059+0000","last_active":"2024-09-21T07:32:51.958975+0000","last_peered":"2024-09-21T07:32:51.958975+0000","last_clean":"2024-09-21T07:32:51.958975+0000","last_became_active":"2024-09-21T07:32:49.535737+0000","last_became_peered":"2024-09-21T07:32:49.535737+0000","last_unstale":"2024-09-21T07:32:51.958975+0000","last_undegraded":"2024-09-21T07:32:51.958975+0000","last_fullsized":"2024-09-21T07:32:51.958975+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.321919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957687+0000","last_change":"2024-09-21T07:32:49.546155+0000","last_active":"2024-09-21T07:32:51.957687+0000","last_peered":"2024-09-21T07:32:51.957687+0000","last_clean":"2024-09-21T07:32:51.957687+0000","last_became_active":"2024-09-21T07:32:49.545822+0000","last_became_peered":"2024-09-21T07:32:49.545822+0000","last_unstale":"2024-09-21T07:32:51.957687+0000","last_undegraded":"2024-09-21T07:32:51.957687+0000","last_fullsized":"2024-09-21T07:32:51.957687+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:47.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528403+0000","last_change":"2024-09-21T07:32:49.548414+0000","last_active":"2024-09-21T07:32:50.528403+0000","last_peered":"2024-09-21T07:32:50.528403+0000","last_clean":"2024-09-21T07:32:50.528403+0000","last_became_active":"2024-09-21T07:32:49.547688+0000","last_became_peered":"2024-09-21T07:32:49.547688+0000","last_unstale":"2024-09-21T07:32:50.528403+0000","last_undegraded":"2024-09-21T07:32:50.528403+0000","last_fullsized":"2024-09-21T07:32:50.528403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:25.154260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957998+0000","last_change":"2024-09-21T07:32:49.539357+0000","last_active":"2024-09-21T07:32:51.957998+0000","last_peered":"2024-09-21T07:32:51.957998+0000","last_clean":"2024-09-21T07:32:51.957998+0000","last_became_active":"2024-09-21T07:32:49.536945+0000","last_became_peered":"2024-09-21T07:32:49.536945+0000","last_unstale":"2024-09-21T07:32:51.957998+0000","last_undegraded":"2024-09-21T07:32:51.957998+0000","last_fullsized":"2024-09-21T07:32:51.957998+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:31.532470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957208+0000","last_change":"2024-09-21T07:32:49.542316+0000","last_active":"2024-09-21T07:32:51.957208+0000","last_peered":"2024-09-21T07:32:51.957208+0000","last_clean":"2024-09-21T07:32:51.957208+0000","last_became_active":"2024-09-21T07:32:49.541568+0000","last_became_peered":"2024-09-21T07:32:49.541568+0000","last_unstale":"2024-09-21T07:32:51.957208+0000","last_undegraded":"2024-09-21T07:32:51.957208+0000","last_fullsized":"2024-09-21T07:32:51.957208+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:53.152222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527641+0000","last_change":"2024-09-21T07:32:49.529616+0000","last_active":"2024-09-21T07:32:50.527641+0000","last_peered":"2024-09-21T07:32:50.527641+0000","last_clean":"2024-09-21T07:32:50.527641+0000","last_became_active":"2024-09-21T07:32:49.529302+0000","last_became_peered":"2024-09-21T07:32:49.529302+0000","last_unstale":"2024-09-21T07:32:50.527641+0000","last_undegraded":"2024-09-21T07:32:50.527641+0000","last_fullsized":"2024-09-21T07:32:50.527641+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:14.350958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958213+0000","last_change":"2024-09-21T07:32:49.532464+0000","last_active":"2024-09-21T07:32:51.958213+0000","last_peered":"2024-09-21T07:32:51.958213+0000","last_clean":"2024-09-21T07:32:51.958213+0000","last_became_active":"2024-09-21T07:32:49.532097+0000","last_became_peered":"2024-09-21T07:32:49.532097+0000","last_unstale":"2024-09-21T07:32:51.958213+0000","last_undegraded":"2024-09-21T07:32:51.958213+0000","last_fullsized":"2024-09-21T07:32:51.958213+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:24.420090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959277+0000","last_change":"2024-09-21T07:32:49.531992+0000","last_active":"2024-09-21T07:32:51.959277+0000","last_peered":"2024-09-21T07:32:51.959277+0000","last_clean":"2024-09-21T07:32:51.959277+0000","last_became_active":"2024-09-21T07:32:49.531626+0000","last_became_peered":"2024-09-21T07:32:49.531626+0000","last_unstale":"2024-09-21T07:32:51.959277+0000","last_undegraded":"2024-09-21T07:32:51.959277+0000","last_fullsized":"2024-09-21T07:32:51.959277+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:26.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530045+0000","last_change":"2024-09-21T07:32:49.546402+0000","last_active":"2024-09-21T07:32:50.530045+0000","last_peered":"2024-09-21T07:32:50.530045+0000","last_clean":"2024-09-21T07:32:50.530045+0000","last_became_active":"2024-09-21T07:32:49.545682+0000","last_became_peered":"2024-09-21T07:32:49.545682+0000","last_unstale":"2024-09-21T07:32:50.530045+0000","last_undegraded":"2024-09-21T07:32:50.530045+0000","last_fullsized":"2024-09-21T07:32:50.530045+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:06.056072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957791+0000","last_change":"2024-09-21T07:32:49.531867+0000","last_active":"2024-09-21T07:32:51.957791+0000","last_peered":"2024-09-21T07:32:51.957791+0000","last_clean":"2024-09-21T07:32:51.957791+0000","last_became_active":"2024-09-21T07:32:49.531519+0000","last_became_peered":"2024-09-21T07:32:49.531519+0000","last_unstale":"2024-09-21T07:32:51.957791+0000","last_undegraded":"2024-09-21T07:32:51.957791+0000","last_fullsized":"2024-09-21T07:32:51.957791+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:00.179890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528290+0000","last_change":"2024-09-21T07:32:49.538114+0000","last_active":"2024-09-21T07:32:50.528290+0000","last_peered":"2024-09-21T07:32:50.528290+0000","last_clean":"2024-09-21T07:32:50.528290+0000","last_became_active":"2024-09-21T07:32:49.537791+0000","last_became_peered":"2024-09-21T07:32:49.537791+0000","last_unstale":"2024-09-21T07:32:50.528290+0000","last_undegraded":"2024-09-21T07:32:50.528290+0000","last_fullsized":"2024-09-21T07:32:50.528290+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:40.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500143+0000","last_change":"2024-09-21T07:32:49.539442+0000","last_active":"2024-09-21T07:32:51.500143+0000","last_peered":"2024-09-21T07:32:51.500143+0000","last_clean":"2024-09-21T07:32:51.500143+0000","last_became_active":"2024-09-21T07:32:49.535735+0000","last_became_peered":"2024-09-21T07:32:49.535735+0000","last_unstale":"2024-09-21T07:32:51.500143+0000","last_undegraded":"2024-09-21T07:32:51.500143+0000","last_fullsized":"2024-09-21T07:32:51.500143+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:20.253679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528025+0000","last_change":"2024-09-21T07:32:49.529193+0000","last_active":"2024-09-21T07:32:50.528025+0000","last_peered":"2024-09-21T07:32:50.528025+0000","last_clean":"2024-09-21T07:32:50.528025+0000","last_became_active":"2024-09-21T07:32:49.528363+0000","last_became_peered":"2024-09-21T07:32:49.528363+0000","last_unstale":"2024-09-21T07:32:50.528025+0000","last_undegraded":"2024-09-21T07:32:50.528025+0000","last_fullsized":"2024-09-21T07:32:50.528025+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:14.847817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958281+0000","last_change":"2024-09-21T07:32:49.539058+0000","last_active":"2024-09-21T07:32:51.958281+0000","last_peered":"2024-09-21T07:32:51.958281+0000","last_clean":"2024-09-21T07:32:51.958281+0000","last_became_active":"2024-09-21T07:32:49.537800+0000","last_became_peered":"2024-09-21T07:32:49.537800+0000","last_unstale":"2024-09-21T07:32:51.958281+0000","last_undegraded":"2024-09-21T07:32:51.958281+0000","last_fullsized":"2024-09-21T07:32:51.958281+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:00.938091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500728+0000","last_change":"2024-09-21T07:32:49.525513+0000","last_active":"2024-09-21T07:32:51.500728+0000","last_peered":"2024-09-21T07:32:51.500728+0000","last_clean":"2024-09-21T07:32:51.500728+0000","last_became_active":"2024-09-21T07:32:49.525195+0000","last_became_peered":"2024-09-21T07:32:49.525195+0000","last_unstale":"2024-09-21T07:32:51.500728+0000","last_undegraded":"2024-09-21T07:32:51.500728+0000","last_fullsized":"2024-09-21T07:32:51.500728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:04.761385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500709+0000","last_change":"2024-09-21T07:32:49.528486+0000","last_active":"2024-09-21T07:32:51.500709+0000","last_peered":"2024-09-21T07:32:51.500709+0000","last_clean":"2024-09-21T07:32:51.500709+0000","last_became_active":"2024-09-21T07:32:49.528093+0000","last_became_peered":"2024-09-21T07:32:49.528093+0000","last_unstale":"2024-09-21T07:32:51.500709+0000","last_undegraded":"2024-09-21T07:32:51.500709+0000","last_fullsized":"2024-09-21T07:32:51.500709+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:56.453673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528066+0000","last_change":"2024-09-21T07:32:49.537416+0000","last_active":"2024-09-21T07:32:50.528066+0000","last_peered":"2024-09-21T07:32:50.528066+0000","last_clean":"2024-09-21T07:32:50.528066+0000","last_became_active":"2024-09-21T07:32:49.537098+0000","last_became_peered":"2024-09-21T07:32:49.537098+0000","last_unstale":"2024-09-21T07:32:50.528066+0000","last_undegraded":"2024-09-21T07:32:50.528066+0000","last_fullsized":"2024-09-21T07:32:50.528066+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:01.332950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958970+0000","last_change":"2024-09-21T07:32:49.520499+0000","last_active":"2024-09-21T07:32:51.958970+0000","last_peered":"2024-09-21T07:32:51.958970+0000","last_clean":"2024-09-21T07:32:51.958970+0000","last_became_active":"2024-09-21T07:32:49.519608+0000","last_became_peered":"2024-09-21T07:32:49.519608+0000","last_unstale":"2024-09-21T07:32:51.958970+0000","last_undegraded":"2024-09-21T07:32:51.958970+0000","last_fullsized":"2024-09-21T07:32:51.958970+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:32.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528763+0000","last_change":"2024-09-21T07:32:49.533297+0000","last_active":"2024-09-21T07:32:50.528763+0000","last_peered":"2024-09-21T07:32:50.528763+0000","last_clean":"2024-09-21T07:32:50.528763+0000","last_became_active":"2024-09-21T07:32:49.532979+0000","last_became_peered":"2024-09-21T07:32:49.532979+0000","last_unstale":"2024-09-21T07:32:50.528763+0000","last_undegraded":"2024-09-21T07:32:50.528763+0000","last_fullsized":"2024-09-21T07:32:50.528763+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:53.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958703+0000","last_change":"2024-09-21T07:32:49.522471+0000","last_active":"2024-09-21T07:32:51.958703+0000","last_peered":"2024-09-21T07:32:51.958703+0000","last_clean":"2024-09-21T07:32:51.958703+0000","last_became_active":"2024-09-21T07:32:49.522165+0000","last_became_peered":"2024-09-21T07:32:49.522165+0000","last_unstale":"2024-09-21T07:32:51.958703+0000","last_undegraded":"2024-09-21T07:32:51.958703+0000","last_fullsized":"2024-09-21T07:32:51.958703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:41.692278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527684+0000","last_change":"2024-09-21T07:32:49.530583+0000","last_active":"2024-09-21T07:32:50.527684+0000","last_peered":"2024-09-21T07:32:50.527684+0000","last_clean":"2024-09-21T07:32:50.527684+0000","last_became_active":"2024-09-21T07:32:49.530202+0000","last_became_peered":"2024-09-21T07:32:49.530202+0000","last_unstale":"2024-09-21T07:32:50.527684+0000","last_undegraded":"2024-09-21T07:32:50.527684+0000","last_fullsized":"2024-09-21T07:32:50.527684+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:25.595680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528035+0000","last_change":"2024-09-21T07:32:49.522695+0000","last_active":"2024-09-21T07:32:50.528035+0000","last_peered":"2024-09-21T07:32:50.528035+0000","last_clean":"2024-09-21T07:32:50.528035+0000","last_became_active":"2024-09-21T07:32:49.522001+0000","last_became_peered":"2024-09-21T07:32:49.522001+0000","last_unstale":"2024-09-21T07:32:50.528035+0000","last_undegraded":"2024-09-21T07:32:50.528035+0000","last_fullsized":"2024-09-21T07:32:50.528035+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:19.545635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957905+0000","last_change":"2024-09-21T07:32:49.537443+0000","last_active":"2024-09-21T07:32:51.957905+0000","last_peered":"2024-09-21T07:32:51.957905+0000","last_clean":"2024-09-21T07:32:51.957905+0000","last_became_active":"2024-09-21T07:32:49.534813+0000","last_became_peered":"2024-09-21T07:32:49.534813+0000","last_unstale":"2024-09-21T07:32:51.957905+0000","last_undegraded":"2024-09-21T07:32:51.957905+0000","last_fullsized":"2024-09-21T07:32:51.957905+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:00.251108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"152'4","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528221+0000","last_change":"2024-09-21T07:32:48.529610+0000","last_active":"2024-09-21T07:32:50.528221+0000","last_peered":"2024-09-21T07:32:50.528221+0000","last_clean":"2024-09-21T07:32:50.528221+0000","last_became_active":"2024-09-21T07:32:48.529270+0000","last_became_peered":"2024-09-21T07:32:48.529270+0000","last_unstale":"2024-09-21T07:32:50.528221+0000","last_undegraded":"2024-09-21T07:32:50.528221+0000","last_fullsized":"2024-09-21T07:32:50.528221+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:05.053428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958435+0000","last_change":"2024-09-21T07:32:49.539455+0000","last_active":"2024-09-21T07:32:51.958435+0000","last_peered":"2024-09-21T07:32:51.958435+0000","last_clean":"2024-09-21T07:32:51.958435+0000","last_became_active":"2024-09-21T07:32:49.538184+0000","last_became_peered":"2024-09-21T07:32:49.538184+0000","last_unstale":"2024-09-21T07:32:51.958435+0000","last_undegraded":"2024-09-21T07:32:51.958435+0000","last_fullsized":"2024-09-21T07:32:51.958435+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:02.572091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529381+0000","last_change":"2024-09-21T07:32:48.537107+0000","last_active":"2024-09-21T07:32:50.529381+0000","last_peered":"2024-09-21T07:32:50.529381+0000","last_clean":"2024-09-21T07:32:50.529381+0000","last_became_active":"2024-09-21T07:32:48.536791+0000","last_became_peered":"2024-09-21T07:32:48.536791+0000","last_unstale":"2024-09-21T07:32:50.529381+0000","last_undegraded":"2024-09-21T07:32:50.529381+0000","last_fullsized":"2024-09-21T07:32:50.529381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:19.331021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529750+0000","last_change":"2024-09-21T07:32:49.520926+0000","last_active":"2024-09-21T07:32:50.529750+0000","last_peered":"2024-09-21T07:32:50.529750+0000","last_clean":"2024-09-21T07:32:50.529750+0000","last_became_active":"2024-09-21T07:32:49.520585+0000","last_became_peered":"2024-09-21T07:32:49.520585+0000","last_unstale":"2024-09-21T07:32:50.529750+0000","last_undegraded":"2024-09-21T07:32:50.529750+0000","last_fullsized":"2024-09-21T07:32:50.529750+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:43.395563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530290+0000","last_change":"2024-09-21T07:32:48.536568+0000","last_active":"2024-09-21T07:32:50.530290+0000","last_peered":"2024-09-21T07:32:50.530290+0000","last_clean":"2024-09-21T07:32:50.530290+0000","last_became_active":"2024-09-21T07:32:48.536154+0000","last_became_peered":"2024-09-21T07:32:48.536154+0000","last_unstale":"2024-09-21T07:32:50.530290+0000","last_undegraded":"2024-09-21T07:32:50.530290+0000","last_fullsized":"2024-09-21T07:32:50.530290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:00.648174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530375+0000","last_change":"2024-09-21T07:32:49.544305+0000","last_active":"2024-09-21T07:32:50.530375+0000","last_peered":"2024-09-21T07:32:50.530375+0000","last_clean":"2024-09-21T07:32:50.530375+0000","last_became_active":"2024-09-21T07:32:49.543995+0000","last_became_peered":"2024-09-21T07:32:49.543995+0000","last_unstale":"2024-09-21T07:32:50.530375+0000","last_undegraded":"2024-09-21T07:32:50.530375+0000","last_fullsized":"2024-09-21T07:32:50.530375+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:22.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958109+0000","last_change":"2024-09-21T07:32:48.527067+0000","last_active":"2024-09-21T07:32:51.958109+0000","last_peered":"2024-09-21T07:32:51.958109+0000","last_clean":"2024-09-21T07:32:51.958109+0000","last_became_active":"2024-09-21T07:32:48.525802+0000","last_became_peered":"2024-09-21T07:32:48.525802+0000","last_unstale":"2024-09-21T07:32:51.958109+0000","last_undegraded":"2024-09-21T07:32:51.958109+0000","last_fullsized":"2024-09-21T07:32:51.958109+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.971670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957262+0000","last_change":"2024-09-21T07:32:49.522575+0000","last_active":"2024-09-21T07:32:51.957262+0000","last_peered":"2024-09-21T07:32:51.957262+0000","last_clean":"2024-09-21T07:32:51.957262+0000","last_became_active":"2024-09-21T07:32:49.522260+0000","last_became_peered":"2024-09-21T07:32:49.522260+0000","last_unstale":"2024-09-21T07:32:51.957262+0000","last_undegraded":"2024-09-21T07:32:51.957262+0000","last_fullsized":"2024-09-21T07:32:51.957262+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.253040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528827+0000","last_change":"2024-09-21T07:32:48.531752+0000","last_active":"2024-09-21T07:32:50.528827+0000","last_peered":"2024-09-21T07:32:50.528827+0000","last_clean":"2024-09-21T07:32:50.528827+0000","last_became_active":"2024-09-21T07:32:48.531374+0000","last_became_peered":"2024-09-21T07:32:48.531374+0000","last_unstale":"2024-09-21T07:32:50.528827+0000","last_undegraded":"2024-09-21T07:32:50.528827+0000","last_fullsized":"2024-09-21T07:32:50.528827+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:17.675625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957720+0000","last_change":"2024-09-21T07:32:49.538671+0000","last_active":"2024-09-21T07:32:51.957720+0000","last_peered":"2024-09-21T07:32:51.957720+0000","last_clean":"2024-09-21T07:32:51.957720+0000","last_became_active":"2024-09-21T07:32:49.538080+0000","last_became_peered":"2024-09-21T07:32:49.538080+0000","last_unstale":"2024-09-21T07:32:51.957720+0000","last_undegraded":"2024-09-21T07:32:51.957720+0000","last_fullsized":"2024-09-21T07:32:51.957720+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:40.789341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527915+0000","last_change":"2024-09-21T07:32:48.530711+0000","last_active":"2024-09-21T07:32:50.527915+0000","last_peered":"2024-09-21T07:32:50.527915+0000","last_clean":"2024-09-21T07:32:50.527915+0000","last_became_active":"2024-09-21T07:32:48.530357+0000","last_became_peered":"2024-09-21T07:32:48.530357+0000","last_unstale":"2024-09-21T07:32:50.527915+0000","last_undegraded":"2024-09-21T07:32:50.527915+0000","last_fullsized":"2024-09-21T07:32:50.527915+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:40.029081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957546+0000","last_change":"2024-09-21T07:32:49.531924+0000","last_active":"2024-09-21T07:32:51.957546+0000","last_peered":"2024-09-21T07:32:51.957546+0000","last_clean":"2024-09-21T07:32:51.957546+0000","last_became_active":"2024-09-21T07:32:49.531297+0000","last_became_peered":"2024-09-21T07:32:49.531297+0000","last_unstale":"2024-09-21T07:32:51.957546+0000","last_undegraded":"2024-09-21T07:32:51.957546+0000","last_fullsized":"2024-09-21T07:32:51.957546+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:13.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.499942+0000","last_change":"2024-09-21T07:32:48.528999+0000","last_active":"2024-09-21T07:32:51.499942+0000","last_peered":"2024-09-21T07:32:51.499942+0000","last_clean":"2024-09-21T07:32:51.499942+0000","last_became_active":"2024-09-21T07:32:48.528681+0000","last_became_peered":"2024-09-21T07:32:48.528681+0000","last_unstale":"2024-09-21T07:32:51.499942+0000","last_undegraded":"2024-09-21T07:32:51.499942+0000","last_fullsized":"2024-09-21T07:32:51.499942+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:33.787348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500306+0000","last_change":"2024-09-21T07:32:49.530662+0000","last_active":"2024-09-21T07:32:51.500306+0000","last_peered":"2024-09-21T07:32:51.500306+0000","last_clean":"2024-09-21T07:32:51.500306+0000","last_became_active":"2024-09-21T07:32:49.530315+0000","last_became_peered":"2024-09-21T07:32:49.530315+0000","last_unstale":"2024-09-21T07:32:51.500306+0000","last_undegraded":"2024-09-21T07:32:51.500306+0000","last_fullsized":"2024-09-21T07:32:51.500306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:58.307161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527614+0000","last_change":"2024-09-21T07:32:48.533369+0000","last_active":"2024-09-21T07:32:50.527614+0000","last_peered":"2024-09-21T07:32:50.527614+0000","last_clean":"2024-09-21T07:32:50.527614+0000","last_became_active":"2024-09-21T07:32:48.533042+0000","last_became_peered":"2024-09-21T07:32:48.533042+0000","last_unstale":"2024-09-21T07:32:50.527614+0000","last_undegraded":"2024-09-21T07:32:50.527614+0000","last_fullsized":"2024-09-21T07:32:50.527614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:05.450728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528898+0000","last_change":"2024-09-21T07:32:49.537150+0000","last_active":"2024-09-21T07:32:50.528898+0000","last_peered":"2024-09-21T07:32:50.528898+0000","last_clean":"2024-09-21T07:32:50.528898+0000","last_became_active":"2024-09-21T07:32:49.536777+0000","last_became_peered":"2024-09-21T07:32:49.536777+0000","last_unstale":"2024-09-21T07:32:50.528898+0000","last_undegraded":"2024-09-21T07:32:50.528898+0000","last_fullsized":"2024-09-21T07:32:50.528898+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:34.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530381+0000","last_change":"2024-09-21T07:32:48.532342+0000","last_active":"2024-09-21T07:32:50.530381+0000","last_peered":"2024-09-21T07:32:50.530381+0000","last_clean":"2024-09-21T07:32:50.530381+0000","last_became_active":"2024-09-21T07:32:48.532002+0000","last_became_peered":"2024-09-21T07:32:48.532002+0000","last_unstale":"2024-09-21T07:32:50.530381+0000","last_undegraded":"2024-09-21T07:32:50.530381+0000","last_fullsized":"2024-09-21T07:32:50.530381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:42.461557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959023+0000","last_change":"2024-09-21T07:32:49.535888+0000","last_active":"2024-09-21T07:32:51.959023+0000","last_peered":"2024-09-21T07:32:51.959023+0000","last_clean":"2024-09-21T07:32:51.959023+0000","last_became_active":"2024-09-21T07:32:49.535305+0000","last_became_peered":"2024-09-21T07:32:49.535305+0000","last_unstale":"2024-09-21T07:32:51.959023+0000","last_undegraded":"2024-09-21T07:32:51.959023+0000","last_fullsized":"2024-09-21T07:32:51.959023+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:02.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500798+0000","last_change":"2024-09-21T07:32:48.529159+0000","last_active":"2024-09-21T07:32:51.500798+0000","last_peered":"2024-09-21T07:32:51.500798+0000","last_clean":"2024-09-21T07:32:51.500798+0000","last_became_active":"2024-09-21T07:32:48.528659+0000","last_became_peered":"2024-09-21T07:32:48.528659+0000","last_unstale":"2024-09-21T07:32:51.500798+0000","last_undegraded":"2024-09-21T07:32:51.500798+0000","last_fullsized":"2024-09-21T07:32:51.500798+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:25.286273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959334+0000","last_change":"2024-09-21T07:32:49.526431+0000","last_active":"2024-09-21T07:32:51.959334+0000","last_peered":"2024-09-21T07:32:51.959334+0000","last_clean":"2024-09-21T07:32:51.959334+0000","last_became_active":"2024-09-21T07:32:49.526105+0000","last_became_peered":"2024-09-21T07:32:49.526105+0000","last_unstale":"2024-09-21T07:32:51.959334+0000","last_undegraded":"2024-09-21T07:32:51.959334+0000","last_fullsized":"2024-09-21T07:32:51.959334+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:54.389862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"152'3","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959043+0000","last_change":"2024-09-21T07:32:48.528147+0000","last_active":"2024-09-21T07:32:51.959043+0000","last_peered":"2024-09-21T07:32:51.959043+0000","last_clean":"2024-09-21T07:32:51.959043+0000","last_became_active":"2024-09-21T07:32:48.527843+0000","last_became_peered":"2024-09-21T07:32:48.527843+0000","last_unstale":"2024-09-21T07:32:51.959043+0000","last_undegraded":"2024-09-21T07:32:51.959043+0000","last_fullsized":"2024-09-21T07:32:51.959043+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:50.158382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528148+0000","last_change":"2024-09-21T07:32:49.530447+0000","last_active":"2024-09-21T07:32:50.528148+0000","last_peered":"2024-09-21T07:32:50.528148+0000","last_clean":"2024-09-21T07:32:50.528148+0000","last_became_active":"2024-09-21T07:32:49.530050+0000","last_became_peered":"2024-09-21T07:32:49.530050+0000","last_unstale":"2024-09-21T07:32:50.528148+0000","last_undegraded":"2024-09-21T07:32:50.528148+0000","last_fullsized":"2024-09-21T07:32:50.528148+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.217052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528537+0000","last_change":"2024-09-21T07:32:48.526875+0000","last_active":"2024-09-21T07:32:50.528537+0000","last_peered":"2024-09-21T07:32:50.528537+0000","last_clean":"2024-09-21T07:32:50.528537+0000","last_became_active":"2024-09-21T07:32:48.525139+0000","last_became_peered":"2024-09-21T07:32:48.525139+0000","last_unstale":"2024-09-21T07:32:50.528537+0000","last_undegraded":"2024-09-21T07:32:50.528537+0000","last_fullsized":"2024-09-21T07:32:50.528537+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:56.747604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957270+0000","last_change":"2024-09-21T07:32:49.541944+0000","last_active":"2024-09-21T07:32:51.957270+0000","last_peered":"2024-09-21T07:32:51.957270+0000","last_clean":"2024-09-21T07:32:51.957270+0000","last_became_active":"2024-09-21T07:32:49.541144+0000","last_became_peered":"2024-09-21T07:32:49.541144+0000","last_unstale":"2024-09-21T07:32:51.957270+0000","last_undegraded":"2024-09-21T07:32:51.957270+0000","last_fullsized":"2024-09-21T07:32:51.957270+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:33.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957341+0000","last_change":"2024-09-21T07:32:48.528524+0000","last_active":"2024-09-21T07:32:51.957341+0000","last_peered":"2024-09-21T07:32:51.957341+0000","last_clean":"2024-09-21T07:32:51.957341+0000","last_became_active":"2024-09-21T07:32:48.528203+0000","last_became_peered":"2024-09-21T07:32:48.528203+0000","last_unstale":"2024-09-21T07:32:51.957341+0000","last_undegraded":"2024-09-21T07:32:51.957341+0000","last_fullsized":"2024-09-21T07:32:51.957341+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:36.219708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.527913+0000","last_change":"2024-09-21T07:32:49.526016+0000","last_active":"2024-09-21T07:32:50.527913+0000","last_peered":"2024-09-21T07:32:50.527913+0000","last_clean":"2024-09-21T07:32:50.527913+0000","last_became_active":"2024-09-21T07:32:49.525695+0000","last_became_peered":"2024-09-21T07:32:49.525695+0000","last_unstale":"2024-09-21T07:32:50.527913+0000","last_undegraded":"2024-09-21T07:32:50.527913+0000","last_fullsized":"2024-09-21T07:32:50.527913+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:21.254601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957761+0000","last_change":"2024-09-21T07:32:48.527969+0000","last_active":"2024-09-21T07:32:51.957761+0000","last_peered":"2024-09-21T07:32:51.957761+0000","last_clean":"2024-09-21T07:32:51.957761+0000","last_became_active":"2024-09-21T07:32:48.527659+0000","last_became_peered":"2024-09-21T07:32:48.527659+0000","last_unstale":"2024-09-21T07:32:51.957761+0000","last_undegraded":"2024-09-21T07:32:51.957761+0000","last_fullsized":"2024-09-21T07:32:51.957761+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:17.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957865+0000","last_change":"2024-09-21T07:32:49.543492+0000","last_active":"2024-09-21T07:32:51.957865+0000","last_peered":"2024-09-21T07:32:51.957865+0000","last_clean":"2024-09-21T07:32:51.957865+0000","last_became_active":"2024-09-21T07:32:49.543195+0000","last_became_peered":"2024-09-21T07:32:49.543195+0000","last_unstale":"2024-09-21T07:32:51.957865+0000","last_undegraded":"2024-09-21T07:32:51.957865+0000","last_fullsized":"2024-09-21T07:32:51.957865+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:32.634615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"152'8","reported_seq":23,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.499802+0000","last_change":"2024-09-21T07:32:48.536189+0000","last_active":"2024-09-21T07:32:51.499802+0000","last_peered":"2024-09-21T07:32:51.499802+0000","last_clean":"2024-09-21T07:32:51.499802+0000","last_became_active":"2024-09-21T07:32:48.535866+0000","last_became_peered":"2024-09-21T07:32:48.535866+0000","last_unstale":"2024-09-21T07:32:51.499802+0000","last_undegraded":"2024-09-21T07:32:51.499802+0000","last_fullsized":"2024-09-21T07:32:51.499802+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:55.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529480+0000","last_change":"2024-09-21T07:32:49.551375+0000","last_active":"2024-09-21T07:32:50.529480+0000","last_peered":"2024-09-21T07:32:50.529480+0000","last_clean":"2024-09-21T07:32:50.529480+0000","last_became_active":"2024-09-21T07:32:49.549734+0000","last_became_peered":"2024-09-21T07:32:49.549734+0000","last_unstale":"2024-09-21T07:32:50.529480+0000","last_undegraded":"2024-09-21T07:32:50.529480+0000","last_fullsized":"2024-09-21T07:32:50.529480+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:39.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.959178+0000","last_change":"2024-09-21T07:32:48.533769+0000","last_active":"2024-09-21T07:32:51.959178+0000","last_peered":"2024-09-21T07:32:51.959178+0000","last_clean":"2024-09-21T07:32:51.959178+0000","last_became_active":"2024-09-21T07:32:48.533300+0000","last_became_peered":"2024-09-21T07:32:48.533300+0000","last_unstale":"2024-09-21T07:32:51.959178+0000","last_undegraded":"2024-09-21T07:32:51.959178+0000","last_fullsized":"2024-09-21T07:32:51.959178+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:46.497229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.530081+0000","last_change":"2024-09-21T07:32:49.547246+0000","last_active":"2024-09-21T07:32:50.530081+0000","last_peered":"2024-09-21T07:32:50.530081+0000","last_clean":"2024-09-21T07:32:50.530081+0000","last_became_active":"2024-09-21T07:32:49.546462+0000","last_became_peered":"2024-09-21T07:32:49.546462+0000","last_unstale":"2024-09-21T07:32:50.530081+0000","last_undegraded":"2024-09-21T07:32:50.530081+0000","last_fullsized":"2024-09-21T07:32:50.530081+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:22.473239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529499+0000","last_change":"2024-09-21T07:32:48.530017+0000","last_active":"2024-09-21T07:32:50.529499+0000","last_peered":"2024-09-21T07:32:50.529499+0000","last_clean":"2024-09-21T07:32:50.529499+0000","last_became_active":"2024-09-21T07:32:48.529711+0000","last_became_peered":"2024-09-21T07:32:48.529711+0000","last_unstale":"2024-09-21T07:32:50.529499+0000","last_undegraded":"2024-09-21T07:32:50.529499+0000","last_fullsized":"2024-09-21T07:32:50.529499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:05.045200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500738+0000","last_change":"2024-09-21T07:32:49.541990+0000","last_active":"2024-09-21T07:32:51.500738+0000","last_peered":"2024-09-21T07:32:51.500738+0000","last_clean":"2024-09-21T07:32:51.500738+0000","last_became_active":"2024-09-21T07:32:49.541622+0000","last_became_peered":"2024-09-21T07:32:49.541622+0000","last_unstale":"2024-09-21T07:32:51.500738+0000","last_undegraded":"2024-09-21T07:32:51.500738+0000","last_fullsized":"2024-09-21T07:32:51.500738+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:06.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958293+0000","last_change":"2024-09-21T07:32:48.527939+0000","last_active":"2024-09-21T07:32:51.958293+0000","last_peered":"2024-09-21T07:32:51.958293+0000","last_clean":"2024-09-21T07:32:51.958293+0000","last_became_active":"2024-09-21T07:32:48.526482+0000","last_became_peered":"2024-09-21T07:32:48.526482+0000","last_unstale":"2024-09-21T07:32:51.958293+0000","last_undegraded":"2024-09-21T07:32:51.958293+0000","last_fullsized":"2024-09-21T07:32:51.958293+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:17.692988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500933+0000","last_change":"2024-09-21T07:32:49.536201+0000","last_active":"2024-09-21T07:32:51.500933+0000","last_peered":"2024-09-21T07:32:51.500933+0000","last_clean":"2024-09-21T07:32:51.500933+0000","last_became_active":"2024-09-21T07:32:49.530993+0000","last_became_peered":"2024-09-21T07:32:49.530993+0000","last_unstale":"2024-09-21T07:32:51.500933+0000","last_undegraded":"2024-09-21T07:32:51.500933+0000","last_fullsized":"2024-09-21T07:32:51.500933+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:40.435135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957779+0000","last_change":"2024-09-21T07:32:48.527756+0000","last_active":"2024-09-21T07:32:51.957779+0000","last_peered":"2024-09-21T07:32:51.957779+0000","last_clean":"2024-09-21T07:32:51.957779+0000","last_became_active":"2024-09-21T07:32:48.527117+0000","last_became_peered":"2024-09-21T07:32:48.527117+0000","last_unstale":"2024-09-21T07:32:51.957779+0000","last_undegraded":"2024-09-21T07:32:51.957779+0000","last_fullsized":"2024-09-21T07:32:51.957779+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:58.085932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529271+0000","last_change":"2024-09-21T07:32:49.538978+0000","last_active":"2024-09-21T07:32:50.529271+0000","last_peered":"2024-09-21T07:32:50.529271+0000","last_clean":"2024-09-21T07:32:50.529271+0000","last_became_active":"2024-09-21T07:32:49.538673+0000","last_became_peered":"2024-09-21T07:32:49.538673+0000","last_unstale":"2024-09-21T07:32:50.529271+0000","last_undegraded":"2024-09-21T07:32:50.529271+0000","last_fullsized":"2024-09-21T07:32:50.529271+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:00.918830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957577+0000","last_change":"2024-09-21T07:32:48.520778+0000","last_active":"2024-09-21T07:32:51.957577+0000","last_peered":"2024-09-21T07:32:51.957577+0000","last_clean":"2024-09-21T07:32:51.957577+0000","last_became_active":"2024-09-21T07:32:48.520476+0000","last_became_peered":"2024-09-21T07:32:48.520476+0000","last_unstale":"2024-09-21T07:32:51.957577+0000","last_undegraded":"2024-09-21T07:32:51.957577+0000","last_fullsized":"2024-09-21T07:32:51.957577+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:04.277591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957428+0000","last_change":"2024-09-21T07:32:49.537747+0000","last_active":"2024-09-21T07:32:51.957428+0000","last_peered":"2024-09-21T07:32:51.957428+0000","last_clean":"2024-09-21T07:32:51.957428+0000","last_became_active":"2024-09-21T07:32:49.536896+0000","last_became_peered":"2024-09-21T07:32:49.536896+0000","last_unstale":"2024-09-21T07:32:51.957428+0000","last_undegraded":"2024-09-21T07:32:51.957428+0000","last_fullsized":"2024-09-21T07:32:51.957428+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:15.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528392+0000","last_change":"2024-09-21T07:32:48.526249+0000","last_active":"2024-09-21T07:32:50.528392+0000","last_peered":"2024-09-21T07:32:50.528392+0000","last_clean":"2024-09-21T07:32:50.528392+0000","last_became_active":"2024-09-21T07:32:48.525953+0000","last_became_peered":"2024-09-21T07:32:48.525953+0000","last_unstale":"2024-09-21T07:32:50.528392+0000","last_undegraded":"2024-09-21T07:32:50.528392+0000","last_fullsized":"2024-09-21T07:32:50.528392+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:42.458271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529149+0000","last_change":"2024-09-21T07:32:49.539273+0000","last_active":"2024-09-21T07:32:50.529149+0000","last_peered":"2024-09-21T07:32:50.529149+0000","last_clean":"2024-09-21T07:32:50.529149+0000","last_became_active":"2024-09-21T07:32:49.537553+0000","last_became_peered":"2024-09-21T07:32:49.537553+0000","last_unstale":"2024-09-21T07:32:50.529149+0000","last_undegraded":"2024-09-21T07:32:50.529149+0000","last_fullsized":"2024-09-21T07:32:50.529149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:57.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958005+0000","last_change":"2024-09-21T07:32:48.520006+0000","last_active":"2024-09-21T07:32:51.958005+0000","last_peered":"2024-09-21T07:32:51.958005+0000","last_clean":"2024-09-21T07:32:51.958005+0000","last_became_active":"2024-09-21T07:32:48.519666+0000","last_became_peered":"2024-09-21T07:32:48.519666+0000","last_unstale":"2024-09-21T07:32:51.958005+0000","last_undegraded":"2024-09-21T07:32:51.958005+0000","last_fullsized":"2024-09-21T07:32:51.958005+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.107846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958011+0000","last_change":"2024-09-21T07:32:49.543685+0000","last_active":"2024-09-21T07:32:51.958011+0000","last_peered":"2024-09-21T07:32:51.958011+0000","last_clean":"2024-09-21T07:32:51.958011+0000","last_became_active":"2024-09-21T07:32:49.543396+0000","last_became_peered":"2024-09-21T07:32:49.543396+0000","last_unstale":"2024-09-21T07:32:51.958011+0000","last_undegraded":"2024-09-21T07:32:51.958011+0000","last_fullsized":"2024-09-21T07:32:51.958011+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:12.974104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528211+0000","last_change":"2024-09-21T07:32:48.523234+0000","last_active":"2024-09-21T07:32:50.528211+0000","last_peered":"2024-09-21T07:32:50.528211+0000","last_clean":"2024-09-21T07:32:50.528211+0000","last_became_active":"2024-09-21T07:32:48.522912+0000","last_became_peered":"2024-09-21T07:32:48.522912+0000","last_unstale":"2024-09-21T07:32:50.528211+0000","last_undegraded":"2024-09-21T07:32:50.528211+0000","last_fullsized":"2024-09-21T07:32:50.528211+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:07.332953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528083+0000","last_change":"2024-09-21T07:32:49.546859+0000","last_active":"2024-09-21T07:32:50.528083+0000","last_peered":"2024-09-21T07:32:50.528083+0000","last_clean":"2024-09-21T07:32:50.528083+0000","last_became_active":"2024-09-21T07:32:49.546525+0000","last_became_peered":"2024-09-21T07:32:49.546525+0000","last_unstale":"2024-09-21T07:32:50.528083+0000","last_undegraded":"2024-09-21T07:32:50.528083+0000","last_fullsized":"2024-09-21T07:32:50.528083+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:22.234805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958045+0000","last_change":"2024-09-21T07:32:48.530785+0000","last_active":"2024-09-21T07:32:51.958045+0000","last_peered":"2024-09-21T07:32:51.958045+0000","last_clean":"2024-09-21T07:32:51.958045+0000","last_became_active":"2024-09-21T07:32:48.530171+0000","last_became_peered":"2024-09-21T07:32:48.530171+0000","last_unstale":"2024-09-21T07:32:51.958045+0000","last_undegraded":"2024-09-21T07:32:51.958045+0000","last_fullsized":"2024-09-21T07:32:51.958045+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:25.514027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957833+0000","last_change":"2024-09-21T07:32:49.537292+0000","last_active":"2024-09-21T07:32:51.957833+0000","last_peered":"2024-09-21T07:32:51.957833+0000","last_clean":"2024-09-21T07:32:51.957833+0000","last_became_active":"2024-09-21T07:32:49.536943+0000","last_became_peered":"2024-09-21T07:32:49.536943+0000","last_unstale":"2024-09-21T07:32:51.957833+0000","last_undegraded":"2024-09-21T07:32:51.957833+0000","last_fullsized":"2024-09-21T07:32:51.957833+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:35.792749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"153'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500933+0000","last_change":"2024-09-21T07:32:48.534626+0000","last_active":"2024-09-21T07:32:51.500933+0000","last_peered":"2024-09-21T07:32:51.500933+0000","last_clean":"2024-09-21T07:32:51.500933+0000","last_became_active":"2024-09-21T07:32:48.534312+0000","last_became_peered":"2024-09-21T07:32:48.534312+0000","last_unstale":"2024-09-21T07:32:51.500933+0000","last_undegraded":"2024-09-21T07:32:51.500933+0000","last_fullsized":"2024-09-21T07:32:51.500933+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.432302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500956+0000","last_change":"2024-09-21T07:32:49.532054+0000","last_active":"2024-09-21T07:32:51.500956+0000","last_peered":"2024-09-21T07:32:51.500956+0000","last_clean":"2024-09-21T07:32:51.500956+0000","last_became_active":"2024-09-21T07:32:49.530843+0000","last_became_peered":"2024-09-21T07:32:49.530843+0000","last_unstale":"2024-09-21T07:32:51.500956+0000","last_undegraded":"2024-09-21T07:32:51.500956+0000","last_fullsized":"2024-09-21T07:32:51.500956+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:43.851694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958413+0000","last_change":"2024-09-21T07:32:48.531905+0000","last_active":"2024-09-21T07:32:51.958413+0000","last_peered":"2024-09-21T07:32:51.958413+0000","last_clean":"2024-09-21T07:32:51.958413+0000","last_became_active":"2024-09-21T07:32:48.531352+0000","last_became_peered":"2024-09-21T07:32:48.531352+0000","last_unstale":"2024-09-21T07:32:51.958413+0000","last_undegraded":"2024-09-21T07:32:51.958413+0000","last_fullsized":"2024-09-21T07:32:51.958413+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:42.128667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528189+0000","last_change":"2024-09-21T07:32:49.545756+0000","last_active":"2024-09-21T07:32:50.528189+0000","last_peered":"2024-09-21T07:32:50.528189+0000","last_clean":"2024-09-21T07:32:50.528189+0000","last_became_active":"2024-09-21T07:32:49.545444+0000","last_became_peered":"2024-09-21T07:32:49.545444+0000","last_unstale":"2024-09-21T07:32:50.528189+0000","last_undegraded":"2024-09-21T07:32:50.528189+0000","last_fullsized":"2024-09-21T07:32:50.528189+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:53.064872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528102+0000","last_change":"2024-09-21T07:32:48.526416+0000","last_active":"2024-09-21T07:32:50.528102+0000","last_peered":"2024-09-21T07:32:50.528102+0000","last_clean":"2024-09-21T07:32:50.528102+0000","last_became_active":"2024-09-21T07:32:48.525689+0000","last_became_peered":"2024-09-21T07:32:48.525689+0000","last_unstale":"2024-09-21T07:32:50.528102+0000","last_undegraded":"2024-09-21T07:32:50.528102+0000","last_fullsized":"2024-09-21T07:32:50.528102+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:59.916186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.528279+0000","last_change":"2024-09-21T07:32:49.520290+0000","last_active":"2024-09-21T07:32:50.528279+0000","last_peered":"2024-09-21T07:32:50.528279+0000","last_clean":"2024-09-21T07:32:50.528279+0000","last_became_active":"2024-09-21T07:32:49.519968+0000","last_became_peered":"2024-09-21T07:32:49.519968+0000","last_unstale":"2024-09-21T07:32:50.528279+0000","last_undegraded":"2024-09-21T07:32:50.528279+0000","last_fullsized":"2024-09-21T07:32:50.528279+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:26.288917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500231+0000","last_change":"2024-09-21T07:32:48.532269+0000","last_active":"2024-09-21T07:32:51.500231+0000","last_peered":"2024-09-21T07:32:51.500231+0000","last_clean":"2024-09-21T07:32:51.500231+0000","last_became_active":"2024-09-21T07:32:48.531937+0000","last_became_peered":"2024-09-21T07:32:48.531937+0000","last_unstale":"2024-09-21T07:32:51.500231+0000","last_undegraded":"2024-09-21T07:32:51.500231+0000","last_fullsized":"2024-09-21T07:32:51.500231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:58.918030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957663+0000","last_change":"2024-09-21T07:32:49.547828+0000","last_active":"2024-09-21T07:32:51.957663+0000","last_peered":"2024-09-21T07:32:51.957663+0000","last_clean":"2024-09-21T07:32:51.957663+0000","last_became_active":"2024-09-21T07:32:49.547522+0000","last_became_peered":"2024-09-21T07:32:49.547522+0000","last_unstale":"2024-09-21T07:32:51.957663+0000","last_undegraded":"2024-09-21T07:32:51.957663+0000","last_fullsized":"2024-09-21T07:32:51.957663+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:33.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.958587+0000","last_change":"2024-09-21T07:32:48.523852+0000","last_active":"2024-09-21T07:32:51.958587+0000","last_peered":"2024-09-21T07:32:51.958587+0000","last_clean":"2024-09-21T07:32:51.958587+0000","last_became_active":"2024-09-21T07:32:48.523545+0000","last_became_peered":"2024-09-21T07:32:48.523545+0000","last_unstale":"2024-09-21T07:32:51.958587+0000","last_undegraded":"2024-09-21T07:32:51.958587+0000","last_fullsized":"2024-09-21T07:32:51.958587+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:12.471302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957757+0000","last_change":"2024-09-21T07:32:49.546338+0000","last_active":"2024-09-21T07:32:51.957757+0000","last_peered":"2024-09-21T07:32:51.957757+0000","last_clean":"2024-09-21T07:32:51.957757+0000","last_became_active":"2024-09-21T07:32:49.544466+0000","last_became_peered":"2024-09-21T07:32:49.544466+0000","last_unstale":"2024-09-21T07:32:51.957757+0000","last_undegraded":"2024-09-21T07:32:51.957757+0000","last_fullsized":"2024-09-21T07:32:51.957757+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:10.483312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.500057+0000","last_change":"2024-09-21T07:32:48.526101+0000","last_active":"2024-09-21T07:32:51.500057+0000","last_peered":"2024-09-21T07:32:51.500057+0000","last_clean":"2024-09-21T07:32:51.500057+0000","last_became_active":"2024-09-21T07:32:48.525807+0000","last_became_peered":"2024-09-21T07:32:48.525807+0000","last_unstale":"2024-09-21T07:32:51.500057+0000","last_undegraded":"2024-09-21T07:32:51.500057+0000","last_fullsized":"2024-09-21T07:32:51.500057+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:42.392920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529792+0000","last_change":"2024-09-21T07:32:49.538001+0000","last_active":"2024-09-21T07:32:50.529792+0000","last_peered":"2024-09-21T07:32:50.529792+0000","last_clean":"2024-09-21T07:32:50.529792+0000","last_became_active":"2024-09-21T07:32:49.537606+0000","last_became_peered":"2024-09-21T07:32:49.537606+0000","last_unstale":"2024-09-21T07:32:50.529792+0000","last_undegraded":"2024-09-21T07:32:50.529792+0000","last_fullsized":"2024-09-21T07:32:50.529792+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:10.468288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529281+0000","last_change":"2024-09-21T07:32:48.534141+0000","last_active":"2024-09-21T07:32:50.529281+0000","last_peered":"2024-09-21T07:32:50.529281+0000","last_clean":"2024-09-21T07:32:50.529281+0000","last_became_active":"2024-09-21T07:32:48.533349+0000","last_became_peered":"2024-09-21T07:32:48.533349+0000","last_unstale":"2024-09-21T07:32:50.529281+0000","last_undegraded":"2024-09-21T07:32:50.529281+0000","last_fullsized":"2024-09-21T07:32:50.529281+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:51.811326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529924+0000","last_change":"2024-09-21T07:32:49.529981+0000","last_active":"2024-09-21T07:32:50.529924+0000","last_peered":"2024-09-21T07:32:50.529924+0000","last_clean":"2024-09-21T07:32:50.529924+0000","last_became_active":"2024-09-21T07:32:49.529615+0000","last_became_peered":"2024-09-21T07:32:49.529615+0000","last_unstale":"2024-09-21T07:32:50.529924+0000","last_undegraded":"2024-09-21T07:32:50.529924+0000","last_fullsized":"2024-09-21T07:32:50.529924+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:48.497061+0000","last_clean_scrub_stamp":"2024-09-21T07:32:48.497061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:52.272833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"152'6","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:51.957753+0000","last_change":"2024-09-21T07:32:48.526383+0000","last_active":"2024-09-21T07:32:51.957753+0000","last_peered":"2024-09-21T07:32:51.957753+0000","last_clean":"2024-09-21T07:32:51.957753+0000","last_became_active":"2024-09-21T07:32:48.526040+0000","last_became_peered":"2024-09-21T07:32:48.526040+0000","last_unstale":"2024-09-21T07:32:51.957753+0000","last_undegraded":"2024-09-21T07:32:51.957753+0000","last_fullsized":"2024-09-21T07:32:51.957753+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:47.494417+0000","last_clean_scrub_stamp":"2024-09-21T07:32:47.494417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:39.548031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":350,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-21T07:32:50.529355+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:32:50.529355+0000","last_peered":"2024-09-21T07:32:50.529355+0000","last_clean":"2024-09-21T07:32:50.529355+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:32:50.529355+0000","last_undegraded":"2024-09-21T07:32:50.529355+0000","last_fullsized":"2024-09-21T07:32:50.529355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509567,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51104,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320736,"statfs":{"total":96636764160,"available":96584433664,"internally_reserved":0,"allocated":1912832,"data_stored":899751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509567,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51100,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320740,"statfs":{"total":96636764160,"available":96584437760,"internally_reserved":0,"allocated":1908736,"data_stored":899681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509567,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":1921024,"data_stored":901293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1916928,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1912832,"data_stored":899751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509567,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":2527232,"data_stored":1492367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51692,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320148,"statfs":{"total":96636764160,"available":96583831552,"internally_reserved":0,"allocated":2506752,"data_stored":1490071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":1904640,"data_stored":893605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:32:54.142 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:32:54.143 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- 172.21.15.64:0/2851062747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680b3d30 msgr2=0x7fb9680b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 --2- 172.21.15.64:0/2851062747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680b3d30 0x7fb9680b4140 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb9680cc8b0 tx=0x7fb95001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- 172.21.15.64:0/2851062747 shutdown_connections 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 --2- 172.21.15.64:0/2851062747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 0x7fb968071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 --2- 172.21.15.64:0/2851062747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680b3d30 0x7fb9680b4140 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 --2- 172.21.15.64:0/2851062747 >> v2:172.21.15.90:3300/0 conn(0x7fb9680cccc0 0x7fb9680cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- 172.21.15.64:0/2851062747 >> 172.21.15.64:0/2851062747 conn(0x7fb96806d510 msgr2=0x7fb9680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- 172.21.15.64:0/2851062747 shutdown_connections 2024-09-21T07:32:54.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- 172.21.15.64:0/2851062747 wait complete. 2024-09-21T07:32:54.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 Processor -- start 2024-09-21T07:32:54.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.344+0000 7fb96fa00640 1 -- start start 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 0x7fb9680b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9680b3d30 0x7fb9681fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9680c6c20 con 0x7fb9680cccc0 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9680c6aa0 con 0x7fb9680b3d30 2024-09-21T07:32:54.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb9680c6da0 con 0x7fb968071140 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57782/0 (socket says 172.21.15.64:57782) 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 -- 172.21.15.64:0/597806912 learned_addr learned my addr 172.21.15.64:0/597806912 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96d000640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 0x7fb9680b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb95fe00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9680b3d30 0x7fb9681fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 -- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 msgr2=0x7fb9680b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 0x7fb9680b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 -- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9680b3d30 msgr2=0x7fb9681fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9680b3d30 0x7fb9681fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 -- 172.21.15.64:0/597806912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96815ed10 con 0x7fb9680cccc0 2024-09-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96da00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb96000ea00 tx=0x7fb96000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96000cde0 con 0x7fb9680cccc0 2024-09-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb960004c20 con 0x7fb9680cccc0 2024-09-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960005020 con 0x7fb9680cccc0 2024-09-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96815f2d0 con 0x7fb9680cccc0 2024-09-21T07:32:54.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb968159dd0 con 0x7fb9680cccc0 2024-09-21T07:32:54.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.348+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9680b4140 con 0x7fb9680cccc0 2024-09-21T07:32:54.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.352+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb9600051c0 con 0x7fb9680cccc0 2024-09-21T07:32:54.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.352+0000 7fb965600640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.352+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fb960094ff0 con 0x7fb9680cccc0 2024-09-21T07:32:54.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.352+0000 7fb96d000640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.352+0000 7fb96d000640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 0x7fb944075710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb958009b40 tx=0x7fb9580091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:54.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.356+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb96005f8a0 con 0x7fb9680cccc0 2024-09-21T07:32:54.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.596+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb96815ea80 con 0x7fb9680cccc0 2024-09-21T07:32:54.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.600+0000 7fb965600640 1 -- 172.21.15.64:0/597806912 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) ==== 190+0+147 (secure 0 0 0) 0x7fb9600642d0 con 0x7fb9680cccc0 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:32:54.604 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:32:54.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 msgr2=0x7fb944075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 0x7fb944075710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb958009b40 tx=0x7fb9580091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 msgr2=0x7fb9681fc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb96000ea00 tx=0x7fb96000eec0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 shutdown_connections 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9680cccc0 0x7fb9681fc9c0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9680b3d30 0x7fb9681fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 --2- 172.21.15.64:0/597806912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb968071140 0x7fb9680b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 >> 172.21.15.64:0/597806912 conn(0x7fb96806d510 msgr2=0x7fb96806f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 shutdown_connections 2024-09-21T07:32:54.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.604+0000 7fb96fa00640 1 -- 172.21.15.64:0/597806912 wait complete. 2024-09-21T07:32:54.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:32:54.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- 172.21.15.64:0/1220435089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 msgr2=0x7f23940b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 --2- 172.21.15.64:0/1220435089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f23940b1ff0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f23940cb050 tx=0x7f238001c7d0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- 172.21.15.64:0/1220435089 shutdown_connections 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 --2- 172.21.15.64:0/1220435089 >> v2:172.21.15.90:3300/0 conn(0x7f23940cbcd0 0x7f23940cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 --2- 172.21.15.64:0/1220435089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f23940b1ff0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- 172.21.15.64:0/1220435089 >> 172.21.15.64:0/1220435089 conn(0x7f23940ccbe0 msgr2=0x7f23940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- 172.21.15.64:0/1220435089 shutdown_connections 2024-09-21T07:32:54.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- 172.21.15.64:0/1220435089 wait complete. 2024-09-21T07:32:54.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 Processor -- start 2024-09-21T07:32:54.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.784+0000 7f239ba00640 1 -- start start 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23940cbcd0 0x7f239409bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 0x7f2394157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f23940b41f0 con 0x7f23940b1be0 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23940b4070 con 0x7f239415cbd0 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f23940b4370 con 0x7f23940cbcd0 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57802/0 (socket says 172.21.15.64:57802) 2024-09-21T07:32:54.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 -- 172.21.15.64:0/232652200 learned_addr learned my addr 172.21.15.64:0/232652200 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399a00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 0x7f2394157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2393e00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23940cbcd0 0x7f239409bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 -- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23940cbcd0 msgr2=0x7f239409bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23940cbcd0 0x7f239409bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 -- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 msgr2=0x7f2394157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 0x7f2394157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 -- 172.21.15.64:0/232652200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2394156280 con 0x7f23940b1be0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399a00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 0x7f2394157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2399000640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f238800c400 tx=0x7f238800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388017070 con 0x7f23940b1be0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2388003600 con 0x7f23940b1be0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388003a50 con 0x7f23940b1be0 2024-09-21T07:32:54.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394156820 con 0x7f23940b1be0 2024-09-21T07:32:54.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2394156de0 con 0x7f23940b1be0 2024-09-21T07:32:54.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.788+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23940b1ff0 con 0x7f23940b1be0 2024-09-21T07:32:54.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.792+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f238801a070 con 0x7f23940b1be0 2024-09-21T07:32:54.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.792+0000 7f2390c00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 0x7f2374075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:54.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.792+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f2388093740 con 0x7f23940b1be0 2024-09-21T07:32:54.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.792+0000 7f2393e00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 0x7f2374075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:54.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.792+0000 7f2393e00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 0x7f2374075740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f23800af000 tx=0x7f238001b010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:54.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:54.796+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f23940b2530 con 0x7f23940b1be0 2024-09-21T07:32:55.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.008+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23940addb0 con 0x7f23940b1be0 2024-09-21T07:32:55.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f2390c00640 1 -- 172.21.15.64:0/232652200 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f238805e530 con 0x7f23940b1be0 2024-09-21T07:32:55.013 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:32:55.013 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:32:55.013 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:32:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 msgr2=0x7f2374075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 0x7f2374075740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f23800af000 tx=0x7f238001b010 comp rx=0 tx=0).stop 2024-09-21T07:32:55.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 msgr2=0x7f2394151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f238800c400 tx=0x7f238800c8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 shutdown_connections 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2374073230 0x7f2374075740 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239415cbd0 0x7f2394157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23940cbcd0 0x7f239409bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 --2- 172.21.15.64:0/232652200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23940b1be0 0x7f2394151500 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 >> 172.21.15.64:0/232652200 conn(0x7f23940ccbe0 msgr2=0x7f23940afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 shutdown_connections 2024-09-21T07:32:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.012+0000 7f239ba00640 1 -- 172.21.15.64:0/232652200 wait complete. 2024-09-21T07:32:55.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:32:48.930852+0000', 'modified': '2024-09-21T07:32:51.965240+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9111': {'gid': 9111, 'name': 'a', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6834/2961655138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2961655138}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2961655138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9111, 'qdb_cluster': [9111]} 2024-09-21T07:32:55.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:32:55.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:32:55.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 -- 172.21.15.64:0/52516479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae48004050 msgr2=0x7fae48004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 --2- 172.21.15.64:0/52516479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae48004050 0x7fae48004810 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c290 tx=0x7fae4c01f700 comp rx=0 tx=0).stop 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66000640 1 -- 172.21.15.64:0/52516479 reap_dead start 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 -- 172.21.15.64:0/52516479 shutdown_connections 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 -- 172.21.15.64:0/52516479 >> 172.21.15.64:0/52516479 conn(0x7fae600b1c60 msgr2=0x7fae600b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 -- 172.21.15.64:0/52516479 shutdown_connections 2024-09-21T07:32:55.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.596+0000 7fae66a00640 1 -- 172.21.15.64:0/52516479 wait complete. 2024-09-21T07:32:55.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 Processor -- start 2024-09-21T07:32:55.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- start start 2024-09-21T07:32:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48004050 0x7fae601f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fae600c6f90 0x7fae600c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fae600b3e50 con 0x7fae600aec60 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae600b3fd0 con 0x7fae48004050 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fae600b4150 con 0x7fae600c6f90 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59584/0 (socket says 172.21.15.64:59584) 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 -- 172.21.15.64:0/512906665 learned_addr learned my addr 172.21.15.64:0/512906665 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae65600640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48004050 0x7fae601f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66000640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fae600c6f90 0x7fae600c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 -- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fae600c6f90 msgr2=0x7fae600c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fae600c6f90 0x7fae600c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 -- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48004050 msgr2=0x7fae601f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48004050 0x7fae601f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 -- 172.21.15.64:0/512906665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae601f5440 con 0x7fae600aec60 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae64c00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fae4c09c000 tx=0x7fae4c006d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae5d600640 1 -- 172.21.15.64:0/512906665 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0bf070 con 0x7fae600aec60 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae5d600640 1 -- 172.21.15.64:0/512906665 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c006530 con 0x7fae600aec60 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae601f56d0 con 0x7fae600aec60 2024-09-21T07:32:55.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae5d600640 1 -- 172.21.15.64:0/512906665 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0b3070 con 0x7fae600aec60 2024-09-21T07:32:55.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.600+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae601f5c90 con 0x7fae600aec60 2024-09-21T07:32:55.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae5d600640 1 -- 172.21.15.64:0/512906665 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fae4c0c2070 con 0x7fae600aec60 2024-09-21T07:32:55.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae5d600640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 0x7fae40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae5d600640 1 -- 172.21.15.64:0/512906665 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fae4c131ac0 con 0x7fae600aec60 2024-09-21T07:32:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae65600640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 0x7fae40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae6f806000 1 Processor -- start 2024-09-21T07:32:55.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.604+0000 7fae6f806000 1 -- start start 2024-09-21T07:32:55.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae65600640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 0x7fae40075710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fae54009c60 tx=0x7fae540091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b40ca0 0x55f991ca9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f991b7d410 con 0x55f991b57950 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f991abab40 con 0x55f991b40ca0 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f991aa9f70 con 0x55f991767460 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59598/0 (socket says 172.21.15.64:59598) 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 -- 172.21.15.64:0/1668575595 learned_addr learned my addr 172.21.15.64:0/1668575595 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae65600640 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae66000640 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b40ca0 0x55f991ca9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 -- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 msgr2=0x55f991ca86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 -- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b40ca0 msgr2=0x55f991ca9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b40ca0 0x55f991ca9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 -- 172.21.15.64:0/1668575595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f991a715b0 con 0x55f991b57950 2024-09-21T07:32:55.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae64c00640 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c380 tx=0x7fae4c0fbce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea919affd06b4f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae51c00640 1 -- 172.21.15.64:0/1668575595 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c100c90 con 0x55f991b57950 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae51c00640 1 -- 172.21.15.64:0/1668575595 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c105bd0 con 0x55f991b57950 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae51c00640 1 -- 172.21.15.64:0/1668575595 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0fb4c0 con 0x55f991b57950 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- 172.21.15.64:0/1668575595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 msgr2=0x55f991ca8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c380 tx=0x7fae4c0fbce0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- 172.21.15.64:0/1668575595 shutdown_connections 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b40ca0 0x55f991ca9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991ca8be0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 --2- 172.21.15.64:0/1668575595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- 172.21.15.64:0/1668575595 >> 172.21.15.64:0/1668575595 conn(0x55f991c2dd90 msgr2=0x55f991c5d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- 172.21.15.64:0/1668575595 shutdown_connections 2024-09-21T07:32:55.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.608+0000 7fae6f806000 1 -- 172.21.15.64:0/1668575595 wait complete. 2024-09-21T07:32:55.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- start start 2024-09-21T07:32:55.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 Processor -- start 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991caf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991b57950 0x55f991cb03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f991a445f0 con 0x55f991b40ca0 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f991aadd80 con 0x55f991767460 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f991a50520 con 0x55f991b57950 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 10 client.0 _ll_register_callbacks cb 0x55f991a54830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59600/0 (socket says 172.21.15.64:59600) 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 -- 172.21.15.64:0/3720868554 learned_addr learned my addr 172.21.15.64:0/3720868554 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae65600640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991caf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae66000640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991b57950 0x55f991cb03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 -- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991b57950 msgr2=0x55f991cb03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991b57950 0x55f991cb03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 -- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 msgr2=0x55f991caf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991caf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 -- 172.21.15.64:0/3720868554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f991a48190 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae64c00640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c380 tx=0x7fae4c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13dc78c38fc0ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae46000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c105bd0 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f991a42110 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fae4c0f7bb0 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fae4c0f7db0 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 10 client.9234 fetch_fsmap learned FSMap version 112 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.612+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55f991b2ef10 con 0x55f991b40ca0 2024-09-21T07:32:55.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f991a42110 con 0x55f991b40ca0 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fae4c0b9070 con 0x55f991b40ca0 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 10 client.9234 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 10 client.9234 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 20 client.9234 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f99174c7d0 0x55f991cb9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 4 client.9234 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:32:55.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f991abca90 con 0x55f99174c7d0 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae65600640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f99174c7d0 0x55f991cb9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae65600640 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f99174c7d0 0x55f991cb9d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a02e2fedf24ddf server_cookie=675b71772b8063a9 in_seq=0 out_seq=0 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 10 client.9234 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 1 -- 172.21.15.64:0/3720868554 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f991abca90 con 0x55f99174c7d0 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 10 client.9234 handle_command_reply: tid=0 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 client.9234 shutdown 2024-09-21T07:32:55.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 msgr2=0x55f991cafe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c380 tx=0x7fae4c001930 comp rx=0 tx=0).stop 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 shutdown_connections 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f99174c7d0 0x55f991cb9d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991b57950 0x55f991cb03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991cafe60 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 --2- 172.21.15.64:0/3720868554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991caf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae46000640 0 client.9234 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 >> 172.21.15.64:0/3720868554 conn(0x55f991c2dd90 msgr2=0x55f991c64440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 shutdown_connections 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 1 -- 172.21.15.64:0/3720868554 wait complete. 2024-09-21T07:32:55.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.616+0000 7fae6f806000 20 client.9234 trim_cache size 0 max 16384 2024-09-21T07:32:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 Processor -- start 2024-09-21T07:32:55.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 -- start start 2024-09-21T07:32:55.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 0x55f991c5ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fae60202e00 con 0x55f991b40ca0 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae60201e90 con 0x55f991b57950 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fae60154100 con 0x55f991767460 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59614/0 (socket says 172.21.15.64:59614) 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae64c00640 1 -- 172.21.15.64:0/2842670112 learned_addr learned my addr 172.21.15.64:0/2842670112 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.636+0000 7fae65600640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae66000640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 0x55f991c5ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 -- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 msgr2=0x55f991ca7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 -- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 msgr2=0x55f991c5ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 0x55f991c5ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 -- 172.21.15.64:0/2842670112 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f991b05db0 con 0x55f991b40ca0 2024-09-21T07:32:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae66000640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 0x55f991c5ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:32:55.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae64c00640 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0fc1f0 tx=0x7fae4c0faf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf06431e0c4f8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae51200640 1 -- 172.21.15.64:0/2842670112 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0fb6d0 con 0x55f991b40ca0 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae51200640 1 -- 172.21.15.64:0/2842670112 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c0fb1e0 con 0x55f991b40ca0 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae51200640 1 -- 172.21.15.64:0/2842670112 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c102120 con 0x55f991b40ca0 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- 172.21.15.64:0/2842670112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 msgr2=0x55f991ca7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0fc1f0 tx=0x7fae4c0faf30 comp rx=0 tx=0).stop 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- 172.21.15.64:0/2842670112 shutdown_connections 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991b57950 0x55f991c5ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b40ca0 0x55f991ca7b70 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 --2- 172.21.15.64:0/2842670112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f991767460 0x55f991ca7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- 172.21.15.64:0/2842670112 >> 172.21.15.64:0/2842670112 conn(0x55f991c2dd90 msgr2=0x55f991c6a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- 172.21.15.64:0/2842670112 shutdown_connections 2024-09-21T07:32:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- 172.21.15.64:0/2842670112 wait complete. 2024-09-21T07:32:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 -- start start 2024-09-21T07:32:55.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.640+0000 7fae6f806000 1 Processor -- start 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991c5fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f99173a830 0x55f991cda220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f991a50520 con 0x55f991b57950 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae60154750 con 0x55f991767460 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f991a445f0 con 0x55f99173a830 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 10 client.0 _ll_register_callbacks cb 0x7fae4c0fbbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59628/0 (socket says 172.21.15.64:59628) 2024-09-21T07:32:55.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae65600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991c5fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 -- 172.21.15.64:0/774684427 learned_addr learned my addr 172.21.15.64:0/774684427 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae66000640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f99173a830 0x55f991cda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 -- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f99173a830 msgr2=0x55f991cda220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f99173a830 0x55f991cda220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 -- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 msgr2=0x55f991c5fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991c5fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 -- 172.21.15.64:0/774684427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f991a70ab0 con 0x55f991b57950 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae64c00640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0fafa0 tx=0x7fae4c12fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1d63a64a845d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0e9040 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fae4c105320 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae4c0fb1e0 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fae4c116020 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 10 client.9240 fetch_fsmap learned FSMap version 112 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55f991a4f070 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c0fb1e0 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fae4c1161c0 con 0x55f991b57950 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 10 client.9240 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 10 client.9240 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 20 client.9240 populate_metadata read hostname 'smithi064' 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f991cdabe0 0x55f991d1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 4 client.9240 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "status"}) -- 0x55f991ab8540 con 0x55f991cdabe0 2024-09-21T07:32:55.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae65600640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f991cdabe0 0x55f991d1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 10 client.9240 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae65600640 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f991cdabe0 0x55f991d1dc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3bf2dfd69e39f5 server_cookie=8b437673c72035a in_seq=0 out_seq=0 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 1 -- 172.21.15.64:0/774684427 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55f991ab8540 con 0x55f991cdabe0 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 10 client.9240 handle_command_reply: tid=0 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 client.9240 shutdown 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 msgr2=0x55f991c60210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0fafa0 tx=0x7fae4c12fe40 comp rx=0 tx=0).stop 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 shutdown_connections 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55f991cdabe0 0x55f991d1dc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f99173a830 0x55f991cda220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f991b57950 0x55f991c60210 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 --2- 172.21.15.64:0/774684427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f991767460 0x55f991c5fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 >> 172.21.15.64:0/774684427 conn(0x55f991c2dd90 msgr2=0x55f991cb98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae46000640 0 client.9240 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 shutdown_connections 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 1 -- 172.21.15.64:0/774684427 wait complete. 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.644+0000 7fae6f806000 20 client.9240 trim_cache size 0 max 16384 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 9111, 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:32:55.651 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 6.1434102959999999, 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 112, 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 153, 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 153, 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 10.576889509000001 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:32:55.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 msgr2=0x7fae40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 0x7fae40075710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fae54009c60 tx=0x7fae540091e0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 msgr2=0x7fae600af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fae4c09c000 tx=0x7fae4c006d60 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 shutdown_connections 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fae40073200 0x7fae40075710 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fae600c6f90 0x7fae600c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae600aec60 0x7fae600af070 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 --2- 172.21.15.64:0/512906665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48004050 0x7fae601f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 >> 172.21.15.64:0/512906665 conn(0x7fae600b1c60 msgr2=0x7fae600b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 shutdown_connections 2024-09-21T07:32:55.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.648+0000 7fae66a00640 1 -- 172.21.15.64:0/512906665 wait complete. 2024-09-21T07:32:55.668 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:32:55.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 -- 172.21.15.64:0/59273495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b406d500 msgr2=0x7f37b415c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 --2- 172.21.15.64:0/59273495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b406d500 0x7f37b415c6c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009900 tx=0x7f37a001c850 comp rx=0 tx=0).stop 2024-09-21T07:32:55.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 -- 172.21.15.64:0/59273495 shutdown_connections 2024-09-21T07:32:55.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 --2- 172.21.15.64:0/59273495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074830 0x7f37b415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 --2- 172.21.15.64:0/59273495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b406d500 0x7f37b415c6c0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 -- 172.21.15.64:0/59273495 >> 172.21.15.64:0/59273495 conn(0x7f37b40cdd00 msgr2=0x7f37b40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 -- 172.21.15.64:0/59273495 shutdown_connections 2024-09-21T07:32:55.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.824+0000 7f37bc400640 1 -- 172.21.15.64:0/59273495 wait complete. 2024-09-21T07:32:55.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 Processor -- start 2024-09-21T07:32:55.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 -- start start 2024-09-21T07:32:55.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074420 0x7f37b40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4074830 0x7f37b4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f37b416a6a0 con 0x7f37b41fb780 2024-09-21T07:32:55.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37b416a520 con 0x7f37b4074830 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37bc400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f37b416a820 con 0x7f37b4074420 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59634/0 (socket says 172.21.15.64:59634) 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 -- 172.21.15.64:0/551774326 learned_addr learned my addr 172.21.15.64:0/551774326 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37b9a00640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074420 0x7f37b40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37b9000640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4074830 0x7f37b4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 -- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074420 msgr2=0x7f37b40b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074420 0x7f37b40b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 -- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4074830 msgr2=0x7f37b4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4074830 0x7f37b4157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.828+0000 7f37ba400640 1 -- 172.21.15.64:0/551774326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40c7a00 con 0x7f37b41fb780 2024-09-21T07:32:55.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37ba400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cae0 tx=0x7f37ac00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00add0 con 0x7f37b41fb780 2024-09-21T07:32:55.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37ac00f560 con 0x7f37b41fb780 2024-09-21T07:32:55.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b41faca0 con 0x7f37b41fb780 2024-09-21T07:32:55.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00f9b0 con 0x7f37b41fb780 2024-09-21T07:32:55.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b41fb260 con 0x7f37b41fb780 2024-09-21T07:32:55.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b415c6c0 con 0x7f37b41fb780 2024-09-21T07:32:55.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f37ac00fb50 con 0x7f37b41fb780 2024-09-21T07:32:55.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 0x7f3794075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.832+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f37ac094db0 con 0x7f37b41fb780 2024-09-21T07:32:55.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.836+0000 7f37b9a00640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 0x7f3794075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.836+0000 7f37b9a00640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 0x7f3794075710 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f37a8006fd0 tx=0x7f37a8009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:55.840+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f37ac099070 con 0x7f37b41fb780 2024-09-21T07:32:56.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f37b409eed0 con 0x7f37b41fb780 2024-09-21T07:32:56.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37b1600640 1 -- 172.21.15.64:0/551774326 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) ==== 53+0+73 (secure 0 0 0) 0x7f37ac014030 con 0x7f37b41fb780 2024-09-21T07:32:56.058 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 msgr2=0x7f3794075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 0x7f3794075710 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f37a8006fd0 tx=0x7f37a8009060 comp rx=0 tx=0).stop 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 msgr2=0x7f37b4155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cae0 tx=0x7f37ac00a250 comp rx=0 tx=0).stop 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 shutdown_connections 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3794073200 0x7f3794075710 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b41fb780 0x7f37b4155460 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:56.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4074830 0x7f37b4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:56.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 --2- 172.21.15.64:0/551774326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37b4074420 0x7f37b40b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:56.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 >> 172.21.15.64:0/551774326 conn(0x7f37b40cdd00 msgr2=0x7f37b40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:56.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 shutdown_connections 2024-09-21T07:32:56.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56.056+0000 7f37bc400640 1 -- 172.21.15.64:0/551774326 wait complete. 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:32:56.080 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:32:56.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:32:56.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.081 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:32:56.090 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41807sec preferred_lft 41807sec 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:32:56.091 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.092 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:32:56.093 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:32:56.093 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:32:56.093 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:32:56.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.094 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:32:56.154 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:32:56.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.156 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:32:56.216 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:32:56.216 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:32:56.216 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:32:56.216 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:32:56.217 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:32:56.217 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:32:56.217 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:56.217 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:32:56.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:32:56.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:32:56.218 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:56.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:32:56.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:56.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.360 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:32:56.369 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:32:56.370 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:32:56.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:32:56.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:32:56.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:32:56.436 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:32:56.488 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:32:56.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:32:56.489 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:32:56.540 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:32:56.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.540 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:32:56.642 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:32:56.642 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:32:56.655 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:32:56.655 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:32:56.655 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:32:56.655 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:32:56.656 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:32:56.659 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:32:56.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:32:56.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:32:56.679 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:32:56.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:56.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:56.794 INFO:teuthology.orchestra.run.smithi064.stdout:client8782 2024-09-21T07:32:56.794 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:32:56.794 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:32:56.822 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:56.822 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:56.823 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.0 2024-09-21T07:32:56.823 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:56.824 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:56.824 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:56.824 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:56.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:56.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:56.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:56.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186037 s, 56.4 MB/s 2024-09-21T07:32:56.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:56.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168477 s, 62.2 MB/s 2024-09-21T07:32:56.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:56.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:56.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157586 s, 66.5 MB/s 2024-09-21T07:32:57.015 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.015 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.015 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151311 s, 69.3 MB/s 2024-09-21T07:32:57.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150219 s, 69.8 MB/s 2024-09-21T07:32:57.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.052 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161172 s, 65.1 MB/s 2024-09-21T07:32:57.074 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.075 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200354 s, 52.3 MB/s 2024-09-21T07:32:57.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.092 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147045 s, 71.3 MB/s 2024-09-21T07:32:57.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014277 s, 73.4 MB/s 2024-09-21T07:32:57.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.128 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162988 s, 64.3 MB/s 2024-09-21T07:32:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154096 s, 68.0 MB/s 2024-09-21T07:32:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145304 s, 72.2 MB/s 2024-09-21T07:32:57.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.179 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131622 s, 79.7 MB/s 2024-09-21T07:32:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144163 s, 72.7 MB/s 2024-09-21T07:32:57.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185135 s, 56.6 MB/s 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138246 s, 75.8 MB/s 2024-09-21T07:32:57.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150609 s, 69.6 MB/s 2024-09-21T07:32:57.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.269 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143487 s, 73.1 MB/s 2024-09-21T07:32:57.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155611 s, 67.4 MB/s 2024-09-21T07:32:57.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153246 s, 68.4 MB/s 2024-09-21T07:32:57.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142408 s, 73.6 MB/s 2024-09-21T07:32:57.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.342 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173416 s, 60.5 MB/s 2024-09-21T07:32:57.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177176 s, 59.2 MB/s 2024-09-21T07:32:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136336 s, 76.9 MB/s 2024-09-21T07:32:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145057 s, 72.3 MB/s 2024-09-21T07:32:57.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164293 s, 63.8 MB/s 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149417 s, 70.2 MB/s 2024-09-21T07:32:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176732 s, 59.3 MB/s 2024-09-21T07:32:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157264 s, 66.7 MB/s 2024-09-21T07:32:57.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017418 s, 60.2 MB/s 2024-09-21T07:32:57.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121073 s, 86.6 MB/s 2024-09-21T07:32:57.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157979 s, 66.4 MB/s 2024-09-21T07:32:57.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:57.531 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:57.531 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:57.531 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.1 2024-09-21T07:32:57.531 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:57.531 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:57.532 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:57.532 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:57.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:57.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140041 s, 74.9 MB/s 2024-09-21T07:32:57.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01446 s, 72.5 MB/s 2024-09-21T07:32:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.673 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131714 s, 79.6 MB/s 2024-09-21T07:32:57.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.692 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159999 s, 65.5 MB/s 2024-09-21T07:32:57.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.714 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.714 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184053 s, 57.0 MB/s 2024-09-21T07:32:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166724 s, 62.9 MB/s 2024-09-21T07:32:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137178 s, 76.4 MB/s 2024-09-21T07:32:57.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197477 s, 53.1 MB/s 2024-09-21T07:32:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145509 s, 72.1 MB/s 2024-09-21T07:32:57.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136198 s, 77.0 MB/s 2024-09-21T07:32:57.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.823 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149262 s, 70.3 MB/s 2024-09-21T07:32:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.839 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138998 s, 75.4 MB/s 2024-09-21T07:32:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.855 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131068 s, 80.0 MB/s 2024-09-21T07:32:57.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.873 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149114 s, 70.3 MB/s 2024-09-21T07:32:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138415 s, 75.8 MB/s 2024-09-21T07:32:57.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.906 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133846 s, 78.3 MB/s 2024-09-21T07:32:57.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135803 s, 77.2 MB/s 2024-09-21T07:32:57.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.938 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014199 s, 73.8 MB/s 2024-09-21T07:32:57.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.958 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174072 s, 60.2 MB/s 2024-09-21T07:32:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144316 s, 72.7 MB/s 2024-09-21T07:32:57.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:57.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:57.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145848 s, 71.9 MB/s 2024-09-21T07:32:58.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134228 s, 78.1 MB/s 2024-09-21T07:32:58.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.025 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136133 s, 77.0 MB/s 2024-09-21T07:32:58.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.043 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147026 s, 71.3 MB/s 2024-09-21T07:32:58.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149155 s, 70.3 MB/s 2024-09-21T07:32:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140409 s, 74.7 MB/s 2024-09-21T07:32:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.093 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136316 s, 76.9 MB/s 2024-09-21T07:32:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180506 s, 58.1 MB/s 2024-09-21T07:32:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131235 s, 79.9 MB/s 2024-09-21T07:32:58.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.145 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132234 s, 79.3 MB/s 2024-09-21T07:32:58.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139249 s, 75.3 MB/s 2024-09-21T07:32:58.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130225 s, 80.5 MB/s 2024-09-21T07:32:58.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.2 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:58.185 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:58.186 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:58.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:58.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.256 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015456 s, 67.8 MB/s 2024-09-21T07:32:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131361 s, 79.8 MB/s 2024-09-21T07:32:58.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131689 s, 79.6 MB/s 2024-09-21T07:32:58.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152481 s, 68.8 MB/s 2024-09-21T07:32:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136798 s, 76.7 MB/s 2024-09-21T07:32:58.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.338 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135454 s, 77.4 MB/s 2024-09-21T07:32:58.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183525 s, 57.1 MB/s 2024-09-21T07:32:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183619 s, 57.1 MB/s 2024-09-21T07:32:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185796 s, 56.4 MB/s 2024-09-21T07:32:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141609 s, 74.0 MB/s 2024-09-21T07:32:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138762 s, 75.6 MB/s 2024-09-21T07:32:58.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141045 s, 74.3 MB/s 2024-09-21T07:32:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137399 s, 76.3 MB/s 2024-09-21T07:32:58.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.485 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141342 s, 74.2 MB/s 2024-09-21T07:32:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140643 s, 74.6 MB/s 2024-09-21T07:32:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.522 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180799 s, 58.0 MB/s 2024-09-21T07:32:58.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.537 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013299 s, 78.8 MB/s 2024-09-21T07:32:58.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138277 s, 75.8 MB/s 2024-09-21T07:32:58.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.575 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182221 s, 57.5 MB/s 2024-09-21T07:32:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.591 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133083 s, 78.8 MB/s 2024-09-21T07:32:58.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.607 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134546 s, 77.9 MB/s 2024-09-21T07:32:58.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135189 s, 77.6 MB/s 2024-09-21T07:32:58.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151159 s, 69.4 MB/s 2024-09-21T07:32:58.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192132 s, 54.6 MB/s 2024-09-21T07:32:58.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01413 s, 74.2 MB/s 2024-09-21T07:32:58.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133651 s, 78.5 MB/s 2024-09-21T07:32:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.711 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125871 s, 83.3 MB/s 2024-09-21T07:32:58.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018718 s, 56.0 MB/s 2024-09-21T07:32:58.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.751 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153935 s, 68.1 MB/s 2024-09-21T07:32:58.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130535 s, 80.3 MB/s 2024-09-21T07:32:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.788 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188554 s, 55.6 MB/s 2024-09-21T07:32:58.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158023 s, 66.4 MB/s 2024-09-21T07:32:58.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:58.814 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.3 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:58.815 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:58.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:58.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137197 s, 76.4 MB/s 2024-09-21T07:32:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01324 s, 79.2 MB/s 2024-09-21T07:32:58.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.957 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151426 s, 69.2 MB/s 2024-09-21T07:32:58.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.974 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136031 s, 77.1 MB/s 2024-09-21T07:32:58.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:58.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:58.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147374 s, 71.2 MB/s 2024-09-21T07:32:59.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.010 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156281 s, 67.1 MB/s 2024-09-21T07:32:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121323 s, 86.4 MB/s 2024-09-21T07:32:59.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.041 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136747 s, 76.7 MB/s 2024-09-21T07:32:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.057 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137574 s, 76.2 MB/s 2024-09-21T07:32:59.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188823 s, 55.5 MB/s 2024-09-21T07:32:59.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184272 s, 56.9 MB/s 2024-09-21T07:32:59.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162819 s, 64.4 MB/s 2024-09-21T07:32:59.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.138 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160443 s, 65.4 MB/s 2024-09-21T07:32:59.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.154 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131882 s, 79.5 MB/s 2024-09-21T07:32:59.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.171 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152352 s, 68.8 MB/s 2024-09-21T07:32:59.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.189 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145867 s, 71.9 MB/s 2024-09-21T07:32:59.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134442 s, 78.0 MB/s 2024-09-21T07:32:59.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143735 s, 73.0 MB/s 2024-09-21T07:32:59.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151827 s, 69.1 MB/s 2024-09-21T07:32:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149597 s, 70.1 MB/s 2024-09-21T07:32:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139807 s, 75.0 MB/s 2024-09-21T07:32:59.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.291 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147401 s, 71.1 MB/s 2024-09-21T07:32:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177163 s, 59.2 MB/s 2024-09-21T07:32:59.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016294 s, 64.4 MB/s 2024-09-21T07:32:59.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134594 s, 77.9 MB/s 2024-09-21T07:32:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129975 s, 80.7 MB/s 2024-09-21T07:32:59.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184808 s, 56.7 MB/s 2024-09-21T07:32:59.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132754 s, 79.0 MB/s 2024-09-21T07:32:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151199 s, 69.4 MB/s 2024-09-21T07:32:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015669 s, 66.9 MB/s 2024-09-21T07:32:59.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182973 s, 57.3 MB/s 2024-09-21T07:32:59.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137936 s, 76.0 MB/s 2024-09-21T07:32:59.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.4 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:32:59.481 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:32:59.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:32:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:32:59.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186715 s, 56.2 MB/s 2024-09-21T07:32:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139337 s, 75.3 MB/s 2024-09-21T07:32:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185794 s, 56.4 MB/s 2024-09-21T07:32:59.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.608 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131141 s, 80.0 MB/s 2024-09-21T07:32:59.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.625 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142047 s, 73.8 MB/s 2024-09-21T07:32:59.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137837 s, 76.1 MB/s 2024-09-21T07:32:59.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181435 s, 57.8 MB/s 2024-09-21T07:32:59.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148336 s, 70.7 MB/s 2024-09-21T07:32:59.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195381 s, 53.7 MB/s 2024-09-21T07:32:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.720 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148719 s, 70.5 MB/s 2024-09-21T07:32:59.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018163 s, 57.7 MB/s 2024-09-21T07:32:59.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153589 s, 68.3 MB/s 2024-09-21T07:32:59.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134571 s, 77.9 MB/s 2024-09-21T07:32:59.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.792 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014482 s, 72.4 MB/s 2024-09-21T07:32:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138087 s, 75.9 MB/s 2024-09-21T07:32:59.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186527 s, 56.2 MB/s 2024-09-21T07:32:59.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136548 s, 76.8 MB/s 2024-09-21T07:32:59.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.865 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159281 s, 65.8 MB/s 2024-09-21T07:32:59.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135627 s, 77.3 MB/s 2024-09-21T07:32:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111902 s, 93.7 MB/s 2024-09-21T07:32:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139198 s, 75.3 MB/s 2024-09-21T07:32:59.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.930 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153524 s, 68.3 MB/s 2024-09-21T07:32:59.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137896 s, 76.0 MB/s 2024-09-21T07:32:59.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134731 s, 77.8 MB/s 2024-09-21T07:32:59.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.979 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138957 s, 75.5 MB/s 2024-09-21T07:32:59.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:32:59.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:32:59.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142882 s, 73.4 MB/s 2024-09-21T07:33:00.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132332 s, 79.2 MB/s 2024-09-21T07:33:00.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.028 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.028 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135395 s, 77.4 MB/s 2024-09-21T07:33:00.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139597 s, 75.1 MB/s 2024-09-21T07:33:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132006 s, 79.4 MB/s 2024-09-21T07:33:00.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134855 s, 77.8 MB/s 2024-09-21T07:33:00.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.099 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.099 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188922 s, 55.5 MB/s 2024-09-21T07:33:00.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.5 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:00.108 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:00.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:00.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137 s, 76.5 MB/s 2024-09-21T07:33:00.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131563 s, 79.7 MB/s 2024-09-21T07:33:00.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179494 s, 58.4 MB/s 2024-09-21T07:33:00.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.231 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152674 s, 68.7 MB/s 2024-09-21T07:33:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148267 s, 70.7 MB/s 2024-09-21T07:33:00.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.265 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141127 s, 74.3 MB/s 2024-09-21T07:33:00.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153894 s, 68.1 MB/s 2024-09-21T07:33:00.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143142 s, 73.3 MB/s 2024-09-21T07:33:00.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129741 s, 80.8 MB/s 2024-09-21T07:33:00.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153344 s, 68.4 MB/s 2024-09-21T07:33:00.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193379 s, 54.2 MB/s 2024-09-21T07:33:00.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132868 s, 78.9 MB/s 2024-09-21T07:33:00.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139089 s, 75.4 MB/s 2024-09-21T07:33:00.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.405 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135535 s, 77.4 MB/s 2024-09-21T07:33:00.421 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.421 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.422 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135195 s, 77.6 MB/s 2024-09-21T07:33:00.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.438 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137654 s, 76.2 MB/s 2024-09-21T07:33:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112037 s, 93.6 MB/s 2024-09-21T07:33:00.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186773 s, 56.1 MB/s 2024-09-21T07:33:00.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015168 s, 69.1 MB/s 2024-09-21T07:33:00.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013612 s, 77.0 MB/s 2024-09-21T07:33:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137019 s, 76.5 MB/s 2024-09-21T07:33:00.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131423 s, 79.8 MB/s 2024-09-21T07:33:00.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182846 s, 57.3 MB/s 2024-09-21T07:33:00.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138046 s, 76.0 MB/s 2024-09-21T07:33:00.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.594 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134988 s, 77.7 MB/s 2024-09-21T07:33:00.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187617 s, 55.9 MB/s 2024-09-21T07:33:00.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167685 s, 62.5 MB/s 2024-09-21T07:33:00.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.656 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183553 s, 57.1 MB/s 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140277 s, 74.8 MB/s 2024-09-21T07:33:00.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01417 s, 74.0 MB/s 2024-09-21T07:33:00.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.706 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143185 s, 73.2 MB/s 2024-09-21T07:33:00.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019059 s, 55.0 MB/s 2024-09-21T07:33:00.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.6 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:00.735 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:00.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:00.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158397 s, 66.2 MB/s 2024-09-21T07:33:00.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136618 s, 76.8 MB/s 2024-09-21T07:33:00.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.839 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149639 s, 70.1 MB/s 2024-09-21T07:33:00.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.855 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.855 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130709 s, 80.2 MB/s 2024-09-21T07:33:00.873 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.873 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.873 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150861 s, 69.5 MB/s 2024-09-21T07:33:00.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.889 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140105 s, 74.8 MB/s 2024-09-21T07:33:00.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.906 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135317 s, 77.5 MB/s 2024-09-21T07:33:00.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133745 s, 78.4 MB/s 2024-09-21T07:33:00.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154618 s, 67.8 MB/s 2024-09-21T07:33:00.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.957 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148502 s, 70.6 MB/s 2024-09-21T07:33:00.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134943 s, 77.7 MB/s 2024-09-21T07:33:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153025 s, 68.5 MB/s 2024-09-21T07:33:01.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014738 s, 71.1 MB/s 2024-09-21T07:33:01.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176302 s, 59.5 MB/s 2024-09-21T07:33:01.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133101 s, 78.8 MB/s 2024-09-21T07:33:01.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01295 s, 81.0 MB/s 2024-09-21T07:33:01.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153447 s, 68.3 MB/s 2024-09-21T07:33:01.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153978 s, 68.1 MB/s 2024-09-21T07:33:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184574 s, 56.8 MB/s 2024-09-21T07:33:01.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.137 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171033 s, 61.3 MB/s 2024-09-21T07:33:01.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.154 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136285 s, 76.9 MB/s 2024-09-21T07:33:01.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.170 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138847 s, 75.5 MB/s 2024-09-21T07:33:01.186 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.187 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135752 s, 77.2 MB/s 2024-09-21T07:33:01.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.203 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.203 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137908 s, 76.0 MB/s 2024-09-21T07:33:01.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.221 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151357 s, 69.3 MB/s 2024-09-21T07:33:01.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.237 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137491 s, 76.3 MB/s 2024-09-21T07:33:01.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145485 s, 72.1 MB/s 2024-09-21T07:33:01.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.272 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146354 s, 71.6 MB/s 2024-09-21T07:33:01.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.288 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135864 s, 77.2 MB/s 2024-09-21T07:33:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.306 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014988 s, 70.0 MB/s 2024-09-21T07:33:01.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133899 s, 78.3 MB/s 2024-09-21T07:33:01.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.340 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015512 s, 67.6 MB/s 2024-09-21T07:33:01.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.7 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:01.347 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:01.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:01.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.413 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119105 s, 88.0 MB/s 2024-09-21T07:33:01.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.434 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169553 s, 61.8 MB/s 2024-09-21T07:33:01.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.450 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144713 s, 72.5 MB/s 2024-09-21T07:33:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134476 s, 78.0 MB/s 2024-09-21T07:33:01.483 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.483 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.483 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141923 s, 73.9 MB/s 2024-09-21T07:33:01.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151743 s, 69.1 MB/s 2024-09-21T07:33:01.518 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.519 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151008 s, 69.4 MB/s 2024-09-21T07:33:01.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.536 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140691 s, 74.5 MB/s 2024-09-21T07:33:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136104 s, 77.0 MB/s 2024-09-21T07:33:01.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.571 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155038 s, 67.6 MB/s 2024-09-21T07:33:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138584 s, 75.7 MB/s 2024-09-21T07:33:01.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.606 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157388 s, 66.6 MB/s 2024-09-21T07:33:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189604 s, 55.3 MB/s 2024-09-21T07:33:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205314 s, 51.1 MB/s 2024-09-21T07:33:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144484 s, 72.6 MB/s 2024-09-21T07:33:01.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147265 s, 71.2 MB/s 2024-09-21T07:33:01.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140026 s, 74.9 MB/s 2024-09-21T07:33:01.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133959 s, 78.3 MB/s 2024-09-21T07:33:01.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140536 s, 74.6 MB/s 2024-09-21T07:33:01.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.751 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133748 s, 78.4 MB/s 2024-09-21T07:33:01.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018848 s, 55.6 MB/s 2024-09-21T07:33:01.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161636 s, 64.9 MB/s 2024-09-21T07:33:01.812 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.812 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.812 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181058 s, 57.9 MB/s 2024-09-21T07:33:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138887 s, 75.5 MB/s 2024-09-21T07:33:01.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.846 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153831 s, 68.2 MB/s 2024-09-21T07:33:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142307 s, 73.7 MB/s 2024-09-21T07:33:01.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135287 s, 77.5 MB/s 2024-09-21T07:33:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013039 s, 80.4 MB/s 2024-09-21T07:33:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141809 s, 73.9 MB/s 2024-09-21T07:33:01.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156167 s, 67.1 MB/s 2024-09-21T07:33:01.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.947 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013617 s, 77.0 MB/s 2024-09-21T07:33:01.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:01.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:01.964 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143387 s, 73.1 MB/s 2024-09-21T07:33:01.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.8 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:01.971 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:01.972 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:02.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:02.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140331 s, 74.7 MB/s 2024-09-21T07:33:02.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183448 s, 57.2 MB/s 2024-09-21T07:33:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141851 s, 73.9 MB/s 2024-09-21T07:33:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01347 s, 77.8 MB/s 2024-09-21T07:33:02.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.111 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143297 s, 73.2 MB/s 2024-09-21T07:33:02.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152834 s, 68.6 MB/s 2024-09-21T07:33:02.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.145 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133619 s, 78.5 MB/s 2024-09-21T07:33:02.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143178 s, 73.2 MB/s 2024-09-21T07:33:02.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135978 s, 77.1 MB/s 2024-09-21T07:33:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184689 s, 56.8 MB/s 2024-09-21T07:33:02.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143656 s, 73.0 MB/s 2024-09-21T07:33:02.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.238 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191341 s, 54.8 MB/s 2024-09-21T07:33:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163342 s, 64.2 MB/s 2024-09-21T07:33:02.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139164 s, 75.3 MB/s 2024-09-21T07:33:02.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.290 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013027 s, 80.5 MB/s 2024-09-21T07:33:02.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.307 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149439 s, 70.2 MB/s 2024-09-21T07:33:02.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133518 s, 78.5 MB/s 2024-09-21T07:33:02.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.340 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.340 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143398 s, 73.1 MB/s 2024-09-21T07:33:02.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142316 s, 73.7 MB/s 2024-09-21T07:33:02.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176248 s, 59.5 MB/s 2024-09-21T07:33:02.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176632 s, 59.4 MB/s 2024-09-21T07:33:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137808 s, 76.1 MB/s 2024-09-21T07:33:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136128 s, 77.0 MB/s 2024-09-21T07:33:02.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145442 s, 72.1 MB/s 2024-09-21T07:33:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133246 s, 78.7 MB/s 2024-09-21T07:33:02.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.480 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135392 s, 77.4 MB/s 2024-09-21T07:33:02.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.497 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142851 s, 73.4 MB/s 2024-09-21T07:33:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015214 s, 68.9 MB/s 2024-09-21T07:33:02.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.536 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186285 s, 56.3 MB/s 2024-09-21T07:33:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151049 s, 69.4 MB/s 2024-09-21T07:33:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129217 s, 81.1 MB/s 2024-09-21T07:33:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143768 s, 72.9 MB/s 2024-09-21T07:33:02.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:02.594 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:02.594 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:02.594 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.9 2024-09-21T07:33:02.595 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:02.595 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:02.595 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:02.595 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:02.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:02.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147983 s, 70.9 MB/s 2024-09-21T07:33:02.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158381 s, 66.2 MB/s 2024-09-21T07:33:02.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149582 s, 70.1 MB/s 2024-09-21T07:33:02.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.716 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134827 s, 77.8 MB/s 2024-09-21T07:33:02.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130218 s, 80.5 MB/s 2024-09-21T07:33:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181795 s, 57.7 MB/s 2024-09-21T07:33:02.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194167 s, 54.0 MB/s 2024-09-21T07:33:02.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.792 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013891 s, 75.5 MB/s 2024-09-21T07:33:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144084 s, 72.8 MB/s 2024-09-21T07:33:02.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.827 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145823 s, 71.9 MB/s 2024-09-21T07:33:02.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134485 s, 78.0 MB/s 2024-09-21T07:33:02.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154503 s, 67.9 MB/s 2024-09-21T07:33:02.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144914 s, 72.4 MB/s 2024-09-21T07:33:02.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015176 s, 69.1 MB/s 2024-09-21T07:33:02.914 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149151 s, 70.3 MB/s 2024-09-21T07:33:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134288 s, 78.1 MB/s 2024-09-21T07:33:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01433 s, 73.2 MB/s 2024-09-21T07:33:02.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.965 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146197 s, 71.7 MB/s 2024-09-21T07:33:02.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.982 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142723 s, 73.5 MB/s 2024-09-21T07:33:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129989 s, 80.7 MB/s 2024-09-21T07:33:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138031 s, 76.0 MB/s 2024-09-21T07:33:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139497 s, 75.2 MB/s 2024-09-21T07:33:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137074 s, 76.5 MB/s 2024-09-21T07:33:03.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.066 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162299 s, 64.6 MB/s 2024-09-21T07:33:03.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139844 s, 75.0 MB/s 2024-09-21T07:33:03.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142741 s, 73.5 MB/s 2024-09-21T07:33:03.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.117 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.117 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150768 s, 69.5 MB/s 2024-09-21T07:33:03.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.135 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143944 s, 72.8 MB/s 2024-09-21T07:33:03.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190048 s, 55.2 MB/s 2024-09-21T07:33:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151268 s, 69.3 MB/s 2024-09-21T07:33:03.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158099 s, 66.3 MB/s 2024-09-21T07:33:03.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185032 s, 56.7 MB/s 2024-09-21T07:33:03.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:03.221 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:03.221 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:03.222 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.10 2024-09-21T07:33:03.222 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:03.222 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:03.222 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:03.222 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:03.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:03.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.294 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180604 s, 58.1 MB/s 2024-09-21T07:33:03.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.310 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132259 s, 79.3 MB/s 2024-09-21T07:33:03.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136241 s, 77.0 MB/s 2024-09-21T07:33:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189919 s, 55.2 MB/s 2024-09-21T07:33:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013404 s, 78.2 MB/s 2024-09-21T07:33:03.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.381 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135222 s, 77.5 MB/s 2024-09-21T07:33:03.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159361 s, 65.8 MB/s 2024-09-21T07:33:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179717 s, 58.3 MB/s 2024-09-21T07:33:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160379 s, 65.4 MB/s 2024-09-21T07:33:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144999 s, 72.3 MB/s 2024-09-21T07:33:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178803 s, 58.6 MB/s 2024-09-21T07:33:03.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.499 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191572 s, 54.7 MB/s 2024-09-21T07:33:03.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.517 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154189 s, 68.0 MB/s 2024-09-21T07:33:03.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139433 s, 75.2 MB/s 2024-09-21T07:33:03.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.550 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138924 s, 75.5 MB/s 2024-09-21T07:33:03.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142037 s, 73.8 MB/s 2024-09-21T07:33:03.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134444 s, 78.0 MB/s 2024-09-21T07:33:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134839 s, 77.8 MB/s 2024-09-21T07:33:03.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143085 s, 73.3 MB/s 2024-09-21T07:33:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013887 s, 75.5 MB/s 2024-09-21T07:33:03.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152576 s, 68.7 MB/s 2024-09-21T07:33:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146338 s, 71.7 MB/s 2024-09-21T07:33:03.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014311 s, 73.3 MB/s 2024-09-21T07:33:03.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134034 s, 78.2 MB/s 2024-09-21T07:33:03.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142483 s, 73.6 MB/s 2024-09-21T07:33:03.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135453 s, 77.4 MB/s 2024-09-21T07:33:03.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146008 s, 71.8 MB/s 2024-09-21T07:33:03.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162752 s, 64.4 MB/s 2024-09-21T07:33:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013466 s, 77.9 MB/s 2024-09-21T07:33:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136819 s, 76.6 MB/s 2024-09-21T07:33:03.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159046 s, 65.9 MB/s 2024-09-21T07:33:03.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.843 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187886 s, 55.8 MB/s 2024-09-21T07:33:03.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.11 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:03.851 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:03.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:03.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135167 s, 77.6 MB/s 2024-09-21T07:33:03.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137959 s, 76.0 MB/s 2024-09-21T07:33:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132187 s, 79.3 MB/s 2024-09-21T07:33:04.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187984 s, 55.8 MB/s 2024-09-21T07:33:04.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149741 s, 70.0 MB/s 2024-09-21T07:33:04.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141862 s, 73.9 MB/s 2024-09-21T07:33:04.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134441 s, 78.0 MB/s 2024-09-21T07:33:04.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.082 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150954 s, 69.5 MB/s 2024-09-21T07:33:04.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015442 s, 67.9 MB/s 2024-09-21T07:33:04.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155372 s, 67.5 MB/s 2024-09-21T07:33:04.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144118 s, 72.8 MB/s 2024-09-21T07:33:04.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131391 s, 79.8 MB/s 2024-09-21T07:33:04.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.172 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175333 s, 59.8 MB/s 2024-09-21T07:33:04.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131373 s, 79.8 MB/s 2024-09-21T07:33:04.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.206 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148553 s, 70.6 MB/s 2024-09-21T07:33:04.223 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.224 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152322 s, 68.8 MB/s 2024-09-21T07:33:04.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152432 s, 68.8 MB/s 2024-09-21T07:33:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134767 s, 77.8 MB/s 2024-09-21T07:33:04.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134599 s, 77.9 MB/s 2024-09-21T07:33:04.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.295 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180425 s, 58.1 MB/s 2024-09-21T07:33:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130478 s, 80.4 MB/s 2024-09-21T07:33:04.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.328 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015373 s, 68.2 MB/s 2024-09-21T07:33:04.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.345 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133611 s, 78.5 MB/s 2024-09-21T07:33:04.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.361 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138274 s, 75.8 MB/s 2024-09-21T07:33:04.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130199 s, 80.5 MB/s 2024-09-21T07:33:04.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131556 s, 79.7 MB/s 2024-09-21T07:33:04.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.411 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155582 s, 67.4 MB/s 2024-09-21T07:33:04.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.429 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146345 s, 71.7 MB/s 2024-09-21T07:33:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.445 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140587 s, 74.6 MB/s 2024-09-21T07:33:04.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117235 s, 89.4 MB/s 2024-09-21T07:33:04.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.476 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139106 s, 75.4 MB/s 2024-09-21T07:33:04.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151756 s, 69.1 MB/s 2024-09-21T07:33:04.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.12 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:04.501 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:04.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:04.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015386 s, 68.2 MB/s 2024-09-21T07:33:04.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134225 s, 78.1 MB/s 2024-09-21T07:33:04.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.605 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143635 s, 73.0 MB/s 2024-09-21T07:33:04.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132324 s, 79.2 MB/s 2024-09-21T07:33:04.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.642 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182216 s, 57.5 MB/s 2024-09-21T07:33:04.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191013 s, 54.9 MB/s 2024-09-21T07:33:04.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174209 s, 60.2 MB/s 2024-09-21T07:33:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134719 s, 77.8 MB/s 2024-09-21T07:33:04.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154349 s, 67.9 MB/s 2024-09-21T07:33:04.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.736 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149459 s, 70.2 MB/s 2024-09-21T07:33:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141102 s, 74.3 MB/s 2024-09-21T07:33:04.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135745 s, 77.2 MB/s 2024-09-21T07:33:04.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189454 s, 55.3 MB/s 2024-09-21T07:33:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156816 s, 66.9 MB/s 2024-09-21T07:33:04.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.830 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182911 s, 57.3 MB/s 2024-09-21T07:33:04.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.848 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153511 s, 68.3 MB/s 2024-09-21T07:33:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.864 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136034 s, 77.1 MB/s 2024-09-21T07:33:04.882 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155521 s, 67.4 MB/s 2024-09-21T07:33:04.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141154 s, 74.3 MB/s 2024-09-21T07:33:04.919 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.920 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176628 s, 59.4 MB/s 2024-09-21T07:33:04.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.936 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141026 s, 74.4 MB/s 2024-09-21T07:33:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172346 s, 60.8 MB/s 2024-09-21T07:33:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178329 s, 58.8 MB/s 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125571 s, 83.5 MB/s 2024-09-21T07:33:05.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144782 s, 72.4 MB/s 2024-09-21T07:33:05.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178862 s, 58.6 MB/s 2024-09-21T07:33:05.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159367 s, 65.8 MB/s 2024-09-21T07:33:05.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.066 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149777 s, 70.0 MB/s 2024-09-21T07:33:05.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161986 s, 64.7 MB/s 2024-09-21T07:33:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176209 s, 59.5 MB/s 2024-09-21T07:33:05.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.126 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178235 s, 58.8 MB/s 2024-09-21T07:33:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182557 s, 57.4 MB/s 2024-09-21T07:33:05.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.13 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:05.155 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:05.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:05.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137757 s, 76.1 MB/s 2024-09-21T07:33:05.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.241 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133541 s, 78.5 MB/s 2024-09-21T07:33:05.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.263 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192689 s, 54.4 MB/s 2024-09-21T07:33:05.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178732 s, 58.7 MB/s 2024-09-21T07:33:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135938 s, 77.1 MB/s 2024-09-21T07:33:05.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137084 s, 76.5 MB/s 2024-09-21T07:33:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139445 s, 75.2 MB/s 2024-09-21T07:33:05.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015434 s, 67.9 MB/s 2024-09-21T07:33:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186371 s, 56.3 MB/s 2024-09-21T07:33:05.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.390 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154486 s, 67.9 MB/s 2024-09-21T07:33:05.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013456 s, 77.9 MB/s 2024-09-21T07:33:05.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135072 s, 77.6 MB/s 2024-09-21T07:33:05.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137293 s, 76.4 MB/s 2024-09-21T07:33:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149545 s, 70.1 MB/s 2024-09-21T07:33:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155242 s, 67.5 MB/s 2024-09-21T07:33:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143401 s, 73.1 MB/s 2024-09-21T07:33:05.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152539 s, 68.7 MB/s 2024-09-21T07:33:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153915 s, 68.1 MB/s 2024-09-21T07:33:05.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200304 s, 52.3 MB/s 2024-09-21T07:33:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.568 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142684 s, 73.5 MB/s 2024-09-21T07:33:05.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.585 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.585 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133679 s, 78.4 MB/s 2024-09-21T07:33:05.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139157 s, 75.4 MB/s 2024-09-21T07:33:05.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136443 s, 76.9 MB/s 2024-09-21T07:33:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145667 s, 72.0 MB/s 2024-09-21T07:33:05.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159581 s, 65.7 MB/s 2024-09-21T07:33:05.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154561 s, 67.8 MB/s 2024-09-21T07:33:05.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172391 s, 60.8 MB/s 2024-09-21T07:33:05.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137703 s, 76.1 MB/s 2024-09-21T07:33:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179339 s, 58.5 MB/s 2024-09-21T07:33:05.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.746 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154097 s, 68.0 MB/s 2024-09-21T07:33:05.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013555 s, 77.4 MB/s 2024-09-21T07:33:05.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142309 s, 73.7 MB/s 2024-09-21T07:33:05.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.14 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:05.786 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:05.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174232 s, 60.2 MB/s 2024-09-21T07:33:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149716 s, 70.0 MB/s 2024-09-21T07:33:05.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155966 s, 67.2 MB/s 2024-09-21T07:33:05.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157547 s, 66.6 MB/s 2024-09-21T07:33:05.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139662 s, 75.1 MB/s 2024-09-21T07:33:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137849 s, 76.1 MB/s 2024-09-21T07:33:05.965 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.966 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174338 s, 60.1 MB/s 2024-09-21T07:33:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.982 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.982 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133161 s, 78.7 MB/s 2024-09-21T07:33:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:05.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133624 s, 78.5 MB/s 2024-09-21T07:33:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144009 s, 72.8 MB/s 2024-09-21T07:33:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137206 s, 76.4 MB/s 2024-09-21T07:33:06.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013617 s, 77.0 MB/s 2024-09-21T07:33:06.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145741 s, 71.9 MB/s 2024-09-21T07:33:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.082 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140027 s, 74.9 MB/s 2024-09-21T07:33:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134409 s, 78.0 MB/s 2024-09-21T07:33:06.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150725 s, 69.6 MB/s 2024-09-21T07:33:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150455 s, 69.7 MB/s 2024-09-21T07:33:06.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013547 s, 77.4 MB/s 2024-09-21T07:33:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145115 s, 72.3 MB/s 2024-09-21T07:33:06.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014389 s, 72.9 MB/s 2024-09-21T07:33:06.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.199 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131878 s, 79.5 MB/s 2024-09-21T07:33:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142691 s, 73.5 MB/s 2024-09-21T07:33:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138285 s, 75.8 MB/s 2024-09-21T07:33:06.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.251 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159749 s, 65.6 MB/s 2024-09-21T07:33:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135485 s, 77.4 MB/s 2024-09-21T07:33:06.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189652 s, 55.3 MB/s 2024-09-21T07:33:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131206 s, 79.9 MB/s 2024-09-21T07:33:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144627 s, 72.5 MB/s 2024-09-21T07:33:06.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.343 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184322 s, 56.9 MB/s 2024-09-21T07:33:06.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.362 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.362 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150065 s, 69.9 MB/s 2024-09-21T07:33:06.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.376 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134141 s, 78.2 MB/s 2024-09-21T07:33:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141001 s, 74.4 MB/s 2024-09-21T07:33:06.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.15 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:06.400 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:06.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:06.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137009 s, 76.5 MB/s 2024-09-21T07:33:06.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013708 s, 76.5 MB/s 2024-09-21T07:33:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015244 s, 68.8 MB/s 2024-09-21T07:33:06.518 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.519 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013511 s, 77.6 MB/s 2024-09-21T07:33:06.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.535 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.535 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133554 s, 78.5 MB/s 2024-09-21T07:33:06.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.552 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147113 s, 71.3 MB/s 2024-09-21T07:33:06.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015152 s, 69.2 MB/s 2024-09-21T07:33:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148812 s, 70.5 MB/s 2024-09-21T07:33:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.607 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161356 s, 65.0 MB/s 2024-09-21T07:33:06.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.624 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143538 s, 73.1 MB/s 2024-09-21T07:33:06.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144982 s, 72.3 MB/s 2024-09-21T07:33:06.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.659 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162908 s, 64.4 MB/s 2024-09-21T07:33:06.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.676 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137367 s, 76.3 MB/s 2024-09-21T07:33:06.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.698 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189338 s, 55.4 MB/s 2024-09-21T07:33:06.714 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142794 s, 73.4 MB/s 2024-09-21T07:33:06.730 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.731 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136273 s, 76.9 MB/s 2024-09-21T07:33:06.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191545 s, 54.7 MB/s 2024-09-21T07:33:06.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153608 s, 68.3 MB/s 2024-09-21T07:33:06.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175384 s, 59.8 MB/s 2024-09-21T07:33:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134894 s, 77.7 MB/s 2024-09-21T07:33:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149476 s, 70.2 MB/s 2024-09-21T07:33:06.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.840 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130277 s, 80.5 MB/s 2024-09-21T07:33:06.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167921 s, 62.4 MB/s 2024-09-21T07:33:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184274 s, 56.9 MB/s 2024-09-21T07:33:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132025 s, 79.4 MB/s 2024-09-21T07:33:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.918 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183389 s, 57.2 MB/s 2024-09-21T07:33:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.934 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131742 s, 79.6 MB/s 2024-09-21T07:33:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.956 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190331 s, 55.1 MB/s 2024-09-21T07:33:06.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.974 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153985 s, 68.1 MB/s 2024-09-21T07:33:06.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:06.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:06.989 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013105 s, 80.0 MB/s 2024-09-21T07:33:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141237 s, 74.2 MB/s 2024-09-21T07:33:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154171 s, 68.0 MB/s 2024-09-21T07:33:07.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:07.032 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:07.032 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:07.032 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.16 2024-09-21T07:33:07.032 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:07.032 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:07.033 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:07.033 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:07.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.102 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149798 s, 70.0 MB/s 2024-09-21T07:33:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156913 s, 66.8 MB/s 2024-09-21T07:33:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129145 s, 81.2 MB/s 2024-09-21T07:33:07.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.153 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141542 s, 74.1 MB/s 2024-09-21T07:33:07.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.169 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.169 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131655 s, 79.6 MB/s 2024-09-21T07:33:07.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.187 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152822 s, 68.6 MB/s 2024-09-21T07:33:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171119 s, 61.3 MB/s 2024-09-21T07:33:07.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.226 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144987 s, 72.3 MB/s 2024-09-21T07:33:07.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011482 s, 91.3 MB/s 2024-09-21T07:33:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146287 s, 71.7 MB/s 2024-09-21T07:33:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.274 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.274 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155695 s, 67.3 MB/s 2024-09-21T07:33:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150959 s, 69.5 MB/s 2024-09-21T07:33:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.313 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187711 s, 55.9 MB/s 2024-09-21T07:33:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.329 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013602 s, 77.1 MB/s 2024-09-21T07:33:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145045 s, 72.3 MB/s 2024-09-21T07:33:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146921 s, 71.4 MB/s 2024-09-21T07:33:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.381 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015305 s, 68.5 MB/s 2024-09-21T07:33:07.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.398 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144081 s, 72.8 MB/s 2024-09-21T07:33:07.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133991 s, 78.3 MB/s 2024-09-21T07:33:07.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179926 s, 58.3 MB/s 2024-09-21T07:33:07.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014575 s, 71.9 MB/s 2024-09-21T07:33:07.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014088 s, 74.4 MB/s 2024-09-21T07:33:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173915 s, 60.3 MB/s 2024-09-21T07:33:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136503 s, 76.8 MB/s 2024-09-21T07:33:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013297 s, 78.9 MB/s 2024-09-21T07:33:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137975 s, 76.0 MB/s 2024-09-21T07:33:07.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176937 s, 59.3 MB/s 2024-09-21T07:33:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158339 s, 66.2 MB/s 2024-09-21T07:33:07.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.594 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135785 s, 77.2 MB/s 2024-09-21T07:33:07.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138555 s, 75.7 MB/s 2024-09-21T07:33:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131529 s, 79.7 MB/s 2024-09-21T07:33:07.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.643 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141343 s, 74.2 MB/s 2024-09-21T07:33:07.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:07.650 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.17 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:07.651 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:07.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:07.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175861 s, 59.6 MB/s 2024-09-21T07:33:07.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131703 s, 79.6 MB/s 2024-09-21T07:33:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014067 s, 74.5 MB/s 2024-09-21T07:33:07.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.776 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164823 s, 63.6 MB/s 2024-09-21T07:33:07.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151296 s, 69.3 MB/s 2024-09-21T07:33:07.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.813 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157877 s, 66.4 MB/s 2024-09-21T07:33:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.830 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138732 s, 75.6 MB/s 2024-09-21T07:33:07.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187044 s, 56.1 MB/s 2024-09-21T07:33:07.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.867 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136442 s, 76.9 MB/s 2024-09-21T07:33:07.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.886 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142387 s, 73.6 MB/s 2024-09-21T07:33:07.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.902 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134323 s, 78.1 MB/s 2024-09-21T07:33:07.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.918 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151643 s, 69.1 MB/s 2024-09-21T07:33:07.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.935 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.935 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142159 s, 73.8 MB/s 2024-09-21T07:33:07.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.953 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152836 s, 68.6 MB/s 2024-09-21T07:33:07.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149415 s, 70.2 MB/s 2024-09-21T07:33:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014401 s, 72.8 MB/s 2024-09-21T07:33:08.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177153 s, 59.2 MB/s 2024-09-21T07:33:08.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129572 s, 80.9 MB/s 2024-09-21T07:33:08.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134303 s, 78.1 MB/s 2024-09-21T07:33:08.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.056 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136825 s, 76.6 MB/s 2024-09-21T07:33:08.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143991 s, 72.8 MB/s 2024-09-21T07:33:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129427 s, 81.0 MB/s 2024-09-21T07:33:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149339 s, 70.2 MB/s 2024-09-21T07:33:08.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149399 s, 70.2 MB/s 2024-09-21T07:33:08.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.145 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017896 s, 58.6 MB/s 2024-09-21T07:33:08.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.161 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132063 s, 79.4 MB/s 2024-09-21T07:33:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136031 s, 77.1 MB/s 2024-09-21T07:33:08.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156495 s, 67.0 MB/s 2024-09-21T07:33:08.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131947 s, 79.5 MB/s 2024-09-21T07:33:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133395 s, 78.6 MB/s 2024-09-21T07:33:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137519 s, 76.2 MB/s 2024-09-21T07:33:08.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015222 s, 68.9 MB/s 2024-09-21T07:33:08.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:08.269 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.18 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:08.270 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:08.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:08.388 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.388 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.388 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177252 s, 59.2 MB/s 2024-09-21T07:33:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.404 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137707 s, 76.1 MB/s 2024-09-21T07:33:08.420 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.420 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.420 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132457 s, 79.2 MB/s 2024-09-21T07:33:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134735 s, 77.8 MB/s 2024-09-21T07:33:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132144 s, 79.4 MB/s 2024-09-21T07:33:08.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130642 s, 80.3 MB/s 2024-09-21T07:33:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178877 s, 58.6 MB/s 2024-09-21T07:33:08.504 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132767 s, 79.0 MB/s 2024-09-21T07:33:08.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138031 s, 76.0 MB/s 2024-09-21T07:33:08.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.537 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122861 s, 85.3 MB/s 2024-09-21T07:33:08.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181651 s, 57.7 MB/s 2024-09-21T07:33:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135659 s, 77.3 MB/s 2024-09-21T07:33:08.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130606 s, 80.3 MB/s 2024-09-21T07:33:08.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.611 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185582 s, 56.5 MB/s 2024-09-21T07:33:08.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.628 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.628 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142174 s, 73.8 MB/s 2024-09-21T07:33:08.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.644 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127466 s, 82.3 MB/s 2024-09-21T07:33:08.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.661 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.661 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150775 s, 69.5 MB/s 2024-09-21T07:33:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148111 s, 70.8 MB/s 2024-09-21T07:33:08.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134865 s, 77.8 MB/s 2024-09-21T07:33:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181094 s, 57.9 MB/s 2024-09-21T07:33:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135052 s, 77.6 MB/s 2024-09-21T07:33:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175525 s, 59.7 MB/s 2024-09-21T07:33:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.770 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151444 s, 69.2 MB/s 2024-09-21T07:33:08.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130576 s, 80.3 MB/s 2024-09-21T07:33:08.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153054 s, 68.5 MB/s 2024-09-21T07:33:08.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011172 s, 93.9 MB/s 2024-09-21T07:33:08.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152435 s, 68.8 MB/s 2024-09-21T07:33:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.851 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129767 s, 80.8 MB/s 2024-09-21T07:33:08.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.872 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184855 s, 56.7 MB/s 2024-09-21T07:33:08.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.893 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177528 s, 59.1 MB/s 2024-09-21T07:33:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136605 s, 76.8 MB/s 2024-09-21T07:33:08.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:08.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:08.927 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154342 s, 67.9 MB/s 2024-09-21T07:33:08.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:08.934 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:08.934 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:08.935 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.19 2024-09-21T07:33:08.935 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:08.935 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:08.935 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:08.935 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:08.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:09.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.007 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175378 s, 59.8 MB/s 2024-09-21T07:33:09.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.023 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142925 s, 73.4 MB/s 2024-09-21T07:33:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141719 s, 74.0 MB/s 2024-09-21T07:33:09.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.056 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.056 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134031 s, 78.2 MB/s 2024-09-21T07:33:09.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186652 s, 56.2 MB/s 2024-09-21T07:33:09.098 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.098 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.098 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174921 s, 59.9 MB/s 2024-09-21T07:33:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146267 s, 71.7 MB/s 2024-09-21T07:33:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136149 s, 77.0 MB/s 2024-09-21T07:33:09.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149548 s, 70.1 MB/s 2024-09-21T07:33:09.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.166 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137954 s, 76.0 MB/s 2024-09-21T07:33:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.182 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133395 s, 78.6 MB/s 2024-09-21T07:33:09.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136832 s, 76.6 MB/s 2024-09-21T07:33:09.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.215 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134551 s, 77.9 MB/s 2024-09-21T07:33:09.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131834 s, 79.5 MB/s 2024-09-21T07:33:09.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.250 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155014 s, 67.6 MB/s 2024-09-21T07:33:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152913 s, 68.6 MB/s 2024-09-21T07:33:09.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.290 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184193 s, 56.9 MB/s 2024-09-21T07:33:09.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.307 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136871 s, 76.6 MB/s 2024-09-21T07:33:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.324 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146689 s, 71.5 MB/s 2024-09-21T07:33:09.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.341 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152596 s, 68.7 MB/s 2024-09-21T07:33:09.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.358 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01369 s, 76.6 MB/s 2024-09-21T07:33:09.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013611 s, 77.0 MB/s 2024-09-21T07:33:09.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.395 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017971 s, 58.3 MB/s 2024-09-21T07:33:09.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.413 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.413 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144523 s, 72.6 MB/s 2024-09-21T07:33:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135788 s, 77.2 MB/s 2024-09-21T07:33:09.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.446 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134817 s, 77.8 MB/s 2024-09-21T07:33:09.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134843 s, 77.8 MB/s 2024-09-21T07:33:09.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.482 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180622 s, 58.1 MB/s 2024-09-21T07:33:09.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.500 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150963 s, 69.5 MB/s 2024-09-21T07:33:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.516 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133107 s, 78.8 MB/s 2024-09-21T07:33:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.532 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128329 s, 81.7 MB/s 2024-09-21T07:33:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136896 s, 76.6 MB/s 2024-09-21T07:33:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.20 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:09.556 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:09.557 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132572 s, 79.1 MB/s 2024-09-21T07:33:09.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.646 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175974 s, 59.6 MB/s 2024-09-21T07:33:09.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141805 s, 73.9 MB/s 2024-09-21T07:33:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168666 s, 62.2 MB/s 2024-09-21T07:33:09.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191751 s, 54.7 MB/s 2024-09-21T07:33:09.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139059 s, 75.4 MB/s 2024-09-21T07:33:09.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.742 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181233 s, 57.9 MB/s 2024-09-21T07:33:09.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180803 s, 58.0 MB/s 2024-09-21T07:33:09.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143905 s, 72.9 MB/s 2024-09-21T07:33:09.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131726 s, 79.6 MB/s 2024-09-21T07:33:09.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.811 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.811 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132931 s, 78.9 MB/s 2024-09-21T07:33:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123934 s, 84.6 MB/s 2024-09-21T07:33:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145716 s, 72.0 MB/s 2024-09-21T07:33:09.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134686 s, 77.9 MB/s 2024-09-21T07:33:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181583 s, 57.7 MB/s 2024-09-21T07:33:09.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137662 s, 76.2 MB/s 2024-09-21T07:33:09.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131576 s, 79.7 MB/s 2024-09-21T07:33:09.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013151 s, 79.7 MB/s 2024-09-21T07:33:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013315 s, 78.8 MB/s 2024-09-21T07:33:09.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.961 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132462 s, 79.2 MB/s 2024-09-21T07:33:09.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.977 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130769 s, 80.2 MB/s 2024-09-21T07:33:09.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:09.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:09.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134757 s, 77.8 MB/s 2024-09-21T07:33:10.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131209 s, 79.9 MB/s 2024-09-21T07:33:10.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137165 s, 76.4 MB/s 2024-09-21T07:33:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178564 s, 58.7 MB/s 2024-09-21T07:33:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.068 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189502 s, 55.3 MB/s 2024-09-21T07:33:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136938 s, 76.6 MB/s 2024-09-21T07:33:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139569 s, 75.1 MB/s 2024-09-21T07:33:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160924 s, 65.2 MB/s 2024-09-21T07:33:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137731 s, 76.1 MB/s 2024-09-21T07:33:10.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141584 s, 74.1 MB/s 2024-09-21T07:33:10.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135221 s, 77.5 MB/s 2024-09-21T07:33:10.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.21 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:10.181 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:10.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:10.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:10.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:10.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142031 s, 73.8 MB/s 2024-09-21T07:33:10.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.266 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139073 s, 75.4 MB/s 2024-09-21T07:33:10.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.282 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138912 s, 75.5 MB/s 2024-09-21T07:33:10.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148952 s, 70.4 MB/s 2024-09-21T07:33:10.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187702 s, 55.9 MB/s 2024-09-21T07:33:10.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.338 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136322 s, 76.9 MB/s 2024-09-21T07:33:10.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111063 s, 94.4 MB/s 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153725 s, 68.2 MB/s 2024-09-21T07:33:10.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121345 s, 86.4 MB/s 2024-09-21T07:33:10.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130895 s, 80.1 MB/s 2024-09-21T07:33:10.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.416 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137654 s, 76.2 MB/s 2024-09-21T07:33:10.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128673 s, 81.5 MB/s 2024-09-21T07:33:10.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129963 s, 80.7 MB/s 2024-09-21T07:33:10.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01836 s, 57.1 MB/s 2024-09-21T07:33:10.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186477 s, 56.2 MB/s 2024-09-21T07:33:10.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.507 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143233 s, 73.2 MB/s 2024-09-21T07:33:10.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144674 s, 72.5 MB/s 2024-09-21T07:33:10.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134899 s, 77.7 MB/s 2024-09-21T07:33:10.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.557 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140749 s, 74.5 MB/s 2024-09-21T07:33:10.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.575 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.575 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147815 s, 70.9 MB/s 2024-09-21T07:33:10.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.596 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186926 s, 56.1 MB/s 2024-09-21T07:33:10.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140369 s, 74.7 MB/s 2024-09-21T07:33:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188744 s, 55.6 MB/s 2024-09-21T07:33:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136203 s, 77.0 MB/s 2024-09-21T07:33:10.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154993 s, 67.7 MB/s 2024-09-21T07:33:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131526 s, 79.7 MB/s 2024-09-21T07:33:10.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157559 s, 66.6 MB/s 2024-09-21T07:33:10.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.720 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146293 s, 71.7 MB/s 2024-09-21T07:33:10.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.742 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183897 s, 57.0 MB/s 2024-09-21T07:33:10.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138641 s, 75.6 MB/s 2024-09-21T07:33:10.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147203 s, 71.2 MB/s 2024-09-21T07:33:10.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.793 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.793 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152582 s, 68.7 MB/s 2024-09-21T07:33:10.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.22 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:10.801 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:10.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191876 s, 54.6 MB/s 2024-09-21T07:33:10.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.937 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175834 s, 59.6 MB/s 2024-09-21T07:33:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.954 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136577 s, 76.8 MB/s 2024-09-21T07:33:10.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.971 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014381 s, 72.9 MB/s 2024-09-21T07:33:10.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:10.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:10.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135203 s, 77.6 MB/s 2024-09-21T07:33:11.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138592 s, 75.7 MB/s 2024-09-21T07:33:11.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135955 s, 77.1 MB/s 2024-09-21T07:33:11.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.036 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-21T07:33:11.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.053 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014903 s, 70.4 MB/s 2024-09-21T07:33:11.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150498 s, 69.7 MB/s 2024-09-21T07:33:11.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.092 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189592 s, 55.3 MB/s 2024-09-21T07:33:11.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.110 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149811 s, 70.0 MB/s 2024-09-21T07:33:11.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.128 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153884 s, 68.1 MB/s 2024-09-21T07:33:11.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194266 s, 54.0 MB/s 2024-09-21T07:33:11.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136463 s, 76.8 MB/s 2024-09-21T07:33:11.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133595 s, 78.5 MB/s 2024-09-21T07:33:11.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.199 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133541 s, 78.5 MB/s 2024-09-21T07:33:11.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129276 s, 81.1 MB/s 2024-09-21T07:33:11.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014863 s, 70.5 MB/s 2024-09-21T07:33:11.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.253 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181945 s, 57.6 MB/s 2024-09-21T07:33:11.270 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.270 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015083 s, 69.5 MB/s 2024-09-21T07:33:11.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133711 s, 78.4 MB/s 2024-09-21T07:33:11.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.303 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136637 s, 76.7 MB/s 2024-09-21T07:33:11.320 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.320 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.320 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142501 s, 73.6 MB/s 2024-09-21T07:33:11.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138659 s, 75.6 MB/s 2024-09-21T07:33:11.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.353 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141318 s, 74.2 MB/s 2024-09-21T07:33:11.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150754 s, 69.6 MB/s 2024-09-21T07:33:11.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.388 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013562 s, 77.3 MB/s 2024-09-21T07:33:11.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017902 s, 58.6 MB/s 2024-09-21T07:33:11.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142839 s, 73.4 MB/s 2024-09-21T07:33:11.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144104 s, 72.8 MB/s 2024-09-21T07:33:11.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.461 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152932 s, 68.6 MB/s 2024-09-21T07:33:11.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:11.468 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:11.468 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:11.468 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.23 2024-09-21T07:33:11.469 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:11.469 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:11.469 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:11.469 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:11.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:11.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.539 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149259 s, 70.3 MB/s 2024-09-21T07:33:11.556 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.556 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.556 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144982 s, 72.3 MB/s 2024-09-21T07:33:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140337 s, 74.7 MB/s 2024-09-21T07:33:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153854 s, 68.2 MB/s 2024-09-21T07:33:11.609 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.609 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.609 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155626 s, 67.4 MB/s 2024-09-21T07:33:11.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151291 s, 69.3 MB/s 2024-09-21T07:33:11.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.644 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150323 s, 69.8 MB/s 2024-09-21T07:33:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155088 s, 67.6 MB/s 2024-09-21T07:33:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178854 s, 58.6 MB/s 2024-09-21T07:33:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137664 s, 76.2 MB/s 2024-09-21T07:33:11.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138913 s, 75.5 MB/s 2024-09-21T07:33:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135788 s, 77.2 MB/s 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131774 s, 79.6 MB/s 2024-09-21T07:33:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.764 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131723 s, 79.6 MB/s 2024-09-21T07:33:11.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.780 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133598 s, 78.5 MB/s 2024-09-21T07:33:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140861 s, 74.4 MB/s 2024-09-21T07:33:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153617 s, 68.3 MB/s 2024-09-21T07:33:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192626 s, 54.4 MB/s 2024-09-21T07:33:11.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136179 s, 77.0 MB/s 2024-09-21T07:33:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140754 s, 74.5 MB/s 2024-09-21T07:33:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138467 s, 75.7 MB/s 2024-09-21T07:33:11.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149978 s, 69.9 MB/s 2024-09-21T07:33:11.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.920 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135144 s, 77.6 MB/s 2024-09-21T07:33:11.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.941 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018835 s, 55.7 MB/s 2024-09-21T07:33:11.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.958 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131524 s, 79.7 MB/s 2024-09-21T07:33:11.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133588 s, 78.5 MB/s 2024-09-21T07:33:11.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:11.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:11.990 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137566 s, 76.2 MB/s 2024-09-21T07:33:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179876 s, 58.3 MB/s 2024-09-21T07:33:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138457 s, 75.7 MB/s 2024-09-21T07:33:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190951 s, 54.9 MB/s 2024-09-21T07:33:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148679 s, 70.5 MB/s 2024-09-21T07:33:12.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.082 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129437 s, 81.0 MB/s 2024-09-21T07:33:12.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.24 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:12.090 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:12.091 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:12.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:12.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.159 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132565 s, 79.1 MB/s 2024-09-21T07:33:12.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140059 s, 74.9 MB/s 2024-09-21T07:33:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134758 s, 77.8 MB/s 2024-09-21T07:33:12.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154517 s, 67.9 MB/s 2024-09-21T07:33:12.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143775 s, 72.9 MB/s 2024-09-21T07:33:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177094 s, 59.2 MB/s 2024-09-21T07:33:12.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152395 s, 68.8 MB/s 2024-09-21T07:33:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132771 s, 79.0 MB/s 2024-09-21T07:33:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147724 s, 71.0 MB/s 2024-09-21T07:33:12.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172041 s, 60.9 MB/s 2024-09-21T07:33:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152851 s, 68.6 MB/s 2024-09-21T07:33:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144555 s, 72.5 MB/s 2024-09-21T07:33:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153673 s, 68.2 MB/s 2024-09-21T07:33:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132094 s, 79.4 MB/s 2024-09-21T07:33:12.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130977 s, 80.1 MB/s 2024-09-21T07:33:12.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132361 s, 79.2 MB/s 2024-09-21T07:33:12.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.438 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133497 s, 78.5 MB/s 2024-09-21T07:33:12.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.455 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133833 s, 78.3 MB/s 2024-09-21T07:33:12.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144172 s, 72.7 MB/s 2024-09-21T07:33:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149567 s, 70.1 MB/s 2024-09-21T07:33:12.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.506 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135567 s, 77.3 MB/s 2024-09-21T07:33:12.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.522 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138359 s, 75.8 MB/s 2024-09-21T07:33:12.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.539 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137767 s, 76.1 MB/s 2024-09-21T07:33:12.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.562 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182641 s, 57.4 MB/s 2024-09-21T07:33:12.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.578 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151258 s, 69.3 MB/s 2024-09-21T07:33:12.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.595 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014848 s, 70.6 MB/s 2024-09-21T07:33:12.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.612 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.612 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137726 s, 76.1 MB/s 2024-09-21T07:33:12.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.629 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.629 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146255 s, 71.7 MB/s 2024-09-21T07:33:12.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156392 s, 67.0 MB/s 2024-09-21T07:33:12.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.667 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165613 s, 63.3 MB/s 2024-09-21T07:33:12.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145517 s, 72.1 MB/s 2024-09-21T07:33:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140855 s, 74.4 MB/s 2024-09-21T07:33:12.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:12.707 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.25 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:12.708 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:12.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:12.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.778 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148479 s, 70.6 MB/s 2024-09-21T07:33:12.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.794 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137018 s, 76.5 MB/s 2024-09-21T07:33:12.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.810 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.810 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131871 s, 79.5 MB/s 2024-09-21T07:33:12.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.832 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197177 s, 53.2 MB/s 2024-09-21T07:33:12.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190269 s, 55.1 MB/s 2024-09-21T07:33:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141674 s, 74.0 MB/s 2024-09-21T07:33:12.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.885 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.886 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119002 s, 88.1 MB/s 2024-09-21T07:33:12.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.902 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135997 s, 77.1 MB/s 2024-09-21T07:33:12.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.918 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.918 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133201 s, 78.7 MB/s 2024-09-21T07:33:12.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.939 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186463 s, 56.2 MB/s 2024-09-21T07:33:12.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.959 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017593 s, 59.6 MB/s 2024-09-21T07:33:12.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.977 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014809 s, 70.8 MB/s 2024-09-21T07:33:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:12.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186525 s, 56.2 MB/s 2024-09-21T07:33:13.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.016 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157805 s, 66.4 MB/s 2024-09-21T07:33:13.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179028 s, 58.6 MB/s 2024-09-21T07:33:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178321 s, 58.8 MB/s 2024-09-21T07:33:13.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.075 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148805 s, 70.5 MB/s 2024-09-21T07:33:13.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.092 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146148 s, 71.7 MB/s 2024-09-21T07:33:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135179 s, 77.6 MB/s 2024-09-21T07:33:13.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136195 s, 77.0 MB/s 2024-09-21T07:33:13.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.141 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135836 s, 77.2 MB/s 2024-09-21T07:33:13.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.163 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190072 s, 55.2 MB/s 2024-09-21T07:33:13.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178319 s, 58.8 MB/s 2024-09-21T07:33:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138975 s, 75.5 MB/s 2024-09-21T07:33:13.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137941 s, 76.0 MB/s 2024-09-21T07:33:13.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.237 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178412 s, 58.8 MB/s 2024-09-21T07:33:13.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153256 s, 68.4 MB/s 2024-09-21T07:33:13.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.272 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141677 s, 74.0 MB/s 2024-09-21T07:33:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.293 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176493 s, 59.4 MB/s 2024-09-21T07:33:13.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135736 s, 77.3 MB/s 2024-09-21T07:33:13.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158473 s, 66.2 MB/s 2024-09-21T07:33:13.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.344 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132517 s, 79.1 MB/s 2024-09-21T07:33:13.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.26 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:13.351 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:13.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:13.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.422 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155559 s, 67.4 MB/s 2024-09-21T07:33:13.438 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136017 s, 77.1 MB/s 2024-09-21T07:33:13.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.455 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134549 s, 77.9 MB/s 2024-09-21T07:33:13.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135392 s, 77.4 MB/s 2024-09-21T07:33:13.488 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.488 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.488 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131017 s, 80.0 MB/s 2024-09-21T07:33:13.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138722 s, 75.6 MB/s 2024-09-21T07:33:13.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140045 s, 74.9 MB/s 2024-09-21T07:33:13.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169671 s, 61.8 MB/s 2024-09-21T07:33:13.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.564 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181131 s, 57.9 MB/s 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141152 s, 74.3 MB/s 2024-09-21T07:33:13.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139814 s, 75.0 MB/s 2024-09-21T07:33:13.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134212 s, 78.1 MB/s 2024-09-21T07:33:13.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.630 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146838 s, 71.4 MB/s 2024-09-21T07:33:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135184 s, 77.6 MB/s 2024-09-21T07:33:13.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.663 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135281 s, 77.5 MB/s 2024-09-21T07:33:13.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143327 s, 73.2 MB/s 2024-09-21T07:33:13.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.697 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.697 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149476 s, 70.2 MB/s 2024-09-21T07:33:13.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151741 s, 69.1 MB/s 2024-09-21T07:33:13.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.729 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110428 s, 95.0 MB/s 2024-09-21T07:33:13.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135794 s, 77.2 MB/s 2024-09-21T07:33:13.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143098 s, 73.3 MB/s 2024-09-21T07:33:13.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.777 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.777 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129809 s, 80.8 MB/s 2024-09-21T07:33:13.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143243 s, 73.2 MB/s 2024-09-21T07:33:13.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.813 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156277 s, 67.1 MB/s 2024-09-21T07:33:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.830 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145393 s, 72.1 MB/s 2024-09-21T07:33:13.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.848 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152255 s, 68.9 MB/s 2024-09-21T07:33:13.866 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.866 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.866 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152568 s, 68.7 MB/s 2024-09-21T07:33:13.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151488 s, 69.2 MB/s 2024-09-21T07:33:13.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150292 s, 69.8 MB/s 2024-09-21T07:33:13.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.917 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128148 s, 81.8 MB/s 2024-09-21T07:33:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.934 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142243 s, 73.7 MB/s 2024-09-21T07:33:13.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:13.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:13.951 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153631 s, 68.3 MB/s 2024-09-21T07:33:13.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.27 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121986 s, 86.0 MB/s 2024-09-21T07:33:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135522 s, 77.4 MB/s 2024-09-21T07:33:14.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.059 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145377 s, 72.1 MB/s 2024-09-21T07:33:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.076 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135789 s, 77.2 MB/s 2024-09-21T07:33:14.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.093 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144841 s, 72.4 MB/s 2024-09-21T07:33:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146686 s, 71.5 MB/s 2024-09-21T07:33:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147157 s, 71.3 MB/s 2024-09-21T07:33:14.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.143 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134667 s, 77.9 MB/s 2024-09-21T07:33:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134551 s, 77.9 MB/s 2024-09-21T07:33:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137169 s, 76.4 MB/s 2024-09-21T07:33:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133631 s, 78.5 MB/s 2024-09-21T07:33:14.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185313 s, 56.6 MB/s 2024-09-21T07:33:14.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.230 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140337 s, 74.7 MB/s 2024-09-21T07:33:14.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155424 s, 67.5 MB/s 2024-09-21T07:33:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.269 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179338 s, 58.5 MB/s 2024-09-21T07:33:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154536 s, 67.9 MB/s 2024-09-21T07:33:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127816 s, 82.0 MB/s 2024-09-21T07:33:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013405 s, 78.2 MB/s 2024-09-21T07:33:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141955 s, 73.9 MB/s 2024-09-21T07:33:14.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.353 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149417 s, 70.2 MB/s 2024-09-21T07:33:14.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.369 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131311 s, 79.9 MB/s 2024-09-21T07:33:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153398 s, 68.4 MB/s 2024-09-21T07:33:14.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.405 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.405 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156228 s, 67.1 MB/s 2024-09-21T07:33:14.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183562 s, 57.1 MB/s 2024-09-21T07:33:14.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136272 s, 76.9 MB/s 2024-09-21T07:33:14.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138104 s, 75.9 MB/s 2024-09-21T07:33:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149607 s, 70.1 MB/s 2024-09-21T07:33:14.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144676 s, 72.5 MB/s 2024-09-21T07:33:14.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133613 s, 78.5 MB/s 2024-09-21T07:33:14.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130842 s, 80.1 MB/s 2024-09-21T07:33:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133837 s, 78.3 MB/s 2024-09-21T07:33:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149347 s, 70.2 MB/s 2024-09-21T07:33:14.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.28 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:14.567 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:14.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:14.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152925 s, 68.6 MB/s 2024-09-21T07:33:14.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152617 s, 68.7 MB/s 2024-09-21T07:33:14.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137633 s, 76.2 MB/s 2024-09-21T07:33:14.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143304 s, 73.2 MB/s 2024-09-21T07:33:14.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151328 s, 69.3 MB/s 2024-09-21T07:33:14.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140206 s, 74.8 MB/s 2024-09-21T07:33:14.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143395 s, 73.1 MB/s 2024-09-21T07:33:14.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155882 s, 67.3 MB/s 2024-09-21T07:33:14.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134368 s, 78.0 MB/s 2024-09-21T07:33:14.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131826 s, 79.5 MB/s 2024-09-21T07:33:14.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137221 s, 76.4 MB/s 2024-09-21T07:33:14.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133391 s, 78.6 MB/s 2024-09-21T07:33:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.887 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152747 s, 68.6 MB/s 2024-09-21T07:33:14.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013498 s, 77.7 MB/s 2024-09-21T07:33:14.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152819 s, 68.6 MB/s 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135193 s, 77.6 MB/s 2024-09-21T07:33:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126241 s, 83.1 MB/s 2024-09-21T07:33:14.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.969 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144828 s, 72.4 MB/s 2024-09-21T07:33:14.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:14.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:14.986 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139685 s, 75.1 MB/s 2024-09-21T07:33:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141341 s, 74.2 MB/s 2024-09-21T07:33:15.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141379 s, 74.2 MB/s 2024-09-21T07:33:15.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.036 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134627 s, 77.9 MB/s 2024-09-21T07:33:15.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.053 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143934 s, 72.9 MB/s 2024-09-21T07:33:15.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.069 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136099 s, 77.0 MB/s 2024-09-21T07:33:15.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.088 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158797 s, 66.0 MB/s 2024-09-21T07:33:15.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.107 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.107 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158234 s, 66.3 MB/s 2024-09-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246994 s, 42.5 MB/s 2024-09-21T07:33:15.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.153 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149024 s, 70.4 MB/s 2024-09-21T07:33:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153036 s, 68.5 MB/s 2024-09-21T07:33:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142229 s, 73.7 MB/s 2024-09-21T07:33:15.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135327 s, 77.5 MB/s 2024-09-21T07:33:15.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015107 s, 69.4 MB/s 2024-09-21T07:33:15.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:15.229 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.29 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:15.230 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:15.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:15.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138181 s, 75.9 MB/s 2024-09-21T07:33:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132894 s, 78.9 MB/s 2024-09-21T07:33:15.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144393 s, 72.6 MB/s 2024-09-21T07:33:15.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184832 s, 56.7 MB/s 2024-09-21T07:33:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.370 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138217 s, 75.9 MB/s 2024-09-21T07:33:15.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141159 s, 74.3 MB/s 2024-09-21T07:33:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016634 s, 63.0 MB/s 2024-09-21T07:33:15.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.423 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139549 s, 75.1 MB/s 2024-09-21T07:33:15.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127877 s, 82.0 MB/s 2024-09-21T07:33:15.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.455 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135513 s, 77.4 MB/s 2024-09-21T07:33:15.471 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.471 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013944 s, 75.2 MB/s 2024-09-21T07:33:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018661 s, 56.2 MB/s 2024-09-21T07:33:15.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.510 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137664 s, 76.2 MB/s 2024-09-21T07:33:15.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134383 s, 78.0 MB/s 2024-09-21T07:33:15.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158811 s, 66.0 MB/s 2024-09-21T07:33:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131112 s, 80.0 MB/s 2024-09-21T07:33:15.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188973 s, 55.5 MB/s 2024-09-21T07:33:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151099 s, 69.4 MB/s 2024-09-21T07:33:15.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180937 s, 58.0 MB/s 2024-09-21T07:33:15.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.640 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146031 s, 71.8 MB/s 2024-09-21T07:33:15.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.657 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132241 s, 79.3 MB/s 2024-09-21T07:33:15.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.675 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155429 s, 67.5 MB/s 2024-09-21T07:33:15.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.692 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013839 s, 75.8 MB/s 2024-09-21T07:33:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.709 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128515 s, 81.6 MB/s 2024-09-21T07:33:15.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150724 s, 69.6 MB/s 2024-09-21T07:33:15.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.743 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135687 s, 77.3 MB/s 2024-09-21T07:33:15.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.765 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182641 s, 57.4 MB/s 2024-09-21T07:33:15.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151868 s, 69.0 MB/s 2024-09-21T07:33:15.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.800 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013436 s, 78.0 MB/s 2024-09-21T07:33:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190908 s, 54.9 MB/s 2024-09-21T07:33:15.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.839 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.839 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137854 s, 76.1 MB/s 2024-09-21T07:33:15.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179048 s, 58.6 MB/s 2024-09-21T07:33:15.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.30 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:15.868 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:15.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:15.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.938 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153966 s, 68.1 MB/s 2024-09-21T07:33:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.954 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138105 s, 75.9 MB/s 2024-09-21T07:33:15.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130696 s, 80.2 MB/s 2024-09-21T07:33:15.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:15.986 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:15.986 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137147 s, 76.5 MB/s 2024-09-21T07:33:16.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137708 s, 76.1 MB/s 2024-09-21T07:33:16.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.019 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133263 s, 78.7 MB/s 2024-09-21T07:33:16.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120229 s, 87.2 MB/s 2024-09-21T07:33:16.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148607 s, 70.6 MB/s 2024-09-21T07:33:16.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.069 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015257 s, 68.7 MB/s 2024-09-21T07:33:16.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.086 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140502 s, 74.6 MB/s 2024-09-21T07:33:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134616 s, 77.9 MB/s 2024-09-21T07:33:16.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019281 s, 54.4 MB/s 2024-09-21T07:33:16.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.145 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181748 s, 57.7 MB/s 2024-09-21T07:33:16.159 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.159 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.159 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117746 s, 89.1 MB/s 2024-09-21T07:33:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131632 s, 79.7 MB/s 2024-09-21T07:33:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013535 s, 77.5 MB/s 2024-09-21T07:33:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136415 s, 76.9 MB/s 2024-09-21T07:33:16.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136237 s, 77.0 MB/s 2024-09-21T07:33:16.241 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135306 s, 77.5 MB/s 2024-09-21T07:33:16.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.259 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142708 s, 73.5 MB/s 2024-09-21T07:33:16.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.275 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134248 s, 78.1 MB/s 2024-09-21T07:33:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135259 s, 77.5 MB/s 2024-09-21T07:33:16.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.306 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119 s, 88.1 MB/s 2024-09-21T07:33:16.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134997 s, 77.7 MB/s 2024-09-21T07:33:16.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134812 s, 77.8 MB/s 2024-09-21T07:33:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018732 s, 56.0 MB/s 2024-09-21T07:33:16.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139285 s, 75.3 MB/s 2024-09-21T07:33:16.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.395 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.395 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153645 s, 68.2 MB/s 2024-09-21T07:33:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131949 s, 79.5 MB/s 2024-09-21T07:33:16.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.427 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134526 s, 77.9 MB/s 2024-09-21T07:33:16.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.448 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.448 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183835 s, 57.0 MB/s 2024-09-21T07:33:16.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.466 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156951 s, 66.8 MB/s 2024-09-21T07:33:16.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.31 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:33:16.474 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:16.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:16.586 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.586 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.586 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154973 s, 67.7 MB/s 2024-09-21T07:33:16.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.604 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150091 s, 69.9 MB/s 2024-09-21T07:33:16.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146072 s, 71.8 MB/s 2024-09-21T07:33:16.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.637 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.637 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140542 s, 74.6 MB/s 2024-09-21T07:33:16.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.654 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141889 s, 73.9 MB/s 2024-09-21T07:33:16.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.672 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145158 s, 72.2 MB/s 2024-09-21T07:33:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143456 s, 73.1 MB/s 2024-09-21T07:33:16.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.706 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152086 s, 68.9 MB/s 2024-09-21T07:33:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.723 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136766 s, 76.7 MB/s 2024-09-21T07:33:16.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.741 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153422 s, 68.3 MB/s 2024-09-21T07:33:16.757 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.757 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.757 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136465 s, 76.8 MB/s 2024-09-21T07:33:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133666 s, 78.4 MB/s 2024-09-21T07:33:16.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.789 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135227 s, 77.5 MB/s 2024-09-21T07:33:16.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151366 s, 69.3 MB/s 2024-09-21T07:33:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178558 s, 58.7 MB/s 2024-09-21T07:33:16.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.845 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.845 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140879 s, 74.4 MB/s 2024-09-21T07:33:16.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154231 s, 68.0 MB/s 2024-09-21T07:33:16.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013643 s, 76.9 MB/s 2024-09-21T07:33:16.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132531 s, 79.1 MB/s 2024-09-21T07:33:16.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133526 s, 78.5 MB/s 2024-09-21T07:33:16.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136683 s, 76.7 MB/s 2024-09-21T07:33:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146086 s, 71.8 MB/s 2024-09-21T07:33:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015093 s, 69.5 MB/s 2024-09-21T07:33:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014174 s, 74.0 MB/s 2024-09-21T07:33:16.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:16.998 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:16.998 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162814 s, 64.4 MB/s 2024-09-21T07:33:17.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135091 s, 77.6 MB/s 2024-09-21T07:33:17.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157434 s, 66.6 MB/s 2024-09-21T07:33:17.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.053 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173998 s, 60.3 MB/s 2024-09-21T07:33:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153086 s, 68.5 MB/s 2024-09-21T07:33:17.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.087 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136918 s, 76.6 MB/s 2024-09-21T07:33:17.103 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.103 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.103 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132852 s, 78.9 MB/s 2024-09-21T07:33:17.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:33:17.123 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:33:17.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175951 s, 59.6 MB/s 2024-09-21T07:33:17.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:17.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:17.131 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1740426918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 msgr2=0x7fe2c00ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1740426918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c00ad210 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009840 tx=0x7fe2ac01c790 comp rx=0 tx=0).stop 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1740426918 shutdown_connections 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1740426918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c00ad210 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1740426918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00ca7c0 0x7fe2c015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1740426918 >> 172.21.15.64:0/1740426918 conn(0x7fe2c00d0170 msgr2=0x7fe2c00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1740426918 shutdown_connections 2024-09-21T07:33:17.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1740426918 wait complete. 2024-09-21T07:33:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 Processor -- start 2024-09-21T07:33:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.292+0000 7fe2c5a00640 1 -- start start 2024-09-21T07:33:17.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 0x7fe2c0155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 0x7fe2c01558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0169d10 con 0x7fe2c00ace00 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0169b90 con 0x7fe2c00ca7c0 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c0169e90 con 0x7fe2c00cc080 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54306/0 (socket says 172.21.15.64:54306) 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 -- 172.21.15.64:0/1858609968 learned_addr learned my addr 172.21.15.64:0/1858609968 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 -- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 msgr2=0x7fe2c01558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bf400640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 0x7fe2c01558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2be000640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 0x7fe2c0155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 0x7fe2c01558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 -- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 msgr2=0x7fe2c0155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 0x7fe2c0155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 -- 172.21.15.64:0/1858609968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c01fcf40 con 0x7fe2c00ace00 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bf400640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 0x7fe2c01558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2be000640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 0x7fe2c0155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2bea00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000e7c0 tx=0x7fe2b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2b6a00640 1 -- 172.21.15.64:0/1858609968 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000ccc0 con 0x7fe2c00ace00 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2b6a00640 1 -- 172.21.15.64:0/1858609968 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b000ce80 con 0x7fe2c00ace00 2024-09-21T07:33:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c01fc6a0 con 0x7fe2c00ace00 2024-09-21T07:33:17.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2b6a00640 1 -- 172.21.15.64:0/1858609968 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0005280 con 0x7fe2c00ace00 2024-09-21T07:33:17.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.296+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c01fcc60 con 0x7fe2c00ace00 2024-09-21T07:33:17.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2b6a00640 1 -- 172.21.15.64:0/1858609968 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe2b0005420 con 0x7fe2c00ace00 2024-09-21T07:33:17.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2b6a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2b6a00640 1 -- 172.21.15.64:0/1858609968 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe2b0094e00 con 0x7fe2c00ace00 2024-09-21T07:33:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 Processor -- start 2024-09-21T07:33:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2be000640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 -- start start 2024-09-21T07:33:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2be000640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0af000 tx=0x7fe2ac01afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1cf00 0x55bf6e09c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1d710 0x55bf6e09cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bf6deae910 con 0x55bf6df299b0 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf6de9dd40 con 0x55bf6df1cf00 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bf6dea1b50 con 0x55bf6df1d710 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.300+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54310/0 (socket says 172.21.15.64:54310) 2024-09-21T07:33:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 -- 172.21.15.64:0/3639786065 learned_addr learned my addr 172.21.15.64:0/3639786065 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 -- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1d710 msgr2=0x55bf6e09cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1d710 0x55bf6e09cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 -- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1cf00 msgr2=0x55bf6e09c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1cf00 0x55bf6e09c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 -- 172.21.15.64:0/3639786065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6de3c2e0 con 0x55bf6df299b0 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe2b005c7f0 tx=0x7fe2b005ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a924fb0851286300 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2ab400640 1 -- 172.21.15.64:0/3639786065 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b005f580 con 0x55bf6df299b0 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2ab400640 1 -- 172.21.15.64:0/3639786065 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b0064060 con 0x55bf6df299b0 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2ab400640 1 -- 172.21.15.64:0/3639786065 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0068c80 con 0x55bf6df299b0 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3639786065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 msgr2=0x55bf6e09c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe2b005c7f0 tx=0x7fe2b005ecf0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3639786065 shutdown_connections 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1d710 0x55bf6e09cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1cf00 0x55bf6e09c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3639786065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e09c2c0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3639786065 >> 172.21.15.64:0/3639786065 conn(0x55bf6df58cb0 msgr2=0x55bf6e059120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3639786065 shutdown_connections 2024-09-21T07:33:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3639786065 wait complete. 2024-09-21T07:33:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 -- start start 2024-09-21T07:33:17.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.304+0000 7fe2cd10a000 1 Processor -- start 2024-09-21T07:33:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bf6de47d10 con 0x55bf6df299b0 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf6de492e0 con 0x55bf6df1d710 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bf6dead6e0 con 0x55bf6df1cf00 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 10 client.0 _ll_register_callbacks cb 0x55bf6e03e790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54326/0 (socket says 172.21.15.64:54326) 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 -- 172.21.15.64:0/2739398857 learned_addr learned my addr 172.21.15.64:0/2739398857 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2be000640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 -- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 msgr2=0x55bf6e0a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e0a3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 -- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 msgr2=0x55bf6e0a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 -- 172.21.15.64:0/2739398857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6de5b250 con 0x55bf6df299b0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bf400640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800d430 tx=0x7fe2b800d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aed28d744758912 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8018060 con 0x55bf6df299b0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe2b8003d90 con 0x55bf6df299b0 2024-09-21T07:33:17.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf6de36420 con 0x55bf6df299b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe2b801e050 con 0x55bf6df299b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 10 client.9261 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55bf6de23030 con 0x55bf6df299b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bf6de36420 con 0x55bf6df299b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe2b8021020 con 0x55bf6df299b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 10 client.9261 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 10 client.9261 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 20 client.9261 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db408b0 0x55bf6e0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 4 client.9261 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf6deb0860 con 0x55bf6db408b0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bea00640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db408b0 0x55bf6e0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe29fe00640 10 client.9261 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.308+0000 7fe2bea00640 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db408b0 0x55bf6e0adb30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fd7f1a7b551fb9 server_cookie=99f21a43636f0ed in_seq=0 out_seq=0 2024-09-21T07:33:17.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe29fe00640 1 -- 172.21.15.64:0/2739398857 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf6deb0860 con 0x55bf6db408b0 2024-09-21T07:33:17.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe29fe00640 10 client.9261 handle_command_reply: tid=0 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 client.9261 shutdown 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 msgr2=0x55bf6e0a41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800d430 tx=0x7fe2b800d8f0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 shutdown_connections 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db408b0 0x55bf6e0adb30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df299b0 0x55bf6e0a41d0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2739398857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e0a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe29fe00640 0 client.9261 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 >> 172.21.15.64:0/2739398857 conn(0x55bf6df58cb0 msgr2=0x55bf6e059120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 shutdown_connections 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2739398857 wait complete. 2024-09-21T07:33:17.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.312+0000 7fe2cd10a000 20 client.9261 trim_cache size 0 max 16384 2024-09-21T07:33:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.328+0000 7fe2cd10a000 1 Processor -- start 2024-09-21T07:33:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.328+0000 7fe2cd10a000 1 -- start start 2024-09-21T07:33:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df299b0 0x55bf6e0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0157ee0 con 0x55bf6df1cf00 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c01fbd70 con 0x55bf6df1d710 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c01578c0 con 0x55bf6df299b0 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54328/0 (socket says 172.21.15.64:54328) 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 -- 172.21.15.64:0/3747000589 learned_addr learned my addr 172.21.15.64:0/3747000589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bf400640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df299b0 0x55bf6e0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2be000640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 -- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df299b0 msgr2=0x55bf6e0a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df299b0 0x55bf6e0a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 -- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 msgr2=0x55bf6e0a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 -- 172.21.15.64:0/3747000589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6defa340 con 0x55bf6df1cf00 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2be000640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2bea00640 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe2b005c7f0 tx=0x7fe2b0092fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc967faac6ddfc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2aaa00640 1 -- 172.21.15.64:0/3747000589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b005f580 con 0x55bf6df1cf00 2024-09-21T07:33:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2aaa00640 1 -- 172.21.15.64:0/3747000589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b0064060 con 0x55bf6df1cf00 2024-09-21T07:33:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2aaa00640 1 -- 172.21.15.64:0/3747000589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b005b7f0 con 0x55bf6df1cf00 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3747000589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 msgr2=0x55bf6e0a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe2b005c7f0 tx=0x7fe2b0092fd0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3747000589 shutdown_connections 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df299b0 0x55bf6e0a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df1d710 0x55bf6e0a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/3747000589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1cf00 0x55bf6e0a8bb0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3747000589 >> 172.21.15.64:0/3747000589 conn(0x55bf6df58cb0 msgr2=0x55bf6e0a3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3747000589 shutdown_connections 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- 172.21.15.64:0/3747000589 wait complete. 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.332+0000 7fe2cd10a000 1 -- start start 2024-09-21T07:33:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 Processor -- start 2024-09-21T07:33:17.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e112480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df299b0 0x55bf6e112f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bf6dea0e60 con 0x55bf6df1d710 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf6de5d850 con 0x55bf6df299b0 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bf6dea6180 con 0x55bf6df1cf00 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 10 client.0 _ll_register_callbacks cb 0x7fe2b8001550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54338/0 (socket says 172.21.15.64:54338) 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 -- 172.21.15.64:0/2109353880 learned_addr learned my addr 172.21.15.64:0/2109353880 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2bf400640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df299b0 0x55bf6e112f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2bea00640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e112480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 -- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 msgr2=0x55bf6e112480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e112480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 -- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df299b0 msgr2=0x55bf6e112f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df299b0 0x55bf6e112f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 -- 172.21.15.64:0/2109353880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6de66d80 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2be000640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a5710 tx=0x7fe2ac0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10631cd4f467a708 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0b2040 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0064060 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe2ac0053c0 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac0055c0 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 10 client.9267 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55bf6db541a0 con 0x55bf6df1d710 2024-09-21T07:33:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b0064060 con 0x55bf6df1d710 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe2ac0b5030 con 0x55bf6df1d710 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 10 client.9267 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 10 client.9267 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 20 client.9267 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db2e910 0x55bf6e052e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 4 client.9267 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55bf6deac310 con 0x55bf6db2e910 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.336+0000 7fe2bea00640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db2e910 0x55bf6e052e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2bea00640 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db2e910 0x55bf6e052e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80500e910e9ab813 server_cookie=165ab22b5f641ba8 in_seq=0 out_seq=0 2024-09-21T07:33:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe29fe00640 10 client.9267 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe29fe00640 1 -- 172.21.15.64:0/2109353880 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bf6deac310 con 0x55bf6db2e910 2024-09-21T07:33:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe29fe00640 10 client.9267 handle_command_reply: tid=0 2024-09-21T07:33:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 client.9267 shutdown 2024-09-21T07:33:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 msgr2=0x55bf6e1129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a5710 tx=0x7fe2ac0091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 shutdown_connections 2024-09-21T07:33:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55bf6db2e910 0x55bf6e052e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bf6df299b0 0x55bf6e112f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bf6df1d710 0x55bf6e1129c0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 --2- 172.21.15.64:0/2109353880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bf6df1cf00 0x55bf6e112480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 >> 172.21.15.64:0/2109353880 conn(0x55bf6df58cb0 msgr2=0x55bf6e0575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe29fe00640 0 client.9267 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 shutdown_connections 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 1 -- 172.21.15.64:0/2109353880 wait complete. 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.340+0000 7fe2cd10a000 20 client.9267 trim_cache size 0 max 16384 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:17.345 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:33:17.346 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "79bce7d5-835e-4615-a2fe-692ab9a13694", 2024-09-21T07:33:17.346 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:33:17.346 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:17.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 msgr2=0x7fe2a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0af000 tx=0x7fe2ac01afd0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 msgr2=0x7fe2c0159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000e7c0 tx=0x7fe2b000ec80 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 shutdown_connections 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe2a0073200 0x7fe2a0075710 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe2c00cc080 0x7fe2c01558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2c00ca7c0 0x7fe2c0155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 --2- 172.21.15.64:0/1858609968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2c00ace00 0x7fe2c0159420 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 >> 172.21.15.64:0/1858609968 conn(0x7fe2c00d0170 msgr2=0x7fe2c0068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 shutdown_connections 2024-09-21T07:33:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.344+0000 7fe2c5a00640 1 -- 172.21.15.64:0/1858609968 wait complete. 2024-09-21T07:33:17.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:17.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-21T07:33:17.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 -- 172.21.15.64:0/4118519179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800b3400 msgr2=0x7f33800d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 --2- 172.21.15.64:0/4118519179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800b3400 0x7f33800d0230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f336c009870 tx=0x7f336c01f010 comp rx=0 tx=0).stop 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 -- 172.21.15.64:0/4118519179 shutdown_connections 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 --2- 172.21.15.64:0/4118519179 >> v2:172.21.15.90:3300/0 conn(0x7f3380070870 0x7f33800b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 --2- 172.21.15.64:0/4118519179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800b3400 0x7f33800d0230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 -- 172.21.15.64:0/4118519179 >> 172.21.15.64:0/4118519179 conn(0x7f33800cdcf0 msgr2=0x7f33800ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 -- 172.21.15.64:0/4118519179 shutdown_connections 2024-09-21T07:33:17.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.592+0000 7f3387a00640 1 -- 172.21.15.64:0/4118519179 wait complete. 2024-09-21T07:33:17.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 Processor -- start 2024-09-21T07:33:17.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 -- start start 2024-09-21T07:33:17.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3380070870 0x7f338015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801f5cd0 0x7f33801f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f33800b4e90 con 0x7f3380070870 2024-09-21T07:33:17.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33800b4d10 con 0x7f33801f5cd0 2024-09-21T07:33:17.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3387a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f33800b5010 con 0x7f33800d07e0 2024-09-21T07:33:17.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3385000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3380070870 0x7f338015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:60304/0 (socket says 172.21.15.64:60304) 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f337fe00640 1 -- 172.21.15.64:0/268507552 learned_addr learned my addr 172.21.15.64:0/268507552 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.596+0000 7f3385a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801f5cd0 0x7f33801f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 -- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801f5cd0 msgr2=0x7f33801f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801f5cd0 0x7f33801f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 -- 172.21.15.64:0/268507552 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3380070870 msgr2=0x7f338015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3380070870 0x7f338015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 -- 172.21.15.64:0/268507552 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33801f6620 con 0x7f33800d07e0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337fe00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f336c01cc40 tx=0x7f336c004620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337cc00640 1 -- 172.21.15.64:0/268507552 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0be070 con 0x7f33800d07e0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337cc00640 1 -- 172.21.15.64:0/268507552 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f336c005230 con 0x7f33800d07e0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337cc00640 1 -- 172.21.15.64:0/268507552 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0b5040 con 0x7f33800d07e0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338015ac50 con 0x7f33800d07e0 2024-09-21T07:33:17.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f338015b210 con 0x7f33800d07e0 2024-09-21T07:33:17.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.600+0000 7f337cc00640 1 -- 172.21.15.64:0/268507552 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f336c0046d0 con 0x7f33800d07e0 2024-09-21T07:33:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f337cc00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 0x7f3360075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f337cc00640 1 -- 172.21.15.64:0/268507552 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f336c131160 con 0x7f33800d07e0 2024-09-21T07:33:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f338f200000 1 Processor -- start 2024-09-21T07:33:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f3385000640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 0x7f3360075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f338f200000 1 -- start start 2024-09-21T07:33:17.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.604+0000 7f3385000640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 0x7f3360075710 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3374001770 tx=0x7f3374009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2059720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5630a1e0d2e0 con 0x5630a1f08630 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5630a1e6abb0 con 0x5630a1ef9ab0 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5630a1e59fe0 con 0x5630a1ee6170 2024-09-21T07:33:17.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54350/0 (socket says 172.21.15.64:54350) 2024-09-21T07:33:17.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 -- 172.21.15.64:0/4075259847 learned_addr learned my addr 172.21.15.64:0/4075259847 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f337fe00640 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385a00640 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2059720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 -- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 msgr2=0x5630a2059720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2059720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 -- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 msgr2=0x5630a20591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 -- 172.21.15.64:0/4075259847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a1df81c0 con 0x5630a1f08630 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3385000640 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f337400f8c0 tx=0x7f3374012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62566ef927c72c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3371600640 1 -- 172.21.15.64:0/4075259847 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374025070 con 0x5630a1f08630 2024-09-21T07:33:17.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3371600640 1 -- 172.21.15.64:0/4075259847 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f337401b050 con 0x5630a1f08630 2024-09-21T07:33:17.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f3371600640 1 -- 172.21.15.64:0/4075259847 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374014e40 con 0x5630a1f08630 2024-09-21T07:33:17.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- 172.21.15.64:0/4075259847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 msgr2=0x5630a2058ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f337400f8c0 tx=0x7f3374012000 comp rx=0 tx=0).stop 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- 172.21.15.64:0/4075259847 shutdown_connections 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2059720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 --2- 172.21.15.64:0/4075259847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2058ca0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.608+0000 7f338f200000 1 -- 172.21.15.64:0/4075259847 >> 172.21.15.64:0/4075259847 conn(0x5630a1b17d20 msgr2=0x5630a200dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.612+0000 7f338f200000 1 -- 172.21.15.64:0/4075259847 shutdown_connections 2024-09-21T07:33:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.612+0000 7f338f200000 1 -- 172.21.15.64:0/4075259847 wait complete. 2024-09-21T07:33:17.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.612+0000 7f338f200000 1 -- start start 2024-09-21T07:33:17.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.612+0000 7f338f200000 1 Processor -- start 2024-09-21T07:33:17.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2044470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2044ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5630a1dff4f0 con 0x5630a1f08630 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5630a1e5ddf0 con 0x5630a1ef9ab0 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5630a1b1f620 con 0x5630a1ee6170 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 10 client.0 _ll_register_callbacks cb 0x5630a1e30cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3385000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2044470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3385a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2044ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:50796/0 (socket says 172.21.15.64:50796) 2024-09-21T07:33:17.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 -- 172.21.15.64:0/1355559671 learned_addr learned my addr 172.21.15.64:0/1355559671 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 -- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 msgr2=0x5630a2044470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2044470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 -- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 msgr2=0x5630a2044ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2044ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 -- 172.21.15.64:0/1355559671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a1f29740 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3385a00640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2044ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f337fe00640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f336c020620 tx=0x7f336c0fb360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b8c093dff4c02e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0fba10 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f336c104e60 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630a1df2300 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f336c100440 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 10 client.8803 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5630a1edf440 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5630a1df2300 con 0x5630a1ef9ab0 2024-09-21T07:33:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f336c0b8030 con 0x5630a1ef9ab0 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 10 client.8803 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 10 client.8803 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 20 client.8803 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.616+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1afc8d0 0x5630a206a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.620+0000 7f338f200000 4 client.8803 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.620+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630a1e6cb00 con 0x5630a1afc8d0 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.620+0000 7f3385000640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1afc8d0 0x5630a206a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.620+0000 7f3366000640 10 client.8803 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.620+0000 7f3385000640 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1afc8d0 0x5630a206a260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=349bcecf6fdeafbe server_cookie=10eeb0c70975418b in_seq=0 out_seq=0 2024-09-21T07:33:17.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f3366000640 1 -- 172.21.15.64:0/1355559671 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630a1e6cb00 con 0x5630a1afc8d0 2024-09-21T07:33:17.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f3366000640 10 client.8803 handle_command_reply: tid=0 2024-09-21T07:33:17.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 client.8803 shutdown 2024-09-21T07:33:17.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 msgr2=0x5630a20449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f336c020620 tx=0x7f336c0fb360 comp rx=0 tx=0).stop 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 shutdown_connections 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1afc8d0 0x5630a206a260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a2044ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a20449b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f3366000640 0 client.8803 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 --2- 172.21.15.64:0/1355559671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2044470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 >> 172.21.15.64:0/1355559671 conn(0x5630a1b17d20 msgr2=0x5630a200dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 shutdown_connections 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 1 -- 172.21.15.64:0/1355559671 wait complete. 2024-09-21T07:33:17.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.624+0000 7f338f200000 20 client.8803 trim_cache size 0 max 16384 2024-09-21T07:33:17.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.660+0000 7f338f200000 1 Processor -- start 2024-09-21T07:33:17.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.660+0000 7f338f200000 1 -- start start 2024-09-21T07:33:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a200d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5630a20136d0 con 0x5630a1f08630 2024-09-21T07:33:17.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3380202a20 con 0x5630a1ef9ab0 2024-09-21T07:33:17.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3380201a20 con 0x5630a1ee6170 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f337fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:50802/0 (socket says 172.21.15.64:50802) 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:60338/0 (socket says 172.21.15.64:60338) 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f337fe00640 1 -- 172.21.15.64:0/1441629366 learned_addr learned my addr 172.21.15.64:0/1441629366 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385a00640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a200d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 -- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 msgr2=0x5630a2014af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 -- 172.21.15.64:0/1441629366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 msgr2=0x5630a200d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a200d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 -- 172.21.15.64:0/1441629366 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a1eb6b00 con 0x5630a1ee6170 2024-09-21T07:33:17.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385a00640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a200d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:17.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f337fe00640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:17.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.664+0000 7f3385000640 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3374022000 tx=0x7f3374007bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3f065396786176 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f3370c00640 1 -- 172.21.15.64:0/1441629366 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374025040 con 0x5630a1ee6170 2024-09-21T07:33:17.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f3370c00640 1 -- 172.21.15.64:0/1441629366 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3374031030 con 0x5630a1ee6170 2024-09-21T07:33:17.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f3370c00640 1 -- 172.21.15.64:0/1441629366 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374007500 con 0x5630a1ee6170 2024-09-21T07:33:17.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 msgr2=0x5630a20145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3374022000 tx=0x7f3374007bb0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- 172.21.15.64:0/1441629366 shutdown_connections 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1f08630 0x5630a200d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1ef9ab0 0x5630a2014af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 --2- 172.21.15.64:0/1441629366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a20145b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- 172.21.15.64:0/1441629366 >> 172.21.15.64:0/1441629366 conn(0x5630a1b17d20 msgr2=0x5630a2058330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- 172.21.15.64:0/1441629366 shutdown_connections 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- 172.21.15.64:0/1441629366 wait complete. 2024-09-21T07:33:17.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 -- start start 2024-09-21T07:33:17.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.668+0000 7f338f200000 1 Processor -- start 2024-09-21T07:33:17.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2010310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1ef9ab0 0x5630a2010850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5630a1e5ddf0 con 0x5630a1ef9ab0 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5630a1e25c70 con 0x5630a1f08630 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5630a1e62420 con 0x5630a1ee6170 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 10 client.0 _ll_register_callbacks cb 0x7f336c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f337fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1ef9ab0 0x5630a2010850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:50812/0 (socket says 172.21.15.64:50812) 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 -- 172.21.15.64:0/2251893338 learned_addr learned my addr 172.21.15.64:0/2251893338 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385000640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 -- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 msgr2=0x5630a2010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 -- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1ef9ab0 msgr2=0x5630a2010850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1ef9ab0 0x5630a2010850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 -- 172.21.15.64:0/2251893338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a1e24060 con 0x5630a1f08630 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3385a00640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3378003fa0 tx=0x7f33780044d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c3cb7f81bb37114 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3366000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378010ac0 con 0x5630a1f08630 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f3378010c60 con 0x5630a1f08630 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3374031030 con 0x5630a1f08630 2024-09-21T07:33:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f3378028050 con 0x5630a1f08630 2024-09-21T07:33:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 10 client.8809 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.672+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5630a1df0640 con 0x5630a1f08630 2024-09-21T07:33:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3374031030 con 0x5630a1f08630 2024-09-21T07:33:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f337802b020 con 0x5630a1f08630 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 10 client.8809 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 10 client.8809 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 20 client.8809 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1aea930 0x5630a208b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 4 client.8809 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x5630a1e685b0 con 0x5630a1aea930 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f3385000640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1aea930 0x5630a208b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f3385000640 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1aea930 0x5630a208b020 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=585ef9a225357d5 server_cookie=3481b3ce0c811cb4 in_seq=0 out_seq=0 2024-09-21T07:33:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.676+0000 7f3366000640 10 client.8809 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3366000640 1 -- 172.21.15.64:0/2251893338 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630a1e685b0 con 0x5630a1aea930 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3366000640 10 client.8809 handle_command_reply: tid=0 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 client.8809 shutdown 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 msgr2=0x5630a208a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3378003fa0 tx=0x7f33780044d0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 shutdown_connections 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x5630a1aea930 0x5630a208b020 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5630a1f08630 0x5630a208a780 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5630a1ef9ab0 0x5630a2010850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 --2- 172.21.15.64:0/2251893338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5630a1ee6170 0x5630a2010310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 >> 172.21.15.64:0/2251893338 conn(0x5630a1b17d20 msgr2=0x5630a2069470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3366000640 0 client.8809 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 shutdown_connections 2024-09-21T07:33:17.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 1 -- 172.21.15.64:0/2251893338 wait complete. 2024-09-21T07:33:17.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f338f200000 20 client.8809 trim_cache size 0 max 16384 2024-09-21T07:33:17.776 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:17.776 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:33:17.776 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:33:17.776 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 msgr2=0x7f3360075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 0x7f3360075710 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3374001770 tx=0x7f3374009040 comp rx=0 tx=0).stop 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 msgr2=0x7f338009e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f336c01cc40 tx=0x7f336c004620 comp rx=0 tx=0).stop 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 shutdown_connections 2024-09-21T07:33:17.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3360073200 0x7f3360075710 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801f5cd0 0x7f33801f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33800d07e0 0x7f338009e470 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 --2- 172.21.15.64:0/268507552 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3380070870 0x7f338015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 >> 172.21.15.64:0/268507552 conn(0x7f33800cdcf0 msgr2=0x7f338006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 shutdown_connections 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.692+0000 7f3387a00640 1 -- 172.21.15.64:0/268507552 wait complete. 2024-09-21T07:33:17.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:17.778 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 -- 172.21.15.64:0/2120096841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c0706c0 msgr2=0x7fcf0c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 --2- 172.21.15.64:0/2120096841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c0706c0 0x7fcf0c0b3ce0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009c80 tx=0x7fcf0401cd10 comp rx=0 tx=0).stop 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 -- 172.21.15.64:0/2120096841 shutdown_connections 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 --2- 172.21.15.64:0/2120096841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c0706c0 0x7fcf0c0b3ce0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 --2- 172.21.15.64:0/2120096841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c15ec20 0x7fcf0c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 -- 172.21.15.64:0/2120096841 >> 172.21.15.64:0/2120096841 conn(0x7fcf0c0ccbe0 msgr2=0x7fcf0c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 -- 172.21.15.64:0/2120096841 shutdown_connections 2024-09-21T07:33:17.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.944+0000 7fcf11400640 1 -- 172.21.15.64:0/2120096841 wait complete. 2024-09-21T07:33:17.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 Processor -- start 2024-09-21T07:33:17.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- start start 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c0ca990 0x7fcf0c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c1fbea0 0x7fcf0c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c168d20 con 0x7fcf0c15ec20 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c168ba0 con 0x7fcf0c0ca990 2024-09-21T07:33:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c168ea0 con 0x7fcf0c1fbea0 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54400/0 (socket says 172.21.15.64:54400) 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 -- 172.21.15.64:0/2351162164 learned_addr learned my addr 172.21.15.64:0/2351162164 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf0b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c1fbea0 0x7fcf0c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c0ca990 0x7fcf0c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 -- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c1fbea0 msgr2=0x7fcf0c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c1fbea0 0x7fcf0c0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 -- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c0ca990 msgr2=0x7fcf0c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c0ca990 0x7fcf0c155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 -- 172.21.15.64:0/2351162164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c163870 con 0x7fcf0c15ec20 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c3f0 tx=0x7fcef400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf02a00640 1 -- 172.21.15.64:0/2351162164 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40052d0 con 0x7fcf0c15ec20 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf02a00640 1 -- 172.21.15.64:0/2351162164 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef4007020 con 0x7fcf0c15ec20 2024-09-21T07:33:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0c0afbd0 con 0x7fcf0c15ec20 2024-09-21T07:33:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf02a00640 1 -- 172.21.15.64:0/2351162164 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4007470 con 0x7fcf0c15ec20 2024-09-21T07:33:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.948+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0c0b03b0 con 0x7fcf0c15ec20 2024-09-21T07:33:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf02a00640 1 -- 172.21.15.64:0/2351162164 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcef40067e0 con 0x7fcf0c15ec20 2024-09-21T07:33:17.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf02a00640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 0x7fcee8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf02a00640 1 -- 172.21.15.64:0/2351162164 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fcef40938c0 con 0x7fcf0c15ec20 2024-09-21T07:33:17.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 0x7fcee8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf18c0f000 1 Processor -- start 2024-09-21T07:33:17.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.952+0000 7fcf18c0f000 1 -- start start 2024-09-21T07:33:17.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 0x7fcee8075740 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c072330 tx=0x7fcefc00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a48cb56d0 0x560a48e219f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e22470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a48cc0cd0 con 0x560a4890c890 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a48bd6330 con 0x560a48cb56d0 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560a48c33bb0 con 0x560a489d0aa0 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54404/0 (socket says 172.21.15.64:54404) 2024-09-21T07:33:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 -- 172.21.15.64:0/1688408593 learned_addr learned my addr 172.21.15.64:0/1688408593 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf0a800640 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a48cb56d0 0x560a48e219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf0b200640 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e22470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 -- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 msgr2=0x560a48e22470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e22470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 -- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a48cb56d0 msgr2=0x560a48e219f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a48cb56d0 0x560a48e219f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 -- 172.21.15.64:0/1688408593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a48bd7c80 con 0x560a4890c890 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf03e00640 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fcef405b2d0 tx=0x7fcef405db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b570c4a955458 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcefb000640 1 -- 172.21.15.64:0/1688408593 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4083030 con 0x560a4890c890 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcefb000640 1 -- 172.21.15.64:0/1688408593 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef4062a90 con 0x560a4890c890 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcefb000640 1 -- 172.21.15.64:0/1688408593 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40679d0 con 0x560a4890c890 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- 172.21.15.64:0/1688408593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 msgr2=0x560a48e21f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fcef405b2d0 tx=0x7fcef405db70 comp rx=0 tx=0).stop 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- 172.21.15.64:0/1688408593 shutdown_connections 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e22470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a4890c890 0x560a48e21f30 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/1688408593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a48cb56d0 0x560a48e219f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- 172.21.15.64:0/1688408593 >> 172.21.15.64:0/1688408593 conn(0x560a488e05c0 msgr2=0x560a48ddeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- 172.21.15.64:0/1688408593 shutdown_connections 2024-09-21T07:33:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.956+0000 7fcf18c0f000 1 -- 172.21.15.64:0/1688408593 wait complete. 2024-09-21T07:33:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 -- start start 2024-09-21T07:33:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 Processor -- start 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a48c26df0 con 0x560a48cb56d0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a48c22fe0 con 0x560a4890c890 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560a48bc84d0 con 0x560a489d0aa0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 10 client.0 _ll_register_callbacks cb 0x560a48ba67f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:50844/0 (socket says 172.21.15.64:50844) 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:60394/0 (socket says 172.21.15.64:60394) 2024-09-21T07:33:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 -- 172.21.15.64:0/2908926592 learned_addr learned my addr 172.21.15.64:0/2908926592 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54420/0 (socket says 172.21.15.64:54420) 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 -- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 msgr2=0x560a48dddf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 -- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 msgr2=0x560a48de45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 -- 172.21.15.64:0/2908926592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a48bc1210 con 0x560a4890c890 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0b200640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf0a800640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0042e0 tx=0x7fcefc004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16f5620434550af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fceef400640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:33:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc004490 con 0x560a4890c890 2024-09-21T07:33:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a48bbb350 con 0x560a4890c890 2024-09-21T07:33:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.960+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fcefc011440 con 0x560a4890c890 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fcefc011660 con 0x560a4890c890 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 10 client.8821 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x560a48ba7fc0 con 0x560a4890c890 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560a48bbb350 con 0x560a4890c890 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fcefc0118f0 con 0x560a4890c890 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 10 client.8821 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 10 client.8821 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 20 client.8821 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488c5930 0x560a48e28e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 4 client.8821 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a48c35b00 con 0x560a488c5930 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488c5930 0x560a48e28e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf03e00640 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488c5930 0x560a48e28e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ac28a2488f3c4e server_cookie=77661da544b2050f in_seq=0 out_seq=0 2024-09-21T07:33:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 10 client.8821 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 1 -- 172.21.15.64:0/2908926592 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a48c35b00 con 0x560a488c5930 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 10 client.8821 handle_command_reply: tid=0 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 client.8821 shutdown 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 msgr2=0x560a48ddd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0042e0 tx=0x7fcefc004740 comp rx=0 tx=0).stop 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 shutdown_connections 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488c5930 0x560a48e28e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48de45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48dddf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fceef400640 0 client.8821 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/2908926592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48ddd9d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 >> 172.21.15.64:0/2908926592 conn(0x560a488e05c0 msgr2=0x560a48dd6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 shutdown_connections 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 1 -- 172.21.15.64:0/2908926592 wait complete. 2024-09-21T07:33:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.964+0000 7fcf18c0f000 20 client.8821 trim_cache size 0 max 16384 2024-09-21T07:33:17.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.988+0000 7fcf18c0f000 1 Processor -- start 2024-09-21T07:33:17.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.988+0000 7fcf18c0f000 1 -- start start 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e93400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 0x560a48e93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a48ddcaf0 con 0x560a489d0aa0 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c205b40 con 0x560a4890c890 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c204bb0 con 0x560a48cb56d0 2024-09-21T07:33:17.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54426/0 (socket says 172.21.15.64:54426) 2024-09-21T07:33:17.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 -- 172.21.15.64:0/3270712091 learned_addr learned my addr 172.21.15.64:0/3270712091 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf0b200640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 0x560a48e93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf0a800640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 -- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 msgr2=0x560a48e93e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 0x560a48e93e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 -- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 msgr2=0x560a48e93400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e93400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 -- 172.21.15.64:0/3270712091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a48c80680 con 0x560a489d0aa0 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf0b200640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 0x560a48e93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf0a800640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e93400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:17.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf03e00640 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fcef405a070 tx=0x7fcef4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53b43e756e43092 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:17.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcefa600640 1 -- 172.21.15.64:0/3270712091 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4083040 con 0x560a489d0aa0 2024-09-21T07:33:17.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcefa600640 1 -- 172.21.15.64:0/3270712091 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef40679d0 con 0x560a489d0aa0 2024-09-21T07:33:17.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcefa600640 1 -- 172.21.15.64:0/3270712091 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef407fb30 con 0x560a489d0aa0 2024-09-21T07:33:17.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- 172.21.15.64:0/3270712091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 msgr2=0x560a48e93940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fcef405a070 tx=0x7fcef4000ee0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- 172.21.15.64:0/3270712091 shutdown_connections 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a48cb56d0 0x560a48e93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a489d0aa0 0x560a48e93940 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/3270712091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e93400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- 172.21.15.64:0/3270712091 >> 172.21.15.64:0/3270712091 conn(0x560a488e05c0 msgr2=0x560a48e33fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- 172.21.15.64:0/3270712091 shutdown_connections 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.992+0000 7fcf18c0f000 1 -- 172.21.15.64:0/3270712091 wait complete. 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- start start 2024-09-21T07:33:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 Processor -- start 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e97440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e97980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c204560 con 0x560a48cb56d0 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c0aec30 con 0x560a4890c890 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x560a488e8680 con 0x560a489d0aa0 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 10 client.0 _ll_register_callbacks cb 0x7fcefc010bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54430/0 (socket says 172.21.15.64:54430) 2024-09-21T07:33:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 -- 172.21.15.64:0/33473460 learned_addr learned my addr 172.21.15.64:0/33473460 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0a800640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf03e00640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e97980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 -- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 msgr2=0x560a48e97980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e97980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 -- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 msgr2=0x560a48e97440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e97440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 -- 172.21.15.64:0/33473460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a48bed0b0 con 0x560a48cb56d0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf0b200640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009bd0 tx=0x7fcf040ad9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d183267f2c9f851b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf040b2040 con 0x560a48cb56d0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcef40679d0 con 0x560a48cb56d0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fcf040adb10 con 0x560a48cb56d0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fcf040c7050 con 0x560a48cb56d0 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 10 client.9303 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x560a48bb9610 con 0x560a48cb56d0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef40679d0 con 0x560a48cb56d0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fcf040ca020 con 0x560a48cb56d0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 10 client.9303 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 10 client.9303 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 20 client.9303 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488b3990 0x560a48dd8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 4 client.9303 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:17.996+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560a48c315b0 con 0x560a488b3990 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf0a800640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488b3990 0x560a48dd8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf0a800640 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488b3990 0x560a48dd8b70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1018f26aeb432618 server_cookie=9ecbeedbc2300e06 in_seq=0 out_seq=0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fceef400640 10 client.9303 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fceef400640 1 -- 172.21.15.64:0/33473460 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x560a48c315b0 con 0x560a488b3990 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fceef400640 10 client.9303 handle_command_reply: tid=0 2024-09-21T07:33:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 client.9303 shutdown 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 msgr2=0x560a48e97ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009bd0 tx=0x7fcf040ad9a0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 shutdown_connections 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x560a488b3990 0x560a48dd8b70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a48cb56d0 0x560a48e97ec0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x560a489d0aa0 0x560a48e97980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 --2- 172.21.15.64:0/33473460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4890c890 0x560a48e97440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fceef400640 0 client.9303 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 >> 172.21.15.64:0/33473460 conn(0x560a488e05c0 msgr2=0x560a48de35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 shutdown_connections 2024-09-21T07:33:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 1 -- 172.21.15.64:0/33473460 wait complete. 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf18c0f000 20 client.9303 trim_cache size 0 max 16384 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "PAUSED (760 inodes in the stack)", 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "79bce7d5-835e-4615-a2fe-692ab9a13694", 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:18.005 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:33:17.340035+0000", 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:18.006 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 msgr2=0x7fcee8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 0x7fcee8075740 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c072330 tx=0x7fcefc00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 msgr2=0x7fcf0c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c3f0 tx=0x7fcef400c8b0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 shutdown_connections 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcee8073230 0x7fcee8075740 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcf0c1fbea0 0x7fcf0c0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf0c15ec20 0x7fcf0c0cb800 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 --2- 172.21.15.64:0/2351162164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c0ca990 0x7fcf0c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 >> 172.21.15.64:0/2351162164 conn(0x7fcf0c0ccbe0 msgr2=0x7fcf0c15c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 shutdown_connections 2024-09-21T07:33:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.000+0000 7fcf11400640 1 -- 172.21.15.64:0/2351162164 wait complete. 2024-09-21T07:33:18.031 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:18.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- 172.21.15.64:0/4117146822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b24e0 msgr2=0x7f08180ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 --2- 172.21.15.64:0/4117146822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b24e0 0x7f08180ca7b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f080c00a950 tx=0x7f080c01db70 comp rx=0 tx=0).stop 2024-09-21T07:33:18.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- 172.21.15.64:0/4117146822 shutdown_connections 2024-09-21T07:33:18.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 --2- 172.21.15.64:0/4117146822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b24e0 0x7f08180ca7b0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- 172.21.15.64:0/4117146822 >> 172.21.15.64:0/4117146822 conn(0x7f08180ccbe0 msgr2=0x7f08180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- 172.21.15.64:0/4117146822 shutdown_connections 2024-09-21T07:33:18.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- 172.21.15.64:0/4117146822 wait complete. 2024-09-21T07:33:18.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 Processor -- start 2024-09-21T07:33:18.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 -- start start 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08180b24e0 0x7f08181f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.188+0000 7f0820200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08180cacf0 0x7f08181faad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0818169180 con 0x7f08180b4130 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0818169000 con 0x7f08180b24e0 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0818169300 con 0x7f08180cacf0 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54456/0 (socket says 172.21.15.64:54456) 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 -- 172.21.15.64:0/3639450385 learned_addr learned my addr 172.21.15.64:0/3639450385 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081d800640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08180b24e0 0x7f08181f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081e200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08180cacf0 0x7f08181faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 -- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08180cacf0 msgr2=0x7f08181faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08180cacf0 0x7f08181faad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 -- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08180b24e0 msgr2=0x7f08181f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08180b24e0 0x7f08181f6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 -- 172.21.15.64:0/3639450385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08181fa310 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f081ce00640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f080400c3c0 tx=0x7f080400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804017070 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0804003600 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804003a50 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081809d040 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081809d600 con 0x7f08180b4130 2024-09-21T07:33:18.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081809cdb0 con 0x7f08180b4130 2024-09-21T07:33:18.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.192+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f080401a070 con 0x7f08180b4130 2024-09-21T07:33:18.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.196+0000 7f0815600640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 0x7f07f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.196+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f0804093630 con 0x7f08180b4130 2024-09-21T07:33:18.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.196+0000 7f081d800640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 0x7f07f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.196+0000 7f081d800640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 0x7f07f8075710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f080c0b0000 tx=0x7f080c01c3b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.200+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f080405dde0 con 0x7f08180b4130 2024-09-21T07:33:18.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08180ca7b0 con 0x7f08180b4130 2024-09-21T07:33:18.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0815600640 1 -- 172.21.15.64:0/3639450385 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f0804062810 con 0x7f08180b4130 2024-09-21T07:33:18.418 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:18.419 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 msgr2=0x7f07f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 0x7f07f8075710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f080c0b0000 tx=0x7f080c01c3b0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 msgr2=0x7f08181591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f080400c3c0 tx=0x7f080400c880 comp rx=0 tx=0).stop 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 shutdown_connections 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f07f8073200 0x7f07f8075710 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08180cacf0 0x7f08181faad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08180b4130 0x7f08181591a0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 --2- 172.21.15.64:0/3639450385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08180b24e0 0x7f08181f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.416+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 >> 172.21.15.64:0/3639450385 conn(0x7f08180ccbe0 msgr2=0x7f08180703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.420+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 shutdown_connections 2024-09-21T07:33:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.420+0000 7f0820200640 1 -- 172.21.15.64:0/3639450385 wait complete. 2024-09-21T07:33:18.440 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:33:18.441 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 -- 172.21.15.64:0/1434111732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df00709b0 msgr2=0x7f4df00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 --2- 172.21.15.64:0/1434111732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df00709b0 0x7f4df00b41c0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009840 tx=0x7f4ddc01c820 comp rx=0 tx=0).stop 2024-09-21T07:33:18.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 -- 172.21.15.64:0/1434111732 shutdown_connections 2024-09-21T07:33:18.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 --2- 172.21.15.64:0/1434111732 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00b4700 0x7f4df0072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 --2- 172.21.15.64:0/1434111732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df00709b0 0x7f4df00b41c0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 -- 172.21.15.64:0/1434111732 >> 172.21.15.64:0/1434111732 conn(0x7f4df00ccbe0 msgr2=0x7f4df00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 -- 172.21.15.64:0/1434111732 shutdown_connections 2024-09-21T07:33:18.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.596+0000 7f4df7800640 1 -- 172.21.15.64:0/1434111732 wait complete. 2024-09-21T07:33:18.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 Processor -- start 2024-09-21T07:33:18.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 -- start start 2024-09-21T07:33:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00709b0 0x7f4df01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4df00b4700 0x7f4df01fca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0168b90 con 0x7f4df015edb0 2024-09-21T07:33:18.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0168a10 con 0x7f4df00b4700 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df7800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4df0168d10 con 0x7f4df00709b0 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54480/0 (socket says 172.21.15.64:54480) 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df5800640 1 -- 172.21.15.64:0/3314663643 learned_addr learned my addr 172.21.15.64:0/3314663643 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4defe00640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4df00b4700 0x7f4df01fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.600+0000 7f4df4e00640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00709b0 0x7f4df01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 -- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00709b0 msgr2=0x7f4df01556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00709b0 0x7f4df01556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 -- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4df00b4700 msgr2=0x7f4df01fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4df00b4700 0x7f4df01fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 -- 172.21.15.64:0/3314663643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df01f9540 con 0x7f4df015edb0 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df5800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4de800eab0 tx=0x7f4de8009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de800ce40 con 0x7f4df015edb0 2024-09-21T07:33:18.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4de8004c20 con 0x7f4df015edb0 2024-09-21T07:33:18.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8005020 con 0x7f4df015edb0 2024-09-21T07:33:18.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df01f9820 con 0x7f4df015edb0 2024-09-21T07:33:18.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df0163f90 con 0x7f4df015edb0 2024-09-21T07:33:18.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df01fc020 con 0x7f4df015edb0 2024-09-21T07:33:18.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4de80051e0 con 0x7f4df015edb0 2024-09-21T07:33:18.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.604+0000 7f4decc00640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 0x7f4dd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.608+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f4de8095190 con 0x7f4df015edb0 2024-09-21T07:33:18.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.608+0000 7f4df4e00640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 0x7f4dd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.608+0000 7f4df4e00640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 0x7f4dd0075710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007d70 tx=0x7f4de4007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.612+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4de805f8f0 con 0x7f4df015edb0 2024-09-21T07:33:18.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4df00b41c0 con 0x7f4df015edb0 2024-09-21T07:33:18.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4decc00640 1 -- 172.21.15.64:0/3314663643 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7f4de8064320 con 0x7f4df015edb0 2024-09-21T07:33:18.854 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:18.854 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":656,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":866,"data_bytes":884867060,"bytes_used":2164588544,"bytes_avail":770929524736,"bytes_total":773094113280,"write_bytes_sec":50762373,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-21T07:32:41.582939+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 msgr2=0x7f4dd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 0x7f4dd0075710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007d70 tx=0x7f4de4007d00 comp rx=0 tx=0).stop 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 msgr2=0x7f4df01f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4de800eab0 tx=0x7f4de8009f70 comp rx=0 tx=0).stop 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 shutdown_connections 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4dd0073200 0x7f4dd0075710 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df015edb0 0x7f4df01f8a70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4df00b4700 0x7f4df01fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 --2- 172.21.15.64:0/3314663643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4df00709b0 0x7f4df01556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 >> 172.21.15.64:0/3314663643 conn(0x7f4df00ccbe0 msgr2=0x7f4df00ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 shutdown_connections 2024-09-21T07:33:18.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:18.852+0000 7f4df7800640 1 -- 172.21.15.64:0/3314663643 wait complete. 2024-09-21T07:33:18.876 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:33:19.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- 172.21.15.64:0/3089446291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c06cdf0 msgr2=0x7fa48c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 --2- 172.21.15.64:0/3089446291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c06cdf0 0x7fa48c06d200 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa480009840 tx=0x7fa48001c820 comp rx=0 tx=0).stop 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- 172.21.15.64:0/3089446291 shutdown_connections 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 --2- 172.21.15.64:0/3089446291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c06cdf0 0x7fa48c06d200 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- 172.21.15.64:0/3089446291 >> 172.21.15.64:0/3089446291 conn(0x7fa48c06e890 msgr2=0x7fa48c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- 172.21.15.64:0/3089446291 shutdown_connections 2024-09-21T07:33:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- 172.21.15.64:0/3089446291 wait complete. 2024-09-21T07:33:20.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 Processor -- start 2024-09-21T07:33:20.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.047+0000 7fa494000640 1 -- start start 2024-09-21T07:33:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48c06cdf0 0x7fa48c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c0cf260 0x7fa48c0b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c16b480 con 0x7fa48c1604b0 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c16b300 con 0x7fa48c0cf260 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa48c16b600 con 0x7fa48c06cdf0 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54486/0 (socket says 172.21.15.64:54486) 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 -- 172.21.15.64:0/3921451448 learned_addr learned my addr 172.21.15.64:0/3921451448 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa490c00640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c0cf260 0x7fa48c0b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa491600640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48c06cdf0 0x7fa48c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 -- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48c06cdf0 msgr2=0x7fa48c0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48c06cdf0 0x7fa48c0b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 -- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c0cf260 msgr2=0x7fa48c0b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c0cf260 0x7fa48c0b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 -- 172.21.15.64:0/3921451448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c151ea0 con 0x7fa48c1604b0 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa492000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c790 tx=0x7fa48400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:20.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484003b80 con 0x7fa48c1604b0 2024-09-21T07:33:20.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa484003d60 con 0x7fa48c1604b0 2024-09-21T07:33:20.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400aa50 con 0x7fa48c1604b0 2024-09-21T07:33:20.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48c159f90 con 0x7fa48c1604b0 2024-09-21T07:33:20.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48c1584c0 con 0x7fa48c1604b0 2024-09-21T07:33:20.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.051+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48c158720 con 0x7fa48c1604b0 2024-09-21T07:33:20.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.055+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa48400abf0 con 0x7fa48c1604b0 2024-09-21T07:33:20.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.055+0000 7fa489600640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 0x7fa46c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.055+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fa484094070 con 0x7fa48c1604b0 2024-09-21T07:33:20.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.055+0000 7fa491600640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 0x7fa46c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.055+0000 7fa491600640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 0x7fa46c075740 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa4800af000 tx=0x7fa48001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:20.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.059+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa48405e820 con 0x7fa48c1604b0 2024-09-21T07:33:20.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa48c06d200 con 0x7fa48c1604b0 2024-09-21T07:33:20.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa489600640 1 -- 172.21.15.64:0/3921451448 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7fa484063250 con 0x7fa48c1604b0 2024-09-21T07:33:20.273 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:20.274 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:20.274 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:20.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 msgr2=0x7fa46c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 0x7fa46c075740 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa4800af000 tx=0x7fa48001b060 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 msgr2=0x7fa48c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c790 tx=0x7fa48400cc50 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 shutdown_connections 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa46c073230 0x7fa46c075740 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c1604b0 0x7fa48c157480 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa48c0cf260 0x7fa48c0b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 --2- 172.21.15.64:0/3921451448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48c06cdf0 0x7fa48c0b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 >> 172.21.15.64:0/3921451448 conn(0x7fa48c06e890 msgr2=0x7fa48c15f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 shutdown_connections 2024-09-21T07:33:20.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.271+0000 7fa494000640 1 -- 172.21.15.64:0/3921451448 wait complete. 2024-09-21T07:33:20.295 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:33:20.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 -- 172.21.15.64:0/4237506617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f884006d500 msgr2=0x7f8840070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 --2- 172.21.15.64:0/4237506617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f884006d500 0x7f8840070d50 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8828009840 tx=0x7f882801c790 comp rx=0 tx=0).stop 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 -- 172.21.15.64:0/4237506617 shutdown_connections 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 --2- 172.21.15.64:0/4237506617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f884006d500 0x7f8840070d50 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 -- 172.21.15.64:0/4237506617 >> 172.21.15.64:0/4237506617 conn(0x7f88400cdcf0 msgr2=0x7f88400ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 -- 172.21.15.64:0/4237506617 shutdown_connections 2024-09-21T07:33:20.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.451+0000 7f8844c00640 1 -- 172.21.15.64:0/4237506617 wait complete. 2024-09-21T07:33:20.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 Processor -- start 2024-09-21T07:33:20.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 -- start start 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8840071290 0x7f8840157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88400cce40 0x7f88400cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f884016ae40 con 0x7f88401587e0 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f884016acc0 con 0x7f8840071290 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f8844c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f884016afc0 con 0x7f88400cce40 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.455+0000 7f883e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54508/0 (socket says 172.21.15.64:54508) 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 -- 172.21.15.64:0/550991306 learned_addr learned my addr 172.21.15.64:0/550991306 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883de00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8840071290 0x7f8840157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8835400640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88400cce40 0x7f88400cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 -- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88400cce40 msgr2=0x7f88400cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88400cce40 0x7f88400cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 -- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8840071290 msgr2=0x7f8840157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8840071290 0x7f8840157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 -- 172.21.15.64:0/550991306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400c8120 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f883e800640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f883800cb70 tx=0x7f883800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838016020 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f883800ab00 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838012420 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88400c4eb0 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88400c5470 con 0x7f88401587e0 2024-09-21T07:33:20.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8840070d50 con 0x7f88401587e0 2024-09-21T07:33:20.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.459+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8838019020 con 0x7f88401587e0 2024-09-21T07:33:20.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.463+0000 7f8836a00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 0x7f881c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:20.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.463+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f8838094ac0 con 0x7f88401587e0 2024-09-21T07:33:20.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.463+0000 7f883de00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 0x7f881c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:20.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.463+0000 7f883de00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 0x7f881c075740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8830000f70 tx=0x7f8830009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:20.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.463+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8838020020 con 0x7f88401587e0 2024-09-21T07:33:20.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f884015d1f0 con 0x7f88401587e0 2024-09-21T07:33:20.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8836a00640 1 -- 172.21.15.64:0/550991306 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7f883805f9c0 con 0x7f88401587e0 2024-09-21T07:33:20.705 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:20.705 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":658,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1026,"data_bytes":1053618425,"bytes_used":2534825984,"bytes_avail":770559287296,"bytes_total":773094113280,"write_bytes_sec":58186142,"read_op_per_sec":0,"write_op_per_sec":69},"fsmap":{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-21T07:32:41.582939+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:20.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 msgr2=0x7f881c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 0x7f881c075740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8830000f70 tx=0x7f8830009040 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 msgr2=0x7f88400cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f883800cb70 tx=0x7f883800cc60 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 shutdown_connections 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f881c073230 0x7f881c075740 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88401587e0 0x7f88400cfcc0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88400cce40 0x7f88400cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 --2- 172.21.15.64:0/550991306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8840071290 0x7f8840157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 >> 172.21.15.64:0/550991306 conn(0x7f88400cdcf0 msgr2=0x7f884015c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 shutdown_connections 2024-09-21T07:33:20.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:20.707+0000 7f8844c00640 1 -- 172.21.15.64:0/550991306 wait complete. 2024-09-21T07:33:20.727 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:33:21.728 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 -- 172.21.15.64:0/414351272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f70004e40 msgr2=0x7f3f7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 --2- 172.21.15.64:0/414351272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f70004e40 0x7f3f7000b9d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c310 tx=0x7f3f8401f540 comp rx=0 tx=0).stop 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f8b400640 1 -- 172.21.15.64:0/414351272 reap_dead start 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 -- 172.21.15.64:0/414351272 shutdown_connections 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 -- 172.21.15.64:0/414351272 >> 172.21.15.64:0/414351272 conn(0x7f3f8c0ccbe0 msgr2=0x7f3f8c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 -- 172.21.15.64:0/414351272 shutdown_connections 2024-09-21T07:33:21.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.895+0000 7f3f91a00640 1 -- 172.21.15.64:0/414351272 wait complete. 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 Processor -- start 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 -- start start 2024-09-21T07:33:21.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f70004e40 0x7f3f8c1f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f8c158a20 0x7f3f8c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c0b2380 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c0b2200 con 0x7f3f70004e40 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f91a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c0b3fc0 con 0x7f3f8c158a20 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f8b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f8b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54526/0 (socket says 172.21.15.64:54526) 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f8b400640 1 -- 172.21.15.64:0/1236272451 learned_addr learned my addr 172.21.15.64:0/1236272451 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f8aa00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f70004e40 0x7f3f8c1f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.899+0000 7f3f82000640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f8c158a20 0x7f3f8c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 -- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f8c158a20 msgr2=0x7f3f8c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f8c158a20 0x7f3f8c14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 -- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f70004e40 msgr2=0x7f3f8c1f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f70004e40 0x7f3f8c1f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 -- 172.21.15.64:0/1236272451 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c1593b0 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f8b400640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f3f8401dc40 tx=0x7f3f84000e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:21.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84006d00 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f84006090 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c159690 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84003820 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c159c50 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c0cc0e0 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.903+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f840039c0 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.907+0000 7f3f83400640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 0x7f3f68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.907+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f3f84131fe0 con 0x7f3f8c14c0d0 2024-09-21T07:33:21.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.907+0000 7f3f8aa00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 0x7f3f68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.907+0000 7f3f8aa00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 0x7f3f68075710 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c006fd0 tx=0x7f3f7c006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:21.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:21.907+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f840cb080 con 0x7f3f8c14c0d0 2024-09-21T07:33:22.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f8c0d0280 con 0x7f3f8c14c0d0 2024-09-21T07:33:22.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f83400640 1 -- 172.21.15.64:0/1236272451 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f3f840c2060 con 0x7f3f8c14c0d0 2024-09-21T07:33:22.122 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:22.122 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:22.122 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:22.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 msgr2=0x7f3f68075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 0x7f3f68075710 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c006fd0 tx=0x7f3f7c006b20 comp rx=0 tx=0).stop 2024-09-21T07:33:22.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 msgr2=0x7f3f8c15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f3f8401dc40 tx=0x7f3f84000e90 comp rx=0 tx=0).stop 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 shutdown_connections 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f68073200 0x7f3f68075710 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f8c14c0d0 0x7f3f8c15a450 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f8c158a20 0x7f3f8c14c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 --2- 172.21.15.64:0/1236272451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f70004e40 0x7f3f8c1f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 >> 172.21.15.64:0/1236272451 conn(0x7f3f8c0ccbe0 msgr2=0x7f3f8c15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 shutdown_connections 2024-09-21T07:33:22.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.123+0000 7f3f91a00640 1 -- 172.21.15.64:0/1236272451 wait complete. 2024-09-21T07:33:22.144 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:33:22.144 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- 172.21.15.64:0/1263263416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c0709b0 msgr2=0x7fdd8c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 --2- 172.21.15.64:0/1263263416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c0b41c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009840 tx=0x7fdd7401c820 comp rx=0 tx=0).stop 2024-09-21T07:33:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- 172.21.15.64:0/1263263416 shutdown_connections 2024-09-21T07:33:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 --2- 172.21.15.64:0/1263263416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c0b41c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- 172.21.15.64:0/1263263416 >> 172.21.15.64:0/1263263416 conn(0x7fdd8c0ccbe0 msgr2=0x7fdd8c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- 172.21.15.64:0/1263263416 shutdown_connections 2024-09-21T07:33:22.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- 172.21.15.64:0/1263263416 wait complete. 2024-09-21T07:33:22.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 Processor -- start 2024-09-21T07:33:22.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.303+0000 7fdd93800640 1 -- start start 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd8c0b4700 0x7fdd8c09ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c15edb0 0x7fdd8c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c16a290 con 0x7fdd8c0709b0 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c16a110 con 0x7fdd8c15edb0 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8c16a410 con 0x7fdd8c0b4700 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54538/0 (socket says 172.21.15.64:54538) 2024-09-21T07:33:22.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 -- 172.21.15.64:0/2570671785 learned_addr learned my addr 172.21.15.64:0/2570671785 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd83e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd8c0b4700 0x7fdd8c09ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd91800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c15edb0 0x7fdd8c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 -- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd8c0b4700 msgr2=0x7fdd8c09ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd8c0b4700 0x7fdd8c09ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 -- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c15edb0 msgr2=0x7fdd8c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c15edb0 0x7fdd8c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 -- 172.21.15.64:0/2570671785 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c155910 con 0x7fdd8c0709b0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd90e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001ec0 tx=0x7fdd7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c017070 con 0x7fdd8c0709b0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd7c003600 con 0x7fdd8c0709b0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c003a50 con 0x7fdd8c0709b0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c155bf0 con 0x7fdd8c0709b0 2024-09-21T07:33:22.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c1561b0 con 0x7fdd8c0709b0 2024-09-21T07:33:22.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.307+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c0b41c0 con 0x7fdd8c0709b0 2024-09-21T07:33:22.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.311+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdd7c01a070 con 0x7fdd8c0709b0 2024-09-21T07:33:22.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.311+0000 7fdd89600640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 0x7fdd68075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.311+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fdd7c0935d0 con 0x7fdd8c0709b0 2024-09-21T07:33:22.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.311+0000 7fdd83e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 0x7fdd68075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.311+0000 7fdd83e00640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 0x7fdd68075740 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd740af000 tx=0x7fdd7401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.315+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdd7c05de00 con 0x7fdd8c0709b0 2024-09-21T07:33:22.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.559+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdd8c09da20 con 0x7fdd8c0709b0 2024-09-21T07:33:22.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.559+0000 7fdd89600640 1 -- 172.21.15.64:0/2570671785 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fdd7c062830 con 0x7fdd8c0709b0 2024-09-21T07:33:22.559 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:22.559 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":660,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1044,"data_bytes":1072492793,"bytes_used":2569428992,"bytes_avail":770524684288,"bytes_total":773094113280,"write_bytes_sec":44160470,"read_op_per_sec":0,"write_op_per_sec":54},"fsmap":{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-21T07:33:21.593220+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 msgr2=0x7fdd68075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 0x7fdd68075740 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd740af000 tx=0x7fdd7401b060 comp rx=0 tx=0).stop 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 msgr2=0x7fdd8c1f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001ec0 tx=0x7fdd7c00c890 comp rx=0 tx=0).stop 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 shutdown_connections 2024-09-21T07:33:22.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd68073230 0x7fdd68075740 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd8c15edb0 0x7fdd8c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd8c0b4700 0x7fdd8c09ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 --2- 172.21.15.64:0/2570671785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0709b0 0x7fdd8c1f6e10 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 >> 172.21.15.64:0/2570671785 conn(0x7fdd8c0ccbe0 msgr2=0x7fdd8c0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 shutdown_connections 2024-09-21T07:33:22.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.563+0000 7fdd93800640 1 -- 172.21.15.64:0/2570671785 wait complete. 2024-09-21T07:33:22.581 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-21T07:33:22.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:22.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-21T07:33:22.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 -- 172.21.15.64:0/281134837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 msgr2=0x7f767400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 --2- 172.21.15.64:0/281134837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f767400b9d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7688001dc0 tx=0x7f768801cb30 comp rx=0 tx=0).stop 2024-09-21T07:33:22.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 -- 172.21.15.64:0/281134837 shutdown_connections 2024-09-21T07:33:22.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 --2- 172.21.15.64:0/281134837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f767400b9d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 -- 172.21.15.64:0/281134837 >> 172.21.15.64:0/281134837 conn(0x7f769008bf80 msgr2=0x7f76900d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 -- 172.21.15.64:0/281134837 shutdown_connections 2024-09-21T07:33:22.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.743+0000 7f7696600640 1 -- 172.21.15.64:0/281134837 wait complete. 2024-09-21T07:33:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 Processor -- start 2024-09-21T07:33:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 -- start start 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 0x7f76900ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 0x7f769015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f76900cf9a0 con 0x7f7674005360 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76900cf820 con 0x7f769014b470 2024-09-21T07:33:22.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7696600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f76900b14a0 con 0x7f76900cabb0 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54560/0 (socket says 172.21.15.64:54560) 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 -- 172.21.15.64:0/3270266298 learned_addr learned my addr 172.21.15.64:0/3270266298 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695c00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 0x7f769015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7687e00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 0x7f76900ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 -- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 msgr2=0x7f769015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 0x7f769015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 -- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 msgr2=0x7f76900ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 0x7f76900ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695200640 1 -- 172.21.15.64:0/3270266298 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900c9920 con 0x7f7674005360 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7695c00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 0x7f769015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:22.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.747+0000 7f7687e00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 0x7f76900ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f7695200640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7680006660 tx=0x7f76800039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f768d600640 1 -- 172.21.15.64:0/3270266298 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680015070 con 0x7f7674005360 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f768d600640 1 -- 172.21.15.64:0/3270266298 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7680011900 con 0x7f7674005360 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f768d600640 1 -- 172.21.15.64:0/3270266298 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680011d50 con 0x7f7674005360 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76901576f0 con 0x7f7674005360 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76900c9e70 con 0x7f7674005360 2024-09-21T07:33:22.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.751+0000 7f768d600640 1 -- 172.21.15.64:0/3270266298 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7680018070 con 0x7f7674005360 2024-09-21T07:33:22.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f768d600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 0x7f766c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f768d600640 1 -- 172.21.15.64:0/3270266298 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f7680094e40 con 0x7f7674005360 2024-09-21T07:33:22.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7687e00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 0x7f766c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 Processor -- start 2024-09-21T07:33:22.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 -- start start 2024-09-21T07:33:22.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7687e00640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 0x7f766c075740 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f76900cc240 tx=0x7f76780091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74794ab0 0x55eb748f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb748f4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eb746a82e0 con 0x55eb747a3630 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eb74705bb0 con 0x55eb74794ab0 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eb746f4fe0 con 0x55eb74781170 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54566/0 (socket says 172.21.15.64:54566) 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 -- 172.21.15.64:0/2849814044 learned_addr learned my addr 172.21.15.64:0/2849814044 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7687e00640 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74794ab0 0x55eb748f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695c00640 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb748f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 -- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 msgr2=0x55eb748f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb748f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 -- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74794ab0 msgr2=0x55eb748f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74794ab0 0x55eb748f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 -- 172.21.15.64:0/2849814044 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb746931c0 con 0x55eb747a3630 2024-09-21T07:33:22.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7695200640 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f768005f4c0 tx=0x7f768005f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b3fc0e7e0618ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7685600640 1 -- 172.21.15.64:0/2849814044 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768001f070 con 0x55eb747a3630 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7685600640 1 -- 172.21.15.64:0/2849814044 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f768005f530 con 0x55eb747a3630 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.755+0000 7f7685600640 1 -- 172.21.15.64:0/2849814044 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768005e990 con 0x55eb747a3630 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- 172.21.15.64:0/2849814044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 msgr2=0x55eb748f3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f768005f4c0 tx=0x7f768005f040 comp rx=0 tx=0).stop 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- 172.21.15.64:0/2849814044 shutdown_connections 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb748f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74794ab0 0x55eb748f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- 172.21.15.64:0/2849814044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748f3ca0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- 172.21.15.64:0/2849814044 >> 172.21.15.64:0/2849814044 conn(0x55eb743b2d20 msgr2=0x55eb748a8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- 172.21.15.64:0/2849814044 shutdown_connections 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- 172.21.15.64:0/2849814044 wait complete. 2024-09-21T07:33:22.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- start start 2024-09-21T07:33:22.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 Processor -- start 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74794ab0 0x55eb748e3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eb7469a4f0 con 0x55eb747a3630 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eb746f8df0 con 0x55eb74781170 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eb743ba620 con 0x55eb74794ab0 2024-09-21T07:33:22.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f769f30f000 10 client.0 _ll_register_callbacks cb 0x55eb746cbcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.759+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54582/0 (socket says 172.21.15.64:54582) 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 -- 172.21.15.64:0/4083527641 learned_addr learned my addr 172.21.15.64:0/4083527641 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695200640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7687e00640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74794ab0 0x55eb748e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 -- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74794ab0 msgr2=0x55eb748e3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74794ab0 0x55eb748e3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 -- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 msgr2=0x55eb748e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 -- 172.21.15.64:0/4083527641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb747c4740 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695c00640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f768801d3d0 tx=0x7f76880019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e705e5344c019c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688003cc0 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f76880bcc80 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb7468d300 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f7688003e60 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 10 client.9360 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55eb7477a440 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55eb7468d300 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f76880b9070 con 0x55eb747a3630 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 10 client.9360 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 10 client.9360 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:22.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 20 client.9360 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743978d0 0x55eb748e4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 4 client.9360 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb74707b00 con 0x55eb743978d0 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695200640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743978d0 0x55eb748e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f7695200640 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743978d0 0x55eb748e4560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2032a84abac3695c server_cookie=e91cf693b4908263 in_seq=0 out_seq=0 2024-09-21T07:33:22.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 10 client.9360 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 1 -- 172.21.15.64:0/4083527641 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb74707b00 con 0x55eb743978d0 2024-09-21T07:33:22.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 10 client.9360 handle_command_reply: tid=0 2024-09-21T07:33:22.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 client.9360 shutdown 2024-09-21T07:33:22.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 msgr2=0x55eb748e3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f768801d3d0 tx=0x7f76880019f0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 shutdown_connections 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743978d0 0x55eb748e4560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb747a3630 0x55eb748e3b50 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74794ab0 0x55eb748e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 --2- 172.21.15.64:0/4083527641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748e30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f767e000640 0 client.9360 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 >> 172.21.15.64:0/4083527641 conn(0x55eb743b2d20 msgr2=0x55eb748afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 shutdown_connections 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 1 -- 172.21.15.64:0/4083527641 wait complete. 2024-09-21T07:33:22.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.763+0000 7f769f30f000 20 client.9360 trim_cache size 0 max 16384 2024-09-21T07:33:22.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 Processor -- start 2024-09-21T07:33:22.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 -- start start 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 0x55eb748f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f76901feb90 con 0x55eb74794ab0 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f769006ff50 con 0x55eb74781170 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f769006f2b0 con 0x55eb743b2d20 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54592/0 (socket says 172.21.15.64:54592) 2024-09-21T07:33:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 -- 172.21.15.64:0/1295604829 learned_addr learned my addr 172.21.15.64:0/1295604829 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7687e00640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695200640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 0x55eb748f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 -- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 msgr2=0x55eb748f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 0x55eb748f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 -- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 msgr2=0x55eb748f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695c00640 1 -- 172.21.15.64:0/1295604829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb748b71b0 con 0x55eb74794ab0 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7687e00640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.783+0000 7f7695200640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 0x55eb748f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f7695c00640 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7688001d10 tx=0x7f7688006de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbcb52fa94763d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f7684c00640 1 -- 172.21.15.64:0/1295604829 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688003cc0 con 0x55eb74794ab0 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f7684c00640 1 -- 172.21.15.64:0/1295604829 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76880cc030 con 0x55eb74794ab0 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f7684c00640 1 -- 172.21.15.64:0/1295604829 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880bb940 con 0x55eb74794ab0 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- 172.21.15.64:0/1295604829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 msgr2=0x55eb749092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7688001d10 tx=0x7f7688006de0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- 172.21.15.64:0/1295604829 shutdown_connections 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb749092a0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb74781170 0x55eb748f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- 172.21.15.64:0/1295604829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb743b2d20 0x55eb748f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- 172.21.15.64:0/1295604829 >> 172.21.15.64:0/1295604829 conn(0x55eb74904b80 msgr2=0x55eb748b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- 172.21.15.64:0/1295604829 shutdown_connections 2024-09-21T07:33:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- 172.21.15.64:0/1295604829 wait complete. 2024-09-21T07:33:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- start start 2024-09-21T07:33:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 Processor -- start 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 0x55eb7496e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb7496e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55eb748e3f10 con 0x55eb74794ab0 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55eb74708720 con 0x55eb743b2d20 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.787+0000 7f769f30f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55eb743ba620 con 0x55eb74781170 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 10 client.0 _ll_register_callbacks cb 0x7f7674005240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54604/0 (socket says 172.21.15.64:54604) 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 -- 172.21.15.64:0/4219265654 learned_addr learned my addr 172.21.15.64:0/4219265654 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7687e00640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb7496e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695200640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 0x55eb7496e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 -- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 msgr2=0x55eb7496e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb7496e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 -- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 msgr2=0x55eb7496e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 0x55eb7496e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 -- 172.21.15.64:0/4219265654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb74751b00 con 0x55eb74794ab0 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7687e00640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb7496e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695200640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 0x55eb7496e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695c00640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f768801b230 tx=0x7f76880bb600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608b363f2501967c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880bbb30 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f76880bbcd0 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76880cc030 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f76880e0050 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 10 client.9366 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55eb746bf060 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76880cc030 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f76880e3020 con 0x55eb74794ab0 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 10 client.9366 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 10 client.9366 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:22.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 20 client.9366 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743b0f80 0x55eb7490d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 4 client.9366 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55eb747035b0 con 0x55eb743b0f80 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695200640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743b0f80 0x55eb7490d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f7695200640 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743b0f80 0x55eb7490d320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a259c974e1c13e server_cookie=66bf0ed477d2b890 in_seq=0 out_seq=0 2024-09-21T07:33:22.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 10 client.9366 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 1 -- 172.21.15.64:0/4219265654 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb747035b0 con 0x55eb743b0f80 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f767e000640 10 client.9366 handle_command_reply: tid=0 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.791+0000 7f769f30f000 1 client.9366 shutdown 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 msgr2=0x55eb7496eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f768801b230 tx=0x7f76880bb600 comp rx=0 tx=0).stop 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 shutdown_connections 2024-09-21T07:33:22.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55eb743b0f80 0x55eb7490d320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55eb74794ab0 0x55eb7496eb80 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55eb74781170 0x55eb7496e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 --2- 172.21.15.64:0/4219265654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb743b2d20 0x55eb7496e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f767e000640 0 client.9366 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 >> 172.21.15.64:0/4219265654 conn(0x55eb74904b80 msgr2=0x55eb748af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 shutdown_connections 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 1 -- 172.21.15.64:0/4219265654 wait complete. 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f769f30f000 20 client.9366 trim_cache size 0 max 16384 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:33:22.795 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:33:22.796 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:22.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 msgr2=0x7f766c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 0x7f766c075740 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f76900cc240 tx=0x7f76780091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 msgr2=0x7f769015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7680006660 tx=0x7f76800039d0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 shutdown_connections 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f766c073230 0x7f766c075740 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76900cabb0 0x7f769015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f769014b470 0x7f76900ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 --2- 172.21.15.64:0/3270266298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674005360 0x7f769015a090 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 >> 172.21.15.64:0/3270266298 conn(0x7f769008bf80 msgr2=0x7f76900b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 shutdown_connections 2024-09-21T07:33:22.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.795+0000 7f7696600640 1 -- 172.21.15.64:0/3270266298 wait complete. 2024-09-21T07:33:22.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:22.813 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- 172.21.15.64:0/758355825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840706c0 msgr2=0x7f26840ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 --2- 172.21.15.64:0/758355825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840706c0 0x7f26840ce740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2674009840 tx=0x7f267401c790 comp rx=0 tx=0).stop 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- 172.21.15.64:0/758355825 shutdown_connections 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 --2- 172.21.15.64:0/758355825 >> v2:172.21.15.90:3300/0 conn(0x7f26840ca990 0x7f26840b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 --2- 172.21.15.64:0/758355825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840706c0 0x7f26840ce740 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- 172.21.15.64:0/758355825 >> 172.21.15.64:0/758355825 conn(0x7f26840ccbe0 msgr2=0x7f26840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- 172.21.15.64:0/758355825 shutdown_connections 2024-09-21T07:33:22.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- 172.21.15.64:0/758355825 wait complete. 2024-09-21T07:33:22.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 Processor -- start 2024-09-21T07:33:22.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.975+0000 7f268c800640 1 -- start start 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840ca990 0x7f2684150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f268415ec20 0x7f26841f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2684168c30 con 0x7f2684151370 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2684168ab0 con 0x7f268415ec20 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2684168db0 con 0x7f26840ca990 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54608/0 (socket says 172.21.15.64:54608) 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 -- 172.21.15.64:0/2525326301 learned_addr learned my addr 172.21.15.64:0/2525326301 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f2689e00640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840ca990 0x7f2684150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f2689400640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f268415ec20 0x7f26841f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 -- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840ca990 msgr2=0x7f2684150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840ca990 0x7f2684150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 -- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f268415ec20 msgr2=0x7f26841f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f268415ec20 0x7f26841f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 -- 172.21.15.64:0/2525326301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840b2b10 con 0x7f2684151370 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268a800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f268000ec70 tx=0x7f268000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f267e000640 1 -- 172.21.15.64:0/2525326301 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680003b80 con 0x7f2684151370 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f267e000640 1 -- 172.21.15.64:0/2525326301 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2680003d20 con 0x7f2684151370 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f267e000640 1 -- 172.21.15.64:0/2525326301 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680004280 con 0x7f2684151370 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26841f62c0 con 0x7f2684151370 2024-09-21T07:33:22.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.979+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26841f6560 con 0x7f2684151370 2024-09-21T07:33:22.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f267e000640 1 -- 172.21.15.64:0/2525326301 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2680004420 con 0x7f2684151370 2024-09-21T07:33:22.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f267e000640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 0x7f2668075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f267e000640 1 -- 172.21.15.64:0/2525326301 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f2680095080 con 0x7f2684151370 2024-09-21T07:33:22.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 Processor -- start 2024-09-21T07:33:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2689e00640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 0x7f2668075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 -- start start 2024-09-21T07:33:22.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2689e00640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 0x7f2668075740 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2684072330 tx=0x7f26780013a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f7a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7a3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b43f641cd0 con 0x55b43f28d890 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b43f557330 con 0x55b43f6366d0 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b43f5b4bb0 con 0x55b43f351aa0 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.983+0000 7f2689400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54620/0 (socket says 172.21.15.64:54620) 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 -- 172.21.15.64:0/1438453815 learned_addr learned my addr 172.21.15.64:0/1438453815 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689e00640 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f7a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f268a800640 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 -- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 msgr2=0x55b43f7a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7a3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 -- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 msgr2=0x55b43f7a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f7a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 -- 172.21.15.64:0/1438453815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43f558c80 con 0x55b43f28d890 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2689400640 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f26740b0040 tx=0x7f2674019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd867d411b34770 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2672600640 1 -- 172.21.15.64:0/1438453815 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26740b2040 con 0x55b43f28d890 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2672600640 1 -- 172.21.15.64:0/1438453815 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2674004330 con 0x55b43f28d890 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2672600640 1 -- 172.21.15.64:0/1438453815 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26740a5a70 con 0x55b43f28d890 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- 172.21.15.64:0/1438453815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 msgr2=0x55b43f7a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f26740b0040 tx=0x7f2674019530 comp rx=0 tx=0).stop 2024-09-21T07:33:22.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- 172.21.15.64:0/1438453815 shutdown_connections 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f7a2f30 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 --2- 172.21.15.64:0/1438453815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f7a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- 172.21.15.64:0/1438453815 >> 172.21.15.64:0/1438453815 conn(0x55b43f2615c0 msgr2=0x55b43f75fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- 172.21.15.64:0/1438453815 shutdown_connections 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- 172.21.15.64:0/1438453815 wait complete. 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 -- start start 2024-09-21T07:33:22.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.987+0000 7f2693f10000 1 Processor -- start 2024-09-21T07:33:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 0x55b43f75ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f351aa0 0x55b43f75ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b43f5a7df0 con 0x55b43f6366d0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b43f5a3fe0 con 0x55b43f351aa0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b43f5494d0 con 0x55b43f28d890 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 10 client.0 _ll_register_callbacks cb 0x55b43f5277f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54630/0 (socket says 172.21.15.64:54630) 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 -- 172.21.15.64:0/3318510403 learned_addr learned my addr 172.21.15.64:0/3318510403 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2689400640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f351aa0 0x55b43f75ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2689e00640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 0x55b43f75ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 -- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 msgr2=0x55b43f75ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 0x55b43f75ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 -- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f351aa0 msgr2=0x55b43f75ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f351aa0 0x55b43f75ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 -- 172.21.15.64:0/3318510403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43f542210 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2689e00640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 0x55b43f75ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f268a800640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f2680093380 tx=0x7f268005f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3f2ca4fc1d110d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268005f330 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f268005b170 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b43f53c350 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f268005f820 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 10 client.9375 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55b43f528fc0 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b43f53c350 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f2680082040 con 0x55b43f6366d0 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 10 client.9375 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 10 client.9375 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 20 client.9375 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:22.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f246930 0x55b43f7ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:22.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 4 client.9375 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:22.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b43f5b6b00 con 0x55b43f246930 2024-09-21T07:33:22.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2689e00640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f246930 0x55b43f7ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2689e00640 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f246930 0x55b43f7ae2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857c2d1620f99ed3 server_cookie=ff3fc33f695bc6d0 in_seq=0 out_seq=0 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.991+0000 7f2666a00640 10 client.9375 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2666a00640 1 -- 172.21.15.64:0/3318510403 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b43f5b6b00 con 0x55b43f246930 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2666a00640 10 client.9375 handle_command_reply: tid=0 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 client.9375 shutdown 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 msgr2=0x55b43f769a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f2680093380 tx=0x7f268005f660 comp rx=0 tx=0).stop 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 shutdown_connections 2024-09-21T07:33:22.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f246930 0x55b43f7ae2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f769a00 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f351aa0 0x55b43f75ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 --2- 172.21.15.64:0/3318510403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f28d890 0x55b43f75ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2666a00640 0 client.9375 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 >> 172.21.15.64:0/3318510403 conn(0x55b43f2615c0 msgr2=0x55b43f757d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 shutdown_connections 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 1 -- 172.21.15.64:0/3318510403 wait complete. 2024-09-21T07:33:22.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:22.995+0000 7f2693f10000 20 client.9375 trim_cache size 0 max 16384 2024-09-21T07:33:23.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.011+0000 7f2693f10000 1 Processor -- start 2024-09-21T07:33:23.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.011+0000 7f2693f10000 1 -- start start 2024-09-21T07:33:23.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f28d890 0x55b43f7beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b43f75c6b0 con 0x55b43f6366d0 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b43f75db20 con 0x55b43f28d890 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2684201320 con 0x55b43f351aa0 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54646/0 (socket says 172.21.15.64:54646) 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 -- 172.21.15.64:0/4149592808 learned_addr learned my addr 172.21.15.64:0/4149592808 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2689400640 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2689e00640 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f28d890 0x55b43f7beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 -- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 msgr2=0x55b43f7bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 -- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f28d890 msgr2=0x55b43f7beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f28d890 0x55b43f7beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 -- 172.21.15.64:0/4149592808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43f769d70 con 0x55b43f6366d0 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f268a800640 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f2680009bc0 tx=0x7f26800692d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaa4cb5447e8f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2671c00640 1 -- 172.21.15.64:0/4149592808 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268005b6c0 con 0x55b43f6366d0 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2671c00640 1 -- 172.21.15.64:0/4149592808 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268005f330 con 0x55b43f6366d0 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2671c00640 1 -- 172.21.15.64:0/4149592808 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268005b170 con 0x55b43f6366d0 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- 172.21.15.64:0/4149592808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 msgr2=0x55b43f7a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f2680009bc0 tx=0x7f26800692d0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- 172.21.15.64:0/4149592808 shutdown_connections 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f6366d0 0x55b43f7a0860 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f7bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 --2- 172.21.15.64:0/4149592808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f28d890 0x55b43f7beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- 172.21.15.64:0/4149592808 >> 172.21.15.64:0/4149592808 conn(0x55b43f2615c0 msgr2=0x55b43f7b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- 172.21.15.64:0/4149592808 shutdown_connections 2024-09-21T07:33:23.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.015+0000 7f2693f10000 1 -- 172.21.15.64:0/4149592808 wait complete. 2024-09-21T07:33:23.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- start start 2024-09-21T07:33:23.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 Processor -- start 2024-09-21T07:33:23.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f81d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f81d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26840b0bd0 con 0x55b43f28d890 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26840b1870 con 0x55b43f6366d0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f26840b1220 con 0x55b43f351aa0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 10 client.0 _ll_register_callbacks cb 0x7f26800640b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54658/0 (socket says 172.21.15.64:54658) 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 -- 172.21.15.64:0/811309448 learned_addr learned my addr 172.21.15.64:0/811309448 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689400640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f81d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f268a800640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f81d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 -- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 msgr2=0x55b43f81d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:23.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f81d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 -- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 msgr2=0x55b43f81d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f81d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 -- 172.21.15.64:0/811309448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43f601680 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2689e00640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2678010000 tx=0x7f2678007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716404de7569005f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267801b040 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f2678010040 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f268005f330 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f2678037050 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 10 client.9381 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55b43f56e0b0 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268005f330 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f267803a020 con 0x55b43f28d890 2024-09-21T07:33:23.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 10 client.9381 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 10 client.9381 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 20 client.9381 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f234990 0x55b43f758ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 4 client.9381 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.019+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b43f5b25b0 con 0x55b43f234990 2024-09-21T07:33:23.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2689400640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f234990 0x55b43f758ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2666a00640 10 client.9381 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2689400640 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f234990 0x55b43f758ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781fd572836f0e0f server_cookie=eb6ff9c25b307d5c in_seq=0 out_seq=0 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2666a00640 1 -- 172.21.15.64:0/811309448 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x55b43f5b25b0 con 0x55b43f234990 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2666a00640 10 client.9381 handle_command_reply: tid=0 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 client.9381 shutdown 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 msgr2=0x55b43f81ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2678010000 tx=0x7f2678007cf0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 shutdown_connections 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55b43f234990 0x55b43f758ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b43f6366d0 0x55b43f81d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b43f351aa0 0x55b43f81d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 --2- 172.21.15.64:0/811309448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b43f28d890 0x55b43f81ce50 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2666a00640 0 client.9381 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 >> 172.21.15.64:0/811309448 conn(0x55b43f2615c0 msgr2=0x55b43f7b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 shutdown_connections 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 1 -- 172.21.15.64:0/811309448 wait complete. 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f2693f10000 20 client.9381 trim_cache size 0 max 16384 2024-09-21T07:33:23.025 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "79bce7d5-835e-4615-a2fe-692ab9a13694", 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:33:17.340035+0000", 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:33:23.026 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:23.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 msgr2=0x7f2668075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 0x7f2668075740 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2684072330 tx=0x7f26780013a0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 msgr2=0x7f268415a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f268000ec70 tx=0x7f268000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 shutdown_connections 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2668073230 0x7f2668075740 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2684151370 0x7f268415a050 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f268415ec20 0x7f26841f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 --2- 172.21.15.64:0/2525326301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26840ca990 0x7f2684150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 >> 172.21.15.64:0/2525326301 conn(0x7f26840ccbe0 msgr2=0x7f268415d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 shutdown_connections 2024-09-21T07:33:23.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.023+0000 7f268c800640 1 -- 172.21.15.64:0/2525326301 wait complete. 2024-09-21T07:33:23.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:23.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- 172.21.15.64:0/3898302679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4004810 msgr2=0x7ffbc4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 --2- 172.21.15.64:0/3898302679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4004810 0x7ffbc4004c20 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c4a0 tx=0x7ffbc801cf00 comp rx=0 tx=0).stop 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbdfe00640 1 -- 172.21.15.64:0/3898302679 reap_dead start 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- 172.21.15.64:0/3898302679 shutdown_connections 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- 172.21.15.64:0/3898302679 >> 172.21.15.64:0/3898302679 conn(0x7ffbe00d0c50 msgr2=0x7ffbe00d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- 172.21.15.64:0/3898302679 shutdown_connections 2024-09-21T07:33:23.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- 172.21.15.64:0/3898302679 wait complete. 2024-09-21T07:33:23.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 Processor -- start 2024-09-21T07:33:23.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.203+0000 7ffbe6200640 1 -- start start 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbc4004810 0x7ffbe0151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe0153340 0x7ffbe01fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe00af4c0 con 0x7ffbe0159c60 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe00cf100 con 0x7ffbe0153340 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe00af640 con 0x7ffbc4004810 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdf400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbc4004810 0x7ffbe0151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbd7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe0153340 0x7ffbe01fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54678/0 (socket says 172.21.15.64:54678) 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 -- 172.21.15.64:0/528118326 learned_addr learned my addr 172.21.15.64:0/528118326 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 -- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbc4004810 msgr2=0x7ffbe0151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbc4004810 0x7ffbe0151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 -- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe0153340 msgr2=0x7ffbe01fbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe0153340 0x7ffbe01fbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 -- 172.21.15.64:0/528118326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe00b04a0 con 0x7ffbe0159c60 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbdfe00640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00735c0 tx=0x7ffbd800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004d30 con 0x7ffbe0159c60 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd8011e50 con 0x7ffbe0159c60 2024-09-21T07:33:23.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe01fc3d0 con 0x7ffbe0159c60 2024-09-21T07:33:23.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800e820 con 0x7ffbe0159c60 2024-09-21T07:33:23.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe0152e70 con 0x7ffbe0159c60 2024-09-21T07:33:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.207+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe0073610 con 0x7ffbe0159c60 2024-09-21T07:33:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.211+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffbd800e9c0 con 0x7ffbe0159c60 2024-09-21T07:33:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.211+0000 7ffbd7400640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 0x7ffbbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.211+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ffbd8095a20 con 0x7ffbe0159c60 2024-09-21T07:33:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.211+0000 7ffbdf400640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 0x7ffbbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.211+0000 7ffbdf400640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 0x7ffbbc075710 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006fd0 tx=0x7ffbd0006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.215+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffbe01fc3d0 con 0x7ffbe0159c60 2024-09-21T07:33:23.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.427+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbe00d12b0 con 0x7ffbe0159c60 2024-09-21T07:33:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.427+0000 7ffbd7400640 1 -- 172.21.15.64:0/528118326 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7ffbd801f060 con 0x7ffbe0159c60 2024-09-21T07:33:23.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:23.428 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:23.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 msgr2=0x7ffbbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 0x7ffbbc075710 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006fd0 tx=0x7ffbd0006b20 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 msgr2=0x7ffbe015a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00735c0 tx=0x7ffbd800f790 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 shutdown_connections 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffbbc073200 0x7ffbbc075710 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe0159c60 0x7ffbe015a070 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe0153340 0x7ffbe01fbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 --2- 172.21.15.64:0/528118326 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbc4004810 0x7ffbe0151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 >> 172.21.15.64:0/528118326 conn(0x7ffbe00d0c50 msgr2=0x7ffbe00b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 shutdown_connections 2024-09-21T07:33:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.431+0000 7ffbe6200640 1 -- 172.21.15.64:0/528118326 wait complete. 2024-09-21T07:33:23.450 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:33:23.450 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- 172.21.15.64:0/4150088067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd11815edb0 msgr2=0x7fd1180700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 --2- 172.21.15.64:0/4150088067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd11815edb0 0x7fd1180700b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009840 tx=0x7fd10c01c820 comp rx=0 tx=0).stop 2024-09-21T07:33:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- 172.21.15.64:0/4150088067 shutdown_connections 2024-09-21T07:33:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 --2- 172.21.15.64:0/4150088067 >> v2:172.21.15.90:3300/0 conn(0x7fd1180709b0 0x7fd1180b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 --2- 172.21.15.64:0/4150088067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd11815edb0 0x7fd1180700b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- 172.21.15.64:0/4150088067 >> 172.21.15.64:0/4150088067 conn(0x7fd1180ccbe0 msgr2=0x7fd1180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- 172.21.15.64:0/4150088067 shutdown_connections 2024-09-21T07:33:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- 172.21.15.64:0/4150088067 wait complete. 2024-09-21T07:33:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 Processor -- start 2024-09-21T07:33:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.611+0000 7fd120200640 1 -- start start 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1180709b0 0x7fd118154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd11815edb0 0x7fd1180ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd118169070 con 0x7fd1180b4700 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd118168ef0 con 0x7fd11815edb0 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd1181691f0 con 0x7fd1180709b0 2024-09-21T07:33:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54684/0 (socket says 172.21.15.64:54684) 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 -- 172.21.15.64:0/452392230 learned_addr learned my addr 172.21.15.64:0/452392230 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11d800640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1180709b0 0x7fd118154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11e200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd11815edb0 0x7fd1180ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 -- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1180709b0 msgr2=0x7fd118154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1180709b0 0x7fd118154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 -- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd11815edb0 msgr2=0x7fd1180ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd11815edb0 0x7fd1180ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 -- 172.21.15.64:0/452392230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1180b0210 con 0x7fd1180b4700 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd11ce00640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd10400e740 tx=0x7fd10400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10400ccc0 con 0x7fd1180b4700 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd10400ce60 con 0x7fd1180b4700 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104004280 con 0x7fd1180b4700 2024-09-21T07:33:23.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1180b04f0 con 0x7fd1180b4700 2024-09-21T07:33:23.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1180c5360 con 0x7fd1180b4700 2024-09-21T07:33:23.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.615+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1180b41c0 con 0x7fd1180b4700 2024-09-21T07:33:23.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.619+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd104003600 con 0x7fd1180b4700 2024-09-21T07:33:23.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.619+0000 7fd115600640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.619+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fd104094c60 con 0x7fd1180b4700 2024-09-21T07:33:23.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.619+0000 7fd11d800640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.619+0000 7fd11d800640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 0x7fd0f8075740 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0af000 tx=0x7fd10c01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.623+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd10405faf0 con 0x7fd1180b4700 2024-09-21T07:33:23.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.863+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd1180aff60 con 0x7fd1180b4700 2024-09-21T07:33:23.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.863+0000 7fd115600640 1 -- 172.21.15.64:0/452392230 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fd10405f3f0 con 0x7fd1180b4700 2024-09-21T07:33:23.864 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:23.865 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":661,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076768563,"bytes_used":2597740544,"bytes_avail":770496372736,"bytes_total":773094113280,"write_bytes_sec":38838074,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-21T07:33:21.593220+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 msgr2=0x7fd0f8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 0x7fd0f8075740 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0af000 tx=0x7fd10c01b060 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 msgr2=0x7fd1180ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd10400e740 tx=0x7fd10400ec00 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 shutdown_connections 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd11815edb0 0x7fd1180ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1180b4700 0x7fd1180ae2c0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 --2- 172.21.15.64:0/452392230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1180709b0 0x7fd118154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 >> 172.21.15.64:0/452392230 conn(0x7fd1180ccbe0 msgr2=0x7fd1180cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 shutdown_connections 2024-09-21T07:33:23.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:23.867+0000 7fd120200640 1 -- 172.21.15.64:0/452392230 wait complete. 2024-09-21T07:33:23.886 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-21T07:33:23.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:23.887 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-21T07:33:24.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 -- 172.21.15.64:0/878939509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f214015ec20 msgr2=0x7f21400ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 --2- 172.21.15.64:0/878939509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f214015ec20 0x7f21400ce740 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f2134009840 tx=0x7f213401c790 comp rx=0 tx=0).stop 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 -- 172.21.15.64:0/878939509 shutdown_connections 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 --2- 172.21.15.64:0/878939509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400ca990 0x7f214006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 --2- 172.21.15.64:0/878939509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f214015ec20 0x7f21400ce740 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 -- 172.21.15.64:0/878939509 >> 172.21.15.64:0/878939509 conn(0x7f21400ccbe0 msgr2=0x7f21400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 -- 172.21.15.64:0/878939509 shutdown_connections 2024-09-21T07:33:24.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.047+0000 7f2148200640 1 -- 172.21.15.64:0/878939509 wait complete. 2024-09-21T07:33:24.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 Processor -- start 2024-09-21T07:33:24.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- start start 2024-09-21T07:33:24.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400704f0 0x7f21400ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 0x7f21401fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2140168ef0 con 0x7f21400ca990 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2140168d70 con 0x7f214015ec20 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2140169070 con 0x7f21400704f0 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54702/0 (socket says 172.21.15.64:54702) 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 -- 172.21.15.64:0/1859151810 learned_addr learned my addr 172.21.15.64:0/1859151810 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2145800640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400704f0 0x7f21400ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2146200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 0x7f21401fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 -- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400704f0 msgr2=0x7f21400ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400704f0 0x7f21400ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 -- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 msgr2=0x7f21401fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 0x7f21401fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 -- 172.21.15.64:0/1859151810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400b0ff0 con 0x7f21400ca990 2024-09-21T07:33:24.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2146200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 0x7f21401fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:24.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2144e00640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f212c00d950 tx=0x7f212c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f213d600640 1 -- 172.21.15.64:0/1859151810 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c017070 con 0x7f21400ca990 2024-09-21T07:33:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f213d600640 1 -- 172.21.15.64:0/1859151810 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f212c009cc0 con 0x7f21400ca990 2024-09-21T07:33:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f213d600640 1 -- 172.21.15.64:0/1859151810 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c0106c0 con 0x7f21400ca990 2024-09-21T07:33:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21400b12d0 con 0x7f21400ca990 2024-09-21T07:33:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.051+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21400b1890 con 0x7f21400ca990 2024-09-21T07:33:24.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f213d600640 1 -- 172.21.15.64:0/1859151810 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f212c01a070 con 0x7f21400ca990 2024-09-21T07:33:24.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f213d600640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 0x7f2120075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f213d600640 1 -- 172.21.15.64:0/1859151810 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f212c094430 con 0x7f21400ca990 2024-09-21T07:33:24.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f2145800640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 0x7f2120075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f214f78c000 1 Processor -- start 2024-09-21T07:33:24.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.055+0000 7f214f78c000 1 -- start start 2024-09-21T07:33:24.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 0x7f2120075740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f21340af000 tx=0x7f213401afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b84ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b850470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ee2b6eecd0 con 0x55ee2b6e36d0 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee2b604330 con 0x55ee2b3feaa0 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ee2b661bb0 con 0x55ee2b33a890 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54716/0 (socket says 172.21.15.64:54716) 2024-09-21T07:33:24.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 -- 172.21.15.64:0/1123478992 learned_addr learned my addr 172.21.15.64:0/1123478992 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2144e00640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b84ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2146200640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b850470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 -- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 msgr2=0x55ee2b84ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b84ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 -- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 msgr2=0x55ee2b850470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b850470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 -- 172.21.15.64:0/1123478992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2b605c80 con 0x55ee2b6e36d0 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2144e00640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b84ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2146200640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b850470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2145800640 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f213401ae40 tx=0x7f21340b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0621c85f0f836f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2132000640 1 -- 172.21.15.64:0/1123478992 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21340c7070 con 0x55ee2b6e36d0 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2132000640 1 -- 172.21.15.64:0/1123478992 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21340a5b40 con 0x55ee2b6e36d0 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f2132000640 1 -- 172.21.15.64:0/1123478992 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21340b2040 con 0x55ee2b6e36d0 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- 172.21.15.64:0/1123478992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 msgr2=0x55ee2b84f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f213401ae40 tx=0x7f21340b7000 comp rx=0 tx=0).stop 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- 172.21.15.64:0/1123478992 shutdown_connections 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b850470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b84ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 --2- 172.21.15.64:0/1123478992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b84f9f0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- 172.21.15.64:0/1123478992 >> 172.21.15.64:0/1123478992 conn(0x55ee2b30e5c0 msgr2=0x55ee2b80cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- 172.21.15.64:0/1123478992 shutdown_connections 2024-09-21T07:33:24.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.059+0000 7f214f78c000 1 -- 172.21.15.64:0/1123478992 wait complete. 2024-09-21T07:33:24.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- start start 2024-09-21T07:33:24.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 Processor -- start 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b80b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8125f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ee2b654df0 con 0x55ee2b3feaa0 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee2b650fe0 con 0x55ee2b6e36d0 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ee2b5f64d0 con 0x55ee2b33a890 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 10 client.0 _ll_register_callbacks cb 0x55ee2b5d47f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54728/0 (socket says 172.21.15.64:54728) 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 -- 172.21.15.64:0/2568131082 learned_addr learned my addr 172.21.15.64:0/2568131082 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2145800640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b80b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2146200640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 -- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 msgr2=0x55ee2b80b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b80b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 -- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 msgr2=0x55ee2b8125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 -- 172.21.15.64:0/2568131082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2b5ef210 con 0x55ee2b3feaa0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2146200640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2144e00640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f212c0926a0 tx=0x7f212c05eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21157e3f9006b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2126a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c021040 con 0x55ee2b3feaa0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f212c092b90 con 0x55ee2b3feaa0 2024-09-21T07:33:24.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee2b5e9350 con 0x55ee2b3feaa0 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f212c05ec60 con 0x55ee2b3feaa0 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 10 client.9405 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55ee2b5d5fc0 con 0x55ee2b3feaa0 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.063+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ee2b5e9350 con 0x55ee2b3feaa0 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f212c04c080 con 0x55ee2b3feaa0 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 10 client.9405 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 10 client.9405 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 20 client.9405 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2f3930 0x55ee2b856e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 4 client.9405 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee2b663b00 con 0x55ee2b2f3930 2024-09-21T07:33:24.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2145800640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2f3930 0x55ee2b856e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2145800640 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2f3930 0x55ee2b856e80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25d7499b9ae68390 server_cookie=cd9aedddb6847dea in_seq=0 out_seq=0 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2126a00640 10 client.9405 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2126a00640 1 -- 172.21.15.64:0/2568131082 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee2b663b00 con 0x55ee2b2f3930 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2126a00640 10 client.9405 handle_command_reply: tid=0 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 client.9405 shutdown 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 msgr2=0x55ee2b80bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f212c0926a0 tx=0x7f212c05eb60 comp rx=0 tx=0).stop 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 shutdown_connections 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2f3930 0x55ee2b856e80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b80bef0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 --2- 172.21.15.64:0/2568131082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b80b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f2126a00640 0 client.9405 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 >> 172.21.15.64:0/2568131082 conn(0x55ee2b30e5c0 msgr2=0x55ee2b804d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 shutdown_connections 2024-09-21T07:33:24.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 1 -- 172.21.15.64:0/2568131082 wait complete. 2024-09-21T07:33:24.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.067+0000 7f214f78c000 20 client.9405 trim_cache size 0 max 16384 2024-09-21T07:33:24.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 Processor -- start 2024-09-21T07:33:24.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 -- start start 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ee2b80ab20 con 0x55ee2b6e36d0 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2140205e60 con 0x55ee2b3feaa0 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2140204eb0 con 0x55ee2b33a890 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54730/0 (socket says 172.21.15.64:54730) 2024-09-21T07:33:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 -- 172.21.15.64:0/1355637734 learned_addr learned my addr 172.21.15.64:0/1355637734 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2144e00640 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2145800640 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 -- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 msgr2=0x55ee2b8c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 -- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 msgr2=0x55ee2b8c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 -- 172.21.15.64:0/1355637734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2b6ae680 con 0x55ee2b6e36d0 2024-09-21T07:33:24.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2146200640 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f21380021a0 tx=0x7f21380112b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c91b5f4b23d11e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2131600640 1 -- 172.21.15.64:0/1355637734 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213801a030 con 0x55ee2b6e36d0 2024-09-21T07:33:24.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2131600640 1 -- 172.21.15.64:0/1355637734 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2138011c30 con 0x55ee2b6e36d0 2024-09-21T07:33:24.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.087+0000 7f2131600640 1 -- 172.21.15.64:0/1355637734 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138010040 con 0x55ee2b6e36d0 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- 172.21.15.64:0/1355637734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 msgr2=0x55ee2b8c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f21380021a0 tx=0x7f21380112b0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- 172.21.15.64:0/1355637734 shutdown_connections 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c1e80 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- 172.21.15.64:0/1355637734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- 172.21.15.64:0/1355637734 >> 172.21.15.64:0/1355637734 conn(0x55ee2b30e5c0 msgr2=0x55ee2b861fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- 172.21.15.64:0/1355637734 shutdown_connections 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- 172.21.15.64:0/1355637734 wait complete. 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- start start 2024-09-21T07:33:24.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 Processor -- start 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2140204860 con 0x55ee2b3feaa0 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2140204360 con 0x55ee2b6e36d0 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55ee2b316680 con 0x55ee2b33a890 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f214f78c000 10 client.0 _ll_register_callbacks cb 0x7f212c00bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:24.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54738/0 (socket says 172.21.15.64:54738) 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 -- 172.21.15.64:0/478376745 learned_addr learned my addr 172.21.15.64:0/478376745 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2146200640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2145800640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 -- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 msgr2=0x55ee2b8c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 -- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 msgr2=0x55ee2b8c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 -- 172.21.15.64:0/478376745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2b61b0b0 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2144e00640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c10 tx=0x7f212c05e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585d47c546b230d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.091+0000 7f2126a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c021070 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f212c01dc90 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2138011c30 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f212c05e3d0 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 10 client.9411 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55ee2b5e7610 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2138011c30 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f212c05dec0 con 0x55ee2b3feaa0 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 10 client.9411 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 10 client.9411 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:24.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 20 client.9411 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2e1990 0x55ee2b806a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 4 client.9411 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55ee2b65f5b0 con 0x55ee2b2e1990 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2145800640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2e1990 0x55ee2b806a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2145800640 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2e1990 0x55ee2b806a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a31db4c15a3b1ad server_cookie=386c8e8cdc5418ef in_seq=0 out_seq=0 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 10 client.9411 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 1 -- 172.21.15.64:0/478376745 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ee2b65f5b0 con 0x55ee2b2e1990 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 10 client.9411 handle_command_reply: tid=0 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 client.9411 shutdown 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 msgr2=0x55ee2b8c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c10 tx=0x7f212c05e8a0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 shutdown_connections 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x55ee2b2e1990 0x55ee2b806a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ee2b6e36d0 0x55ee2b8c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ee2b3feaa0 0x55ee2b8c5b90 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2126a00640 0 client.9411 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 --2- 172.21.15.64:0/478376745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55ee2b33a890 0x55ee2b8c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 >> 172.21.15.64:0/478376745 conn(0x55ee2b30e5c0 msgr2=0x55ee2b8115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 shutdown_connections 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 1 -- 172.21.15.64:0/478376745 wait complete. 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f214f78c000 20 client.9411 trim_cache size 0 max 16384 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:33:24.098 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:24.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 msgr2=0x7f2120075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 0x7f2120075740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f21340af000 tx=0x7f213401afd0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 msgr2=0x7f21400ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f212c00d950 tx=0x7f212c00de10 comp rx=0 tx=0).stop 2024-09-21T07:33:24.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 shutdown_connections 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2120073230 0x7f2120075740 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f214015ec20 0x7f21401fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21400ca990 0x7f21400ad7d0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 --2- 172.21.15.64:0/1859151810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21400704f0 0x7f21400ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 >> 172.21.15.64:0/1859151810 conn(0x7f21400ccbe0 msgr2=0x7f21400cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 shutdown_connections 2024-09-21T07:33:24.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.095+0000 7f2148200640 1 -- 172.21.15.64:0/1859151810 wait complete. 2024-09-21T07:33:24.115 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:33:24.115 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-21T07:33:24.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 -- 172.21.15.64:0/202298755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 msgr2=0x7f25a415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 --2- 172.21.15.64:0/202298755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a415c880 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2598009840 tx=0x7f259801c790 comp rx=0 tx=0).stop 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 -- 172.21.15.64:0/202298755 shutdown_connections 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 --2- 172.21.15.64:0/202298755 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 --2- 172.21.15.64:0/202298755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a415c880 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 -- 172.21.15.64:0/202298755 >> 172.21.15.64:0/202298755 conn(0x7f25a40d0c10 msgr2=0x7f25a40d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.275+0000 7f25ac000640 1 -- 172.21.15.64:0/202298755 shutdown_connections 2024-09-21T07:33:24.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 -- 172.21.15.64:0/202298755 wait complete. 2024-09-21T07:33:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 Processor -- start 2024-09-21T07:33:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 -- start start 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25a416a3c0 con 0x7f25a40736a0 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25a416a240 con 0x7f25a40cb980 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25ac000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f25a416a540 con 0x7f25a406cdf0 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.279+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54740/0 (socket says 172.21.15.64:54740) 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a8c00640 1 -- 172.21.15.64:0/2423563941 learned_addr learned my addr 172.21.15.64:0/2423563941 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25aa000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 -- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 msgr2=0x7f25a4151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a4151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 -- 172.21.15.64:0/2423563941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 msgr2=0x7f25a4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 -- 172.21.15.64:0/2423563941 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a4150b60 con 0x7f25a406cdf0 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a8c00640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:24.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a9600640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a414ffc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25a4071730 tx=0x7f25980a5f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a1600640 1 -- 172.21.15.64:0/2423563941 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980b2040 con 0x7f25a406cdf0 2024-09-21T07:33:24.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a1600640 1 -- 172.21.15.64:0/2423563941 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25980043e0 con 0x7f25a406cdf0 2024-09-21T07:33:24.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a4150e40 con 0x7f25a406cdf0 2024-09-21T07:33:24.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25a1600640 1 -- 172.21.15.64:0/2423563941 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980052d0 con 0x7f25a406cdf0 2024-09-21T07:33:24.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.283+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a4151400 con 0x7f25a406cdf0 2024-09-21T07:33:24.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a1600640 1 -- 172.21.15.64:0/2423563941 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2598005470 con 0x7f25a406cdf0 2024-09-21T07:33:24.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 Processor -- start 2024-09-21T07:33:24.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a1600640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 0x7f2584075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a1600640 1 -- 172.21.15.64:0/2423563941 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f259812d4c0 con 0x7f25a406cdf0 2024-09-21T07:33:24.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 -- start start 2024-09-21T07:33:24.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25aa000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 0x7f2584075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25aa000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 0x7f2584075740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f259c0012f0 tx=0x7f259c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x563517233f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x563517234470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5635170d2cd0 con 0x5635170c76d0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563516fe8330 con 0x563516de2aa0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563517045bb0 con 0x563516d1e890 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54754/0 (socket says 172.21.15.64:54754) 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 -- 172.21.15.64:0/3234710869 learned_addr learned my addr 172.21.15.64:0/3234710869 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a8c00640 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x563517233f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25aa000640 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x563517234470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 -- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 msgr2=0x563517233f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x563517233f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 -- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 msgr2=0x563517234470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x563517234470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.287+0000 7f25a9600640 1 -- 172.21.15.64:0/3234710869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563516fe9c80 con 0x5635170c76d0 2024-09-21T07:33:24.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25a9600640 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f259801cd00 tx=0x7f25980f7ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df7139318718a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f2595c00640 1 -- 172.21.15.64:0/3234710869 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980a5830 con 0x5635170c76d0 2024-09-21T07:33:24.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f2595c00640 1 -- 172.21.15.64:0/3234710869 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25980f7810 con 0x5635170c76d0 2024-09-21T07:33:24.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f2595c00640 1 -- 172.21.15.64:0/3234710869 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980f7d00 con 0x5635170c76d0 2024-09-21T07:33:24.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- 172.21.15.64:0/3234710869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 msgr2=0x5635172339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f259801cd00 tx=0x7f25980f7ad0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- 172.21.15.64:0/3234710869 shutdown_connections 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x563517234470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x563517233f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 --2- 172.21.15.64:0/3234710869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x5635172339f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- 172.21.15.64:0/3234710869 >> 172.21.15.64:0/3234710869 conn(0x563516cf25c0 msgr2=0x5635171f0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- 172.21.15.64:0/3234710869 shutdown_connections 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- 172.21.15.64:0/3234710869 wait complete. 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 -- start start 2024-09-21T07:33:24.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.291+0000 7f25b36b6000 1 Processor -- start 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x56351723b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5635170c76d0 0x56351723b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563517038df0 con 0x563516d1e890 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563517034fe0 con 0x563516de2aa0 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563516fda4d0 con 0x5635170c76d0 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 10 client.0 _ll_register_callbacks cb 0x563516fb87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54764/0 (socket says 172.21.15.64:54764) 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x56351723b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 -- 172.21.15.64:0/2242920164 learned_addr learned my addr 172.21.15.64:0/2242920164 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25aa000640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5635170c76d0 0x56351723b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 -- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5635170c76d0 msgr2=0x56351723b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5635170c76d0 0x56351723b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 -- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 msgr2=0x56351723b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x56351723b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 -- 172.21.15.64:0/2242920164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563516fd3210 con 0x563516d1e890 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a9600640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2598098260 tx=0x7f25980f7970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b955e65687c9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598101670 con 0x563516d1e890 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f25981013f0 con 0x563516d1e890 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563516fcd350 con 0x563516d1e890 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f25980f7d00 con 0x563516d1e890 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 10 client.9420 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x563516fb9fc0 con 0x563516d1e890 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563516fcd350 con 0x563516d1e890 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f25980b5070 con 0x563516d1e890 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 10 client.9420 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 10 client.9420 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 20 client.9420 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cd7930 0x563517245050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 4 client.9420 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563517047b00 con 0x563516cd7930 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a8c00640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cd7930 0x563517245050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25a8c00640 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cd7930 0x563517245050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96dfd4272645f039 server_cookie=15f0a0ad79c792cf in_seq=0 out_seq=0 2024-09-21T07:33:24.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 10 client.9420 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 1 -- 172.21.15.64:0/2242920164 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563517047b00 con 0x563516cd7930 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 10 client.9420 handle_command_reply: tid=0 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 client.9420 shutdown 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 msgr2=0x56351723ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2598098260 tx=0x7f25980f7970 comp rx=0 tx=0).stop 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 shutdown_connections 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cd7930 0x563517245050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5635170c76d0 0x56351723b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516de2aa0 0x56351723b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f258a000640 0 client.9420 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 --2- 172.21.15.64:0/2242920164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516d1e890 0x56351723ac70 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.295+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 >> 172.21.15.64:0/2242920164 conn(0x563516cf25c0 msgr2=0x5635171e8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.299+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 shutdown_connections 2024-09-21T07:33:24.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.299+0000 7f25b36b6000 1 -- 172.21.15.64:0/2242920164 wait complete. 2024-09-21T07:33:24.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.299+0000 7f25b36b6000 20 client.9420 trim_cache size 0 max 16384 2024-09-21T07:33:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.315+0000 7f25b36b6000 1 Processor -- start 2024-09-21T07:33:24.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.315+0000 7f25b36b6000 1 -- start start 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516d1e890 0x56351723ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516de2aa0 0x56351723b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5635171ee7f0 con 0x5635170c76d0 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4205fe0 con 0x563516d1e890 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f25a4205060 con 0x563516de2aa0 2024-09-21T07:33:24.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54778/0 (socket says 172.21.15.64:54778) 2024-09-21T07:33:24.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 -- 172.21.15.64:0/1285230866 learned_addr learned my addr 172.21.15.64:0/1285230866 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25a8c00640 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516de2aa0 0x56351723b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25a9600640 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516d1e890 0x56351723ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 -- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516de2aa0 msgr2=0x56351723b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516de2aa0 0x56351723b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 -- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516d1e890 msgr2=0x56351723ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516d1e890 0x56351723ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 -- 172.21.15.64:0/1285230866 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563517092680 con 0x5635170c76d0 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25aa000640 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f259c00fe40 tx=0x7f259c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fddc6f2b2ea3d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f2595200640 1 -- 172.21.15.64:0/1285230866 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c00fe70 con 0x5635170c76d0 2024-09-21T07:33:24.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f2595200640 1 -- 172.21.15.64:0/1285230866 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f259c028070 con 0x5635170c76d0 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f2595200640 1 -- 172.21.15.64:0/1285230866 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c023980 con 0x5635170c76d0 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- 172.21.15.64:0/1285230866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 msgr2=0x56351723bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f259c00fe40 tx=0x7f259c012000 comp rx=0 tx=0).stop 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- 172.21.15.64:0/1285230866 shutdown_connections 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5635170c76d0 0x56351723bc80 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516de2aa0 0x56351723b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 --2- 172.21.15.64:0/1285230866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563516d1e890 0x56351723ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- 172.21.15.64:0/1285230866 >> 172.21.15.64:0/1285230866 conn(0x563516cf25c0 msgr2=0x563517232fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- 172.21.15.64:0/1285230866 shutdown_connections 2024-09-21T07:33:24.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- 172.21.15.64:0/1285230866 wait complete. 2024-09-21T07:33:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 -- start start 2024-09-21T07:33:24.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.319+0000 7f25b36b6000 1 Processor -- start 2024-09-21T07:33:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x5635172a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635170c76d0 0x5635172aa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25a415ec90 con 0x563516de2aa0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25a415e640 con 0x5635170c76d0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563516cfa680 con 0x563516d1e890 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 10 client.0 _ll_register_callbacks cb 0x7f25980f3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54788/0 (socket says 172.21.15.64:54788) 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 -- 172.21.15.64:0/92080569 learned_addr learned my addr 172.21.15.64:0/92080569 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a9600640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x5635172a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25aa000640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635170c76d0 0x5635172aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 -- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 msgr2=0x5635172a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x5635172a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 -- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635170c76d0 msgr2=0x5635172aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635170c76d0 0x5635172aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 -- 172.21.15.64:0/92080569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563516fff0b0 con 0x563516de2aa0 2024-09-21T07:33:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a8c00640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f2590004710 tx=0x7f2590012ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6dd31340c372ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590011910 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f2590011ab0 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f259c028070 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f2590031050 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 10 client.9426 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x563516fcb610 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f259c028070 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f2590034020 con 0x563516de2aa0 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 10 client.9426 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 10 client.9426 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:24.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 20 client.9426 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cc5990 0x56351723f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 4 client.9426 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5635170435b0 con 0x563516cc5990 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.323+0000 7f25a9600640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cc5990 0x56351723f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25a9600640 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cc5990 0x56351723f800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e3a81988d5018b server_cookie=b1e30fa19ca4ecd7 in_seq=0 out_seq=0 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f258a000640 10 client.9426 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f258a000640 1 -- 172.21.15.64:0/92080569 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x5635170435b0 con 0x563516cc5990 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f258a000640 10 client.9426 handle_command_reply: tid=0 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 client.9426 shutdown 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 msgr2=0x5635172a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f2590004710 tx=0x7f2590012ac0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 shutdown_connections 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563516cc5990 0x56351723f800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635170c76d0 0x5635172aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563516de2aa0 0x5635172a9d40 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 --2- 172.21.15.64:0/92080569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563516d1e890 0x5635172a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f258a000640 0 client.9426 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 >> 172.21.15.64:0/92080569 conn(0x563516cf25c0 msgr2=0x563517239c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 shutdown_connections 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 1 -- 172.21.15.64:0/92080569 wait complete. 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25b36b6000 20 client.9426 trim_cache size 0 max 16384 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:24.328 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "79bce7d5-835e-4615-a2fe-692ab9a13694", 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:33:17.340035+0000", 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:24.329 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 msgr2=0x7f2584075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 0x7f2584075740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f259c0012f0 tx=0x7f259c009040 comp rx=0 tx=0).stop 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 msgr2=0x7f25a414ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a414ffc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25a4071730 tx=0x7f25980a5f70 comp rx=0 tx=0).stop 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 shutdown_connections 2024-09-21T07:33:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2584073230 0x7f2584075740 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25a40cb980 0x7f25a4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25a40736a0 0x7f25a4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 --2- 172.21.15.64:0/2423563941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25a406cdf0 0x7f25a414ffc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 >> 172.21.15.64:0/2423563941 conn(0x7f25a40d0c10 msgr2=0x7f25a4073ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 shutdown_connections 2024-09-21T07:33:24.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:24.327+0000 7f25ac000640 1 -- 172.21.15.64:0/2423563941 wait complete. 2024-09-21T07:33:29.346 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-21T07:33:29.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-21T07:33:29.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- 172.21.15.64:0/1866204652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe89815a1c0 msgr2=0x7fe8980b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 --2- 172.21.15.64:0/1866204652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe89815a1c0 0x7fe8980b1be0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fe880009840 tx=0x7fe88001c760 comp rx=0 tx=0).stop 2024-09-21T07:33:29.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- 172.21.15.64:0/1866204652 shutdown_connections 2024-09-21T07:33:29.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 --2- 172.21.15.64:0/1866204652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe89815a1c0 0x7fe8980b1be0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- 172.21.15.64:0/1866204652 >> 172.21.15.64:0/1866204652 conn(0x7fe8980ccbe0 msgr2=0x7fe8980ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- 172.21.15.64:0/1866204652 shutdown_connections 2024-09-21T07:33:29.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- 172.21.15.64:0/1866204652 wait complete. 2024-09-21T07:33:29.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 Processor -- start 2024-09-21T07:33:29.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.523+0000 7fe89ce00640 1 -- start start 2024-09-21T07:33:29.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8980b2120 0x7fe89814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89815a1c0 0x7fe89809d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe89806faf0 con 0x7fe898159db0 2024-09-21T07:33:29.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe89806f970 con 0x7fe89815a1c0 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe89816b420 con 0x7fe8980b2120 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46530/0 (socket says 172.21.15.64:46530) 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 -- 172.21.15.64:0/2195265226 learned_addr learned my addr 172.21.15.64:0/2195265226 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe895e00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8980b2120 0x7fe89814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe896800640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89815a1c0 0x7fe89809d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 -- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8980b2120 msgr2=0x7fe89814a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8980b2120 0x7fe89814a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 -- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89815a1c0 msgr2=0x7fe89809d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89815a1c0 0x7fe89809d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 -- 172.21.15.64:0/2195265226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8980af330 con 0x7fe898159db0 2024-09-21T07:33:29.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88d400640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe880009790 tx=0x7fe880004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88ea00640 1 -- 172.21.15.64:0/2195265226 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800bb070 con 0x7fe898159db0 2024-09-21T07:33:29.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88ea00640 1 -- 172.21.15.64:0/2195265226 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe880005030 con 0x7fe898159db0 2024-09-21T07:33:29.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe88ea00640 1 -- 172.21.15.64:0/2195265226 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800b2040 con 0x7fe898159db0 2024-09-21T07:33:29.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8980af050 con 0x7fe898159db0 2024-09-21T07:33:29.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.527+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89809d930 con 0x7fe898159db0 2024-09-21T07:33:29.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe88ea00640 1 -- 172.21.15.64:0/2195265226 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8800046d0 con 0x7fe898159db0 2024-09-21T07:33:29.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe8a4630000 1 Processor -- start 2024-09-21T07:33:29.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe8a4630000 1 -- start start 2024-09-21T07:33:29.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe88ea00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 0x7fe874075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe88ea00640 1 -- 172.21.15.64:0/2195265226 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe88012dde0 con 0x7fe898159db0 2024-09-21T07:33:29.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.531+0000 7fe896800640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 0x7fe874075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x56318077cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x56318077d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56318061bcd0 con 0x5631806106d0 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563180531330 con 0x56318032baa0 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56318058ebb0 con 0x563180267890 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe896800640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 0x7fe874075710 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe8981fbf00 tx=0x7fe8900019e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46538/0 (socket says 172.21.15.64:46538) 2024-09-21T07:33:29.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 -- 172.21.15.64:0/1308124899 learned_addr learned my addr 172.21.15.64:0/1308124899 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe896800640 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x56318077d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe88d400640 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x56318077cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 -- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 msgr2=0x56318077cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x56318077cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 -- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 msgr2=0x56318077d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x56318077d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 -- 172.21.15.64:0/1308124899 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563180532c80 con 0x5631806106d0 2024-09-21T07:33:29.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe895e00640 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fe888001810 tx=0x7fe888007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dd43ea3fb91904 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe886a00640 1 -- 172.21.15.64:0/1308124899 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8880052e0 con 0x5631806106d0 2024-09-21T07:33:29.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe886a00640 1 -- 172.21.15.64:0/1308124899 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe888018070 con 0x5631806106d0 2024-09-21T07:33:29.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe886a00640 1 -- 172.21.15.64:0/1308124899 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88800f9b0 con 0x5631806106d0 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- 172.21.15.64:0/1308124899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 msgr2=0x56318077c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fe888001810 tx=0x7fe888007e40 comp rx=0 tx=0).stop 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- 172.21.15.64:0/1308124899 shutdown_connections 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x56318077d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x56318077cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 --2- 172.21.15.64:0/1308124899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318077c9f0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- 172.21.15.64:0/1308124899 >> 172.21.15.64:0/1308124899 conn(0x56318023b5c0 msgr2=0x563180739ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- 172.21.15.64:0/1308124899 shutdown_connections 2024-09-21T07:33:29.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.535+0000 7fe8a4630000 1 -- 172.21.15.64:0/1308124899 wait complete. 2024-09-21T07:33:29.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 -- start start 2024-09-21T07:33:29.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 Processor -- start 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807389d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563180581df0 con 0x5631806106d0 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56318057dfe0 con 0x56318032baa0 2024-09-21T07:33:29.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5631805234d0 con 0x563180267890 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe8a4630000 10 client.0 _ll_register_callbacks cb 0x5631805017f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe896800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe895e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:36446/0 (socket says 172.21.15.64:36446) 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe895e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:48378/0 (socket says 172.21.15.64:48378) 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 -- 172.21.15.64:0/481438094 learned_addr learned my addr 172.21.15.64:0/481438094 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe896800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46554/0 (socket says 172.21.15.64:46554) 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 -- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 msgr2=0x5631807389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 -- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 msgr2=0x56318073f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 -- 172.21.15.64:0/481438094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318051c210 con 0x56318032baa0 2024-09-21T07:33:29.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe896800640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:29.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe88d400640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8800f5920 tx=0x7fe8800f81c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ce527f37db7ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.539+0000 7fe87b400640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880101f90 con 0x56318032baa0 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe880101b00 con 0x56318032baa0 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563180516350 con 0x56318032baa0 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe880119050 con 0x56318032baa0 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 10 client.8956 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:29.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x563180502fc0 con 0x56318032baa0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563180516350 con 0x56318032baa0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe8800b5030 con 0x56318032baa0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 10 client.8956 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 10 client.8956 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 20 client.8956 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563180220930 0x563180783e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 4 client.8956 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563180590b00 con 0x563180220930 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe895e00640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563180220930 0x563180783e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe895e00640 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563180220930 0x563180783e80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec7ccbb6386eafd server_cookie=ddb383d6f25e950c in_seq=0 out_seq=0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 10 client.8956 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 1 -- 172.21.15.64:0/481438094 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563180590b00 con 0x563180220930 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 10 client.8956 handle_command_reply: tid=0 2024-09-21T07:33:29.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 client.8956 shutdown 2024-09-21T07:33:29.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 msgr2=0x563180738f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8800f5920 tx=0x7fe8800f81c0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 shutdown_connections 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x563180220930 0x563180783e80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x56318073f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56318032baa0 0x563180738f10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 --2- 172.21.15.64:0/481438094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807389d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe87b400640 0 client.8956 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 >> 172.21.15.64:0/481438094 conn(0x56318023b5c0 msgr2=0x563180731d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 shutdown_connections 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 1 -- 172.21.15.64:0/481438094 wait complete. 2024-09-21T07:33:29.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.543+0000 7fe8a4630000 20 client.8956 trim_cache size 0 max 16384 2024-09-21T07:33:29.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.563+0000 7fe8a4630000 1 Processor -- start 2024-09-21T07:33:29.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.563+0000 7fe8a4630000 1 -- start start 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807ee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631806106d0 0x5631807eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563180737af0 con 0x56318032baa0 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe898205f40 con 0x5631806106d0 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe898204f60 con 0x563180267890 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46562/0 (socket says 172.21.15.64:46562) 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe895e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 -- 172.21.15.64:0/667789055 learned_addr learned my addr 172.21.15.64:0/667789055 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe896800640 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631806106d0 0x5631807eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 -- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 msgr2=0x5631807ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 -- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631806106d0 msgr2=0x5631807eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631806106d0 0x5631807eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 -- 172.21.15.64:0/667789055 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631805db680 con 0x56318032baa0 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe895e00640 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:29.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe88d400640 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fe8800f8640 tx=0x7fe8800056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a808e9f92258780 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe886000640 1 -- 172.21.15.64:0/667789055 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880101f90 con 0x56318032baa0 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe886000640 1 -- 172.21.15.64:0/667789055 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8800f7b80 con 0x56318032baa0 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe886000640 1 -- 172.21.15.64:0/667789055 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800f8000 con 0x56318032baa0 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- 172.21.15.64:0/667789055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 msgr2=0x5631807ee940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fe8800f8640 tx=0x7fe8800056b0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- 172.21.15.64:0/667789055 shutdown_connections 2024-09-21T07:33:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631806106d0 0x5631807eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56318032baa0 0x5631807ee940 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 --2- 172.21.15.64:0/667789055 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563180267890 0x5631807ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- 172.21.15.64:0/667789055 >> 172.21.15.64:0/667789055 conn(0x56318023b5c0 msgr2=0x56318078efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- 172.21.15.64:0/667789055 shutdown_connections 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- 172.21.15.64:0/667789055 wait complete. 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.567+0000 7fe8a4630000 1 -- start start 2024-09-21T07:33:29.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 Processor -- start 2024-09-21T07:33:29.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563180267890 0x5631807f2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56318032baa0 0x5631807f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe898204910 con 0x5631806106d0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe898204310 con 0x563180267890 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563180243680 con 0x56318032baa0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 10 client.0 _ll_register_callbacks cb 0x7fe880005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46576/0 (socket says 172.21.15.64:46576) 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 -- 172.21.15.64:0/3184970053 learned_addr learned my addr 172.21.15.64:0/3184970053 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe895e00640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563180267890 0x5631807f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe88d400640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56318032baa0 0x5631807f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 -- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56318032baa0 msgr2=0x5631807f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56318032baa0 0x5631807f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 -- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563180267890 msgr2=0x5631807f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563180267890 0x5631807f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 -- 172.21.15.64:0/3184970053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631805480b0 con 0x5631806106d0 2024-09-21T07:33:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe896800640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fe890014ca0 tx=0x7fe8900049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46887689381bad8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89001b040 con 0x5631806106d0 2024-09-21T07:33:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fe89002ec80 con 0x5631806106d0 2024-09-21T07:33:29.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8800f7b80 con 0x5631806106d0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe890015400 con 0x5631806106d0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 10 client.9447 fetch_fsmap learned FSMap version 112 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x563180514610 con 0x5631806106d0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8800f7b80 con 0x5631806106d0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe89002b070 con 0x5631806106d0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 10 client.9447 fetch_fsmap finished waiting for FSMap version 112 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 10 client.9447 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 20 client.9447 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x56318020e990 0x563180733be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 4 client.9447 mds_command: new command op to 9111 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.571+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 --> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56318058c5b0 con 0x56318020e990 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe895e00640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x56318020e990 0x563180733be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe895e00640 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x56318020e990 0x563180733be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5808f8fd0a02d108 server_cookie=ba4b455a5e42ecf in_seq=0 out_seq=0 2024-09-21T07:33:29.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe87b400640 10 client.9447 ms_handle_connect on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe87b400640 1 -- 172.21.15.64:0/3184970053 <== mds.0 v2:172.21.15.64:6832/2961655138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x56318058c5b0 con 0x56318020e990 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe87b400640 10 client.9447 handle_command_reply: tid=0 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 client.9447 shutdown 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 msgr2=0x5631807f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fe890014ca0 tx=0x7fe8900049b0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 shutdown_connections 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:6832/2961655138,v1:172.21.15.64:6834/2961655138] conn(0x56318020e990 0x563180733be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5631806106d0 0x5631807f30d0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56318032baa0 0x5631807f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 --2- 172.21.15.64:0/3184970053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563180267890 0x5631807f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 >> 172.21.15.64:0/3184970053 conn(0x56318023b5c0 msgr2=0x56318073e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe87b400640 0 client.9447 ms_handle_reset on v2:172.21.15.64:6832/2961655138 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 shutdown_connections 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 1 -- 172.21.15.64:0/3184970053 wait complete. 2024-09-21T07:33:29.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe8a4630000 20 client.9447 trim_cache size 0 max 16384 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "79bce7d5-835e-4615-a2fe-692ab9a13694": { 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:33:17.340035+0000", 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:33:29.577 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:33:29.578 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:29.578 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:29.578 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:29.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 msgr2=0x7fe874075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 0x7fe874075710 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe8981fbf00 tx=0x7fe8900019e0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 msgr2=0x7fe89809ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe880009790 tx=0x7fe880004040 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 shutdown_connections 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe874073200 0x7fe874075710 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89815a1c0 0x7fe89809d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe898159db0 0x7fe89809ceb0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 --2- 172.21.15.64:0/2195265226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8980b2120 0x7fe89814a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 >> 172.21.15.64:0/2195265226 conn(0x7fe8980ccbe0 msgr2=0x7fe898159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 shutdown_connections 2024-09-21T07:33:29.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.575+0000 7fe89ce00640 1 -- 172.21.15.64:0/2195265226 wait complete. 2024-09-21T07:33:29.594 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:33:29.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- 172.21.15.64:0/4175842239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 msgr2=0x7f6b58073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 --2- 172.21.15.64:0/4175842239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58073600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009840 tx=0x7f6b4001c740 comp rx=0 tx=0).stop 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- 172.21.15.64:0/4175842239 shutdown_connections 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 --2- 172.21.15.64:0/4175842239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58073600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 --2- 172.21.15.64:0/4175842239 >> v2:172.21.15.90:3300/0 conn(0x7f6b580cf8b0 0x7f6b5806d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- 172.21.15.64:0/4175842239 >> 172.21.15.64:0/4175842239 conn(0x7f6b580d0de0 msgr2=0x7f6b580d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- 172.21.15.64:0/4175842239 shutdown_connections 2024-09-21T07:33:29.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- 172.21.15.64:0/4175842239 wait complete. 2024-09-21T07:33:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 Processor -- start 2024-09-21T07:33:29.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.759+0000 7f6b5e800640 1 -- start start 2024-09-21T07:33:29.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 0x7f6b580aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580c5cb0 con 0x7f6b58073b40 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5816a260 con 0x7f6b580cf8b0 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b58159950 con 0x7f6b5806d560 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46590/0 (socket says 172.21.15.64:46590) 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 -- 172.21.15.64:0/3033970618 learned_addr learned my addr 172.21.15.64:0/3033970618 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b57400640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b57e00640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 0x7f6b580aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 -- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 msgr2=0x7f6b58158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 -- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 msgr2=0x7f6b580aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 0x7f6b580aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 -- 172.21.15.64:0/3033970618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5815de40 con 0x7f6b58073b40 2024-09-21T07:33:29.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b57e00640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 0x7f6b580aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:29.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4fe00640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009790 tx=0x7f6b40005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400ad070 con 0x7f6b58073b40 2024-09-21T07:33:29.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b400aaaf0 con 0x7f6b58073b40 2024-09-21T07:33:29.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5815a720 con 0x7f6b58073b40 2024-09-21T07:33:29.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400046d0 con 0x7f6b58073b40 2024-09-21T07:33:29.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b58159ba0 con 0x7f6b58073b40 2024-09-21T07:33:29.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.763+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b58073600 con 0x7f6b58073b40 2024-09-21T07:33:29.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.767+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6b400b0070 con 0x7f6b58073b40 2024-09-21T07:33:29.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.767+0000 7f6b4f400640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 0x7f6b34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:29.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.767+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6159+0+0 (secure 0 0 0) 0x7f6b4012ecb0 con 0x7f6b58073b40 2024-09-21T07:33:29.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.767+0000 7f6b57400640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 0x7f6b34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:29.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.767+0000 7f6b57400640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 0x7f6b34075710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009600 tx=0x7f6b480091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:29.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.771+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6b40016330 con 0x7f6b58073b40 2024-09-21T07:33:29.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.983+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b580b5660 con 0x7f6b58073b40 2024-09-21T07:33:29.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.983+0000 7f6b4f400640 1 -- 172.21.15.64:0/3033970618 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f6b400f9a70 con 0x7f6b58073b40 2024-09-21T07:33:29.983 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:29.983 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:29.983 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 msgr2=0x7f6b34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 0x7f6b34075710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009600 tx=0x7f6b480091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 msgr2=0x7f6b580ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009790 tx=0x7f6b40005750 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 shutdown_connections 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b34073200 0x7f6b34075710 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b580cf8b0 0x7f6b580aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b58073b40 0x7f6b580ca110 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 --2- 172.21.15.64:0/3033970618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b5806d560 0x7f6b58158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 >> 172.21.15.64:0/3033970618 conn(0x7f6b580d0de0 msgr2=0x7f6b580b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 shutdown_connections 2024-09-21T07:33:29.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:29.987+0000 7f6b5e800640 1 -- 172.21.15.64:0/3033970618 wait complete. 2024-09-21T07:33:30.005 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:33:30.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:30.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 -- 172.21.15.64:0/2070116435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 msgr2=0x7fb01415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 --2- 172.21.15.64:0/2070116435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb01415b320 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fb004009840 tx=0x7fb00401c6d0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 -- 172.21.15.64:0/2070116435 shutdown_connections 2024-09-21T07:33:30.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 --2- 172.21.15.64:0/2070116435 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0140702b0 0x7fb01415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 --2- 172.21.15.64:0/2070116435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb01415b320 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 -- 172.21.15.64:0/2070116435 >> 172.21.15.64:0/2070116435 conn(0x7fb0140b2ca0 msgr2=0x7fb0140b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:30.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 -- 172.21.15.64:0/2070116435 shutdown_connections 2024-09-21T07:33:30.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.163+0000 7fb01b000640 1 -- 172.21.15.64:0/2070116435 wait complete. 2024-09-21T07:33:30.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 Processor -- start 2024-09-21T07:33:30.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 -- start start 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01415f100 0x7fb014153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 0x7fb0141fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb0140b6900 con 0x7fb0140cd790 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0140b6780 con 0x7fb01415f100 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb01b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb0140b6a80 con 0x7fb0141586a0 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb013e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb013e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46612/0 (socket says 172.21.15.64:46612) 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb013e00640 1 -- 172.21.15.64:0/1251108070 learned_addr learned my addr 172.21.15.64:0/1251108070 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb019000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 0x7fb0141fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.167+0000 7fb00b400640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01415f100 0x7fb014153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 -- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 msgr2=0x7fb0141fc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 0x7fb0141fc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 -- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01415f100 msgr2=0x7fb014153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01415f100 0x7fb014153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 -- 172.21.15.64:0/1251108070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb014154240 con 0x7fb0140cd790 2024-09-21T07:33:30.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb019000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 0x7fb0141fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:30.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb013e00640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb004009790 tx=0x7fb0040a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040b2040 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0040042c0 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0140b2170 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004005020 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0140b2730 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01415f510 con 0x7fb0140cd790 2024-09-21T07:33:30.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0040051c0 con 0x7fb0140cd790 2024-09-21T07:33:30.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.171+0000 7fb010c00640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 0x7faff0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.175+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6159+0+0 (secure 0 0 0) 0x7fb00412e080 con 0x7fb0140cd790 2024-09-21T07:33:30.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.175+0000 7fb00b400640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 0x7faff0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.175+0000 7fb00b400640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 0x7faff0075710 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb01415a960 tx=0x7faffc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.179+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb004016410 con 0x7fb0140cd790 2024-09-21T07:33:30.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb0140b3bb0 con 0x7fb0140cd790 2024-09-21T07:33:30.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb010c00640 1 -- 172.21.15.64:0/1251108070 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fb0040f8ee0 con 0x7fb0140cd790 2024-09-21T07:33:30.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:30.418 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":668,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076772788,"bytes_used":2597748736,"bytes_avail":770496364544,"bytes_total":773094113280,"write_bytes_sec":15992262,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-21T07:33:27.595091+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:30.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 msgr2=0x7faff0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 0x7faff0075710 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb01415a960 tx=0x7faffc009040 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 msgr2=0x7fb014152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb004009790 tx=0x7fb0040a5630 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 shutdown_connections 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faff0073200 0x7faff0075710 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0141586a0 0x7fb0141fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01415f100 0x7fb014153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 --2- 172.21.15.64:0/1251108070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140cd790 0x7fb014152000 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 >> 172.21.15.64:0/1251108070 conn(0x7fb0140b2ca0 msgr2=0x7fb0140b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:30.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 shutdown_connections 2024-09-21T07:33:30.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.419+0000 7fb01b000640 1 -- 172.21.15.64:0/1251108070 wait complete. 2024-09-21T07:33:30.439 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:33:30.439 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:33:30.439 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:33:30.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:33:30.640 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:33:30.640 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:33:30.640 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:30.641 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:30.649 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:30.649 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:30.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.923+0000 7f5ee1600640 1 -- 172.21.15.64:0/3027353041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 msgr2=0x7f5ec00040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.923+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3027353041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5ec00040e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009b30 tx=0x7f5ecc01d250 comp rx=0 tx=0).stop 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.923+0000 7f5edb400640 1 -- 172.21.15.64:0/3027353041 reap_dead start 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- 172.21.15.64:0/3027353041 shutdown_connections 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- 172.21.15.64:0/3027353041 >> 172.21.15.64:0/3027353041 conn(0x7f5edc06d450 msgr2=0x7f5edc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- 172.21.15.64:0/3027353041 shutdown_connections 2024-09-21T07:33:30.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- 172.21.15.64:0/3027353041 wait complete. 2024-09-21T07:33:30.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 Processor -- start 2024-09-21T07:33:30.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- start start 2024-09-21T07:33:30.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc15b150 0x7f5edc15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc1532e0 0x7f5edc1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc168310 con 0x7f5ec0003c90 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc168190 con 0x7f5edc1532e0 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.927+0000 7f5ee1600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc168490 con 0x7f5edc15b150 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46630/0 (socket says 172.21.15.64:46630) 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 -- 172.21.15.64:0/3551253723 learned_addr learned my addr 172.21.15.64:0/3551253723 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ed2000640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc15b150 0x7f5edc15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edb400640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc1532e0 0x7f5edc1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 -- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc15b150 msgr2=0x7f5edc15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc15b150 0x7f5edc15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 -- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc1532e0 msgr2=0x7f5edc1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc1532e0 0x7f5edc1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 -- 172.21.15.64:0/3551253723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc1fd680 con 0x7f5ec0003c90 2024-09-21T07:33:30.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5edaa00640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009b30 tx=0x7f5ecc009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0b2040 con 0x7f5ec0003c90 2024-09-21T07:33:30.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ecc004b80 con 0x7f5ec0003c90 2024-09-21T07:33:30.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc005030 con 0x7f5ec0003c90 2024-09-21T07:33:30.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5edc153c30 con 0x7f5ec0003c90 2024-09-21T07:33:30.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5edc159000 con 0x7f5ec0003c90 2024-09-21T07:33:30.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5edc0b3550 con 0x7f5ec0003c90 2024-09-21T07:33:30.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.931+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5ecc0c0020 con 0x7f5ec0003c90 2024-09-21T07:33:30.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.935+0000 7f5ed3400640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 0x7f5eb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.935+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7f5ecc12f110 con 0x7f5ec0003c90 2024-09-21T07:33:30.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.935+0000 7f5ed2000640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 0x7f5eb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.935+0000 7f5ed2000640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 0x7f5eb8075710 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5edc15c200 tx=0x7f5ec4006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:30.939+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5ecc0c7020 con 0x7f5ec0003c90 2024-09-21T07:33:31.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.123+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5edc06ef20 con 0x7f5ec0003c90 2024-09-21T07:33:31.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ed3400640 1 -- 172.21.15.64:0/3551253723 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v155) ==== 80+0+0 (secure 0 0 0) 0x7f5edc1fd680 con 0x7f5ec0003c90 2024-09-21T07:33:31.125 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:33:31.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 msgr2=0x7f5eb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 0x7f5eb8075710 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5edc15c200 tx=0x7f5ec4006b20 comp rx=0 tx=0).stop 2024-09-21T07:33:31.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 msgr2=0x7f5edc1fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009b30 tx=0x7f5ecc009730 comp rx=0 tx=0).stop 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 shutdown_connections 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5eb8073200 0x7f5eb8075710 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc1532e0 0x7f5edc1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc15b150 0x7f5edc15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 --2- 172.21.15.64:0/3551253723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec0003c90 0x7f5edc1fd140 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 >> 172.21.15.64:0/3551253723 conn(0x7f5edc06d450 msgr2=0x7f5edc06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 shutdown_connections 2024-09-21T07:33:31.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:31.127+0000 7f5ee1600640 1 -- 172.21.15.64:0/3551253723 wait complete. 2024-09-21T07:33:31.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:33:31.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:31.147 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:33:31.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:33:31.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:31.872 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:33:31.881 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:33:31.881 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:33:31.881 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:31.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:33:31.890 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:33:31.890 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:31.890 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:31.936 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:33:31.936 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:33:31.936 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:33:31.937 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:31.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:33:31.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 -- 172.21.15.64:0/488902650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 msgr2=0x7fd7100cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 --2- 172.21.15.64:0/488902650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100cd3b0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fd710074800 tx=0x7fd6f801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 -- 172.21.15.64:0/488902650 shutdown_connections 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 --2- 172.21.15.64:0/488902650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100cd3b0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 --2- 172.21.15.64:0/488902650 >> v2:172.21.15.90:3300/0 conn(0x7fd7100b34a0 0x7fd7100cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 -- 172.21.15.64:0/488902650 >> 172.21.15.64:0/488902650 conn(0x7fd71009b400 msgr2=0x7fd7100d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 -- 172.21.15.64:0/488902650 shutdown_connections 2024-09-21T07:33:32.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.143+0000 7fd716400640 1 -- 172.21.15.64:0/488902650 wait complete. 2024-09-21T07:33:32.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 Processor -- start 2024-09-21T07:33:32.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- start start 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 0x7fd7101660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7100b34a0 0x7fd710155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd710169b60 con 0x7fd7100ccfa0 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101699e0 con 0x7fd7100b18d0 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd710169ce0 con 0x7fd7100b34a0 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46636/0 (socket says 172.21.15.64:46636) 2024-09-21T07:33:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 -- 172.21.15.64:0/1855522340 learned_addr learned my addr 172.21.15.64:0/1855522340 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715000640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 0x7fd7101660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd707e00640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7100b34a0 0x7fd710155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 -- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7100b34a0 msgr2=0x7fd710155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7100b34a0 0x7fd710155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 -- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 msgr2=0x7fd7101660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 0x7fd7101660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 -- 172.21.15.64:0/1855522340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd710166600 con 0x7fd7100ccfa0 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715000640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 0x7fd7101660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:32.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd715a00640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c730 tx=0x7fd70800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708003b80 con 0x7fd7100ccfa0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd708003d20 con 0x7fd7100ccfa0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70800aab0 con 0x7fd7100ccfa0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7101f63a0 con 0x7fd7100ccfa0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101f6660 con 0x7fd7100ccfa0 2024-09-21T07:33:32.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.147+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7101667d0 con 0x7fd7100ccfa0 2024-09-21T07:33:32.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.151+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd70800ac50 con 0x7fd7100ccfa0 2024-09-21T07:33:32.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.151+0000 7fd70d600640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 0x7fd6ec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.151+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7fd708094220 con 0x7fd7100ccfa0 2024-09-21T07:33:32.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.151+0000 7fd715000640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 0x7fd6ec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.151+0000 7fd715000640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 0x7fd6ec075740 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd700005fd0 tx=0x7fd700005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.155+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd7100d2c50 con 0x7fd7100ccfa0 2024-09-21T07:33:32.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.367+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7100b0a00 con 0x7fd7100ccfa0 2024-09-21T07:33:32.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.367+0000 7fd70d600640 1 -- 172.21.15.64:0/1855522340 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7fd70805f070 con 0x7fd7100ccfa0 2024-09-21T07:33:32.368 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:32.368 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:32.368 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 msgr2=0x7fd6ec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 0x7fd6ec075740 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd700005fd0 tx=0x7fd700005f40 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 msgr2=0x7fd7100b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c730 tx=0x7fd70800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 shutdown_connections 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd6ec073230 0x7fd6ec075740 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7100ccfa0 0x7fd7100b5fa0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7100b34a0 0x7fd710155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 --2- 172.21.15.64:0/1855522340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7100b18d0 0x7fd7101660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 >> 172.21.15.64:0/1855522340 conn(0x7fd71009b400 msgr2=0x7fd7100cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 shutdown_connections 2024-09-21T07:33:32.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.371+0000 7fd716400640 1 -- 172.21.15.64:0/1855522340 wait complete. 2024-09-21T07:33:32.391 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:32.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- 172.21.15.64:0/1217697612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b1be0 msgr2=0x7f9b5c0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1217697612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c0b1ff0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cb050 tx=0x7f9b4801c7d0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- 172.21.15.64:0/1217697612 shutdown_connections 2024-09-21T07:33:32.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1217697612 >> v2:172.21.15.90:3300/0 conn(0x7f9b5c0cbcd0 0x7f9b5c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1217697612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c0b1ff0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- 172.21.15.64:0/1217697612 >> 172.21.15.64:0/1217697612 conn(0x7f9b5c0ccbe0 msgr2=0x7f9b5c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- 172.21.15.64:0/1217697612 shutdown_connections 2024-09-21T07:33:32.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- 172.21.15.64:0/1217697612 wait complete. 2024-09-21T07:33:32.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 Processor -- start 2024-09-21T07:33:32.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.551+0000 7f9b63c00640 1 -- start start 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c15cbd0 0x7f9b5c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b4150 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b3fd0 con 0x7f9b5c0b1be0 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5c0b42d0 con 0x7f9b5c15cbd0 2024-09-21T07:33:32.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46656/0 (socket says 172.21.15.64:46656) 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 -- 172.21.15.64:0/1562824794 learned_addr learned my addr 172.21.15.64:0/1562824794 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b61200640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b61c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c15cbd0 0x7f9b5c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 -- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c15cbd0 msgr2=0x7f9b5c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c15cbd0 0x7f9b5c0c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 -- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c0b1be0 msgr2=0x7f9b5c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 -- 172.21.15.64:0/1562824794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c075080 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b5be00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b0040 tx=0x7f9b48005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b480b2040 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b480bb070 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48003600 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5c0c7ed0 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5c0c8170 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.555+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b5c074b10 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.559+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9b480037a0 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.559+0000 7f9b58c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 0x7f9b3c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.559+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7f9b4812e870 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.559+0000 7f9b61200640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 0x7f9b3c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.559+0000 7f9b61200640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 0x7f9b3c075710 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9b50007fd0 tx=0x7f9b50009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.563+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9b480163f0 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.779+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b5c0b1ff0 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.779+0000 7f9b58c00640 1 -- 172.21.15.64:0/1562824794 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f9b480f9070 con 0x7f9b5c0cbcd0 2024-09-21T07:33:32.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:32.779 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:32.779 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 msgr2=0x7f9b3c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 0x7f9b3c075710 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9b50007fd0 tx=0x7f9b50009040 comp rx=0 tx=0).stop 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 msgr2=0x7f9b5c0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b0040 tx=0x7f9b48005d20 comp rx=0 tx=0).stop 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 shutdown_connections 2024-09-21T07:33:32.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9b3c073200 0x7f9b3c075710 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b5c15cbd0 0x7f9b5c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0cbcd0 0x7f9b5c0c8970 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 --2- 172.21.15.64:0/1562824794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b5c0b1be0 0x7f9b5c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 >> 172.21.15.64:0/1562824794 conn(0x7f9b5c0ccbe0 msgr2=0x7f9b5c1578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 shutdown_connections 2024-09-21T07:33:32.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.783+0000 7f9b63c00640 1 -- 172.21.15.64:0/1562824794 wait complete. 2024-09-21T07:33:32.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1115494662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 msgr2=0x7ffbcc0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1115494662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc0b3120 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0cd8c0 tx=0x7ffbb401caa0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1115494662 shutdown_connections 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1115494662 >> v2:172.21.15.90:3300/0 conn(0x7ffbcc0cb2d0 0x7ffbcc0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1115494662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc0b3120 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1115494662 >> 172.21.15.64:0/1115494662 conn(0x7ffbcc0ccbe0 msgr2=0x7ffbcc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1115494662 shutdown_connections 2024-09-21T07:33:32.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1115494662 wait complete. 2024-09-21T07:33:32.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 Processor -- start 2024-09-21T07:33:32.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.963+0000 7ffbd1e00640 1 -- start start 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc0b24e0 0x7ffbcc0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 0x7ffbcc1fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc168030 con 0x7ffbcc0caec0 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc167eb0 con 0x7ffbcc0cb2d0 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc1681b0 con 0x7ffbcc0b24e0 2024-09-21T07:33:32.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46662/0 (socket says 172.21.15.64:46662) 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 -- 172.21.15.64:0/1475110359 learned_addr learned my addr 172.21.15.64:0/1475110359 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbcaa00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc0b24e0 0x7ffbcc0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbcb400640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 0x7ffbcc1fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 -- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc0b24e0 msgr2=0x7ffbcc0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc0b24e0 0x7ffbcc0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 -- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 msgr2=0x7ffbcc1fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 0x7ffbcc1fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 -- 172.21.15.64:0/1475110359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc09c660 con 0x7ffbcc0caec0 2024-09-21T07:33:32.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbcb400640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 0x7ffbcc1fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc2000640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4000f90 tx=0x7ffbb4009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40bb070 con 0x7ffbcc0caec0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbb4004e00 con 0x7ffbcc0caec0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40b2040 con 0x7ffbcc0caec0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc09c940 con 0x7ffbcc0caec0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc0c9650 con 0x7ffbcc0caec0 2024-09-21T07:33:32.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.967+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0c6aa0 con 0x7ffbcc0caec0 2024-09-21T07:33:32.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.971+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffbb4005230 con 0x7ffbcc0caec0 2024-09-21T07:33:32.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.971+0000 7ffbc3e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 0x7ffba8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.971+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7ffbb412dc90 con 0x7ffbcc0caec0 2024-09-21T07:33:32.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.971+0000 7ffbcaa00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 0x7ffba8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.971+0000 7ffbcaa00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 0x7ffba8075740 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc007990 tx=0x7ffbbc001da0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:32.975+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffbb40f3290 con 0x7ffbcc0caec0 2024-09-21T07:33:33.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbcc0ca7b0 con 0x7ffbcc0caec0 2024-09-21T07:33:33.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbc3e00640 1 -- 172.21.15.64:0/1475110359 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+17061 (secure 0 0 0) 0x7ffbb4101020 con 0x7ffbcc0caec0 2024-09-21T07:33:33.154 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:33.154 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":155,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:30.721070+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:46.878179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:47.893039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:33.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 msgr2=0x7ffba8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 0x7ffba8075740 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc007990 tx=0x7ffbbc001da0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 msgr2=0x7ffbcc1f87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4000f90 tx=0x7ffbb4009280 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 shutdown_connections 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffba8073230 0x7ffba8075740 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc0cb2d0 0x7ffbcc1fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbcc0caec0 0x7ffbcc1f87a0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 --2- 172.21.15.64:0/1475110359 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc0b24e0 0x7ffbcc0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 >> 172.21.15.64:0/1475110359 conn(0x7ffbcc0ccbe0 msgr2=0x7ffbcc15a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 shutdown_connections 2024-09-21T07:33:33.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.155+0000 7ffbd1e00640 1 -- 172.21.15.64:0/1475110359 wait complete. 2024-09-21T07:33:33.177 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:33:33.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:33.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 -- 172.21.15.64:0/3610763511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fc4004810 msgr2=0x7f9fc4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3610763511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fc4004810 0x7f9fc4004c20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8006f60 tx=0x7f9fc801cec0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe1800640 1 -- 172.21.15.64:0/3610763511 reap_dead start 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 -- 172.21.15.64:0/3610763511 shutdown_connections 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 -- 172.21.15.64:0/3610763511 >> 172.21.15.64:0/3610763511 conn(0x7f9fdc0d0de0 msgr2=0x7f9fdc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 -- 172.21.15.64:0/3610763511 shutdown_connections 2024-09-21T07:33:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.335+0000 7f9fe3800640 1 -- 172.21.15.64:0/3610763511 wait complete. 2024-09-21T07:33:33.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 Processor -- start 2024-09-21T07:33:33.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- start start 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 0x7f9fdc157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 0x7f9fdc1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0c59a0 con 0x7f9fdc157d30 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0c5820 con 0x7f9fc4004810 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0c5b20 con 0x7f9fdc15dee0 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46690/0 (socket says 172.21.15.64:46690) 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 -- 172.21.15.64:0/3790619109 learned_addr learned my addr 172.21.15.64:0/3790619109 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe1800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 0x7f9fdc1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe0e00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 0x7f9fdc157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 -- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 msgr2=0x7f9fdc1f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 0x7f9fdc1f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 -- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 msgr2=0x7f9fdc157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 0x7f9fdc157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 -- 172.21.15.64:0/3790619109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc157b40 con 0x7f9fdc157d30 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe0e00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 0x7f9fdc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe1800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 0x7f9fdc1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:33.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fdbe00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8000c10 tx=0x7f9fc8001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80060c0 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fc8001440 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8003600 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc15e2f0 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.339+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc1f5880 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.343+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc0c4af0 con 0x7f9fdc157d30 2024-09-21T07:33:33.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.343+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9fc80c0060 con 0x7f9fdc157d30 2024-09-21T07:33:33.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.343+0000 7f9fd8c00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 0x7f9fbc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.347+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7f9fc812ed60 con 0x7f9fdc157d30 2024-09-21T07:33:33.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.347+0000 7f9fe0e00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 0x7f9fbc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.347+0000 7f9fe0e00640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 0x7f9fbc075740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000c10 tx=0x7f9fd0003ef0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.347+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9fdc15e2f0 con 0x7f9fdc157d30 2024-09-21T07:33:33.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fdc0b18e0 con 0x7f9fdc157d30 2024-09-21T07:33:33.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fd8c00640 1 -- 172.21.15.64:0/3790619109 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7f9fc8016c70 con 0x7f9fdc157d30 2024-09-21T07:33:33.562 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:33.562 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:33.563 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:33.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 msgr2=0x7f9fbc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 0x7f9fbc075740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000c10 tx=0x7f9fd0003ef0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 msgr2=0x7f9fdc15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8000c10 tx=0x7f9fc8001c30 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 shutdown_connections 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9fbc073230 0x7f9fbc075740 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fdc15dee0 0x7f9fdc1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fdc157d30 0x7f9fdc15d9a0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 --2- 172.21.15.64:0/3790619109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fc4004810 0x7f9fdc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 >> 172.21.15.64:0/3790619109 conn(0x7f9fdc0d0de0 msgr2=0x7f9fdc0cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 shutdown_connections 2024-09-21T07:33:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.563+0000 7f9fe3800640 1 -- 172.21.15.64:0/3790619109 wait complete. 2024-09-21T07:33:33.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:33.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 -- 172.21.15.64:0/2134368548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc006e6e0 msgr2=0x7fddc006eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 --2- 172.21.15.64:0/2134368548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc006e6e0 0x7fddc006eaf0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009bc0 tx=0x7fddb801cba0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 -- 172.21.15.64:0/2134368548 shutdown_connections 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 --2- 172.21.15.64:0/2134368548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc006e6e0 0x7fddc006eaf0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 --2- 172.21.15.64:0/2134368548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc00b4400 0x7fddc006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 -- 172.21.15.64:0/2134368548 >> 172.21.15.64:0/2134368548 conn(0x7fddc006d530 msgr2=0x7fddc00d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 -- 172.21.15.64:0/2134368548 shutdown_connections 2024-09-21T07:33:33.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.747+0000 7fddc4e00640 1 -- 172.21.15.64:0/2134368548 wait complete. 2024-09-21T07:33:33.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 Processor -- start 2024-09-21T07:33:33.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- start start 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 0x7fddc0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 0x7fddc015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fddc016c3b0 con 0x7fddc0156a20 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddc00d0af0 con 0x7fddc006e6e0 2024-09-21T07:33:33.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fddc016c530 con 0x7fddc0163000 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46712/0 (socket says 172.21.15.64:46712) 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 -- 172.21.15.64:0/3948002706 learned_addr learned my addr 172.21.15.64:0/3948002706 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 -- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 msgr2=0x7fddc015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbd400640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 0x7fddc015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbde00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 0x7fddc0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 0x7fddc015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 -- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 msgr2=0x7fddc0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 0x7fddc0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 -- 172.21.15.64:0/3948002706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc0157170 con 0x7fddc0156a20 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbd400640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 0x7fddc015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbde00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 0x7fddc0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddbe800640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fddb801a7d0 tx=0x7fddb8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80bb070 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc0157450 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddb8004c50 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80b2040 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.751+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc00b39e0 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.755+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc0157970 con 0x7fddc0156a20 2024-09-21T07:33:33.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.755+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fddb80be070 con 0x7fddc0156a20 2024-09-21T07:33:33.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.755+0000 7fddb6000640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.755+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7fddb812dea0 con 0x7fddc0156a20 2024-09-21T07:33:33.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.755+0000 7fddbde00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.759+0000 7fddbde00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fddb0001230 tx=0x7fddb0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.759+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fddc0157970 con 0x7fddc0156a20 2024-09-21T07:33:33.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddc006eaf0 con 0x7fddc0156a20 2024-09-21T07:33:33.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddb6000640 1 -- 172.21.15.64:0/3948002706 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5230 (secure 0 0 0) 0x7fddb8016790 con 0x7fddc0156a20 2024-09-21T07:33:33.970 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:33.970 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":112,"btime":"2024-09-21T07:32:52:534769+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:32:48.930852+0000","modified":"2024-09-21T07:32:51.965240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9111":{"gid":9111,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6834/2961655138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2961655138},{"type":"v1","addr":"172.21.15.64:6834","nonce":2961655138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9111,"qdb_cluster":[9111]},"id":10}]} 2024-09-21T07:33:33.970 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 112 2024-09-21T07:33:33.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 msgr2=0x7fdda0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fddb0001230 tx=0x7fddb0009040 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 msgr2=0x7fddc015a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fddb801a7d0 tx=0x7fddb8003f40 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 shutdown_connections 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddc0156a20 0x7fddc015a5f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddc0163000 0x7fddc015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 --2- 172.21.15.64:0/3948002706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddc006e6e0 0x7fddc0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 >> 172.21.15.64:0/3948002706 conn(0x7fddc006d530 msgr2=0x7fddc015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 shutdown_connections 2024-09-21T07:33:33.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:33.971+0000 7fddc4e00640 1 -- 172.21.15.64:0/3948002706 wait complete. 2024-09-21T07:33:33.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.151+0000 7fb25b200640 1 -- 172.21.15.64:0/4011219648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 msgr2=0x7fb2540cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.151+0000 7fb25b200640 1 --2- 172.21.15.64:0/4011219648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2540cbe20 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009840 tx=0x7fb23c01c760 comp rx=0 tx=0).stop 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- 172.21.15.64:0/4011219648 shutdown_connections 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 --2- 172.21.15.64:0/4011219648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb254166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 --2- 172.21.15.64:0/4011219648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2540cbe20 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- 172.21.15.64:0/4011219648 >> 172.21.15.64:0/4011219648 conn(0x7fb2540b2ca0 msgr2=0x7fb2540b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- 172.21.15.64:0/4011219648 shutdown_connections 2024-09-21T07:33:34.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- 172.21.15.64:0/4011219648 wait complete. 2024-09-21T07:33:34.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 Processor -- start 2024-09-21T07:33:34.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- start start 2024-09-21T07:33:34.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 0x7fb2541589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb25406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb254169ad0 con 0x7fb2540cba10 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb254169950 con 0x7fb25415fca0 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.155+0000 7fb25b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb254169c50 con 0x7fb254164200 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46728/0 (socket says 172.21.15.64:46728) 2024-09-21T07:33:34.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 -- 172.21.15.64:0/928577551 learned_addr learned my addr 172.21.15.64:0/928577551 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb259200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb25406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 -- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 msgr2=0x7fb25406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb24be00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 0x7fb2541589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb25406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 -- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 msgr2=0x7fb2541589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 0x7fb2541589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 -- 172.21.15.64:0/928577551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2540b6320 con 0x7fb2540cba10 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb259200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb25406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb24be00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 0x7fb2541589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:34.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb253e00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c730 tx=0x7fb24400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244016020 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb24400a950 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb254159580 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ada0 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541f9280 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2540cbe20 con 0x7fb2540cba10 2024-09-21T07:33:34.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.159+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb244019020 con 0x7fb2540cba10 2024-09-21T07:33:34.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.163+0000 7fb250c00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 0x7fb230075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.163+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7fb244094360 con 0x7fb2540cba10 2024-09-21T07:33:34.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.163+0000 7fb24be00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 0x7fb230075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.163+0000 7fb24be00640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 0x7fb230075710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0af000 tx=0x7fb23c01afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.167+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb244020020 con 0x7fb2540cba10 2024-09-21T07:33:34.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.343+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb254074ab0 con 0x7fb2540cba10 2024-09-21T07:33:34.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb250c00640 1 -- 172.21.15.64:0/928577551 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+17061 (secure 0 0 0) 0x7fb2540b4000 con 0x7fb2540cba10 2024-09-21T07:33:34.346 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:34.346 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":155,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:30.721070+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:46.878179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:47.893039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:34.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 msgr2=0x7fb230075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 0x7fb230075710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0af000 tx=0x7fb23c01afa0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 msgr2=0x7fb2541fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c730 tx=0x7fb24400cbf0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 shutdown_connections 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb230073200 0x7fb230075710 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb254164200 0x7fb25406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25415fca0 0x7fb2541589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 --2- 172.21.15.64:0/928577551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2540cba10 0x7fb2541fcab0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 >> 172.21.15.64:0/928577551 conn(0x7fb2540b2ca0 msgr2=0x7fb25415b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 shutdown_connections 2024-09-21T07:33:34.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.347+0000 7fb25b200640 1 -- 172.21.15.64:0/928577551 wait complete. 2024-09-21T07:33:34.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:33:34.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- 172.21.15.64:0/2462874586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 msgr2=0x7f2630004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 --2- 172.21.15.64:0/2462874586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f2630004c20 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f264c0728d0 tx=0x7f263401f600 comp rx=0 tx=0).stop 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2651200640 1 -- 172.21.15.64:0/2462874586 reap_dead start 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- 172.21.15.64:0/2462874586 shutdown_connections 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- 172.21.15.64:0/2462874586 >> 172.21.15.64:0/2462874586 conn(0x7f264c06d450 msgr2=0x7f264c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- 172.21.15.64:0/2462874586 shutdown_connections 2024-09-21T07:33:34.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- 172.21.15.64:0/2462874586 wait complete. 2024-09-21T07:33:34.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 Processor -- start 2024-09-21T07:33:34.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.531+0000 7f2653200640 1 -- start start 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c0b0960 0x7f264c15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 0x7f264c073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f264c15f200 con 0x7f2630004810 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f264c15f080 con 0x7f264c073430 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f264c0cfb30 con 0x7f264c0b0960 2024-09-21T07:33:34.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46748/0 (socket says 172.21.15.64:46748) 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 -- 172.21.15.64:0/3750385286 learned_addr learned my addr 172.21.15.64:0/3750385286 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2651200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 0x7f264c073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2643e00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c0b0960 0x7f264c15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 -- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c0b0960 msgr2=0x7f264c15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c0b0960 0x7f264c15dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 -- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 msgr2=0x7f264c073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 0x7f264c073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 -- 172.21.15.64:0/3750385286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c073d80 con 0x7f2630004810 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2651200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 0x7f264c073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:34.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f264be00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f263c0119b0 tx=0x7f263c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00fd30 con 0x7f2630004810 2024-09-21T07:33:34.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f263c005020 con 0x7f2630004810 2024-09-21T07:33:34.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c005470 con 0x7f2630004810 2024-09-21T07:33:34.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c0b1100 con 0x7f2630004810 2024-09-21T07:33:34.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c0b16c0 con 0x7f2630004810 2024-09-21T07:33:34.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.535+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c0ce8e0 con 0x7f2630004810 2024-09-21T07:33:34.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.539+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f263c0047b0 con 0x7f2630004810 2024-09-21T07:33:34.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.539+0000 7f2648c00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 0x7f2628075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.539+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6159+0+0 (secure 0 0 0) 0x7f263c095180 con 0x7f2630004810 2024-09-21T07:33:34.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.539+0000 7f2643e00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 0x7f2628075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.539+0000 7f2643e00640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 0x7f2628075710 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f26340b0000 tx=0x7f26340b3040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.543+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f264c073d80 con 0x7f2630004810 2024-09-21T07:33:34.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.759+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f264c0ad750 con 0x7f2630004810 2024-09-21T07:33:34.759 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:33:34.759+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:33:34.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.763+0000 7f2648c00640 1 -- 172.21.15.64:0/3750385286 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) ==== 161+0+0 (secure 0 0 0) 0x7f263c05ffd0 con 0x7f2630004810 2024-09-21T07:33:34.763 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:33:34.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 msgr2=0x7f2628075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 0x7f2628075710 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f26340b0000 tx=0x7f26340b3040 comp rx=0 tx=0).stop 2024-09-21T07:33:34.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 msgr2=0x7f264c0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f263c0119b0 tx=0x7f263c011e70 comp rx=0 tx=0).stop 2024-09-21T07:33:34.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 shutdown_connections 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2628073200 0x7f2628075710 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f264c073430 0x7f264c073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f264c0b0960 0x7f264c15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 --2- 172.21.15.64:0/3750385286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2630004810 0x7f264c0c3fe0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 >> 172.21.15.64:0/3750385286 conn(0x7f264c06d450 msgr2=0x7f264c0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 shutdown_connections 2024-09-21T07:33:34.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.767+0000 7f2653200640 1 -- 172.21.15.64:0/3750385286 wait complete. 2024-09-21T07:33:34.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:33:34.908 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:33:34.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 -- 172.21.15.64:0/280603679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cec004d50 msgr2=0x7f7cec005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 --2- 172.21.15.64:0/280603679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cec004d50 0x7f7cec005160 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009ee0 tx=0x7f7d0001d610 comp rx=0 tx=0).stop 2024-09-21T07:33:34.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0a800640 1 -- 172.21.15.64:0/280603679 reap_dead start 2024-09-21T07:33:34.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 -- 172.21.15.64:0/280603679 shutdown_connections 2024-09-21T07:33:34.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 -- 172.21.15.64:0/280603679 >> 172.21.15.64:0/280603679 conn(0x7f7d040d0c10 msgr2=0x7f7d040d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 -- 172.21.15.64:0/280603679 shutdown_connections 2024-09-21T07:33:34.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.955+0000 7f7d0c800640 1 -- 172.21.15.64:0/280603679 wait complete. 2024-09-21T07:33:34.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 Processor -- start 2024-09-21T07:33:34.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 -- start start 2024-09-21T07:33:34.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cec004d50 0x7f7d04151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d04156f50 0x7f7d040b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415bfc0 con 0x7f7d040b04f0 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415be40 con 0x7f7d04156f50 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0415c140 con 0x7f7cec004d50 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46786/0 (socket says 172.21.15.64:46786) 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 -- 172.21.15.64:0/3273412247 learned_addr learned my addr 172.21.15.64:0/3273412247 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d0a800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d04156f50 0x7f7d040b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09e00640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cec004d50 0x7f7d04151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 -- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cec004d50 msgr2=0x7f7d04151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cec004d50 0x7f7d04151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 -- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d04156f50 msgr2=0x7f7d040b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.959+0000 7f7d09400640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d04156f50 0x7f7d040b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7d09400640 1 -- 172.21.15.64:0/3273412247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d040ad870 con 0x7f7d040b04f0 2024-09-21T07:33:34.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7d09400640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4011ab0 tx=0x7f7cf4011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4012450 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cf4016070 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d040afb60 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4012940 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d040b47b0 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d041f6480 con 0x7f7d040b04f0 2024-09-21T07:33:34.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.963+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7cf4018030 con 0x7f7d040b04f0 2024-09-21T07:33:34.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.967+0000 7f7cfe000640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 0x7f7ce8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.967+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6245+0+0 (secure 0 0 0) 0x7f7cf4094e40 con 0x7f7d040b04f0 2024-09-21T07:33:34.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.967+0000 7f7d09e00640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 0x7f7ce8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.967+0000 7f7d09e00640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 0x7f7ce8075740 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8000fc0 tx=0x7f7cf80011a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:34.971+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7cf405f5e0 con 0x7f7d040b04f0 2024-09-21T07:33:35.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.187+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7d040736a0 con 0x7f7d040b04f0 2024-09-21T07:33:35.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.771+0000 7f7cfe000640 1 -- 172.21.15.64:0/3273412247 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v114) ==== 104+0+0 (secure 0 0 0) 0x7f7cf4064010 con 0x7f7d040b04f0 2024-09-21T07:33:35.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 msgr2=0x7f7ce8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 0x7f7ce8075740 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8000fc0 tx=0x7f7cf80011a0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 msgr2=0x7f7d040b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4011ab0 tx=0x7f7cf4011f70 comp rx=0 tx=0).stop 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 shutdown_connections 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7ce8073230 0x7f7ce8075740 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d04156f50 0x7f7d040b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d040b04f0 0x7f7d040b2700 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 --2- 172.21.15.64:0/3273412247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cec004d50 0x7f7d04151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 >> 172.21.15.64:0/3273412247 conn(0x7f7d040d0c10 msgr2=0x7f7d040d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:35.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 shutdown_connections 2024-09-21T07:33:35.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.775+0000 7f7d0c800640 1 -- 172.21.15.64:0/3273412247 wait complete. 2024-09-21T07:33:35.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:33:35.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 -- 172.21.15.64:0/3037760389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 msgr2=0x7f0a3c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 --2- 172.21.15.64:0/3037760389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cd660 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0ce440 tx=0x7f0a3401caf0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 -- 172.21.15.64:0/3037760389 shutdown_connections 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 --2- 172.21.15.64:0/3037760389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cd660 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 --2- 172.21.15.64:0/3037760389 >> v2:172.21.15.90:3300/0 conn(0x7f0a3c0cf080 0x7f0a3c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 -- 172.21.15.64:0/3037760389 >> 172.21.15.64:0/3037760389 conn(0x7f0a3c0d2140 msgr2=0x7f0a3c0d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 -- 172.21.15.64:0/3037760389 shutdown_connections 2024-09-21T07:33:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.963+0000 7f0a42000640 1 -- 172.21.15.64:0/3037760389 wait complete. 2024-09-21T07:33:35.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 Processor -- start 2024-09-21T07:33:35.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 -- start start 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3c0cf080 0x7f0a3c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a3c0d0ca0 0x7f0a3c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c169cc0 con 0x7f0a3c0cd250 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c169b40 con 0x7f0a3c0cf080 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a42000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c169e40 con 0x7f0a3c0d0ca0 2024-09-21T07:33:35.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a40c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a40c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55854/0 (socket says 172.21.15.64:55854) 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.967+0000 7f0a40c00640 1 -- 172.21.15.64:0/986195758 learned_addr learned my addr 172.21.15.64:0/986195758 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 -- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a3c0d0ca0 msgr2=0x7f0a3c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a3c0d0ca0 0x7f0a3c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 -- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3c0cf080 msgr2=0x7f0a3c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3c0cf080 0x7f0a3c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 -- 172.21.15.64:0/986195758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0cc150 con 0x7f0a3c0cd250 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a40c00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f0a30001ec0 tx=0x7f0a3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30017070 con 0x7f0a3c0cd250 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a30003600 con 0x7f0a3c0cd250 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30003a50 con 0x7f0a3c0cd250 2024-09-21T07:33:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c164f40 con 0x7f0a3c0cd250 2024-09-21T07:33:35.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c06df00 con 0x7f0a3c0cd250 2024-09-21T07:33:35.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3c0cd660 con 0x7f0a3c0cd250 2024-09-21T07:33:35.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.971+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0a3001a070 con 0x7f0a3c0cd250 2024-09-21T07:33:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.975+0000 7f0a38c00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 0x7f0a1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.975+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6245+0+0 (secure 0 0 0) 0x7f0a30093830 con 0x7f0a3c0cd250 2024-09-21T07:33:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.975+0000 7f0a3be00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 0x7f0a1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.975+0000 7f0a3be00640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 0x7f0a1c075710 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0a280058d0 tx=0x7f0a28005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:35.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:35.979+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0a3005e590 con 0x7f0a3c0cd250 2024-09-21T07:33:36.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.155+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a3c0b2a00 con 0x7f0a3c0cd250 2024-09-21T07:33:36.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a38c00640 1 -- 172.21.15.64:0/986195758 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7f0a3005de90 con 0x7f0a3c0cd250 2024-09-21T07:33:36.775 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 msgr2=0x7f0a1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 0x7f0a1c075710 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0a280058d0 tx=0x7f0a28005860 comp rx=0 tx=0).stop 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 msgr2=0x7f0a3c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f0a30001ec0 tx=0x7f0a3000c890 comp rx=0 tx=0).stop 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 shutdown_connections 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a1c073200 0x7f0a1c075710 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a3c0d0ca0 0x7f0a3c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3c0cf080 0x7f0a3c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 --2- 172.21.15.64:0/986195758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a3c0cd250 0x7f0a3c0cbc10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.775+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 >> 172.21.15.64:0/986195758 conn(0x7f0a3c0d2140 msgr2=0x7f0a3c0b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:36.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.779+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 shutdown_connections 2024-09-21T07:33:36.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.779+0000 7f0a42000640 1 -- 172.21.15.64:0/986195758 wait complete. 2024-09-21T07:33:36.801 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:33:36.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- 172.21.15.64:0/2659789019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841594c0 msgr2=0x7f9a840aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2659789019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841594c0 0x7f9a840aee20 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f9a84073fa0 tx=0x7f9a6c01c820 comp rx=0 tx=0).stop 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- 172.21.15.64:0/2659789019 shutdown_connections 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2659789019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841594c0 0x7f9a840aee20 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- 172.21.15.64:0/2659789019 >> 172.21.15.64:0/2659789019 conn(0x7f9a840d0170 msgr2=0x7f9a840d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- 172.21.15.64:0/2659789019 shutdown_connections 2024-09-21T07:33:36.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- 172.21.15.64:0/2659789019 wait complete. 2024-09-21T07:33:36.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 Processor -- start 2024-09-21T07:33:36.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.971+0000 7f9a8b200640 1 -- start start 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a8406ec70 0x7f9a840b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a840af360 0x7f9a841669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8416a250 con 0x7f9a841573d0 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8416a0d0 con 0x7f9a840af360 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8416a3d0 con 0x7f9a8406ec70 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55862/0 (socket says 172.21.15.64:55862) 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 -- 172.21.15.64:0/2776937619 learned_addr learned my addr 172.21.15.64:0/2776937619 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a7be00640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a840af360 0x7f9a841669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a83e00640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a8406ec70 0x7f9a840b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 -- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a8406ec70 msgr2=0x7f9a840b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a8406ec70 0x7f9a840b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 -- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a840af360 msgr2=0x7f9a841669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a840af360 0x7f9a841669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 -- 172.21.15.64:0/2776937619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a840b1e30 con 0x7f9a841573d0 2024-09-21T07:33:36.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a89200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00cb10 tx=0x7f9a7c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:36.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c016020 con 0x7f9a841573d0 2024-09-21T07:33:36.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a7c00ce50 con 0x7f9a841573d0 2024-09-21T07:33:36.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00adc0 con 0x7f9a841573d0 2024-09-21T07:33:36.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a840b2110 con 0x7f9a841573d0 2024-09-21T07:33:36.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a840b26d0 con 0x7f9a841573d0 2024-09-21T07:33:36.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.975+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a840aee20 con 0x7f9a841573d0 2024-09-21T07:33:36.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.979+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9a7c019020 con 0x7f9a841573d0 2024-09-21T07:33:36.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.979+0000 7f9a80c00640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 0x7f9a60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.979+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5807+0+0 (secure 0 0 0) 0x7f9a7c0940f0 con 0x7f9a841573d0 2024-09-21T07:33:36.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.979+0000 7f9a83e00640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 0x7f9a60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.979+0000 7f9a83e00640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 0x7f9a60075710 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007fd0 tx=0x7f9a74009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:36.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:36.983+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9a7c020030 con 0x7f9a841573d0 2024-09-21T07:33:37.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.159+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a840b60f0 con 0x7f9a841573d0 2024-09-21T07:33:37.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.783+0000 7f9a80c00640 1 -- 172.21.15.64:0/2776937619 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7f9a7c05e9c0 con 0x7f9a841573d0 2024-09-21T07:33:37.784 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:33:37.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 msgr2=0x7f9a60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:37.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 0x7f9a60075710 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007fd0 tx=0x7f9a74009040 comp rx=0 tx=0).stop 2024-09-21T07:33:37.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 msgr2=0x7f9a84166f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:37.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00cb10 tx=0x7f9a7c00cc00 comp rx=0 tx=0).stop 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 shutdown_connections 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9a60073200 0x7f9a60075710 secure :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007fd0 tx=0x7f9a74009040 comp rx=0 tx=0).stop 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a841573d0 0x7f9a84166f00 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a840af360 0x7f9a841669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 --2- 172.21.15.64:0/2776937619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a8406ec70 0x7f9a840b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 >> 172.21.15.64:0/2776937619 conn(0x7f9a840d0170 msgr2=0x7f9a8415f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 shutdown_connections 2024-09-21T07:33:37.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.787+0000 7f9a8b200640 1 -- 172.21.15.64:0/2776937619 wait complete. 2024-09-21T07:33:37.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:33:37.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- 172.21.15.64:0/3697979432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5400b3910 msgr2=0x7fb5400ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:37.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 --2- 172.21.15.64:0/3697979432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5400b3910 0x7fb5400ce1f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb528009840 tx=0x7fb52801c820 comp rx=0 tx=0).stop 2024-09-21T07:33:37.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- 172.21.15.64:0/3697979432 shutdown_connections 2024-09-21T07:33:37.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 --2- 172.21.15.64:0/3697979432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5400b3910 0x7fb5400ce1f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:37.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 --2- 172.21.15.64:0/3697979432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb54009df30 0x7fb5400b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:37.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- 172.21.15.64:0/3697979432 >> 172.21.15.64:0/3697979432 conn(0x7fb54006d450 msgr2=0x7fb5400d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:37.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- 172.21.15.64:0/3697979432 shutdown_connections 2024-09-21T07:33:37.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- 172.21.15.64:0/3697979432 wait complete. 2024-09-21T07:33:37.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 Processor -- start 2024-09-21T07:33:37.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.995+0000 7fb546000640 1 -- start start 2024-09-21T07:33:37.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb54009df30 0x7fb54014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5400b3910 0x7fb5400cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb540169160 con 0x7fb5400ce730 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb540168fe0 con 0x7fb54009df30 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb5401692e0 con 0x7fb5400b3910 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55876/0 (socket says 172.21.15.64:55876) 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 -- 172.21.15.64:0/208908953 learned_addr learned my addr 172.21.15.64:0/208908953 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb536a00640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5400b3910 0x7fb5400cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53f400640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb54009df30 0x7fb54014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 -- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5400b3910 msgr2=0x7fb5400cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:37.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5400b3910 0x7fb5400cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 -- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb54009df30 msgr2=0x7fb54014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb54009df30 0x7fb54014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 -- 172.21.15.64:0/208908953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54014e240 con 0x7fb5400ce730 2024-09-21T07:33:38.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb53fe00640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c760 tx=0x7fb53800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538003db0 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb53800ce10 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380052d0 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5401fcee0 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54015de50 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:37.999+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5400b33d0 con 0x7fb5400ce730 2024-09-21T07:33:38.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.003+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb538005470 con 0x7fb5400ce730 2024-09-21T07:33:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.003+0000 7fb537e00640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 0x7fb51c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.003+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fb538093ee0 con 0x7fb5400ce730 2024-09-21T07:33:38.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.003+0000 7fb53f400640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 0x7fb51c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.003+0000 7fb53f400640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 0x7fb51c075710 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb530005fd0 tx=0x7fb530005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.007+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb53805f070 con 0x7fb5400ce730 2024-09-21T07:33:38.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.183+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fb5400cf750 con 0x7fb5400ce730 2024-09-21T07:33:38.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb537e00640 1 -- 172.21.15.64:0/208908953 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v57) ==== 71+0+0 (secure 0 0 0) 0x7fb53805e970 con 0x7fb5400ce730 2024-09-21T07:33:38.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 msgr2=0x7fb51c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 0x7fb51c075710 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb530005fd0 tx=0x7fb530005f40 comp rx=0 tx=0).stop 2024-09-21T07:33:38.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 msgr2=0x7fb5400cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c760 tx=0x7fb53800cc20 comp rx=0 tx=0).stop 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 shutdown_connections 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb51c073200 0x7fb51c075710 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5400ce730 0x7fb5400cd6f0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5400b3910 0x7fb5400cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 --2- 172.21.15.64:0/208908953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb54009df30 0x7fb54014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 >> 172.21.15.64:0/208908953 conn(0x7fb54006d450 msgr2=0x7fb54015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 shutdown_connections 2024-09-21T07:33:38.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.191+0000 7fb546000640 1 -- 172.21.15.64:0/208908953 wait complete. 2024-09-21T07:33:38.212 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 -- 172.21.15.64:0/91714278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50071880 msgr2=0x7f8a501606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 --2- 172.21.15.64:0/91714278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50071880 0x7f8a501606e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009840 tx=0x7f8a3801c790 comp rx=0 tx=0).stop 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 -- 172.21.15.64:0/91714278 shutdown_connections 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 --2- 172.21.15.64:0/91714278 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a500d05f0 0x7f8a500d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 --2- 172.21.15.64:0/91714278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50071880 0x7f8a501606e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 -- 172.21.15.64:0/91714278 >> 172.21.15.64:0/91714278 conn(0x7f8a500cecd0 msgr2=0x7f8a500cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 -- 172.21.15.64:0/91714278 shutdown_connections 2024-09-21T07:33:38.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.371+0000 7f8a57c00640 1 -- 172.21.15.64:0/91714278 wait complete. 2024-09-21T07:33:38.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 Processor -- start 2024-09-21T07:33:38.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 -- start start 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a501602d0 0x7f8a500b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50165810 0x7f8a50165c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5016a2a0 con 0x7f8a500d05f0 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5016a120 con 0x7f8a50165810 2024-09-21T07:33:38.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a57c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5016a420 con 0x7f8a501602d0 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a55200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a55200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55886/0 (socket says 172.21.15.64:55886) 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.375+0000 7f8a55200640 1 -- 172.21.15.64:0/3710059312 learned_addr learned my addr 172.21.15.64:0/3710059312 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50165810 0x7f8a50165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a47e00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a501602d0 0x7f8a500b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 -- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a501602d0 msgr2=0x7f8a500b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a501602d0 0x7f8a500b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 -- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50165810 msgr2=0x7f8a50165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50165810 0x7f8a50165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 -- 172.21.15.64:0/3710059312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a50166160 con 0x7f8a500d05f0 2024-09-21T07:33:38.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a55200640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c3f0 tx=0x7f8a4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40017070 con 0x7f8a500d05f0 2024-09-21T07:33:38.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a400053c0 con 0x7f8a500d05f0 2024-09-21T07:33:38.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a500b4980 con 0x7f8a500d05f0 2024-09-21T07:33:38.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40003860 con 0x7f8a500d05f0 2024-09-21T07:33:38.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5006f520 con 0x7f8a500d05f0 2024-09-21T07:33:38.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a500d0b30 con 0x7f8a500d05f0 2024-09-21T07:33:38.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.379+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a4001a070 con 0x7f8a500d05f0 2024-09-21T07:33:38.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.383+0000 7f8a4d600640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 0x7f8a2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.383+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f8a40093400 con 0x7f8a500d05f0 2024-09-21T07:33:38.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.383+0000 7f8a47e00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 0x7f8a2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.383+0000 7f8a47e00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 0x7f8a2c075710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8a380af000 tx=0x7f8a3801afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.387+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8a50166160 con 0x7f8a500d05f0 2024-09-21T07:33:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.635+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f8a501606e0 con 0x7f8a500d05f0 2024-09-21T07:33:38.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a4d600640 1 -- 172.21.15.64:0/3710059312 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v522) ==== 166+0+0 (secure 0 0 0) 0x7f8a4005df40 con 0x7f8a500d05f0 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 msgr2=0x7f8a2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 0x7f8a2c075710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8a380af000 tx=0x7f8a3801afd0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 msgr2=0x7f8a501fc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c3f0 tx=0x7f8a4000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 shutdown_connections 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8a2c073200 0x7f8a2c075710 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a50165810 0x7f8a50165c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8a501602d0 0x7f8a500b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 --2- 172.21.15.64:0/3710059312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500d05f0 0x7f8a501fc850 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 >> 172.21.15.64:0/3710059312 conn(0x7f8a500cecd0 msgr2=0x7f8a5015df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 shutdown_connections 2024-09-21T07:33:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.787+0000 7f8a57c00640 1 -- 172.21.15.64:0/3710059312 wait complete. 2024-09-21T07:33:38.808 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-21T07:33:38.809 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-21T07:33:38.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 -- 172.21.15.64:0/2821395892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac070850 msgr2=0x7fdfac0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/2821395892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac070850 0x7fdfac0b1be0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009bf0 tx=0x7fdf9401cb70 comp rx=0 tx=0).stop 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 -- 172.21.15.64:0/2821395892 shutdown_connections 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/2821395892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac070850 0x7fdfac0b1be0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/2821395892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac15cbd0 0x7fdfac070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 -- 172.21.15.64:0/2821395892 >> 172.21.15.64:0/2821395892 conn(0x7fdfac0ccbe0 msgr2=0x7fdfac0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 -- 172.21.15.64:0/2821395892 shutdown_connections 2024-09-21T07:33:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.967+0000 7fdfb2c00640 1 -- 172.21.15.64:0/2821395892 wait complete. 2024-09-21T07:33:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 Processor -- start 2024-09-21T07:33:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- start start 2024-09-21T07:33:38.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac070850 0x7fdfac152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac15cbd0 0x7fdfac15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0b41f0 con 0x7fdfac0b2120 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0b4070 con 0x7fdfac15cbd0 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac0b4370 con 0x7fdfac070850 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55910/0 (socket says 172.21.15.64:55910) 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 -- 172.21.15.64:0/984299031 learned_addr learned my addr 172.21.15.64:0/984299031 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb0c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac15cbd0 0x7fdfac15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfabe00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac070850 0x7fdfac152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 -- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac070850 msgr2=0x7fdfac152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac070850 0x7fdfac152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 -- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac15cbd0 msgr2=0x7fdfac15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac15cbd0 0x7fdfac15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 -- 172.21.15.64:0/984299031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac152bc0 con 0x7fdfac0b2120 2024-09-21T07:33:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa3400640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009b10 tx=0x7fdf940a5ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf940bb070 con 0x7fdfac0b2120 2024-09-21T07:33:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf94004d40 con 0x7fdfac0b2120 2024-09-21T07:33:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf940b2040 con 0x7fdfac0b2120 2024-09-21T07:33:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfac09b7b0 con 0x7fdfac0b2120 2024-09-21T07:33:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.971+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfac15a730 con 0x7fdfac0b2120 2024-09-21T07:33:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.975+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfac09b520 con 0x7fdfac0b2120 2024-09-21T07:33:38.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.975+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdf940be070 con 0x7fdfac0b2120 2024-09-21T07:33:38.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.975+0000 7fdfa8c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 0x7fdf88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.975+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fdf9412dec0 con 0x7fdfac0b2120 2024-09-21T07:33:38.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.975+0000 7fdfabe00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 0x7fdf88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.979+0000 7fdfabe00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 0x7fdf88075710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c005fd0 tx=0x7fdf9c005d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:38.979+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdf94016790 con 0x7fdfac0b2120 2024-09-21T07:33:39.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.167+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfac0b1be0 con 0x7fdfac0b2120 2024-09-21T07:33:39.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.167+0000 7fdfa8c00640 1 -- 172.21.15.64:0/984299031 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13267 (secure 0 0 0) 0x7fdf940f8fb0 con 0x7fdfac0b2120 2024-09-21T07:33:39.168 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:39.170 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":158,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:37.777887+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6834/2961655138":"2024-09-22T07:33:34.762839+0000","172.21.15.64:6832/2961655138":"2024-09-22T07:33:34.762839+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 msgr2=0x7fdf88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 0x7fdf88075710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c005fd0 tx=0x7fdf9c005d10 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 msgr2=0x7fdfac15ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009b10 tx=0x7fdf940a5ae0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 shutdown_connections 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdf88073200 0x7fdf88075710 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac15cbd0 0x7fdfac15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdfac0b2120 0x7fdfac15ef60 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 --2- 172.21.15.64:0/984299031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdfac070850 0x7fdfac152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 >> 172.21.15.64:0/984299031 conn(0x7fdfac0ccbe0 msgr2=0x7fdfac0af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 shutdown_connections 2024-09-21T07:33:39.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.171+0000 7fdfb2c00640 1 -- 172.21.15.64:0/984299031 wait complete. 2024-09-21T07:33:39.191 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:33:39.192 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:33:39.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 -- 172.21.15.64:0/238620022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0b3910 msgr2=0x7f374c0ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 --2- 172.21.15.64:0/238620022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0b3910 0x7f374c0ce1f0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f374c0ca850 tx=0x7f373801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 -- 172.21.15.64:0/238620022 shutdown_connections 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 --2- 172.21.15.64:0/238620022 >> v2:172.21.15.90:3300/0 conn(0x7f374c0ce730 0x7f374c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 --2- 172.21.15.64:0/238620022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0b3910 0x7f374c0ce1f0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 --2- 172.21.15.64:0/238620022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 0x7f374c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 -- 172.21.15.64:0/238620022 >> 172.21.15.64:0/238620022 conn(0x7f374c06d450 msgr2=0x7f374c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 -- 172.21.15.64:0/238620022 shutdown_connections 2024-09-21T07:33:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.355+0000 7f3753e00640 1 -- 172.21.15.64:0/238620022 wait complete. 2024-09-21T07:33:39.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 Processor -- start 2024-09-21T07:33:39.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- start start 2024-09-21T07:33:39.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 0x7f374c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f374c0b3910 0x7f374c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f374c0ccef0 con 0x7f374c0ce730 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f374c0ccd70 con 0x7f374c0b3910 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f374c0cd070 con 0x7f374c09df30 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55940/0 (socket says 172.21.15.64:55940) 2024-09-21T07:33:39.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 -- 172.21.15.64:0/2349959734 learned_addr learned my addr 172.21.15.64:0/2349959734 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751400640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 0x7f374c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3750a00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f374c0b3910 0x7f374c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 -- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 msgr2=0x7f374c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 0x7f374c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 -- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f374c0b3910 msgr2=0x7f374c15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f374c0b3910 0x7f374c15de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 -- 172.21.15.64:0/2349959734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c168c60 con 0x7f374c0ce730 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3751e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f374400cab0 tx=0x7f374400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400ae20 con 0x7f374c0ce730 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f374400f560 con 0x7f374c0ce730 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c168370 con 0x7f374c0ce730 2024-09-21T07:33:39.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400f9b0 con 0x7f374c0ce730 2024-09-21T07:33:39.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.359+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c158640 con 0x7f374c0ce730 2024-09-21T07:33:39.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c0ce1f0 con 0x7f374c0ce730 2024-09-21T07:33:39.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f374400fb50 con 0x7f374c0ce730 2024-09-21T07:33:39.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3749600640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 0x7f372c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f3744094ad0 con 0x7f374c0ce730 2024-09-21T07:33:39.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3751400640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 0x7f372c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.363+0000 7f3751400640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 0x7f372c075710 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f374000a4d0 tx=0x7f374000a460 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.367+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3744014030 con 0x7f374c0ce730 2024-09-21T07:33:39.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.543+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f374c158fb0 con 0x7f374c0ce730 2024-09-21T07:33:39.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3749600640 1 -- 172.21.15.64:0/2349959734 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7f374405f600 con 0x7f374c0ce730 2024-09-21T07:33:39.545 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:33:39.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 msgr2=0x7f372c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 0x7f372c075710 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f374000a4d0 tx=0x7f374000a460 comp rx=0 tx=0).stop 2024-09-21T07:33:39.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 msgr2=0x7f374c157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f374400cab0 tx=0x7f374400cf70 comp rx=0 tx=0).stop 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 shutdown_connections 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f372c073200 0x7f372c075710 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f374c0ce730 0x7f374c157460 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f374c0b3910 0x7f374c15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 --2- 172.21.15.64:0/2349959734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f374c09df30 0x7f374c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 >> 172.21.15.64:0/2349959734 conn(0x7f374c06d450 msgr2=0x7f374c15bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 shutdown_connections 2024-09-21T07:33:39.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.547+0000 7f3753e00640 1 -- 172.21.15.64:0/2349959734 wait complete. 2024-09-21T07:33:39.571 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 -- 172.21.15.64:0/3317339408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 msgr2=0x7fc3940cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 --2- 172.21.15.64:0/3317339408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc3940cb100 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fc3940ce390 tx=0x7fc37c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 -- 172.21.15.64:0/3317339408 shutdown_connections 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 --2- 172.21.15.64:0/3317339408 >> v2:172.21.15.90:3300/0 conn(0x7fc39415e9b0 0x7fc39415edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 --2- 172.21.15.64:0/3317339408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc3940cb100 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 --2- 172.21.15.64:0/3317339408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 0x7fc3940ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 -- 172.21.15.64:0/3317339408 >> 172.21.15.64:0/3317339408 conn(0x7fc3940ccbe0 msgr2=0x7fc3940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 -- 172.21.15.64:0/3317339408 shutdown_connections 2024-09-21T07:33:39.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.739+0000 7fc399e00640 1 -- 172.21.15.64:0/3317339408 wait complete. 2024-09-21T07:33:39.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 Processor -- start 2024-09-21T07:33:39.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- start start 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 0x7fc39415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39415e9b0 0x7fc394073340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940b3860 con 0x7fc3940cacf0 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940b36e0 con 0x7fc39415e9b0 2024-09-21T07:33:39.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc3940b39e0 con 0x7fc3940b24e0 2024-09-21T07:33:39.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55952/0 (socket says 172.21.15.64:55952) 2024-09-21T07:33:39.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 -- 172.21.15.64:0/2410412178 learned_addr learned my addr 172.21.15.64:0/2410412178 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc392a00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 0x7fc39415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc393400640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39415e9b0 0x7fc394073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 -- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 msgr2=0x7fc39415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 0x7fc39415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 -- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39415e9b0 msgr2=0x7fc394073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39415e9b0 0x7fc394073340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 -- 172.21.15.64:0/2410412178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940c5f30 con 0x7fc3940cacf0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38be00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fc37c01c6f0 tx=0x7fc37c0a6f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c005280 con 0x7fc3940cacf0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc37c005510 con 0x7fc3940cacf0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c004910 con 0x7fc3940cacf0 2024-09-21T07:33:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39409cc60 con 0x7fc3940cacf0 2024-09-21T07:33:39.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.743+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3940c61b0 con 0x7fc3940cacf0 2024-09-21T07:33:39.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.747+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39409d180 con 0x7fc3940cacf0 2024-09-21T07:33:39.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.747+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc37c0bf020 con 0x7fc3940cacf0 2024-09-21T07:33:39.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.747+0000 7fc38b400640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 0x7fc370075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.747+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fc37c12e810 con 0x7fc3940cacf0 2024-09-21T07:33:39.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.747+0000 7fc392a00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 0x7fc370075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.751+0000 7fc392a00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 0x7fc370075710 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc384005fd0 tx=0x7fc384005d60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.751+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc39409d180 con 0x7fc3940cacf0 2024-09-21T07:33:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:39.995+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fc3940cb100 con 0x7fc3940cacf0 2024-09-21T07:33:40.286 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:40.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:40.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.795+0000 7fc38b400640 1 -- 172.21.15.64:0/2410412178 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v524) ==== 169+0+0 (secure 0 0 0) 0x7fc3940c5f30 con 0x7fc3940cacf0 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 msgr2=0x7fc370075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 0x7fc370075710 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc384005fd0 tx=0x7fc384005d60 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 msgr2=0x7fc394072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fc37c01c6f0 tx=0x7fc37c0a6f70 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 shutdown_connections 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc370073200 0x7fc370075710 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39415e9b0 0x7fc394073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3940cacf0 0x7fc394072e00 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 --2- 172.21.15.64:0/2410412178 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3940b24e0 0x7fc39415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 >> 172.21.15.64:0/2410412178 conn(0x7fc3940ccbe0 msgr2=0x7fc3941651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 shutdown_connections 2024-09-21T07:33:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.799+0000 7fc399e00640 1 -- 172.21.15.64:0/2410412178 wait complete. 2024-09-21T07:33:40.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:33:40.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 -- 172.21.15.64:0/4184433550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0c6eb0 msgr2=0x7f035c167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:40.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 --2- 172.21.15.64:0/4184433550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0c6eb0 0x7f035c167450 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f0354009bc0 tx=0x7f035401cae0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 -- 172.21.15.64:0/4184433550 shutdown_connections 2024-09-21T07:33:40.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 --2- 172.21.15.64:0/4184433550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0c6eb0 0x7f035c167450 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 -- 172.21.15.64:0/4184433550 >> 172.21.15.64:0/4184433550 conn(0x7f035c06d1c0 msgr2=0x7f035c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:40.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 -- 172.21.15.64:0/4184433550 shutdown_connections 2024-09-21T07:33:40.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.983+0000 7f0362800640 1 -- 172.21.15.64:0/4184433550 wait complete. 2024-09-21T07:33:40.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 Processor -- start 2024-09-21T07:33:40.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 -- start start 2024-09-21T07:33:40.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:40.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 0x7f035c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:40.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 0x7f035c0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:40.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f035c16af10 con 0x7f035c0b3d60 2024-09-21T07:33:40.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f035c16ad90 con 0x7f035c0c6eb0 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f0362800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f035c16b090 con 0x7f035c0d1d00 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55980/0 (socket says 172.21.15.64:55980) 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 -- 172.21.15.64:0/3713075242 learned_addr learned my addr 172.21.15.64:0/3713075242 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035be00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 0x7f035c0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035aa00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 0x7f035c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 -- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 msgr2=0x7f035c0c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 0x7f035c0c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 -- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 msgr2=0x7f035c0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 0x7f035c0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035b400640 1 -- 172.21.15.64:0/3713075242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c0b5360 con 0x7f035c0b3d60 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035be00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 0x7f035c0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.987+0000 7f035aa00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 0x7f035c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:40.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f035b400640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c400 tx=0x7f034c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c017070 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f034c003600 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c003a50 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c0b5640 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c15cea0 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035c0d03f0 con 0x7f035c0b3d60 2024-09-21T07:33:40.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.991+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f034c01a070 con 0x7f035c0b3d60 2024-09-21T07:33:40.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.995+0000 7f0353400640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 0x7f033c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:40.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.995+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f034c093420 con 0x7f035c0b3d60 2024-09-21T07:33:40.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.995+0000 7f035aa00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 0x7f033c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:40.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.995+0000 7f035aa00640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 0x7f033c075740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f035c06dbc0 tx=0x7f0348008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:40.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:40.999+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f034c05e5a0 con 0x7f035c0b3d60 2024-09-21T07:33:41.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.179+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f035c0b6eb0 con 0x7f035c0b3d60 2024-09-21T07:33:41.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.179+0000 7f0353400640 1 -- 172.21.15.64:0/3713075242 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v57) ==== 59+0+2294 (secure 0 0 0) 0x7f034c05dea0 con 0x7f035c0b3d60 2024-09-21T07:33:41.179 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:33:41.179 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:33:41.180 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:33:41.181 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:33:41.182 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:33:41.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 msgr2=0x7f033c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 0x7f033c075740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f035c06dbc0 tx=0x7f0348008040 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 msgr2=0x7f035c15f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c400 tx=0x7f034c00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 shutdown_connections 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f033c073230 0x7f033c075740 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035c0d1d00 0x7f035c0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035c0c6eb0 0x7f035c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 --2- 172.21.15.64:0/3713075242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c0b3d60 0x7f035c15f600 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 >> 172.21.15.64:0/3713075242 conn(0x7f035c06d1c0 msgr2=0x7f035c1596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 shutdown_connections 2024-09-21T07:33:41.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.183+0000 7f0362800640 1 -- 172.21.15.64:0/3713075242 wait complete. 2024-09-21T07:33:41.202 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- 172.21.15.64:0/2217001740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c0b0570 msgr2=0x7fb320003a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 --2- 172.21.15.64:0/2217001740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c0b0570 0x7fb320003a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009b60 tx=0x7fb32c01d270 comp rx=0 tx=0).stop 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb33b200640 1 -- 172.21.15.64:0/2217001740 reap_dead start 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- 172.21.15.64:0/2217001740 shutdown_connections 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- 172.21.15.64:0/2217001740 >> 172.21.15.64:0/2217001740 conn(0x7fb33c0cdd10 msgr2=0x7fb33c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- 172.21.15.64:0/2217001740 shutdown_connections 2024-09-21T07:33:41.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- 172.21.15.64:0/2217001740 wait complete. 2024-09-21T07:33:41.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 Processor -- start 2024-09-21T07:33:41.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.367+0000 7fb341400640 1 -- start start 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33c0b0570 0x7fb33c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c1e66c0 0x7fb33c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c15cbd0 con 0x7fb33c1f56d0 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c15ca50 con 0x7fb33c0b0570 2024-09-21T07:33:41.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c15cd50 con 0x7fb33c1e66c0 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56008/0 (socket says 172.21.15.64:56008) 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 -- 172.21.15.64:0/3277097317 learned_addr learned my addr 172.21.15.64:0/3277097317 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb33a800640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33c0b0570 0x7fb33c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb33b200640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c1e66c0 0x7fb33c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 -- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c1e66c0 msgr2=0x7fb33c1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c1e66c0 0x7fb33c1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 -- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33c0b0570 msgr2=0x7fb33c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33c0b0570 0x7fb33c14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 -- 172.21.15.64:0/3277097317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c1e6ad0 con 0x7fb33c1f56d0 2024-09-21T07:33:41.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb331e00640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb324012410 tx=0x7fb3240128d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240139e0 con 0x7fb33c1f56d0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb324013b80 con 0x7fb33c1f56d0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324010480 con 0x7fb33c1f56d0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c0b2940 con 0x7fb33c1f56d0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c0b2f00 con 0x7fb33c1f56d0 2024-09-21T07:33:41.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.371+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c074340 con 0x7fb33c1f56d0 2024-09-21T07:33:41.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.375+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb324010620 con 0x7fb33c1f56d0 2024-09-21T07:33:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.375+0000 7fb333400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 0x7fb318075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.375+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fb324097f70 con 0x7fb33c1f56d0 2024-09-21T07:33:41.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.375+0000 7fb33a800640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 0x7fb318075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.375+0000 7fb33a800640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 0x7fb318075740 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c01a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:41.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.379+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb33c1e6ad0 con 0x7fb33c1f56d0 2024-09-21T07:33:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.559+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb33c0725c0 con 0x7fb33c1f56d0 2024-09-21T07:33:41.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb333400640 1 -- 172.21.15.64:0/3277097317 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7fb324062a10 con 0x7fb33c1f56d0 2024-09-21T07:33:41.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 msgr2=0x7fb318075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 0x7fb318075740 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c01a010 comp rx=0 tx=0).stop 2024-09-21T07:33:41.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 msgr2=0x7fb33c1e6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb324012410 tx=0x7fb3240128d0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 shutdown_connections 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb318073230 0x7fb318075740 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb33c1e66c0 0x7fb33c1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb33c1f56d0 0x7fb33c1e6180 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 --2- 172.21.15.64:0/3277097317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33c0b0570 0x7fb33c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 >> 172.21.15.64:0/3277097317 conn(0x7fb33c0cdd10 msgr2=0x7fb33c068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 shutdown_connections 2024-09-21T07:33:41.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:41.563+0000 7fb341400640 1 -- 172.21.15.64:0/3277097317 wait complete. 2024-09-21T07:33:41.585 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:33:41.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:33:41.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:33:41.764 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:33:41.764 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:41.765 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:41.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:33:41.773 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:33:41.773 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:41.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:33:41.783 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:41.783 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:41.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:33:41.825 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:33:41.825 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:41.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:33:41.834 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:33:41.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:42.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 -- 172.21.15.64:0/2047857541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 msgr2=0x7f5f440700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/2047857541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440700b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406f220 tx=0x7f5f3801c820 comp rx=0 tx=0).stop 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 -- 172.21.15.64:0/2047857541 shutdown_connections 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/2047857541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440700b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 -- 172.21.15.64:0/2047857541 >> 172.21.15.64:0/2047857541 conn(0x7f5f440ccbe0 msgr2=0x7f5f440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 -- 172.21.15.64:0/2047857541 shutdown_connections 2024-09-21T07:33:42.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 -- 172.21.15.64:0/2047857541 wait complete. 2024-09-21T07:33:42.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.031+0000 7f5f4bc00640 1 Processor -- start 2024-09-21T07:33:42.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- start start 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440709b0 0x7f5f440c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5f4414c4b0 0x7f5f4414cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4416a240 con 0x7f5f4415edb0 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4416a0c0 con 0x7f5f440709b0 2024-09-21T07:33:42.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4416a3c0 con 0x7f5f4414c4b0 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56036/0 (socket says 172.21.15.64:56036) 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 -- 172.21.15.64:0/1214665771 learned_addr learned my addr 172.21.15.64:0/1214665771 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f49200640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440709b0 0x7f5f440c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f49c00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5f4414c4b0 0x7f5f4414cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 -- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5f4414c4b0 msgr2=0x7f5f4414cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5f4414c4b0 0x7f5f4414cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 -- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440709b0 msgr2=0x7f5f440c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440709b0 0x7f5f440c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 -- 172.21.15.64:0/1214665771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f440c7cc0 con 0x7f5f4415edb0 2024-09-21T07:33:42.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f43e00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000c430 tx=0x7f5f3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011790 con 0x7f5f4415edb0 2024-09-21T07:33:42.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f30017070 con 0x7f5f4415edb0 2024-09-21T07:33:42.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011ce0 con 0x7f5f4415edb0 2024-09-21T07:33:42.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f440c7fa0 con 0x7f5f4415edb0 2024-09-21T07:33:42.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.035+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f440c8560 con 0x7f5f4415edb0 2024-09-21T07:33:42.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.039+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f440c7a30 con 0x7f5f4415edb0 2024-09-21T07:33:42.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.039+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5f3001c460 con 0x7f5f4415edb0 2024-09-21T07:33:42.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.039+0000 7f5f40c00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 0x7f5f24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.039+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f5f300940e0 con 0x7f5f4415edb0 2024-09-21T07:33:42.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.039+0000 7f5f49200640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 0x7f5f24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.043+0000 7f5f49200640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 0x7f5f24075710 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5f380af000 tx=0x7f5f3801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.043+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5f3005ed50 con 0x7f5f4415edb0 2024-09-21T07:33:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.259+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f440700b0 con 0x7f5f4415edb0 2024-09-21T07:33:42.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.259+0000 7f5f40c00640 1 -- 172.21.15.64:0/1214665771 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+3913 (secure 0 0 0) 0x7f5f30063780 con 0x7f5f4415edb0 2024-09-21T07:33:42.259 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:42.259 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":114,"btime":"2024-09-21T07:33:35:766934+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/138541879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":138541879},{"type":"v1","addr":"172.21.15.90:6836","nonce":138541879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1725022910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1725022910},{"type":"v1","addr":"172.21.15.64:6835","nonce":1725022910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":8665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3965658563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3965658563},{"type":"v1","addr":"172.21.15.90:6837","nonce":3965658563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3957385818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3957385818},{"type":"v1","addr":"172.21.15.64:6834","nonce":3957385818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[]} 2024-09-21T07:33:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 114 2024-09-21T07:33:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 msgr2=0x7f5f24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 0x7f5f24075710 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5f380af000 tx=0x7f5f3801b060 comp rx=0 tx=0).stop 2024-09-21T07:33:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 msgr2=0x7f5f440c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000c430 tx=0x7f5f3000c8f0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 shutdown_connections 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f24073200 0x7f5f24075710 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5f4414c4b0 0x7f5f4414cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f4415edb0 0x7f5f440c71c0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 --2- 172.21.15.64:0/1214665771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440709b0 0x7f5f440c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 >> 172.21.15.64:0/1214665771 conn(0x7f5f440ccbe0 msgr2=0x7f5f440cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 shutdown_connections 2024-09-21T07:33:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.263+0000 7f5f4bc00640 1 -- 172.21.15.64:0/1214665771 wait complete. 2024-09-21T07:33:42.282 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:33:42.282 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:33:42.282 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:33:42.282 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:33:42.283 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:33:42.283 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:33:42.283 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:33:42.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:33:42.283 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:33:42.283 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:33:42.283 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:33:42.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:33:42.284 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:33:42.284 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:33:42.284 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:33:42.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:33:42.297 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:33:42.297 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:33:42.299 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:33:42.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:33:42.300 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:33:42.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:33:42.306 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:33:42.307 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:33:42.344 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:33:42.344 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:42.345 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:33:42.346 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:42.354 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:33:42.354 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:42.356 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:33:42.356 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:42.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:33:42.448 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:33:42.449 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:33:42.457 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:33:42.457 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 -- 172.21.15.64:0/217804144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c0aefe0 msgr2=0x7f993c0af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 --2- 172.21.15.64:0/217804144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c0aefe0 0x7f993c0af3f0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f993c09e310 tx=0x7f993401ddf0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 -- 172.21.15.64:0/217804144 shutdown_connections 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 --2- 172.21.15.64:0/217804144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c0aefe0 0x7f993c0af3f0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 --2- 172.21.15.64:0/217804144 >> v2:172.21.15.90:3300/0 conn(0x7f993c15eb80 0x7f993c15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 -- 172.21.15.64:0/217804144 >> 172.21.15.64:0/217804144 conn(0x7f993c06d450 msgr2=0x7f993c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 -- 172.21.15.64:0/217804144 shutdown_connections 2024-09-21T07:33:42.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.523+0000 7f9942400640 1 -- 172.21.15.64:0/217804144 wait complete. 2024-09-21T07:33:42.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 Processor -- start 2024-09-21T07:33:42.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- start start 2024-09-21T07:33:42.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f993c0aefe0 0x7f993c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993c15eb80 0x7f993c074330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f993c0ce920 con 0x7f993c155560 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f993c0ce7a0 con 0x7f993c15eb80 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f993c0ceaa0 con 0x7f993c0aefe0 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56090/0 (socket says 172.21.15.64:56090) 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 -- 172.21.15.64:0/3356592230 learned_addr learned my addr 172.21.15.64:0/3356592230 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f993be00640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993c15eb80 0x7f993c074330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f993b400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f993c0aefe0 0x7f993c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 -- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f993c0aefe0 msgr2=0x7f993c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f993c0aefe0 0x7f993c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 -- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993c15eb80 msgr2=0x7f993c074330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993c15eb80 0x7f993c074330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 -- 172.21.15.64:0/3356592230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c09ab70 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933e00640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f992400e970 tx=0x7f992400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992400cd80 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9924004020 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924004470 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993c150640 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.527+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993c0b2be0 con 0x7f993c155560 2024-09-21T07:33:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993c0af3f0 con 0x7f993c155560 2024-09-21T07:33:42.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9924003600 con 0x7f993c155560 2024-09-21T07:33:42.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f9933400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 0x7f9918075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f9924094940 con 0x7f993c155560 2024-09-21T07:33:42.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f993b400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 0x7f9918075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.531+0000 7f993b400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 0x7f9918075710 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f992c001780 tx=0x7f992c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.535+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f992405f470 con 0x7f993c155560 2024-09-21T07:33:42.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:42.727+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f993c0704c0 con 0x7f993c155560 2024-09-21T07:33:43.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.583+0000 7f9933400640 1 -- 172.21.15.64:0/3356592230 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v163) ==== 97+0+0 (secure 0 0 0) 0x7f9924063ea0 con 0x7f993c155560 2024-09-21T07:33:43.583 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 msgr2=0x7f9918075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 0x7f9918075710 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f992c001780 tx=0x7f992c009040 comp rx=0 tx=0).stop 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 msgr2=0x7f993c073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f992400e970 tx=0x7f992400ee30 comp rx=0 tx=0).stop 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 shutdown_connections 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9918073200 0x7f9918075710 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993c15eb80 0x7f993c074330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f993c155560 0x7f993c073df0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 --2- 172.21.15.64:0/3356592230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f993c0aefe0 0x7f993c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 >> 172.21.15.64:0/3356592230 conn(0x7f993c06d450 msgr2=0x7f993c1665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:43.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 shutdown_connections 2024-09-21T07:33:43.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.587+0000 7f9942400640 1 -- 172.21.15.64:0/3356592230 wait complete. 2024-09-21T07:33:43.608 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:33:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 -- 172.21.15.64:0/4031404975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 msgr2=0x7f45240d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 --2- 172.21.15.64:0/4031404975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f45240d0f50 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f45240cf4c0 tx=0x7f451401c8a0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 -- 172.21.15.64:0/4031404975 shutdown_connections 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 --2- 172.21.15.64:0/4031404975 >> v2:172.21.15.90:3300/0 conn(0x7f45240b0300 0x7f45240b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 --2- 172.21.15.64:0/4031404975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f45240d0f50 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 -- 172.21.15.64:0/4031404975 >> 172.21.15.64:0/4031404975 conn(0x7f45240743a0 msgr2=0x7f45240747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 -- 172.21.15.64:0/4031404975 shutdown_connections 2024-09-21T07:33:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.767+0000 7f4523e00640 1 -- 172.21.15.64:0/4031404975 wait complete. 2024-09-21T07:33:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 Processor -- start 2024-09-21T07:33:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 -- start start 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45240b0300 0x7f45240994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 0x7f452415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4524168100 con 0x7f452415dde0 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4524167f80 con 0x7f45240b0300 2024-09-21T07:33:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4524168280 con 0x7f45240b3220 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56104/0 (socket says 172.21.15.64:56104) 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 -- 172.21.15.64:0/3697701272 learned_addr learned my addr 172.21.15.64:0/3697701272 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4522a00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45240b0300 0x7f45240994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f451be00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 0x7f452415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 -- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 msgr2=0x7f452415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 0x7f452415b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 -- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45240b0300 msgr2=0x7f45240994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45240b0300 0x7f45240994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f4523400640 1 -- 172.21.15.64:0/3697701272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524099a10 con 0x7f452415dde0 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.771+0000 7f451be00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 0x7f452415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:43.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f4523400640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f451c00ddf0 tx=0x7f451c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c004d30 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f451c00be40 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c00e8c0 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45241fb020 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45241faa60 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45240510a0 con 0x7f452415dde0 2024-09-21T07:33:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f451c00ea60 con 0x7f452415dde0 2024-09-21T07:33:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 0x7f4500075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.775+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5249+0+0 (secure 0 0 0) 0x7f451c0949c0 con 0x7f452415dde0 2024-09-21T07:33:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.779+0000 7f4522a00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 0x7f4500075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.779+0000 7f4522a00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 0x7f4500075710 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f45140af000 tx=0x7f451401b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:43.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:43.779+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f451c05f4c0 con 0x7f452415dde0 2024-09-21T07:33:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.019+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f45240b0710 con 0x7f452415dde0 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.019+0000 7f451aa00640 1 -- 172.21.15.64:0/3697701272 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) ==== 80+0+5304 (secure 0 0 0) 0x7f451c063ef0 con 0x7f452415dde0 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.019 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.021 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:33:44.022 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.023 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:33:44.024 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.025 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.026 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.027 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:33:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:33:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:33:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:33:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:33:44.032 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:44.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 msgr2=0x7f4500075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 0x7f4500075710 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f45140af000 tx=0x7f451401b0e0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 msgr2=0x7f4524155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f451c00ddf0 tx=0x7f451c00b730 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 shutdown_connections 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4500073200 0x7f4500075710 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452415dde0 0x7f4524155c70 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45240b3220 0x7f452415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 --2- 172.21.15.64:0/3697701272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45240b0300 0x7f45240994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 >> 172.21.15.64:0/3697701272 conn(0x7f45240743a0 msgr2=0x7f45240b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 shutdown_connections 2024-09-21T07:33:44.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.023+0000 7f4523e00640 1 -- 172.21.15.64:0/3697701272 wait complete. 2024-09-21T07:33:44.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:33:44.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- 172.21.15.64:0/3929499608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc15edb0 msgr2=0x7f74bc0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 --2- 172.21.15.64:0/3929499608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc15edb0 0x7f74bc0700b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f74bc06f220 tx=0x7f74b001c8a0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- 172.21.15.64:0/3929499608 shutdown_connections 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 --2- 172.21.15.64:0/3929499608 >> v2:172.21.15.90:3300/0 conn(0x7f74bc0709b0 0x7f74bc0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 --2- 172.21.15.64:0/3929499608 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc15edb0 0x7f74bc0700b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- 172.21.15.64:0/3929499608 >> 172.21.15.64:0/3929499608 conn(0x7f74bc0ccbe0 msgr2=0x7f74bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- 172.21.15.64:0/3929499608 shutdown_connections 2024-09-21T07:33:44.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- 172.21.15.64:0/3929499608 wait complete. 2024-09-21T07:33:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 Processor -- start 2024-09-21T07:33:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.203+0000 7f74c4800640 1 -- start start 2024-09-21T07:33:44.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74bc0b4700 0x7f74bc163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 0x7f74bc164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc169010 con 0x7f74bc0709b0 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc168e90 con 0x7f74bc15edb0 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f74bc169190 con 0x7f74bc0b4700 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56110/0 (socket says 172.21.15.64:56110) 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 -- 172.21.15.64:0/2793517382 learned_addr learned my addr 172.21.15.64:0/2793517382 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c2800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 0x7f74bc164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1400640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74bc0b4700 0x7f74bc163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 -- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74bc0b4700 msgr2=0x7f74bc163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74bc0b4700 0x7f74bc163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 -- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 msgr2=0x7f74bc164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 0x7f74bc164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 -- 172.21.15.64:0/2793517382 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74bc164ac0 con 0x7f74bc0709b0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c2800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 0x7f74bc164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c1e00640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f74b00194b0 tx=0x7f74b00a5560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00bc070 con 0x7f74bc0709b0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b00043b0 con 0x7f74bc0709b0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b00b2040 con 0x7f74bc0709b0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74bc09bd60 con 0x7f74bc0709b0 2024-09-21T07:33:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74bc09c320 con 0x7f74bc0709b0 2024-09-21T07:33:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.207+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74bc0b41c0 con 0x7f74bc0709b0 2024-09-21T07:33:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.211+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f74b0005290 con 0x7f74bc0709b0 2024-09-21T07:33:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.211+0000 7f74b6000640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 0x7f74a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.211+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5249+0+0 (secure 0 0 0) 0x7f74b012d7b0 con 0x7f74bc0709b0 2024-09-21T07:33:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.211+0000 7f74c1400640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 0x7f74a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.211+0000 7f74c1400640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 0x7f74a0075710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f74ac005fd0 tx=0x7f74ac005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.215+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f74b0016490 con 0x7f74bc0709b0 2024-09-21T07:33:44.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f74bc157c70 con 0x7f74bc0709b0 2024-09-21T07:33:44.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74b6000640 1 -- 172.21.15.64:0/2793517382 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) ==== 84+0+65 (secure 0 0 0) 0x7f74b00f8a10 con 0x7f74bc0709b0 2024-09-21T07:33:44.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:33:44.398 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:33:44.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 msgr2=0x7f74a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 0x7f74a0075710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f74ac005fd0 tx=0x7f74ac005e40 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 msgr2=0x7f74bc156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f74b00194b0 tx=0x7f74b00a5560 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 shutdown_connections 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74a0073200 0x7f74a0075710 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74bc15edb0 0x7f74bc164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74bc0b4700 0x7f74bc163cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 --2- 172.21.15.64:0/2793517382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74bc0709b0 0x7f74bc156c10 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 >> 172.21.15.64:0/2793517382 conn(0x7f74bc0ccbe0 msgr2=0x7f74bc15d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 shutdown_connections 2024-09-21T07:33:44.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.399+0000 7f74c4800640 1 -- 172.21.15.64:0/2793517382 wait complete. 2024-09-21T07:33:44.420 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:33:44.420 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- 172.21.15.64:0/2394506861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea0160d50 msgr2=0x7f5ea006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 --2- 172.21.15.64:0/2394506861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea0160d50 0x7f5ea006cdf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009840 tx=0x7f5e8c01c760 comp rx=0 tx=0).stop 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- 172.21.15.64:0/2394506861 shutdown_connections 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 --2- 172.21.15.64:0/2394506861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea0160d50 0x7f5ea006cdf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 --2- 172.21.15.64:0/2394506861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea00b38d0 0x7f5ea015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- 172.21.15.64:0/2394506861 >> 172.21.15.64:0/2394506861 conn(0x7f5ea00d0c50 msgr2=0x7f5ea00d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- 172.21.15.64:0/2394506861 shutdown_connections 2024-09-21T07:33:44.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- 172.21.15.64:0/2394506861 wait complete. 2024-09-21T07:33:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 Processor -- start 2024-09-21T07:33:44.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.587+0000 7f5ea8200640 1 -- start start 2024-09-21T07:33:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea006d330 0x7f5ea0158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea0160d50 0x7f5ea015e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0169bf0 con 0x7f5ea00b38d0 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0169a70 con 0x7f5ea006d330 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea0169d70 con 0x7f5ea0160d50 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56118/0 (socket says 172.21.15.64:56118) 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 -- 172.21.15.64:0/4015886364 learned_addr learned my addr 172.21.15.64:0/4015886364 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea5800640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea006d330 0x7f5ea0158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea6200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea0160d50 0x7f5ea015e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 -- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea0160d50 msgr2=0x7f5ea015e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea0160d50 0x7f5ea015e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 -- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea006d330 msgr2=0x7f5ea0158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea006d330 0x7f5ea0158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 -- 172.21.15.64:0/4015886364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea0159570 con 0x7f5ea00b38d0 2024-09-21T07:33:44.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea4e00640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01cc40 tx=0x7f5e8c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0b2040 con 0x7f5ea00b38d0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e8c0bb070 con 0x7f5ea00b38d0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea00c7bd0 con 0x7f5ea00b38d0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c003600 con 0x7f5ea00b38d0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea00c8190 con 0x7f5ea00b38d0 2024-09-21T07:33:44.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea015c8c0 con 0x7f5ea00b38d0 2024-09-21T07:33:44.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.595+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5e8c0037a0 con 0x7f5ea00b38d0 2024-09-21T07:33:44.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.595+0000 7f5e9d600640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 0x7f5e80075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.595+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5249+0+0 (secure 0 0 0) 0x7f5e8c12e560 con 0x7f5ea00b38d0 2024-09-21T07:33:44.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.595+0000 7f5ea5800640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 0x7f5e80075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.595+0000 7f5ea5800640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 0x7f5e80075740 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009600 tx=0x7f5e940091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.599+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5ea0159570 con 0x7f5ea00b38d0 2024-09-21T07:33:44.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:44.775+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5ea00cb520 con 0x7f5ea00b38d0 2024-09-21T07:33:45.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.587+0000 7f5e9d600640 1 -- 172.21.15.64:0/4015886364 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v164) ==== 138+0+0 (secure 0 0 0) 0x7f5e8c016410 con 0x7f5ea00b38d0 2024-09-21T07:33:45.588 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:33:45.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 msgr2=0x7f5e80075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 0x7f5e80075740 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009600 tx=0x7f5e940091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 msgr2=0x7f5ea00b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01cc40 tx=0x7f5e8c005ca0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 shutdown_connections 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e80073230 0x7f5e80075740 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea0160d50 0x7f5ea015e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ea00b38d0 0x7f5ea00b2da0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 --2- 172.21.15.64:0/4015886364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ea006d330 0x7f5ea0158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.591+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 >> 172.21.15.64:0/4015886364 conn(0x7f5ea00d0c50 msgr2=0x7f5ea015bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.595+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 shutdown_connections 2024-09-21T07:33:45.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.595+0000 7f5ea8200640 1 -- 172.21.15.64:0/4015886364 wait complete. 2024-09-21T07:33:45.622 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 -- 172.21.15.64:0/1073560740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e80ca990 msgr2=0x7f49e80b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 --2- 172.21.15.64:0/1073560740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e80ca990 0x7f49e80b3ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b3130 tx=0x7f49e001ccb0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 -- 172.21.15.64:0/1073560740 shutdown_connections 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 --2- 172.21.15.64:0/1073560740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e80ca990 0x7f49e80b3ce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 --2- 172.21.15.64:0/1073560740 >> v2:172.21.15.90:3300/0 conn(0x7f49e80706c0 0x7f49e80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 -- 172.21.15.64:0/1073560740 >> 172.21.15.64:0/1073560740 conn(0x7f49e80ccbe0 msgr2=0x7f49e80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 -- 172.21.15.64:0/1073560740 shutdown_connections 2024-09-21T07:33:45.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.791+0000 7f49ecc00640 1 -- 172.21.15.64:0/1073560740 wait complete. 2024-09-21T07:33:45.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 Processor -- start 2024-09-21T07:33:45.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- start start 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49e80ca990 0x7f49e8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 0x7f49e8153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8168e10 con 0x7f49e8153320 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8168c90 con 0x7f49e80ca990 2024-09-21T07:33:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f49e8168f90 con 0x7f49e815ec20 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33238/0 (socket says 172.21.15.64:33238) 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 -- 172.21.15.64:0/2861366599 learned_addr learned my addr 172.21.15.64:0/2861366599 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49dfe00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 0x7f49e8153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e5e00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49e80ca990 0x7f49e8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 -- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 msgr2=0x7f49e8153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 0x7f49e8153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 -- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49e80ca990 msgr2=0x7f49e8152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49e80ca990 0x7f49e8152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 -- 172.21.15.64:0/2861366599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8158240 con 0x7f49e8153320 2024-09-21T07:33:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49dfe00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 0x7f49e8153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49e6800640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009bd0 tx=0x7f49e00092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00bb070 con 0x7f49e8153320 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49e0004d40 con 0x7f49e8153320 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e8155db0 con 0x7f49e8153320 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00b2040 con 0x7f49e8153320 2024-09-21T07:33:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.795+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e8154e20 con 0x7f49e8153320 2024-09-21T07:33:45.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e80ce740 con 0x7f49e8153320 2024-09-21T07:33:45.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f49e00be070 con 0x7f49e8153320 2024-09-21T07:33:45.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49de000640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 0x7f49c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:45.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5619+0+0 (secure 0 0 0) 0x7f49e012e280 con 0x7f49e8153320 2024-09-21T07:33:45.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49e5e00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 0x7f49c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:45.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.799+0000 7f49e5e00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 0x7f49c4075710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49e8072330 tx=0x7f49d8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:45.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.803+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f49e00f3290 con 0x7f49e8153320 2024-09-21T07:33:45.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:45.983+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f49e80cd190 con 0x7f49e8153320 2024-09-21T07:33:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.591+0000 7f49de000640 1 -- 172.21.15.64:0/2861366599 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v165) ==== 170+0+0 (secure 0 0 0) 0x7f49e0016990 con 0x7f49e8153320 2024-09-21T07:33:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:33:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 msgr2=0x7f49c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 0x7f49c4075710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49e8072330 tx=0x7f49d8009040 comp rx=0 tx=0).stop 2024-09-21T07:33:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 msgr2=0x7f49e81543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009bd0 tx=0x7f49e00092c0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 shutdown_connections 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f49c4073200 0x7f49c4075710 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e8153320 0x7f49e81543b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49e815ec20 0x7f49e8153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 --2- 172.21.15.64:0/2861366599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49e80ca990 0x7f49e8152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 >> 172.21.15.64:0/2861366599 conn(0x7f49e80ccbe0 msgr2=0x7f49e80b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 shutdown_connections 2024-09-21T07:33:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.595+0000 7f49ecc00640 1 -- 172.21.15.64:0/2861366599 wait complete. 2024-09-21T07:33:46.637 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:33:46.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 -- 172.21.15.64:0/2455425119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe534003ad0 msgr2=0x7fe534003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 --2- 172.21.15.64:0/2455425119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe534003ad0 0x7fe534003f40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c640 tx=0x7fe54001d2c0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 -- 172.21.15.64:0/2455425119 shutdown_connections 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 --2- 172.21.15.64:0/2455425119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe534003ad0 0x7fe534003f40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 -- 172.21.15.64:0/2455425119 >> 172.21.15.64:0/2455425119 conn(0x7fe55006d450 msgr2=0x7fe5500d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 -- 172.21.15.64:0/2455425119 shutdown_connections 2024-09-21T07:33:46.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 -- 172.21.15.64:0/2455425119 wait complete. 2024-09-21T07:33:46.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.803+0000 7fe556e00640 1 Processor -- start 2024-09-21T07:33:46.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- start start 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe534003ad0 0x7fe5500c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 0x7fe5500b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe550160140 con 0x7fe5501f74c0 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe55015ffc0 con 0x7fe5500b0d90 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe5500b33d0 con 0x7fe534003ad0 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33250/0 (socket says 172.21.15.64:33250) 2024-09-21T07:33:46.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 -- 172.21.15.64:0/1934790087 learned_addr learned my addr 172.21.15.64:0/1934790087 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe54fe00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe534003ad0 0x7fe5500c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe547400640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 0x7fe5500b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 -- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe534003ad0 msgr2=0x7fe5500c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe534003ad0 0x7fe5500c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 -- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 msgr2=0x7fe5500b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 0x7fe5500b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 -- 172.21.15.64:0/1934790087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501f7e10 con 0x7fe5501f74c0 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe547400640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 0x7fe5500b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:46.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe554e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe548006fd0 tx=0x7fe548001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548001310 con 0x7fe5501f74c0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe548017070 con 0x7fe5501f74c0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480118b0 con 0x7fe5501f74c0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5500b18f0 con 0x7fe5501f74c0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5500b1eb0 con 0x7fe5501f74c0 2024-09-21T07:33:46.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.807+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5500b2500 con 0x7fe5501f74c0 2024-09-21T07:33:46.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.811+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe548011a50 con 0x7fe5501f74c0 2024-09-21T07:33:46.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.811+0000 7fe54cc00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 0x7fe52c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:46.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.811+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6001+0+0 (secure 0 0 0) 0x7fe5480954c0 con 0x7fe5501f74c0 2024-09-21T07:33:46.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.811+0000 7fe54fe00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 0x7fe52c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:46.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.811+0000 7fe54fe00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 0x7fe52c0756e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5400ad000 tx=0x7fe540005040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:46.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:46.815+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe5501f7e10 con 0x7fe5501f74c0 2024-09-21T07:33:47.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.027+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe5500aed90 con 0x7fe5501f74c0 2024-09-21T07:33:47.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.607+0000 7fe54cc00640 1 -- 172.21.15.64:0/1934790087 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v116) ==== 174+0+0 (secure 0 0 0) 0x7fe548060390 con 0x7fe5501f74c0 2024-09-21T07:33:47.607 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 23 and data pool 24 2024-09-21T07:33:47.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 msgr2=0x7fe52c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 0x7fe52c0756e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5400ad000 tx=0x7fe540005040 comp rx=0 tx=0).stop 2024-09-21T07:33:47.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 msgr2=0x7fe5501f78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe548006fd0 tx=0x7fe548001880 comp rx=0 tx=0).stop 2024-09-21T07:33:47.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 shutdown_connections 2024-09-21T07:33:47.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe52c0731d0 0x7fe52c0756e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5501f74c0 0x7fe5501f78d0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5500b0d90 0x7fe5500b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 --2- 172.21.15.64:0/1934790087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe534003ad0 0x7fe5500c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 >> 172.21.15.64:0/1934790087 conn(0x7fe55006d450 msgr2=0x7fe55015bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.611+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 shutdown_connections 2024-09-21T07:33:47.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.615+0000 7fe556e00640 1 -- 172.21.15.64:0/1934790087 wait complete. 2024-09-21T07:33:47.661 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:47.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- 172.21.15.64:0/534999082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 msgr2=0x7fa77c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 --2- 172.21.15.64:0/534999082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c072e20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa774009bc0 tx=0x7fa77401cac0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- 172.21.15.64:0/534999082 shutdown_connections 2024-09-21T07:33:47.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 --2- 172.21.15.64:0/534999082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c072e20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 --2- 172.21.15.64:0/534999082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 0x7fa77c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- 172.21.15.64:0/534999082 >> 172.21.15.64:0/534999082 conn(0x7fa77c0ccbe0 msgr2=0x7fa77c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- 172.21.15.64:0/534999082 shutdown_connections 2024-09-21T07:33:47.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- 172.21.15.64:0/534999082 wait complete. 2024-09-21T07:33:47.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 Processor -- start 2024-09-21T07:33:47.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.823+0000 7fa780c00640 1 -- start start 2024-09-21T07:33:47.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 0x7fa77c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c168ba0 con 0x7fa77c15edb0 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c168a20 con 0x7fa77c0b4700 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa77c168d20 con 0x7fa77c0709b0 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33260/0 (socket says 172.21.15.64:33260) 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 -- 172.21.15.64:0/847348028 learned_addr learned my addr 172.21.15.64:0/847348028 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa771400640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa779e00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 0x7fa77c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 -- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 msgr2=0x7fa77c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 0x7fa77c158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 -- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 msgr2=0x7fa77c0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c0d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 -- 172.21.15.64:0/847348028 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c0b0d60 con 0x7fa77c15edb0 2024-09-21T07:33:47.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa771400640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c0d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:47.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa77a800640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fa77401d360 tx=0x7fa7740b9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774004c50 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa774003980 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c1f91f0 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774003d70 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c1f97b0 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.827+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77c0b41c0 con 0x7fa77c15edb0 2024-09-21T07:33:47.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.831+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa7740a5780 con 0x7fa77c15edb0 2024-09-21T07:33:47.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.831+0000 7fa772a00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 0x7fa758075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.831+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fa7741367e0 con 0x7fa77c15edb0 2024-09-21T07:33:47.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.831+0000 7fa779e00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 0x7fa758075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.831+0000 7fa779e00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 0x7fa758075740 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa76c007990 tx=0x7fa76c0012e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:47.835+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa7740be070 con 0x7fa77c15edb0 2024-09-21T07:33:48.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.011+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa77c09da20 con 0x7fa77c15edb0 2024-09-21T07:33:48.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa772a00640 1 -- 172.21.15.64:0/847348028 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16909 (secure 0 0 0) 0x7fa7740166b0 con 0x7fa77c15edb0 2024-09-21T07:33:48.014 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:48.015 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":166,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:47.029564+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:33:44.789416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-21T07:33:45.996202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:48.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 msgr2=0x7fa758075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 0x7fa758075740 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa76c007990 tx=0x7fa76c0012e0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 msgr2=0x7fa77c0d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fa77401d360 tx=0x7fa7740b9f60 comp rx=0 tx=0).stop 2024-09-21T07:33:48.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 shutdown_connections 2024-09-21T07:33:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa758073230 0x7fa758075740 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa77c15edb0 0x7fa77c0d0660 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa77c0b4700 0x7fa77c0d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 --2- 172.21.15.64:0/847348028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa77c0709b0 0x7fa77c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 >> 172.21.15.64:0/847348028 conn(0x7fa77c0ccbe0 msgr2=0x7fa77c070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:48.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 shutdown_connections 2024-09-21T07:33:48.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.015+0000 7fa780c00640 1 -- 172.21.15.64:0/847348028 wait complete. 2024-09-21T07:33:48.039 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:48.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1482124945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 msgr2=0x7fdb380b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1482124945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb380b1ff0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fdb380cb9c0 tx=0x7fdb2001c740 comp rx=0 tx=0).stop 2024-09-21T07:33:48.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1482124945 shutdown_connections 2024-09-21T07:33:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1482124945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb380b1ff0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1482124945 >> 172.21.15.64:0/1482124945 conn(0x7fdb380ccbe0 msgr2=0x7fdb380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1482124945 shutdown_connections 2024-09-21T07:33:48.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1482124945 wait complete. 2024-09-21T07:33:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 Processor -- start 2024-09-21T07:33:48.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.199+0000 7fdb3ce00640 1 -- start start 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 0x7fdb380c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3815cbd0 0x7fdb380c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3816b160 con 0x7fdb380b1be0 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3816afe0 con 0x7fdb380cbcd0 2024-09-21T07:33:48.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3816b2e0 con 0x7fdb3815cbd0 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33270/0 (socket says 172.21.15.64:33270) 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 -- 172.21.15.64:0/1765219301 learned_addr learned my addr 172.21.15.64:0/1765219301 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb2d400640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 0x7fdb380c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 -- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3815cbd0 msgr2=0x7fdb380c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3815cbd0 0x7fdb380c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 -- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 msgr2=0x7fdb380c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 0x7fdb380c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 -- 172.21.15.64:0/1765219301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb381592f0 con 0x7fdb380b1be0 2024-09-21T07:33:48.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb2d400640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 0x7fdb380c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:48.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb35e00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c730 tx=0x7fdb2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:48.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28017070 con 0x7fdb380b1be0 2024-09-21T07:33:48.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb2800ce40 con 0x7fdb380b1be0 2024-09-21T07:33:48.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800a8a0 con 0x7fdb380b1be0 2024-09-21T07:33:48.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb380af1f0 con 0x7fdb380b1be0 2024-09-21T07:33:48.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb381595b0 con 0x7fdb380b1be0 2024-09-21T07:33:48.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.203+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb380b1ff0 con 0x7fdb380b1be0 2024-09-21T07:33:48.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.207+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x7fdb380b1be0 2024-09-21T07:33:48.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.207+0000 7fdb2ea00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 0x7fdb14075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.207+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fdb28093f20 con 0x7fdb380b1be0 2024-09-21T07:33:48.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.207+0000 7fdb2d400640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 0x7fdb14075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.207+0000 7fdb2d400640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 0x7fdb14075740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdb200af000 tx=0x7fdb2001af80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:48.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.211+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdb28021020 con 0x7fdb380b1be0 2024-09-21T07:33:48.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb380741f0 con 0x7fdb380b1be0 2024-09-21T07:33:48.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb2ea00640 1 -- 172.21.15.64:0/1765219301 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16909 (secure 0 0 0) 0x7fdb380b2530 con 0x7fdb380b1be0 2024-09-21T07:33:48.391 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:48.391 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":166,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:47.029564+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:33:44.789416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-21T07:33:45.996202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 msgr2=0x7fdb14075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 0x7fdb14075740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdb200af000 tx=0x7fdb2001af80 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 msgr2=0x7fdb381493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c730 tx=0x7fdb2800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 shutdown_connections 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb14073230 0x7fdb14075740 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb3815cbd0 0x7fdb380c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb380cbcd0 0x7fdb380c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 --2- 172.21.15.64:0/1765219301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb380b1be0 0x7fdb381493a0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.391+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 >> 172.21.15.64:0/1765219301 conn(0x7fdb380ccbe0 msgr2=0x7fdb3815b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:48.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.395+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 shutdown_connections 2024-09-21T07:33:48.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.395+0000 7fdb3ce00640 1 -- 172.21.15.64:0/1765219301 wait complete. 2024-09-21T07:33:48.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:33:48.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 -- 172.21.15.64:0/2987013610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0003cb0 msgr2=0x7fc5d0004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 --2- 172.21.15.64:0/2987013610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0003cb0 0x7fc5d0004100 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc001f50 tx=0x7fc5dc01cc20 comp rx=0 tx=0).stop 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 -- 172.21.15.64:0/2987013610 shutdown_connections 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 --2- 172.21.15.64:0/2987013610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0003cb0 0x7fc5d0004100 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 -- 172.21.15.64:0/2987013610 >> 172.21.15.64:0/2987013610 conn(0x7fc5ec09b3b0 msgr2=0x7fc5ec0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 -- 172.21.15.64:0/2987013610 shutdown_connections 2024-09-21T07:33:48.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.575+0000 7fc5eb200640 1 -- 172.21.15.64:0/2987013610 wait complete. 2024-09-21T07:33:48.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 Processor -- start 2024-09-21T07:33:48.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 -- start start 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5d0003cb0 0x7fc5ec151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5ec06df00 0x7fc5ec0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec0cd5c0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec0cd440 con 0x7fc5d0003cb0 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5eb200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec0cd740 con 0x7fc5ec06df00 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33286/0 (socket says 172.21.15.64:33286) 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5ea800640 1 -- 172.21.15.64:0/1971783747 learned_addr learned my addr 172.21.15.64:0/1971783747 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5e1400640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5ec06df00 0x7fc5ec0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5e9e00640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5d0003cb0 0x7fc5ec151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5ea800640 1 -- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5ec06df00 msgr2=0x7fc5ec0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.579+0000 7fc5ea800640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5ec06df00 0x7fc5ec0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5ea800640 1 -- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5d0003cb0 msgr2=0x7fc5ec151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:48.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5ea800640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5d0003cb0 0x7fc5ec151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:48.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5ea800640 1 -- 172.21.15.64:0/1971783747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec1fc300 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5ea800640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00057f0 tx=0x7fc5e4006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40107d0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5e4016070 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec06e6f0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4010ce0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec06ecb0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5ec0cdca0 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.583+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc5e401b460 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.587+0000 7fc5e2a00640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 0x7fc5c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.587+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fc5e4094c50 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.587+0000 7fc5e9e00640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 0x7fc5c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:48.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.587+0000 7fc5e9e00640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 0x7fc5c8075710 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0a9000 tx=0x7fc5dc019a60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:48.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.591+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc5ec1fc300 con 0x7fc5ec1fb9b0 2024-09-21T07:33:48.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:48.811+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc5ec06b020 con 0x7fc5ec1fb9b0 2024-09-21T07:33:49.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.651+0000 7fc5e2a00640 1 -- 172.21.15.64:0/1971783747 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v119) ==== 118+0+0 (secure 0 0 0) 0x7fc5ec0cf400 con 0x7fc5ec1fb9b0 2024-09-21T07:33:49.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 msgr2=0x7fc5c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 0x7fc5c8075710 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0a9000 tx=0x7fc5dc019a60 comp rx=0 tx=0).stop 2024-09-21T07:33:49.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 msgr2=0x7fc5ec1fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00057f0 tx=0x7fc5e4006f70 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 shutdown_connections 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc5c8073200 0x7fc5c8075710 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5ec1fb9b0 0x7fc5ec1fbdc0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.655+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5ec06df00 0x7fc5ec0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.659+0000 7fc5eb200640 1 --2- 172.21.15.64:0/1971783747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5d0003cb0 0x7fc5ec151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.659+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 >> 172.21.15.64:0/1971783747 conn(0x7fc5ec09b3b0 msgr2=0x7fc5ec0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.659+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 shutdown_connections 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.659+0000 7fc5eb200640 1 -- 172.21.15.64:0/1971783747 wait complete. 2024-09-21T07:33:49.682 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:33:49.682 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- 172.21.15.64:0/3594787383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 msgr2=0x7f442c0cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 --2- 172.21.15.64:0/3594787383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c0cc1a0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f442c070790 tx=0x7f442401cd60 comp rx=0 tx=0).stop 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- 172.21.15.64:0/3594787383 shutdown_connections 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 --2- 172.21.15.64:0/3594787383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c0cc1a0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 --2- 172.21.15.64:0/3594787383 >> v2:172.21.15.90:3300/0 conn(0x7f442c0afde0 0x7f442c0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- 172.21.15.64:0/3594787383 >> 172.21.15.64:0/3594787383 conn(0x7f442c0b2510 msgr2=0x7f442c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- 172.21.15.64:0/3594787383 shutdown_connections 2024-09-21T07:33:49.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- 172.21.15.64:0/3594787383 wait complete. 2024-09-21T07:33:49.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 Processor -- start 2024-09-21T07:33:49.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.851+0000 7f4433200640 1 -- start start 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f442c15b850 0x7f442c0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c156350 0x7f442c0aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f442c168f20 con 0x7f442c0cbd90 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f442c06f8d0 con 0x7f442c156350 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f442c1690a0 con 0x7f442c15b850 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33300/0 (socket says 172.21.15.64:33300) 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 -- 172.21.15.64:0/3671150648 learned_addr learned my addr 172.21.15.64:0/3671150648 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:49.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4423e00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f442c15b850 0x7f442c0a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4431200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c156350 0x7f442c0aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 -- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f442c15b850 msgr2=0x7f442c0a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f442c15b850 0x7f442c0a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 -- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c156350 msgr2=0x7f442c0aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c156350 0x7f442c0aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 -- 172.21.15.64:0/3671150648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c0c7770 con 0x7f442c0cbd90 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f442be00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c3c0 tx=0x7f441c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c017070 con 0x7f442c0cbd90 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f441c0053c0 con 0x7f442c0cbd90 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c003860 con 0x7f442c0cbd90 2024-09-21T07:33:49.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c0c7be0 con 0x7f442c0cbd90 2024-09-21T07:33:49.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c0c8160 con 0x7f442c0cbd90 2024-09-21T07:33:49.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.855+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c0cb850 con 0x7f442c0cbd90 2024-09-21T07:33:49.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.859+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f441c01a070 con 0x7f442c0cbd90 2024-09-21T07:33:49.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.859+0000 7f4428c00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 0x7f4408075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.859+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f441c0936b0 con 0x7f442c0cbd90 2024-09-21T07:33:49.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.859+0000 7f4423e00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 0x7f4408075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.859+0000 7f4423e00640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 0x7f4408075710 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f442c0a9780 tx=0x7f44140091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:49.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:49.863+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f442c071a10 con 0x7f442c0cbd90 2024-09-21T07:33:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.079+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f442c06b130 con 0x7f442c0cbd90 2024-09-21T07:33:50.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.655+0000 7f4428c00640 1 -- 172.21.15.64:0/3671150648 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v120) ==== 122+0+0 (secure 0 0 0) 0x7f441c05dee0 con 0x7f442c0cbd90 2024-09-21T07:33:50.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 msgr2=0x7f4408075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 0x7f4408075710 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f442c0a9780 tx=0x7f44140091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 msgr2=0x7f442c155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c3c0 tx=0x7f441c00c880 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 shutdown_connections 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4408073200 0x7f4408075710 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c156350 0x7f442c0aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f442c15b850 0x7f442c0a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 --2- 172.21.15.64:0/3671150648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f442c0cbd90 0x7f442c155b40 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 >> 172.21.15.64:0/3671150648 conn(0x7f442c0b2510 msgr2=0x7f442c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 shutdown_connections 2024-09-21T07:33:50.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.659+0000 7f4433200640 1 -- 172.21.15.64:0/3671150648 wait complete. 2024-09-21T07:33:50.680 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:33:50.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:50.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- 172.21.15.64:0/1296188643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 msgr2=0x7f7064070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 --2- 172.21.15.64:0/1296188643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f7064070880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7054009840 tx=0x7f705401c6d0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- 172.21.15.64:0/1296188643 shutdown_connections 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 --2- 172.21.15.64:0/1296188643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f7064070880 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- 172.21.15.64:0/1296188643 >> 172.21.15.64:0/1296188643 conn(0x7f706406e890 msgr2=0x7f70640b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- 172.21.15.64:0/1296188643 shutdown_connections 2024-09-21T07:33:50.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- 172.21.15.64:0/1296188643 wait complete. 2024-09-21T07:33:50.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 Processor -- start 2024-09-21T07:33:50.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.843+0000 7f706b400640 1 -- start start 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f70641f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f70640c8f80 0x7f70640ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f706416af70 con 0x7f7064149790 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f706416adf0 con 0x7f706415c660 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f706416b0f0 con 0x7f70640c8f80 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33304/0 (socket says 172.21.15.64:33304) 2024-09-21T07:33:50.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 -- 172.21.15.64:0/2227793378 learned_addr learned my addr 172.21.15.64:0/2227793378 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:50.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7068a00640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f70641f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f705be00640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f70640c8f80 0x7f70640ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 -- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f70640c8f80 msgr2=0x7f70640ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f70640c8f80 0x7f70640ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 -- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 msgr2=0x7f70641f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f70641f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 -- 172.21.15.64:0/2227793378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70640b2100 con 0x7f7064149790 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7069400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ca70 tx=0x7f705c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c016020 con 0x7f7064149790 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f705c00a930 con 0x7f7064149790 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70640b23e0 con 0x7f7064149790 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c00ad60 con 0x7f7064149790 2024-09-21T07:33:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7064149ba0 con 0x7f7064149790 2024-09-21T07:33:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.847+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7064160480 con 0x7f7064149790 2024-09-21T07:33:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.851+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f705c019020 con 0x7f7064149790 2024-09-21T07:33:50.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.851+0000 7f7061600640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 0x7f7040075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.851+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f705c0948b0 con 0x7f7064149790 2024-09-21T07:33:50.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.851+0000 7f7068a00640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 0x7f7040075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.851+0000 7f7068a00640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 0x7f7040075710 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f70540af000 tx=0x7f705401af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:50.855+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f705c020020 con 0x7f7064149790 2024-09-21T07:33:51.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.071+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7064157870 con 0x7f7064149790 2024-09-21T07:33:51.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.071+0000 7f7061600640 1 -- 172.21.15.64:0/2227793378 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f705c05f1e0 con 0x7f7064149790 2024-09-21T07:33:51.072 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:51.073 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:33:51.073 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 msgr2=0x7f7040075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 0x7f7040075710 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f70540af000 tx=0x7f705401af10 comp rx=0 tx=0).stop 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 msgr2=0x7f706415a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ca70 tx=0x7f705c00cb60 comp rx=0 tx=0).stop 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 shutdown_connections 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7040073200 0x7f7040075710 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7064149790 0x7f706415a480 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f70640c8f80 0x7f70640ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 --2- 172.21.15.64:0/2227793378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f706415c660 0x7f70641f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 >> 172.21.15.64:0/2227793378 conn(0x7f706406e890 msgr2=0x7f7064159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 shutdown_connections 2024-09-21T07:33:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.075+0000 7f706b400640 1 -- 172.21.15.64:0/2227793378 wait complete. 2024-09-21T07:33:51.095 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- 172.21.15.64:0/3464597160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f040b4700 msgr2=0x7f4f04072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 --2- 172.21.15.64:0/3464597160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f040b4700 0x7f4f04072e20 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f4f040c3c60 tx=0x7f4efc01cd20 comp rx=0 tx=0).stop 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- 172.21.15.64:0/3464597160 shutdown_connections 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 --2- 172.21.15.64:0/3464597160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f040b4700 0x7f4f04072e20 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 --2- 172.21.15.64:0/3464597160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040709b0 0x7f4f040b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 --2- 172.21.15.64:0/3464597160 >> v2:172.21.15.90:3300/0 conn(0x7f4f0415edb0 0x7f4f040700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- 172.21.15.64:0/3464597160 >> 172.21.15.64:0/3464597160 conn(0x7f4f040ccbe0 msgr2=0x7f4f040ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- 172.21.15.64:0/3464597160 shutdown_connections 2024-09-21T07:33:51.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- 172.21.15.64:0/3464597160 wait complete. 2024-09-21T07:33:51.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 Processor -- start 2024-09-21T07:33:51.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.255+0000 7f4f0a600640 1 -- start start 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f040709b0 0x7f4f040adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040b4700 0x7f4f040aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f040b23d0 con 0x7f4f0415edb0 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f040b2250 con 0x7f4f040709b0 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040b2550 con 0x7f4f040b4700 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33320/0 (socket says 172.21.15.64:33320) 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 -- 172.21.15.64:0/1818030548 learned_addr learned my addr 172.21.15.64:0/1818030548 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03400640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f040709b0 0x7f4f040adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4efbe00640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040b4700 0x7f4f040aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 -- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040b4700 msgr2=0x7f4f040aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040b4700 0x7f4f040aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 -- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f040709b0 msgr2=0x7f4f040adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f040709b0 0x7f4f040adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 -- 172.21.15.64:0/1818030548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f041fa460 con 0x7f4f0415edb0 2024-09-21T07:33:51.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f03e00640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009bd0 tx=0x7f4efc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0bb070 con 0x7f4f0415edb0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4efc0a5e50 con 0x7f4f0415edb0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0b2040 con 0x7f4f0415edb0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f041fa740 con 0x7f4f0415edb0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f041fad00 con 0x7f4f0415edb0 2024-09-21T07:33:51.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.259+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f04072e20 con 0x7f4f0415edb0 2024-09-21T07:33:51.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.263+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4efc0be070 con 0x7f4f0415edb0 2024-09-21T07:33:51.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.263+0000 7f4efb400640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 0x7f4ee0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.263+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f4efc12e0f0 con 0x7f4f0415edb0 2024-09-21T07:33:51.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.263+0000 7f4f03400640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 0x7f4ee0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.263+0000 7f4f03400640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 0x7f4ee0075740 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400bb50 tx=0x7f4ef400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.267+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4efc016970 con 0x7f4f0415edb0 2024-09-21T07:33:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.443+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f040750e0 con 0x7f4f0415edb0 2024-09-21T07:33:51.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4efb400640 1 -- 172.21.15.64:0/1818030548 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16896 (secure 0 0 0) 0x7f4efc0f8930 con 0x7f4f0415edb0 2024-09-21T07:33:51.445 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:51.445 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":167,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:33:48.627267+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:33:44.789416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-21T07:33:45.996202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:51.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 msgr2=0x7f4ee0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 0x7f4ee0075740 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400bb50 tx=0x7f4ef400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 msgr2=0x7f4f0415c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009bd0 tx=0x7f4efc005b00 comp rx=0 tx=0).stop 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 shutdown_connections 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4ee0073230 0x7f4ee0075740 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0415edb0 0x7f4f0415c170 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f040b4700 0x7f4f040aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 --2- 172.21.15.64:0/1818030548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f040709b0 0x7f4f040adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 >> 172.21.15.64:0/1818030548 conn(0x7f4f040ccbe0 msgr2=0x7f4f040b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 shutdown_connections 2024-09-21T07:33:51.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.447+0000 7f4f0a600640 1 -- 172.21.15.64:0/1818030548 wait complete. 2024-09-21T07:33:51.469 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:33:51.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:33:51.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 -- 172.21.15.64:0/3765671309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 msgr2=0x7fac840b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 --2- 172.21.15.64:0/3765671309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840b1be0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009930 tx=0x7fac6c01c8b0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 -- 172.21.15.64:0/3765671309 shutdown_connections 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 --2- 172.21.15.64:0/3765671309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840b1be0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 --2- 172.21.15.64:0/3765671309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac8415cbd0 0x7fac84070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 -- 172.21.15.64:0/3765671309 >> 172.21.15.64:0/3765671309 conn(0x7fac840ccbe0 msgr2=0x7fac840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 -- 172.21.15.64:0/3765671309 shutdown_connections 2024-09-21T07:33:51.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.627+0000 7fac8ac00640 1 -- 172.21.15.64:0/3765671309 wait complete. 2024-09-21T07:33:51.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 Processor -- start 2024-09-21T07:33:51.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 -- start start 2024-09-21T07:33:51.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 0x7fac841527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 0x7fac8415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b4150 con 0x7fac84070850 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b3fd0 con 0x7fac8415cbd0 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac8ac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac840b42d0 con 0x7fac840b2120 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33336/0 (socket says 172.21.15.64:33336) 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.631+0000 7fac83e00640 1 -- 172.21.15.64:0/823469126 learned_addr learned my addr 172.21.15.64:0/823469126 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac88c00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 0x7fac8415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac7be00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 0x7fac841527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 -- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 msgr2=0x7fac841527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 0x7fac841527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 -- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 msgr2=0x7fac8415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 0x7fac8415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 -- 172.21.15.64:0/823469126 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840aee40 con 0x7fac84070850 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac88c00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 0x7fac8415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac7be00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 0x7fac841527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac83e00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fac7400d750 tx=0x7fac7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74017070 con 0x7fac84070850 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac74009d20 con 0x7fac84070850 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac840ae880 con 0x7fac84070850 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74005280 con 0x7fac84070850 2024-09-21T07:33:51.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac840c7f20 con 0x7fac84070850 2024-09-21T07:33:51.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac841f9420 con 0x7fac84070850 2024-09-21T07:33:51.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.635+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac74005420 con 0x7fac84070850 2024-09-21T07:33:51.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.639+0000 7fac80c00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 0x7fac60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.639+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fac740944a0 con 0x7fac84070850 2024-09-21T07:33:51.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.639+0000 7fac7be00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 0x7fac60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.639+0000 7fac7be00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 0x7fac60075710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0af000 tx=0x7fac6c01b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.643+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fac7400de60 con 0x7fac84070850 2024-09-21T07:33:51.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.815+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac841f9920 con 0x7fac60073200 2024-09-21T07:33:51.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.823+0000 7fac80c00640 1 -- 172.21.15.64:0/823469126 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250947 (secure 0 0 0) 0x7fac841f9920 con 0x7fac60073200 2024-09-21T07:33:51.824 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:51.825 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:33:51.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 msgr2=0x7fac60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 0x7fac60075710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0af000 tx=0x7fac6c01b0f0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 msgr2=0x7fac840c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fac7400d750 tx=0x7fac7400dc10 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 shutdown_connections 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac60073200 0x7fac60075710 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac8415cbd0 0x7fac8415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac840b2120 0x7fac841527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 --2- 172.21.15.64:0/823469126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac84070850 0x7fac840c9ab0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 >> 172.21.15.64:0/823469126 conn(0x7fac840ccbe0 msgr2=0x7fac840b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 shutdown_connections 2024-09-21T07:33:51.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:51.827+0000 7fac8ac00640 1 -- 172.21.15.64:0/823469126 wait complete. 2024-09-21T07:33:51.845 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-21T07:33:51.605099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":440368,"kb_used_data":17320,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754534352,"statfs":{"total":773094113280,"available":772643176448,"internally_reserved":0,"allocated":17735680,"data_stored":8965952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":432983603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.628655+0000","last_change":"2024-09-21T07:33:47.625720+0000","last_active":"2024-09-21T07:33:47.628655+0000","last_peered":"2024-09-21T07:33:47.628655+0000","last_clean":"2024-09-21T07:33:47.628655+0000","last_became_active":"2024-09-21T07:33:47.625405+0000","last_became_peered":"2024-09-21T07:33:47.625405+0000","last_unstale":"2024-09-21T07:33:47.628655+0000","last_undegraded":"2024-09-21T07:33:47.628655+0000","last_fullsized":"2024-09-21T07:33:47.628655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:39.184691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608952+0000","last_change":"2024-09-21T07:33:46.608952+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608952+0000","last_undegraded":"2024-09-21T07:33:46.608952+0000","last_fullsized":"2024-09-21T07:33:46.608952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627903+0000","last_change":"2024-09-21T07:33:47.625681+0000","last_active":"2024-09-21T07:33:47.627903+0000","last_peered":"2024-09-21T07:33:47.627903+0000","last_clean":"2024-09-21T07:33:47.627903+0000","last_became_active":"2024-09-21T07:33:47.625335+0000","last_became_peered":"2024-09-21T07:33:47.625335+0000","last_unstale":"2024-09-21T07:33:47.627903+0000","last_undegraded":"2024-09-21T07:33:47.627903+0000","last_fullsized":"2024-09-21T07:33:47.627903+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:43.864741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.639981+0000","last_change":"2024-09-21T07:33:47.633470+0000","last_active":"2024-09-21T07:33:47.639981+0000","last_peered":"2024-09-21T07:33:47.639981+0000","last_clean":"2024-09-21T07:33:47.639981+0000","last_became_active":"2024-09-21T07:33:47.631234+0000","last_became_peered":"2024-09-21T07:33:47.631234+0000","last_unstale":"2024-09-21T07:33:47.639981+0000","last_undegraded":"2024-09-21T07:33:47.639981+0000","last_fullsized":"2024-09-21T07:33:47.639981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:10.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.630756+0000","last_change":"2024-09-21T07:33:47.630664+0000","last_active":"2024-09-21T07:33:47.630756+0000","last_peered":"2024-09-21T07:33:47.630756+0000","last_clean":"2024-09-21T07:33:47.630756+0000","last_became_active":"2024-09-21T07:33:47.630362+0000","last_became_peered":"2024-09-21T07:33:47.630362+0000","last_unstale":"2024-09-21T07:33:47.630756+0000","last_undegraded":"2024-09-21T07:33:47.630756+0000","last_fullsized":"2024-09-21T07:33:47.630756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:09.697464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612223+0000","last_change":"2024-09-21T07:33:46.612223+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612223+0000","last_undegraded":"2024-09-21T07:33:46.612223+0000","last_fullsized":"2024-09-21T07:33:46.612223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645051+0000","last_change":"2024-09-21T07:33:47.641086+0000","last_active":"2024-09-21T07:33:47.645051+0000","last_peered":"2024-09-21T07:33:47.645051+0000","last_clean":"2024-09-21T07:33:47.645051+0000","last_became_active":"2024-09-21T07:33:47.640738+0000","last_became_peered":"2024-09-21T07:33:47.640738+0000","last_unstale":"2024-09-21T07:33:47.645051+0000","last_undegraded":"2024-09-21T07:33:47.645051+0000","last_fullsized":"2024-09-21T07:33:47.645051+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:10.534281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647269+0000","last_change":"2024-09-21T07:33:47.641177+0000","last_active":"2024-09-21T07:33:47.647269+0000","last_peered":"2024-09-21T07:33:47.647269+0000","last_clean":"2024-09-21T07:33:47.647269+0000","last_became_active":"2024-09-21T07:33:47.640519+0000","last_became_peered":"2024-09-21T07:33:47.640519+0000","last_unstale":"2024-09-21T07:33:47.647269+0000","last_undegraded":"2024-09-21T07:33:47.647269+0000","last_fullsized":"2024-09-21T07:33:47.647269+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:59.630563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.653039+0000","last_change":"2024-09-21T07:33:47.648250+0000","last_active":"2024-09-21T07:33:47.653039+0000","last_peered":"2024-09-21T07:33:47.653039+0000","last_clean":"2024-09-21T07:33:47.653039+0000","last_became_active":"2024-09-21T07:33:47.647932+0000","last_became_peered":"2024-09-21T07:33:47.647932+0000","last_unstale":"2024-09-21T07:33:47.653039+0000","last_undegraded":"2024-09-21T07:33:47.653039+0000","last_fullsized":"2024-09-21T07:33:47.653039+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655569+0000","last_change":"2024-09-21T07:33:47.650131+0000","last_active":"2024-09-21T07:33:47.655569+0000","last_peered":"2024-09-21T07:33:47.655569+0000","last_clean":"2024-09-21T07:33:47.655569+0000","last_became_active":"2024-09-21T07:33:47.649771+0000","last_became_peered":"2024-09-21T07:33:47.649771+0000","last_unstale":"2024-09-21T07:33:47.655569+0000","last_undegraded":"2024-09-21T07:33:47.655569+0000","last_fullsized":"2024-09-21T07:33:47.655569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:25.893560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647649+0000","last_change":"2024-09-21T07:33:47.639979+0000","last_active":"2024-09-21T07:33:47.647649+0000","last_peered":"2024-09-21T07:33:47.647649+0000","last_clean":"2024-09-21T07:33:47.647649+0000","last_became_active":"2024-09-21T07:33:47.639661+0000","last_became_peered":"2024-09-21T07:33:47.639661+0000","last_unstale":"2024-09-21T07:33:47.647649+0000","last_undegraded":"2024-09-21T07:33:47.647649+0000","last_fullsized":"2024-09-21T07:33:47.647649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:34.175607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609434+0000","last_change":"2024-09-21T07:33:46.609434+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609434+0000","last_undegraded":"2024-09-21T07:33:46.609434+0000","last_fullsized":"2024-09-21T07:33:46.609434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642703+0000","last_change":"2024-09-21T07:33:47.642336+0000","last_active":"2024-09-21T07:33:48.642703+0000","last_peered":"2024-09-21T07:33:48.642703+0000","last_clean":"2024-09-21T07:33:48.642703+0000","last_became_active":"2024-09-21T07:33:47.642063+0000","last_became_peered":"2024-09-21T07:33:47.642063+0000","last_unstale":"2024-09-21T07:33:48.642703+0000","last_undegraded":"2024-09-21T07:33:48.642703+0000","last_fullsized":"2024-09-21T07:33:48.642703+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:53.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.621166+0000","last_change":"2024-09-21T07:33:47.621166+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.621166+0000","last_undegraded":"2024-09-21T07:33:47.621166+0000","last_fullsized":"2024-09-21T07:33:47.621166+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647814+0000","last_change":"2024-09-21T07:33:47.643740+0000","last_active":"2024-09-21T07:33:47.647814+0000","last_peered":"2024-09-21T07:33:47.647814+0000","last_clean":"2024-09-21T07:33:47.647814+0000","last_became_active":"2024-09-21T07:33:47.640771+0000","last_became_peered":"2024-09-21T07:33:47.640771+0000","last_unstale":"2024-09-21T07:33:47.647814+0000","last_undegraded":"2024-09-21T07:33:47.647814+0000","last_fullsized":"2024-09-21T07:33:47.647814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:16.925254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637281+0000","last_change":"2024-09-21T07:33:47.632386+0000","last_active":"2024-09-21T07:33:47.637281+0000","last_peered":"2024-09-21T07:33:47.637281+0000","last_clean":"2024-09-21T07:33:47.637281+0000","last_became_active":"2024-09-21T07:33:47.631743+0000","last_became_peered":"2024-09-21T07:33:47.631743+0000","last_unstale":"2024-09-21T07:33:47.637281+0000","last_undegraded":"2024-09-21T07:33:47.637281+0000","last_fullsized":"2024-09-21T07:33:47.637281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:11.253008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650242+0000","last_change":"2024-09-21T07:33:47.646697+0000","last_active":"2024-09-21T07:33:47.650242+0000","last_peered":"2024-09-21T07:33:47.650242+0000","last_clean":"2024-09-21T07:33:47.650242+0000","last_became_active":"2024-09-21T07:33:47.646388+0000","last_became_peered":"2024-09-21T07:33:47.646388+0000","last_unstale":"2024-09-21T07:33:47.650242+0000","last_undegraded":"2024-09-21T07:33:47.650242+0000","last_fullsized":"2024-09-21T07:33:47.650242+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620998+0000","last_change":"2024-09-21T07:33:47.620998+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620998+0000","last_undegraded":"2024-09-21T07:33:47.620998+0000","last_fullsized":"2024-09-21T07:33:47.620998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647684+0000","last_change":"2024-09-21T07:33:47.643086+0000","last_active":"2024-09-21T07:33:47.647684+0000","last_peered":"2024-09-21T07:33:47.647684+0000","last_clean":"2024-09-21T07:33:47.647684+0000","last_became_active":"2024-09-21T07:33:47.640786+0000","last_became_peered":"2024-09-21T07:33:47.640786+0000","last_unstale":"2024-09-21T07:33:47.647684+0000","last_undegraded":"2024-09-21T07:33:47.647684+0000","last_fullsized":"2024-09-21T07:33:47.647684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:42.233855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636537+0000","last_change":"2024-09-21T07:33:47.633448+0000","last_active":"2024-09-21T07:33:47.636537+0000","last_peered":"2024-09-21T07:33:47.636537+0000","last_clean":"2024-09-21T07:33:47.636537+0000","last_became_active":"2024-09-21T07:33:47.633066+0000","last_became_peered":"2024-09-21T07:33:47.633066+0000","last_unstale":"2024-09-21T07:33:47.636537+0000","last_undegraded":"2024-09-21T07:33:47.636537+0000","last_fullsized":"2024-09-21T07:33:47.636537+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:16.784821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642952+0000","last_change":"2024-09-21T07:33:47.629236+0000","last_active":"2024-09-21T07:33:48.642952+0000","last_peered":"2024-09-21T07:33:48.642952+0000","last_clean":"2024-09-21T07:33:48.642952+0000","last_became_active":"2024-09-21T07:33:47.628957+0000","last_became_peered":"2024-09-21T07:33:47.628957+0000","last_unstale":"2024-09-21T07:33:48.642952+0000","last_undegraded":"2024-09-21T07:33:48.642952+0000","last_fullsized":"2024-09-21T07:33:48.642952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:22.566695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608721+0000","last_change":"2024-09-21T07:33:46.608721+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608721+0000","last_undegraded":"2024-09-21T07:33:46.608721+0000","last_fullsized":"2024-09-21T07:33:46.608721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633662+0000","last_change":"2024-09-21T07:33:47.633569+0000","last_active":"2024-09-21T07:33:47.633662+0000","last_peered":"2024-09-21T07:33:47.633662+0000","last_clean":"2024-09-21T07:33:47.633662+0000","last_became_active":"2024-09-21T07:33:47.632464+0000","last_became_peered":"2024-09-21T07:33:47.632464+0000","last_unstale":"2024-09-21T07:33:47.633662+0000","last_undegraded":"2024-09-21T07:33:47.633662+0000","last_fullsized":"2024-09-21T07:33:47.633662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:34.907981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637311+0000","last_change":"2024-09-21T07:33:47.632731+0000","last_active":"2024-09-21T07:33:47.637311+0000","last_peered":"2024-09-21T07:33:47.637311+0000","last_clean":"2024-09-21T07:33:47.637311+0000","last_became_active":"2024-09-21T07:33:47.632100+0000","last_became_peered":"2024-09-21T07:33:47.632100+0000","last_unstale":"2024-09-21T07:33:47.637311+0000","last_undegraded":"2024-09-21T07:33:47.637311+0000","last_fullsized":"2024-09-21T07:33:47.637311+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:35.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643809+0000","last_change":"2024-09-21T07:33:47.634716+0000","last_active":"2024-09-21T07:33:48.643809+0000","last_peered":"2024-09-21T07:33:48.643809+0000","last_clean":"2024-09-21T07:33:48.643809+0000","last_became_active":"2024-09-21T07:33:47.634400+0000","last_became_peered":"2024-09-21T07:33:47.634400+0000","last_unstale":"2024-09-21T07:33:48.643809+0000","last_undegraded":"2024-09-21T07:33:48.643809+0000","last_fullsized":"2024-09-21T07:33:48.643809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:56.119446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635434+0000","last_change":"2024-09-21T07:33:47.632215+0000","last_active":"2024-09-21T07:33:47.635434+0000","last_peered":"2024-09-21T07:33:47.635434+0000","last_clean":"2024-09-21T07:33:47.635434+0000","last_became_active":"2024-09-21T07:33:47.631762+0000","last_became_peered":"2024-09-21T07:33:47.631762+0000","last_unstale":"2024-09-21T07:33:47.635434+0000","last_undegraded":"2024-09-21T07:33:47.635434+0000","last_fullsized":"2024-09-21T07:33:47.635434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:53.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613896+0000","last_change":"2024-09-21T07:33:46.613896+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613896+0000","last_undegraded":"2024-09-21T07:33:46.613896+0000","last_fullsized":"2024-09-21T07:33:46.613896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643015+0000","last_change":"2024-09-21T07:33:47.631128+0000","last_active":"2024-09-21T07:33:48.643015+0000","last_peered":"2024-09-21T07:33:48.643015+0000","last_clean":"2024-09-21T07:33:48.643015+0000","last_became_active":"2024-09-21T07:33:47.626470+0000","last_became_peered":"2024-09-21T07:33:47.626470+0000","last_unstale":"2024-09-21T07:33:48.643015+0000","last_undegraded":"2024-09-21T07:33:48.643015+0000","last_fullsized":"2024-09-21T07:33:48.643015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:16.850891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.614301+0000","last_change":"2024-09-21T07:33:46.614301+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.614301+0000","last_undegraded":"2024-09-21T07:33:46.614301+0000","last_fullsized":"2024-09-21T07:33:46.614301+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.618315+0000","last_change":"2024-09-21T07:33:47.618315+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.618315+0000","last_undegraded":"2024-09-21T07:33:47.618315+0000","last_fullsized":"2024-09-21T07:33:47.618315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647785+0000","last_change":"2024-09-21T07:33:47.640296+0000","last_active":"2024-09-21T07:33:47.647785+0000","last_peered":"2024-09-21T07:33:47.647785+0000","last_clean":"2024-09-21T07:33:47.647785+0000","last_became_active":"2024-09-21T07:33:47.639859+0000","last_became_peered":"2024-09-21T07:33:47.639859+0000","last_unstale":"2024-09-21T07:33:47.647785+0000","last_undegraded":"2024-09-21T07:33:47.647785+0000","last_fullsized":"2024-09-21T07:33:47.647785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:20.740598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634628+0000","last_change":"2024-09-21T07:33:47.632301+0000","last_active":"2024-09-21T07:33:47.634628+0000","last_peered":"2024-09-21T07:33:47.634628+0000","last_clean":"2024-09-21T07:33:47.634628+0000","last_became_active":"2024-09-21T07:33:47.631997+0000","last_became_peered":"2024-09-21T07:33:47.631997+0000","last_unstale":"2024-09-21T07:33:47.634628+0000","last_undegraded":"2024-09-21T07:33:47.634628+0000","last_fullsized":"2024-09-21T07:33:47.634628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:13.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609249+0000","last_change":"2024-09-21T07:33:46.609249+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609249+0000","last_undegraded":"2024-09-21T07:33:46.609249+0000","last_fullsized":"2024-09-21T07:33:46.609249+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614971+0000","last_change":"2024-09-21T07:33:46.621829+0000","last_active":"2024-09-21T07:33:47.614971+0000","last_peered":"2024-09-21T07:33:47.614971+0000","last_clean":"2024-09-21T07:33:47.614971+0000","last_became_active":"2024-09-21T07:33:46.621108+0000","last_became_peered":"2024-09-21T07:33:46.621108+0000","last_unstale":"2024-09-21T07:33:47.614971+0000","last_undegraded":"2024-09-21T07:33:47.614971+0000","last_fullsized":"2024-09-21T07:33:47.614971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:49.328101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642339+0000","last_change":"2024-09-21T07:33:47.633401+0000","last_active":"2024-09-21T07:33:48.642339+0000","last_peered":"2024-09-21T07:33:48.642339+0000","last_clean":"2024-09-21T07:33:48.642339+0000","last_became_active":"2024-09-21T07:33:47.633086+0000","last_became_peered":"2024-09-21T07:33:47.633086+0000","last_unstale":"2024-09-21T07:33:48.642339+0000","last_undegraded":"2024-09-21T07:33:48.642339+0000","last_fullsized":"2024-09-21T07:33:48.642339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:35.443908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627767+0000","last_change":"2024-09-21T07:33:46.629787+0000","last_active":"2024-09-21T07:33:47.627767+0000","last_peered":"2024-09-21T07:33:47.627767+0000","last_clean":"2024-09-21T07:33:47.627767+0000","last_became_active":"2024-09-21T07:33:46.629432+0000","last_became_peered":"2024-09-21T07:33:46.629432+0000","last_unstale":"2024-09-21T07:33:47.627767+0000","last_undegraded":"2024-09-21T07:33:47.627767+0000","last_fullsized":"2024-09-21T07:33:47.627767+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:20.018028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620779+0000","last_change":"2024-09-21T07:33:47.620779+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620779+0000","last_undegraded":"2024-09-21T07:33:47.620779+0000","last_fullsized":"2024-09-21T07:33:47.620779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.620530+0000","last_change":"2024-09-21T07:33:46.627109+0000","last_active":"2024-09-21T07:33:47.620530+0000","last_peered":"2024-09-21T07:33:47.620530+0000","last_clean":"2024-09-21T07:33:47.620530+0000","last_became_active":"2024-09-21T07:33:46.626791+0000","last_became_peered":"2024-09-21T07:33:46.626791+0000","last_unstale":"2024-09-21T07:33:47.620530+0000","last_undegraded":"2024-09-21T07:33:47.620530+0000","last_fullsized":"2024-09-21T07:33:47.620530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:27.963968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.610637+0000","last_change":"2024-09-21T07:33:46.610637+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.610637+0000","last_undegraded":"2024-09-21T07:33:46.610637+0000","last_fullsized":"2024-09-21T07:33:46.610637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615697+0000","last_change":"2024-09-21T07:33:46.628812+0000","last_active":"2024-09-21T07:33:47.615697+0000","last_peered":"2024-09-21T07:33:47.615697+0000","last_clean":"2024-09-21T07:33:47.615697+0000","last_became_active":"2024-09-21T07:33:46.628282+0000","last_became_peered":"2024-09-21T07:33:46.628282+0000","last_unstale":"2024-09-21T07:33:47.615697+0000","last_undegraded":"2024-09-21T07:33:47.615697+0000","last_fullsized":"2024-09-21T07:33:47.615697+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.194913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.656287+0000","last_change":"2024-09-21T07:33:47.650503+0000","last_active":"2024-09-21T07:33:47.656287+0000","last_peered":"2024-09-21T07:33:47.656287+0000","last_clean":"2024-09-21T07:33:47.656287+0000","last_became_active":"2024-09-21T07:33:47.650188+0000","last_became_peered":"2024-09-21T07:33:47.650188+0000","last_unstale":"2024-09-21T07:33:47.656287+0000","last_undegraded":"2024-09-21T07:33:47.656287+0000","last_fullsized":"2024-09-21T07:33:47.656287+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.846100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.648138+0000","last_change":"2024-09-21T07:33:46.623523+0000","last_active":"2024-09-21T07:33:47.648138+0000","last_peered":"2024-09-21T07:33:47.648138+0000","last_clean":"2024-09-21T07:33:47.648138+0000","last_became_active":"2024-09-21T07:33:46.623174+0000","last_became_peered":"2024-09-21T07:33:46.623174+0000","last_unstale":"2024-09-21T07:33:47.648138+0000","last_undegraded":"2024-09-21T07:33:47.648138+0000","last_fullsized":"2024-09-21T07:33:47.648138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:58.346289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636603+0000","last_change":"2024-09-21T07:33:47.630806+0000","last_active":"2024-09-21T07:33:47.636603+0000","last_peered":"2024-09-21T07:33:47.636603+0000","last_clean":"2024-09-21T07:33:47.636603+0000","last_became_active":"2024-09-21T07:33:47.630494+0000","last_became_peered":"2024-09-21T07:33:47.630494+0000","last_unstale":"2024-09-21T07:33:47.636603+0000","last_undegraded":"2024-09-21T07:33:47.636603+0000","last_fullsized":"2024-09-21T07:33:47.636603+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.316252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.625009+0000","last_change":"2024-09-21T07:33:46.608788+0000","last_active":"2024-09-21T07:33:47.625009+0000","last_peered":"2024-09-21T07:33:47.625009+0000","last_clean":"2024-09-21T07:33:47.625009+0000","last_became_active":"2024-09-21T07:33:46.608428+0000","last_became_peered":"2024-09-21T07:33:46.608428+0000","last_unstale":"2024-09-21T07:33:47.625009+0000","last_undegraded":"2024-09-21T07:33:47.625009+0000","last_fullsized":"2024-09-21T07:33:47.625009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:24.973246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634160+0000","last_change":"2024-09-21T07:33:47.624817+0000","last_active":"2024-09-21T07:33:47.634160+0000","last_peered":"2024-09-21T07:33:47.634160+0000","last_clean":"2024-09-21T07:33:47.634160+0000","last_became_active":"2024-09-21T07:33:47.624500+0000","last_became_peered":"2024-09-21T07:33:47.624500+0000","last_unstale":"2024-09-21T07:33:47.634160+0000","last_undegraded":"2024-09-21T07:33:47.634160+0000","last_fullsized":"2024-09-21T07:33:47.634160+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:36.647441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618360+0000","last_change":"2024-09-21T07:33:46.629058+0000","last_active":"2024-09-21T07:33:47.618360+0000","last_peered":"2024-09-21T07:33:47.618360+0000","last_clean":"2024-09-21T07:33:47.618360+0000","last_became_active":"2024-09-21T07:33:46.628579+0000","last_became_peered":"2024-09-21T07:33:46.628579+0000","last_unstale":"2024-09-21T07:33:47.618360+0000","last_undegraded":"2024-09-21T07:33:47.618360+0000","last_fullsized":"2024-09-21T07:33:47.618360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:58.077760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.641218+0000","last_change":"2024-09-21T07:33:47.635770+0000","last_active":"2024-09-21T07:33:47.641218+0000","last_peered":"2024-09-21T07:33:47.641218+0000","last_clean":"2024-09-21T07:33:47.641218+0000","last_became_active":"2024-09-21T07:33:47.635454+0000","last_became_peered":"2024-09-21T07:33:47.635454+0000","last_unstale":"2024-09-21T07:33:47.641218+0000","last_undegraded":"2024-09-21T07:33:47.641218+0000","last_fullsized":"2024-09-21T07:33:47.641218+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:53.974927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624650+0000","last_change":"2024-09-21T07:33:46.626183+0000","last_active":"2024-09-21T07:33:47.624650+0000","last_peered":"2024-09-21T07:33:47.624650+0000","last_clean":"2024-09-21T07:33:47.624650+0000","last_became_active":"2024-09-21T07:33:46.625875+0000","last_became_peered":"2024-09-21T07:33:46.625875+0000","last_unstale":"2024-09-21T07:33:47.624650+0000","last_undegraded":"2024-09-21T07:33:47.624650+0000","last_fullsized":"2024-09-21T07:33:47.624650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.173888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613127+0000","last_change":"2024-09-21T07:33:46.613127+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613127+0000","last_undegraded":"2024-09-21T07:33:46.613127+0000","last_fullsized":"2024-09-21T07:33:46.613127+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643517+0000","last_change":"2024-09-21T07:33:46.627781+0000","last_active":"2024-09-21T07:33:48.643517+0000","last_peered":"2024-09-21T07:33:48.643517+0000","last_clean":"2024-09-21T07:33:48.643517+0000","last_became_active":"2024-09-21T07:33:46.627385+0000","last_became_peered":"2024-09-21T07:33:46.627385+0000","last_unstale":"2024-09-21T07:33:48.643517+0000","last_undegraded":"2024-09-21T07:33:48.643517+0000","last_fullsized":"2024-09-21T07:33:48.643517+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:55.725847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642572+0000","last_change":"2024-09-21T07:33:47.639144+0000","last_active":"2024-09-21T07:33:48.642572+0000","last_peered":"2024-09-21T07:33:48.642572+0000","last_clean":"2024-09-21T07:33:48.642572+0000","last_became_active":"2024-09-21T07:33:47.638831+0000","last_became_peered":"2024-09-21T07:33:47.638831+0000","last_unstale":"2024-09-21T07:33:48.642572+0000","last_undegraded":"2024-09-21T07:33:48.642572+0000","last_fullsized":"2024-09-21T07:33:48.642572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.804124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614671+0000","last_change":"2024-09-21T07:33:46.618197+0000","last_active":"2024-09-21T07:33:47.614671+0000","last_peered":"2024-09-21T07:33:47.614671+0000","last_clean":"2024-09-21T07:33:47.614671+0000","last_became_active":"2024-09-21T07:33:46.617845+0000","last_became_peered":"2024-09-21T07:33:46.617845+0000","last_unstale":"2024-09-21T07:33:47.614671+0000","last_undegraded":"2024-09-21T07:33:47.614671+0000","last_fullsized":"2024-09-21T07:33:47.614671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:40.942593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636657+0000","last_change":"2024-09-21T07:33:47.633080+0000","last_active":"2024-09-21T07:33:47.636657+0000","last_peered":"2024-09-21T07:33:47.636657+0000","last_clean":"2024-09-21T07:33:47.636657+0000","last_became_active":"2024-09-21T07:33:47.632770+0000","last_became_peered":"2024-09-21T07:33:47.632770+0000","last_unstale":"2024-09-21T07:33:47.636657+0000","last_undegraded":"2024-09-21T07:33:47.636657+0000","last_fullsized":"2024-09-21T07:33:47.636657+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:26.206243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643087+0000","last_change":"2024-09-21T07:33:46.624386+0000","last_active":"2024-09-21T07:33:48.643087+0000","last_peered":"2024-09-21T07:33:48.643087+0000","last_clean":"2024-09-21T07:33:48.643087+0000","last_became_active":"2024-09-21T07:33:46.622664+0000","last_became_peered":"2024-09-21T07:33:46.622664+0000","last_unstale":"2024-09-21T07:33:48.643087+0000","last_undegraded":"2024-09-21T07:33:48.643087+0000","last_fullsized":"2024-09-21T07:33:48.643087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.642393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633788+0000","last_change":"2024-09-21T07:33:47.632859+0000","last_active":"2024-09-21T07:33:47.633788+0000","last_peered":"2024-09-21T07:33:47.633788+0000","last_clean":"2024-09-21T07:33:47.633788+0000","last_became_active":"2024-09-21T07:33:47.632480+0000","last_became_peered":"2024-09-21T07:33:47.632480+0000","last_unstale":"2024-09-21T07:33:47.633788+0000","last_undegraded":"2024-09-21T07:33:47.633788+0000","last_fullsized":"2024-09-21T07:33:47.633788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:37.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626018+0000","last_change":"2024-09-21T07:33:46.618752+0000","last_active":"2024-09-21T07:33:47.626018+0000","last_peered":"2024-09-21T07:33:47.626018+0000","last_clean":"2024-09-21T07:33:47.626018+0000","last_became_active":"2024-09-21T07:33:46.617838+0000","last_became_peered":"2024-09-21T07:33:46.617838+0000","last_unstale":"2024-09-21T07:33:47.626018+0000","last_undegraded":"2024-09-21T07:33:47.626018+0000","last_fullsized":"2024-09-21T07:33:47.626018+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.349802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646073+0000","last_change":"2024-09-21T07:33:47.643524+0000","last_active":"2024-09-21T07:33:47.646073+0000","last_peered":"2024-09-21T07:33:47.646073+0000","last_clean":"2024-09-21T07:33:47.646073+0000","last_became_active":"2024-09-21T07:33:47.643202+0000","last_became_peered":"2024-09-21T07:33:47.643202+0000","last_unstale":"2024-09-21T07:33:47.646073+0000","last_undegraded":"2024-09-21T07:33:47.646073+0000","last_fullsized":"2024-09-21T07:33:47.646073+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:39.768719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642752+0000","last_change":"2024-09-21T07:33:46.608302+0000","last_active":"2024-09-21T07:33:48.642752+0000","last_peered":"2024-09-21T07:33:48.642752+0000","last_clean":"2024-09-21T07:33:48.642752+0000","last_became_active":"2024-09-21T07:33:46.607990+0000","last_became_peered":"2024-09-21T07:33:46.607990+0000","last_unstale":"2024-09-21T07:33:48.642752+0000","last_undegraded":"2024-09-21T07:33:48.642752+0000","last_fullsized":"2024-09-21T07:33:48.642752+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:19.640505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.644246+0000","last_change":"2024-09-21T07:33:47.636878+0000","last_active":"2024-09-21T07:33:47.644246+0000","last_peered":"2024-09-21T07:33:47.644246+0000","last_clean":"2024-09-21T07:33:47.644246+0000","last_became_active":"2024-09-21T07:33:47.636386+0000","last_became_peered":"2024-09-21T07:33:47.636386+0000","last_unstale":"2024-09-21T07:33:47.644246+0000","last_undegraded":"2024-09-21T07:33:47.644246+0000","last_fullsized":"2024-09-21T07:33:47.644246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:03.374135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.621926+0000","last_change":"2024-09-21T07:33:46.618935+0000","last_active":"2024-09-21T07:33:47.621926+0000","last_peered":"2024-09-21T07:33:47.621926+0000","last_clean":"2024-09-21T07:33:47.621926+0000","last_became_active":"2024-09-21T07:33:46.618440+0000","last_became_peered":"2024-09-21T07:33:46.618440+0000","last_unstale":"2024-09-21T07:33:47.621926+0000","last_undegraded":"2024-09-21T07:33:47.621926+0000","last_fullsized":"2024-09-21T07:33:47.621926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:42.515209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637419+0000","last_change":"2024-09-21T07:33:47.635158+0000","last_active":"2024-09-21T07:33:47.637419+0000","last_peered":"2024-09-21T07:33:47.637419+0000","last_clean":"2024-09-21T07:33:47.637419+0000","last_became_active":"2024-09-21T07:33:47.631190+0000","last_became_peered":"2024-09-21T07:33:47.631190+0000","last_unstale":"2024-09-21T07:33:47.637419+0000","last_undegraded":"2024-09-21T07:33:47.637419+0000","last_fullsized":"2024-09-21T07:33:47.637419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:57.182476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.651436+0000","last_change":"2024-09-21T07:33:46.622115+0000","last_active":"2024-09-21T07:33:47.651436+0000","last_peered":"2024-09-21T07:33:47.651436+0000","last_clean":"2024-09-21T07:33:47.651436+0000","last_became_active":"2024-09-21T07:33:46.621741+0000","last_became_peered":"2024-09-21T07:33:46.621741+0000","last_unstale":"2024-09-21T07:33:47.651436+0000","last_undegraded":"2024-09-21T07:33:47.651436+0000","last_fullsized":"2024-09-21T07:33:47.651436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:09.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645042+0000","last_change":"2024-09-21T07:33:47.640834+0000","last_active":"2024-09-21T07:33:47.645042+0000","last_peered":"2024-09-21T07:33:47.645042+0000","last_clean":"2024-09-21T07:33:47.645042+0000","last_became_active":"2024-09-21T07:33:47.640148+0000","last_became_peered":"2024-09-21T07:33:47.640148+0000","last_unstale":"2024-09-21T07:33:47.645042+0000","last_undegraded":"2024-09-21T07:33:47.645042+0000","last_fullsized":"2024-09-21T07:33:47.645042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:32.615535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643855+0000","last_change":"2024-09-21T07:33:46.616859+0000","last_active":"2024-09-21T07:33:48.643855+0000","last_peered":"2024-09-21T07:33:48.643855+0000","last_clean":"2024-09-21T07:33:48.643855+0000","last_became_active":"2024-09-21T07:33:46.616532+0000","last_became_peered":"2024-09-21T07:33:46.616532+0000","last_unstale":"2024-09-21T07:33:48.643855+0000","last_undegraded":"2024-09-21T07:33:48.643855+0000","last_fullsized":"2024-09-21T07:33:48.643855+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:07.334027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635879+0000","last_change":"2024-09-21T07:33:47.634300+0000","last_active":"2024-09-21T07:33:47.635879+0000","last_peered":"2024-09-21T07:33:47.635879+0000","last_clean":"2024-09-21T07:33:47.635879+0000","last_became_active":"2024-09-21T07:33:47.633771+0000","last_became_peered":"2024-09-21T07:33:47.633771+0000","last_unstale":"2024-09-21T07:33:47.635879+0000","last_undegraded":"2024-09-21T07:33:47.635879+0000","last_fullsized":"2024-09-21T07:33:47.635879+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:26.900131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650706+0000","last_change":"2024-09-21T07:33:46.630896+0000","last_active":"2024-09-21T07:33:47.650706+0000","last_peered":"2024-09-21T07:33:47.650706+0000","last_clean":"2024-09-21T07:33:47.650706+0000","last_became_active":"2024-09-21T07:33:46.630594+0000","last_became_peered":"2024-09-21T07:33:46.630594+0000","last_unstale":"2024-09-21T07:33:47.650706+0000","last_undegraded":"2024-09-21T07:33:47.650706+0000","last_fullsized":"2024-09-21T07:33:47.650706+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:15.215651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645092+0000","last_change":"2024-09-21T07:33:47.639931+0000","last_active":"2024-09-21T07:33:47.645092+0000","last_peered":"2024-09-21T07:33:47.645092+0000","last_clean":"2024-09-21T07:33:47.645092+0000","last_became_active":"2024-09-21T07:33:47.636826+0000","last_became_peered":"2024-09-21T07:33:47.636826+0000","last_unstale":"2024-09-21T07:33:47.645092+0000","last_undegraded":"2024-09-21T07:33:47.645092+0000","last_fullsized":"2024-09-21T07:33:47.645092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:38.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623601+0000","last_change":"2024-09-21T07:33:46.618120+0000","last_active":"2024-09-21T07:33:47.623601+0000","last_peered":"2024-09-21T07:33:47.623601+0000","last_clean":"2024-09-21T07:33:47.623601+0000","last_became_active":"2024-09-21T07:33:46.616030+0000","last_became_peered":"2024-09-21T07:33:46.616030+0000","last_unstale":"2024-09-21T07:33:47.623601+0000","last_undegraded":"2024-09-21T07:33:47.623601+0000","last_fullsized":"2024-09-21T07:33:47.623601+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:32.017754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647351+0000","last_change":"2024-09-21T07:33:47.647224+0000","last_active":"2024-09-21T07:33:47.647351+0000","last_peered":"2024-09-21T07:33:47.647351+0000","last_clean":"2024-09-21T07:33:47.647351+0000","last_became_active":"2024-09-21T07:33:47.646601+0000","last_became_peered":"2024-09-21T07:33:47.646601+0000","last_unstale":"2024-09-21T07:33:47.647351+0000","last_undegraded":"2024-09-21T07:33:47.647351+0000","last_fullsized":"2024-09-21T07:33:47.647351+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:04.972030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635958+0000","last_change":"2024-09-21T07:33:46.621372+0000","last_active":"2024-09-21T07:33:47.635958+0000","last_peered":"2024-09-21T07:33:47.635958+0000","last_clean":"2024-09-21T07:33:47.635958+0000","last_became_active":"2024-09-21T07:33:46.621006+0000","last_became_peered":"2024-09-21T07:33:46.621006+0000","last_unstale":"2024-09-21T07:33:47.635958+0000","last_undegraded":"2024-09-21T07:33:47.635958+0000","last_fullsized":"2024-09-21T07:33:47.635958+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643288+0000","last_change":"2024-09-21T07:33:47.630067+0000","last_active":"2024-09-21T07:33:48.643288+0000","last_peered":"2024-09-21T07:33:48.643288+0000","last_clean":"2024-09-21T07:33:48.643288+0000","last_became_active":"2024-09-21T07:33:47.626995+0000","last_became_peered":"2024-09-21T07:33:47.626995+0000","last_unstale":"2024-09-21T07:33:48.643288+0000","last_undegraded":"2024-09-21T07:33:48.643288+0000","last_fullsized":"2024-09-21T07:33:48.643288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:06.240784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626235+0000","last_change":"2024-09-21T07:33:46.619652+0000","last_active":"2024-09-21T07:33:47.626235+0000","last_peered":"2024-09-21T07:33:47.626235+0000","last_clean":"2024-09-21T07:33:47.626235+0000","last_became_active":"2024-09-21T07:33:46.619267+0000","last_became_peered":"2024-09-21T07:33:46.619267+0000","last_unstale":"2024-09-21T07:33:47.626235+0000","last_undegraded":"2024-09-21T07:33:47.626235+0000","last_fullsized":"2024-09-21T07:33:47.626235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:59.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.623190+0000","last_change":"2024-09-21T07:33:47.623190+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.623190+0000","last_undegraded":"2024-09-21T07:33:47.623190+0000","last_fullsized":"2024-09-21T07:33:47.623190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.619911+0000","last_change":"2024-09-21T07:33:46.614497+0000","last_active":"2024-09-21T07:33:47.619911+0000","last_peered":"2024-09-21T07:33:47.619911+0000","last_clean":"2024-09-21T07:33:47.619911+0000","last_became_active":"2024-09-21T07:33:46.614181+0000","last_became_peered":"2024-09-21T07:33:46.614181+0000","last_unstale":"2024-09-21T07:33:47.619911+0000","last_undegraded":"2024-09-21T07:33:47.619911+0000","last_fullsized":"2024-09-21T07:33:47.619911+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:29.909421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.625374+0000","last_change":"2024-09-21T07:33:47.625374+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.625374+0000","last_undegraded":"2024-09-21T07:33:47.625374+0000","last_fullsized":"2024-09-21T07:33:47.625374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618612+0000","last_change":"2024-09-21T07:33:46.621849+0000","last_active":"2024-09-21T07:33:47.618612+0000","last_peered":"2024-09-21T07:33:47.618612+0000","last_clean":"2024-09-21T07:33:47.618612+0000","last_became_active":"2024-09-21T07:33:46.621232+0000","last_became_peered":"2024-09-21T07:33:46.621232+0000","last_unstale":"2024-09-21T07:33:47.618612+0000","last_undegraded":"2024-09-21T07:33:47.618612+0000","last_fullsized":"2024-09-21T07:33:47.618612+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.193047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612446+0000","last_change":"2024-09-21T07:33:46.612446+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612446+0000","last_undegraded":"2024-09-21T07:33:46.612446+0000","last_fullsized":"2024-09-21T07:33:46.612446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.623747+0000","last_change":"2024-09-21T07:33:46.623165+0000","last_active":"2024-09-21T07:33:46.623747+0000","last_peered":"2024-09-21T07:33:46.623747+0000","last_clean":"2024-09-21T07:33:46.623747+0000","last_became_active":"2024-09-21T07:33:46.622212+0000","last_became_peered":"2024-09-21T07:33:46.622212+0000","last_unstale":"2024-09-21T07:33:46.623747+0000","last_undegraded":"2024-09-21T07:33:46.623747+0000","last_fullsized":"2024-09-21T07:33:46.623747+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:40.821174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.642998+0000","last_change":"2024-09-21T07:33:47.631677+0000","last_active":"2024-09-21T07:33:47.642998+0000","last_peered":"2024-09-21T07:33:47.642998+0000","last_clean":"2024-09-21T07:33:47.642998+0000","last_became_active":"2024-09-21T07:33:47.631353+0000","last_became_peered":"2024-09-21T07:33:47.631353+0000","last_unstale":"2024-09-21T07:33:47.642998+0000","last_undegraded":"2024-09-21T07:33:47.642998+0000","last_fullsized":"2024-09-21T07:33:47.642998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:29.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623959+0000","last_change":"2024-09-21T07:33:46.617084+0000","last_active":"2024-09-21T07:33:47.623959+0000","last_peered":"2024-09-21T07:33:47.623959+0000","last_clean":"2024-09-21T07:33:47.623959+0000","last_became_active":"2024-09-21T07:33:46.616734+0000","last_became_peered":"2024-09-21T07:33:46.616734+0000","last_unstale":"2024-09-21T07:33:47.623959+0000","last_undegraded":"2024-09-21T07:33:47.623959+0000","last_fullsized":"2024-09-21T07:33:47.623959+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:32.230121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646020+0000","last_change":"2024-09-21T07:33:47.642657+0000","last_active":"2024-09-21T07:33:47.646020+0000","last_peered":"2024-09-21T07:33:47.646020+0000","last_clean":"2024-09-21T07:33:47.646020+0000","last_became_active":"2024-09-21T07:33:47.642192+0000","last_became_peered":"2024-09-21T07:33:47.642192+0000","last_unstale":"2024-09-21T07:33:47.646020+0000","last_undegraded":"2024-09-21T07:33:47.646020+0000","last_fullsized":"2024-09-21T07:33:47.646020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:36.500996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"167'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643520+0000","last_change":"2024-09-21T07:33:46.631671+0000","last_active":"2024-09-21T07:33:48.643520+0000","last_peered":"2024-09-21T07:33:48.643520+0000","last_clean":"2024-09-21T07:33:48.643520+0000","last_became_active":"2024-09-21T07:33:46.631252+0000","last_became_peered":"2024-09-21T07:33:46.631252+0000","last_unstale":"2024-09-21T07:33:48.643520+0000","last_undegraded":"2024-09-21T07:33:48.643520+0000","last_fullsized":"2024-09-21T07:33:48.643520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:21.204372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634381+0000","last_change":"2024-09-21T07:33:47.629056+0000","last_active":"2024-09-21T07:33:47.634381+0000","last_peered":"2024-09-21T07:33:47.634381+0000","last_clean":"2024-09-21T07:33:47.634381+0000","last_became_active":"2024-09-21T07:33:47.628712+0000","last_became_peered":"2024-09-21T07:33:47.628712+0000","last_unstale":"2024-09-21T07:33:47.634381+0000","last_undegraded":"2024-09-21T07:33:47.634381+0000","last_fullsized":"2024-09-21T07:33:47.634381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:23.902544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642993+0000","last_change":"2024-09-21T07:33:46.620290+0000","last_active":"2024-09-21T07:33:48.642993+0000","last_peered":"2024-09-21T07:33:48.642993+0000","last_clean":"2024-09-21T07:33:48.642993+0000","last_became_active":"2024-09-21T07:33:46.619866+0000","last_became_peered":"2024-09-21T07:33:46.619866+0000","last_unstale":"2024-09-21T07:33:48.642993+0000","last_undegraded":"2024-09-21T07:33:48.642993+0000","last_fullsized":"2024-09-21T07:33:48.642993+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.778171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655365+0000","last_change":"2024-09-21T07:33:47.651031+0000","last_active":"2024-09-21T07:33:47.655365+0000","last_peered":"2024-09-21T07:33:47.655365+0000","last_clean":"2024-09-21T07:33:47.655365+0000","last_became_active":"2024-09-21T07:33:47.650740+0000","last_became_peered":"2024-09-21T07:33:47.650740+0000","last_unstale":"2024-09-21T07:33:47.655365+0000","last_undegraded":"2024-09-21T07:33:47.655365+0000","last_fullsized":"2024-09-21T07:33:47.655365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:41.408856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615429+0000","last_change":"2024-09-21T07:33:46.634107+0000","last_active":"2024-09-21T07:33:47.615429+0000","last_peered":"2024-09-21T07:33:47.615429+0000","last_clean":"2024-09-21T07:33:47.615429+0000","last_became_active":"2024-09-21T07:33:46.633497+0000","last_became_peered":"2024-09-21T07:33:46.633497+0000","last_unstale":"2024-09-21T07:33:47.615429+0000","last_undegraded":"2024-09-21T07:33:47.615429+0000","last_fullsized":"2024-09-21T07:33:47.615429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:15.769168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634796+0000","last_change":"2024-09-21T07:33:47.631144+0000","last_active":"2024-09-21T07:33:47.634796+0000","last_peered":"2024-09-21T07:33:47.634796+0000","last_clean":"2024-09-21T07:33:47.634796+0000","last_became_active":"2024-09-21T07:33:47.630009+0000","last_became_peered":"2024-09-21T07:33:47.630009+0000","last_unstale":"2024-09-21T07:33:47.634796+0000","last_undegraded":"2024-09-21T07:33:47.634796+0000","last_fullsized":"2024-09-21T07:33:47.634796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:12.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.613968+0000","last_change":"2024-09-21T07:33:46.619099+0000","last_active":"2024-09-21T07:33:47.613968+0000","last_peered":"2024-09-21T07:33:47.613968+0000","last_clean":"2024-09-21T07:33:47.613968+0000","last_became_active":"2024-09-21T07:33:46.618774+0000","last_became_peered":"2024-09-21T07:33:46.618774+0000","last_unstale":"2024-09-21T07:33:47.613968+0000","last_undegraded":"2024-09-21T07:33:47.613968+0000","last_fullsized":"2024-09-21T07:33:47.613968+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:37.526034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.611062+0000","last_change":"2024-09-21T07:33:46.611062+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.611062+0000","last_undegraded":"2024-09-21T07:33:46.611062+0000","last_fullsized":"2024-09-21T07:33:46.611062+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642639+0000","last_change":"2024-09-21T07:33:46.629792+0000","last_active":"2024-09-21T07:33:48.642639+0000","last_peered":"2024-09-21T07:33:48.642639+0000","last_clean":"2024-09-21T07:33:48.642639+0000","last_became_active":"2024-09-21T07:33:46.628571+0000","last_became_peered":"2024-09-21T07:33:46.628571+0000","last_unstale":"2024-09-21T07:33:48.642639+0000","last_undegraded":"2024-09-21T07:33:48.642639+0000","last_fullsized":"2024-09-21T07:33:48.642639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:12.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643428+0000","last_change":"2024-09-21T07:33:47.632070+0000","last_active":"2024-09-21T07:33:48.643428+0000","last_peered":"2024-09-21T07:33:48.643428+0000","last_clean":"2024-09-21T07:33:48.643428+0000","last_became_active":"2024-09-21T07:33:47.630789+0000","last_became_peered":"2024-09-21T07:33:47.630789+0000","last_unstale":"2024-09-21T07:33:48.643428+0000","last_undegraded":"2024-09-21T07:33:48.643428+0000","last_fullsized":"2024-09-21T07:33:48.643428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:43.272580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.622151+0000","last_change":"2024-09-21T07:33:46.622064+0000","last_active":"2024-09-21T07:33:47.622151+0000","last_peered":"2024-09-21T07:33:47.622151+0000","last_clean":"2024-09-21T07:33:47.622151+0000","last_became_active":"2024-09-21T07:33:46.621756+0000","last_became_peered":"2024-09-21T07:33:46.621756+0000","last_unstale":"2024-09-21T07:33:47.622151+0000","last_undegraded":"2024-09-21T07:33:47.622151+0000","last_fullsized":"2024-09-21T07:33:47.622151+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:20.287855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.616070+0000","last_change":"2024-09-21T07:33:47.616070+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.616070+0000","last_undegraded":"2024-09-21T07:33:47.616070+0000","last_fullsized":"2024-09-21T07:33:47.616070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624227+0000","last_change":"2024-09-21T07:33:46.619268+0000","last_active":"2024-09-21T07:33:47.624227+0000","last_peered":"2024-09-21T07:33:47.624227+0000","last_clean":"2024-09-21T07:33:47.624227+0000","last_became_active":"2024-09-21T07:33:46.618021+0000","last_became_peered":"2024-09-21T07:33:46.618021+0000","last_unstale":"2024-09-21T07:33:47.624227+0000","last_undegraded":"2024-09-21T07:33:47.624227+0000","last_fullsized":"2024-09-21T07:33:47.624227+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:40.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609654+0000","last_change":"2024-09-21T07:33:46.609654+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609654+0000","last_undegraded":"2024-09-21T07:33:46.609654+0000","last_fullsized":"2024-09-21T07:33:46.609654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643309+0000","last_change":"2024-09-21T07:33:46.631055+0000","last_active":"2024-09-21T07:33:48.643309+0000","last_peered":"2024-09-21T07:33:48.643309+0000","last_clean":"2024-09-21T07:33:48.643309+0000","last_became_active":"2024-09-21T07:33:46.630753+0000","last_became_peered":"2024-09-21T07:33:46.630753+0000","last_unstale":"2024-09-21T07:33:48.643309+0000","last_undegraded":"2024-09-21T07:33:48.643309+0000","last_fullsized":"2024-09-21T07:33:48.643309+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:32.810868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":372,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.614920+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:33:46.614920+0000","last_peered":"2024-09-21T07:33:46.614920+0000","last_clean":"2024-09-21T07:33:46.614920+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:33:46.614920+0000","last_undegraded":"2024-09-21T07:33:46.614920+0000","last_fullsized":"2024-09-21T07:33:46.614920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509577,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51832,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320008,"statfs":{"total":96636764160,"available":96583688192,"internally_reserved":0,"allocated":2658304,"data_stored":1562343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2646016,"data_stored":1555684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2109440,"data_stored":988050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:51.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:33:52.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 -- 172.21.15.64:0/455992949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 msgr2=0x7f8e400700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 --2- 172.21.15.64:0/455992949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e400700b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009900 tx=0x7f8e3401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 -- 172.21.15.64:0/455992949 shutdown_connections 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 --2- 172.21.15.64:0/455992949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400b48d0 0x7f8e40072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 --2- 172.21.15.64:0/455992949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e400700b0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 -- 172.21.15.64:0/455992949 >> 172.21.15.64:0/455992949 conn(0x7f8e400ccbe0 msgr2=0x7f8e400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 -- 172.21.15.64:0/455992949 shutdown_connections 2024-09-21T07:33:52.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.051+0000 7f8e48000640 1 -- 172.21.15.64:0/455992949 wait complete. 2024-09-21T07:33:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 Processor -- start 2024-09-21T07:33:52.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- start start 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400709b0 0x7f8e4009bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 0x7f8e4015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40168b60 con 0x7f8e4015edb0 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401689e0 con 0x7f8e4015a590 2024-09-21T07:33:52.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8e40168ce0 con 0x7f8e400709b0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33350/0 (socket says 172.21.15.64:33350) 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 -- 172.21.15.64:0/3989420238 learned_addr learned my addr 172.21.15.64:0/3989420238 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e45600640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400709b0 0x7f8e4009bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e46000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 0x7f8e4015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 -- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400709b0 msgr2=0x7f8e4009bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400709b0 0x7f8e4009bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 -- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 msgr2=0x7f8e4015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 0x7f8e4015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 -- 172.21.15.64:0/3989420238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4009c630 con 0x7f8e4015edb0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e46000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 0x7f8e4015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e44c00640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c001ec0 tx=0x7f8e2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c017070 con 0x7f8e4015edb0 2024-09-21T07:33:52.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e2c003600 con 0x7f8e4015edb0 2024-09-21T07:33:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c003a50 con 0x7f8e4015edb0 2024-09-21T07:33:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4009c910 con 0x7f8e4015edb0 2024-09-21T07:33:52.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.055+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4009ced0 con 0x7f8e4015edb0 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.059+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4009d3f0 con 0x7f8e4015edb0 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.059+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8e2c01a070 con 0x7f8e4015edb0 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.059+0000 7f8e3d600640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 0x7f8e20075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.059+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f8e2c0935d0 con 0x7f8e4015edb0 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.059+0000 7f8e45600640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 0x7f8e20075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.063+0000 7f8e45600640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 0x7f8e20075740 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e340af000 tx=0x7f8e3401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.063+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8e2c05de10 con 0x7f8e4015edb0 2024-09-21T07:33:52.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.239+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e400c67a0 con 0x7f8e20073230 2024-09-21T07:33:52.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.243+0000 7f8e3d600640 1 -- 172.21.15.64:0/3989420238 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250947 (secure 0 0 0) 0x7f8e340b3040 con 0x7f8e20073230 2024-09-21T07:33:52.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:52.248 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 msgr2=0x7f8e20075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 0x7f8e20075740 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e340af000 tx=0x7f8e3401b120 comp rx=0 tx=0).stop 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 msgr2=0x7f8e4015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c001ec0 tx=0x7f8e2c00c890 comp rx=0 tx=0).stop 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 shutdown_connections 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8e20073230 0x7f8e20075740 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e4015a590 0x7f8e4015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e4015edb0 0x7f8e4015a050 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 --2- 172.21.15.64:0/3989420238 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8e400709b0 0x7f8e4009bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 >> 172.21.15.64:0/3989420238 conn(0x7f8e400ccbe0 msgr2=0x7f8e4015c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 shutdown_connections 2024-09-21T07:33:52.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.247+0000 7f8e48000640 1 -- 172.21.15.64:0/3989420238 wait complete. 2024-09-21T07:33:52.268 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-21T07:33:51.605099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":440368,"kb_used_data":17320,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754534352,"statfs":{"total":773094113280,"available":772643176448,"internally_reserved":0,"allocated":17735680,"data_stored":8965952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":432983603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.628655+0000","last_change":"2024-09-21T07:33:47.625720+0000","last_active":"2024-09-21T07:33:47.628655+0000","last_peered":"2024-09-21T07:33:47.628655+0000","last_clean":"2024-09-21T07:33:47.628655+0000","last_became_active":"2024-09-21T07:33:47.625405+0000","last_became_peered":"2024-09-21T07:33:47.625405+0000","last_unstale":"2024-09-21T07:33:47.628655+0000","last_undegraded":"2024-09-21T07:33:47.628655+0000","last_fullsized":"2024-09-21T07:33:47.628655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:39.184691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608952+0000","last_change":"2024-09-21T07:33:46.608952+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608952+0000","last_undegraded":"2024-09-21T07:33:46.608952+0000","last_fullsized":"2024-09-21T07:33:46.608952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627903+0000","last_change":"2024-09-21T07:33:47.625681+0000","last_active":"2024-09-21T07:33:47.627903+0000","last_peered":"2024-09-21T07:33:47.627903+0000","last_clean":"2024-09-21T07:33:47.627903+0000","last_became_active":"2024-09-21T07:33:47.625335+0000","last_became_peered":"2024-09-21T07:33:47.625335+0000","last_unstale":"2024-09-21T07:33:47.627903+0000","last_undegraded":"2024-09-21T07:33:47.627903+0000","last_fullsized":"2024-09-21T07:33:47.627903+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:43.864741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.639981+0000","last_change":"2024-09-21T07:33:47.633470+0000","last_active":"2024-09-21T07:33:47.639981+0000","last_peered":"2024-09-21T07:33:47.639981+0000","last_clean":"2024-09-21T07:33:47.639981+0000","last_became_active":"2024-09-21T07:33:47.631234+0000","last_became_peered":"2024-09-21T07:33:47.631234+0000","last_unstale":"2024-09-21T07:33:47.639981+0000","last_undegraded":"2024-09-21T07:33:47.639981+0000","last_fullsized":"2024-09-21T07:33:47.639981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:10.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.630756+0000","last_change":"2024-09-21T07:33:47.630664+0000","last_active":"2024-09-21T07:33:47.630756+0000","last_peered":"2024-09-21T07:33:47.630756+0000","last_clean":"2024-09-21T07:33:47.630756+0000","last_became_active":"2024-09-21T07:33:47.630362+0000","last_became_peered":"2024-09-21T07:33:47.630362+0000","last_unstale":"2024-09-21T07:33:47.630756+0000","last_undegraded":"2024-09-21T07:33:47.630756+0000","last_fullsized":"2024-09-21T07:33:47.630756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:09.697464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612223+0000","last_change":"2024-09-21T07:33:46.612223+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612223+0000","last_undegraded":"2024-09-21T07:33:46.612223+0000","last_fullsized":"2024-09-21T07:33:46.612223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645051+0000","last_change":"2024-09-21T07:33:47.641086+0000","last_active":"2024-09-21T07:33:47.645051+0000","last_peered":"2024-09-21T07:33:47.645051+0000","last_clean":"2024-09-21T07:33:47.645051+0000","last_became_active":"2024-09-21T07:33:47.640738+0000","last_became_peered":"2024-09-21T07:33:47.640738+0000","last_unstale":"2024-09-21T07:33:47.645051+0000","last_undegraded":"2024-09-21T07:33:47.645051+0000","last_fullsized":"2024-09-21T07:33:47.645051+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:10.534281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647269+0000","last_change":"2024-09-21T07:33:47.641177+0000","last_active":"2024-09-21T07:33:47.647269+0000","last_peered":"2024-09-21T07:33:47.647269+0000","last_clean":"2024-09-21T07:33:47.647269+0000","last_became_active":"2024-09-21T07:33:47.640519+0000","last_became_peered":"2024-09-21T07:33:47.640519+0000","last_unstale":"2024-09-21T07:33:47.647269+0000","last_undegraded":"2024-09-21T07:33:47.647269+0000","last_fullsized":"2024-09-21T07:33:47.647269+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:59.630563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.653039+0000","last_change":"2024-09-21T07:33:47.648250+0000","last_active":"2024-09-21T07:33:47.653039+0000","last_peered":"2024-09-21T07:33:47.653039+0000","last_clean":"2024-09-21T07:33:47.653039+0000","last_became_active":"2024-09-21T07:33:47.647932+0000","last_became_peered":"2024-09-21T07:33:47.647932+0000","last_unstale":"2024-09-21T07:33:47.653039+0000","last_undegraded":"2024-09-21T07:33:47.653039+0000","last_fullsized":"2024-09-21T07:33:47.653039+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655569+0000","last_change":"2024-09-21T07:33:47.650131+0000","last_active":"2024-09-21T07:33:47.655569+0000","last_peered":"2024-09-21T07:33:47.655569+0000","last_clean":"2024-09-21T07:33:47.655569+0000","last_became_active":"2024-09-21T07:33:47.649771+0000","last_became_peered":"2024-09-21T07:33:47.649771+0000","last_unstale":"2024-09-21T07:33:47.655569+0000","last_undegraded":"2024-09-21T07:33:47.655569+0000","last_fullsized":"2024-09-21T07:33:47.655569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:25.893560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647649+0000","last_change":"2024-09-21T07:33:47.639979+0000","last_active":"2024-09-21T07:33:47.647649+0000","last_peered":"2024-09-21T07:33:47.647649+0000","last_clean":"2024-09-21T07:33:47.647649+0000","last_became_active":"2024-09-21T07:33:47.639661+0000","last_became_peered":"2024-09-21T07:33:47.639661+0000","last_unstale":"2024-09-21T07:33:47.647649+0000","last_undegraded":"2024-09-21T07:33:47.647649+0000","last_fullsized":"2024-09-21T07:33:47.647649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:34.175607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609434+0000","last_change":"2024-09-21T07:33:46.609434+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609434+0000","last_undegraded":"2024-09-21T07:33:46.609434+0000","last_fullsized":"2024-09-21T07:33:46.609434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642703+0000","last_change":"2024-09-21T07:33:47.642336+0000","last_active":"2024-09-21T07:33:48.642703+0000","last_peered":"2024-09-21T07:33:48.642703+0000","last_clean":"2024-09-21T07:33:48.642703+0000","last_became_active":"2024-09-21T07:33:47.642063+0000","last_became_peered":"2024-09-21T07:33:47.642063+0000","last_unstale":"2024-09-21T07:33:48.642703+0000","last_undegraded":"2024-09-21T07:33:48.642703+0000","last_fullsized":"2024-09-21T07:33:48.642703+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:53.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.621166+0000","last_change":"2024-09-21T07:33:47.621166+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.621166+0000","last_undegraded":"2024-09-21T07:33:47.621166+0000","last_fullsized":"2024-09-21T07:33:47.621166+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647814+0000","last_change":"2024-09-21T07:33:47.643740+0000","last_active":"2024-09-21T07:33:47.647814+0000","last_peered":"2024-09-21T07:33:47.647814+0000","last_clean":"2024-09-21T07:33:47.647814+0000","last_became_active":"2024-09-21T07:33:47.640771+0000","last_became_peered":"2024-09-21T07:33:47.640771+0000","last_unstale":"2024-09-21T07:33:47.647814+0000","last_undegraded":"2024-09-21T07:33:47.647814+0000","last_fullsized":"2024-09-21T07:33:47.647814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:16.925254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637281+0000","last_change":"2024-09-21T07:33:47.632386+0000","last_active":"2024-09-21T07:33:47.637281+0000","last_peered":"2024-09-21T07:33:47.637281+0000","last_clean":"2024-09-21T07:33:47.637281+0000","last_became_active":"2024-09-21T07:33:47.631743+0000","last_became_peered":"2024-09-21T07:33:47.631743+0000","last_unstale":"2024-09-21T07:33:47.637281+0000","last_undegraded":"2024-09-21T07:33:47.637281+0000","last_fullsized":"2024-09-21T07:33:47.637281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:11.253008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650242+0000","last_change":"2024-09-21T07:33:47.646697+0000","last_active":"2024-09-21T07:33:47.650242+0000","last_peered":"2024-09-21T07:33:47.650242+0000","last_clean":"2024-09-21T07:33:47.650242+0000","last_became_active":"2024-09-21T07:33:47.646388+0000","last_became_peered":"2024-09-21T07:33:47.646388+0000","last_unstale":"2024-09-21T07:33:47.650242+0000","last_undegraded":"2024-09-21T07:33:47.650242+0000","last_fullsized":"2024-09-21T07:33:47.650242+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620998+0000","last_change":"2024-09-21T07:33:47.620998+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620998+0000","last_undegraded":"2024-09-21T07:33:47.620998+0000","last_fullsized":"2024-09-21T07:33:47.620998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647684+0000","last_change":"2024-09-21T07:33:47.643086+0000","last_active":"2024-09-21T07:33:47.647684+0000","last_peered":"2024-09-21T07:33:47.647684+0000","last_clean":"2024-09-21T07:33:47.647684+0000","last_became_active":"2024-09-21T07:33:47.640786+0000","last_became_peered":"2024-09-21T07:33:47.640786+0000","last_unstale":"2024-09-21T07:33:47.647684+0000","last_undegraded":"2024-09-21T07:33:47.647684+0000","last_fullsized":"2024-09-21T07:33:47.647684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:42.233855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636537+0000","last_change":"2024-09-21T07:33:47.633448+0000","last_active":"2024-09-21T07:33:47.636537+0000","last_peered":"2024-09-21T07:33:47.636537+0000","last_clean":"2024-09-21T07:33:47.636537+0000","last_became_active":"2024-09-21T07:33:47.633066+0000","last_became_peered":"2024-09-21T07:33:47.633066+0000","last_unstale":"2024-09-21T07:33:47.636537+0000","last_undegraded":"2024-09-21T07:33:47.636537+0000","last_fullsized":"2024-09-21T07:33:47.636537+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:16.784821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642952+0000","last_change":"2024-09-21T07:33:47.629236+0000","last_active":"2024-09-21T07:33:48.642952+0000","last_peered":"2024-09-21T07:33:48.642952+0000","last_clean":"2024-09-21T07:33:48.642952+0000","last_became_active":"2024-09-21T07:33:47.628957+0000","last_became_peered":"2024-09-21T07:33:47.628957+0000","last_unstale":"2024-09-21T07:33:48.642952+0000","last_undegraded":"2024-09-21T07:33:48.642952+0000","last_fullsized":"2024-09-21T07:33:48.642952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:22.566695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608721+0000","last_change":"2024-09-21T07:33:46.608721+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608721+0000","last_undegraded":"2024-09-21T07:33:46.608721+0000","last_fullsized":"2024-09-21T07:33:46.608721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633662+0000","last_change":"2024-09-21T07:33:47.633569+0000","last_active":"2024-09-21T07:33:47.633662+0000","last_peered":"2024-09-21T07:33:47.633662+0000","last_clean":"2024-09-21T07:33:47.633662+0000","last_became_active":"2024-09-21T07:33:47.632464+0000","last_became_peered":"2024-09-21T07:33:47.632464+0000","last_unstale":"2024-09-21T07:33:47.633662+0000","last_undegraded":"2024-09-21T07:33:47.633662+0000","last_fullsized":"2024-09-21T07:33:47.633662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:34.907981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637311+0000","last_change":"2024-09-21T07:33:47.632731+0000","last_active":"2024-09-21T07:33:47.637311+0000","last_peered":"2024-09-21T07:33:47.637311+0000","last_clean":"2024-09-21T07:33:47.637311+0000","last_became_active":"2024-09-21T07:33:47.632100+0000","last_became_peered":"2024-09-21T07:33:47.632100+0000","last_unstale":"2024-09-21T07:33:47.637311+0000","last_undegraded":"2024-09-21T07:33:47.637311+0000","last_fullsized":"2024-09-21T07:33:47.637311+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:35.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643809+0000","last_change":"2024-09-21T07:33:47.634716+0000","last_active":"2024-09-21T07:33:48.643809+0000","last_peered":"2024-09-21T07:33:48.643809+0000","last_clean":"2024-09-21T07:33:48.643809+0000","last_became_active":"2024-09-21T07:33:47.634400+0000","last_became_peered":"2024-09-21T07:33:47.634400+0000","last_unstale":"2024-09-21T07:33:48.643809+0000","last_undegraded":"2024-09-21T07:33:48.643809+0000","last_fullsized":"2024-09-21T07:33:48.643809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:56.119446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635434+0000","last_change":"2024-09-21T07:33:47.632215+0000","last_active":"2024-09-21T07:33:47.635434+0000","last_peered":"2024-09-21T07:33:47.635434+0000","last_clean":"2024-09-21T07:33:47.635434+0000","last_became_active":"2024-09-21T07:33:47.631762+0000","last_became_peered":"2024-09-21T07:33:47.631762+0000","last_unstale":"2024-09-21T07:33:47.635434+0000","last_undegraded":"2024-09-21T07:33:47.635434+0000","last_fullsized":"2024-09-21T07:33:47.635434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:53.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613896+0000","last_change":"2024-09-21T07:33:46.613896+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613896+0000","last_undegraded":"2024-09-21T07:33:46.613896+0000","last_fullsized":"2024-09-21T07:33:46.613896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643015+0000","last_change":"2024-09-21T07:33:47.631128+0000","last_active":"2024-09-21T07:33:48.643015+0000","last_peered":"2024-09-21T07:33:48.643015+0000","last_clean":"2024-09-21T07:33:48.643015+0000","last_became_active":"2024-09-21T07:33:47.626470+0000","last_became_peered":"2024-09-21T07:33:47.626470+0000","last_unstale":"2024-09-21T07:33:48.643015+0000","last_undegraded":"2024-09-21T07:33:48.643015+0000","last_fullsized":"2024-09-21T07:33:48.643015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:16.850891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.614301+0000","last_change":"2024-09-21T07:33:46.614301+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.614301+0000","last_undegraded":"2024-09-21T07:33:46.614301+0000","last_fullsized":"2024-09-21T07:33:46.614301+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.618315+0000","last_change":"2024-09-21T07:33:47.618315+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.618315+0000","last_undegraded":"2024-09-21T07:33:47.618315+0000","last_fullsized":"2024-09-21T07:33:47.618315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647785+0000","last_change":"2024-09-21T07:33:47.640296+0000","last_active":"2024-09-21T07:33:47.647785+0000","last_peered":"2024-09-21T07:33:47.647785+0000","last_clean":"2024-09-21T07:33:47.647785+0000","last_became_active":"2024-09-21T07:33:47.639859+0000","last_became_peered":"2024-09-21T07:33:47.639859+0000","last_unstale":"2024-09-21T07:33:47.647785+0000","last_undegraded":"2024-09-21T07:33:47.647785+0000","last_fullsized":"2024-09-21T07:33:47.647785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:20.740598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634628+0000","last_change":"2024-09-21T07:33:47.632301+0000","last_active":"2024-09-21T07:33:47.634628+0000","last_peered":"2024-09-21T07:33:47.634628+0000","last_clean":"2024-09-21T07:33:47.634628+0000","last_became_active":"2024-09-21T07:33:47.631997+0000","last_became_peered":"2024-09-21T07:33:47.631997+0000","last_unstale":"2024-09-21T07:33:47.634628+0000","last_undegraded":"2024-09-21T07:33:47.634628+0000","last_fullsized":"2024-09-21T07:33:47.634628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:13.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609249+0000","last_change":"2024-09-21T07:33:46.609249+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609249+0000","last_undegraded":"2024-09-21T07:33:46.609249+0000","last_fullsized":"2024-09-21T07:33:46.609249+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614971+0000","last_change":"2024-09-21T07:33:46.621829+0000","last_active":"2024-09-21T07:33:47.614971+0000","last_peered":"2024-09-21T07:33:47.614971+0000","last_clean":"2024-09-21T07:33:47.614971+0000","last_became_active":"2024-09-21T07:33:46.621108+0000","last_became_peered":"2024-09-21T07:33:46.621108+0000","last_unstale":"2024-09-21T07:33:47.614971+0000","last_undegraded":"2024-09-21T07:33:47.614971+0000","last_fullsized":"2024-09-21T07:33:47.614971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:49.328101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642339+0000","last_change":"2024-09-21T07:33:47.633401+0000","last_active":"2024-09-21T07:33:48.642339+0000","last_peered":"2024-09-21T07:33:48.642339+0000","last_clean":"2024-09-21T07:33:48.642339+0000","last_became_active":"2024-09-21T07:33:47.633086+0000","last_became_peered":"2024-09-21T07:33:47.633086+0000","last_unstale":"2024-09-21T07:33:48.642339+0000","last_undegraded":"2024-09-21T07:33:48.642339+0000","last_fullsized":"2024-09-21T07:33:48.642339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:35.443908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627767+0000","last_change":"2024-09-21T07:33:46.629787+0000","last_active":"2024-09-21T07:33:47.627767+0000","last_peered":"2024-09-21T07:33:47.627767+0000","last_clean":"2024-09-21T07:33:47.627767+0000","last_became_active":"2024-09-21T07:33:46.629432+0000","last_became_peered":"2024-09-21T07:33:46.629432+0000","last_unstale":"2024-09-21T07:33:47.627767+0000","last_undegraded":"2024-09-21T07:33:47.627767+0000","last_fullsized":"2024-09-21T07:33:47.627767+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:20.018028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620779+0000","last_change":"2024-09-21T07:33:47.620779+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620779+0000","last_undegraded":"2024-09-21T07:33:47.620779+0000","last_fullsized":"2024-09-21T07:33:47.620779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.620530+0000","last_change":"2024-09-21T07:33:46.627109+0000","last_active":"2024-09-21T07:33:47.620530+0000","last_peered":"2024-09-21T07:33:47.620530+0000","last_clean":"2024-09-21T07:33:47.620530+0000","last_became_active":"2024-09-21T07:33:46.626791+0000","last_became_peered":"2024-09-21T07:33:46.626791+0000","last_unstale":"2024-09-21T07:33:47.620530+0000","last_undegraded":"2024-09-21T07:33:47.620530+0000","last_fullsized":"2024-09-21T07:33:47.620530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:27.963968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.610637+0000","last_change":"2024-09-21T07:33:46.610637+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.610637+0000","last_undegraded":"2024-09-21T07:33:46.610637+0000","last_fullsized":"2024-09-21T07:33:46.610637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615697+0000","last_change":"2024-09-21T07:33:46.628812+0000","last_active":"2024-09-21T07:33:47.615697+0000","last_peered":"2024-09-21T07:33:47.615697+0000","last_clean":"2024-09-21T07:33:47.615697+0000","last_became_active":"2024-09-21T07:33:46.628282+0000","last_became_peered":"2024-09-21T07:33:46.628282+0000","last_unstale":"2024-09-21T07:33:47.615697+0000","last_undegraded":"2024-09-21T07:33:47.615697+0000","last_fullsized":"2024-09-21T07:33:47.615697+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.194913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.656287+0000","last_change":"2024-09-21T07:33:47.650503+0000","last_active":"2024-09-21T07:33:47.656287+0000","last_peered":"2024-09-21T07:33:47.656287+0000","last_clean":"2024-09-21T07:33:47.656287+0000","last_became_active":"2024-09-21T07:33:47.650188+0000","last_became_peered":"2024-09-21T07:33:47.650188+0000","last_unstale":"2024-09-21T07:33:47.656287+0000","last_undegraded":"2024-09-21T07:33:47.656287+0000","last_fullsized":"2024-09-21T07:33:47.656287+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.846100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.648138+0000","last_change":"2024-09-21T07:33:46.623523+0000","last_active":"2024-09-21T07:33:47.648138+0000","last_peered":"2024-09-21T07:33:47.648138+0000","last_clean":"2024-09-21T07:33:47.648138+0000","last_became_active":"2024-09-21T07:33:46.623174+0000","last_became_peered":"2024-09-21T07:33:46.623174+0000","last_unstale":"2024-09-21T07:33:47.648138+0000","last_undegraded":"2024-09-21T07:33:47.648138+0000","last_fullsized":"2024-09-21T07:33:47.648138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:58.346289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636603+0000","last_change":"2024-09-21T07:33:47.630806+0000","last_active":"2024-09-21T07:33:47.636603+0000","last_peered":"2024-09-21T07:33:47.636603+0000","last_clean":"2024-09-21T07:33:47.636603+0000","last_became_active":"2024-09-21T07:33:47.630494+0000","last_became_peered":"2024-09-21T07:33:47.630494+0000","last_unstale":"2024-09-21T07:33:47.636603+0000","last_undegraded":"2024-09-21T07:33:47.636603+0000","last_fullsized":"2024-09-21T07:33:47.636603+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.316252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.625009+0000","last_change":"2024-09-21T07:33:46.608788+0000","last_active":"2024-09-21T07:33:47.625009+0000","last_peered":"2024-09-21T07:33:47.625009+0000","last_clean":"2024-09-21T07:33:47.625009+0000","last_became_active":"2024-09-21T07:33:46.608428+0000","last_became_peered":"2024-09-21T07:33:46.608428+0000","last_unstale":"2024-09-21T07:33:47.625009+0000","last_undegraded":"2024-09-21T07:33:47.625009+0000","last_fullsized":"2024-09-21T07:33:47.625009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:24.973246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634160+0000","last_change":"2024-09-21T07:33:47.624817+0000","last_active":"2024-09-21T07:33:47.634160+0000","last_peered":"2024-09-21T07:33:47.634160+0000","last_clean":"2024-09-21T07:33:47.634160+0000","last_became_active":"2024-09-21T07:33:47.624500+0000","last_became_peered":"2024-09-21T07:33:47.624500+0000","last_unstale":"2024-09-21T07:33:47.634160+0000","last_undegraded":"2024-09-21T07:33:47.634160+0000","last_fullsized":"2024-09-21T07:33:47.634160+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:36.647441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618360+0000","last_change":"2024-09-21T07:33:46.629058+0000","last_active":"2024-09-21T07:33:47.618360+0000","last_peered":"2024-09-21T07:33:47.618360+0000","last_clean":"2024-09-21T07:33:47.618360+0000","last_became_active":"2024-09-21T07:33:46.628579+0000","last_became_peered":"2024-09-21T07:33:46.628579+0000","last_unstale":"2024-09-21T07:33:47.618360+0000","last_undegraded":"2024-09-21T07:33:47.618360+0000","last_fullsized":"2024-09-21T07:33:47.618360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:58.077760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.641218+0000","last_change":"2024-09-21T07:33:47.635770+0000","last_active":"2024-09-21T07:33:47.641218+0000","last_peered":"2024-09-21T07:33:47.641218+0000","last_clean":"2024-09-21T07:33:47.641218+0000","last_became_active":"2024-09-21T07:33:47.635454+0000","last_became_peered":"2024-09-21T07:33:47.635454+0000","last_unstale":"2024-09-21T07:33:47.641218+0000","last_undegraded":"2024-09-21T07:33:47.641218+0000","last_fullsized":"2024-09-21T07:33:47.641218+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:53.974927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624650+0000","last_change":"2024-09-21T07:33:46.626183+0000","last_active":"2024-09-21T07:33:47.624650+0000","last_peered":"2024-09-21T07:33:47.624650+0000","last_clean":"2024-09-21T07:33:47.624650+0000","last_became_active":"2024-09-21T07:33:46.625875+0000","last_became_peered":"2024-09-21T07:33:46.625875+0000","last_unstale":"2024-09-21T07:33:47.624650+0000","last_undegraded":"2024-09-21T07:33:47.624650+0000","last_fullsized":"2024-09-21T07:33:47.624650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.173888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613127+0000","last_change":"2024-09-21T07:33:46.613127+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613127+0000","last_undegraded":"2024-09-21T07:33:46.613127+0000","last_fullsized":"2024-09-21T07:33:46.613127+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643517+0000","last_change":"2024-09-21T07:33:46.627781+0000","last_active":"2024-09-21T07:33:48.643517+0000","last_peered":"2024-09-21T07:33:48.643517+0000","last_clean":"2024-09-21T07:33:48.643517+0000","last_became_active":"2024-09-21T07:33:46.627385+0000","last_became_peered":"2024-09-21T07:33:46.627385+0000","last_unstale":"2024-09-21T07:33:48.643517+0000","last_undegraded":"2024-09-21T07:33:48.643517+0000","last_fullsized":"2024-09-21T07:33:48.643517+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:55.725847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642572+0000","last_change":"2024-09-21T07:33:47.639144+0000","last_active":"2024-09-21T07:33:48.642572+0000","last_peered":"2024-09-21T07:33:48.642572+0000","last_clean":"2024-09-21T07:33:48.642572+0000","last_became_active":"2024-09-21T07:33:47.638831+0000","last_became_peered":"2024-09-21T07:33:47.638831+0000","last_unstale":"2024-09-21T07:33:48.642572+0000","last_undegraded":"2024-09-21T07:33:48.642572+0000","last_fullsized":"2024-09-21T07:33:48.642572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.804124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614671+0000","last_change":"2024-09-21T07:33:46.618197+0000","last_active":"2024-09-21T07:33:47.614671+0000","last_peered":"2024-09-21T07:33:47.614671+0000","last_clean":"2024-09-21T07:33:47.614671+0000","last_became_active":"2024-09-21T07:33:46.617845+0000","last_became_peered":"2024-09-21T07:33:46.617845+0000","last_unstale":"2024-09-21T07:33:47.614671+0000","last_undegraded":"2024-09-21T07:33:47.614671+0000","last_fullsized":"2024-09-21T07:33:47.614671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:40.942593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636657+0000","last_change":"2024-09-21T07:33:47.633080+0000","last_active":"2024-09-21T07:33:47.636657+0000","last_peered":"2024-09-21T07:33:47.636657+0000","last_clean":"2024-09-21T07:33:47.636657+0000","last_became_active":"2024-09-21T07:33:47.632770+0000","last_became_peered":"2024-09-21T07:33:47.632770+0000","last_unstale":"2024-09-21T07:33:47.636657+0000","last_undegraded":"2024-09-21T07:33:47.636657+0000","last_fullsized":"2024-09-21T07:33:47.636657+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:26.206243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643087+0000","last_change":"2024-09-21T07:33:46.624386+0000","last_active":"2024-09-21T07:33:48.643087+0000","last_peered":"2024-09-21T07:33:48.643087+0000","last_clean":"2024-09-21T07:33:48.643087+0000","last_became_active":"2024-09-21T07:33:46.622664+0000","last_became_peered":"2024-09-21T07:33:46.622664+0000","last_unstale":"2024-09-21T07:33:48.643087+0000","last_undegraded":"2024-09-21T07:33:48.643087+0000","last_fullsized":"2024-09-21T07:33:48.643087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.642393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633788+0000","last_change":"2024-09-21T07:33:47.632859+0000","last_active":"2024-09-21T07:33:47.633788+0000","last_peered":"2024-09-21T07:33:47.633788+0000","last_clean":"2024-09-21T07:33:47.633788+0000","last_became_active":"2024-09-21T07:33:47.632480+0000","last_became_peered":"2024-09-21T07:33:47.632480+0000","last_unstale":"2024-09-21T07:33:47.633788+0000","last_undegraded":"2024-09-21T07:33:47.633788+0000","last_fullsized":"2024-09-21T07:33:47.633788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:37.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626018+0000","last_change":"2024-09-21T07:33:46.618752+0000","last_active":"2024-09-21T07:33:47.626018+0000","last_peered":"2024-09-21T07:33:47.626018+0000","last_clean":"2024-09-21T07:33:47.626018+0000","last_became_active":"2024-09-21T07:33:46.617838+0000","last_became_peered":"2024-09-21T07:33:46.617838+0000","last_unstale":"2024-09-21T07:33:47.626018+0000","last_undegraded":"2024-09-21T07:33:47.626018+0000","last_fullsized":"2024-09-21T07:33:47.626018+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.349802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646073+0000","last_change":"2024-09-21T07:33:47.643524+0000","last_active":"2024-09-21T07:33:47.646073+0000","last_peered":"2024-09-21T07:33:47.646073+0000","last_clean":"2024-09-21T07:33:47.646073+0000","last_became_active":"2024-09-21T07:33:47.643202+0000","last_became_peered":"2024-09-21T07:33:47.643202+0000","last_unstale":"2024-09-21T07:33:47.646073+0000","last_undegraded":"2024-09-21T07:33:47.646073+0000","last_fullsized":"2024-09-21T07:33:47.646073+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:39.768719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642752+0000","last_change":"2024-09-21T07:33:46.608302+0000","last_active":"2024-09-21T07:33:48.642752+0000","last_peered":"2024-09-21T07:33:48.642752+0000","last_clean":"2024-09-21T07:33:48.642752+0000","last_became_active":"2024-09-21T07:33:46.607990+0000","last_became_peered":"2024-09-21T07:33:46.607990+0000","last_unstale":"2024-09-21T07:33:48.642752+0000","last_undegraded":"2024-09-21T07:33:48.642752+0000","last_fullsized":"2024-09-21T07:33:48.642752+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:19.640505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.644246+0000","last_change":"2024-09-21T07:33:47.636878+0000","last_active":"2024-09-21T07:33:47.644246+0000","last_peered":"2024-09-21T07:33:47.644246+0000","last_clean":"2024-09-21T07:33:47.644246+0000","last_became_active":"2024-09-21T07:33:47.636386+0000","last_became_peered":"2024-09-21T07:33:47.636386+0000","last_unstale":"2024-09-21T07:33:47.644246+0000","last_undegraded":"2024-09-21T07:33:47.644246+0000","last_fullsized":"2024-09-21T07:33:47.644246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:03.374135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.621926+0000","last_change":"2024-09-21T07:33:46.618935+0000","last_active":"2024-09-21T07:33:47.621926+0000","last_peered":"2024-09-21T07:33:47.621926+0000","last_clean":"2024-09-21T07:33:47.621926+0000","last_became_active":"2024-09-21T07:33:46.618440+0000","last_became_peered":"2024-09-21T07:33:46.618440+0000","last_unstale":"2024-09-21T07:33:47.621926+0000","last_undegraded":"2024-09-21T07:33:47.621926+0000","last_fullsized":"2024-09-21T07:33:47.621926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:42.515209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637419+0000","last_change":"2024-09-21T07:33:47.635158+0000","last_active":"2024-09-21T07:33:47.637419+0000","last_peered":"2024-09-21T07:33:47.637419+0000","last_clean":"2024-09-21T07:33:47.637419+0000","last_became_active":"2024-09-21T07:33:47.631190+0000","last_became_peered":"2024-09-21T07:33:47.631190+0000","last_unstale":"2024-09-21T07:33:47.637419+0000","last_undegraded":"2024-09-21T07:33:47.637419+0000","last_fullsized":"2024-09-21T07:33:47.637419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:57.182476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.651436+0000","last_change":"2024-09-21T07:33:46.622115+0000","last_active":"2024-09-21T07:33:47.651436+0000","last_peered":"2024-09-21T07:33:47.651436+0000","last_clean":"2024-09-21T07:33:47.651436+0000","last_became_active":"2024-09-21T07:33:46.621741+0000","last_became_peered":"2024-09-21T07:33:46.621741+0000","last_unstale":"2024-09-21T07:33:47.651436+0000","last_undegraded":"2024-09-21T07:33:47.651436+0000","last_fullsized":"2024-09-21T07:33:47.651436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:09.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645042+0000","last_change":"2024-09-21T07:33:47.640834+0000","last_active":"2024-09-21T07:33:47.645042+0000","last_peered":"2024-09-21T07:33:47.645042+0000","last_clean":"2024-09-21T07:33:47.645042+0000","last_became_active":"2024-09-21T07:33:47.640148+0000","last_became_peered":"2024-09-21T07:33:47.640148+0000","last_unstale":"2024-09-21T07:33:47.645042+0000","last_undegraded":"2024-09-21T07:33:47.645042+0000","last_fullsized":"2024-09-21T07:33:47.645042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:32.615535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643855+0000","last_change":"2024-09-21T07:33:46.616859+0000","last_active":"2024-09-21T07:33:48.643855+0000","last_peered":"2024-09-21T07:33:48.643855+0000","last_clean":"2024-09-21T07:33:48.643855+0000","last_became_active":"2024-09-21T07:33:46.616532+0000","last_became_peered":"2024-09-21T07:33:46.616532+0000","last_unstale":"2024-09-21T07:33:48.643855+0000","last_undegraded":"2024-09-21T07:33:48.643855+0000","last_fullsized":"2024-09-21T07:33:48.643855+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:07.334027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635879+0000","last_change":"2024-09-21T07:33:47.634300+0000","last_active":"2024-09-21T07:33:47.635879+0000","last_peered":"2024-09-21T07:33:47.635879+0000","last_clean":"2024-09-21T07:33:47.635879+0000","last_became_active":"2024-09-21T07:33:47.633771+0000","last_became_peered":"2024-09-21T07:33:47.633771+0000","last_unstale":"2024-09-21T07:33:47.635879+0000","last_undegraded":"2024-09-21T07:33:47.635879+0000","last_fullsized":"2024-09-21T07:33:47.635879+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:26.900131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650706+0000","last_change":"2024-09-21T07:33:46.630896+0000","last_active":"2024-09-21T07:33:47.650706+0000","last_peered":"2024-09-21T07:33:47.650706+0000","last_clean":"2024-09-21T07:33:47.650706+0000","last_became_active":"2024-09-21T07:33:46.630594+0000","last_became_peered":"2024-09-21T07:33:46.630594+0000","last_unstale":"2024-09-21T07:33:47.650706+0000","last_undegraded":"2024-09-21T07:33:47.650706+0000","last_fullsized":"2024-09-21T07:33:47.650706+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:15.215651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645092+0000","last_change":"2024-09-21T07:33:47.639931+0000","last_active":"2024-09-21T07:33:47.645092+0000","last_peered":"2024-09-21T07:33:47.645092+0000","last_clean":"2024-09-21T07:33:47.645092+0000","last_became_active":"2024-09-21T07:33:47.636826+0000","last_became_peered":"2024-09-21T07:33:47.636826+0000","last_unstale":"2024-09-21T07:33:47.645092+0000","last_undegraded":"2024-09-21T07:33:47.645092+0000","last_fullsized":"2024-09-21T07:33:47.645092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:38.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623601+0000","last_change":"2024-09-21T07:33:46.618120+0000","last_active":"2024-09-21T07:33:47.623601+0000","last_peered":"2024-09-21T07:33:47.623601+0000","last_clean":"2024-09-21T07:33:47.623601+0000","last_became_active":"2024-09-21T07:33:46.616030+0000","last_became_peered":"2024-09-21T07:33:46.616030+0000","last_unstale":"2024-09-21T07:33:47.623601+0000","last_undegraded":"2024-09-21T07:33:47.623601+0000","last_fullsized":"2024-09-21T07:33:47.623601+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:32.017754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647351+0000","last_change":"2024-09-21T07:33:47.647224+0000","last_active":"2024-09-21T07:33:47.647351+0000","last_peered":"2024-09-21T07:33:47.647351+0000","last_clean":"2024-09-21T07:33:47.647351+0000","last_became_active":"2024-09-21T07:33:47.646601+0000","last_became_peered":"2024-09-21T07:33:47.646601+0000","last_unstale":"2024-09-21T07:33:47.647351+0000","last_undegraded":"2024-09-21T07:33:47.647351+0000","last_fullsized":"2024-09-21T07:33:47.647351+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:04.972030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635958+0000","last_change":"2024-09-21T07:33:46.621372+0000","last_active":"2024-09-21T07:33:47.635958+0000","last_peered":"2024-09-21T07:33:47.635958+0000","last_clean":"2024-09-21T07:33:47.635958+0000","last_became_active":"2024-09-21T07:33:46.621006+0000","last_became_peered":"2024-09-21T07:33:46.621006+0000","last_unstale":"2024-09-21T07:33:47.635958+0000","last_undegraded":"2024-09-21T07:33:47.635958+0000","last_fullsized":"2024-09-21T07:33:47.635958+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643288+0000","last_change":"2024-09-21T07:33:47.630067+0000","last_active":"2024-09-21T07:33:48.643288+0000","last_peered":"2024-09-21T07:33:48.643288+0000","last_clean":"2024-09-21T07:33:48.643288+0000","last_became_active":"2024-09-21T07:33:47.626995+0000","last_became_peered":"2024-09-21T07:33:47.626995+0000","last_unstale":"2024-09-21T07:33:48.643288+0000","last_undegraded":"2024-09-21T07:33:48.643288+0000","last_fullsized":"2024-09-21T07:33:48.643288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:06.240784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626235+0000","last_change":"2024-09-21T07:33:46.619652+0000","last_active":"2024-09-21T07:33:47.626235+0000","last_peered":"2024-09-21T07:33:47.626235+0000","last_clean":"2024-09-21T07:33:47.626235+0000","last_became_active":"2024-09-21T07:33:46.619267+0000","last_became_peered":"2024-09-21T07:33:46.619267+0000","last_unstale":"2024-09-21T07:33:47.626235+0000","last_undegraded":"2024-09-21T07:33:47.626235+0000","last_fullsized":"2024-09-21T07:33:47.626235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:59.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.623190+0000","last_change":"2024-09-21T07:33:47.623190+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.623190+0000","last_undegraded":"2024-09-21T07:33:47.623190+0000","last_fullsized":"2024-09-21T07:33:47.623190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.619911+0000","last_change":"2024-09-21T07:33:46.614497+0000","last_active":"2024-09-21T07:33:47.619911+0000","last_peered":"2024-09-21T07:33:47.619911+0000","last_clean":"2024-09-21T07:33:47.619911+0000","last_became_active":"2024-09-21T07:33:46.614181+0000","last_became_peered":"2024-09-21T07:33:46.614181+0000","last_unstale":"2024-09-21T07:33:47.619911+0000","last_undegraded":"2024-09-21T07:33:47.619911+0000","last_fullsized":"2024-09-21T07:33:47.619911+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:29.909421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.625374+0000","last_change":"2024-09-21T07:33:47.625374+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.625374+0000","last_undegraded":"2024-09-21T07:33:47.625374+0000","last_fullsized":"2024-09-21T07:33:47.625374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618612+0000","last_change":"2024-09-21T07:33:46.621849+0000","last_active":"2024-09-21T07:33:47.618612+0000","last_peered":"2024-09-21T07:33:47.618612+0000","last_clean":"2024-09-21T07:33:47.618612+0000","last_became_active":"2024-09-21T07:33:46.621232+0000","last_became_peered":"2024-09-21T07:33:46.621232+0000","last_unstale":"2024-09-21T07:33:47.618612+0000","last_undegraded":"2024-09-21T07:33:47.618612+0000","last_fullsized":"2024-09-21T07:33:47.618612+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.193047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612446+0000","last_change":"2024-09-21T07:33:46.612446+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612446+0000","last_undegraded":"2024-09-21T07:33:46.612446+0000","last_fullsized":"2024-09-21T07:33:46.612446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.623747+0000","last_change":"2024-09-21T07:33:46.623165+0000","last_active":"2024-09-21T07:33:46.623747+0000","last_peered":"2024-09-21T07:33:46.623747+0000","last_clean":"2024-09-21T07:33:46.623747+0000","last_became_active":"2024-09-21T07:33:46.622212+0000","last_became_peered":"2024-09-21T07:33:46.622212+0000","last_unstale":"2024-09-21T07:33:46.623747+0000","last_undegraded":"2024-09-21T07:33:46.623747+0000","last_fullsized":"2024-09-21T07:33:46.623747+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:40.821174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.642998+0000","last_change":"2024-09-21T07:33:47.631677+0000","last_active":"2024-09-21T07:33:47.642998+0000","last_peered":"2024-09-21T07:33:47.642998+0000","last_clean":"2024-09-21T07:33:47.642998+0000","last_became_active":"2024-09-21T07:33:47.631353+0000","last_became_peered":"2024-09-21T07:33:47.631353+0000","last_unstale":"2024-09-21T07:33:47.642998+0000","last_undegraded":"2024-09-21T07:33:47.642998+0000","last_fullsized":"2024-09-21T07:33:47.642998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:29.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623959+0000","last_change":"2024-09-21T07:33:46.617084+0000","last_active":"2024-09-21T07:33:47.623959+0000","last_peered":"2024-09-21T07:33:47.623959+0000","last_clean":"2024-09-21T07:33:47.623959+0000","last_became_active":"2024-09-21T07:33:46.616734+0000","last_became_peered":"2024-09-21T07:33:46.616734+0000","last_unstale":"2024-09-21T07:33:47.623959+0000","last_undegraded":"2024-09-21T07:33:47.623959+0000","last_fullsized":"2024-09-21T07:33:47.623959+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:32.230121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646020+0000","last_change":"2024-09-21T07:33:47.642657+0000","last_active":"2024-09-21T07:33:47.646020+0000","last_peered":"2024-09-21T07:33:47.646020+0000","last_clean":"2024-09-21T07:33:47.646020+0000","last_became_active":"2024-09-21T07:33:47.642192+0000","last_became_peered":"2024-09-21T07:33:47.642192+0000","last_unstale":"2024-09-21T07:33:47.646020+0000","last_undegraded":"2024-09-21T07:33:47.646020+0000","last_fullsized":"2024-09-21T07:33:47.646020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:36.500996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"167'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643520+0000","last_change":"2024-09-21T07:33:46.631671+0000","last_active":"2024-09-21T07:33:48.643520+0000","last_peered":"2024-09-21T07:33:48.643520+0000","last_clean":"2024-09-21T07:33:48.643520+0000","last_became_active":"2024-09-21T07:33:46.631252+0000","last_became_peered":"2024-09-21T07:33:46.631252+0000","last_unstale":"2024-09-21T07:33:48.643520+0000","last_undegraded":"2024-09-21T07:33:48.643520+0000","last_fullsized":"2024-09-21T07:33:48.643520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:21.204372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634381+0000","last_change":"2024-09-21T07:33:47.629056+0000","last_active":"2024-09-21T07:33:47.634381+0000","last_peered":"2024-09-21T07:33:47.634381+0000","last_clean":"2024-09-21T07:33:47.634381+0000","last_became_active":"2024-09-21T07:33:47.628712+0000","last_became_peered":"2024-09-21T07:33:47.628712+0000","last_unstale":"2024-09-21T07:33:47.634381+0000","last_undegraded":"2024-09-21T07:33:47.634381+0000","last_fullsized":"2024-09-21T07:33:47.634381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:23.902544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642993+0000","last_change":"2024-09-21T07:33:46.620290+0000","last_active":"2024-09-21T07:33:48.642993+0000","last_peered":"2024-09-21T07:33:48.642993+0000","last_clean":"2024-09-21T07:33:48.642993+0000","last_became_active":"2024-09-21T07:33:46.619866+0000","last_became_peered":"2024-09-21T07:33:46.619866+0000","last_unstale":"2024-09-21T07:33:48.642993+0000","last_undegraded":"2024-09-21T07:33:48.642993+0000","last_fullsized":"2024-09-21T07:33:48.642993+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.778171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655365+0000","last_change":"2024-09-21T07:33:47.651031+0000","last_active":"2024-09-21T07:33:47.655365+0000","last_peered":"2024-09-21T07:33:47.655365+0000","last_clean":"2024-09-21T07:33:47.655365+0000","last_became_active":"2024-09-21T07:33:47.650740+0000","last_became_peered":"2024-09-21T07:33:47.650740+0000","last_unstale":"2024-09-21T07:33:47.655365+0000","last_undegraded":"2024-09-21T07:33:47.655365+0000","last_fullsized":"2024-09-21T07:33:47.655365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:41.408856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615429+0000","last_change":"2024-09-21T07:33:46.634107+0000","last_active":"2024-09-21T07:33:47.615429+0000","last_peered":"2024-09-21T07:33:47.615429+0000","last_clean":"2024-09-21T07:33:47.615429+0000","last_became_active":"2024-09-21T07:33:46.633497+0000","last_became_peered":"2024-09-21T07:33:46.633497+0000","last_unstale":"2024-09-21T07:33:47.615429+0000","last_undegraded":"2024-09-21T07:33:47.615429+0000","last_fullsized":"2024-09-21T07:33:47.615429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:15.769168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634796+0000","last_change":"2024-09-21T07:33:47.631144+0000","last_active":"2024-09-21T07:33:47.634796+0000","last_peered":"2024-09-21T07:33:47.634796+0000","last_clean":"2024-09-21T07:33:47.634796+0000","last_became_active":"2024-09-21T07:33:47.630009+0000","last_became_peered":"2024-09-21T07:33:47.630009+0000","last_unstale":"2024-09-21T07:33:47.634796+0000","last_undegraded":"2024-09-21T07:33:47.634796+0000","last_fullsized":"2024-09-21T07:33:47.634796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:12.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.613968+0000","last_change":"2024-09-21T07:33:46.619099+0000","last_active":"2024-09-21T07:33:47.613968+0000","last_peered":"2024-09-21T07:33:47.613968+0000","last_clean":"2024-09-21T07:33:47.613968+0000","last_became_active":"2024-09-21T07:33:46.618774+0000","last_became_peered":"2024-09-21T07:33:46.618774+0000","last_unstale":"2024-09-21T07:33:47.613968+0000","last_undegraded":"2024-09-21T07:33:47.613968+0000","last_fullsized":"2024-09-21T07:33:47.613968+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:37.526034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.611062+0000","last_change":"2024-09-21T07:33:46.611062+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.611062+0000","last_undegraded":"2024-09-21T07:33:46.611062+0000","last_fullsized":"2024-09-21T07:33:46.611062+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642639+0000","last_change":"2024-09-21T07:33:46.629792+0000","last_active":"2024-09-21T07:33:48.642639+0000","last_peered":"2024-09-21T07:33:48.642639+0000","last_clean":"2024-09-21T07:33:48.642639+0000","last_became_active":"2024-09-21T07:33:46.628571+0000","last_became_peered":"2024-09-21T07:33:46.628571+0000","last_unstale":"2024-09-21T07:33:48.642639+0000","last_undegraded":"2024-09-21T07:33:48.642639+0000","last_fullsized":"2024-09-21T07:33:48.642639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:12.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643428+0000","last_change":"2024-09-21T07:33:47.632070+0000","last_active":"2024-09-21T07:33:48.643428+0000","last_peered":"2024-09-21T07:33:48.643428+0000","last_clean":"2024-09-21T07:33:48.643428+0000","last_became_active":"2024-09-21T07:33:47.630789+0000","last_became_peered":"2024-09-21T07:33:47.630789+0000","last_unstale":"2024-09-21T07:33:48.643428+0000","last_undegraded":"2024-09-21T07:33:48.643428+0000","last_fullsized":"2024-09-21T07:33:48.643428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:43.272580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.622151+0000","last_change":"2024-09-21T07:33:46.622064+0000","last_active":"2024-09-21T07:33:47.622151+0000","last_peered":"2024-09-21T07:33:47.622151+0000","last_clean":"2024-09-21T07:33:47.622151+0000","last_became_active":"2024-09-21T07:33:46.621756+0000","last_became_peered":"2024-09-21T07:33:46.621756+0000","last_unstale":"2024-09-21T07:33:47.622151+0000","last_undegraded":"2024-09-21T07:33:47.622151+0000","last_fullsized":"2024-09-21T07:33:47.622151+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:20.287855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.616070+0000","last_change":"2024-09-21T07:33:47.616070+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.616070+0000","last_undegraded":"2024-09-21T07:33:47.616070+0000","last_fullsized":"2024-09-21T07:33:47.616070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624227+0000","last_change":"2024-09-21T07:33:46.619268+0000","last_active":"2024-09-21T07:33:47.624227+0000","last_peered":"2024-09-21T07:33:47.624227+0000","last_clean":"2024-09-21T07:33:47.624227+0000","last_became_active":"2024-09-21T07:33:46.618021+0000","last_became_peered":"2024-09-21T07:33:46.618021+0000","last_unstale":"2024-09-21T07:33:47.624227+0000","last_undegraded":"2024-09-21T07:33:47.624227+0000","last_fullsized":"2024-09-21T07:33:47.624227+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:40.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609654+0000","last_change":"2024-09-21T07:33:46.609654+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609654+0000","last_undegraded":"2024-09-21T07:33:46.609654+0000","last_fullsized":"2024-09-21T07:33:46.609654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643309+0000","last_change":"2024-09-21T07:33:46.631055+0000","last_active":"2024-09-21T07:33:48.643309+0000","last_peered":"2024-09-21T07:33:48.643309+0000","last_clean":"2024-09-21T07:33:48.643309+0000","last_became_active":"2024-09-21T07:33:46.630753+0000","last_became_peered":"2024-09-21T07:33:46.630753+0000","last_unstale":"2024-09-21T07:33:48.643309+0000","last_undegraded":"2024-09-21T07:33:48.643309+0000","last_fullsized":"2024-09-21T07:33:48.643309+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:32.810868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":372,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.614920+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:33:46.614920+0000","last_peered":"2024-09-21T07:33:46.614920+0000","last_clean":"2024-09-21T07:33:46.614920+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:33:46.614920+0000","last_undegraded":"2024-09-21T07:33:46.614920+0000","last_fullsized":"2024-09-21T07:33:46.614920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509577,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51832,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320008,"statfs":{"total":96636764160,"available":96583688192,"internally_reserved":0,"allocated":2658304,"data_stored":1562343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2646016,"data_stored":1555684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2109440,"data_stored":988050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:52.272 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:33:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- 172.21.15.64:0/2417251050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f940b48d0 msgr2=0x7f7f94072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 --2- 172.21.15.64:0/2417251050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f940b48d0 0x7f7f94072e20 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009c80 tx=0x7f7f8c01cda0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- 172.21.15.64:0/2417251050 shutdown_connections 2024-09-21T07:33:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 --2- 172.21.15.64:0/2417251050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f940b48d0 0x7f7f94072e20 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- 172.21.15.64:0/2417251050 >> 172.21.15.64:0/2417251050 conn(0x7f7f940ccbe0 msgr2=0x7f7f940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- 172.21.15.64:0/2417251050 shutdown_connections 2024-09-21T07:33:52.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- 172.21.15.64:0/2417251050 wait complete. 2024-09-21T07:33:52.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 Processor -- start 2024-09-21T07:33:52.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.467+0000 7f7f9b800640 1 -- start start 2024-09-21T07:33:52.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f940709b0 0x7f7f94150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 0x7f7f94155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9416a420 con 0x7f7f9409b570 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9416a2a0 con 0x7f7f9415edb0 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9416a5a0 con 0x7f7f940709b0 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33356/0 (socket says 172.21.15.64:33356) 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 -- 172.21.15.64:0/4188284034 learned_addr learned my addr 172.21.15.64:0/4188284034 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f98e00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f940709b0 0x7f7f94150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f93e00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 0x7f7f94155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 -- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f940709b0 msgr2=0x7f7f94150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f940709b0 0x7f7f94150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 -- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 msgr2=0x7f7f94155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 0x7f7f94155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 -- 172.21.15.64:0/4188284034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f941548f0 con 0x7f7f9409b570 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f93e00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 0x7f7f94155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f99800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c01c810 tx=0x7f7f8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0b2040 con 0x7f7f9409b570 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f8c0044e0 con 0x7f7f9409b570 2024-09-21T07:33:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0ad440 con 0x7f7f9409b570 2024-09-21T07:33:52.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f94154bd0 con 0x7f7f9409b570 2024-09-21T07:33:52.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f94155190 con 0x7f7f9409b570 2024-09-21T07:33:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.471+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f94072e20 con 0x7f7f9409b570 2024-09-21T07:33:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.475+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f8c0bd030 con 0x7f7f9409b570 2024-09-21T07:33:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.475+0000 7f7f90c00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 0x7f7f74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.475+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f7f8c12e680 con 0x7f7f9409b570 2024-09-21T07:33:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.475+0000 7f7f98e00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 0x7f7f74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.475+0000 7f7f98e00640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 0x7f7f74075710 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7f880098e0 tx=0x7f7f88009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.479+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7f8c0c4060 con 0x7f7f9409b570 2024-09-21T07:33:52.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.655+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f94155ed0 con 0x7f7f74073200 2024-09-21T07:33:52.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.659+0000 7f7f90c00640 1 -- 172.21.15.64:0/4188284034 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250947 (secure 0 0 0) 0x7f7f94155ed0 con 0x7f7f74073200 2024-09-21T07:33:52.661 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:52.662 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:33:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 msgr2=0x7f7f74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 0x7f7f74075710 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7f880098e0 tx=0x7f7f88009060 comp rx=0 tx=0).stop 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 msgr2=0x7f7f9409b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c01c810 tx=0x7f7f8c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 shutdown_connections 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7f74073200 0x7f7f74075710 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f9409b570 0x7f7f9409b980 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f9415edb0 0x7f7f94155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 --2- 172.21.15.64:0/4188284034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f940709b0 0x7f7f94150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 >> 172.21.15.64:0/4188284034 conn(0x7f7f940ccbe0 msgr2=0x7f7f940ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 shutdown_connections 2024-09-21T07:33:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.663+0000 7f7f9b800640 1 -- 172.21.15.64:0/4188284034 wait complete. 2024-09-21T07:33:52.684 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-21T07:33:51.605099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":440368,"kb_used_data":17320,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754534352,"statfs":{"total":773094113280,"available":772643176448,"internally_reserved":0,"allocated":17735680,"data_stored":8965952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":432983603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.628655+0000","last_change":"2024-09-21T07:33:47.625720+0000","last_active":"2024-09-21T07:33:47.628655+0000","last_peered":"2024-09-21T07:33:47.628655+0000","last_clean":"2024-09-21T07:33:47.628655+0000","last_became_active":"2024-09-21T07:33:47.625405+0000","last_became_peered":"2024-09-21T07:33:47.625405+0000","last_unstale":"2024-09-21T07:33:47.628655+0000","last_undegraded":"2024-09-21T07:33:47.628655+0000","last_fullsized":"2024-09-21T07:33:47.628655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:39.184691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608952+0000","last_change":"2024-09-21T07:33:46.608952+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608952+0000","last_undegraded":"2024-09-21T07:33:46.608952+0000","last_fullsized":"2024-09-21T07:33:46.608952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627903+0000","last_change":"2024-09-21T07:33:47.625681+0000","last_active":"2024-09-21T07:33:47.627903+0000","last_peered":"2024-09-21T07:33:47.627903+0000","last_clean":"2024-09-21T07:33:47.627903+0000","last_became_active":"2024-09-21T07:33:47.625335+0000","last_became_peered":"2024-09-21T07:33:47.625335+0000","last_unstale":"2024-09-21T07:33:47.627903+0000","last_undegraded":"2024-09-21T07:33:47.627903+0000","last_fullsized":"2024-09-21T07:33:47.627903+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:43.864741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.639981+0000","last_change":"2024-09-21T07:33:47.633470+0000","last_active":"2024-09-21T07:33:47.639981+0000","last_peered":"2024-09-21T07:33:47.639981+0000","last_clean":"2024-09-21T07:33:47.639981+0000","last_became_active":"2024-09-21T07:33:47.631234+0000","last_became_peered":"2024-09-21T07:33:47.631234+0000","last_unstale":"2024-09-21T07:33:47.639981+0000","last_undegraded":"2024-09-21T07:33:47.639981+0000","last_fullsized":"2024-09-21T07:33:47.639981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:10.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.630756+0000","last_change":"2024-09-21T07:33:47.630664+0000","last_active":"2024-09-21T07:33:47.630756+0000","last_peered":"2024-09-21T07:33:47.630756+0000","last_clean":"2024-09-21T07:33:47.630756+0000","last_became_active":"2024-09-21T07:33:47.630362+0000","last_became_peered":"2024-09-21T07:33:47.630362+0000","last_unstale":"2024-09-21T07:33:47.630756+0000","last_undegraded":"2024-09-21T07:33:47.630756+0000","last_fullsized":"2024-09-21T07:33:47.630756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:09.697464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612223+0000","last_change":"2024-09-21T07:33:46.612223+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612223+0000","last_undegraded":"2024-09-21T07:33:46.612223+0000","last_fullsized":"2024-09-21T07:33:46.612223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645051+0000","last_change":"2024-09-21T07:33:47.641086+0000","last_active":"2024-09-21T07:33:47.645051+0000","last_peered":"2024-09-21T07:33:47.645051+0000","last_clean":"2024-09-21T07:33:47.645051+0000","last_became_active":"2024-09-21T07:33:47.640738+0000","last_became_peered":"2024-09-21T07:33:47.640738+0000","last_unstale":"2024-09-21T07:33:47.645051+0000","last_undegraded":"2024-09-21T07:33:47.645051+0000","last_fullsized":"2024-09-21T07:33:47.645051+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:10.534281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647269+0000","last_change":"2024-09-21T07:33:47.641177+0000","last_active":"2024-09-21T07:33:47.647269+0000","last_peered":"2024-09-21T07:33:47.647269+0000","last_clean":"2024-09-21T07:33:47.647269+0000","last_became_active":"2024-09-21T07:33:47.640519+0000","last_became_peered":"2024-09-21T07:33:47.640519+0000","last_unstale":"2024-09-21T07:33:47.647269+0000","last_undegraded":"2024-09-21T07:33:47.647269+0000","last_fullsized":"2024-09-21T07:33:47.647269+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:59.630563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.653039+0000","last_change":"2024-09-21T07:33:47.648250+0000","last_active":"2024-09-21T07:33:47.653039+0000","last_peered":"2024-09-21T07:33:47.653039+0000","last_clean":"2024-09-21T07:33:47.653039+0000","last_became_active":"2024-09-21T07:33:47.647932+0000","last_became_peered":"2024-09-21T07:33:47.647932+0000","last_unstale":"2024-09-21T07:33:47.653039+0000","last_undegraded":"2024-09-21T07:33:47.653039+0000","last_fullsized":"2024-09-21T07:33:47.653039+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655569+0000","last_change":"2024-09-21T07:33:47.650131+0000","last_active":"2024-09-21T07:33:47.655569+0000","last_peered":"2024-09-21T07:33:47.655569+0000","last_clean":"2024-09-21T07:33:47.655569+0000","last_became_active":"2024-09-21T07:33:47.649771+0000","last_became_peered":"2024-09-21T07:33:47.649771+0000","last_unstale":"2024-09-21T07:33:47.655569+0000","last_undegraded":"2024-09-21T07:33:47.655569+0000","last_fullsized":"2024-09-21T07:33:47.655569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:25.893560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647649+0000","last_change":"2024-09-21T07:33:47.639979+0000","last_active":"2024-09-21T07:33:47.647649+0000","last_peered":"2024-09-21T07:33:47.647649+0000","last_clean":"2024-09-21T07:33:47.647649+0000","last_became_active":"2024-09-21T07:33:47.639661+0000","last_became_peered":"2024-09-21T07:33:47.639661+0000","last_unstale":"2024-09-21T07:33:47.647649+0000","last_undegraded":"2024-09-21T07:33:47.647649+0000","last_fullsized":"2024-09-21T07:33:47.647649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:34.175607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609434+0000","last_change":"2024-09-21T07:33:46.609434+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609434+0000","last_undegraded":"2024-09-21T07:33:46.609434+0000","last_fullsized":"2024-09-21T07:33:46.609434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642703+0000","last_change":"2024-09-21T07:33:47.642336+0000","last_active":"2024-09-21T07:33:48.642703+0000","last_peered":"2024-09-21T07:33:48.642703+0000","last_clean":"2024-09-21T07:33:48.642703+0000","last_became_active":"2024-09-21T07:33:47.642063+0000","last_became_peered":"2024-09-21T07:33:47.642063+0000","last_unstale":"2024-09-21T07:33:48.642703+0000","last_undegraded":"2024-09-21T07:33:48.642703+0000","last_fullsized":"2024-09-21T07:33:48.642703+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:53.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.621166+0000","last_change":"2024-09-21T07:33:47.621166+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.621166+0000","last_undegraded":"2024-09-21T07:33:47.621166+0000","last_fullsized":"2024-09-21T07:33:47.621166+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647814+0000","last_change":"2024-09-21T07:33:47.643740+0000","last_active":"2024-09-21T07:33:47.647814+0000","last_peered":"2024-09-21T07:33:47.647814+0000","last_clean":"2024-09-21T07:33:47.647814+0000","last_became_active":"2024-09-21T07:33:47.640771+0000","last_became_peered":"2024-09-21T07:33:47.640771+0000","last_unstale":"2024-09-21T07:33:47.647814+0000","last_undegraded":"2024-09-21T07:33:47.647814+0000","last_fullsized":"2024-09-21T07:33:47.647814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:16.925254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637281+0000","last_change":"2024-09-21T07:33:47.632386+0000","last_active":"2024-09-21T07:33:47.637281+0000","last_peered":"2024-09-21T07:33:47.637281+0000","last_clean":"2024-09-21T07:33:47.637281+0000","last_became_active":"2024-09-21T07:33:47.631743+0000","last_became_peered":"2024-09-21T07:33:47.631743+0000","last_unstale":"2024-09-21T07:33:47.637281+0000","last_undegraded":"2024-09-21T07:33:47.637281+0000","last_fullsized":"2024-09-21T07:33:47.637281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:11.253008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650242+0000","last_change":"2024-09-21T07:33:47.646697+0000","last_active":"2024-09-21T07:33:47.650242+0000","last_peered":"2024-09-21T07:33:47.650242+0000","last_clean":"2024-09-21T07:33:47.650242+0000","last_became_active":"2024-09-21T07:33:47.646388+0000","last_became_peered":"2024-09-21T07:33:47.646388+0000","last_unstale":"2024-09-21T07:33:47.650242+0000","last_undegraded":"2024-09-21T07:33:47.650242+0000","last_fullsized":"2024-09-21T07:33:47.650242+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620998+0000","last_change":"2024-09-21T07:33:47.620998+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620998+0000","last_undegraded":"2024-09-21T07:33:47.620998+0000","last_fullsized":"2024-09-21T07:33:47.620998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647684+0000","last_change":"2024-09-21T07:33:47.643086+0000","last_active":"2024-09-21T07:33:47.647684+0000","last_peered":"2024-09-21T07:33:47.647684+0000","last_clean":"2024-09-21T07:33:47.647684+0000","last_became_active":"2024-09-21T07:33:47.640786+0000","last_became_peered":"2024-09-21T07:33:47.640786+0000","last_unstale":"2024-09-21T07:33:47.647684+0000","last_undegraded":"2024-09-21T07:33:47.647684+0000","last_fullsized":"2024-09-21T07:33:47.647684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:42.233855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636537+0000","last_change":"2024-09-21T07:33:47.633448+0000","last_active":"2024-09-21T07:33:47.636537+0000","last_peered":"2024-09-21T07:33:47.636537+0000","last_clean":"2024-09-21T07:33:47.636537+0000","last_became_active":"2024-09-21T07:33:47.633066+0000","last_became_peered":"2024-09-21T07:33:47.633066+0000","last_unstale":"2024-09-21T07:33:47.636537+0000","last_undegraded":"2024-09-21T07:33:47.636537+0000","last_fullsized":"2024-09-21T07:33:47.636537+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:16.784821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642952+0000","last_change":"2024-09-21T07:33:47.629236+0000","last_active":"2024-09-21T07:33:48.642952+0000","last_peered":"2024-09-21T07:33:48.642952+0000","last_clean":"2024-09-21T07:33:48.642952+0000","last_became_active":"2024-09-21T07:33:47.628957+0000","last_became_peered":"2024-09-21T07:33:47.628957+0000","last_unstale":"2024-09-21T07:33:48.642952+0000","last_undegraded":"2024-09-21T07:33:48.642952+0000","last_fullsized":"2024-09-21T07:33:48.642952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:22.566695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608721+0000","last_change":"2024-09-21T07:33:46.608721+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608721+0000","last_undegraded":"2024-09-21T07:33:46.608721+0000","last_fullsized":"2024-09-21T07:33:46.608721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633662+0000","last_change":"2024-09-21T07:33:47.633569+0000","last_active":"2024-09-21T07:33:47.633662+0000","last_peered":"2024-09-21T07:33:47.633662+0000","last_clean":"2024-09-21T07:33:47.633662+0000","last_became_active":"2024-09-21T07:33:47.632464+0000","last_became_peered":"2024-09-21T07:33:47.632464+0000","last_unstale":"2024-09-21T07:33:47.633662+0000","last_undegraded":"2024-09-21T07:33:47.633662+0000","last_fullsized":"2024-09-21T07:33:47.633662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:34.907981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637311+0000","last_change":"2024-09-21T07:33:47.632731+0000","last_active":"2024-09-21T07:33:47.637311+0000","last_peered":"2024-09-21T07:33:47.637311+0000","last_clean":"2024-09-21T07:33:47.637311+0000","last_became_active":"2024-09-21T07:33:47.632100+0000","last_became_peered":"2024-09-21T07:33:47.632100+0000","last_unstale":"2024-09-21T07:33:47.637311+0000","last_undegraded":"2024-09-21T07:33:47.637311+0000","last_fullsized":"2024-09-21T07:33:47.637311+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:35.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643809+0000","last_change":"2024-09-21T07:33:47.634716+0000","last_active":"2024-09-21T07:33:48.643809+0000","last_peered":"2024-09-21T07:33:48.643809+0000","last_clean":"2024-09-21T07:33:48.643809+0000","last_became_active":"2024-09-21T07:33:47.634400+0000","last_became_peered":"2024-09-21T07:33:47.634400+0000","last_unstale":"2024-09-21T07:33:48.643809+0000","last_undegraded":"2024-09-21T07:33:48.643809+0000","last_fullsized":"2024-09-21T07:33:48.643809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:56.119446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635434+0000","last_change":"2024-09-21T07:33:47.632215+0000","last_active":"2024-09-21T07:33:47.635434+0000","last_peered":"2024-09-21T07:33:47.635434+0000","last_clean":"2024-09-21T07:33:47.635434+0000","last_became_active":"2024-09-21T07:33:47.631762+0000","last_became_peered":"2024-09-21T07:33:47.631762+0000","last_unstale":"2024-09-21T07:33:47.635434+0000","last_undegraded":"2024-09-21T07:33:47.635434+0000","last_fullsized":"2024-09-21T07:33:47.635434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:53.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613896+0000","last_change":"2024-09-21T07:33:46.613896+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613896+0000","last_undegraded":"2024-09-21T07:33:46.613896+0000","last_fullsized":"2024-09-21T07:33:46.613896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643015+0000","last_change":"2024-09-21T07:33:47.631128+0000","last_active":"2024-09-21T07:33:48.643015+0000","last_peered":"2024-09-21T07:33:48.643015+0000","last_clean":"2024-09-21T07:33:48.643015+0000","last_became_active":"2024-09-21T07:33:47.626470+0000","last_became_peered":"2024-09-21T07:33:47.626470+0000","last_unstale":"2024-09-21T07:33:48.643015+0000","last_undegraded":"2024-09-21T07:33:48.643015+0000","last_fullsized":"2024-09-21T07:33:48.643015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:16.850891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.614301+0000","last_change":"2024-09-21T07:33:46.614301+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.614301+0000","last_undegraded":"2024-09-21T07:33:46.614301+0000","last_fullsized":"2024-09-21T07:33:46.614301+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.618315+0000","last_change":"2024-09-21T07:33:47.618315+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.618315+0000","last_undegraded":"2024-09-21T07:33:47.618315+0000","last_fullsized":"2024-09-21T07:33:47.618315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647785+0000","last_change":"2024-09-21T07:33:47.640296+0000","last_active":"2024-09-21T07:33:47.647785+0000","last_peered":"2024-09-21T07:33:47.647785+0000","last_clean":"2024-09-21T07:33:47.647785+0000","last_became_active":"2024-09-21T07:33:47.639859+0000","last_became_peered":"2024-09-21T07:33:47.639859+0000","last_unstale":"2024-09-21T07:33:47.647785+0000","last_undegraded":"2024-09-21T07:33:47.647785+0000","last_fullsized":"2024-09-21T07:33:47.647785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:20.740598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634628+0000","last_change":"2024-09-21T07:33:47.632301+0000","last_active":"2024-09-21T07:33:47.634628+0000","last_peered":"2024-09-21T07:33:47.634628+0000","last_clean":"2024-09-21T07:33:47.634628+0000","last_became_active":"2024-09-21T07:33:47.631997+0000","last_became_peered":"2024-09-21T07:33:47.631997+0000","last_unstale":"2024-09-21T07:33:47.634628+0000","last_undegraded":"2024-09-21T07:33:47.634628+0000","last_fullsized":"2024-09-21T07:33:47.634628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:13.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609249+0000","last_change":"2024-09-21T07:33:46.609249+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609249+0000","last_undegraded":"2024-09-21T07:33:46.609249+0000","last_fullsized":"2024-09-21T07:33:46.609249+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614971+0000","last_change":"2024-09-21T07:33:46.621829+0000","last_active":"2024-09-21T07:33:47.614971+0000","last_peered":"2024-09-21T07:33:47.614971+0000","last_clean":"2024-09-21T07:33:47.614971+0000","last_became_active":"2024-09-21T07:33:46.621108+0000","last_became_peered":"2024-09-21T07:33:46.621108+0000","last_unstale":"2024-09-21T07:33:47.614971+0000","last_undegraded":"2024-09-21T07:33:47.614971+0000","last_fullsized":"2024-09-21T07:33:47.614971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:49.328101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642339+0000","last_change":"2024-09-21T07:33:47.633401+0000","last_active":"2024-09-21T07:33:48.642339+0000","last_peered":"2024-09-21T07:33:48.642339+0000","last_clean":"2024-09-21T07:33:48.642339+0000","last_became_active":"2024-09-21T07:33:47.633086+0000","last_became_peered":"2024-09-21T07:33:47.633086+0000","last_unstale":"2024-09-21T07:33:48.642339+0000","last_undegraded":"2024-09-21T07:33:48.642339+0000","last_fullsized":"2024-09-21T07:33:48.642339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:35.443908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627767+0000","last_change":"2024-09-21T07:33:46.629787+0000","last_active":"2024-09-21T07:33:47.627767+0000","last_peered":"2024-09-21T07:33:47.627767+0000","last_clean":"2024-09-21T07:33:47.627767+0000","last_became_active":"2024-09-21T07:33:46.629432+0000","last_became_peered":"2024-09-21T07:33:46.629432+0000","last_unstale":"2024-09-21T07:33:47.627767+0000","last_undegraded":"2024-09-21T07:33:47.627767+0000","last_fullsized":"2024-09-21T07:33:47.627767+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:20.018028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620779+0000","last_change":"2024-09-21T07:33:47.620779+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620779+0000","last_undegraded":"2024-09-21T07:33:47.620779+0000","last_fullsized":"2024-09-21T07:33:47.620779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.620530+0000","last_change":"2024-09-21T07:33:46.627109+0000","last_active":"2024-09-21T07:33:47.620530+0000","last_peered":"2024-09-21T07:33:47.620530+0000","last_clean":"2024-09-21T07:33:47.620530+0000","last_became_active":"2024-09-21T07:33:46.626791+0000","last_became_peered":"2024-09-21T07:33:46.626791+0000","last_unstale":"2024-09-21T07:33:47.620530+0000","last_undegraded":"2024-09-21T07:33:47.620530+0000","last_fullsized":"2024-09-21T07:33:47.620530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:27.963968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.610637+0000","last_change":"2024-09-21T07:33:46.610637+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.610637+0000","last_undegraded":"2024-09-21T07:33:46.610637+0000","last_fullsized":"2024-09-21T07:33:46.610637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615697+0000","last_change":"2024-09-21T07:33:46.628812+0000","last_active":"2024-09-21T07:33:47.615697+0000","last_peered":"2024-09-21T07:33:47.615697+0000","last_clean":"2024-09-21T07:33:47.615697+0000","last_became_active":"2024-09-21T07:33:46.628282+0000","last_became_peered":"2024-09-21T07:33:46.628282+0000","last_unstale":"2024-09-21T07:33:47.615697+0000","last_undegraded":"2024-09-21T07:33:47.615697+0000","last_fullsized":"2024-09-21T07:33:47.615697+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.194913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.656287+0000","last_change":"2024-09-21T07:33:47.650503+0000","last_active":"2024-09-21T07:33:47.656287+0000","last_peered":"2024-09-21T07:33:47.656287+0000","last_clean":"2024-09-21T07:33:47.656287+0000","last_became_active":"2024-09-21T07:33:47.650188+0000","last_became_peered":"2024-09-21T07:33:47.650188+0000","last_unstale":"2024-09-21T07:33:47.656287+0000","last_undegraded":"2024-09-21T07:33:47.656287+0000","last_fullsized":"2024-09-21T07:33:47.656287+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.846100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.648138+0000","last_change":"2024-09-21T07:33:46.623523+0000","last_active":"2024-09-21T07:33:47.648138+0000","last_peered":"2024-09-21T07:33:47.648138+0000","last_clean":"2024-09-21T07:33:47.648138+0000","last_became_active":"2024-09-21T07:33:46.623174+0000","last_became_peered":"2024-09-21T07:33:46.623174+0000","last_unstale":"2024-09-21T07:33:47.648138+0000","last_undegraded":"2024-09-21T07:33:47.648138+0000","last_fullsized":"2024-09-21T07:33:47.648138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:58.346289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636603+0000","last_change":"2024-09-21T07:33:47.630806+0000","last_active":"2024-09-21T07:33:47.636603+0000","last_peered":"2024-09-21T07:33:47.636603+0000","last_clean":"2024-09-21T07:33:47.636603+0000","last_became_active":"2024-09-21T07:33:47.630494+0000","last_became_peered":"2024-09-21T07:33:47.630494+0000","last_unstale":"2024-09-21T07:33:47.636603+0000","last_undegraded":"2024-09-21T07:33:47.636603+0000","last_fullsized":"2024-09-21T07:33:47.636603+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.316252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.625009+0000","last_change":"2024-09-21T07:33:46.608788+0000","last_active":"2024-09-21T07:33:47.625009+0000","last_peered":"2024-09-21T07:33:47.625009+0000","last_clean":"2024-09-21T07:33:47.625009+0000","last_became_active":"2024-09-21T07:33:46.608428+0000","last_became_peered":"2024-09-21T07:33:46.608428+0000","last_unstale":"2024-09-21T07:33:47.625009+0000","last_undegraded":"2024-09-21T07:33:47.625009+0000","last_fullsized":"2024-09-21T07:33:47.625009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:24.973246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634160+0000","last_change":"2024-09-21T07:33:47.624817+0000","last_active":"2024-09-21T07:33:47.634160+0000","last_peered":"2024-09-21T07:33:47.634160+0000","last_clean":"2024-09-21T07:33:47.634160+0000","last_became_active":"2024-09-21T07:33:47.624500+0000","last_became_peered":"2024-09-21T07:33:47.624500+0000","last_unstale":"2024-09-21T07:33:47.634160+0000","last_undegraded":"2024-09-21T07:33:47.634160+0000","last_fullsized":"2024-09-21T07:33:47.634160+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:36.647441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618360+0000","last_change":"2024-09-21T07:33:46.629058+0000","last_active":"2024-09-21T07:33:47.618360+0000","last_peered":"2024-09-21T07:33:47.618360+0000","last_clean":"2024-09-21T07:33:47.618360+0000","last_became_active":"2024-09-21T07:33:46.628579+0000","last_became_peered":"2024-09-21T07:33:46.628579+0000","last_unstale":"2024-09-21T07:33:47.618360+0000","last_undegraded":"2024-09-21T07:33:47.618360+0000","last_fullsized":"2024-09-21T07:33:47.618360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:58.077760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.641218+0000","last_change":"2024-09-21T07:33:47.635770+0000","last_active":"2024-09-21T07:33:47.641218+0000","last_peered":"2024-09-21T07:33:47.641218+0000","last_clean":"2024-09-21T07:33:47.641218+0000","last_became_active":"2024-09-21T07:33:47.635454+0000","last_became_peered":"2024-09-21T07:33:47.635454+0000","last_unstale":"2024-09-21T07:33:47.641218+0000","last_undegraded":"2024-09-21T07:33:47.641218+0000","last_fullsized":"2024-09-21T07:33:47.641218+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:53.974927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624650+0000","last_change":"2024-09-21T07:33:46.626183+0000","last_active":"2024-09-21T07:33:47.624650+0000","last_peered":"2024-09-21T07:33:47.624650+0000","last_clean":"2024-09-21T07:33:47.624650+0000","last_became_active":"2024-09-21T07:33:46.625875+0000","last_became_peered":"2024-09-21T07:33:46.625875+0000","last_unstale":"2024-09-21T07:33:47.624650+0000","last_undegraded":"2024-09-21T07:33:47.624650+0000","last_fullsized":"2024-09-21T07:33:47.624650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.173888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613127+0000","last_change":"2024-09-21T07:33:46.613127+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613127+0000","last_undegraded":"2024-09-21T07:33:46.613127+0000","last_fullsized":"2024-09-21T07:33:46.613127+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643517+0000","last_change":"2024-09-21T07:33:46.627781+0000","last_active":"2024-09-21T07:33:48.643517+0000","last_peered":"2024-09-21T07:33:48.643517+0000","last_clean":"2024-09-21T07:33:48.643517+0000","last_became_active":"2024-09-21T07:33:46.627385+0000","last_became_peered":"2024-09-21T07:33:46.627385+0000","last_unstale":"2024-09-21T07:33:48.643517+0000","last_undegraded":"2024-09-21T07:33:48.643517+0000","last_fullsized":"2024-09-21T07:33:48.643517+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:55.725847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642572+0000","last_change":"2024-09-21T07:33:47.639144+0000","last_active":"2024-09-21T07:33:48.642572+0000","last_peered":"2024-09-21T07:33:48.642572+0000","last_clean":"2024-09-21T07:33:48.642572+0000","last_became_active":"2024-09-21T07:33:47.638831+0000","last_became_peered":"2024-09-21T07:33:47.638831+0000","last_unstale":"2024-09-21T07:33:48.642572+0000","last_undegraded":"2024-09-21T07:33:48.642572+0000","last_fullsized":"2024-09-21T07:33:48.642572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.804124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614671+0000","last_change":"2024-09-21T07:33:46.618197+0000","last_active":"2024-09-21T07:33:47.614671+0000","last_peered":"2024-09-21T07:33:47.614671+0000","last_clean":"2024-09-21T07:33:47.614671+0000","last_became_active":"2024-09-21T07:33:46.617845+0000","last_became_peered":"2024-09-21T07:33:46.617845+0000","last_unstale":"2024-09-21T07:33:47.614671+0000","last_undegraded":"2024-09-21T07:33:47.614671+0000","last_fullsized":"2024-09-21T07:33:47.614671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:40.942593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636657+0000","last_change":"2024-09-21T07:33:47.633080+0000","last_active":"2024-09-21T07:33:47.636657+0000","last_peered":"2024-09-21T07:33:47.636657+0000","last_clean":"2024-09-21T07:33:47.636657+0000","last_became_active":"2024-09-21T07:33:47.632770+0000","last_became_peered":"2024-09-21T07:33:47.632770+0000","last_unstale":"2024-09-21T07:33:47.636657+0000","last_undegraded":"2024-09-21T07:33:47.636657+0000","last_fullsized":"2024-09-21T07:33:47.636657+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:26.206243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643087+0000","last_change":"2024-09-21T07:33:46.624386+0000","last_active":"2024-09-21T07:33:48.643087+0000","last_peered":"2024-09-21T07:33:48.643087+0000","last_clean":"2024-09-21T07:33:48.643087+0000","last_became_active":"2024-09-21T07:33:46.622664+0000","last_became_peered":"2024-09-21T07:33:46.622664+0000","last_unstale":"2024-09-21T07:33:48.643087+0000","last_undegraded":"2024-09-21T07:33:48.643087+0000","last_fullsized":"2024-09-21T07:33:48.643087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.642393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633788+0000","last_change":"2024-09-21T07:33:47.632859+0000","last_active":"2024-09-21T07:33:47.633788+0000","last_peered":"2024-09-21T07:33:47.633788+0000","last_clean":"2024-09-21T07:33:47.633788+0000","last_became_active":"2024-09-21T07:33:47.632480+0000","last_became_peered":"2024-09-21T07:33:47.632480+0000","last_unstale":"2024-09-21T07:33:47.633788+0000","last_undegraded":"2024-09-21T07:33:47.633788+0000","last_fullsized":"2024-09-21T07:33:47.633788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:37.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626018+0000","last_change":"2024-09-21T07:33:46.618752+0000","last_active":"2024-09-21T07:33:47.626018+0000","last_peered":"2024-09-21T07:33:47.626018+0000","last_clean":"2024-09-21T07:33:47.626018+0000","last_became_active":"2024-09-21T07:33:46.617838+0000","last_became_peered":"2024-09-21T07:33:46.617838+0000","last_unstale":"2024-09-21T07:33:47.626018+0000","last_undegraded":"2024-09-21T07:33:47.626018+0000","last_fullsized":"2024-09-21T07:33:47.626018+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.349802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646073+0000","last_change":"2024-09-21T07:33:47.643524+0000","last_active":"2024-09-21T07:33:47.646073+0000","last_peered":"2024-09-21T07:33:47.646073+0000","last_clean":"2024-09-21T07:33:47.646073+0000","last_became_active":"2024-09-21T07:33:47.643202+0000","last_became_peered":"2024-09-21T07:33:47.643202+0000","last_unstale":"2024-09-21T07:33:47.646073+0000","last_undegraded":"2024-09-21T07:33:47.646073+0000","last_fullsized":"2024-09-21T07:33:47.646073+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:39.768719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642752+0000","last_change":"2024-09-21T07:33:46.608302+0000","last_active":"2024-09-21T07:33:48.642752+0000","last_peered":"2024-09-21T07:33:48.642752+0000","last_clean":"2024-09-21T07:33:48.642752+0000","last_became_active":"2024-09-21T07:33:46.607990+0000","last_became_peered":"2024-09-21T07:33:46.607990+0000","last_unstale":"2024-09-21T07:33:48.642752+0000","last_undegraded":"2024-09-21T07:33:48.642752+0000","last_fullsized":"2024-09-21T07:33:48.642752+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:19.640505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.644246+0000","last_change":"2024-09-21T07:33:47.636878+0000","last_active":"2024-09-21T07:33:47.644246+0000","last_peered":"2024-09-21T07:33:47.644246+0000","last_clean":"2024-09-21T07:33:47.644246+0000","last_became_active":"2024-09-21T07:33:47.636386+0000","last_became_peered":"2024-09-21T07:33:47.636386+0000","last_unstale":"2024-09-21T07:33:47.644246+0000","last_undegraded":"2024-09-21T07:33:47.644246+0000","last_fullsized":"2024-09-21T07:33:47.644246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:03.374135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.621926+0000","last_change":"2024-09-21T07:33:46.618935+0000","last_active":"2024-09-21T07:33:47.621926+0000","last_peered":"2024-09-21T07:33:47.621926+0000","last_clean":"2024-09-21T07:33:47.621926+0000","last_became_active":"2024-09-21T07:33:46.618440+0000","last_became_peered":"2024-09-21T07:33:46.618440+0000","last_unstale":"2024-09-21T07:33:47.621926+0000","last_undegraded":"2024-09-21T07:33:47.621926+0000","last_fullsized":"2024-09-21T07:33:47.621926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:42.515209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637419+0000","last_change":"2024-09-21T07:33:47.635158+0000","last_active":"2024-09-21T07:33:47.637419+0000","last_peered":"2024-09-21T07:33:47.637419+0000","last_clean":"2024-09-21T07:33:47.637419+0000","last_became_active":"2024-09-21T07:33:47.631190+0000","last_became_peered":"2024-09-21T07:33:47.631190+0000","last_unstale":"2024-09-21T07:33:47.637419+0000","last_undegraded":"2024-09-21T07:33:47.637419+0000","last_fullsized":"2024-09-21T07:33:47.637419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:57.182476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.651436+0000","last_change":"2024-09-21T07:33:46.622115+0000","last_active":"2024-09-21T07:33:47.651436+0000","last_peered":"2024-09-21T07:33:47.651436+0000","last_clean":"2024-09-21T07:33:47.651436+0000","last_became_active":"2024-09-21T07:33:46.621741+0000","last_became_peered":"2024-09-21T07:33:46.621741+0000","last_unstale":"2024-09-21T07:33:47.651436+0000","last_undegraded":"2024-09-21T07:33:47.651436+0000","last_fullsized":"2024-09-21T07:33:47.651436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:09.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645042+0000","last_change":"2024-09-21T07:33:47.640834+0000","last_active":"2024-09-21T07:33:47.645042+0000","last_peered":"2024-09-21T07:33:47.645042+0000","last_clean":"2024-09-21T07:33:47.645042+0000","last_became_active":"2024-09-21T07:33:47.640148+0000","last_became_peered":"2024-09-21T07:33:47.640148+0000","last_unstale":"2024-09-21T07:33:47.645042+0000","last_undegraded":"2024-09-21T07:33:47.645042+0000","last_fullsized":"2024-09-21T07:33:47.645042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:32.615535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643855+0000","last_change":"2024-09-21T07:33:46.616859+0000","last_active":"2024-09-21T07:33:48.643855+0000","last_peered":"2024-09-21T07:33:48.643855+0000","last_clean":"2024-09-21T07:33:48.643855+0000","last_became_active":"2024-09-21T07:33:46.616532+0000","last_became_peered":"2024-09-21T07:33:46.616532+0000","last_unstale":"2024-09-21T07:33:48.643855+0000","last_undegraded":"2024-09-21T07:33:48.643855+0000","last_fullsized":"2024-09-21T07:33:48.643855+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:07.334027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635879+0000","last_change":"2024-09-21T07:33:47.634300+0000","last_active":"2024-09-21T07:33:47.635879+0000","last_peered":"2024-09-21T07:33:47.635879+0000","last_clean":"2024-09-21T07:33:47.635879+0000","last_became_active":"2024-09-21T07:33:47.633771+0000","last_became_peered":"2024-09-21T07:33:47.633771+0000","last_unstale":"2024-09-21T07:33:47.635879+0000","last_undegraded":"2024-09-21T07:33:47.635879+0000","last_fullsized":"2024-09-21T07:33:47.635879+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:26.900131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650706+0000","last_change":"2024-09-21T07:33:46.630896+0000","last_active":"2024-09-21T07:33:47.650706+0000","last_peered":"2024-09-21T07:33:47.650706+0000","last_clean":"2024-09-21T07:33:47.650706+0000","last_became_active":"2024-09-21T07:33:46.630594+0000","last_became_peered":"2024-09-21T07:33:46.630594+0000","last_unstale":"2024-09-21T07:33:47.650706+0000","last_undegraded":"2024-09-21T07:33:47.650706+0000","last_fullsized":"2024-09-21T07:33:47.650706+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:15.215651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645092+0000","last_change":"2024-09-21T07:33:47.639931+0000","last_active":"2024-09-21T07:33:47.645092+0000","last_peered":"2024-09-21T07:33:47.645092+0000","last_clean":"2024-09-21T07:33:47.645092+0000","last_became_active":"2024-09-21T07:33:47.636826+0000","last_became_peered":"2024-09-21T07:33:47.636826+0000","last_unstale":"2024-09-21T07:33:47.645092+0000","last_undegraded":"2024-09-21T07:33:47.645092+0000","last_fullsized":"2024-09-21T07:33:47.645092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:38.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623601+0000","last_change":"2024-09-21T07:33:46.618120+0000","last_active":"2024-09-21T07:33:47.623601+0000","last_peered":"2024-09-21T07:33:47.623601+0000","last_clean":"2024-09-21T07:33:47.623601+0000","last_became_active":"2024-09-21T07:33:46.616030+0000","last_became_peered":"2024-09-21T07:33:46.616030+0000","last_unstale":"2024-09-21T07:33:47.623601+0000","last_undegraded":"2024-09-21T07:33:47.623601+0000","last_fullsized":"2024-09-21T07:33:47.623601+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:32.017754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647351+0000","last_change":"2024-09-21T07:33:47.647224+0000","last_active":"2024-09-21T07:33:47.647351+0000","last_peered":"2024-09-21T07:33:47.647351+0000","last_clean":"2024-09-21T07:33:47.647351+0000","last_became_active":"2024-09-21T07:33:47.646601+0000","last_became_peered":"2024-09-21T07:33:47.646601+0000","last_unstale":"2024-09-21T07:33:47.647351+0000","last_undegraded":"2024-09-21T07:33:47.647351+0000","last_fullsized":"2024-09-21T07:33:47.647351+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:04.972030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635958+0000","last_change":"2024-09-21T07:33:46.621372+0000","last_active":"2024-09-21T07:33:47.635958+0000","last_peered":"2024-09-21T07:33:47.635958+0000","last_clean":"2024-09-21T07:33:47.635958+0000","last_became_active":"2024-09-21T07:33:46.621006+0000","last_became_peered":"2024-09-21T07:33:46.621006+0000","last_unstale":"2024-09-21T07:33:47.635958+0000","last_undegraded":"2024-09-21T07:33:47.635958+0000","last_fullsized":"2024-09-21T07:33:47.635958+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643288+0000","last_change":"2024-09-21T07:33:47.630067+0000","last_active":"2024-09-21T07:33:48.643288+0000","last_peered":"2024-09-21T07:33:48.643288+0000","last_clean":"2024-09-21T07:33:48.643288+0000","last_became_active":"2024-09-21T07:33:47.626995+0000","last_became_peered":"2024-09-21T07:33:47.626995+0000","last_unstale":"2024-09-21T07:33:48.643288+0000","last_undegraded":"2024-09-21T07:33:48.643288+0000","last_fullsized":"2024-09-21T07:33:48.643288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:06.240784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626235+0000","last_change":"2024-09-21T07:33:46.619652+0000","last_active":"2024-09-21T07:33:47.626235+0000","last_peered":"2024-09-21T07:33:47.626235+0000","last_clean":"2024-09-21T07:33:47.626235+0000","last_became_active":"2024-09-21T07:33:46.619267+0000","last_became_peered":"2024-09-21T07:33:46.619267+0000","last_unstale":"2024-09-21T07:33:47.626235+0000","last_undegraded":"2024-09-21T07:33:47.626235+0000","last_fullsized":"2024-09-21T07:33:47.626235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:59.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.623190+0000","last_change":"2024-09-21T07:33:47.623190+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.623190+0000","last_undegraded":"2024-09-21T07:33:47.623190+0000","last_fullsized":"2024-09-21T07:33:47.623190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.619911+0000","last_change":"2024-09-21T07:33:46.614497+0000","last_active":"2024-09-21T07:33:47.619911+0000","last_peered":"2024-09-21T07:33:47.619911+0000","last_clean":"2024-09-21T07:33:47.619911+0000","last_became_active":"2024-09-21T07:33:46.614181+0000","last_became_peered":"2024-09-21T07:33:46.614181+0000","last_unstale":"2024-09-21T07:33:47.619911+0000","last_undegraded":"2024-09-21T07:33:47.619911+0000","last_fullsized":"2024-09-21T07:33:47.619911+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:29.909421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.625374+0000","last_change":"2024-09-21T07:33:47.625374+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.625374+0000","last_undegraded":"2024-09-21T07:33:47.625374+0000","last_fullsized":"2024-09-21T07:33:47.625374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618612+0000","last_change":"2024-09-21T07:33:46.621849+0000","last_active":"2024-09-21T07:33:47.618612+0000","last_peered":"2024-09-21T07:33:47.618612+0000","last_clean":"2024-09-21T07:33:47.618612+0000","last_became_active":"2024-09-21T07:33:46.621232+0000","last_became_peered":"2024-09-21T07:33:46.621232+0000","last_unstale":"2024-09-21T07:33:47.618612+0000","last_undegraded":"2024-09-21T07:33:47.618612+0000","last_fullsized":"2024-09-21T07:33:47.618612+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.193047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612446+0000","last_change":"2024-09-21T07:33:46.612446+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612446+0000","last_undegraded":"2024-09-21T07:33:46.612446+0000","last_fullsized":"2024-09-21T07:33:46.612446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.623747+0000","last_change":"2024-09-21T07:33:46.623165+0000","last_active":"2024-09-21T07:33:46.623747+0000","last_peered":"2024-09-21T07:33:46.623747+0000","last_clean":"2024-09-21T07:33:46.623747+0000","last_became_active":"2024-09-21T07:33:46.622212+0000","last_became_peered":"2024-09-21T07:33:46.622212+0000","last_unstale":"2024-09-21T07:33:46.623747+0000","last_undegraded":"2024-09-21T07:33:46.623747+0000","last_fullsized":"2024-09-21T07:33:46.623747+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:40.821174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.642998+0000","last_change":"2024-09-21T07:33:47.631677+0000","last_active":"2024-09-21T07:33:47.642998+0000","last_peered":"2024-09-21T07:33:47.642998+0000","last_clean":"2024-09-21T07:33:47.642998+0000","last_became_active":"2024-09-21T07:33:47.631353+0000","last_became_peered":"2024-09-21T07:33:47.631353+0000","last_unstale":"2024-09-21T07:33:47.642998+0000","last_undegraded":"2024-09-21T07:33:47.642998+0000","last_fullsized":"2024-09-21T07:33:47.642998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:29.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623959+0000","last_change":"2024-09-21T07:33:46.617084+0000","last_active":"2024-09-21T07:33:47.623959+0000","last_peered":"2024-09-21T07:33:47.623959+0000","last_clean":"2024-09-21T07:33:47.623959+0000","last_became_active":"2024-09-21T07:33:46.616734+0000","last_became_peered":"2024-09-21T07:33:46.616734+0000","last_unstale":"2024-09-21T07:33:47.623959+0000","last_undegraded":"2024-09-21T07:33:47.623959+0000","last_fullsized":"2024-09-21T07:33:47.623959+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:32.230121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646020+0000","last_change":"2024-09-21T07:33:47.642657+0000","last_active":"2024-09-21T07:33:47.646020+0000","last_peered":"2024-09-21T07:33:47.646020+0000","last_clean":"2024-09-21T07:33:47.646020+0000","last_became_active":"2024-09-21T07:33:47.642192+0000","last_became_peered":"2024-09-21T07:33:47.642192+0000","last_unstale":"2024-09-21T07:33:47.646020+0000","last_undegraded":"2024-09-21T07:33:47.646020+0000","last_fullsized":"2024-09-21T07:33:47.646020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:36.500996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"167'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643520+0000","last_change":"2024-09-21T07:33:46.631671+0000","last_active":"2024-09-21T07:33:48.643520+0000","last_peered":"2024-09-21T07:33:48.643520+0000","last_clean":"2024-09-21T07:33:48.643520+0000","last_became_active":"2024-09-21T07:33:46.631252+0000","last_became_peered":"2024-09-21T07:33:46.631252+0000","last_unstale":"2024-09-21T07:33:48.643520+0000","last_undegraded":"2024-09-21T07:33:48.643520+0000","last_fullsized":"2024-09-21T07:33:48.643520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:21.204372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634381+0000","last_change":"2024-09-21T07:33:47.629056+0000","last_active":"2024-09-21T07:33:47.634381+0000","last_peered":"2024-09-21T07:33:47.634381+0000","last_clean":"2024-09-21T07:33:47.634381+0000","last_became_active":"2024-09-21T07:33:47.628712+0000","last_became_peered":"2024-09-21T07:33:47.628712+0000","last_unstale":"2024-09-21T07:33:47.634381+0000","last_undegraded":"2024-09-21T07:33:47.634381+0000","last_fullsized":"2024-09-21T07:33:47.634381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:23.902544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642993+0000","last_change":"2024-09-21T07:33:46.620290+0000","last_active":"2024-09-21T07:33:48.642993+0000","last_peered":"2024-09-21T07:33:48.642993+0000","last_clean":"2024-09-21T07:33:48.642993+0000","last_became_active":"2024-09-21T07:33:46.619866+0000","last_became_peered":"2024-09-21T07:33:46.619866+0000","last_unstale":"2024-09-21T07:33:48.642993+0000","last_undegraded":"2024-09-21T07:33:48.642993+0000","last_fullsized":"2024-09-21T07:33:48.642993+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.778171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655365+0000","last_change":"2024-09-21T07:33:47.651031+0000","last_active":"2024-09-21T07:33:47.655365+0000","last_peered":"2024-09-21T07:33:47.655365+0000","last_clean":"2024-09-21T07:33:47.655365+0000","last_became_active":"2024-09-21T07:33:47.650740+0000","last_became_peered":"2024-09-21T07:33:47.650740+0000","last_unstale":"2024-09-21T07:33:47.655365+0000","last_undegraded":"2024-09-21T07:33:47.655365+0000","last_fullsized":"2024-09-21T07:33:47.655365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:41.408856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615429+0000","last_change":"2024-09-21T07:33:46.634107+0000","last_active":"2024-09-21T07:33:47.615429+0000","last_peered":"2024-09-21T07:33:47.615429+0000","last_clean":"2024-09-21T07:33:47.615429+0000","last_became_active":"2024-09-21T07:33:46.633497+0000","last_became_peered":"2024-09-21T07:33:46.633497+0000","last_unstale":"2024-09-21T07:33:47.615429+0000","last_undegraded":"2024-09-21T07:33:47.615429+0000","last_fullsized":"2024-09-21T07:33:47.615429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:15.769168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634796+0000","last_change":"2024-09-21T07:33:47.631144+0000","last_active":"2024-09-21T07:33:47.634796+0000","last_peered":"2024-09-21T07:33:47.634796+0000","last_clean":"2024-09-21T07:33:47.634796+0000","last_became_active":"2024-09-21T07:33:47.630009+0000","last_became_peered":"2024-09-21T07:33:47.630009+0000","last_unstale":"2024-09-21T07:33:47.634796+0000","last_undegraded":"2024-09-21T07:33:47.634796+0000","last_fullsized":"2024-09-21T07:33:47.634796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:12.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.613968+0000","last_change":"2024-09-21T07:33:46.619099+0000","last_active":"2024-09-21T07:33:47.613968+0000","last_peered":"2024-09-21T07:33:47.613968+0000","last_clean":"2024-09-21T07:33:47.613968+0000","last_became_active":"2024-09-21T07:33:46.618774+0000","last_became_peered":"2024-09-21T07:33:46.618774+0000","last_unstale":"2024-09-21T07:33:47.613968+0000","last_undegraded":"2024-09-21T07:33:47.613968+0000","last_fullsized":"2024-09-21T07:33:47.613968+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:37.526034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.611062+0000","last_change":"2024-09-21T07:33:46.611062+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.611062+0000","last_undegraded":"2024-09-21T07:33:46.611062+0000","last_fullsized":"2024-09-21T07:33:46.611062+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642639+0000","last_change":"2024-09-21T07:33:46.629792+0000","last_active":"2024-09-21T07:33:48.642639+0000","last_peered":"2024-09-21T07:33:48.642639+0000","last_clean":"2024-09-21T07:33:48.642639+0000","last_became_active":"2024-09-21T07:33:46.628571+0000","last_became_peered":"2024-09-21T07:33:46.628571+0000","last_unstale":"2024-09-21T07:33:48.642639+0000","last_undegraded":"2024-09-21T07:33:48.642639+0000","last_fullsized":"2024-09-21T07:33:48.642639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:12.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643428+0000","last_change":"2024-09-21T07:33:47.632070+0000","last_active":"2024-09-21T07:33:48.643428+0000","last_peered":"2024-09-21T07:33:48.643428+0000","last_clean":"2024-09-21T07:33:48.643428+0000","last_became_active":"2024-09-21T07:33:47.630789+0000","last_became_peered":"2024-09-21T07:33:47.630789+0000","last_unstale":"2024-09-21T07:33:48.643428+0000","last_undegraded":"2024-09-21T07:33:48.643428+0000","last_fullsized":"2024-09-21T07:33:48.643428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:43.272580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.622151+0000","last_change":"2024-09-21T07:33:46.622064+0000","last_active":"2024-09-21T07:33:47.622151+0000","last_peered":"2024-09-21T07:33:47.622151+0000","last_clean":"2024-09-21T07:33:47.622151+0000","last_became_active":"2024-09-21T07:33:46.621756+0000","last_became_peered":"2024-09-21T07:33:46.621756+0000","last_unstale":"2024-09-21T07:33:47.622151+0000","last_undegraded":"2024-09-21T07:33:47.622151+0000","last_fullsized":"2024-09-21T07:33:47.622151+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:20.287855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.616070+0000","last_change":"2024-09-21T07:33:47.616070+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.616070+0000","last_undegraded":"2024-09-21T07:33:47.616070+0000","last_fullsized":"2024-09-21T07:33:47.616070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624227+0000","last_change":"2024-09-21T07:33:46.619268+0000","last_active":"2024-09-21T07:33:47.624227+0000","last_peered":"2024-09-21T07:33:47.624227+0000","last_clean":"2024-09-21T07:33:47.624227+0000","last_became_active":"2024-09-21T07:33:46.618021+0000","last_became_peered":"2024-09-21T07:33:46.618021+0000","last_unstale":"2024-09-21T07:33:47.624227+0000","last_undegraded":"2024-09-21T07:33:47.624227+0000","last_fullsized":"2024-09-21T07:33:47.624227+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:40.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609654+0000","last_change":"2024-09-21T07:33:46.609654+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609654+0000","last_undegraded":"2024-09-21T07:33:46.609654+0000","last_fullsized":"2024-09-21T07:33:46.609654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643309+0000","last_change":"2024-09-21T07:33:46.631055+0000","last_active":"2024-09-21T07:33:48.643309+0000","last_peered":"2024-09-21T07:33:48.643309+0000","last_clean":"2024-09-21T07:33:48.643309+0000","last_became_active":"2024-09-21T07:33:46.630753+0000","last_became_peered":"2024-09-21T07:33:46.630753+0000","last_unstale":"2024-09-21T07:33:48.643309+0000","last_undegraded":"2024-09-21T07:33:48.643309+0000","last_fullsized":"2024-09-21T07:33:48.643309+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:32.810868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":372,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.614920+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:33:46.614920+0000","last_peered":"2024-09-21T07:33:46.614920+0000","last_clean":"2024-09-21T07:33:46.614920+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:33:46.614920+0000","last_undegraded":"2024-09-21T07:33:46.614920+0000","last_fullsized":"2024-09-21T07:33:46.614920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509577,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51832,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320008,"statfs":{"total":96636764160,"available":96583688192,"internally_reserved":0,"allocated":2658304,"data_stored":1562343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2646016,"data_stored":1555684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2109440,"data_stored":988050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:PG 24.3e is not active+clean 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.608952+0000', 'last_change': '2024-09-21T07:33:46.608952+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.608952+0000', 'last_undegraded': '2024-09-21T07:33:46.608952+0000', 'last_fullsized': '2024-09-21T07:33:46.608952+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:PG 24.3a is not active+clean 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.612223+0000', 'last_change': '2024-09-21T07:33:46.612223+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.612223+0000', 'last_undegraded': '2024-09-21T07:33:46.612223+0000', 'last_fullsized': '2024-09-21T07:33:46.612223+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:PG 24.34 is not active+clean 2024-09-21T07:33:52.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.609434+0000', 'last_change': '2024-09-21T07:33:46.609434+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.609434+0000', 'last_undegraded': '2024-09-21T07:33:46.609434+0000', 'last_fullsized': '2024-09-21T07:33:46.609434+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.32 is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.621166+0000', 'last_change': '2024-09-21T07:33:47.621166+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.621166+0000', 'last_undegraded': '2024-09-21T07:33:47.621166+0000', 'last_fullsized': '2024-09-21T07:33:47.621166+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.2e is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.620998+0000', 'last_change': '2024-09-21T07:33:47.620998+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.620998+0000', 'last_undegraded': '2024-09-21T07:33:47.620998+0000', 'last_fullsized': '2024-09-21T07:33:47.620998+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.2a is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.608721+0000', 'last_change': '2024-09-21T07:33:46.608721+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.608721+0000', 'last_undegraded': '2024-09-21T07:33:46.608721+0000', 'last_fullsized': '2024-09-21T07:33:46.608721+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.25 is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.613896+0000', 'last_change': '2024-09-21T07:33:46.613896+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.613896+0000', 'last_undegraded': '2024-09-21T07:33:46.613896+0000', 'last_fullsized': '2024-09-21T07:33:46.613896+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.23 is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.614301+0000', 'last_change': '2024-09-21T07:33:46.614301+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.614301+0000', 'last_undegraded': '2024-09-21T07:33:46.614301+0000', 'last_fullsized': '2024-09-21T07:33:46.614301+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:PG 24.22 is not active+clean 2024-09-21T07:33:52.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.618315+0000', 'last_change': '2024-09-21T07:33:47.618315+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.618315+0000', 'last_undegraded': '2024-09-21T07:33:47.618315+0000', 'last_fullsized': '2024-09-21T07:33:47.618315+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.10 is not active+clean 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.609249+0000', 'last_change': '2024-09-21T07:33:46.609249+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.609249+0000', 'last_undegraded': '2024-09-21T07:33:46.609249+0000', 'last_fullsized': '2024-09-21T07:33:46.609249+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.12 is not active+clean 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.620779+0000', 'last_change': '2024-09-21T07:33:47.620779+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.620779+0000', 'last_undegraded': '2024-09-21T07:33:47.620779+0000', 'last_fullsized': '2024-09-21T07:33:47.620779+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.13 is not active+clean 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.610637+0000', 'last_change': '2024-09-21T07:33:46.610637+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.610637+0000', 'last_undegraded': '2024-09-21T07:33:46.610637+0000', 'last_fullsized': '2024-09-21T07:33:46.610637+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.18 is not active+clean 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.613127+0000', 'last_change': '2024-09-21T07:33:46.613127+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.613127+0000', 'last_undegraded': '2024-09-21T07:33:46.613127+0000', 'last_fullsized': '2024-09-21T07:33:46.613127+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.5 is not active+clean 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.623190+0000', 'last_change': '2024-09-21T07:33:47.623190+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.623190+0000', 'last_undegraded': '2024-09-21T07:33:47.623190+0000', 'last_fullsized': '2024-09-21T07:33:47.623190+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:33:52.690 INFO:tasks.ceph.ceph_manager.ceph:PG 24.6 is not active+clean 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.625374+0000', 'last_change': '2024-09-21T07:33:47.625374+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.625374+0000', 'last_undegraded': '2024-09-21T07:33:47.625374+0000', 'last_fullsized': '2024-09-21T07:33:47.625374+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:PG 24.7 is not active+clean 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.612446+0000', 'last_change': '2024-09-21T07:33:46.612446+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.612446+0000', 'last_undegraded': '2024-09-21T07:33:46.612446+0000', 'last_fullsized': '2024-09-21T07:33:46.612446+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:PG 24.d is not active+clean 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.611062+0000', 'last_change': '2024-09-21T07:33:46.611062+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.611062+0000', 'last_undegraded': '2024-09-21T07:33:46.611062+0000', 'last_fullsized': '2024-09-21T07:33:46.611062+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:PG 24.f is not active+clean 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 166, 'state': 'creating+activating', 'last_fresh': '2024-09-21T07:33:47.616070+0000', 'last_change': '2024-09-21T07:33:47.616070+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:47.616070+0000', 'last_undegraded': '2024-09-21T07:33:47.616070+0000', 'last_fullsized': '2024-09-21T07:33:47.616070+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:PG 24.19 is not active+clean 2024-09-21T07:33:52.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:33:46.609654+0000', 'last_change': '2024-09-21T07:33:46.609654+0000', 'last_active': '2024-09-21T07:33:46.590961+0000', 'last_peered': '2024-09-21T07:33:46.590961+0000', 'last_clean': '2024-09-21T07:33:46.590961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:33:46.609654+0000', 'last_undegraded': '2024-09-21T07:33:46.609654+0000', 'last_fullsized': '2024-09-21T07:33:46.609654+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'last_clean_scrub_stamp': '2024-09-21T07:33:46.590961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:33:52.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:33:52.819 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:33:52.819+0000 7fd9fca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:33:52.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- 172.21.15.64:0/1223921271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7000709b0 msgr2=0x7fb7000b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 --2- 172.21.15.64:0/1223921271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7000709b0 0x7fb7000b41c0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009900 tx=0x7fb6ec01c700 comp rx=0 tx=0).stop 2024-09-21T07:33:52.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- 172.21.15.64:0/1223921271 shutdown_connections 2024-09-21T07:33:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 --2- 172.21.15.64:0/1223921271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7000709b0 0x7fb7000b41c0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 --2- 172.21.15.64:0/1223921271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb70015edb0 0x7fb7000700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- 172.21.15.64:0/1223921271 >> 172.21.15.64:0/1223921271 conn(0x7fb7000ccbe0 msgr2=0x7fb7000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- 172.21.15.64:0/1223921271 shutdown_connections 2024-09-21T07:33:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- 172.21.15.64:0/1223921271 wait complete. 2024-09-21T07:33:52.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 Processor -- start 2024-09-21T07:33:52.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.887+0000 7fb708000640 1 -- start start 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7000709b0 0x7fb700158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7000b4700 0x7fb700153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb700169070 con 0x7fb70015edb0 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb700168ef0 con 0x7fb7000b4700 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb7001691f0 con 0x7fb7000709b0 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb705600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7000709b0 0x7fb700158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33368/0 (socket says 172.21.15.64:33368) 2024-09-21T07:33:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 -- 172.21.15.64:0/792748632 learned_addr learned my addr 172.21.15.64:0/792748632 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb704c00640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7000b4700 0x7fb700153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 -- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7000709b0 msgr2=0x7fb700158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7000709b0 0x7fb700158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 -- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7000b4700 msgr2=0x7fb700153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7000b4700 0x7fb700153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 -- 172.21.15.64:0/792748632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb700157c70 con 0x7fb70015edb0 2024-09-21T07:33:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb706000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800be60 tx=0x7fb6f800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8019070 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f8014440 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80148d0 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb700157f50 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7001fd520 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.891+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7000c6010 con 0x7fb70015edb0 2024-09-21T07:33:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.895+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6f801c070 con 0x7fb70015edb0 2024-09-21T07:33:52.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.895+0000 7fb6fd600640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 0x7fb6e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.895+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fb6f80942f0 con 0x7fb70015edb0 2024-09-21T07:33:52.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.895+0000 7fb705600640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 0x7fb6e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.895+0000 7fb705600640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 0x7fb6e0075740 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400ab40 tx=0x7fb6f400a250 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:52.899+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb6f805eb20 con 0x7fb70015edb0 2024-09-21T07:33:53.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.135+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb7000b41c0 con 0x7fb70015edb0 2024-09-21T07:33:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb6fd600640 1 -- 172.21.15.64:0/792748632 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1612 (secure 0 0 0) 0x7fb6f8063550 con 0x7fb70015edb0 2024-09-21T07:33:53.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:53.137 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":691,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"creating+peering","count":12},{"state_name":"creating+activating","count":7}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592674,"bytes_used":450936832,"bytes_avail":772643176448,"bytes_total":773094113280,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9094}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-21T07:33:35.597408+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:33:53.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 msgr2=0x7fb6e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 0x7fb6e0075740 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400ab40 tx=0x7fb6f400a250 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 msgr2=0x7fb7000c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800be60 tx=0x7fb6f800bf50 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 shutdown_connections 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb6e0073230 0x7fb6e0075740 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb70015edb0 0x7fb7000c5690 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7000b4700 0x7fb700153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 --2- 172.21.15.64:0/792748632 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7000709b0 0x7fb700158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 >> 172.21.15.64:0/792748632 conn(0x7fb7000ccbe0 msgr2=0x7fb7000cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:53.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 shutdown_connections 2024-09-21T07:33:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.139+0000 7fb708000640 1 -- 172.21.15.64:0/792748632 wait complete. 2024-09-21T07:33:53.160 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:33:53.160 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- 172.21.15.64:0/47170892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 msgr2=0x7f238c166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 --2- 172.21.15.64:0/47170892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c166230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2384009bc0 tx=0x7f238401ca90 comp rx=0 tx=0).stop 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- 172.21.15.64:0/47170892 shutdown_connections 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 --2- 172.21.15.64:0/47170892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c166230 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- 172.21.15.64:0/47170892 >> 172.21.15.64:0/47170892 conn(0x7f238c0d0de0 msgr2=0x7f238c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- 172.21.15.64:0/47170892 shutdown_connections 2024-09-21T07:33:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- 172.21.15.64:0/47170892 wait complete. 2024-09-21T07:33:53.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 Processor -- start 2024-09-21T07:33:53.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.319+0000 7f2391800640 1 -- start start 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c1fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f238c15b810 0x7f238c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f238c169830 con 0x7f238c06d020 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1696b0 con 0x7f238c070630 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f238c1699b0 con 0x7f238c15b810 2024-09-21T07:33:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33378/0 (socket says 172.21.15.64:33378) 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 -- 172.21.15.64:0/1056205253 learned_addr learned my addr 172.21.15.64:0/1056205253 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238a000640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c1fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238b400640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f238c15b810 0x7f238c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 -- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f238c15b810 msgr2=0x7f238c150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f238c15b810 0x7f238c150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 -- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 msgr2=0x7f238c1fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c1fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 -- 172.21.15.64:0/1056205253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c1faa70 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f238aa00640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f237c001230 tx=0x7f237c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c016020 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f237c012920 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c1f6fa0 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c012d70 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1f9d30 con 0x7f238c06d020 2024-09-21T07:33:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.323+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c0b5c10 con 0x7f238c06d020 2024-09-21T07:33:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.327+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f237c019020 con 0x7f238c06d020 2024-09-21T07:33:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.327+0000 7f2382a00640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 0x7f236c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.327+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f237c0943f0 con 0x7f238c06d020 2024-09-21T07:33:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.327+0000 7f238a000640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 0x7f236c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.327+0000 7f238a000640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 0x7f236c075710 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f238c15e330 tx=0x7f2378009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.331+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f237c020020 con 0x7f238c06d020 2024-09-21T07:33:53.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.503+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f238c0ce590 con 0x7f236c073200 2024-09-21T07:33:53.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.511+0000 7f2382a00640 1 -- 172.21.15.64:0/1056205253 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250947 (secure 0 0 0) 0x7f238c0ce590 con 0x7f236c073200 2024-09-21T07:33:53.512 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:53.513 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:33:53.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 msgr2=0x7f236c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 0x7f236c075710 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f238c15e330 tx=0x7f2378009040 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 msgr2=0x7f238c1f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f237c001230 tx=0x7f237c00c980 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 shutdown_connections 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f236c073200 0x7f236c075710 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f238c15b810 0x7f238c150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238c070630 0x7f238c1fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 --2- 172.21.15.64:0/1056205253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f238c06d020 0x7f238c1f66a0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 >> 172.21.15.64:0/1056205253 conn(0x7f238c0d0de0 msgr2=0x7f238c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 shutdown_connections 2024-09-21T07:33:53.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:53.515+0000 7f2391800640 1 -- 172.21.15.64:0/1056205253 wait complete. 2024-09-21T07:33:53.534 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-21T07:33:51.605099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":440368,"kb_used_data":17320,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754534352,"statfs":{"total":773094113280,"available":772643176448,"internally_reserved":0,"allocated":17735680,"data_stored":8965952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":432983603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.628655+0000","last_change":"2024-09-21T07:33:47.625720+0000","last_active":"2024-09-21T07:33:47.628655+0000","last_peered":"2024-09-21T07:33:47.628655+0000","last_clean":"2024-09-21T07:33:47.628655+0000","last_became_active":"2024-09-21T07:33:47.625405+0000","last_became_peered":"2024-09-21T07:33:47.625405+0000","last_unstale":"2024-09-21T07:33:47.628655+0000","last_undegraded":"2024-09-21T07:33:47.628655+0000","last_fullsized":"2024-09-21T07:33:47.628655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:39.184691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608952+0000","last_change":"2024-09-21T07:33:46.608952+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608952+0000","last_undegraded":"2024-09-21T07:33:46.608952+0000","last_fullsized":"2024-09-21T07:33:46.608952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627903+0000","last_change":"2024-09-21T07:33:47.625681+0000","last_active":"2024-09-21T07:33:47.627903+0000","last_peered":"2024-09-21T07:33:47.627903+0000","last_clean":"2024-09-21T07:33:47.627903+0000","last_became_active":"2024-09-21T07:33:47.625335+0000","last_became_peered":"2024-09-21T07:33:47.625335+0000","last_unstale":"2024-09-21T07:33:47.627903+0000","last_undegraded":"2024-09-21T07:33:47.627903+0000","last_fullsized":"2024-09-21T07:33:47.627903+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:43.864741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.639981+0000","last_change":"2024-09-21T07:33:47.633470+0000","last_active":"2024-09-21T07:33:47.639981+0000","last_peered":"2024-09-21T07:33:47.639981+0000","last_clean":"2024-09-21T07:33:47.639981+0000","last_became_active":"2024-09-21T07:33:47.631234+0000","last_became_peered":"2024-09-21T07:33:47.631234+0000","last_unstale":"2024-09-21T07:33:47.639981+0000","last_undegraded":"2024-09-21T07:33:47.639981+0000","last_fullsized":"2024-09-21T07:33:47.639981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:10.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.630756+0000","last_change":"2024-09-21T07:33:47.630664+0000","last_active":"2024-09-21T07:33:47.630756+0000","last_peered":"2024-09-21T07:33:47.630756+0000","last_clean":"2024-09-21T07:33:47.630756+0000","last_became_active":"2024-09-21T07:33:47.630362+0000","last_became_peered":"2024-09-21T07:33:47.630362+0000","last_unstale":"2024-09-21T07:33:47.630756+0000","last_undegraded":"2024-09-21T07:33:47.630756+0000","last_fullsized":"2024-09-21T07:33:47.630756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:09.697464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612223+0000","last_change":"2024-09-21T07:33:46.612223+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612223+0000","last_undegraded":"2024-09-21T07:33:46.612223+0000","last_fullsized":"2024-09-21T07:33:46.612223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645051+0000","last_change":"2024-09-21T07:33:47.641086+0000","last_active":"2024-09-21T07:33:47.645051+0000","last_peered":"2024-09-21T07:33:47.645051+0000","last_clean":"2024-09-21T07:33:47.645051+0000","last_became_active":"2024-09-21T07:33:47.640738+0000","last_became_peered":"2024-09-21T07:33:47.640738+0000","last_unstale":"2024-09-21T07:33:47.645051+0000","last_undegraded":"2024-09-21T07:33:47.645051+0000","last_fullsized":"2024-09-21T07:33:47.645051+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:10.534281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647269+0000","last_change":"2024-09-21T07:33:47.641177+0000","last_active":"2024-09-21T07:33:47.647269+0000","last_peered":"2024-09-21T07:33:47.647269+0000","last_clean":"2024-09-21T07:33:47.647269+0000","last_became_active":"2024-09-21T07:33:47.640519+0000","last_became_peered":"2024-09-21T07:33:47.640519+0000","last_unstale":"2024-09-21T07:33:47.647269+0000","last_undegraded":"2024-09-21T07:33:47.647269+0000","last_fullsized":"2024-09-21T07:33:47.647269+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:59.630563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.653039+0000","last_change":"2024-09-21T07:33:47.648250+0000","last_active":"2024-09-21T07:33:47.653039+0000","last_peered":"2024-09-21T07:33:47.653039+0000","last_clean":"2024-09-21T07:33:47.653039+0000","last_became_active":"2024-09-21T07:33:47.647932+0000","last_became_peered":"2024-09-21T07:33:47.647932+0000","last_unstale":"2024-09-21T07:33:47.653039+0000","last_undegraded":"2024-09-21T07:33:47.653039+0000","last_fullsized":"2024-09-21T07:33:47.653039+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:44.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655569+0000","last_change":"2024-09-21T07:33:47.650131+0000","last_active":"2024-09-21T07:33:47.655569+0000","last_peered":"2024-09-21T07:33:47.655569+0000","last_clean":"2024-09-21T07:33:47.655569+0000","last_became_active":"2024-09-21T07:33:47.649771+0000","last_became_peered":"2024-09-21T07:33:47.649771+0000","last_unstale":"2024-09-21T07:33:47.655569+0000","last_undegraded":"2024-09-21T07:33:47.655569+0000","last_fullsized":"2024-09-21T07:33:47.655569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:25.893560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647649+0000","last_change":"2024-09-21T07:33:47.639979+0000","last_active":"2024-09-21T07:33:47.647649+0000","last_peered":"2024-09-21T07:33:47.647649+0000","last_clean":"2024-09-21T07:33:47.647649+0000","last_became_active":"2024-09-21T07:33:47.639661+0000","last_became_peered":"2024-09-21T07:33:47.639661+0000","last_unstale":"2024-09-21T07:33:47.647649+0000","last_undegraded":"2024-09-21T07:33:47.647649+0000","last_fullsized":"2024-09-21T07:33:47.647649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:34.175607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609434+0000","last_change":"2024-09-21T07:33:46.609434+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609434+0000","last_undegraded":"2024-09-21T07:33:46.609434+0000","last_fullsized":"2024-09-21T07:33:46.609434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642703+0000","last_change":"2024-09-21T07:33:47.642336+0000","last_active":"2024-09-21T07:33:48.642703+0000","last_peered":"2024-09-21T07:33:48.642703+0000","last_clean":"2024-09-21T07:33:48.642703+0000","last_became_active":"2024-09-21T07:33:47.642063+0000","last_became_peered":"2024-09-21T07:33:47.642063+0000","last_unstale":"2024-09-21T07:33:48.642703+0000","last_undegraded":"2024-09-21T07:33:48.642703+0000","last_fullsized":"2024-09-21T07:33:48.642703+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:53.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.621166+0000","last_change":"2024-09-21T07:33:47.621166+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.621166+0000","last_undegraded":"2024-09-21T07:33:47.621166+0000","last_fullsized":"2024-09-21T07:33:47.621166+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647814+0000","last_change":"2024-09-21T07:33:47.643740+0000","last_active":"2024-09-21T07:33:47.647814+0000","last_peered":"2024-09-21T07:33:47.647814+0000","last_clean":"2024-09-21T07:33:47.647814+0000","last_became_active":"2024-09-21T07:33:47.640771+0000","last_became_peered":"2024-09-21T07:33:47.640771+0000","last_unstale":"2024-09-21T07:33:47.647814+0000","last_undegraded":"2024-09-21T07:33:47.647814+0000","last_fullsized":"2024-09-21T07:33:47.647814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:16.925254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637281+0000","last_change":"2024-09-21T07:33:47.632386+0000","last_active":"2024-09-21T07:33:47.637281+0000","last_peered":"2024-09-21T07:33:47.637281+0000","last_clean":"2024-09-21T07:33:47.637281+0000","last_became_active":"2024-09-21T07:33:47.631743+0000","last_became_peered":"2024-09-21T07:33:47.631743+0000","last_unstale":"2024-09-21T07:33:47.637281+0000","last_undegraded":"2024-09-21T07:33:47.637281+0000","last_fullsized":"2024-09-21T07:33:47.637281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:11.253008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650242+0000","last_change":"2024-09-21T07:33:47.646697+0000","last_active":"2024-09-21T07:33:47.650242+0000","last_peered":"2024-09-21T07:33:47.650242+0000","last_clean":"2024-09-21T07:33:47.650242+0000","last_became_active":"2024-09-21T07:33:47.646388+0000","last_became_peered":"2024-09-21T07:33:47.646388+0000","last_unstale":"2024-09-21T07:33:47.650242+0000","last_undegraded":"2024-09-21T07:33:47.650242+0000","last_fullsized":"2024-09-21T07:33:47.650242+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620998+0000","last_change":"2024-09-21T07:33:47.620998+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620998+0000","last_undegraded":"2024-09-21T07:33:47.620998+0000","last_fullsized":"2024-09-21T07:33:47.620998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647684+0000","last_change":"2024-09-21T07:33:47.643086+0000","last_active":"2024-09-21T07:33:47.647684+0000","last_peered":"2024-09-21T07:33:47.647684+0000","last_clean":"2024-09-21T07:33:47.647684+0000","last_became_active":"2024-09-21T07:33:47.640786+0000","last_became_peered":"2024-09-21T07:33:47.640786+0000","last_unstale":"2024-09-21T07:33:47.647684+0000","last_undegraded":"2024-09-21T07:33:47.647684+0000","last_fullsized":"2024-09-21T07:33:47.647684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:42.233855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636537+0000","last_change":"2024-09-21T07:33:47.633448+0000","last_active":"2024-09-21T07:33:47.636537+0000","last_peered":"2024-09-21T07:33:47.636537+0000","last_clean":"2024-09-21T07:33:47.636537+0000","last_became_active":"2024-09-21T07:33:47.633066+0000","last_became_peered":"2024-09-21T07:33:47.633066+0000","last_unstale":"2024-09-21T07:33:47.636537+0000","last_undegraded":"2024-09-21T07:33:47.636537+0000","last_fullsized":"2024-09-21T07:33:47.636537+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:16.784821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642952+0000","last_change":"2024-09-21T07:33:47.629236+0000","last_active":"2024-09-21T07:33:48.642952+0000","last_peered":"2024-09-21T07:33:48.642952+0000","last_clean":"2024-09-21T07:33:48.642952+0000","last_became_active":"2024-09-21T07:33:47.628957+0000","last_became_peered":"2024-09-21T07:33:47.628957+0000","last_unstale":"2024-09-21T07:33:48.642952+0000","last_undegraded":"2024-09-21T07:33:48.642952+0000","last_fullsized":"2024-09-21T07:33:48.642952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:22.566695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.608721+0000","last_change":"2024-09-21T07:33:46.608721+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.608721+0000","last_undegraded":"2024-09-21T07:33:46.608721+0000","last_fullsized":"2024-09-21T07:33:46.608721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633662+0000","last_change":"2024-09-21T07:33:47.633569+0000","last_active":"2024-09-21T07:33:47.633662+0000","last_peered":"2024-09-21T07:33:47.633662+0000","last_clean":"2024-09-21T07:33:47.633662+0000","last_became_active":"2024-09-21T07:33:47.632464+0000","last_became_peered":"2024-09-21T07:33:47.632464+0000","last_unstale":"2024-09-21T07:33:47.633662+0000","last_undegraded":"2024-09-21T07:33:47.633662+0000","last_fullsized":"2024-09-21T07:33:47.633662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:34.907981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637311+0000","last_change":"2024-09-21T07:33:47.632731+0000","last_active":"2024-09-21T07:33:47.637311+0000","last_peered":"2024-09-21T07:33:47.637311+0000","last_clean":"2024-09-21T07:33:47.637311+0000","last_became_active":"2024-09-21T07:33:47.632100+0000","last_became_peered":"2024-09-21T07:33:47.632100+0000","last_unstale":"2024-09-21T07:33:47.637311+0000","last_undegraded":"2024-09-21T07:33:47.637311+0000","last_fullsized":"2024-09-21T07:33:47.637311+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:35.440685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643809+0000","last_change":"2024-09-21T07:33:47.634716+0000","last_active":"2024-09-21T07:33:48.643809+0000","last_peered":"2024-09-21T07:33:48.643809+0000","last_clean":"2024-09-21T07:33:48.643809+0000","last_became_active":"2024-09-21T07:33:47.634400+0000","last_became_peered":"2024-09-21T07:33:47.634400+0000","last_unstale":"2024-09-21T07:33:48.643809+0000","last_undegraded":"2024-09-21T07:33:48.643809+0000","last_fullsized":"2024-09-21T07:33:48.643809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:56.119446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635434+0000","last_change":"2024-09-21T07:33:47.632215+0000","last_active":"2024-09-21T07:33:47.635434+0000","last_peered":"2024-09-21T07:33:47.635434+0000","last_clean":"2024-09-21T07:33:47.635434+0000","last_became_active":"2024-09-21T07:33:47.631762+0000","last_became_peered":"2024-09-21T07:33:47.631762+0000","last_unstale":"2024-09-21T07:33:47.635434+0000","last_undegraded":"2024-09-21T07:33:47.635434+0000","last_fullsized":"2024-09-21T07:33:47.635434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:53.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613896+0000","last_change":"2024-09-21T07:33:46.613896+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613896+0000","last_undegraded":"2024-09-21T07:33:46.613896+0000","last_fullsized":"2024-09-21T07:33:46.613896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643015+0000","last_change":"2024-09-21T07:33:47.631128+0000","last_active":"2024-09-21T07:33:48.643015+0000","last_peered":"2024-09-21T07:33:48.643015+0000","last_clean":"2024-09-21T07:33:48.643015+0000","last_became_active":"2024-09-21T07:33:47.626470+0000","last_became_peered":"2024-09-21T07:33:47.626470+0000","last_unstale":"2024-09-21T07:33:48.643015+0000","last_undegraded":"2024-09-21T07:33:48.643015+0000","last_fullsized":"2024-09-21T07:33:48.643015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:16.850891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.614301+0000","last_change":"2024-09-21T07:33:46.614301+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.614301+0000","last_undegraded":"2024-09-21T07:33:46.614301+0000","last_fullsized":"2024-09-21T07:33:46.614301+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.618315+0000","last_change":"2024-09-21T07:33:47.618315+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.618315+0000","last_undegraded":"2024-09-21T07:33:47.618315+0000","last_fullsized":"2024-09-21T07:33:47.618315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647785+0000","last_change":"2024-09-21T07:33:47.640296+0000","last_active":"2024-09-21T07:33:47.647785+0000","last_peered":"2024-09-21T07:33:47.647785+0000","last_clean":"2024-09-21T07:33:47.647785+0000","last_became_active":"2024-09-21T07:33:47.639859+0000","last_became_peered":"2024-09-21T07:33:47.639859+0000","last_unstale":"2024-09-21T07:33:47.647785+0000","last_undegraded":"2024-09-21T07:33:47.647785+0000","last_fullsized":"2024-09-21T07:33:47.647785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:20.740598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634628+0000","last_change":"2024-09-21T07:33:47.632301+0000","last_active":"2024-09-21T07:33:47.634628+0000","last_peered":"2024-09-21T07:33:47.634628+0000","last_clean":"2024-09-21T07:33:47.634628+0000","last_became_active":"2024-09-21T07:33:47.631997+0000","last_became_peered":"2024-09-21T07:33:47.631997+0000","last_unstale":"2024-09-21T07:33:47.634628+0000","last_undegraded":"2024-09-21T07:33:47.634628+0000","last_fullsized":"2024-09-21T07:33:47.634628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:13.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609249+0000","last_change":"2024-09-21T07:33:46.609249+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609249+0000","last_undegraded":"2024-09-21T07:33:46.609249+0000","last_fullsized":"2024-09-21T07:33:46.609249+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614971+0000","last_change":"2024-09-21T07:33:46.621829+0000","last_active":"2024-09-21T07:33:47.614971+0000","last_peered":"2024-09-21T07:33:47.614971+0000","last_clean":"2024-09-21T07:33:47.614971+0000","last_became_active":"2024-09-21T07:33:46.621108+0000","last_became_peered":"2024-09-21T07:33:46.621108+0000","last_unstale":"2024-09-21T07:33:47.614971+0000","last_undegraded":"2024-09-21T07:33:47.614971+0000","last_fullsized":"2024-09-21T07:33:47.614971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:49.328101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642339+0000","last_change":"2024-09-21T07:33:47.633401+0000","last_active":"2024-09-21T07:33:48.642339+0000","last_peered":"2024-09-21T07:33:48.642339+0000","last_clean":"2024-09-21T07:33:48.642339+0000","last_became_active":"2024-09-21T07:33:47.633086+0000","last_became_peered":"2024-09-21T07:33:47.633086+0000","last_unstale":"2024-09-21T07:33:48.642339+0000","last_undegraded":"2024-09-21T07:33:48.642339+0000","last_fullsized":"2024-09-21T07:33:48.642339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:35.443908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.627767+0000","last_change":"2024-09-21T07:33:46.629787+0000","last_active":"2024-09-21T07:33:47.627767+0000","last_peered":"2024-09-21T07:33:47.627767+0000","last_clean":"2024-09-21T07:33:47.627767+0000","last_became_active":"2024-09-21T07:33:46.629432+0000","last_became_peered":"2024-09-21T07:33:46.629432+0000","last_unstale":"2024-09-21T07:33:47.627767+0000","last_undegraded":"2024-09-21T07:33:47.627767+0000","last_fullsized":"2024-09-21T07:33:47.627767+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:20.018028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.620779+0000","last_change":"2024-09-21T07:33:47.620779+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.620779+0000","last_undegraded":"2024-09-21T07:33:47.620779+0000","last_fullsized":"2024-09-21T07:33:47.620779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.620530+0000","last_change":"2024-09-21T07:33:46.627109+0000","last_active":"2024-09-21T07:33:47.620530+0000","last_peered":"2024-09-21T07:33:47.620530+0000","last_clean":"2024-09-21T07:33:47.620530+0000","last_became_active":"2024-09-21T07:33:46.626791+0000","last_became_peered":"2024-09-21T07:33:46.626791+0000","last_unstale":"2024-09-21T07:33:47.620530+0000","last_undegraded":"2024-09-21T07:33:47.620530+0000","last_fullsized":"2024-09-21T07:33:47.620530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:27.963968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.610637+0000","last_change":"2024-09-21T07:33:46.610637+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.610637+0000","last_undegraded":"2024-09-21T07:33:46.610637+0000","last_fullsized":"2024-09-21T07:33:46.610637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615697+0000","last_change":"2024-09-21T07:33:46.628812+0000","last_active":"2024-09-21T07:33:47.615697+0000","last_peered":"2024-09-21T07:33:47.615697+0000","last_clean":"2024-09-21T07:33:47.615697+0000","last_became_active":"2024-09-21T07:33:46.628282+0000","last_became_peered":"2024-09-21T07:33:46.628282+0000","last_unstale":"2024-09-21T07:33:47.615697+0000","last_undegraded":"2024-09-21T07:33:47.615697+0000","last_fullsized":"2024-09-21T07:33:47.615697+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.194913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.656287+0000","last_change":"2024-09-21T07:33:47.650503+0000","last_active":"2024-09-21T07:33:47.656287+0000","last_peered":"2024-09-21T07:33:47.656287+0000","last_clean":"2024-09-21T07:33:47.656287+0000","last_became_active":"2024-09-21T07:33:47.650188+0000","last_became_peered":"2024-09-21T07:33:47.650188+0000","last_unstale":"2024-09-21T07:33:47.656287+0000","last_undegraded":"2024-09-21T07:33:47.656287+0000","last_fullsized":"2024-09-21T07:33:47.656287+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:19.846100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.648138+0000","last_change":"2024-09-21T07:33:46.623523+0000","last_active":"2024-09-21T07:33:47.648138+0000","last_peered":"2024-09-21T07:33:47.648138+0000","last_clean":"2024-09-21T07:33:47.648138+0000","last_became_active":"2024-09-21T07:33:46.623174+0000","last_became_peered":"2024-09-21T07:33:46.623174+0000","last_unstale":"2024-09-21T07:33:47.648138+0000","last_undegraded":"2024-09-21T07:33:47.648138+0000","last_fullsized":"2024-09-21T07:33:47.648138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:58.346289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636603+0000","last_change":"2024-09-21T07:33:47.630806+0000","last_active":"2024-09-21T07:33:47.636603+0000","last_peered":"2024-09-21T07:33:47.636603+0000","last_clean":"2024-09-21T07:33:47.636603+0000","last_became_active":"2024-09-21T07:33:47.630494+0000","last_became_peered":"2024-09-21T07:33:47.630494+0000","last_unstale":"2024-09-21T07:33:47.636603+0000","last_undegraded":"2024-09-21T07:33:47.636603+0000","last_fullsized":"2024-09-21T07:33:47.636603+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.316252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.625009+0000","last_change":"2024-09-21T07:33:46.608788+0000","last_active":"2024-09-21T07:33:47.625009+0000","last_peered":"2024-09-21T07:33:47.625009+0000","last_clean":"2024-09-21T07:33:47.625009+0000","last_became_active":"2024-09-21T07:33:46.608428+0000","last_became_peered":"2024-09-21T07:33:46.608428+0000","last_unstale":"2024-09-21T07:33:47.625009+0000","last_undegraded":"2024-09-21T07:33:47.625009+0000","last_fullsized":"2024-09-21T07:33:47.625009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:24.973246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634160+0000","last_change":"2024-09-21T07:33:47.624817+0000","last_active":"2024-09-21T07:33:47.634160+0000","last_peered":"2024-09-21T07:33:47.634160+0000","last_clean":"2024-09-21T07:33:47.634160+0000","last_became_active":"2024-09-21T07:33:47.624500+0000","last_became_peered":"2024-09-21T07:33:47.624500+0000","last_unstale":"2024-09-21T07:33:47.634160+0000","last_undegraded":"2024-09-21T07:33:47.634160+0000","last_fullsized":"2024-09-21T07:33:47.634160+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:36.647441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618360+0000","last_change":"2024-09-21T07:33:46.629058+0000","last_active":"2024-09-21T07:33:47.618360+0000","last_peered":"2024-09-21T07:33:47.618360+0000","last_clean":"2024-09-21T07:33:47.618360+0000","last_became_active":"2024-09-21T07:33:46.628579+0000","last_became_peered":"2024-09-21T07:33:46.628579+0000","last_unstale":"2024-09-21T07:33:47.618360+0000","last_undegraded":"2024-09-21T07:33:47.618360+0000","last_fullsized":"2024-09-21T07:33:47.618360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:58.077760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.641218+0000","last_change":"2024-09-21T07:33:47.635770+0000","last_active":"2024-09-21T07:33:47.641218+0000","last_peered":"2024-09-21T07:33:47.641218+0000","last_clean":"2024-09-21T07:33:47.641218+0000","last_became_active":"2024-09-21T07:33:47.635454+0000","last_became_peered":"2024-09-21T07:33:47.635454+0000","last_unstale":"2024-09-21T07:33:47.641218+0000","last_undegraded":"2024-09-21T07:33:47.641218+0000","last_fullsized":"2024-09-21T07:33:47.641218+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:53.974927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624650+0000","last_change":"2024-09-21T07:33:46.626183+0000","last_active":"2024-09-21T07:33:47.624650+0000","last_peered":"2024-09-21T07:33:47.624650+0000","last_clean":"2024-09-21T07:33:47.624650+0000","last_became_active":"2024-09-21T07:33:46.625875+0000","last_became_peered":"2024-09-21T07:33:46.625875+0000","last_unstale":"2024-09-21T07:33:47.624650+0000","last_undegraded":"2024-09-21T07:33:47.624650+0000","last_fullsized":"2024-09-21T07:33:47.624650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.173888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.613127+0000","last_change":"2024-09-21T07:33:46.613127+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.613127+0000","last_undegraded":"2024-09-21T07:33:46.613127+0000","last_fullsized":"2024-09-21T07:33:46.613127+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643517+0000","last_change":"2024-09-21T07:33:46.627781+0000","last_active":"2024-09-21T07:33:48.643517+0000","last_peered":"2024-09-21T07:33:48.643517+0000","last_clean":"2024-09-21T07:33:48.643517+0000","last_became_active":"2024-09-21T07:33:46.627385+0000","last_became_peered":"2024-09-21T07:33:46.627385+0000","last_unstale":"2024-09-21T07:33:48.643517+0000","last_undegraded":"2024-09-21T07:33:48.643517+0000","last_fullsized":"2024-09-21T07:33:48.643517+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:55.725847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642572+0000","last_change":"2024-09-21T07:33:47.639144+0000","last_active":"2024-09-21T07:33:48.642572+0000","last_peered":"2024-09-21T07:33:48.642572+0000","last_clean":"2024-09-21T07:33:48.642572+0000","last_became_active":"2024-09-21T07:33:47.638831+0000","last_became_peered":"2024-09-21T07:33:47.638831+0000","last_unstale":"2024-09-21T07:33:48.642572+0000","last_undegraded":"2024-09-21T07:33:48.642572+0000","last_fullsized":"2024-09-21T07:33:48.642572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.804124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.614671+0000","last_change":"2024-09-21T07:33:46.618197+0000","last_active":"2024-09-21T07:33:47.614671+0000","last_peered":"2024-09-21T07:33:47.614671+0000","last_clean":"2024-09-21T07:33:47.614671+0000","last_became_active":"2024-09-21T07:33:46.617845+0000","last_became_peered":"2024-09-21T07:33:46.617845+0000","last_unstale":"2024-09-21T07:33:47.614671+0000","last_undegraded":"2024-09-21T07:33:47.614671+0000","last_fullsized":"2024-09-21T07:33:47.614671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:40.942593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.636657+0000","last_change":"2024-09-21T07:33:47.633080+0000","last_active":"2024-09-21T07:33:47.636657+0000","last_peered":"2024-09-21T07:33:47.636657+0000","last_clean":"2024-09-21T07:33:47.636657+0000","last_became_active":"2024-09-21T07:33:47.632770+0000","last_became_peered":"2024-09-21T07:33:47.632770+0000","last_unstale":"2024-09-21T07:33:47.636657+0000","last_undegraded":"2024-09-21T07:33:47.636657+0000","last_fullsized":"2024-09-21T07:33:47.636657+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:26.206243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643087+0000","last_change":"2024-09-21T07:33:46.624386+0000","last_active":"2024-09-21T07:33:48.643087+0000","last_peered":"2024-09-21T07:33:48.643087+0000","last_clean":"2024-09-21T07:33:48.643087+0000","last_became_active":"2024-09-21T07:33:46.622664+0000","last_became_peered":"2024-09-21T07:33:46.622664+0000","last_unstale":"2024-09-21T07:33:48.643087+0000","last_undegraded":"2024-09-21T07:33:48.643087+0000","last_fullsized":"2024-09-21T07:33:48.643087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.642393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.633788+0000","last_change":"2024-09-21T07:33:47.632859+0000","last_active":"2024-09-21T07:33:47.633788+0000","last_peered":"2024-09-21T07:33:47.633788+0000","last_clean":"2024-09-21T07:33:47.633788+0000","last_became_active":"2024-09-21T07:33:47.632480+0000","last_became_peered":"2024-09-21T07:33:47.632480+0000","last_unstale":"2024-09-21T07:33:47.633788+0000","last_undegraded":"2024-09-21T07:33:47.633788+0000","last_fullsized":"2024-09-21T07:33:47.633788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:37.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626018+0000","last_change":"2024-09-21T07:33:46.618752+0000","last_active":"2024-09-21T07:33:47.626018+0000","last_peered":"2024-09-21T07:33:47.626018+0000","last_clean":"2024-09-21T07:33:47.626018+0000","last_became_active":"2024-09-21T07:33:46.617838+0000","last_became_peered":"2024-09-21T07:33:46.617838+0000","last_unstale":"2024-09-21T07:33:47.626018+0000","last_undegraded":"2024-09-21T07:33:47.626018+0000","last_fullsized":"2024-09-21T07:33:47.626018+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.349802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646073+0000","last_change":"2024-09-21T07:33:47.643524+0000","last_active":"2024-09-21T07:33:47.646073+0000","last_peered":"2024-09-21T07:33:47.646073+0000","last_clean":"2024-09-21T07:33:47.646073+0000","last_became_active":"2024-09-21T07:33:47.643202+0000","last_became_peered":"2024-09-21T07:33:47.643202+0000","last_unstale":"2024-09-21T07:33:47.646073+0000","last_undegraded":"2024-09-21T07:33:47.646073+0000","last_fullsized":"2024-09-21T07:33:47.646073+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:39.768719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642752+0000","last_change":"2024-09-21T07:33:46.608302+0000","last_active":"2024-09-21T07:33:48.642752+0000","last_peered":"2024-09-21T07:33:48.642752+0000","last_clean":"2024-09-21T07:33:48.642752+0000","last_became_active":"2024-09-21T07:33:46.607990+0000","last_became_peered":"2024-09-21T07:33:46.607990+0000","last_unstale":"2024-09-21T07:33:48.642752+0000","last_undegraded":"2024-09-21T07:33:48.642752+0000","last_fullsized":"2024-09-21T07:33:48.642752+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:19.640505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.644246+0000","last_change":"2024-09-21T07:33:47.636878+0000","last_active":"2024-09-21T07:33:47.644246+0000","last_peered":"2024-09-21T07:33:47.644246+0000","last_clean":"2024-09-21T07:33:47.644246+0000","last_became_active":"2024-09-21T07:33:47.636386+0000","last_became_peered":"2024-09-21T07:33:47.636386+0000","last_unstale":"2024-09-21T07:33:47.644246+0000","last_undegraded":"2024-09-21T07:33:47.644246+0000","last_fullsized":"2024-09-21T07:33:47.644246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:03.374135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.621926+0000","last_change":"2024-09-21T07:33:46.618935+0000","last_active":"2024-09-21T07:33:47.621926+0000","last_peered":"2024-09-21T07:33:47.621926+0000","last_clean":"2024-09-21T07:33:47.621926+0000","last_became_active":"2024-09-21T07:33:46.618440+0000","last_became_peered":"2024-09-21T07:33:46.618440+0000","last_unstale":"2024-09-21T07:33:47.621926+0000","last_undegraded":"2024-09-21T07:33:47.621926+0000","last_fullsized":"2024-09-21T07:33:47.621926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:42.515209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.637419+0000","last_change":"2024-09-21T07:33:47.635158+0000","last_active":"2024-09-21T07:33:47.637419+0000","last_peered":"2024-09-21T07:33:47.637419+0000","last_clean":"2024-09-21T07:33:47.637419+0000","last_became_active":"2024-09-21T07:33:47.631190+0000","last_became_peered":"2024-09-21T07:33:47.631190+0000","last_unstale":"2024-09-21T07:33:47.637419+0000","last_undegraded":"2024-09-21T07:33:47.637419+0000","last_fullsized":"2024-09-21T07:33:47.637419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:57.182476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.651436+0000","last_change":"2024-09-21T07:33:46.622115+0000","last_active":"2024-09-21T07:33:47.651436+0000","last_peered":"2024-09-21T07:33:47.651436+0000","last_clean":"2024-09-21T07:33:47.651436+0000","last_became_active":"2024-09-21T07:33:46.621741+0000","last_became_peered":"2024-09-21T07:33:46.621741+0000","last_unstale":"2024-09-21T07:33:47.651436+0000","last_undegraded":"2024-09-21T07:33:47.651436+0000","last_fullsized":"2024-09-21T07:33:47.651436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:09.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645042+0000","last_change":"2024-09-21T07:33:47.640834+0000","last_active":"2024-09-21T07:33:47.645042+0000","last_peered":"2024-09-21T07:33:47.645042+0000","last_clean":"2024-09-21T07:33:47.645042+0000","last_became_active":"2024-09-21T07:33:47.640148+0000","last_became_peered":"2024-09-21T07:33:47.640148+0000","last_unstale":"2024-09-21T07:33:47.645042+0000","last_undegraded":"2024-09-21T07:33:47.645042+0000","last_fullsized":"2024-09-21T07:33:47.645042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:32.615535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643855+0000","last_change":"2024-09-21T07:33:46.616859+0000","last_active":"2024-09-21T07:33:48.643855+0000","last_peered":"2024-09-21T07:33:48.643855+0000","last_clean":"2024-09-21T07:33:48.643855+0000","last_became_active":"2024-09-21T07:33:46.616532+0000","last_became_peered":"2024-09-21T07:33:46.616532+0000","last_unstale":"2024-09-21T07:33:48.643855+0000","last_undegraded":"2024-09-21T07:33:48.643855+0000","last_fullsized":"2024-09-21T07:33:48.643855+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:07.334027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635879+0000","last_change":"2024-09-21T07:33:47.634300+0000","last_active":"2024-09-21T07:33:47.635879+0000","last_peered":"2024-09-21T07:33:47.635879+0000","last_clean":"2024-09-21T07:33:47.635879+0000","last_became_active":"2024-09-21T07:33:47.633771+0000","last_became_peered":"2024-09-21T07:33:47.633771+0000","last_unstale":"2024-09-21T07:33:47.635879+0000","last_undegraded":"2024-09-21T07:33:47.635879+0000","last_fullsized":"2024-09-21T07:33:47.635879+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:26.900131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.650706+0000","last_change":"2024-09-21T07:33:46.630896+0000","last_active":"2024-09-21T07:33:47.650706+0000","last_peered":"2024-09-21T07:33:47.650706+0000","last_clean":"2024-09-21T07:33:47.650706+0000","last_became_active":"2024-09-21T07:33:46.630594+0000","last_became_peered":"2024-09-21T07:33:46.630594+0000","last_unstale":"2024-09-21T07:33:47.650706+0000","last_undegraded":"2024-09-21T07:33:47.650706+0000","last_fullsized":"2024-09-21T07:33:47.650706+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:15.215651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.645092+0000","last_change":"2024-09-21T07:33:47.639931+0000","last_active":"2024-09-21T07:33:47.645092+0000","last_peered":"2024-09-21T07:33:47.645092+0000","last_clean":"2024-09-21T07:33:47.645092+0000","last_became_active":"2024-09-21T07:33:47.636826+0000","last_became_peered":"2024-09-21T07:33:47.636826+0000","last_unstale":"2024-09-21T07:33:47.645092+0000","last_undegraded":"2024-09-21T07:33:47.645092+0000","last_fullsized":"2024-09-21T07:33:47.645092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:38.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623601+0000","last_change":"2024-09-21T07:33:46.618120+0000","last_active":"2024-09-21T07:33:47.623601+0000","last_peered":"2024-09-21T07:33:47.623601+0000","last_clean":"2024-09-21T07:33:47.623601+0000","last_became_active":"2024-09-21T07:33:46.616030+0000","last_became_peered":"2024-09-21T07:33:46.616030+0000","last_unstale":"2024-09-21T07:33:47.623601+0000","last_undegraded":"2024-09-21T07:33:47.623601+0000","last_fullsized":"2024-09-21T07:33:47.623601+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:32.017754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.647351+0000","last_change":"2024-09-21T07:33:47.647224+0000","last_active":"2024-09-21T07:33:47.647351+0000","last_peered":"2024-09-21T07:33:47.647351+0000","last_clean":"2024-09-21T07:33:47.647351+0000","last_became_active":"2024-09-21T07:33:47.646601+0000","last_became_peered":"2024-09-21T07:33:47.646601+0000","last_unstale":"2024-09-21T07:33:47.647351+0000","last_undegraded":"2024-09-21T07:33:47.647351+0000","last_fullsized":"2024-09-21T07:33:47.647351+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:04.972030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.635958+0000","last_change":"2024-09-21T07:33:46.621372+0000","last_active":"2024-09-21T07:33:47.635958+0000","last_peered":"2024-09-21T07:33:47.635958+0000","last_clean":"2024-09-21T07:33:47.635958+0000","last_became_active":"2024-09-21T07:33:46.621006+0000","last_became_peered":"2024-09-21T07:33:46.621006+0000","last_unstale":"2024-09-21T07:33:47.635958+0000","last_undegraded":"2024-09-21T07:33:47.635958+0000","last_fullsized":"2024-09-21T07:33:47.635958+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643288+0000","last_change":"2024-09-21T07:33:47.630067+0000","last_active":"2024-09-21T07:33:48.643288+0000","last_peered":"2024-09-21T07:33:48.643288+0000","last_clean":"2024-09-21T07:33:48.643288+0000","last_became_active":"2024-09-21T07:33:47.626995+0000","last_became_peered":"2024-09-21T07:33:47.626995+0000","last_unstale":"2024-09-21T07:33:48.643288+0000","last_undegraded":"2024-09-21T07:33:48.643288+0000","last_fullsized":"2024-09-21T07:33:48.643288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:06.240784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.626235+0000","last_change":"2024-09-21T07:33:46.619652+0000","last_active":"2024-09-21T07:33:47.626235+0000","last_peered":"2024-09-21T07:33:47.626235+0000","last_clean":"2024-09-21T07:33:47.626235+0000","last_became_active":"2024-09-21T07:33:46.619267+0000","last_became_peered":"2024-09-21T07:33:46.619267+0000","last_unstale":"2024-09-21T07:33:47.626235+0000","last_undegraded":"2024-09-21T07:33:47.626235+0000","last_fullsized":"2024-09-21T07:33:47.626235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:59.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.623190+0000","last_change":"2024-09-21T07:33:47.623190+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.623190+0000","last_undegraded":"2024-09-21T07:33:47.623190+0000","last_fullsized":"2024-09-21T07:33:47.623190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.619911+0000","last_change":"2024-09-21T07:33:46.614497+0000","last_active":"2024-09-21T07:33:47.619911+0000","last_peered":"2024-09-21T07:33:47.619911+0000","last_clean":"2024-09-21T07:33:47.619911+0000","last_became_active":"2024-09-21T07:33:46.614181+0000","last_became_peered":"2024-09-21T07:33:46.614181+0000","last_unstale":"2024-09-21T07:33:47.619911+0000","last_undegraded":"2024-09-21T07:33:47.619911+0000","last_fullsized":"2024-09-21T07:33:47.619911+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:29.909421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.625374+0000","last_change":"2024-09-21T07:33:47.625374+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.625374+0000","last_undegraded":"2024-09-21T07:33:47.625374+0000","last_fullsized":"2024-09-21T07:33:47.625374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.618612+0000","last_change":"2024-09-21T07:33:46.621849+0000","last_active":"2024-09-21T07:33:47.618612+0000","last_peered":"2024-09-21T07:33:47.618612+0000","last_clean":"2024-09-21T07:33:47.618612+0000","last_became_active":"2024-09-21T07:33:46.621232+0000","last_became_peered":"2024-09-21T07:33:46.621232+0000","last_unstale":"2024-09-21T07:33:47.618612+0000","last_undegraded":"2024-09-21T07:33:47.618612+0000","last_fullsized":"2024-09-21T07:33:47.618612+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.193047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.612446+0000","last_change":"2024-09-21T07:33:46.612446+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.612446+0000","last_undegraded":"2024-09-21T07:33:46.612446+0000","last_fullsized":"2024-09-21T07:33:46.612446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.623747+0000","last_change":"2024-09-21T07:33:46.623165+0000","last_active":"2024-09-21T07:33:46.623747+0000","last_peered":"2024-09-21T07:33:46.623747+0000","last_clean":"2024-09-21T07:33:46.623747+0000","last_became_active":"2024-09-21T07:33:46.622212+0000","last_became_peered":"2024-09-21T07:33:46.622212+0000","last_unstale":"2024-09-21T07:33:46.623747+0000","last_undegraded":"2024-09-21T07:33:46.623747+0000","last_fullsized":"2024-09-21T07:33:46.623747+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:40.821174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.642998+0000","last_change":"2024-09-21T07:33:47.631677+0000","last_active":"2024-09-21T07:33:47.642998+0000","last_peered":"2024-09-21T07:33:47.642998+0000","last_clean":"2024-09-21T07:33:47.642998+0000","last_became_active":"2024-09-21T07:33:47.631353+0000","last_became_peered":"2024-09-21T07:33:47.631353+0000","last_unstale":"2024-09-21T07:33:47.642998+0000","last_undegraded":"2024-09-21T07:33:47.642998+0000","last_fullsized":"2024-09-21T07:33:47.642998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:29.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.623959+0000","last_change":"2024-09-21T07:33:46.617084+0000","last_active":"2024-09-21T07:33:47.623959+0000","last_peered":"2024-09-21T07:33:47.623959+0000","last_clean":"2024-09-21T07:33:47.623959+0000","last_became_active":"2024-09-21T07:33:46.616734+0000","last_became_peered":"2024-09-21T07:33:46.616734+0000","last_unstale":"2024-09-21T07:33:47.623959+0000","last_undegraded":"2024-09-21T07:33:47.623959+0000","last_fullsized":"2024-09-21T07:33:47.623959+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:32.230121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.646020+0000","last_change":"2024-09-21T07:33:47.642657+0000","last_active":"2024-09-21T07:33:47.646020+0000","last_peered":"2024-09-21T07:33:47.646020+0000","last_clean":"2024-09-21T07:33:47.646020+0000","last_became_active":"2024-09-21T07:33:47.642192+0000","last_became_peered":"2024-09-21T07:33:47.642192+0000","last_unstale":"2024-09-21T07:33:47.646020+0000","last_undegraded":"2024-09-21T07:33:47.646020+0000","last_fullsized":"2024-09-21T07:33:47.646020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:36.500996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"167'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643520+0000","last_change":"2024-09-21T07:33:46.631671+0000","last_active":"2024-09-21T07:33:48.643520+0000","last_peered":"2024-09-21T07:33:48.643520+0000","last_clean":"2024-09-21T07:33:48.643520+0000","last_became_active":"2024-09-21T07:33:46.631252+0000","last_became_peered":"2024-09-21T07:33:46.631252+0000","last_unstale":"2024-09-21T07:33:48.643520+0000","last_undegraded":"2024-09-21T07:33:48.643520+0000","last_fullsized":"2024-09-21T07:33:48.643520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:21.204372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634381+0000","last_change":"2024-09-21T07:33:47.629056+0000","last_active":"2024-09-21T07:33:47.634381+0000","last_peered":"2024-09-21T07:33:47.634381+0000","last_clean":"2024-09-21T07:33:47.634381+0000","last_became_active":"2024-09-21T07:33:47.628712+0000","last_became_peered":"2024-09-21T07:33:47.628712+0000","last_unstale":"2024-09-21T07:33:47.634381+0000","last_undegraded":"2024-09-21T07:33:47.634381+0000","last_fullsized":"2024-09-21T07:33:47.634381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:23.902544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642993+0000","last_change":"2024-09-21T07:33:46.620290+0000","last_active":"2024-09-21T07:33:48.642993+0000","last_peered":"2024-09-21T07:33:48.642993+0000","last_clean":"2024-09-21T07:33:48.642993+0000","last_became_active":"2024-09-21T07:33:46.619866+0000","last_became_peered":"2024-09-21T07:33:46.619866+0000","last_unstale":"2024-09-21T07:33:48.642993+0000","last_undegraded":"2024-09-21T07:33:48.642993+0000","last_fullsized":"2024-09-21T07:33:48.642993+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.778171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.655365+0000","last_change":"2024-09-21T07:33:47.651031+0000","last_active":"2024-09-21T07:33:47.655365+0000","last_peered":"2024-09-21T07:33:47.655365+0000","last_clean":"2024-09-21T07:33:47.655365+0000","last_became_active":"2024-09-21T07:33:47.650740+0000","last_became_peered":"2024-09-21T07:33:47.650740+0000","last_unstale":"2024-09-21T07:33:47.655365+0000","last_undegraded":"2024-09-21T07:33:47.655365+0000","last_fullsized":"2024-09-21T07:33:47.655365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:41.408856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.615429+0000","last_change":"2024-09-21T07:33:46.634107+0000","last_active":"2024-09-21T07:33:47.615429+0000","last_peered":"2024-09-21T07:33:47.615429+0000","last_clean":"2024-09-21T07:33:47.615429+0000","last_became_active":"2024-09-21T07:33:46.633497+0000","last_became_peered":"2024-09-21T07:33:46.633497+0000","last_unstale":"2024-09-21T07:33:47.615429+0000","last_undegraded":"2024-09-21T07:33:47.615429+0000","last_fullsized":"2024-09-21T07:33:47.615429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:15.769168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.634796+0000","last_change":"2024-09-21T07:33:47.631144+0000","last_active":"2024-09-21T07:33:47.634796+0000","last_peered":"2024-09-21T07:33:47.634796+0000","last_clean":"2024-09-21T07:33:47.634796+0000","last_became_active":"2024-09-21T07:33:47.630009+0000","last_became_peered":"2024-09-21T07:33:47.630009+0000","last_unstale":"2024-09-21T07:33:47.634796+0000","last_undegraded":"2024-09-21T07:33:47.634796+0000","last_fullsized":"2024-09-21T07:33:47.634796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:12.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.613968+0000","last_change":"2024-09-21T07:33:46.619099+0000","last_active":"2024-09-21T07:33:47.613968+0000","last_peered":"2024-09-21T07:33:47.613968+0000","last_clean":"2024-09-21T07:33:47.613968+0000","last_became_active":"2024-09-21T07:33:46.618774+0000","last_became_peered":"2024-09-21T07:33:46.618774+0000","last_unstale":"2024-09-21T07:33:47.613968+0000","last_undegraded":"2024-09-21T07:33:47.613968+0000","last_fullsized":"2024-09-21T07:33:47.613968+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:37.526034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.611062+0000","last_change":"2024-09-21T07:33:46.611062+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.611062+0000","last_undegraded":"2024-09-21T07:33:46.611062+0000","last_fullsized":"2024-09-21T07:33:46.611062+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642639+0000","last_change":"2024-09-21T07:33:46.629792+0000","last_active":"2024-09-21T07:33:48.642639+0000","last_peered":"2024-09-21T07:33:48.642639+0000","last_clean":"2024-09-21T07:33:48.642639+0000","last_became_active":"2024-09-21T07:33:46.628571+0000","last_became_peered":"2024-09-21T07:33:46.628571+0000","last_unstale":"2024-09-21T07:33:48.642639+0000","last_undegraded":"2024-09-21T07:33:48.642639+0000","last_fullsized":"2024-09-21T07:33:48.642639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:12.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643428+0000","last_change":"2024-09-21T07:33:47.632070+0000","last_active":"2024-09-21T07:33:48.643428+0000","last_peered":"2024-09-21T07:33:48.643428+0000","last_clean":"2024-09-21T07:33:48.643428+0000","last_became_active":"2024-09-21T07:33:47.630789+0000","last_became_peered":"2024-09-21T07:33:47.630789+0000","last_unstale":"2024-09-21T07:33:48.643428+0000","last_undegraded":"2024-09-21T07:33:48.643428+0000","last_fullsized":"2024-09-21T07:33:48.643428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:43.272580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.622151+0000","last_change":"2024-09-21T07:33:46.622064+0000","last_active":"2024-09-21T07:33:47.622151+0000","last_peered":"2024-09-21T07:33:47.622151+0000","last_clean":"2024-09-21T07:33:47.622151+0000","last_became_active":"2024-09-21T07:33:46.621756+0000","last_became_peered":"2024-09-21T07:33:46.621756+0000","last_unstale":"2024-09-21T07:33:47.622151+0000","last_undegraded":"2024-09-21T07:33:47.622151+0000","last_fullsized":"2024-09-21T07:33:47.622151+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:20.287855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":3,"reported_epoch":166,"state":"creating+activating","last_fresh":"2024-09-21T07:33:47.616070+0000","last_change":"2024-09-21T07:33:47.616070+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:47.616070+0000","last_undegraded":"2024-09-21T07:33:47.616070+0000","last_fullsized":"2024-09-21T07:33:47.616070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-21T07:33:47.624227+0000","last_change":"2024-09-21T07:33:46.619268+0000","last_active":"2024-09-21T07:33:47.624227+0000","last_peered":"2024-09-21T07:33:47.624227+0000","last_clean":"2024-09-21T07:33:47.624227+0000","last_became_active":"2024-09-21T07:33:46.618021+0000","last_became_peered":"2024-09-21T07:33:46.618021+0000","last_unstale":"2024-09-21T07:33:47.624227+0000","last_undegraded":"2024-09-21T07:33:47.624227+0000","last_fullsized":"2024-09-21T07:33:47.624227+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:40.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-21T07:33:46.609654+0000","last_change":"2024-09-21T07:33:46.609654+0000","last_active":"2024-09-21T07:33:46.590961+0000","last_peered":"2024-09-21T07:33:46.590961+0000","last_clean":"2024-09-21T07:33:46.590961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:33:46.609654+0000","last_undegraded":"2024-09-21T07:33:46.609654+0000","last_fullsized":"2024-09-21T07:33:46.609654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643309+0000","last_change":"2024-09-21T07:33:46.631055+0000","last_active":"2024-09-21T07:33:48.643309+0000","last_peered":"2024-09-21T07:33:48.643309+0000","last_clean":"2024-09-21T07:33:48.643309+0000","last_became_active":"2024-09-21T07:33:46.630753+0000","last_became_peered":"2024-09-21T07:33:46.630753+0000","last_unstale":"2024-09-21T07:33:48.643309+0000","last_undegraded":"2024-09-21T07:33:48.643309+0000","last_fullsized":"2024-09-21T07:33:48.643309+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:32.810868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":372,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-21T07:33:46.614920+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:33:46.614920+0000","last_peered":"2024-09-21T07:33:46.614920+0000","last_clean":"2024-09-21T07:33:46.614920+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:33:46.614920+0000","last_undegraded":"2024-09-21T07:33:46.614920+0000","last_fullsized":"2024-09-21T07:33:46.614920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509577,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2064384,"data_stored":971975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51832,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320008,"statfs":{"total":96636764160,"available":96583688192,"internally_reserved":0,"allocated":2658304,"data_stored":1562343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2646016,"data_stored":1555684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2109440,"data_stored":988050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:56.539 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:33:56.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 -- 172.21.15.64:0/1916593090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 msgr2=0x7fade4160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 --2- 172.21.15.64:0/1916593090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade4160d70 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7faddc009c80 tx=0x7faddc01ccb0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 -- 172.21.15.64:0/1916593090 shutdown_connections 2024-09-21T07:33:56.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 --2- 172.21.15.64:0/1916593090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade4160d70 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 --2- 172.21.15.64:0/1916593090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade40b1b10 0x7fade4074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 -- 172.21.15.64:0/1916593090 >> 172.21.15.64:0/1916593090 conn(0x7fade40b2020 msgr2=0x7fade40b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:56.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 -- 172.21.15.64:0/1916593090 shutdown_connections 2024-09-21T07:33:56.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.711+0000 7fadec600640 1 -- 172.21.15.64:0/1916593090 wait complete. 2024-09-21T07:33:56.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 Processor -- start 2024-09-21T07:33:56.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- start start 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade4074aa0 0x7fade41554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40b1b10 0x7fade4098c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fade4161430 con 0x7fade40b50d0 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fade41612b0 con 0x7fade40b1b10 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fade416a000 con 0x7fade4074aa0 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37890/0 (socket says 172.21.15.64:37890) 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 -- 172.21.15.64:0/4288497067 learned_addr learned my addr 172.21.15.64:0/4288497067 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fade9c00640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade4074aa0 0x7fade41554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fade9200640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40b1b10 0x7fade4098c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 -- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade4074aa0 msgr2=0x7fade41554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade4074aa0 0x7fade41554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 -- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40b1b10 msgr2=0x7fade4098c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40b1b10 0x7fade4098c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 -- 172.21.15.64:0/4288497067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4158020 con 0x7fade40b50d0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadea600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7faddc01a940 tx=0x7faddc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0bb070 con 0x7fade40b50d0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faddc004a50 con 0x7fade40b50d0 2024-09-21T07:33:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade414ef40 con 0x7fade40b50d0 2024-09-21T07:33:56.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0b2040 con 0x7fade40b50d0 2024-09-21T07:33:56.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.715+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade4099180 con 0x7fade40b50d0 2024-09-21T07:33:56.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade414ed60 con 0x7fade40b50d0 2024-09-21T07:33:56.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faddc0be070 con 0x7fade40b50d0 2024-09-21T07:33:56.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fade1600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 0x7fadc4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7faddc12dec0 con 0x7fade40b50d0 2024-09-21T07:33:56.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fade9c00640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 0x7fadc4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.719+0000 7fade9c00640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 0x7fadc4075710 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fadd8005fd0 tx=0x7fadd8005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.723+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fade414ed60 con 0x7fade40b50d0 2024-09-21T07:33:56.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.899+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fade4074560 con 0x7fadc4073200 2024-09-21T07:33:56.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.903+0000 7fade1600640 1 -- 172.21.15.64:0/4288497067 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252457 (secure 0 0 0) 0x7fade4074560 con 0x7fadc4073200 2024-09-21T07:33:56.906 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 msgr2=0x7fadc4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 0x7fadc4075710 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fadd8005fd0 tx=0x7fadd8005f40 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 msgr2=0x7fade41572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7faddc01a940 tx=0x7faddc005b00 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 shutdown_connections 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fadc4073200 0x7fadc4075710 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fade40b50d0 0x7fade41572a0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40b1b10 0x7fade4098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 --2- 172.21.15.64:0/4288497067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fade4074aa0 0x7fade41554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 >> 172.21.15.64:0/4288497067 conn(0x7fade40b2020 msgr2=0x7fade40ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 shutdown_connections 2024-09-21T07:33:56.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:56.907+0000 7fadec600640 1 -- 172.21.15.64:0/4288497067 wait complete. 2024-09-21T07:33:56.928 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2024-09-21T07:33:55.606236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":440572,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754534148,"statfs":{"total":773094113280,"available":772642967552,"internally_reserved":0,"allocated":17965056,"data_stored":9072228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":432983603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002511"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027945+0000","last_change":"2024-09-21T07:33:47.625720+0000","last_active":"2024-09-21T07:33:50.027945+0000","last_peered":"2024-09-21T07:33:50.027945+0000","last_clean":"2024-09-21T07:33:50.027945+0000","last_became_active":"2024-09-21T07:33:47.625405+0000","last_became_peered":"2024-09-21T07:33:47.625405+0000","last_unstale":"2024-09-21T07:33:50.027945+0000","last_undegraded":"2024-09-21T07:33:50.027945+0000","last_fullsized":"2024-09-21T07:33:50.027945+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:45.101225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027641+0000","last_change":"2024-09-21T07:33:47.635936+0000","last_active":"2024-09-21T07:33:50.027641+0000","last_peered":"2024-09-21T07:33:50.027641+0000","last_clean":"2024-09-21T07:33:50.027641+0000","last_became_active":"2024-09-21T07:33:47.634768+0000","last_became_peered":"2024-09-21T07:33:47.634768+0000","last_unstale":"2024-09-21T07:33:50.027641+0000","last_undegraded":"2024-09-21T07:33:50.027641+0000","last_fullsized":"2024-09-21T07:33:50.027641+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:28.715804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027813+0000","last_change":"2024-09-21T07:33:47.625681+0000","last_active":"2024-09-21T07:33:50.027813+0000","last_peered":"2024-09-21T07:33:50.027813+0000","last_clean":"2024-09-21T07:33:50.027813+0000","last_became_active":"2024-09-21T07:33:47.625335+0000","last_became_peered":"2024-09-21T07:33:47.625335+0000","last_unstale":"2024-09-21T07:33:50.027813+0000","last_undegraded":"2024-09-21T07:33:50.027813+0000","last_fullsized":"2024-09-21T07:33:50.027813+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:48.866593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.028086+0000","last_change":"2024-09-21T07:33:47.633470+0000","last_active":"2024-09-21T07:33:50.028086+0000","last_peered":"2024-09-21T07:33:50.028086+0000","last_clean":"2024-09-21T07:33:50.028086+0000","last_became_active":"2024-09-21T07:33:47.631234+0000","last_became_peered":"2024-09-21T07:33:47.631234+0000","last_unstale":"2024-09-21T07:33:50.028086+0000","last_undegraded":"2024-09-21T07:33:50.028086+0000","last_fullsized":"2024-09-21T07:33:50.028086+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:30.912423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025868+0000","last_change":"2024-09-21T07:33:47.630664+0000","last_active":"2024-09-21T07:33:50.025868+0000","last_peered":"2024-09-21T07:33:50.025868+0000","last_clean":"2024-09-21T07:33:50.025868+0000","last_became_active":"2024-09-21T07:33:47.630362+0000","last_became_peered":"2024-09-21T07:33:47.630362+0000","last_unstale":"2024-09-21T07:33:50.025868+0000","last_undegraded":"2024-09-21T07:33:50.025868+0000","last_fullsized":"2024-09-21T07:33:50.025868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:06.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026787+0000","last_change":"2024-09-21T07:33:47.630199+0000","last_active":"2024-09-21T07:33:50.026787+0000","last_peered":"2024-09-21T07:33:50.026787+0000","last_clean":"2024-09-21T07:33:50.026787+0000","last_became_active":"2024-09-21T07:33:47.629697+0000","last_became_peered":"2024-09-21T07:33:47.629697+0000","last_unstale":"2024-09-21T07:33:50.026787+0000","last_undegraded":"2024-09-21T07:33:50.026787+0000","last_fullsized":"2024-09-21T07:33:50.026787+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:32.851071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643632+0000","last_change":"2024-09-21T07:33:47.641086+0000","last_active":"2024-09-21T07:33:48.643632+0000","last_peered":"2024-09-21T07:33:48.643632+0000","last_clean":"2024-09-21T07:33:48.643632+0000","last_became_active":"2024-09-21T07:33:47.640738+0000","last_became_peered":"2024-09-21T07:33:47.640738+0000","last_unstale":"2024-09-21T07:33:48.643632+0000","last_undegraded":"2024-09-21T07:33:48.643632+0000","last_fullsized":"2024-09-21T07:33:48.643632+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:56.024927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642796+0000","last_change":"2024-09-21T07:33:47.641177+0000","last_active":"2024-09-21T07:33:48.642796+0000","last_peered":"2024-09-21T07:33:48.642796+0000","last_clean":"2024-09-21T07:33:48.642796+0000","last_became_active":"2024-09-21T07:33:47.640519+0000","last_became_peered":"2024-09-21T07:33:47.640519+0000","last_unstale":"2024-09-21T07:33:48.642796+0000","last_undegraded":"2024-09-21T07:33:48.642796+0000","last_fullsized":"2024-09-21T07:33:48.642796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:03.994784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644649+0000","last_change":"2024-09-21T07:33:47.648250+0000","last_active":"2024-09-21T07:33:48.644649+0000","last_peered":"2024-09-21T07:33:48.644649+0000","last_clean":"2024-09-21T07:33:48.644649+0000","last_became_active":"2024-09-21T07:33:47.647932+0000","last_became_peered":"2024-09-21T07:33:47.647932+0000","last_unstale":"2024-09-21T07:33:48.644649+0000","last_undegraded":"2024-09-21T07:33:48.644649+0000","last_fullsized":"2024-09-21T07:33:48.644649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:47.743043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644950+0000","last_change":"2024-09-21T07:33:47.650131+0000","last_active":"2024-09-21T07:33:48.644950+0000","last_peered":"2024-09-21T07:33:48.644950+0000","last_clean":"2024-09-21T07:33:48.644950+0000","last_became_active":"2024-09-21T07:33:47.649771+0000","last_became_peered":"2024-09-21T07:33:47.649771+0000","last_unstale":"2024-09-21T07:33:48.644950+0000","last_undegraded":"2024-09-21T07:33:48.644950+0000","last_fullsized":"2024-09-21T07:33:48.644950+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:11.238543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026306+0000","last_change":"2024-09-21T07:33:47.639979+0000","last_active":"2024-09-21T07:33:50.026306+0000","last_peered":"2024-09-21T07:33:50.026306+0000","last_clean":"2024-09-21T07:33:50.026306+0000","last_became_active":"2024-09-21T07:33:47.639661+0000","last_became_peered":"2024-09-21T07:33:47.639661+0000","last_unstale":"2024-09-21T07:33:50.026306+0000","last_undegraded":"2024-09-21T07:33:50.026306+0000","last_fullsized":"2024-09-21T07:33:50.026306+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.605093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027076+0000","last_change":"2024-09-21T07:33:47.624493+0000","last_active":"2024-09-21T07:33:50.027076+0000","last_peered":"2024-09-21T07:33:50.027076+0000","last_clean":"2024-09-21T07:33:50.027076+0000","last_became_active":"2024-09-21T07:33:47.623558+0000","last_became_peered":"2024-09-21T07:33:47.623558+0000","last_unstale":"2024-09-21T07:33:50.027076+0000","last_undegraded":"2024-09-21T07:33:50.027076+0000","last_fullsized":"2024-09-21T07:33:50.027076+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:35.500776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642703+0000","last_change":"2024-09-21T07:33:47.642336+0000","last_active":"2024-09-21T07:33:48.642703+0000","last_peered":"2024-09-21T07:33:48.642703+0000","last_clean":"2024-09-21T07:33:48.642703+0000","last_became_active":"2024-09-21T07:33:47.642063+0000","last_became_peered":"2024-09-21T07:33:47.642063+0000","last_unstale":"2024-09-21T07:33:48.642703+0000","last_undegraded":"2024-09-21T07:33:48.642703+0000","last_fullsized":"2024-09-21T07:33:48.642703+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:53.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025551+0000","last_change":"2024-09-21T07:33:47.636635+0000","last_active":"2024-09-21T07:33:50.025551+0000","last_peered":"2024-09-21T07:33:50.025551+0000","last_clean":"2024-09-21T07:33:50.025551+0000","last_became_active":"2024-09-21T07:33:47.635389+0000","last_became_peered":"2024-09-21T07:33:47.635389+0000","last_unstale":"2024-09-21T07:33:50.025551+0000","last_undegraded":"2024-09-21T07:33:50.025551+0000","last_fullsized":"2024-09-21T07:33:50.025551+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:34.536999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025696+0000","last_change":"2024-09-21T07:33:47.643740+0000","last_active":"2024-09-21T07:33:50.025696+0000","last_peered":"2024-09-21T07:33:50.025696+0000","last_clean":"2024-09-21T07:33:50.025696+0000","last_became_active":"2024-09-21T07:33:47.640771+0000","last_became_peered":"2024-09-21T07:33:47.640771+0000","last_unstale":"2024-09-21T07:33:50.025696+0000","last_undegraded":"2024-09-21T07:33:50.025696+0000","last_fullsized":"2024-09-21T07:33:50.025696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:14.522212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025923+0000","last_change":"2024-09-21T07:33:47.632386+0000","last_active":"2024-09-21T07:33:50.025923+0000","last_peered":"2024-09-21T07:33:50.025923+0000","last_clean":"2024-09-21T07:33:50.025923+0000","last_became_active":"2024-09-21T07:33:47.631743+0000","last_became_peered":"2024-09-21T07:33:47.631743+0000","last_unstale":"2024-09-21T07:33:50.025923+0000","last_undegraded":"2024-09-21T07:33:50.025923+0000","last_fullsized":"2024-09-21T07:33:50.025923+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:03.785007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644829+0000","last_change":"2024-09-21T07:33:47.646697+0000","last_active":"2024-09-21T07:33:48.644829+0000","last_peered":"2024-09-21T07:33:48.644829+0000","last_clean":"2024-09-21T07:33:48.644829+0000","last_became_active":"2024-09-21T07:33:47.646388+0000","last_became_peered":"2024-09-21T07:33:47.646388+0000","last_unstale":"2024-09-21T07:33:48.644829+0000","last_undegraded":"2024-09-21T07:33:48.644829+0000","last_fullsized":"2024-09-21T07:33:48.644829+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:42.095326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643657+0000","last_change":"2024-09-21T07:33:47.642102+0000","last_active":"2024-09-21T07:33:48.643657+0000","last_peered":"2024-09-21T07:33:48.643657+0000","last_clean":"2024-09-21T07:33:48.643657+0000","last_became_active":"2024-09-21T07:33:47.641771+0000","last_became_peered":"2024-09-21T07:33:47.641771+0000","last_unstale":"2024-09-21T07:33:48.643657+0000","last_undegraded":"2024-09-21T07:33:48.643657+0000","last_fullsized":"2024-09-21T07:33:48.643657+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:18.172643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026589+0000","last_change":"2024-09-21T07:33:47.643086+0000","last_active":"2024-09-21T07:33:50.026589+0000","last_peered":"2024-09-21T07:33:50.026589+0000","last_clean":"2024-09-21T07:33:50.026589+0000","last_became_active":"2024-09-21T07:33:47.640786+0000","last_became_peered":"2024-09-21T07:33:47.640786+0000","last_unstale":"2024-09-21T07:33:50.026589+0000","last_undegraded":"2024-09-21T07:33:50.026589+0000","last_fullsized":"2024-09-21T07:33:50.026589+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.714361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027020+0000","last_change":"2024-09-21T07:33:47.633448+0000","last_active":"2024-09-21T07:33:50.027020+0000","last_peered":"2024-09-21T07:33:50.027020+0000","last_clean":"2024-09-21T07:33:50.027020+0000","last_became_active":"2024-09-21T07:33:47.633066+0000","last_became_peered":"2024-09-21T07:33:47.633066+0000","last_unstale":"2024-09-21T07:33:50.027020+0000","last_undegraded":"2024-09-21T07:33:50.027020+0000","last_fullsized":"2024-09-21T07:33:50.027020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:54.310952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642952+0000","last_change":"2024-09-21T07:33:47.629236+0000","last_active":"2024-09-21T07:33:48.642952+0000","last_peered":"2024-09-21T07:33:48.642952+0000","last_clean":"2024-09-21T07:33:48.642952+0000","last_became_active":"2024-09-21T07:33:47.628957+0000","last_became_peered":"2024-09-21T07:33:47.628957+0000","last_unstale":"2024-09-21T07:33:48.642952+0000","last_undegraded":"2024-09-21T07:33:48.642952+0000","last_fullsized":"2024-09-21T07:33:48.642952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:22.566695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027040+0000","last_change":"2024-09-21T07:33:47.644825+0000","last_active":"2024-09-21T07:33:50.027040+0000","last_peered":"2024-09-21T07:33:50.027040+0000","last_clean":"2024-09-21T07:33:50.027040+0000","last_became_active":"2024-09-21T07:33:47.643711+0000","last_became_peered":"2024-09-21T07:33:47.643711+0000","last_unstale":"2024-09-21T07:33:50.027040+0000","last_undegraded":"2024-09-21T07:33:50.027040+0000","last_fullsized":"2024-09-21T07:33:50.027040+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:59.557015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025469+0000","last_change":"2024-09-21T07:33:47.633569+0000","last_active":"2024-09-21T07:33:50.025469+0000","last_peered":"2024-09-21T07:33:50.025469+0000","last_clean":"2024-09-21T07:33:50.025469+0000","last_became_active":"2024-09-21T07:33:47.632464+0000","last_became_peered":"2024-09-21T07:33:47.632464+0000","last_unstale":"2024-09-21T07:33:50.025469+0000","last_undegraded":"2024-09-21T07:33:50.025469+0000","last_fullsized":"2024-09-21T07:33:50.025469+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:04.681855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026051+0000","last_change":"2024-09-21T07:33:47.632731+0000","last_active":"2024-09-21T07:33:50.026051+0000","last_peered":"2024-09-21T07:33:50.026051+0000","last_clean":"2024-09-21T07:33:50.026051+0000","last_became_active":"2024-09-21T07:33:47.632100+0000","last_became_peered":"2024-09-21T07:33:47.632100+0000","last_unstale":"2024-09-21T07:33:50.026051+0000","last_undegraded":"2024-09-21T07:33:50.026051+0000","last_fullsized":"2024-09-21T07:33:50.026051+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:18.172643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643809+0000","last_change":"2024-09-21T07:33:47.634716+0000","last_active":"2024-09-21T07:33:48.643809+0000","last_peered":"2024-09-21T07:33:48.643809+0000","last_clean":"2024-09-21T07:33:48.643809+0000","last_became_active":"2024-09-21T07:33:47.634400+0000","last_became_peered":"2024-09-21T07:33:47.634400+0000","last_unstale":"2024-09-21T07:33:48.643809+0000","last_undegraded":"2024-09-21T07:33:48.643809+0000","last_fullsized":"2024-09-21T07:33:48.643809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:56.119446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027422+0000","last_change":"2024-09-21T07:33:47.632215+0000","last_active":"2024-09-21T07:33:50.027422+0000","last_peered":"2024-09-21T07:33:50.027422+0000","last_clean":"2024-09-21T07:33:50.027422+0000","last_became_active":"2024-09-21T07:33:47.631762+0000","last_became_peered":"2024-09-21T07:33:47.631762+0000","last_unstale":"2024-09-21T07:33:50.027422+0000","last_undegraded":"2024-09-21T07:33:50.027422+0000","last_fullsized":"2024-09-21T07:33:50.027422+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:50:51.528846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027162+0000","last_change":"2024-09-21T07:33:47.644300+0000","last_active":"2024-09-21T07:33:50.027162+0000","last_peered":"2024-09-21T07:33:50.027162+0000","last_clean":"2024-09-21T07:33:50.027162+0000","last_became_active":"2024-09-21T07:33:47.643985+0000","last_became_peered":"2024-09-21T07:33:47.643985+0000","last_unstale":"2024-09-21T07:33:50.027162+0000","last_undegraded":"2024-09-21T07:33:50.027162+0000","last_fullsized":"2024-09-21T07:33:50.027162+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:14.302677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643015+0000","last_change":"2024-09-21T07:33:47.631128+0000","last_active":"2024-09-21T07:33:48.643015+0000","last_peered":"2024-09-21T07:33:48.643015+0000","last_clean":"2024-09-21T07:33:48.643015+0000","last_became_active":"2024-09-21T07:33:47.626470+0000","last_became_peered":"2024-09-21T07:33:47.626470+0000","last_unstale":"2024-09-21T07:33:48.643015+0000","last_undegraded":"2024-09-21T07:33:48.643015+0000","last_fullsized":"2024-09-21T07:33:48.643015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:16.850891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026974+0000","last_change":"2024-09-21T07:33:47.646591+0000","last_active":"2024-09-21T07:33:50.026974+0000","last_peered":"2024-09-21T07:33:50.026974+0000","last_clean":"2024-09-21T07:33:50.026974+0000","last_became_active":"2024-09-21T07:33:47.646236+0000","last_became_peered":"2024-09-21T07:33:47.646236+0000","last_unstale":"2024-09-21T07:33:50.026974+0000","last_undegraded":"2024-09-21T07:33:50.026974+0000","last_fullsized":"2024-09-21T07:33:50.026974+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:14.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643109+0000","last_change":"2024-09-21T07:33:47.638445+0000","last_active":"2024-09-21T07:33:48.643109+0000","last_peered":"2024-09-21T07:33:48.643109+0000","last_clean":"2024-09-21T07:33:48.643109+0000","last_became_active":"2024-09-21T07:33:47.638126+0000","last_became_peered":"2024-09-21T07:33:47.638126+0000","last_unstale":"2024-09-21T07:33:48.643109+0000","last_undegraded":"2024-09-21T07:33:48.643109+0000","last_fullsized":"2024-09-21T07:33:48.643109+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:07.197283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026320+0000","last_change":"2024-09-21T07:33:47.640296+0000","last_active":"2024-09-21T07:33:50.026320+0000","last_peered":"2024-09-21T07:33:50.026320+0000","last_clean":"2024-09-21T07:33:50.026320+0000","last_became_active":"2024-09-21T07:33:47.639859+0000","last_became_peered":"2024-09-21T07:33:47.639859+0000","last_unstale":"2024-09-21T07:33:50.026320+0000","last_undegraded":"2024-09-21T07:33:50.026320+0000","last_fullsized":"2024-09-21T07:33:50.026320+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.374692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643029+0000","last_change":"2024-09-21T07:33:47.632301+0000","last_active":"2024-09-21T07:33:48.643029+0000","last_peered":"2024-09-21T07:33:48.643029+0000","last_clean":"2024-09-21T07:33:48.643029+0000","last_became_active":"2024-09-21T07:33:47.631997+0000","last_became_peered":"2024-09-21T07:33:47.631997+0000","last_unstale":"2024-09-21T07:33:48.643029+0000","last_undegraded":"2024-09-21T07:33:48.643029+0000","last_fullsized":"2024-09-21T07:33:48.643029+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:21.956663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026239+0000","last_change":"2024-09-21T07:33:47.645853+0000","last_active":"2024-09-21T07:33:50.026239+0000","last_peered":"2024-09-21T07:33:50.026239+0000","last_clean":"2024-09-21T07:33:50.026239+0000","last_became_active":"2024-09-21T07:33:47.645496+0000","last_became_peered":"2024-09-21T07:33:47.645496+0000","last_unstale":"2024-09-21T07:33:50.026239+0000","last_undegraded":"2024-09-21T07:33:50.026239+0000","last_fullsized":"2024-09-21T07:33:50.026239+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:16.326266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":19,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.028427+0000","last_change":"2024-09-21T07:33:46.621829+0000","last_active":"2024-09-21T07:33:50.028427+0000","last_peered":"2024-09-21T07:33:50.028427+0000","last_clean":"2024-09-21T07:33:50.028427+0000","last_became_active":"2024-09-21T07:33:46.621108+0000","last_became_peered":"2024-09-21T07:33:46.621108+0000","last_unstale":"2024-09-21T07:33:50.028427+0000","last_undegraded":"2024-09-21T07:33:50.028427+0000","last_fullsized":"2024-09-21T07:33:50.028427+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:49.328101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642339+0000","last_change":"2024-09-21T07:33:47.633401+0000","last_active":"2024-09-21T07:33:48.642339+0000","last_peered":"2024-09-21T07:33:48.642339+0000","last_clean":"2024-09-21T07:33:48.642339+0000","last_became_active":"2024-09-21T07:33:47.633086+0000","last_became_peered":"2024-09-21T07:33:47.633086+0000","last_unstale":"2024-09-21T07:33:48.642339+0000","last_undegraded":"2024-09-21T07:33:48.642339+0000","last_fullsized":"2024-09-21T07:33:48.642339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:35.443908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026155+0000","last_change":"2024-09-21T07:33:46.629787+0000","last_active":"2024-09-21T07:33:50.026155+0000","last_peered":"2024-09-21T07:33:50.026155+0000","last_clean":"2024-09-21T07:33:50.026155+0000","last_became_active":"2024-09-21T07:33:46.629432+0000","last_became_peered":"2024-09-21T07:33:46.629432+0000","last_unstale":"2024-09-21T07:33:50.026155+0000","last_undegraded":"2024-09-21T07:33:50.026155+0000","last_fullsized":"2024-09-21T07:33:50.026155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:20.018028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025636+0000","last_change":"2024-09-21T07:33:47.637328+0000","last_active":"2024-09-21T07:33:50.025636+0000","last_peered":"2024-09-21T07:33:50.025636+0000","last_clean":"2024-09-21T07:33:50.025636+0000","last_became_active":"2024-09-21T07:33:47.634805+0000","last_became_peered":"2024-09-21T07:33:47.634805+0000","last_unstale":"2024-09-21T07:33:50.025636+0000","last_undegraded":"2024-09-21T07:33:50.025636+0000","last_fullsized":"2024-09-21T07:33:50.025636+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:12.106112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026766+0000","last_change":"2024-09-21T07:33:46.627109+0000","last_active":"2024-09-21T07:33:50.026766+0000","last_peered":"2024-09-21T07:33:50.026766+0000","last_clean":"2024-09-21T07:33:50.026766+0000","last_became_active":"2024-09-21T07:33:46.626791+0000","last_became_peered":"2024-09-21T07:33:46.626791+0000","last_unstale":"2024-09-21T07:33:50.026766+0000","last_undegraded":"2024-09-21T07:33:50.026766+0000","last_fullsized":"2024-09-21T07:33:50.026766+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:27.963968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027235+0000","last_change":"2024-09-21T07:33:47.653669+0000","last_active":"2024-09-21T07:33:50.027235+0000","last_peered":"2024-09-21T07:33:50.027235+0000","last_clean":"2024-09-21T07:33:50.027235+0000","last_became_active":"2024-09-21T07:33:47.653365+0000","last_became_peered":"2024-09-21T07:33:47.653365+0000","last_unstale":"2024-09-21T07:33:50.027235+0000","last_undegraded":"2024-09-21T07:33:50.027235+0000","last_fullsized":"2024-09-21T07:33:50.027235+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:57.901365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027186+0000","last_change":"2024-09-21T07:33:46.628812+0000","last_active":"2024-09-21T07:33:50.027186+0000","last_peered":"2024-09-21T07:33:50.027186+0000","last_clean":"2024-09-21T07:33:50.027186+0000","last_became_active":"2024-09-21T07:33:46.628282+0000","last_became_peered":"2024-09-21T07:33:46.628282+0000","last_unstale":"2024-09-21T07:33:50.027186+0000","last_undegraded":"2024-09-21T07:33:50.027186+0000","last_fullsized":"2024-09-21T07:33:50.027186+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.194913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644635+0000","last_change":"2024-09-21T07:33:47.650503+0000","last_active":"2024-09-21T07:33:48.644635+0000","last_peered":"2024-09-21T07:33:48.644635+0000","last_clean":"2024-09-21T07:33:48.644635+0000","last_became_active":"2024-09-21T07:33:47.650188+0000","last_became_peered":"2024-09-21T07:33:47.650188+0000","last_unstale":"2024-09-21T07:33:48.644635+0000","last_undegraded":"2024-09-21T07:33:48.644635+0000","last_fullsized":"2024-09-21T07:33:48.644635+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:00.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644291+0000","last_change":"2024-09-21T07:33:46.623523+0000","last_active":"2024-09-21T07:33:48.644291+0000","last_peered":"2024-09-21T07:33:48.644291+0000","last_clean":"2024-09-21T07:33:48.644291+0000","last_became_active":"2024-09-21T07:33:46.623174+0000","last_became_peered":"2024-09-21T07:33:46.623174+0000","last_unstale":"2024-09-21T07:33:48.644291+0000","last_undegraded":"2024-09-21T07:33:48.644291+0000","last_fullsized":"2024-09-21T07:33:48.644291+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:58.346289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027110+0000","last_change":"2024-09-21T07:33:47.630806+0000","last_active":"2024-09-21T07:33:50.027110+0000","last_peered":"2024-09-21T07:33:50.027110+0000","last_clean":"2024-09-21T07:33:50.027110+0000","last_became_active":"2024-09-21T07:33:47.630494+0000","last_became_peered":"2024-09-21T07:33:47.630494+0000","last_unstale":"2024-09-21T07:33:50.027110+0000","last_undegraded":"2024-09-21T07:33:50.027110+0000","last_fullsized":"2024-09-21T07:33:50.027110+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:24.382817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025811+0000","last_change":"2024-09-21T07:33:46.608788+0000","last_active":"2024-09-21T07:33:50.025811+0000","last_peered":"2024-09-21T07:33:50.025811+0000","last_clean":"2024-09-21T07:33:50.025811+0000","last_became_active":"2024-09-21T07:33:46.608428+0000","last_became_peered":"2024-09-21T07:33:46.608428+0000","last_unstale":"2024-09-21T07:33:50.025811+0000","last_undegraded":"2024-09-21T07:33:50.025811+0000","last_fullsized":"2024-09-21T07:33:50.025811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:24.973246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027481+0000","last_change":"2024-09-21T07:33:47.624817+0000","last_active":"2024-09-21T07:33:50.027481+0000","last_peered":"2024-09-21T07:33:50.027481+0000","last_clean":"2024-09-21T07:33:50.027481+0000","last_became_active":"2024-09-21T07:33:47.624500+0000","last_became_peered":"2024-09-21T07:33:47.624500+0000","last_unstale":"2024-09-21T07:33:50.027481+0000","last_undegraded":"2024-09-21T07:33:50.027481+0000","last_fullsized":"2024-09-21T07:33:50.027481+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.883892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026598+0000","last_change":"2024-09-21T07:33:46.629058+0000","last_active":"2024-09-21T07:33:50.026598+0000","last_peered":"2024-09-21T07:33:50.026598+0000","last_clean":"2024-09-21T07:33:50.026598+0000","last_became_active":"2024-09-21T07:33:46.628579+0000","last_became_peered":"2024-09-21T07:33:46.628579+0000","last_unstale":"2024-09-21T07:33:50.026598+0000","last_undegraded":"2024-09-21T07:33:50.026598+0000","last_fullsized":"2024-09-21T07:33:50.026598+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:58.077760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.028355+0000","last_change":"2024-09-21T07:33:47.635770+0000","last_active":"2024-09-21T07:33:50.028355+0000","last_peered":"2024-09-21T07:33:50.028355+0000","last_clean":"2024-09-21T07:33:50.028355+0000","last_became_active":"2024-09-21T07:33:47.635454+0000","last_became_peered":"2024-09-21T07:33:47.635454+0000","last_unstale":"2024-09-21T07:33:50.028355+0000","last_undegraded":"2024-09-21T07:33:50.028355+0000","last_fullsized":"2024-09-21T07:33:50.028355+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.518211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643863+0000","last_change":"2024-09-21T07:33:46.626183+0000","last_active":"2024-09-21T07:33:48.643863+0000","last_peered":"2024-09-21T07:33:48.643863+0000","last_clean":"2024-09-21T07:33:48.643863+0000","last_became_active":"2024-09-21T07:33:46.625875+0000","last_became_peered":"2024-09-21T07:33:46.625875+0000","last_unstale":"2024-09-21T07:33:48.643863+0000","last_undegraded":"2024-09-21T07:33:48.643863+0000","last_fullsized":"2024-09-21T07:33:48.643863+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.173888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026177+0000","last_change":"2024-09-21T07:33:47.645938+0000","last_active":"2024-09-21T07:33:50.026177+0000","last_peered":"2024-09-21T07:33:50.026177+0000","last_clean":"2024-09-21T07:33:50.026177+0000","last_became_active":"2024-09-21T07:33:47.645443+0000","last_became_peered":"2024-09-21T07:33:47.645443+0000","last_unstale":"2024-09-21T07:33:50.026177+0000","last_undegraded":"2024-09-21T07:33:50.026177+0000","last_fullsized":"2024-09-21T07:33:50.026177+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:11.361972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643517+0000","last_change":"2024-09-21T07:33:46.627781+0000","last_active":"2024-09-21T07:33:48.643517+0000","last_peered":"2024-09-21T07:33:48.643517+0000","last_clean":"2024-09-21T07:33:48.643517+0000","last_became_active":"2024-09-21T07:33:46.627385+0000","last_became_peered":"2024-09-21T07:33:46.627385+0000","last_unstale":"2024-09-21T07:33:48.643517+0000","last_undegraded":"2024-09-21T07:33:48.643517+0000","last_fullsized":"2024-09-21T07:33:48.643517+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:55.725847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642572+0000","last_change":"2024-09-21T07:33:47.639144+0000","last_active":"2024-09-21T07:33:48.642572+0000","last_peered":"2024-09-21T07:33:48.642572+0000","last_clean":"2024-09-21T07:33:48.642572+0000","last_became_active":"2024-09-21T07:33:47.638831+0000","last_became_peered":"2024-09-21T07:33:47.638831+0000","last_unstale":"2024-09-21T07:33:48.642572+0000","last_undegraded":"2024-09-21T07:33:48.642572+0000","last_fullsized":"2024-09-21T07:33:48.642572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.804124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027870+0000","last_change":"2024-09-21T07:33:46.618197+0000","last_active":"2024-09-21T07:33:50.027870+0000","last_peered":"2024-09-21T07:33:50.027870+0000","last_clean":"2024-09-21T07:33:50.027870+0000","last_became_active":"2024-09-21T07:33:46.617845+0000","last_became_peered":"2024-09-21T07:33:46.617845+0000","last_unstale":"2024-09-21T07:33:50.027870+0000","last_undegraded":"2024-09-21T07:33:50.027870+0000","last_fullsized":"2024-09-21T07:33:50.027870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:40.942593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026998+0000","last_change":"2024-09-21T07:33:47.633080+0000","last_active":"2024-09-21T07:33:50.026998+0000","last_peered":"2024-09-21T07:33:50.026998+0000","last_clean":"2024-09-21T07:33:50.026998+0000","last_became_active":"2024-09-21T07:33:47.632770+0000","last_became_peered":"2024-09-21T07:33:47.632770+0000","last_unstale":"2024-09-21T07:33:50.026998+0000","last_undegraded":"2024-09-21T07:33:50.026998+0000","last_fullsized":"2024-09-21T07:33:50.026998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:58.014574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643087+0000","last_change":"2024-09-21T07:33:46.624386+0000","last_active":"2024-09-21T07:33:48.643087+0000","last_peered":"2024-09-21T07:33:48.643087+0000","last_clean":"2024-09-21T07:33:48.643087+0000","last_became_active":"2024-09-21T07:33:46.622664+0000","last_became_peered":"2024-09-21T07:33:46.622664+0000","last_unstale":"2024-09-21T07:33:48.643087+0000","last_undegraded":"2024-09-21T07:33:48.643087+0000","last_fullsized":"2024-09-21T07:33:48.643087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.642393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643476+0000","last_change":"2024-09-21T07:33:47.632859+0000","last_active":"2024-09-21T07:33:48.643476+0000","last_peered":"2024-09-21T07:33:48.643476+0000","last_clean":"2024-09-21T07:33:48.643476+0000","last_became_active":"2024-09-21T07:33:47.632480+0000","last_became_peered":"2024-09-21T07:33:47.632480+0000","last_unstale":"2024-09-21T07:33:48.643476+0000","last_undegraded":"2024-09-21T07:33:48.643476+0000","last_fullsized":"2024-09-21T07:33:48.643476+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:03.785007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026047+0000","last_change":"2024-09-21T07:33:46.618752+0000","last_active":"2024-09-21T07:33:50.026047+0000","last_peered":"2024-09-21T07:33:50.026047+0000","last_clean":"2024-09-21T07:33:50.026047+0000","last_became_active":"2024-09-21T07:33:46.617838+0000","last_became_peered":"2024-09-21T07:33:46.617838+0000","last_unstale":"2024-09-21T07:33:50.026047+0000","last_undegraded":"2024-09-21T07:33:50.026047+0000","last_fullsized":"2024-09-21T07:33:50.026047+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.349802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644667+0000","last_change":"2024-09-21T07:33:47.643524+0000","last_active":"2024-09-21T07:33:48.644667+0000","last_peered":"2024-09-21T07:33:48.644667+0000","last_clean":"2024-09-21T07:33:48.644667+0000","last_became_active":"2024-09-21T07:33:47.643202+0000","last_became_peered":"2024-09-21T07:33:47.643202+0000","last_unstale":"2024-09-21T07:33:48.644667+0000","last_undegraded":"2024-09-21T07:33:48.644667+0000","last_fullsized":"2024-09-21T07:33:48.644667+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:52.185311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642752+0000","last_change":"2024-09-21T07:33:46.608302+0000","last_active":"2024-09-21T07:33:48.642752+0000","last_peered":"2024-09-21T07:33:48.642752+0000","last_clean":"2024-09-21T07:33:48.642752+0000","last_became_active":"2024-09-21T07:33:46.607990+0000","last_became_peered":"2024-09-21T07:33:46.607990+0000","last_unstale":"2024-09-21T07:33:48.642752+0000","last_undegraded":"2024-09-21T07:33:48.642752+0000","last_fullsized":"2024-09-21T07:33:48.642752+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:19.640505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026254+0000","last_change":"2024-09-21T07:33:47.636878+0000","last_active":"2024-09-21T07:33:50.026254+0000","last_peered":"2024-09-21T07:33:50.026254+0000","last_clean":"2024-09-21T07:33:50.026254+0000","last_became_active":"2024-09-21T07:33:47.636386+0000","last_became_peered":"2024-09-21T07:33:47.636386+0000","last_unstale":"2024-09-21T07:33:50.026254+0000","last_undegraded":"2024-09-21T07:33:50.026254+0000","last_fullsized":"2024-09-21T07:33:50.026254+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:36.998684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026525+0000","last_change":"2024-09-21T07:33:46.618935+0000","last_active":"2024-09-21T07:33:50.026525+0000","last_peered":"2024-09-21T07:33:50.026525+0000","last_clean":"2024-09-21T07:33:50.026525+0000","last_became_active":"2024-09-21T07:33:46.618440+0000","last_became_peered":"2024-09-21T07:33:46.618440+0000","last_unstale":"2024-09-21T07:33:50.026525+0000","last_undegraded":"2024-09-21T07:33:50.026525+0000","last_fullsized":"2024-09-21T07:33:50.026525+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:42.515209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027491+0000","last_change":"2024-09-21T07:33:47.635158+0000","last_active":"2024-09-21T07:33:50.027491+0000","last_peered":"2024-09-21T07:33:50.027491+0000","last_clean":"2024-09-21T07:33:50.027491+0000","last_became_active":"2024-09-21T07:33:47.631190+0000","last_became_peered":"2024-09-21T07:33:47.631190+0000","last_unstale":"2024-09-21T07:33:50.027491+0000","last_undegraded":"2024-09-21T07:33:50.027491+0000","last_fullsized":"2024-09-21T07:33:50.027491+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:04.018626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":23,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643928+0000","last_change":"2024-09-21T07:33:46.622115+0000","last_active":"2024-09-21T07:33:48.643928+0000","last_peered":"2024-09-21T07:33:48.643928+0000","last_clean":"2024-09-21T07:33:48.643928+0000","last_became_active":"2024-09-21T07:33:46.621741+0000","last_became_peered":"2024-09-21T07:33:46.621741+0000","last_unstale":"2024-09-21T07:33:48.643928+0000","last_undegraded":"2024-09-21T07:33:48.643928+0000","last_fullsized":"2024-09-21T07:33:48.643928+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:09.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643067+0000","last_change":"2024-09-21T07:33:47.640834+0000","last_active":"2024-09-21T07:33:48.643067+0000","last_peered":"2024-09-21T07:33:48.643067+0000","last_clean":"2024-09-21T07:33:48.643067+0000","last_became_active":"2024-09-21T07:33:47.640148+0000","last_became_peered":"2024-09-21T07:33:47.640148+0000","last_unstale":"2024-09-21T07:33:48.643067+0000","last_undegraded":"2024-09-21T07:33:48.643067+0000","last_fullsized":"2024-09-21T07:33:48.643067+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:33.660002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643855+0000","last_change":"2024-09-21T07:33:46.616859+0000","last_active":"2024-09-21T07:33:48.643855+0000","last_peered":"2024-09-21T07:33:48.643855+0000","last_clean":"2024-09-21T07:33:48.643855+0000","last_became_active":"2024-09-21T07:33:46.616532+0000","last_became_peered":"2024-09-21T07:33:46.616532+0000","last_unstale":"2024-09-21T07:33:48.643855+0000","last_undegraded":"2024-09-21T07:33:48.643855+0000","last_fullsized":"2024-09-21T07:33:48.643855+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:07.334027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643236+0000","last_change":"2024-09-21T07:33:47.634300+0000","last_active":"2024-09-21T07:33:48.643236+0000","last_peered":"2024-09-21T07:33:48.643236+0000","last_clean":"2024-09-21T07:33:48.643236+0000","last_became_active":"2024-09-21T07:33:47.633771+0000","last_became_peered":"2024-09-21T07:33:47.633771+0000","last_unstale":"2024-09-21T07:33:48.643236+0000","last_undegraded":"2024-09-21T07:33:48.643236+0000","last_fullsized":"2024-09-21T07:33:48.643236+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:02.630896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.645150+0000","last_change":"2024-09-21T07:33:46.630896+0000","last_active":"2024-09-21T07:33:48.645150+0000","last_peered":"2024-09-21T07:33:48.645150+0000","last_clean":"2024-09-21T07:33:48.645150+0000","last_became_active":"2024-09-21T07:33:46.630594+0000","last_became_peered":"2024-09-21T07:33:46.630594+0000","last_unstale":"2024-09-21T07:33:48.645150+0000","last_undegraded":"2024-09-21T07:33:48.645150+0000","last_fullsized":"2024-09-21T07:33:48.645150+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:15.215651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025707+0000","last_change":"2024-09-21T07:33:47.639931+0000","last_active":"2024-09-21T07:33:50.025707+0000","last_peered":"2024-09-21T07:33:50.025707+0000","last_clean":"2024-09-21T07:33:50.025707+0000","last_became_active":"2024-09-21T07:33:47.636826+0000","last_became_peered":"2024-09-21T07:33:47.636826+0000","last_unstale":"2024-09-21T07:33:50.025707+0000","last_undegraded":"2024-09-21T07:33:50.025707+0000","last_fullsized":"2024-09-21T07:33:50.025707+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:46.560730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"166'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026406+0000","last_change":"2024-09-21T07:33:46.618120+0000","last_active":"2024-09-21T07:33:50.026406+0000","last_peered":"2024-09-21T07:33:50.026406+0000","last_clean":"2024-09-21T07:33:50.026406+0000","last_became_active":"2024-09-21T07:33:46.616030+0000","last_became_peered":"2024-09-21T07:33:46.616030+0000","last_unstale":"2024-09-21T07:33:50.026406+0000","last_undegraded":"2024-09-21T07:33:50.026406+0000","last_fullsized":"2024-09-21T07:33:50.026406+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:32.017754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026637+0000","last_change":"2024-09-21T07:33:47.647224+0000","last_active":"2024-09-21T07:33:50.026637+0000","last_peered":"2024-09-21T07:33:50.026637+0000","last_clean":"2024-09-21T07:33:50.026637+0000","last_became_active":"2024-09-21T07:33:47.646601+0000","last_became_peered":"2024-09-21T07:33:47.646601+0000","last_unstale":"2024-09-21T07:33:50.026637+0000","last_undegraded":"2024-09-21T07:33:50.026637+0000","last_fullsized":"2024-09-21T07:33:50.026637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:35.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644436+0000","last_change":"2024-09-21T07:33:46.621372+0000","last_active":"2024-09-21T07:33:48.644436+0000","last_peered":"2024-09-21T07:33:48.644436+0000","last_clean":"2024-09-21T07:33:48.644436+0000","last_became_active":"2024-09-21T07:33:46.621006+0000","last_became_peered":"2024-09-21T07:33:46.621006+0000","last_unstale":"2024-09-21T07:33:48.644436+0000","last_undegraded":"2024-09-21T07:33:48.644436+0000","last_fullsized":"2024-09-21T07:33:48.644436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643288+0000","last_change":"2024-09-21T07:33:47.630067+0000","last_active":"2024-09-21T07:33:48.643288+0000","last_peered":"2024-09-21T07:33:48.643288+0000","last_clean":"2024-09-21T07:33:48.643288+0000","last_became_active":"2024-09-21T07:33:47.626995+0000","last_became_peered":"2024-09-21T07:33:47.626995+0000","last_unstale":"2024-09-21T07:33:48.643288+0000","last_undegraded":"2024-09-21T07:33:48.643288+0000","last_fullsized":"2024-09-21T07:33:48.643288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:06.240784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026191+0000","last_change":"2024-09-21T07:33:46.619652+0000","last_active":"2024-09-21T07:33:50.026191+0000","last_peered":"2024-09-21T07:33:50.026191+0000","last_clean":"2024-09-21T07:33:50.026191+0000","last_became_active":"2024-09-21T07:33:46.619267+0000","last_became_peered":"2024-09-21T07:33:46.619267+0000","last_unstale":"2024-09-21T07:33:50.026191+0000","last_undegraded":"2024-09-21T07:33:50.026191+0000","last_fullsized":"2024-09-21T07:33:50.026191+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:59.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026201+0000","last_change":"2024-09-21T07:33:47.645375+0000","last_active":"2024-09-21T07:33:50.026201+0000","last_peered":"2024-09-21T07:33:50.026201+0000","last_clean":"2024-09-21T07:33:50.026201+0000","last_became_active":"2024-09-21T07:33:47.645041+0000","last_became_peered":"2024-09-21T07:33:47.645041+0000","last_unstale":"2024-09-21T07:33:50.026201+0000","last_undegraded":"2024-09-21T07:33:50.026201+0000","last_fullsized":"2024-09-21T07:33:50.026201+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:05.935303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026594+0000","last_change":"2024-09-21T07:33:46.614497+0000","last_active":"2024-09-21T07:33:50.026594+0000","last_peered":"2024-09-21T07:33:50.026594+0000","last_clean":"2024-09-21T07:33:50.026594+0000","last_became_active":"2024-09-21T07:33:46.614181+0000","last_became_peered":"2024-09-21T07:33:46.614181+0000","last_unstale":"2024-09-21T07:33:50.026594+0000","last_undegraded":"2024-09-21T07:33:50.026594+0000","last_fullsized":"2024-09-21T07:33:50.026594+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:29.909421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025945+0000","last_change":"2024-09-21T07:33:47.650393+0000","last_active":"2024-09-21T07:33:50.025945+0000","last_peered":"2024-09-21T07:33:50.025945+0000","last_clean":"2024-09-21T07:33:50.025945+0000","last_became_active":"2024-09-21T07:33:47.649490+0000","last_became_peered":"2024-09-21T07:33:47.649490+0000","last_unstale":"2024-09-21T07:33:50.025945+0000","last_undegraded":"2024-09-21T07:33:50.025945+0000","last_fullsized":"2024-09-21T07:33:50.025945+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:50.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026699+0000","last_change":"2024-09-21T07:33:46.621849+0000","last_active":"2024-09-21T07:33:50.026699+0000","last_peered":"2024-09-21T07:33:50.026699+0000","last_clean":"2024-09-21T07:33:50.026699+0000","last_became_active":"2024-09-21T07:33:46.621232+0000","last_became_peered":"2024-09-21T07:33:46.621232+0000","last_unstale":"2024-09-21T07:33:50.026699+0000","last_undegraded":"2024-09-21T07:33:50.026699+0000","last_fullsized":"2024-09-21T07:33:50.026699+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.193047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.028302+0000","last_change":"2024-09-21T07:33:47.638134+0000","last_active":"2024-09-21T07:33:50.028302+0000","last_peered":"2024-09-21T07:33:50.028302+0000","last_clean":"2024-09-21T07:33:50.028302+0000","last_became_active":"2024-09-21T07:33:47.637839+0000","last_became_peered":"2024-09-21T07:33:47.637839+0000","last_unstale":"2024-09-21T07:33:50.028302+0000","last_undegraded":"2024-09-21T07:33:50.028302+0000","last_fullsized":"2024-09-21T07:33:50.028302+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:29.661690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026452+0000","last_change":"2024-09-21T07:33:46.623165+0000","last_active":"2024-09-21T07:33:50.026452+0000","last_peered":"2024-09-21T07:33:50.026452+0000","last_clean":"2024-09-21T07:33:50.026452+0000","last_became_active":"2024-09-21T07:33:46.622212+0000","last_became_peered":"2024-09-21T07:33:46.622212+0000","last_unstale":"2024-09-21T07:33:50.026452+0000","last_undegraded":"2024-09-21T07:33:50.026452+0000","last_fullsized":"2024-09-21T07:33:50.026452+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:27.598707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025592+0000","last_change":"2024-09-21T07:33:47.631677+0000","last_active":"2024-09-21T07:33:50.025592+0000","last_peered":"2024-09-21T07:33:50.025592+0000","last_clean":"2024-09-21T07:33:50.025592+0000","last_became_active":"2024-09-21T07:33:47.631353+0000","last_became_peered":"2024-09-21T07:33:47.631353+0000","last_unstale":"2024-09-21T07:33:50.025592+0000","last_undegraded":"2024-09-21T07:33:50.025592+0000","last_fullsized":"2024-09-21T07:33:50.025592+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:44.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"166'2","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026201+0000","last_change":"2024-09-21T07:33:46.617084+0000","last_active":"2024-09-21T07:33:50.026201+0000","last_peered":"2024-09-21T07:33:50.026201+0000","last_clean":"2024-09-21T07:33:50.026201+0000","last_became_active":"2024-09-21T07:33:46.616734+0000","last_became_peered":"2024-09-21T07:33:46.616734+0000","last_unstale":"2024-09-21T07:33:50.026201+0000","last_undegraded":"2024-09-21T07:33:50.026201+0000","last_fullsized":"2024-09-21T07:33:50.026201+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:32.230121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644150+0000","last_change":"2024-09-21T07:33:47.642657+0000","last_active":"2024-09-21T07:33:48.644150+0000","last_peered":"2024-09-21T07:33:48.644150+0000","last_clean":"2024-09-21T07:33:48.644150+0000","last_became_active":"2024-09-21T07:33:47.642192+0000","last_became_peered":"2024-09-21T07:33:47.642192+0000","last_unstale":"2024-09-21T07:33:48.644150+0000","last_undegraded":"2024-09-21T07:33:48.644150+0000","last_fullsized":"2024-09-21T07:33:48.644150+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:01.575726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"167'1","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643520+0000","last_change":"2024-09-21T07:33:46.631671+0000","last_active":"2024-09-21T07:33:48.643520+0000","last_peered":"2024-09-21T07:33:48.643520+0000","last_clean":"2024-09-21T07:33:48.643520+0000","last_became_active":"2024-09-21T07:33:46.631252+0000","last_became_peered":"2024-09-21T07:33:46.631252+0000","last_unstale":"2024-09-21T07:33:48.643520+0000","last_undegraded":"2024-09-21T07:33:48.643520+0000","last_fullsized":"2024-09-21T07:33:48.643520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:21.204372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026917+0000","last_change":"2024-09-21T07:33:47.629056+0000","last_active":"2024-09-21T07:33:50.026917+0000","last_peered":"2024-09-21T07:33:50.026917+0000","last_clean":"2024-09-21T07:33:50.026917+0000","last_became_active":"2024-09-21T07:33:47.628712+0000","last_became_peered":"2024-09-21T07:33:47.628712+0000","last_unstale":"2024-09-21T07:33:50.026917+0000","last_undegraded":"2024-09-21T07:33:50.026917+0000","last_fullsized":"2024-09-21T07:33:50.026917+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:12.941718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642993+0000","last_change":"2024-09-21T07:33:46.620290+0000","last_active":"2024-09-21T07:33:48.642993+0000","last_peered":"2024-09-21T07:33:48.642993+0000","last_clean":"2024-09-21T07:33:48.642993+0000","last_became_active":"2024-09-21T07:33:46.619866+0000","last_became_peered":"2024-09-21T07:33:46.619866+0000","last_unstale":"2024-09-21T07:33:48.642993+0000","last_undegraded":"2024-09-21T07:33:48.642993+0000","last_fullsized":"2024-09-21T07:33:48.642993+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.778171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.644300+0000","last_change":"2024-09-21T07:33:47.651031+0000","last_active":"2024-09-21T07:33:48.644300+0000","last_peered":"2024-09-21T07:33:48.644300+0000","last_clean":"2024-09-21T07:33:48.644300+0000","last_became_active":"2024-09-21T07:33:47.650740+0000","last_became_peered":"2024-09-21T07:33:47.650740+0000","last_unstale":"2024-09-21T07:33:48.644300+0000","last_undegraded":"2024-09-21T07:33:48.644300+0000","last_fullsized":"2024-09-21T07:33:48.644300+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:43.222410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027117+0000","last_change":"2024-09-21T07:33:46.634107+0000","last_active":"2024-09-21T07:33:50.027117+0000","last_peered":"2024-09-21T07:33:50.027117+0000","last_clean":"2024-09-21T07:33:50.027117+0000","last_became_active":"2024-09-21T07:33:46.633497+0000","last_became_peered":"2024-09-21T07:33:46.633497+0000","last_unstale":"2024-09-21T07:33:50.027117+0000","last_undegraded":"2024-09-21T07:33:50.027117+0000","last_fullsized":"2024-09-21T07:33:50.027117+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:15.769168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.028217+0000","last_change":"2024-09-21T07:33:47.631144+0000","last_active":"2024-09-21T07:33:50.028217+0000","last_peered":"2024-09-21T07:33:50.028217+0000","last_clean":"2024-09-21T07:33:50.028217+0000","last_became_active":"2024-09-21T07:33:47.630009+0000","last_became_peered":"2024-09-21T07:33:47.630009+0000","last_unstale":"2024-09-21T07:33:50.028217+0000","last_undegraded":"2024-09-21T07:33:50.028217+0000","last_fullsized":"2024-09-21T07:33:50.028217+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:28.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027635+0000","last_change":"2024-09-21T07:33:46.619099+0000","last_active":"2024-09-21T07:33:50.027635+0000","last_peered":"2024-09-21T07:33:50.027635+0000","last_clean":"2024-09-21T07:33:50.027635+0000","last_became_active":"2024-09-21T07:33:46.618774+0000","last_became_peered":"2024-09-21T07:33:46.618774+0000","last_unstale":"2024-09-21T07:33:50.027635+0000","last_undegraded":"2024-09-21T07:33:50.027635+0000","last_fullsized":"2024-09-21T07:33:50.027635+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:37.526034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027336+0000","last_change":"2024-09-21T07:33:47.642304+0000","last_active":"2024-09-21T07:33:50.027336+0000","last_peered":"2024-09-21T07:33:50.027336+0000","last_clean":"2024-09-21T07:33:50.027336+0000","last_became_active":"2024-09-21T07:33:47.641929+0000","last_became_peered":"2024-09-21T07:33:47.641929+0000","last_unstale":"2024-09-21T07:33:50.027336+0000","last_undegraded":"2024-09-21T07:33:50.027336+0000","last_fullsized":"2024-09-21T07:33:50.027336+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:57.664734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.642639+0000","last_change":"2024-09-21T07:33:46.629792+0000","last_active":"2024-09-21T07:33:48.642639+0000","last_peered":"2024-09-21T07:33:48.642639+0000","last_clean":"2024-09-21T07:33:48.642639+0000","last_became_active":"2024-09-21T07:33:46.628571+0000","last_became_peered":"2024-09-21T07:33:46.628571+0000","last_unstale":"2024-09-21T07:33:48.642639+0000","last_undegraded":"2024-09-21T07:33:48.642639+0000","last_fullsized":"2024-09-21T07:33:48.642639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:12.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643428+0000","last_change":"2024-09-21T07:33:47.632070+0000","last_active":"2024-09-21T07:33:48.643428+0000","last_peered":"2024-09-21T07:33:48.643428+0000","last_clean":"2024-09-21T07:33:48.643428+0000","last_became_active":"2024-09-21T07:33:47.630789+0000","last_became_peered":"2024-09-21T07:33:47.630789+0000","last_unstale":"2024-09-21T07:33:48.643428+0000","last_undegraded":"2024-09-21T07:33:48.643428+0000","last_fullsized":"2024-09-21T07:33:48.643428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:43.272580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026640+0000","last_change":"2024-09-21T07:33:46.622064+0000","last_active":"2024-09-21T07:33:50.026640+0000","last_peered":"2024-09-21T07:33:50.026640+0000","last_clean":"2024-09-21T07:33:50.026640+0000","last_became_active":"2024-09-21T07:33:46.621756+0000","last_became_peered":"2024-09-21T07:33:46.621756+0000","last_unstale":"2024-09-21T07:33:50.026640+0000","last_undegraded":"2024-09-21T07:33:50.026640+0000","last_fullsized":"2024-09-21T07:33:50.026640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:20.287855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.027622+0000","last_change":"2024-09-21T07:33:47.644071+0000","last_active":"2024-09-21T07:33:50.027622+0000","last_peered":"2024-09-21T07:33:50.027622+0000","last_clean":"2024-09-21T07:33:50.027622+0000","last_became_active":"2024-09-21T07:33:47.643633+0000","last_became_peered":"2024-09-21T07:33:47.643633+0000","last_unstale":"2024-09-21T07:33:50.027622+0000","last_undegraded":"2024-09-21T07:33:50.027622+0000","last_fullsized":"2024-09-21T07:33:50.027622+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:08.562188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025194+0000","last_change":"2024-09-21T07:33:46.619268+0000","last_active":"2024-09-21T07:33:50.025194+0000","last_peered":"2024-09-21T07:33:50.025194+0000","last_clean":"2024-09-21T07:33:50.025194+0000","last_became_active":"2024-09-21T07:33:46.618021+0000","last_became_peered":"2024-09-21T07:33:46.618021+0000","last_unstale":"2024-09-21T07:33:50.025194+0000","last_undegraded":"2024-09-21T07:33:50.025194+0000","last_fullsized":"2024-09-21T07:33:50.025194+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:40.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.025785+0000","last_change":"2024-09-21T07:33:47.628375+0000","last_active":"2024-09-21T07:33:50.025785+0000","last_peered":"2024-09-21T07:33:50.025785+0000","last_clean":"2024-09-21T07:33:50.025785+0000","last_became_active":"2024-09-21T07:33:47.628062+0000","last_became_peered":"2024-09-21T07:33:47.628062+0000","last_unstale":"2024-09-21T07:33:50.025785+0000","last_undegraded":"2024-09-21T07:33:50.025785+0000","last_fullsized":"2024-09-21T07:33:50.025785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:46.590961+0000","last_clean_scrub_stamp":"2024-09-21T07:33:46.590961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:53.333326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:48.643309+0000","last_change":"2024-09-21T07:33:46.631055+0000","last_active":"2024-09-21T07:33:48.643309+0000","last_peered":"2024-09-21T07:33:48.643309+0000","last_clean":"2024-09-21T07:33:48.643309+0000","last_became_active":"2024-09-21T07:33:46.630753+0000","last_became_peered":"2024-09-21T07:33:46.630753+0000","last_unstale":"2024-09-21T07:33:48.643309+0000","last_undegraded":"2024-09-21T07:33:48.643309+0000","last_fullsized":"2024-09-21T07:33:48.643309+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:33:45.587960+0000","last_clean_scrub_stamp":"2024-09-21T07:33:45.587960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:32.810868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":376,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-21T07:33:50.026446+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:33:50.026446+0000","last_peered":"2024-09-21T07:33:50.026446+0000","last_clean":"2024-09-21T07:33:50.026446+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:33:50.026446+0000","last_undegraded":"2024-09-21T07:33:50.026446+0000","last_fullsized":"2024-09-21T07:33:50.026446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51276,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":2088960,"data_stored":985834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2097152,"data_stored":985958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509579,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59612,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312228,"statfs":{"total":96636764160,"available":96575721472,"internally_reserved":0,"allocated":2105344,"data_stored":986598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55440,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316400,"statfs":{"total":96636764160,"available":96579993600,"internally_reserved":0,"allocated":2088960,"data_stored":985834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55456,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316384,"statfs":{"total":96636764160,"available":96579977216,"internally_reserved":0,"allocated":2101248,"data_stored":987446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1576306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56016,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315824,"statfs":{"total":96636764160,"available":96579403776,"internally_reserved":0,"allocated":2682880,"data_stored":1576202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2109440,"data_stored":988050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:56.932 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:33:56.932 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.131+0000 7f98a1400640 1 -- 172.21.15.64:0/1503946213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c0ca990 msgr2=0x7f989c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 --2- 172.21.15.64:0/1503946213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c0ca990 0x7f989c0b3ce0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f9894009bc0 tx=0x7f989401cb10 comp rx=0 tx=0).stop 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 -- 172.21.15.64:0/1503946213 shutdown_connections 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 --2- 172.21.15.64:0/1503946213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c0ca990 0x7f989c0b3ce0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 --2- 172.21.15.64:0/1503946213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0706c0 0x7f989c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 -- 172.21.15.64:0/1503946213 >> 172.21.15.64:0/1503946213 conn(0x7f989c0ccbe0 msgr2=0x7f989c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 -- 172.21.15.64:0/1503946213 shutdown_connections 2024-09-21T07:33:57.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 -- 172.21.15.64:0/1503946213 wait complete. 2024-09-21T07:33:57.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 Processor -- start 2024-09-21T07:33:57.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 -- start start 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0ca990 0x7f989c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.135+0000 7f98a1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 0x7f989c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f989c168c80 con 0x7f989c073330 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f989c168b00 con 0x7f989c15ec20 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f989c168e00 con 0x7f989c0ca990 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37904/0 (socket says 172.21.15.64:37904) 2024-09-21T07:33:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 -- 172.21.15.64:0/176651464 learned_addr learned my addr 172.21.15.64:0/176651464 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:57.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9891e00640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 0x7f989c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989a800640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0ca990 0x7f989c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 -- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0ca990 msgr2=0x7f989c150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0ca990 0x7f989c150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 -- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 msgr2=0x7f989c072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 0x7f989c072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 -- 172.21.15.64:0/176651464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c151430 con 0x7f989c073330 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9891e00640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 0x7f989c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f989b200640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f98940b0040 tx=0x7f98940a5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940b2040 con 0x7f989c073330 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98940bb070 con 0x7f989c073330 2024-09-21T07:33:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894004040 con 0x7f989c073330 2024-09-21T07:33:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c073740 con 0x7f989c073330 2024-09-21T07:33:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1555e0 con 0x7f989c073330 2024-09-21T07:33:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c0ce740 con 0x7f989c073330 2024-09-21T07:33:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.139+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98940041e0 con 0x7f989c073330 2024-09-21T07:33:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.143+0000 7f9893400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 0x7f9878075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.143+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f989412ea70 con 0x7f989c073330 2024-09-21T07:33:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.143+0000 7f989a800640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 0x7f9878075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.143+0000 7f989a800640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 0x7f9878075710 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f988c0046c0 tx=0x7f988c007ec0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:57.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.147+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f989c073740 con 0x7f989c073330 2024-09-21T07:33:57.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.383+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f989c0ce320 con 0x7f989c073330 2024-09-21T07:33:57.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.387+0000 7f9893400640 1 -- 172.21.15.64:0/176651464 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) ==== 190+0+147 (secure 0 0 0) 0x7f989c151430 con 0x7f989c073330 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:33:57.388 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 msgr2=0x7f9878075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 0x7f9878075710 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f988c0046c0 tx=0x7f988c007ec0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 msgr2=0x7f989c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f98940b0040 tx=0x7f98940a5970 comp rx=0 tx=0).stop 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 shutdown_connections 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9878073200 0x7f9878075710 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989c073330 0x7f989c1560c0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f989c15ec20 0x7f989c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 --2- 172.21.15.64:0/176651464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989c0ca990 0x7f989c150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 >> 172.21.15.64:0/176651464 conn(0x7f989c0ccbe0 msgr2=0x7f989c15ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:57.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 shutdown_connections 2024-09-21T07:33:57.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.391+0000 7f98a1400640 1 -- 172.21.15.64:0/176651464 wait complete. 2024-09-21T07:33:57.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- 172.21.15.64:0/2423433412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec80b48d0 msgr2=0x7f9ec8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 --2- 172.21.15.64:0/2423433412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec80b48d0 0x7f9ec8072e20 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009c80 tx=0x7f9ec001cda0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- 172.21.15.64:0/2423433412 shutdown_connections 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 --2- 172.21.15.64:0/2423433412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec80b48d0 0x7f9ec8072e20 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- 172.21.15.64:0/2423433412 >> 172.21.15.64:0/2423433412 conn(0x7f9ec80ccbe0 msgr2=0x7f9ec80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:57.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- 172.21.15.64:0/2423433412 shutdown_connections 2024-09-21T07:33:57.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- 172.21.15.64:0/2423433412 wait complete. 2024-09-21T07:33:57.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 Processor -- start 2024-09-21T07:33:57.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- start start 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ec80709b0 0x7f9ec8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec815edb0 0x7f9ec809cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec816a420 con 0x7f9ec8166730 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec816a2a0 con 0x7f9ec815edb0 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.571+0000 7f9ecea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec816a5a0 con 0x7f9ec80709b0 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37926/0 (socket says 172.21.15.64:37926) 2024-09-21T07:33:57.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 -- 172.21.15.64:0/3347576474 learned_addr learned my addr 172.21.15.64:0/3347576474 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:57.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ec7e00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ec80709b0 0x7f9ec8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ec7400640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec815edb0 0x7f9ec809cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 -- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ec80709b0 msgr2=0x7f9ec8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ec80709b0 0x7f9ec8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 -- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec815edb0 msgr2=0x7f9ec809cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec815edb0 0x7f9ec809cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 -- 172.21.15.64:0/3347576474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec81559c0 con 0x7f9ec8166730 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecca00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f9ec001c810 tx=0x7f9ec00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec00b2040 con 0x7f9ec8166730 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec00044e0 con 0x7f9ec8166730 2024-09-21T07:33:57.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec00ad440 con 0x7f9ec8166730 2024-09-21T07:33:57.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec80ad250 con 0x7f9ec8166730 2024-09-21T07:33:57.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec8154270 con 0x7f9ec8166730 2024-09-21T07:33:57.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8072e20 con 0x7f9ec8166730 2024-09-21T07:33:57.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.575+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ec00be030 con 0x7f9ec8166730 2024-09-21T07:33:57.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.579+0000 7f9ebfe00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 0x7f9ea8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:57.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.579+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f9ec012e6e0 con 0x7f9ec8166730 2024-09-21T07:33:57.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.579+0000 7f9ec7e00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 0x7f9ea8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:57.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.579+0000 7f9ec7e00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 0x7f9ea8075740 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80098e0 tx=0x7f9eb8009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:57.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.583+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9ec00c5060 con 0x7f9ec8166730 2024-09-21T07:33:57.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.795+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ec809da20 con 0x7f9ec8166730 2024-09-21T07:33:57.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.795+0000 7f9ebfe00640 1 -- 172.21.15.64:0/3347576474 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f9ec0016990 con 0x7f9ec8166730 2024-09-21T07:33:57.795 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:33:57.796 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:33:57.796 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 msgr2=0x7f9ea8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 0x7f9ea8075740 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80098e0 tx=0x7f9eb8009060 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 msgr2=0x7f9ec809ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f9ec001c810 tx=0x7f9ec00042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 shutdown_connections 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ea8073230 0x7f9ea8075740 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ec8166730 0x7f9ec809ba40 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec815edb0 0x7f9ec809cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 --2- 172.21.15.64:0/3347576474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ec80709b0 0x7f9ec8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 >> 172.21.15.64:0/3347576474 conn(0x7f9ec80ccbe0 msgr2=0x7f9ec80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:57.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 shutdown_connections 2024-09-21T07:33:57.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:57.799+0000 7f9ecea00640 1 -- 172.21.15.64:0/3347576474 wait complete. 2024-09-21T07:33:58.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 120, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:33:47.029522+0000', 'modified': '2024-09-21T07:33:50.083239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9094}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9094': {'gid': 9094, 'name': 'a', 'rank': 0, 'incarnation': 116, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/130164325', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 130164325}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 130164325}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9094, 'qdb_cluster': [9094]} 2024-09-21T07:33:58.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:33:58.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- 172.21.15.64:0/3797112584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd628004810 msgr2=0x7fd628004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 --2- 172.21.15.64:0/3797112584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd628004810 0x7fd628004c20 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b40 tx=0x7fd62c01d250 comp rx=0 tx=0).stop 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- 172.21.15.64:0/3797112584 shutdown_connections 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 --2- 172.21.15.64:0/3797112584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd628004810 0x7fd628004c20 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- 172.21.15.64:0/3797112584 >> 172.21.15.64:0/3797112584 conn(0x7fd6440d23f0 msgr2=0x7fd6440d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- 172.21.15.64:0/3797112584 shutdown_connections 2024-09-21T07:33:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- 172.21.15.64:0/3797112584 wait complete. 2024-09-21T07:33:58.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 Processor -- start 2024-09-21T07:33:58.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.383+0000 7fd64b200640 1 -- start start 2024-09-21T07:33:58.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd628004810 0x7fd6440b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 0x7fd6440c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd644071650 con 0x7fd6441fa0b0 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd6440714d0 con 0x7fd628004810 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd6440717d0 con 0x7fd6441f3820 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37950/0 (socket says 172.21.15.64:37950) 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 -- 172.21.15.64:0/380790102 learned_addr learned my addr 172.21.15.64:0/380790102 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd63be00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 0x7fd6440c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd643e00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd628004810 0x7fd6440b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 -- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 msgr2=0x7fd6440c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 0x7fd6440c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 -- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd628004810 msgr2=0x7fd6440b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd628004810 0x7fd6440b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 -- 172.21.15.64:0/380790102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6440b3690 con 0x7fd6441fa0b0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd63be00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 0x7fd6440c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd649200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b1dd0 tx=0x7fd63c012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd640c00640 1 -- 172.21.15.64:0/380790102 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c013860 con 0x7fd6441fa0b0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd640c00640 1 -- 172.21.15.64:0/380790102 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd63c013a20 con 0x7fd6441fa0b0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd640c00640 1 -- 172.21.15.64:0/380790102 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c010480 con 0x7fd6441fa0b0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6440b3970 con 0x7fd6441fa0b0 2024-09-21T07:33:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.387+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6441f9b90 con 0x7fd6441fa0b0 2024-09-21T07:33:58.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd640c00640 1 -- 172.21.15.64:0/380790102 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd63c010620 con 0x7fd6441fa0b0 2024-09-21T07:33:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd652a40000 1 Processor -- start 2024-09-21T07:33:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd652a40000 1 -- start start 2024-09-21T07:33:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd640c00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 0x7fd620075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd640c00640 1 -- 172.21.15.64:0/380790102 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd63c0981d0 con 0x7fd6441fa0b0 2024-09-21T07:33:58.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd63be00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 0x7fd620075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed0f9460 0x5578ed63a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 0x5578ed63abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.391+0000 7fd652a40000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578ed50f410 con 0x5578ed4d2ca0 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578ed44cb40 con 0x5578ed4e9950 2024-09-21T07:33:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578ed43bf70 con 0x5578ed0f9460 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd63be00640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 0x7fd620075710 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0ad000 tx=0x7fd62c019ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37956/0 (socket says 172.21.15.64:37956) 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 -- 172.21.15.64:0/2521078512 learned_addr learned my addr 172.21.15.64:0/2521078512 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd643e00640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed0f9460 0x5578ed63a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd63be00640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 0x5578ed63abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 -- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed0f9460 msgr2=0x5578ed63a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed0f9460 0x5578ed63a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 -- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 msgr2=0x5578ed63abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 0x5578ed63abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 -- 172.21.15.64:0/2521078512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578ed4035b0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd63be00640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 0x5578ed63abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd649200640 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001f40 tx=0x7fd63c0623d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ad656f1d08e31d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd638c00640 1 -- 172.21.15.64:0/2521078512 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c022040 con 0x5578ed4d2ca0 2024-09-21T07:33:58.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd638c00640 1 -- 172.21.15.64:0/2521078512 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd63c062970 con 0x5578ed4d2ca0 2024-09-21T07:33:58.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd638c00640 1 -- 172.21.15.64:0/2521078512 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0673a0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- 172.21.15.64:0/2521078512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 msgr2=0x5578ed63b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001f40 tx=0x7fd63c0623d0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- 172.21.15.64:0/2521078512 shutdown_connections 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed63b120 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed4e9950 0x5578ed63abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 --2- 172.21.15.64:0/2521078512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed0f9460 0x5578ed63a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- 172.21.15.64:0/2521078512 >> 172.21.15.64:0/2521078512 conn(0x5578ed5bfd90 msgr2=0x5578ed5ef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- 172.21.15.64:0/2521078512 shutdown_connections 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- 172.21.15.64:0/2521078512 wait complete. 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 -- start start 2024-09-21T07:33:58.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.395+0000 7fd652a40000 1 Processor -- start 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed641920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5578ed3d65f0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578ed43fd80 con 0x5578ed0f9460 2024-09-21T07:33:58.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578ed3e2520 con 0x5578ed4e9950 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 10 client.0 _ll_register_callbacks cb 0x5578ed3e6830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37958/0 (socket says 172.21.15.64:37958) 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 -- 172.21.15.64:0/4027142612 learned_addr learned my addr 172.21.15.64:0/4027142612 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd649200640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd643e00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed641920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 -- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 msgr2=0x5578ed6423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 -- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 msgr2=0x5578ed641920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed641920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 -- 172.21.15.64:0/4027142612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578ed3da190 con 0x5578ed4d2ca0 2024-09-21T07:33:58.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd63be00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0ae040 tx=0x7fd62c0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6957733e33d118 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0c5420 con 0x5578ed4d2ca0 2024-09-21T07:33:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd62c0c55c0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578ed3d4110 con 0x5578ed4d2ca0 2024-09-21T07:33:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fd62c0d5050 con 0x5578ed4d2ca0 2024-09-21T07:33:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 10 client.9786 fetch_fsmap learned FSMap version 120 2024-09-21T07:33:58.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x5578ed4c0f10 con 0x5578ed4d2ca0 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578ed3d4110 con 0x5578ed4d2ca0 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fd62c0d8020 con 0x5578ed4d2ca0 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 10 client.9786 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 10 client.9786 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 20 client.9786 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0de7d0 0x5578ed64bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 4 client.9786 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578ed44ea90 con 0x5578ed0de7d0 2024-09-21T07:33:58.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.399+0000 7fd643e00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0de7d0 0x5578ed64bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd643e00640 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0de7d0 0x5578ed64bd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb9664820f0c6c1 server_cookie=755dba5ee3783d18 in_seq=0 out_seq=0 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd631600640 10 client.9786 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd631600640 1 -- 172.21.15.64:0/4027142612 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578ed44ea90 con 0x5578ed0de7d0 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd631600640 10 client.9786 handle_command_reply: tid=0 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 client.9786 shutdown 2024-09-21T07:33:58.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 msgr2=0x5578ed641e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0ae040 tx=0x7fd62c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 shutdown_connections 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0de7d0 0x5578ed64bd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed641e60 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd631600640 0 client.9786 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 --2- 172.21.15.64:0/4027142612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed641920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 >> 172.21.15.64:0/4027142612 conn(0x5578ed5bfd90 msgr2=0x5578ed5f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 shutdown_connections 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 1 -- 172.21.15.64:0/4027142612 wait complete. 2024-09-21T07:33:58.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.403+0000 7fd652a40000 20 client.9786 trim_cache size 0 max 16384 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 Processor -- start 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 -- start start 2024-09-21T07:33:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6ac620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd644202ec0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd644201f40 con 0x5578ed0f9460 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd6440b5fe0 con 0x5578ed4e9950 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37970/0 (socket says 172.21.15.64:37970) 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 -- 172.21.15.64:0/3910063298 learned_addr learned my addr 172.21.15.64:0/3910063298 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd649200640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd643e00640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 -- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 msgr2=0x5578ed6ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 -- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 msgr2=0x5578ed6ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 -- 172.21.15.64:0/3910063298 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578ed497db0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd649200640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:58.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd63be00640 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005250 tx=0x7fd62c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558217c549c64de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd633e00640 1 -- 172.21.15.64:0/3910063298 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0dd030 con 0x5578ed4d2ca0 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd633e00640 1 -- 172.21.15.64:0/3910063298 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd62c0cd070 con 0x5578ed4d2ca0 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.423+0000 7fd633e00640 1 -- 172.21.15.64:0/3910063298 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0c5a50 con 0x5578ed4d2ca0 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- 172.21.15.64:0/3910063298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 msgr2=0x5578ed6acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005250 tx=0x7fd62c004b20 comp rx=0 tx=0).stop 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- 172.21.15.64:0/3910063298 shutdown_connections 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6acb60 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- 172.21.15.64:0/3910063298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- 172.21.15.64:0/3910063298 >> 172.21.15.64:0/3910063298 conn(0x5578ed5bfd90 msgr2=0x5578ed638620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- 172.21.15.64:0/3910063298 shutdown_connections 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- 172.21.15.64:0/3910063298 wait complete. 2024-09-21T07:33:58.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- start start 2024-09-21T07:33:58.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 Processor -- start 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd6440cc500 con 0x5578ed4d2ca0 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578ed44b910 con 0x5578ed0f9460 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5578ed4443b0 con 0x5578ed4e9950 2024-09-21T07:33:58.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd652a40000 10 client.0 _ll_register_callbacks cb 0x7fd62c0bc070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37978/0 (socket says 172.21.15.64:37978) 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 -- 172.21.15.64:0/3863380998 learned_addr learned my addr 172.21.15.64:0/3863380998 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd643e00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd649200640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 -- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 msgr2=0x5578ed6b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 -- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 msgr2=0x5578ed6b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.427+0000 7fd63be00640 1 -- 172.21.15.64:0/3863380998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578ed402ab0 con 0x5578ed4d2ca0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd63be00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005d90 tx=0x7fd62c0c6a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8948804bc89e10af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:33:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0d3650 con 0x5578ed4d2ca0 2024-09-21T07:33:58.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd62c0de870 con 0x5578ed4d2ca0 2024-09-21T07:33:58.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62c0cd070 con 0x5578ed4d2ca0 2024-09-21T07:33:58.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fd62c0dea70 con 0x5578ed4d2ca0 2024-09-21T07:33:58.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 10 client.9792 fetch_fsmap learned FSMap version 120 2024-09-21T07:33:58.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x5578ed3e1070 con 0x5578ed4d2ca0 2024-09-21T07:33:58.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd62c0cd070 con 0x5578ed4d2ca0 2024-09-21T07:33:58.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fd62c0d8040 con 0x5578ed4d2ca0 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 10 client.9792 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 10 client.9792 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 20 client.9792 populate_metadata read hostname 'smithi064' 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0cc830 0x5578ed66c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 4 client.9792 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "status"}) -- 0x5578ed44a540 con 0x5578ed0cc830 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd643e00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0cc830 0x5578ed66c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 10 client.9792 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd643e00640 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0cc830 0x5578ed66c6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbebdba38394f5b6 server_cookie=da0db4e60b8b6ca4 in_seq=0 out_seq=0 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 1 -- 172.21.15.64:0/3863380998 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5578ed44a540 con 0x5578ed0cc830 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 10 client.9792 handle_command_reply: tid=0 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 client.9792 shutdown 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 msgr2=0x5578ed6b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005d90 tx=0x7fd62c0c6a70 comp rx=0 tx=0).stop 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 shutdown_connections 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x5578ed0cc830 0x5578ed66c6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5578ed4e9950 0x5578ed6b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5578ed4d2ca0 0x5578ed6b08d0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 --2- 172.21.15.64:0/3863380998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5578ed0f9460 0x5578ed6b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 >> 172.21.15.64:0/3863380998 conn(0x5578ed5bfd90 msgr2=0x5578ed638fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd631600640 0 client.9792 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 shutdown_connections 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 1 -- 172.21.15.64:0/3863380998 wait complete. 2024-09-21T07:33:58.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd652a40000 20 client.9792 trim_cache size 0 max 16384 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 9094, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.821970532, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 120, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 167, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 167, 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.967851753 2024-09-21T07:33:58.435 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 msgr2=0x7fd620075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 0x7fd620075710 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0ad000 tx=0x7fd62c019ff0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 msgr2=0x7fd6441fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b1dd0 tx=0x7fd63c012870 comp rx=0 tx=0).stop 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 shutdown_connections 2024-09-21T07:33:58.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd620073200 0x7fd620075710 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6441fa0b0 0x7fd6441fa4c0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6441f3820 0x7fd6440c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 --2- 172.21.15.64:0/380790102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd628004810 0x7fd6440b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 >> 172.21.15.64:0/380790102 conn(0x7fd6440d23f0 msgr2=0x7fd64406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 shutdown_connections 2024-09-21T07:33:58.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.431+0000 7fd64b200640 1 -- 172.21.15.64:0/380790102 wait complete. 2024-09-21T07:33:58.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:33:58.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- 172.21.15.64:0/2510490240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c0709b0 msgr2=0x7f417c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 --2- 172.21.15.64:0/2510490240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c0709b0 0x7f417c0b41c0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f4164009900 tx=0x7f416401c700 comp rx=0 tx=0).stop 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- 172.21.15.64:0/2510490240 shutdown_connections 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 --2- 172.21.15.64:0/2510490240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 0x7f417c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 --2- 172.21.15.64:0/2510490240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c0709b0 0x7f417c0b41c0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- 172.21.15.64:0/2510490240 >> 172.21.15.64:0/2510490240 conn(0x7f417c0ccbe0 msgr2=0x7f417c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- 172.21.15.64:0/2510490240 shutdown_connections 2024-09-21T07:33:58.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- 172.21.15.64:0/2510490240 wait complete. 2024-09-21T07:33:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 Processor -- start 2024-09-21T07:33:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.615+0000 7f4183000640 1 -- start start 2024-09-21T07:33:58.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c0709b0 0x7f417c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 0x7f417c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f417c168c40 con 0x7f417c15edb0 2024-09-21T07:33:58.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f417c168ac0 con 0x7f417c0709b0 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f417c168dc0 con 0x7f417c0b4700 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38008/0 (socket says 172.21.15.64:38008) 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 -- 172.21.15.64:0/2901310012 learned_addr learned my addr 172.21.15.64:0/2901310012 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f417be00640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c0709b0 0x7f417c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4173e00640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 0x7f417c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 -- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 msgr2=0x7f417c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 0x7f417c15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 -- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c0709b0 msgr2=0x7f417c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c0709b0 0x7f417c1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 -- 172.21.15.64:0/2901310012 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c158c20 con 0x7f417c15edb0 2024-09-21T07:33:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4181000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f417400e910 tx=0x7f417400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174004d30 con 0x7f417c15edb0 2024-09-21T07:33:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f417400cb20 con 0x7f417c15edb0 2024-09-21T07:33:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174005020 con 0x7f417c15edb0 2024-09-21T07:33:58.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c0afd80 con 0x7f417c15edb0 2024-09-21T07:33:58.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c0b0340 con 0x7f417c15edb0 2024-09-21T07:33:58.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.619+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c0b41c0 con 0x7f417c15edb0 2024-09-21T07:33:58.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.623+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f41740051c0 con 0x7f417c15edb0 2024-09-21T07:33:58.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.623+0000 7f4178c00640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 0x7f4158075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.623+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f4174094a10 con 0x7f417c15edb0 2024-09-21T07:33:58.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.623+0000 7f417be00640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 0x7f4158075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.623+0000 7f417be00640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 0x7f4158075740 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.627+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4174016030 con 0x7f417c15edb0 2024-09-21T07:33:58.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.843+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f417c09da20 con 0x7f417c15edb0 2024-09-21T07:33:58.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.843+0000 7f4178c00640 1 -- 172.21.15.64:0/2901310012 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) ==== 53+0+73 (secure 0 0 0) 0x7f417405f2e0 con 0x7f417c15edb0 2024-09-21T07:33:58.845 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:33:58.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 msgr2=0x7f4158075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 0x7f4158075740 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c009060 comp rx=0 tx=0).stop 2024-09-21T07:33:58.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 msgr2=0x7f417c15e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f417400e910 tx=0x7f417400edd0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 shutdown_connections 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4158073230 0x7f4158075740 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f417c15edb0 0x7f417c15e230 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f417c0b4700 0x7f417c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 --2- 172.21.15.64:0/2901310012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c0709b0 0x7f417c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 >> 172.21.15.64:0/2901310012 conn(0x7f417c0ccbe0 msgr2=0x7f417c0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 shutdown_connections 2024-09-21T07:33:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:58.847+0000 7f4183000640 1 -- 172.21.15.64:0/2901310012 wait complete. 2024-09-21T07:33:58.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:33:58.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:33:58.868 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:33:58.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:58.869 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:33:58.878 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:33:58.878 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:33:58.878 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:33:58.879 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41745sec preferred_lft 41745sec 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:33:58.880 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:33:58.881 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:33:58.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:58.883 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:33:58.938 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:33:58.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:58.940 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:33:58.992 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:33:58.993 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:33:58.993 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:33:59.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:33:59.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:59.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:59.132 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:33:59.189 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:33:59.189 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:33:59.190 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:33:59.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:59.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:33:59.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:33:59.252 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:33:59.300 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:33:59.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:33:59.300 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:33:59.356 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:33:59.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:59.356 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:33:59.459 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:33:59.459 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:33:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:33:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:33:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:33:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:33:59.471 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:33:59.475 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:33:59.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:33:59.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:33:59.505 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:33:59.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:33:59.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:33:59.620 INFO:teuthology.orchestra.run.smithi064.stdout:client8225 2024-09-21T07:33:59.620 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:33:59.620 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:33:59.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- 172.21.15.64:0/2134782738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa868004e60 msgr2=0x7fa86800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 --2- 172.21.15.64:0/2134782738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa868004e60 0x7fa86800b9d0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c610 tx=0x7fa87801f880 comp rx=0 tx=0).stop 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa886200640 1 -- 172.21.15.64:0/2134782738 reap_dead start 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- 172.21.15.64:0/2134782738 shutdown_connections 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- 172.21.15.64:0/2134782738 >> 172.21.15.64:0/2134782738 conn(0x7fa8800ccbe0 msgr2=0x7fa8800ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:59.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- 172.21.15.64:0/2134782738 shutdown_connections 2024-09-21T07:33:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- 172.21.15.64:0/2134782738 wait complete. 2024-09-21T07:33:59.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 Processor -- start 2024-09-21T07:33:59.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.883+0000 7fa888200640 1 -- start start 2024-09-21T07:33:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa868004e60 0x7fa8800c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800c71a0 0x7fa8800ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:59.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa880073530 con 0x7fa8800aef30 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8800b4420 con 0x7fa868004e60 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa8800736b0 con 0x7fa8800c71a0 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38026/0 (socket says 172.21.15.64:38026) 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 -- 172.21.15.64:0/2258453923 learned_addr learned my addr 172.21.15.64:0/2258453923 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa885800640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa868004e60 0x7fa8800c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa884e00640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800c71a0 0x7fa8800ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 -- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800c71a0 msgr2=0x7fa8800ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800c71a0 0x7fa8800ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:59.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 -- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa868004e60 msgr2=0x7fa8800c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa868004e60 0x7fa8800c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 -- 172.21.15.64:0/2258453923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8800afcd0 con 0x7fa8800aef30 2024-09-21T07:33:59.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa886200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa878026590 tx=0x7fa878001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878003b80 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa878003e10 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8780062e0 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8800affb0 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8800b0570 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.887+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa880072e20 con 0x7fa8800aef30 2024-09-21T07:33:59.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.891+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa878006480 con 0x7fa8800aef30 2024-09-21T07:33:59.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.891+0000 7fa87d600640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 0x7fa860075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:59.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.891+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fa878132540 con 0x7fa8800aef30 2024-09-21T07:33:59.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.891+0000 7fa885800640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 0x7fa860075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:59.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.891+0000 7fa885800640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 0x7fa860075710 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa8740068e0 tx=0x7fa874006ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:59.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:33:59.895+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa8800b4b10 con 0x7fa8800aef30 2024-09-21T07:34:00.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.107+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa88009da20 con 0x7fa8800aef30 2024-09-21T07:34:00.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa87d600640 1 -- 172.21.15.64:0/2258453923 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7fa8780fcd70 con 0x7fa8800aef30 2024-09-21T07:34:00.109 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:00.109 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:00.109 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 msgr2=0x7fa860075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 0x7fa860075710 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa8740068e0 tx=0x7fa874006ac0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 msgr2=0x7fa8800c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa878026590 tx=0x7fa878001670 comp rx=0 tx=0).stop 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 shutdown_connections 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa860073200 0x7fa860075710 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8800aef30 0x7fa8800c7e60 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800c71a0 0x7fa8800ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 --2- 172.21.15.64:0/2258453923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa868004e60 0x7fa8800c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 >> 172.21.15.64:0/2258453923 conn(0x7fa8800ccbe0 msgr2=0x7fa88015d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:00.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 shutdown_connections 2024-09-21T07:34:00.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.111+0000 7fa888200640 1 -- 172.21.15.64:0/2258453923 wait complete. 2024-09-21T07:34:00.132 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 -- 172.21.15.64:0/2396207579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040b48d0 msgr2=0x7f5004072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 --2- 172.21.15.64:0/2396207579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040b48d0 0x7f5004072e20 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009bc0 tx=0x7f4ffc01cbc0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 -- 172.21.15.64:0/2396207579 shutdown_connections 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 --2- 172.21.15.64:0/2396207579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040b48d0 0x7f5004072e20 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 --2- 172.21.15.64:0/2396207579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f50040700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 -- 172.21.15.64:0/2396207579 >> 172.21.15.64:0/2396207579 conn(0x7f50040ccbe0 msgr2=0x7f50040ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 -- 172.21.15.64:0/2396207579 shutdown_connections 2024-09-21T07:34:00.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.291+0000 7f500c400640 1 -- 172.21.15.64:0/2396207579 wait complete. 2024-09-21T07:34:00.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 Processor -- start 2024-09-21T07:34:00.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 -- start start 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50040709b0 0x7f50041476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f500415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5004168cf0 con 0x7f50040c3c90 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5004168b70 con 0x7f50040709b0 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5004168e70 con 0x7f500415edb0 2024-09-21T07:34:00.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38048/0 (socket says 172.21.15.64:38048) 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 -- 172.21.15.64:0/2668986318 learned_addr learned my addr 172.21.15.64:0/2668986318 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f5009a00640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50040709b0 0x7f50041476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f5009000640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f500415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 -- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 msgr2=0x7f500415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f500415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 -- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50040709b0 msgr2=0x7f50041476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50040709b0 0x7f50041476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 -- 172.21.15.64:0/2668986318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040b1160 con 0x7f50040c3c90 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f5009000640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f500415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:00.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.295+0000 7f500a400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc01b270 tx=0x7f4ffc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0bb070 con 0x7f50040c3c90 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ffc004e00 con 0x7f50040c3c90 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50041f98a0 con 0x7f50040c3c90 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b2040 con 0x7f50040c3c90 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50041f9e60 con 0x7f50040c3c90 2024-09-21T07:34:00.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50040b1330 con 0x7f50040c3c90 2024-09-21T07:34:00.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ffc0be070 con 0x7f50040c3c90 2024-09-21T07:34:00.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 0x7f4fe4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f4ffc12e190 con 0x7f50040c3c90 2024-09-21T07:34:00.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.299+0000 7f5009a00640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 0x7f4fe4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.303+0000 7f5009a00640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 0x7f4fe4075710 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800bb50 tx=0x7f4ff800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:00.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.303+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4ffc0167b0 con 0x7f50040c3c90 2024-09-21T07:34:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.515+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5004072e20 con 0x7f50040c3c90 2024-09-21T07:34:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f5001600640 1 -- 172.21.15.64:0/2668986318 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f4ffc0f8930 con 0x7f50040c3c90 2024-09-21T07:34:00.517 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:00.518 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:00.518 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 msgr2=0x7f4fe4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 0x7f4fe4075710 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800bb50 tx=0x7f4ff800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 msgr2=0x7f500415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc01b270 tx=0x7f4ffc003f60 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 shutdown_connections 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4fe4073200 0x7f4fe4075710 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50040c3c90 0x7f500415c660 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f500415edb0 0x7f500415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 --2- 172.21.15.64:0/2668986318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50040709b0 0x7f50041476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 >> 172.21.15.64:0/2668986318 conn(0x7f50040ccbe0 msgr2=0x7f50040aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 shutdown_connections 2024-09-21T07:34:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00.519+0000 7f500c400640 1 -- 172.21.15.64:0/2668986318 wait complete. 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.0 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:00.540 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:00.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.624 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190169 s, 55.1 MB/s 2024-09-21T07:34:00.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215812 s, 48.6 MB/s 2024-09-21T07:34:00.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147273 s, 71.2 MB/s 2024-09-21T07:34:00.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149363 s, 70.2 MB/s 2024-09-21T07:34:00.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170262 s, 61.6 MB/s 2024-09-21T07:34:00.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161688 s, 64.9 MB/s 2024-09-21T07:34:00.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.739 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151215 s, 69.3 MB/s 2024-09-21T07:34:00.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.760 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185668 s, 56.5 MB/s 2024-09-21T07:34:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169585 s, 61.8 MB/s 2024-09-21T07:34:00.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160632 s, 65.3 MB/s 2024-09-21T07:34:00.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150254 s, 69.8 MB/s 2024-09-21T07:34:00.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159379 s, 65.8 MB/s 2024-09-21T07:34:00.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151382 s, 69.3 MB/s 2024-09-21T07:34:00.874 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.874 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.874 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187212 s, 56.0 MB/s 2024-09-21T07:34:00.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149603 s, 70.1 MB/s 2024-09-21T07:34:00.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152777 s, 68.6 MB/s 2024-09-21T07:34:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013444 s, 78.0 MB/s 2024-09-21T07:34:00.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.943 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150224 s, 69.8 MB/s 2024-09-21T07:34:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139944 s, 74.9 MB/s 2024-09-21T07:34:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136278 s, 76.9 MB/s 2024-09-21T07:34:00.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:00.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:00.994 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150132 s, 69.8 MB/s 2024-09-21T07:34:01.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.009 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.009 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126761 s, 82.7 MB/s 2024-09-21T07:34:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.032 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199469 s, 52.6 MB/s 2024-09-21T07:34:01.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155406 s, 67.5 MB/s 2024-09-21T07:34:01.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.069 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.069 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163894 s, 64.0 MB/s 2024-09-21T07:34:01.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.086 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145223 s, 72.2 MB/s 2024-09-21T07:34:01.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162106 s, 64.7 MB/s 2024-09-21T07:34:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.121 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129495 s, 81.0 MB/s 2024-09-21T07:34:01.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.139 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150439 s, 69.7 MB/s 2024-09-21T07:34:01.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143819 s, 72.9 MB/s 2024-09-21T07:34:01.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154015 s, 68.1 MB/s 2024-09-21T07:34:01.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148085 s, 70.8 MB/s 2024-09-21T07:34:01.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:01.198 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.1 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:01.199 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:01.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:01.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133764 s, 78.4 MB/s 2024-09-21T07:34:01.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137601 s, 76.2 MB/s 2024-09-21T07:34:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187501 s, 55.9 MB/s 2024-09-21T07:34:01.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.324 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163404 s, 64.2 MB/s 2024-09-21T07:34:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138084 s, 75.9 MB/s 2024-09-21T07:34:01.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.358 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152614 s, 68.7 MB/s 2024-09-21T07:34:01.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153402 s, 68.4 MB/s 2024-09-21T07:34:01.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150501 s, 69.7 MB/s 2024-09-21T07:34:01.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.416 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185153 s, 56.6 MB/s 2024-09-21T07:34:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172853 s, 60.7 MB/s 2024-09-21T07:34:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130301 s, 80.5 MB/s 2024-09-21T07:34:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135899 s, 77.2 MB/s 2024-09-21T07:34:01.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128915 s, 81.3 MB/s 2024-09-21T07:34:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155385 s, 67.5 MB/s 2024-09-21T07:34:01.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.518 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.518 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133862 s, 78.3 MB/s 2024-09-21T07:34:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134965 s, 77.7 MB/s 2024-09-21T07:34:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155021 s, 67.6 MB/s 2024-09-21T07:34:01.569 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.569 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.569 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142722 s, 73.5 MB/s 2024-09-21T07:34:01.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178647 s, 58.7 MB/s 2024-09-21T07:34:01.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.608 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149939 s, 69.9 MB/s 2024-09-21T07:34:01.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122464 s, 85.6 MB/s 2024-09-21T07:34:01.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.644 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186719 s, 56.2 MB/s 2024-09-21T07:34:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137248 s, 76.4 MB/s 2024-09-21T07:34:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128408 s, 81.7 MB/s 2024-09-21T07:34:01.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130026 s, 80.6 MB/s 2024-09-21T07:34:01.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139027 s, 75.4 MB/s 2024-09-21T07:34:01.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.725 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131138 s, 80.0 MB/s 2024-09-21T07:34:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147361 s, 71.2 MB/s 2024-09-21T07:34:01.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.763 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.763 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01851 s, 56.6 MB/s 2024-09-21T07:34:01.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132504 s, 79.1 MB/s 2024-09-21T07:34:01.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.794 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127424 s, 82.3 MB/s 2024-09-21T07:34:01.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.814 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149912 s, 69.9 MB/s 2024-09-21T07:34:01.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:01.819 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.2 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:01.820 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:01.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135962 s, 77.1 MB/s 2024-09-21T07:34:01.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189926 s, 55.2 MB/s 2024-09-21T07:34:01.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.927 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147274 s, 71.2 MB/s 2024-09-21T07:34:01.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147028 s, 71.3 MB/s 2024-09-21T07:34:01.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150494 s, 69.7 MB/s 2024-09-21T07:34:01.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:01.983 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:01.983 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178608 s, 58.7 MB/s 2024-09-21T07:34:02.000 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.000 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.000 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145751 s, 71.9 MB/s 2024-09-21T07:34:02.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.022 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175215 s, 59.8 MB/s 2024-09-21T07:34:02.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.038 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143424 s, 73.1 MB/s 2024-09-21T07:34:02.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.059 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018932 s, 55.4 MB/s 2024-09-21T07:34:02.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154075 s, 68.1 MB/s 2024-09-21T07:34:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147982 s, 70.9 MB/s 2024-09-21T07:34:02.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150584 s, 69.6 MB/s 2024-09-21T07:34:02.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.130 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146168 s, 71.7 MB/s 2024-09-21T07:34:02.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129321 s, 81.1 MB/s 2024-09-21T07:34:02.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.163 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144907 s, 72.4 MB/s 2024-09-21T07:34:02.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.180 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140826 s, 74.5 MB/s 2024-09-21T07:34:02.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013751 s, 76.3 MB/s 2024-09-21T07:34:02.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013507 s, 77.6 MB/s 2024-09-21T07:34:02.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131123 s, 80.0 MB/s 2024-09-21T07:34:02.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145201 s, 72.2 MB/s 2024-09-21T07:34:02.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.263 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150168 s, 69.8 MB/s 2024-09-21T07:34:02.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113122 s, 92.7 MB/s 2024-09-21T07:34:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.294 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137404 s, 76.3 MB/s 2024-09-21T07:34:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185227 s, 56.6 MB/s 2024-09-21T07:34:02.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.333 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152235 s, 68.9 MB/s 2024-09-21T07:34:02.349 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.349 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.349 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134198 s, 78.1 MB/s 2024-09-21T07:34:02.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.366 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146668 s, 71.5 MB/s 2024-09-21T07:34:02.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013622 s, 77.0 MB/s 2024-09-21T07:34:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137027 s, 76.5 MB/s 2024-09-21T07:34:02.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.416 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140329 s, 74.7 MB/s 2024-09-21T07:34:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186806 s, 56.1 MB/s 2024-09-21T07:34:02.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:02.444 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:02.444 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:02.445 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.3 2024-09-21T07:34:02.445 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:02.445 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:02.445 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:02.445 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:02.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:02.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.521 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141985 s, 73.9 MB/s 2024-09-21T07:34:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188897 s, 55.5 MB/s 2024-09-21T07:34:02.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179007 s, 58.6 MB/s 2024-09-21T07:34:02.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139947 s, 74.9 MB/s 2024-09-21T07:34:02.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.596 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138921 s, 75.5 MB/s 2024-09-21T07:34:02.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.613 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.613 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146081 s, 71.8 MB/s 2024-09-21T07:34:02.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165361 s, 63.4 MB/s 2024-09-21T07:34:02.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.649 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013537 s, 77.5 MB/s 2024-09-21T07:34:02.670 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187671 s, 55.9 MB/s 2024-09-21T07:34:02.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132603 s, 79.1 MB/s 2024-09-21T07:34:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182457 s, 57.5 MB/s 2024-09-21T07:34:02.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138854 s, 75.5 MB/s 2024-09-21T07:34:02.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136094 s, 77.0 MB/s 2024-09-21T07:34:02.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.757 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133329 s, 78.6 MB/s 2024-09-21T07:34:02.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.775 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152328 s, 68.8 MB/s 2024-09-21T07:34:02.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.790 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136448 s, 76.8 MB/s 2024-09-21T07:34:02.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013705 s, 76.5 MB/s 2024-09-21T07:34:02.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137784 s, 76.1 MB/s 2024-09-21T07:34:02.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.842 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136821 s, 76.6 MB/s 2024-09-21T07:34:02.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.856 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136206 s, 77.0 MB/s 2024-09-21T07:34:02.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.873 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.873 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013458 s, 77.9 MB/s 2024-09-21T07:34:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135183 s, 77.6 MB/s 2024-09-21T07:34:02.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.907 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153768 s, 68.2 MB/s 2024-09-21T07:34:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133862 s, 78.3 MB/s 2024-09-21T07:34:02.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.944 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178684 s, 58.7 MB/s 2024-09-21T07:34:02.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139212 s, 75.3 MB/s 2024-09-21T07:34:02.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.975 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123473 s, 84.9 MB/s 2024-09-21T07:34:02.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:02.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:02.990 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121948 s, 86.0 MB/s 2024-09-21T07:34:03.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155957 s, 67.2 MB/s 2024-09-21T07:34:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.025 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146796 s, 71.4 MB/s 2024-09-21T07:34:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018892 s, 55.5 MB/s 2024-09-21T07:34:03.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151699 s, 69.1 MB/s 2024-09-21T07:34:03.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:03.072 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.4 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:03.073 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:03.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:03.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189916 s, 55.2 MB/s 2024-09-21T07:34:03.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138572 s, 75.7 MB/s 2024-09-21T07:34:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188434 s, 55.6 MB/s 2024-09-21T07:34:03.202 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.202 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.202 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149757 s, 70.0 MB/s 2024-09-21T07:34:03.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.218 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.218 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132215 s, 79.3 MB/s 2024-09-21T07:34:03.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.234 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135112 s, 77.6 MB/s 2024-09-21T07:34:03.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180659 s, 58.0 MB/s 2024-09-21T07:34:03.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142684 s, 73.5 MB/s 2024-09-21T07:34:03.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.292 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178753 s, 58.7 MB/s 2024-09-21T07:34:03.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.308 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140855 s, 74.4 MB/s 2024-09-21T07:34:03.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.324 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132451 s, 79.2 MB/s 2024-09-21T07:34:03.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.345 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186616 s, 56.2 MB/s 2024-09-21T07:34:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154243 s, 68.0 MB/s 2024-09-21T07:34:03.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151828 s, 69.1 MB/s 2024-09-21T07:34:03.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.398 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.398 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137783 s, 76.1 MB/s 2024-09-21T07:34:03.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139524 s, 75.2 MB/s 2024-09-21T07:34:03.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.431 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138689 s, 75.6 MB/s 2024-09-21T07:34:03.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132516 s, 79.1 MB/s 2024-09-21T07:34:03.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.463 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130938 s, 80.1 MB/s 2024-09-21T07:34:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018966 s, 55.3 MB/s 2024-09-21T07:34:03.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152289 s, 68.9 MB/s 2024-09-21T07:34:03.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.520 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140359 s, 74.7 MB/s 2024-09-21T07:34:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019292 s, 54.4 MB/s 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015349 s, 68.3 MB/s 2024-09-21T07:34:03.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.583 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020043 s, 52.3 MB/s 2024-09-21T07:34:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138869 s, 75.5 MB/s 2024-09-21T07:34:03.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.616 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136307 s, 76.9 MB/s 2024-09-21T07:34:03.638 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.638 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.638 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018806 s, 55.8 MB/s 2024-09-21T07:34:03.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015357 s, 68.3 MB/s 2024-09-21T07:34:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149099 s, 70.3 MB/s 2024-09-21T07:34:03.690 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.690 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135046 s, 77.6 MB/s 2024-09-21T07:34:03.710 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.710 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.710 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169268 s, 61.9 MB/s 2024-09-21T07:34:03.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:03.717 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:03.717 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:03.717 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.5 2024-09-21T07:34:03.717 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:03.718 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:03.718 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:03.718 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:03.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148452 s, 70.6 MB/s 2024-09-21T07:34:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140022 s, 74.9 MB/s 2024-09-21T07:34:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176445 s, 59.4 MB/s 2024-09-21T07:34:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139546 s, 75.1 MB/s 2024-09-21T07:34:03.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.859 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153306 s, 68.4 MB/s 2024-09-21T07:34:03.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149034 s, 70.4 MB/s 2024-09-21T07:34:03.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.893 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014021 s, 74.8 MB/s 2024-09-21T07:34:03.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.909 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131594 s, 79.7 MB/s 2024-09-21T07:34:03.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176128 s, 59.5 MB/s 2024-09-21T07:34:03.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162231 s, 64.6 MB/s 2024-09-21T07:34:03.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.969 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181122 s, 57.9 MB/s 2024-09-21T07:34:03.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:03.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01908 s, 55.0 MB/s 2024-09-21T07:34:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133461 s, 78.6 MB/s 2024-09-21T07:34:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119156 s, 88.0 MB/s 2024-09-21T07:34:04.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.042 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183582 s, 57.1 MB/s 2024-09-21T07:34:04.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.058 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132273 s, 79.3 MB/s 2024-09-21T07:34:04.074 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.074 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.074 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132998 s, 78.8 MB/s 2024-09-21T07:34:04.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.091 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-09-21T07:34:04.110 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.111 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01421 s, 73.8 MB/s 2024-09-21T07:34:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134802 s, 77.8 MB/s 2024-09-21T07:34:04.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149027 s, 70.4 MB/s 2024-09-21T07:34:04.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191334 s, 54.8 MB/s 2024-09-21T07:34:04.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.180 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136985 s, 76.5 MB/s 2024-09-21T07:34:04.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014926 s, 70.3 MB/s 2024-09-21T07:34:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134093 s, 78.2 MB/s 2024-09-21T07:34:04.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.231 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145883 s, 71.9 MB/s 2024-09-21T07:34:04.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178769 s, 58.7 MB/s 2024-09-21T07:34:04.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188274 s, 55.7 MB/s 2024-09-21T07:34:04.292 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.293 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016779 s, 62.5 MB/s 2024-09-21T07:34:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.310 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014875 s, 70.5 MB/s 2024-09-21T07:34:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.324 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111501 s, 94.0 MB/s 2024-09-21T07:34:04.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.341 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.341 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145278 s, 72.2 MB/s 2024-09-21T07:34:04.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:04.348 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:04.348 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:04.348 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.6 2024-09-21T07:34:04.348 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:04.349 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:04.349 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:04.349 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:04.397 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.419 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148568 s, 70.6 MB/s 2024-09-21T07:34:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135026 s, 77.7 MB/s 2024-09-21T07:34:04.454 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.455 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.455 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172916 s, 60.6 MB/s 2024-09-21T07:34:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138722 s, 75.6 MB/s 2024-09-21T07:34:04.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.487 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013337 s, 78.6 MB/s 2024-09-21T07:34:04.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153928 s, 68.1 MB/s 2024-09-21T07:34:04.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.524 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.524 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155252 s, 67.5 MB/s 2024-09-21T07:34:04.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.541 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147202 s, 71.2 MB/s 2024-09-21T07:34:04.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191389 s, 54.8 MB/s 2024-09-21T07:34:04.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150749 s, 69.6 MB/s 2024-09-21T07:34:04.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.596 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013531 s, 77.5 MB/s 2024-09-21T07:34:04.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142887 s, 73.4 MB/s 2024-09-21T07:34:04.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.630 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137665 s, 76.2 MB/s 2024-09-21T07:34:04.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184024 s, 57.0 MB/s 2024-09-21T07:34:04.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.668 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138346 s, 75.8 MB/s 2024-09-21T07:34:04.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013362 s, 78.5 MB/s 2024-09-21T07:34:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136916 s, 76.6 MB/s 2024-09-21T07:34:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140797 s, 74.5 MB/s 2024-09-21T07:34:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015528 s, 67.5 MB/s 2024-09-21T07:34:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.757 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186841 s, 56.1 MB/s 2024-09-21T07:34:04.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.773 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135016 s, 77.7 MB/s 2024-09-21T07:34:04.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.789 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137002 s, 76.5 MB/s 2024-09-21T07:34:04.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.808 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.808 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157026 s, 66.8 MB/s 2024-09-21T07:34:04.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136772 s, 76.7 MB/s 2024-09-21T07:34:04.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172244 s, 60.9 MB/s 2024-09-21T07:34:04.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155294 s, 67.5 MB/s 2024-09-21T07:34:04.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.878 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132156 s, 79.3 MB/s 2024-09-21T07:34:04.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133445 s, 78.6 MB/s 2024-09-21T07:34:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151642 s, 69.1 MB/s 2024-09-21T07:34:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130473 s, 80.4 MB/s 2024-09-21T07:34:04.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144374 s, 72.6 MB/s 2024-09-21T07:34:04.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:04.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:04.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138121 s, 75.9 MB/s 2024-09-21T07:34:04.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:04.969 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:04.969 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:04.969 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.7 2024-09-21T07:34:04.969 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:04.970 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:04.970 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:04.970 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:05.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:05.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.043 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186754 s, 56.1 MB/s 2024-09-21T07:34:05.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152731 s, 68.7 MB/s 2024-09-21T07:34:05.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144849 s, 72.4 MB/s 2024-09-21T07:34:05.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134804 s, 77.8 MB/s 2024-09-21T07:34:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015363 s, 68.3 MB/s 2024-09-21T07:34:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.127 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012525 s, 83.7 MB/s 2024-09-21T07:34:05.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.143 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.143 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012897 s, 81.3 MB/s 2024-09-21T07:34:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178873 s, 58.6 MB/s 2024-09-21T07:34:05.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.180 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134518 s, 78.0 MB/s 2024-09-21T07:34:05.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.196 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134431 s, 78.0 MB/s 2024-09-21T07:34:05.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134683 s, 77.9 MB/s 2024-09-21T07:34:05.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.229 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013559 s, 77.3 MB/s 2024-09-21T07:34:05.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131957 s, 79.5 MB/s 2024-09-21T07:34:05.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148902 s, 70.4 MB/s 2024-09-21T07:34:05.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124024 s, 84.5 MB/s 2024-09-21T07:34:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184441 s, 56.9 MB/s 2024-09-21T07:34:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193328 s, 54.2 MB/s 2024-09-21T07:34:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.337 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133668 s, 78.4 MB/s 2024-09-21T07:34:05.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.353 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.353 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134978 s, 77.7 MB/s 2024-09-21T07:34:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135496 s, 77.4 MB/s 2024-09-21T07:34:05.386 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144417 s, 72.6 MB/s 2024-09-21T07:34:05.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.403 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.403 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131982 s, 79.4 MB/s 2024-09-21T07:34:05.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191151 s, 54.9 MB/s 2024-09-21T07:34:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141513 s, 74.1 MB/s 2024-09-21T07:34:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013389 s, 78.3 MB/s 2024-09-21T07:34:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013061 s, 80.3 MB/s 2024-09-21T07:34:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185376 s, 56.6 MB/s 2024-09-21T07:34:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150039 s, 69.9 MB/s 2024-09-21T07:34:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138379 s, 75.8 MB/s 2024-09-21T07:34:05.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.546 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148538 s, 70.6 MB/s 2024-09-21T07:34:05.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.562 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013245 s, 79.2 MB/s 2024-09-21T07:34:05.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.583 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178606 s, 58.7 MB/s 2024-09-21T07:34:05.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.8 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:05.590 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:05.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:05.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187369 s, 56.0 MB/s 2024-09-21T07:34:05.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135001 s, 77.7 MB/s 2024-09-21T07:34:05.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.699 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015555 s, 67.4 MB/s 2024-09-21T07:34:05.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148325 s, 70.7 MB/s 2024-09-21T07:34:05.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139452 s, 75.2 MB/s 2024-09-21T07:34:05.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132207 s, 79.3 MB/s 2024-09-21T07:34:05.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.766 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137214 s, 76.4 MB/s 2024-09-21T07:34:05.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142325 s, 73.7 MB/s 2024-09-21T07:34:05.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013852 s, 75.7 MB/s 2024-09-21T07:34:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136234 s, 77.0 MB/s 2024-09-21T07:34:05.833 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.833 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.833 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143316 s, 73.2 MB/s 2024-09-21T07:34:05.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184149 s, 56.9 MB/s 2024-09-21T07:34:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153116 s, 68.5 MB/s 2024-09-21T07:34:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013914 s, 75.4 MB/s 2024-09-21T07:34:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.904 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013196 s, 79.5 MB/s 2024-09-21T07:34:05.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.921 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133755 s, 78.4 MB/s 2024-09-21T07:34:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.936 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130392 s, 80.4 MB/s 2024-09-21T07:34:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154338 s, 67.9 MB/s 2024-09-21T07:34:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152081 s, 68.9 MB/s 2024-09-21T07:34:05.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:05.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:05.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130654 s, 80.3 MB/s 2024-09-21T07:34:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.004 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132512 s, 79.1 MB/s 2024-09-21T07:34:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156297 s, 67.1 MB/s 2024-09-21T07:34:06.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.044 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182649 s, 57.4 MB/s 2024-09-21T07:34:06.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137223 s, 76.4 MB/s 2024-09-21T07:34:06.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.076 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012879 s, 81.4 MB/s 2024-09-21T07:34:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187159 s, 56.0 MB/s 2024-09-21T07:34:06.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.118 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177614 s, 59.0 MB/s 2024-09-21T07:34:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.134 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138527 s, 75.7 MB/s 2024-09-21T07:34:06.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.154 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168381 s, 62.3 MB/s 2024-09-21T07:34:06.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163811 s, 64.0 MB/s 2024-09-21T07:34:06.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.189 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.189 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131374 s, 79.8 MB/s 2024-09-21T07:34:06.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137515 s, 76.3 MB/s 2024-09-21T07:34:06.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:06.212 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:06.212 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:06.213 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.9 2024-09-21T07:34:06.213 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:06.213 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:06.213 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:06.213 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:06.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:06.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134367 s, 78.0 MB/s 2024-09-21T07:34:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180659 s, 58.0 MB/s 2024-09-21T07:34:06.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120295 s, 87.2 MB/s 2024-09-21T07:34:06.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134989 s, 77.7 MB/s 2024-09-21T07:34:06.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.348 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.348 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131223 s, 79.9 MB/s 2024-09-21T07:34:06.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134357 s, 78.0 MB/s 2024-09-21T07:34:06.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154723 s, 67.8 MB/s 2024-09-21T07:34:06.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.402 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160469 s, 65.3 MB/s 2024-09-21T07:34:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013728 s, 76.4 MB/s 2024-09-21T07:34:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150974 s, 69.5 MB/s 2024-09-21T07:34:06.453 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.454 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.454 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146875 s, 71.4 MB/s 2024-09-21T07:34:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146482 s, 71.6 MB/s 2024-09-21T07:34:06.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.487 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139909 s, 74.9 MB/s 2024-09-21T07:34:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133709 s, 78.4 MB/s 2024-09-21T07:34:06.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.519 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135253 s, 77.5 MB/s 2024-09-21T07:34:06.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.537 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01512 s, 69.4 MB/s 2024-09-21T07:34:06.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.555 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151488 s, 69.2 MB/s 2024-09-21T07:34:06.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.573 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.573 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149653 s, 70.1 MB/s 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150753 s, 69.6 MB/s 2024-09-21T07:34:06.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.607 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134769 s, 77.8 MB/s 2024-09-21T07:34:06.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013916 s, 75.4 MB/s 2024-09-21T07:34:06.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.639 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013309 s, 78.8 MB/s 2024-09-21T07:34:06.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.656 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136201 s, 77.0 MB/s 2024-09-21T07:34:06.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.672 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134598 s, 77.9 MB/s 2024-09-21T07:34:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140987 s, 74.4 MB/s 2024-09-21T07:34:06.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.705 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138816 s, 75.5 MB/s 2024-09-21T07:34:06.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.721 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.721 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013165 s, 79.6 MB/s 2024-09-21T07:34:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.739 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152901 s, 68.6 MB/s 2024-09-21T07:34:06.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.755 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134462 s, 78.0 MB/s 2024-09-21T07:34:06.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.771 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.771 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127704 s, 82.1 MB/s 2024-09-21T07:34:06.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.788 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139837 s, 75.0 MB/s 2024-09-21T07:34:06.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134187 s, 78.1 MB/s 2024-09-21T07:34:06.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.10 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:06.811 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:06.812 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:06.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133527 s, 78.5 MB/s 2024-09-21T07:34:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131866 s, 79.5 MB/s 2024-09-21T07:34:06.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153369 s, 68.4 MB/s 2024-09-21T07:34:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134917 s, 77.7 MB/s 2024-09-21T07:34:06.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.947 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133682 s, 78.4 MB/s 2024-09-21T07:34:06.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132572 s, 79.1 MB/s 2024-09-21T07:34:06.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.979 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130119 s, 80.6 MB/s 2024-09-21T07:34:06.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:06.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:06.996 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147676 s, 71.0 MB/s 2024-09-21T07:34:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146942 s, 71.4 MB/s 2024-09-21T07:34:07.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013396 s, 78.3 MB/s 2024-09-21T07:34:07.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132707 s, 79.0 MB/s 2024-09-21T07:34:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013776 s, 76.1 MB/s 2024-09-21T07:34:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149197 s, 70.3 MB/s 2024-09-21T07:34:07.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135759 s, 77.2 MB/s 2024-09-21T07:34:07.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150607 s, 69.6 MB/s 2024-09-21T07:34:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014049 s, 74.6 MB/s 2024-09-21T07:34:07.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129518 s, 81.0 MB/s 2024-09-21T07:34:07.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.165 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151503 s, 69.2 MB/s 2024-09-21T07:34:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153265 s, 68.4 MB/s 2024-09-21T07:34:07.201 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.201 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.201 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152948 s, 68.6 MB/s 2024-09-21T07:34:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.222 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184898 s, 56.7 MB/s 2024-09-21T07:34:07.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.242 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.242 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165608 s, 63.3 MB/s 2024-09-21T07:34:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151116 s, 69.4 MB/s 2024-09-21T07:34:07.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182239 s, 57.5 MB/s 2024-09-21T07:34:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146332 s, 71.7 MB/s 2024-09-21T07:34:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152115 s, 68.9 MB/s 2024-09-21T07:34:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150892 s, 69.5 MB/s 2024-09-21T07:34:07.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.352 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151706 s, 69.1 MB/s 2024-09-21T07:34:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.369 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147686 s, 71.0 MB/s 2024-09-21T07:34:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.385 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141069 s, 74.3 MB/s 2024-09-21T07:34:07.403 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.403 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.403 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145417 s, 72.1 MB/s 2024-09-21T07:34:07.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120547 s, 87.0 MB/s 2024-09-21T07:34:07.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.11 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:07.425 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:07.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:07.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.589 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146569 s, 71.5 MB/s 2024-09-21T07:34:07.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.605 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136503 s, 76.8 MB/s 2024-09-21T07:34:07.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186695 s, 56.2 MB/s 2024-09-21T07:34:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158403 s, 66.2 MB/s 2024-09-21T07:34:07.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143643 s, 73.0 MB/s 2024-09-21T07:34:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152527 s, 68.7 MB/s 2024-09-21T07:34:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.698 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149071 s, 70.3 MB/s 2024-09-21T07:34:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146268 s, 71.7 MB/s 2024-09-21T07:34:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137758 s, 76.1 MB/s 2024-09-21T07:34:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.749 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145224 s, 72.2 MB/s 2024-09-21T07:34:07.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149815 s, 70.0 MB/s 2024-09-21T07:34:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.783 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140494 s, 74.6 MB/s 2024-09-21T07:34:07.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.801 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149577 s, 70.1 MB/s 2024-09-21T07:34:07.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187867 s, 55.8 MB/s 2024-09-21T07:34:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180999 s, 57.9 MB/s 2024-09-21T07:34:07.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.860 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.860 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137284 s, 76.4 MB/s 2024-09-21T07:34:07.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136084 s, 77.1 MB/s 2024-09-21T07:34:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153619 s, 68.3 MB/s 2024-09-21T07:34:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139074 s, 75.4 MB/s 2024-09-21T07:34:07.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151202 s, 69.3 MB/s 2024-09-21T07:34:07.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.950 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190056 s, 55.2 MB/s 2024-09-21T07:34:07.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.968 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153239 s, 68.4 MB/s 2024-09-21T07:34:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184645 s, 56.8 MB/s 2024-09-21T07:34:08.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185269 s, 56.6 MB/s 2024-09-21T07:34:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134711 s, 77.8 MB/s 2024-09-21T07:34:08.044 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015009 s, 69.9 MB/s 2024-09-21T07:34:08.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.060 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.060 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129937 s, 80.7 MB/s 2024-09-21T07:34:08.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.077 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.077 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136392 s, 76.9 MB/s 2024-09-21T07:34:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158295 s, 66.2 MB/s 2024-09-21T07:34:08.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.112 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137693 s, 76.2 MB/s 2024-09-21T07:34:08.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.130 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152506 s, 68.8 MB/s 2024-09-21T07:34:08.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148195 s, 70.8 MB/s 2024-09-21T07:34:08.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:08.154 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.12 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:08.155 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:08.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183326 s, 57.2 MB/s 2024-09-21T07:34:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141237 s, 74.2 MB/s 2024-09-21T07:34:08.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.266 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187468 s, 55.9 MB/s 2024-09-21T07:34:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147864 s, 70.9 MB/s 2024-09-21T07:34:08.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132104 s, 79.4 MB/s 2024-09-21T07:34:08.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133488 s, 78.6 MB/s 2024-09-21T07:34:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136696 s, 76.7 MB/s 2024-09-21T07:34:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.347 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127706 s, 82.1 MB/s 2024-09-21T07:34:08.363 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.364 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.364 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133917 s, 78.3 MB/s 2024-09-21T07:34:08.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.381 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143518 s, 73.1 MB/s 2024-09-21T07:34:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.397 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142759 s, 73.5 MB/s 2024-09-21T07:34:08.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151047 s, 69.4 MB/s 2024-09-21T07:34:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184071 s, 57.0 MB/s 2024-09-21T07:34:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133448 s, 78.6 MB/s 2024-09-21T07:34:08.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.467 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119671 s, 87.6 MB/s 2024-09-21T07:34:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136179 s, 77.0 MB/s 2024-09-21T07:34:08.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.503 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175104 s, 59.9 MB/s 2024-09-21T07:34:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174257 s, 60.2 MB/s 2024-09-21T07:34:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183254 s, 57.2 MB/s 2024-09-21T07:34:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153786 s, 68.2 MB/s 2024-09-21T07:34:08.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190213 s, 55.1 MB/s 2024-09-21T07:34:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135257 s, 77.5 MB/s 2024-09-21T07:34:08.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.616 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137601 s, 76.2 MB/s 2024-09-21T07:34:08.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137208 s, 76.4 MB/s 2024-09-21T07:34:08.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131432 s, 79.8 MB/s 2024-09-21T07:34:08.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.666 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130475 s, 80.4 MB/s 2024-09-21T07:34:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140021 s, 74.9 MB/s 2024-09-21T07:34:08.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.706 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.706 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019396 s, 54.1 MB/s 2024-09-21T07:34:08.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.723 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136406 s, 76.9 MB/s 2024-09-21T07:34:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139588 s, 75.1 MB/s 2024-09-21T07:34:08.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191871 s, 54.7 MB/s 2024-09-21T07:34:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148185 s, 70.8 MB/s 2024-09-21T07:34:08.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:08.786 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.13 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:08.787 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:08.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:08.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183984 s, 57.0 MB/s 2024-09-21T07:34:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153359 s, 68.4 MB/s 2024-09-21T07:34:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183687 s, 57.1 MB/s 2024-09-21T07:34:08.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.920 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166172 s, 63.1 MB/s 2024-09-21T07:34:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138141 s, 75.9 MB/s 2024-09-21T07:34:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.953 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126969 s, 82.6 MB/s 2024-09-21T07:34:08.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015373 s, 68.2 MB/s 2024-09-21T07:34:08.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:08.988 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:08.988 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144782 s, 72.4 MB/s 2024-09-21T07:34:09.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.006 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150778 s, 69.5 MB/s 2024-09-21T07:34:09.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.023 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.023 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146735 s, 71.5 MB/s 2024-09-21T07:34:09.039 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146001 s, 71.8 MB/s 2024-09-21T07:34:09.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.058 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154286 s, 68.0 MB/s 2024-09-21T07:34:09.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.076 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152013 s, 69.0 MB/s 2024-09-21T07:34:09.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.092 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.092 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133426 s, 78.6 MB/s 2024-09-21T07:34:09.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143489 s, 73.1 MB/s 2024-09-21T07:34:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136458 s, 76.8 MB/s 2024-09-21T07:34:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012146 s, 86.3 MB/s 2024-09-21T07:34:09.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.157 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014049 s, 74.6 MB/s 2024-09-21T07:34:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.175 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.175 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148204 s, 70.8 MB/s 2024-09-21T07:34:09.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013548 s, 77.4 MB/s 2024-09-21T07:34:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188707 s, 55.6 MB/s 2024-09-21T07:34:09.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.231 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157304 s, 66.7 MB/s 2024-09-21T07:34:09.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018426 s, 56.9 MB/s 2024-09-21T07:34:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150053 s, 69.9 MB/s 2024-09-21T07:34:09.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.286 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130652 s, 80.3 MB/s 2024-09-21T07:34:09.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131091 s, 80.0 MB/s 2024-09-21T07:34:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135895 s, 77.2 MB/s 2024-09-21T07:34:09.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144241 s, 72.7 MB/s 2024-09-21T07:34:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183823 s, 57.0 MB/s 2024-09-21T07:34:09.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144003 s, 72.8 MB/s 2024-09-21T07:34:09.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152042 s, 69.0 MB/s 2024-09-21T07:34:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183622 s, 57.1 MB/s 2024-09-21T07:34:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:09.419 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:09.419 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:09.419 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.14 2024-09-21T07:34:09.419 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:09.419 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:09.420 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:09.420 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:09.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:09.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.506 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.506 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154443 s, 67.9 MB/s 2024-09-21T07:34:09.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142328 s, 73.7 MB/s 2024-09-21T07:34:09.539 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143189 s, 73.2 MB/s 2024-09-21T07:34:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163519 s, 64.1 MB/s 2024-09-21T07:34:09.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158369 s, 66.2 MB/s 2024-09-21T07:34:09.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.595 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149127 s, 70.3 MB/s 2024-09-21T07:34:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167094 s, 62.8 MB/s 2024-09-21T07:34:09.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.630 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.631 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137699 s, 76.2 MB/s 2024-09-21T07:34:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140073 s, 74.9 MB/s 2024-09-21T07:34:09.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138099 s, 75.9 MB/s 2024-09-21T07:34:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149034 s, 70.4 MB/s 2024-09-21T07:34:09.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157919 s, 66.4 MB/s 2024-09-21T07:34:09.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.716 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138299 s, 75.8 MB/s 2024-09-21T07:34:09.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.732 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134425 s, 78.0 MB/s 2024-09-21T07:34:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176905 s, 59.3 MB/s 2024-09-21T07:34:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133021 s, 78.8 MB/s 2024-09-21T07:34:09.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.785 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135917 s, 77.1 MB/s 2024-09-21T07:34:09.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.805 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.805 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169302 s, 61.9 MB/s 2024-09-21T07:34:09.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144514 s, 72.6 MB/s 2024-09-21T07:34:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013389 s, 78.3 MB/s 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135614 s, 77.3 MB/s 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134699 s, 77.8 MB/s 2024-09-21T07:34:09.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166411 s, 63.0 MB/s 2024-09-21T07:34:09.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.906 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137362 s, 76.3 MB/s 2024-09-21T07:34:09.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133147 s, 78.8 MB/s 2024-09-21T07:34:09.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152607 s, 68.7 MB/s 2024-09-21T07:34:09.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.957 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138784 s, 75.6 MB/s 2024-09-21T07:34:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.974 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151028 s, 69.4 MB/s 2024-09-21T07:34:09.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:09.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:09.990 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131166 s, 79.9 MB/s 2024-09-21T07:34:10.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149048 s, 70.4 MB/s 2024-09-21T07:34:10.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.026 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148528 s, 70.6 MB/s 2024-09-21T07:34:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180627 s, 58.1 MB/s 2024-09-21T07:34:10.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:10.053 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.15 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:10.054 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:10.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158473 s, 66.2 MB/s 2024-09-21T07:34:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012641 s, 83.0 MB/s 2024-09-21T07:34:10.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.157 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138178 s, 75.9 MB/s 2024-09-21T07:34:10.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.179 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01884 s, 55.7 MB/s 2024-09-21T07:34:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181514 s, 57.8 MB/s 2024-09-21T07:34:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148931 s, 70.4 MB/s 2024-09-21T07:34:10.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.234 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141024 s, 74.4 MB/s 2024-09-21T07:34:10.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.251 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141735 s, 74.0 MB/s 2024-09-21T07:34:10.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146384 s, 71.6 MB/s 2024-09-21T07:34:10.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.284 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131954 s, 79.5 MB/s 2024-09-21T07:34:10.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014114 s, 74.3 MB/s 2024-09-21T07:34:10.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146106 s, 71.8 MB/s 2024-09-21T07:34:10.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013357 s, 78.5 MB/s 2024-09-21T07:34:10.342 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:10.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:10.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.355 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186116 s, 56.3 MB/s 2024-09-21T07:34:10.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.372 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146263 s, 71.7 MB/s 2024-09-21T07:34:10.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139238 s, 75.3 MB/s 2024-09-21T07:34:10.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.404 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.404 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130234 s, 80.5 MB/s 2024-09-21T07:34:10.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016586 s, 63.2 MB/s 2024-09-21T07:34:10.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.441 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.441 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140206 s, 74.8 MB/s 2024-09-21T07:34:10.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013927 s, 75.3 MB/s 2024-09-21T07:34:10.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.474 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143454 s, 73.1 MB/s 2024-09-21T07:34:10.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152693 s, 68.7 MB/s 2024-09-21T07:34:10.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170196 s, 61.6 MB/s 2024-09-21T07:34:10.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.529 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144845 s, 72.4 MB/s 2024-09-21T07:34:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.545 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137282 s, 76.4 MB/s 2024-09-21T07:34:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151748 s, 69.1 MB/s 2024-09-21T07:34:10.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.581 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.581 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149455 s, 70.2 MB/s 2024-09-21T07:34:10.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.598 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142413 s, 73.6 MB/s 2024-09-21T07:34:10.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148158 s, 70.8 MB/s 2024-09-21T07:34:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.634 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150035 s, 69.9 MB/s 2024-09-21T07:34:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144981 s, 72.3 MB/s 2024-09-21T07:34:10.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.666 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.666 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139797 s, 75.0 MB/s 2024-09-21T07:34:10.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.16 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:10.674 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:10.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:10.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162782 s, 64.4 MB/s 2024-09-21T07:34:10.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125647 s, 83.5 MB/s 2024-09-21T07:34:10.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130414 s, 80.4 MB/s 2024-09-21T07:34:10.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014047 s, 74.6 MB/s 2024-09-21T07:34:10.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01902 s, 55.1 MB/s 2024-09-21T07:34:10.874 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.874 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.874 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135426 s, 77.4 MB/s 2024-09-21T07:34:10.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.891 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133277 s, 78.7 MB/s 2024-09-21T07:34:10.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177206 s, 59.2 MB/s 2024-09-21T07:34:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151902 s, 69.0 MB/s 2024-09-21T07:34:10.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150892 s, 69.5 MB/s 2024-09-21T07:34:10.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.970 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.970 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187532 s, 55.9 MB/s 2024-09-21T07:34:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:10.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017924 s, 58.5 MB/s 2024-09-21T07:34:11.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142971 s, 73.3 MB/s 2024-09-21T07:34:11.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.025 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.025 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136744 s, 76.7 MB/s 2024-09-21T07:34:11.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.042 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.042 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137683 s, 76.2 MB/s 2024-09-21T07:34:11.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185918 s, 56.4 MB/s 2024-09-21T07:34:11.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172159 s, 60.9 MB/s 2024-09-21T07:34:11.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.102 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153405 s, 68.4 MB/s 2024-09-21T07:34:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136566 s, 76.8 MB/s 2024-09-21T07:34:11.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.138 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152851 s, 68.6 MB/s 2024-09-21T07:34:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146861 s, 71.4 MB/s 2024-09-21T07:34:11.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154174 s, 68.0 MB/s 2024-09-21T07:34:11.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131549 s, 79.7 MB/s 2024-09-21T07:34:11.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.208 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.208 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143415 s, 73.1 MB/s 2024-09-21T07:34:11.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.231 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01909 s, 54.9 MB/s 2024-09-21T07:34:11.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179554 s, 58.4 MB/s 2024-09-21T07:34:11.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013278 s, 79.0 MB/s 2024-09-21T07:34:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135323 s, 77.5 MB/s 2024-09-21T07:34:11.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130447 s, 80.4 MB/s 2024-09-21T07:34:11.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129965 s, 80.7 MB/s 2024-09-21T07:34:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018707 s, 56.1 MB/s 2024-09-21T07:34:11.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013139 s, 79.8 MB/s 2024-09-21T07:34:11.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:11.363 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.17 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:11.364 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153224 s, 68.4 MB/s 2024-09-21T07:34:11.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.458 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187513 s, 55.9 MB/s 2024-09-21T07:34:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129331 s, 81.1 MB/s 2024-09-21T07:34:11.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151721 s, 69.1 MB/s 2024-09-21T07:34:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134283 s, 78.1 MB/s 2024-09-21T07:34:11.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179884 s, 58.3 MB/s 2024-09-21T07:34:11.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.546 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147916 s, 70.9 MB/s 2024-09-21T07:34:11.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.567 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183156 s, 57.3 MB/s 2024-09-21T07:34:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150339 s, 69.7 MB/s 2024-09-21T07:34:11.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144329 s, 72.7 MB/s 2024-09-21T07:34:11.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192792 s, 54.4 MB/s 2024-09-21T07:34:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192835 s, 54.4 MB/s 2024-09-21T07:34:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139342 s, 75.3 MB/s 2024-09-21T07:34:11.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.678 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131323 s, 79.8 MB/s 2024-09-21T07:34:11.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.700 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018752 s, 55.9 MB/s 2024-09-21T07:34:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141757 s, 74.0 MB/s 2024-09-21T07:34:11.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150379 s, 69.7 MB/s 2024-09-21T07:34:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014851 s, 70.6 MB/s 2024-09-21T07:34:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130261 s, 80.5 MB/s 2024-09-21T07:34:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156125 s, 67.2 MB/s 2024-09-21T07:34:11.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146201 s, 71.7 MB/s 2024-09-21T07:34:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179832 s, 58.3 MB/s 2024-09-21T07:34:11.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014641 s, 71.6 MB/s 2024-09-21T07:34:11.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.857 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134783 s, 77.8 MB/s 2024-09-21T07:34:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151459 s, 69.2 MB/s 2024-09-21T07:34:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015068 s, 69.6 MB/s 2024-09-21T07:34:11.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151427 s, 69.2 MB/s 2024-09-21T07:34:11.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181253 s, 57.9 MB/s 2024-09-21T07:34:11.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137794 s, 76.1 MB/s 2024-09-21T07:34:11.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.964 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131774 s, 79.6 MB/s 2024-09-21T07:34:11.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:11.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:11.985 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186054 s, 56.4 MB/s 2024-09-21T07:34:12.001 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.001 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.001 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135475 s, 77.4 MB/s 2024-09-21T07:34:12.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:12.008 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.18 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:12.009 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:12.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:12.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.126 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.126 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018961 s, 55.3 MB/s 2024-09-21T07:34:12.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.144 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150925 s, 69.5 MB/s 2024-09-21T07:34:12.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174407 s, 60.1 MB/s 2024-09-21T07:34:12.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.187 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195143 s, 53.7 MB/s 2024-09-21T07:34:12.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.204 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146042 s, 71.8 MB/s 2024-09-21T07:34:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.221 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142864 s, 73.4 MB/s 2024-09-21T07:34:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014976 s, 70.0 MB/s 2024-09-21T07:34:12.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.256 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148353 s, 70.7 MB/s 2024-09-21T07:34:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141381 s, 74.2 MB/s 2024-09-21T07:34:12.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.293 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176845 s, 59.3 MB/s 2024-09-21T07:34:12.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.309 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.309 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129911 s, 80.7 MB/s 2024-09-21T07:34:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141122 s, 74.3 MB/s 2024-09-21T07:34:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152495 s, 68.8 MB/s 2024-09-21T07:34:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186593 s, 56.2 MB/s 2024-09-21T07:34:12.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.381 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136992 s, 76.5 MB/s 2024-09-21T07:34:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150843 s, 69.5 MB/s 2024-09-21T07:34:12.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014975 s, 70.0 MB/s 2024-09-21T07:34:12.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.433 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131207 s, 79.9 MB/s 2024-09-21T07:34:12.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.449 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138571 s, 75.7 MB/s 2024-09-21T07:34:12.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.466 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138924 s, 75.5 MB/s 2024-09-21T07:34:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193987 s, 54.1 MB/s 2024-09-21T07:34:12.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.507 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149239 s, 70.3 MB/s 2024-09-21T07:34:12.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.529 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019447 s, 53.9 MB/s 2024-09-21T07:34:12.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.547 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152629 s, 68.7 MB/s 2024-09-21T07:34:12.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.564 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.564 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141605 s, 74.0 MB/s 2024-09-21T07:34:12.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.580 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.580 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131401 s, 79.8 MB/s 2024-09-21T07:34:12.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.599 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.599 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016057 s, 65.3 MB/s 2024-09-21T07:34:12.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136254 s, 77.0 MB/s 2024-09-21T07:34:12.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016424 s, 63.8 MB/s 2024-09-21T07:34:12.655 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.655 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.655 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173196 s, 60.5 MB/s 2024-09-21T07:34:12.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133525 s, 78.5 MB/s 2024-09-21T07:34:12.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.687 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132465 s, 79.2 MB/s 2024-09-21T07:34:12.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:12.694 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:12.694 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:12.695 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.19 2024-09-21T07:34:12.695 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:12.695 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:12.695 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:12.695 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:12.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.764 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134842 s, 77.8 MB/s 2024-09-21T07:34:12.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.782 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151901 s, 69.0 MB/s 2024-09-21T07:34:12.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157047 s, 66.8 MB/s 2024-09-21T07:34:12.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138481 s, 75.7 MB/s 2024-09-21T07:34:12.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150523 s, 69.7 MB/s 2024-09-21T07:34:12.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143743 s, 72.9 MB/s 2024-09-21T07:34:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.871 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147745 s, 71.0 MB/s 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144534 s, 72.5 MB/s 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148949 s, 70.4 MB/s 2024-09-21T07:34:12.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.920 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.921 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127066 s, 82.5 MB/s 2024-09-21T07:34:12.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.937 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.937 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013582 s, 77.2 MB/s 2024-09-21T07:34:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155967 s, 67.2 MB/s 2024-09-21T07:34:12.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.972 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136467 s, 76.8 MB/s 2024-09-21T07:34:12.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:12.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:12.989 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146648 s, 71.5 MB/s 2024-09-21T07:34:13.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.006 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.006 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145151 s, 72.2 MB/s 2024-09-21T07:34:13.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.022 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136571 s, 76.8 MB/s 2024-09-21T07:34:13.039 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150032 s, 69.9 MB/s 2024-09-21T07:34:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152598 s, 68.7 MB/s 2024-09-21T07:34:13.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132996 s, 78.8 MB/s 2024-09-21T07:34:13.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.090 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141045 s, 74.3 MB/s 2024-09-21T07:34:13.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120771 s, 86.8 MB/s 2024-09-21T07:34:13.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.122 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150848 s, 69.5 MB/s 2024-09-21T07:34:13.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171796 s, 61.0 MB/s 2024-09-21T07:34:13.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.160 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149974 s, 69.9 MB/s 2024-09-21T07:34:13.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139479 s, 75.2 MB/s 2024-09-21T07:34:13.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131082 s, 80.0 MB/s 2024-09-21T07:34:13.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149186 s, 70.3 MB/s 2024-09-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134523 s, 77.9 MB/s 2024-09-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183426 s, 57.2 MB/s 2024-09-21T07:34:13.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.263 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.263 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137813 s, 76.1 MB/s 2024-09-21T07:34:13.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129986 s, 80.7 MB/s 2024-09-21T07:34:13.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151973 s, 69.0 MB/s 2024-09-21T07:34:13.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:13.304 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:13.304 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:13.304 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.20 2024-09-21T07:34:13.304 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:13.305 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:13.305 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:13.305 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:13.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:13.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.376 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153423 s, 68.3 MB/s 2024-09-21T07:34:13.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165092 s, 63.5 MB/s 2024-09-21T07:34:13.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176753 s, 59.3 MB/s 2024-09-21T07:34:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148891 s, 70.4 MB/s 2024-09-21T07:34:13.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.450 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158757 s, 66.0 MB/s 2024-09-21T07:34:13.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.468 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.468 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144565 s, 72.5 MB/s 2024-09-21T07:34:13.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.484 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135978 s, 77.1 MB/s 2024-09-21T07:34:13.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.502 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142546 s, 73.6 MB/s 2024-09-21T07:34:13.519 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.520 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151836 s, 69.1 MB/s 2024-09-21T07:34:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135565 s, 77.3 MB/s 2024-09-21T07:34:13.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.552 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.552 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132257 s, 79.3 MB/s 2024-09-21T07:34:13.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.570 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.570 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148462 s, 70.6 MB/s 2024-09-21T07:34:13.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.591 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186652 s, 56.2 MB/s 2024-09-21T07:34:13.609 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.609 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151797 s, 69.1 MB/s 2024-09-21T07:34:13.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148526 s, 70.6 MB/s 2024-09-21T07:34:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183563 s, 57.1 MB/s 2024-09-21T07:34:13.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149573 s, 70.1 MB/s 2024-09-21T07:34:13.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013398 s, 78.3 MB/s 2024-09-21T07:34:13.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179675 s, 58.4 MB/s 2024-09-21T07:34:13.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.720 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.720 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152563 s, 68.7 MB/s 2024-09-21T07:34:13.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.736 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134442 s, 78.0 MB/s 2024-09-21T07:34:13.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188574 s, 55.6 MB/s 2024-09-21T07:34:13.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.776 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.776 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158097 s, 66.3 MB/s 2024-09-21T07:34:13.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.793 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134404 s, 78.0 MB/s 2024-09-21T07:34:13.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.809 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140542 s, 74.6 MB/s 2024-09-21T07:34:13.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138548 s, 75.7 MB/s 2024-09-21T07:34:13.842 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.843 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.843 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141949 s, 73.9 MB/s 2024-09-21T07:34:13.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.859 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136275 s, 76.9 MB/s 2024-09-21T07:34:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.875 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138946 s, 75.5 MB/s 2024-09-21T07:34:13.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139267 s, 75.3 MB/s 2024-09-21T07:34:13.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153587 s, 68.3 MB/s 2024-09-21T07:34:13.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:13.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:13.927 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146701 s, 71.5 MB/s 2024-09-21T07:34:13.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.21 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:13.935 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140635 s, 74.6 MB/s 2024-09-21T07:34:14.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.066 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.066 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152321 s, 68.8 MB/s 2024-09-21T07:34:14.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134248 s, 78.1 MB/s 2024-09-21T07:34:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148927 s, 70.4 MB/s 2024-09-21T07:34:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152641 s, 68.7 MB/s 2024-09-21T07:34:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141085 s, 74.3 MB/s 2024-09-21T07:34:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135719 s, 77.3 MB/s 2024-09-21T07:34:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142728 s, 73.5 MB/s 2024-09-21T07:34:14.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.185 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138695 s, 75.6 MB/s 2024-09-21T07:34:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132175 s, 79.3 MB/s 2024-09-21T07:34:14.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.217 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.217 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138629 s, 75.6 MB/s 2024-09-21T07:34:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133768 s, 78.4 MB/s 2024-09-21T07:34:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130589 s, 80.3 MB/s 2024-09-21T07:34:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135858 s, 77.2 MB/s 2024-09-21T07:34:14.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.281 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132805 s, 79.0 MB/s 2024-09-21T07:34:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136423 s, 76.9 MB/s 2024-09-21T07:34:14.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.315 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.315 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150934 s, 69.5 MB/s 2024-09-21T07:34:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149297 s, 70.2 MB/s 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134706 s, 77.8 MB/s 2024-09-21T07:34:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192024 s, 54.6 MB/s 2024-09-21T07:34:14.388 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.388 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.388 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145219 s, 72.2 MB/s 2024-09-21T07:34:14.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152741 s, 68.7 MB/s 2024-09-21T07:34:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.422 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136485 s, 76.8 MB/s 2024-09-21T07:34:14.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185581 s, 56.5 MB/s 2024-09-21T07:34:14.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.464 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172968 s, 60.6 MB/s 2024-09-21T07:34:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150458 s, 69.7 MB/s 2024-09-21T07:34:14.498 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136747 s, 76.7 MB/s 2024-09-21T07:34:14.516 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.516 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.516 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144034 s, 72.8 MB/s 2024-09-21T07:34:14.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.537 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.537 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177225 s, 59.2 MB/s 2024-09-21T07:34:14.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.558 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175096 s, 59.9 MB/s 2024-09-21T07:34:14.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.576 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.576 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015268 s, 68.7 MB/s 2024-09-21T07:34:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141612 s, 74.0 MB/s 2024-09-21T07:34:14.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.22 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:14.601 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:14.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150704 s, 69.6 MB/s 2024-09-21T07:34:14.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137395 s, 76.3 MB/s 2024-09-21T07:34:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132325 s, 79.2 MB/s 2024-09-21T07:34:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137663 s, 76.2 MB/s 2024-09-21T07:34:14.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.739 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135044 s, 77.6 MB/s 2024-09-21T07:34:14.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.756 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135248 s, 77.5 MB/s 2024-09-21T07:34:14.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.773 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.773 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138885 s, 75.5 MB/s 2024-09-21T07:34:14.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.792 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.793 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161967 s, 64.7 MB/s 2024-09-21T07:34:14.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.813 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178299 s, 58.8 MB/s 2024-09-21T07:34:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.829 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129462 s, 81.0 MB/s 2024-09-21T07:34:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.850 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185769 s, 56.4 MB/s 2024-09-21T07:34:14.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.866 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.866 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130741 s, 80.2 MB/s 2024-09-21T07:34:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126888 s, 82.6 MB/s 2024-09-21T07:34:14.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.898 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.898 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135406 s, 77.4 MB/s 2024-09-21T07:34:14.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134284 s, 78.1 MB/s 2024-09-21T07:34:14.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014965 s, 70.1 MB/s 2024-09-21T07:34:14.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.949 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.949 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151429 s, 69.2 MB/s 2024-09-21T07:34:14.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.968 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162559 s, 64.5 MB/s 2024-09-21T07:34:14.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:14.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:14.984 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133164 s, 78.7 MB/s 2024-09-21T07:34:15.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.002 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151564 s, 69.2 MB/s 2024-09-21T07:34:15.017 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.017 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.017 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126247 s, 83.1 MB/s 2024-09-21T07:34:15.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131443 s, 79.8 MB/s 2024-09-21T07:34:15.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.054 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183268 s, 57.2 MB/s 2024-09-21T07:34:15.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.072 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150394 s, 69.7 MB/s 2024-09-21T07:34:15.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.093 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.093 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186506 s, 56.2 MB/s 2024-09-21T07:34:15.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176517 s, 59.4 MB/s 2024-09-21T07:34:15.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134115 s, 78.2 MB/s 2024-09-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187006 s, 56.1 MB/s 2024-09-21T07:34:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186674 s, 56.2 MB/s 2024-09-21T07:34:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132578 s, 79.1 MB/s 2024-09-21T07:34:15.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192199 s, 54.6 MB/s 2024-09-21T07:34:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013344 s, 78.6 MB/s 2024-09-21T07:34:15.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:15.233 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:15.233 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:15.233 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.23 2024-09-21T07:34:15.233 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:15.233 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:15.234 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:15.234 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:15.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:15.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174687 s, 60.0 MB/s 2024-09-21T07:34:15.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139393 s, 75.2 MB/s 2024-09-21T07:34:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133931 s, 78.3 MB/s 2024-09-21T07:34:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144933 s, 72.3 MB/s 2024-09-21T07:34:15.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.374 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139846 s, 75.0 MB/s 2024-09-21T07:34:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013343 s, 78.6 MB/s 2024-09-21T07:34:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153221 s, 68.4 MB/s 2024-09-21T07:34:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135799 s, 77.2 MB/s 2024-09-21T07:34:15.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184885 s, 56.7 MB/s 2024-09-21T07:34:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131556 s, 79.7 MB/s 2024-09-21T07:34:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.478 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127998 s, 81.9 MB/s 2024-09-21T07:34:15.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134414 s, 78.0 MB/s 2024-09-21T07:34:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141245 s, 74.2 MB/s 2024-09-21T07:34:15.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.527 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.527 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132312 s, 79.3 MB/s 2024-09-21T07:34:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133287 s, 78.7 MB/s 2024-09-21T07:34:15.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.565 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.565 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018914 s, 55.4 MB/s 2024-09-21T07:34:15.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.582 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.582 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145807 s, 71.9 MB/s 2024-09-21T07:34:15.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.600 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149518 s, 70.1 MB/s 2024-09-21T07:34:15.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141959 s, 73.9 MB/s 2024-09-21T07:34:15.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.635 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155397 s, 67.5 MB/s 2024-09-21T07:34:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.653 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154127 s, 68.0 MB/s 2024-09-21T07:34:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131005 s, 80.0 MB/s 2024-09-21T07:34:15.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133635 s, 78.5 MB/s 2024-09-21T07:34:15.700 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127931 s, 82.0 MB/s 2024-09-21T07:34:15.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144094 s, 72.8 MB/s 2024-09-21T07:34:15.737 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.738 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.738 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171481 s, 61.1 MB/s 2024-09-21T07:34:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.755 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143106 s, 73.3 MB/s 2024-09-21T07:34:15.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.770 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129812 s, 80.8 MB/s 2024-09-21T07:34:15.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136764 s, 76.7 MB/s 2024-09-21T07:34:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.809 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189622 s, 55.3 MB/s 2024-09-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152516 s, 68.8 MB/s 2024-09-21T07:34:15.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150795 s, 69.5 MB/s 2024-09-21T07:34:15.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.24 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:15.852 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:15.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170764 s, 61.4 MB/s 2024-09-21T07:34:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149062 s, 70.3 MB/s 2024-09-21T07:34:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.958 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.959 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141375 s, 74.2 MB/s 2024-09-21T07:34:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.976 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147134 s, 71.3 MB/s 2024-09-21T07:34:15.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:15.992 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:15.992 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013238 s, 79.2 MB/s 2024-09-21T07:34:16.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.008 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.008 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137476 s, 76.3 MB/s 2024-09-21T07:34:16.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.024 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.024 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127922 s, 82.0 MB/s 2024-09-21T07:34:16.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.041 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.041 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141733 s, 74.0 MB/s 2024-09-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156464 s, 67.0 MB/s 2024-09-21T07:34:16.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.078 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157466 s, 66.6 MB/s 2024-09-21T07:34:16.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.094 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.094 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130515 s, 80.3 MB/s 2024-09-21T07:34:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143846 s, 72.9 MB/s 2024-09-21T07:34:16.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152661 s, 68.7 MB/s 2024-09-21T07:34:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153592 s, 68.3 MB/s 2024-09-21T07:34:16.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.163 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.163 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132548 s, 79.1 MB/s 2024-09-21T07:34:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.179 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131971 s, 79.5 MB/s 2024-09-21T07:34:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130436 s, 80.4 MB/s 2024-09-21T07:34:16.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153946 s, 68.1 MB/s 2024-09-21T07:34:16.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165499 s, 63.4 MB/s 2024-09-21T07:34:16.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136953 s, 76.6 MB/s 2024-09-21T07:34:16.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153329 s, 68.4 MB/s 2024-09-21T07:34:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137336 s, 76.4 MB/s 2024-09-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149194 s, 70.3 MB/s 2024-09-21T07:34:16.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130958 s, 80.1 MB/s 2024-09-21T07:34:16.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131921 s, 79.5 MB/s 2024-09-21T07:34:16.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154364 s, 67.9 MB/s 2024-09-21T07:34:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.367 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131043 s, 80.0 MB/s 2024-09-21T07:34:16.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013343 s, 78.6 MB/s 2024-09-21T07:34:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138235 s, 75.9 MB/s 2024-09-21T07:34:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.418 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149525 s, 70.1 MB/s 2024-09-21T07:34:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.433 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134136 s, 78.2 MB/s 2024-09-21T07:34:16.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.449 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012986 s, 80.7 MB/s 2024-09-21T07:34:16.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:16.456 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.25 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:16.457 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:16.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126884 s, 82.6 MB/s 2024-09-21T07:34:16.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131472 s, 79.8 MB/s 2024-09-21T07:34:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148674 s, 70.5 MB/s 2024-09-21T07:34:16.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148789 s, 70.5 MB/s 2024-09-21T07:34:16.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.594 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.594 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140672 s, 74.5 MB/s 2024-09-21T07:34:16.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185558 s, 56.5 MB/s 2024-09-21T07:34:16.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147055 s, 71.3 MB/s 2024-09-21T07:34:16.649 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.650 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149928 s, 69.9 MB/s 2024-09-21T07:34:16.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.667 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150542 s, 69.7 MB/s 2024-09-21T07:34:16.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.687 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.688 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017132 s, 61.2 MB/s 2024-09-21T07:34:16.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.705 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151446 s, 69.2 MB/s 2024-09-21T07:34:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.722 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138905 s, 75.5 MB/s 2024-09-21T07:34:16.739 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148166 s, 70.8 MB/s 2024-09-21T07:34:16.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.756 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.756 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139349 s, 75.2 MB/s 2024-09-21T07:34:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013406 s, 78.2 MB/s 2024-09-21T07:34:16.788 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.789 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.789 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134133 s, 78.2 MB/s 2024-09-21T07:34:16.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.806 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.806 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014879 s, 70.5 MB/s 2024-09-21T07:34:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.822 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.822 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125445 s, 83.6 MB/s 2024-09-21T07:34:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131818 s, 79.5 MB/s 2024-09-21T07:34:16.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.859 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190322 s, 55.1 MB/s 2024-09-21T07:34:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155746 s, 67.3 MB/s 2024-09-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178663 s, 58.7 MB/s 2024-09-21T07:34:16.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134001 s, 78.3 MB/s 2024-09-21T07:34:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141612 s, 74.0 MB/s 2024-09-21T07:34:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.947 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142505 s, 73.6 MB/s 2024-09-21T07:34:16.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.968 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184025 s, 57.0 MB/s 2024-09-21T07:34:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:16.984 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131701 s, 79.6 MB/s 2024-09-21T07:34:17.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.002 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.002 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155155 s, 67.6 MB/s 2024-09-21T07:34:17.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014261 s, 73.5 MB/s 2024-09-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149696 s, 70.0 MB/s 2024-09-21T07:34:17.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.055 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015366 s, 68.2 MB/s 2024-09-21T07:34:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130395 s, 80.4 MB/s 2024-09-21T07:34:17.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.26 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:17.078 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:17.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:17.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153444 s, 68.3 MB/s 2024-09-21T07:34:17.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152249 s, 68.9 MB/s 2024-09-21T07:34:17.183 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142187 s, 73.7 MB/s 2024-09-21T07:34:17.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.200 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.200 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141685 s, 74.0 MB/s 2024-09-21T07:34:17.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.216 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132481 s, 79.1 MB/s 2024-09-21T07:34:17.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141316 s, 74.2 MB/s 2024-09-21T07:34:17.250 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.251 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.251 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151886 s, 69.0 MB/s 2024-09-21T07:34:17.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136628 s, 76.7 MB/s 2024-09-21T07:34:17.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132845 s, 78.9 MB/s 2024-09-21T07:34:17.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150211 s, 69.8 MB/s 2024-09-21T07:34:17.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137925 s, 76.0 MB/s 2024-09-21T07:34:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014386 s, 72.9 MB/s 2024-09-21T07:34:17.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.355 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018305 s, 57.3 MB/s 2024-09-21T07:34:17.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.372 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.372 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137633 s, 76.2 MB/s 2024-09-21T07:34:17.386 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.387 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.387 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121074 s, 86.6 MB/s 2024-09-21T07:34:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135751 s, 77.2 MB/s 2024-09-21T07:34:17.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.418 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113528 s, 92.4 MB/s 2024-09-21T07:34:17.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152408 s, 68.8 MB/s 2024-09-21T07:34:17.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.452 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138409 s, 75.8 MB/s 2024-09-21T07:34:17.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146213 s, 71.7 MB/s 2024-09-21T07:34:17.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.486 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.486 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142465 s, 73.6 MB/s 2024-09-21T07:34:17.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186551 s, 56.2 MB/s 2024-09-21T07:34:17.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223157 s, 47.0 MB/s 2024-09-21T07:34:17.553 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164589 s, 63.7 MB/s 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146874 s, 71.4 MB/s 2024-09-21T07:34:17.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.589 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145979 s, 71.8 MB/s 2024-09-21T07:34:17.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.606 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135504 s, 77.4 MB/s 2024-09-21T07:34:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.622 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132985 s, 78.8 MB/s 2024-09-21T07:34:17.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.640 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159892 s, 65.6 MB/s 2024-09-21T07:34:17.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144973 s, 72.3 MB/s 2024-09-21T07:34:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.675 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142703 s, 73.5 MB/s 2024-09-21T07:34:17.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134046 s, 78.2 MB/s 2024-09-21T07:34:17.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:17.698 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.27 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:17.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139794 s, 75.0 MB/s 2024-09-21T07:34:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133638 s, 78.5 MB/s 2024-09-21T07:34:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136365 s, 76.9 MB/s 2024-09-21T07:34:17.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.825 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193992 s, 54.1 MB/s 2024-09-21T07:34:17.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013964 s, 75.1 MB/s 2024-09-21T07:34:17.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142727 s, 73.5 MB/s 2024-09-21T07:34:17.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.879 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186966 s, 56.1 MB/s 2024-09-21T07:34:17.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149283 s, 70.2 MB/s 2024-09-21T07:34:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125254 s, 83.7 MB/s 2024-09-21T07:34:17.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134207 s, 78.1 MB/s 2024-09-21T07:34:17.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150059 s, 69.9 MB/s 2024-09-21T07:34:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137472 s, 76.3 MB/s 2024-09-21T07:34:17.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.981 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015895 s, 66.0 MB/s 2024-09-21T07:34:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132722 s, 79.0 MB/s 2024-09-21T07:34:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151641 s, 69.1 MB/s 2024-09-21T07:34:18.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.032 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.032 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147924 s, 70.9 MB/s 2024-09-21T07:34:18.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132661 s, 79.0 MB/s 2024-09-21T07:34:18.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138243 s, 75.9 MB/s 2024-09-21T07:34:18.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129972 s, 80.7 MB/s 2024-09-21T07:34:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135459 s, 77.4 MB/s 2024-09-21T07:34:18.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131194 s, 79.9 MB/s 2024-09-21T07:34:18.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.130 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.130 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151179 s, 69.4 MB/s 2024-09-21T07:34:18.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135721 s, 77.3 MB/s 2024-09-21T07:34:18.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149004 s, 70.4 MB/s 2024-09-21T07:34:18.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.181 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147343 s, 71.2 MB/s 2024-09-21T07:34:18.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.199 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149776 s, 70.0 MB/s 2024-09-21T07:34:18.219 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.219 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.219 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176217 s, 59.5 MB/s 2024-09-21T07:34:18.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.236 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.236 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145212 s, 72.2 MB/s 2024-09-21T07:34:18.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.253 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.253 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139022 s, 75.4 MB/s 2024-09-21T07:34:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137855 s, 76.1 MB/s 2024-09-21T07:34:18.287 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.288 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155994 s, 67.2 MB/s 2024-09-21T07:34:18.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.304 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137536 s, 76.2 MB/s 2024-09-21T07:34:18.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:18.311 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:18.311 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:18.311 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.28 2024-09-21T07:34:18.311 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:18.312 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:18.312 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:18.312 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:18.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:18.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.379 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136129 s, 77.0 MB/s 2024-09-21T07:34:18.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192635 s, 54.4 MB/s 2024-09-21T07:34:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146711 s, 71.5 MB/s 2024-09-21T07:34:18.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133836 s, 78.3 MB/s 2024-09-21T07:34:18.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137369 s, 76.3 MB/s 2024-09-21T07:34:18.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.469 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.469 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155285 s, 67.5 MB/s 2024-09-21T07:34:18.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.487 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.487 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151658 s, 69.1 MB/s 2024-09-21T07:34:18.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185423 s, 56.6 MB/s 2024-09-21T07:34:18.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.525 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138791 s, 75.6 MB/s 2024-09-21T07:34:18.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.543 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.543 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159368 s, 65.8 MB/s 2024-09-21T07:34:18.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130129 s, 80.6 MB/s 2024-09-21T07:34:18.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151773 s, 69.1 MB/s 2024-09-21T07:34:18.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.593 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136018 s, 77.1 MB/s 2024-09-21T07:34:18.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139944 s, 74.9 MB/s 2024-09-21T07:34:18.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145976 s, 71.8 MB/s 2024-09-21T07:34:18.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.644 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145609 s, 72.0 MB/s 2024-09-21T07:34:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132111 s, 79.4 MB/s 2024-09-21T07:34:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147971 s, 70.9 MB/s 2024-09-21T07:34:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013528 s, 77.5 MB/s 2024-09-21T07:34:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149545 s, 70.1 MB/s 2024-09-21T07:34:18.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.729 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145521 s, 72.1 MB/s 2024-09-21T07:34:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133709 s, 78.4 MB/s 2024-09-21T07:34:18.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.762 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138809 s, 75.5 MB/s 2024-09-21T07:34:18.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141951 s, 73.9 MB/s 2024-09-21T07:34:18.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131371 s, 79.8 MB/s 2024-09-21T07:34:18.813 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.814 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150859 s, 69.5 MB/s 2024-09-21T07:34:18.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.831 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157195 s, 66.7 MB/s 2024-09-21T07:34:18.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013527 s, 77.5 MB/s 2024-09-21T07:34:18.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.864 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013611 s, 77.0 MB/s 2024-09-21T07:34:18.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177946 s, 58.9 MB/s 2024-09-21T07:34:18.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.900 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134942 s, 77.7 MB/s 2024-09-21T07:34:18.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.916 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130487 s, 80.4 MB/s 2024-09-21T07:34:18.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:18.923 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:18.923 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:18.923 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.29 2024-09-21T07:34:18.924 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:18.924 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:18.924 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:18.924 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:18.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:18.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:18.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:18.995 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159126 s, 65.9 MB/s 2024-09-21T07:34:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137349 s, 76.3 MB/s 2024-09-21T07:34:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153064 s, 68.5 MB/s 2024-09-21T07:34:19.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135555 s, 77.4 MB/s 2024-09-21T07:34:19.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150761 s, 69.6 MB/s 2024-09-21T07:34:19.078 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132742 s, 79.0 MB/s 2024-09-21T07:34:19.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.095 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.095 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137384 s, 76.3 MB/s 2024-09-21T07:34:19.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148734 s, 70.5 MB/s 2024-09-21T07:34:19.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.131 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.131 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151615 s, 69.2 MB/s 2024-09-21T07:34:19.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186973 s, 56.1 MB/s 2024-09-21T07:34:19.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.170 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.170 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151195 s, 69.4 MB/s 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156061 s, 67.2 MB/s 2024-09-21T07:34:19.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.205 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140059 s, 74.9 MB/s 2024-09-21T07:34:19.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.221 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.221 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013703 s, 76.5 MB/s 2024-09-21T07:34:19.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.238 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.238 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145709 s, 72.0 MB/s 2024-09-21T07:34:19.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145585 s, 72.0 MB/s 2024-09-21T07:34:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134997 s, 77.7 MB/s 2024-09-21T07:34:19.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.290 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156351 s, 67.1 MB/s 2024-09-21T07:34:19.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134232 s, 78.1 MB/s 2024-09-21T07:34:19.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134969 s, 77.7 MB/s 2024-09-21T07:34:19.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143342 s, 73.2 MB/s 2024-09-21T07:34:19.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.355 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134155 s, 78.2 MB/s 2024-09-21T07:34:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137617 s, 76.2 MB/s 2024-09-21T07:34:19.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148508 s, 70.6 MB/s 2024-09-21T07:34:19.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015026 s, 69.8 MB/s 2024-09-21T07:34:19.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147204 s, 71.2 MB/s 2024-09-21T07:34:19.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.440 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135335 s, 77.5 MB/s 2024-09-21T07:34:19.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131269 s, 79.9 MB/s 2024-09-21T07:34:19.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140377 s, 74.7 MB/s 2024-09-21T07:34:19.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.493 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174702 s, 60.0 MB/s 2024-09-21T07:34:19.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133505 s, 78.5 MB/s 2024-09-21T07:34:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132645 s, 79.1 MB/s 2024-09-21T07:34:19.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:19.532 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.30 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:19.533 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:19.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:19.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.606 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183332 s, 57.2 MB/s 2024-09-21T07:34:19.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.625 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172991 s, 60.6 MB/s 2024-09-21T07:34:19.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.646 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.646 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165468 s, 63.4 MB/s 2024-09-21T07:34:19.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148624 s, 70.6 MB/s 2024-09-21T07:34:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165945 s, 63.2 MB/s 2024-09-21T07:34:19.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.698 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124942 s, 83.9 MB/s 2024-09-21T07:34:19.714 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.714 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.714 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135252 s, 77.5 MB/s 2024-09-21T07:34:19.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.736 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187641 s, 55.9 MB/s 2024-09-21T07:34:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014266 s, 73.5 MB/s 2024-09-21T07:34:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132777 s, 79.0 MB/s 2024-09-21T07:34:19.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.785 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135273 s, 77.5 MB/s 2024-09-21T07:34:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150588 s, 69.6 MB/s 2024-09-21T07:34:19.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.824 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.824 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182145 s, 57.6 MB/s 2024-09-21T07:34:19.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.840 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141958 s, 73.9 MB/s 2024-09-21T07:34:19.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.862 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.862 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182145 s, 57.6 MB/s 2024-09-21T07:34:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014439 s, 72.6 MB/s 2024-09-21T07:34:19.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132207 s, 79.3 MB/s 2024-09-21T07:34:19.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140977 s, 74.4 MB/s 2024-09-21T07:34:19.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.929 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148707 s, 70.5 MB/s 2024-09-21T07:34:19.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140789 s, 74.5 MB/s 2024-09-21T07:34:19.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143358 s, 73.1 MB/s 2024-09-21T07:34:19.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154059 s, 68.1 MB/s 2024-09-21T07:34:19.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:19.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:19.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139562 s, 75.1 MB/s 2024-09-21T07:34:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152539 s, 68.7 MB/s 2024-09-21T07:34:20.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143042 s, 73.3 MB/s 2024-09-21T07:34:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149072 s, 70.3 MB/s 2024-09-21T07:34:20.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145294 s, 72.2 MB/s 2024-09-21T07:34:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133926 s, 78.3 MB/s 2024-09-21T07:34:20.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.102 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154675 s, 67.8 MB/s 2024-09-21T07:34:20.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.119 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142925 s, 73.4 MB/s 2024-09-21T07:34:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149398 s, 70.2 MB/s 2024-09-21T07:34:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134381 s, 78.0 MB/s 2024-09-21T07:34:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:20.159 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:34:20.159 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:34:20.159 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.31 2024-09-21T07:34:20.159 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:34:20.159 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:34:20.160 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:34:20.160 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:34:20.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:20.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.230 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149051 s, 70.4 MB/s 2024-09-21T07:34:20.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140186 s, 74.8 MB/s 2024-09-21T07:34:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182628 s, 57.4 MB/s 2024-09-21T07:34:20.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133391 s, 78.6 MB/s 2024-09-21T07:34:20.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141918 s, 73.9 MB/s 2024-09-21T07:34:20.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135067 s, 77.6 MB/s 2024-09-21T07:34:20.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.334 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.334 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150314 s, 69.8 MB/s 2024-09-21T07:34:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144841 s, 72.4 MB/s 2024-09-21T07:34:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135132 s, 77.6 MB/s 2024-09-21T07:34:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136813 s, 76.6 MB/s 2024-09-21T07:34:20.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.402 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.402 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151347 s, 69.3 MB/s 2024-09-21T07:34:20.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.419 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.419 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139973 s, 74.9 MB/s 2024-09-21T07:34:20.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.434 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133345 s, 78.6 MB/s 2024-09-21T07:34:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013898 s, 75.4 MB/s 2024-09-21T07:34:20.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.467 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.467 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132415 s, 79.2 MB/s 2024-09-21T07:34:20.484 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.485 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.485 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148659 s, 70.5 MB/s 2024-09-21T07:34:20.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.501 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01415 s, 74.1 MB/s 2024-09-21T07:34:20.518 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.518 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.518 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014327 s, 73.2 MB/s 2024-09-21T07:34:20.535 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.535 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.535 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148986 s, 70.4 MB/s 2024-09-21T07:34:20.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131247 s, 79.9 MB/s 2024-09-21T07:34:20.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.573 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.573 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186207 s, 56.3 MB/s 2024-09-21T07:34:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144704 s, 72.5 MB/s 2024-09-21T07:34:20.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.607 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.607 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014999 s, 69.9 MB/s 2024-09-21T07:34:20.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172024 s, 61.0 MB/s 2024-09-21T07:34:20.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.645 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.645 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152384 s, 68.8 MB/s 2024-09-21T07:34:20.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142678 s, 73.5 MB/s 2024-09-21T07:34:20.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143357 s, 73.1 MB/s 2024-09-21T07:34:20.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013325 s, 78.7 MB/s 2024-09-21T07:34:20.710 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.711 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132009 s, 79.4 MB/s 2024-09-21T07:34:20.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.729 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015695 s, 66.8 MB/s 2024-09-21T07:34:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.746 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134648 s, 77.9 MB/s 2024-09-21T07:34:20.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:34:20.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:34:20.764 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154525 s, 67.9 MB/s 2024-09-21T07:34:20.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:20.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:20.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-21T07:34:20.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- 172.21.15.64:0/3106608747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 msgr2=0x7fd73015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 --2- 172.21.15.64:0/3106608747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015f480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd728009bc0 tx=0x7fd72801cac0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- 172.21.15.64:0/3106608747 shutdown_connections 2024-09-21T07:34:20.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 --2- 172.21.15.64:0/3106608747 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015f480 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 --2- 172.21.15.64:0/3106608747 >> v2:172.21.15.90:3300/0 conn(0x7fd7301594c0 0x7fd7300aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- 172.21.15.64:0/3106608747 >> 172.21.15.64:0/3106608747 conn(0x7fd7300d0170 msgr2=0x7fd7300d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- 172.21.15.64:0/3106608747 shutdown_connections 2024-09-21T07:34:20.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- 172.21.15.64:0/3106608747 wait complete. 2024-09-21T07:34:20.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 Processor -- start 2024-09-21T07:34:20.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.934+0000 7fd736000640 1 -- start start 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 0x7fd730157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd73015c490 con 0x7fd730158400 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd73015c310 con 0x7fd73006ec70 2024-09-21T07:34:20.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd73015c610 con 0x7fd7300af360 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60008/0 (socket says 172.21.15.64:60008) 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 -- 172.21.15.64:0/4078468569 learned_addr learned my addr 172.21.15.64:0/4078468569 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd727e00640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72f400640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 0x7fd730157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 -- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 msgr2=0x7fd73015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 -- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 msgr2=0x7fd730157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 0x7fd730157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 -- 172.21.15.64:0/4078468569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd730158200 con 0x7fd730158400 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72f400640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 0x7fd730157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:20.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd72fe00640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fd72801b170 tx=0x7fd728003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd727400640 1 -- 172.21.15.64:0/4078468569 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7280bb070 con 0x7fd730158400 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd727400640 1 -- 172.21.15.64:0/4078468569 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd728004c50 con 0x7fd730158400 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7300b5cd0 con 0x7fd730158400 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd727400640 1 -- 172.21.15.64:0/4078468569 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7280b2040 con 0x7fd730158400 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.938+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7301fc310 con 0x7fd730158400 2024-09-21T07:34:20.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd727400640 1 -- 172.21.15.64:0/4078468569 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd7280be070 con 0x7fd730158400 2024-09-21T07:34:20.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd727400640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 0x7fd70c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd727400640 1 -- 172.21.15.64:0/4078468569 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd72812daa0 con 0x7fd730158400 2024-09-21T07:34:20.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd72f400640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 0x7fd70c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd73d83b000 1 Processor -- start 2024-09-21T07:34:20.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd73d83b000 1 -- start start 2024-09-21T07:34:20.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.942+0000 7fd72f400640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 0x7fd70c075710 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd7300cc8f0 tx=0x7fd720009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c249b0 0x557972d972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c18710 0x557972d97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557972ba9910 con 0x557972c17f00 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557972b98d40 con 0x557972c18710 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557972b9cb50 con 0x557972c249b0 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60020/0 (socket says 172.21.15.64:60020) 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 -- 172.21.15.64:0/3490853804 learned_addr learned my addr 172.21.15.64:0/3490853804 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd72f400640 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c249b0 0x557972d972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd72fe00640 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c18710 0x557972d97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 -- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c249b0 msgr2=0x557972d972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c249b0 0x557972d972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 -- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c18710 msgr2=0x557972d97d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c18710 0x557972d97d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 -- 172.21.15.64:0/3490853804 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557972b372e0 con 0x557972c17f00 2024-09-21T07:34:20.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd727e00640 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fd718009b90 tx=0x7fd718011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8746a59e4159669 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd71f400640 1 -- 172.21.15.64:0/3490853804 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718004050 con 0x557972c17f00 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd71f400640 1 -- 172.21.15.64:0/3490853804 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7180042e0 con 0x557972c17f00 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd71f400640 1 -- 172.21.15.64:0/3490853804 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718005020 con 0x557972c17f00 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- 172.21.15.64:0/3490853804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 msgr2=0x557972d97800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fd718009b90 tx=0x7fd718011810 comp rx=0 tx=0).stop 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- 172.21.15.64:0/3490853804 shutdown_connections 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c18710 0x557972d97d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d97800 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 --2- 172.21.15.64:0/3490853804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c249b0 0x557972d972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- 172.21.15.64:0/3490853804 >> 172.21.15.64:0/3490853804 conn(0x557972c53cb0 msgr2=0x557972d54120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- 172.21.15.64:0/3490853804 shutdown_connections 2024-09-21T07:34:20.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- 172.21.15.64:0/3490853804 wait complete. 2024-09-21T07:34:20.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 -- start start 2024-09-21T07:34:20.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.946+0000 7fd73d83b000 1 Processor -- start 2024-09-21T07:34:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972d967c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972d96d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557972b42d10 con 0x557972c17f00 2024-09-21T07:34:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557972b442e0 con 0x557972c249b0 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557972ba86e0 con 0x557972c18710 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 10 client.0 _ll_register_callbacks cb 0x557972d39790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60026/0 (socket says 172.21.15.64:60026) 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 -- 172.21.15.64:0/302251150 learned_addr learned my addr 172.21.15.64:0/302251150 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd727e00640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972d967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72fe00640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972d96d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 -- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 msgr2=0x557972d967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972d967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 -- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 msgr2=0x557972d96d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972d96d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 -- 172.21.15.64:0/302251150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557972b56250 con 0x557972c17f00 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd72f400640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fd72000eea0 tx=0x7fd720001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647900c1f65f2d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:34:20.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720015e40 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd720010040 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557972b31420 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fd72002e050 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 10 client.9825 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x557972b1e030 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557972b31420 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fd720031020 con 0x557972c17f00 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 10 client.9825 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 10 client.9825 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 20 client.9825 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55797283b8b0 0x557972da8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 4 client.9825 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:20.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557972bab860 con 0x55797283b8b0 2024-09-21T07:34:20.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.950+0000 7fd727e00640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55797283b8b0 0x557972da8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd727e00640 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55797283b8b0 0x557972da8d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c1e7d6cdb00bfa8 server_cookie=89dadfb159bed6c2 in_seq=0 out_seq=0 2024-09-21T07:34:20.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd713e00640 10 client.9825 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd713e00640 1 -- 172.21.15.64:0/302251150 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557972bab860 con 0x55797283b8b0 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd713e00640 10 client.9825 handle_command_reply: tid=0 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 client.9825 shutdown 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 msgr2=0x557972d96280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fd72000eea0 tx=0x7fd720001ae0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 shutdown_connections 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972d96d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55797283b8b0 0x557972da8d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972d967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 --2- 172.21.15.64:0/302251150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c17f00 0x557972d96280 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 >> 172.21.15.64:0/302251150 conn(0x557972c53cb0 msgr2=0x557972d4caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd713e00640 0 client.9825 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:20.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 shutdown_connections 2024-09-21T07:34:20.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 1 -- 172.21.15.64:0/302251150 wait complete. 2024-09-21T07:34:20.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.954+0000 7fd73d83b000 20 client.9825 trim_cache size 0 max 16384 2024-09-21T07:34:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 Processor -- start 2024-09-21T07:34:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- start start 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e09800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 0x557972e09d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd730204720 con 0x557972c18710 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd730159ed0 con 0x557972c249b0 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd730204150 con 0x557972854f60 2024-09-21T07:34:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60032/0 (socket says 172.21.15.64:60032) 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 -- 172.21.15.64:0/1769449216 learned_addr learned my addr 172.21.15.64:0/1769449216 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd727e00640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e09800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72fe00640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 0x557972e09d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 -- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 msgr2=0x557972e09d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 0x557972e09d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 -- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 msgr2=0x557972e09800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e09800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 -- 172.21.15.64:0/1769449216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557972bf5340 con 0x557972c18710 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72fe00640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 0x557972e09d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd72f400640 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd72000e530 tx=0x7fd720013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2811404d68e4eb4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd71ea00640 1 -- 172.21.15.64:0/1769449216 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720037070 con 0x557972c18710 2024-09-21T07:34:20.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd71ea00640 1 -- 172.21.15.64:0/1769449216 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd720026070 con 0x557972c18710 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd71ea00640 1 -- 172.21.15.64:0/1769449216 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720013bb0 con 0x557972c18710 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- 172.21.15.64:0/1769449216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 msgr2=0x557972e092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd72000e530 tx=0x7fd720013780 comp rx=0 tx=0).stop 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- 172.21.15.64:0/1769449216 shutdown_connections 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972854f60 0x557972e09d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e09800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1769449216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972c18710 0x557972e092c0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- 172.21.15.64:0/1769449216 >> 172.21.15.64:0/1769449216 conn(0x557972c53cb0 msgr2=0x557972d4c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- 172.21.15.64:0/1769449216 shutdown_connections 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.974+0000 7fd73d83b000 1 -- 172.21.15.64:0/1769449216 wait complete. 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 -- start start 2024-09-21T07:34:20.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 Processor -- start 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972e0da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e0dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557972b9be60 con 0x557972854f60 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557972b58850 con 0x557972c249b0 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557972ba1180 con 0x557972c18710 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 10 client.0 _ll_register_callbacks cb 0x7fd7200015a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60036/0 (socket says 172.21.15.64:60036) 2024-09-21T07:34:20.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 -- 172.21.15.64:0/1479635756 learned_addr learned my addr 172.21.15.64:0/1479635756 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72fe00640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e0dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd727e00640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972e0da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 -- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 msgr2=0x557972e0da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972e0da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 -- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 msgr2=0x557972e0dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e0dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 -- 172.21.15.64:0/1479635756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557972b61d80 con 0x557972854f60 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72fe00640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e0dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd72f400640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd720017010 tx=0x7fd720013de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deda01a979e1ac93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd713e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720037020 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fd720010040 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd720026070 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.978+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fd7200139c0 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 10 client.9831 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55797284f1a0 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd720026070 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fd720031040 con 0x557972854f60 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 10 client.9831 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 10 client.9831 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 20 client.9831 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:20.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557972dc8b80 0x557972dc8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 4 client.9831 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-21T07:34:20.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x557972ba7310 con 0x557972dc8b80 2024-09-21T07:34:20.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd727e00640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557972dc8b80 0x557972dc8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd727e00640 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557972dc8b80 0x557972dc8f90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ec67c44d70fe86 server_cookie=1b6235482ba7de33 in_seq=0 out_seq=0 2024-09-21T07:34:20.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.982+0000 7fd713e00640 10 client.9831 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd713e00640 1 -- 172.21.15.64:0/1479635756 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557972ba7310 con 0x557972dc8b80 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd713e00640 10 client.9831 handle_command_reply: tid=0 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 client.9831 shutdown 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 msgr2=0x557972e0d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd720017010 tx=0x7fd720013de0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 shutdown_connections 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557972c249b0 0x557972e0dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557972dc8b80 0x557972dc8f90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557972c18710 0x557972e0da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 --2- 172.21.15.64:0/1479635756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557972854f60 0x557972e0d530 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 >> 172.21.15.64:0/1479635756 conn(0x557972c53cb0 msgr2=0x557972d4caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd713e00640 0 client.9831 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:20.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 shutdown_connections 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 1 -- 172.21.15.64:0/1479635756 wait complete. 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd73d83b000 20 client.9831 trim_cache size 0 max 16384 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "05d5bfca-d05c-4bd5-b40c-7f56f1e365c9", 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:34:20.988 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 msgr2=0x7fd70c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 0x7fd70c075710 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd7300cc8f0 tx=0x7fd720009040 comp rx=0 tx=0).stop 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 msgr2=0x7fd73015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fd72801b170 tx=0x7fd728003f60 comp rx=0 tx=0).stop 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 shutdown_connections 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd70c073200 0x7fd70c075710 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd730158400 0x7fd73015aac0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7300af360 0x7fd73015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 --2- 172.21.15.64:0/4078468569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd73006ec70 0x7fd730157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 >> 172.21.15.64:0/4078468569 conn(0x7fd7300d0170 msgr2=0x7fd73015da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 shutdown_connections 2024-09-21T07:34:20.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:20.986+0000 7fd736000640 1 -- 172.21.15.64:0/4078468569 wait complete. 2024-09-21T07:34:21.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:21.008 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 -- 172.21.15.64:0/3416317682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f564815ef30 msgr2=0x7f564815f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 --2- 172.21.15.64:0/3416317682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f564815ef30 0x7f564815f340 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f56480736e0 tx=0x7f563801c830 comp rx=0 tx=0).stop 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 -- 172.21.15.64:0/3416317682 shutdown_connections 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 --2- 172.21.15.64:0/3416317682 >> v2:172.21.15.64:3300/0 conn(0x7f56480715b0 0x7f56480719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 --2- 172.21.15.64:0/3416317682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f564815ef30 0x7f564815f340 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 -- 172.21.15.64:0/3416317682 >> 172.21.15.64:0/3416317682 conn(0x7f56480cdc90 msgr2=0x7f56480ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 -- 172.21.15.64:0/3416317682 shutdown_connections 2024-09-21T07:34:21.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.238+0000 7f564e000640 1 -- 172.21.15.64:0/3416317682 wait complete. 2024-09-21T07:34:21.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 Processor -- start 2024-09-21T07:34:21.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 -- start start 2024-09-21T07:34:21.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 0x7f564809e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 0x7f56480b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f564815ef30 0x7f5648200680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5648074770 con 0x7f564815ef30 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56480745f0 con 0x7f5648073f10 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f564e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f564816bec0 con 0x7f56480715b0 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f564815ef30 0x7f5648200680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5646a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 0x7f56480b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 0x7f564809e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5646a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 0x7f56480b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:33030/0 (socket says 172.21.15.64:33030) 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5646a00640 1 -- 172.21.15.64:0/1061112979 learned_addr learned my addr 172.21.15.64:0/1061112979 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 -- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 msgr2=0x7f56480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 0x7f56480b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 -- 172.21.15.64:0/1061112979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f564815ef30 msgr2=0x7f5648200680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f564815ef30 0x7f5648200680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.242+0000 7f5647400640 1 -- 172.21.15.64:0/1061112979 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480b2c60 con 0x7f56480715b0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f5647400640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 0x7f564809e3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f56380ac000 tx=0x7f56380a5800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f563f400640 1 -- 172.21.15.64:0/1061112979 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b2040 con 0x7f56480715b0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f563f400640 1 -- 172.21.15.64:0/1061112979 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5638004450 con 0x7f56480715b0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56480b2f40 con 0x7f56480715b0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480b3500 con 0x7f56480715b0 2024-09-21T07:34:21.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f563f400640 1 -- 172.21.15.64:0/1061112979 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638003860 con 0x7f56480715b0 2024-09-21T07:34:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.246+0000 7f563f400640 1 -- 172.21.15.64:0/1061112979 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5638003a00 con 0x7f56480715b0 2024-09-21T07:34:21.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f563f400640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 0x7f5628075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f563f400640 1 -- 172.21.15.64:0/1061112979 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f563812d9d0 con 0x7f56480715b0 2024-09-21T07:34:21.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f5646a00640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 0x7f5628075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f5646a00640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 0x7f5628075710 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56480d07c0 tx=0x7f56340091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f5655802000 1 Processor -- start 2024-09-21T07:34:21.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.250+0000 7f5655802000 1 -- start start 2024-09-21T07:34:21.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 0x557368073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557367e272e0 con 0x557367f00170 2024-09-21T07:34:21.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557367e84bb0 con 0x557367f22630 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557367e73fe0 con 0x557367f13ab0 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 0x557368073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 0x557368073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60056/0 (socket says 172.21.15.64:60056) 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5646a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:33040/0 (socket says 172.21.15.64:33040) 2024-09-21T07:34:21.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647e00640 1 -- 172.21.15.64:0/2797705512 learned_addr learned my addr 172.21.15.64:0/2797705512 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 -- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 msgr2=0x5573680731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 -- 172.21.15.64:0/2797705512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 msgr2=0x557368073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 0x557368073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 -- 172.21.15.64:0/2797705512 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557367e121c0 con 0x557367f22630 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5647400640 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f563801cda0 tx=0x7f56380f40d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=238959aa8e96d289 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5633400640 1 -- 172.21.15.64:0/2797705512 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638003cf0 con 0x557367f22630 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5633400640 1 -- 172.21.15.64:0/2797705512 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56380f7c80 con 0x557367f22630 2024-09-21T07:34:21.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5633400640 1 -- 172.21.15.64:0/2797705512 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380f8170 con 0x557367f22630 2024-09-21T07:34:21.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 msgr2=0x557368072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f563801cda0 tx=0x7f56380f40d0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- 172.21.15.64:0/2797705512 shutdown_connections 2024-09-21T07:34:21.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f00170 0x557368073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 --2- 172.21.15.64:0/2797705512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x557368072ca0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- 172.21.15.64:0/2797705512 >> 172.21.15.64:0/2797705512 conn(0x557367b31d20 msgr2=0x557368027c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- 172.21.15.64:0/2797705512 shutdown_connections 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.254+0000 7f5655802000 1 -- 172.21.15.64:0/2797705512 wait complete. 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 -- start start 2024-09-21T07:34:21.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 Processor -- start 2024-09-21T07:34:21.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x55736805e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x55736805eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557367e194f0 con 0x557367f22630 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557367e77df0 con 0x557367f00170 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557367b39620 con 0x557367f13ab0 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5655802000 10 client.0 _ll_register_callbacks cb 0x557367e4acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5646a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5647400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x55736805e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5646a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:33164/0 (socket says 172.21.15.64:33164) 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5646a00640 1 -- 172.21.15.64:0/2722898597 learned_addr learned my addr 172.21.15.64:0/2722898597 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.258+0000 7f5647e00640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x55736805eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 -- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 msgr2=0x55736805e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 -- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 msgr2=0x55736805eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x55736805eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 -- 172.21.15.64:0/2722898597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557367f43740 con 0x557367f00170 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5646a00640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:34:21.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5647400640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x55736805e470 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f563812bcd0 tx=0x7f5638009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d770bc66f705ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T07:34:21.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380bc040 con 0x557367f00170 2024-09-21T07:34:21.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f56380f73d0 con 0x557367f00170 2024-09-21T07:34:21.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557367e0c300 con 0x557367f00170 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f56380fcba0 con 0x557367f00170 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 10 client.9280 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x557367ef9440 con 0x557367f00170 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557367e0c300 con 0x557367f00170 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f56380f3ac0 con 0x557367f00170 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 10 client.9280 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 10 client.9280 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 20 client.9280 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b168d0 0x557368084260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 4 client.9280 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557367e86b00 con 0x557367b168d0 2024-09-21T07:34:21.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.262+0000 7f5646a00640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b168d0 0x557368084260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.266+0000 7f5627e00640 10 client.9280 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.266+0000 7f5646a00640 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b168d0 0x557368084260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2100f00105168871 server_cookie=28062283356faf38 in_seq=0 out_seq=0 2024-09-21T07:34:21.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.266+0000 7f5627e00640 1 -- 172.21.15.64:0/2722898597 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557367e86b00 con 0x557367b168d0 2024-09-21T07:34:21.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.266+0000 7f5627e00640 10 client.9280 handle_command_reply: tid=0 2024-09-21T07:34:21.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.266+0000 7f5655802000 1 client.9280 shutdown 2024-09-21T07:34:21.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 msgr2=0x55736805e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x55736805e470 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f563812bcd0 tx=0x7f5638009560 comp rx=0 tx=0).stop 2024-09-21T07:34:21.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 shutdown_connections 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x55736805eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b168d0 0x557368084260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x55736805e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 --2- 172.21.15.64:0/2722898597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x55736805e470 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 >> 172.21.15.64:0/2722898597 conn(0x557367b31d20 msgr2=0x557368027c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5627e00640 0 client.9280 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 shutdown_connections 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 1 -- 172.21.15.64:0/2722898597 wait complete. 2024-09-21T07:34:21.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.270+0000 7f5655802000 20 client.9280 trim_cache size 0 max 16384 2024-09-21T07:34:21.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.298+0000 7f5655802000 1 Processor -- start 2024-09-21T07:34:21.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 -- start start 2024-09-21T07:34:21.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f00170 0x55736805e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x55736805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55736802d750 con 0x557367f13ab0 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f562000ce10 con 0x557367f22630 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f562000bdf0 con 0x557367f00170 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60084/0 (socket says 172.21.15.64:60084) 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 -- 172.21.15.64:0/385211958 learned_addr learned my addr 172.21.15.64:0/385211958 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5647400640 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f00170 0x55736805e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5647e00640 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x55736805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 -- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f00170 msgr2=0x55736805e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f00170 0x55736805e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 -- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 msgr2=0x55736805c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x55736805c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 -- 172.21.15.64:0/385211958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557367ed0b00 con 0x557367f13ab0 2024-09-21T07:34:21.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5646a00640 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f56340093f0 tx=0x7f5634014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8fe378d901798f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5632a00640 1 -- 172.21.15.64:0/385211958 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634035070 con 0x557367f13ab0 2024-09-21T07:34:21.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5632a00640 1 -- 172.21.15.64:0/385211958 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f563401cb80 con 0x557367f13ab0 2024-09-21T07:34:21.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.302+0000 7f5632a00640 1 -- 172.21.15.64:0/385211958 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634030430 con 0x557367f13ab0 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- 172.21.15.64:0/385211958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 msgr2=0x55736805e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f56340093f0 tx=0x7f5634014000 comp rx=0 tx=0).stop 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- 172.21.15.64:0/385211958 shutdown_connections 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f22630 0x55736805c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f13ab0 0x55736805e7a0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 --2- 172.21.15.64:0/385211958 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f00170 0x55736805e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- 172.21.15.64:0/385211958 >> 172.21.15.64:0/385211958 conn(0x557367b31d20 msgr2=0x55736802e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- 172.21.15.64:0/385211958 shutdown_connections 2024-09-21T07:34:21.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- 172.21.15.64:0/385211958 wait complete. 2024-09-21T07:34:21.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 -- start start 2024-09-21T07:34:21.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.306+0000 7f5655802000 1 Processor -- start 2024-09-21T07:34:21.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x5573680e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680e8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557367e84bb0 con 0x557367f22630 2024-09-21T07:34:21.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557367e1f040 con 0x557367f00170 2024-09-21T07:34:21.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x557367e3fc70 con 0x557367f13ab0 2024-09-21T07:34:21.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 10 client.0 _ll_register_callbacks cb 0x7f56400018e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60096/0 (socket says 172.21.15.64:60096) 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 -- 172.21.15.64:0/1750414825 learned_addr learned my addr 172.21.15.64:0/1750414825 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647400640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x5573680e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5646a00640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 -- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 msgr2=0x5573680e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 -- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 msgr2=0x5573680e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x5573680e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 -- 172.21.15.64:0/1750414825 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557367e3e060 con 0x557367f22630 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5646a00640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5647e00640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f5640002110 tx=0x7f5640002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d82d07cd881913d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5627e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640006d70 con 0x557367f22630 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f56400175d0 con 0x557367f22630 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.310+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f563401cb80 con 0x557367f22630 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f5640027050 con 0x557367f22630 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 10 client.9849 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x557367e0a640 con 0x557367f22630 2024-09-21T07:34:21.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f563401cb80 con 0x557367f22630 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f564002a020 con 0x557367f22630 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 10 client.9849 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 10 client.9849 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 20 client.9849 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b04930 0x557368028790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 4 client.9849 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x557367e825b0 con 0x557367b04930 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5647400640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b04930 0x557368028790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5647400640 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b04930 0x557368028790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9313ec3bb5a75fc1 server_cookie=d6fdfa921ca69138 in_seq=0 out_seq=0 2024-09-21T07:34:21.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.314+0000 7f5627e00640 10 client.9849 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5627e00640 1 -- 172.21.15.64:0/1750414825 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557367e825b0 con 0x557367b04930 2024-09-21T07:34:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5627e00640 10 client.9849 handle_command_reply: tid=0 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 client.9849 shutdown 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 msgr2=0x5573680e88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f5640002110 tx=0x7f5640002200 comp rx=0 tx=0).stop 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 shutdown_connections 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557367f22630 0x5573680e88a0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x557367b04930 0x557368028790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557367f13ab0 0x5573680e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 --2- 172.21.15.64:0/1750414825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557367f00170 0x5573680e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 >> 172.21.15.64:0/1750414825 conn(0x557367b31d20 msgr2=0x55736802f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5627e00640 0 client.9849 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 shutdown_connections 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 1 -- 172.21.15.64:0/1750414825 wait complete. 2024-09-21T07:34:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f5655802000 20 client.9849 trim_cache size 0 max 16384 2024-09-21T07:34:21.336 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:34:21.336 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2024-09-21T07:34:21.336 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0 2024-09-21T07:34:21.336 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 msgr2=0x7f5628075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 0x7f5628075710 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56480d07c0 tx=0x7f56340091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 msgr2=0x7f564809e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 0x7f564809e3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f56380ac000 tx=0x7f56380a5800 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 shutdown_connections 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5628073200 0x7f5628075710 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f564815ef30 0x7f5648200680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648073f10 0x7f56480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 --2- 172.21.15.64:0/1061112979 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56480715b0 0x7f564809e3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 >> 172.21.15.64:0/1061112979 conn(0x7f56480cdc90 msgr2=0x7f56480cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 shutdown_connections 2024-09-21T07:34:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.334+0000 7f564e000640 1 -- 172.21.15.64:0/1061112979 wait complete. 2024-09-21T07:34:21.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:21.355 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-21T07:34:21.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 -- 172.21.15.64:0/1586306600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 msgr2=0x7f0c000b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 --2- 172.21.15.64:0/1586306600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000b3ce0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f0c000b3130 tx=0x7f0bf801cc40 comp rx=0 tx=0).stop 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 -- 172.21.15.64:0/1586306600 shutdown_connections 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 --2- 172.21.15.64:0/1586306600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000b3ce0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 --2- 172.21.15.64:0/1586306600 >> v2:172.21.15.90:3300/0 conn(0x7f0c000706c0 0x7f0c000ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 -- 172.21.15.64:0/1586306600 >> 172.21.15.64:0/1586306600 conn(0x7f0c000ccbe0 msgr2=0x7f0c000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 -- 172.21.15.64:0/1586306600 shutdown_connections 2024-09-21T07:34:21.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.514+0000 7f0c07200640 1 -- 172.21.15.64:0/1586306600 wait complete. 2024-09-21T07:34:21.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 Processor -- start 2024-09-21T07:34:21.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 -- start start 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c0015ec20 0x7f0c000ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c000c9600 0x7f0c001569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00168d70 con 0x7f0c000ca990 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00168bf0 con 0x7f0c0015ec20 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c07200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0c00168ef0 con 0x7f0c000c9600 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60114/0 (socket says 172.21.15.64:60114) 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0bffe00640 1 -- 172.21.15.64:0/652556811 learned_addr learned my addr 172.21.15.64:0/652556811 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0bf7400640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c0015ec20 0x7f0c000ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.518+0000 7f0c05200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c000c9600 0x7f0c001569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 -- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c000c9600 msgr2=0x7f0c001569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c000c9600 0x7f0c001569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 -- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c0015ec20 msgr2=0x7f0c000ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c0015ec20 0x7f0c000ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 -- 172.21.15.64:0/652556811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c001577f0 con 0x7f0c000ca990 2024-09-21T07:34:21.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bffe00640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c3c0 tx=0x7f0bf000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bfcc00640 1 -- 172.21.15.64:0/652556811 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0017070 con 0x7f0c000ca990 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bfcc00640 1 -- 172.21.15.64:0/652556811 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf00053c0 con 0x7f0c000ca990 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c000736a0 con 0x7f0c000ca990 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bfcc00640 1 -- 172.21.15.64:0/652556811 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0003860 con 0x7f0c000ca990 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001561b0 con 0x7f0c000ca990 2024-09-21T07:34:21.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.522+0000 7f0bfcc00640 1 -- 172.21.15.64:0/652556811 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0bf001a070 con 0x7f0c000ca990 2024-09-21T07:34:21.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bfcc00640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 0x7f0bdc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bfcc00640 1 -- 172.21.15.64:0/652556811 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f0bf0093640 con 0x7f0c000ca990 2024-09-21T07:34:21.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf7400640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 0x7f0bdc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 Processor -- start 2024-09-21T07:34:21.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 -- start start 2024-09-21T07:34:21.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf7400640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 0x7f0bdc075740 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c000ae280 tx=0x7f0be800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a97f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a98470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b364936cd0 con 0x55b36492b6d0 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b36484c330 con 0x55b364646aa0 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b3648a9bb0 con 0x55b364582890 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60120/0 (socket says 172.21.15.64:60120) 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 -- 172.21.15.64:0/2114485622 learned_addr learned my addr 172.21.15.64:0/2114485622 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0c05200640 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a98470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf7400640 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a97f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 -- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 msgr2=0x55b364a97f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a97f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 -- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 msgr2=0x55b364a98470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a98470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 -- 172.21.15.64:0/2114485622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b36484dc80 con 0x55b36492b6d0 2024-09-21T07:34:21.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bffe00640 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f0bf005de00 tx=0x7f0bf005d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa34cfc73999a04d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf4c00640 1 -- 172.21.15.64:0/2114485622 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00628a0 con 0x55b36492b6d0 2024-09-21T07:34:21.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf4c00640 1 -- 172.21.15.64:0/2114485622 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf0067750 con 0x55b36492b6d0 2024-09-21T07:34:21.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.526+0000 7f0bf4c00640 1 -- 172.21.15.64:0/2114485622 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0065d90 con 0x55b36492b6d0 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- 172.21.15.64:0/2114485622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 msgr2=0x55b364a979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f0bf005de00 tx=0x7f0bf005d980 comp rx=0 tx=0).stop 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- 172.21.15.64:0/2114485622 shutdown_connections 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a98470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a97f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/2114485622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a979f0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- 172.21.15.64:0/2114485622 >> 172.21.15.64:0/2114485622 conn(0x55b3645565c0 msgr2=0x55b364a54ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- 172.21.15.64:0/2114485622 shutdown_connections 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- 172.21.15.64:0/2114485622 wait complete. 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- start start 2024-09-21T07:34:21.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 Processor -- start 2024-09-21T07:34:21.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a53a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a53f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b36489cdf0 con 0x55b36492b6d0 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b364898fe0 con 0x55b364646aa0 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b36483e4d0 con 0x55b364582890 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c0ea08000 10 client.0 _ll_register_callbacks cb 0x55b36481c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c05200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a53a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.530+0000 7f0c05200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60122/0 (socket says 172.21.15.64:60122) 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 -- 172.21.15.64:0/283515124 learned_addr learned my addr 172.21.15.64:0/283515124 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bf7400640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a53f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 -- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 msgr2=0x55b364a53a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a53a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 -- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 msgr2=0x55b364a53f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a53f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 -- 172.21.15.64:0/283515124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b364837210 con 0x55b36492b6d0 2024-09-21T07:34:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bffe00640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a53a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c05200640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009bd0 tx=0x7f0bf8003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403b80fb843543af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80bc070 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f0bf8004a50 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b364831350 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f0bf80c4050 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 10 client.9861 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55b36481dfc0 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b364831350 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f0bf80c7020 con 0x55b36492b6d0 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 10 client.9861 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 10 client.9861 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 20 client.9861 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b36453b930 0x55b364a9ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 4 client.9861 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3648abb00 con 0x55b36453b930 2024-09-21T07:34:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bffe00640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b36453b930 0x55b364a9ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 10 client.9861 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bffe00640 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b36453b930 0x55b364a9ee80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d759cc3b339c82 server_cookie=c08ca03c1ea85b57 in_seq=0 out_seq=0 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 1 -- 172.21.15.64:0/283515124 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3648abb00 con 0x55b36453b930 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 10 client.9861 handle_command_reply: tid=0 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 client.9861 shutdown 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 msgr2=0x55b364a5a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009bd0 tx=0x7f0bf8003f50 comp rx=0 tx=0).stop 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 shutdown_connections 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364a5a5f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364a53f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b36453b930 0x55b364a9ee80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/283515124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364a53a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 >> 172.21.15.64:0/283515124 conn(0x55b3645565c0 msgr2=0x55b364a4cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0bed600640 0 client.9861 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 shutdown_connections 2024-09-21T07:34:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 1 -- 172.21.15.64:0/283515124 wait complete. 2024-09-21T07:34:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.534+0000 7f0c0ea08000 20 client.9861 trim_cache size 0 max 16384 2024-09-21T07:34:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 Processor -- start 2024-09-21T07:34:21.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 -- start start 2024-09-21T07:34:21.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364b09400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364b09940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b364a52b20 con 0x55b36492b6d0 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00205a40 con 0x55b364646aa0 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.554+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0c000ad7d0 con 0x55b364582890 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60134/0 (socket says 172.21.15.64:60134) 2024-09-21T07:34:21.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 -- 172.21.15.64:0/227577767 learned_addr learned my addr 172.21.15.64:0/227577767 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 -- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 msgr2=0x55b364b09400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364b09400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 -- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 msgr2=0x55b364b09940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364b09940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 -- 172.21.15.64:0/227577767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3648f6680 con 0x55b36492b6d0 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c05200640 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f0bf801a870 tx=0x7f0bf8004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685619d4381ca68c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0befe00640 1 -- 172.21.15.64:0/227577767 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80cd070 con 0x55b36492b6d0 2024-09-21T07:34:21.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0befe00640 1 -- 172.21.15.64:0/227577767 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf8004a50 con 0x55b36492b6d0 2024-09-21T07:34:21.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0befe00640 1 -- 172.21.15.64:0/227577767 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80bc040 con 0x55b36492b6d0 2024-09-21T07:34:21.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- 172.21.15.64:0/227577767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 msgr2=0x55b364b09e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f0bf801a870 tx=0x7f0bf8004f40 comp rx=0 tx=0).stop 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- 172.21.15.64:0/227577767 shutdown_connections 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b36492b6d0 0x55b364b09e80 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364646aa0 0x55b364b09940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/227577767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b364582890 0x55b364b09400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- 172.21.15.64:0/227577767 >> 172.21.15.64:0/227577767 conn(0x55b3645565c0 msgr2=0x55b364aa9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- 172.21.15.64:0/227577767 shutdown_connections 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- 172.21.15.64:0/227577767 wait complete. 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 -- start start 2024-09-21T07:34:21.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.558+0000 7f0c0ea08000 1 Processor -- start 2024-09-21T07:34:21.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364582890 0x55b364b0d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b36492b6d0 0x55b364b0e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0c000ad180 con 0x55b364646aa0 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00155c50 con 0x55b364582890 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55b36455e680 con 0x55b36492b6d0 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 10 client.0 _ll_register_callbacks cb 0x7f0bf80099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364582890 0x55b364b0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60150/0 (socket says 172.21.15.64:60150) 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 -- 172.21.15.64:0/3059797566 learned_addr learned my addr 172.21.15.64:0/3059797566 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c05200640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b36492b6d0 0x55b364b0e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 -- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b36492b6d0 msgr2=0x55b364b0e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b36492b6d0 0x55b364b0e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 -- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364582890 msgr2=0x55b364b0d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:21.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364582890 0x55b364b0d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 -- 172.21.15.64:0/3059797566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3648630b0 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bf7400640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f0be800be50 tx=0x7f0be80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fe7bfe83045c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8029420 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f0be802ae00 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bf8004a50 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f0be801e420 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 10 client.9867 fetch_fsmap learned FSMap version 120 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55b36482f610 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf8004a50 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f0be8031050 con 0x55b364646aa0 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 10 client.9867 fetch_fsmap finished waiting for FSMap version 120 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 10 client.9867 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 20 client.9867 populate_metadata read hostname 'smithi064' 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b364529990 0x55b364a4eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 4 client.9867 mds_command: new command op to 9094 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 --> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b3648a75b0 con 0x55b364529990 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bffe00640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b364529990 0x55b364a4eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bffe00640 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b364529990 0x55b364a4eeb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be881a1eb8db9e2 server_cookie=32d44859d263af74 in_seq=0 out_seq=0 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 10 client.9867 ms_handle_connect on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 1 -- 172.21.15.64:0/3059797566 <== mds.0 v2:172.21.15.64:6833/130164325 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55b3648a75b0 con 0x55b364529990 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0bed600640 10 client.9867 handle_command_reply: tid=0 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 client.9867 shutdown 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 msgr2=0x55b364b0db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.562+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f0be800be50 tx=0x7f0be80046d0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 shutdown_connections 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:6833/130164325,v1:172.21.15.64:6835/130164325] conn(0x55b364529990 0x55b364a4eeb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55b36492b6d0 0x55b364b0e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b364646aa0 0x55b364b0db90 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0bed600640 0 client.9867 ms_handle_reset on v2:172.21.15.64:6833/130164325 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 --2- 172.21.15.64:0/3059797566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b364582890 0x55b364b0d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 >> 172.21.15.64:0/3059797566 conn(0x55b3645565c0 msgr2=0x55b364a595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 shutdown_connections 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 1 -- 172.21.15.64:0/3059797566 wait complete. 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c0ea08000 20 client.9867 trim_cache size 0 max 16384 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "PAUSED (727 inodes in the stack)", 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "05d5bfca-d05c-4bd5-b40c-7f56f1e365c9": { 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "05d5bfca-d05c-4bd5-b40c-7f56f1e365c9", 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:21.568 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "05d5bfca-d05c-4bd5-b40c-7f56f1e365c9": { 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:34:20.982679+0000", 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/scrub_control_test_path", 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:21.569 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:34:21.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 msgr2=0x7f0bdc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 0x7f0bdc075740 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c000ae280 tx=0x7f0be800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 msgr2=0x7f0c000af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c3c0 tx=0x7f0bf000c880 comp rx=0 tx=0).stop 2024-09-21T07:34:21.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 shutdown_connections 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bdc073230 0x7f0bdc075740 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c000c9600 0x7f0c001569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c0015ec20 0x7f0c000ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 --2- 172.21.15.64:0/652556811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c000ca990 0x7f0c000af9c0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 >> 172.21.15.64:0/652556811 conn(0x7f0c000ccbe0 msgr2=0x7f0c0015cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 shutdown_connections 2024-09-21T07:34:21.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.566+0000 7f0c07200640 1 -- 172.21.15.64:0/652556811 wait complete. 2024-09-21T07:34:21.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:21.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 -- 172.21.15.64:0/1208239840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea40b6bb0 msgr2=0x7f9ea415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 --2- 172.21.15.64:0/1208239840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea40b6bb0 0x7f9ea415c880 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40cd570 tx=0x7f9e9801c7a0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 -- 172.21.15.64:0/1208239840 shutdown_connections 2024-09-21T07:34:21.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 --2- 172.21.15.64:0/1208239840 >> v2:172.21.15.90:3300/0 conn(0x7f9ea40cbc50 0x7f9ea40cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 --2- 172.21.15.64:0/1208239840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea40b6bb0 0x7f9ea415c880 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 -- 172.21.15.64:0/1208239840 >> 172.21.15.64:0/1208239840 conn(0x7f9ea40b2dc0 msgr2=0x7f9ea40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 -- 172.21.15.64:0/1208239840 shutdown_connections 2024-09-21T07:34:21.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.742+0000 7f9eab800640 1 -- 172.21.15.64:0/1208239840 wait complete. 2024-09-21T07:34:21.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 Processor -- start 2024-09-21T07:34:21.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 -- start start 2024-09-21T07:34:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ea40b6bb0 0x7f9ea41f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 0x7f9ea415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea416a090 con 0x7f9ea4071280 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4169f10 con 0x7f9ea40cbc50 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9eab800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea416a210 con 0x7f9ea40b6bb0 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60166/0 (socket says 172.21.15.64:60166) 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 -- 172.21.15.64:0/3847490763 learned_addr learned my addr 172.21.15.64:0/3847490763 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea3e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ea40b6bb0 0x7f9ea41f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea9800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 0x7f9ea415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 -- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ea40b6bb0 msgr2=0x7f9ea41f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ea40b6bb0 0x7f9ea41f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 -- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 msgr2=0x7f9ea415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 0x7f9ea415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea8e00640 1 -- 172.21.15.64:0/3847490763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40cfc70 con 0x7f9ea4071280 2024-09-21T07:34:21.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.746+0000 7f9ea9800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 0x7f9ea415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:21.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea8e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f9e980193b0 tx=0x7f9e980a64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98004240 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e980044d0 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea40cff50 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98005270 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea40d0510 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea415c880 con 0x7f9ea4071280 2024-09-21T07:34:21.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e98005410 con 0x7f9ea4071280 2024-09-21T07:34:21.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.750+0000 7f9ea0c00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 0x7f9e84075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:21.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.754+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f9e9812e680 con 0x7f9ea4071280 2024-09-21T07:34:21.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.754+0000 7f9ea3e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 0x7f9e84075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:21.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.754+0000 7f9ea3e00640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 0x7f9e84075740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000bb50 tx=0x7f9e9000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:21.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.754+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9e980bf070 con 0x7f9ea4071280 2024-09-21T07:34:21.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.966+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ea40b2a20 con 0x7f9ea4071280 2024-09-21T07:34:21.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9ea0c00640 1 -- 172.21.15.64:0/3847490763 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f9e980b6070 con 0x7f9ea4071280 2024-09-21T07:34:21.969 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:21.969 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:21.969 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:21.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 msgr2=0x7f9e84075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 0x7f9e84075740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000bb50 tx=0x7f9e9000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 msgr2=0x7f9ea41f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f9e980193b0 tx=0x7f9e980a64f0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 shutdown_connections 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e84073230 0x7f9e84075740 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea40cbc50 0x7f9ea415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ea40b6bb0 0x7f9ea41f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 --2- 172.21.15.64:0/3847490763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea4071280 0x7f9ea41f91d0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 >> 172.21.15.64:0/3847490763 conn(0x7f9ea40b2dc0 msgr2=0x7f9ea40b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 shutdown_connections 2024-09-21T07:34:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:21.970+0000 7f9eab800640 1 -- 172.21.15.64:0/3847490763 wait complete. 2024-09-21T07:34:21.991 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:34:21.991 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:34:22.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 -- 172.21.15.64:0/1161215492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 msgr2=0x7f10540cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 --2- 172.21.15.64:0/1161215492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540cf0c0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f10540c4190 tx=0x7f104c01ccf0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 -- 172.21.15.64:0/1161215492 shutdown_connections 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 --2- 172.21.15.64:0/1161215492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540cf0c0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 --2- 172.21.15.64:0/1161215492 >> v2:172.21.15.90:3300/0 conn(0x7f105406cdf0 0x7f105406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 -- 172.21.15.64:0/1161215492 >> 172.21.15.64:0/1161215492 conn(0x7f10540d0c50 msgr2=0x7f10540d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 -- 172.21.15.64:0/1161215492 shutdown_connections 2024-09-21T07:34:22.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.150+0000 7f105be00640 1 -- 172.21.15.64:0/1161215492 wait complete. 2024-09-21T07:34:22.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 Processor -- start 2024-09-21T07:34:22.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 -- start start 2024-09-21T07:34:22.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105406cdf0 0x7f105414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1054070e80 0x7f10540c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f10540cf600 con 0x7f10540cecb0 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f105415b720 con 0x7f105406cdf0 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f105be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f10540cf780 con 0x7f1054070e80 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105406cdf0 0x7f105414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60178/0 (socket says 172.21.15.64:60178) 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 -- 172.21.15.64:0/413385067 learned_addr learned my addr 172.21.15.64:0/413385067 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:22.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1058a00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1054070e80 0x7f10540c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 -- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1054070e80 msgr2=0x7f10540c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1054070e80 0x7f10540c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 -- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105406cdf0 msgr2=0x7f105414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105406cdf0 0x7f105414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 -- 172.21.15.64:0/413385067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10540b3360 con 0x7f10540cecb0 2024-09-21T07:34:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1059e00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f104c009bd0 tx=0x7f104c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0bc070 con 0x7f10540cecb0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.154+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f104c0040f0 con 0x7f10540cecb0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541fa0c0 con 0x7f10540cecb0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0b2040 con 0x7f10540cecb0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10540b2da0 con 0x7f10540cecb0 2024-09-21T07:34:22.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105406d200 con 0x7f10540cecb0 2024-09-21T07:34:22.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f104c0bf070 con 0x7f10540cecb0 2024-09-21T07:34:22.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f1051600640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 0x7f1034075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f104c12df50 con 0x7f10540cecb0 2024-09-21T07:34:22.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.158+0000 7f1059400640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 0x7f1034075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.162+0000 7f1059400640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 0x7f1034075740 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1048007fd0 tx=0x7f1048009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:22.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.162+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f104c016970 con 0x7f10540cecb0 2024-09-21T07:34:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f10541fa350 con 0x7f10540cecb0 2024-09-21T07:34:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f1051600640 1 -- 172.21.15.64:0/413385067 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f104c0f88b0 con 0x7f10540cecb0 2024-09-21T07:34:22.406 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:22.407 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":720,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":893,"data_bytes":913571556,"bytes_used":2213658624,"bytes_avail":770880454656,"bytes_total":773094113280,"write_bytes_sec":46789535,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9094}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-21T07:33:35.597408+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 msgr2=0x7f1034075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 0x7f1034075740 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1048007fd0 tx=0x7f1048009040 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 msgr2=0x7f10540c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.406+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f104c009bd0 tx=0x7f104c005ae0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 shutdown_connections 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1034073230 0x7f1034075740 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540cecb0 0x7f10540c7100 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1054070e80 0x7f10540c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 --2- 172.21.15.64:0/413385067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105406cdf0 0x7f105414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 >> 172.21.15.64:0/413385067 conn(0x7f10540d0c50 msgr2=0x7f10541553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 shutdown_connections 2024-09-21T07:34:22.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:22.410+0000 7f105be00640 1 -- 172.21.15.64:0/413385067 wait complete. 2024-09-21T07:34:22.429 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-21T07:34:23.429 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- 172.21.15.64:0/2941815601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0caec0 msgr2=0x7efbfc0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 --2- 172.21.15.64:0/2941815601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0caec0 0x7efbfc0b3120 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0cd8c0 tx=0x7efbe401daf0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- 172.21.15.64:0/2941815601 shutdown_connections 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 --2- 172.21.15.64:0/2941815601 >> v2:172.21.15.90:3300/0 conn(0x7efbfc0cb2d0 0x7efbfc0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 --2- 172.21.15.64:0/2941815601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0caec0 0x7efbfc0b3120 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- 172.21.15.64:0/2941815601 >> 172.21.15.64:0/2941815601 conn(0x7efbfc0ccbe0 msgr2=0x7efbfc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- 172.21.15.64:0/2941815601 shutdown_connections 2024-09-21T07:34:23.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- 172.21.15.64:0/2941815601 wait complete. 2024-09-21T07:34:23.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 Processor -- start 2024-09-21T07:34:23.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.602+0000 7efc02400640 1 -- start start 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc0b24e0 0x7efbfc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbfc0caec0 0x7efbfc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc168030 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc167eb0 con 0x7efbfc0b24e0 2024-09-21T07:34:23.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc1681b0 con 0x7efbfc0caec0 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60188/0 (socket says 172.21.15.64:60188) 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 -- 172.21.15.64:0/263042203 learned_addr learned my addr 172.21.15.64:0/263042203 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfb400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc0b24e0 0x7efbfc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbf3e00640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbfc0caec0 0x7efbfc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 -- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbfc0caec0 msgr2=0x7efbfc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbfc0caec0 0x7efbfc070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 -- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc0b24e0 msgr2=0x7efbfc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:23.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc0b24e0 0x7efbfc1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 -- 172.21.15.64:0/263042203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc06f130 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbfbe00640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e910 tx=0x7efbf400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004d30 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf400cb20 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4005020 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc06f410 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc06f9d0 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.606+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc0ca7b0 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.610+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efbf40051c0 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.610+0000 7efbf3400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 0x7efbd8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.610+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7efbf4094bc0 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.610+0000 7efbfb400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 0x7efbd8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.610+0000 7efbfb400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 0x7efbd8075710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efbec007fd0 tx=0x7efbec009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.614+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efbf4016030 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.826+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbfc06eec0 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.826+0000 7efbf3400640 1 -- 172.21.15.64:0/263042203 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7efbf405f360 con 0x7efbfc0cb2d0 2024-09-21T07:34:23.828 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:23.828 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 msgr2=0x7efbd8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 0x7efbd8075710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efbec007fd0 tx=0x7efbec009040 comp rx=0 tx=0).stop 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 msgr2=0x7efbfc163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e910 tx=0x7efbf400edd0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 shutdown_connections 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efbd8073200 0x7efbd8075710 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efbfc0cb2d0 0x7efbfc163ef0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbfc0caec0 0x7efbfc070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 --2- 172.21.15.64:0/263042203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc0b24e0 0x7efbfc1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 >> 172.21.15.64:0/263042203 conn(0x7efbfc0ccbe0 msgr2=0x7efbfc0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 shutdown_connections 2024-09-21T07:34:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:23.830+0000 7efc02400640 1 -- 172.21.15.64:0/263042203 wait complete. 2024-09-21T07:34:23.850 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-21T07:34:23.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.006+0000 7fe000600640 1 -- 172.21.15.64:0/4020169954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 msgr2=0x7fdfe0003a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.006+0000 7fe000600640 1 --2- 172.21.15.64:0/4020169954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 0x7fdfe0003a80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009b40 tx=0x7fdfec01d290 comp rx=0 tx=0).stop 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.006+0000 7fdffe600640 1 -- 172.21.15.64:0/4020169954 reap_dead start 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- 172.21.15.64:0/4020169954 shutdown_connections 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- 172.21.15.64:0/4020169954 >> 172.21.15.64:0/4020169954 conn(0x7fdff80ccbe0 msgr2=0x7fdff80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- 172.21.15.64:0/4020169954 shutdown_connections 2024-09-21T07:34:24.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- 172.21.15.64:0/4020169954 wait complete. 2024-09-21T07:34:24.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 Processor -- start 2024-09-21T07:34:24.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- start start 2024-09-21T07:34:24.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 0x7fdff8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 0x7fdff81f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdff8070440 con 0x7fdff814b580 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80702c0 con 0x7fdff81481d0 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.010+0000 7fe000600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80c6fd0 con 0x7fdff815edb0 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60210/0 (socket says 172.21.15.64:60210) 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 -- 172.21.15.64:0/700335934 learned_addr learned my addr 172.21.15.64:0/700335934 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffdc00640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 0x7fdff8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffe600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 0x7fdff81f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 -- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 msgr2=0x7fdff8147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 0x7fdff8147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 -- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 msgr2=0x7fdff81f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 0x7fdff81f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 -- 172.21.15.64:0/700335934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff814a820 con 0x7fdff814b580 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffe600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 0x7fdff81f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdffd200640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40118b0 tx=0x7fdfe4011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe401e070 con 0x7fdff814b580 2024-09-21T07:34:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfe400fbb0 con 0x7fdff814b580 2024-09-21T07:34:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4019410 con 0x7fdff814b580 2024-09-21T07:34:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81f66d0 con 0x7fdff814b580 2024-09-21T07:34:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff814ad80 con 0x7fdff814b580 2024-09-21T07:34:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff8073840 con 0x7fdff814b580 2024-09-21T07:34:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.014+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdfe4021070 con 0x7fdff814b580 2024-09-21T07:34:24.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.018+0000 7fdff5600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 0x7fdfd8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.018+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fdfe4094b30 con 0x7fdff814b580 2024-09-21T07:34:24.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.018+0000 7fdffdc00640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 0x7fdfd8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.018+0000 7fdffdc00640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 0x7fdfd8075740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0ad000 tx=0x7fdfec01a030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.022+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdff814a820 con 0x7fdff814b580 2024-09-21T07:34:24.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.262+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdff81f6460 con 0x7fdff814b580 2024-09-21T07:34:24.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.262+0000 7fdff5600640 1 -- 172.21.15.64:0/700335934 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fdfe405f350 con 0x7fdff814b580 2024-09-21T07:34:24.264 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:24.264 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":722,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1046,"data_bytes":1074003684,"bytes_used":2598572032,"bytes_avail":770495541248,"bytes_total":773094113280,"write_bytes_sec":57750941,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9094}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-21T07:34:23.613142+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 msgr2=0x7fdfd8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 0x7fdfd8075740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0ad000 tx=0x7fdfec01a030 comp rx=0 tx=0).stop 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 msgr2=0x7fdff81f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40118b0 tx=0x7fdfe4011d70 comp rx=0 tx=0).stop 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 shutdown_connections 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdfd8073230 0x7fdfd8075740 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff81481d0 0x7fdff81f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdff814b580 0x7fdff81f59c0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 --2- 172.21.15.64:0/700335934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdff815edb0 0x7fdff8147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 >> 172.21.15.64:0/700335934 conn(0x7fdff80ccbe0 msgr2=0x7fdff80aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 shutdown_connections 2024-09-21T07:34:24.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.266+0000 7fe000600640 1 -- 172.21.15.64:0/700335934 wait complete. 2024-09-21T07:34:24.286 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-21T07:34:24.286 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:34:24.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:34:24.303 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:34:24.304 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'d', 'b', 'c'} 2024-09-21T07:34:24.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-21T07:34:24.510 INFO:teuthology.orchestra.run.smithi064.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-21T07:34:24.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-21T07:34:24.511 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- 172.21.15.64:0/1839650684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 msgr2=0x7f36280b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 --2- 172.21.15.64:0/1839650684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b4170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3614009870 tx=0x7f361401c6c0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- 172.21.15.64:0/1839650684 shutdown_connections 2024-09-21T07:34:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 --2- 172.21.15.64:0/1839650684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b4170 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- 172.21.15.64:0/1839650684 >> 172.21.15.64:0/1839650684 conn(0x7f362806d1c0 msgr2=0x7f362806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- 172.21.15.64:0/1839650684 shutdown_connections 2024-09-21T07:34:24.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- 172.21.15.64:0/1839650684 wait complete. 2024-09-21T07:34:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 Processor -- start 2024-09-21T07:34:24.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.670+0000 7f362fe00640 1 -- start start 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36280c5ea0 0x7f36281fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f362816afe0 con 0x7f36280d1d00 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f362816ae60 con 0x7f36280c5ea0 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f362816b160 con 0x7f36280b3d60 2024-09-21T07:34:24.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36280c5ea0 0x7f36281fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60212/0 (socket says 172.21.15.64:60212) 2024-09-21T07:34:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 -- 172.21.15.64:0/2693116380 learned_addr learned my addr 172.21.15.64:0/2693116380 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:24.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362d400640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 -- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 msgr2=0x7f36280b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 -- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36280c5ea0 msgr2=0x7f36281fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36280c5ea0 0x7f36281fbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 -- 172.21.15.64:0/2693116380 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36280b7e20 con 0x7f36280d1d00 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362de00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f362000cfd0 tx=0x7f3620002050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362000a9f0 con 0x7f36280d1d00 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3620017070 con 0x7f36280d1d00 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620012420 con 0x7f36280d1d00 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362806df00 con 0x7f36280d1d00 2024-09-21T07:34:24.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362806e4c0 con 0x7f36280d1d00 2024-09-21T07:34:24.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36280b4170 con 0x7f36280d1d00 2024-09-21T07:34:24.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.674+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f36200125c0 con 0x7f36280d1d00 2024-09-21T07:34:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.678+0000 7f3625600640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 0x7f3608075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.678+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f3620094520 con 0x7f36280d1d00 2024-09-21T07:34:24.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.678+0000 7f362d400640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 0x7f3608075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.678+0000 7f362d400640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 0x7f3608075740 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f361c007fd0 tx=0x7f361c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.682+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f36280b46b0 con 0x7f36280d1d00 2024-09-21T07:34:24.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.898+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36280d06b0 con 0x7f36280d1d00 2024-09-21T07:34:24.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.898+0000 7f3625600640 1 -- 172.21.15.64:0/2693116380 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f362005ecc0 con 0x7f36280d1d00 2024-09-21T07:34:24.899 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:24.900 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:24.900 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 msgr2=0x7f3608075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 0x7f3608075740 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f361c007fd0 tx=0x7f361c009040 comp rx=0 tx=0).stop 2024-09-21T07:34:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 msgr2=0x7f362815ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f362000cfd0 tx=0x7f3620002050 comp rx=0 tx=0).stop 2024-09-21T07:34:24.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 shutdown_connections 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3608073230 0x7f3608075740 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36280d1d00 0x7f362815ef20 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36280c5ea0 0x7f36281fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 --2- 172.21.15.64:0/2693116380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f36280b3d60 0x7f36280b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 >> 172.21.15.64:0/2693116380 conn(0x7f362806d1c0 msgr2=0x7f362815bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 shutdown_connections 2024-09-21T07:34:24.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:24.902+0000 7f362fe00640 1 -- 172.21.15.64:0/2693116380 wait complete. 2024-09-21T07:34:24.922 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-21T07:34:29.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 -- 172.21.15.64:0/1656076850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85740b1be0 msgr2=0x7f85740b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 --2- 172.21.15.64:0/1656076850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85740b1be0 0x7f85740b1ff0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f856001c8b0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 -- 172.21.15.64:0/1656076850 shutdown_connections 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 --2- 172.21.15.64:0/1656076850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f85740cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 --2- 172.21.15.64:0/1656076850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85740b1be0 0x7f85740b1ff0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 -- 172.21.15.64:0/1656076850 >> 172.21.15.64:0/1656076850 conn(0x7f85740ccbe0 msgr2=0x7f85740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 -- 172.21.15.64:0/1656076850 shutdown_connections 2024-09-21T07:34:30.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.094+0000 7f857c400640 1 -- 172.21.15.64:0/1656076850 wait complete. 2024-09-21T07:34:30.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 Processor -- start 2024-09-21T07:34:30.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- start start 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85740b1be0 0x7f85741465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f857415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85740b41f0 con 0x7f857415cbd0 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85740b4070 con 0x7f85740b1be0 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f85740b4370 con 0x7f85740cbcd0 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36716/0 (socket says 172.21.15.64:36716) 2024-09-21T07:34:30.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 -- 172.21.15.64:0/3199548523 learned_addr learned my addr 172.21.15.64:0/3199548523 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8579000640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f857415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8579a00640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85740b1be0 0x7f85741465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 -- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 msgr2=0x7f857415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f857415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 -- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85740b1be0 msgr2=0x7f85741465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85740b1be0 0x7f85741465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 -- 172.21.15.64:0/3199548523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857409afb0 con 0x7f857415cbd0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8579000640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f857415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857a400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f856c00caa0 tx=0x7f856c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c00adf0 con 0x7f857415cbd0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f856c003a70 con 0x7f857415cbd0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c004030 con 0x7f857415cbd0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857409b290 con 0x7f857415cbd0 2024-09-21T07:34:30.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.098+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857409b850 con 0x7f857415cbd0 2024-09-21T07:34:30.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.102+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85740b1ff0 con 0x7f857415cbd0 2024-09-21T07:34:30.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.102+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f856c0041d0 con 0x7f857415cbd0 2024-09-21T07:34:30.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.102+0000 7f8571600640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 0x7f8554075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.102+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f856c094c40 con 0x7f857415cbd0 2024-09-21T07:34:30.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.102+0000 7f8579a00640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 0x7f8554075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.106+0000 7f8579a00640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 0x7f8554075710 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8568001650 tx=0x7f8568009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.106+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f856c014070 con 0x7f857415cbd0 2024-09-21T07:34:30.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.318+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85740adc00 con 0x7f857415cbd0 2024-09-21T07:34:30.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.318+0000 7f8571600640 1 -- 172.21.15.64:0/3199548523 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f856c05fac0 con 0x7f857415cbd0 2024-09-21T07:34:30.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:30.320 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:30.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 msgr2=0x7f8554075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 0x7f8554075710 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8568001650 tx=0x7f8568009040 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 msgr2=0x7f857415b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f856c00caa0 tx=0x7f856c00cf60 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 shutdown_connections 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8554073200 0x7f8554075710 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f857415cbd0 0x7f857415b860 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f85740cbcd0 0x7f857415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 --2- 172.21.15.64:0/3199548523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85740b1be0 0x7f85741465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 >> 172.21.15.64:0/3199548523 conn(0x7f85740ccbe0 msgr2=0x7f85740ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 shutdown_connections 2024-09-21T07:34:30.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:30.322+0000 7f857c400640 1 -- 172.21.15.64:0/3199548523 wait complete. 2024-09-21T07:34:30.343 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-21T07:34:35.344 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:35.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 -- 172.21.15.64:0/3189099243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6c4004dc0 msgr2=0x7fc6c4005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 --2- 172.21.15.64:0/3189099243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6c4004dc0 0x7fc6c4005290 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0160190 tx=0x7fc6d801cee0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6dfe00640 1 -- 172.21.15.64:0/3189099243 reap_dead start 2024-09-21T07:34:35.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 -- 172.21.15.64:0/3189099243 shutdown_connections 2024-09-21T07:34:35.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 -- 172.21.15.64:0/3189099243 >> 172.21.15.64:0/3189099243 conn(0x7fc6e00ccbe0 msgr2=0x7fc6e00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:35.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 -- 172.21.15.64:0/3189099243 shutdown_connections 2024-09-21T07:34:35.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.514+0000 7fc6e6600640 1 -- 172.21.15.64:0/3189099243 wait complete. 2024-09-21T07:34:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 Processor -- start 2024-09-21T07:34:35.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- start start 2024-09-21T07:34:35.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4004dc0 0x7fc6e01f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 0x7fc6e009ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e00b2380 con 0x7fc6e00c3df0 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e00b2200 con 0x7fc6c4004dc0 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e00b3fc0 con 0x7fc6e009c630 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56360/0 (socket says 172.21.15.64:56360) 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 -- 172.21.15.64:0/1470750846 learned_addr learned my addr 172.21.15.64:0/1470750846 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6df400640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4004dc0 0x7fc6e01f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6dfe00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 0x7fc6e009ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 -- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 msgr2=0x7fc6e009ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 0x7fc6e009ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 -- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4004dc0 msgr2=0x7fc6e01f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4004dc0 0x7fc6e01f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 -- 172.21.15.64:0/1470750846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e00cc620 con 0x7fc6e00c3df0 2024-09-21T07:34:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6dfe00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 0x7fc6e009ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d6a00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80118b0 tx=0x7fc6c8011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800f9a0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.521 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6c800fb40 con 0x7fc6e00c3df0 2024-09-21T07:34:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8005020 con 0x7fc6e00c3df0 2024-09-21T07:34:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e00695a0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.518+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e009cf80 con 0x7fc6e00c3df0 2024-09-21T07:34:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e00cc0e0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc6c80051c0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6d7e00640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fc6c8094ff0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6df400640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.522+0000 7fc6df400640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 0x7fc6bc075710 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f90 tx=0x7fc6d0006f00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:35.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.526+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc6e009cf80 con 0x7fc6e00c3df0 2024-09-21T07:34:35.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6e00c48f0 con 0x7fc6e00c3df0 2024-09-21T07:34:35.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6d7e00640 1 -- 172.21.15.64:0/1470750846 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7fc6c805f880 con 0x7fc6e00c3df0 2024-09-21T07:34:35.746 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:35.746 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:35.746 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 msgr2=0x7fc6bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 0x7fc6bc075710 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f90 tx=0x7fc6d0006f00 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 msgr2=0x7fc6e00c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80118b0 tx=0x7fc6c8011d70 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 shutdown_connections 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6e009c630 0x7fc6e009ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6e00c3df0 0x7fc6e00c4200 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 --2- 172.21.15.64:0/1470750846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4004dc0 0x7fc6e01f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 >> 172.21.15.64:0/1470750846 conn(0x7fc6e00ccbe0 msgr2=0x7fc6e0072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:35.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 shutdown_connections 2024-09-21T07:34:35.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:35.746+0000 7fc6e6600640 1 -- 172.21.15.64:0/1470750846 wait complete. 2024-09-21T07:34:35.768 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-21T07:34:40.393 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:40.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:40.769 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:40.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- 172.21.15.64:0/2702312092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00cbcd0 msgr2=0x7f48a00cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:40.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 --2- 172.21.15.64:0/2702312092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00cbcd0 0x7f48a00cc0e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4898009c80 tx=0x7f489801cd70 comp rx=0 tx=0).stop 2024-09-21T07:34:40.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- 172.21.15.64:0/2702312092 shutdown_connections 2024-09-21T07:34:40.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 --2- 172.21.15.64:0/2702312092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00cbcd0 0x7f48a00cc0e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:40.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 --2- 172.21.15.64:0/2702312092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00b1be0 0x7f48a00b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- 172.21.15.64:0/2702312092 >> 172.21.15.64:0/2702312092 conn(0x7f48a00ccbe0 msgr2=0x7f48a00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- 172.21.15.64:0/2702312092 shutdown_connections 2024-09-21T07:34:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- 172.21.15.64:0/2702312092 wait complete. 2024-09-21T07:34:40.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 Processor -- start 2024-09-21T07:34:40.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.942+0000 7f48a8000640 1 -- start start 2024-09-21T07:34:40.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00b1be0 0x7f48a015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00cbcd0 0x7f48a014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00b4240 con 0x7f48a015cbd0 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00b40c0 con 0x7f48a00b1be0 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f48a016a290 con 0x7f48a00cbcd0 2024-09-21T07:34:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00b1be0 0x7f48a015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56368/0 (socket says 172.21.15.64:56368) 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 -- 172.21.15.64:0/3608584947 learned_addr learned my addr 172.21.15.64:0/3608584947 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a4c00640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00cbcd0 0x7f48a014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 -- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00cbcd0 msgr2=0x7f48a014f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00cbcd0 0x7f48a014f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 -- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00b1be0 msgr2=0x7f48a015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00b1be0 0x7f48a015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 -- 172.21.15.64:0/3608584947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a0159e20 con 0x7f48a015cbd0 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a6000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f48980b0040 tx=0x7f48980092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48980bc070 con 0x7f48a015cbd0 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48980042f0 con 0x7f48a015cbd0 2024-09-21T07:34:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a01fa920 con 0x7f48a015cbd0 2024-09-21T07:34:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48980b2040 con 0x7f48a015cbd0 2024-09-21T07:34:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a01faee0 con 0x7f48a015cbd0 2024-09-21T07:34:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.946+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a01fa690 con 0x7f48a015cbd0 2024-09-21T07:34:40.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.950+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f48980bf070 con 0x7f48a015cbd0 2024-09-21T07:34:40.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.950+0000 7f489d600640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 0x7f4880075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:40.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.950+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f489812df10 con 0x7f48a015cbd0 2024-09-21T07:34:40.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.950+0000 7f48a5600640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 0x7f4880075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:40.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.950+0000 7f48a5600640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 0x7f4880075710 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4894007fd0 tx=0x7f4894009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:40.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:40.954+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4898016990 con 0x7f48a015cbd0 2024-09-21T07:34:41.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48a014fb00 con 0x7f48a015cbd0 2024-09-21T07:34:41.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f489d600640 1 -- 172.21.15.64:0/3608584947 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f48a014fb00 con 0x7f48a015cbd0 2024-09-21T07:34:41.167 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:41.167 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":120,"btime":"2024-09-21T07:33:50:655586+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:33:50.083239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9094":{"gid":9094,"name":"a","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/130164325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":130164325},{"type":"v1","addr":"172.21.15.64:6835","nonce":130164325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9094,"qdb_cluster":[9094]},"id":11}]} 2024-09-21T07:34:41.167 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 120 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 msgr2=0x7f4880075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 0x7f4880075710 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4894007fd0 tx=0x7f4894009040 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 msgr2=0x7f48a00ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f48980b0040 tx=0x7f48980092c0 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 shutdown_connections 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4880073200 0x7f4880075710 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48a015cbd0 0x7f48a00ae6a0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48a00cbcd0 0x7f48a014f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 --2- 172.21.15.64:0/3608584947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48a00b1be0 0x7f48a015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.166+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 >> 172.21.15.64:0/3608584947 conn(0x7f48a00ccbe0 msgr2=0x7f48a00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:41.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.170+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 shutdown_connections 2024-09-21T07:34:41.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:41.170+0000 7f48a8000640 1 -- 172.21.15.64:0/3608584947 wait complete. 2024-09-21T07:34:41.190 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-21T07:34:46.191 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:46.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- 172.21.15.64:0/2776780048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0b48d0 msgr2=0x7f223c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 --2- 172.21.15.64:0/2776780048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0b48d0 0x7f223c072e20 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f2234009bc0 tx=0x7f223401cba0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- 172.21.15.64:0/2776780048 shutdown_connections 2024-09-21T07:34:46.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 --2- 172.21.15.64:0/2776780048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0b48d0 0x7f223c072e20 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- 172.21.15.64:0/2776780048 >> 172.21.15.64:0/2776780048 conn(0x7f223c0ccbe0 msgr2=0x7f223c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:46.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- 172.21.15.64:0/2776780048 shutdown_connections 2024-09-21T07:34:46.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- 172.21.15.64:0/2776780048 wait complete. 2024-09-21T07:34:46.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 Processor -- start 2024-09-21T07:34:46.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.350+0000 7f2241000640 1 -- start start 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 0x7f223c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 0x7f223c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f223c16a470 con 0x7f223c0709b0 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f223c16a2f0 con 0x7f223c15edb0 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f223c16a5f0 con 0x7f223c152610 2024-09-21T07:34:46.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49320/0 (socket says 172.21.15.64:49320) 2024-09-21T07:34:46.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 -- 172.21.15.64:0/3268730573 learned_addr learned my addr 172.21.15.64:0/3268730573 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2233e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 0x7f223c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f223a800640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 0x7f223c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 -- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 msgr2=0x7f223c153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 0x7f223c153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 -- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 msgr2=0x7f223c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 0x7f223c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 -- 172.21.15.64:0/3268730573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c0ae2c0 con 0x7f223c0709b0 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f223a800640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 0x7f223c153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2233e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 0x7f223c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:46.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2239e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c430 tx=0x7f222c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c017070 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f222c0053c0 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c003860 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c0af0a0 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c0ae840 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c0aea40 con 0x7f223c0709b0 2024-09-21T07:34:46.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.354+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f222c01a070 con 0x7f223c0709b0 2024-09-21T07:34:46.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.358+0000 7f2232000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 0x7f2218075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.358+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f222c093870 con 0x7f223c0709b0 2024-09-21T07:34:46.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.358+0000 7f2233e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 0x7f2218075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.358+0000 7f2233e00640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 0x7f2218075740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2224001230 tx=0x7f2224009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:46.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.362+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f223c0aea40 con 0x7f223c0709b0 2024-09-21T07:34:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.570+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f223c072e20 con 0x7f223c0709b0 2024-09-21T07:34:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2232000640 1 -- 172.21.15.64:0/3268730573 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7f222c05e6a0 con 0x7f223c0709b0 2024-09-21T07:34:46.573 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:46.573 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 msgr2=0x7f2218075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 0x7f2218075740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2224001230 tx=0x7f2224009040 comp rx=0 tx=0).stop 2024-09-21T07:34:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 msgr2=0x7f223c0b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c430 tx=0x7f222c00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 shutdown_connections 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2218073230 0x7f2218075740 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f223c152610 0x7f223c153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c15edb0 0x7f223c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 --2- 172.21.15.64:0/3268730573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f223c0709b0 0x7f223c0b01e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 >> 172.21.15.64:0/3268730573 conn(0x7f223c0ccbe0 msgr2=0x7f223c155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 shutdown_connections 2024-09-21T07:34:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.574+0000 7f2241000640 1 -- 172.21.15.64:0/3268730573 wait complete. 2024-09-21T07:34:46.595 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-21T07:34:46.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:46.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 -- 172.21.15.64:0/3605910536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 msgr2=0x7ff7f00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 --2- 172.21.15.64:0/3605910536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f00b41c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00af810 tx=0x7ff7dc01c6e0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 -- 172.21.15.64:0/3605910536 shutdown_connections 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 --2- 172.21.15.64:0/3605910536 >> v2:172.21.15.90:3300/0 conn(0x7ff7f00b4700 0x7ff7f0072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 --2- 172.21.15.64:0/3605910536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f00b41c0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 -- 172.21.15.64:0/3605910536 >> 172.21.15.64:0/3605910536 conn(0x7ff7f00ccbe0 msgr2=0x7ff7f00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 -- 172.21.15.64:0/3605910536 shutdown_connections 2024-09-21T07:34:46.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.754+0000 7ff7f7400640 1 -- 172.21.15.64:0/3605910536 wait complete. 2024-09-21T07:34:46.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 Processor -- start 2024-09-21T07:34:46.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 -- start start 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 0x7ff7f015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7f015edb0 0x7ff7f00aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0168b90 con 0x7ff7f00709b0 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0168a10 con 0x7ff7f015edb0 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f0168d10 con 0x7ff7f00b4700 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49328/0 (socket says 172.21.15.64:49328) 2024-09-21T07:34:46.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 -- 172.21.15.64:0/2204746580 learned_addr learned my addr 172.21.15.64:0/2204746580 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f5400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7f015edb0 0x7ff7f00aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7efe00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 0x7ff7f015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 -- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 msgr2=0x7ff7f015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 0x7ff7f015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 -- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7f015edb0 msgr2=0x7ff7f00aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7f015edb0 0x7ff7f00aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 -- 172.21.15.64:0/2204746580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f009d6c0 con 0x7ff7f00709b0 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7efe00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 0x7ff7f015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:46.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f4a00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400b410 tx=0x7ff7e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4015030 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7e4004020 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40044b0 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.758+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f009bc90 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f009c250 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f00b41c0 con 0x7ff7f00709b0 2024-09-21T07:34:46.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff7e4018070 con 0x7ff7f00709b0 2024-09-21T07:34:46.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7ecc00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 0x7ff7d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:46.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7ff7e4093f80 con 0x7ff7f00709b0 2024-09-21T07:34:46.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.762+0000 7ff7efe00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 0x7ff7d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:46.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.766+0000 7ff7efe00640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 0x7ff7d0075710 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0af000 tx=0x7ff7dc01af20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:46.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.766+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff7e405edb0 con 0x7ff7f00709b0 2024-09-21T07:34:46.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7f009da20 con 0x7ff7f00709b0 2024-09-21T07:34:46.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7ecc00640 1 -- 172.21.15.64:0/2204746580 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7ff7e405e6b0 con 0x7ff7f00709b0 2024-09-21T07:34:46.986 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:46.986 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 msgr2=0x7ff7d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 0x7ff7d0075710 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0af000 tx=0x7ff7dc01af20 comp rx=0 tx=0).stop 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 msgr2=0x7ff7f009cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.986+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400b410 tx=0x7ff7e400b8d0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 shutdown_connections 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff7d0073200 0x7ff7d0075710 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7f015edb0 0x7ff7f00aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7f00b4700 0x7ff7f015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 --2- 172.21.15.64:0/2204746580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff7f00709b0 0x7ff7f009cb70 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 >> 172.21.15.64:0/2204746580 conn(0x7ff7f00ccbe0 msgr2=0x7ff7f0159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 shutdown_connections 2024-09-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:46.990+0000 7ff7f7400640 1 -- 172.21.15.64:0/2204746580 wait complete. 2024-09-21T07:34:47.009 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-21T07:34:47.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:34:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.166+0000 7f7dc5a00640 1 -- 172.21.15.64:0/951339468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00709b0 msgr2=0x7f7dc00b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.166+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/951339468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00709b0 0x7f7dc00b41c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009900 tx=0x7f7da801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- 172.21.15.64:0/951339468 shutdown_connections 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/951339468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00709b0 0x7f7dc00b41c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/951339468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 0x7f7dc00700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- 172.21.15.64:0/951339468 >> 172.21.15.64:0/951339468 conn(0x7f7dc00ccbe0 msgr2=0x7f7dc00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- 172.21.15.64:0/951339468 shutdown_connections 2024-09-21T07:34:47.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- 172.21.15.64:0/951339468 wait complete. 2024-09-21T07:34:47.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 Processor -- start 2024-09-21T07:34:47.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- start start 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00b4700 0x7f7dc00b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 0x7f7dc00b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0169020 con 0x7f7dc00709b0 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0168ea0 con 0x7f7dc00b4700 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.170+0000 7f7dc5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc01691a0 con 0x7f7dc015edb0 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49344/0 (socket says 172.21.15.64:49344) 2024-09-21T07:34:47.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 -- 172.21.15.64:0/3605492517 learned_addr learned my addr 172.21.15.64:0/3605492517 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbf400640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 0x7f7dc00b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7db7e00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00b4700 0x7f7dc00b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 -- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 msgr2=0x7f7dc00b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 0x7f7dc00b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 -- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00b4700 msgr2=0x7f7dc00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00b4700 0x7f7dc00b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 -- 172.21.15.64:0/3605492517 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00b2970 con 0x7f7dc00709b0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dbea00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e7d0 tx=0x7f7db000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000ccc0 con 0x7f7dc00709b0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc01fc830 con 0x7f7dc00709b0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db0010430 con 0x7f7dc00709b0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0010860 con 0x7f7dc00709b0 2024-09-21T07:34:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01fcdf0 con 0x7f7dc00709b0 2024-09-21T07:34:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc00b41c0 con 0x7f7dc00709b0 2024-09-21T07:34:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.174+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7db0010a00 con 0x7f7dc00709b0 2024-09-21T07:34:47.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.178+0000 7f7db6a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 0x7f7d9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.178+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f7db0094f90 con 0x7f7dc00709b0 2024-09-21T07:34:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.178+0000 7f7db7e00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 0x7f7d9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.178+0000 7f7db7e00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 0x7f7d9c075710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7da80af000 tx=0x7f7da801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.182+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7db005fcb0 con 0x7f7dc00709b0 2024-09-21T07:34:47.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7dc0073010 con 0x7f7dc00709b0 2024-09-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7db6a00640 1 -- 172.21.15.64:0/3605492517 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1065 (secure 0 0 0) 0x7f7db005f5b0 con 0x7f7dc00709b0 2024-09-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":745,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076695148,"bytes_used":2611863552,"bytes_avail":770482249728,"bytes_total":773094113280,"read_bytes_sec":614,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":9085}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-21T07:34:43.619250+0000","services":{}},"progress_events":{}} 2024-09-21T07:34:47.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 msgr2=0x7f7d9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 0x7f7d9c075710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7da80af000 tx=0x7f7da801b120 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 msgr2=0x7f7dc0157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e7d0 tx=0x7f7db000ec90 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 shutdown_connections 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d9c073200 0x7f7d9c075710 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7dc015edb0 0x7f7dc00b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc00b4700 0x7f7dc00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 --2- 172.21.15.64:0/3605492517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dc00709b0 0x7f7dc0157660 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 >> 172.21.15.64:0/3605492517 conn(0x7f7dc00ccbe0 msgr2=0x7f7dc00ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 shutdown_connections 2024-09-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.422+0000 7f7dc5a00640 1 -- 172.21.15.64:0/3605492517 wait complete. 2024-09-21T07:34:47.447 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:34:47.447 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:34:47.595 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:34:47.680 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:34:47.681 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:34:47.681 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:34:47.681 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:47.690 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:34:47.691 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:47.748 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:34:47.820 INFO:tasks.ceph.mds.d.smithi090.stderr:2024-09-21T07:34:47.820+0000 7efe34800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 -- 172.21.15.64:0/732756557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5368003ad0 msgr2=0x7f5368003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 --2- 172.21.15.64:0/732756557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5368003ad0 0x7f5368003f40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f5374001720 tx=0x7f537401c730 comp rx=0 tx=0).stop 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 -- 172.21.15.64:0/732756557 shutdown_connections 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 --2- 172.21.15.64:0/732756557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5368003ad0 0x7f5368003f40 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 -- 172.21.15.64:0/732756557 >> 172.21.15.64:0/732756557 conn(0x7f538406d450 msgr2=0x7f53840d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 -- 172.21.15.64:0/732756557 shutdown_connections 2024-09-21T07:34:47.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.954+0000 7f538b200640 1 -- 172.21.15.64:0/732756557 wait complete. 2024-09-21T07:34:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 Processor -- start 2024-09-21T07:34:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- start start 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 0x7f53841568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 0x7f53840c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53840ce8b0 con 0x7f53840c96b0 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53840ce730 con 0x7f53840c8d60 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f53840cea30 con 0x7f5368003ad0 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49362/0 (socket says 172.21.15.64:49362) 2024-09-21T07:34:47.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 -- 172.21.15.64:0/18099850 learned_addr learned my addr 172.21.15.64:0/18099850 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f537be00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 0x7f53840c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5383e00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 0x7f53841568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 -- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 msgr2=0x7f53841568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 0x7f53841568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 -- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 msgr2=0x7f53840c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 0x7f53840c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 -- 172.21.15.64:0/18099850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53840c9de0 con 0x7f53840c96b0 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f537be00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 0x7f53840c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5383e00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 0x7f53841568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5389200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f90 tx=0x7f537c00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c00c970 con 0x7f53840c96b0 2024-09-21T07:34:47.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f537c018070 con 0x7f53840c96b0 2024-09-21T07:34:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c011460 con 0x7f53840c96b0 2024-09-21T07:34:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53840c85a0 con 0x7f53840c96b0 2024-09-21T07:34:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.958+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53841fd030 con 0x7f53840c96b0 2024-09-21T07:34:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.962+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53840cef90 con 0x7f53840c96b0 2024-09-21T07:34:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.962+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f537c011600 con 0x7f53840c96b0 2024-09-21T07:34:47.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.962+0000 7f5380c00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 0x7f5360075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:47.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.962+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f537c094930 con 0x7f53840c96b0 2024-09-21T07:34:47.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.962+0000 7f5383e00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 0x7f5360075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:47.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.966+0000 7f5383e00640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 0x7f5360075710 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f53740ab000 tx=0x7f5374019520 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:47.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:47.966+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f537c05f760 con 0x7f53840c96b0 2024-09-21T07:34:48.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.158+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53841fd560 con 0x7f53840c96b0 2024-09-21T07:34:48.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.158+0000 7f5380c00640 1 -- 172.21.15.64:0/18099850 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v168) ==== 80+0+120 (secure 0 0 0) 0x7f537c05f060 con 0x7f53840c96b0 2024-09-21T07:34:48.160 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6835/130164325 2024-09-22T07:34:42.058595+0000 2024-09-21T07:34:48.160 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6833/130164325 2024-09-22T07:34:42.058595+0000 2024-09-21T07:34:48.160 INFO:teuthology.orchestra.run.smithi064.stderr:listed 2 entries 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 msgr2=0x7f5360075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 0x7f5360075710 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f53740ab000 tx=0x7f5374019520 comp rx=0 tx=0).stop 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 msgr2=0x7f53840b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f90 tx=0x7f537c00eb00 comp rx=0 tx=0).stop 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 shutdown_connections 2024-09-21T07:34:48.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5360073200 0x7f5360075710 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53840c96b0 0x7f53840b1db0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53840c8d60 0x7f53840c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 --2- 172.21.15.64:0/18099850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5368003ad0 0x7f53841568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 >> 172.21.15.64:0/18099850 conn(0x7f538406d450 msgr2=0x7f53840c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 shutdown_connections 2024-09-21T07:34:48.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.162+0000 7f538b200640 1 -- 172.21.15.64:0/18099850 wait complete. 2024-09-21T07:34:48.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:34:48.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:48.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:48.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:34:48.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:48.209 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:34:48.265 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:34:48.265 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:34:48.265 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:48.275 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:34:48.275 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:34:48.275 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:34:48.275 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:48.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:34:48.316 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:34:48.317 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:34:48.317 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:48.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:34:48.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 -- 172.21.15.64:0/979178038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c15edb0 msgr2=0x7f5c1c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 --2- 172.21.15.64:0/979178038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c15edb0 0x7f5c1c0700b0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0728d0 tx=0x7f5c1001c860 comp rx=0 tx=0).stop 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 -- 172.21.15.64:0/979178038 shutdown_connections 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 --2- 172.21.15.64:0/979178038 >> v2:172.21.15.90:3300/0 conn(0x7f5c1c0b4700 0x7f5c1c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 --2- 172.21.15.64:0/979178038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c0709b0 0x7f5c1c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 --2- 172.21.15.64:0/979178038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c15edb0 0x7f5c1c0700b0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 -- 172.21.15.64:0/979178038 >> 172.21.15.64:0/979178038 conn(0x7f5c1c0ccbe0 msgr2=0x7f5c1c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:48.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 -- 172.21.15.64:0/979178038 shutdown_connections 2024-09-21T07:34:48.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.522+0000 7f5c23e00640 1 -- 172.21.15.64:0/979178038 wait complete. 2024-09-21T07:34:48.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 Processor -- start 2024-09-21T07:34:48.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- start start 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c1c0709b0 0x7f5c1c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 0x7f5c1c09d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0b2380 con 0x7f5c1c0b4700 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0b2200 con 0x7f5c1c0709b0 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c0b2500 con 0x7f5c1c15edb0 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49392/0 (socket says 172.21.15.64:49392) 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 -- 172.21.15.64:0/374507375 learned_addr learned my addr 172.21.15.64:0/374507375 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c21400640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c1c0709b0 0x7f5c1c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c21e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 0x7f5c1c09d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 -- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 msgr2=0x7f5c1c09d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 0x7f5c1c09d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 -- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c1c0709b0 msgr2=0x7f5c1c14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c1c0709b0 0x7f5c1c14f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 -- 172.21.15.64:0/374507375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c0c3e70 con 0x7f5c1c0b4700 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c21e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 0x7f5c1c09d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c20a00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d700 tx=0x7f5c0800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08017070 con 0x7f5c1c0b4700 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c08009b10 con 0x7f5c1c0b4700 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c0c4150 con 0x7f5c1c0b4700 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08010460 con 0x7f5c1c0b4700 2024-09-21T07:34:48.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.526+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c0c4710 con 0x7f5c1c0b4700 2024-09-21T07:34:48.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c072e20 con 0x7f5c1c0b4700 2024-09-21T07:34:48.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5c0801a070 con 0x7f5c1c0b4700 2024-09-21T07:34:48.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c19600640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 0x7f5bfc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f5c08094450 con 0x7f5c1c0b4700 2024-09-21T07:34:48.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c21400640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 0x7f5bfc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.530+0000 7f5c21400640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 0x7f5bfc075740 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c100af000 tx=0x7f5c1001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:48.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.534+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5c0805ec30 con 0x7f5c1c0b4700 2024-09-21T07:34:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c1c0b31e0 con 0x7f5c1c0b4700 2024-09-21T07:34:48.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c19600640 1 -- 172.21.15.64:0/374507375 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7f5c08063660 con 0x7f5c1c0b4700 2024-09-21T07:34:48.750 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:48.750 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:48.750 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 msgr2=0x7f5bfc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 0x7f5bfc075740 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c100af000 tx=0x7f5c1001b100 comp rx=0 tx=0).stop 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 msgr2=0x7f5c1c09ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d700 tx=0x7f5c0800dbc0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 shutdown_connections 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5bfc073230 0x7f5bfc075740 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c1c15edb0 0x7f5c1c09d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c0b4700 0x7f5c1c09ce60 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 --2- 172.21.15.64:0/374507375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c1c0709b0 0x7f5c1c14f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 >> 172.21.15.64:0/374507375 conn(0x7f5c1c0ccbe0 msgr2=0x7f5c1c0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 shutdown_connections 2024-09-21T07:34:48.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.750+0000 7f5c23e00640 1 -- 172.21.15.64:0/374507375 wait complete. 2024-09-21T07:34:48.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:48.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8cfe00640 1 -- 172.21.15.64:0/1757039072 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4001700 con 0x7fe8d00cb2d0 2024-09-21T07:34:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1757039072 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00cb2d0 msgr2=0x7fe8d00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1757039072 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00cb2d0 0x7fe8d00b3830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800ad00 tx=0x7fe8c801de30 comp rx=0 tx=0).stop 2024-09-21T07:34:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1757039072 shutdown_connections 2024-09-21T07:34:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1757039072 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00cb2d0 0x7fe8d00b3830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1757039072 >> 172.21.15.64:0/1757039072 conn(0x7fe8d00ccbe0 msgr2=0x7fe8d00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1757039072 shutdown_connections 2024-09-21T07:34:48.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.930+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1757039072 wait complete. 2024-09-21T07:34:48.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 Processor -- start 2024-09-21T07:34:48.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 -- start start 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00b24e0 0x7fe8d0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8d00cb2d0 0x7fe8d0151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01693a0 con 0x7fe8d00caec0 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0169220 con 0x7fe8d00cb2d0 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d7e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d0169520 con 0x7fe8d00b24e0 2024-09-21T07:34:48.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49398/0 (socket says 172.21.15.64:49398) 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d4a00640 1 -- 172.21.15.64:0/1709748412 learned_addr learned my addr 172.21.15.64:0/1709748412 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d5400640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00b24e0 0x7fe8d0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.934+0000 7fe8d5e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8d00cb2d0 0x7fe8d0151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 -- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00b24e0 msgr2=0x7fe8d0150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00b24e0 0x7fe8d0150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 -- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8d00cb2d0 msgr2=0x7fe8d0151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8d00cb2d0 0x7fe8d0151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 -- 172.21.15.64:0/1709748412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d01548c0 con 0x7fe8d00caec0 2024-09-21T07:34:48.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d4a00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c430 tx=0x7fe8bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8bc0053c0 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d0073e10 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc003860 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00743d0 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d00ca7b0 con 0x7fe8d00caec0 2024-09-21T07:34:48.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.938+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8bc01a070 con 0x7fe8d00caec0 2024-09-21T07:34:48.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.942+0000 7fe8cd600640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 0x7fe8b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:48.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.942+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7fe8bc093770 con 0x7fe8d00caec0 2024-09-21T07:34:48.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.942+0000 7fe8d5400640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 0x7fe8b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:48.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.942+0000 7fe8d5400640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 0x7fe8b0075710 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c10 tx=0x7fe8c4001730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:48.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:48.946+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe8bc05df50 con 0x7fe8d00caec0 2024-09-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8d00b4690 con 0x7fe8d00caec0 2024-09-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8cd600640 1 -- 172.21.15.64:0/1709748412 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7fe8bc062980 con 0x7fe8d00caec0 2024-09-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 msgr2=0x7fe8b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 0x7fe8b0075710 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c10 tx=0x7fe8c4001730 comp rx=0 tx=0).stop 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 msgr2=0x7fe8d0153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.158+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c430 tx=0x7fe8bc00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 shutdown_connections 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8b0073200 0x7fe8b0075710 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8d00cb2d0 0x7fe8d0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00caec0 0x7fe8d0153f50 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 --2- 172.21.15.64:0/1709748412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8d00b24e0 0x7fe8d0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 >> 172.21.15.64:0/1709748412 conn(0x7fe8d00ccbe0 msgr2=0x7fe8d0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 shutdown_connections 2024-09-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.162+0000 7fe8d7e00640 1 -- 172.21.15.64:0/1709748412 wait complete. 2024-09-21T07:34:49.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 -- 172.21.15.64:0/3029660016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40d0080 msgr2=0x7fb0d40d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/3029660016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40d0080 0x7fb0d40d0490 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4072190 tx=0x7fb0cc01cc60 comp rx=0 tx=0).stop 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 -- 172.21.15.64:0/3029660016 shutdown_connections 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/3029660016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40d0080 0x7fb0d40d0490 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/3029660016 >> v2:172.21.15.90:3300/0 conn(0x7fb0d40b7a60 0x7fb0d40cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 -- 172.21.15.64:0/3029660016 >> 172.21.15.64:0/3029660016 conn(0x7fb0d406d480 msgr2=0x7fb0d40d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 -- 172.21.15.64:0/3029660016 shutdown_connections 2024-09-21T07:34:49.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.342+0000 7fb0d9a00640 1 -- 172.21.15.64:0/3029660016 wait complete. 2024-09-21T07:34:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 Processor -- start 2024-09-21T07:34:49.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- start start 2024-09-21T07:34:49.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40b3ce0 0x7fb0d41fc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d40d0080 0x7fb0d41f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4169b20 con 0x7fb0d40b7a60 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d41699a0 con 0x7fb0d40d0080 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d4169ca0 con 0x7fb0d40b3ce0 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49420/0 (socket says 172.21.15.64:49420) 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 -- 172.21.15.64:0/4289507512 learned_addr learned my addr 172.21.15.64:0/4289507512 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d2a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40b3ce0 0x7fb0d41fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d3400640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d40d0080 0x7fb0d41f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 -- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40b3ce0 msgr2=0x7fb0d41fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40b3ce0 0x7fb0d41fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 -- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d40d0080 msgr2=0x7fb0d41f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d40d0080 0x7fb0d41f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 -- 172.21.15.64:0/4289507512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d41fc900 con 0x7fb0d40b7a60 2024-09-21T07:34:49.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0cbe00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c3f0 tx=0x7fb0bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:49.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc017070 con 0x7fb0d40b7a60 2024-09-21T07:34:49.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0bc0053c0 con 0x7fb0d40b7a60 2024-09-21T07:34:49.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003860 con 0x7fb0d40b7a60 2024-09-21T07:34:49.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41fcbe0 con 0x7fb0d40b7a60 2024-09-21T07:34:49.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.346+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d4159da0 con 0x7fb0d40b7a60 2024-09-21T07:34:49.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.350+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40cd1c0 con 0x7fb0d40b7a60 2024-09-21T07:34:49.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.350+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0bc01a070 con 0x7fb0d40b7a60 2024-09-21T07:34:49.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.350+0000 7fb0caa00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 0x7fb0b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.350+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7fb0bc093660 con 0x7fb0d40b7a60 2024-09-21T07:34:49.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.350+0000 7fb0d2a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 0x7fb0b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.354+0000 7fb0d2a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 0x7fb0b0075710 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009b40 tx=0x7fb0c40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:49.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.354+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb0bc05dee0 con 0x7fb0d40b7a60 2024-09-21T07:34:49.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.538+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0d41fc690 con 0x7fb0d40b7a60 2024-09-21T07:34:49.539 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.538+0000 7fb0caa00640 1 -- 172.21.15.64:0/4289507512 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+17023 (secure 0 0 0) 0x7fb0bc062910 con 0x7fb0d40b7a60 2024-09-21T07:34:49.539 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":168,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:34:42.058648+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:33:44.789416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-21T07:33:45.996202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/130164325":"2024-09-22T07:34:42.058595+0000","172.21.15.64:6833/130164325":"2024-09-22T07:34:42.058595+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:34:49.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 msgr2=0x7fb0b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 0x7fb0b0075710 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009b40 tx=0x7fb0c40091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 msgr2=0x7fb0d4159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c3f0 tx=0x7fb0bc00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 shutdown_connections 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb0b0073200 0x7fb0b0075710 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d40d0080 0x7fb0d41f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0d40b7a60 0x7fb0d4159860 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 --2- 172.21.15.64:0/4289507512 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40b3ce0 0x7fb0d41fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 >> 172.21.15.64:0/4289507512 conn(0x7fb0d406d480 msgr2=0x7fb0d40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 shutdown_connections 2024-09-21T07:34:49.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.542+0000 7fb0d9a00640 1 -- 172.21.15.64:0/4289507512 wait complete. 2024-09-21T07:34:49.562 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:34:49.563 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:49.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- 172.21.15.64:0/2238358526 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 msgr2=0x7efd940700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 --2- 172.21.15.64:0/2238358526 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940700b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd8801c860 comp rx=0 tx=0).stop 2024-09-21T07:34:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- 172.21.15.64:0/2238358526 shutdown_connections 2024-09-21T07:34:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 --2- 172.21.15.64:0/2238358526 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940700b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- 172.21.15.64:0/2238358526 >> 172.21.15.64:0/2238358526 conn(0x7efd940ccbe0 msgr2=0x7efd940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- 172.21.15.64:0/2238358526 shutdown_connections 2024-09-21T07:34:49.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- 172.21.15.64:0/2238358526 wait complete. 2024-09-21T07:34:49.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 Processor -- start 2024-09-21T07:34:49.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.722+0000 7efd9c400640 1 -- start start 2024-09-21T07:34:49.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd941fc350 0x7efd940ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efd9416a330 con 0x7efd940709b0 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd9416a1b0 con 0x7efd941fc350 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efd9416a4b0 con 0x7efd9415edb0 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49422/0 (socket says 172.21.15.64:49422) 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 -- 172.21.15.64:0/3272389639 learned_addr learned my addr 172.21.15.64:0/3272389639 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9a400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd941fc350 0x7efd940ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99000640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 -- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 msgr2=0x7efd940ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 -- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd941fc350 msgr2=0x7efd940ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd941fc350 0x7efd940ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 -- 172.21.15.64:0/3272389639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd941fcac0 con 0x7efd940709b0 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd99a00640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7efd8801a490 tx=0x7efd880a5f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880b2040 con 0x7efd940709b0 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd88004320 con 0x7efd940709b0 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941fcda0 con 0x7efd940709b0 2024-09-21T07:34:49.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880044f0 con 0x7efd940709b0 2024-09-21T07:34:49.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9415bcb0 con 0x7efd940709b0 2024-09-21T07:34:49.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.726+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd940700b0 con 0x7efd940709b0 2024-09-21T07:34:49.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.730+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd880052d0 con 0x7efd940709b0 2024-09-21T07:34:49.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.730+0000 7efd91600640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 0x7efd74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:49.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.730+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7efd8812ddc0 con 0x7efd940709b0 2024-09-21T07:34:49.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.730+0000 7efd99000640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 0x7efd74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:49.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.730+0000 7efd99000640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 0x7efd74075710 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efd940cb880 tx=0x7efd80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:49.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.734+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efd88016450 con 0x7efd940709b0 2024-09-21T07:34:49.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.946+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd9409da20 con 0x7efd940709b0 2024-09-21T07:34:49.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd91600640 1 -- 172.21.15.64:0/3272389639 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7efd880f8b70 con 0x7efd940709b0 2024-09-21T07:34:49.949 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:49.949 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:49.950 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 msgr2=0x7efd74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 0x7efd74075710 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efd940cb880 tx=0x7efd80009040 comp rx=0 tx=0).stop 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 msgr2=0x7efd94155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7efd8801a490 tx=0x7efd880a5f80 comp rx=0 tx=0).stop 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 shutdown_connections 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd74073200 0x7efd74075710 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd941fc350 0x7efd940ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd9415edb0 0x7efd940ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 --2- 172.21.15.64:0/3272389639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd940709b0 0x7efd94155a90 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:49.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 >> 172.21.15.64:0/3272389639 conn(0x7efd940ccbe0 msgr2=0x7efd94156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:49.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 shutdown_connections 2024-09-21T07:34:49.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:49.950+0000 7efd9c400640 1 -- 172.21.15.64:0/3272389639 wait complete. 2024-09-21T07:34:49.973 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:50.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 -- 172.21.15.64:0/263433714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 msgr2=0x7f68c4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 --2- 172.21.15.64:0/263433714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68c4003f40 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f68d000c310 tx=0x7f68d001f6c0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 -- 172.21.15.64:0/263433714 shutdown_connections 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 --2- 172.21.15.64:0/263433714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68c4003f40 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 -- 172.21.15.64:0/263433714 >> 172.21.15.64:0/263433714 conn(0x7f68dc0cd3a0 msgr2=0x7f68dc0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 -- 172.21.15.64:0/263433714 shutdown_connections 2024-09-21T07:34:50.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.134+0000 7f68e2800640 1 -- 172.21.15.64:0/263433714 wait complete. 2024-09-21T07:34:50.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 Processor -- start 2024-09-21T07:34:50.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- start start 2024-09-21T07:34:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68dc0c8510 0x7f68dc153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 0x7f68dc15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc070dc0 con 0x7f68c4003ad0 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc070c40 con 0x7f68dc0c8510 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc0ce520 con 0x7f68dc15bc40 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49430/0 (socket says 172.21.15.64:49430) 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 -- 172.21.15.64:0/2111992221 learned_addr learned my addr 172.21.15.64:0/2111992221 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e0a00640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68dc0c8510 0x7f68dc153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1e00640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 0x7f68dc15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 -- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 msgr2=0x7f68dc15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 0x7f68dc15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 -- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68dc0c8510 msgr2=0x7f68dc153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68dc0c8510 0x7f68dc153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 -- 172.21.15.64:0/2111992221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc0b0ca0 con 0x7f68c4003ad0 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1e00640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 0x7f68dc15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:50.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e1400640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f68d001ddc0 tx=0x7f68d0006690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d00b3070 con 0x7f68c4003ad0 2024-09-21T07:34:50.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d00be070 con 0x7f68c4003ad0 2024-09-21T07:34:50.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc0b0f80 con 0x7f68c4003ad0 2024-09-21T07:34:50.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0001d00 con 0x7f68c4003ad0 2024-09-21T07:34:50.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.138+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc0c7d10 con 0x7f68c4003ad0 2024-09-21T07:34:50.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc0c8920 con 0x7f68c4003ad0 2024-09-21T07:34:50.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f68d0003860 con 0x7f68c4003ad0 2024-09-21T07:34:50.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68d9600640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 0x7f68bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f68d01320b0 con 0x7f68c4003ad0 2024-09-21T07:34:50.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68e0a00640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 0x7f68bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.142+0000 7f68e0a00640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 0x7f68bc075740 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f68c800a580 tx=0x7f68c800a2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.146+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f68d0019470 con 0x7f68c4003ad0 2024-09-21T07:34:50.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.358+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68dc15e2e0 con 0x7f68c4003ad0 2024-09-21T07:34:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68d9600640 1 -- 172.21.15.64:0/2111992221 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+4410 (secure 0 0 0) 0x7f68d00fc890 con 0x7f68c4003ad0 2024-09-21T07:34:50.361 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:50.361 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":124,"btime":"2024-09-21T07:34:45:071203+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:33:47.029522+0000","modified":"2024-09-21T07:34:45.071192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":168,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9085":{"gid":9085,"name":"d","rank":0,"incarnation":121,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6836/2090079902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2090079902},{"type":"v1","addr":"172.21.15.90:6836","nonce":2090079902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9085,"qdb_cluster":[9085]},"id":11}]} 2024-09-21T07:34:50.361 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 124 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 msgr2=0x7f68bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 0x7f68bc075740 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f68c800a580 tx=0x7f68c800a2f0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 msgr2=0x7f68dc0c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f68d001ddc0 tx=0x7f68d0006690 comp rx=0 tx=0).stop 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 shutdown_connections 2024-09-21T07:34:50.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f68bc073230 0x7f68bc075740 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f68dc15bc40 0x7f68dc15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68dc0c8510 0x7f68dc153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 --2- 172.21.15.64:0/2111992221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c4003ad0 0x7f68dc0c9c20 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 >> 172.21.15.64:0/2111992221 conn(0x7f68dc0cd3a0 msgr2=0x7f68dc0c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 shutdown_connections 2024-09-21T07:34:50.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.362+0000 7f68e2800640 1 -- 172.21.15.64:0/2111992221 wait complete. 2024-09-21T07:34:50.384 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:34:50.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 -- 172.21.15.64:0/4099544663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf34005290 msgr2=0x7faf3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 --2- 172.21.15.64:0/4099544663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf34005290 0x7faf3400b9d0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0cc6f0 tx=0x7faf4401cbe0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf51400640 1 -- 172.21.15.64:0/4099544663 reap_dead start 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 -- 172.21.15.64:0/4099544663 shutdown_connections 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 -- 172.21.15.64:0/4099544663 >> 172.21.15.64:0/4099544663 conn(0x7faf4c0ccbe0 msgr2=0x7faf4c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 -- 172.21.15.64:0/4099544663 shutdown_connections 2024-09-21T07:34:50.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 -- 172.21.15.64:0/4099544663 wait complete. 2024-09-21T07:34:50.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.542+0000 7faf53400640 1 Processor -- start 2024-09-21T07:34:50.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- start start 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf34005290 0x7faf4c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4c1e4b70 0x7faf4c1e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c0cab40 con 0x7faf4c1f3b90 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c0ca9c0 con 0x7faf34005290 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faf4c0cb100 con 0x7faf4c1e4b70 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49452/0 (socket says 172.21.15.64:49452) 2024-09-21T07:34:50.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 -- 172.21.15.64:0/3542932826 learned_addr learned my addr 172.21.15.64:0/3542932826 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf51400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4c1e4b70 0x7faf4c1e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf50a00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf34005290 0x7faf4c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 -- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4c1e4b70 msgr2=0x7faf4c1e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4c1e4b70 0x7faf4c1e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 -- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf34005290 msgr2=0x7faf4c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf34005290 0x7faf4c0c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 -- 172.21.15.64:0/3542932826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c1e54c0 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf4be00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0cef00 tx=0x7faf38012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf38010b40 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf38017030 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c09c6f0 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf38012e60 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.546+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4c09ccb0 con 0x7faf4c1f3b90 2024-09-21T07:34:50.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c0d1070 con 0x7faf4c1f3b90 2024-09-21T07:34:50.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faf38013450 con 0x7faf4c1f3b90 2024-09-21T07:34:50.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf48c00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 0x7faf2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7faf38098050 con 0x7faf4c1f3b90 2024-09-21T07:34:50.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf50a00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 0x7faf2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.550+0000 7faf50a00640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 0x7faf2c075710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7faf4000a580 tx=0x7faf40010040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.554+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faf4c1e54c0 con 0x7faf4c1f3b90 2024-09-21T07:34:50.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.734+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf4c09c480 con 0x7faf4c1f3b90 2024-09-21T07:34:50.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.734+0000 7faf48c00640 1 -- 172.21.15.64:0/3542932826 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+17023 (secure 0 0 0) 0x7faf380627b0 con 0x7faf4c1f3b90 2024-09-21T07:34:50.736 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:50.736 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":168,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:34:42.058648+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:33:44.789416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-21T07:33:45.996202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/130164325":"2024-09-22T07:34:42.058595+0000","172.21.15.64:6833/130164325":"2024-09-22T07:34:42.058595+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 msgr2=0x7faf2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 0x7faf2c075710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7faf4000a580 tx=0x7faf40010040 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 msgr2=0x7faf4c09bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0cef00 tx=0x7faf38012b20 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 shutdown_connections 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faf2c073200 0x7faf2c075710 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4c1e4b70 0x7faf4c1e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf4c1f3b90 0x7faf4c09bd50 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 --2- 172.21.15.64:0/3542932826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf34005290 0x7faf4c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 >> 172.21.15.64:0/3542932826 conn(0x7faf4c0ccbe0 msgr2=0x7faf4c0cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:50.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 shutdown_connections 2024-09-21T07:34:50.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.738+0000 7faf53400640 1 -- 172.21.15.64:0/3542932826 wait complete. 2024-09-21T07:34:50.759 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 -- 172.21.15.64:0/1578844078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9c004d50 msgr2=0x7f3f9c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 --2- 172.21.15.64:0/1578844078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f9c004d50 0x7f3f9c005160 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0005fd0 tx=0x7f3fb001d5f0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbce00640 1 -- 172.21.15.64:0/1578844078 reap_dead start 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 -- 172.21.15.64:0/1578844078 shutdown_connections 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 -- 172.21.15.64:0/1578844078 >> 172.21.15.64:0/1578844078 conn(0x7f3fb80b2510 msgr2=0x7f3fb80b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:50.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 -- 172.21.15.64:0/1578844078 shutdown_connections 2024-09-21T07:34:50.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.918+0000 7f3fbee00640 1 -- 172.21.15.64:0/1578844078 wait complete. 2024-09-21T07:34:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 Processor -- start 2024-09-21T07:34:50.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- start start 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 0x7f3fb80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 0x7f3fb815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb80ce5f0 con 0x7f3fb81f62d0 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb806af80 con 0x7f3fb815bed0 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb80ce770 con 0x7f3f9c004d50 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49458/0 (socket says 172.21.15.64:49458) 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 -- 172.21.15.64:0/4265104834 learned_addr learned my addr 172.21.15.64:0/4265104834 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:50.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fb7e00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 0x7f3fb80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbce00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 0x7f3fb815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 -- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 msgr2=0x7f3fb80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 0x7f3fb80b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 -- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 msgr2=0x7f3fb815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 0x7f3fb815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 -- 172.21.15.64:0/4265104834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb80b5b00 con 0x7f3fb81f62d0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbce00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 0x7f3fb815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fb7e00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 0x7f3fb80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fafe00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0011650 tx=0x7f3fa0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0017070 con 0x7f3fb81f62d0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa000fc00 con 0x7f3fb81f62d0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0013450 con 0x7f3fb81f62d0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb80b5820 con 0x7f3fb81f62d0 2024-09-21T07:34:50.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.922+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb80b3bd0 con 0x7f3fb81f62d0 2024-09-21T07:34:50.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb80b5570 con 0x7f3fb81f62d0 2024-09-21T07:34:50.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3fa00135f0 con 0x7f3fb81f62d0 2024-09-21T07:34:50.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fb4c00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 0x7f3f94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:50.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6187+0+0 (secure 0 0 0) 0x7f3fa0098450 con 0x7f3fb81f62d0 2024-09-21T07:34:50.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fb7e00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 0x7f3f94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:50.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.926+0000 7f3fb7e00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 0x7f3f94075710 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009bf0 tx=0x7f3fa80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:50.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:50.930+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3fb8071a10 con 0x7f3fb81f62d0 2024-09-21T07:34:51.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.146+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3fb806f830 con 0x7f3fb81f62d0 2024-09-21T07:34:51.146 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:34:51.146+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:34:51.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fb4c00640 1 -- 172.21.15.64:0/4265104834 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v125) ==== 161+0+0 (secure 0 0 0) 0x7f3fa00631f0 con 0x7f3fb81f62d0 2024-09-21T07:34:51.150 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 msgr2=0x7f3f94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 0x7f3f94075710 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009bf0 tx=0x7f3fa80091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 msgr2=0x7f3fb8155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0011650 tx=0x7f3fa0011b10 comp rx=0 tx=0).stop 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 shutdown_connections 2024-09-21T07:34:51.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f94073200 0x7f3f94075710 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fb815bed0 0x7f3fb815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fb81f62d0 0x7f3fb8155ee0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 --2- 172.21.15.64:0/4265104834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f9c004d50 0x7f3fb80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 >> 172.21.15.64:0/4265104834 conn(0x7f3fb80b2510 msgr2=0x7f3fb80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 shutdown_connections 2024-09-21T07:34:51.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.150+0000 7f3fbee00640 1 -- 172.21.15.64:0/4265104834 wait complete. 2024-09-21T07:34:51.173 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:34:51.179 INFO:tasks.ceph.mds.d.smithi090.stderr: -195> 2024-09-21T07:34:47.820+0000 7efe34800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:34:51.292 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:34:51.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 -- 172.21.15.64:0/815265117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c073be0 msgr2=0x7f9d0c15bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 --2- 172.21.15.64:0/815265117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15bc30 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c06acb0 tx=0x7f9d0401cd80 comp rx=0 tx=0).stop 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 -- 172.21.15.64:0/815265117 shutdown_connections 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 --2- 172.21.15.64:0/815265117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15bc30 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 --2- 172.21.15.64:0/815265117 >> v2:172.21.15.90:3300/0 conn(0x7f9d0c0d0130 0x7f9d0c0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 -- 172.21.15.64:0/815265117 >> 172.21.15.64:0/815265117 conn(0x7f9d0c0d0c10 msgr2=0x7f9d0c0d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 -- 172.21.15.64:0/815265117 shutdown_connections 2024-09-21T07:34:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 -- 172.21.15.64:0/815265117 wait complete. 2024-09-21T07:34:51.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.334+0000 7f9d12800640 1 Processor -- start 2024-09-21T07:34:51.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- start start 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c0d0130 0x7f9d0c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c168d50 con 0x7f9d0c0d0130 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c168bd0 con 0x7f9d0c073be0 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c168ed0 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d0be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c0d0130 0x7f9d0c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d0b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:35388/0 (socket says 172.21.15.64:35388) 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 -- 172.21.15.64:0/4019068325 learned_addr learned my addr 172.21.15.64:0/4019068325 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 -- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0c073be0 msgr2=0x7f9d0c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 -- 172.21.15.64:0/4019068325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c0d0130 msgr2=0x7f9d0c0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c0d0130 0x7f9d0c0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 -- 172.21.15.64:0/4019068325 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c0aedf0 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d02a00640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e7a0 tx=0x7f9cf400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:51.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ccc0 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf4010430 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c0af0d0 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4010860 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c0c9d60 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.338+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c0aeb60 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.342+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9cf4010a00 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.342+0000 7f9d03e00640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 0x7f9ce8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.342+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(169..169 src has 1..169) ==== 6273+0+0 (secure 0 0 0) 0x7f9cf4095600 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.342+0000 7f9d0b400640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 0x7f9ce8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.342+0000 7f9d0b400640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 0x7f9ce8075710 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc007fd0 tx=0x7f9cfc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:51.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.346+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9cf405fe00 con 0x7f9d0c0cc1d0 2024-09-21T07:34:51.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:51.558+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9d0c0b3460 con 0x7f9d0c0cc1d0 2024-09-21T07:34:52.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.162+0000 7f9d03e00640 1 -- 172.21.15.64:0/4019068325 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v126) ==== 104+0+0 (secure 0 0 0) 0x7f9cf4064830 con 0x7f9d0c0cc1d0 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 msgr2=0x7f9ce8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 0x7f9ce8075710 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc007fd0 tx=0x7f9cfc009040 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 msgr2=0x7f9d0c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e7a0 tx=0x7f9cf400ec60 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 shutdown_connections 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ce8073200 0x7f9ce8075710 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d0c0d0130 0x7f9d0c0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d0c0cc1d0 0x7f9d0c0b49a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 --2- 172.21.15.64:0/4019068325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d0c073be0 0x7f9d0c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 >> 172.21.15.64:0/4019068325 conn(0x7f9d0c0d0c10 msgr2=0x7f9d0c0d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 shutdown_connections 2024-09-21T07:34:52.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.166+0000 7f9d12800640 1 -- 172.21.15.64:0/4019068325 wait complete. 2024-09-21T07:34:52.189 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:34:52.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- 172.21.15.64:0/839358492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c0af530 msgr2=0x7f8f7c15f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 --2- 172.21.15.64:0/839358492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c0af530 0x7f8f7c15f480 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009c80 tx=0x7f8f7401cda0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- 172.21.15.64:0/839358492 shutdown_connections 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 --2- 172.21.15.64:0/839358492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c0af530 0x7f8f7c15f480 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 --2- 172.21.15.64:0/839358492 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c06ec70 0x7f8f7c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- 172.21.15.64:0/839358492 >> 172.21.15.64:0/839358492 conn(0x7f8f7c0d0170 msgr2=0x7f8f7c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- 172.21.15.64:0/839358492 shutdown_connections 2024-09-21T07:34:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- 172.21.15.64:0/839358492 wait complete. 2024-09-21T07:34:52.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 Processor -- start 2024-09-21T07:34:52.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.354+0000 7f8f84200640 1 -- start start 2024-09-21T07:34:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c06ec70 0x7f8f7c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 0x7f8f7c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c15c500 con 0x7f8f7c1592f0 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c15c380 con 0x7f8f7c06ec70 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7c15c680 con 0x7f8f7c0af530 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49492/0 (socket says 172.21.15.64:49492) 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 -- 172.21.15.64:0/2113874070 learned_addr learned my addr 172.21.15.64:0/2113874070 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f80e00640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 0x7f8f7c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f81800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c06ec70 0x7f8f7c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 -- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 msgr2=0x7f8f7c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 0x7f8f7c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 -- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c06ec70 msgr2=0x7f8f7c156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c06ec70 0x7f8f7c156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 -- 172.21.15.64:0/2113874070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c0ace00 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f80e00640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 0x7f8f7c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f82200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009bd0 tx=0x7f8f74005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740bb070 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f74004b40 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740b2040 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7c1569a0 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7c156eb0 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.358+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7c156c20 con 0x7f8f7c1592f0 2024-09-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.362+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8f74004000 con 0x7f8f7c1592f0 2024-09-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.362+0000 7f8f79600640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 0x7f8f5c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.362+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6273+0+0 (secure 0 0 0) 0x7f8f7412e220 con 0x7f8f7c1592f0 2024-09-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.362+0000 7f8f81800640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 0x7f8f5c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.362+0000 7f8f81800640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 0x7f8f5c075740 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009600 tx=0x7f8f700091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.366+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8f74016990 con 0x7f8f7c1592f0 2024-09-21T07:34:52.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:52.542+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f7c158db0 con 0x7f8f7c1592f0 2024-09-21T07:34:53.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.162+0000 7f8f79600640 1 -- 172.21.15.64:0/2113874070 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) ==== 181+0+0 (secure 0 0 0) 0x7f8f740f8910 con 0x7f8f7c1592f0 2024-09-21T07:34:53.163 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:34:53.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 msgr2=0x7f8f5c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:53.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 0x7f8f5c075740 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009600 tx=0x7f8f700091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 msgr2=0x7f8f7c0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:53.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009bd0 tx=0x7f8f74005b00 comp rx=0 tx=0).stop 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 shutdown_connections 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8f5c073230 0x7f8f5c075740 secure :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009600 tx=0x7f8f700091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f7c1592f0 0x7f8f7c0b22a0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f7c0af530 0x7f8f7c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 --2- 172.21.15.64:0/2113874070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f7c06ec70 0x7f8f7c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 >> 172.21.15.64:0/2113874070 conn(0x7f8f7c0d0170 msgr2=0x7f8f7c15d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 shutdown_connections 2024-09-21T07:34:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.166+0000 7f8f84200640 1 -- 172.21.15.64:0/2113874070 wait complete. 2024-09-21T07:34:53.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:34:53.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 -- 172.21.15.64:0/3901033111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec98003a60 msgr2=0x7fec98003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3901033111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec98003a60 0x7fec98003ed0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7feca400abd0 tx=0x7feca401cd70 comp rx=0 tx=0).stop 2024-09-21T07:34:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 -- 172.21.15.64:0/3901033111 shutdown_connections 2024-09-21T07:34:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3901033111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec98003a60 0x7fec98003ed0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 -- 172.21.15.64:0/3901033111 >> 172.21.15.64:0/3901033111 conn(0x7fecb40d0170 msgr2=0x7fecb40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 -- 172.21.15.64:0/3901033111 shutdown_connections 2024-09-21T07:34:53.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.358+0000 7fecb9e00640 1 -- 172.21.15.64:0/3901033111 wait complete. 2024-09-21T07:34:53.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 Processor -- start 2024-09-21T07:34:53.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 -- start start 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec98003a60 0x7fecb41f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b1210 0x7fecb40b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fecb406f860 con 0x7fecb40c8d40 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fecb406f6e0 con 0x7fecb40b1210 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fecb4073530 con 0x7fec98003a60 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49498/0 (socket says 172.21.15.64:49498) 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb3400640 1 -- 172.21.15.64:0/3015639702 learned_addr learned my addr 172.21.15.64:0/3015639702 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:53.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb2000640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b1210 0x7fecb40b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.362+0000 7fecb2a00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec98003a60 0x7fecb41f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 -- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec98003a60 msgr2=0x7fecb41f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec98003a60 0x7fecb41f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 -- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b1210 msgr2=0x7fecb40b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b1210 0x7fecb40b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 -- 172.21.15.64:0/3015639702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb40c9690 con 0x7fecb40c8d40 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb3400640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fecac001340 tx=0x7fecac00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac00c8f0 con 0x7fecb40c8d40 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecac017070 con 0x7fecb40c8d40 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac00ce20 con 0x7fecb40c8d40 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb40b5eb0 con 0x7fecb40c8d40 2024-09-21T07:34:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41f4470 con 0x7fecb40c8d40 2024-09-21T07:34:53.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb4073a30 con 0x7fecb40c8d40 2024-09-21T07:34:53.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.366+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fecac01c460 con 0x7fecb40c8d40 2024-09-21T07:34:53.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.370+0000 7fecab400640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 0x7fec94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:53.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.370+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5835+0+0 (secure 0 0 0) 0x7fecac094680 con 0x7fecb40c8d40 2024-09-21T07:34:53.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.370+0000 7fecb2a00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 0x7fec94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:53.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.370+0000 7fecb2a00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 0x7fec94075710 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feca40ae000 tx=0x7feca40a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:53.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.374+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fecb40c9690 con 0x7fecb40c8d40 2024-09-21T07:34:53.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:53.546+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fecb40b60f0 con 0x7fecb40c8d40 2024-09-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.170+0000 7fecab400640 1 -- 172.21.15.64:0/3015639702 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) ==== 169+0+0 (secure 0 0 0) 0x7fecac05ef30 con 0x7fecb40c8d40 2024-09-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:34:54.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 msgr2=0x7fec94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 0x7fec94075710 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feca40ae000 tx=0x7feca40a7040 comp rx=0 tx=0).stop 2024-09-21T07:34:54.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 msgr2=0x7fecb40c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fecac001340 tx=0x7fecac00eae0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 shutdown_connections 2024-09-21T07:34:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec94073200 0x7fec94075710 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb40c8d40 0x7fecb40c9150 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecb40b1210 0x7fecb40b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 --2- 172.21.15.64:0/3015639702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec98003a60 0x7fecb41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 >> 172.21.15.64:0/3015639702 conn(0x7fecb40d0170 msgr2=0x7fecb40c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 shutdown_connections 2024-09-21T07:34:54.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.174+0000 7fecb9e00640 1 -- 172.21.15.64:0/3015639702 wait complete. 2024-09-21T07:34:54.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:34:54.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- 172.21.15.64:0/2077359061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9401602f0 msgr2=0x7ff94006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 --2- 172.21.15.64:0/2077359061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9401602f0 0x7ff94006f890 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009c80 tx=0x7ff93c01cda0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- 172.21.15.64:0/2077359061 shutdown_connections 2024-09-21T07:34:54.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 --2- 172.21.15.64:0/2077359061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9401602f0 0x7ff94006f890 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 --2- 172.21.15.64:0/2077359061 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94015f9a0 0x7ff94015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- 172.21.15.64:0/2077359061 >> 172.21.15.64:0/2077359061 conn(0x7ff94006d450 msgr2=0x7ff9400d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:54.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- 172.21.15.64:0/2077359061 shutdown_connections 2024-09-21T07:34:54.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- 172.21.15.64:0/2077359061 wait complete. 2024-09-21T07:34:54.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 Processor -- start 2024-09-21T07:34:54.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.366+0000 7ff948800640 1 -- start start 2024-09-21T07:34:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94009df30 0x7ff940159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 0x7ff9400cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff940168df0 con 0x7ff94015f9a0 2024-09-21T07:34:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff940168c70 con 0x7ff9401602f0 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff940168f70 con 0x7ff94009df30 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49514/0 (socket says 172.21.15.64:49514) 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 -- 172.21.15.64:0/3963190736 learned_addr learned my addr 172.21.15.64:0/3963190736 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945e00640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94009df30 0x7ff940159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff946800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 0x7ff9400cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 -- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94009df30 msgr2=0x7ff940159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94009df30 0x7ff940159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 -- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 msgr2=0x7ff9400cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 0x7ff9400cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 -- 172.21.15.64:0/3963190736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94009afd0 con 0x7ff94015f9a0 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff946800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 0x7ff9400cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff945400640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff93000d700 tx=0x7ff93000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930017070 con 0x7ff94015f9a0 2024-09-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff930009b10 con 0x7ff94015f9a0 2024-09-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94009b2b0 con 0x7ff94015f9a0 2024-09-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930010460 con 0x7ff94015f9a0 2024-09-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94009b870 con 0x7ff94015f9a0 2024-09-21T07:34:54.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.370+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94015fdb0 con 0x7ff94015f9a0 2024-09-21T07:34:54.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.374+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff93001a070 con 0x7ff94015f9a0 2024-09-21T07:34:54.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.374+0000 7ff93a000640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 0x7ff924075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.374+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7ff930094270 con 0x7ff94015f9a0 2024-09-21T07:34:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.374+0000 7ff945e00640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 0x7ff924075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.374+0000 7ff945e00640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 0x7ff924075710 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff934006fd0 tx=0x7ff934009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:54.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.378+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff93005ecd0 con 0x7ff94015f9a0 2024-09-21T07:34:54.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.554+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7ff94009ad60 con 0x7ff94015f9a0 2024-09-21T07:34:54.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.558+0000 7ff93a000640 1 -- 172.21.15.64:0/3963190736 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v59) ==== 71+0+0 (secure 0 0 0) 0x7ff930063700 con 0x7ff94015f9a0 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 msgr2=0x7ff924075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 0x7ff924075710 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff934006fd0 tx=0x7ff934009060 comp rx=0 tx=0).stop 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 msgr2=0x7ff9400cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff93000d700 tx=0x7ff93000dbc0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 shutdown_connections 2024-09-21T07:34:54.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff924073200 0x7ff924075710 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9401602f0 0x7ff9400cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94015f9a0 0x7ff9400cecd0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 --2- 172.21.15.64:0/3963190736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff94009df30 0x7ff940159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 >> 172.21.15.64:0/3963190736 conn(0x7ff94006d450 msgr2=0x7ff94015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 shutdown_connections 2024-09-21T07:34:54.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.562+0000 7ff948800640 1 -- 172.21.15.64:0/3963190736 wait complete. 2024-09-21T07:34:54.583 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-21T07:34:54.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- 172.21.15.64:0/3064015757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3200099c0 msgr2=0x7fc32000bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 --2- 172.21.15.64:0/3064015757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3200099c0 0x7fc32000bde0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0c5ce0 tx=0x7fc33401d200 comp rx=0 tx=0).stop 2024-09-21T07:34:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- 172.21.15.64:0/3064015757 shutdown_connections 2024-09-21T07:34:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 --2- 172.21.15.64:0/3064015757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3200099c0 0x7fc32000bde0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- 172.21.15.64:0/3064015757 >> 172.21.15.64:0/3064015757 conn(0x7fc33c06d480 msgr2=0x7fc33c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- 172.21.15.64:0/3064015757 shutdown_connections 2024-09-21T07:34:54.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- 172.21.15.64:0/3064015757 wait complete. 2024-09-21T07:34:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 Processor -- start 2024-09-21T07:34:54.744 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.742+0000 7fc343800640 1 -- start start 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3200099c0 0x7fc33c1f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc33c154f40 0x7fc33c1fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0d0400 con 0x7fc33c167c10 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0c60a0 con 0x7fc3200099c0 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c0d0580 con 0x7fc33c154f40 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49518/0 (socket says 172.21.15.64:49518) 2024-09-21T07:34:54.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc340e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3200099c0 0x7fc33c1f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 -- 172.21.15.64:0/1599900453 learned_addr learned my addr 172.21.15.64:0/1599900453 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc341800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc33c154f40 0x7fc33c1fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 -- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc33c154f40 msgr2=0x7fc33c1fb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc33c154f40 0x7fc33c1fb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 -- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3200099c0 msgr2=0x7fc33c1f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3200099c0 0x7fc33c1f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 -- 172.21.15.64:0/1599900453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c1f9390 con 0x7fc33c167c10 2024-09-21T07:34:54.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc333e00640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc324006660 tx=0x7fc324001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324011640 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc324016020 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c155350 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324011aa0 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c155bf0 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.746+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c0c63e0 con 0x7fc33c167c10 2024-09-21T07:34:54.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.750+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc324011c40 con 0x7fc33c167c10 2024-09-21T07:34:54.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.750+0000 7fc339600640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 0x7fc318075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:54.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.750+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7fc324094cd0 con 0x7fc33c167c10 2024-09-21T07:34:54.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.750+0000 7fc340e00640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 0x7fc318075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:54.751 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.750+0000 7fc340e00640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 0x7fc318075710 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009470 tx=0x7fc32c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:54.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.754+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc324020020 con 0x7fc33c167c10 2024-09-21T07:34:54.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:54.994+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fc33c0b3cf0 con 0x7fc33c167c10 2024-09-21T07:34:55.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.170+0000 7fc339600640 1 -- 172.21.15.64:0/1599900453 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v579) ==== 166+0+0 (secure 0 0 0) 0x7fc33c155350 con 0x7fc33c167c10 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 msgr2=0x7fc318075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 0x7fc318075710 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009470 tx=0x7fc32c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 msgr2=0x7fc33c154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc324006660 tx=0x7fc324001810 comp rx=0 tx=0).stop 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 shutdown_connections 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc318073200 0x7fc318075710 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc33c154f40 0x7fc33c1fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc33c167c10 0x7fc33c154a00 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 --2- 172.21.15.64:0/1599900453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3200099c0 0x7fc33c1f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 >> 172.21.15.64:0/1599900453 conn(0x7fc33c06d480 msgr2=0x7fc33c156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 shutdown_connections 2024-09-21T07:34:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.174+0000 7fc343800640 1 -- 172.21.15.64:0/1599900453 wait complete. 2024-09-21T07:34:55.195 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-21T07:34:55.195 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-21T07:34:55.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 -- 172.21.15.64:0/954718897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c15cbd0 msgr2=0x7f3f7c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 --2- 172.21.15.64:0/954718897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c15cbd0 0x7f3f7c070310 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009930 tx=0x7f3f6c01c6d0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 -- 172.21.15.64:0/954718897 shutdown_connections 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 --2- 172.21.15.64:0/954718897 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c070850 0x7f3f7c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 --2- 172.21.15.64:0/954718897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c15cbd0 0x7f3f7c070310 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 -- 172.21.15.64:0/954718897 >> 172.21.15.64:0/954718897 conn(0x7f3f7c0ccbe0 msgr2=0x7f3f7c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 -- 172.21.15.64:0/954718897 shutdown_connections 2024-09-21T07:34:55.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.354+0000 7f3f81400640 1 -- 172.21.15.64:0/954718897 wait complete. 2024-09-21T07:34:55.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 Processor -- start 2024-09-21T07:34:55.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- start start 2024-09-21T07:34:55.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7c070850 0x7f3f7c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 0x7f3f7c0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c0b4230 con 0x7f3f7c0b2120 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c0b40b0 con 0x7f3f7c070850 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c16a290 con 0x7f3f7c15cbd0 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39424/0 (socket says 172.21.15.64:39424) 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 -- 172.21.15.64:0/3090855839 learned_addr learned my addr 172.21.15.64:0/3090855839 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f7a800640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7c070850 0x7f3f7c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f7b200640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 0x7f3f7c0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 -- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 msgr2=0x7f3f7c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 0x7f3f7c0cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 -- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7c070850 msgr2=0x7f3f7c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7c070850 0x7f3f7c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 -- 172.21.15.64:0/3090855839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c15f8c0 con 0x7f3f7c0b2120 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f7b200640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 0x7f3f7c0cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f71e00640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400d680 tx=0x7f3f6400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64017070 con 0x7f3f7c0b2120 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c157790 con 0x7f3f7c0b2120 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f64005310 con 0x7f3f7c0b2120 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f640097c0 con 0x7f3f7c0b2120 2024-09-21T07:34:55.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.358+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c157d50 con 0x7f3f7c0b2120 2024-09-21T07:34:55.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.362+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c0b1be0 con 0x7f3f7c0b2120 2024-09-21T07:34:55.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.362+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f64009960 con 0x7f3f7c0b2120 2024-09-21T07:34:55.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.362+0000 7f3f73400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 0x7f3f58075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.362+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7f3f64094100 con 0x7f3f7c0b2120 2024-09-21T07:34:55.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.362+0000 7f3f7a800640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 0x7f3f58075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.366+0000 7f3f7a800640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 0x7f3f58075740 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0af000 tx=0x7f3f6c01af10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:55.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.366+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f6405eb70 con 0x7f3f7c0b2120 2024-09-21T07:34:55.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f7c0ad010 con 0x7f3f7c0b2120 2024-09-21T07:34:55.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f73400640 1 -- 172.21.15.64:0/3090855839 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+13395 (secure 0 0 0) 0x7f3f640635a0 con 0x7f3f7c0b2120 2024-09-21T07:34:55.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:55.579 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":171,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:34:54.166039+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6836/2090079902":"2024-09-22T07:34:51.149294+0000","172.21.15.90:6834/2090079902":"2024-09-22T07:34:51.149294+0000","172.21.15.64:6835/130164325":"2024-09-22T07:34:42.058595+0000","172.21.15.64:6833/130164325":"2024-09-22T07:34:42.058595+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 msgr2=0x7f3f58075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 0x7f3f58075740 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0af000 tx=0x7f3f6c01af10 comp rx=0 tx=0).stop 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 msgr2=0x7f3f7c1f99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400d680 tx=0x7f3f6400db40 comp rx=0 tx=0).stop 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 shutdown_connections 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f58073230 0x7f3f58075740 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f7c15cbd0 0x7f3f7c0cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f7c0b2120 0x7f3f7c1f99c0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 --2- 172.21.15.64:0/3090855839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7c070850 0x7f3f7c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.578+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 >> 172.21.15.64:0/3090855839 conn(0x7f3f7c0ccbe0 msgr2=0x7f3f7c0afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:55.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.582+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 shutdown_connections 2024-09-21T07:34:55.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.582+0000 7f3f81400640 1 -- 172.21.15.64:0/3090855839 wait complete. 2024-09-21T07:34:55.602 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:34:55.602 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:34:55.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.762+0000 7f4457800640 1 -- 172.21.15.64:0/4195300612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500adfd0 msgr2=0x7f44500ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.762+0000 7f4457800640 1 --2- 172.21.15.64:0/4195300612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500adfd0 0x7f44500ae3e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f443c009900 tx=0x7f443c01c850 comp rx=0 tx=0).stop 2024-09-21T07:34:55.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- 172.21.15.64:0/4195300612 shutdown_connections 2024-09-21T07:34:55.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 --2- 172.21.15.64:0/4195300612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500ae920 0x7f44500cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 --2- 172.21.15.64:0/4195300612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500adfd0 0x7f44500ae3e0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- 172.21.15.64:0/4195300612 >> 172.21.15.64:0/4195300612 conn(0x7f44500b2510 msgr2=0x7f44500b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:55.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- 172.21.15.64:0/4195300612 shutdown_connections 2024-09-21T07:34:55.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- 172.21.15.64:0/4195300612 wait complete. 2024-09-21T07:34:55.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 Processor -- start 2024-09-21T07:34:55.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- start start 2024-09-21T07:34:55.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 0x7f4450155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 0x7f44500b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f445016c1f0 con 0x7f44500cf980 2024-09-21T07:34:55.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f445016c070 con 0x7f44500ae920 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.766+0000 7f4457800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f445016c370 con 0x7f44500adfd0 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39454/0 (socket says 172.21.15.64:39454) 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 -- 172.21.15.64:0/1171656183 learned_addr learned my addr 172.21.15.64:0/1171656183 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444fe00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 0x7f44500b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 -- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 msgr2=0x7f4450155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4454e00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 0x7f4450155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 0x7f4450155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 -- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 msgr2=0x7f44500b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 0x7f44500b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 -- 172.21.15.64:0/1171656183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4450157490 con 0x7f44500cf980 2024-09-21T07:34:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444fe00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 0x7f44500b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4454e00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 0x7f4450155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4455800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f444800e9c0 tx=0x7f444800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448016070 con 0x7f44500cf980 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f444800c910 con 0x7f44500cf980 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444800cd60 con 0x7f44500cf980 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4450169ab0 con 0x7f44500cf980 2024-09-21T07:34:55.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4450161050 con 0x7f44500cf980 2024-09-21T07:34:55.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44500ae3e0 con 0x7f44500cf980 2024-09-21T07:34:55.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.770+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4448019070 con 0x7f44500cf980 2024-09-21T07:34:55.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.774+0000 7f444cc00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 0x7f4430075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:55.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.774+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7f4448094840 con 0x7f44500cf980 2024-09-21T07:34:55.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.774+0000 7f4454e00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 0x7f4430075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:55.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.774+0000 7f4454e00640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 0x7f4430075710 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4444000f70 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:55.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.778+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f444805f9f0 con 0x7f44500cf980 2024-09-21T07:34:55.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44500b1bd0 con 0x7f44500cf980 2024-09-21T07:34:55.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f444cc00640 1 -- 172.21.15.64:0/1171656183 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v171) ==== 93+0+10 (secure 0 0 0) 0x7f444805f2f0 con 0x7f44500cf980 2024-09-21T07:34:55.954 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 msgr2=0x7f4430075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 0x7f4430075710 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4444000f70 tx=0x7f4444009040 comp rx=0 tx=0).stop 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 msgr2=0x7f44500b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f444800e9c0 tx=0x7f444800ee80 comp rx=0 tx=0).stop 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 shutdown_connections 2024-09-21T07:34:55.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4430073200 0x7f4430075710 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44500cf980 0x7f44500b4e90 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44500ae920 0x7f44500b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 --2- 172.21.15.64:0/1171656183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44500adfd0 0x7f4450155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 >> 172.21.15.64:0/1171656183 conn(0x7f44500b2510 msgr2=0x7f4450073920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 shutdown_connections 2024-09-21T07:34:55.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:55.954+0000 7f4457800640 1 -- 172.21.15.64:0/1171656183 wait complete. 2024-09-21T07:34:55.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- 172.21.15.64:0/900183811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a015e9b0 msgr2=0x7fb7a015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 --2- 172.21.15.64:0/900183811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a015e9b0 0x7fb7a015edc0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0071d50 tx=0x7fb79801cd80 comp rx=0 tx=0).stop 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- 172.21.15.64:0/900183811 shutdown_connections 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 --2- 172.21.15.64:0/900183811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a015e9b0 0x7fb7a015edc0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 --2- 172.21.15.64:0/900183811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a00cacf0 0x7fb7a00cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 --2- 172.21.15.64:0/900183811 >> v2:172.21.15.90:3300/0 conn(0x7fb7a00b24e0 0x7fb7a00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:56.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- 172.21.15.64:0/900183811 >> 172.21.15.64:0/900183811 conn(0x7fb7a00ccbe0 msgr2=0x7fb7a00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:56.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- 172.21.15.64:0/900183811 shutdown_connections 2024-09-21T07:34:56.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- 172.21.15.64:0/900183811 wait complete. 2024-09-21T07:34:56.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 Processor -- start 2024-09-21T07:34:56.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.137+0000 7fb7a8000640 1 -- start start 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a00b24e0 0x7fb7a00af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a015e9b0 0x7fb7a01fc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00b3810 con 0x7fb7a00cacf0 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00b3690 con 0x7fb7a00b24e0 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00b3990 con 0x7fb7a015e9b0 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39482/0 (socket says 172.21.15.64:39482) 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 -- 172.21.15.64:0/4272106646 learned_addr learned my addr 172.21.15.64:0/4272106646 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:56.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a6000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a015e9b0 0x7fb7a01fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:56.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a5600640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a00b24e0 0x7fb7a00af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 -- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a015e9b0 msgr2=0x7fb7a01fc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a015e9b0 0x7fb7a01fc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 -- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a00b24e0 msgr2=0x7fb7a00af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a00b24e0 0x7fb7a00af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 -- 172.21.15.64:0/4272106646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a009d440 con 0x7fb7a00cacf0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a4c00640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00d650 tx=0x7fb78c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c017070 con 0x7fb7a00cacf0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb78c004310 con 0x7fb7a00cacf0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c009a20 con 0x7fb7a00cacf0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a01fd3b0 con 0x7fb7a00cacf0 2024-09-21T07:34:56.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a009ce80 con 0x7fb7a00cacf0 2024-09-21T07:34:56.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.141+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a009c910 con 0x7fb7a00cacf0 2024-09-21T07:34:56.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.145+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb78c009bc0 con 0x7fb7a00cacf0 2024-09-21T07:34:56.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.145+0000 7fb79d600640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 0x7fb780075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:56.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.145+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7fb78c0943a0 con 0x7fb7a00cacf0 2024-09-21T07:34:56.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.145+0000 7fb7a5600640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 0x7fb780075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:56.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.145+0000 7fb7a5600640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 0x7fb780075740 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb79400bbd0 tx=0x7fb79400b360 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:56.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.149+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb78c05f000 con 0x7fb7a00cacf0 2024-09-21T07:34:56.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:56.389+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fb7a00cb100 con 0x7fb7a00cacf0 2024-09-21T07:34:57.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.177+0000 7fb79d600640 1 -- 172.21.15.64:0/4272106646 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v581) ==== 162+0+0 (secure 0 0 0) 0x7fb78c063a30 con 0x7fb7a00cacf0 2024-09-21T07:34:57.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 msgr2=0x7fb780075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 0x7fb780075740 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb79400bbd0 tx=0x7fb79400b360 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 msgr2=0x7fb7a015db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00d650 tx=0x7fb78c00db10 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 shutdown_connections 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb780073230 0x7fb780075740 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7a015e9b0 0x7fb7a01fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7a00cacf0 0x7fb7a015db00 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 --2- 172.21.15.64:0/4272106646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a00b24e0 0x7fb7a00af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 >> 172.21.15.64:0/4272106646 conn(0x7fb7a00ccbe0 msgr2=0x7fb7a00afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 shutdown_connections 2024-09-21T07:34:57.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.181+0000 7fb7a8000640 1 -- 172.21.15.64:0/4272106646 wait complete. 2024-09-21T07:34:57.207 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 -- 172.21.15.64:0/1999896475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65bc004810 msgr2=0x7f65bc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 --2- 172.21.15.64:0/1999896475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65bc004810 0x7f65bc004c20 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f65c000c310 tx=0x7f65c001f680 comp rx=0 tx=0).stop 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 -- 172.21.15.64:0/1999896475 shutdown_connections 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 --2- 172.21.15.64:0/1999896475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65bc004810 0x7f65bc004c20 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 -- 172.21.15.64:0/1999896475 >> 172.21.15.64:0/1999896475 conn(0x7f65d80ccbe0 msgr2=0x7f65d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:57.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 -- 172.21.15.64:0/1999896475 shutdown_connections 2024-09-21T07:34:57.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.369+0000 7f65dd000640 1 -- 172.21.15.64:0/1999896475 wait complete. 2024-09-21T07:34:57.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 Processor -- start 2024-09-21T07:34:57.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 -- start start 2024-09-21T07:34:57.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 0x7f65d814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 0x7f65d80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80b41c0 con 0x7f65d8157a10 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80704d0 con 0x7f65bc004810 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65dd000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80b4340 con 0x7f65d8157450 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39504/0 (socket says 172.21.15.64:39504) 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 -- 172.21.15.64:0/128524665 learned_addr learned my addr 172.21.15.64:0/128524665 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65d5e00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 0x7f65d814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65d6800640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 0x7f65d80cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 -- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 msgr2=0x7f65d80cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 0x7f65d80cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 -- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 msgr2=0x7f65d814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 0x7f65d814c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65cfe00640 1 -- 172.21.15.64:0/128524665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d814c9f0 con 0x7f65d8157a10 2024-09-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65d5e00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 0x7f65d814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.373+0000 7f65d6800640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 0x7f65d80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65cfe00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f65c001dd80 tx=0x7f65c0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c00b3070 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c00b4040 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0003860 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d81e90b0 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81e9670 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d80b48a0 con 0x7f65d8157a10 2024-09-21T07:34:57.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f65c00c1060 con 0x7f65d8157a10 2024-09-21T07:34:57.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 0x7f65b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7f65c0130d20 con 0x7f65d8157a10 2024-09-21T07:34:57.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.377+0000 7f65d5e00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 0x7f65b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.381+0000 7f65d5e00640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 0x7f65b4075740 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c10 tx=0x7f65c8006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:57.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.385+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f65c00ab070 con 0x7f65d8157a10 2024-09-21T07:34:57.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f65d809da20 con 0x7f65d8157a10 2024-09-21T07:34:57.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65ce000640 1 -- 172.21.15.64:0/128524665 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v59) ==== 59+0+2294 (secure 0 0 0) 0x7f65c0019430 con 0x7f65d8157a10 2024-09-21T07:34:57.562 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:34:57.563 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:34:57.564 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:34:57.565 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:34:57.565 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:34:57.565 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 msgr2=0x7f65b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 0x7f65b4075740 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c10 tx=0x7f65c8006b80 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 msgr2=0x7f65d80cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f65c001dd80 tx=0x7f65c0001e10 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 shutdown_connections 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f65b4073230 0x7f65b4075740 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f65d8157450 0x7f65d80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d8157a10 0x7f65d80cb0d0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 --2- 172.21.15.64:0/128524665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65bc004810 0x7f65d814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.561+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 >> 172.21.15.64:0/128524665 conn(0x7f65d80ccbe0 msgr2=0x7f65d80ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.565+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 shutdown_connections 2024-09-21T07:34:57.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.565+0000 7f65dd000640 1 -- 172.21.15.64:0/128524665 wait complete. 2024-09-21T07:34:57.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 -- 172.21.15.64:0/2511607160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3df4003a80 msgr2=0x7f3df4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2511607160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3df4003a80 0x7f3df4003ef0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ec0 tx=0x7f3e0001d5f0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0e800640 1 -- 172.21.15.64:0/2511607160 reap_dead start 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 -- 172.21.15.64:0/2511607160 shutdown_connections 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 -- 172.21.15.64:0/2511607160 >> 172.21.15.64:0/2511607160 conn(0x7f3e1009b3b0 msgr2=0x7f3e100d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 -- 172.21.15.64:0/2511607160 shutdown_connections 2024-09-21T07:34:57.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.745+0000 7f3e0f200640 1 -- 172.21.15.64:0/2511607160 wait complete. 2024-09-21T07:34:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 Processor -- start 2024-09-21T07:34:57.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 -- start start 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df4003a80 0x7f3e101fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10164ae0 0x7f3e10164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10167c50 con 0x7f3e101f98a0 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10167ad0 con 0x7f3df4003a80 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0f200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e10167dd0 con 0x7f3e10164ae0 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39522/0 (socket says 172.21.15.64:39522) 2024-09-21T07:34:57.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 -- 172.21.15.64:0/2249475863 learned_addr learned my addr 172.21.15.64:0/2249475863 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df4003a80 0x7f3e101fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e0e800640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10164ae0 0x7f3e10164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 -- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10164ae0 msgr2=0x7f3e10164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10164ae0 0x7f3e10164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 -- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df4003a80 msgr2=0x7f3e101fccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df4003a80 0x7f3e101fccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 -- 172.21.15.64:0/2249475863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e10165430 con 0x7f3e101f98a0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.749+0000 7f3e05400640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f3df8004fd0 tx=0x7f3df800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8015070 con 0x7f3e101f98a0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3df8010980 con 0x7f3e101f98a0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8010dd0 con 0x7f3e101f98a0 2024-09-21T07:34:57.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e100c8360 con 0x7f3e101f98a0 2024-09-21T07:34:57.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101f8dc0 con 0x7f3e101f98a0 2024-09-21T07:34:57.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100c80d0 con 0x7f3e101f98a0 2024-09-21T07:34:57.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3df8018070 con 0x7f3e101f98a0 2024-09-21T07:34:57.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 0x7f3dec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:57.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.753+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7f3df80944b0 con 0x7f3e101f98a0 2024-09-21T07:34:57.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.757+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 0x7f3dec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:57.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.757+0000 7f3e0de00640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 0x7f3dec075710 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ae000 tx=0x7f3e0001a390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:57.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.757+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3e10165430 con 0x7f3e101f98a0 2024-09-21T07:34:57.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.937+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3e100b1f00 con 0x7f3e101f98a0 2024-09-21T07:34:57.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.941+0000 7f3e06a00640 1 -- 172.21.15.64:0/2249475863 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v60)=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f3df805ef00 con 0x7f3e101f98a0 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.941+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 msgr2=0x7f3dec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.941+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 0x7f3dec075710 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ae000 tx=0x7f3e0001a390 comp rx=0 tx=0).stop 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.941+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 msgr2=0x7f3e100c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.941+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f3df8004fd0 tx=0x7f3df800eaa0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 shutdown_connections 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3dec073200 0x7f3dec075710 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10164ae0 0x7f3e10164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e101f98a0 0x7f3e100c7050 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 --2- 172.21.15.64:0/2249475863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df4003a80 0x7f3e101fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:57.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 >> 172.21.15.64:0/2249475863 conn(0x7f3e1009b3b0 msgr2=0x7f3e100b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:57.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 shutdown_connections 2024-09-21T07:34:57.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:57.945+0000 7f3e0f200640 1 -- 172.21.15.64:0/2249475863 wait complete. 2024-09-21T07:34:57.965 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:34:57.965 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:34:58.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:34:58.156 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:34:58.156 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:34:58.157 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:58.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:34:58.165 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:34:58.166 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:58.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:34:58.175 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:34:58.175 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:58.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:34:58.217 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:34:58.217 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:58.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:34:58.226 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:34:58.226 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:34:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- 172.21.15.64:0/2873921045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c15cbd0 msgr2=0x7fc30c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 --2- 172.21.15.64:0/2873921045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c15cbd0 0x7fc30c070310 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009900 tx=0x7fc2fc01c870 comp rx=0 tx=0).stop 2024-09-21T07:34:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- 172.21.15.64:0/2873921045 shutdown_connections 2024-09-21T07:34:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 --2- 172.21.15.64:0/2873921045 >> v2:172.21.15.90:3300/0 conn(0x7fc30c070850 0x7fc30c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 --2- 172.21.15.64:0/2873921045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c15cbd0 0x7fc30c070310 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- 172.21.15.64:0/2873921045 >> 172.21.15.64:0/2873921045 conn(0x7fc30c0ccbe0 msgr2=0x7fc30c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- 172.21.15.64:0/2873921045 shutdown_connections 2024-09-21T07:34:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- 172.21.15.64:0/2873921045 wait complete. 2024-09-21T07:34:58.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 Processor -- start 2024-09-21T07:34:58.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.417+0000 7fc311000640 1 -- start start 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc30c070850 0x7fc30c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc30c15cbd0 0x7fc30c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0b4120 con 0x7fc30c0b2120 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0b3fa0 con 0x7fc30c070850 2024-09-21T07:34:58.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c0b42a0 con 0x7fc30c15cbd0 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39536/0 (socket says 172.21.15.64:39536) 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 -- 172.21.15.64:0/1319109799 learned_addr learned my addr 172.21.15.64:0/1319109799 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc309e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc30c070850 0x7fc30c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc30a800640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc30c15cbd0 0x7fc30c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 -- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc30c15cbd0 msgr2=0x7fc30c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc30c15cbd0 0x7fc30c0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 -- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc30c070850 msgr2=0x7fc30c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc30c070850 0x7fc30c157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 -- 172.21.15.64:0/1319109799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c159fe0 con 0x7fc30c0b2120 2024-09-21T07:34:58.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc303e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400d750 tx=0x7fc2f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4017070 con 0x7fc30c0b2120 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2f4009d20 con 0x7fc30c0b2120 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4005280 con 0x7fc30c0b2120 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c15a2c0 con 0x7fc30c0b2120 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c14e850 con 0x7fc30c0b2120 2024-09-21T07:34:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.421+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c0b1be0 con 0x7fc30c0b2120 2024-09-21T07:34:58.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.425+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2f4005420 con 0x7fc30c0b2120 2024-09-21T07:34:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.425+0000 7fc302000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 0x7fc2e8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.425+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7fc2f40940f0 con 0x7fc30c0b2120 2024-09-21T07:34:58.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.425+0000 7fc309e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 0x7fc2e8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.425+0000 7fc309e00640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 0x7fc2e8075740 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af000 tx=0x7fc2fc01b0b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:58.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.429+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc2f400de60 con 0x7fc30c0b2120 2024-09-21T07:34:58.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.641+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc30c0b1670 con 0x7fc30c0b2120 2024-09-21T07:34:58.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.641+0000 7fc302000640 1 -- 172.21.15.64:0/1319109799 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) ==== 95+0+3087 (secure 0 0 0) 0x7fc2f405ec60 con 0x7fc30c0b2120 2024-09-21T07:34:58.644 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:58.644 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":126,"btime":"2024-09-21T07:34:52:153465+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2065885905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2065885905},{"type":"v1","addr":"172.21.15.90:6837","nonce":2065885905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1254221190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1254221190},{"type":"v1","addr":"172.21.15.64:6834","nonce":1254221190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":9430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/700245978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":700245978},{"type":"v1","addr":"172.21.15.90:6836","nonce":700245978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[]} 2024-09-21T07:34:58.644 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 126 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 msgr2=0x7fc2e8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 0x7fc2e8075740 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af000 tx=0x7fc2fc01b0b0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 msgr2=0x7fc30c157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400d750 tx=0x7fc2f400dc10 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 shutdown_connections 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc2e8073230 0x7fc2e8075740 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc30c15cbd0 0x7fc30c0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc30c0b2120 0x7fc30c157ec0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 --2- 172.21.15.64:0/1319109799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc30c070850 0x7fc30c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 >> 172.21.15.64:0/1319109799 conn(0x7fc30c0ccbe0 msgr2=0x7fc30c0744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:58.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 shutdown_connections 2024-09-21T07:34:58.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.645+0000 7fc311000640 1 -- 172.21.15.64:0/1319109799 wait complete. 2024-09-21T07:34:58.666 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:34:58.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:34:58.667 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:34:58.667 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:34:58.667 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:34:58.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:34:58.667 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:34:58.667 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:34:58.667 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:34:58.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:34:58.668 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:34:58.668 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:34:58.668 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:34:58.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:34:58.680 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:34:58.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:34:58.681 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:34:58.682 DEBUG:teuthology.parallel:result is None 2024-09-21T07:34:58.683 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:34:58.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:34:58.684 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:34:58.684 DEBUG:teuthology.parallel:result is None 2024-09-21T07:34:58.689 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:34:58.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:34:58.736 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:34:58.736 DEBUG:teuthology.parallel:result is None 2024-09-21T07:34:58.738 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:34:58.738 DEBUG:teuthology.parallel:result is None 2024-09-21T07:34:58.739 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:34:58.781 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:34:58.785 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:34:58.841 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:34:58.842 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 -- 172.21.15.64:0/1620122785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43340b3140 msgr2=0x7f43340b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 --2- 172.21.15.64:0/1620122785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43340b3140 0x7f43340b3550 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f4334070f10 tx=0x7f432001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 -- 172.21.15.64:0/1620122785 shutdown_connections 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 --2- 172.21.15.64:0/1620122785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43340b3140 0x7f43340b3550 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 --2- 172.21.15.64:0/1620122785 >> v2:172.21.15.90:3300/0 conn(0x7f43340cc960 0x7f433415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 -- 172.21.15.64:0/1620122785 >> 172.21.15.64:0/1620122785 conn(0x7f433406d450 msgr2=0x7f43340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 -- 172.21.15.64:0/1620122785 shutdown_connections 2024-09-21T07:34:58.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.905+0000 7f4339e00640 1 -- 172.21.15.64:0/1620122785 wait complete. 2024-09-21T07:34:58.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 Processor -- start 2024-09-21T07:34:58.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 -- start start 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 0x7f433414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43340cc960 0x7f4334164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4334169150 con 0x7f433406f890 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4334168fd0 con 0x7f43340cc960 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4339e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f43341692d0 con 0x7f43340b3140 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39586/0 (socket says 172.21.15.64:39586) 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 -- 172.21.15.64:0/2373586667 learned_addr learned my addr 172.21.15.64:0/2373586667 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332000640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 0x7f433414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4333400640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43340cc960 0x7f4334164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 -- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 msgr2=0x7f433414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 0x7f433414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 -- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43340cc960 msgr2=0x7f4334164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43340cc960 0x7f4334164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 -- 172.21.15.64:0/2373586667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43340ae560 con 0x7f433406f890 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332000640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 0x7f433414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f4332a00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f432400e9c0 tx=0x7f432400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.909+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432400cc60 con 0x7f433406f890 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4324010430 con 0x7f433406f890 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324010880 con 0x7f433406f890 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43341fc1a0 con 0x7f433406f890 2024-09-21T07:34:58.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4334159930 con 0x7f433406f890 2024-09-21T07:34:58.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43340b3550 con 0x7f433406f890 2024-09-21T07:34:58.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.913+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4324010a20 con 0x7f433406f890 2024-09-21T07:34:58.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.917+0000 7f432b400640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 0x7f4314075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:58.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.917+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5421+0+0 (secure 0 0 0) 0x7f43240953f0 con 0x7f433406f890 2024-09-21T07:34:58.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.917+0000 7f4332000640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 0x7f4314075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:58.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.917+0000 7f4332000640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 0x7f4314075740 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f43200af000 tx=0x7f432001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:58.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:58.917+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4324060610 con 0x7f433406f890 2024-09-21T07:34:59.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.105+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f43340cd820 con 0x7f433406f890 2024-09-21T07:34:59.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.205+0000 7f432b400640 1 -- 172.21.15.64:0/2373586667 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v173) ==== 97+0+0 (secure 0 0 0) 0x7f432405ff10 con 0x7f433406f890 2024-09-21T07:34:59.207 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:34:59.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 msgr2=0x7f4314075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 0x7f4314075740 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f43200af000 tx=0x7f432001b100 comp rx=0 tx=0).stop 2024-09-21T07:34:59.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 msgr2=0x7f43340ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f432400e9c0 tx=0x7f432400ee80 comp rx=0 tx=0).stop 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 shutdown_connections 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4314073230 0x7f4314075740 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43340cc960 0x7f4334164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43340b3140 0x7f433414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 --2- 172.21.15.64:0/2373586667 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433406f890 0x7f43340ae9d0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 >> 172.21.15.64:0/2373586667 conn(0x7f433406d450 msgr2=0x7f43340cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 shutdown_connections 2024-09-21T07:34:59.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.209+0000 7f4339e00640 1 -- 172.21.15.64:0/2373586667 wait complete. 2024-09-21T07:34:59.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 -- 172.21.15.64:0/1621487607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f513815cbd0 msgr2=0x7f5138070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 --2- 172.21.15.64:0/1621487607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f513815cbd0 0x7f5138070310 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5128009870 tx=0x7f512801c710 comp rx=0 tx=0).stop 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 -- 172.21.15.64:0/1621487607 shutdown_connections 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 --2- 172.21.15.64:0/1621487607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f513815cbd0 0x7f5138070310 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 -- 172.21.15.64:0/1621487607 >> 172.21.15.64:0/1621487607 conn(0x7f51380ccbe0 msgr2=0x7f51380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 -- 172.21.15.64:0/1621487607 shutdown_connections 2024-09-21T07:34:59.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.429+0000 7f513d400640 1 -- 172.21.15.64:0/1621487607 wait complete. 2024-09-21T07:34:59.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 Processor -- start 2024-09-21T07:34:59.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- start start 2024-09-21T07:34:59.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5138070850 0x7f51381511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f513815cbd0 0x7f51380c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f513816b6b0 con 0x7f5138155340 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f513816b530 con 0x7f5138070850 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f513816b830 con 0x7f513815cbd0 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39600/0 (socket says 172.21.15.64:39600) 2024-09-21T07:34:59.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 -- 172.21.15.64:0/2504900516 learned_addr learned my addr 172.21.15.64:0/2504900516 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 -- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f513815cbd0 msgr2=0x7f51380c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f513815cbd0 0x7f51380c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 -- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5138070850 msgr2=0x7f51381511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5138070850 0x7f51381511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 -- 172.21.15.64:0/2504900516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51380749f0 con 0x7f5138155340 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f5137200640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f513000c3c0 tx=0x7f513000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:59.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130017070 con 0x7f5138155340 2024-09-21T07:34:59.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5130005400 con 0x7f5138155340 2024-09-21T07:34:59.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5138074430 con 0x7f5138155340 2024-09-21T07:34:59.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51300118b0 con 0x7f5138155340 2024-09-21T07:34:59.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51380cddd0 con 0x7f5138155340 2024-09-21T07:34:59.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.433+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5138070310 con 0x7f5138155340 2024-09-21T07:34:59.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.437+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f513001a070 con 0x7f5138155340 2024-09-21T07:34:59.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.437+0000 7f512f400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 0x7f5114075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.437+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5249+0+0 (secure 0 0 0) 0x7f5130093360 con 0x7f5138155340 2024-09-21T07:34:59.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.437+0000 7f5136800640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 0x7f5114075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.437+0000 7f5136800640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 0x7f5114075740 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f51280af000 tx=0x7f51280194b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:59.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.441+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f513005de60 con 0x7f5138155340 2024-09-21T07:34:59.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.677+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5138154590 con 0x7f5138155340 2024-09-21T07:34:59.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.677+0000 7f512f400640 1 -- 172.21.15.64:0/2504900516 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v34) ==== 80+0+5304 (secure 0 0 0) 0x7f5130062890 con 0x7f5138155340 2024-09-21T07:34:59.680 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:34:59.680 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:34:59.680 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:34:59.682 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:34:59.685 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.686 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.687 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.688 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.689 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.690 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:34:59.691 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.692 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:34:59.693 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 msgr2=0x7f5114075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 0x7f5114075740 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f51280af000 tx=0x7f51280194b0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 msgr2=0x7f51380cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f513000c3c0 tx=0x7f513000c880 comp rx=0 tx=0).stop 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 shutdown_connections 2024-09-21T07:34:59.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5114073230 0x7f5114075740 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5138155340 0x7f51380cf370 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f513815cbd0 0x7f51380c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 --2- 172.21.15.64:0/2504900516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5138070850 0x7f51381511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 >> 172.21.15.64:0/2504900516 conn(0x7f51380ccbe0 msgr2=0x7f5138154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 shutdown_connections 2024-09-21T07:34:59.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.681+0000 7f513d400640 1 -- 172.21.15.64:0/2504900516 wait complete. 2024-09-21T07:34:59.703 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 -- 172.21.15.64:0/44909060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 msgr2=0x7fc430004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 --2- 172.21.15.64:0/44909060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc430004c20 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fc434009b60 tx=0x7fc43401d280 comp rx=0 tx=0).stop 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44a800640 1 -- 172.21.15.64:0/44909060 reap_dead start 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 -- 172.21.15.64:0/44909060 shutdown_connections 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 -- 172.21.15.64:0/44909060 >> 172.21.15.64:0/44909060 conn(0x7fc44c0cd3a0 msgr2=0x7fc44c0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 -- 172.21.15.64:0/44909060 shutdown_connections 2024-09-21T07:34:59.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.861+0000 7fc44b200640 1 -- 172.21.15.64:0/44909060 wait complete. 2024-09-21T07:34:59.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 Processor -- start 2024-09-21T07:34:59.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- start start 2024-09-21T07:34:59.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc44c14de90 0x7fc44c1fac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 0x7fc44c1fb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c166720 con 0x7fc430004810 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1665a0 con 0x7fc44c14de90 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c1668a0 con 0x7fc44c0b0e80 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39616/0 (socket says 172.21.15.64:39616) 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 -- 172.21.15.64:0/2506416581 learned_addr learned my addr 172.21.15.64:0/2506416581 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44a800640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 0x7fc44c1fb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc443e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc44c14de90 0x7fc44c1fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 -- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 msgr2=0x7fc44c1fb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 0x7fc44c1fb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 -- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc44c14de90 msgr2=0x7fc44c1fac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:59.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc44c14de90 0x7fc44c1fac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:59.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 -- 172.21.15.64:0/2506416581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c151420 con 0x7fc430004810 2024-09-21T07:34:59.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44a800640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 0x7fc44c1fb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:59.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc449e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000fc0 tx=0x7fc43c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:59.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c015020 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc43c010980 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c010d90 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c151890 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.865+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c151e50 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.869+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c0ce8c0 con 0x7fc430004810 2024-09-21T07:34:59.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.869+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc43c018020 con 0x7fc430004810 2024-09-21T07:34:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.869+0000 7fc442000640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 0x7fc428075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.869+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5249+0+0 (secure 0 0 0) 0x7fc43c0946e0 con 0x7fc430004810 2024-09-21T07:34:59.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.869+0000 7fc443e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 0x7fc428075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:59.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.873+0000 7fc443e00640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 0x7fc428075740 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc4340ae000 tx=0x7fc43401a020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:59.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:34:59.873+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc43c01f020 con 0x7fc430004810 2024-09-21T07:35:00.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc44c0cf2f0 con 0x7fc430004810 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc442000640 1 -- 172.21.15.64:0/2506416581 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) ==== 84+0+65 (secure 0 0 0) 0x7fc44c0ca960 con 0x7fc430004810 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:35:00.058 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:00.059 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 msgr2=0x7fc428075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 0x7fc428075740 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc4340ae000 tx=0x7fc43401a020 comp rx=0 tx=0).stop 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 msgr2=0x7fc44c0b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000fc0 tx=0x7fc43c00ea20 comp rx=0 tx=0).stop 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 shutdown_connections 2024-09-21T07:35:00.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc428073230 0x7fc428075740 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc44c0b0e80 0x7fc44c1fb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc44c14de90 0x7fc44c1fac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 --2- 172.21.15.64:0/2506416581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc430004810 0x7fc44c0b0800 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 >> 172.21.15.64:0/2506416581 conn(0x7fc44c0cd3a0 msgr2=0x7fc44c0b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 shutdown_connections 2024-09-21T07:35:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.057+0000 7fc44b200640 1 -- 172.21.15.64:0/2506416581 wait complete. 2024-09-21T07:35:00.081 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:35:00.081 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:35:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- 172.21.15.64:0/493343274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa58160c60 msgr2=0x7faa5806cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 --2- 172.21.15.64:0/493343274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa58160c60 0x7faa5806cdf0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7faa44009900 tx=0x7faa4401d300 comp rx=0 tx=0).stop 2024-09-21T07:35:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- 172.21.15.64:0/493343274 shutdown_connections 2024-09-21T07:35:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 --2- 172.21.15.64:0/493343274 >> v2:172.21.15.90:3300/0 conn(0x7faa58161070 0x7faa5806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 --2- 172.21.15.64:0/493343274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa58160c60 0x7faa5806cdf0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- 172.21.15.64:0/493343274 >> 172.21.15.64:0/493343274 conn(0x7faa580cdd00 msgr2=0x7faa580ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- 172.21.15.64:0/493343274 shutdown_connections 2024-09-21T07:35:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- 172.21.15.64:0/493343274 wait complete. 2024-09-21T07:35:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 Processor -- start 2024-09-21T07:35:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.245+0000 7faa5fc00640 1 -- start start 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 0x7faa58156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa58161070 0x7faa581f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa58169d70 con 0x7faa5815a360 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa58169bf0 con 0x7faa58161070 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7faa58169ef0 con 0x7faa58160c60 2024-09-21T07:35:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39632/0 (socket says 172.21.15.64:39632) 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 -- 172.21.15.64:0/3753623690 learned_addr learned my addr 172.21.15.64:0/3753623690 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa57e00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 0x7faa58156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5dc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa58161070 0x7faa581f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 -- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 msgr2=0x7faa58156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 0x7faa58156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 -- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa58161070 msgr2=0x7faa581f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa58161070 0x7faa581f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 -- 172.21.15.64:0/3753623690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5809cd30 con 0x7faa5815a360 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa57e00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 0x7faa58156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5d200640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c3d0 tx=0x7faa4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c017070 con 0x7faa5815a360 2024-09-21T07:35:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa4c0053c0 con 0x7faa5815a360 2024-09-21T07:35:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0038b0 con 0x7faa5815a360 2024-09-21T07:35:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5809d010 con 0x7faa5815a360 2024-09-21T07:35:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5809d5d0 con 0x7faa5815a360 2024-09-21T07:35:00.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.249+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa580b2d00 con 0x7faa5815a360 2024-09-21T07:35:00.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.253+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa4c01a070 con 0x7faa5815a360 2024-09-21T07:35:00.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.253+0000 7faa54c00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 0x7faa38075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:00.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.253+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5249+0+0 (secure 0 0 0) 0x7faa4c093460 con 0x7faa5815a360 2024-09-21T07:35:00.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.253+0000 7faa57e00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 0x7faa38075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:00.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.253+0000 7faa57e00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 0x7faa38075740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faa440af000 tx=0x7faa4401b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:00.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.257+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7faa4c05e630 con 0x7faa5815a360 2024-09-21T07:35:00.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:00.433+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7faa58074bb0 con 0x7faa5815a360 2024-09-21T07:35:01.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.217+0000 7faa54c00640 1 -- 172.21.15.64:0/3753623690 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) ==== 138+0+0 (secure 0 0 0) 0x7faa4c05df30 con 0x7faa5815a360 2024-09-21T07:35:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:35:01.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 msgr2=0x7faa38075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 0x7faa38075740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faa440af000 tx=0x7faa4401b0e0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 msgr2=0x7faa5809a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c3d0 tx=0x7faa4c00c890 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 shutdown_connections 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7faa38073230 0x7faa38075740 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa58161070 0x7faa581f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa58160c60 0x7faa58156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 --2- 172.21.15.64:0/3753623690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5815a360 0x7faa5809a9f0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 >> 172.21.15.64:0/3753623690 conn(0x7faa580cdd00 msgr2=0x7faa580b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 shutdown_connections 2024-09-21T07:35:01.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.221+0000 7faa5fc00640 1 -- 172.21.15.64:0/3753623690 wait complete. 2024-09-21T07:35:01.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 -- 172.21.15.64:0/2040991886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 msgr2=0x7f754c06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 --2- 172.21.15.64:0/2040991886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06ffb0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f754c0c71b0 tx=0x7f753401c7d0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 -- 172.21.15.64:0/2040991886 shutdown_connections 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 --2- 172.21.15.64:0/2040991886 >> v2:172.21.15.90:3300/0 conn(0x7f754c0704f0 0x7f754c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 --2- 172.21.15.64:0/2040991886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06ffb0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 --2- 172.21.15.64:0/2040991886 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c15ec20 0x7f754c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 -- 172.21.15.64:0/2040991886 >> 172.21.15.64:0/2040991886 conn(0x7f754c0ccbe0 msgr2=0x7f754c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 -- 172.21.15.64:0/2040991886 shutdown_connections 2024-09-21T07:35:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 -- 172.21.15.64:0/2040991886 wait complete. 2024-09-21T07:35:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.421+0000 7f7552000640 1 Processor -- start 2024-09-21T07:35:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- start start 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c0704f0 0x7f754c06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754c15ec20 0x7f754c1fc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0b24c0 con 0x7f754c0ca990 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0b2340 con 0x7f754c15ec20 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f754c0b2640 con 0x7f754c0704f0 2024-09-21T07:35:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39646/0 (socket says 172.21.15.64:39646) 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 -- 172.21.15.64:0/658890904 learned_addr learned my addr 172.21.15.64:0/658890904 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f754b400640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c0704f0 0x7f754c06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f754be00640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754c15ec20 0x7f754c1fc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 -- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c0704f0 msgr2=0x7f754c06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c0704f0 0x7f754c06eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 -- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754c15ec20 msgr2=0x7f754c1fc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754c15ec20 0x7f754c1fc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 -- 172.21.15.64:0/658890904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1f8b60 con 0x7f754c0ca990 2024-09-21T07:35:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543e00640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f753401a460 tx=0x7f7534004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340b2040 con 0x7f754c0ca990 2024-09-21T07:35:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7534005320 con 0x7f754c0ca990 2024-09-21T07:35:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340a5890 con 0x7f754c0ca990 2024-09-21T07:35:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c0c9fb0 con 0x7f754c0ca990 2024-09-21T07:35:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c0c5f10 con 0x7f754c0ca990 2024-09-21T07:35:01.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.425+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c1f8970 con 0x7f754c0ca990 2024-09-21T07:35:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.429+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f75340a5a30 con 0x7f754c0ca990 2024-09-21T07:35:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.429+0000 7f7543400640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 0x7f7528075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.429+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5619+0+0 (secure 0 0 0) 0x7f753412dd80 con 0x7f754c0ca990 2024-09-21T07:35:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.429+0000 7f754b400640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 0x7f7528075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.433+0000 7f754b400640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 0x7f7528075710 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f754c072330 tx=0x7f753c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.433+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f75340bd060 con 0x7f754c0ca990 2024-09-21T07:35:01.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:01.613+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f754c06ffb0 con 0x7f754c0ca990 2024-09-21T07:35:02.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.225+0000 7f7543400640 1 -- 172.21.15.64:0/658890904 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) ==== 170+0+0 (secure 0 0 0) 0x7f75340164b0 con 0x7f754c0ca990 2024-09-21T07:35:02.226 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:35:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 msgr2=0x7f7528075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 0x7f7528075710 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f754c072330 tx=0x7f753c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 msgr2=0x7f754c06f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f753401a460 tx=0x7f7534004600 comp rx=0 tx=0).stop 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 shutdown_connections 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7528073200 0x7f7528075710 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754c15ec20 0x7f754c1fc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f754c0ca990 0x7f754c06f3e0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 --2- 172.21.15.64:0/658890904 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f754c0704f0 0x7f754c06eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 >> 172.21.15.64:0/658890904 conn(0x7f754c0ccbe0 msgr2=0x7f754c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.229+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 shutdown_connections 2024-09-21T07:35:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.233+0000 7f7552000640 1 -- 172.21.15.64:0/658890904 wait complete. 2024-09-21T07:35:02.274 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 -- 172.21.15.64:0/2070100691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340cc960 msgr2=0x7f753415ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 --2- 172.21.15.64:0/2070100691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340cc960 0x7f753415ee70 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f75240098f0 tx=0x7f752401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 -- 172.21.15.64:0/2070100691 shutdown_connections 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 --2- 172.21.15.64:0/2070100691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75340b3140 0x7f75340b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 --2- 172.21.15.64:0/2070100691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340cc960 0x7f753415ee70 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 -- 172.21.15.64:0/2070100691 >> 172.21.15.64:0/2070100691 conn(0x7f753406d450 msgr2=0x7f75340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:02.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.433+0000 7f7538e00640 1 -- 172.21.15.64:0/2070100691 shutdown_connections 2024-09-21T07:35:02.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 -- 172.21.15.64:0/2070100691 wait complete. 2024-09-21T07:35:02.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 Processor -- start 2024-09-21T07:35:02.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 -- start start 2024-09-21T07:35:02.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:02.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75340cc960 0x7f75340ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:02.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75340c8360 0x7f75340cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7534168f50 con 0x7f75340b3140 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7534168dd0 con 0x7f75340cc960 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.437+0000 7f7538e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f75341690d0 con 0x7f75340c8360 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39670/0 (socket says 172.21.15.64:39670) 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 -- 172.21.15.64:0/3959123619 learned_addr learned my addr 172.21.15.64:0/3959123619 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 -- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75340c8360 msgr2=0x7f75340cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75340c8360 0x7f75340cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 -- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75340cc960 msgr2=0x7f75340ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75340cc960 0x7f75340ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 -- 172.21.15.64:0/3959123619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753415cdf0 con 0x7f75340b3140 2024-09-21T07:35:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7531e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f752401cdc0 tx=0x7f7524005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240b2040 con 0x7f75340b3140 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7524004130 con 0x7f75340b3140 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524003600 con 0x7f75340b3140 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753415d0d0 con 0x7f75340b3140 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75340c8810 con 0x7f75340b3140 2024-09-21T07:35:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753415d310 con 0x7f75340b3140 2024-09-21T07:35:02.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.441+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f75240bd030 con 0x7f75340b3140 2024-09-21T07:35:02.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.445+0000 7f752a000640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 0x7f7510075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:02.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.445+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6001+0+0 (secure 0 0 0) 0x7f752412ded0 con 0x7f75340b3140 2024-09-21T07:35:02.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.445+0000 7f752be00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 0x7f7510075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:02.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.445+0000 7f752be00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 0x7f7510075710 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f751c0058d0 tx=0x7f751c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:02.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.449+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f753415d310 con 0x7f75340b3140 2024-09-21T07:35:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:02.665+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f75340c8a70 con 0x7f75340b3140 2024-09-21T07:35:03.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.225+0000 7f752a000640 1 -- 172.21.15.64:0/3959123619 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v129) ==== 174+0+0 (secure 0 0 0) 0x7f75240c4060 con 0x7f75340b3140 2024-09-21T07:35:03.228 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 25 and data pool 26 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 msgr2=0x7f7510075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 0x7f7510075710 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f751c0058d0 tx=0x7f751c005860 comp rx=0 tx=0).stop 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 msgr2=0x7f753415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f752401cdc0 tx=0x7f7524005e10 comp rx=0 tx=0).stop 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 shutdown_connections 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7510073200 0x7f7510075710 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75340c8360 0x7f75340cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75340cc960 0x7f75340ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 --2- 172.21.15.64:0/3959123619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75340b3140 0x7f753415dec0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 >> 172.21.15.64:0/3959123619 conn(0x7f753406d450 msgr2=0x7f75340ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:03.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 shutdown_connections 2024-09-21T07:35:03.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.229+0000 7f7538e00640 1 -- 172.21.15.64:0/3959123619 wait complete. 2024-09-21T07:35:03.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- 172.21.15.64:0/1683578191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d415cbd0 msgr2=0x7fe7d4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 --2- 172.21.15.64:0/1683578191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d415cbd0 0x7fe7d4070310 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009cb0 tx=0x7fe7c401cd70 comp rx=0 tx=0).stop 2024-09-21T07:35:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- 172.21.15.64:0/1683578191 shutdown_connections 2024-09-21T07:35:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 --2- 172.21.15.64:0/1683578191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d415cbd0 0x7fe7d4070310 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- 172.21.15.64:0/1683578191 >> 172.21.15.64:0/1683578191 conn(0x7fe7d40ccbe0 msgr2=0x7fe7d40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:03.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- 172.21.15.64:0/1683578191 shutdown_connections 2024-09-21T07:35:03.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- 172.21.15.64:0/1683578191 wait complete. 2024-09-21T07:35:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 Processor -- start 2024-09-21T07:35:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.453+0000 7fe7da600640 1 -- start start 2024-09-21T07:35:03.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7d415cbd0 0x7fe7d4153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d40aeda0 0x7fe7d409cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d416b6b0 con 0x7fe7d4070850 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d416b530 con 0x7fe7d40aeda0 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d416b830 con 0x7fe7d415cbd0 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39696/0 (socket says 172.21.15.64:39696) 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 -- 172.21.15.64:0/1349085740 learned_addr learned my addr 172.21.15.64:0/1349085740 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7caa00640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7d415cbd0 0x7fe7d4153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3e00640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d40aeda0 0x7fe7d409cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 -- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7d415cbd0 msgr2=0x7fe7d4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7d415cbd0 0x7fe7d4153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 -- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d40aeda0 msgr2=0x7fe7d409cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d40aeda0 0x7fe7d409cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 -- 172.21.15.64:0/1349085740 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4151620 con 0x7fe7d4070850 2024-09-21T07:35:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7d3400640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f90 tx=0x7fe7c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40bb070 con 0x7fe7d4070850 2024-09-21T07:35:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7c40045d0 con 0x7fe7d4070850 2024-09-21T07:35:03.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40b2040 con 0x7fe7d4070850 2024-09-21T07:35:03.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d40ae360 con 0x7fe7d4070850 2024-09-21T07:35:03.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d40aff20 con 0x7fe7d4070850 2024-09-21T07:35:03.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.457+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d4070310 con 0x7fe7d4070850 2024-09-21T07:35:03.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.461+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe7c4004a50 con 0x7fe7d4070850 2024-09-21T07:35:03.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.461+0000 7fe7cbe00640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 0x7fe7b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.461+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fe7c412e630 con 0x7fe7d4070850 2024-09-21T07:35:03.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.461+0000 7fe7caa00640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 0x7fe7b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.461+0000 7fe7caa00640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 0x7fe7b0075710 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4074d00 tx=0x7fe7bc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:03.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.465+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe7c4016990 con 0x7fe7d4070850 2024-09-21T07:35:03.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.641+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7d4154f30 con 0x7fe7d4070850 2024-09-21T07:35:03.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.641+0000 7fe7cbe00640 1 -- 172.21.15.64:0/1349085740 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16913 (secure 0 0 0) 0x7fe7c40f9420 con 0x7fe7d4070850 2024-09-21T07:35:03.645 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:03.645 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":177,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:02.669216+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:00.450517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:01.627078+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 msgr2=0x7fe7b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 0x7fe7b0075710 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4074d00 tx=0x7fe7bc009040 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 msgr2=0x7fe7d409b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f90 tx=0x7fe7c40042f0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 shutdown_connections 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe7b0073200 0x7fe7b0075710 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d40aeda0 0x7fe7d409cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7d415cbd0 0x7fe7d4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 --2- 172.21.15.64:0/1349085740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7d4070850 0x7fe7d409b400 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 >> 172.21.15.64:0/1349085740 conn(0x7fe7d40ccbe0 msgr2=0x7fe7d415e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 shutdown_connections 2024-09-21T07:35:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.645+0000 7fe7da600640 1 -- 172.21.15.64:0/1349085740 wait complete. 2024-09-21T07:35:03.667 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- 172.21.15.64:0/237885769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440b4130 msgr2=0x7f98440cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 --2- 172.21.15.64:0/237885769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440b4130 0x7f98440cb100 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f9844071d50 tx=0x7f983c01cd80 comp rx=0 tx=0).stop 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- 172.21.15.64:0/237885769 shutdown_connections 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 --2- 172.21.15.64:0/237885769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440b4130 0x7f98440cb100 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 --2- 172.21.15.64:0/237885769 >> v2:172.21.15.90:3300/0 conn(0x7f98440b24e0 0x7f98440ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- 172.21.15.64:0/237885769 >> 172.21.15.64:0/237885769 conn(0x7f98440ccbe0 msgr2=0x7f98440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- 172.21.15.64:0/237885769 shutdown_connections 2024-09-21T07:35:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- 172.21.15.64:0/237885769 wait complete. 2024-09-21T07:35:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 Processor -- start 2024-09-21T07:35:03.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.825+0000 7f984a400640 1 -- start start 2024-09-21T07:35:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98440b24e0 0x7f9844154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98440b4130 0x7f9844166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9844165b30 con 0x7f98440cacf0 2024-09-21T07:35:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f984415f910 con 0x7f98440b24e0 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9844165cb0 con 0x7f98440b4130 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39712/0 (socket says 172.21.15.64:39712) 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 -- 172.21.15.64:0/1282533752 learned_addr learned my addr 172.21.15.64:0/1282533752 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98440b24e0 0x7f9844154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f983aa00640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98440b4130 0x7f9844166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 -- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98440b4130 msgr2=0x7f9844166b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98440b4130 0x7f9844166b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 -- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98440b24e0 msgr2=0x7f9844154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98440b24e0 0x7f9844154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 -- 172.21.15.64:0/1282533752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9844070510 con 0x7f98440cacf0 2024-09-21T07:35:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f9843e00640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f983c009bd0 tx=0x7f983c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0bb070 con 0x7f98440cacf0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f983c004d40 con 0x7f98440cacf0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0b2040 con 0x7f98440cacf0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98440707f0 con 0x7f98440cacf0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98440ae370 con 0x7f98440cacf0 2024-09-21T07:35:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.829+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98440ae0e0 con 0x7f98440cacf0 2024-09-21T07:35:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.833+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f983c004240 con 0x7f98440cacf0 2024-09-21T07:35:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.833+0000 7f983be00640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 0x7f9820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.833+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f983c12e1b0 con 0x7f98440cacf0 2024-09-21T07:35:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.833+0000 7f9843400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 0x7f9820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.833+0000 7f9843400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 0x7f9820075710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f983400ff60 tx=0x7f983400f6f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:03.837+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f983c016970 con 0x7f98440cacf0 2024-09-21T07:35:04.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.013+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98440ad120 con 0x7f98440cacf0 2024-09-21T07:35:04.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f983be00640 1 -- 172.21.15.64:0/1282533752 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16913 (secure 0 0 0) 0x7f983c0f89e0 con 0x7f98440cacf0 2024-09-21T07:35:04.018 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:04.018 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":177,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:02.669216+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:00.450517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:01.627078+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 msgr2=0x7f9820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 0x7f9820075710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f983400ff60 tx=0x7f983400f6f0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 msgr2=0x7f9844167080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f983c009bd0 tx=0x7f983c005b00 comp rx=0 tx=0).stop 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 shutdown_connections 2024-09-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9820073200 0x7f9820075710 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98440cacf0 0x7f9844167080 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98440b4130 0x7f9844166b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 --2- 172.21.15.64:0/1282533752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98440b24e0 0x7f9844154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 >> 172.21.15.64:0/1282533752 conn(0x7f98440ccbe0 msgr2=0x7f9844164bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 shutdown_connections 2024-09-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.017+0000 7f984a400640 1 -- 172.21.15.64:0/1282533752 wait complete. 2024-09-21T07:35:04.041 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 -- 172.21.15.64:0/505056864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 msgr2=0x7fe19c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/505056864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c0d0300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe19c15d100 tx=0x7fe18801c820 comp rx=0 tx=0).stop 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 -- 172.21.15.64:0/505056864 shutdown_connections 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/505056864 >> v2:172.21.15.90:3300/0 conn(0x7fe19c0b3e30 0x7fe19c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/505056864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c0d0300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 -- 172.21.15.64:0/505056864 >> 172.21.15.64:0/505056864 conn(0x7fe19c0d23b0 msgr2=0x7fe19c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:04.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 -- 172.21.15.64:0/505056864 shutdown_connections 2024-09-21T07:35:04.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.201+0000 7fe1a3c00640 1 -- 172.21.15.64:0/505056864 wait complete. 2024-09-21T07:35:04.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 Processor -- start 2024-09-21T07:35:04.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- start start 2024-09-21T07:35:04.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:04.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:04.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19c15c9f0 0x7fe19c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c169e90 con 0x7fe19c0b3e30 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c169d10 con 0x7fe19c15c9f0 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c16a010 con 0x7fe19c0cfef0 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe19be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39728/0 (socket says 172.21.15.64:39728) 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 -- 172.21.15.64:0/2443566969 learned_addr learned my addr 172.21.15.64:0/2443566969 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19c15c9f0 0x7fe19c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 -- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 msgr2=0x7fe19c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 -- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19c15c9f0 msgr2=0x7fe19c158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19c15c9f0 0x7fe19c158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 -- 172.21.15.64:0/2443566969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c1569f0 con 0x7fe19c0b3e30 2024-09-21T07:35:04.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a1200640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c430 tx=0x7fe19000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190011790 con 0x7fe19c0b3e30 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c0ca540 con 0x7fe19c0b3e30 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe190017070 con 0x7fe19c0b3e30 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190011ce0 con 0x7fe19c0b3e30 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.205+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c0caac0 con 0x7fe19c0b3e30 2024-09-21T07:35:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c0b4240 con 0x7fe19c0b3e30 2024-09-21T07:35:04.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe19001c460 con 0x7fe19c0b3e30 2024-09-21T07:35:04.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe198c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 0x7fe17c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:04.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fe190094080 con 0x7fe19c0b3e30 2024-09-21T07:35:04.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe19be00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 0x7fe17c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:04.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.209+0000 7fe19be00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 0x7fe17c075710 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe1880af000 tx=0x7fe18801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.213+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe19c0ca540 con 0x7fe19c0b3e30 2024-09-21T07:35:04.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:04.433+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe19c0c5c10 con 0x7fe19c0b3e30 2024-09-21T07:35:05.206 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:35:05.205+0000 7feecae00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:35:05.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.269+0000 7fe198c00640 1 -- 172.21.15.64:0/2443566969 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v132) ==== 118+0+0 (secure 0 0 0) 0x7fe19005e990 con 0x7fe19c0b3e30 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 msgr2=0x7fe17c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 0x7fe17c075710 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe1880af000 tx=0x7fe18801b060 comp rx=0 tx=0).stop 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 msgr2=0x7fe19c0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c430 tx=0x7fe19000c8f0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 shutdown_connections 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe17c073200 0x7fe17c075710 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19c15c9f0 0x7fe19c158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe19c0cfef0 0x7fe19c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 --2- 172.21.15.64:0/2443566969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe19c0b3e30 0x7fe19c0c8010 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 >> 172.21.15.64:0/2443566969 conn(0x7fe19c0d23b0 msgr2=0x7fe19c0d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:05.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 shutdown_connections 2024-09-21T07:35:05.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.273+0000 7fe1a3c00640 1 -- 172.21.15.64:0/2443566969 wait complete. 2024-09-21T07:35:05.296 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:35:05.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 -- 172.21.15.64:0/1992827432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac015f9a0 msgr2=0x7f5ac015fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 --2- 172.21.15.64:0/1992827432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac015f9a0 0x7f5ac015fdb0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009900 tx=0x7f5aa801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 -- 172.21.15.64:0/1992827432 shutdown_connections 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 --2- 172.21.15.64:0/1992827432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac01602f0 0x7f5ac006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 --2- 172.21.15.64:0/1992827432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac015f9a0 0x7f5ac015fdb0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 -- 172.21.15.64:0/1992827432 >> 172.21.15.64:0/1992827432 conn(0x7f5ac006d450 msgr2=0x7f5ac00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 -- 172.21.15.64:0/1992827432 shutdown_connections 2024-09-21T07:35:05.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.461+0000 7f5ac7000640 1 -- 172.21.15.64:0/1992827432 wait complete. 2024-09-21T07:35:05.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 Processor -- start 2024-09-21T07:35:05.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- start start 2024-09-21T07:35:05.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac009df30 0x7f5ac0153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:05.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ac015f9a0 0x7f5ac009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:05.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:05.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0168df0 con 0x7f5ac01602f0 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0168c70 con 0x7f5ac015f9a0 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac0168f70 con 0x7f5ac009df30 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac009df30 0x7f5ac0153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39804/0 (socket says 172.21.15.64:39804) 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 -- 172.21.15.64:0/2843805288 learned_addr learned my addr 172.21.15.64:0/2843805288 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ab7e00640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ac015f9a0 0x7f5ac009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 -- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac009df30 msgr2=0x7f5ac0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac009df30 0x7f5ac0153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 -- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ac015f9a0 msgr2=0x7f5ac009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ac015f9a0 0x7f5ac009c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:05.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 -- 172.21.15.64:0/2843805288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00afb10 con 0x7f5ac01602f0 2024-09-21T07:35:05.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac5000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800ea80 tx=0x7f5ab800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:05.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8004b30 con 0x7f5ac01602f0 2024-09-21T07:35:05.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab8004cf0 con 0x7f5ac01602f0 2024-09-21T07:35:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8005280 con 0x7f5ac01602f0 2024-09-21T07:35:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01f99a0 con 0x7f5ac01602f0 2024-09-21T07:35:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.465+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac00b2b00 con 0x7f5ac01602f0 2024-09-21T07:35:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac015fdb0 con 0x7f5ac01602f0 2024-09-21T07:35:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5ab8005420 con 0x7f5ac01602f0 2024-09-21T07:35:05.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5abcc00640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 0x7f5a9c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:05.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f5ab8094f20 con 0x7f5ac01602f0 2024-09-21T07:35:05.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5abfe00640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 0x7f5a9c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:05.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.469+0000 7f5abfe00640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 0x7f5a9c075740 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0001780 tx=0x7f5ab0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.473+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5ab805f7e0 con 0x7f5ac01602f0 2024-09-21T07:35:05.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:05.689+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5ac0153fe0 con 0x7f5ac01602f0 2024-09-21T07:35:06.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5abcc00640 1 -- 172.21.15.64:0/2843805288 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v133) ==== 122+0+0 (secure 0 0 0) 0x7f5ab8064210 con 0x7f5ac01602f0 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 msgr2=0x7f5a9c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 0x7f5a9c075740 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0001780 tx=0x7f5ab0009040 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 msgr2=0x7f5ac009c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800ea80 tx=0x7f5ab800ef40 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 shutdown_connections 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a9c073230 0x7f5a9c075740 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac01602f0 0x7f5ac009c7a0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ac015f9a0 0x7f5ac009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 --2- 172.21.15.64:0/2843805288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ac009df30 0x7f5ac0153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.277+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 >> 172.21.15.64:0/2843805288 conn(0x7f5ac006d450 msgr2=0x7f5ac01663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.281+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 shutdown_connections 2024-09-21T07:35:06.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.281+0000 7f5ac7000640 1 -- 172.21.15.64:0/2843805288 wait complete. 2024-09-21T07:35:06.303 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:35:06.303 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:06.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 -- 172.21.15.64:0/4274478192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 msgr2=0x7feef8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 --2- 172.21.15.64:0/4274478192 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7feef8003ef0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fef04009b60 tx=0x7fef0401d280 comp rx=0 tx=0).stop 2024-09-21T07:35:06.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef12800640 1 -- 172.21.15.64:0/4274478192 reap_dead start 2024-09-21T07:35:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 -- 172.21.15.64:0/4274478192 shutdown_connections 2024-09-21T07:35:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 -- 172.21.15.64:0/4274478192 >> 172.21.15.64:0/4274478192 conn(0x7fef140ccbe0 msgr2=0x7fef140ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 -- 172.21.15.64:0/4274478192 shutdown_connections 2024-09-21T07:35:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.461+0000 7fef18e00640 1 -- 172.21.15.64:0/4274478192 wait complete. 2024-09-21T07:35:06.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 Processor -- start 2024-09-21T07:35:06.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 -- start start 2024-09-21T07:35:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef140c9040 0x7fef140c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 0x7fef141f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b34e0 con 0x7feef8003a80 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b3360 con 0x7fef141f85a0 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef18e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fef140b3660 con 0x7fef140c9040 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39830/0 (socket says 172.21.15.64:39830) 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 -- 172.21.15.64:0/938365583 learned_addr learned my addr 172.21.15.64:0/938365583 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 -- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef140c9040 msgr2=0x7fef140c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef12800640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 0x7fef141f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef140c9040 0x7fef140c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 -- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 msgr2=0x7fef141f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 0x7fef141f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.465+0000 7fef11e00640 1 -- 172.21.15.64:0/938365583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef141f80f0 con 0x7feef8003a80 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef12800640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 0x7fef141f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef11e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fef040af040 tx=0x7fef04005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040b1040 con 0x7feef8003a80 2024-09-21T07:35:06.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef040bb070 con 0x7feef8003a80 2024-09-21T07:35:06.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef141f8ef0 con 0x7feef8003a80 2024-09-21T07:35:06.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04004290 con 0x7feef8003a80 2024-09-21T07:35:06.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef141fbe00 con 0x7feef8003a80 2024-09-21T07:35:06.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14070310 con 0x7feef8003a80 2024-09-21T07:35:06.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fef040046d0 con 0x7feef8003a80 2024-09-21T07:35:06.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 0x7feef0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.469+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fef0412f4e0 con 0x7feef8003a80 2024-09-21T07:35:06.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.473+0000 7fef09400640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 0x7feef0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.473+0000 7fef09400640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 0x7feef0075740 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fef141572c0 tx=0x7feefc001260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:06.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.473+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fef04016fc0 con 0x7feef8003a80 2024-09-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1409d8b0 con 0x7feef8003a80 2024-09-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef0aa00640 1 -- 172.21.15.64:0/938365583 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5233 (secure 0 0 0) 0x7fef040fa360 con 0x7feef8003a80 2024-09-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":133,"btime":"2024-09-21T07:35:06:274222+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":10065,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":133,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:05.695775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:06.691 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 133 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 msgr2=0x7feef0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 0x7feef0075740 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fef141572c0 tx=0x7feefc001260 comp rx=0 tx=0).stop 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 msgr2=0x7fef140cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fef040af040 tx=0x7fef04005640 comp rx=0 tx=0).stop 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 shutdown_connections 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feef0073230 0x7feef0075740 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef141f85a0 0x7fef141f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef140c9040 0x7fef140c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 --2- 172.21.15.64:0/938365583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feef8003a80 0x7fef140cf8a0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 >> 172.21.15.64:0/938365583 conn(0x7fef140ccbe0 msgr2=0x7fef140ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:06.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 shutdown_connections 2024-09-21T07:35:06.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.689+0000 7fef18e00640 1 -- 172.21.15.64:0/938365583 wait complete. 2024-09-21T07:35:06.713 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:06.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 -- 172.21.15.64:0/4171528441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 msgr2=0x7fec7c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 --2- 172.21.15.64:0/4171528441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b41c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec64009840 tx=0x7fec6401c820 comp rx=0 tx=0).stop 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 -- 172.21.15.64:0/4171528441 shutdown_connections 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 --2- 172.21.15.64:0/4171528441 >> v2:172.21.15.90:3300/0 conn(0x7fec7c0b4700 0x7fec7c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 --2- 172.21.15.64:0/4171528441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b41c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 -- 172.21.15.64:0/4171528441 >> 172.21.15.64:0/4171528441 conn(0x7fec7c0ccbe0 msgr2=0x7fec7c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 -- 172.21.15.64:0/4171528441 shutdown_connections 2024-09-21T07:35:06.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.869+0000 7fec82600640 1 -- 172.21.15.64:0/4171528441 wait complete. 2024-09-21T07:35:06.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 Processor -- start 2024-09-21T07:35:06.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 -- start start 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 0x7fec7c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c168bb0 con 0x7fec7c15edb0 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c168a30 con 0x7fec7c0b4700 2024-09-21T07:35:06.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec82600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c168d30 con 0x7fec7c0709b0 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39834/0 (socket says 172.21.15.64:39834) 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec7be00640 1 -- 172.21.15.64:0/3522486922 learned_addr learned my addr 172.21.15.64:0/3522486922 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 0x7fec7c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec7b400640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 -- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 msgr2=0x7fec7c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 -- 172.21.15.64:0/3522486922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 msgr2=0x7fec7c1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 -- 172.21.15.64:0/3522486922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c0b2840 con 0x7fec7c0b4700 2024-09-21T07:35:06.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec7be00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.873+0000 7fec72a00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 0x7fec7c155410 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fec640ac000 tx=0x7fec640a65c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640a6db0 con 0x7fec7c0b4700 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec64004130 con 0x7fec7c0b4700 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c1fa3c0 con 0x7fec7c0b4700 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64003600 con 0x7fec7c0b4700 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c1fa980 con 0x7fec7c0b4700 2024-09-21T07:35:06.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c0b25b0 con 0x7fec7c0b4700 2024-09-21T07:35:06.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fec640c0060 con 0x7fec7c0b4700 2024-09-21T07:35:06.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 0x7fec58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:06.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fec6412e4f0 con 0x7fec7c0b4700 2024-09-21T07:35:06.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.877+0000 7fec7b400640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 0x7fec58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:06.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.881+0000 7fec7b400640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 0x7fec58075710 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007d70 tx=0x7fec6c007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:06.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:06.881+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fec64016410 con 0x7fec7c0b4700 2024-09-21T07:35:07.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.065+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec7c0b41c0 con 0x7fec7c0b4700 2024-09-21T07:35:07.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.065+0000 7fec73e00640 1 -- 172.21.15.64:0/3522486922 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16900 (secure 0 0 0) 0x7fec64118220 con 0x7fec7c0b4700 2024-09-21T07:35:07.068 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:07.068 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":178,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:04.244734+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:00.450517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:01.627078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:07.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 msgr2=0x7fec58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 0x7fec58075710 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007d70 tx=0x7fec6c007d00 comp rx=0 tx=0).stop 2024-09-21T07:35:07.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 msgr2=0x7fec7c155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 0x7fec7c155410 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fec640ac000 tx=0x7fec640a65c0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 shutdown_connections 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fec58073200 0x7fec58075710 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec7c15edb0 0x7fec7c1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec7c0b4700 0x7fec7c155410 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 --2- 172.21.15.64:0/3522486922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fec7c0709b0 0x7fec7c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 >> 172.21.15.64:0/3522486922 conn(0x7fec7c0ccbe0 msgr2=0x7fec7c158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 shutdown_connections 2024-09-21T07:35:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.069+0000 7fec82600640 1 -- 172.21.15.64:0/3522486922 wait complete. 2024-09-21T07:35:07.091 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:35:07.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:35:07.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- 172.21.15.64:0/2161128020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb01604b0 msgr2=0x7f3bb01608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2161128020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb01604b0 0x7f3bb01608c0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009bc0 tx=0x7f3ba801cba0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- 172.21.15.64:0/2161128020 shutdown_connections 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2161128020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb01604b0 0x7f3bb01608c0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2161128020 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb00cf260 0x7f3bb00cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- 172.21.15.64:0/2161128020 >> 172.21.15.64:0/2161128020 conn(0x7f3bb006e890 msgr2=0x7f3bb00b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- 172.21.15.64:0/2161128020 shutdown_connections 2024-09-21T07:35:07.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- 172.21.15.64:0/2161128020 wait complete. 2024-09-21T07:35:07.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 Processor -- start 2024-09-21T07:35:07.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.249+0000 7f3bb5400640 1 -- start start 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bb00cf260 0x7f3bb014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb01604b0 0x7f3bb0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb016a320 con 0x7f3bb006cdf0 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb016a1a0 con 0x7f3bb00cf260 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb016a4a0 con 0x7f3bb01604b0 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39864/0 (socket says 172.21.15.64:39864) 2024-09-21T07:35:07.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 -- 172.21.15.64:0/2745213616 learned_addr learned my addr 172.21.15.64:0/2745213616 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3baf200640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb01604b0 0x7f3bb0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3ba7e00640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bb00cf260 0x7f3bb014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 -- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb01604b0 msgr2=0x7f3bb0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb01604b0 0x7f3bb0152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 -- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bb00cf260 msgr2=0x7f3bb014b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bb00cf260 0x7f3bb014b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 -- 172.21.15.64:0/2745213616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb014b550 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bae800640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0001ec0 tx=0x7f3ba000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0017070 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ba0003600 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb00b29c0 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003a50 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb0154740 con 0x7f3bb006cdf0 2024-09-21T07:35:07.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.253+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb00cf670 con 0x7f3bb006cdf0 2024-09-21T07:35:07.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.257+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3ba001a070 con 0x7f3bb006cdf0 2024-09-21T07:35:07.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.257+0000 7f3ba6a00640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 0x7f3b8c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.257+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f3ba00936f0 con 0x7f3bb006cdf0 2024-09-21T07:35:07.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.257+0000 7f3ba7e00640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 0x7f3b8c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.257+0000 7f3ba7e00640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 0x7f3b8c075710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0153570 tx=0x7f3b9800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:07.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.261+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3ba005de90 con 0x7f3bb006cdf0 2024-09-21T07:35:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.433+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bb0071090 con 0x7f3b8c073200 2024-09-21T07:35:07.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3ba6a00640 1 -- 172.21.15.64:0/2745213616 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244964 (secure 0 0 0) 0x7f3bb0071090 con 0x7f3b8c073200 2024-09-21T07:35:07.444 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:07.445 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 msgr2=0x7f3b8c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 0x7f3b8c075710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0153570 tx=0x7f3b9800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 msgr2=0x7f3bb00b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0001ec0 tx=0x7f3ba000c890 comp rx=0 tx=0).stop 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 shutdown_connections 2024-09-21T07:35:07.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b8c073200 0x7f3b8c075710 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3bb01604b0 0x7f3bb0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bb00cf260 0x7f3bb014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 --2- 172.21.15.64:0/2745213616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bb006cdf0 0x7f3bb00b2070 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.441+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 >> 172.21.15.64:0/2745213616 conn(0x7f3bb006e890 msgr2=0x7f3bb006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.445+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 shutdown_connections 2024-09-21T07:35:07.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.445+0000 7f3bb5400640 1 -- 172.21.15.64:0/2745213616 wait complete. 2024-09-21T07:35:07.465 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-09-21T07:35:05.624550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":473232,"kb_used_data":18336,"kb_used_omap":12,"kb_used_meta":454707,"kb_avail":754501488,"statfs":{"total":773094113280,"available":772609523712,"internally_reserved":0,"allocated":18776064,"data_stored":9468592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":465620531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.401159"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240634+0000","last_change":"2024-09-21T07:35:02.240634+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240634+0000","last_undegraded":"2024-09-21T07:35:02.240634+0000","last_fullsized":"2024-09-21T07:35:02.240634+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239707+0000","last_change":"2024-09-21T07:35:02.239707+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239707+0000","last_undegraded":"2024-09-21T07:35:02.239707+0000","last_fullsized":"2024-09-21T07:35:02.239707+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243453+0000","last_change":"2024-09-21T07:35:02.243453+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243453+0000","last_undegraded":"2024-09-21T07:35:02.243453+0000","last_fullsized":"2024-09-21T07:35:02.243453+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.247783+0000","last_change":"2024-09-21T07:35:02.247783+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.247783+0000","last_undegraded":"2024-09-21T07:35:02.247783+0000","last_fullsized":"2024-09-21T07:35:02.247783+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234135+0000","last_change":"2024-09-21T07:35:02.234135+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234135+0000","last_undegraded":"2024-09-21T07:35:02.234135+0000","last_fullsized":"2024-09-21T07:35:02.234135+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239262+0000","last_change":"2024-09-21T07:35:02.239262+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239262+0000","last_undegraded":"2024-09-21T07:35:02.239262+0000","last_fullsized":"2024-09-21T07:35:02.239262+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237648+0000","last_change":"2024-09-21T07:35:02.237648+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237648+0000","last_undegraded":"2024-09-21T07:35:02.237648+0000","last_fullsized":"2024-09-21T07:35:02.237648+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.245751+0000","last_change":"2024-09-21T07:35:02.245751+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.245751+0000","last_undegraded":"2024-09-21T07:35:02.245751+0000","last_fullsized":"2024-09-21T07:35:02.245751+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239916+0000","last_change":"2024-09-21T07:35:02.239916+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239916+0000","last_undegraded":"2024-09-21T07:35:02.239916+0000","last_fullsized":"2024-09-21T07:35:02.239916+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232742+0000","last_change":"2024-09-21T07:35:02.232742+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232742+0000","last_undegraded":"2024-09-21T07:35:02.232742+0000","last_fullsized":"2024-09-21T07:35:02.232742+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239815+0000","last_change":"2024-09-21T07:35:02.239815+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239815+0000","last_undegraded":"2024-09-21T07:35:02.239815+0000","last_fullsized":"2024-09-21T07:35:02.239815+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241032+0000","last_change":"2024-09-21T07:35:02.241032+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241032+0000","last_undegraded":"2024-09-21T07:35:02.241032+0000","last_fullsized":"2024-09-21T07:35:02.241032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238290+0000","last_change":"2024-09-21T07:35:02.238290+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238290+0000","last_undegraded":"2024-09-21T07:35:02.238290+0000","last_fullsized":"2024-09-21T07:35:02.238290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238804+0000","last_change":"2024-09-21T07:35:02.238804+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238804+0000","last_undegraded":"2024-09-21T07:35:02.238804+0000","last_fullsized":"2024-09-21T07:35:02.238804+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244198+0000","last_change":"2024-09-21T07:35:02.244198+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244198+0000","last_undegraded":"2024-09-21T07:35:02.244198+0000","last_fullsized":"2024-09-21T07:35:02.244198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240376+0000","last_change":"2024-09-21T07:35:02.240376+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240376+0000","last_undegraded":"2024-09-21T07:35:02.240376+0000","last_fullsized":"2024-09-21T07:35:02.240376+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235734+0000","last_change":"2024-09-21T07:35:02.235734+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235734+0000","last_undegraded":"2024-09-21T07:35:02.235734+0000","last_fullsized":"2024-09-21T07:35:02.235734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238877+0000","last_change":"2024-09-21T07:35:02.238877+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238877+0000","last_undegraded":"2024-09-21T07:35:02.238877+0000","last_fullsized":"2024-09-21T07:35:02.238877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237637+0000","last_change":"2024-09-21T07:35:02.237637+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237637+0000","last_undegraded":"2024-09-21T07:35:02.237637+0000","last_fullsized":"2024-09-21T07:35:02.237637+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235914+0000","last_change":"2024-09-21T07:35:02.235914+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235914+0000","last_undegraded":"2024-09-21T07:35:02.235914+0000","last_fullsized":"2024-09-21T07:35:02.235914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233660+0000","last_change":"2024-09-21T07:35:02.233660+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233660+0000","last_undegraded":"2024-09-21T07:35:02.233660+0000","last_fullsized":"2024-09-21T07:35:02.233660+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261396+0000","last_change":"2024-09-21T07:35:02.258592+0000","last_active":"2024-09-21T07:35:02.261396+0000","last_peered":"2024-09-21T07:35:02.261396+0000","last_clean":"2024-09-21T07:35:02.261396+0000","last_became_active":"2024-09-21T07:35:02.258264+0000","last_became_peered":"2024-09-21T07:35:02.258264+0000","last_unstale":"2024-09-21T07:35:02.261396+0000","last_undegraded":"2024-09-21T07:35:02.261396+0000","last_fullsized":"2024-09-21T07:35:02.261396+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:09.521183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234610+0000","last_change":"2024-09-21T07:35:02.234610+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234610+0000","last_undegraded":"2024-09-21T07:35:02.234610+0000","last_fullsized":"2024-09-21T07:35:02.234610+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:01.219487+0000","last_change":"2024-09-21T07:35:01.219487+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.219487+0000","last_undegraded":"2024-09-21T07:35:01.219487+0000","last_fullsized":"2024-09-21T07:35:01.219487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238071+0000","last_change":"2024-09-21T07:35:02.238071+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238071+0000","last_undegraded":"2024-09-21T07:35:02.238071+0000","last_fullsized":"2024-09-21T07:35:02.238071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.251107+0000","last_change":"2024-09-21T07:35:02.249622+0000","last_active":"2024-09-21T07:35:02.251107+0000","last_peered":"2024-09-21T07:35:02.251107+0000","last_clean":"2024-09-21T07:35:02.251107+0000","last_became_active":"2024-09-21T07:35:02.249278+0000","last_became_peered":"2024-09-21T07:35:02.249278+0000","last_unstale":"2024-09-21T07:35:02.251107+0000","last_undegraded":"2024-09-21T07:35:02.251107+0000","last_fullsized":"2024-09-21T07:35:02.251107+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:50.071551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.242278+0000","last_change":"2024-09-21T07:35:02.242278+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.242278+0000","last_undegraded":"2024-09-21T07:35:02.242278+0000","last_fullsized":"2024-09-21T07:35:02.242278+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.245953+0000","last_change":"2024-09-21T07:35:02.244307+0000","last_active":"2024-09-21T07:35:02.245953+0000","last_peered":"2024-09-21T07:35:02.245953+0000","last_clean":"2024-09-21T07:35:02.245953+0000","last_became_active":"2024-09-21T07:35:02.243923+0000","last_became_peered":"2024-09-21T07:35:02.243923+0000","last_unstale":"2024-09-21T07:35:02.245953+0000","last_undegraded":"2024-09-21T07:35:02.245953+0000","last_fullsized":"2024-09-21T07:35:02.245953+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:51.627210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235902+0000","last_change":"2024-09-21T07:35:02.235902+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235902+0000","last_undegraded":"2024-09-21T07:35:02.235902+0000","last_fullsized":"2024-09-21T07:35:02.235902+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:01.219487+0000","last_change":"2024-09-21T07:35:01.219487+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.219487+0000","last_undegraded":"2024-09-21T07:35:01.219487+0000","last_fullsized":"2024-09-21T07:35:01.219487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237912+0000","last_change":"2024-09-21T07:35:02.237912+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237912+0000","last_undegraded":"2024-09-21T07:35:02.237912+0000","last_fullsized":"2024-09-21T07:35:02.237912+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262455+0000","last_change":"2024-09-21T07:35:02.261499+0000","last_active":"2024-09-21T07:35:02.262455+0000","last_peered":"2024-09-21T07:35:02.262455+0000","last_clean":"2024-09-21T07:35:02.262455+0000","last_became_active":"2024-09-21T07:35:02.261161+0000","last_became_peered":"2024-09-21T07:35:02.261161+0000","last_unstale":"2024-09-21T07:35:02.262455+0000","last_undegraded":"2024-09-21T07:35:02.262455+0000","last_fullsized":"2024-09-21T07:35:02.262455+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:36.330951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239267+0000","last_change":"2024-09-21T07:35:02.239267+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239267+0000","last_undegraded":"2024-09-21T07:35:02.239267+0000","last_fullsized":"2024-09-21T07:35:02.239267+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252571+0000","last_change":"2024-09-21T07:35:02.248579+0000","last_active":"2024-09-21T07:35:02.252571+0000","last_peered":"2024-09-21T07:35:02.252571+0000","last_clean":"2024-09-21T07:35:02.252571+0000","last_became_active":"2024-09-21T07:35:02.248203+0000","last_became_peered":"2024-09-21T07:35:02.248203+0000","last_unstale":"2024-09-21T07:35:02.252571+0000","last_undegraded":"2024-09-21T07:35:02.252571+0000","last_fullsized":"2024-09-21T07:35:02.252571+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:29.233618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:01.219487+0000","last_change":"2024-09-21T07:35:01.219487+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.219487+0000","last_undegraded":"2024-09-21T07:35:01.219487+0000","last_fullsized":"2024-09-21T07:35:01.219487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.248899+0000","last_change":"2024-09-21T07:35:02.247431+0000","last_active":"2024-09-21T07:35:02.248899+0000","last_peered":"2024-09-21T07:35:02.248899+0000","last_clean":"2024-09-21T07:35:02.248899+0000","last_became_active":"2024-09-21T07:35:02.247100+0000","last_became_peered":"2024-09-21T07:35:02.247100+0000","last_unstale":"2024-09-21T07:35:02.248899+0000","last_undegraded":"2024-09-21T07:35:02.248899+0000","last_fullsized":"2024-09-21T07:35:02.248899+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:40.087806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240470+0000","last_change":"2024-09-21T07:35:02.240470+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240470+0000","last_undegraded":"2024-09-21T07:35:02.240470+0000","last_fullsized":"2024-09-21T07:35:02.240470+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262625+0000","last_change":"2024-09-21T07:35:02.261614+0000","last_active":"2024-09-21T07:35:02.262625+0000","last_peered":"2024-09-21T07:35:02.262625+0000","last_clean":"2024-09-21T07:35:02.262625+0000","last_became_active":"2024-09-21T07:35:02.261277+0000","last_became_peered":"2024-09-21T07:35:02.261277+0000","last_unstale":"2024-09-21T07:35:02.262625+0000","last_undegraded":"2024-09-21T07:35:02.262625+0000","last_fullsized":"2024-09-21T07:35:02.262625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:19.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238435+0000","last_change":"2024-09-21T07:35:02.238435+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238435+0000","last_undegraded":"2024-09-21T07:35:02.238435+0000","last_fullsized":"2024-09-21T07:35:02.238435+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.256190+0000","last_change":"2024-09-21T07:35:02.255104+0000","last_active":"2024-09-21T07:35:02.256190+0000","last_peered":"2024-09-21T07:35:02.256190+0000","last_clean":"2024-09-21T07:35:02.256190+0000","last_became_active":"2024-09-21T07:35:02.254632+0000","last_became_peered":"2024-09-21T07:35:02.254632+0000","last_unstale":"2024-09-21T07:35:02.256190+0000","last_undegraded":"2024-09-21T07:35:02.256190+0000","last_fullsized":"2024-09-21T07:35:02.256190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:03.429390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232471+0000","last_change":"2024-09-21T07:35:02.232471+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232471+0000","last_undegraded":"2024-09-21T07:35:02.232471+0000","last_fullsized":"2024-09-21T07:35:02.232471+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260979+0000","last_change":"2024-09-21T07:35:02.260184+0000","last_active":"2024-09-21T07:35:02.260979+0000","last_peered":"2024-09-21T07:35:02.260979+0000","last_clean":"2024-09-21T07:35:02.260979+0000","last_became_active":"2024-09-21T07:35:02.259823+0000","last_became_peered":"2024-09-21T07:35:02.259823+0000","last_unstale":"2024-09-21T07:35:02.260979+0000","last_undegraded":"2024-09-21T07:35:02.260979+0000","last_fullsized":"2024-09-21T07:35:02.260979+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:19.342886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259295+0000","last_change":"2024-09-21T07:35:02.256316+0000","last_active":"2024-09-21T07:35:02.259295+0000","last_peered":"2024-09-21T07:35:02.259295+0000","last_clean":"2024-09-21T07:35:02.259295+0000","last_became_active":"2024-09-21T07:35:02.255641+0000","last_became_peered":"2024-09-21T07:35:02.255641+0000","last_unstale":"2024-09-21T07:35:02.259295+0000","last_undegraded":"2024-09-21T07:35:02.259295+0000","last_fullsized":"2024-09-21T07:35:02.259295+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:43.643912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236989+0000","last_change":"2024-09-21T07:35:02.236989+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236989+0000","last_undegraded":"2024-09-21T07:35:02.236989+0000","last_fullsized":"2024-09-21T07:35:02.236989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255721+0000","last_change":"2024-09-21T07:35:02.251182+0000","last_active":"2024-09-21T07:35:02.255721+0000","last_peered":"2024-09-21T07:35:02.255721+0000","last_clean":"2024-09-21T07:35:02.255721+0000","last_became_active":"2024-09-21T07:35:02.250879+0000","last_became_peered":"2024-09-21T07:35:02.250879+0000","last_unstale":"2024-09-21T07:35:02.255721+0000","last_undegraded":"2024-09-21T07:35:02.255721+0000","last_fullsized":"2024-09-21T07:35:02.255721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:59.006953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239439+0000","last_change":"2024-09-21T07:35:02.239439+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239439+0000","last_undegraded":"2024-09-21T07:35:02.239439+0000","last_fullsized":"2024-09-21T07:35:02.239439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.249536+0000","last_change":"2024-09-21T07:35:02.246826+0000","last_active":"2024-09-21T07:35:02.249536+0000","last_peered":"2024-09-21T07:35:02.249536+0000","last_clean":"2024-09-21T07:35:02.249536+0000","last_became_active":"2024-09-21T07:35:02.246426+0000","last_became_peered":"2024-09-21T07:35:02.246426+0000","last_unstale":"2024-09-21T07:35:02.249536+0000","last_undegraded":"2024-09-21T07:35:02.249536+0000","last_fullsized":"2024-09-21T07:35:02.249536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:15.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235286+0000","last_change":"2024-09-21T07:35:02.235286+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235286+0000","last_undegraded":"2024-09-21T07:35:02.235286+0000","last_fullsized":"2024-09-21T07:35:02.235286+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259020+0000","last_change":"2024-09-21T07:35:02.256374+0000","last_active":"2024-09-21T07:35:02.259020+0000","last_peered":"2024-09-21T07:35:02.259020+0000","last_clean":"2024-09-21T07:35:02.259020+0000","last_became_active":"2024-09-21T07:35:02.255795+0000","last_became_peered":"2024-09-21T07:35:02.255795+0000","last_unstale":"2024-09-21T07:35:02.259020+0000","last_undegraded":"2024-09-21T07:35:02.259020+0000","last_fullsized":"2024-09-21T07:35:02.259020+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:29.735597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261134+0000","last_change":"2024-09-21T07:35:02.257673+0000","last_active":"2024-09-21T07:35:02.261134+0000","last_peered":"2024-09-21T07:35:02.261134+0000","last_clean":"2024-09-21T07:35:02.261134+0000","last_became_active":"2024-09-21T07:35:02.256474+0000","last_became_peered":"2024-09-21T07:35:02.256474+0000","last_unstale":"2024-09-21T07:35:02.261134+0000","last_undegraded":"2024-09-21T07:35:02.261134+0000","last_fullsized":"2024-09-21T07:35:02.261134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:52.614926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237509+0000","last_change":"2024-09-21T07:35:02.237509+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237509+0000","last_undegraded":"2024-09-21T07:35:02.237509+0000","last_fullsized":"2024-09-21T07:35:02.237509+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258876+0000","last_change":"2024-09-21T07:35:02.257206+0000","last_active":"2024-09-21T07:35:02.258876+0000","last_peered":"2024-09-21T07:35:02.258876+0000","last_clean":"2024-09-21T07:35:02.258876+0000","last_became_active":"2024-09-21T07:35:02.256889+0000","last_became_peered":"2024-09-21T07:35:02.256889+0000","last_unstale":"2024-09-21T07:35:02.258876+0000","last_undegraded":"2024-09-21T07:35:02.258876+0000","last_fullsized":"2024-09-21T07:35:02.258876+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:12.902316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236526+0000","last_change":"2024-09-21T07:35:02.236526+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236526+0000","last_undegraded":"2024-09-21T07:35:02.236526+0000","last_fullsized":"2024-09-21T07:35:02.236526+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252163+0000","last_change":"2024-09-21T07:35:02.250284+0000","last_active":"2024-09-21T07:35:02.252163+0000","last_peered":"2024-09-21T07:35:02.252163+0000","last_clean":"2024-09-21T07:35:02.252163+0000","last_became_active":"2024-09-21T07:35:02.246160+0000","last_became_peered":"2024-09-21T07:35:02.246160+0000","last_unstale":"2024-09-21T07:35:02.252163+0000","last_undegraded":"2024-09-21T07:35:02.252163+0000","last_fullsized":"2024-09-21T07:35:02.252163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:13.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237046+0000","last_change":"2024-09-21T07:35:02.237046+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237046+0000","last_undegraded":"2024-09-21T07:35:02.237046+0000","last_fullsized":"2024-09-21T07:35:02.237046+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261239+0000","last_change":"2024-09-21T07:35:02.260372+0000","last_active":"2024-09-21T07:35:02.261239+0000","last_peered":"2024-09-21T07:35:02.261239+0000","last_clean":"2024-09-21T07:35:02.261239+0000","last_became_active":"2024-09-21T07:35:02.260081+0000","last_became_peered":"2024-09-21T07:35:02.260081+0000","last_unstale":"2024-09-21T07:35:02.261239+0000","last_undegraded":"2024-09-21T07:35:02.261239+0000","last_fullsized":"2024-09-21T07:35:02.261239+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:50.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241741+0000","last_change":"2024-09-21T07:35:02.241741+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241741+0000","last_undegraded":"2024-09-21T07:35:02.241741+0000","last_fullsized":"2024-09-21T07:35:02.241741+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261095+0000","last_change":"2024-09-21T07:35:02.258379+0000","last_active":"2024-09-21T07:35:02.261095+0000","last_peered":"2024-09-21T07:35:02.261095+0000","last_clean":"2024-09-21T07:35:02.261095+0000","last_became_active":"2024-09-21T07:35:02.258050+0000","last_became_peered":"2024-09-21T07:35:02.258050+0000","last_unstale":"2024-09-21T07:35:02.261095+0000","last_undegraded":"2024-09-21T07:35:02.261095+0000","last_fullsized":"2024-09-21T07:35:02.261095+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:50.176822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243017+0000","last_change":"2024-09-21T07:35:02.243017+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243017+0000","last_undegraded":"2024-09-21T07:35:02.243017+0000","last_fullsized":"2024-09-21T07:35:02.243017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255202+0000","last_change":"2024-09-21T07:35:02.247540+0000","last_active":"2024-09-21T07:35:02.255202+0000","last_peered":"2024-09-21T07:35:02.255202+0000","last_clean":"2024-09-21T07:35:02.255202+0000","last_became_active":"2024-09-21T07:35:02.246243+0000","last_became_peered":"2024-09-21T07:35:02.246243+0000","last_unstale":"2024-09-21T07:35:02.255202+0000","last_undegraded":"2024-09-21T07:35:02.255202+0000","last_fullsized":"2024-09-21T07:35:02.255202+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:53.157560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.253606+0000","last_change":"2024-09-21T07:35:02.252337+0000","last_active":"2024-09-21T07:35:02.253606+0000","last_peered":"2024-09-21T07:35:02.253606+0000","last_clean":"2024-09-21T07:35:02.253606+0000","last_became_active":"2024-09-21T07:35:02.250853+0000","last_became_peered":"2024-09-21T07:35:02.250853+0000","last_unstale":"2024-09-21T07:35:02.253606+0000","last_undegraded":"2024-09-21T07:35:02.253606+0000","last_fullsized":"2024-09-21T07:35:02.253606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:55.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233421+0000","last_change":"2024-09-21T07:35:02.233421+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233421+0000","last_undegraded":"2024-09-21T07:35:02.233421+0000","last_fullsized":"2024-09-21T07:35:02.233421+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.257226+0000","last_change":"2024-09-21T07:35:02.254083+0000","last_active":"2024-09-21T07:35:02.257226+0000","last_peered":"2024-09-21T07:35:02.257226+0000","last_clean":"2024-09-21T07:35:02.257226+0000","last_became_active":"2024-09-21T07:35:02.253685+0000","last_became_peered":"2024-09-21T07:35:02.253685+0000","last_unstale":"2024-09-21T07:35:02.257226+0000","last_undegraded":"2024-09-21T07:35:02.257226+0000","last_fullsized":"2024-09-21T07:35:02.257226+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:18.167243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234083+0000","last_change":"2024-09-21T07:35:02.234083+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234083+0000","last_undegraded":"2024-09-21T07:35:02.234083+0000","last_fullsized":"2024-09-21T07:35:02.234083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.246830+0000","last_change":"2024-09-21T07:35:02.244930+0000","last_active":"2024-09-21T07:35:02.246830+0000","last_peered":"2024-09-21T07:35:02.246830+0000","last_clean":"2024-09-21T07:35:02.246830+0000","last_became_active":"2024-09-21T07:35:02.244374+0000","last_became_peered":"2024-09-21T07:35:02.244374+0000","last_unstale":"2024-09-21T07:35:02.246830+0000","last_undegraded":"2024-09-21T07:35:02.246830+0000","last_fullsized":"2024-09-21T07:35:02.246830+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:48.574990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:01.219487+0000","last_change":"2024-09-21T07:35:01.219487+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.219487+0000","last_undegraded":"2024-09-21T07:35:01.219487+0000","last_fullsized":"2024-09-21T07:35:01.219487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235257+0000","last_change":"2024-09-21T07:35:02.235257+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235257+0000","last_undegraded":"2024-09-21T07:35:02.235257+0000","last_fullsized":"2024-09-21T07:35:02.235257+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:01.219487+0000","last_change":"2024-09-21T07:35:01.219487+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.219487+0000","last_undegraded":"2024-09-21T07:35:01.219487+0000","last_fullsized":"2024-09-21T07:35:01.219487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244058+0000","last_change":"2024-09-21T07:35:02.244058+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244058+0000","last_undegraded":"2024-09-21T07:35:02.244058+0000","last_fullsized":"2024-09-21T07:35:02.244058+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-21T07:35:01.230199+0000","last_change":"2024-09-21T07:35:01.230199+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.230199+0000","last_undegraded":"2024-09-21T07:35:01.230199+0000","last_fullsized":"2024-09-21T07:35:01.230199+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237226+0000","last_change":"2024-09-21T07:35:02.237226+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237226+0000","last_undegraded":"2024-09-21T07:35:02.237226+0000","last_fullsized":"2024-09-21T07:35:02.237226+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-21T07:35:01.229971+0000","last_change":"2024-09-21T07:35:01.229971+0000","last_active":"2024-09-21T07:35:01.219487+0000","last_peered":"2024-09-21T07:35:01.219487+0000","last_clean":"2024-09-21T07:35:01.219487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:01.229971+0000","last_undegraded":"2024-09-21T07:35:01.229971+0000","last_fullsized":"2024-09-21T07:35:01.229971+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235130+0000","last_change":"2024-09-21T07:35:02.235130+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235130+0000","last_undegraded":"2024-09-21T07:35:02.235130+0000","last_fullsized":"2024-09-21T07:35:02.235130+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260366+0000","last_change":"2024-09-21T07:35:02.254958+0000","last_active":"2024-09-21T07:35:02.260366+0000","last_peered":"2024-09-21T07:35:02.260366+0000","last_clean":"2024-09-21T07:35:02.260366+0000","last_became_active":"2024-09-21T07:35:02.253119+0000","last_became_peered":"2024-09-21T07:35:02.253119+0000","last_unstale":"2024-09-21T07:35:02.260366+0000","last_undegraded":"2024-09-21T07:35:02.260366+0000","last_fullsized":"2024-09-21T07:35:02.260366+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:35:02.222436+0000","last_change":"2024-09-21T07:35:02.222436+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.222436+0000","last_undegraded":"2024-09-21T07:35:02.222436+0000","last_fullsized":"2024-09-21T07:35:02.222436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258885+0000","last_change":"2024-09-21T07:35:02.257732+0000","last_active":"2024-09-21T07:35:02.258885+0000","last_peered":"2024-09-21T07:35:02.258885+0000","last_clean":"2024-09-21T07:35:02.258885+0000","last_became_active":"2024-09-21T07:35:02.257428+0000","last_became_peered":"2024-09-21T07:35:02.257428+0000","last_unstale":"2024-09-21T07:35:02.258885+0000","last_undegraded":"2024-09-21T07:35:02.258885+0000","last_fullsized":"2024-09-21T07:35:02.258885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:48.747844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241038+0000","last_change":"2024-09-21T07:35:02.241038+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241038+0000","last_undegraded":"2024-09-21T07:35:02.241038+0000","last_fullsized":"2024-09-21T07:35:02.241038+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260795+0000","last_change":"2024-09-21T07:35:02.254903+0000","last_active":"2024-09-21T07:35:02.260795+0000","last_peered":"2024-09-21T07:35:02.260795+0000","last_clean":"2024-09-21T07:35:02.260795+0000","last_became_active":"2024-09-21T07:35:02.254530+0000","last_became_peered":"2024-09-21T07:35:02.254530+0000","last_unstale":"2024-09-21T07:35:02.260795+0000","last_undegraded":"2024-09-21T07:35:02.260795+0000","last_fullsized":"2024-09-21T07:35:02.260795+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:10.217766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":391,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-21T07:35:01.231988+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:01.231988+0000","last_peered":"2024-09-21T07:35:01.231988+0000","last_clean":"2024-09-21T07:35:01.231988+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:01.231988+0000","last_undegraded":"2024-09-21T07:35:01.231988+0000","last_fullsized":"2024-09-21T07:35:01.231988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":6},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59712,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312128,"statfs":{"total":96636764160,"available":96575619072,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56120,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315720,"statfs":{"total":96636764160,"available":96579297280,"internally_reserved":0,"allocated":2789376,"data_stored":1624626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56120,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315720,"statfs":{"total":96636764160,"available":96579297280,"internally_reserved":0,"allocated":2789376,"data_stored":1624626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83244,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94288596,"statfs":{"total":96636764160,"available":96551522304,"internally_reserved":0,"allocated":2183168,"data_stored":1028049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:35:07.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 -- 172.21.15.64:0/1385402224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700b48d0 msgr2=0x7f7d70072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 --2- 172.21.15.64:0/1385402224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700b48d0 0x7f7d70072e20 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009bc0 tx=0x7f7d6801ca30 comp rx=0 tx=0).stop 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 -- 172.21.15.64:0/1385402224 shutdown_connections 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 --2- 172.21.15.64:0/1385402224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700b48d0 0x7f7d70072e20 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 -- 172.21.15.64:0/1385402224 >> 172.21.15.64:0/1385402224 conn(0x7f7d700ccbe0 msgr2=0x7f7d700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 -- 172.21.15.64:0/1385402224 shutdown_connections 2024-09-21T07:35:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.665+0000 7f7d77400640 1 -- 172.21.15.64:0/1385402224 wait complete. 2024-09-21T07:35:07.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 Processor -- start 2024-09-21T07:35:07.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- start start 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d7015edb0 0x7f7d701fc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d701522d0 0x7f7d70155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7016a470 con 0x7f7d700709b0 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7016a2f0 con 0x7f7d7015edb0 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7016a5f0 con 0x7f7d701522d0 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39876/0 (socket says 172.21.15.64:39876) 2024-09-21T07:35:07.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 -- 172.21.15.64:0/3368155510 learned_addr learned my addr 172.21.15.64:0/3368155510 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d6fe00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d7015edb0 0x7f7d701fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d75400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d701522d0 0x7f7d70155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 -- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d701522d0 msgr2=0x7f7d70155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d701522d0 0x7f7d70155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 -- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d7015edb0 msgr2=0x7f7d701fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d7015edb0 0x7f7d701fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 -- 172.21.15.64:0/3368155510 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7009d020 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d74a00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c700 tx=0x7f7d6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64017070 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d64005360 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7009d300 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400a8a0 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.669+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d701fc2e0 con 0x7f7d700709b0 2024-09-21T07:35:07.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d70072e20 con 0x7f7d700709b0 2024-09-21T07:35:07.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d6401a070 con 0x7f7d700709b0 2024-09-21T07:35:07.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d6cc00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 0x7f7d50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:07.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f7d64093910 con 0x7f7d700709b0 2024-09-21T07:35:07.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d6fe00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 0x7f7d50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:07.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.673+0000 7f7d6fe00640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 0x7f7d50075710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7d700ca740 tx=0x7f7d5c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:07.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.677+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7d6405e790 con 0x7f7d700709b0 2024-09-21T07:35:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.849+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d701520f0 con 0x7f7d50073200 2024-09-21T07:35:07.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.857+0000 7f7d6cc00640 1 -- 172.21.15.64:0/3368155510 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248687 (secure 0 0 0) 0x7f7d5c0050d0 con 0x7f7d50073200 2024-09-21T07:35:07.860 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:07.861 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:35:07.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 msgr2=0x7f7d50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 0x7f7d50075710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7d700ca740 tx=0x7f7d5c009040 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 msgr2=0x7f7d700afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c700 tx=0x7f7d6400cbc0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 shutdown_connections 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7d50073200 0x7f7d50075710 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d701522d0 0x7f7d70155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d7015edb0 0x7f7d701fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 --2- 172.21.15.64:0/3368155510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d700709b0 0x7f7d700afb70 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 >> 172.21.15.64:0/3368155510 conn(0x7f7d700ccbe0 msgr2=0x7f7d70070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 shutdown_connections 2024-09-21T07:35:07.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:07.861+0000 7f7d77400640 1 -- 172.21.15.64:0/3368155510 wait complete. 2024-09-21T07:35:07.882 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2024-09-21T07:35:07.624984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":473320,"kb_used_data":18428,"kb_used_omap":12,"kb_used_meta":454707,"kb_avail":754501400,"statfs":{"total":773094113280,"available":772609433600,"internally_reserved":0,"allocated":18870272,"data_stored":9516013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":465620531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001456"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240634+0000","last_change":"2024-09-21T07:35:02.240634+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240634+0000","last_undegraded":"2024-09-21T07:35:02.240634+0000","last_fullsized":"2024-09-21T07:35:02.240634+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239707+0000","last_change":"2024-09-21T07:35:02.239707+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239707+0000","last_undegraded":"2024-09-21T07:35:02.239707+0000","last_fullsized":"2024-09-21T07:35:02.239707+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243453+0000","last_change":"2024-09-21T07:35:02.243453+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243453+0000","last_undegraded":"2024-09-21T07:35:02.243453+0000","last_fullsized":"2024-09-21T07:35:02.243453+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.247783+0000","last_change":"2024-09-21T07:35:02.247783+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.247783+0000","last_undegraded":"2024-09-21T07:35:02.247783+0000","last_fullsized":"2024-09-21T07:35:02.247783+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250829+0000","last_change":"2024-09-21T07:35:03.260600+0000","last_active":"2024-09-21T07:35:04.250829+0000","last_peered":"2024-09-21T07:35:04.250829+0000","last_clean":"2024-09-21T07:35:04.250829+0000","last_became_active":"2024-09-21T07:35:03.260309+0000","last_became_peered":"2024-09-21T07:35:03.260309+0000","last_unstale":"2024-09-21T07:35:04.250829+0000","last_undegraded":"2024-09-21T07:35:04.250829+0000","last_fullsized":"2024-09-21T07:35:04.250829+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:04.784721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249856+0000","last_change":"2024-09-21T07:35:03.259023+0000","last_active":"2024-09-21T07:35:04.249856+0000","last_peered":"2024-09-21T07:35:04.249856+0000","last_clean":"2024-09-21T07:35:04.249856+0000","last_became_active":"2024-09-21T07:35:03.258721+0000","last_became_peered":"2024-09-21T07:35:03.258721+0000","last_unstale":"2024-09-21T07:35:04.249856+0000","last_undegraded":"2024-09-21T07:35:04.249856+0000","last_fullsized":"2024-09-21T07:35:04.249856+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:57.399605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234135+0000","last_change":"2024-09-21T07:35:02.234135+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234135+0000","last_undegraded":"2024-09-21T07:35:02.234135+0000","last_fullsized":"2024-09-21T07:35:02.234135+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078662+0000","last_change":"2024-09-21T07:35:03.267609+0000","last_active":"2024-09-21T07:35:05.078662+0000","last_peered":"2024-09-21T07:35:05.078662+0000","last_clean":"2024-09-21T07:35:05.078662+0000","last_became_active":"2024-09-21T07:35:03.267316+0000","last_became_peered":"2024-09-21T07:35:03.267316+0000","last_unstale":"2024-09-21T07:35:05.078662+0000","last_undegraded":"2024-09-21T07:35:05.078662+0000","last_fullsized":"2024-09-21T07:35:05.078662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:55.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239262+0000","last_change":"2024-09-21T07:35:02.239262+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239262+0000","last_undegraded":"2024-09-21T07:35:02.239262+0000","last_fullsized":"2024-09-21T07:35:02.239262+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252882+0000","last_change":"2024-09-21T07:35:03.260726+0000","last_active":"2024-09-21T07:35:04.252882+0000","last_peered":"2024-09-21T07:35:04.252882+0000","last_clean":"2024-09-21T07:35:04.252882+0000","last_became_active":"2024-09-21T07:35:03.256428+0000","last_became_peered":"2024-09-21T07:35:03.256428+0000","last_unstale":"2024-09-21T07:35:04.252882+0000","last_undegraded":"2024-09-21T07:35:04.252882+0000","last_fullsized":"2024-09-21T07:35:04.252882+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237648+0000","last_change":"2024-09-21T07:35:02.237648+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237648+0000","last_undegraded":"2024-09-21T07:35:02.237648+0000","last_fullsized":"2024-09-21T07:35:02.237648+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.245751+0000","last_change":"2024-09-21T07:35:02.245751+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.245751+0000","last_undegraded":"2024-09-21T07:35:02.245751+0000","last_fullsized":"2024-09-21T07:35:02.245751+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239916+0000","last_change":"2024-09-21T07:35:02.239916+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239916+0000","last_undegraded":"2024-09-21T07:35:02.239916+0000","last_fullsized":"2024-09-21T07:35:02.239916+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232742+0000","last_change":"2024-09-21T07:35:02.232742+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232742+0000","last_undegraded":"2024-09-21T07:35:02.232742+0000","last_fullsized":"2024-09-21T07:35:02.232742+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239815+0000","last_change":"2024-09-21T07:35:02.239815+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239815+0000","last_undegraded":"2024-09-21T07:35:02.239815+0000","last_fullsized":"2024-09-21T07:35:02.239815+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249682+0000","last_change":"2024-09-21T07:35:03.254637+0000","last_active":"2024-09-21T07:35:04.249682+0000","last_peered":"2024-09-21T07:35:04.249682+0000","last_clean":"2024-09-21T07:35:04.249682+0000","last_became_active":"2024-09-21T07:35:03.254227+0000","last_became_peered":"2024-09-21T07:35:03.254227+0000","last_unstale":"2024-09-21T07:35:04.249682+0000","last_undegraded":"2024-09-21T07:35:04.249682+0000","last_fullsized":"2024-09-21T07:35:04.249682+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.940090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251731+0000","last_change":"2024-09-21T07:35:03.270378+0000","last_active":"2024-09-21T07:35:04.251731+0000","last_peered":"2024-09-21T07:35:04.251731+0000","last_clean":"2024-09-21T07:35:04.251731+0000","last_became_active":"2024-09-21T07:35:03.269427+0000","last_became_peered":"2024-09-21T07:35:03.269427+0000","last_unstale":"2024-09-21T07:35:04.251731+0000","last_undegraded":"2024-09-21T07:35:04.251731+0000","last_fullsized":"2024-09-21T07:35:04.251731+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:52.605389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241032+0000","last_change":"2024-09-21T07:35:02.241032+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241032+0000","last_undegraded":"2024-09-21T07:35:02.241032+0000","last_fullsized":"2024-09-21T07:35:02.241032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238290+0000","last_change":"2024-09-21T07:35:02.238290+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238290+0000","last_undegraded":"2024-09-21T07:35:02.238290+0000","last_fullsized":"2024-09-21T07:35:02.238290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250361+0000","last_change":"2024-09-21T07:35:03.261822+0000","last_active":"2024-09-21T07:35:04.250361+0000","last_peered":"2024-09-21T07:35:04.250361+0000","last_clean":"2024-09-21T07:35:04.250361+0000","last_became_active":"2024-09-21T07:35:03.261533+0000","last_became_peered":"2024-09-21T07:35:03.261533+0000","last_unstale":"2024-09-21T07:35:04.250361+0000","last_undegraded":"2024-09-21T07:35:04.250361+0000","last_fullsized":"2024-09-21T07:35:04.250361+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.404434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238804+0000","last_change":"2024-09-21T07:35:02.238804+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238804+0000","last_undegraded":"2024-09-21T07:35:02.238804+0000","last_fullsized":"2024-09-21T07:35:02.238804+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244198+0000","last_change":"2024-09-21T07:35:02.244198+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244198+0000","last_undegraded":"2024-09-21T07:35:02.244198+0000","last_fullsized":"2024-09-21T07:35:02.244198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078605+0000","last_change":"2024-09-21T07:35:03.277225+0000","last_active":"2024-09-21T07:35:05.078605+0000","last_peered":"2024-09-21T07:35:05.078605+0000","last_clean":"2024-09-21T07:35:05.078605+0000","last_became_active":"2024-09-21T07:35:03.276612+0000","last_became_peered":"2024-09-21T07:35:03.276612+0000","last_unstale":"2024-09-21T07:35:05.078605+0000","last_undegraded":"2024-09-21T07:35:05.078605+0000","last_fullsized":"2024-09-21T07:35:05.078605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:08.098778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240376+0000","last_change":"2024-09-21T07:35:02.240376+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240376+0000","last_undegraded":"2024-09-21T07:35:02.240376+0000","last_fullsized":"2024-09-21T07:35:02.240376+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235734+0000","last_change":"2024-09-21T07:35:02.235734+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235734+0000","last_undegraded":"2024-09-21T07:35:02.235734+0000","last_fullsized":"2024-09-21T07:35:02.235734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238877+0000","last_change":"2024-09-21T07:35:02.238877+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238877+0000","last_undegraded":"2024-09-21T07:35:02.238877+0000","last_fullsized":"2024-09-21T07:35:02.238877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079386+0000","last_change":"2024-09-21T07:35:03.267424+0000","last_active":"2024-09-21T07:35:05.079386+0000","last_peered":"2024-09-21T07:35:05.079386+0000","last_clean":"2024-09-21T07:35:05.079386+0000","last_became_active":"2024-09-21T07:35:03.266994+0000","last_became_peered":"2024-09-21T07:35:03.266994+0000","last_unstale":"2024-09-21T07:35:05.079386+0000","last_undegraded":"2024-09-21T07:35:05.079386+0000","last_fullsized":"2024-09-21T07:35:05.079386+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:48.006626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250585+0000","last_change":"2024-09-21T07:35:03.254332+0000","last_active":"2024-09-21T07:35:04.250585+0000","last_peered":"2024-09-21T07:35:04.250585+0000","last_clean":"2024-09-21T07:35:04.250585+0000","last_became_active":"2024-09-21T07:35:03.254005+0000","last_became_peered":"2024-09-21T07:35:03.254005+0000","last_unstale":"2024-09-21T07:35:04.250585+0000","last_undegraded":"2024-09-21T07:35:04.250585+0000","last_fullsized":"2024-09-21T07:35:04.250585+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:08.989540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237637+0000","last_change":"2024-09-21T07:35:02.237637+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237637+0000","last_undegraded":"2024-09-21T07:35:02.237637+0000","last_fullsized":"2024-09-21T07:35:02.237637+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235914+0000","last_change":"2024-09-21T07:35:02.235914+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235914+0000","last_undegraded":"2024-09-21T07:35:02.235914+0000","last_fullsized":"2024-09-21T07:35:02.235914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233660+0000","last_change":"2024-09-21T07:35:02.233660+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233660+0000","last_undegraded":"2024-09-21T07:35:02.233660+0000","last_fullsized":"2024-09-21T07:35:02.233660+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249694+0000","last_change":"2024-09-21T07:35:03.261409+0000","last_active":"2024-09-21T07:35:04.249694+0000","last_peered":"2024-09-21T07:35:04.249694+0000","last_clean":"2024-09-21T07:35:04.249694+0000","last_became_active":"2024-09-21T07:35:03.261076+0000","last_became_peered":"2024-09-21T07:35:03.261076+0000","last_unstale":"2024-09-21T07:35:04.249694+0000","last_undegraded":"2024-09-21T07:35:04.249694+0000","last_fullsized":"2024-09-21T07:35:04.249694+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:55.778957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079516+0000","last_change":"2024-09-21T07:35:03.270094+0000","last_active":"2024-09-21T07:35:05.079516+0000","last_peered":"2024-09-21T07:35:05.079516+0000","last_clean":"2024-09-21T07:35:05.079516+0000","last_became_active":"2024-09-21T07:35:03.269758+0000","last_became_peered":"2024-09-21T07:35:03.269758+0000","last_unstale":"2024-09-21T07:35:05.079516+0000","last_undegraded":"2024-09-21T07:35:05.079516+0000","last_fullsized":"2024-09-21T07:35:05.079516+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.138794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261396+0000","last_change":"2024-09-21T07:35:02.258592+0000","last_active":"2024-09-21T07:35:02.261396+0000","last_peered":"2024-09-21T07:35:02.261396+0000","last_clean":"2024-09-21T07:35:02.261396+0000","last_became_active":"2024-09-21T07:35:02.258264+0000","last_became_peered":"2024-09-21T07:35:02.258264+0000","last_unstale":"2024-09-21T07:35:02.261396+0000","last_undegraded":"2024-09-21T07:35:02.261396+0000","last_fullsized":"2024-09-21T07:35:02.261396+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:09.521183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234610+0000","last_change":"2024-09-21T07:35:02.234610+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234610+0000","last_undegraded":"2024-09-21T07:35:02.234610+0000","last_fullsized":"2024-09-21T07:35:02.234610+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.253042+0000","last_change":"2024-09-21T07:35:02.252098+0000","last_active":"2024-09-21T07:35:04.253042+0000","last_peered":"2024-09-21T07:35:04.253042+0000","last_clean":"2024-09-21T07:35:04.253042+0000","last_became_active":"2024-09-21T07:35:02.249744+0000","last_became_peered":"2024-09-21T07:35:02.249744+0000","last_unstale":"2024-09-21T07:35:04.253042+0000","last_undegraded":"2024-09-21T07:35:04.253042+0000","last_fullsized":"2024-09-21T07:35:04.253042+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.362809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238071+0000","last_change":"2024-09-21T07:35:02.238071+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238071+0000","last_undegraded":"2024-09-21T07:35:02.238071+0000","last_fullsized":"2024-09-21T07:35:02.238071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.251107+0000","last_change":"2024-09-21T07:35:02.249622+0000","last_active":"2024-09-21T07:35:02.251107+0000","last_peered":"2024-09-21T07:35:02.251107+0000","last_clean":"2024-09-21T07:35:02.251107+0000","last_became_active":"2024-09-21T07:35:02.249278+0000","last_became_peered":"2024-09-21T07:35:02.249278+0000","last_unstale":"2024-09-21T07:35:02.251107+0000","last_undegraded":"2024-09-21T07:35:02.251107+0000","last_fullsized":"2024-09-21T07:35:02.251107+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:50.071551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.242278+0000","last_change":"2024-09-21T07:35:02.242278+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.242278+0000","last_undegraded":"2024-09-21T07:35:02.242278+0000","last_fullsized":"2024-09-21T07:35:02.242278+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.245953+0000","last_change":"2024-09-21T07:35:02.244307+0000","last_active":"2024-09-21T07:35:02.245953+0000","last_peered":"2024-09-21T07:35:02.245953+0000","last_clean":"2024-09-21T07:35:02.245953+0000","last_became_active":"2024-09-21T07:35:02.243923+0000","last_became_peered":"2024-09-21T07:35:02.243923+0000","last_unstale":"2024-09-21T07:35:02.245953+0000","last_undegraded":"2024-09-21T07:35:02.245953+0000","last_fullsized":"2024-09-21T07:35:02.245953+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:51.627210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235902+0000","last_change":"2024-09-21T07:35:02.235902+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235902+0000","last_undegraded":"2024-09-21T07:35:02.235902+0000","last_fullsized":"2024-09-21T07:35:02.235902+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250126+0000","last_change":"2024-09-21T07:35:02.253834+0000","last_active":"2024-09-21T07:35:04.250126+0000","last_peered":"2024-09-21T07:35:04.250126+0000","last_clean":"2024-09-21T07:35:04.250126+0000","last_became_active":"2024-09-21T07:35:02.252826+0000","last_became_peered":"2024-09-21T07:35:02.252826+0000","last_unstale":"2024-09-21T07:35:04.250126+0000","last_undegraded":"2024-09-21T07:35:04.250126+0000","last_fullsized":"2024-09-21T07:35:04.250126+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:39.103263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237912+0000","last_change":"2024-09-21T07:35:02.237912+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237912+0000","last_undegraded":"2024-09-21T07:35:02.237912+0000","last_fullsized":"2024-09-21T07:35:02.237912+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262455+0000","last_change":"2024-09-21T07:35:02.261499+0000","last_active":"2024-09-21T07:35:02.262455+0000","last_peered":"2024-09-21T07:35:02.262455+0000","last_clean":"2024-09-21T07:35:02.262455+0000","last_became_active":"2024-09-21T07:35:02.261161+0000","last_became_peered":"2024-09-21T07:35:02.261161+0000","last_unstale":"2024-09-21T07:35:02.262455+0000","last_undegraded":"2024-09-21T07:35:02.262455+0000","last_fullsized":"2024-09-21T07:35:02.262455+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:36.330951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239267+0000","last_change":"2024-09-21T07:35:02.239267+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239267+0000","last_undegraded":"2024-09-21T07:35:02.239267+0000","last_fullsized":"2024-09-21T07:35:02.239267+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252571+0000","last_change":"2024-09-21T07:35:02.248579+0000","last_active":"2024-09-21T07:35:02.252571+0000","last_peered":"2024-09-21T07:35:02.252571+0000","last_clean":"2024-09-21T07:35:02.252571+0000","last_became_active":"2024-09-21T07:35:02.248203+0000","last_became_peered":"2024-09-21T07:35:02.248203+0000","last_unstale":"2024-09-21T07:35:02.252571+0000","last_undegraded":"2024-09-21T07:35:02.252571+0000","last_fullsized":"2024-09-21T07:35:02.252571+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:29.233618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079418+0000","last_change":"2024-09-21T07:35:03.270828+0000","last_active":"2024-09-21T07:35:05.079418+0000","last_peered":"2024-09-21T07:35:05.079418+0000","last_clean":"2024-09-21T07:35:05.079418+0000","last_became_active":"2024-09-21T07:35:03.270525+0000","last_became_peered":"2024-09-21T07:35:03.270525+0000","last_unstale":"2024-09-21T07:35:05.079418+0000","last_undegraded":"2024-09-21T07:35:05.079418+0000","last_fullsized":"2024-09-21T07:35:05.079418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:35.198735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251909+0000","last_change":"2024-09-21T07:35:02.257632+0000","last_active":"2024-09-21T07:35:04.251909+0000","last_peered":"2024-09-21T07:35:04.251909+0000","last_clean":"2024-09-21T07:35:04.251909+0000","last_became_active":"2024-09-21T07:35:02.256235+0000","last_became_peered":"2024-09-21T07:35:02.256235+0000","last_unstale":"2024-09-21T07:35:04.251909+0000","last_undegraded":"2024-09-21T07:35:04.251909+0000","last_fullsized":"2024-09-21T07:35:04.251909+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:41.865068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251199+0000","last_change":"2024-09-21T07:35:03.258728+0000","last_active":"2024-09-21T07:35:04.251199+0000","last_peered":"2024-09-21T07:35:04.251199+0000","last_clean":"2024-09-21T07:35:04.251199+0000","last_became_active":"2024-09-21T07:35:03.258061+0000","last_became_peered":"2024-09-21T07:35:03.258061+0000","last_unstale":"2024-09-21T07:35:04.251199+0000","last_undegraded":"2024-09-21T07:35:04.251199+0000","last_fullsized":"2024-09-21T07:35:04.251199+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:47.404474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.248899+0000","last_change":"2024-09-21T07:35:02.247431+0000","last_active":"2024-09-21T07:35:02.248899+0000","last_peered":"2024-09-21T07:35:02.248899+0000","last_clean":"2024-09-21T07:35:02.248899+0000","last_became_active":"2024-09-21T07:35:02.247100+0000","last_became_peered":"2024-09-21T07:35:02.247100+0000","last_unstale":"2024-09-21T07:35:02.248899+0000","last_undegraded":"2024-09-21T07:35:02.248899+0000","last_fullsized":"2024-09-21T07:35:02.248899+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:40.087806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240470+0000","last_change":"2024-09-21T07:35:02.240470+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240470+0000","last_undegraded":"2024-09-21T07:35:02.240470+0000","last_fullsized":"2024-09-21T07:35:02.240470+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262625+0000","last_change":"2024-09-21T07:35:02.261614+0000","last_active":"2024-09-21T07:35:02.262625+0000","last_peered":"2024-09-21T07:35:02.262625+0000","last_clean":"2024-09-21T07:35:02.262625+0000","last_became_active":"2024-09-21T07:35:02.261277+0000","last_became_peered":"2024-09-21T07:35:02.261277+0000","last_unstale":"2024-09-21T07:35:02.262625+0000","last_undegraded":"2024-09-21T07:35:02.262625+0000","last_fullsized":"2024-09-21T07:35:02.262625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:19.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238435+0000","last_change":"2024-09-21T07:35:02.238435+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238435+0000","last_undegraded":"2024-09-21T07:35:02.238435+0000","last_fullsized":"2024-09-21T07:35:02.238435+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.256190+0000","last_change":"2024-09-21T07:35:02.255104+0000","last_active":"2024-09-21T07:35:02.256190+0000","last_peered":"2024-09-21T07:35:02.256190+0000","last_clean":"2024-09-21T07:35:02.256190+0000","last_became_active":"2024-09-21T07:35:02.254632+0000","last_became_peered":"2024-09-21T07:35:02.254632+0000","last_unstale":"2024-09-21T07:35:02.256190+0000","last_undegraded":"2024-09-21T07:35:02.256190+0000","last_fullsized":"2024-09-21T07:35:02.256190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:03.429390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232471+0000","last_change":"2024-09-21T07:35:02.232471+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232471+0000","last_undegraded":"2024-09-21T07:35:02.232471+0000","last_fullsized":"2024-09-21T07:35:02.232471+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260979+0000","last_change":"2024-09-21T07:35:02.260184+0000","last_active":"2024-09-21T07:35:02.260979+0000","last_peered":"2024-09-21T07:35:02.260979+0000","last_clean":"2024-09-21T07:35:02.260979+0000","last_became_active":"2024-09-21T07:35:02.259823+0000","last_became_peered":"2024-09-21T07:35:02.259823+0000","last_unstale":"2024-09-21T07:35:02.260979+0000","last_undegraded":"2024-09-21T07:35:02.260979+0000","last_fullsized":"2024-09-21T07:35:02.260979+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:19.342886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249632+0000","last_change":"2024-09-21T07:35:03.255093+0000","last_active":"2024-09-21T07:35:04.249632+0000","last_peered":"2024-09-21T07:35:04.249632+0000","last_clean":"2024-09-21T07:35:04.249632+0000","last_became_active":"2024-09-21T07:35:03.254830+0000","last_became_peered":"2024-09-21T07:35:03.254830+0000","last_unstale":"2024-09-21T07:35:04.249632+0000","last_undegraded":"2024-09-21T07:35:04.249632+0000","last_fullsized":"2024-09-21T07:35:04.249632+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:09.529360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259295+0000","last_change":"2024-09-21T07:35:02.256316+0000","last_active":"2024-09-21T07:35:02.259295+0000","last_peered":"2024-09-21T07:35:02.259295+0000","last_clean":"2024-09-21T07:35:02.259295+0000","last_became_active":"2024-09-21T07:35:02.255641+0000","last_became_peered":"2024-09-21T07:35:02.255641+0000","last_unstale":"2024-09-21T07:35:02.259295+0000","last_undegraded":"2024-09-21T07:35:02.259295+0000","last_fullsized":"2024-09-21T07:35:02.259295+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:43.643912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236989+0000","last_change":"2024-09-21T07:35:02.236989+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236989+0000","last_undegraded":"2024-09-21T07:35:02.236989+0000","last_fullsized":"2024-09-21T07:35:02.236989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255721+0000","last_change":"2024-09-21T07:35:02.251182+0000","last_active":"2024-09-21T07:35:02.255721+0000","last_peered":"2024-09-21T07:35:02.255721+0000","last_clean":"2024-09-21T07:35:02.255721+0000","last_became_active":"2024-09-21T07:35:02.250879+0000","last_became_peered":"2024-09-21T07:35:02.250879+0000","last_unstale":"2024-09-21T07:35:02.255721+0000","last_undegraded":"2024-09-21T07:35:02.255721+0000","last_fullsized":"2024-09-21T07:35:02.255721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:59.006953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239439+0000","last_change":"2024-09-21T07:35:02.239439+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239439+0000","last_undegraded":"2024-09-21T07:35:02.239439+0000","last_fullsized":"2024-09-21T07:35:02.239439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.249536+0000","last_change":"2024-09-21T07:35:02.246826+0000","last_active":"2024-09-21T07:35:02.249536+0000","last_peered":"2024-09-21T07:35:02.249536+0000","last_clean":"2024-09-21T07:35:02.249536+0000","last_became_active":"2024-09-21T07:35:02.246426+0000","last_became_peered":"2024-09-21T07:35:02.246426+0000","last_unstale":"2024-09-21T07:35:02.249536+0000","last_undegraded":"2024-09-21T07:35:02.249536+0000","last_fullsized":"2024-09-21T07:35:02.249536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:15.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235286+0000","last_change":"2024-09-21T07:35:02.235286+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235286+0000","last_undegraded":"2024-09-21T07:35:02.235286+0000","last_fullsized":"2024-09-21T07:35:02.235286+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259020+0000","last_change":"2024-09-21T07:35:02.256374+0000","last_active":"2024-09-21T07:35:02.259020+0000","last_peered":"2024-09-21T07:35:02.259020+0000","last_clean":"2024-09-21T07:35:02.259020+0000","last_became_active":"2024-09-21T07:35:02.255795+0000","last_became_peered":"2024-09-21T07:35:02.255795+0000","last_unstale":"2024-09-21T07:35:02.259020+0000","last_undegraded":"2024-09-21T07:35:02.259020+0000","last_fullsized":"2024-09-21T07:35:02.259020+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:29.735597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251189+0000","last_change":"2024-09-21T07:35:03.259092+0000","last_active":"2024-09-21T07:35:04.251189+0000","last_peered":"2024-09-21T07:35:04.251189+0000","last_clean":"2024-09-21T07:35:04.251189+0000","last_became_active":"2024-09-21T07:35:03.256278+0000","last_became_peered":"2024-09-21T07:35:03.256278+0000","last_unstale":"2024-09-21T07:35:04.251189+0000","last_undegraded":"2024-09-21T07:35:04.251189+0000","last_fullsized":"2024-09-21T07:35:04.251189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.004230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261134+0000","last_change":"2024-09-21T07:35:02.257673+0000","last_active":"2024-09-21T07:35:02.261134+0000","last_peered":"2024-09-21T07:35:02.261134+0000","last_clean":"2024-09-21T07:35:02.261134+0000","last_became_active":"2024-09-21T07:35:02.256474+0000","last_became_peered":"2024-09-21T07:35:02.256474+0000","last_unstale":"2024-09-21T07:35:02.261134+0000","last_undegraded":"2024-09-21T07:35:02.261134+0000","last_fullsized":"2024-09-21T07:35:02.261134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:52.614926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237509+0000","last_change":"2024-09-21T07:35:02.237509+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237509+0000","last_undegraded":"2024-09-21T07:35:02.237509+0000","last_fullsized":"2024-09-21T07:35:02.237509+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258876+0000","last_change":"2024-09-21T07:35:02.257206+0000","last_active":"2024-09-21T07:35:02.258876+0000","last_peered":"2024-09-21T07:35:02.258876+0000","last_clean":"2024-09-21T07:35:02.258876+0000","last_became_active":"2024-09-21T07:35:02.256889+0000","last_became_peered":"2024-09-21T07:35:02.256889+0000","last_unstale":"2024-09-21T07:35:02.258876+0000","last_undegraded":"2024-09-21T07:35:02.258876+0000","last_fullsized":"2024-09-21T07:35:02.258876+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:12.902316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236526+0000","last_change":"2024-09-21T07:35:02.236526+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236526+0000","last_undegraded":"2024-09-21T07:35:02.236526+0000","last_fullsized":"2024-09-21T07:35:02.236526+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252163+0000","last_change":"2024-09-21T07:35:02.250284+0000","last_active":"2024-09-21T07:35:02.252163+0000","last_peered":"2024-09-21T07:35:02.252163+0000","last_clean":"2024-09-21T07:35:02.252163+0000","last_became_active":"2024-09-21T07:35:02.246160+0000","last_became_peered":"2024-09-21T07:35:02.246160+0000","last_unstale":"2024-09-21T07:35:02.252163+0000","last_undegraded":"2024-09-21T07:35:02.252163+0000","last_fullsized":"2024-09-21T07:35:02.252163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:13.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237046+0000","last_change":"2024-09-21T07:35:02.237046+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237046+0000","last_undegraded":"2024-09-21T07:35:02.237046+0000","last_fullsized":"2024-09-21T07:35:02.237046+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261239+0000","last_change":"2024-09-21T07:35:02.260372+0000","last_active":"2024-09-21T07:35:02.261239+0000","last_peered":"2024-09-21T07:35:02.261239+0000","last_clean":"2024-09-21T07:35:02.261239+0000","last_became_active":"2024-09-21T07:35:02.260081+0000","last_became_peered":"2024-09-21T07:35:02.260081+0000","last_unstale":"2024-09-21T07:35:02.261239+0000","last_undegraded":"2024-09-21T07:35:02.261239+0000","last_fullsized":"2024-09-21T07:35:02.261239+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:50.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241741+0000","last_change":"2024-09-21T07:35:02.241741+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241741+0000","last_undegraded":"2024-09-21T07:35:02.241741+0000","last_fullsized":"2024-09-21T07:35:02.241741+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261095+0000","last_change":"2024-09-21T07:35:02.258379+0000","last_active":"2024-09-21T07:35:02.261095+0000","last_peered":"2024-09-21T07:35:02.261095+0000","last_clean":"2024-09-21T07:35:02.261095+0000","last_became_active":"2024-09-21T07:35:02.258050+0000","last_became_peered":"2024-09-21T07:35:02.258050+0000","last_unstale":"2024-09-21T07:35:02.261095+0000","last_undegraded":"2024-09-21T07:35:02.261095+0000","last_fullsized":"2024-09-21T07:35:02.261095+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:50.176822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243017+0000","last_change":"2024-09-21T07:35:02.243017+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243017+0000","last_undegraded":"2024-09-21T07:35:02.243017+0000","last_fullsized":"2024-09-21T07:35:02.243017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255202+0000","last_change":"2024-09-21T07:35:02.247540+0000","last_active":"2024-09-21T07:35:02.255202+0000","last_peered":"2024-09-21T07:35:02.255202+0000","last_clean":"2024-09-21T07:35:02.255202+0000","last_became_active":"2024-09-21T07:35:02.246243+0000","last_became_peered":"2024-09-21T07:35:02.246243+0000","last_unstale":"2024-09-21T07:35:02.255202+0000","last_undegraded":"2024-09-21T07:35:02.255202+0000","last_fullsized":"2024-09-21T07:35:02.255202+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:53.157560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250000+0000","last_change":"2024-09-21T07:35:03.273184+0000","last_active":"2024-09-21T07:35:04.250000+0000","last_peered":"2024-09-21T07:35:04.250000+0000","last_clean":"2024-09-21T07:35:04.250000+0000","last_became_active":"2024-09-21T07:35:03.272844+0000","last_became_peered":"2024-09-21T07:35:03.272844+0000","last_unstale":"2024-09-21T07:35:04.250000+0000","last_undegraded":"2024-09-21T07:35:04.250000+0000","last_fullsized":"2024-09-21T07:35:04.250000+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:20.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.253606+0000","last_change":"2024-09-21T07:35:02.252337+0000","last_active":"2024-09-21T07:35:02.253606+0000","last_peered":"2024-09-21T07:35:02.253606+0000","last_clean":"2024-09-21T07:35:02.253606+0000","last_became_active":"2024-09-21T07:35:02.250853+0000","last_became_peered":"2024-09-21T07:35:02.250853+0000","last_unstale":"2024-09-21T07:35:02.253606+0000","last_undegraded":"2024-09-21T07:35:02.253606+0000","last_fullsized":"2024-09-21T07:35:02.253606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:55.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233421+0000","last_change":"2024-09-21T07:35:02.233421+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233421+0000","last_undegraded":"2024-09-21T07:35:02.233421+0000","last_fullsized":"2024-09-21T07:35:02.233421+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.257226+0000","last_change":"2024-09-21T07:35:02.254083+0000","last_active":"2024-09-21T07:35:02.257226+0000","last_peered":"2024-09-21T07:35:02.257226+0000","last_clean":"2024-09-21T07:35:02.257226+0000","last_became_active":"2024-09-21T07:35:02.253685+0000","last_became_peered":"2024-09-21T07:35:02.253685+0000","last_unstale":"2024-09-21T07:35:02.257226+0000","last_undegraded":"2024-09-21T07:35:02.257226+0000","last_fullsized":"2024-09-21T07:35:02.257226+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:18.167243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234083+0000","last_change":"2024-09-21T07:35:02.234083+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234083+0000","last_undegraded":"2024-09-21T07:35:02.234083+0000","last_fullsized":"2024-09-21T07:35:02.234083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.246830+0000","last_change":"2024-09-21T07:35:02.244930+0000","last_active":"2024-09-21T07:35:02.246830+0000","last_peered":"2024-09-21T07:35:02.246830+0000","last_clean":"2024-09-21T07:35:02.246830+0000","last_became_active":"2024-09-21T07:35:02.244374+0000","last_became_peered":"2024-09-21T07:35:02.244374+0000","last_unstale":"2024-09-21T07:35:02.246830+0000","last_undegraded":"2024-09-21T07:35:02.246830+0000","last_fullsized":"2024-09-21T07:35:02.246830+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:48.574990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079598+0000","last_change":"2024-09-21T07:35:03.269506+0000","last_active":"2024-09-21T07:35:05.079598+0000","last_peered":"2024-09-21T07:35:05.079598+0000","last_clean":"2024-09-21T07:35:05.079598+0000","last_became_active":"2024-09-21T07:35:03.267171+0000","last_became_peered":"2024-09-21T07:35:03.267171+0000","last_unstale":"2024-09-21T07:35:05.079598+0000","last_undegraded":"2024-09-21T07:35:05.079598+0000","last_fullsized":"2024-09-21T07:35:05.079598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.131661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251322+0000","last_change":"2024-09-21T07:35:02.255663+0000","last_active":"2024-09-21T07:35:04.251322+0000","last_peered":"2024-09-21T07:35:04.251322+0000","last_clean":"2024-09-21T07:35:04.251322+0000","last_became_active":"2024-09-21T07:35:02.254828+0000","last_became_peered":"2024-09-21T07:35:02.254828+0000","last_unstale":"2024-09-21T07:35:04.251322+0000","last_undegraded":"2024-09-21T07:35:04.251322+0000","last_fullsized":"2024-09-21T07:35:04.251322+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:29.571173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235257+0000","last_change":"2024-09-21T07:35:02.235257+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235257+0000","last_undegraded":"2024-09-21T07:35:02.235257+0000","last_fullsized":"2024-09-21T07:35:02.235257+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250706+0000","last_change":"2024-09-21T07:35:02.250656+0000","last_active":"2024-09-21T07:35:04.250706+0000","last_peered":"2024-09-21T07:35:04.250706+0000","last_clean":"2024-09-21T07:35:04.250706+0000","last_became_active":"2024-09-21T07:35:02.250329+0000","last_became_peered":"2024-09-21T07:35:02.250329+0000","last_unstale":"2024-09-21T07:35:04.250706+0000","last_undegraded":"2024-09-21T07:35:04.250706+0000","last_fullsized":"2024-09-21T07:35:04.250706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.341710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244058+0000","last_change":"2024-09-21T07:35:02.244058+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244058+0000","last_undegraded":"2024-09-21T07:35:02.244058+0000","last_fullsized":"2024-09-21T07:35:02.244058+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079012+0000","last_change":"2024-09-21T07:35:02.250574+0000","last_active":"2024-09-21T07:35:05.079012+0000","last_peered":"2024-09-21T07:35:05.079012+0000","last_clean":"2024-09-21T07:35:05.079012+0000","last_became_active":"2024-09-21T07:35:02.250234+0000","last_became_peered":"2024-09-21T07:35:02.250234+0000","last_unstale":"2024-09-21T07:35:05.079012+0000","last_undegraded":"2024-09-21T07:35:05.079012+0000","last_fullsized":"2024-09-21T07:35:05.079012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:37.854681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237226+0000","last_change":"2024-09-21T07:35:02.237226+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237226+0000","last_undegraded":"2024-09-21T07:35:02.237226+0000","last_fullsized":"2024-09-21T07:35:02.237226+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078769+0000","last_change":"2024-09-21T07:35:02.255595+0000","last_active":"2024-09-21T07:35:05.078769+0000","last_peered":"2024-09-21T07:35:05.078769+0000","last_clean":"2024-09-21T07:35:05.078769+0000","last_became_active":"2024-09-21T07:35:02.255252+0000","last_became_peered":"2024-09-21T07:35:02.255252+0000","last_unstale":"2024-09-21T07:35:05.078769+0000","last_undegraded":"2024-09-21T07:35:05.078769+0000","last_fullsized":"2024-09-21T07:35:05.078769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:26.903296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235130+0000","last_change":"2024-09-21T07:35:02.235130+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235130+0000","last_undegraded":"2024-09-21T07:35:02.235130+0000","last_fullsized":"2024-09-21T07:35:02.235130+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260366+0000","last_change":"2024-09-21T07:35:02.254958+0000","last_active":"2024-09-21T07:35:02.260366+0000","last_peered":"2024-09-21T07:35:02.260366+0000","last_clean":"2024-09-21T07:35:02.260366+0000","last_became_active":"2024-09-21T07:35:02.253119+0000","last_became_peered":"2024-09-21T07:35:02.253119+0000","last_unstale":"2024-09-21T07:35:02.260366+0000","last_undegraded":"2024-09-21T07:35:02.260366+0000","last_fullsized":"2024-09-21T07:35:02.260366+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079321+0000","last_change":"2024-09-21T07:35:03.275353+0000","last_active":"2024-09-21T07:35:05.079321+0000","last_peered":"2024-09-21T07:35:05.079321+0000","last_clean":"2024-09-21T07:35:05.079321+0000","last_became_active":"2024-09-21T07:35:03.275033+0000","last_became_peered":"2024-09-21T07:35:03.275033+0000","last_unstale":"2024-09-21T07:35:05.079321+0000","last_undegraded":"2024-09-21T07:35:05.079321+0000","last_fullsized":"2024-09-21T07:35:05.079321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:52.384866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258885+0000","last_change":"2024-09-21T07:35:02.257732+0000","last_active":"2024-09-21T07:35:02.258885+0000","last_peered":"2024-09-21T07:35:02.258885+0000","last_clean":"2024-09-21T07:35:02.258885+0000","last_became_active":"2024-09-21T07:35:02.257428+0000","last_became_peered":"2024-09-21T07:35:02.257428+0000","last_unstale":"2024-09-21T07:35:02.258885+0000","last_undegraded":"2024-09-21T07:35:02.258885+0000","last_fullsized":"2024-09-21T07:35:02.258885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:48.747844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241038+0000","last_change":"2024-09-21T07:35:02.241038+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241038+0000","last_undegraded":"2024-09-21T07:35:02.241038+0000","last_fullsized":"2024-09-21T07:35:02.241038+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260795+0000","last_change":"2024-09-21T07:35:02.254903+0000","last_active":"2024-09-21T07:35:02.260795+0000","last_peered":"2024-09-21T07:35:02.260795+0000","last_clean":"2024-09-21T07:35:02.260795+0000","last_became_active":"2024-09-21T07:35:02.254530+0000","last_became_peered":"2024-09-21T07:35:02.254530+0000","last_unstale":"2024-09-21T07:35:02.260795+0000","last_undegraded":"2024-09-21T07:35:02.260795+0000","last_fullsized":"2024-09-21T07:35:02.260795+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:10.217766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":397,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078709+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:05.078709+0000","last_peered":"2024-09-21T07:35:05.078709+0000","last_clean":"2024-09-21T07:35:05.078709+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:05.078709+0000","last_undegraded":"2024-09-21T07:35:05.078709+0000","last_fullsized":"2024-09-21T07:35:05.078709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59712,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312128,"statfs":{"total":96636764160,"available":96575619072,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56120,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315720,"statfs":{"total":96636764160,"available":96579297280,"internally_reserved":0,"allocated":2789376,"data_stored":1624626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542298,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1645152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83296,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94288544,"statfs":{"total":96636764160,"available":96551469056,"internally_reserved":0,"allocated":2240512,"data_stored":1054944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:35:07.886 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:35:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 -- 172.21.15.64:0/707109010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0cbcd0 msgr2=0x7f239c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 --2- 172.21.15.64:0/707109010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0cbcd0 0x7f239c0cc0e0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f2394009c80 tx=0x7f239401cd70 comp rx=0 tx=0).stop 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 -- 172.21.15.64:0/707109010 shutdown_connections 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 --2- 172.21.15.64:0/707109010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0cbcd0 0x7f239c0cc0e0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 --2- 172.21.15.64:0/707109010 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c0b1be0 0x7f239c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 -- 172.21.15.64:0/707109010 >> 172.21.15.64:0/707109010 conn(0x7f239c0ccbe0 msgr2=0x7f239c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 -- 172.21.15.64:0/707109010 shutdown_connections 2024-09-21T07:35:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.085+0000 7f23a2a00640 1 -- 172.21.15.64:0/707109010 wait complete. 2024-09-21T07:35:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 Processor -- start 2024-09-21T07:35:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- start start 2024-09-21T07:35:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 0x7f239c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 0x7f239c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f239c0b42e0 con 0x7f239c0b1be0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f239c0b4160 con 0x7f239c0cbcd0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f239c16a290 con 0x7f239c15cbd0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39888/0 (socket says 172.21.15.64:39888) 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 -- 172.21.15.64:0/2230856954 learned_addr learned my addr 172.21.15.64:0/2230856954 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f2393400640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 0x7f239c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a0a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 0x7f239c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 -- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 msgr2=0x7f239c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 0x7f239c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 -- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 msgr2=0x7f239c15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 0x7f239c15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 -- 172.21.15.64:0/2230856954 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c1f9d50 con 0x7f239c0b1be0 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f2393400640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 0x7f239c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a0a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 0x7f239c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f239be00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f238c001ec0 tx=0x7f238c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c017070 con 0x7f239c0b1be0 2024-09-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f238c003600 con 0x7f239c0b1be0 2024-09-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c003a50 con 0x7f239c0b1be0 2024-09-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c1fa010 con 0x7f239c0b1be0 2024-09-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.089+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c1fa5d0 con 0x7f239c0b1be0 2024-09-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.093+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239c0b1ff0 con 0x7f239c0b1be0 2024-09-21T07:35:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.093+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f238c01a070 con 0x7f239c0b1be0 2024-09-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.093+0000 7f2398c00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 0x7f2378075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.093+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f238c093a40 con 0x7f239c0b1be0 2024-09-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.093+0000 7f2393400640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 0x7f2378075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.097+0000 7f2393400640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 0x7f2378075710 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f239c0cafa0 tx=0x7f23840091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.097+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f238c021020 con 0x7f239c0b1be0 2024-09-21T07:35:08.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.273+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f239c072ee0 con 0x7f2378073200 2024-09-21T07:35:08.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.277+0000 7f2398c00640 1 -- 172.21.15.64:0/2230856954 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248687 (secure 0 0 0) 0x7f239c072ee0 con 0x7f2378073200 2024-09-21T07:35:08.282 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:35:08.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 msgr2=0x7f2378075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 0x7f2378075710 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f239c0cafa0 tx=0x7f23840091e0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 msgr2=0x7f239c15b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f238c001ec0 tx=0x7f238c00c890 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 shutdown_connections 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2378073200 0x7f2378075710 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f239c15cbd0 0x7f239c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c0cbcd0 0x7f239c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 --2- 172.21.15.64:0/2230856954 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f239c0b1be0 0x7f239c15b5c0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 >> 172.21.15.64:0/2230856954 conn(0x7f239c0ccbe0 msgr2=0x7f239c074830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 shutdown_connections 2024-09-21T07:35:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.281+0000 7f23a2a00640 1 -- 172.21.15.64:0/2230856954 wait complete. 2024-09-21T07:35:08.305 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2024-09-21T07:35:07.624984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":473320,"kb_used_data":18428,"kb_used_omap":12,"kb_used_meta":454707,"kb_avail":754501400,"statfs":{"total":773094113280,"available":772609433600,"internally_reserved":0,"allocated":18870272,"data_stored":9516013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":465620531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001456"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240634+0000","last_change":"2024-09-21T07:35:02.240634+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240634+0000","last_undegraded":"2024-09-21T07:35:02.240634+0000","last_fullsized":"2024-09-21T07:35:02.240634+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239707+0000","last_change":"2024-09-21T07:35:02.239707+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239707+0000","last_undegraded":"2024-09-21T07:35:02.239707+0000","last_fullsized":"2024-09-21T07:35:02.239707+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243453+0000","last_change":"2024-09-21T07:35:02.243453+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243453+0000","last_undegraded":"2024-09-21T07:35:02.243453+0000","last_fullsized":"2024-09-21T07:35:02.243453+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.247783+0000","last_change":"2024-09-21T07:35:02.247783+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.247783+0000","last_undegraded":"2024-09-21T07:35:02.247783+0000","last_fullsized":"2024-09-21T07:35:02.247783+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250829+0000","last_change":"2024-09-21T07:35:03.260600+0000","last_active":"2024-09-21T07:35:04.250829+0000","last_peered":"2024-09-21T07:35:04.250829+0000","last_clean":"2024-09-21T07:35:04.250829+0000","last_became_active":"2024-09-21T07:35:03.260309+0000","last_became_peered":"2024-09-21T07:35:03.260309+0000","last_unstale":"2024-09-21T07:35:04.250829+0000","last_undegraded":"2024-09-21T07:35:04.250829+0000","last_fullsized":"2024-09-21T07:35:04.250829+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:04.784721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249856+0000","last_change":"2024-09-21T07:35:03.259023+0000","last_active":"2024-09-21T07:35:04.249856+0000","last_peered":"2024-09-21T07:35:04.249856+0000","last_clean":"2024-09-21T07:35:04.249856+0000","last_became_active":"2024-09-21T07:35:03.258721+0000","last_became_peered":"2024-09-21T07:35:03.258721+0000","last_unstale":"2024-09-21T07:35:04.249856+0000","last_undegraded":"2024-09-21T07:35:04.249856+0000","last_fullsized":"2024-09-21T07:35:04.249856+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:57.399605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234135+0000","last_change":"2024-09-21T07:35:02.234135+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234135+0000","last_undegraded":"2024-09-21T07:35:02.234135+0000","last_fullsized":"2024-09-21T07:35:02.234135+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078662+0000","last_change":"2024-09-21T07:35:03.267609+0000","last_active":"2024-09-21T07:35:05.078662+0000","last_peered":"2024-09-21T07:35:05.078662+0000","last_clean":"2024-09-21T07:35:05.078662+0000","last_became_active":"2024-09-21T07:35:03.267316+0000","last_became_peered":"2024-09-21T07:35:03.267316+0000","last_unstale":"2024-09-21T07:35:05.078662+0000","last_undegraded":"2024-09-21T07:35:05.078662+0000","last_fullsized":"2024-09-21T07:35:05.078662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:55.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239262+0000","last_change":"2024-09-21T07:35:02.239262+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239262+0000","last_undegraded":"2024-09-21T07:35:02.239262+0000","last_fullsized":"2024-09-21T07:35:02.239262+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252882+0000","last_change":"2024-09-21T07:35:03.260726+0000","last_active":"2024-09-21T07:35:04.252882+0000","last_peered":"2024-09-21T07:35:04.252882+0000","last_clean":"2024-09-21T07:35:04.252882+0000","last_became_active":"2024-09-21T07:35:03.256428+0000","last_became_peered":"2024-09-21T07:35:03.256428+0000","last_unstale":"2024-09-21T07:35:04.252882+0000","last_undegraded":"2024-09-21T07:35:04.252882+0000","last_fullsized":"2024-09-21T07:35:04.252882+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237648+0000","last_change":"2024-09-21T07:35:02.237648+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237648+0000","last_undegraded":"2024-09-21T07:35:02.237648+0000","last_fullsized":"2024-09-21T07:35:02.237648+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.245751+0000","last_change":"2024-09-21T07:35:02.245751+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.245751+0000","last_undegraded":"2024-09-21T07:35:02.245751+0000","last_fullsized":"2024-09-21T07:35:02.245751+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239916+0000","last_change":"2024-09-21T07:35:02.239916+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239916+0000","last_undegraded":"2024-09-21T07:35:02.239916+0000","last_fullsized":"2024-09-21T07:35:02.239916+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232742+0000","last_change":"2024-09-21T07:35:02.232742+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232742+0000","last_undegraded":"2024-09-21T07:35:02.232742+0000","last_fullsized":"2024-09-21T07:35:02.232742+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239815+0000","last_change":"2024-09-21T07:35:02.239815+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239815+0000","last_undegraded":"2024-09-21T07:35:02.239815+0000","last_fullsized":"2024-09-21T07:35:02.239815+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249682+0000","last_change":"2024-09-21T07:35:03.254637+0000","last_active":"2024-09-21T07:35:04.249682+0000","last_peered":"2024-09-21T07:35:04.249682+0000","last_clean":"2024-09-21T07:35:04.249682+0000","last_became_active":"2024-09-21T07:35:03.254227+0000","last_became_peered":"2024-09-21T07:35:03.254227+0000","last_unstale":"2024-09-21T07:35:04.249682+0000","last_undegraded":"2024-09-21T07:35:04.249682+0000","last_fullsized":"2024-09-21T07:35:04.249682+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.940090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251731+0000","last_change":"2024-09-21T07:35:03.270378+0000","last_active":"2024-09-21T07:35:04.251731+0000","last_peered":"2024-09-21T07:35:04.251731+0000","last_clean":"2024-09-21T07:35:04.251731+0000","last_became_active":"2024-09-21T07:35:03.269427+0000","last_became_peered":"2024-09-21T07:35:03.269427+0000","last_unstale":"2024-09-21T07:35:04.251731+0000","last_undegraded":"2024-09-21T07:35:04.251731+0000","last_fullsized":"2024-09-21T07:35:04.251731+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:52.605389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241032+0000","last_change":"2024-09-21T07:35:02.241032+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241032+0000","last_undegraded":"2024-09-21T07:35:02.241032+0000","last_fullsized":"2024-09-21T07:35:02.241032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238290+0000","last_change":"2024-09-21T07:35:02.238290+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238290+0000","last_undegraded":"2024-09-21T07:35:02.238290+0000","last_fullsized":"2024-09-21T07:35:02.238290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250361+0000","last_change":"2024-09-21T07:35:03.261822+0000","last_active":"2024-09-21T07:35:04.250361+0000","last_peered":"2024-09-21T07:35:04.250361+0000","last_clean":"2024-09-21T07:35:04.250361+0000","last_became_active":"2024-09-21T07:35:03.261533+0000","last_became_peered":"2024-09-21T07:35:03.261533+0000","last_unstale":"2024-09-21T07:35:04.250361+0000","last_undegraded":"2024-09-21T07:35:04.250361+0000","last_fullsized":"2024-09-21T07:35:04.250361+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.404434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238804+0000","last_change":"2024-09-21T07:35:02.238804+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238804+0000","last_undegraded":"2024-09-21T07:35:02.238804+0000","last_fullsized":"2024-09-21T07:35:02.238804+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244198+0000","last_change":"2024-09-21T07:35:02.244198+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244198+0000","last_undegraded":"2024-09-21T07:35:02.244198+0000","last_fullsized":"2024-09-21T07:35:02.244198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078605+0000","last_change":"2024-09-21T07:35:03.277225+0000","last_active":"2024-09-21T07:35:05.078605+0000","last_peered":"2024-09-21T07:35:05.078605+0000","last_clean":"2024-09-21T07:35:05.078605+0000","last_became_active":"2024-09-21T07:35:03.276612+0000","last_became_peered":"2024-09-21T07:35:03.276612+0000","last_unstale":"2024-09-21T07:35:05.078605+0000","last_undegraded":"2024-09-21T07:35:05.078605+0000","last_fullsized":"2024-09-21T07:35:05.078605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:08.098778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240376+0000","last_change":"2024-09-21T07:35:02.240376+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240376+0000","last_undegraded":"2024-09-21T07:35:02.240376+0000","last_fullsized":"2024-09-21T07:35:02.240376+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235734+0000","last_change":"2024-09-21T07:35:02.235734+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235734+0000","last_undegraded":"2024-09-21T07:35:02.235734+0000","last_fullsized":"2024-09-21T07:35:02.235734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238877+0000","last_change":"2024-09-21T07:35:02.238877+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238877+0000","last_undegraded":"2024-09-21T07:35:02.238877+0000","last_fullsized":"2024-09-21T07:35:02.238877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079386+0000","last_change":"2024-09-21T07:35:03.267424+0000","last_active":"2024-09-21T07:35:05.079386+0000","last_peered":"2024-09-21T07:35:05.079386+0000","last_clean":"2024-09-21T07:35:05.079386+0000","last_became_active":"2024-09-21T07:35:03.266994+0000","last_became_peered":"2024-09-21T07:35:03.266994+0000","last_unstale":"2024-09-21T07:35:05.079386+0000","last_undegraded":"2024-09-21T07:35:05.079386+0000","last_fullsized":"2024-09-21T07:35:05.079386+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:48.006626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250585+0000","last_change":"2024-09-21T07:35:03.254332+0000","last_active":"2024-09-21T07:35:04.250585+0000","last_peered":"2024-09-21T07:35:04.250585+0000","last_clean":"2024-09-21T07:35:04.250585+0000","last_became_active":"2024-09-21T07:35:03.254005+0000","last_became_peered":"2024-09-21T07:35:03.254005+0000","last_unstale":"2024-09-21T07:35:04.250585+0000","last_undegraded":"2024-09-21T07:35:04.250585+0000","last_fullsized":"2024-09-21T07:35:04.250585+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:08.989540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237637+0000","last_change":"2024-09-21T07:35:02.237637+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237637+0000","last_undegraded":"2024-09-21T07:35:02.237637+0000","last_fullsized":"2024-09-21T07:35:02.237637+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235914+0000","last_change":"2024-09-21T07:35:02.235914+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235914+0000","last_undegraded":"2024-09-21T07:35:02.235914+0000","last_fullsized":"2024-09-21T07:35:02.235914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233660+0000","last_change":"2024-09-21T07:35:02.233660+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233660+0000","last_undegraded":"2024-09-21T07:35:02.233660+0000","last_fullsized":"2024-09-21T07:35:02.233660+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249694+0000","last_change":"2024-09-21T07:35:03.261409+0000","last_active":"2024-09-21T07:35:04.249694+0000","last_peered":"2024-09-21T07:35:04.249694+0000","last_clean":"2024-09-21T07:35:04.249694+0000","last_became_active":"2024-09-21T07:35:03.261076+0000","last_became_peered":"2024-09-21T07:35:03.261076+0000","last_unstale":"2024-09-21T07:35:04.249694+0000","last_undegraded":"2024-09-21T07:35:04.249694+0000","last_fullsized":"2024-09-21T07:35:04.249694+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:55.778957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079516+0000","last_change":"2024-09-21T07:35:03.270094+0000","last_active":"2024-09-21T07:35:05.079516+0000","last_peered":"2024-09-21T07:35:05.079516+0000","last_clean":"2024-09-21T07:35:05.079516+0000","last_became_active":"2024-09-21T07:35:03.269758+0000","last_became_peered":"2024-09-21T07:35:03.269758+0000","last_unstale":"2024-09-21T07:35:05.079516+0000","last_undegraded":"2024-09-21T07:35:05.079516+0000","last_fullsized":"2024-09-21T07:35:05.079516+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.138794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261396+0000","last_change":"2024-09-21T07:35:02.258592+0000","last_active":"2024-09-21T07:35:02.261396+0000","last_peered":"2024-09-21T07:35:02.261396+0000","last_clean":"2024-09-21T07:35:02.261396+0000","last_became_active":"2024-09-21T07:35:02.258264+0000","last_became_peered":"2024-09-21T07:35:02.258264+0000","last_unstale":"2024-09-21T07:35:02.261396+0000","last_undegraded":"2024-09-21T07:35:02.261396+0000","last_fullsized":"2024-09-21T07:35:02.261396+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:09.521183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234610+0000","last_change":"2024-09-21T07:35:02.234610+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234610+0000","last_undegraded":"2024-09-21T07:35:02.234610+0000","last_fullsized":"2024-09-21T07:35:02.234610+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.253042+0000","last_change":"2024-09-21T07:35:02.252098+0000","last_active":"2024-09-21T07:35:04.253042+0000","last_peered":"2024-09-21T07:35:04.253042+0000","last_clean":"2024-09-21T07:35:04.253042+0000","last_became_active":"2024-09-21T07:35:02.249744+0000","last_became_peered":"2024-09-21T07:35:02.249744+0000","last_unstale":"2024-09-21T07:35:04.253042+0000","last_undegraded":"2024-09-21T07:35:04.253042+0000","last_fullsized":"2024-09-21T07:35:04.253042+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.362809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238071+0000","last_change":"2024-09-21T07:35:02.238071+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238071+0000","last_undegraded":"2024-09-21T07:35:02.238071+0000","last_fullsized":"2024-09-21T07:35:02.238071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.251107+0000","last_change":"2024-09-21T07:35:02.249622+0000","last_active":"2024-09-21T07:35:02.251107+0000","last_peered":"2024-09-21T07:35:02.251107+0000","last_clean":"2024-09-21T07:35:02.251107+0000","last_became_active":"2024-09-21T07:35:02.249278+0000","last_became_peered":"2024-09-21T07:35:02.249278+0000","last_unstale":"2024-09-21T07:35:02.251107+0000","last_undegraded":"2024-09-21T07:35:02.251107+0000","last_fullsized":"2024-09-21T07:35:02.251107+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:50.071551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.242278+0000","last_change":"2024-09-21T07:35:02.242278+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.242278+0000","last_undegraded":"2024-09-21T07:35:02.242278+0000","last_fullsized":"2024-09-21T07:35:02.242278+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.245953+0000","last_change":"2024-09-21T07:35:02.244307+0000","last_active":"2024-09-21T07:35:02.245953+0000","last_peered":"2024-09-21T07:35:02.245953+0000","last_clean":"2024-09-21T07:35:02.245953+0000","last_became_active":"2024-09-21T07:35:02.243923+0000","last_became_peered":"2024-09-21T07:35:02.243923+0000","last_unstale":"2024-09-21T07:35:02.245953+0000","last_undegraded":"2024-09-21T07:35:02.245953+0000","last_fullsized":"2024-09-21T07:35:02.245953+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:51.627210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235902+0000","last_change":"2024-09-21T07:35:02.235902+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235902+0000","last_undegraded":"2024-09-21T07:35:02.235902+0000","last_fullsized":"2024-09-21T07:35:02.235902+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250126+0000","last_change":"2024-09-21T07:35:02.253834+0000","last_active":"2024-09-21T07:35:04.250126+0000","last_peered":"2024-09-21T07:35:04.250126+0000","last_clean":"2024-09-21T07:35:04.250126+0000","last_became_active":"2024-09-21T07:35:02.252826+0000","last_became_peered":"2024-09-21T07:35:02.252826+0000","last_unstale":"2024-09-21T07:35:04.250126+0000","last_undegraded":"2024-09-21T07:35:04.250126+0000","last_fullsized":"2024-09-21T07:35:04.250126+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:39.103263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237912+0000","last_change":"2024-09-21T07:35:02.237912+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237912+0000","last_undegraded":"2024-09-21T07:35:02.237912+0000","last_fullsized":"2024-09-21T07:35:02.237912+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262455+0000","last_change":"2024-09-21T07:35:02.261499+0000","last_active":"2024-09-21T07:35:02.262455+0000","last_peered":"2024-09-21T07:35:02.262455+0000","last_clean":"2024-09-21T07:35:02.262455+0000","last_became_active":"2024-09-21T07:35:02.261161+0000","last_became_peered":"2024-09-21T07:35:02.261161+0000","last_unstale":"2024-09-21T07:35:02.262455+0000","last_undegraded":"2024-09-21T07:35:02.262455+0000","last_fullsized":"2024-09-21T07:35:02.262455+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:36.330951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239267+0000","last_change":"2024-09-21T07:35:02.239267+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239267+0000","last_undegraded":"2024-09-21T07:35:02.239267+0000","last_fullsized":"2024-09-21T07:35:02.239267+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252571+0000","last_change":"2024-09-21T07:35:02.248579+0000","last_active":"2024-09-21T07:35:02.252571+0000","last_peered":"2024-09-21T07:35:02.252571+0000","last_clean":"2024-09-21T07:35:02.252571+0000","last_became_active":"2024-09-21T07:35:02.248203+0000","last_became_peered":"2024-09-21T07:35:02.248203+0000","last_unstale":"2024-09-21T07:35:02.252571+0000","last_undegraded":"2024-09-21T07:35:02.252571+0000","last_fullsized":"2024-09-21T07:35:02.252571+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:29.233618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079418+0000","last_change":"2024-09-21T07:35:03.270828+0000","last_active":"2024-09-21T07:35:05.079418+0000","last_peered":"2024-09-21T07:35:05.079418+0000","last_clean":"2024-09-21T07:35:05.079418+0000","last_became_active":"2024-09-21T07:35:03.270525+0000","last_became_peered":"2024-09-21T07:35:03.270525+0000","last_unstale":"2024-09-21T07:35:05.079418+0000","last_undegraded":"2024-09-21T07:35:05.079418+0000","last_fullsized":"2024-09-21T07:35:05.079418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:35.198735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251909+0000","last_change":"2024-09-21T07:35:02.257632+0000","last_active":"2024-09-21T07:35:04.251909+0000","last_peered":"2024-09-21T07:35:04.251909+0000","last_clean":"2024-09-21T07:35:04.251909+0000","last_became_active":"2024-09-21T07:35:02.256235+0000","last_became_peered":"2024-09-21T07:35:02.256235+0000","last_unstale":"2024-09-21T07:35:04.251909+0000","last_undegraded":"2024-09-21T07:35:04.251909+0000","last_fullsized":"2024-09-21T07:35:04.251909+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:41.865068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251199+0000","last_change":"2024-09-21T07:35:03.258728+0000","last_active":"2024-09-21T07:35:04.251199+0000","last_peered":"2024-09-21T07:35:04.251199+0000","last_clean":"2024-09-21T07:35:04.251199+0000","last_became_active":"2024-09-21T07:35:03.258061+0000","last_became_peered":"2024-09-21T07:35:03.258061+0000","last_unstale":"2024-09-21T07:35:04.251199+0000","last_undegraded":"2024-09-21T07:35:04.251199+0000","last_fullsized":"2024-09-21T07:35:04.251199+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:47.404474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.248899+0000","last_change":"2024-09-21T07:35:02.247431+0000","last_active":"2024-09-21T07:35:02.248899+0000","last_peered":"2024-09-21T07:35:02.248899+0000","last_clean":"2024-09-21T07:35:02.248899+0000","last_became_active":"2024-09-21T07:35:02.247100+0000","last_became_peered":"2024-09-21T07:35:02.247100+0000","last_unstale":"2024-09-21T07:35:02.248899+0000","last_undegraded":"2024-09-21T07:35:02.248899+0000","last_fullsized":"2024-09-21T07:35:02.248899+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:40.087806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240470+0000","last_change":"2024-09-21T07:35:02.240470+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240470+0000","last_undegraded":"2024-09-21T07:35:02.240470+0000","last_fullsized":"2024-09-21T07:35:02.240470+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262625+0000","last_change":"2024-09-21T07:35:02.261614+0000","last_active":"2024-09-21T07:35:02.262625+0000","last_peered":"2024-09-21T07:35:02.262625+0000","last_clean":"2024-09-21T07:35:02.262625+0000","last_became_active":"2024-09-21T07:35:02.261277+0000","last_became_peered":"2024-09-21T07:35:02.261277+0000","last_unstale":"2024-09-21T07:35:02.262625+0000","last_undegraded":"2024-09-21T07:35:02.262625+0000","last_fullsized":"2024-09-21T07:35:02.262625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:19.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238435+0000","last_change":"2024-09-21T07:35:02.238435+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238435+0000","last_undegraded":"2024-09-21T07:35:02.238435+0000","last_fullsized":"2024-09-21T07:35:02.238435+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.256190+0000","last_change":"2024-09-21T07:35:02.255104+0000","last_active":"2024-09-21T07:35:02.256190+0000","last_peered":"2024-09-21T07:35:02.256190+0000","last_clean":"2024-09-21T07:35:02.256190+0000","last_became_active":"2024-09-21T07:35:02.254632+0000","last_became_peered":"2024-09-21T07:35:02.254632+0000","last_unstale":"2024-09-21T07:35:02.256190+0000","last_undegraded":"2024-09-21T07:35:02.256190+0000","last_fullsized":"2024-09-21T07:35:02.256190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:03.429390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232471+0000","last_change":"2024-09-21T07:35:02.232471+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232471+0000","last_undegraded":"2024-09-21T07:35:02.232471+0000","last_fullsized":"2024-09-21T07:35:02.232471+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260979+0000","last_change":"2024-09-21T07:35:02.260184+0000","last_active":"2024-09-21T07:35:02.260979+0000","last_peered":"2024-09-21T07:35:02.260979+0000","last_clean":"2024-09-21T07:35:02.260979+0000","last_became_active":"2024-09-21T07:35:02.259823+0000","last_became_peered":"2024-09-21T07:35:02.259823+0000","last_unstale":"2024-09-21T07:35:02.260979+0000","last_undegraded":"2024-09-21T07:35:02.260979+0000","last_fullsized":"2024-09-21T07:35:02.260979+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:19.342886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249632+0000","last_change":"2024-09-21T07:35:03.255093+0000","last_active":"2024-09-21T07:35:04.249632+0000","last_peered":"2024-09-21T07:35:04.249632+0000","last_clean":"2024-09-21T07:35:04.249632+0000","last_became_active":"2024-09-21T07:35:03.254830+0000","last_became_peered":"2024-09-21T07:35:03.254830+0000","last_unstale":"2024-09-21T07:35:04.249632+0000","last_undegraded":"2024-09-21T07:35:04.249632+0000","last_fullsized":"2024-09-21T07:35:04.249632+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:09.529360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259295+0000","last_change":"2024-09-21T07:35:02.256316+0000","last_active":"2024-09-21T07:35:02.259295+0000","last_peered":"2024-09-21T07:35:02.259295+0000","last_clean":"2024-09-21T07:35:02.259295+0000","last_became_active":"2024-09-21T07:35:02.255641+0000","last_became_peered":"2024-09-21T07:35:02.255641+0000","last_unstale":"2024-09-21T07:35:02.259295+0000","last_undegraded":"2024-09-21T07:35:02.259295+0000","last_fullsized":"2024-09-21T07:35:02.259295+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:43.643912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236989+0000","last_change":"2024-09-21T07:35:02.236989+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236989+0000","last_undegraded":"2024-09-21T07:35:02.236989+0000","last_fullsized":"2024-09-21T07:35:02.236989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255721+0000","last_change":"2024-09-21T07:35:02.251182+0000","last_active":"2024-09-21T07:35:02.255721+0000","last_peered":"2024-09-21T07:35:02.255721+0000","last_clean":"2024-09-21T07:35:02.255721+0000","last_became_active":"2024-09-21T07:35:02.250879+0000","last_became_peered":"2024-09-21T07:35:02.250879+0000","last_unstale":"2024-09-21T07:35:02.255721+0000","last_undegraded":"2024-09-21T07:35:02.255721+0000","last_fullsized":"2024-09-21T07:35:02.255721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:59.006953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239439+0000","last_change":"2024-09-21T07:35:02.239439+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239439+0000","last_undegraded":"2024-09-21T07:35:02.239439+0000","last_fullsized":"2024-09-21T07:35:02.239439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.249536+0000","last_change":"2024-09-21T07:35:02.246826+0000","last_active":"2024-09-21T07:35:02.249536+0000","last_peered":"2024-09-21T07:35:02.249536+0000","last_clean":"2024-09-21T07:35:02.249536+0000","last_became_active":"2024-09-21T07:35:02.246426+0000","last_became_peered":"2024-09-21T07:35:02.246426+0000","last_unstale":"2024-09-21T07:35:02.249536+0000","last_undegraded":"2024-09-21T07:35:02.249536+0000","last_fullsized":"2024-09-21T07:35:02.249536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:15.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235286+0000","last_change":"2024-09-21T07:35:02.235286+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235286+0000","last_undegraded":"2024-09-21T07:35:02.235286+0000","last_fullsized":"2024-09-21T07:35:02.235286+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259020+0000","last_change":"2024-09-21T07:35:02.256374+0000","last_active":"2024-09-21T07:35:02.259020+0000","last_peered":"2024-09-21T07:35:02.259020+0000","last_clean":"2024-09-21T07:35:02.259020+0000","last_became_active":"2024-09-21T07:35:02.255795+0000","last_became_peered":"2024-09-21T07:35:02.255795+0000","last_unstale":"2024-09-21T07:35:02.259020+0000","last_undegraded":"2024-09-21T07:35:02.259020+0000","last_fullsized":"2024-09-21T07:35:02.259020+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:29.735597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251189+0000","last_change":"2024-09-21T07:35:03.259092+0000","last_active":"2024-09-21T07:35:04.251189+0000","last_peered":"2024-09-21T07:35:04.251189+0000","last_clean":"2024-09-21T07:35:04.251189+0000","last_became_active":"2024-09-21T07:35:03.256278+0000","last_became_peered":"2024-09-21T07:35:03.256278+0000","last_unstale":"2024-09-21T07:35:04.251189+0000","last_undegraded":"2024-09-21T07:35:04.251189+0000","last_fullsized":"2024-09-21T07:35:04.251189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.004230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261134+0000","last_change":"2024-09-21T07:35:02.257673+0000","last_active":"2024-09-21T07:35:02.261134+0000","last_peered":"2024-09-21T07:35:02.261134+0000","last_clean":"2024-09-21T07:35:02.261134+0000","last_became_active":"2024-09-21T07:35:02.256474+0000","last_became_peered":"2024-09-21T07:35:02.256474+0000","last_unstale":"2024-09-21T07:35:02.261134+0000","last_undegraded":"2024-09-21T07:35:02.261134+0000","last_fullsized":"2024-09-21T07:35:02.261134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:52.614926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237509+0000","last_change":"2024-09-21T07:35:02.237509+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237509+0000","last_undegraded":"2024-09-21T07:35:02.237509+0000","last_fullsized":"2024-09-21T07:35:02.237509+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258876+0000","last_change":"2024-09-21T07:35:02.257206+0000","last_active":"2024-09-21T07:35:02.258876+0000","last_peered":"2024-09-21T07:35:02.258876+0000","last_clean":"2024-09-21T07:35:02.258876+0000","last_became_active":"2024-09-21T07:35:02.256889+0000","last_became_peered":"2024-09-21T07:35:02.256889+0000","last_unstale":"2024-09-21T07:35:02.258876+0000","last_undegraded":"2024-09-21T07:35:02.258876+0000","last_fullsized":"2024-09-21T07:35:02.258876+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:12.902316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236526+0000","last_change":"2024-09-21T07:35:02.236526+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236526+0000","last_undegraded":"2024-09-21T07:35:02.236526+0000","last_fullsized":"2024-09-21T07:35:02.236526+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252163+0000","last_change":"2024-09-21T07:35:02.250284+0000","last_active":"2024-09-21T07:35:02.252163+0000","last_peered":"2024-09-21T07:35:02.252163+0000","last_clean":"2024-09-21T07:35:02.252163+0000","last_became_active":"2024-09-21T07:35:02.246160+0000","last_became_peered":"2024-09-21T07:35:02.246160+0000","last_unstale":"2024-09-21T07:35:02.252163+0000","last_undegraded":"2024-09-21T07:35:02.252163+0000","last_fullsized":"2024-09-21T07:35:02.252163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:13.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237046+0000","last_change":"2024-09-21T07:35:02.237046+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237046+0000","last_undegraded":"2024-09-21T07:35:02.237046+0000","last_fullsized":"2024-09-21T07:35:02.237046+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261239+0000","last_change":"2024-09-21T07:35:02.260372+0000","last_active":"2024-09-21T07:35:02.261239+0000","last_peered":"2024-09-21T07:35:02.261239+0000","last_clean":"2024-09-21T07:35:02.261239+0000","last_became_active":"2024-09-21T07:35:02.260081+0000","last_became_peered":"2024-09-21T07:35:02.260081+0000","last_unstale":"2024-09-21T07:35:02.261239+0000","last_undegraded":"2024-09-21T07:35:02.261239+0000","last_fullsized":"2024-09-21T07:35:02.261239+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:50.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241741+0000","last_change":"2024-09-21T07:35:02.241741+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241741+0000","last_undegraded":"2024-09-21T07:35:02.241741+0000","last_fullsized":"2024-09-21T07:35:02.241741+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261095+0000","last_change":"2024-09-21T07:35:02.258379+0000","last_active":"2024-09-21T07:35:02.261095+0000","last_peered":"2024-09-21T07:35:02.261095+0000","last_clean":"2024-09-21T07:35:02.261095+0000","last_became_active":"2024-09-21T07:35:02.258050+0000","last_became_peered":"2024-09-21T07:35:02.258050+0000","last_unstale":"2024-09-21T07:35:02.261095+0000","last_undegraded":"2024-09-21T07:35:02.261095+0000","last_fullsized":"2024-09-21T07:35:02.261095+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:50.176822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243017+0000","last_change":"2024-09-21T07:35:02.243017+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243017+0000","last_undegraded":"2024-09-21T07:35:02.243017+0000","last_fullsized":"2024-09-21T07:35:02.243017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255202+0000","last_change":"2024-09-21T07:35:02.247540+0000","last_active":"2024-09-21T07:35:02.255202+0000","last_peered":"2024-09-21T07:35:02.255202+0000","last_clean":"2024-09-21T07:35:02.255202+0000","last_became_active":"2024-09-21T07:35:02.246243+0000","last_became_peered":"2024-09-21T07:35:02.246243+0000","last_unstale":"2024-09-21T07:35:02.255202+0000","last_undegraded":"2024-09-21T07:35:02.255202+0000","last_fullsized":"2024-09-21T07:35:02.255202+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:53.157560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250000+0000","last_change":"2024-09-21T07:35:03.273184+0000","last_active":"2024-09-21T07:35:04.250000+0000","last_peered":"2024-09-21T07:35:04.250000+0000","last_clean":"2024-09-21T07:35:04.250000+0000","last_became_active":"2024-09-21T07:35:03.272844+0000","last_became_peered":"2024-09-21T07:35:03.272844+0000","last_unstale":"2024-09-21T07:35:04.250000+0000","last_undegraded":"2024-09-21T07:35:04.250000+0000","last_fullsized":"2024-09-21T07:35:04.250000+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:20.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.253606+0000","last_change":"2024-09-21T07:35:02.252337+0000","last_active":"2024-09-21T07:35:02.253606+0000","last_peered":"2024-09-21T07:35:02.253606+0000","last_clean":"2024-09-21T07:35:02.253606+0000","last_became_active":"2024-09-21T07:35:02.250853+0000","last_became_peered":"2024-09-21T07:35:02.250853+0000","last_unstale":"2024-09-21T07:35:02.253606+0000","last_undegraded":"2024-09-21T07:35:02.253606+0000","last_fullsized":"2024-09-21T07:35:02.253606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:55.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233421+0000","last_change":"2024-09-21T07:35:02.233421+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233421+0000","last_undegraded":"2024-09-21T07:35:02.233421+0000","last_fullsized":"2024-09-21T07:35:02.233421+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.257226+0000","last_change":"2024-09-21T07:35:02.254083+0000","last_active":"2024-09-21T07:35:02.257226+0000","last_peered":"2024-09-21T07:35:02.257226+0000","last_clean":"2024-09-21T07:35:02.257226+0000","last_became_active":"2024-09-21T07:35:02.253685+0000","last_became_peered":"2024-09-21T07:35:02.253685+0000","last_unstale":"2024-09-21T07:35:02.257226+0000","last_undegraded":"2024-09-21T07:35:02.257226+0000","last_fullsized":"2024-09-21T07:35:02.257226+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:18.167243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234083+0000","last_change":"2024-09-21T07:35:02.234083+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234083+0000","last_undegraded":"2024-09-21T07:35:02.234083+0000","last_fullsized":"2024-09-21T07:35:02.234083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.246830+0000","last_change":"2024-09-21T07:35:02.244930+0000","last_active":"2024-09-21T07:35:02.246830+0000","last_peered":"2024-09-21T07:35:02.246830+0000","last_clean":"2024-09-21T07:35:02.246830+0000","last_became_active":"2024-09-21T07:35:02.244374+0000","last_became_peered":"2024-09-21T07:35:02.244374+0000","last_unstale":"2024-09-21T07:35:02.246830+0000","last_undegraded":"2024-09-21T07:35:02.246830+0000","last_fullsized":"2024-09-21T07:35:02.246830+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:48.574990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079598+0000","last_change":"2024-09-21T07:35:03.269506+0000","last_active":"2024-09-21T07:35:05.079598+0000","last_peered":"2024-09-21T07:35:05.079598+0000","last_clean":"2024-09-21T07:35:05.079598+0000","last_became_active":"2024-09-21T07:35:03.267171+0000","last_became_peered":"2024-09-21T07:35:03.267171+0000","last_unstale":"2024-09-21T07:35:05.079598+0000","last_undegraded":"2024-09-21T07:35:05.079598+0000","last_fullsized":"2024-09-21T07:35:05.079598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.131661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251322+0000","last_change":"2024-09-21T07:35:02.255663+0000","last_active":"2024-09-21T07:35:04.251322+0000","last_peered":"2024-09-21T07:35:04.251322+0000","last_clean":"2024-09-21T07:35:04.251322+0000","last_became_active":"2024-09-21T07:35:02.254828+0000","last_became_peered":"2024-09-21T07:35:02.254828+0000","last_unstale":"2024-09-21T07:35:04.251322+0000","last_undegraded":"2024-09-21T07:35:04.251322+0000","last_fullsized":"2024-09-21T07:35:04.251322+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:29.571173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235257+0000","last_change":"2024-09-21T07:35:02.235257+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235257+0000","last_undegraded":"2024-09-21T07:35:02.235257+0000","last_fullsized":"2024-09-21T07:35:02.235257+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250706+0000","last_change":"2024-09-21T07:35:02.250656+0000","last_active":"2024-09-21T07:35:04.250706+0000","last_peered":"2024-09-21T07:35:04.250706+0000","last_clean":"2024-09-21T07:35:04.250706+0000","last_became_active":"2024-09-21T07:35:02.250329+0000","last_became_peered":"2024-09-21T07:35:02.250329+0000","last_unstale":"2024-09-21T07:35:04.250706+0000","last_undegraded":"2024-09-21T07:35:04.250706+0000","last_fullsized":"2024-09-21T07:35:04.250706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.341710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244058+0000","last_change":"2024-09-21T07:35:02.244058+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244058+0000","last_undegraded":"2024-09-21T07:35:02.244058+0000","last_fullsized":"2024-09-21T07:35:02.244058+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079012+0000","last_change":"2024-09-21T07:35:02.250574+0000","last_active":"2024-09-21T07:35:05.079012+0000","last_peered":"2024-09-21T07:35:05.079012+0000","last_clean":"2024-09-21T07:35:05.079012+0000","last_became_active":"2024-09-21T07:35:02.250234+0000","last_became_peered":"2024-09-21T07:35:02.250234+0000","last_unstale":"2024-09-21T07:35:05.079012+0000","last_undegraded":"2024-09-21T07:35:05.079012+0000","last_fullsized":"2024-09-21T07:35:05.079012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:37.854681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237226+0000","last_change":"2024-09-21T07:35:02.237226+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237226+0000","last_undegraded":"2024-09-21T07:35:02.237226+0000","last_fullsized":"2024-09-21T07:35:02.237226+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078769+0000","last_change":"2024-09-21T07:35:02.255595+0000","last_active":"2024-09-21T07:35:05.078769+0000","last_peered":"2024-09-21T07:35:05.078769+0000","last_clean":"2024-09-21T07:35:05.078769+0000","last_became_active":"2024-09-21T07:35:02.255252+0000","last_became_peered":"2024-09-21T07:35:02.255252+0000","last_unstale":"2024-09-21T07:35:05.078769+0000","last_undegraded":"2024-09-21T07:35:05.078769+0000","last_fullsized":"2024-09-21T07:35:05.078769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:26.903296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235130+0000","last_change":"2024-09-21T07:35:02.235130+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235130+0000","last_undegraded":"2024-09-21T07:35:02.235130+0000","last_fullsized":"2024-09-21T07:35:02.235130+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260366+0000","last_change":"2024-09-21T07:35:02.254958+0000","last_active":"2024-09-21T07:35:02.260366+0000","last_peered":"2024-09-21T07:35:02.260366+0000","last_clean":"2024-09-21T07:35:02.260366+0000","last_became_active":"2024-09-21T07:35:02.253119+0000","last_became_peered":"2024-09-21T07:35:02.253119+0000","last_unstale":"2024-09-21T07:35:02.260366+0000","last_undegraded":"2024-09-21T07:35:02.260366+0000","last_fullsized":"2024-09-21T07:35:02.260366+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079321+0000","last_change":"2024-09-21T07:35:03.275353+0000","last_active":"2024-09-21T07:35:05.079321+0000","last_peered":"2024-09-21T07:35:05.079321+0000","last_clean":"2024-09-21T07:35:05.079321+0000","last_became_active":"2024-09-21T07:35:03.275033+0000","last_became_peered":"2024-09-21T07:35:03.275033+0000","last_unstale":"2024-09-21T07:35:05.079321+0000","last_undegraded":"2024-09-21T07:35:05.079321+0000","last_fullsized":"2024-09-21T07:35:05.079321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:52.384866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258885+0000","last_change":"2024-09-21T07:35:02.257732+0000","last_active":"2024-09-21T07:35:02.258885+0000","last_peered":"2024-09-21T07:35:02.258885+0000","last_clean":"2024-09-21T07:35:02.258885+0000","last_became_active":"2024-09-21T07:35:02.257428+0000","last_became_peered":"2024-09-21T07:35:02.257428+0000","last_unstale":"2024-09-21T07:35:02.258885+0000","last_undegraded":"2024-09-21T07:35:02.258885+0000","last_fullsized":"2024-09-21T07:35:02.258885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:48.747844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241038+0000","last_change":"2024-09-21T07:35:02.241038+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241038+0000","last_undegraded":"2024-09-21T07:35:02.241038+0000","last_fullsized":"2024-09-21T07:35:02.241038+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260795+0000","last_change":"2024-09-21T07:35:02.254903+0000","last_active":"2024-09-21T07:35:02.260795+0000","last_peered":"2024-09-21T07:35:02.260795+0000","last_clean":"2024-09-21T07:35:02.260795+0000","last_became_active":"2024-09-21T07:35:02.254530+0000","last_became_peered":"2024-09-21T07:35:02.254530+0000","last_unstale":"2024-09-21T07:35:02.260795+0000","last_undegraded":"2024-09-21T07:35:02.260795+0000","last_fullsized":"2024-09-21T07:35:02.260795+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:10.217766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":397,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078709+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:05.078709+0000","last_peered":"2024-09-21T07:35:05.078709+0000","last_clean":"2024-09-21T07:35:05.078709+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:05.078709+0000","last_undegraded":"2024-09-21T07:35:05.078709+0000","last_fullsized":"2024-09-21T07:35:05.078709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59712,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312128,"statfs":{"total":96636764160,"available":96575619072,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56120,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315720,"statfs":{"total":96636764160,"available":96579297280,"internally_reserved":0,"allocated":2789376,"data_stored":1624626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542298,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1645152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83296,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94288544,"statfs":{"total":96636764160,"available":96551469056,"internally_reserved":0,"allocated":2240512,"data_stored":1054944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:35:08.308 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3f is not active+clean 2024-09-21T07:35:08.308 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.240634+0000', 'last_change': '2024-09-21T07:35:02.240634+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.240634+0000', 'last_undegraded': '2024-09-21T07:35:02.240634+0000', 'last_fullsized': '2024-09-21T07:35:02.240634+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.308 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3e is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239707+0000', 'last_change': '2024-09-21T07:35:02.239707+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239707+0000', 'last_undegraded': '2024-09-21T07:35:02.239707+0000', 'last_fullsized': '2024-09-21T07:35:02.239707+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3d is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.243453+0000', 'last_change': '2024-09-21T07:35:02.243453+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.243453+0000', 'last_undegraded': '2024-09-21T07:35:02.243453+0000', 'last_fullsized': '2024-09-21T07:35:02.243453+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3c is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.247783+0000', 'last_change': '2024-09-21T07:35:02.247783+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.247783+0000', 'last_undegraded': '2024-09-21T07:35:02.247783+0000', 'last_fullsized': '2024-09-21T07:35:02.247783+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:PG 26.39 is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.234135+0000', 'last_change': '2024-09-21T07:35:02.234135+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.234135+0000', 'last_undegraded': '2024-09-21T07:35:02.234135+0000', 'last_fullsized': '2024-09-21T07:35:02.234135+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:PG 26.37 is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239262+0000', 'last_change': '2024-09-21T07:35:02.239262+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239262+0000', 'last_undegraded': '2024-09-21T07:35:02.239262+0000', 'last_fullsized': '2024-09-21T07:35:02.239262+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:PG 26.35 is not active+clean 2024-09-21T07:35:08.309 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237648+0000', 'last_change': '2024-09-21T07:35:02.237648+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237648+0000', 'last_undegraded': '2024-09-21T07:35:02.237648+0000', 'last_fullsized': '2024-09-21T07:35:02.237648+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.34 is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.245751+0000', 'last_change': '2024-09-21T07:35:02.245751+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.245751+0000', 'last_undegraded': '2024-09-21T07:35:02.245751+0000', 'last_fullsized': '2024-09-21T07:35:02.245751+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.33 is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239916+0000', 'last_change': '2024-09-21T07:35:02.239916+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239916+0000', 'last_undegraded': '2024-09-21T07:35:02.239916+0000', 'last_fullsized': '2024-09-21T07:35:02.239916+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.32 is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.232742+0000', 'last_change': '2024-09-21T07:35:02.232742+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.232742+0000', 'last_undegraded': '2024-09-21T07:35:02.232742+0000', 'last_fullsized': '2024-09-21T07:35:02.232742+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.31 is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239815+0000', 'last_change': '2024-09-21T07:35:02.239815+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239815+0000', 'last_undegraded': '2024-09-21T07:35:02.239815+0000', 'last_fullsized': '2024-09-21T07:35:02.239815+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2e is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.241032+0000', 'last_change': '2024-09-21T07:35:02.241032+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.241032+0000', 'last_undegraded': '2024-09-21T07:35:02.241032+0000', 'last_fullsized': '2024-09-21T07:35:02.241032+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2d is not active+clean 2024-09-21T07:35:08.310 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.238290+0000', 'last_change': '2024-09-21T07:35:02.238290+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.238290+0000', 'last_undegraded': '2024-09-21T07:35:02.238290+0000', 'last_fullsized': '2024-09-21T07:35:02.238290+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2b is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.238804+0000', 'last_change': '2024-09-21T07:35:02.238804+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.238804+0000', 'last_undegraded': '2024-09-21T07:35:02.238804+0000', 'last_fullsized': '2024-09-21T07:35:02.238804+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2a is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.244198+0000', 'last_change': '2024-09-21T07:35:02.244198+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.244198+0000', 'last_undegraded': '2024-09-21T07:35:02.244198+0000', 'last_fullsized': '2024-09-21T07:35:02.244198+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.28 is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.240376+0000', 'last_change': '2024-09-21T07:35:02.240376+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.240376+0000', 'last_undegraded': '2024-09-21T07:35:02.240376+0000', 'last_fullsized': '2024-09-21T07:35:02.240376+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.27 is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235734+0000', 'last_change': '2024-09-21T07:35:02.235734+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235734+0000', 'last_undegraded': '2024-09-21T07:35:02.235734+0000', 'last_fullsized': '2024-09-21T07:35:02.235734+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.26 is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.238877+0000', 'last_change': '2024-09-21T07:35:02.238877+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.238877+0000', 'last_undegraded': '2024-09-21T07:35:02.238877+0000', 'last_fullsized': '2024-09-21T07:35:02.238877+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:PG 26.23 is not active+clean 2024-09-21T07:35:08.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237637+0000', 'last_change': '2024-09-21T07:35:02.237637+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237637+0000', 'last_undegraded': '2024-09-21T07:35:02.237637+0000', 'last_fullsized': '2024-09-21T07:35:02.237637+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.22 is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235914+0000', 'last_change': '2024-09-21T07:35:02.235914+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235914+0000', 'last_undegraded': '2024-09-21T07:35:02.235914+0000', 'last_fullsized': '2024-09-21T07:35:02.235914+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.21 is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.233660+0000', 'last_change': '2024-09-21T07:35:02.233660+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.233660+0000', 'last_undegraded': '2024-09-21T07:35:02.233660+0000', 'last_fullsized': '2024-09-21T07:35:02.233660+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1d is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.234610+0000', 'last_change': '2024-09-21T07:35:02.234610+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.234610+0000', 'last_undegraded': '2024-09-21T07:35:02.234610+0000', 'last_fullsized': '2024-09-21T07:35:02.234610+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1e is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.238071+0000', 'last_change': '2024-09-21T07:35:02.238071+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.238071+0000', 'last_undegraded': '2024-09-21T07:35:02.238071+0000', 'last_fullsized': '2024-09-21T07:35:02.238071+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1f is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.242278+0000', 'last_change': '2024-09-21T07:35:02.242278+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.242278+0000', 'last_undegraded': '2024-09-21T07:35:02.242278+0000', 'last_fullsized': '2024-09-21T07:35:02.242278+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:PG 26.18 is not active+clean 2024-09-21T07:35:08.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235902+0000', 'last_change': '2024-09-21T07:35:02.235902+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235902+0000', 'last_undegraded': '2024-09-21T07:35:02.235902+0000', 'last_fullsized': '2024-09-21T07:35:02.235902+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.19 is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237912+0000', 'last_change': '2024-09-21T07:35:02.237912+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237912+0000', 'last_undegraded': '2024-09-21T07:35:02.237912+0000', 'last_fullsized': '2024-09-21T07:35:02.237912+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1a is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239267+0000', 'last_change': '2024-09-21T07:35:02.239267+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239267+0000', 'last_undegraded': '2024-09-21T07:35:02.239267+0000', 'last_fullsized': '2024-09-21T07:35:02.239267+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.16 is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.240470+0000', 'last_change': '2024-09-21T07:35:02.240470+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.240470+0000', 'last_undegraded': '2024-09-21T07:35:02.240470+0000', 'last_fullsized': '2024-09-21T07:35:02.240470+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.17 is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.238435+0000', 'last_change': '2024-09-21T07:35:02.238435+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.238435+0000', 'last_undegraded': '2024-09-21T07:35:02.238435+0000', 'last_fullsized': '2024-09-21T07:35:02.238435+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.10 is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.232471+0000', 'last_change': '2024-09-21T07:35:02.232471+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.232471+0000', 'last_undegraded': '2024-09-21T07:35:02.232471+0000', 'last_fullsized': '2024-09-21T07:35:02.232471+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:PG 26.12 is not active+clean 2024-09-21T07:35:08.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.236989+0000', 'last_change': '2024-09-21T07:35:02.236989+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.236989+0000', 'last_undegraded': '2024-09-21T07:35:02.236989+0000', 'last_fullsized': '2024-09-21T07:35:02.236989+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.13 is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.239439+0000', 'last_change': '2024-09-21T07:35:02.239439+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.239439+0000', 'last_undegraded': '2024-09-21T07:35:02.239439+0000', 'last_fullsized': '2024-09-21T07:35:02.239439+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.c is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235286+0000', 'last_change': '2024-09-21T07:35:02.235286+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235286+0000', 'last_undegraded': '2024-09-21T07:35:02.235286+0000', 'last_fullsized': '2024-09-21T07:35:02.235286+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.e is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237509+0000', 'last_change': '2024-09-21T07:35:02.237509+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237509+0000', 'last_undegraded': '2024-09-21T07:35:02.237509+0000', 'last_fullsized': '2024-09-21T07:35:02.237509+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.f is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.236526+0000', 'last_change': '2024-09-21T07:35:02.236526+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.236526+0000', 'last_undegraded': '2024-09-21T07:35:02.236526+0000', 'last_fullsized': '2024-09-21T07:35:02.236526+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.8 is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237046+0000', 'last_change': '2024-09-21T07:35:02.237046+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237046+0000', 'last_undegraded': '2024-09-21T07:35:02.237046+0000', 'last_fullsized': '2024-09-21T07:35:02.237046+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:PG 26.9 is not active+clean 2024-09-21T07:35:08.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.241741+0000', 'last_change': '2024-09-21T07:35:02.241741+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.241741+0000', 'last_undegraded': '2024-09-21T07:35:02.241741+0000', 'last_fullsized': '2024-09-21T07:35:02.241741+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.a is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.243017+0000', 'last_change': '2024-09-21T07:35:02.243017+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.243017+0000', 'last_undegraded': '2024-09-21T07:35:02.243017+0000', 'last_fullsized': '2024-09-21T07:35:02.243017+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.4 is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.233421+0000', 'last_change': '2024-09-21T07:35:02.233421+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.233421+0000', 'last_undegraded': '2024-09-21T07:35:02.233421+0000', 'last_fullsized': '2024-09-21T07:35:02.233421+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.5 is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.234083+0000', 'last_change': '2024-09-21T07:35:02.234083+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.234083+0000', 'last_undegraded': '2024-09-21T07:35:02.234083+0000', 'last_fullsized': '2024-09-21T07:35:02.234083+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.7 is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235257+0000', 'last_change': '2024-09-21T07:35:02.235257+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235257+0000', 'last_undegraded': '2024-09-21T07:35:02.235257+0000', 'last_fullsized': '2024-09-21T07:35:02.235257+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.0 is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.244058+0000', 'last_change': '2024-09-21T07:35:02.244058+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.244058+0000', 'last_undegraded': '2024-09-21T07:35:02.244058+0000', 'last_fullsized': '2024-09-21T07:35:02.244058+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1 is not active+clean 2024-09-21T07:35:08.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.237226+0000', 'last_change': '2024-09-21T07:35:02.237226+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.237226+0000', 'last_undegraded': '2024-09-21T07:35:02.237226+0000', 'last_fullsized': '2024-09-21T07:35:02.237226+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:35:08.316 INFO:tasks.ceph.ceph_manager.ceph:PG 26.2 is not active+clean 2024-09-21T07:35:08.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.235130+0000', 'last_change': '2024-09-21T07:35:02.235130+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.235130+0000', 'last_undegraded': '2024-09-21T07:35:02.235130+0000', 'last_fullsized': '2024-09-21T07:35:02.235130+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:35:08.316 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1b is not active+clean 2024-09-21T07:35:08.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:02.241038+0000', 'last_change': '2024-09-21T07:35:02.241038+0000', 'last_active': '2024-09-21T07:35:02.222436+0000', 'last_peered': '2024-09-21T07:35:02.222436+0000', 'last_clean': '2024-09-21T07:35:02.222436+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:02.241038+0000', 'last_undegraded': '2024-09-21T07:35:02.241038+0000', 'last_fullsized': '2024-09-21T07:35:02.241038+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:02.222436+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:35:08.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:35:08.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 -- 172.21.15.64:0/2071353710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e84005350 msgr2=0x7f9e8400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 --2- 172.21.15.64:0/2071353710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e84005350 0x7f9e8400b9d0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0071150 tx=0x7f9e9801f550 comp rx=0 tx=0).stop 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 -- 172.21.15.64:0/2071353710 shutdown_connections 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 --2- 172.21.15.64:0/2071353710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e84005350 0x7f9e8400b9d0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 -- 172.21.15.64:0/2071353710 >> 172.21.15.64:0/2071353710 conn(0x7f9ea00ccbe0 msgr2=0x7f9ea00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 -- 172.21.15.64:0/2071353710 shutdown_connections 2024-09-21T07:35:08.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 -- 172.21.15.64:0/2071353710 wait complete. 2024-09-21T07:35:08.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.505+0000 7f9ea7200640 1 Processor -- start 2024-09-21T07:35:08.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- start start 2024-09-21T07:35:08.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 0x7f9ea009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 0x7f9ea00c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0070440 con 0x7f9ea00b2650 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea00702c0 con 0x7f9ea00c91e0 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea00c5390 con 0x7f9e84005350 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39908/0 (socket says 172.21.15.64:39908) 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 -- 172.21.15.64:0/1816670039 learned_addr learned my addr 172.21.15.64:0/1816670039 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea5200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 0x7f9ea00c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e9fe00640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 0x7f9ea009c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 -- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 msgr2=0x7f9ea009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 0x7f9ea009c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 -- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 msgr2=0x7f9ea00c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 0x7f9ea00c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 -- 172.21.15.64:0/1816670039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01f5840 con 0x7f9ea00b2650 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e9fe00640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 0x7f9ea009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea5200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 0x7f9ea00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e97400640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006340 tx=0x7f9e88006800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88015070 con 0x7f9ea00b2650 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e8800fd60 con 0x7f9ea00b2650 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea01f5b20 con 0x7f9ea00b2650 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011690 con 0x7f9ea00b2650 2024-09-21T07:35:08.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea01f60e0 con 0x7f9ea00b2650 2024-09-21T07:35:08.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.509+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea0073200 con 0x7f9ea00b2650 2024-09-21T07:35:08.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.513+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e88011830 con 0x7f9ea00b2650 2024-09-21T07:35:08.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.513+0000 7f9e9cc00640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 0x7f9e7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.513+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f9e88095430 con 0x7f9ea00b2650 2024-09-21T07:35:08.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.513+0000 7f9e9fe00640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 0x7f9e7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.513+0000 7f9e9fe00640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 0x7f9e7c075710 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009470 tx=0x7f9e900091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.517+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9e88060220 con 0x7f9ea00b2650 2024-09-21T07:35:08.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.757+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9ea009dfd0 con 0x7f9ea00b2650 2024-09-21T07:35:08.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.757+0000 7f9e9cc00640 1 -- 172.21.15.64:0/1816670039 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1082 (secure 0 0 0) 0x7f9e8805fb20 con 0x7f9ea00b2650 2024-09-21T07:35:08.761 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:08.761 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":766,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":178,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":52},{"state_name":"creating+peering","count":45}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":484679680,"bytes_avail":772609433600,"bytes_total":773094113280,"inactive_pgs_ratio":0.46391752362251282},"fsmap":{"epoch":133,"btime":"2024-09-21T07:35:06:274222+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":10068}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-21T07:34:51.621102+0000","services":{}},"progress_events":{}} 2024-09-21T07:35:08.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 msgr2=0x7f9e7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 0x7f9e7c075710 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009470 tx=0x7f9e900091e0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 msgr2=0x7f9ea009c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006340 tx=0x7f9e88006800 comp rx=0 tx=0).stop 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 shutdown_connections 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e7c073200 0x7f9e7c075710 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00c91e0 0x7f9ea00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ea00b2650 0x7f9ea009c570 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 --2- 172.21.15.64:0/1816670039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e84005350 0x7f9ea009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 >> 172.21.15.64:0/1816670039 conn(0x7f9ea00ccbe0 msgr2=0x7f9ea00cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 shutdown_connections 2024-09-21T07:35:08.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.761+0000 7f9ea7200640 1 -- 172.21.15.64:0/1816670039 wait complete. 2024-09-21T07:35:08.784 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:35:08.784 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 -- 172.21.15.64:0/224160196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604074aa0 msgr2=0x7f8604160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 --2- 172.21.15.64:0/224160196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604074aa0 0x7f8604160660 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f86040720a0 tx=0x7f85ec01c830 comp rx=0 tx=0).stop 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 -- 172.21.15.64:0/224160196 shutdown_connections 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 --2- 172.21.15.64:0/224160196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604074aa0 0x7f8604160660 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 --2- 172.21.15.64:0/224160196 >> v2:172.21.15.90:3300/0 conn(0x7f86040b1b10 0x7f8604074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 -- 172.21.15.64:0/224160196 >> 172.21.15.64:0/224160196 conn(0x7f86040b2020 msgr2=0x7f86040b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 -- 172.21.15.64:0/224160196 shutdown_connections 2024-09-21T07:35:08.943 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.941+0000 7f8609e00640 1 -- 172.21.15.64:0/224160196 wait complete. 2024-09-21T07:35:08.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 Processor -- start 2024-09-21T07:35:08.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- start start 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 0x7f86040c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040b1b10 0x7f8604156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86040b4fe0 con 0x7f8604160ba0 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f86040b5160 con 0x7f86040b1b10 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f86040b52e0 con 0x7f8604074aa0 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39922/0 (socket says 172.21.15.64:39922) 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 -- 172.21.15.64:0/3935574198 learned_addr learned my addr 172.21.15.64:0/3935574198 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f85fbe00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040b1b10 0x7f8604156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8602a00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 0x7f86040c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 -- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 msgr2=0x7f86040c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 0x7f86040c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 -- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040b1b10 msgr2=0x7f8604156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040b1b10 0x7f8604156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 -- 172.21.15.64:0/3935574198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8604157dc0 con 0x7f8604160ba0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8602a00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 0x7f86040c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8603400640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00c760 tx=0x7f85fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc003db0 con 0x7f8604160ba0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85fc00ce10 con 0x7f8604160ba0 2024-09-21T07:35:08.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0052d0 con 0x7f8604160ba0 2024-09-21T07:35:08.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86041575f0 con 0x7f8604160ba0 2024-09-21T07:35:08.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.945+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86040c8370 con 0x7f8604160ba0 2024-09-21T07:35:08.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8604160660 con 0x7f8604160ba0 2024-09-21T07:35:08.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85fc005470 con 0x7f8604160ba0 2024-09-21T07:35:08.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f85fb400640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 0x7f85e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:08.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f85fc094270 con 0x7f8604160ba0 2024-09-21T07:35:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f8602a00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 0x7f85e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:08.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.949+0000 7f8602a00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 0x7f85e0075710 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f85f400bbc0 tx=0x7f85f4005ef0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:08.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:08.953+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8604074eb0 con 0x7f8604160ba0 2024-09-21T07:35:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.129+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86041580f0 con 0x7f85e0073200 2024-09-21T07:35:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.133+0000 7f85fb400640 1 -- 172.21.15.64:0/3935574198 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248687 (secure 0 0 0) 0x7f86041580f0 con 0x7f85e0073200 2024-09-21T07:35:09.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:09.138 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:35:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 msgr2=0x7f85e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 0x7f85e0075710 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f85f400bbc0 tx=0x7f85f4005ef0 comp rx=0 tx=0).stop 2024-09-21T07:35:09.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 msgr2=0x7f86040c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00c760 tx=0x7f85fc00cc20 comp rx=0 tx=0).stop 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 shutdown_connections 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f85e0073200 0x7f85e0075710 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8604160ba0 0x7f86040c9b50 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86040b1b10 0x7f8604156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 --2- 172.21.15.64:0/3935574198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8604074aa0 0x7f86040c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 >> 172.21.15.64:0/3935574198 conn(0x7f86040b2020 msgr2=0x7f86040ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 shutdown_connections 2024-09-21T07:35:09.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:09.137+0000 7f8609e00640 1 -- 172.21.15.64:0/3935574198 wait complete. 2024-09-21T07:35:09.158 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2024-09-21T07:35:07.624984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":473320,"kb_used_data":18428,"kb_used_omap":12,"kb_used_meta":454707,"kb_avail":754501400,"statfs":{"total":773094113280,"available":772609433600,"internally_reserved":0,"allocated":18870272,"data_stored":9516013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":465620531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001456"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240634+0000","last_change":"2024-09-21T07:35:02.240634+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240634+0000","last_undegraded":"2024-09-21T07:35:02.240634+0000","last_fullsized":"2024-09-21T07:35:02.240634+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239707+0000","last_change":"2024-09-21T07:35:02.239707+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239707+0000","last_undegraded":"2024-09-21T07:35:02.239707+0000","last_fullsized":"2024-09-21T07:35:02.239707+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243453+0000","last_change":"2024-09-21T07:35:02.243453+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243453+0000","last_undegraded":"2024-09-21T07:35:02.243453+0000","last_fullsized":"2024-09-21T07:35:02.243453+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.247783+0000","last_change":"2024-09-21T07:35:02.247783+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.247783+0000","last_undegraded":"2024-09-21T07:35:02.247783+0000","last_fullsized":"2024-09-21T07:35:02.247783+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250829+0000","last_change":"2024-09-21T07:35:03.260600+0000","last_active":"2024-09-21T07:35:04.250829+0000","last_peered":"2024-09-21T07:35:04.250829+0000","last_clean":"2024-09-21T07:35:04.250829+0000","last_became_active":"2024-09-21T07:35:03.260309+0000","last_became_peered":"2024-09-21T07:35:03.260309+0000","last_unstale":"2024-09-21T07:35:04.250829+0000","last_undegraded":"2024-09-21T07:35:04.250829+0000","last_fullsized":"2024-09-21T07:35:04.250829+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:04.784721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249856+0000","last_change":"2024-09-21T07:35:03.259023+0000","last_active":"2024-09-21T07:35:04.249856+0000","last_peered":"2024-09-21T07:35:04.249856+0000","last_clean":"2024-09-21T07:35:04.249856+0000","last_became_active":"2024-09-21T07:35:03.258721+0000","last_became_peered":"2024-09-21T07:35:03.258721+0000","last_unstale":"2024-09-21T07:35:04.249856+0000","last_undegraded":"2024-09-21T07:35:04.249856+0000","last_fullsized":"2024-09-21T07:35:04.249856+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:57.399605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234135+0000","last_change":"2024-09-21T07:35:02.234135+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234135+0000","last_undegraded":"2024-09-21T07:35:02.234135+0000","last_fullsized":"2024-09-21T07:35:02.234135+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078662+0000","last_change":"2024-09-21T07:35:03.267609+0000","last_active":"2024-09-21T07:35:05.078662+0000","last_peered":"2024-09-21T07:35:05.078662+0000","last_clean":"2024-09-21T07:35:05.078662+0000","last_became_active":"2024-09-21T07:35:03.267316+0000","last_became_peered":"2024-09-21T07:35:03.267316+0000","last_unstale":"2024-09-21T07:35:05.078662+0000","last_undegraded":"2024-09-21T07:35:05.078662+0000","last_fullsized":"2024-09-21T07:35:05.078662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:55.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239262+0000","last_change":"2024-09-21T07:35:02.239262+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239262+0000","last_undegraded":"2024-09-21T07:35:02.239262+0000","last_fullsized":"2024-09-21T07:35:02.239262+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252882+0000","last_change":"2024-09-21T07:35:03.260726+0000","last_active":"2024-09-21T07:35:04.252882+0000","last_peered":"2024-09-21T07:35:04.252882+0000","last_clean":"2024-09-21T07:35:04.252882+0000","last_became_active":"2024-09-21T07:35:03.256428+0000","last_became_peered":"2024-09-21T07:35:03.256428+0000","last_unstale":"2024-09-21T07:35:04.252882+0000","last_undegraded":"2024-09-21T07:35:04.252882+0000","last_fullsized":"2024-09-21T07:35:04.252882+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237648+0000","last_change":"2024-09-21T07:35:02.237648+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237648+0000","last_undegraded":"2024-09-21T07:35:02.237648+0000","last_fullsized":"2024-09-21T07:35:02.237648+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.245751+0000","last_change":"2024-09-21T07:35:02.245751+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.245751+0000","last_undegraded":"2024-09-21T07:35:02.245751+0000","last_fullsized":"2024-09-21T07:35:02.245751+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239916+0000","last_change":"2024-09-21T07:35:02.239916+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239916+0000","last_undegraded":"2024-09-21T07:35:02.239916+0000","last_fullsized":"2024-09-21T07:35:02.239916+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232742+0000","last_change":"2024-09-21T07:35:02.232742+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232742+0000","last_undegraded":"2024-09-21T07:35:02.232742+0000","last_fullsized":"2024-09-21T07:35:02.232742+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239815+0000","last_change":"2024-09-21T07:35:02.239815+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239815+0000","last_undegraded":"2024-09-21T07:35:02.239815+0000","last_fullsized":"2024-09-21T07:35:02.239815+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249682+0000","last_change":"2024-09-21T07:35:03.254637+0000","last_active":"2024-09-21T07:35:04.249682+0000","last_peered":"2024-09-21T07:35:04.249682+0000","last_clean":"2024-09-21T07:35:04.249682+0000","last_became_active":"2024-09-21T07:35:03.254227+0000","last_became_peered":"2024-09-21T07:35:03.254227+0000","last_unstale":"2024-09-21T07:35:04.249682+0000","last_undegraded":"2024-09-21T07:35:04.249682+0000","last_fullsized":"2024-09-21T07:35:04.249682+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.940090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251731+0000","last_change":"2024-09-21T07:35:03.270378+0000","last_active":"2024-09-21T07:35:04.251731+0000","last_peered":"2024-09-21T07:35:04.251731+0000","last_clean":"2024-09-21T07:35:04.251731+0000","last_became_active":"2024-09-21T07:35:03.269427+0000","last_became_peered":"2024-09-21T07:35:03.269427+0000","last_unstale":"2024-09-21T07:35:04.251731+0000","last_undegraded":"2024-09-21T07:35:04.251731+0000","last_fullsized":"2024-09-21T07:35:04.251731+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:52.605389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241032+0000","last_change":"2024-09-21T07:35:02.241032+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241032+0000","last_undegraded":"2024-09-21T07:35:02.241032+0000","last_fullsized":"2024-09-21T07:35:02.241032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238290+0000","last_change":"2024-09-21T07:35:02.238290+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238290+0000","last_undegraded":"2024-09-21T07:35:02.238290+0000","last_fullsized":"2024-09-21T07:35:02.238290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250361+0000","last_change":"2024-09-21T07:35:03.261822+0000","last_active":"2024-09-21T07:35:04.250361+0000","last_peered":"2024-09-21T07:35:04.250361+0000","last_clean":"2024-09-21T07:35:04.250361+0000","last_became_active":"2024-09-21T07:35:03.261533+0000","last_became_peered":"2024-09-21T07:35:03.261533+0000","last_unstale":"2024-09-21T07:35:04.250361+0000","last_undegraded":"2024-09-21T07:35:04.250361+0000","last_fullsized":"2024-09-21T07:35:04.250361+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.404434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238804+0000","last_change":"2024-09-21T07:35:02.238804+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238804+0000","last_undegraded":"2024-09-21T07:35:02.238804+0000","last_fullsized":"2024-09-21T07:35:02.238804+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244198+0000","last_change":"2024-09-21T07:35:02.244198+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244198+0000","last_undegraded":"2024-09-21T07:35:02.244198+0000","last_fullsized":"2024-09-21T07:35:02.244198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078605+0000","last_change":"2024-09-21T07:35:03.277225+0000","last_active":"2024-09-21T07:35:05.078605+0000","last_peered":"2024-09-21T07:35:05.078605+0000","last_clean":"2024-09-21T07:35:05.078605+0000","last_became_active":"2024-09-21T07:35:03.276612+0000","last_became_peered":"2024-09-21T07:35:03.276612+0000","last_unstale":"2024-09-21T07:35:05.078605+0000","last_undegraded":"2024-09-21T07:35:05.078605+0000","last_fullsized":"2024-09-21T07:35:05.078605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:08.098778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240376+0000","last_change":"2024-09-21T07:35:02.240376+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240376+0000","last_undegraded":"2024-09-21T07:35:02.240376+0000","last_fullsized":"2024-09-21T07:35:02.240376+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235734+0000","last_change":"2024-09-21T07:35:02.235734+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235734+0000","last_undegraded":"2024-09-21T07:35:02.235734+0000","last_fullsized":"2024-09-21T07:35:02.235734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238877+0000","last_change":"2024-09-21T07:35:02.238877+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238877+0000","last_undegraded":"2024-09-21T07:35:02.238877+0000","last_fullsized":"2024-09-21T07:35:02.238877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079386+0000","last_change":"2024-09-21T07:35:03.267424+0000","last_active":"2024-09-21T07:35:05.079386+0000","last_peered":"2024-09-21T07:35:05.079386+0000","last_clean":"2024-09-21T07:35:05.079386+0000","last_became_active":"2024-09-21T07:35:03.266994+0000","last_became_peered":"2024-09-21T07:35:03.266994+0000","last_unstale":"2024-09-21T07:35:05.079386+0000","last_undegraded":"2024-09-21T07:35:05.079386+0000","last_fullsized":"2024-09-21T07:35:05.079386+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:48.006626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250585+0000","last_change":"2024-09-21T07:35:03.254332+0000","last_active":"2024-09-21T07:35:04.250585+0000","last_peered":"2024-09-21T07:35:04.250585+0000","last_clean":"2024-09-21T07:35:04.250585+0000","last_became_active":"2024-09-21T07:35:03.254005+0000","last_became_peered":"2024-09-21T07:35:03.254005+0000","last_unstale":"2024-09-21T07:35:04.250585+0000","last_undegraded":"2024-09-21T07:35:04.250585+0000","last_fullsized":"2024-09-21T07:35:04.250585+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:08.989540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237637+0000","last_change":"2024-09-21T07:35:02.237637+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237637+0000","last_undegraded":"2024-09-21T07:35:02.237637+0000","last_fullsized":"2024-09-21T07:35:02.237637+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235914+0000","last_change":"2024-09-21T07:35:02.235914+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235914+0000","last_undegraded":"2024-09-21T07:35:02.235914+0000","last_fullsized":"2024-09-21T07:35:02.235914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233660+0000","last_change":"2024-09-21T07:35:02.233660+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233660+0000","last_undegraded":"2024-09-21T07:35:02.233660+0000","last_fullsized":"2024-09-21T07:35:02.233660+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249694+0000","last_change":"2024-09-21T07:35:03.261409+0000","last_active":"2024-09-21T07:35:04.249694+0000","last_peered":"2024-09-21T07:35:04.249694+0000","last_clean":"2024-09-21T07:35:04.249694+0000","last_became_active":"2024-09-21T07:35:03.261076+0000","last_became_peered":"2024-09-21T07:35:03.261076+0000","last_unstale":"2024-09-21T07:35:04.249694+0000","last_undegraded":"2024-09-21T07:35:04.249694+0000","last_fullsized":"2024-09-21T07:35:04.249694+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:55.778957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079516+0000","last_change":"2024-09-21T07:35:03.270094+0000","last_active":"2024-09-21T07:35:05.079516+0000","last_peered":"2024-09-21T07:35:05.079516+0000","last_clean":"2024-09-21T07:35:05.079516+0000","last_became_active":"2024-09-21T07:35:03.269758+0000","last_became_peered":"2024-09-21T07:35:03.269758+0000","last_unstale":"2024-09-21T07:35:05.079516+0000","last_undegraded":"2024-09-21T07:35:05.079516+0000","last_fullsized":"2024-09-21T07:35:05.079516+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.138794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261396+0000","last_change":"2024-09-21T07:35:02.258592+0000","last_active":"2024-09-21T07:35:02.261396+0000","last_peered":"2024-09-21T07:35:02.261396+0000","last_clean":"2024-09-21T07:35:02.261396+0000","last_became_active":"2024-09-21T07:35:02.258264+0000","last_became_peered":"2024-09-21T07:35:02.258264+0000","last_unstale":"2024-09-21T07:35:02.261396+0000","last_undegraded":"2024-09-21T07:35:02.261396+0000","last_fullsized":"2024-09-21T07:35:02.261396+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:09.521183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234610+0000","last_change":"2024-09-21T07:35:02.234610+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234610+0000","last_undegraded":"2024-09-21T07:35:02.234610+0000","last_fullsized":"2024-09-21T07:35:02.234610+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.253042+0000","last_change":"2024-09-21T07:35:02.252098+0000","last_active":"2024-09-21T07:35:04.253042+0000","last_peered":"2024-09-21T07:35:04.253042+0000","last_clean":"2024-09-21T07:35:04.253042+0000","last_became_active":"2024-09-21T07:35:02.249744+0000","last_became_peered":"2024-09-21T07:35:02.249744+0000","last_unstale":"2024-09-21T07:35:04.253042+0000","last_undegraded":"2024-09-21T07:35:04.253042+0000","last_fullsized":"2024-09-21T07:35:04.253042+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.362809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238071+0000","last_change":"2024-09-21T07:35:02.238071+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238071+0000","last_undegraded":"2024-09-21T07:35:02.238071+0000","last_fullsized":"2024-09-21T07:35:02.238071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.251107+0000","last_change":"2024-09-21T07:35:02.249622+0000","last_active":"2024-09-21T07:35:02.251107+0000","last_peered":"2024-09-21T07:35:02.251107+0000","last_clean":"2024-09-21T07:35:02.251107+0000","last_became_active":"2024-09-21T07:35:02.249278+0000","last_became_peered":"2024-09-21T07:35:02.249278+0000","last_unstale":"2024-09-21T07:35:02.251107+0000","last_undegraded":"2024-09-21T07:35:02.251107+0000","last_fullsized":"2024-09-21T07:35:02.251107+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:50.071551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.242278+0000","last_change":"2024-09-21T07:35:02.242278+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.242278+0000","last_undegraded":"2024-09-21T07:35:02.242278+0000","last_fullsized":"2024-09-21T07:35:02.242278+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.245953+0000","last_change":"2024-09-21T07:35:02.244307+0000","last_active":"2024-09-21T07:35:02.245953+0000","last_peered":"2024-09-21T07:35:02.245953+0000","last_clean":"2024-09-21T07:35:02.245953+0000","last_became_active":"2024-09-21T07:35:02.243923+0000","last_became_peered":"2024-09-21T07:35:02.243923+0000","last_unstale":"2024-09-21T07:35:02.245953+0000","last_undegraded":"2024-09-21T07:35:02.245953+0000","last_fullsized":"2024-09-21T07:35:02.245953+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:51.627210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235902+0000","last_change":"2024-09-21T07:35:02.235902+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235902+0000","last_undegraded":"2024-09-21T07:35:02.235902+0000","last_fullsized":"2024-09-21T07:35:02.235902+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250126+0000","last_change":"2024-09-21T07:35:02.253834+0000","last_active":"2024-09-21T07:35:04.250126+0000","last_peered":"2024-09-21T07:35:04.250126+0000","last_clean":"2024-09-21T07:35:04.250126+0000","last_became_active":"2024-09-21T07:35:02.252826+0000","last_became_peered":"2024-09-21T07:35:02.252826+0000","last_unstale":"2024-09-21T07:35:04.250126+0000","last_undegraded":"2024-09-21T07:35:04.250126+0000","last_fullsized":"2024-09-21T07:35:04.250126+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:39.103263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237912+0000","last_change":"2024-09-21T07:35:02.237912+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237912+0000","last_undegraded":"2024-09-21T07:35:02.237912+0000","last_fullsized":"2024-09-21T07:35:02.237912+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262455+0000","last_change":"2024-09-21T07:35:02.261499+0000","last_active":"2024-09-21T07:35:02.262455+0000","last_peered":"2024-09-21T07:35:02.262455+0000","last_clean":"2024-09-21T07:35:02.262455+0000","last_became_active":"2024-09-21T07:35:02.261161+0000","last_became_peered":"2024-09-21T07:35:02.261161+0000","last_unstale":"2024-09-21T07:35:02.262455+0000","last_undegraded":"2024-09-21T07:35:02.262455+0000","last_fullsized":"2024-09-21T07:35:02.262455+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:36.330951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239267+0000","last_change":"2024-09-21T07:35:02.239267+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239267+0000","last_undegraded":"2024-09-21T07:35:02.239267+0000","last_fullsized":"2024-09-21T07:35:02.239267+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252571+0000","last_change":"2024-09-21T07:35:02.248579+0000","last_active":"2024-09-21T07:35:02.252571+0000","last_peered":"2024-09-21T07:35:02.252571+0000","last_clean":"2024-09-21T07:35:02.252571+0000","last_became_active":"2024-09-21T07:35:02.248203+0000","last_became_peered":"2024-09-21T07:35:02.248203+0000","last_unstale":"2024-09-21T07:35:02.252571+0000","last_undegraded":"2024-09-21T07:35:02.252571+0000","last_fullsized":"2024-09-21T07:35:02.252571+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:29.233618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079418+0000","last_change":"2024-09-21T07:35:03.270828+0000","last_active":"2024-09-21T07:35:05.079418+0000","last_peered":"2024-09-21T07:35:05.079418+0000","last_clean":"2024-09-21T07:35:05.079418+0000","last_became_active":"2024-09-21T07:35:03.270525+0000","last_became_peered":"2024-09-21T07:35:03.270525+0000","last_unstale":"2024-09-21T07:35:05.079418+0000","last_undegraded":"2024-09-21T07:35:05.079418+0000","last_fullsized":"2024-09-21T07:35:05.079418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:35.198735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251909+0000","last_change":"2024-09-21T07:35:02.257632+0000","last_active":"2024-09-21T07:35:04.251909+0000","last_peered":"2024-09-21T07:35:04.251909+0000","last_clean":"2024-09-21T07:35:04.251909+0000","last_became_active":"2024-09-21T07:35:02.256235+0000","last_became_peered":"2024-09-21T07:35:02.256235+0000","last_unstale":"2024-09-21T07:35:04.251909+0000","last_undegraded":"2024-09-21T07:35:04.251909+0000","last_fullsized":"2024-09-21T07:35:04.251909+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:41.865068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251199+0000","last_change":"2024-09-21T07:35:03.258728+0000","last_active":"2024-09-21T07:35:04.251199+0000","last_peered":"2024-09-21T07:35:04.251199+0000","last_clean":"2024-09-21T07:35:04.251199+0000","last_became_active":"2024-09-21T07:35:03.258061+0000","last_became_peered":"2024-09-21T07:35:03.258061+0000","last_unstale":"2024-09-21T07:35:04.251199+0000","last_undegraded":"2024-09-21T07:35:04.251199+0000","last_fullsized":"2024-09-21T07:35:04.251199+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:47.404474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.248899+0000","last_change":"2024-09-21T07:35:02.247431+0000","last_active":"2024-09-21T07:35:02.248899+0000","last_peered":"2024-09-21T07:35:02.248899+0000","last_clean":"2024-09-21T07:35:02.248899+0000","last_became_active":"2024-09-21T07:35:02.247100+0000","last_became_peered":"2024-09-21T07:35:02.247100+0000","last_unstale":"2024-09-21T07:35:02.248899+0000","last_undegraded":"2024-09-21T07:35:02.248899+0000","last_fullsized":"2024-09-21T07:35:02.248899+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:40.087806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.240470+0000","last_change":"2024-09-21T07:35:02.240470+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.240470+0000","last_undegraded":"2024-09-21T07:35:02.240470+0000","last_fullsized":"2024-09-21T07:35:02.240470+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.262625+0000","last_change":"2024-09-21T07:35:02.261614+0000","last_active":"2024-09-21T07:35:02.262625+0000","last_peered":"2024-09-21T07:35:02.262625+0000","last_clean":"2024-09-21T07:35:02.262625+0000","last_became_active":"2024-09-21T07:35:02.261277+0000","last_became_peered":"2024-09-21T07:35:02.261277+0000","last_unstale":"2024-09-21T07:35:02.262625+0000","last_undegraded":"2024-09-21T07:35:02.262625+0000","last_fullsized":"2024-09-21T07:35:02.262625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:19.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.238435+0000","last_change":"2024-09-21T07:35:02.238435+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.238435+0000","last_undegraded":"2024-09-21T07:35:02.238435+0000","last_fullsized":"2024-09-21T07:35:02.238435+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.256190+0000","last_change":"2024-09-21T07:35:02.255104+0000","last_active":"2024-09-21T07:35:02.256190+0000","last_peered":"2024-09-21T07:35:02.256190+0000","last_clean":"2024-09-21T07:35:02.256190+0000","last_became_active":"2024-09-21T07:35:02.254632+0000","last_became_peered":"2024-09-21T07:35:02.254632+0000","last_unstale":"2024-09-21T07:35:02.256190+0000","last_undegraded":"2024-09-21T07:35:02.256190+0000","last_fullsized":"2024-09-21T07:35:02.256190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:03.429390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.232471+0000","last_change":"2024-09-21T07:35:02.232471+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.232471+0000","last_undegraded":"2024-09-21T07:35:02.232471+0000","last_fullsized":"2024-09-21T07:35:02.232471+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260979+0000","last_change":"2024-09-21T07:35:02.260184+0000","last_active":"2024-09-21T07:35:02.260979+0000","last_peered":"2024-09-21T07:35:02.260979+0000","last_clean":"2024-09-21T07:35:02.260979+0000","last_became_active":"2024-09-21T07:35:02.259823+0000","last_became_peered":"2024-09-21T07:35:02.259823+0000","last_unstale":"2024-09-21T07:35:02.260979+0000","last_undegraded":"2024-09-21T07:35:02.260979+0000","last_fullsized":"2024-09-21T07:35:02.260979+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:19.342886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249632+0000","last_change":"2024-09-21T07:35:03.255093+0000","last_active":"2024-09-21T07:35:04.249632+0000","last_peered":"2024-09-21T07:35:04.249632+0000","last_clean":"2024-09-21T07:35:04.249632+0000","last_became_active":"2024-09-21T07:35:03.254830+0000","last_became_peered":"2024-09-21T07:35:03.254830+0000","last_unstale":"2024-09-21T07:35:04.249632+0000","last_undegraded":"2024-09-21T07:35:04.249632+0000","last_fullsized":"2024-09-21T07:35:04.249632+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:09.529360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259295+0000","last_change":"2024-09-21T07:35:02.256316+0000","last_active":"2024-09-21T07:35:02.259295+0000","last_peered":"2024-09-21T07:35:02.259295+0000","last_clean":"2024-09-21T07:35:02.259295+0000","last_became_active":"2024-09-21T07:35:02.255641+0000","last_became_peered":"2024-09-21T07:35:02.255641+0000","last_unstale":"2024-09-21T07:35:02.259295+0000","last_undegraded":"2024-09-21T07:35:02.259295+0000","last_fullsized":"2024-09-21T07:35:02.259295+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:43.643912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236989+0000","last_change":"2024-09-21T07:35:02.236989+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236989+0000","last_undegraded":"2024-09-21T07:35:02.236989+0000","last_fullsized":"2024-09-21T07:35:02.236989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255721+0000","last_change":"2024-09-21T07:35:02.251182+0000","last_active":"2024-09-21T07:35:02.255721+0000","last_peered":"2024-09-21T07:35:02.255721+0000","last_clean":"2024-09-21T07:35:02.255721+0000","last_became_active":"2024-09-21T07:35:02.250879+0000","last_became_peered":"2024-09-21T07:35:02.250879+0000","last_unstale":"2024-09-21T07:35:02.255721+0000","last_undegraded":"2024-09-21T07:35:02.255721+0000","last_fullsized":"2024-09-21T07:35:02.255721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:59.006953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.239439+0000","last_change":"2024-09-21T07:35:02.239439+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.239439+0000","last_undegraded":"2024-09-21T07:35:02.239439+0000","last_fullsized":"2024-09-21T07:35:02.239439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.249536+0000","last_change":"2024-09-21T07:35:02.246826+0000","last_active":"2024-09-21T07:35:02.249536+0000","last_peered":"2024-09-21T07:35:02.249536+0000","last_clean":"2024-09-21T07:35:02.249536+0000","last_became_active":"2024-09-21T07:35:02.246426+0000","last_became_peered":"2024-09-21T07:35:02.246426+0000","last_unstale":"2024-09-21T07:35:02.249536+0000","last_undegraded":"2024-09-21T07:35:02.249536+0000","last_fullsized":"2024-09-21T07:35:02.249536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:15.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235286+0000","last_change":"2024-09-21T07:35:02.235286+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235286+0000","last_undegraded":"2024-09-21T07:35:02.235286+0000","last_fullsized":"2024-09-21T07:35:02.235286+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.259020+0000","last_change":"2024-09-21T07:35:02.256374+0000","last_active":"2024-09-21T07:35:02.259020+0000","last_peered":"2024-09-21T07:35:02.259020+0000","last_clean":"2024-09-21T07:35:02.259020+0000","last_became_active":"2024-09-21T07:35:02.255795+0000","last_became_peered":"2024-09-21T07:35:02.255795+0000","last_unstale":"2024-09-21T07:35:02.259020+0000","last_undegraded":"2024-09-21T07:35:02.259020+0000","last_fullsized":"2024-09-21T07:35:02.259020+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:29.735597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251189+0000","last_change":"2024-09-21T07:35:03.259092+0000","last_active":"2024-09-21T07:35:04.251189+0000","last_peered":"2024-09-21T07:35:04.251189+0000","last_clean":"2024-09-21T07:35:04.251189+0000","last_became_active":"2024-09-21T07:35:03.256278+0000","last_became_peered":"2024-09-21T07:35:03.256278+0000","last_unstale":"2024-09-21T07:35:04.251189+0000","last_undegraded":"2024-09-21T07:35:04.251189+0000","last_fullsized":"2024-09-21T07:35:04.251189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.004230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261134+0000","last_change":"2024-09-21T07:35:02.257673+0000","last_active":"2024-09-21T07:35:02.261134+0000","last_peered":"2024-09-21T07:35:02.261134+0000","last_clean":"2024-09-21T07:35:02.261134+0000","last_became_active":"2024-09-21T07:35:02.256474+0000","last_became_peered":"2024-09-21T07:35:02.256474+0000","last_unstale":"2024-09-21T07:35:02.261134+0000","last_undegraded":"2024-09-21T07:35:02.261134+0000","last_fullsized":"2024-09-21T07:35:02.261134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:52.614926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237509+0000","last_change":"2024-09-21T07:35:02.237509+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237509+0000","last_undegraded":"2024-09-21T07:35:02.237509+0000","last_fullsized":"2024-09-21T07:35:02.237509+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258876+0000","last_change":"2024-09-21T07:35:02.257206+0000","last_active":"2024-09-21T07:35:02.258876+0000","last_peered":"2024-09-21T07:35:02.258876+0000","last_clean":"2024-09-21T07:35:02.258876+0000","last_became_active":"2024-09-21T07:35:02.256889+0000","last_became_peered":"2024-09-21T07:35:02.256889+0000","last_unstale":"2024-09-21T07:35:02.258876+0000","last_undegraded":"2024-09-21T07:35:02.258876+0000","last_fullsized":"2024-09-21T07:35:02.258876+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:12.902316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.236526+0000","last_change":"2024-09-21T07:35:02.236526+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.236526+0000","last_undegraded":"2024-09-21T07:35:02.236526+0000","last_fullsized":"2024-09-21T07:35:02.236526+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.252163+0000","last_change":"2024-09-21T07:35:02.250284+0000","last_active":"2024-09-21T07:35:02.252163+0000","last_peered":"2024-09-21T07:35:02.252163+0000","last_clean":"2024-09-21T07:35:02.252163+0000","last_became_active":"2024-09-21T07:35:02.246160+0000","last_became_peered":"2024-09-21T07:35:02.246160+0000","last_unstale":"2024-09-21T07:35:02.252163+0000","last_undegraded":"2024-09-21T07:35:02.252163+0000","last_fullsized":"2024-09-21T07:35:02.252163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:13.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237046+0000","last_change":"2024-09-21T07:35:02.237046+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237046+0000","last_undegraded":"2024-09-21T07:35:02.237046+0000","last_fullsized":"2024-09-21T07:35:02.237046+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261239+0000","last_change":"2024-09-21T07:35:02.260372+0000","last_active":"2024-09-21T07:35:02.261239+0000","last_peered":"2024-09-21T07:35:02.261239+0000","last_clean":"2024-09-21T07:35:02.261239+0000","last_became_active":"2024-09-21T07:35:02.260081+0000","last_became_peered":"2024-09-21T07:35:02.260081+0000","last_unstale":"2024-09-21T07:35:02.261239+0000","last_undegraded":"2024-09-21T07:35:02.261239+0000","last_fullsized":"2024-09-21T07:35:02.261239+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:50.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241741+0000","last_change":"2024-09-21T07:35:02.241741+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241741+0000","last_undegraded":"2024-09-21T07:35:02.241741+0000","last_fullsized":"2024-09-21T07:35:02.241741+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.261095+0000","last_change":"2024-09-21T07:35:02.258379+0000","last_active":"2024-09-21T07:35:02.261095+0000","last_peered":"2024-09-21T07:35:02.261095+0000","last_clean":"2024-09-21T07:35:02.261095+0000","last_became_active":"2024-09-21T07:35:02.258050+0000","last_became_peered":"2024-09-21T07:35:02.258050+0000","last_unstale":"2024-09-21T07:35:02.261095+0000","last_undegraded":"2024-09-21T07:35:02.261095+0000","last_fullsized":"2024-09-21T07:35:02.261095+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:50.176822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.243017+0000","last_change":"2024-09-21T07:35:02.243017+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.243017+0000","last_undegraded":"2024-09-21T07:35:02.243017+0000","last_fullsized":"2024-09-21T07:35:02.243017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.255202+0000","last_change":"2024-09-21T07:35:02.247540+0000","last_active":"2024-09-21T07:35:02.255202+0000","last_peered":"2024-09-21T07:35:02.255202+0000","last_clean":"2024-09-21T07:35:02.255202+0000","last_became_active":"2024-09-21T07:35:02.246243+0000","last_became_peered":"2024-09-21T07:35:02.246243+0000","last_unstale":"2024-09-21T07:35:02.255202+0000","last_undegraded":"2024-09-21T07:35:02.255202+0000","last_fullsized":"2024-09-21T07:35:02.255202+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:53.157560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250000+0000","last_change":"2024-09-21T07:35:03.273184+0000","last_active":"2024-09-21T07:35:04.250000+0000","last_peered":"2024-09-21T07:35:04.250000+0000","last_clean":"2024-09-21T07:35:04.250000+0000","last_became_active":"2024-09-21T07:35:03.272844+0000","last_became_peered":"2024-09-21T07:35:03.272844+0000","last_unstale":"2024-09-21T07:35:04.250000+0000","last_undegraded":"2024-09-21T07:35:04.250000+0000","last_fullsized":"2024-09-21T07:35:04.250000+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:20.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.253606+0000","last_change":"2024-09-21T07:35:02.252337+0000","last_active":"2024-09-21T07:35:02.253606+0000","last_peered":"2024-09-21T07:35:02.253606+0000","last_clean":"2024-09-21T07:35:02.253606+0000","last_became_active":"2024-09-21T07:35:02.250853+0000","last_became_peered":"2024-09-21T07:35:02.250853+0000","last_unstale":"2024-09-21T07:35:02.253606+0000","last_undegraded":"2024-09-21T07:35:02.253606+0000","last_fullsized":"2024-09-21T07:35:02.253606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:55.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.233421+0000","last_change":"2024-09-21T07:35:02.233421+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.233421+0000","last_undegraded":"2024-09-21T07:35:02.233421+0000","last_fullsized":"2024-09-21T07:35:02.233421+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.257226+0000","last_change":"2024-09-21T07:35:02.254083+0000","last_active":"2024-09-21T07:35:02.257226+0000","last_peered":"2024-09-21T07:35:02.257226+0000","last_clean":"2024-09-21T07:35:02.257226+0000","last_became_active":"2024-09-21T07:35:02.253685+0000","last_became_peered":"2024-09-21T07:35:02.253685+0000","last_unstale":"2024-09-21T07:35:02.257226+0000","last_undegraded":"2024-09-21T07:35:02.257226+0000","last_fullsized":"2024-09-21T07:35:02.257226+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:18.167243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.234083+0000","last_change":"2024-09-21T07:35:02.234083+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.234083+0000","last_undegraded":"2024-09-21T07:35:02.234083+0000","last_fullsized":"2024-09-21T07:35:02.234083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.246830+0000","last_change":"2024-09-21T07:35:02.244930+0000","last_active":"2024-09-21T07:35:02.246830+0000","last_peered":"2024-09-21T07:35:02.246830+0000","last_clean":"2024-09-21T07:35:02.246830+0000","last_became_active":"2024-09-21T07:35:02.244374+0000","last_became_peered":"2024-09-21T07:35:02.244374+0000","last_unstale":"2024-09-21T07:35:02.246830+0000","last_undegraded":"2024-09-21T07:35:02.246830+0000","last_fullsized":"2024-09-21T07:35:02.246830+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:48.574990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079598+0000","last_change":"2024-09-21T07:35:03.269506+0000","last_active":"2024-09-21T07:35:05.079598+0000","last_peered":"2024-09-21T07:35:05.079598+0000","last_clean":"2024-09-21T07:35:05.079598+0000","last_became_active":"2024-09-21T07:35:03.267171+0000","last_became_peered":"2024-09-21T07:35:03.267171+0000","last_unstale":"2024-09-21T07:35:05.079598+0000","last_undegraded":"2024-09-21T07:35:05.079598+0000","last_fullsized":"2024-09-21T07:35:05.079598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.131661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251322+0000","last_change":"2024-09-21T07:35:02.255663+0000","last_active":"2024-09-21T07:35:04.251322+0000","last_peered":"2024-09-21T07:35:04.251322+0000","last_clean":"2024-09-21T07:35:04.251322+0000","last_became_active":"2024-09-21T07:35:02.254828+0000","last_became_peered":"2024-09-21T07:35:02.254828+0000","last_unstale":"2024-09-21T07:35:04.251322+0000","last_undegraded":"2024-09-21T07:35:04.251322+0000","last_fullsized":"2024-09-21T07:35:04.251322+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:29.571173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235257+0000","last_change":"2024-09-21T07:35:02.235257+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235257+0000","last_undegraded":"2024-09-21T07:35:02.235257+0000","last_fullsized":"2024-09-21T07:35:02.235257+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250706+0000","last_change":"2024-09-21T07:35:02.250656+0000","last_active":"2024-09-21T07:35:04.250706+0000","last_peered":"2024-09-21T07:35:04.250706+0000","last_clean":"2024-09-21T07:35:04.250706+0000","last_became_active":"2024-09-21T07:35:02.250329+0000","last_became_peered":"2024-09-21T07:35:02.250329+0000","last_unstale":"2024-09-21T07:35:04.250706+0000","last_undegraded":"2024-09-21T07:35:04.250706+0000","last_fullsized":"2024-09-21T07:35:04.250706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.341710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.244058+0000","last_change":"2024-09-21T07:35:02.244058+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.244058+0000","last_undegraded":"2024-09-21T07:35:02.244058+0000","last_fullsized":"2024-09-21T07:35:02.244058+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079012+0000","last_change":"2024-09-21T07:35:02.250574+0000","last_active":"2024-09-21T07:35:05.079012+0000","last_peered":"2024-09-21T07:35:05.079012+0000","last_clean":"2024-09-21T07:35:05.079012+0000","last_became_active":"2024-09-21T07:35:02.250234+0000","last_became_peered":"2024-09-21T07:35:02.250234+0000","last_unstale":"2024-09-21T07:35:05.079012+0000","last_undegraded":"2024-09-21T07:35:05.079012+0000","last_fullsized":"2024-09-21T07:35:05.079012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:37.854681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.237226+0000","last_change":"2024-09-21T07:35:02.237226+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.237226+0000","last_undegraded":"2024-09-21T07:35:02.237226+0000","last_fullsized":"2024-09-21T07:35:02.237226+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078769+0000","last_change":"2024-09-21T07:35:02.255595+0000","last_active":"2024-09-21T07:35:05.078769+0000","last_peered":"2024-09-21T07:35:05.078769+0000","last_clean":"2024-09-21T07:35:05.078769+0000","last_became_active":"2024-09-21T07:35:02.255252+0000","last_became_peered":"2024-09-21T07:35:02.255252+0000","last_unstale":"2024-09-21T07:35:05.078769+0000","last_undegraded":"2024-09-21T07:35:05.078769+0000","last_fullsized":"2024-09-21T07:35:05.078769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:26.903296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.235130+0000","last_change":"2024-09-21T07:35:02.235130+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.235130+0000","last_undegraded":"2024-09-21T07:35:02.235130+0000","last_fullsized":"2024-09-21T07:35:02.235130+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260366+0000","last_change":"2024-09-21T07:35:02.254958+0000","last_active":"2024-09-21T07:35:02.260366+0000","last_peered":"2024-09-21T07:35:02.260366+0000","last_clean":"2024-09-21T07:35:02.260366+0000","last_became_active":"2024-09-21T07:35:02.253119+0000","last_became_peered":"2024-09-21T07:35:02.253119+0000","last_unstale":"2024-09-21T07:35:02.260366+0000","last_undegraded":"2024-09-21T07:35:02.260366+0000","last_fullsized":"2024-09-21T07:35:02.260366+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:56.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079321+0000","last_change":"2024-09-21T07:35:03.275353+0000","last_active":"2024-09-21T07:35:05.079321+0000","last_peered":"2024-09-21T07:35:05.079321+0000","last_clean":"2024-09-21T07:35:05.079321+0000","last_became_active":"2024-09-21T07:35:03.275033+0000","last_became_peered":"2024-09-21T07:35:03.275033+0000","last_unstale":"2024-09-21T07:35:05.079321+0000","last_undegraded":"2024-09-21T07:35:05.079321+0000","last_fullsized":"2024-09-21T07:35:05.079321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:52.384866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.258885+0000","last_change":"2024-09-21T07:35:02.257732+0000","last_active":"2024-09-21T07:35:02.258885+0000","last_peered":"2024-09-21T07:35:02.258885+0000","last_clean":"2024-09-21T07:35:02.258885+0000","last_became_active":"2024-09-21T07:35:02.257428+0000","last_became_peered":"2024-09-21T07:35:02.257428+0000","last_unstale":"2024-09-21T07:35:02.258885+0000","last_undegraded":"2024-09-21T07:35:02.258885+0000","last_fullsized":"2024-09-21T07:35:02.258885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:48.747844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2024-09-21T07:35:02.241038+0000","last_change":"2024-09-21T07:35:02.241038+0000","last_active":"2024-09-21T07:35:02.222436+0000","last_peered":"2024-09-21T07:35:02.222436+0000","last_clean":"2024-09-21T07:35:02.222436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:02.241038+0000","last_undegraded":"2024-09-21T07:35:02.241038+0000","last_fullsized":"2024-09-21T07:35:02.241038+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T07:35:02.260795+0000","last_change":"2024-09-21T07:35:02.254903+0000","last_active":"2024-09-21T07:35:02.260795+0000","last_peered":"2024-09-21T07:35:02.260795+0000","last_clean":"2024-09-21T07:35:02.260795+0000","last_became_active":"2024-09-21T07:35:02.254530+0000","last_became_peered":"2024-09-21T07:35:02.254530+0000","last_unstale":"2024-09-21T07:35:02.260795+0000","last_undegraded":"2024-09-21T07:35:02.260795+0000","last_fullsized":"2024-09-21T07:35:02.260795+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:10.217766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":397,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078709+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:05.078709+0000","last_peered":"2024-09-21T07:35:05.078709+0000","last_clean":"2024-09-21T07:35:05.078709+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:05.078709+0000","last_undegraded":"2024-09-21T07:35:05.078709+0000","last_fullsized":"2024-09-21T07:35:05.078709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1034258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59712,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312128,"statfs":{"total":96636764160,"available":96575619072,"internally_reserved":0,"allocated":2207744,"data_stored":1040925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56120,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315720,"statfs":{"total":96636764160,"available":96579297280,"internally_reserved":0,"allocated":2789376,"data_stored":1624626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542298,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1645152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83296,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94288544,"statfs":{"total":96636764160,"available":96551469056,"internally_reserved":0,"allocated":2240512,"data_stored":1054944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:35:10.452 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:35:10.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:35:12.163 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:35:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 -- 172.21.15.64:0/2946119561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 msgr2=0x7f150c0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 --2- 172.21.15.64:0/2946119561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c0b1be0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f150c06ad60 tx=0x7f14f801c890 comp rx=0 tx=0).stop 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 -- 172.21.15.64:0/2946119561 shutdown_connections 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 --2- 172.21.15.64:0/2946119561 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 0x7f150c0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 --2- 172.21.15.64:0/2946119561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c0b1be0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 --2- 172.21.15.64:0/2946119561 >> v2:172.21.15.90:3300/0 conn(0x7f150c15cbd0 0x7f150c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 -- 172.21.15.64:0/2946119561 >> 172.21.15.64:0/2946119561 conn(0x7f150c0ccbe0 msgr2=0x7f150c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 -- 172.21.15.64:0/2946119561 shutdown_connections 2024-09-21T07:35:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.333+0000 7f1514200640 1 -- 172.21.15.64:0/2946119561 wait complete. 2024-09-21T07:35:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 Processor -- start 2024-09-21T07:35:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- start start 2024-09-21T07:35:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 0x7f150c151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c15cbd0 0x7f150c1fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f150c06f990 con 0x7f150c070850 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f150c06f810 con 0x7f150c15cbd0 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f150c06fb10 con 0x7f150c0b2120 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39940/0 (socket says 172.21.15.64:39940) 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 -- 172.21.15.64:0/3823412133 learned_addr learned my addr 172.21.15.64:0/3823412133 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1512200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c15cbd0 0x7f150c1fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1510e00640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 0x7f150c151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 -- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 msgr2=0x7f150c151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 0x7f150c151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 -- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c15cbd0 msgr2=0x7f150c1fa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c15cbd0 0x7f150c1fa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 -- 172.21.15.64:0/3823412133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c1537c0 con 0x7f150c070850 2024-09-21T07:35:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1511800640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f15000058d0 tx=0x7f150000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500017070 con 0x7f150c070850 2024-09-21T07:35:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1500009d20 con 0x7f150c070850 2024-09-21T07:35:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000106c0 con 0x7f150c070850 2024-09-21T07:35:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c154e70 con 0x7f150c070850 2024-09-21T07:35:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.337+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c155f20 con 0x7f150c070850 2024-09-21T07:35:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.341+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150c155530 con 0x7f150c070850 2024-09-21T07:35:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.341+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f150001a070 con 0x7f150c070850 2024-09-21T07:35:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.341+0000 7f1509600640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 0x7f14ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.341+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f1500094460 con 0x7f150c070850 2024-09-21T07:35:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.341+0000 7f1510e00640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 0x7f14ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.345+0000 7f1510e00640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 0x7f14ec075710 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f14f80af000 tx=0x7f14f801b0d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:12.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.345+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f150005ec90 con 0x7f150c070850 2024-09-21T07:35:12.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.525+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f150c153570 con 0x7f14ec073200 2024-09-21T07:35:12.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.529+0000 7f1509600640 1 -- 172.21.15.64:0/3823412133 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252467 (secure 0 0 0) 0x7f14f80faa50 con 0x7f14ec073200 2024-09-21T07:35:12.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:12.534 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 msgr2=0x7f14ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 0x7f14ec075710 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f14f80af000 tx=0x7f14f801b0d0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 msgr2=0x7f150c1559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f15000058d0 tx=0x7f150000dde0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 shutdown_connections 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f14ec073200 0x7f14ec075710 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c15cbd0 0x7f150c1fa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f150c0b2120 0x7f150c151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 --2- 172.21.15.64:0/3823412133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f150c070850 0x7f150c1559e0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 >> 172.21.15.64:0/3823412133 conn(0x7f150c0ccbe0 msgr2=0x7f150c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:12.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 shutdown_connections 2024-09-21T07:35:12.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.533+0000 7f1514200640 1 -- 172.21.15.64:0/3823412133 wait complete. 2024-09-21T07:35:12.553 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-21T07:35:11.626492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":473564,"kb_used_data":18664,"kb_used_omap":12,"kb_used_meta":454707,"kb_avail":754501156,"statfs":{"total":773094113280,"available":772609183744,"internally_reserved":0,"allocated":19111936,"data_stored":9623828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":465620531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.392089"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251509+0000","last_change":"2024-09-21T07:35:03.269086+0000","last_active":"2024-09-21T07:35:04.251509+0000","last_peered":"2024-09-21T07:35:04.251509+0000","last_clean":"2024-09-21T07:35:04.251509+0000","last_became_active":"2024-09-21T07:35:03.268746+0000","last_became_peered":"2024-09-21T07:35:03.268746+0000","last_unstale":"2024-09-21T07:35:04.251509+0000","last_undegraded":"2024-09-21T07:35:04.251509+0000","last_fullsized":"2024-09-21T07:35:04.251509+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:04.248630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251216+0000","last_change":"2024-09-21T07:35:03.260824+0000","last_active":"2024-09-21T07:35:04.251216+0000","last_peered":"2024-09-21T07:35:04.251216+0000","last_clean":"2024-09-21T07:35:04.251216+0000","last_became_active":"2024-09-21T07:35:03.260436+0000","last_became_peered":"2024-09-21T07:35:03.260436+0000","last_unstale":"2024-09-21T07:35:04.251216+0000","last_undegraded":"2024-09-21T07:35:04.251216+0000","last_fullsized":"2024-09-21T07:35:04.251216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:33.664813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045743+0000","last_change":"2024-09-21T07:35:03.266367+0000","last_active":"2024-09-21T07:35:05.045743+0000","last_peered":"2024-09-21T07:35:05.045743+0000","last_clean":"2024-09-21T07:35:05.045743+0000","last_became_active":"2024-09-21T07:35:03.266035+0000","last_became_peered":"2024-09-21T07:35:03.266035+0000","last_unstale":"2024-09-21T07:35:05.045743+0000","last_undegraded":"2024-09-21T07:35:05.045743+0000","last_fullsized":"2024-09-21T07:35:05.045743+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:25.881843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857827+0000","last_change":"2024-09-21T07:35:03.259248+0000","last_active":"2024-09-21T07:35:04.857827+0000","last_peered":"2024-09-21T07:35:04.857827+0000","last_clean":"2024-09-21T07:35:04.857827+0000","last_became_active":"2024-09-21T07:35:03.258963+0000","last_became_peered":"2024-09-21T07:35:03.258963+0000","last_unstale":"2024-09-21T07:35:04.857827+0000","last_undegraded":"2024-09-21T07:35:04.857827+0000","last_fullsized":"2024-09-21T07:35:04.857827+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:33.531249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250829+0000","last_change":"2024-09-21T07:35:03.260600+0000","last_active":"2024-09-21T07:35:04.250829+0000","last_peered":"2024-09-21T07:35:04.250829+0000","last_clean":"2024-09-21T07:35:04.250829+0000","last_became_active":"2024-09-21T07:35:03.260309+0000","last_became_peered":"2024-09-21T07:35:03.260309+0000","last_unstale":"2024-09-21T07:35:04.250829+0000","last_undegraded":"2024-09-21T07:35:04.250829+0000","last_fullsized":"2024-09-21T07:35:04.250829+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:04.784721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249856+0000","last_change":"2024-09-21T07:35:03.259023+0000","last_active":"2024-09-21T07:35:04.249856+0000","last_peered":"2024-09-21T07:35:04.249856+0000","last_clean":"2024-09-21T07:35:04.249856+0000","last_became_active":"2024-09-21T07:35:03.258721+0000","last_became_peered":"2024-09-21T07:35:03.258721+0000","last_unstale":"2024-09-21T07:35:04.249856+0000","last_undegraded":"2024-09-21T07:35:04.249856+0000","last_fullsized":"2024-09-21T07:35:04.249856+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:57.399605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250318+0000","last_change":"2024-09-21T07:35:03.275745+0000","last_active":"2024-09-21T07:35:04.250318+0000","last_peered":"2024-09-21T07:35:04.250318+0000","last_clean":"2024-09-21T07:35:04.250318+0000","last_became_active":"2024-09-21T07:35:03.275407+0000","last_became_peered":"2024-09-21T07:35:03.275407+0000","last_unstale":"2024-09-21T07:35:04.250318+0000","last_undegraded":"2024-09-21T07:35:04.250318+0000","last_fullsized":"2024-09-21T07:35:04.250318+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:46.543897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078662+0000","last_change":"2024-09-21T07:35:03.267609+0000","last_active":"2024-09-21T07:35:05.078662+0000","last_peered":"2024-09-21T07:35:05.078662+0000","last_clean":"2024-09-21T07:35:05.078662+0000","last_became_active":"2024-09-21T07:35:03.267316+0000","last_became_peered":"2024-09-21T07:35:03.267316+0000","last_unstale":"2024-09-21T07:35:05.078662+0000","last_undegraded":"2024-09-21T07:35:05.078662+0000","last_fullsized":"2024-09-21T07:35:05.078662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:55.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252492+0000","last_change":"2024-09-21T07:35:03.261867+0000","last_active":"2024-09-21T07:35:04.252492+0000","last_peered":"2024-09-21T07:35:04.252492+0000","last_clean":"2024-09-21T07:35:04.252492+0000","last_became_active":"2024-09-21T07:35:03.258190+0000","last_became_peered":"2024-09-21T07:35:03.258190+0000","last_unstale":"2024-09-21T07:35:04.252492+0000","last_undegraded":"2024-09-21T07:35:04.252492+0000","last_fullsized":"2024-09-21T07:35:04.252492+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:11.151922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252882+0000","last_change":"2024-09-21T07:35:03.260726+0000","last_active":"2024-09-21T07:35:04.252882+0000","last_peered":"2024-09-21T07:35:04.252882+0000","last_clean":"2024-09-21T07:35:04.252882+0000","last_became_active":"2024-09-21T07:35:03.256428+0000","last_became_peered":"2024-09-21T07:35:03.256428+0000","last_unstale":"2024-09-21T07:35:04.252882+0000","last_undegraded":"2024-09-21T07:35:04.252882+0000","last_fullsized":"2024-09-21T07:35:04.252882+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078501+0000","last_change":"2024-09-21T07:35:03.264076+0000","last_active":"2024-09-21T07:35:05.078501+0000","last_peered":"2024-09-21T07:35:05.078501+0000","last_clean":"2024-09-21T07:35:05.078501+0000","last_became_active":"2024-09-21T07:35:03.263733+0000","last_became_peered":"2024-09-21T07:35:03.263733+0000","last_unstale":"2024-09-21T07:35:05.078501+0000","last_undegraded":"2024-09-21T07:35:05.078501+0000","last_fullsized":"2024-09-21T07:35:05.078501+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:11.199547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.858059+0000","last_change":"2024-09-21T07:35:03.263218+0000","last_active":"2024-09-21T07:35:04.858059+0000","last_peered":"2024-09-21T07:35:04.858059+0000","last_clean":"2024-09-21T07:35:04.858059+0000","last_became_active":"2024-09-21T07:35:03.262931+0000","last_became_peered":"2024-09-21T07:35:03.262931+0000","last_unstale":"2024-09-21T07:35:04.858059+0000","last_undegraded":"2024-09-21T07:35:04.858059+0000","last_fullsized":"2024-09-21T07:35:04.858059+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:17.438525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990723+0000","last_change":"2024-09-21T07:35:03.252540+0000","last_active":"2024-09-21T07:35:04.990723+0000","last_peered":"2024-09-21T07:35:04.990723+0000","last_clean":"2024-09-21T07:35:04.990723+0000","last_became_active":"2024-09-21T07:35:03.252093+0000","last_became_peered":"2024-09-21T07:35:03.252093+0000","last_unstale":"2024-09-21T07:35:04.990723+0000","last_undegraded":"2024-09-21T07:35:04.990723+0000","last_fullsized":"2024-09-21T07:35:04.990723+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:39.295403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250419+0000","last_change":"2024-09-21T07:35:03.266723+0000","last_active":"2024-09-21T07:35:04.250419+0000","last_peered":"2024-09-21T07:35:04.250419+0000","last_clean":"2024-09-21T07:35:04.250419+0000","last_became_active":"2024-09-21T07:35:03.266425+0000","last_became_peered":"2024-09-21T07:35:03.266425+0000","last_unstale":"2024-09-21T07:35:04.250419+0000","last_undegraded":"2024-09-21T07:35:04.250419+0000","last_fullsized":"2024-09-21T07:35:04.250419+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:59.149685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251336+0000","last_change":"2024-09-21T07:35:03.269146+0000","last_active":"2024-09-21T07:35:04.251336+0000","last_peered":"2024-09-21T07:35:04.251336+0000","last_clean":"2024-09-21T07:35:04.251336+0000","last_became_active":"2024-09-21T07:35:03.268831+0000","last_became_peered":"2024-09-21T07:35:03.268831+0000","last_unstale":"2024-09-21T07:35:04.251336+0000","last_undegraded":"2024-09-21T07:35:04.251336+0000","last_fullsized":"2024-09-21T07:35:04.251336+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:48.732346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249682+0000","last_change":"2024-09-21T07:35:03.254637+0000","last_active":"2024-09-21T07:35:04.249682+0000","last_peered":"2024-09-21T07:35:04.249682+0000","last_clean":"2024-09-21T07:35:04.249682+0000","last_became_active":"2024-09-21T07:35:03.254227+0000","last_became_peered":"2024-09-21T07:35:03.254227+0000","last_unstale":"2024-09-21T07:35:04.249682+0000","last_undegraded":"2024-09-21T07:35:04.249682+0000","last_fullsized":"2024-09-21T07:35:04.249682+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.940090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251731+0000","last_change":"2024-09-21T07:35:03.270378+0000","last_active":"2024-09-21T07:35:04.251731+0000","last_peered":"2024-09-21T07:35:04.251731+0000","last_clean":"2024-09-21T07:35:04.251731+0000","last_became_active":"2024-09-21T07:35:03.269427+0000","last_became_peered":"2024-09-21T07:35:03.269427+0000","last_unstale":"2024-09-21T07:35:04.251731+0000","last_undegraded":"2024-09-21T07:35:04.251731+0000","last_fullsized":"2024-09-21T07:35:04.251731+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:52.605389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.991101+0000","last_change":"2024-09-21T07:35:03.266836+0000","last_active":"2024-09-21T07:35:04.991101+0000","last_peered":"2024-09-21T07:35:04.991101+0000","last_clean":"2024-09-21T07:35:04.991101+0000","last_became_active":"2024-09-21T07:35:03.266410+0000","last_became_peered":"2024-09-21T07:35:03.266410+0000","last_unstale":"2024-09-21T07:35:04.991101+0000","last_undegraded":"2024-09-21T07:35:04.991101+0000","last_fullsized":"2024-09-21T07:35:04.991101+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:24.733814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.991003+0000","last_change":"2024-09-21T07:35:03.268657+0000","last_active":"2024-09-21T07:35:04.991003+0000","last_peered":"2024-09-21T07:35:04.991003+0000","last_clean":"2024-09-21T07:35:04.991003+0000","last_became_active":"2024-09-21T07:35:03.268239+0000","last_became_peered":"2024-09-21T07:35:03.268239+0000","last_unstale":"2024-09-21T07:35:04.991003+0000","last_undegraded":"2024-09-21T07:35:04.991003+0000","last_fullsized":"2024-09-21T07:35:04.991003+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:51.701228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250361+0000","last_change":"2024-09-21T07:35:03.261822+0000","last_active":"2024-09-21T07:35:04.250361+0000","last_peered":"2024-09-21T07:35:04.250361+0000","last_clean":"2024-09-21T07:35:04.250361+0000","last_became_active":"2024-09-21T07:35:03.261533+0000","last_became_peered":"2024-09-21T07:35:03.261533+0000","last_unstale":"2024-09-21T07:35:04.250361+0000","last_undegraded":"2024-09-21T07:35:04.250361+0000","last_fullsized":"2024-09-21T07:35:04.250361+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.404434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252681+0000","last_change":"2024-09-21T07:35:03.263687+0000","last_active":"2024-09-21T07:35:04.252681+0000","last_peered":"2024-09-21T07:35:04.252681+0000","last_clean":"2024-09-21T07:35:04.252681+0000","last_became_active":"2024-09-21T07:35:03.263375+0000","last_became_peered":"2024-09-21T07:35:03.263375+0000","last_unstale":"2024-09-21T07:35:04.252681+0000","last_undegraded":"2024-09-21T07:35:04.252681+0000","last_fullsized":"2024-09-21T07:35:04.252681+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:41.782149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252159+0000","last_change":"2024-09-21T07:35:03.260969+0000","last_active":"2024-09-21T07:35:04.252159+0000","last_peered":"2024-09-21T07:35:04.252159+0000","last_clean":"2024-09-21T07:35:04.252159+0000","last_became_active":"2024-09-21T07:35:03.259945+0000","last_became_peered":"2024-09-21T07:35:03.259945+0000","last_unstale":"2024-09-21T07:35:04.252159+0000","last_undegraded":"2024-09-21T07:35:04.252159+0000","last_fullsized":"2024-09-21T07:35:04.252159+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:47.578155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078605+0000","last_change":"2024-09-21T07:35:03.277225+0000","last_active":"2024-09-21T07:35:05.078605+0000","last_peered":"2024-09-21T07:35:05.078605+0000","last_clean":"2024-09-21T07:35:05.078605+0000","last_became_active":"2024-09-21T07:35:03.276612+0000","last_became_peered":"2024-09-21T07:35:03.276612+0000","last_unstale":"2024-09-21T07:35:05.078605+0000","last_undegraded":"2024-09-21T07:35:05.078605+0000","last_fullsized":"2024-09-21T07:35:05.078605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:08.098778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251759+0000","last_change":"2024-09-21T07:35:03.270262+0000","last_active":"2024-09-21T07:35:04.251759+0000","last_peered":"2024-09-21T07:35:04.251759+0000","last_clean":"2024-09-21T07:35:04.251759+0000","last_became_active":"2024-09-21T07:35:03.269975+0000","last_became_peered":"2024-09-21T07:35:03.269975+0000","last_unstale":"2024-09-21T07:35:04.251759+0000","last_undegraded":"2024-09-21T07:35:04.251759+0000","last_fullsized":"2024-09-21T07:35:04.251759+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:30.905873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252517+0000","last_change":"2024-09-21T07:35:03.266003+0000","last_active":"2024-09-21T07:35:04.252517+0000","last_peered":"2024-09-21T07:35:04.252517+0000","last_clean":"2024-09-21T07:35:04.252517+0000","last_became_active":"2024-09-21T07:35:03.265705+0000","last_became_peered":"2024-09-21T07:35:03.265705+0000","last_unstale":"2024-09-21T07:35:04.252517+0000","last_undegraded":"2024-09-21T07:35:04.252517+0000","last_fullsized":"2024-09-21T07:35:04.252517+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:49.807081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078545+0000","last_change":"2024-09-21T07:35:03.269932+0000","last_active":"2024-09-21T07:35:05.078545+0000","last_peered":"2024-09-21T07:35:05.078545+0000","last_clean":"2024-09-21T07:35:05.078545+0000","last_became_active":"2024-09-21T07:35:03.264259+0000","last_became_peered":"2024-09-21T07:35:03.264259+0000","last_unstale":"2024-09-21T07:35:05.078545+0000","last_undegraded":"2024-09-21T07:35:05.078545+0000","last_fullsized":"2024-09-21T07:35:05.078545+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:19.168199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079386+0000","last_change":"2024-09-21T07:35:03.267424+0000","last_active":"2024-09-21T07:35:05.079386+0000","last_peered":"2024-09-21T07:35:05.079386+0000","last_clean":"2024-09-21T07:35:05.079386+0000","last_became_active":"2024-09-21T07:35:03.266994+0000","last_became_peered":"2024-09-21T07:35:03.266994+0000","last_unstale":"2024-09-21T07:35:05.079386+0000","last_undegraded":"2024-09-21T07:35:05.079386+0000","last_fullsized":"2024-09-21T07:35:05.079386+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:48.006626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250585+0000","last_change":"2024-09-21T07:35:03.254332+0000","last_active":"2024-09-21T07:35:04.250585+0000","last_peered":"2024-09-21T07:35:04.250585+0000","last_clean":"2024-09-21T07:35:04.250585+0000","last_became_active":"2024-09-21T07:35:03.254005+0000","last_became_peered":"2024-09-21T07:35:03.254005+0000","last_unstale":"2024-09-21T07:35:04.250585+0000","last_undegraded":"2024-09-21T07:35:04.250585+0000","last_fullsized":"2024-09-21T07:35:04.250585+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:08.989540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078223+0000","last_change":"2024-09-21T07:35:03.269693+0000","last_active":"2024-09-21T07:35:05.078223+0000","last_peered":"2024-09-21T07:35:05.078223+0000","last_clean":"2024-09-21T07:35:05.078223+0000","last_became_active":"2024-09-21T07:35:03.258035+0000","last_became_peered":"2024-09-21T07:35:03.258035+0000","last_unstale":"2024-09-21T07:35:05.078223+0000","last_undegraded":"2024-09-21T07:35:05.078223+0000","last_fullsized":"2024-09-21T07:35:05.078223+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:11.938095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078243+0000","last_change":"2024-09-21T07:35:03.276984+0000","last_active":"2024-09-21T07:35:05.078243+0000","last_peered":"2024-09-21T07:35:05.078243+0000","last_clean":"2024-09-21T07:35:05.078243+0000","last_became_active":"2024-09-21T07:35:03.276585+0000","last_became_peered":"2024-09-21T07:35:03.276585+0000","last_unstale":"2024-09-21T07:35:05.078243+0000","last_undegraded":"2024-09-21T07:35:05.078243+0000","last_fullsized":"2024-09-21T07:35:05.078243+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:42.181491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250320+0000","last_change":"2024-09-21T07:35:03.270569+0000","last_active":"2024-09-21T07:35:04.250320+0000","last_peered":"2024-09-21T07:35:04.250320+0000","last_clean":"2024-09-21T07:35:04.250320+0000","last_became_active":"2024-09-21T07:35:03.270271+0000","last_became_peered":"2024-09-21T07:35:03.270271+0000","last_unstale":"2024-09-21T07:35:04.250320+0000","last_undegraded":"2024-09-21T07:35:04.250320+0000","last_fullsized":"2024-09-21T07:35:04.250320+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:44.598444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249694+0000","last_change":"2024-09-21T07:35:03.261409+0000","last_active":"2024-09-21T07:35:04.249694+0000","last_peered":"2024-09-21T07:35:04.249694+0000","last_clean":"2024-09-21T07:35:04.249694+0000","last_became_active":"2024-09-21T07:35:03.261076+0000","last_became_peered":"2024-09-21T07:35:03.261076+0000","last_unstale":"2024-09-21T07:35:04.249694+0000","last_undegraded":"2024-09-21T07:35:04.249694+0000","last_fullsized":"2024-09-21T07:35:04.249694+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:55.778957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079516+0000","last_change":"2024-09-21T07:35:03.270094+0000","last_active":"2024-09-21T07:35:05.079516+0000","last_peered":"2024-09-21T07:35:05.079516+0000","last_clean":"2024-09-21T07:35:05.079516+0000","last_became_active":"2024-09-21T07:35:03.269758+0000","last_became_peered":"2024-09-21T07:35:03.269758+0000","last_unstale":"2024-09-21T07:35:05.079516+0000","last_undegraded":"2024-09-21T07:35:05.079516+0000","last_fullsized":"2024-09-21T07:35:05.079516+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.138794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"177'4","reported_seq":19,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.858103+0000","last_change":"2024-09-21T07:35:02.258592+0000","last_active":"2024-09-21T07:35:04.858103+0000","last_peered":"2024-09-21T07:35:04.858103+0000","last_clean":"2024-09-21T07:35:04.858103+0000","last_became_active":"2024-09-21T07:35:02.258264+0000","last_became_peered":"2024-09-21T07:35:02.258264+0000","last_unstale":"2024-09-21T07:35:04.858103+0000","last_undegraded":"2024-09-21T07:35:04.858103+0000","last_fullsized":"2024-09-21T07:35:04.858103+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:26.199944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251232+0000","last_change":"2024-09-21T07:35:03.276138+0000","last_active":"2024-09-21T07:35:04.251232+0000","last_peered":"2024-09-21T07:35:04.251232+0000","last_clean":"2024-09-21T07:35:04.251232+0000","last_became_active":"2024-09-21T07:35:03.275678+0000","last_became_peered":"2024-09-21T07:35:03.275678+0000","last_unstale":"2024-09-21T07:35:04.251232+0000","last_undegraded":"2024-09-21T07:35:04.251232+0000","last_fullsized":"2024-09-21T07:35:04.251232+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:36.922331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.253042+0000","last_change":"2024-09-21T07:35:02.252098+0000","last_active":"2024-09-21T07:35:04.253042+0000","last_peered":"2024-09-21T07:35:04.253042+0000","last_clean":"2024-09-21T07:35:04.253042+0000","last_became_active":"2024-09-21T07:35:02.249744+0000","last_became_peered":"2024-09-21T07:35:02.249744+0000","last_unstale":"2024-09-21T07:35:04.253042+0000","last_undegraded":"2024-09-21T07:35:04.253042+0000","last_fullsized":"2024-09-21T07:35:04.253042+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.362809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078661+0000","last_change":"2024-09-21T07:35:03.263473+0000","last_active":"2024-09-21T07:35:05.078661+0000","last_peered":"2024-09-21T07:35:05.078661+0000","last_clean":"2024-09-21T07:35:05.078661+0000","last_became_active":"2024-09-21T07:35:03.263073+0000","last_became_peered":"2024-09-21T07:35:03.263073+0000","last_unstale":"2024-09-21T07:35:05.078661+0000","last_undegraded":"2024-09-21T07:35:05.078661+0000","last_fullsized":"2024-09-21T07:35:05.078661+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:50.082888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078773+0000","last_change":"2024-09-21T07:35:02.249622+0000","last_active":"2024-09-21T07:35:05.078773+0000","last_peered":"2024-09-21T07:35:05.078773+0000","last_clean":"2024-09-21T07:35:05.078773+0000","last_became_active":"2024-09-21T07:35:02.249278+0000","last_became_peered":"2024-09-21T07:35:02.249278+0000","last_unstale":"2024-09-21T07:35:05.078773+0000","last_undegraded":"2024-09-21T07:35:05.078773+0000","last_fullsized":"2024-09-21T07:35:05.078773+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:50.698279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045923+0000","last_change":"2024-09-21T07:35:03.259350+0000","last_active":"2024-09-21T07:35:05.045923+0000","last_peered":"2024-09-21T07:35:05.045923+0000","last_clean":"2024-09-21T07:35:05.045923+0000","last_became_active":"2024-09-21T07:35:03.256288+0000","last_became_peered":"2024-09-21T07:35:03.256288+0000","last_unstale":"2024-09-21T07:35:05.045923+0000","last_undegraded":"2024-09-21T07:35:05.045923+0000","last_fullsized":"2024-09-21T07:35:05.045923+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:28.594746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990843+0000","last_change":"2024-09-21T07:35:02.244307+0000","last_active":"2024-09-21T07:35:04.990843+0000","last_peered":"2024-09-21T07:35:04.990843+0000","last_clean":"2024-09-21T07:35:04.990843+0000","last_became_active":"2024-09-21T07:35:02.243923+0000","last_became_peered":"2024-09-21T07:35:02.243923+0000","last_unstale":"2024-09-21T07:35:04.990843+0000","last_undegraded":"2024-09-21T07:35:04.990843+0000","last_fullsized":"2024-09-21T07:35:04.990843+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.878893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990389+0000","last_change":"2024-09-21T07:35:03.265015+0000","last_active":"2024-09-21T07:35:04.990389+0000","last_peered":"2024-09-21T07:35:04.990389+0000","last_clean":"2024-09-21T07:35:04.990389+0000","last_became_active":"2024-09-21T07:35:03.264382+0000","last_became_peered":"2024-09-21T07:35:03.264382+0000","last_unstale":"2024-09-21T07:35:04.990389+0000","last_undegraded":"2024-09-21T07:35:04.990389+0000","last_fullsized":"2024-09-21T07:35:04.990389+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:08:14.899188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250126+0000","last_change":"2024-09-21T07:35:02.253834+0000","last_active":"2024-09-21T07:35:04.250126+0000","last_peered":"2024-09-21T07:35:04.250126+0000","last_clean":"2024-09-21T07:35:04.250126+0000","last_became_active":"2024-09-21T07:35:02.252826+0000","last_became_peered":"2024-09-21T07:35:02.252826+0000","last_unstale":"2024-09-21T07:35:04.250126+0000","last_undegraded":"2024-09-21T07:35:04.250126+0000","last_fullsized":"2024-09-21T07:35:04.250126+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:39.103263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251586+0000","last_change":"2024-09-21T07:35:03.265424+0000","last_active":"2024-09-21T07:35:04.251586+0000","last_peered":"2024-09-21T07:35:04.251586+0000","last_clean":"2024-09-21T07:35:04.251586+0000","last_became_active":"2024-09-21T07:35:03.265149+0000","last_became_peered":"2024-09-21T07:35:03.265149+0000","last_unstale":"2024-09-21T07:35:04.251586+0000","last_undegraded":"2024-09-21T07:35:04.251586+0000","last_fullsized":"2024-09-21T07:35:04.251586+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:41.717136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857857+0000","last_change":"2024-09-21T07:35:02.261499+0000","last_active":"2024-09-21T07:35:04.857857+0000","last_peered":"2024-09-21T07:35:04.857857+0000","last_clean":"2024-09-21T07:35:04.857857+0000","last_became_active":"2024-09-21T07:35:02.261161+0000","last_became_peered":"2024-09-21T07:35:02.261161+0000","last_unstale":"2024-09-21T07:35:04.857857+0000","last_undegraded":"2024-09-21T07:35:04.857857+0000","last_fullsized":"2024-09-21T07:35:04.857857+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:05.730072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252356+0000","last_change":"2024-09-21T07:35:03.266576+0000","last_active":"2024-09-21T07:35:04.252356+0000","last_peered":"2024-09-21T07:35:04.252356+0000","last_clean":"2024-09-21T07:35:04.252356+0000","last_became_active":"2024-09-21T07:35:03.266238+0000","last_became_peered":"2024-09-21T07:35:03.266238+0000","last_unstale":"2024-09-21T07:35:04.252356+0000","last_undegraded":"2024-09-21T07:35:04.252356+0000","last_fullsized":"2024-09-21T07:35:04.252356+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:27.084860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990468+0000","last_change":"2024-09-21T07:35:02.248579+0000","last_active":"2024-09-21T07:35:04.990468+0000","last_peered":"2024-09-21T07:35:04.990468+0000","last_clean":"2024-09-21T07:35:04.990468+0000","last_became_active":"2024-09-21T07:35:02.248203+0000","last_became_peered":"2024-09-21T07:35:02.248203+0000","last_unstale":"2024-09-21T07:35:04.990468+0000","last_undegraded":"2024-09-21T07:35:04.990468+0000","last_fullsized":"2024-09-21T07:35:04.990468+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:03.865010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079418+0000","last_change":"2024-09-21T07:35:03.270828+0000","last_active":"2024-09-21T07:35:05.079418+0000","last_peered":"2024-09-21T07:35:05.079418+0000","last_clean":"2024-09-21T07:35:05.079418+0000","last_became_active":"2024-09-21T07:35:03.270525+0000","last_became_peered":"2024-09-21T07:35:03.270525+0000","last_unstale":"2024-09-21T07:35:05.079418+0000","last_undegraded":"2024-09-21T07:35:05.079418+0000","last_fullsized":"2024-09-21T07:35:05.079418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:35.198735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251909+0000","last_change":"2024-09-21T07:35:02.257632+0000","last_active":"2024-09-21T07:35:04.251909+0000","last_peered":"2024-09-21T07:35:04.251909+0000","last_clean":"2024-09-21T07:35:04.251909+0000","last_became_active":"2024-09-21T07:35:02.256235+0000","last_became_peered":"2024-09-21T07:35:02.256235+0000","last_unstale":"2024-09-21T07:35:04.251909+0000","last_undegraded":"2024-09-21T07:35:04.251909+0000","last_fullsized":"2024-09-21T07:35:04.251909+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:41.865068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251199+0000","last_change":"2024-09-21T07:35:03.258728+0000","last_active":"2024-09-21T07:35:04.251199+0000","last_peered":"2024-09-21T07:35:04.251199+0000","last_clean":"2024-09-21T07:35:04.251199+0000","last_became_active":"2024-09-21T07:35:03.258061+0000","last_became_peered":"2024-09-21T07:35:03.258061+0000","last_unstale":"2024-09-21T07:35:04.251199+0000","last_undegraded":"2024-09-21T07:35:04.251199+0000","last_fullsized":"2024-09-21T07:35:04.251199+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:47.404474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251492+0000","last_change":"2024-09-21T07:35:02.247431+0000","last_active":"2024-09-21T07:35:04.251492+0000","last_peered":"2024-09-21T07:35:04.251492+0000","last_clean":"2024-09-21T07:35:04.251492+0000","last_became_active":"2024-09-21T07:35:02.247100+0000","last_became_peered":"2024-09-21T07:35:02.247100+0000","last_unstale":"2024-09-21T07:35:04.251492+0000","last_undegraded":"2024-09-21T07:35:04.251492+0000","last_fullsized":"2024-09-21T07:35:04.251492+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:36.205192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.991219+0000","last_change":"2024-09-21T07:35:03.249314+0000","last_active":"2024-09-21T07:35:04.991219+0000","last_peered":"2024-09-21T07:35:04.991219+0000","last_clean":"2024-09-21T07:35:04.991219+0000","last_became_active":"2024-09-21T07:35:03.248969+0000","last_became_peered":"2024-09-21T07:35:03.248969+0000","last_unstale":"2024-09-21T07:35:04.991219+0000","last_undegraded":"2024-09-21T07:35:04.991219+0000","last_fullsized":"2024-09-21T07:35:04.991219+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:13.349450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"177'3","reported_seq":18,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857935+0000","last_change":"2024-09-21T07:35:02.261614+0000","last_active":"2024-09-21T07:35:04.857935+0000","last_peered":"2024-09-21T07:35:04.857935+0000","last_clean":"2024-09-21T07:35:04.857935+0000","last_became_active":"2024-09-21T07:35:02.261277+0000","last_became_peered":"2024-09-21T07:35:02.261277+0000","last_unstale":"2024-09-21T07:35:04.857935+0000","last_undegraded":"2024-09-21T07:35:04.857935+0000","last_fullsized":"2024-09-21T07:35:04.857935+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:46.548626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251996+0000","last_change":"2024-09-21T07:35:03.258114+0000","last_active":"2024-09-21T07:35:04.251996+0000","last_peered":"2024-09-21T07:35:04.251996+0000","last_clean":"2024-09-21T07:35:04.251996+0000","last_became_active":"2024-09-21T07:35:03.257765+0000","last_became_peered":"2024-09-21T07:35:03.257765+0000","last_unstale":"2024-09-21T07:35:04.251996+0000","last_undegraded":"2024-09-21T07:35:04.251996+0000","last_fullsized":"2024-09-21T07:35:04.251996+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:48.352184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"177'6","reported_seq":21,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990873+0000","last_change":"2024-09-21T07:35:02.255104+0000","last_active":"2024-09-21T07:35:04.990873+0000","last_peered":"2024-09-21T07:35:04.990873+0000","last_clean":"2024-09-21T07:35:04.990873+0000","last_became_active":"2024-09-21T07:35:02.254632+0000","last_became_peered":"2024-09-21T07:35:02.254632+0000","last_unstale":"2024-09-21T07:35:04.990873+0000","last_undegraded":"2024-09-21T07:35:04.990873+0000","last_fullsized":"2024-09-21T07:35:04.990873+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:27.591797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252086+0000","last_change":"2024-09-21T07:35:03.268259+0000","last_active":"2024-09-21T07:35:04.252086+0000","last_peered":"2024-09-21T07:35:04.252086+0000","last_clean":"2024-09-21T07:35:04.252086+0000","last_became_active":"2024-09-21T07:35:03.267888+0000","last_became_peered":"2024-09-21T07:35:03.267888+0000","last_unstale":"2024-09-21T07:35:04.252086+0000","last_undegraded":"2024-09-21T07:35:04.252086+0000","last_fullsized":"2024-09-21T07:35:04.252086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:54.276050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990971+0000","last_change":"2024-09-21T07:35:02.260184+0000","last_active":"2024-09-21T07:35:04.990971+0000","last_peered":"2024-09-21T07:35:04.990971+0000","last_clean":"2024-09-21T07:35:04.990971+0000","last_became_active":"2024-09-21T07:35:02.259823+0000","last_became_peered":"2024-09-21T07:35:02.259823+0000","last_unstale":"2024-09-21T07:35:04.990971+0000","last_undegraded":"2024-09-21T07:35:04.990971+0000","last_fullsized":"2024-09-21T07:35:04.990971+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:52.433378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.249632+0000","last_change":"2024-09-21T07:35:03.255093+0000","last_active":"2024-09-21T07:35:04.249632+0000","last_peered":"2024-09-21T07:35:04.249632+0000","last_clean":"2024-09-21T07:35:04.249632+0000","last_became_active":"2024-09-21T07:35:03.254830+0000","last_became_peered":"2024-09-21T07:35:03.254830+0000","last_unstale":"2024-09-21T07:35:04.249632+0000","last_undegraded":"2024-09-21T07:35:04.249632+0000","last_fullsized":"2024-09-21T07:35:04.249632+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:09.529360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252729+0000","last_change":"2024-09-21T07:35:02.256316+0000","last_active":"2024-09-21T07:35:04.252729+0000","last_peered":"2024-09-21T07:35:04.252729+0000","last_clean":"2024-09-21T07:35:04.252729+0000","last_became_active":"2024-09-21T07:35:02.255641+0000","last_became_peered":"2024-09-21T07:35:02.255641+0000","last_unstale":"2024-09-21T07:35:04.252729+0000","last_undegraded":"2024-09-21T07:35:04.252729+0000","last_fullsized":"2024-09-21T07:35:04.252729+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.198767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990591+0000","last_change":"2024-09-21T07:35:03.266349+0000","last_active":"2024-09-21T07:35:04.990591+0000","last_peered":"2024-09-21T07:35:04.990591+0000","last_clean":"2024-09-21T07:35:04.990591+0000","last_became_active":"2024-09-21T07:35:03.258957+0000","last_became_peered":"2024-09-21T07:35:03.258957+0000","last_unstale":"2024-09-21T07:35:04.990591+0000","last_undegraded":"2024-09-21T07:35:04.990591+0000","last_fullsized":"2024-09-21T07:35:04.990591+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:30.629801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857615+0000","last_change":"2024-09-21T07:35:02.251182+0000","last_active":"2024-09-21T07:35:04.857615+0000","last_peered":"2024-09-21T07:35:04.857615+0000","last_clean":"2024-09-21T07:35:04.857615+0000","last_became_active":"2024-09-21T07:35:02.250879+0000","last_became_peered":"2024-09-21T07:35:02.250879+0000","last_unstale":"2024-09-21T07:35:04.857615+0000","last_undegraded":"2024-09-21T07:35:04.857615+0000","last_fullsized":"2024-09-21T07:35:04.857615+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:16.314221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990710+0000","last_change":"2024-09-21T07:35:03.252250+0000","last_active":"2024-09-21T07:35:04.990710+0000","last_peered":"2024-09-21T07:35:04.990710+0000","last_clean":"2024-09-21T07:35:04.990710+0000","last_became_active":"2024-09-21T07:35:03.251901+0000","last_became_peered":"2024-09-21T07:35:03.251901+0000","last_unstale":"2024-09-21T07:35:04.990710+0000","last_undegraded":"2024-09-21T07:35:04.990710+0000","last_fullsized":"2024-09-21T07:35:04.990710+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:25.328939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"177'8","reported_seq":23,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078012+0000","last_change":"2024-09-21T07:35:02.246826+0000","last_active":"2024-09-21T07:35:05.078012+0000","last_peered":"2024-09-21T07:35:05.078012+0000","last_clean":"2024-09-21T07:35:05.078012+0000","last_became_active":"2024-09-21T07:35:02.246426+0000","last_became_peered":"2024-09-21T07:35:02.246426+0000","last_unstale":"2024-09-21T07:35:05.078012+0000","last_undegraded":"2024-09-21T07:35:05.078012+0000","last_fullsized":"2024-09-21T07:35:05.078012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:38.292454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251440+0000","last_change":"2024-09-21T07:35:03.277336+0000","last_active":"2024-09-21T07:35:04.251440+0000","last_peered":"2024-09-21T07:35:04.251440+0000","last_clean":"2024-09-21T07:35:04.251440+0000","last_became_active":"2024-09-21T07:35:03.275857+0000","last_became_peered":"2024-09-21T07:35:03.275857+0000","last_unstale":"2024-09-21T07:35:04.251440+0000","last_undegraded":"2024-09-21T07:35:04.251440+0000","last_fullsized":"2024-09-21T07:35:04.251440+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:44.835865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078912+0000","last_change":"2024-09-21T07:35:02.256374+0000","last_active":"2024-09-21T07:35:05.078912+0000","last_peered":"2024-09-21T07:35:05.078912+0000","last_clean":"2024-09-21T07:35:05.078912+0000","last_became_active":"2024-09-21T07:35:02.255795+0000","last_became_peered":"2024-09-21T07:35:02.255795+0000","last_unstale":"2024-09-21T07:35:05.078912+0000","last_undegraded":"2024-09-21T07:35:05.078912+0000","last_fullsized":"2024-09-21T07:35:05.078912+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:29.626852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251189+0000","last_change":"2024-09-21T07:35:03.259092+0000","last_active":"2024-09-21T07:35:04.251189+0000","last_peered":"2024-09-21T07:35:04.251189+0000","last_clean":"2024-09-21T07:35:04.251189+0000","last_became_active":"2024-09-21T07:35:03.256278+0000","last_became_peered":"2024-09-21T07:35:03.256278+0000","last_unstale":"2024-09-21T07:35:04.251189+0000","last_undegraded":"2024-09-21T07:35:04.251189+0000","last_fullsized":"2024-09-21T07:35:04.251189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.004230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857955+0000","last_change":"2024-09-21T07:35:02.257673+0000","last_active":"2024-09-21T07:35:04.857955+0000","last_peered":"2024-09-21T07:35:04.857955+0000","last_clean":"2024-09-21T07:35:04.857955+0000","last_became_active":"2024-09-21T07:35:02.256474+0000","last_became_peered":"2024-09-21T07:35:02.256474+0000","last_unstale":"2024-09-21T07:35:04.857955+0000","last_undegraded":"2024-09-21T07:35:04.857955+0000","last_fullsized":"2024-09-21T07:35:04.857955+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:48.687277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078794+0000","last_change":"2024-09-21T07:35:03.264433+0000","last_active":"2024-09-21T07:35:05.078794+0000","last_peered":"2024-09-21T07:35:05.078794+0000","last_clean":"2024-09-21T07:35:05.078794+0000","last_became_active":"2024-09-21T07:35:03.264121+0000","last_became_peered":"2024-09-21T07:35:03.264121+0000","last_unstale":"2024-09-21T07:35:05.078794+0000","last_undegraded":"2024-09-21T07:35:05.078794+0000","last_fullsized":"2024-09-21T07:35:05.078794+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:05.368735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"177'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045776+0000","last_change":"2024-09-21T07:35:02.257206+0000","last_active":"2024-09-21T07:35:05.045776+0000","last_peered":"2024-09-21T07:35:05.045776+0000","last_clean":"2024-09-21T07:35:05.045776+0000","last_became_active":"2024-09-21T07:35:02.256889+0000","last_became_peered":"2024-09-21T07:35:02.256889+0000","last_unstale":"2024-09-21T07:35:05.045776+0000","last_undegraded":"2024-09-21T07:35:05.045776+0000","last_fullsized":"2024-09-21T07:35:05.045776+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:01.189255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252246+0000","last_change":"2024-09-21T07:35:03.262186+0000","last_active":"2024-09-21T07:35:04.252246+0000","last_peered":"2024-09-21T07:35:04.252246+0000","last_clean":"2024-09-21T07:35:04.252246+0000","last_became_active":"2024-09-21T07:35:03.261531+0000","last_became_peered":"2024-09-21T07:35:03.261531+0000","last_unstale":"2024-09-21T07:35:04.252246+0000","last_undegraded":"2024-09-21T07:35:04.252246+0000","last_fullsized":"2024-09-21T07:35:04.252246+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:39.063178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078402+0000","last_change":"2024-09-21T07:35:02.250284+0000","last_active":"2024-09-21T07:35:05.078402+0000","last_peered":"2024-09-21T07:35:05.078402+0000","last_clean":"2024-09-21T07:35:05.078402+0000","last_became_active":"2024-09-21T07:35:02.246160+0000","last_became_peered":"2024-09-21T07:35:02.246160+0000","last_unstale":"2024-09-21T07:35:05.078402+0000","last_undegraded":"2024-09-21T07:35:05.078402+0000","last_fullsized":"2024-09-21T07:35:05.078402+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:26.863467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251125+0000","last_change":"2024-09-21T07:35:03.263373+0000","last_active":"2024-09-21T07:35:04.251125+0000","last_peered":"2024-09-21T07:35:04.251125+0000","last_clean":"2024-09-21T07:35:04.251125+0000","last_became_active":"2024-09-21T07:35:03.263082+0000","last_became_peered":"2024-09-21T07:35:03.263082+0000","last_unstale":"2024-09-21T07:35:04.251125+0000","last_undegraded":"2024-09-21T07:35:04.251125+0000","last_fullsized":"2024-09-21T07:35:04.251125+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:08.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.991066+0000","last_change":"2024-09-21T07:35:02.260372+0000","last_active":"2024-09-21T07:35:04.991066+0000","last_peered":"2024-09-21T07:35:04.991066+0000","last_clean":"2024-09-21T07:35:04.991066+0000","last_became_active":"2024-09-21T07:35:02.260081+0000","last_became_peered":"2024-09-21T07:35:02.260081+0000","last_unstale":"2024-09-21T07:35:04.991066+0000","last_undegraded":"2024-09-21T07:35:04.991066+0000","last_fullsized":"2024-09-21T07:35:04.991066+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:35.413865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857877+0000","last_change":"2024-09-21T07:35:03.257939+0000","last_active":"2024-09-21T07:35:04.857877+0000","last_peered":"2024-09-21T07:35:04.857877+0000","last_clean":"2024-09-21T07:35:04.857877+0000","last_became_active":"2024-09-21T07:35:03.257334+0000","last_became_peered":"2024-09-21T07:35:03.257334+0000","last_unstale":"2024-09-21T07:35:04.857877+0000","last_undegraded":"2024-09-21T07:35:04.857877+0000","last_fullsized":"2024-09-21T07:35:04.857877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:17.503276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.858012+0000","last_change":"2024-09-21T07:35:02.258379+0000","last_active":"2024-09-21T07:35:04.858012+0000","last_peered":"2024-09-21T07:35:04.858012+0000","last_clean":"2024-09-21T07:35:04.858012+0000","last_became_active":"2024-09-21T07:35:02.258050+0000","last_became_peered":"2024-09-21T07:35:02.258050+0000","last_unstale":"2024-09-21T07:35:04.858012+0000","last_undegraded":"2024-09-21T07:35:04.858012+0000","last_fullsized":"2024-09-21T07:35:04.858012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:22.638540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857918+0000","last_change":"2024-09-21T07:35:03.262155+0000","last_active":"2024-09-21T07:35:04.857918+0000","last_peered":"2024-09-21T07:35:04.857918+0000","last_clean":"2024-09-21T07:35:04.857918+0000","last_became_active":"2024-09-21T07:35:03.261855+0000","last_became_peered":"2024-09-21T07:35:03.261855+0000","last_unstale":"2024-09-21T07:35:04.857918+0000","last_undegraded":"2024-09-21T07:35:04.857918+0000","last_fullsized":"2024-09-21T07:35:04.857918+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:51.512188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251836+0000","last_change":"2024-09-21T07:35:02.247540+0000","last_active":"2024-09-21T07:35:04.251836+0000","last_peered":"2024-09-21T07:35:04.251836+0000","last_clean":"2024-09-21T07:35:04.251836+0000","last_became_active":"2024-09-21T07:35:02.246243+0000","last_became_peered":"2024-09-21T07:35:02.246243+0000","last_unstale":"2024-09-21T07:35:04.251836+0000","last_undegraded":"2024-09-21T07:35:04.251836+0000","last_fullsized":"2024-09-21T07:35:04.251836+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:04.959628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250000+0000","last_change":"2024-09-21T07:35:03.273184+0000","last_active":"2024-09-21T07:35:04.250000+0000","last_peered":"2024-09-21T07:35:04.250000+0000","last_clean":"2024-09-21T07:35:04.250000+0000","last_became_active":"2024-09-21T07:35:03.272844+0000","last_became_peered":"2024-09-21T07:35:03.272844+0000","last_unstale":"2024-09-21T07:35:04.250000+0000","last_undegraded":"2024-09-21T07:35:04.250000+0000","last_fullsized":"2024-09-21T07:35:04.250000+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:20.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045826+0000","last_change":"2024-09-21T07:35:02.252337+0000","last_active":"2024-09-21T07:35:05.045826+0000","last_peered":"2024-09-21T07:35:05.045826+0000","last_clean":"2024-09-21T07:35:05.045826+0000","last_became_active":"2024-09-21T07:35:02.250853+0000","last_became_peered":"2024-09-21T07:35:02.250853+0000","last_unstale":"2024-09-21T07:35:05.045826+0000","last_undegraded":"2024-09-21T07:35:05.045826+0000","last_fullsized":"2024-09-21T07:35:05.045826+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:27.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251676+0000","last_change":"2024-09-21T07:35:03.265169+0000","last_active":"2024-09-21T07:35:04.251676+0000","last_peered":"2024-09-21T07:35:04.251676+0000","last_clean":"2024-09-21T07:35:04.251676+0000","last_became_active":"2024-09-21T07:35:03.264816+0000","last_became_peered":"2024-09-21T07:35:03.264816+0000","last_unstale":"2024-09-21T07:35:04.251676+0000","last_undegraded":"2024-09-21T07:35:04.251676+0000","last_fullsized":"2024-09-21T07:35:04.251676+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:19.005610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"177'2","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.858168+0000","last_change":"2024-09-21T07:35:02.254083+0000","last_active":"2024-09-21T07:35:04.858168+0000","last_peered":"2024-09-21T07:35:04.858168+0000","last_clean":"2024-09-21T07:35:04.858168+0000","last_became_active":"2024-09-21T07:35:02.253685+0000","last_became_peered":"2024-09-21T07:35:02.253685+0000","last_unstale":"2024-09-21T07:35:04.858168+0000","last_undegraded":"2024-09-21T07:35:04.858168+0000","last_fullsized":"2024-09-21T07:35:04.858168+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:30.106555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251931+0000","last_change":"2024-09-21T07:35:03.265763+0000","last_active":"2024-09-21T07:35:04.251931+0000","last_peered":"2024-09-21T07:35:04.251931+0000","last_clean":"2024-09-21T07:35:04.251931+0000","last_became_active":"2024-09-21T07:35:03.265458+0000","last_became_peered":"2024-09-21T07:35:03.265458+0000","last_unstale":"2024-09-21T07:35:04.251931+0000","last_undegraded":"2024-09-21T07:35:04.251931+0000","last_fullsized":"2024-09-21T07:35:04.251931+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:27.100874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"178'1","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251808+0000","last_change":"2024-09-21T07:35:02.244930+0000","last_active":"2024-09-21T07:35:04.251808+0000","last_peered":"2024-09-21T07:35:04.251808+0000","last_clean":"2024-09-21T07:35:04.251808+0000","last_became_active":"2024-09-21T07:35:02.244374+0000","last_became_peered":"2024-09-21T07:35:02.244374+0000","last_unstale":"2024-09-21T07:35:04.251808+0000","last_undegraded":"2024-09-21T07:35:04.251808+0000","last_fullsized":"2024-09-21T07:35:04.251808+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:53.813216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079598+0000","last_change":"2024-09-21T07:35:03.269506+0000","last_active":"2024-09-21T07:35:05.079598+0000","last_peered":"2024-09-21T07:35:05.079598+0000","last_clean":"2024-09-21T07:35:05.079598+0000","last_became_active":"2024-09-21T07:35:03.267171+0000","last_became_peered":"2024-09-21T07:35:03.267171+0000","last_unstale":"2024-09-21T07:35:05.079598+0000","last_undegraded":"2024-09-21T07:35:05.079598+0000","last_fullsized":"2024-09-21T07:35:05.079598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:19.131661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.251322+0000","last_change":"2024-09-21T07:35:02.255663+0000","last_active":"2024-09-21T07:35:04.251322+0000","last_peered":"2024-09-21T07:35:04.251322+0000","last_clean":"2024-09-21T07:35:04.251322+0000","last_became_active":"2024-09-21T07:35:02.254828+0000","last_became_peered":"2024-09-21T07:35:02.254828+0000","last_unstale":"2024-09-21T07:35:04.251322+0000","last_undegraded":"2024-09-21T07:35:04.251322+0000","last_fullsized":"2024-09-21T07:35:04.251322+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:29.571173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252566+0000","last_change":"2024-09-21T07:35:03.266972+0000","last_active":"2024-09-21T07:35:04.252566+0000","last_peered":"2024-09-21T07:35:04.252566+0000","last_clean":"2024-09-21T07:35:04.252566+0000","last_became_active":"2024-09-21T07:35:03.266289+0000","last_became_peered":"2024-09-21T07:35:03.266289+0000","last_unstale":"2024-09-21T07:35:04.252566+0000","last_undegraded":"2024-09-21T07:35:04.252566+0000","last_fullsized":"2024-09-21T07:35:04.252566+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:36.372073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250706+0000","last_change":"2024-09-21T07:35:02.250656+0000","last_active":"2024-09-21T07:35:04.250706+0000","last_peered":"2024-09-21T07:35:04.250706+0000","last_clean":"2024-09-21T07:35:04.250706+0000","last_became_active":"2024-09-21T07:35:02.250329+0000","last_became_peered":"2024-09-21T07:35:02.250329+0000","last_unstale":"2024-09-21T07:35:04.250706+0000","last_undegraded":"2024-09-21T07:35:04.250706+0000","last_fullsized":"2024-09-21T07:35:04.250706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.341710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045587+0000","last_change":"2024-09-21T07:35:03.259100+0000","last_active":"2024-09-21T07:35:05.045587+0000","last_peered":"2024-09-21T07:35:05.045587+0000","last_clean":"2024-09-21T07:35:05.045587+0000","last_became_active":"2024-09-21T07:35:03.258799+0000","last_became_peered":"2024-09-21T07:35:03.258799+0000","last_unstale":"2024-09-21T07:35:05.045587+0000","last_undegraded":"2024-09-21T07:35:05.045587+0000","last_fullsized":"2024-09-21T07:35:05.045587+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:04.867959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079012+0000","last_change":"2024-09-21T07:35:02.250574+0000","last_active":"2024-09-21T07:35:05.079012+0000","last_peered":"2024-09-21T07:35:05.079012+0000","last_clean":"2024-09-21T07:35:05.079012+0000","last_became_active":"2024-09-21T07:35:02.250234+0000","last_became_peered":"2024-09-21T07:35:02.250234+0000","last_unstale":"2024-09-21T07:35:05.079012+0000","last_undegraded":"2024-09-21T07:35:05.079012+0000","last_fullsized":"2024-09-21T07:35:05.079012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:37.854681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.990491+0000","last_change":"2024-09-21T07:35:03.264721+0000","last_active":"2024-09-21T07:35:04.990491+0000","last_peered":"2024-09-21T07:35:04.990491+0000","last_clean":"2024-09-21T07:35:04.990491+0000","last_became_active":"2024-09-21T07:35:03.264256+0000","last_became_peered":"2024-09-21T07:35:03.264256+0000","last_unstale":"2024-09-21T07:35:04.990491+0000","last_undegraded":"2024-09-21T07:35:04.990491+0000","last_fullsized":"2024-09-21T07:35:04.990491+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:30.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078769+0000","last_change":"2024-09-21T07:35:02.255595+0000","last_active":"2024-09-21T07:35:05.078769+0000","last_peered":"2024-09-21T07:35:05.078769+0000","last_clean":"2024-09-21T07:35:05.078769+0000","last_became_active":"2024-09-21T07:35:02.255252+0000","last_became_peered":"2024-09-21T07:35:02.255252+0000","last_unstale":"2024-09-21T07:35:05.078769+0000","last_undegraded":"2024-09-21T07:35:05.078769+0000","last_fullsized":"2024-09-21T07:35:05.078769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:26.903296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.252566+0000","last_change":"2024-09-21T07:35:03.261980+0000","last_active":"2024-09-21T07:35:04.252566+0000","last_peered":"2024-09-21T07:35:04.252566+0000","last_clean":"2024-09-21T07:35:04.252566+0000","last_became_active":"2024-09-21T07:35:03.261582+0000","last_became_peered":"2024-09-21T07:35:03.261582+0000","last_unstale":"2024-09-21T07:35:04.252566+0000","last_undegraded":"2024-09-21T07:35:04.252566+0000","last_fullsized":"2024-09-21T07:35:04.252566+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:48.465214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.250601+0000","last_change":"2024-09-21T07:35:02.254958+0000","last_active":"2024-09-21T07:35:04.250601+0000","last_peered":"2024-09-21T07:35:04.250601+0000","last_clean":"2024-09-21T07:35:04.250601+0000","last_became_active":"2024-09-21T07:35:02.253119+0000","last_became_peered":"2024-09-21T07:35:02.253119+0000","last_unstale":"2024-09-21T07:35:04.250601+0000","last_undegraded":"2024-09-21T07:35:04.250601+0000","last_fullsized":"2024-09-21T07:35:04.250601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:58.493266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.079321+0000","last_change":"2024-09-21T07:35:03.275353+0000","last_active":"2024-09-21T07:35:05.079321+0000","last_peered":"2024-09-21T07:35:05.079321+0000","last_clean":"2024-09-21T07:35:05.079321+0000","last_became_active":"2024-09-21T07:35:03.275033+0000","last_became_peered":"2024-09-21T07:35:03.275033+0000","last_unstale":"2024-09-21T07:35:05.079321+0000","last_undegraded":"2024-09-21T07:35:05.079321+0000","last_fullsized":"2024-09-21T07:35:05.079321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:52.384866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045641+0000","last_change":"2024-09-21T07:35:02.257732+0000","last_active":"2024-09-21T07:35:05.045641+0000","last_peered":"2024-09-21T07:35:05.045641+0000","last_clean":"2024-09-21T07:35:05.045641+0000","last_became_active":"2024-09-21T07:35:02.257428+0000","last_became_peered":"2024-09-21T07:35:02.257428+0000","last_unstale":"2024-09-21T07:35:05.045641+0000","last_undegraded":"2024-09-21T07:35:05.045641+0000","last_fullsized":"2024-09-21T07:35:05.045641+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:51.182236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.045775+0000","last_change":"2024-09-21T07:35:03.262516+0000","last_active":"2024-09-21T07:35:05.045775+0000","last_peered":"2024-09-21T07:35:05.045775+0000","last_clean":"2024-09-21T07:35:05.045775+0000","last_became_active":"2024-09-21T07:35:03.261901+0000","last_became_peered":"2024-09-21T07:35:03.261901+0000","last_unstale":"2024-09-21T07:35:05.045775+0000","last_undegraded":"2024-09-21T07:35:05.045775+0000","last_fullsized":"2024-09-21T07:35:05.045775+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:02.222436+0000","last_clean_scrub_stamp":"2024-09-21T07:35:02.222436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:53.436327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:04.857658+0000","last_change":"2024-09-21T07:35:02.254903+0000","last_active":"2024-09-21T07:35:04.857658+0000","last_peered":"2024-09-21T07:35:04.857658+0000","last_clean":"2024-09-21T07:35:04.857658+0000","last_became_active":"2024-09-21T07:35:02.254530+0000","last_became_peered":"2024-09-21T07:35:02.254530+0000","last_unstale":"2024-09-21T07:35:04.857658+0000","last_undegraded":"2024-09-21T07:35:04.857658+0000","last_fullsized":"2024-09-21T07:35:04.857658+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:01.219487+0000","last_clean_scrub_stamp":"2024-09-21T07:35:01.219487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:19.672136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":397,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T07:35:05.078709+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:05.078709+0000","last_peered":"2024-09-21T07:35:05.078709+0000","last_clean":"2024-09-21T07:35:05.078709+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:05.078709+0000","last_undegraded":"2024-09-21T07:35:05.078709+0000","last_fullsized":"2024-09-21T07:35:05.078709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509594,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51424,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320416,"statfs":{"total":96636764160,"available":96584105984,"internally_reserved":0,"allocated":2236416,"data_stored":1054854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509594,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51432,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320408,"statfs":{"total":96636764160,"available":96584097792,"internally_reserved":0,"allocated":2248704,"data_stored":1056418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509594,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59756,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312084,"statfs":{"total":96636764160,"available":96575574016,"internally_reserved":0,"allocated":2248704,"data_stored":1056430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509594,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2236416,"data_stored":1055366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2232320,"data_stored":1054784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509594,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56172,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315668,"statfs":{"total":96636764160,"available":96579244032,"internally_reserved":0,"allocated":2842624,"data_stored":1645880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542298,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1645152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83296,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94288544,"statfs":{"total":96636764160,"available":96551469056,"internally_reserved":0,"allocated":2240512,"data_stored":1054944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:35:12.558 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:35:12.558 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:35:12.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- 172.21.15.64:0/3236242720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c15ec20 msgr2=0x7ff26c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 --2- 172.21.15.64:0/3236242720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c15ec20 0x7ff26c0ce740 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009900 tx=0x7ff25c01c7c0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- 172.21.15.64:0/3236242720 shutdown_connections 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 --2- 172.21.15.64:0/3236242720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c15ec20 0x7ff26c0ce740 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- 172.21.15.64:0/3236242720 >> 172.21.15.64:0/3236242720 conn(0x7ff26c0ccbe0 msgr2=0x7ff26c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- 172.21.15.64:0/3236242720 shutdown_connections 2024-09-21T07:35:12.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- 172.21.15.64:0/3236242720 wait complete. 2024-09-21T07:35:12.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 Processor -- start 2024-09-21T07:35:12.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.765+0000 7ff273c00640 1 -- start start 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff26c0ca990 0x7ff26c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff26c15ec20 0x7ff26c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c16a2c0 con 0x7ff26c152d70 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c16a140 con 0x7ff26c15ec20 2024-09-21T07:35:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c16a440 con 0x7ff26c0ca990 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39970/0 (socket says 172.21.15.64:39970) 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 -- 172.21.15.64:0/4037515663 learned_addr learned my addr 172.21.15.64:0/4037515663 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff263e00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff26c15ec20 0x7ff26c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271200640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff26c0ca990 0x7ff26c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 -- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff26c0ca990 msgr2=0x7ff26c0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff26c0ca990 0x7ff26c0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 -- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff26c15ec20 msgr2=0x7ff26c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff26c15ec20 0x7ff26c0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 -- 172.21.15.64:0/4037515663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c154830 con 0x7ff26c152d70 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff271c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b9e0 tx=0x7ff26400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264003b80 con 0x7ff26c152d70 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff264003e10 con 0x7ff26c152d70 2024-09-21T07:35:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26400cb80 con 0x7ff26c152d70 2024-09-21T07:35:12.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c154b10 con 0x7ff26c152d70 2024-09-21T07:35:12.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c0ae7f0 con 0x7ff26c152d70 2024-09-21T07:35:12.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.769+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c154580 con 0x7ff26c152d70 2024-09-21T07:35:12.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.773+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff264006d10 con 0x7ff26c152d70 2024-09-21T07:35:12.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.773+0000 7ff269600640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 0x7ff248075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:12.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.773+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7ff264093fe0 con 0x7ff26c152d70 2024-09-21T07:35:12.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.773+0000 7ff271200640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 0x7ff248075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:12.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.773+0000 7ff271200640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 0x7ff248075710 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0af000 tx=0x7ff25c01b000 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:12.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:12.777+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff26405ee10 con 0x7ff26c152d70 2024-09-21T07:35:13.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.021+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff26c0ce740 con 0x7ff26c152d70 2024-09-21T07:35:13.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.025+0000 7ff269600640 1 -- 172.21.15.64:0/4037515663 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v35) ==== 190+0+147 (secure 0 0 0) 0x7ff26405e710 con 0x7ff26c152d70 2024-09-21T07:35:13.027 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:35:13.027 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:35:13.028 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:35:13.028 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:35:13.028 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:35:13.028 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:35:13.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 msgr2=0x7ff248075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 0x7ff248075710 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0af000 tx=0x7ff25c01b000 comp rx=0 tx=0).stop 2024-09-21T07:35:13.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 msgr2=0x7ff26c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b9e0 tx=0x7ff26400bea0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 shutdown_connections 2024-09-21T07:35:13.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff248073200 0x7ff248075710 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff26c152d70 0x7ff26c15a770 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff26c15ec20 0x7ff26c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 --2- 172.21.15.64:0/4037515663 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff26c0ca990 0x7ff26c0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 >> 172.21.15.64:0/4037515663 conn(0x7ff26c0ccbe0 msgr2=0x7ff26c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:13.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 shutdown_connections 2024-09-21T07:35:13.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.029+0000 7ff273c00640 1 -- 172.21.15.64:0/4037515663 wait complete. 2024-09-21T07:35:13.050 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 -- 172.21.15.64:0/3747903078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 msgr2=0x7f016c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 --2- 172.21.15.64:0/3747903078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0b41c0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f0154009900 tx=0x7f015401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 -- 172.21.15.64:0/3747903078 shutdown_connections 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 --2- 172.21.15.64:0/3747903078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c0b4700 0x7f016c072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 --2- 172.21.15.64:0/3747903078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0b41c0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 -- 172.21.15.64:0/3747903078 >> 172.21.15.64:0/3747903078 conn(0x7f016c0ccbe0 msgr2=0x7f016c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 -- 172.21.15.64:0/3747903078 shutdown_connections 2024-09-21T07:35:13.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.205+0000 7f0170e00640 1 -- 172.21.15.64:0/3747903078 wait complete. 2024-09-21T07:35:13.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 Processor -- start 2024-09-21T07:35:13.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- start start 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f016c0b4700 0x7f016c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c15edb0 0x7f016c09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f016c168c90 con 0x7f016c0709b0 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f016c168b10 con 0x7f016c0b4700 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f016c168e10 con 0x7f016c15edb0 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39982/0 (socket says 172.21.15.64:39982) 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 -- 172.21.15.64:0/3689938680 learned_addr learned my addr 172.21.15.64:0/3689938680 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0163e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f016c0b4700 0x7f016c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f016a800640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c15edb0 0x7f016c09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 -- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c15edb0 msgr2=0x7f016c09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c15edb0 0x7f016c09bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 -- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f016c0b4700 msgr2=0x7f016c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f016c0b4700 0x7f016c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 -- 172.21.15.64:0/3689938680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0c4d80 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0169e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c3f0 tx=0x7f015c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c017070 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f015c0053c0 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c003860 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c0c5020 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.209+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c15cd80 con 0x7f016c0709b0 2024-09-21T07:35:13.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.213+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f016c0b41c0 con 0x7f016c0709b0 2024-09-21T07:35:13.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.213+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f015c01a070 con 0x7f016c0709b0 2024-09-21T07:35:13.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.213+0000 7f0162000640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 0x7f0148075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:13.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.213+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f015c0936b0 con 0x7f016c0709b0 2024-09-21T07:35:13.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.213+0000 7f0163e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 0x7f0148075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:13.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.217+0000 7f0163e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 0x7f0148075770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f01540af000 tx=0x7f015401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:13.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.217+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f016c0b4b10 con 0x7f016c0709b0 2024-09-21T07:35:13.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.429+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f016c09da20 con 0x7f016c0709b0 2024-09-21T07:35:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.429+0000 7f0162000640 1 -- 172.21.15.64:0/3689938680 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5233 (secure 0 0 0) 0x7f015c05de50 con 0x7f016c0709b0 2024-09-21T07:35:13.432 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:13.432 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":133,"btime":"2024-09-21T07:35:06:274222+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":10065,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127}],"filesystems":[{"mdsmap":{"epoch":133,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:05.695775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:13.432 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 133 2024-09-21T07:35:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 msgr2=0x7f0148075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 0x7f0148075770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f01540af000 tx=0x7f015401b120 comp rx=0 tx=0).stop 2024-09-21T07:35:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 msgr2=0x7f016c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:13.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c3f0 tx=0x7f015c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 shutdown_connections 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0148073260 0x7f0148075770 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f016c15edb0 0x7f016c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f016c0b4700 0x7f016c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 --2- 172.21.15.64:0/3689938680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f016c0709b0 0x7f016c0cab00 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 >> 172.21.15.64:0/3689938680 conn(0x7f016c0ccbe0 msgr2=0x7f016c159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 shutdown_connections 2024-09-21T07:35:13.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:13.433+0000 7f0170e00640 1 -- 172.21.15.64:0/3689938680 wait complete. 2024-09-21T07:35:13.866 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 133, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:35:02.669172+0000', 'modified': '2024-09-21T07:35:05.695775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10068': {'gid': 10068, 'name': 'a', 'rank': 0, 'incarnation': 129, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/650567742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 650567742}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 650567742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10068, 'qdb_cluster': [10068]} 2024-09-21T07:35:13.866 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:35:13.866 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 -- 172.21.15.64:0/2861295304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 msgr2=0x7fdacc15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 --2- 172.21.15.64:0/2861295304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc15ee70 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fdacc072db0 tx=0x7fdab801c880 comp rx=0 tx=0).stop 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 -- 172.21.15.64:0/2861295304 shutdown_connections 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 --2- 172.21.15.64:0/2861295304 >> v2:172.21.15.90:3300/0 conn(0x7fdacc0ce4d0 0x7fdacc0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 --2- 172.21.15.64:0/2861295304 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc15ee70 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 -- 172.21.15.64:0/2861295304 >> 172.21.15.64:0/2861295304 conn(0x7fdacc06d450 msgr2=0x7fdacc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 -- 172.21.15.64:0/2861295304 shutdown_connections 2024-09-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.025+0000 7fdad3800640 1 -- 172.21.15.64:0/2861295304 wait complete. 2024-09-21T07:35:14.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 Processor -- start 2024-09-21T07:35:14.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 -- start start 2024-09-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdacc0cc960 0x7fdacc158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdacc0ce4d0 0x7fdacc1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc168d00 con 0x7fdacc0b3850 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc168b80 con 0x7fdacc0ce4d0 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad3800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc168e80 con 0x7fdacc0cc960 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40012/0 (socket says 172.21.15.64:40012) 2024-09-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad0e00640 1 -- 172.21.15.64:0/1637235102 learned_addr learned my addr 172.21.15.64:0/1637235102 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdad1800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdacc0ce4d0 0x7fdacc1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.029+0000 7fdacbe00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdacc0cc960 0x7fdacc158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 -- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdacc0cc960 msgr2=0x7fdacc158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdacc0cc960 0x7fdacc158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 -- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdacc0ce4d0 msgr2=0x7fdacc1645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdacc0ce4d0 0x7fdacc1645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 -- 172.21.15.64:0/1637235102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc1f8a90 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad0e00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3f0 tx=0x7fdac000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdac8c00640 1 -- 172.21.15.64:0/1637235102 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0015020 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdac8c00640 1 -- 172.21.15.64:0/1637235102 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac0011940 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdac8c00640 1 -- 172.21.15.64:0/1637235102 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011d90 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdacc165690 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc1f8d10 con 0x7fdacc0b3850 2024-09-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.033+0000 7fdac8c00640 1 -- 172.21.15.64:0/1637235102 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdac0018020 con 0x7fdacc0b3850 2024-09-21T07:35:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdac8c00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 0x7fdaac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdac8c00640 1 -- 172.21.15.64:0/1637235102 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fdac0094290 con 0x7fdacc0b3850 2024-09-21T07:35:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 0x7fdaac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 Processor -- start 2024-09-21T07:35:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 -- start start 2024-09-21T07:35:14.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 0x7fdaac075710 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdab80af000 tx=0x7fdab80b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 0x5586e91a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e903eca0 0x5586e91a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586e907b410 con 0x5586e9055950 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586e8fb8b40 con 0x5586e8c65460 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5586e8fa7f70 con 0x5586e903eca0 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 0x5586e91a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40016/0 (socket says 172.21.15.64:40016) 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 -- 172.21.15.64:0/3800640636 learned_addr learned my addr 172.21.15.64:0/3800640636 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad1800640 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e903eca0 0x5586e91a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 -- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e903eca0 msgr2=0x5586e91a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e903eca0 0x5586e91a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 -- 172.21.15.64:0/3800640636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 msgr2=0x5586e91a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 -- 172.21.15.64:0/3800640636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e8f6f5b0 con 0x5586e8c65460 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdacbe00640 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:14.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdad0e00640 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 0x5586e91a66a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3c0 tx=0x7fdac005ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=727dd68a7d2aa138 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.037+0000 7fdabd600640 1 -- 172.21.15.64:0/3800640636 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0063580 con 0x5586e8c65460 2024-09-21T07:35:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdabd600640 1 -- 172.21.15.64:0/3800640636 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac00683a0 con 0x5586e8c65460 2024-09-21T07:35:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdabd600640 1 -- 172.21.15.64:0/3800640636 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0063380 con 0x5586e8c65460 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 msgr2=0x5586e91a66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 0x5586e91a66a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3c0 tx=0x7fdac005ea50 comp rx=0 tx=0).stop 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3800640636 shutdown_connections 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e903eca0 0x5586e91a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e9055950 0x5586e91a6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3800640636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e8c65460 0x5586e91a66a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3800640636 >> 172.21.15.64:0/3800640636 conn(0x5586e912bd90 msgr2=0x5586e915b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3800640636 shutdown_connections 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3800640636 wait complete. 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- start start 2024-09-21T07:35:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 Processor -- start 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e91ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586e8f425f0 con 0x5586e903eca0 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586e8fabd80 con 0x5586e9055950 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5586e8f4e520 con 0x5586e8c65460 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdadaf3c000 10 client.0 _ll_register_callbacks cb 0x5586e8f52830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.041+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40022/0 (socket says 172.21.15.64:40022) 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 -- 172.21.15.64:0/2770027815 learned_addr learned my addr 172.21.15.64:0/2770027815 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdad1800640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e91ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 -- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 msgr2=0x5586e91ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 -- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 msgr2=0x5586e91ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e91ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 -- 172.21.15.64:0/2770027815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e8f46190 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fdab801cd60 tx=0x7fdab8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae855f30b268b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80cc060 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fdab8003cd0 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586e8f40110 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fdab80c7420 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 10 client.10230 fetch_fsmap learned FSMap version 133 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x5586e902cf10 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5586e8f40110 con 0x5586e903eca0 2024-09-21T07:35:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 133) ==== 3502+0+0 (secure 0 0 0) 0x7fdab80ba070 con 0x5586e903eca0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 10 client.10230 fetch_fsmap finished waiting for FSMap version 133 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 10 client.10230 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 20 client.10230 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c4a7d0 0x5586e91b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 4 client.10230 mds_command: new command op to 10068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 --> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586e8fbaa90 con 0x5586e8c4a7d0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c4a7d0 0x5586e91b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c4a7d0 0x5586e91b7d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76358a93918d4bd server_cookie=6f29274330fe5ca2 in_seq=0 out_seq=0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 10 client.10230 ms_handle_connect on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 1 -- 172.21.15.64:0/2770027815 <== mds.0 v2:172.21.15.64:6834/650567742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586e8fbaa90 con 0x5586e8c4a7d0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 10 client.10230 handle_command_reply: tid=0 2024-09-21T07:35:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 client.10230 shutdown 2024-09-21T07:35:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 msgr2=0x5586e91ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fdab801cd60 tx=0x7fdab8009260 comp rx=0 tx=0).stop 2024-09-21T07:35:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 shutdown_connections 2024-09-21T07:35:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c4a7d0 0x5586e91b7d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e91ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91ade60 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2770027815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdab2000640 0 client.10230 ms_handle_reset on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.045+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 >> 172.21.15.64:0/2770027815 conn(0x5586e912bd90 msgr2=0x5586e9162440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.049+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 shutdown_connections 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.049+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2770027815 wait complete. 2024-09-21T07:35:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.049+0000 7fdadaf3c000 20 client.10230 trim_cache size 0 max 16384 2024-09-21T07:35:14.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.065+0000 7fdadaf3c000 1 Processor -- start 2024-09-21T07:35:14.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.065+0000 7fdadaf3c000 1 -- start start 2024-09-21T07:35:14.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91a5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e915acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc205ad0 con 0x5586e903eca0 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc204ab0 con 0x5586e9055950 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc1fca80 con 0x5586e8c65460 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40032/0 (socket says 172.21.15.64:40032) 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 -- 172.21.15.64:0/3352026133 learned_addr learned my addr 172.21.15.64:0/3352026133 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdad0e00640 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdad1800640 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e915acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 -- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 msgr2=0x5586e91a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 -- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 msgr2=0x5586e915acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e915acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 -- 172.21.15.64:0/3352026133 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e9003db0 con 0x5586e903eca0 2024-09-21T07:35:14.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdacbe00640 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000c10 tx=0x7fdab8003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50581d54507c10f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdabcc00640 1 -- 172.21.15.64:0/3352026133 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80cc070 con 0x5586e903eca0 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdabcc00640 1 -- 172.21.15.64:0/3352026133 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdab80c7900 con 0x5586e903eca0 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdabcc00640 1 -- 172.21.15.64:0/3352026133 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80c7d10 con 0x5586e903eca0 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3352026133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 msgr2=0x5586e91a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000c10 tx=0x7fdab8003b80 comp rx=0 tx=0).stop 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3352026133 shutdown_connections 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e9055950 0x5586e915acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e903eca0 0x5586e91a5b70 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/3352026133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e8c65460 0x5586e91a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3352026133 >> 172.21.15.64:0/3352026133 conn(0x5586e912bd90 msgr2=0x5586e91680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3352026133 shutdown_connections 2024-09-21T07:35:14.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- 172.21.15.64:0/3352026133 wait complete. 2024-09-21T07:35:14.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 -- start start 2024-09-21T07:35:14.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.069+0000 7fdadaf3c000 1 Processor -- start 2024-09-21T07:35:14.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e903eca0 0x5586e915e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e9055950 0x5586e91d8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586e8fb7910 con 0x5586e8c65460 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586e902ca80 con 0x5586e903eca0 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5586e9067750 con 0x5586e9055950 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 10 client.0 _ll_register_callbacks cb 0x7fdab80044f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40040/0 (socket says 172.21.15.64:40040) 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 -- 172.21.15.64:0/2500470765 learned_addr learned my addr 172.21.15.64:0/2500470765 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad1800640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e9055950 0x5586e91d8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e903eca0 0x5586e915e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 -- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e9055950 msgr2=0x5586e91d8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e9055950 0x5586e91d8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 -- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e903eca0 msgr2=0x5586e915e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e903eca0 0x5586e915e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 -- 172.21.15.64:0/2500470765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e8f6eab0 con 0x5586e8c65460 2024-09-21T07:35:14.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdad0e00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3c0 tx=0x7fdac001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d54b50c1323c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac005a9f0 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdab80c7900 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fdac0063120 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fdac0063580 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 10 client.10236 fetch_fsmap learned FSMap version 133 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x5586e8f4d070 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdab80c7900 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 133) ==== 3502+0+0 (secure 0 0 0) 0x7fdac0074b30 con 0x5586e8c65460 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 10 client.10236 fetch_fsmap finished waiting for FSMap version 133 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 10 client.10236 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 20 client.10236 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c38830 0x5586e91d8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 4 client.10236 mds_command: new command op to 10068 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:35:14.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 --> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] -- command(tid 0: {"prefix": "status"}) -- 0x5586e8fb6540 con 0x5586e8c38830 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c38830 0x5586e91d8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdab2000640 10 client.10236 ms_handle_connect on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.073+0000 7fdacbe00640 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c38830 0x5586e91d8b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57128737a69131f server_cookie=937f29c23522fc90 in_seq=0 out_seq=0 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdab2000640 1 -- 172.21.15.64:0/2500470765 <== mds.0 v2:172.21.15.64:6834/650567742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x5586e8fb6540 con 0x5586e8c38830 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdab2000640 10 client.10236 handle_command_reply: tid=0 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 client.10236 shutdown 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 msgr2=0x5586e915dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3c0 tx=0x7fdac001c040 comp rx=0 tx=0).stop 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 shutdown_connections 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x5586e8c38830 0x5586e91d8b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5586e9055950 0x5586e91d8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e903eca0 0x5586e915e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdab2000640 0 client.10236 ms_handle_reset on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 --2- 172.21.15.64:0/2500470765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586e8c65460 0x5586e915dcd0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 >> 172.21.15.64:0/2500470765 conn(0x5586e912bd90 msgr2=0x5586e91b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 shutdown_connections 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 1 -- 172.21.15.64:0/2500470765 wait complete. 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdadaf3c000 20 client.10236 trim_cache size 0 max 16384 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 10068, 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:35:14.080 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.847597116999999, 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 133, 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 178, 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 178, 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.287507623 2024-09-21T07:35:14.081 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 msgr2=0x7fdaac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 0x7fdaac075710 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdab80af000 tx=0x7fdab80b2040 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 msgr2=0x7fdacc074080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b3f0 tx=0x7fdac000b8b0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 shutdown_connections 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdaac073200 0x7fdaac075710 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdacc0ce4d0 0x7fdacc1645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdacc0cc960 0x7fdacc158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 --2- 172.21.15.64:0/1637235102 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdacc0b3850 0x7fdacc074080 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 >> 172.21.15.64:0/1637235102 conn(0x7fdacc06d450 msgr2=0x7fdacc15e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 shutdown_connections 2024-09-21T07:35:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.077+0000 7fdad3800640 1 -- 172.21.15.64:0/1637235102 wait complete. 2024-09-21T07:35:14.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- 172.21.15.64:0/2848774051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea8004810 msgr2=0x7f2ea8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 --2- 172.21.15.64:0/2848774051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea8004810 0x7f2ea8004c20 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009b40 tx=0x7f2eb001d250 comp rx=0 tx=0).stop 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- 172.21.15.64:0/2848774051 shutdown_connections 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 --2- 172.21.15.64:0/2848774051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea8004810 0x7f2ea8004c20 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- 172.21.15.64:0/2848774051 >> 172.21.15.64:0/2848774051 conn(0x7f2ec40b2dc0 msgr2=0x7f2ec40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- 172.21.15.64:0/2848774051 shutdown_connections 2024-09-21T07:35:14.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- 172.21.15.64:0/2848774051 wait complete. 2024-09-21T07:35:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 Processor -- start 2024-09-21T07:35:14.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.257+0000 7f2ec9200640 1 -- start start 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 0x7f2ec4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ec40cada0 0x7f2ec40cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec415b540 con 0x7f2ec41e9b60 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec40719b0 con 0x7f2ea8004810 2024-09-21T07:35:14.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec415b6c0 con 0x7f2ec40cada0 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40054/0 (socket says 172.21.15.64:40054) 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 -- 172.21.15.64:0/3482923086 learned_addr learned my addr 172.21.15.64:0/3482923086 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1e00640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 0x7f2ec4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec2800640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ec40cada0 0x7f2ec40cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 -- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ec40cada0 msgr2=0x7f2ec40cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ec40cada0 0x7f2ec40cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 -- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 msgr2=0x7f2ec4154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 0x7f2ec4154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 -- 172.21.15.64:0/3482923086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec40cb6f0 con 0x7f2ec41e9b60 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1e00640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 0x7f2ec4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:14.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec1400640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009a60 tx=0x7f2eb00053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00bb030 con 0x7f2ec41e9b60 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2eb00047c0 con 0x7f2ec41e9b60 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004c10 con 0x7f2ec41e9b60 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec41f9d10 con 0x7f2ec41e9b60 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec41f9230 con 0x7f2ec41e9b60 2024-09-21T07:35:14.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.261+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec40d0890 con 0x7f2ec41e9b60 2024-09-21T07:35:14.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.265+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2eb00be030 con 0x7f2ec41e9b60 2024-09-21T07:35:14.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.265+0000 7f2eba000640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 0x7f2ea4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.265+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f2eb012fbc0 con 0x7f2ec41e9b60 2024-09-21T07:35:14.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.265+0000 7f2ec1e00640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 0x7f2ea4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:14.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.265+0000 7f2ec1e00640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 0x7f2ea4075710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4076ab0 tx=0x7f2eb40067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:14.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.269+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2ec40cb6f0 con 0x7f2ec41e9b60 2024-09-21T07:35:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2ec41ea540 con 0x7f2ec41e9b60 2024-09-21T07:35:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2eba000640 1 -- 172.21.15.64:0/3482923086 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v133) ==== 53+0+73 (secure 0 0 0) 0x7f2eb0016f60 con 0x7f2ec41e9b60 2024-09-21T07:35:14.486 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 msgr2=0x7f2ea4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 0x7f2ea4075710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4076ab0 tx=0x7f2eb40067b0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 msgr2=0x7f2ec41e9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009a60 tx=0x7f2eb00053d0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 shutdown_connections 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2ea4073200 0x7f2ea4075710 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ec40cada0 0x7f2ec40cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ec41e9b60 0x7f2ec41e9f70 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 --2- 172.21.15.64:0/3482923086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea8004810 0x7f2ec4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 >> 172.21.15.64:0/3482923086 conn(0x7f2ec40b2dc0 msgr2=0x7f2ec40b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.485+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 shutdown_connections 2024-09-21T07:35:14.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14.489+0000 7f2ec9200640 1 -- 172.21.15.64:0/3482923086 wait complete. 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:35:14.509 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:35:14.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:14.510 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:35:14.519 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:35:14.519 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:35:14.519 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:35:14.519 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41669sec preferred_lft 41669sec 2024-09-21T07:35:14.520 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:35:14.521 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.522 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:35:14.522 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:35:14.522 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:35:14.522 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:35:14.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:14.522 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:35:14.579 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:35:14.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:14.581 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:35:14.639 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:35:14.639 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:35:14.639 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:35:14.640 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:35:14.640 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:35:14.640 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:14.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:35:14.641 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:35:14.641 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:35:14.641 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:14.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:35:14.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:14.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:14.777 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:35:14.833 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:35:14.833 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:35:14.834 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:35:14.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:14.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:35:14.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:35:14.900 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:35:14.956 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:35:14.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:35:14.957 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:35:15.012 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:35:15.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:15.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:35:15.118 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:35:15.118 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:35:15.132 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:35:15.132 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:35:15.132 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:35:15.132 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:35:15.132 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:35:15.136 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:35:15.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:15.136 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:35:15.156 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:35:15.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:15.263 INFO:teuthology.orchestra.run.smithi064.stdout:client9655 2024-09-21T07:35:15.263 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:15.263 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.0 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:15.272 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:15.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:15.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.393 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165008 s, 63.5 MB/s 2024-09-21T07:35:15.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170499 s, 61.5 MB/s 2024-09-21T07:35:15.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.431 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.431 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157767 s, 66.5 MB/s 2024-09-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157597 s, 66.5 MB/s 2024-09-21T07:35:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143875 s, 72.9 MB/s 2024-09-21T07:35:15.488 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.488 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.488 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188914 s, 55.5 MB/s 2024-09-21T07:35:15.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147509 s, 71.1 MB/s 2024-09-21T07:35:15.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.522 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013725 s, 76.4 MB/s 2024-09-21T07:35:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154224 s, 68.0 MB/s 2024-09-21T07:35:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188027 s, 55.8 MB/s 2024-09-21T07:35:15.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.578 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134718 s, 77.8 MB/s 2024-09-21T07:35:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160561 s, 65.3 MB/s 2024-09-21T07:35:15.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155903 s, 67.3 MB/s 2024-09-21T07:35:15.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143815 s, 72.9 MB/s 2024-09-21T07:35:15.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.647 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.647 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129857 s, 80.7 MB/s 2024-09-21T07:35:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.667 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165794 s, 63.2 MB/s 2024-09-21T07:35:15.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.682 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.682 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124321 s, 84.3 MB/s 2024-09-21T07:35:15.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.699 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.699 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147511 s, 71.1 MB/s 2024-09-21T07:35:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015526 s, 67.5 MB/s 2024-09-21T07:35:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142635 s, 73.5 MB/s 2024-09-21T07:35:15.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130421 s, 80.4 MB/s 2024-09-21T07:35:15.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.766 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.766 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134916 s, 77.7 MB/s 2024-09-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149248 s, 70.3 MB/s 2024-09-21T07:35:15.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127745 s, 82.1 MB/s 2024-09-21T07:35:15.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.817 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146979 s, 71.3 MB/s 2024-09-21T07:35:15.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.832 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.832 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131219 s, 79.9 MB/s 2024-09-21T07:35:15.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.851 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.851 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155001 s, 67.6 MB/s 2024-09-21T07:35:15.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146483 s, 71.6 MB/s 2024-09-21T07:35:15.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.887 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163691 s, 64.1 MB/s 2024-09-21T07:35:15.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.906 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162043 s, 64.7 MB/s 2024-09-21T07:35:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144388 s, 72.6 MB/s 2024-09-21T07:35:15.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:15.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:15.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140318 s, 74.7 MB/s 2024-09-21T07:35:15.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.1 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:15.947 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:15.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:16.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.016 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.016 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134618 s, 77.9 MB/s 2024-09-21T07:35:16.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.040 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.040 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020689 s, 50.7 MB/s 2024-09-21T07:35:16.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.059 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152004 s, 69.0 MB/s 2024-09-21T07:35:16.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.075 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.075 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132195 s, 79.3 MB/s 2024-09-21T07:35:16.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.091 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.091 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130105 s, 80.6 MB/s 2024-09-21T07:35:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149245 s, 70.3 MB/s 2024-09-21T07:35:16.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.127 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.127 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014916 s, 70.3 MB/s 2024-09-21T07:35:16.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.145 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.145 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140872 s, 74.4 MB/s 2024-09-21T07:35:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137707 s, 76.1 MB/s 2024-09-21T07:35:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134483 s, 78.0 MB/s 2024-09-21T07:35:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131025 s, 80.0 MB/s 2024-09-21T07:35:16.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137713 s, 76.1 MB/s 2024-09-21T07:35:16.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130594 s, 80.3 MB/s 2024-09-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015404 s, 68.1 MB/s 2024-09-21T07:35:16.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136258 s, 77.0 MB/s 2024-09-21T07:35:16.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136532 s, 76.8 MB/s 2024-09-21T07:35:16.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.296 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01368 s, 76.7 MB/s 2024-09-21T07:35:16.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.313 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145465 s, 72.1 MB/s 2024-09-21T07:35:16.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137496 s, 76.3 MB/s 2024-09-21T07:35:16.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013282 s, 78.9 MB/s 2024-09-21T07:35:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.360 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112923 s, 92.9 MB/s 2024-09-21T07:35:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.376 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132859 s, 78.9 MB/s 2024-09-21T07:35:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132828 s, 78.9 MB/s 2024-09-21T07:35:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134175 s, 78.1 MB/s 2024-09-21T07:35:16.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148782 s, 70.5 MB/s 2024-09-21T07:35:16.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188467 s, 55.6 MB/s 2024-09-21T07:35:16.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.464 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.464 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136038 s, 77.1 MB/s 2024-09-21T07:35:16.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.480 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136507 s, 76.8 MB/s 2024-09-21T07:35:16.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.496 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013272 s, 79.0 MB/s 2024-09-21T07:35:16.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134301 s, 78.1 MB/s 2024-09-21T07:35:16.529 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.530 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148471 s, 70.6 MB/s 2024-09-21T07:35:16.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.545 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.546 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013288 s, 78.9 MB/s 2024-09-21T07:35:16.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.2 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:16.553 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:16.554 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:16.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:16.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.623 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.623 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147212 s, 71.2 MB/s 2024-09-21T07:35:16.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.640 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150667 s, 69.6 MB/s 2024-09-21T07:35:16.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.656 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131968 s, 79.5 MB/s 2024-09-21T07:35:16.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.676 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170258 s, 61.6 MB/s 2024-09-21T07:35:16.693 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.693 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.693 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145932 s, 71.9 MB/s 2024-09-21T07:35:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152287 s, 68.9 MB/s 2024-09-21T07:35:16.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136998 s, 76.5 MB/s 2024-09-21T07:35:16.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.746 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162297 s, 64.6 MB/s 2024-09-21T07:35:16.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189926 s, 55.2 MB/s 2024-09-21T07:35:16.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152973 s, 68.5 MB/s 2024-09-21T07:35:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138219 s, 75.9 MB/s 2024-09-21T07:35:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153875 s, 68.1 MB/s 2024-09-21T07:35:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.838 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139791 s, 75.0 MB/s 2024-09-21T07:35:16.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133023 s, 78.8 MB/s 2024-09-21T07:35:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135781 s, 77.2 MB/s 2024-09-21T07:35:16.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186967 s, 56.1 MB/s 2024-09-21T07:35:16.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.909 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140853 s, 74.4 MB/s 2024-09-21T07:35:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.930 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179598 s, 58.4 MB/s 2024-09-21T07:35:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.951 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184789 s, 56.7 MB/s 2024-09-21T07:35:16.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.972 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018431 s, 56.9 MB/s 2024-09-21T07:35:16.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:16.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148908 s, 70.4 MB/s 2024-09-21T07:35:17.007 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.007 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.007 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134751 s, 77.8 MB/s 2024-09-21T07:35:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187133 s, 56.0 MB/s 2024-09-21T07:35:17.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013292 s, 78.9 MB/s 2024-09-21T07:35:17.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137849 s, 76.1 MB/s 2024-09-21T07:35:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133856 s, 78.3 MB/s 2024-09-21T07:35:17.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013607 s, 77.1 MB/s 2024-09-21T07:35:17.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138987 s, 75.4 MB/s 2024-09-21T07:35:17.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128631 s, 81.5 MB/s 2024-09-21T07:35:17.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136901 s, 76.6 MB/s 2024-09-21T07:35:17.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128126 s, 81.8 MB/s 2024-09-21T07:35:17.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131218 s, 79.9 MB/s 2024-09-21T07:35:17.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.3 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:17.186 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.296 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133075 s, 78.8 MB/s 2024-09-21T07:35:17.313 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.314 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.314 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150595 s, 69.6 MB/s 2024-09-21T07:35:17.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.329 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.329 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126761 s, 82.7 MB/s 2024-09-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133497 s, 78.5 MB/s 2024-09-21T07:35:17.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.361 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131756 s, 79.6 MB/s 2024-09-21T07:35:17.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189302 s, 55.4 MB/s 2024-09-21T07:35:17.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014101 s, 74.4 MB/s 2024-09-21T07:35:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137114 s, 76.5 MB/s 2024-09-21T07:35:17.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.432 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.432 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131917 s, 79.5 MB/s 2024-09-21T07:35:17.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.447 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119384 s, 87.8 MB/s 2024-09-21T07:35:17.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013008 s, 80.6 MB/s 2024-09-21T07:35:17.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.479 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142341 s, 73.7 MB/s 2024-09-21T07:35:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.497 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143775 s, 72.9 MB/s 2024-09-21T07:35:17.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132034 s, 79.4 MB/s 2024-09-21T07:35:17.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.528 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.528 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132164 s, 79.3 MB/s 2024-09-21T07:35:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133502 s, 78.5 MB/s 2024-09-21T07:35:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.561 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013507 s, 77.6 MB/s 2024-09-21T07:35:17.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151627 s, 69.2 MB/s 2024-09-21T07:35:17.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.596 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015095 s, 69.5 MB/s 2024-09-21T07:35:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.614 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150074 s, 69.9 MB/s 2024-09-21T07:35:17.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.631 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136687 s, 76.7 MB/s 2024-09-21T07:35:17.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147755 s, 71.0 MB/s 2024-09-21T07:35:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.665 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138478 s, 75.7 MB/s 2024-09-21T07:35:17.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.686 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.686 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183665 s, 57.1 MB/s 2024-09-21T07:35:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138675 s, 75.6 MB/s 2024-09-21T07:35:17.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.719 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.719 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135005 s, 77.7 MB/s 2024-09-21T07:35:17.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.736 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.736 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144286 s, 72.7 MB/s 2024-09-21T07:35:17.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134468 s, 78.0 MB/s 2024-09-21T07:35:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.770 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149458 s, 70.2 MB/s 2024-09-21T07:35:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133467 s, 78.6 MB/s 2024-09-21T07:35:17.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.801 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117079 s, 89.6 MB/s 2024-09-21T07:35:17.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014668 s, 71.5 MB/s 2024-09-21T07:35:17.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.4 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:17.826 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:17.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:17.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.895 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152597 s, 68.7 MB/s 2024-09-21T07:35:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137308 s, 76.4 MB/s 2024-09-21T07:35:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191741 s, 54.7 MB/s 2024-09-21T07:35:17.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.952 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.952 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149557 s, 70.1 MB/s 2024-09-21T07:35:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.969 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141307 s, 74.2 MB/s 2024-09-21T07:35:17.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:17.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:17.985 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139235 s, 75.3 MB/s 2024-09-21T07:35:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153004 s, 68.5 MB/s 2024-09-21T07:35:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.019 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132992 s, 78.8 MB/s 2024-09-21T07:35:18.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.035 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133704 s, 78.4 MB/s 2024-09-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173631 s, 60.4 MB/s 2024-09-21T07:35:18.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.073 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.073 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150458 s, 69.7 MB/s 2024-09-21T07:35:18.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.090 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146754 s, 71.5 MB/s 2024-09-21T07:35:18.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.112 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189979 s, 55.2 MB/s 2024-09-21T07:35:18.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.128 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.128 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132038 s, 79.4 MB/s 2024-09-21T07:35:18.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.144 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.144 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129961 s, 80.7 MB/s 2024-09-21T07:35:18.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.160 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.160 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134375 s, 78.0 MB/s 2024-09-21T07:35:18.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.177 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.177 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143319 s, 73.2 MB/s 2024-09-21T07:35:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013447 s, 78.0 MB/s 2024-09-21T07:35:18.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135487 s, 77.4 MB/s 2024-09-21T07:35:18.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142416 s, 73.6 MB/s 2024-09-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01979 s, 53.0 MB/s 2024-09-21T07:35:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145377 s, 72.1 MB/s 2024-09-21T07:35:18.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135014 s, 77.7 MB/s 2024-09-21T07:35:18.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.301 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151948 s, 69.0 MB/s 2024-09-21T07:35:18.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149087 s, 70.3 MB/s 2024-09-21T07:35:18.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141686 s, 74.0 MB/s 2024-09-21T07:35:18.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.350 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129997 s, 80.7 MB/s 2024-09-21T07:35:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132227 s, 79.3 MB/s 2024-09-21T07:35:18.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.382 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129018 s, 81.3 MB/s 2024-09-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145032 s, 72.3 MB/s 2024-09-21T07:35:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131386 s, 79.8 MB/s 2024-09-21T07:35:18.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.435 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.435 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177426 s, 59.1 MB/s 2024-09-21T07:35:18.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.5 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:18.443 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:18.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:18.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135716 s, 77.3 MB/s 2024-09-21T07:35:18.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182341 s, 57.5 MB/s 2024-09-21T07:35:18.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133183 s, 78.7 MB/s 2024-09-21T07:35:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.605 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014541 s, 72.1 MB/s 2024-09-21T07:35:18.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012912 s, 81.2 MB/s 2024-09-21T07:35:18.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.639 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152361 s, 68.8 MB/s 2024-09-21T07:35:18.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.659 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169028 s, 62.0 MB/s 2024-09-21T07:35:18.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.675 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139943 s, 74.9 MB/s 2024-09-21T07:35:18.693 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151959 s, 69.0 MB/s 2024-09-21T07:35:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135265 s, 77.5 MB/s 2024-09-21T07:35:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136617 s, 76.8 MB/s 2024-09-21T07:35:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150644 s, 69.6 MB/s 2024-09-21T07:35:18.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.762 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.763 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138509 s, 75.7 MB/s 2024-09-21T07:35:18.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.780 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.780 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141996 s, 73.8 MB/s 2024-09-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152277 s, 68.9 MB/s 2024-09-21T07:35:18.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.815 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.815 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136539 s, 76.8 MB/s 2024-09-21T07:35:18.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173575 s, 60.4 MB/s 2024-09-21T07:35:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.856 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164387 s, 63.8 MB/s 2024-09-21T07:35:18.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.872 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.872 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130964 s, 80.1 MB/s 2024-09-21T07:35:18.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.889 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.890 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149332 s, 70.2 MB/s 2024-09-21T07:35:18.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184059 s, 57.0 MB/s 2024-09-21T07:35:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145937 s, 71.9 MB/s 2024-09-21T07:35:18.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.943 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122214 s, 85.8 MB/s 2024-09-21T07:35:18.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.964 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188243 s, 55.7 MB/s 2024-09-21T07:35:18.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131348 s, 79.8 MB/s 2024-09-21T07:35:18.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141403 s, 74.2 MB/s 2024-09-21T07:35:19.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.013 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134953 s, 77.7 MB/s 2024-09-21T07:35:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133262 s, 78.7 MB/s 2024-09-21T07:35:19.052 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.052 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.052 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207963 s, 50.4 MB/s 2024-09-21T07:35:19.070 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.070 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.070 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146754 s, 71.5 MB/s 2024-09-21T07:35:19.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.086 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131489 s, 79.7 MB/s 2024-09-21T07:35:19.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.103 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139117 s, 75.4 MB/s 2024-09-21T07:35:19.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.6 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:19.110 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:19.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:19.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.178 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.178 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133695 s, 78.4 MB/s 2024-09-21T07:35:19.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.194 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130704 s, 80.2 MB/s 2024-09-21T07:35:19.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132111 s, 79.4 MB/s 2024-09-21T07:35:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018761 s, 55.9 MB/s 2024-09-21T07:35:19.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136892 s, 76.6 MB/s 2024-09-21T07:35:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.271 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198069 s, 52.9 MB/s 2024-09-21T07:35:19.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.288 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014039 s, 74.7 MB/s 2024-09-21T07:35:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131727 s, 79.6 MB/s 2024-09-21T07:35:19.320 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.320 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.320 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133857 s, 78.3 MB/s 2024-09-21T07:35:19.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135691 s, 77.3 MB/s 2024-09-21T07:35:19.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146018 s, 71.8 MB/s 2024-09-21T07:35:19.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.370 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013889 s, 75.5 MB/s 2024-09-21T07:35:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182609 s, 57.4 MB/s 2024-09-21T07:35:19.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154941 s, 67.7 MB/s 2024-09-21T07:35:19.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133987 s, 78.3 MB/s 2024-09-21T07:35:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154197 s, 68.0 MB/s 2024-09-21T07:35:19.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013777 s, 76.1 MB/s 2024-09-21T07:35:19.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180739 s, 58.0 MB/s 2024-09-21T07:35:19.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.496 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.496 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131709 s, 79.6 MB/s 2024-09-21T07:35:19.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.514 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.514 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150832 s, 69.5 MB/s 2024-09-21T07:35:19.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.530 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135436 s, 77.4 MB/s 2024-09-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131643 s, 79.7 MB/s 2024-09-21T07:35:19.562 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134926 s, 77.7 MB/s 2024-09-21T07:35:19.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133964 s, 78.3 MB/s 2024-09-21T07:35:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.595 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139353 s, 75.2 MB/s 2024-09-21T07:35:19.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188622 s, 55.6 MB/s 2024-09-21T07:35:19.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135695 s, 77.3 MB/s 2024-09-21T07:35:19.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.652 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156145 s, 67.2 MB/s 2024-09-21T07:35:19.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141939 s, 73.9 MB/s 2024-09-21T07:35:19.690 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.690 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.690 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189476 s, 55.3 MB/s 2024-09-21T07:35:19.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148247 s, 70.7 MB/s 2024-09-21T07:35:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126818 s, 82.7 MB/s 2024-09-21T07:35:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:19.730 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:19.730 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:19.730 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.7 2024-09-21T07:35:19.730 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:19.731 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:19.731 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:19.731 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:19.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:19.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142517 s, 73.6 MB/s 2024-09-21T07:35:19.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161397 s, 65.0 MB/s 2024-09-21T07:35:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142524 s, 73.6 MB/s 2024-09-21T07:35:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147223 s, 71.2 MB/s 2024-09-21T07:35:19.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.867 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.867 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119473 s, 87.8 MB/s 2024-09-21T07:35:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133323 s, 78.6 MB/s 2024-09-21T07:35:19.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137207 s, 76.4 MB/s 2024-09-21T07:35:19.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.916 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.916 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137854 s, 76.1 MB/s 2024-09-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135603 s, 77.3 MB/s 2024-09-21T07:35:19.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132649 s, 79.0 MB/s 2024-09-21T07:35:19.968 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.969 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181141 s, 57.9 MB/s 2024-09-21T07:35:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013655 s, 76.8 MB/s 2024-09-21T07:35:20.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.004 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.004 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157707 s, 66.5 MB/s 2024-09-21T07:35:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013833 s, 75.8 MB/s 2024-09-21T07:35:20.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139422 s, 75.2 MB/s 2024-09-21T07:35:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.053 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013535 s, 77.5 MB/s 2024-09-21T07:35:20.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.072 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158355 s, 66.2 MB/s 2024-09-21T07:35:20.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.088 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134715 s, 77.8 MB/s 2024-09-21T07:35:20.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.104 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131053 s, 80.0 MB/s 2024-09-21T07:35:20.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.125 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.125 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018171 s, 57.7 MB/s 2024-09-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147328 s, 71.2 MB/s 2024-09-21T07:35:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133611 s, 78.5 MB/s 2024-09-21T07:35:20.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.176 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154244 s, 68.0 MB/s 2024-09-21T07:35:20.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.192 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.192 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132566 s, 79.1 MB/s 2024-09-21T07:35:20.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.209 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143244 s, 73.2 MB/s 2024-09-21T07:35:20.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.225 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.225 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132183 s, 79.3 MB/s 2024-09-21T07:35:20.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.245 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170496 s, 61.5 MB/s 2024-09-21T07:35:20.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.264 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155 s, 67.6 MB/s 2024-09-21T07:35:20.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.286 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192257 s, 54.5 MB/s 2024-09-21T07:35:20.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.302 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134653 s, 77.9 MB/s 2024-09-21T07:35:20.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130289 s, 80.5 MB/s 2024-09-21T07:35:20.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146715 s, 71.5 MB/s 2024-09-21T07:35:20.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:20.342 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.8 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:20.343 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:20.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:20.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.412 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141317 s, 74.2 MB/s 2024-09-21T07:35:20.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.428 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129091 s, 81.2 MB/s 2024-09-21T07:35:20.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.445 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.445 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137602 s, 76.2 MB/s 2024-09-21T07:35:20.465 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.466 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.466 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181607 s, 57.7 MB/s 2024-09-21T07:35:20.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.480 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.480 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115551 s, 90.7 MB/s 2024-09-21T07:35:20.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.500 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.500 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181251 s, 57.9 MB/s 2024-09-21T07:35:20.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.517 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013949 s, 75.2 MB/s 2024-09-21T07:35:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.534 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142818 s, 73.4 MB/s 2024-09-21T07:35:20.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.550 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133727 s, 78.4 MB/s 2024-09-21T07:35:20.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.566 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013453 s, 77.9 MB/s 2024-09-21T07:35:20.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154077 s, 68.1 MB/s 2024-09-21T07:35:20.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135161 s, 77.6 MB/s 2024-09-21T07:35:20.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.619 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.619 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153216 s, 68.4 MB/s 2024-09-21T07:35:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132694 s, 79.0 MB/s 2024-09-21T07:35:20.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133538 s, 78.5 MB/s 2024-09-21T07:35:20.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.672 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.673 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186348 s, 56.3 MB/s 2024-09-21T07:35:20.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132412 s, 79.2 MB/s 2024-09-21T07:35:20.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.704 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132375 s, 79.2 MB/s 2024-09-21T07:35:20.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.722 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.722 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015094 s, 69.5 MB/s 2024-09-21T07:35:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152358 s, 68.8 MB/s 2024-09-21T07:35:20.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.758 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.758 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146511 s, 71.6 MB/s 2024-09-21T07:35:20.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.774 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.774 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140521 s, 74.6 MB/s 2024-09-21T07:35:20.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.791 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.791 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140112 s, 74.8 MB/s 2024-09-21T07:35:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133866 s, 78.3 MB/s 2024-09-21T07:35:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177762 s, 59.0 MB/s 2024-09-21T07:35:20.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135106 s, 77.6 MB/s 2024-09-21T07:35:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176362 s, 59.5 MB/s 2024-09-21T07:35:20.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131574 s, 79.7 MB/s 2024-09-21T07:35:20.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013131 s, 79.9 MB/s 2024-09-21T07:35:20.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.913 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013785 s, 76.1 MB/s 2024-09-21T07:35:20.930 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.931 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.931 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149655 s, 70.1 MB/s 2024-09-21T07:35:20.950 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017459 s, 60.1 MB/s 2024-09-21T07:35:20.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:20.958 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.9 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:20.959 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:21.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:21.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129972 s, 80.7 MB/s 2024-09-21T07:35:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176479 s, 59.4 MB/s 2024-09-21T07:35:21.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132032 s, 79.4 MB/s 2024-09-21T07:35:21.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131203 s, 79.9 MB/s 2024-09-21T07:35:21.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.101 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.101 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184416 s, 56.9 MB/s 2024-09-21T07:35:21.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.118 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.119 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150089 s, 69.9 MB/s 2024-09-21T07:35:21.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151907 s, 69.0 MB/s 2024-09-21T07:35:21.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.154 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.154 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151936 s, 69.0 MB/s 2024-09-21T07:35:21.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.176 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.176 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192047 s, 54.6 MB/s 2024-09-21T07:35:21.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.194 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149978 s, 69.9 MB/s 2024-09-21T07:35:21.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.209 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129505 s, 81.0 MB/s 2024-09-21T07:35:21.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.230 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.230 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179926 s, 58.3 MB/s 2024-09-21T07:35:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153782 s, 68.2 MB/s 2024-09-21T07:35:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.264 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130331 s, 80.5 MB/s 2024-09-21T07:35:21.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.280 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129609 s, 80.9 MB/s 2024-09-21T07:35:21.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015065 s, 69.6 MB/s 2024-09-21T07:35:21.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.317 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150047 s, 69.9 MB/s 2024-09-21T07:35:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013341 s, 78.6 MB/s 2024-09-21T07:35:21.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.350 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138414 s, 75.8 MB/s 2024-09-21T07:35:21.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.367 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.367 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133787 s, 78.4 MB/s 2024-09-21T07:35:21.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.384 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136247 s, 77.0 MB/s 2024-09-21T07:35:21.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.400 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130323 s, 80.5 MB/s 2024-09-21T07:35:21.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142302 s, 73.7 MB/s 2024-09-21T07:35:21.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.434 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.434 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133408 s, 78.6 MB/s 2024-09-21T07:35:21.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.451 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.451 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135758 s, 77.2 MB/s 2024-09-21T07:35:21.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182973 s, 57.3 MB/s 2024-09-21T07:35:21.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186367 s, 56.3 MB/s 2024-09-21T07:35:21.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.511 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.511 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014203 s, 73.8 MB/s 2024-09-21T07:35:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183477 s, 57.2 MB/s 2024-09-21T07:35:21.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.551 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.551 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148204 s, 70.8 MB/s 2024-09-21T07:35:21.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.569 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145003 s, 72.3 MB/s 2024-09-21T07:35:21.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157201 s, 66.7 MB/s 2024-09-21T07:35:21.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.10 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:21.595 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:21.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:21.663 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.664 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.664 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135239 s, 77.5 MB/s 2024-09-21T07:35:21.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137279 s, 76.4 MB/s 2024-09-21T07:35:21.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.698 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.698 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150666 s, 69.6 MB/s 2024-09-21T07:35:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.715 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146463 s, 71.6 MB/s 2024-09-21T07:35:21.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150917 s, 69.5 MB/s 2024-09-21T07:35:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.749 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135221 s, 77.5 MB/s 2024-09-21T07:35:21.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.770 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.770 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176369 s, 59.5 MB/s 2024-09-21T07:35:21.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.786 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138891 s, 75.5 MB/s 2024-09-21T07:35:21.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136136 s, 77.0 MB/s 2024-09-21T07:35:21.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132578 s, 79.1 MB/s 2024-09-21T07:35:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131547 s, 79.7 MB/s 2024-09-21T07:35:21.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139235 s, 75.3 MB/s 2024-09-21T07:35:21.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152131 s, 68.9 MB/s 2024-09-21T07:35:21.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.887 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139924 s, 74.9 MB/s 2024-09-21T07:35:21.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.907 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165057 s, 63.5 MB/s 2024-09-21T07:35:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135397 s, 77.4 MB/s 2024-09-21T07:35:21.939 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130907 s, 80.1 MB/s 2024-09-21T07:35:21.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.955 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.955 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130823 s, 80.2 MB/s 2024-09-21T07:35:21.971 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.972 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134912 s, 77.7 MB/s 2024-09-21T07:35:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:21.990 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:21.990 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152549 s, 68.7 MB/s 2024-09-21T07:35:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188689 s, 55.6 MB/s 2024-09-21T07:35:22.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153601 s, 68.3 MB/s 2024-09-21T07:35:22.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142071 s, 73.8 MB/s 2024-09-21T07:35:22.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152915 s, 68.6 MB/s 2024-09-21T07:35:22.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133414 s, 78.6 MB/s 2024-09-21T07:35:22.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.104 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200445 s, 52.3 MB/s 2024-09-21T07:35:22.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135694 s, 77.3 MB/s 2024-09-21T07:35:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180239 s, 58.2 MB/s 2024-09-21T07:35:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.157 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137159 s, 76.4 MB/s 2024-09-21T07:35:22.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.174 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137413 s, 76.3 MB/s 2024-09-21T07:35:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136832 s, 76.6 MB/s 2024-09-21T07:35:22.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.206 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.206 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134092 s, 78.2 MB/s 2024-09-21T07:35:22.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.11 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:22.214 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:22.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.322 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121047 s, 86.6 MB/s 2024-09-21T07:35:22.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143694 s, 73.0 MB/s 2024-09-21T07:35:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138899 s, 75.5 MB/s 2024-09-21T07:35:22.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169703 s, 61.8 MB/s 2024-09-21T07:35:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136511 s, 76.8 MB/s 2024-09-21T07:35:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141021 s, 74.4 MB/s 2024-09-21T07:35:22.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.424 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131506 s, 79.7 MB/s 2024-09-21T07:35:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127187 s, 82.4 MB/s 2024-09-21T07:35:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132296 s, 79.3 MB/s 2024-09-21T07:35:22.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.472 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.472 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136003 s, 77.1 MB/s 2024-09-21T07:35:22.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136767 s, 76.7 MB/s 2024-09-21T07:35:22.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137339 s, 76.3 MB/s 2024-09-21T07:35:22.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.520 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.521 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124589 s, 84.2 MB/s 2024-09-21T07:35:22.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185882 s, 56.4 MB/s 2024-09-21T07:35:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.563 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189254 s, 55.4 MB/s 2024-09-21T07:35:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.579 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133225 s, 78.7 MB/s 2024-09-21T07:35:22.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.597 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.597 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146288 s, 71.7 MB/s 2024-09-21T07:35:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.614 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.615 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152478 s, 68.8 MB/s 2024-09-21T07:35:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.631 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143425 s, 73.1 MB/s 2024-09-21T07:35:22.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.650 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159145 s, 65.9 MB/s 2024-09-21T07:35:22.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.671 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.671 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183002 s, 57.3 MB/s 2024-09-21T07:35:22.688 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.689 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.689 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147044 s, 71.3 MB/s 2024-09-21T07:35:22.704 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132536 s, 79.1 MB/s 2024-09-21T07:35:22.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.725 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174713 s, 60.0 MB/s 2024-09-21T07:35:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187179 s, 56.0 MB/s 2024-09-21T07:35:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.764 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156003 s, 67.2 MB/s 2024-09-21T07:35:22.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.782 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.782 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145892 s, 71.9 MB/s 2024-09-21T07:35:22.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186618 s, 56.2 MB/s 2024-09-21T07:35:22.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139315 s, 75.3 MB/s 2024-09-21T07:35:22.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.841 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.841 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187687 s, 55.9 MB/s 2024-09-21T07:35:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170184 s, 61.6 MB/s 2024-09-21T07:35:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.877 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131914 s, 79.5 MB/s 2024-09-21T07:35:22.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.12 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:22.885 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:22.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128499 s, 81.6 MB/s 2024-09-21T07:35:22.974 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.975 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.975 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187305 s, 56.0 MB/s 2024-09-21T07:35:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:22.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134812 s, 77.8 MB/s 2024-09-21T07:35:23.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186544 s, 56.2 MB/s 2024-09-21T07:35:23.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181871 s, 57.7 MB/s 2024-09-21T07:35:23.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.049 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134514 s, 78.0 MB/s 2024-09-21T07:35:23.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.066 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135607 s, 77.3 MB/s 2024-09-21T07:35:23.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.082 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.082 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136851 s, 76.6 MB/s 2024-09-21T07:35:23.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122559 s, 85.6 MB/s 2024-09-21T07:35:23.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137498 s, 76.3 MB/s 2024-09-21T07:35:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161042 s, 65.1 MB/s 2024-09-21T07:35:23.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.148 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.148 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132081 s, 79.4 MB/s 2024-09-21T07:35:23.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.165 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013776 s, 76.1 MB/s 2024-09-21T07:35:23.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.181 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.181 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013615 s, 77.0 MB/s 2024-09-21T07:35:23.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.195 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.196 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116554 s, 90.0 MB/s 2024-09-21T07:35:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140178 s, 74.8 MB/s 2024-09-21T07:35:23.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132456 s, 79.2 MB/s 2024-09-21T07:35:23.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.244 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134588 s, 77.9 MB/s 2024-09-21T07:35:23.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.260 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.260 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131253 s, 79.9 MB/s 2024-09-21T07:35:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142758 s, 73.5 MB/s 2024-09-21T07:35:23.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.294 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014011 s, 74.8 MB/s 2024-09-21T07:35:23.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.310 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.311 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137733 s, 76.1 MB/s 2024-09-21T07:35:23.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135045 s, 77.6 MB/s 2024-09-21T07:35:23.342 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130553 s, 80.3 MB/s 2024-09-21T07:35:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148536 s, 70.6 MB/s 2024-09-21T07:35:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146853 s, 71.4 MB/s 2024-09-21T07:35:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134613 s, 77.9 MB/s 2024-09-21T07:35:23.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.409 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133356 s, 78.6 MB/s 2024-09-21T07:35:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133513 s, 78.5 MB/s 2024-09-21T07:35:23.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.442 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137914 s, 76.0 MB/s 2024-09-21T07:35:23.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.463 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.463 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018299 s, 57.3 MB/s 2024-09-21T07:35:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137006 s, 76.5 MB/s 2024-09-21T07:35:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:23.486 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.13 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:23.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140793 s, 74.5 MB/s 2024-09-21T07:35:23.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.574 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152013 s, 69.0 MB/s 2024-09-21T07:35:23.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.590 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.590 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131368 s, 79.8 MB/s 2024-09-21T07:35:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182716 s, 57.4 MB/s 2024-09-21T07:35:23.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.627 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.627 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132905 s, 78.9 MB/s 2024-09-21T07:35:23.643 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.680 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.680 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137121 s, 76.5 MB/s 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153062 s, 68.5 MB/s 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.681 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137837 s, 76.1 MB/s 2024-09-21T07:35:23.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150335 s, 69.7 MB/s 2024-09-21T07:35:23.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014627 s, 71.7 MB/s 2024-09-21T07:35:23.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.734 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181548 s, 57.8 MB/s 2024-09-21T07:35:23.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138178 s, 75.9 MB/s 2024-09-21T07:35:23.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151417 s, 69.3 MB/s 2024-09-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013291 s, 78.9 MB/s 2024-09-21T07:35:23.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146079 s, 71.8 MB/s 2024-09-21T07:35:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239388 s, 43.8 MB/s 2024-09-21T07:35:23.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206198 s, 50.9 MB/s 2024-09-21T07:35:23.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.869 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136246 s, 77.0 MB/s 2024-09-21T07:35:23.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.888 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.888 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156441 s, 67.0 MB/s 2024-09-21T07:35:23.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.905 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.905 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133709 s, 78.4 MB/s 2024-09-21T07:35:23.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.922 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.922 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147793 s, 70.9 MB/s 2024-09-21T07:35:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.940 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151454 s, 69.2 MB/s 2024-09-21T07:35:23.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.961 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184258 s, 56.9 MB/s 2024-09-21T07:35:23.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.978 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144307 s, 72.7 MB/s 2024-09-21T07:35:23.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:23.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:23.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018026 s, 58.2 MB/s 2024-09-21T07:35:24.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191282 s, 54.8 MB/s 2024-09-21T07:35:24.036 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.037 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132001 s, 79.4 MB/s 2024-09-21T07:35:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.054 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140998 s, 74.4 MB/s 2024-09-21T07:35:24.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.072 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.072 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150617 s, 69.6 MB/s 2024-09-21T07:35:24.087 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.088 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133469 s, 78.6 MB/s 2024-09-21T07:35:24.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150146 s, 69.8 MB/s 2024-09-21T07:35:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136194 s, 77.0 MB/s 2024-09-21T07:35:24.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.14 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:24.129 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:24.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:24.197 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133592 s, 78.5 MB/s 2024-09-21T07:35:24.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138851 s, 75.5 MB/s 2024-09-21T07:35:24.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.232 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.232 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153335 s, 68.4 MB/s 2024-09-21T07:35:24.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147978 s, 70.9 MB/s 2024-09-21T07:35:24.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.266 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131645 s, 79.7 MB/s 2024-09-21T07:35:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112882 s, 92.9 MB/s 2024-09-21T07:35:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.296 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136332 s, 76.9 MB/s 2024-09-21T07:35:24.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134716 s, 77.8 MB/s 2024-09-21T07:35:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.330 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148347 s, 70.7 MB/s 2024-09-21T07:35:24.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.344 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114362 s, 91.7 MB/s 2024-09-21T07:35:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132019 s, 79.4 MB/s 2024-09-21T07:35:24.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.376 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.376 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131846 s, 79.5 MB/s 2024-09-21T07:35:24.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148752 s, 70.5 MB/s 2024-09-21T07:35:24.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.412 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146035 s, 71.8 MB/s 2024-09-21T07:35:24.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.428 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137346 s, 76.3 MB/s 2024-09-21T07:35:24.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152018 s, 69.0 MB/s 2024-09-21T07:35:24.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.462 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.462 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013005 s, 80.6 MB/s 2024-09-21T07:35:24.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.479 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.479 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137006 s, 76.5 MB/s 2024-09-21T07:35:24.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.499 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.499 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175066 s, 59.9 MB/s 2024-09-21T07:35:24.516 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.517 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.517 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141338 s, 74.2 MB/s 2024-09-21T07:35:24.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.533 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.533 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137449 s, 76.3 MB/s 2024-09-21T07:35:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.550 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132944 s, 78.9 MB/s 2024-09-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133104 s, 78.8 MB/s 2024-09-21T07:35:24.585 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.585 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.585 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151853 s, 69.1 MB/s 2024-09-21T07:35:24.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.602 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134527 s, 77.9 MB/s 2024-09-21T07:35:24.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.620 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.620 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152112 s, 68.9 MB/s 2024-09-21T07:35:24.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.642 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189654 s, 55.3 MB/s 2024-09-21T07:35:24.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152162 s, 68.9 MB/s 2024-09-21T07:35:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.677 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136424 s, 76.9 MB/s 2024-09-21T07:35:24.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149508 s, 70.1 MB/s 2024-09-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148182 s, 70.8 MB/s 2024-09-21T07:35:24.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.732 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151217 s, 69.3 MB/s 2024-09-21T07:35:24.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.15 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:24.739 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:24.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:24.857 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.858 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185258 s, 56.6 MB/s 2024-09-21T07:35:24.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.875 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148428 s, 70.6 MB/s 2024-09-21T07:35:24.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013156 s, 79.7 MB/s 2024-09-21T07:35:24.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.908 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134403 s, 78.0 MB/s 2024-09-21T07:35:24.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145266 s, 72.2 MB/s 2024-09-21T07:35:24.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155709 s, 67.3 MB/s 2024-09-21T07:35:24.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.962 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137088 s, 76.5 MB/s 2024-09-21T07:35:24.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.978 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131604 s, 79.7 MB/s 2024-09-21T07:35:24.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:24.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:24.996 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013557 s, 77.3 MB/s 2024-09-21T07:35:25.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014695 s, 71.4 MB/s 2024-09-21T07:35:25.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.033 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.033 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182457 s, 57.5 MB/s 2024-09-21T07:35:25.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.050 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144933 s, 72.3 MB/s 2024-09-21T07:35:25.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138173 s, 75.9 MB/s 2024-09-21T07:35:25.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.083 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013415 s, 78.2 MB/s 2024-09-21T07:35:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142388 s, 73.6 MB/s 2024-09-21T07:35:25.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133753 s, 78.4 MB/s 2024-09-21T07:35:25.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.132 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.132 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130439 s, 80.4 MB/s 2024-09-21T07:35:25.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129115 s, 81.2 MB/s 2024-09-21T07:35:25.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.164 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136364 s, 76.9 MB/s 2024-09-21T07:35:25.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.180 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.181 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140964 s, 74.4 MB/s 2024-09-21T07:35:25.197 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139721 s, 75.0 MB/s 2024-09-21T07:35:25.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.216 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.216 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156217 s, 67.1 MB/s 2024-09-21T07:35:25.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.234 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.234 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158196 s, 66.3 MB/s 2024-09-21T07:35:25.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.257 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199199 s, 52.6 MB/s 2024-09-21T07:35:25.272 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013278 s, 79.0 MB/s 2024-09-21T07:35:25.288 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013365 s, 78.5 MB/s 2024-09-21T07:35:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151483 s, 69.2 MB/s 2024-09-21T07:35:25.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133605 s, 78.5 MB/s 2024-09-21T07:35:25.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131642 s, 79.7 MB/s 2024-09-21T07:35:25.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.355 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136342 s, 76.9 MB/s 2024-09-21T07:35:25.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168187 s, 62.3 MB/s 2024-09-21T07:35:25.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151891 s, 69.0 MB/s 2024-09-21T07:35:25.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.16 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:25.400 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:25.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:25.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144917 s, 72.4 MB/s 2024-09-21T07:35:25.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.525 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013455 s, 77.9 MB/s 2024-09-21T07:35:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.541 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132602 s, 79.1 MB/s 2024-09-21T07:35:25.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.557 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136458 s, 76.8 MB/s 2024-09-21T07:35:25.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.571 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.571 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109389 s, 95.9 MB/s 2024-09-21T07:35:25.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.587 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.587 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135986 s, 77.1 MB/s 2024-09-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134225 s, 78.1 MB/s 2024-09-21T07:35:25.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.621 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.621 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151866 s, 69.0 MB/s 2024-09-21T07:35:25.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.639 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157439 s, 66.6 MB/s 2024-09-21T07:35:25.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176555 s, 59.4 MB/s 2024-09-21T07:35:25.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.678 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.678 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151081 s, 69.4 MB/s 2024-09-21T07:35:25.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014472 s, 72.5 MB/s 2024-09-21T07:35:25.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.711 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133432 s, 78.6 MB/s 2024-09-21T07:35:25.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.727 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.728 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135982 s, 77.1 MB/s 2024-09-21T07:35:25.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.743 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.743 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131491 s, 79.7 MB/s 2024-09-21T07:35:25.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.760 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.760 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01348 s, 77.8 MB/s 2024-09-21T07:35:25.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.775 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.776 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131548 s, 79.7 MB/s 2024-09-21T07:35:25.797 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.797 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.797 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189839 s, 55.2 MB/s 2024-09-21T07:35:25.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.814 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.814 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142784 s, 73.4 MB/s 2024-09-21T07:35:25.830 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.831 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.831 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136458 s, 76.8 MB/s 2024-09-21T07:35:25.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.848 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.849 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150288 s, 69.8 MB/s 2024-09-21T07:35:25.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.864 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.865 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013269 s, 79.0 MB/s 2024-09-21T07:35:25.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.880 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130888 s, 80.1 MB/s 2024-09-21T07:35:25.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.897 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.897 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143147 s, 73.3 MB/s 2024-09-21T07:35:25.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.915 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.915 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150041 s, 69.9 MB/s 2024-09-21T07:35:25.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.932 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138158 s, 75.9 MB/s 2024-09-21T07:35:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.948 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137845 s, 76.1 MB/s 2024-09-21T07:35:25.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.966 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.966 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151233 s, 69.3 MB/s 2024-09-21T07:35:25.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:25.987 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:25.987 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178362 s, 58.8 MB/s 2024-09-21T07:35:26.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.003 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133482 s, 78.6 MB/s 2024-09-21T07:35:26.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.020 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.021 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148132 s, 70.8 MB/s 2024-09-21T07:35:26.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.039 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.039 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154372 s, 67.9 MB/s 2024-09-21T07:35:26.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:26.046 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.17 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:26.047 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:26.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:26.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148859 s, 70.4 MB/s 2024-09-21T07:35:26.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.137 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.138 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185609 s, 56.5 MB/s 2024-09-21T07:35:26.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.152 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119492 s, 87.8 MB/s 2024-09-21T07:35:26.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.174 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185803 s, 56.4 MB/s 2024-09-21T07:35:26.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.194 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.194 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017987 s, 58.3 MB/s 2024-09-21T07:35:26.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.211 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.211 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014423 s, 72.7 MB/s 2024-09-21T07:35:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.227 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135019 s, 77.7 MB/s 2024-09-21T07:35:26.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.244 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014289 s, 73.4 MB/s 2024-09-21T07:35:26.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.262 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.262 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143661 s, 73.0 MB/s 2024-09-21T07:35:26.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.278 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.278 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133205 s, 78.7 MB/s 2024-09-21T07:35:26.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.296 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.296 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01549 s, 67.7 MB/s 2024-09-21T07:35:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.312 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129994 s, 80.7 MB/s 2024-09-21T07:35:26.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.328 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.328 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138851 s, 75.5 MB/s 2024-09-21T07:35:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152797 s, 68.6 MB/s 2024-09-21T07:35:26.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.365 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.365 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153195 s, 68.4 MB/s 2024-09-21T07:35:26.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.383 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145335 s, 72.1 MB/s 2024-09-21T07:35:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149668 s, 70.1 MB/s 2024-09-21T07:35:26.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.417 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.417 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135024 s, 77.7 MB/s 2024-09-21T07:35:26.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.437 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.437 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164787 s, 63.6 MB/s 2024-09-21T07:35:26.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174202 s, 60.2 MB/s 2024-09-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138889 s, 75.5 MB/s 2024-09-21T07:35:26.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138127 s, 75.9 MB/s 2024-09-21T07:35:26.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135788 s, 77.2 MB/s 2024-09-21T07:35:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.525 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144174 s, 72.7 MB/s 2024-09-21T07:35:26.541 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137402 s, 76.3 MB/s 2024-09-21T07:35:26.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.560 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154569 s, 67.8 MB/s 2024-09-21T07:35:26.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.578 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.578 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149304 s, 70.2 MB/s 2024-09-21T07:35:26.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.598 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.598 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173327 s, 60.5 MB/s 2024-09-21T07:35:26.615 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.616 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.616 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014413 s, 72.8 MB/s 2024-09-21T07:35:26.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.632 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.632 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133982 s, 78.3 MB/s 2024-09-21T07:35:26.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.648 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.648 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131517 s, 79.7 MB/s 2024-09-21T07:35:26.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183973 s, 57.0 MB/s 2024-09-21T07:35:26.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:26.677 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:26.677 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:26.677 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.18 2024-09-21T07:35:26.678 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:26.678 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:26.678 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:26.678 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:26.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:26.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.746 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.747 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138661 s, 75.6 MB/s 2024-09-21T07:35:26.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.768 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.768 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190694 s, 55.0 MB/s 2024-09-21T07:35:26.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153933 s, 68.1 MB/s 2024-09-21T07:35:26.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.807 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.807 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181099 s, 57.9 MB/s 2024-09-21T07:35:26.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.825 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.826 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154853 s, 67.7 MB/s 2024-09-21T07:35:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.847 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.847 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183461 s, 57.2 MB/s 2024-09-21T07:35:26.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.863 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.863 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137682 s, 76.2 MB/s 2024-09-21T07:35:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.879 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.880 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135274 s, 77.5 MB/s 2024-09-21T07:35:26.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.895 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.896 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134275 s, 78.1 MB/s 2024-09-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135558 s, 77.4 MB/s 2024-09-21T07:35:26.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.927 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126978 s, 82.6 MB/s 2024-09-21T07:35:26.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.944 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132128 s, 79.4 MB/s 2024-09-21T07:35:26.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136815 s, 76.6 MB/s 2024-09-21T07:35:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153601 s, 68.3 MB/s 2024-09-21T07:35:26.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:26.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:26.995 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141546 s, 74.1 MB/s 2024-09-21T07:35:27.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.012 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146814 s, 71.4 MB/s 2024-09-21T07:35:27.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144472 s, 72.6 MB/s 2024-09-21T07:35:27.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.046 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.046 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140796 s, 74.5 MB/s 2024-09-21T07:35:27.062 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.063 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134659 s, 77.9 MB/s 2024-09-21T07:35:27.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.080 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.080 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138207 s, 75.9 MB/s 2024-09-21T07:35:27.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.096 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.096 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137977 s, 76.0 MB/s 2024-09-21T07:35:27.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.113 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136937 s, 76.6 MB/s 2024-09-21T07:35:27.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.134 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.134 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185584 s, 56.5 MB/s 2024-09-21T07:35:27.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013376 s, 78.4 MB/s 2024-09-21T07:35:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136125 s, 77.0 MB/s 2024-09-21T07:35:27.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.187 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.187 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180266 s, 58.2 MB/s 2024-09-21T07:35:27.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.205 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145637 s, 72.0 MB/s 2024-09-21T07:35:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.220 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134095 s, 78.2 MB/s 2024-09-21T07:35:27.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.237 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.237 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136097 s, 77.0 MB/s 2024-09-21T07:35:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.255 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149451 s, 70.2 MB/s 2024-09-21T07:35:27.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.275 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.276 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016893 s, 62.1 MB/s 2024-09-21T07:35:27.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.293 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.293 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145934 s, 71.9 MB/s 2024-09-21T07:35:27.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.19 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:27.301 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:27.370 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138596 s, 75.7 MB/s 2024-09-21T07:35:27.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150475 s, 69.7 MB/s 2024-09-21T07:35:27.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.408 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.408 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158041 s, 66.3 MB/s 2024-09-21T07:35:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.425 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142105 s, 73.8 MB/s 2024-09-21T07:35:27.444 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.444 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.444 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152734 s, 68.7 MB/s 2024-09-21T07:35:27.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118759 s, 88.3 MB/s 2024-09-21T07:35:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.475 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134056 s, 78.2 MB/s 2024-09-21T07:35:27.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.490 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.490 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128448 s, 81.6 MB/s 2024-09-21T07:35:27.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.512 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184447 s, 56.8 MB/s 2024-09-21T07:35:27.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.530 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152664 s, 68.7 MB/s 2024-09-21T07:35:27.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.546 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.546 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137963 s, 76.0 MB/s 2024-09-21T07:35:27.567 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.568 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187716 s, 55.9 MB/s 2024-09-21T07:35:27.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134519 s, 78.0 MB/s 2024-09-21T07:35:27.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.602 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.602 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150953 s, 69.5 MB/s 2024-09-21T07:35:27.618 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.618 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.618 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140991 s, 74.4 MB/s 2024-09-21T07:35:27.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.639 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.639 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175647 s, 59.7 MB/s 2024-09-21T07:35:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.660 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187813 s, 55.8 MB/s 2024-09-21T07:35:27.677 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.677 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.677 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137279 s, 76.4 MB/s 2024-09-21T07:35:27.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152594 s, 68.7 MB/s 2024-09-21T07:35:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.711 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134345 s, 78.1 MB/s 2024-09-21T07:35:27.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192502 s, 54.5 MB/s 2024-09-21T07:35:27.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141691 s, 74.0 MB/s 2024-09-21T07:35:27.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014158 s, 74.1 MB/s 2024-09-21T07:35:27.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014237 s, 73.7 MB/s 2024-09-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129184 s, 81.2 MB/s 2024-09-21T07:35:27.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.816 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.816 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136227 s, 77.0 MB/s 2024-09-21T07:35:27.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178185 s, 58.8 MB/s 2024-09-21T07:35:27.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.853 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134981 s, 77.7 MB/s 2024-09-21T07:35:27.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.869 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141064 s, 74.3 MB/s 2024-09-21T07:35:27.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.886 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.886 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140057 s, 74.9 MB/s 2024-09-21T07:35:27.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.902 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.902 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134629 s, 77.9 MB/s 2024-09-21T07:35:27.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183892 s, 57.0 MB/s 2024-09-21T07:35:27.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.20 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:27.931 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:27.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:27.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136051 s, 77.1 MB/s 2024-09-21T07:35:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148381 s, 70.7 MB/s 2024-09-21T07:35:28.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.035 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.035 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015503 s, 67.6 MB/s 2024-09-21T07:35:28.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.051 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.051 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134961 s, 77.7 MB/s 2024-09-21T07:35:28.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013167 s, 79.6 MB/s 2024-09-21T07:35:28.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.088 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.088 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183749 s, 57.1 MB/s 2024-09-21T07:35:28.103 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.103 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.104 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129222 s, 81.1 MB/s 2024-09-21T07:35:28.121 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.121 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.121 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143286 s, 73.2 MB/s 2024-09-21T07:35:28.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.139 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.139 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155489 s, 67.4 MB/s 2024-09-21T07:35:28.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143344 s, 73.2 MB/s 2024-09-21T07:35:28.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135352 s, 77.5 MB/s 2024-09-21T07:35:28.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151685 s, 69.1 MB/s 2024-09-21T07:35:28.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.207 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.207 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125925 s, 83.3 MB/s 2024-09-21T07:35:28.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.224 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.224 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136546 s, 76.8 MB/s 2024-09-21T07:35:28.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.246 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192822 s, 54.4 MB/s 2024-09-21T07:35:28.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178776 s, 58.7 MB/s 2024-09-21T07:35:28.282 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.283 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.283 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132822 s, 78.9 MB/s 2024-09-21T07:35:28.298 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.299 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.299 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134707 s, 77.8 MB/s 2024-09-21T07:35:28.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.316 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.316 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015008 s, 69.9 MB/s 2024-09-21T07:35:28.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.338 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189946 s, 55.2 MB/s 2024-09-21T07:35:28.358 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.359 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.359 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177492 s, 59.1 MB/s 2024-09-21T07:35:28.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131527 s, 79.7 MB/s 2024-09-21T07:35:28.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.391 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.391 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013871 s, 75.6 MB/s 2024-09-21T07:35:28.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.407 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.407 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134891 s, 77.7 MB/s 2024-09-21T07:35:28.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.423 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.424 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134127 s, 78.2 MB/s 2024-09-21T07:35:28.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.439 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.439 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125533 s, 83.5 MB/s 2024-09-21T07:35:28.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.456 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.456 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146924 s, 71.4 MB/s 2024-09-21T07:35:28.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.478 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.478 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185242 s, 56.6 MB/s 2024-09-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133468 s, 78.6 MB/s 2024-09-21T07:35:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152674 s, 68.7 MB/s 2024-09-21T07:35:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156935 s, 66.8 MB/s 2024-09-21T07:35:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.548 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137345 s, 76.3 MB/s 2024-09-21T07:35:28.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.21 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:28.555 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:28.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:28.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.624 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137843 s, 76.1 MB/s 2024-09-21T07:35:28.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.641 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144224 s, 72.7 MB/s 2024-09-21T07:35:28.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.657 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013965 s, 75.1 MB/s 2024-09-21T07:35:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.674 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136809 s, 76.6 MB/s 2024-09-21T07:35:28.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146185 s, 71.7 MB/s 2024-09-21T07:35:28.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138599 s, 75.7 MB/s 2024-09-21T07:35:28.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.725 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014778 s, 71.0 MB/s 2024-09-21T07:35:28.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.741 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.741 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134673 s, 77.9 MB/s 2024-09-21T07:35:28.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.759 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.759 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134884 s, 77.7 MB/s 2024-09-21T07:35:28.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.779 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181174 s, 57.9 MB/s 2024-09-21T07:35:28.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129623 s, 80.9 MB/s 2024-09-21T07:35:28.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182184 s, 57.6 MB/s 2024-09-21T07:35:28.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144105 s, 72.8 MB/s 2024-09-21T07:35:28.853 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.854 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.854 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174555 s, 60.1 MB/s 2024-09-21T07:35:28.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.896 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.896 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202031 s, 51.9 MB/s 2024-09-21T07:35:28.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.899 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.900 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135842 s, 77.2 MB/s 2024-09-21T07:35:28.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.911 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.911 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143936 s, 72.8 MB/s 2024-09-21T07:35:28.927 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137729 s, 76.1 MB/s 2024-09-21T07:35:28.943 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.944 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138534 s, 75.7 MB/s 2024-09-21T07:35:28.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.961 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150991 s, 69.4 MB/s 2024-09-21T07:35:28.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.977 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.977 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135791 s, 77.2 MB/s 2024-09-21T07:35:28.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:28.994 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:28.994 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136551 s, 76.8 MB/s 2024-09-21T07:35:29.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.012 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148622 s, 70.6 MB/s 2024-09-21T07:35:29.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.030 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.030 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151535 s, 69.2 MB/s 2024-09-21T07:35:29.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145365 s, 72.1 MB/s 2024-09-21T07:35:29.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.065 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.065 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01513 s, 69.3 MB/s 2024-09-21T07:35:29.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144023 s, 72.8 MB/s 2024-09-21T07:35:29.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153524 s, 68.3 MB/s 2024-09-21T07:35:29.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.116 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.116 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136781 s, 76.7 MB/s 2024-09-21T07:35:29.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.134 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144904 s, 72.4 MB/s 2024-09-21T07:35:29.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.151 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.151 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143314 s, 73.2 MB/s 2024-09-21T07:35:29.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.167 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137854 s, 76.1 MB/s 2024-09-21T07:35:29.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.22 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:29.174 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:29.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:29.243 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.244 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.244 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140787 s, 74.5 MB/s 2024-09-21T07:35:29.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.261 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.261 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145458 s, 72.1 MB/s 2024-09-21T07:35:29.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.277 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.277 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133304 s, 78.7 MB/s 2024-09-21T07:35:29.294 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.295 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.295 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150949 s, 69.5 MB/s 2024-09-21T07:35:29.311 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.311 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.311 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135976 s, 77.1 MB/s 2024-09-21T07:35:29.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.327 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.327 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013717 s, 76.4 MB/s 2024-09-21T07:35:29.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.344 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.345 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146357 s, 71.6 MB/s 2024-09-21T07:35:29.360 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013613 s, 77.0 MB/s 2024-09-21T07:35:29.379 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.380 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.380 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158579 s, 66.1 MB/s 2024-09-21T07:35:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143117 s, 73.3 MB/s 2024-09-21T07:35:29.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.414 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.414 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146681 s, 71.5 MB/s 2024-09-21T07:35:29.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.428 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.429 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121074 s, 86.6 MB/s 2024-09-21T07:35:29.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.446 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.446 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145967 s, 71.8 MB/s 2024-09-21T07:35:29.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.461 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.461 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124053 s, 84.5 MB/s 2024-09-21T07:35:29.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130147 s, 80.6 MB/s 2024-09-21T07:35:29.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.493 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.493 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131912 s, 79.5 MB/s 2024-09-21T07:35:29.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138485 s, 75.7 MB/s 2024-09-21T07:35:29.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.530 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.530 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179895 s, 58.3 MB/s 2024-09-21T07:35:29.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.547 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.547 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148815 s, 70.5 MB/s 2024-09-21T07:35:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.568 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185002 s, 56.7 MB/s 2024-09-21T07:35:29.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.584 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.584 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013537 s, 77.5 MB/s 2024-09-21T07:35:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131311 s, 79.9 MB/s 2024-09-21T07:35:29.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138818 s, 75.5 MB/s 2024-09-21T07:35:29.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134473 s, 78.0 MB/s 2024-09-21T07:35:29.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.654 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.654 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178615 s, 58.7 MB/s 2024-09-21T07:35:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129011 s, 81.3 MB/s 2024-09-21T07:35:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132111 s, 79.4 MB/s 2024-09-21T07:35:29.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.702 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137165 s, 76.4 MB/s 2024-09-21T07:35:29.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.718 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131183 s, 79.9 MB/s 2024-09-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143613 s, 73.0 MB/s 2024-09-21T07:35:29.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.752 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.752 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143415 s, 73.1 MB/s 2024-09-21T07:35:29.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.772 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.772 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181649 s, 57.7 MB/s 2024-09-21T07:35:29.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:29.780 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:29.780 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:29.780 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.23 2024-09-21T07:35:29.780 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:29.781 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:29.781 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:29.781 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:29.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152428 s, 68.8 MB/s 2024-09-21T07:35:29.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.912 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.913 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160801 s, 65.2 MB/s 2024-09-21T07:35:29.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.929 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132556 s, 79.1 MB/s 2024-09-21T07:35:29.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.944 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128493 s, 81.6 MB/s 2024-09-21T07:35:29.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.960 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131829 s, 79.5 MB/s 2024-09-21T07:35:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.977 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013582 s, 77.2 MB/s 2024-09-21T07:35:29.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:29.993 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:29.993 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139574 s, 75.1 MB/s 2024-09-21T07:35:30.010 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.011 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.011 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146887 s, 71.4 MB/s 2024-09-21T07:35:30.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.027 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136375 s, 76.9 MB/s 2024-09-21T07:35:30.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.043 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.044 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138961 s, 75.5 MB/s 2024-09-21T07:35:30.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017389 s, 60.3 MB/s 2024-09-21T07:35:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185303 s, 56.6 MB/s 2024-09-21T07:35:30.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.108 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.108 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200472 s, 52.3 MB/s 2024-09-21T07:35:30.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132472 s, 79.2 MB/s 2024-09-21T07:35:30.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.140 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137306 s, 76.4 MB/s 2024-09-21T07:35:30.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.156 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.156 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131763 s, 79.6 MB/s 2024-09-21T07:35:30.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:30.172 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:30.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134745 s, 77.8 MB/s 2024-09-21T07:35:31.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.086 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.086 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.910861 s, 1.2 MB/s 2024-09-21T07:35:31.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.106 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.106 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016146 s, 64.9 MB/s 2024-09-21T07:35:31.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018123 s, 57.9 MB/s 2024-09-21T07:35:31.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.149 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.149 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169756 s, 61.8 MB/s 2024-09-21T07:35:31.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.171 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.171 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181051 s, 57.9 MB/s 2024-09-21T07:35:31.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.191 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.191 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173255 s, 60.5 MB/s 2024-09-21T07:35:31.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186714 s, 56.2 MB/s 2024-09-21T07:35:31.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.233 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.233 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169759 s, 61.8 MB/s 2024-09-21T07:35:31.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.256 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.257 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020178 s, 52.0 MB/s 2024-09-21T07:35:31.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.273 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.273 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136425 s, 76.9 MB/s 2024-09-21T07:35:31.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.289 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.289 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013333 s, 78.6 MB/s 2024-09-21T07:35:31.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.305 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136673 s, 76.7 MB/s 2024-09-21T07:35:31.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.321 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134163 s, 78.2 MB/s 2024-09-21T07:35:31.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.338 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.338 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136329 s, 76.9 MB/s 2024-09-21T07:35:31.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.355 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.355 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150432 s, 69.7 MB/s 2024-09-21T07:35:31.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.24 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:31.363 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:31.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:31.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.436 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.436 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188944 s, 55.5 MB/s 2024-09-21T07:35:31.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.457 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.457 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175318 s, 59.8 MB/s 2024-09-21T07:35:31.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.473 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.473 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139866 s, 75.0 MB/s 2024-09-21T07:35:31.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.489 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.489 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129698 s, 80.8 MB/s 2024-09-21T07:35:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136829 s, 76.6 MB/s 2024-09-21T07:35:31.522 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149571 s, 70.1 MB/s 2024-09-21T07:35:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130785 s, 80.2 MB/s 2024-09-21T07:35:31.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.554 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129123 s, 81.2 MB/s 2024-09-21T07:35:31.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.572 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015234 s, 68.8 MB/s 2024-09-21T07:35:31.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.588 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.588 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139342 s, 75.3 MB/s 2024-09-21T07:35:31.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.608 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.608 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168925 s, 62.1 MB/s 2024-09-21T07:35:31.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.624 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.624 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129881 s, 80.7 MB/s 2024-09-21T07:35:31.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.640 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.641 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139151 s, 75.4 MB/s 2024-09-21T07:35:31.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.662 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.662 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190582 s, 55.0 MB/s 2024-09-21T07:35:31.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140474 s, 74.6 MB/s 2024-09-21T07:35:31.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.696 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136726 s, 76.7 MB/s 2024-09-21T07:35:31.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.711 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.712 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132783 s, 79.0 MB/s 2024-09-21T07:35:31.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.729 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.729 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147159 s, 71.3 MB/s 2024-09-21T07:35:31.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.750 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166653 s, 62.9 MB/s 2024-09-21T07:35:31.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.765 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.765 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014002 s, 74.9 MB/s 2024-09-21T07:35:31.786 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.787 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.787 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018617 s, 56.3 MB/s 2024-09-21T07:35:31.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.803 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.803 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140857 s, 74.4 MB/s 2024-09-21T07:35:31.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.819 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132903 s, 78.9 MB/s 2024-09-21T07:35:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133306 s, 78.7 MB/s 2024-09-21T07:35:31.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142549 s, 73.6 MB/s 2024-09-21T07:35:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131866 s, 79.5 MB/s 2024-09-21T07:35:31.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.884 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.884 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131746 s, 79.6 MB/s 2024-09-21T07:35:31.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.901 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.901 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146168 s, 71.7 MB/s 2024-09-21T07:35:31.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.917 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.917 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132511 s, 79.1 MB/s 2024-09-21T07:35:31.933 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.933 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.933 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135012 s, 77.7 MB/s 2024-09-21T07:35:31.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.951 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.951 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149027 s, 70.4 MB/s 2024-09-21T07:35:31.967 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:31.967 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:31.967 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138233 s, 75.9 MB/s 2024-09-21T07:35:31.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:31.974 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.25 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:31.975 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:32.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:32.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.045 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.045 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149301 s, 70.2 MB/s 2024-09-21T07:35:32.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.061 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.061 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137142 s, 76.5 MB/s 2024-09-21T07:35:32.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.081 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.081 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171038 s, 61.3 MB/s 2024-09-21T07:35:32.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135906 s, 77.2 MB/s 2024-09-21T07:35:32.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.114 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.114 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137567 s, 76.2 MB/s 2024-09-21T07:35:32.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.129 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.129 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128812 s, 81.4 MB/s 2024-09-21T07:35:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.147 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145349 s, 72.1 MB/s 2024-09-21T07:35:32.164 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.165 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.165 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150917 s, 69.5 MB/s 2024-09-21T07:35:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.183 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151696 s, 69.1 MB/s 2024-09-21T07:35:32.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130769 s, 80.2 MB/s 2024-09-21T07:35:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136875 s, 76.6 MB/s 2024-09-21T07:35:32.235 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.235 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.235 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179689 s, 58.4 MB/s 2024-09-21T07:35:32.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.252 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.252 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135803 s, 77.2 MB/s 2024-09-21T07:35:32.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013806 s, 76.0 MB/s 2024-09-21T07:35:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139029 s, 75.4 MB/s 2024-09-21T07:35:32.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.303 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152457 s, 68.8 MB/s 2024-09-21T07:35:32.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131987 s, 79.4 MB/s 2024-09-21T07:35:32.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.337 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.337 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015016 s, 69.8 MB/s 2024-09-21T07:35:32.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148894 s, 70.4 MB/s 2024-09-21T07:35:32.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.374 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.374 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165992 s, 63.2 MB/s 2024-09-21T07:35:32.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.394 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.394 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180893 s, 58.0 MB/s 2024-09-21T07:35:32.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.411 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.411 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013649 s, 76.8 MB/s 2024-09-21T07:35:32.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.427 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133036 s, 78.8 MB/s 2024-09-21T07:35:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129088 s, 81.2 MB/s 2024-09-21T07:35:32.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133494 s, 78.5 MB/s 2024-09-21T07:35:32.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.476 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.476 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147403 s, 71.1 MB/s 2024-09-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133549 s, 78.5 MB/s 2024-09-21T07:35:32.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.509 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.509 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136635 s, 76.7 MB/s 2024-09-21T07:35:32.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149755 s, 70.0 MB/s 2024-09-21T07:35:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132988 s, 78.8 MB/s 2024-09-21T07:35:32.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.560 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.560 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146258 s, 71.7 MB/s 2024-09-21T07:35:32.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.577 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.577 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142109 s, 73.8 MB/s 2024-09-21T07:35:32.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:32.584 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.26 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:32.585 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:32.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:32.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123703 s, 84.8 MB/s 2024-09-21T07:35:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01491 s, 70.3 MB/s 2024-09-21T07:35:32.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.685 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.685 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013268 s, 79.0 MB/s 2024-09-21T07:35:32.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.702 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137145 s, 76.5 MB/s 2024-09-21T07:35:32.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.717 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.718 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131935 s, 79.5 MB/s 2024-09-21T07:35:32.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.733 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.733 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013082 s, 80.2 MB/s 2024-09-21T07:35:32.750 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.751 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.751 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146718 s, 71.5 MB/s 2024-09-21T07:35:32.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.767 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.767 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139962 s, 74.9 MB/s 2024-09-21T07:35:32.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.784 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.784 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143387 s, 73.1 MB/s 2024-09-21T07:35:32.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.804 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.804 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017176 s, 61.0 MB/s 2024-09-21T07:35:32.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132625 s, 79.1 MB/s 2024-09-21T07:35:32.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.837 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.837 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014232 s, 73.7 MB/s 2024-09-21T07:35:32.858 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.859 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189026 s, 55.5 MB/s 2024-09-21T07:35:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140884 s, 74.4 MB/s 2024-09-21T07:35:32.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.892 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.892 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134413 s, 78.0 MB/s 2024-09-21T07:35:32.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.910 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.910 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015148 s, 69.2 MB/s 2024-09-21T07:35:32.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.926 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.926 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135594 s, 77.3 MB/s 2024-09-21T07:35:32.944 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.945 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.945 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155137 s, 67.6 MB/s 2024-09-21T07:35:32.960 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.961 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.961 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133846 s, 78.3 MB/s 2024-09-21T07:35:32.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.979 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.979 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154998 s, 67.7 MB/s 2024-09-21T07:35:32.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:32.995 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:32.995 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138306 s, 75.8 MB/s 2024-09-21T07:35:33.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.013 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.013 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151497 s, 69.2 MB/s 2024-09-21T07:35:33.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.029 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.029 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132906 s, 78.9 MB/s 2024-09-21T07:35:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.049 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.050 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174714 s, 60.0 MB/s 2024-09-21T07:35:33.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.067 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.067 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147716 s, 71.0 MB/s 2024-09-21T07:35:33.083 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.084 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.084 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140291 s, 74.7 MB/s 2024-09-21T07:35:33.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.100 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.100 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133502 s, 78.5 MB/s 2024-09-21T07:35:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127297 s, 82.4 MB/s 2024-09-21T07:35:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014677 s, 71.4 MB/s 2024-09-21T07:35:33.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.150 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.150 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138458 s, 75.7 MB/s 2024-09-21T07:35:33.167 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.168 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.168 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147773 s, 71.0 MB/s 2024-09-21T07:35:33.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.184 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.184 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136356 s, 76.9 MB/s 2024-09-21T07:35:33.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:33.191 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:33.191 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:33.192 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.27 2024-09-21T07:35:33.192 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:33.192 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:33.192 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:33.192 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:33.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:33.301 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.302 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.302 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150445 s, 69.7 MB/s 2024-09-21T07:35:33.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137379 s, 76.3 MB/s 2024-09-21T07:35:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154018 s, 68.1 MB/s 2024-09-21T07:35:33.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.354 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.354 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152559 s, 68.7 MB/s 2024-09-21T07:35:33.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.375 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.375 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188411 s, 55.7 MB/s 2024-09-21T07:35:33.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.392 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.392 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138112 s, 75.9 MB/s 2024-09-21T07:35:33.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156177 s, 67.1 MB/s 2024-09-21T07:35:33.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130659 s, 80.3 MB/s 2024-09-21T07:35:33.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.442 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.442 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130966 s, 80.1 MB/s 2024-09-21T07:35:33.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.458 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.458 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131172 s, 79.9 MB/s 2024-09-21T07:35:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.474 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132679 s, 79.0 MB/s 2024-09-21T07:35:33.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149758 s, 70.0 MB/s 2024-09-21T07:35:33.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.507 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131541 s, 79.7 MB/s 2024-09-21T07:35:33.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.526 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.526 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153832 s, 68.2 MB/s 2024-09-21T07:35:33.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.542 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.542 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139191 s, 75.3 MB/s 2024-09-21T07:35:33.558 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.559 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.559 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136632 s, 76.7 MB/s 2024-09-21T07:35:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130277 s, 80.5 MB/s 2024-09-21T07:35:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135445 s, 77.4 MB/s 2024-09-21T07:35:33.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.606 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.606 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112217 s, 93.4 MB/s 2024-09-21T07:35:33.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.622 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.622 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131624 s, 79.7 MB/s 2024-09-21T07:35:33.638 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.638 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.638 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136283 s, 76.9 MB/s 2024-09-21T07:35:33.656 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.657 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.657 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151675 s, 69.1 MB/s 2024-09-21T07:35:33.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.675 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.675 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154015 s, 68.1 MB/s 2024-09-21T07:35:33.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.691 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.691 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132465 s, 79.2 MB/s 2024-09-21T07:35:33.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.708 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.708 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145617 s, 72.0 MB/s 2024-09-21T07:35:33.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.724 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.724 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136833 s, 76.6 MB/s 2024-09-21T07:35:33.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.745 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.745 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017901 s, 58.6 MB/s 2024-09-21T07:35:33.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.761 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.761 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137057 s, 76.5 MB/s 2024-09-21T07:35:33.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.778 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.779 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145673 s, 72.0 MB/s 2024-09-21T07:35:33.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.795 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.795 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137472 s, 76.3 MB/s 2024-09-21T07:35:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196491 s, 53.4 MB/s 2024-09-21T07:35:33.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.844 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.844 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234026 s, 44.8 MB/s 2024-09-21T07:35:33.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.28 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:33.855 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:33.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:33.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.928 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.928 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173151 s, 60.6 MB/s 2024-09-21T07:35:33.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.946 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.946 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152169 s, 68.9 MB/s 2024-09-21T07:35:33.962 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.963 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.963 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134697 s, 77.8 MB/s 2024-09-21T07:35:33.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.981 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.981 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154662 s, 67.8 MB/s 2024-09-21T07:35:33.996 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:33.997 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:33.997 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134979 s, 77.7 MB/s 2024-09-21T07:35:34.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.014 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.014 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150277 s, 69.8 MB/s 2024-09-21T07:35:34.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.031 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.031 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139904 s, 74.9 MB/s 2024-09-21T07:35:34.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.047 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.047 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136164 s, 77.0 MB/s 2024-09-21T07:35:34.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.064 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.064 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135173 s, 77.6 MB/s 2024-09-21T07:35:34.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.085 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.085 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186601 s, 56.2 MB/s 2024-09-21T07:35:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.102 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.103 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144796 s, 72.4 MB/s 2024-09-21T07:35:34.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.124 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.124 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186378 s, 56.3 MB/s 2024-09-21T07:35:34.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.146 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.146 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192633 s, 54.4 MB/s 2024-09-21T07:35:34.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.162 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.162 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135571 s, 77.3 MB/s 2024-09-21T07:35:34.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.179 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.180 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148429 s, 70.6 MB/s 2024-09-21T07:35:34.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.198 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155931 s, 67.2 MB/s 2024-09-21T07:35:34.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.214 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.214 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133321 s, 78.7 MB/s 2024-09-21T07:35:34.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.231 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.231 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139736 s, 75.0 MB/s 2024-09-21T07:35:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151189 s, 69.4 MB/s 2024-09-21T07:35:34.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167427 s, 62.6 MB/s 2024-09-21T07:35:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.284 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134345 s, 78.1 MB/s 2024-09-21T07:35:34.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.300 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.300 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133788 s, 78.4 MB/s 2024-09-21T07:35:34.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.318 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.318 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152426 s, 68.8 MB/s 2024-09-21T07:35:34.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.335 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141425 s, 74.1 MB/s 2024-09-21T07:35:34.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.350 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.351 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127615 s, 82.2 MB/s 2024-09-21T07:35:34.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.371 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.371 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181094 s, 57.9 MB/s 2024-09-21T07:35:34.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.389 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151461 s, 69.2 MB/s 2024-09-21T07:35:34.409 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.410 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.410 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178156 s, 58.9 MB/s 2024-09-21T07:35:34.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.427 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.427 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143267 s, 73.2 MB/s 2024-09-21T07:35:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140965 s, 74.4 MB/s 2024-09-21T07:35:34.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.460 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.460 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137485 s, 76.3 MB/s 2024-09-21T07:35:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145193 s, 72.2 MB/s 2024-09-21T07:35:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:34.484 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:34.484 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:34.484 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.29 2024-09-21T07:35:34.485 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:34.485 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:34.485 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:34.485 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:34.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155069 s, 67.6 MB/s 2024-09-21T07:35:34.572 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150579 s, 69.6 MB/s 2024-09-21T07:35:34.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.592 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.592 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169217 s, 62.0 MB/s 2024-09-21T07:35:34.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.610 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.610 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153748 s, 68.2 MB/s 2024-09-21T07:35:34.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.626 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.626 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128744 s, 81.4 MB/s 2024-09-21T07:35:34.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.642 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.642 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133199 s, 78.7 MB/s 2024-09-21T07:35:34.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.658 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.658 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132908 s, 78.9 MB/s 2024-09-21T07:35:34.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.679 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.679 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185333 s, 56.6 MB/s 2024-09-21T07:35:34.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.695 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-21T07:35:34.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.713 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.713 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155218 s, 67.6 MB/s 2024-09-21T07:35:34.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.731 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.731 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146342 s, 71.7 MB/s 2024-09-21T07:35:34.748 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.748 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.748 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015052 s, 69.7 MB/s 2024-09-21T07:35:34.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.769 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.769 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177442 s, 59.1 MB/s 2024-09-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130738 s, 80.2 MB/s 2024-09-21T07:35:34.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139976 s, 74.9 MB/s 2024-09-21T07:35:34.819 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.820 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152297 s, 68.9 MB/s 2024-09-21T07:35:34.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.836 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.836 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01353 s, 77.5 MB/s 2024-09-21T07:35:34.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.852 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.852 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131493 s, 79.7 MB/s 2024-09-21T07:35:34.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.869 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.869 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147125 s, 71.3 MB/s 2024-09-21T07:35:34.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.891 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.891 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190649 s, 55.0 MB/s 2024-09-21T07:35:34.906 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131459 s, 79.8 MB/s 2024-09-21T07:35:34.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.924 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146979 s, 71.3 MB/s 2024-09-21T07:35:34.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.942 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.942 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151508 s, 69.2 MB/s 2024-09-21T07:35:34.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.964 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.964 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186978 s, 56.1 MB/s 2024-09-21T07:35:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136393 s, 76.9 MB/s 2024-09-21T07:35:34.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:34.999 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:34.999 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151921 s, 69.0 MB/s 2024-09-21T07:35:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173115 s, 60.6 MB/s 2024-09-21T07:35:35.037 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.038 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148673 s, 70.5 MB/s 2024-09-21T07:35:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173863 s, 60.3 MB/s 2024-09-21T07:35:35.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.079 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.079 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180163 s, 58.2 MB/s 2024-09-21T07:35:35.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.097 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.097 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142013 s, 73.8 MB/s 2024-09-21T07:35:35.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.112 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131272 s, 79.9 MB/s 2024-09-21T07:35:35.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.30 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:35.120 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:35.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:35.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178944 s, 58.6 MB/s 2024-09-21T07:35:35.209 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.210 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.210 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137181 s, 76.4 MB/s 2024-09-21T07:35:35.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.228 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.228 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153604 s, 68.3 MB/s 2024-09-21T07:35:35.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.249 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.249 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018672 s, 56.2 MB/s 2024-09-21T07:35:35.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.268 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.268 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162937 s, 64.4 MB/s 2024-09-21T07:35:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.286 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.287 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156911 s, 66.8 MB/s 2024-09-21T07:35:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.303 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138984 s, 75.4 MB/s 2024-09-21T07:35:35.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.319 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.319 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134149 s, 78.2 MB/s 2024-09-21T07:35:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.335 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.336 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134516 s, 78.0 MB/s 2024-09-21T07:35:35.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.357 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.357 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187648 s, 55.9 MB/s 2024-09-21T07:35:35.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.373 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.373 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137701 s, 76.1 MB/s 2024-09-21T07:35:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.389 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.390 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134124 s, 78.2 MB/s 2024-09-21T07:35:35.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.406 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.406 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138027 s, 76.0 MB/s 2024-09-21T07:35:35.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.426 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.426 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173621 s, 60.4 MB/s 2024-09-21T07:35:35.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.443 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138885 s, 75.5 MB/s 2024-09-21T07:35:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133673 s, 78.4 MB/s 2024-09-21T07:35:35.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.475 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.475 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136569 s, 76.8 MB/s 2024-09-21T07:35:35.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.491 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.491 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131934 s, 79.5 MB/s 2024-09-21T07:35:35.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.508 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.508 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136888 s, 76.6 MB/s 2024-09-21T07:35:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.523 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129892 s, 80.7 MB/s 2024-09-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135487 s, 77.4 MB/s 2024-09-21T07:35:35.554 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.555 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.555 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121689 s, 86.2 MB/s 2024-09-21T07:35:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117154 s, 89.5 MB/s 2024-09-21T07:35:35.585 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.585 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.585 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134683 s, 77.9 MB/s 2024-09-21T07:35:35.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.601 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.601 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013499 s, 77.7 MB/s 2024-09-21T07:35:35.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.617 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.617 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131355 s, 79.8 MB/s 2024-09-21T07:35:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.633 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130247 s, 80.5 MB/s 2024-09-21T07:35:35.650 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.651 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.651 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015041 s, 69.7 MB/s 2024-09-21T07:35:35.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.669 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.669 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154086 s, 68.1 MB/s 2024-09-21T07:35:35.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.684 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.684 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128225 s, 81.8 MB/s 2024-09-21T07:35:35.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.701 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.701 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139192 s, 75.3 MB/s 2024-09-21T07:35:35.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.723 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.723 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190295 s, 55.1 MB/s 2024-09-21T07:35:35.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p scrub_control_test_path/dir.31 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> for ((i = 0; i < 32; i++)); do 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> done 2024-09-21T07:35:35.731 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:35:35.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:35:35.801 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.802 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.802 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154976 s, 67.7 MB/s 2024-09-21T07:35:35.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.818 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.818 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136712 s, 76.7 MB/s 2024-09-21T07:35:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136466 s, 76.8 MB/s 2024-09-21T07:35:35.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.850 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.850 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132043 s, 79.4 MB/s 2024-09-21T07:35:35.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.870 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.870 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169965 s, 61.7 MB/s 2024-09-21T07:35:35.890 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.890 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.890 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175732 s, 59.7 MB/s 2024-09-21T07:35:35.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.908 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.908 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152455 s, 68.8 MB/s 2024-09-21T07:35:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.924 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.925 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132137 s, 79.4 MB/s 2024-09-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139095 s, 75.4 MB/s 2024-09-21T07:35:35.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.957 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.957 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131988 s, 79.4 MB/s 2024-09-21T07:35:35.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.973 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.973 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135213 s, 77.5 MB/s 2024-09-21T07:35:35.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:35.991 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:35.991 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151297 s, 69.3 MB/s 2024-09-21T07:35:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.005 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114031 s, 92.0 MB/s 2024-09-21T07:35:36.021 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.022 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.022 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143073 s, 73.3 MB/s 2024-09-21T07:35:36.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.038 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.038 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135214 s, 77.5 MB/s 2024-09-21T07:35:36.054 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.055 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.055 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139182 s, 75.3 MB/s 2024-09-21T07:35:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.071 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136934 s, 76.6 MB/s 2024-09-21T07:35:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155951 s, 67.2 MB/s 2024-09-21T07:35:36.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125944 s, 83.3 MB/s 2024-09-21T07:35:36.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.120 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.120 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131089 s, 80.0 MB/s 2024-09-21T07:35:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.136 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132354 s, 79.2 MB/s 2024-09-21T07:35:36.152 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.153 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.153 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137201 s, 76.4 MB/s 2024-09-21T07:35:36.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.173 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.173 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017283 s, 60.7 MB/s 2024-09-21T07:35:36.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.193 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.193 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175126 s, 59.9 MB/s 2024-09-21T07:35:36.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.213 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.213 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176039 s, 59.6 MB/s 2024-09-21T07:35:36.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.229 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.229 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132959 s, 78.9 MB/s 2024-09-21T07:35:36.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.245 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.246 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133702 s, 78.4 MB/s 2024-09-21T07:35:36.266 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.267 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.267 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183224 s, 57.2 MB/s 2024-09-21T07:35:36.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.285 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.285 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155622 s, 67.4 MB/s 2024-09-21T07:35:36.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.305 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.306 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177879 s, 58.9 MB/s 2024-09-21T07:35:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.323 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142714 s, 73.5 MB/s 2024-09-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138879 s, 75.5 MB/s 2024-09-21T07:35:36.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:35:36.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 -- 172.21.15.64:0/1506346233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0b3850 msgr2=0x7fb08c15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 --2- 172.21.15.64:0/1506346233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0b3850 0x7fb08c15ee70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb078009840 tx=0x7fb07801c800 comp rx=0 tx=0).stop 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 -- 172.21.15.64:0/1506346233 shutdown_connections 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 --2- 172.21.15.64:0/1506346233 >> v2:172.21.15.90:3300/0 conn(0x7fb08c0ce4d0 0x7fb08c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 --2- 172.21.15.64:0/1506346233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0b3850 0x7fb08c15ee70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 -- 172.21.15.64:0/1506346233 >> 172.21.15.64:0/1506346233 conn(0x7fb08c06d450 msgr2=0x7fb08c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 -- 172.21.15.64:0/1506346233 shutdown_connections 2024-09-21T07:35:36.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.505+0000 7fb094000640 1 -- 172.21.15.64:0/1506346233 wait complete. 2024-09-21T07:35:36.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 Processor -- start 2024-09-21T07:35:36.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 -- start start 2024-09-21T07:35:36.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:36.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 0x7fb08c140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb08c0ce4d0 0x7fb08c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c168e50 con 0x7fb08c0b3850 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c168cd0 con 0x7fb08c0ce4d0 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb094000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb08c168fd0 con 0x7fb08c0cc960 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb090c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 0x7fb08c140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54946/0 (socket says 172.21.15.64:54946) 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 -- 172.21.15.64:0/310880649 learned_addr learned my addr 172.21.15.64:0/310880649 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:36.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb092000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb08c0ce4d0 0x7fb08c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:36.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 -- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 msgr2=0x7fb08c140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:36.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 0x7fb08c140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:36.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 -- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb08c0ce4d0 msgr2=0x7fb08c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:36.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb08c0ce4d0 0x7fb08c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 -- 172.21.15.64:0/310880649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c0b19a0 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb090c00640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 0x7fb08c140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb091600640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c3f0 tx=0x7fb08000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.509+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080017070 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb080003600 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c141470 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080003a50 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c0b1c20 con 0x7fb08c0b3850 2024-09-21T07:35:36.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c15ee70 con 0x7fb08c0b3850 2024-09-21T07:35:36.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb08001a070 con 0x7fb08c0b3850 2024-09-21T07:35:36.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb089600640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 0x7fb06c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:36.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.513+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fb0800936c0 con 0x7fb08c0b3850 2024-09-21T07:35:36.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.517+0000 7fb090c00640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 0x7fb06c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:36.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.517+0000 7fb090c00640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 0x7fb06c075710 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb0780af000 tx=0x7fb07801b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:36.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.521+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb08c0b19a0 con 0x7fb08c0b3850 2024-09-21T07:35:36.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:36.733+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fb08c0ca240 con 0x7fb08c0b3850 2024-09-21T07:35:37.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb089600640 1 -- 172.21.15.64:0/310880649 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v134) ==== 105+0+0 (secure 0 0 0) 0x7fb08005de10 con 0x7fb08c0b3850 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 msgr2=0x7fb06c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 0x7fb06c075710 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb0780af000 tx=0x7fb07801b040 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 msgr2=0x7fb08c072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c3f0 tx=0x7fb08000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 shutdown_connections 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb06c073200 0x7fb06c075710 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb08c0ce4d0 0x7fb08c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb08c0cc960 0x7fb08c140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 --2- 172.21.15.64:0/310880649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0b3850 0x7fb08c072c70 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 >> 172.21.15.64:0/310880649 conn(0x7fb08c06d450 msgr2=0x7fb08c15d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.089+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 shutdown_connections 2024-09-21T07:35:37.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.093+0000 7fb094000640 1 -- 172.21.15.64:0/310880649 wait complete. 2024-09-21T07:35:37.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-21T07:35:37.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 -- 172.21.15.64:0/4124587870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140b4460 msgr2=0x7fe9140cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 --2- 172.21.15.64:0/4124587870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140b4460 0x7fe9140cd140 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fe900009900 tx=0x7fe90001c7e0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 -- 172.21.15.64:0/4124587870 shutdown_connections 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 --2- 172.21.15.64:0/4124587870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9140c5f00 0x7fe9140c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 --2- 172.21.15.64:0/4124587870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140b4460 0x7fe9140cd140 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 -- 172.21.15.64:0/4124587870 >> 172.21.15.64:0/4124587870 conn(0x7fe91406d4e0 msgr2=0x7fe9140ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 -- 172.21.15.64:0/4124587870 shutdown_connections 2024-09-21T07:35:37.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.273+0000 7fe918e00640 1 -- 172.21.15.64:0/4124587870 wait complete. 2024-09-21T07:35:37.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 Processor -- start 2024-09-21T07:35:37.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 -- start start 2024-09-21T07:35:37.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9140ccd30 0x7fe914157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe914154570 0x7fe91415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe914169f30 con 0x7fe9140c5f00 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe914169db0 con 0x7fe9140ccd30 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe918e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe91416a0b0 con 0x7fe914154570 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54958/0 (socket says 172.21.15.64:54958) 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 -- 172.21.15.64:0/357040336 learned_addr learned my addr 172.21.15.64:0/357040336 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911400640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9140ccd30 0x7fe914157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:37.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe912800640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe914154570 0x7fe91415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:37.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 -- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe914154570 msgr2=0x7fe91415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:37.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe914154570 0x7fe91415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 -- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9140ccd30 msgr2=0x7fe914157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:37.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9140ccd30 0x7fe914157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 -- 172.21.15.64:0/357040336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91414c0d0 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.277+0000 7fe911e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fe904001ec0 tx=0x7fe90400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904017070 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe904003600 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904003a50 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91415e880 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91415ee40 con 0x7fe9140c5f00 2024-09-21T07:35:37.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9141505e0 con 0x7fe9140c5f00 2024-09-21T07:35:37.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe90401a070 con 0x7fe9140c5f00 2024-09-21T07:35:37.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 0x7fe8f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:37.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fe904093620 con 0x7fe9140c5f00 2024-09-21T07:35:37.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.281+0000 7fe911400640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 0x7fe8f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:37.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.285+0000 7fe911400640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 0x7fe8f4075710 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe9000af000 tx=0x7fe90001b020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:37.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.285+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe90405de90 con 0x7fe9140c5f00 2024-09-21T07:35:37.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:37.513+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe9140cd140 con 0x7fe9140c5f00 2024-09-21T07:35:38.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.097+0000 7fe90a000640 1 -- 172.21.15.64:0/357040336 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v135) ==== 121+0+0 (secure 0 0 0) 0x7fe9040628c0 con 0x7fe9140c5f00 2024-09-21T07:35:38.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 msgr2=0x7fe8f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 0x7fe8f4075710 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe9000af000 tx=0x7fe90001b020 comp rx=0 tx=0).stop 2024-09-21T07:35:38.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 msgr2=0x7fe914157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fe904001ec0 tx=0x7fe90400c890 comp rx=0 tx=0).stop 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 shutdown_connections 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe8f4073200 0x7fe8f4075710 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe914154570 0x7fe91415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9140ccd30 0x7fe914157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 --2- 172.21.15.64:0/357040336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9140c5f00 0x7fe914157610 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 >> 172.21.15.64:0/357040336 conn(0x7fe91406d4e0 msgr2=0x7fe9140b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 shutdown_connections 2024-09-21T07:35:38.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.101+0000 7fe918e00640 1 -- 172.21.15.64:0/357040336 wait complete. 2024-09-21T07:35:38.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:38.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 -- 172.21.15.64:0/3553713870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b48004810 msgr2=0x7f2b48004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 --2- 172.21.15.64:0/3553713870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009b40 tx=0x7f2b4c01d250 comp rx=0 tx=0).stop 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 -- 172.21.15.64:0/3553713870 shutdown_connections 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 --2- 172.21.15.64:0/3553713870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 -- 172.21.15.64:0/3553713870 >> 172.21.15.64:0/3553713870 conn(0x7f2b600ccbe0 msgr2=0x7f2b600ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 -- 172.21.15.64:0/3553713870 shutdown_connections 2024-09-21T07:35:38.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.293+0000 7f2b68600640 1 -- 172.21.15.64:0/3553713870 wait complete. 2024-09-21T07:35:38.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 Processor -- start 2024-09-21T07:35:38.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 -- start start 2024-09-21T07:35:38.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b48004810 0x7f2b600ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b600b0d80 0x7f2b600b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600b4550 con 0x7f2b601482b0 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600b43d0 con 0x7f2b48004810 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2b600700b0 con 0x7f2b600b0d80 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54970/0 (socket says 172.21.15.64:54970) 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 -- 172.21.15.64:0/738386497 learned_addr learned my addr 172.21.15.64:0/738386497 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65c00640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b48004810 0x7f2b600ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:38.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b66600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b600b0d80 0x7f2b600b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:38.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 -- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b600b0d80 msgr2=0x7f2b600b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b600b0d80 0x7f2b600b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 -- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b48004810 msgr2=0x7f2b600ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b48004810 0x7f2b600ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 -- 172.21.15.64:0/738386497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b600c93a0 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b65200640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae040 tx=0x7f2b4c0050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0bb030 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b4c004b10 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0b7440 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.297+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b600c9680 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b600c9c40 con 0x7f2b601482b0 2024-09-21T07:35:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b60075820 con 0x7f2b601482b0 2024-09-21T07:35:38.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b4c0be030 con 0x7f2b601482b0 2024-09-21T07:35:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b5d600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 0x7f2b40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f2b4c12fce0 con 0x7f2b601482b0 2024-09-21T07:35:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.301+0000 7f2b65c00640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 0x7f2b40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.305+0000 7f2b65c00640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 0x7f2b40075710 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2b54006e20 tx=0x7f2b54006960 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:38.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.305+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2b4c016f60 con 0x7f2b601482b0 2024-09-21T07:35:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.517+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b6015e510 con 0x7f2b601482b0 2024-09-21T07:35:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.517+0000 7f2b5d600640 1 -- 172.21.15.64:0/738386497 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5240 (secure 0 0 0) 0x7f2b4c0fa440 con 0x7f2b601482b0 2024-09-21T07:35:38.520 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:38.520 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":136,"btime":"2024-09-21T07:35:38:106449+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:38.106426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10065":{"gid":10065,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 136 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 msgr2=0x7f2b40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 0x7f2b40075710 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2b54006e20 tx=0x7f2b54006960 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 msgr2=0x7f2b601f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae040 tx=0x7f2b4c0050a0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 shutdown_connections 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2b40073200 0x7f2b40075710 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b600b0d80 0x7f2b600b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b601482b0 0x7f2b601f6670 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 --2- 172.21.15.64:0/738386497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b48004810 0x7f2b600ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 >> 172.21.15.64:0/738386497 conn(0x7f2b600ccbe0 msgr2=0x7f2b60072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 shutdown_connections 2024-09-21T07:35:38.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:38.521+0000 7f2b68600640 1 -- 172.21.15.64:0/738386497 wait complete. 2024-09-21T07:35:38.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:35:02.669172+0000', 'modified': '2024-09-21T07:35:38.106426+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10065': {'gid': 10065, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6833/1704179740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 1704179740}, {'type': 'v1', 'addr': '172.21.15.64:6833', 'nonce': 1704179740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_10068': {'gid': 10068, 'name': 'a', 'rank': 0, 'incarnation': 129, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/650567742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 650567742}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 650567742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10068, 'qdb_cluster': [10068]} 2024-09-21T07:35:38.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:35:38.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:35:39.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 -- 172.21.15.64:0/1062424535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 msgr2=0x7fbd6406f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 --2- 172.21.15.64:0/1062424535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd6406f890 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fbd64070f10 tx=0x7fbd5c01cb80 comp rx=0 tx=0).stop 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 -- 172.21.15.64:0/1062424535 shutdown_connections 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 --2- 172.21.15.64:0/1062424535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd6406f890 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 --2- 172.21.15.64:0/1062424535 >> v2:172.21.15.90:3300/0 conn(0x7fbd6409df30 0x7fbd640b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 -- 172.21.15.64:0/1062424535 >> 172.21.15.64:0/1062424535 conn(0x7fbd6406d450 msgr2=0x7fbd640d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 -- 172.21.15.64:0/1062424535 shutdown_connections 2024-09-21T07:35:39.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.105+0000 7fbd68c00640 1 -- 172.21.15.64:0/1062424535 wait complete. 2024-09-21T07:35:39.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 Processor -- start 2024-09-21T07:35:39.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- start start 2024-09-21T07:35:39.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd6409df30 0x7fbd64153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd640b3910 0x7fbd64151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64169000 con 0x7fbd640ce900 2024-09-21T07:35:39.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64168e80 con 0x7fbd640b3910 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbd64169180 con 0x7fbd6409df30 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55000/0 (socket says 172.21.15.64:55000) 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 -- 172.21.15.64:0/689295079 learned_addr learned my addr 172.21.15.64:0/689295079 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd5be00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd640b3910 0x7fbd64151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd61e00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd6409df30 0x7fbd64153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 -- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd6409df30 msgr2=0x7fbd64153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd6409df30 0x7fbd64153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 -- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd640b3910 msgr2=0x7fbd64151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd640b3910 0x7fbd64151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 -- 172.21.15.64:0/689295079 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd64158d40 con 0x7fbd640ce900 2024-09-21T07:35:39.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd62800640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009b10 tx=0x7fbd5c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd5a000640 1 -- 172.21.15.64:0/689295079 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0bc070 con 0x7fbd640ce900 2024-09-21T07:35:39.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd5a000640 1 -- 172.21.15.64:0/689295079 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd5c0042f0 con 0x7fbd640ce900 2024-09-21T07:35:39.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd5a000640 1 -- 172.21.15.64:0/689295079 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0b2040 con 0x7fbd640ce900 2024-09-21T07:35:39.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd640b2520 con 0x7fbd640ce900 2024-09-21T07:35:39.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.109+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd641519d0 con 0x7fbd640ce900 2024-09-21T07:35:39.114 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd5a000640 1 -- 172.21.15.64:0/689295079 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbd5c0bf070 con 0x7fbd640ce900 2024-09-21T07:35:39.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd5a000640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 0x7fbd40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd5a000640 1 -- 172.21.15.64:0/689295079 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fbd5c12e190 con 0x7fbd640ce900 2024-09-21T07:35:39.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd61e00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 0x7fbd40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd703e4000 1 Processor -- start 2024-09-21T07:35:39.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd703e4000 1 -- start start 2024-09-21T07:35:39.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.113+0000 7fbd61e00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 0x7fbd40075710 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005fd0 tx=0x7fbd5400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b4b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 0x55f9a4b4b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f9a4a1b410 con 0x55f9a4605460 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9a4958b40 con 0x55f9a49f5950 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f9a4947f70 con 0x55f9a49deca0 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55006/0 (socket says 172.21.15.64:55006) 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 -- 172.21.15.64:0/774936625 learned_addr learned my addr 172.21.15.64:0/774936625 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd5be00640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b4b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd62800640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 0x55f9a4b4b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 -- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 msgr2=0x55f9a4b4b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 0x55f9a4b4b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 -- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 msgr2=0x55f9a4b4b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b4b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 -- 172.21.15.64:0/774936625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a490f5b0 con 0x55f9a4605460 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd62800640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 0x55f9a4b4b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd61e00640 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010f70 tx=0x7fbd54013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e4b9bd692c7212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd52600640 1 -- 172.21.15.64:0/774936625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401e620 con 0x55f9a4605460 2024-09-21T07:35:39.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd52600640 1 -- 172.21.15.64:0/774936625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd5401e7c0 con 0x55f9a4605460 2024-09-21T07:35:39.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd52600640 1 -- 172.21.15.64:0/774936625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401eb70 con 0x55f9a4605460 2024-09-21T07:35:39.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- 172.21.15.64:0/774936625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 msgr2=0x55f9a4b4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010f70 tx=0x7fbd54013000 comp rx=0 tx=0).stop 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- 172.21.15.64:0/774936625 shutdown_connections 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49deca0 0x55f9a4b4b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b4b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 --2- 172.21.15.64:0/774936625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4b4ab00 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- 172.21.15.64:0/774936625 >> 172.21.15.64:0/774936625 conn(0x55f9a4acbd90 msgr2=0x55f9a4afb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- 172.21.15.64:0/774936625 shutdown_connections 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- 172.21.15.64:0/774936625 wait complete. 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.117+0000 7fbd703e4000 1 -- start start 2024-09-21T07:35:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 Processor -- start 2024-09-21T07:35:39.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a4605460 0x55f9a4b390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f9a48e25f0 con 0x55f9a49deca0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9a494bd80 con 0x55f9a49f5950 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f9a48ee520 con 0x55f9a4605460 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 10 client.0 _ll_register_callbacks cb 0x55f9a48f2830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55012/0 (socket says 172.21.15.64:55012) 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 -- 172.21.15.64:0/3083421516 learned_addr learned my addr 172.21.15.64:0/3083421516 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd61e00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a4605460 0x55f9a4b390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd62800640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 -- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a4605460 msgr2=0x55f9a4b390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a4605460 0x55f9a4b390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 -- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 msgr2=0x55f9a4b39b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b39b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 -- 172.21.15.64:0/3083421516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a48e6190 con 0x55f9a49deca0 2024-09-21T07:35:39.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd62800640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c012520 tx=0x7fbd4c0129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95a0096c2548e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c019070 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fbd4c005260 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9a48e0110 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fbd4c024050 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 10 client.10275 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55f9a49ccf10 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f9a48e0110 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fbd4c027020 con 0x55f9a49deca0 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 10 client.10275 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 10 client.10275 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 20 client.10275 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45ea7d0 0x55f9a4b3a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 4 client.10275 mds_command: new command op to 10068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:39.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 --> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9a495aa90 con 0x55f9a45ea7d0 2024-09-21T07:35:39.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.121+0000 7fbd61e00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45ea7d0 0x55f9a4b3a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd61e00640 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45ea7d0 0x55f9a4b3a570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31be5128c4c7a5a server_cookie=d4a17fc49b13e6e5 in_seq=0 out_seq=0 2024-09-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd46a00640 10 client.10275 ms_handle_connect on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd46a00640 1 -- 172.21.15.64:0/3083421516 <== mds.0 v2:172.21.15.64:6834/650567742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9a495aa90 con 0x55f9a45ea7d0 2024-09-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd46a00640 10 client.10275 handle_command_reply: tid=0 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 client.10275 shutdown 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 msgr2=0x55f9a4b39620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c012520 tx=0x7fbd4c0129e0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 shutdown_connections 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45ea7d0 0x55f9a4b3a570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49f5950 0x55f9a4b39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b39620 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3083421516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a4605460 0x55f9a4b390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd46a00640 0 client.10275 ms_handle_reset on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 >> 172.21.15.64:0/3083421516 conn(0x55f9a4acbd90 msgr2=0x55f9a4b03050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 shutdown_connections 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 1 -- 172.21.15.64:0/3083421516 wait complete. 2024-09-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.125+0000 7fbd703e4000 20 client.10275 trim_cache size 0 max 16384 2024-09-21T07:35:39.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 Processor -- start 2024-09-21T07:35:39.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 -- start start 2024-09-21T07:35:39.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a4605460 0x55f9a4b08190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4b61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd642011c0 con 0x55f9a49deca0 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64201890 con 0x55f9a4605460 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbd641faaf0 con 0x55f9a49f5950 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55018/0 (socket says 172.21.15.64:55018) 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 -- 172.21.15.64:0/3803280625 learned_addr learned my addr 172.21.15.64:0/3803280625 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd61e00640 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a4605460 0x55f9a4b08190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd62800640 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4b61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 -- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 msgr2=0x55f9a4b61110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4b61110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 -- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a4605460 msgr2=0x55f9a4b08190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a4605460 0x55f9a4b08190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 -- 172.21.15.64:0/3803280625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a49a3db0 con 0x55f9a49deca0 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd5be00640 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0012f0 tx=0x7fbd4c000e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4905cf6f15100fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd51c00640 1 -- 172.21.15.64:0/3803280625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c02d070 con 0x55f9a49deca0 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd51c00640 1 -- 172.21.15.64:0/3803280625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd4c004990 con 0x55f9a49deca0 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.145+0000 7fbd51c00640 1 -- 172.21.15.64:0/3803280625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c019070 con 0x55f9a49deca0 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- 172.21.15.64:0/3803280625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 msgr2=0x55f9a4b086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0012f0 tx=0x7fbd4c000e50 comp rx=0 tx=0).stop 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- 172.21.15.64:0/3803280625 shutdown_connections 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4b61110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a49deca0 0x55f9a4b086d0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- 172.21.15.64:0/3803280625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a4605460 0x55f9a4b08190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- 172.21.15.64:0/3803280625 >> 172.21.15.64:0/3803280625 conn(0x55f9a4acbd90 msgr2=0x55f9a4b07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- 172.21.15.64:0/3803280625 shutdown_connections 2024-09-21T07:35:39.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- 172.21.15.64:0/3803280625 wait complete. 2024-09-21T07:35:39.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- start start 2024-09-21T07:35:39.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 Processor -- start 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49deca0 0x55f9a4bc0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4bc1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f9a4b39f20 con 0x55f9a4605460 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9a494b090 con 0x55f9a49deca0 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f9a49cca80 con 0x55f9a49f5950 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd703e4000 10 client.0 _ll_register_callbacks cb 0x7fbd4c001bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55026/0 (socket says 172.21.15.64:55026) 2024-09-21T07:35:39.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 -- 172.21.15.64:0/1540116254 learned_addr learned my addr 172.21.15.64:0/1540116254 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd5be00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49deca0 0x55f9a4bc0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd62800640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4bc1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 -- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 msgr2=0x55f9a4bc1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4bc1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 -- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49deca0 msgr2=0x55f9a4bc0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49deca0 0x55f9a4bc0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.149+0000 7fbd61e00640 1 -- 172.21.15.64:0/1540116254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a490eab0 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd61e00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005840 tx=0x7fbd54011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ac89aed056cbfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401e9d0 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fbd5401eb70 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd4c004990 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fbd54047050 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 10 client.10281 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55f9a48ed070 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd4c004990 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fbd5404a020 con 0x55f9a4605460 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 10 client.10281 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 10 client.10281 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 20 client.10281 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45d8830 0x55f9a4b5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 4 client.10281 mds_command: new command op to 10068 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:35:39.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 --> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] -- command(tid 0: {"prefix": "status"}) -- 0x55f9a4956540 con 0x55f9a45d8830 2024-09-21T07:35:39.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd5be00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45d8830 0x55f9a4b5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd5be00640 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45d8830 0x55f9a4b5dce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdee7c0570697a1a server_cookie=87571ab8b1de867 in_seq=0 out_seq=0 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 10 client.10281 ms_handle_connect on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 1 -- 172.21.15.64:0/1540116254 <== mds.0 v2:172.21.15.64:6834/650567742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55f9a4956540 con 0x55f9a45d8830 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 10 client.10281 handle_command_reply: tid=0 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 client.10281 shutdown 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 msgr2=0x55f9a4bc06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005840 tx=0x7fbd54011d50 comp rx=0 tx=0).stop 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 shutdown_connections 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:6834/650567742,v1:172.21.15.64:6835/650567742] conn(0x55f9a45d8830 0x55f9a4b5dce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f9a49f5950 0x55f9a4bc1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f9a49deca0 0x55f9a4bc0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 --2- 172.21.15.64:0/1540116254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f9a4605460 0x55f9a4bc06d0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd46a00640 0 client.10281 ms_handle_reset on v2:172.21.15.64:6834/650567742 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 >> 172.21.15.64:0/1540116254 conn(0x55f9a4acbd90 msgr2=0x55f9a4b08440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 shutdown_connections 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 1 -- 172.21.15.64:0/1540116254 wait complete. 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd703e4000 20 client.10281 trim_cache size 0 max 16384 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 10068, 2024-09-21T07:35:39.158 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 35.925987565, 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 136, 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 180, 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 180, 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 40.365898311000002 2024-09-21T07:35:39.159 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 msgr2=0x7fbd40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 0x7fbd40075710 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005fd0 tx=0x7fbd5400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 msgr2=0x7fbd641f6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009b10 tx=0x7fbd5c009310 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 shutdown_connections 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd40073200 0x7fbd40075710 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd640ce900 0x7fbd641f6f10 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd640b3910 0x7fbd64151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 --2- 172.21.15.64:0/689295079 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd6409df30 0x7fbd64153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 >> 172.21.15.64:0/689295079 conn(0x7fbd6406d450 msgr2=0x7fbd640ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 shutdown_connections 2024-09-21T07:35:39.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.153+0000 7fbd68c00640 1 -- 172.21.15.64:0/689295079 wait complete. 2024-09-21T07:35:39.175 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /scrub_control_test_path recursive 2024-09-21T07:35:39.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 -- 172.21.15.64:0/3637146198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 msgr2=0x7f14700cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 --2- 172.21.15.64:0/3637146198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f14700cde40 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f1458009840 tx=0x7f145801c730 comp rx=0 tx=0).stop 2024-09-21T07:35:39.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 -- 172.21.15.64:0/3637146198 shutdown_connections 2024-09-21T07:35:39.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 --2- 172.21.15.64:0/3637146198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f14700cde40 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 --2- 172.21.15.64:0/3637146198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f147015f660 0x7f147006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 -- 172.21.15.64:0/3637146198 >> 172.21.15.64:0/3637146198 conn(0x7f14700d0170 msgr2=0x7f14700d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 -- 172.21.15.64:0/3637146198 shutdown_connections 2024-09-21T07:35:39.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.337+0000 7f1475c00640 1 -- 172.21.15.64:0/3637146198 wait complete. 2024-09-21T07:35:39.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 Processor -- start 2024-09-21T07:35:39.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- start start 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f1470165a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14700ce380 0x7f1470155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f147015f660 0x7f14700c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1470166510 con 0x7f147006fa40 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1470166390 con 0x7f147015f660 2024-09-21T07:35:39.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1470166690 con 0x7f14700ce380 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f1470165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f1470165a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55032/0 (socket says 172.21.15.64:55032) 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 -- 172.21.15.64:0/1595507875 learned_addr learned my addr 172.21.15.64:0/1595507875 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1466000640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14700ce380 0x7f1470155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146f400640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f147015f660 0x7f14700c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 -- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14700ce380 msgr2=0x7f1470155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14700ce380 0x7f1470155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 -- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f147015f660 msgr2=0x7f14700c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f147015f660 0x7f14700c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 -- 172.21.15.64:0/1595507875 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1470164520 con 0x7f147006fa40 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f146ea00640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f147006fa40 0x7f1470165a40 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f146000eb30 tx=0x7f146000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1467400640 1 -- 172.21.15.64:0/1595507875 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460004b30 con 0x7f147006fa40 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1467400640 1 -- 172.21.15.64:0/1595507875 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1460004cf0 con 0x7f147006fa40 2024-09-21T07:35:39.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1467400640 1 -- 172.21.15.64:0/1595507875 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460005280 con 0x7f147006fa40 2024-09-21T07:35:39.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- 172.21.15.64:0/1595507875 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1470164800 con 0x7f147006fa40 2024-09-21T07:35:39.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.341+0000 7f1475c00640 1 -- 172.21.15.64:0/1595507875 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1470164dc0 con 0x7f147006fa40 2024-09-21T07:35:39.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f1467400640 1 -- 172.21.15.64:0/1595507875 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1460005420 con 0x7f147006fa40 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f1467400640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f144c073200 0x7f144c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f1467400640 1 -- 172.21.15.64:0/1595507875 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1460095260 con 0x7f147006fa40 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f147d302000 1 Processor -- start 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f1466000640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f144c073200 0x7f144c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.345+0000 7f147d302000 1 -- start start 2024-09-21T07:35:39.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f1466000640 1 --2- 172.21.15.64:0/1595507875 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f144c073200 0x7f144c075710 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f14580af000 tx=0x7f145801afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd5b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556ecd3c4dd0 con 0x556ecd43bbd0 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ecd3b4200 con 0x556ecd44b240 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556ecd3b8010 con 0x556ecd461770 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55042/0 (socket says 172.21.15.64:55042) 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 -- 172.21.15.64:0/1022118869 learned_addr learned my addr 172.21.15.64:0/1022118869 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146ea00640 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd5b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f1466000640 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 -- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 msgr2=0x556ecd5b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd5b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 -- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 msgr2=0x556ecd5b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 -- 172.21.15.64:0/1022118869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ecd36d7c0 con 0x556ecd43bbd0 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f146f400640 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1468001490 tx=0x7f1468001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bd7fcf352f2f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f145f400640 1 -- 172.21.15.64:0/1022118869 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468005020 con 0x556ecd43bbd0 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f145f400640 1 -- 172.21.15.64:0/1022118869 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14680052b0 con 0x556ecd43bbd0 2024-09-21T07:35:39.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f145f400640 1 -- 172.21.15.64:0/1022118869 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468005500 con 0x556ecd43bbd0 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- 172.21.15.64:0/1022118869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 msgr2=0x556ecd5b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1468001490 tx=0x7f1468001950 comp rx=0 tx=0).stop 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- 172.21.15.64:0/1022118869 shutdown_connections 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd5b3240 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 --2- 172.21.15.64:0/1022118869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd5b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- 172.21.15.64:0/1022118869 >> 172.21.15.64:0/1022118869 conn(0x556ecd482640 msgr2=0x556ecd595c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- 172.21.15.64:0/1022118869 shutdown_connections 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.349+0000 7f147d302000 1 -- 172.21.15.64:0/1022118869 wait complete. 2024-09-21T07:35:39.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- start start 2024-09-21T07:35:39.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 Processor -- start 2024-09-21T07:35:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd56def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd461770 0x556ecd594db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556ecd0795b0 con 0x556ecd44b240 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ecd34e9c0 con 0x556ecd461770 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556ecd369cf0 con 0x556ecd43bbd0 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 10 client.0 _ll_register_callbacks cb 0x556ecd35a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55052/0 (socket says 172.21.15.64:55052) 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 -- 172.21.15.64:0/3862756205 learned_addr learned my addr 172.21.15.64:0/3862756205 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f146f400640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd461770 0x556ecd594db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f146ea00640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd56def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 -- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 msgr2=0x556ecd56def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd56def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 -- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd461770 msgr2=0x556ecd594db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd461770 0x556ecd594db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 -- 172.21.15.64:0/3862756205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ecd3742e0 con 0x556ecd44b240 2024-09-21T07:35:39.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1466000640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f14580b0040 tx=0x7f145801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f87f2acae936ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14580c1070 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1458005590 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ecd34c650 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f14580d4050 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 10 client.10296 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x556ecd3744e0 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556ecd34c650 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.353+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f14580d7020 con 0x556ecd44b240 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 10 client.10296 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 10 client.10296 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 20 client.10296 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd056860 0x556ecd5c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 4 client.10296 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ecd3c6d20 con 0x556ecd056860 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f146ea00640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd056860 0x556ecd5c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f146ea00640 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd056860 0x556ecd5c3d80 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=20e66359676fe7c5 server_cookie=713020b058a580de in_seq=0 out_seq=0 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f1453e00640 10 client.10296 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f1453e00640 1 -- 172.21.15.64:0/3862756205 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1460079e50 con 0x556ecd056860 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f1453e00640 10 client.10296 handle_command_reply: tid=0 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 client.10296 shutdown 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 msgr2=0x556ecd56e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f14580b0040 tx=0x7f145801c730 comp rx=0 tx=0).stop 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 shutdown_connections 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd461770 0x556ecd594db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd056860 0x556ecd5c3d80 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd44b240 0x556ecd56e430 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 --2- 172.21.15.64:0/3862756205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd56def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f1453e00640 0 client.10296 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 >> 172.21.15.64:0/3862756205 conn(0x556ecd482640 msgr2=0x556ecd566b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 shutdown_connections 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 1 -- 172.21.15.64:0/3862756205 wait complete. 2024-09-21T07:35:39.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.357+0000 7f147d302000 20 client.10296 trim_cache size 0 max 16384 2024-09-21T07:35:39.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 Processor -- start 2024-09-21T07:35:39.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 -- start start 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd594960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd594ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14702060a0 con 0x556ecd43bbd0 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f147009c990 con 0x556ecd44b240 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1470204c60 con 0x556ecd461770 2024-09-21T07:35:39.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55060/0 (socket says 172.21.15.64:55060) 2024-09-21T07:35:39.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 -- 172.21.15.64:0/1151616216 learned_addr learned my addr 172.21.15.64:0/1151616216 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f1466000640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd594960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146f400640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd594ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 -- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 msgr2=0x556ecd594ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd594ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 -- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 msgr2=0x556ecd594960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd594960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 -- 172.21.15.64:0/1151616216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ecd352540 con 0x556ecd43bbd0 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f1466000640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd594960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146f400640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd594ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f146ea00640 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f146005f600 tx=0x7f1460084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e86b0f57fa4858 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f145ea00640 1 -- 172.21.15.64:0/1151616216 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146005f410 con 0x556ecd43bbd0 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f145ea00640 1 -- 172.21.15.64:0/1151616216 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1460079e50 con 0x556ecd43bbd0 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.377+0000 7f145ea00640 1 -- 172.21.15.64:0/1151616216 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460060000 con 0x556ecd43bbd0 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- 172.21.15.64:0/1151616216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 msgr2=0x556ecd56e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f146005f600 tx=0x7f1460084040 comp rx=0 tx=0).stop 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- 172.21.15.64:0/1151616216 shutdown_connections 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd461770 0x556ecd594ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd594960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- 172.21.15.64:0/1151616216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd43bbd0 0x556ecd56e490 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- 172.21.15.64:0/1151616216 >> 172.21.15.64:0/1151616216 conn(0x556ecd482640 msgr2=0x556ecd5c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- 172.21.15.64:0/1151616216 shutdown_connections 2024-09-21T07:35:39.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- 172.21.15.64:0/1151616216 wait complete. 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- start start 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 Processor -- start 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd5c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556ecd3c3ba0 con 0x556ecd461770 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ecd473570 con 0x556ecd44b240 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556ecd3b7320 con 0x556ecd43bbd0 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f147d302000 10 client.0 _ll_register_callbacks cb 0x7f1454003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55064/0 (socket says 172.21.15.64:55064) 2024-09-21T07:35:39.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 -- 172.21.15.64:0/863445292 learned_addr learned my addr 172.21.15.64:0/863445292 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146ea00640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd5c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f1466000640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 -- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 msgr2=0x556ecd5c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd5c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 -- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 msgr2=0x556ecd5c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.381+0000 7f146f400640 1 -- 172.21.15.64:0/863445292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ecd438810 con 0x556ecd461770 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f146f400640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f1468000c10 tx=0x7f146800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2e70ceff27dc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146800eda0 con 0x556ecd461770 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1468010040 con 0x556ecd461770 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1460079e50 con 0x556ecd461770 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f1468030050 con 0x556ecd461770 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 10 client.10302 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x556ecd359420 con 0x556ecd461770 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1460079e50 con 0x556ecd461770 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f1468033020 con 0x556ecd461770 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 10 client.10302 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 10 client.10302 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 20 client.10302 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd0448c0 0x556ecd5c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 4 client.10302 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x556ecd3c27d0 con 0x556ecd0448c0 2024-09-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f146ea00640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd0448c0 0x556ecd5c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f146ea00640 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd0448c0 0x556ecd5c6250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=9076ceca0e2b841e server_cookie=1d3f7fe872cf525c in_seq=0 out_seq=0 2024-09-21T07:35:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 10 client.10302 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 1 -- 172.21.15.64:0/863445292 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x556ecd3c27d0 con 0x556ecd0448c0 2024-09-21T07:35:39.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 10 client.10302 handle_command_reply: tid=0 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 client.10302 shutdown 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 msgr2=0x556ecd5c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f1468000c10 tx=0x7f146800e960 comp rx=0 tx=0).stop 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 shutdown_connections 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x556ecd0448c0 0x556ecd5c6250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556ecd461770 0x556ecd5c5d10 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ecd44b240 0x556ecd5c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 --2- 172.21.15.64:0/863445292 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556ecd43bbd0 0x556ecd5c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f1453e00640 0 client.10302 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 >> 172.21.15.64:0/863445292 conn(0x556ecd482640 msgr2=0x556ecd5c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 shutdown_connections 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 1 -- 172.21.15.64:0/863445292 wait complete. 2024-09-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.385+0000 7f147d302000 20 client.10302 trim_cache size 0 max 16384 2024-09-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi064.stderr:Error EINVAL: MDS is not active 2024-09-21T07:35:39.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T07:35:39.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-21T07:35:39.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 -- 172.21.15.64:0/3262782723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16300706c0 msgr2=0x7f16300ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 --2- 172.21.15.64:0/3262782723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16300706c0 0x7f16300ce740 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f16300b3130 tx=0x7f161801c780 comp rx=0 tx=0).stop 2024-09-21T07:35:39.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 -- 172.21.15.64:0/3262782723 shutdown_connections 2024-09-21T07:35:39.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 --2- 172.21.15.64:0/3262782723 >> v2:172.21.15.90:3300/0 conn(0x7f16300ca990 0x7f16300b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 --2- 172.21.15.64:0/3262782723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16300706c0 0x7f16300ce740 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 -- 172.21.15.64:0/3262782723 >> 172.21.15.64:0/3262782723 conn(0x7f16300ccbe0 msgr2=0x7f16300ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 -- 172.21.15.64:0/3262782723 shutdown_connections 2024-09-21T07:35:39.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.553+0000 7f1637200640 1 -- 172.21.15.64:0/3262782723 wait complete. 2024-09-21T07:35:39.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 Processor -- start 2024-09-21T07:35:39.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- start start 2024-09-21T07:35:39.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16300ca990 0x7f1630159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163015ec20 0x7f16300b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16300c8ad0 0x7f163015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1630168cd0 con 0x7f163015ec20 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1630168b50 con 0x7f16300c8ad0 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1630168e50 con 0x7f16300ca990 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163015ec20 0x7f16300b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163015ec20 0x7f16300b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55082/0 (socket says 172.21.15.64:55082) 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 -- 172.21.15.64:0/2954004626 learned_addr learned my addr 172.21.15.64:0/2954004626 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f162fe00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16300ca990 0x7f1630159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1635200640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16300c8ad0 0x7f163015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 -- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16300ca990 msgr2=0x7f1630159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f16300ca990 0x7f1630159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 -- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16300c8ad0 msgr2=0x7f163015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16300c8ad0 0x7f163015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 -- 172.21.15.64:0/2954004626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16301598d0 con 0x7f163015ec20 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1627e00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163015ec20 0x7f16300b0d50 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f1618019390 tx=0x7f1618005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f162cc00640 1 -- 172.21.15.64:0/2954004626 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180b2040 con 0x7f163015ec20 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f162cc00640 1 -- 172.21.15.64:0/2954004626 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1618005320 con 0x7f163015ec20 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- 172.21.15.64:0/2954004626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16300b1290 con 0x7f163015ec20 2024-09-21T07:35:39.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f162cc00640 1 -- 172.21.15.64:0/2954004626 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180a5840 con 0x7f163015ec20 2024-09-21T07:35:39.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.557+0000 7f1637200640 1 -- 172.21.15.64:0/2954004626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16301fc670 con 0x7f163015ec20 2024-09-21T07:35:39.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.561+0000 7f162cc00640 1 -- 172.21.15.64:0/2954004626 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f16180bd060 con 0x7f163015ec20 2024-09-21T07:35:39.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.561+0000 7f162cc00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f160c073200 0x7f160c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.561+0000 7f162cc00640 1 -- 172.21.15.64:0/2954004626 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f161812db10 con 0x7f163015ec20 2024-09-21T07:35:39.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.561+0000 7f163e91d000 1 Processor -- start 2024-09-21T07:35:39.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.561+0000 7f162fe00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f160c073200 0x7f160c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- start start 2024-09-21T07:35:39.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- 172.21.15.64:0/2954004626 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f160c073200 0x7f160c075710 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1620007fd0 tx=0x7f1620009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a58c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a58c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f11a39dab0 con 0x55f11a45ce60 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f11a38cee0 con 0x55f11a43bd80 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f11a390cf0 con 0x55f11a426560 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55094/0 (socket says 172.21.15.64:55094) 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 -- 172.21.15.64:0/769738495 learned_addr learned my addr 172.21.15.64:0/769738495 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f1635200640 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a58c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f1627e00640 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a58c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 -- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 msgr2=0x55f11a58c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a58c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 -- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 msgr2=0x55f11a58c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a58c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 -- 172.21.15.64:0/769738495 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f11a331240 con 0x55f11a45ce60 2024-09-21T07:35:39.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f162fe00640 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f162000f960 tx=0x7f1620012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d527ac44ec7b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f1624c00640 1 -- 172.21.15.64:0/769738495 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620025070 con 0x55f11a45ce60 2024-09-21T07:35:39.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f1624c00640 1 -- 172.21.15.64:0/769738495 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f162001b050 con 0x55f11a45ce60 2024-09-21T07:35:39.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f1624c00640 1 -- 172.21.15.64:0/769738495 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620014e20 con 0x55f11a45ce60 2024-09-21T07:35:39.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- 172.21.15.64:0/769738495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 msgr2=0x55f11a58bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f162000f960 tx=0x7f1620012000 comp rx=0 tx=0).stop 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- 172.21.15.64:0/769738495 shutdown_connections 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a58c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a58c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 --2- 172.21.15.64:0/769738495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a58bba0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- 172.21.15.64:0/769738495 >> 172.21.15.64:0/769738495 conn(0x55f11a04a510 msgr2=0x55f11a54b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- 172.21.15.64:0/769738495 shutdown_connections 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.565+0000 7f163e91d000 1 -- 172.21.15.64:0/769738495 wait complete. 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 -- start start 2024-09-21T07:35:39.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 Processor -- start 2024-09-21T07:35:39.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a54d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a54dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f11a336a40 con 0x55f11a45ce60 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f11a338010 con 0x55f11a43bd80 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f11a344c20 con 0x55f11a426560 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 10 client.0 _ll_register_callbacks cb 0x55f11a444ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55100/0 (socket says 172.21.15.64:55100) 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 -- 172.21.15.64:0/4218391794 learned_addr learned my addr 172.21.15.64:0/4218391794 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f162fe00640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a54d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1627e00640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a54dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 -- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 msgr2=0x55f11a54d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a54d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 -- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 msgr2=0x55f11a54dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a54dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 -- 172.21.15.64:0/4218391794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f11a32b190 con 0x55f11a45ce60 2024-09-21T07:35:39.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f1635200640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f1628009c00 tx=0x7f1628004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4095c355512661 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f161d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628011850 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f16280119f0 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f11a325110 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f1628022050 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.569+0000 7f163e91d000 10 client.10314 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55f11a413450 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f11a325110 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f1628025020 con 0x55f11a45ce60 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 10 client.10314 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 10 client.10314 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 20 client.10314 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a02f880 0x55f11a54ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 4 client.10314 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f11a39fa00 con 0x55f11a02f880 2024-09-21T07:35:39.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f162fe00640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a02f880 0x55f11a54ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f162fe00640 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a02f880 0x55f11a54ebe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=2590cda97519d954 server_cookie=da6c90b0b16fd6b4 in_seq=0 out_seq=0 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 10 client.10314 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 1 -- 172.21.15.64:0/4218391794 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f11a39fa00 con 0x55f11a02f880 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 10 client.10314 handle_command_reply: tid=0 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 client.10314 shutdown 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 msgr2=0x55f11a54e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f1628009c00 tx=0x7f1628004410 comp rx=0 tx=0).stop 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 shutdown_connections 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a02f880 0x55f11a54ebe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a45ce60 0x55f11a54e1d0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a43bd80 0x55f11a54dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f161d600640 0 client.10314 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 --2- 172.21.15.64:0/4218391794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a54d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 >> 172.21.15.64:0/4218391794 conn(0x55f11a04a510 msgr2=0x55f11a543910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 shutdown_connections 2024-09-21T07:35:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 1 -- 172.21.15.64:0/4218391794 wait complete. 2024-09-21T07:35:39.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.573+0000 7f163e91d000 20 client.10314 trim_cache size 0 max 16384 2024-09-21T07:35:39.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 Processor -- start 2024-09-21T07:35:39.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 -- start start 2024-09-21T07:35:39.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a546ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a543490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1630205ae0 con 0x55f11a43bd80 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16300c9b70 con 0x55f11a45ce60 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1630204580 con 0x55f11a426560 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55104/0 (socket says 172.21.15.64:55104) 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 -- 172.21.15.64:0/775278058 learned_addr learned my addr 172.21.15.64:0/775278058 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f162fe00640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a546ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1635200640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a543490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 -- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 msgr2=0x55f11a546ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a546ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 -- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 msgr2=0x55f11a543490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a543490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 -- 172.21.15.64:0/775278058 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f11a335c20 con 0x55f11a43bd80 2024-09-21T07:35:39.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f162fe00640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a546ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1635200640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a543490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f1627e00640 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f1618098270 tx=0x7f16180f8190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d6883e0fbbc1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f161fe00640 1 -- 172.21.15.64:0/775278058 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180f8300 con 0x55f11a43bd80 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f161fe00640 1 -- 172.21.15.64:0/775278058 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1618101be0 con 0x55f11a43bd80 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.593+0000 7f161fe00640 1 -- 172.21.15.64:0/775278058 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180f8560 con 0x55f11a43bd80 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- 172.21.15.64:0/775278058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 msgr2=0x55f11a542f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f1618098270 tx=0x7f16180f8190 comp rx=0 tx=0).stop 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- 172.21.15.64:0/775278058 shutdown_connections 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a543490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a43bd80 0x55f11a542f50 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- 172.21.15.64:0/775278058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a426560 0x55f11a546ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- 172.21.15.64:0/775278058 >> 172.21.15.64:0/775278058 conn(0x55f11a04a510 msgr2=0x55f11a597e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- 172.21.15.64:0/775278058 shutdown_connections 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- 172.21.15.64:0/775278058 wait complete. 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- start start 2024-09-21T07:35:39.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 Processor -- start 2024-09-21T07:35:39.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a43bd80 0x55f11a546f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a5bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f11a395320 con 0x55f11a426560 2024-09-21T07:35:39.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f11a390000 con 0x55f11a45ce60 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f11a3a0620 con 0x55f11a43bd80 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f163e91d000 10 client.0 _ll_register_callbacks cb 0x7f16280039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55114/0 (socket says 172.21.15.64:55114) 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 -- 172.21.15.64:0/632689518 learned_addr learned my addr 172.21.15.64:0/632689518 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f1627e00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a43bd80 0x55f11a546f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f1635200640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a5bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 -- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a43bd80 msgr2=0x55f11a546f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a43bd80 0x55f11a546f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 -- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 msgr2=0x55f11a5bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a5bd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.597+0000 7f162fe00640 1 -- 172.21.15.64:0/632689518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f11a3169b0 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f162fe00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f1620023040 tx=0x7f1620020500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687c8e2cf0c3d36e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620037060 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1620020950 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1618101be0 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f162003d050 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 10 client.10320 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55f11a332160 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1618101be0 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f1620040020 con 0x55f11a426560 2024-09-21T07:35:39.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 10 client.10320 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 10 client.10320 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 20 client.10320 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a01d8e0 0x55f11a5bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 4 client.10320 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55f11a39b4b0 con 0x55f11a01d8e0 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f1627e00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a01d8e0 0x55f11a5bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f1627e00640 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a01d8e0 0x55f11a5bdaa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=fc82d4e2f0c587c4 server_cookie=ee65ccf381519f8f in_seq=0 out_seq=0 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 10 client.10320 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 1 -- 172.21.15.64:0/632689518 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f11a39b4b0 con 0x55f11a01d8e0 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 10 client.10320 handle_command_reply: tid=0 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 client.10320 shutdown 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 msgr2=0x55f11a546a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f1620023040 tx=0x7f1620020500 comp rx=0 tx=0).stop 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 shutdown_connections 2024-09-21T07:35:39.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f11a45ce60 0x55f11a5bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f11a43bd80 0x55f11a546f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55f11a01d8e0 0x55f11a5bdaa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 --2- 172.21.15.64:0/632689518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f11a426560 0x55f11a546a50 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 >> 172.21.15.64:0/632689518 conn(0x55f11a04a510 msgr2=0x55f11a59b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f161d600640 0 client.10320 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 shutdown_connections 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 1 -- 172.21.15.64:0/632689518 wait complete. 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.601+0000 7f163e91d000 20 client.10320 trim_cache size 0 max 16384 2024-09-21T07:35:39.606 INFO:teuthology.orchestra.run.smithi064.stderr:Error EINVAL: MDS is not active 2024-09-21T07:35:39.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T07:35:39.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-21T07:35:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 -- 172.21.15.64:0/502017813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc15f8d0 msgr2=0x7fa0fc0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 --2- 172.21.15.64:0/502017813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0cc910 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009840 tx=0x7fa0f001c760 comp rx=0 tx=0).stop 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 -- 172.21.15.64:0/502017813 shutdown_connections 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 --2- 172.21.15.64:0/502017813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0cc910 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 -- 172.21.15.64:0/502017813 >> 172.21.15.64:0/502017813 conn(0x7fa0fc0b1c60 msgr2=0x7fa0fc0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 -- 172.21.15.64:0/502017813 shutdown_connections 2024-09-21T07:35:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.769+0000 7fa102800640 1 -- 172.21.15.64:0/502017813 wait complete. 2024-09-21T07:35:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 Processor -- start 2024-09-21T07:35:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 -- start start 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc0cbf10 0x7fa0fc1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0fc0cce50 0x7fa0fc1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1699a0 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc169820 con 0x7fa0fc15f8d0 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa102800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc169b20 con 0x7fa0fc0cce50 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc0cbf10 0x7fa0fc1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc0cbf10 0x7fa0fc1f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55122/0 (socket says 172.21.15.64:55122) 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 -- 172.21.15.64:0/1253927781 learned_addr learned my addr 172.21.15.64:0/1253927781 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101e00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa100a00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0fc0cce50 0x7fa0fc1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 -- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0fc0cce50 msgr2=0x7fa0fc1f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0fc0cce50 0x7fa0fc1f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 -- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0fc15f8d0 msgr2=0x7fa0fc0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 -- 172.21.15.64:0/1253927781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc06efe0 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101e00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0fc15f8d0 0x7fa0fc0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa100a00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0fc0cce50 0x7fa0fc1f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa101400640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0fc0cbf10 0x7fa0fc1f8280 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009790 tx=0x7fa0f00a5780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.773+0000 7fa0f9600640 1 -- 172.21.15.64:0/1253927781 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00b2040 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa0f9600640 1 -- 172.21.15.64:0/1253927781 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f0003600 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa102800640 1 -- 172.21.15.64:0/1253927781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc06f2c0 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa0f9600640 1 -- 172.21.15.64:0/1253927781 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00044f0 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa102800640 1 -- 172.21.15.64:0/1253927781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc06f880 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa0f9600640 1 -- 172.21.15.64:0/1253927781 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa0f00bd060 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa0f9600640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0dc073200 0x7fa0dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa0f9600640 1 -- 172.21.15.64:0/1253927781 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fa0f012df10 con 0x7fa0fc0cbf10 2024-09-21T07:35:39.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa10b3d4000 1 Processor -- start 2024-09-21T07:35:39.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.777+0000 7fa100a00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0dc073200 0x7fa0dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- start start 2024-09-21T07:35:39.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- 172.21.15.64:0/1253927781 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa0dc073200 0x7fa0dc075710 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc15b6d0 tx=0x7fa0e8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4088ce60 0x55bc409bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc40856560 0x55bc409bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bc407cdab0 con 0x55bc4086bd80 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc407bcee0 con 0x55bc40856560 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bc407c0cf0 con 0x55bc4088ce60 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55126/0 (socket says 172.21.15.64:55126) 2024-09-21T07:35:39.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 -- 172.21.15.64:0/1533107781 learned_addr learned my addr 172.21.15.64:0/1533107781 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa101e00640 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc40856560 0x55bc409bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa101400640 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4088ce60 0x55bc409bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 -- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4088ce60 msgr2=0x55bc409bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4088ce60 0x55bc409bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 -- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc40856560 msgr2=0x55bc409bc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc40856560 0x55bc409bc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 -- 172.21.15.64:0/1533107781 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc40761240 con 0x55bc4086bd80 2024-09-21T07:35:39.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa100a00640 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005360 tx=0x7fa0e8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d0f82d4b6a6c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa0edc00640 1 -- 172.21.15.64:0/1533107781 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8003a30 con 0x55bc4086bd80 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa0edc00640 1 -- 172.21.15.64:0/1533107781 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0e8003bd0 con 0x55bc4086bd80 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa0edc00640 1 -- 172.21.15.64:0/1533107781 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8020450 con 0x55bc4086bd80 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1533107781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 msgr2=0x55bc409bc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005360 tx=0x7fa0e8010000 comp rx=0 tx=0).stop 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1533107781 shutdown_connections 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc40856560 0x55bc409bc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc409bc0e0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1533107781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4088ce60 0x55bc409bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1533107781 >> 172.21.15.64:0/1533107781 conn(0x55bc4047a510 msgr2=0x55bc4097b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1533107781 shutdown_connections 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.781+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1533107781 wait complete. 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 -- start start 2024-09-21T07:35:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 Processor -- start 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc4097dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc4097e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bc40766a40 con 0x55bc40856560 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc40768010 con 0x55bc4088ce60 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bc40774c20 con 0x55bc4086bd80 2024-09-21T07:35:39.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 10 client.0 _ll_register_callbacks cb 0x55bc40874ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55140/0 (socket says 172.21.15.64:55140) 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 -- 172.21.15.64:0/1192715584 learned_addr learned my addr 172.21.15.64:0/1192715584 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa100a00640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc4097dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101e00640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc4097e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 -- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 msgr2=0x55bc4097dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc4097dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 -- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 msgr2=0x55bc4097e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc4097e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 -- 172.21.15.64:0/1192715584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc4075b190 con 0x55bc40856560 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa101400640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa0f001a390 tx=0x7fa0f00f8190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80995845a481640b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa0e2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00fd0a0 con 0x55bc40856560 2024-09-21T07:35:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fa0f0101cd0 con 0x55bc40856560 2024-09-21T07:35:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.785+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc40755110 con 0x55bc40856560 2024-09-21T07:35:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fa0f0101f50 con 0x55bc40856560 2024-09-21T07:35:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 10 client.10335 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55bc40843450 con 0x55bc40856560 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bc40755110 con 0x55bc40856560 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fa0f00b5070 con 0x55bc40856560 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 10 client.10335 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 10 client.10335 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 20 client.10335 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4045f880 0x55bc4097ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 4 client.10335 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc407cfa00 con 0x55bc4045f880 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa100a00640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4045f880 0x55bc4097ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa100a00640 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4045f880 0x55bc4097ebe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=1b84cd7469865f0e server_cookie=14237c447ad94f9c in_seq=0 out_seq=0 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 10 client.10335 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 1 -- 172.21.15.64:0/1192715584 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc407cfa00 con 0x55bc4045f880 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 10 client.10335 handle_command_reply: tid=0 2024-09-21T07:35:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 client.10335 shutdown 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 msgr2=0x55bc4097d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa0f001a390 tx=0x7fa0f00f8190 comp rx=0 tx=0).stop 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 shutdown_connections 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc4097e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc4097dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4045f880 0x55bc4097ebe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/1192715584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc4097d750 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa0e2000640 0 client.10335 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 >> 172.21.15.64:0/1192715584 conn(0x55bc4047a510 msgr2=0x55bc40973910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 shutdown_connections 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 1 -- 172.21.15.64:0/1192715584 wait complete. 2024-09-21T07:35:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.789+0000 7fa10b3d4000 20 client.10335 trim_cache size 0 max 16384 2024-09-21T07:35:39.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 Processor -- start 2024-09-21T07:35:39.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 -- start start 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc40972f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc40973490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc205850 con 0x55bc40856560 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1fd060 con 0x55bc4088ce60 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc150840 con 0x55bc4086bd80 2024-09-21T07:35:39.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55156/0 (socket says 172.21.15.64:55156) 2024-09-21T07:35:39.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 -- 172.21.15.64:0/3487828209 learned_addr learned my addr 172.21.15.64:0/3487828209 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101e00640 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc40973490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa100a00640 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc40972f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 -- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 msgr2=0x55bc40972f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc40972f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 -- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 msgr2=0x55bc40973490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc40973490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 -- 172.21.15.64:0/3487828209 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc40765c20 con 0x55bc40856560 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa101400640 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0098340 tx=0x7fa0f00f78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc34ee637d89683 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa0ed200640 1 -- 172.21.15.64:0/3487828209 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00fd0a0 con 0x55bc40856560 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa0ed200640 1 -- 172.21.15.64:0/3487828209 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f0101cd0 con 0x55bc40856560 2024-09-21T07:35:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.809+0000 7fa0ed200640 1 -- 172.21.15.64:0/3487828209 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00f7f10 con 0x55bc40856560 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- 172.21.15.64:0/3487828209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 msgr2=0x55bc40976ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0098340 tx=0x7fa0f00f78c0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- 172.21.15.64:0/3487828209 shutdown_connections 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc40973490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc4086bd80 0x55bc40972f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/3487828209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc40856560 0x55bc40976ed0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- 172.21.15.64:0/3487828209 >> 172.21.15.64:0/3487828209 conn(0x55bc4047a510 msgr2=0x55bc409c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- 172.21.15.64:0/3487828209 shutdown_connections 2024-09-21T07:35:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- 172.21.15.64:0/3487828209 wait complete. 2024-09-21T07:35:39.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- start start 2024-09-21T07:35:39.815 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 Processor -- start 2024-09-21T07:35:39.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc40856560 0x55bc40976a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc409ed140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bc407c5320 con 0x55bc4086bd80 2024-09-21T07:35:39.816 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc407c0000 con 0x55bc4088ce60 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bc407d0620 con 0x55bc40856560 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa10b3d4000 10 client.0 _ll_register_callbacks cb 0x7fa0f0009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55172/0 (socket says 172.21.15.64:55172) 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 -- 172.21.15.64:0/2911031616 learned_addr learned my addr 172.21.15.64:0/2911031616 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa101400640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc40856560 0x55bc40976a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa101e00640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc409ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 -- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc40856560 msgr2=0x55bc40976a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc40856560 0x55bc40976a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 -- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 msgr2=0x55bc409ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc409ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.813+0000 7fa100a00640 1 -- 172.21.15.64:0/2911031616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc407469b0 con 0x55bc4086bd80 2024-09-21T07:35:39.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa100a00640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001ec0 tx=0x7fa0e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97aab96e346aa18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8003e00 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fa0e8007030 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f0101cd0 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fa0e803c050 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 10 client.10341 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55bc40762160 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f0101cd0 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fa0e803f020 con 0x55bc4086bd80 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 10 client.10341 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 10 client.10341 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 20 client.10341 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4044d8e0 0x55bc409edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 4 client.10341 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-21T07:35:39.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55bc407cb4b0 con 0x55bc4044d8e0 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa101400640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4044d8e0 0x55bc409edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 10 client.10341 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa101400640 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4044d8e0 0x55bc409edaa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=2272d51cb83fd65f server_cookie=f92aa9dfdb468c78 in_seq=0 out_seq=0 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 1 -- 172.21.15.64:0/2911031616 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55bc407cb4b0 con 0x55bc4044d8e0 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 10 client.10341 handle_command_reply: tid=0 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 client.10341 shutdown 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 msgr2=0x55bc40976f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001ec0 tx=0x7fa0e8000ee0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 shutdown_connections 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc4088ce60 0x55bc409ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55bc4044d8e0 0x55bc409edaa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bc4086bd80 0x55bc40976f90 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 --2- 172.21.15.64:0/2911031616 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bc40856560 0x55bc40976a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa0e2000640 0 client.10341 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 >> 172.21.15.64:0/2911031616 conn(0x55bc4047a510 msgr2=0x55bc409cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 shutdown_connections 2024-09-21T07:35:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 1 -- 172.21.15.64:0/2911031616 wait complete. 2024-09-21T07:35:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.817+0000 7fa10b3d4000 20 client.10341 trim_cache size 0 max 16384 2024-09-21T07:35:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:Error EINVAL: MDS is not active 2024-09-21T07:35:39.826 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T07:35:39.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- 172.21.15.64:0/1317809477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6ec003c90 msgr2=0x7fc6ec0040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 --2- 172.21.15.64:0/1317809477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6ec003c90 0x7fc6ec0040e0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8001860 tx=0x7fc6f801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70cc00640 1 -- 172.21.15.64:0/1317809477 reap_dead start 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- 172.21.15.64:0/1317809477 shutdown_connections 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- 172.21.15.64:0/1317809477 >> 172.21.15.64:0/1317809477 conn(0x7fc7080ccbe0 msgr2=0x7fc7080ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:39.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- 172.21.15.64:0/1317809477 shutdown_connections 2024-09-21T07:35:39.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- 172.21.15.64:0/1317809477 wait complete. 2024-09-21T07:35:39.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 Processor -- start 2024-09-21T07:35:39.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.989+0000 7fc70ec00640 1 -- start start 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6ec003c90 0x7fc70814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc70815ae40 0x7fc70815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc70814e840 0x7fc70814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc70815bfc0 con 0x7fc70815ae40 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc70815be40 con 0x7fc6ec003c90 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc70815c140 con 0x7fc70814e840 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc70815ae40 0x7fc70815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc70815ae40 0x7fc70815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55184/0 (socket says 172.21.15.64:55184) 2024-09-21T07:35:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 -- 172.21.15.64:0/2514737668 learned_addr learned my addr 172.21.15.64:0/2514737668 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc707e00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6ec003c90 0x7fc70814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70cc00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc70814e840 0x7fc70814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 -- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc70814e840 msgr2=0x7fc70814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc70814e840 0x7fc70814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 -- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6ec003c90 msgr2=0x7fc70814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6ec003c90 0x7fc70814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 -- 172.21.15.64:0/2514737668 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70814d2a0 con 0x7fc70815ae40 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc707e00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6ec003c90 0x7fc70814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc70815ae40 0x7fc70815b250 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0006670 tx=0x7fc6f0003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc704c00640 1 -- 172.21.15.64:0/2514737668 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0015070 con 0x7fc70815ae40 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc704c00640 1 -- 172.21.15.64:0/2514737668 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6f000fa00 con 0x7fc70815ae40 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc704c00640 1 -- 172.21.15.64:0/2514737668 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000fe50 con 0x7fc70815ae40 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 -- 172.21.15.64:0/2514737668 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70814d580 con 0x7fc70815ae40 2024-09-21T07:35:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc70ec00640 1 -- 172.21.15.64:0/2514737668 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70814e320 con 0x7fc70815ae40 2024-09-21T07:35:39.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.993+0000 7fc704c00640 1 -- 172.21.15.64:0/2514737668 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc6f0011430 con 0x7fc70815ae40 2024-09-21T07:35:39.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc704c00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6e4073200 0x7fc6e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:39.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc704c00640 1 -- 172.21.15.64:0/2514737668 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fc6f00952d0 con 0x7fc70815ae40 2024-09-21T07:35:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc707e00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6e4073200 0x7fc6e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 Processor -- start 2024-09-21T07:35:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 -- start start 2024-09-21T07:35:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc707e00640 1 --2- 172.21.15.64:0/2514737668 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc6e4073200 0x7fc6e4075710 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8001830 tx=0x7fc6f8019720 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bd5630 0x55a7b3d25ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3d261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3ada2e0 con 0x55a7b3bb3170 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3b37bb0 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a7b3b26fe0 con 0x55a7b3bd5630 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55190/0 (socket says 172.21.15.64:55190) 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 -- 172.21.15.64:0/1496831792 learned_addr learned my addr 172.21.15.64:0/1496831792 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc707e00640 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bd5630 0x55a7b3d25ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3d261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 -- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bd5630 msgr2=0x55a7b3d25ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bd5630 0x55a7b3d25ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 -- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bc6ab0 msgr2=0x55a7b3d261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3d261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 -- 172.21.15.64:0/1496831792 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b3ac51c0 con 0x55a7b3bb3170 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:39.997+0000 7fc70cc00640 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b5150 tx=0x7fc70000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d433827932ab4dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc6f7e00640 1 -- 172.21.15.64:0/1496831792 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700003b80 con 0x55a7b3bb3170 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc6f7e00640 1 -- 172.21.15.64:0/1496831792 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc700003d20 con 0x55a7b3bb3170 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc6f7e00640 1 -- 172.21.15.64:0/1496831792 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700004230 con 0x55a7b3bb3170 2024-09-21T07:35:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- 172.21.15.64:0/1496831792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 msgr2=0x55a7b3d26720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b5150 tx=0x7fc70000e820 comp rx=0 tx=0).stop 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- 172.21.15.64:0/1496831792 shutdown_connections 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d26720 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3d261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- 172.21.15.64:0/1496831792 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bd5630 0x55a7b3d25ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- 172.21.15.64:0/1496831792 >> 172.21.15.64:0/1496831792 conn(0x55a7b37e4d20 msgr2=0x55a7b3cdac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- 172.21.15.64:0/1496831792 shutdown_connections 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- 172.21.15.64:0/1496831792 wait complete. 2024-09-21T07:35:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- start start 2024-09-21T07:35:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 Processor -- start 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bb3170 0x55a7b3d30f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 0x55a7b3d319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3acc4f0 con 0x55a7b3bd5630 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3b2adf0 con 0x55a7b3bb3170 2024-09-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.001+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a7b37ec620 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 10 client.0 _ll_register_callbacks cb 0x55a7b3afdcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 0x55a7b3d319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc707e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bb3170 0x55a7b3d30f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d314a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:34886/0 (socket says 172.21.15.64:34886) 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6ffe00640 1 -- 172.21.15.64:0/427591908 learned_addr learned my addr 172.21.15.64:0/427591908 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 -- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 msgr2=0x55a7b3d314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 -- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bb3170 msgr2=0x55a7b3d30f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bb3170 0x55a7b3d30f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 -- 172.21.15.64:0/427591908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b3bf6740 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc70cc00640 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 0x55a7b3d319e0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fc700018000 tx=0x7fc700019a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb4d77f36b976e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700019d90 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fc700003980 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7b3abf300 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fc70002b050 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 10 client.10353 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55a7b3bac440 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a7b3abf300 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fc700017020 con 0x55a7b3bd5630 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 10 client.10353 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 10 client.10353 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 20 client.10353 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37c98d0 0x55a7b3d3b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 4 client.10353 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7b3b39b00 con 0x55a7b37c98d0 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc707e00640 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37c98d0 0x55a7b3d3b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc707e00640 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37c98d0 0x55a7b3d3b340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=8af8f97d13a56f3a server_cookie=c6ca46d478ba9353 in_seq=0 out_seq=0 2024-09-21T07:35:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 10 client.10353 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 1 -- 172.21.15.64:0/427591908 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7b3b39b00 con 0x55a7b37c98d0 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc6f4c00640 10 client.10353 handle_command_reply: tid=0 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 client.10353 shutdown 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 msgr2=0x55a7b3d319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.005+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 0x55a7b3d319e0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fc700018000 tx=0x7fc700019a10 comp rx=0 tx=0).stop 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 shutdown_connections 2024-09-21T07:35:40.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37c98d0 0x55a7b3d3b340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bd5630 0x55a7b3d319e0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 --2- 172.21.15.64:0/427591908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bb3170 0x55a7b3d30f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 >> 172.21.15.64:0/427591908 conn(0x55a7b37e4d20 msgr2=0x55a7b3cdac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc6f4c00640 0 client.10353 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 shutdown_connections 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 1 -- 172.21.15.64:0/427591908 wait complete. 2024-09-21T07:35:40.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.009+0000 7fc716441000 20 client.10353 trim_cache size 0 max 16384 2024-09-21T07:35:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.025+0000 7fc716441000 1 Processor -- start 2024-09-21T07:35:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.025+0000 7fc716441000 1 -- start start 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d9b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3abe2b0 con 0x55a7b3bb3170 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3ad2040 con 0x55a7b3bd5630 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a7b3af2c70 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55204/0 (socket says 172.21.15.64:55204) 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 -- 172.21.15.64:0/1265855319 learned_addr learned my addr 172.21.15.64:0/1265855319 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc70cc00640 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d9b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 -- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 msgr2=0x55a7b3d9b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d9b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 -- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 msgr2=0x55a7b3d9bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d9bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 -- 172.21.15.64:0/1265855319 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b3b83b00 con 0x55a7b3bb3170 2024-09-21T07:35:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc707e00640 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8006290 tx=0x7fc6f80b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1785e8f2534fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc6f7400640 1 -- 172.21.15.64:0/1265855319 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80d4070 con 0x55a7b3bb3170 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc6f7400640 1 -- 172.21.15.64:0/1265855319 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6f8003d90 con 0x55a7b3bb3170 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc6f7400640 1 -- 172.21.15.64:0/1265855319 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80a57f0 con 0x55a7b3bb3170 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- 172.21.15.64:0/1265855319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 msgr2=0x55a7b3d9b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8006290 tx=0x7fc6f80b3040 comp rx=0 tx=0).stop 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- 172.21.15.64:0/1265855319 shutdown_connections 2024-09-21T07:35:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d9bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bc6ab0 0x55a7b3d9b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 --2- 172.21.15.64:0/1265855319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bb3170 0x55a7b3d9b280 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- 172.21.15.64:0/1265855319 >> 172.21.15.64:0/1265855319 conn(0x55a7b37e4d20 msgr2=0x55a7b3ce2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- 172.21.15.64:0/1265855319 shutdown_connections 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- 172.21.15.64:0/1265855319 wait complete. 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 -- start start 2024-09-21T07:35:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.029+0000 7fc716441000 1 Processor -- start 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bb3170 0x55a7b3cdd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3b2f420 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3b2a100 con 0x55a7b3bd5630 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55a7b3b3a720 con 0x55a7b3bb3170 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 10 client.0 _ll_register_callbacks cb 0x7fc6f005c0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55208/0 (socket says 172.21.15.64:55208) 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 -- 172.21.15.64:0/879794524 learned_addr learned my addr 172.21.15.64:0/879794524 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc707e00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bb3170 0x55a7b3cdd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc70cc00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 -- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bb3170 msgr2=0x55a7b3cdd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bb3170 0x55a7b3cdd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 -- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 msgr2=0x55a7b3d5b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d5b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 -- 172.21.15.64:0/879794524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b3af1060 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc70cc00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6ffe00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0093580 tx=0x7fc6f0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3939f532333a7619 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0020040 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fc6f005ec70 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6f8003d90 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fc6f00812b0 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 10 client.10359 fetch_fsmap learned FSMap version 136 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55a7b3abd640 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6f8003d90 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fc6f0075b30 con 0x55a7b3bc6ab0 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 10 client.10359 fetch_fsmap finished waiting for FSMap version 136 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 10 client.10359 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 20 client.10359 populate_metadata read hostname 'smithi064' 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37b7930 0x55a7b3d9f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 4 client.10359 mds_command: new command op to 10065 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 --> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55a7b3b355b0 con 0x55a7b37b7930 2024-09-21T07:35:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc707e00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37b7930 0x55a7b3d9f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc707e00640 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37b7930 0x55a7b3d9f4d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10065 client_cookie=7641298787181936 server_cookie=b4bfa71e51edb0e9 in_seq=0 out_seq=0 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.033+0000 7fc6f4c00640 10 client.10359 ms_handle_connect on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc6f4c00640 1 -- 172.21.15.64:0/879794524 <== mds.10065 v2:172.21.15.64:6832/1704179740 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55a7b3b355b0 con 0x55a7b37b7930 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc6f4c00640 10 client.10359 handle_command_reply: tid=0 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 client.10359 shutdown 2024-09-21T07:35:40.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 msgr2=0x55a7b3cddaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0093580 tx=0x7fc6f0000bd0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 shutdown_connections 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a7b3bd5630 0x55a7b3d5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:6832/1704179740,v1:172.21.15.64:6833/1704179740] conn(0x55a7b37b7930 0x55a7b3d9f4d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a7b3bc6ab0 0x55a7b3cddaa0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 --2- 172.21.15.64:0/879794524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a7b3bb3170 0x55a7b3cdd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 >> 172.21.15.64:0/879794524 conn(0x55a7b37e4d20 msgr2=0x55a7b3cd8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc6f4c00640 0 client.10359 ms_handle_reset on v2:172.21.15.64:6832/1704179740 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 shutdown_connections 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 1 -- 172.21.15.64:0/879794524 wait complete. 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.037+0000 7fc716441000 20 client.10359 trim_cache size 0 max 16384 2024-09-21T07:35:40.040 INFO:teuthology.orchestra.run.smithi064.stderr:Error EINVAL: MDS is not active 2024-09-21T07:35:40.044 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T07:35:40.045 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:35:40.045 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:35:40.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:35:40.224 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:35:40.224 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:35:40.224 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:40.224 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:40.233 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:40.233 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:40.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 -- 172.21.15.64:0/185398059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880cfef0 msgr2=0x7f13880d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 --2- 172.21.15.64:0/185398059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880cfef0 0x7f13880d0300 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f13880747b0 tx=0x7f137001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 -- 172.21.15.64:0/185398059 shutdown_connections 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 --2- 172.21.15.64:0/185398059 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880cfef0 0x7f13880d0300 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 --2- 172.21.15.64:0/185398059 >> v2:172.21.15.90:3300/0 conn(0x7f138815c9f0 0x7f1388160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 -- 172.21.15.64:0/185398059 >> 172.21.15.64:0/185398059 conn(0x7f13880d23b0 msgr2=0x7f13880d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 -- 172.21.15.64:0/185398059 shutdown_connections 2024-09-21T07:35:40.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.493+0000 7f138e000640 1 -- 172.21.15.64:0/185398059 wait complete. 2024-09-21T07:35:40.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 Processor -- start 2024-09-21T07:35:40.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- start start 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13880cfef0 0x7f13880b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 0x7f1388165ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1388169ed0 con 0x7f13880b3e30 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1388169d50 con 0x7f13880cfef0 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f138816a050 con 0x7f138815c9f0 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55224/0 (socket says 172.21.15.64:55224) 2024-09-21T07:35:40.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 -- 172.21.15.64:0/719020724 learned_addr learned my addr 172.21.15.64:0/719020724 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f137fe00640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13880cfef0 0x7f13880b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387e00640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 0x7f1388165ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 -- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 msgr2=0x7f1388165ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 0x7f1388165ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 -- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13880cfef0 msgr2=0x7f13880b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13880cfef0 0x7f13880b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 -- 172.21.15.64:0/719020724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1388157890 con 0x7f13880b3e30 2024-09-21T07:35:40.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387e00640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 0x7f1388165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f1387400640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f137800b440 tx=0x7f137800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378015020 con 0x7f13880b3e30 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13780119a0 con 0x7f13880b3e30 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378011df0 con 0x7f13880b3e30 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138806fec0 con 0x7f13880b3e30 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.497+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138806f900 con 0x7f13880b3e30 2024-09-21T07:35:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13880d0300 con 0x7f13880b3e30 2024-09-21T07:35:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1378018020 con 0x7f13880b3e30 2024-09-21T07:35:40.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f137f400640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 0x7f1364075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:40.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1378094540 con 0x7f13880b3e30 2024-09-21T07:35:40.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f137fe00640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 0x7f1364075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:40.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.501+0000 7f137fe00640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 0x7f1364075710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f13700af000 tx=0x7f137001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:40.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.505+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f137801f020 con 0x7f13880b3e30 2024-09-21T07:35:40.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:35:40.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:35:40.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.693+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f13880c7f50 con 0x7f13880b3e30 2024-09-21T07:35:40.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f137f400640 1 -- 172.21.15.64:0/719020724 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) ==== 80+0+0 (secure 0 0 0) 0x7f137800d040 con 0x7f13880b3e30 2024-09-21T07:35:40.697 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 msgr2=0x7f1364075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 0x7f1364075710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f13700af000 tx=0x7f137001b100 comp rx=0 tx=0).stop 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 msgr2=0x7f1388159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f137800b440 tx=0x7f137800b900 comp rx=0 tx=0).stop 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 shutdown_connections 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1364073200 0x7f1364075710 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f138815c9f0 0x7f1388165ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13880cfef0 0x7f13880b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 --2- 172.21.15.64:0/719020724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13880b3e30 0x7f1388159f40 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:40.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 >> 172.21.15.64:0/719020724 conn(0x7f13880d23b0 msgr2=0x7f138815bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:40.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 shutdown_connections 2024-09-21T07:35:40.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:40.697+0000 7f138e000640 1 -- 172.21.15.64:0/719020724 wait complete. 2024-09-21T07:35:40.719 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:35:40.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:40.719 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:35:41.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:35:41.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:35:41.554 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:35:41.567 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:35:41.567 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:35:41.567 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:41.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:35:41.576 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:35:41.576 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:41.576 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:41.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:35:41.617 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:35:41.617 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:35:41.617 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:41.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:35:41.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 -- 172.21.15.64:0/1606703317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 msgr2=0x7fe4200700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 --2- 172.21.15.64:0/1606703317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe4200700b0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe42006f220 tx=0x7fe41001c8a0 comp rx=0 tx=0).stop 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 -- 172.21.15.64:0/1606703317 shutdown_connections 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 --2- 172.21.15.64:0/1606703317 >> v2:172.21.15.90:3300/0 conn(0x7fe4200709b0 0x7fe4200b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 --2- 172.21.15.64:0/1606703317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe4200700b0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 -- 172.21.15.64:0/1606703317 >> 172.21.15.64:0/1606703317 conn(0x7fe4200ccbe0 msgr2=0x7fe4200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 -- 172.21.15.64:0/1606703317 shutdown_connections 2024-09-21T07:35:41.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.817+0000 7fe426000640 1 -- 172.21.15.64:0/1606703317 wait complete. 2024-09-21T07:35:41.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 Processor -- start 2024-09-21T07:35:41.821 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- start start 2024-09-21T07:35:41.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4200709b0 0x7fe4200cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4200b4700 0x7fe4200cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe420169010 con 0x7fe42015edb0 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe420168e90 con 0x7fe4200709b0 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe420169190 con 0x7fe4200b4700 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4200709b0 0x7fe4200cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe416a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4200b4700 0x7fe4200cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55234/0 (socket says 172.21.15.64:55234) 2024-09-21T07:35:41.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 -- 172.21.15.64:0/5160324 learned_addr learned my addr 172.21.15.64:0/5160324 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 -- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4200b4700 msgr2=0x7fe4200cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4200b4700 0x7fe4200cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 -- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4200709b0 msgr2=0x7fe4200cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4200709b0 0x7fe4200cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 -- 172.21.15.64:0/5160324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4200cc5a0 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe41fe00640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c6b0 tx=0x7fe41800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418003b80 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe418003d20 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418005330 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4200ca9a0 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.821+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4200caf60 con 0x7fe42015edb0 2024-09-21T07:35:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4200cc310 con 0x7fe42015edb0 2024-09-21T07:35:41.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe4180054d0 con 0x7fe42015edb0 2024-09-21T07:35:41.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe417e00640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 0x7fe3fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:41.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7fe418094150 con 0x7fe42015edb0 2024-09-21T07:35:41.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe41f400640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 0x7fe3fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:41.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.825+0000 7fe41f400640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 0x7fe3fc075710 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe4100af000 tx=0x7fe4100a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:41.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:41.829+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe4200b4b10 con 0x7fe42015edb0 2024-09-21T07:35:42.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4200b41c0 con 0x7fe42015edb0 2024-09-21T07:35:42.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe417e00640 1 -- 172.21.15.64:0/5160324 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5240 (secure 0 0 0) 0x7fe41805e8a0 con 0x7fe42015edb0 2024-09-21T07:35:42.046 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:42.046 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":136,"btime":"2024-09-21T07:35:38:106449+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:38.106426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10065":{"gid":10065,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:42.046 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 136 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 msgr2=0x7fe3fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 0x7fe3fc075710 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe4100af000 tx=0x7fe4100a7040 comp rx=0 tx=0).stop 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 msgr2=0x7fe420159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c6b0 tx=0x7fe41800cb70 comp rx=0 tx=0).stop 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 shutdown_connections 2024-09-21T07:35:42.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3fc073200 0x7fe3fc075710 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42015edb0 0x7fe420159040 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4200b4700 0x7fe4200cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 --2- 172.21.15.64:0/5160324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4200709b0 0x7fe4200cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 >> 172.21.15.64:0/5160324 conn(0x7fe4200ccbe0 msgr2=0x7fe4200ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 shutdown_connections 2024-09-21T07:35:42.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.045+0000 7fe426000640 1 -- 172.21.15.64:0/5160324 wait complete. 2024-09-21T07:35:42.068 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 -- 172.21.15.64:0/3731514158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140c5ea0 msgr2=0x7f56140c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 --2- 172.21.15.64:0/3731514158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140c5ea0 0x7f56140c62b0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f560c009bc0 tx=0x7f560c01cb00 comp rx=0 tx=0).stop 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 -- 172.21.15.64:0/3731514158 shutdown_connections 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 --2- 172.21.15.64:0/3731514158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140c5ea0 0x7f56140c62b0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 --2- 172.21.15.64:0/3731514158 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140d1d00 0x7f56140d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 -- 172.21.15.64:0/3731514158 >> 172.21.15.64:0/3731514158 conn(0x7f561406d1c0 msgr2=0x7f561406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 -- 172.21.15.64:0/3731514158 shutdown_connections 2024-09-21T07:35:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.225+0000 7f561aa00640 1 -- 172.21.15.64:0/3731514158 wait complete. 2024-09-21T07:35:42.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 Processor -- start 2024-09-21T07:35:42.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 -- start start 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140b3d60 0x7f561414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 0x7f561415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5614169fd0 con 0x7f56140d1d00 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5614169e50 con 0x7f56140c5ea0 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f561aa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f561416a150 con 0x7f56140b3d60 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f5618a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f5618a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55252/0 (socket says 172.21.15.64:55252) 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f5618a00640 1 -- 172.21.15.64:0/637455390 learned_addr learned my addr 172.21.15.64:0/637455390 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f5613e00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140b3d60 0x7f561414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.229+0000 7f560be00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 0x7f561415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 -- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140b3d60 msgr2=0x7f561414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140b3d60 0x7f561414d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 -- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 msgr2=0x7f561415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 0x7f561415e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 -- 172.21.15.64:0/637455390 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561415f5a0 con 0x7f56140d1d00 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f560be00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 0x7f561415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5618a00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b10 tx=0x7f560c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0bb070 con 0x7f56140d1d00 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f560c004e00 con 0x7f56140d1d00 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561415f2c0 con 0x7f56140d1d00 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b2040 con 0x7f56140d1d00 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561415d360 con 0x7f56140d1d00 2024-09-21T07:35:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56140c62b0 con 0x7f56140d1d00 2024-09-21T07:35:42.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.233+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f560c0be070 con 0x7f56140d1d00 2024-09-21T07:35:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.237+0000 7f5610c00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 0x7f55f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.237+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f560c12e180 con 0x7f56140d1d00 2024-09-21T07:35:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.237+0000 7f5613e00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 0x7f55f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.237+0000 7f5613e00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 0x7f55f0075710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5604005fd0 tx=0x7f560400b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.241+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f560c0167b0 con 0x7f56140d1d00 2024-09-21T07:35:42.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.457+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56140c5b20 con 0x7f56140d1d00 2024-09-21T07:35:42.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.457+0000 7f5610c00640 1 -- 172.21.15.64:0/637455390 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5240 (secure 0 0 0) 0x7f560c0f8960 con 0x7f56140d1d00 2024-09-21T07:35:42.461 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:42.461 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":136,"btime":"2024-09-21T07:35:38:106449+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:38.106426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10065":{"gid":10065,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:42.461 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 136 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 msgr2=0x7f55f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 0x7f55f0075710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5604005fd0 tx=0x7f560400b390 comp rx=0 tx=0).stop 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 msgr2=0x7f561415db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b10 tx=0x7f560c003f60 comp rx=0 tx=0).stop 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 shutdown_connections 2024-09-21T07:35:42.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f55f0073200 0x7f55f0075710 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56140d1d00 0x7f561415db60 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56140c5ea0 0x7f561415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 --2- 172.21.15.64:0/637455390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f56140b3d60 0x7f561414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 >> 172.21.15.64:0/637455390 conn(0x7f561406d1c0 msgr2=0x7f56141527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 shutdown_connections 2024-09-21T07:35:42.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.461+0000 7f561aa00640 1 -- 172.21.15.64:0/637455390 wait complete. 2024-09-21T07:35:42.483 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 -- 172.21.15.64:0/1426829146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00c5ea0 msgr2=0x7f92e00c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 --2- 172.21.15.64:0/1426829146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00c5ea0 0x7f92e00c62b0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f92e00b1cf0 tx=0x7f92d801cac0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 -- 172.21.15.64:0/1426829146 shutdown_connections 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 --2- 172.21.15.64:0/1426829146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00c5ea0 0x7f92e00c62b0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 --2- 172.21.15.64:0/1426829146 >> v2:172.21.15.90:3300/0 conn(0x7f92e00b3d60 0x7f92e00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 -- 172.21.15.64:0/1426829146 >> 172.21.15.64:0/1426829146 conn(0x7f92e006d1c0 msgr2=0x7f92e006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.637+0000 7f92e4a00640 1 -- 172.21.15.64:0/1426829146 shutdown_connections 2024-09-21T07:35:42.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.641+0000 7f92e4a00640 1 -- 172.21.15.64:0/1426829146 wait complete. 2024-09-21T07:35:42.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.641+0000 7f92e4a00640 1 Processor -- start 2024-09-21T07:35:42.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.641+0000 7f92e4a00640 1 -- start start 2024-09-21T07:35:42.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.641+0000 7f92e4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e00b3d60 0x7f92e006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92e00c5ea0 0x7f92e00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0169eb0 con 0x7f92e00d1d00 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0169d30 con 0x7f92e00b3d60 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f92e016a030 con 0x7f92e00c5ea0 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55266/0 (socket says 172.21.15.64:55266) 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 -- 172.21.15.64:0/148999850 learned_addr learned my addr 172.21.15.64:0/148999850 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92dde00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e00b3d60 0x7f92e006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92d5400640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92e00c5ea0 0x7f92e00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 -- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92e00c5ea0 msgr2=0x7f92e00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92e00c5ea0 0x7f92e00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 -- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e00b3d60 msgr2=0x7f92e006e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e00b3d60 0x7f92e006e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 -- 172.21.15.64:0/148999850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0075240 con 0x7f92e00d1d00 2024-09-21T07:35:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92de800640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009b10 tx=0x7f92d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:42.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80bc070 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92d80042f0 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b2040 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e00ccf80 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e0154b00 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e00b4170 con 0x7f92e00d1d00 2024-09-21T07:35:42.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.645+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f92d80ad440 con 0x7f92e00d1d00 2024-09-21T07:35:42.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.649+0000 7f92d6a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 0x7f92bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:42.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.649+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f92d812e330 con 0x7f92e00d1d00 2024-09-21T07:35:42.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.649+0000 7f92dde00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 0x7f92bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:42.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.649+0000 7f92dde00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 0x7f92bc075740 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f92d0007fd0 tx=0x7f92d0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:42.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.653+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f92d8016770 con 0x7f92e00d1d00 2024-09-21T07:35:42.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.829+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92e0075410 con 0x7f92e00d1d00 2024-09-21T07:35:42.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.829+0000 7f92d6a00640 1 -- 172.21.15.64:0/148999850 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+17099 (secure 0 0 0) 0x7f92d80f8b10 con 0x7f92e00d1d00 2024-09-21T07:35:42.832 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:42.832 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":180,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:31.062569+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:00.450517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:01.627078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.3","mappings":[{"from":1,"to":0}]},{"pgid":"26.8","mappings":[{"from":1,"to":0}]},{"pgid":"26.c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 msgr2=0x7f92bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 0x7f92bc075740 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f92d0007fd0 tx=0x7f92d0009040 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 msgr2=0x7f92e00c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009b10 tx=0x7f92d8009260 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 shutdown_connections 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f92bc073230 0x7f92bc075740 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92e00d1d00 0x7f92e00c9980 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92e00c5ea0 0x7f92e00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 --2- 172.21.15.64:0/148999850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e00b3d60 0x7f92e006e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 >> 172.21.15.64:0/148999850 conn(0x7f92e006d1c0 msgr2=0x7f92e006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 shutdown_connections 2024-09-21T07:35:42.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:42.833+0000 7f92e4a00640 1 -- 172.21.15.64:0/148999850 wait complete. 2024-09-21T07:35:42.855 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:35:42.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:43.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- 172.21.15.64:0/3431454474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 msgr2=0x7effd00700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 --2- 172.21.15.64:0/3431454474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd00700b0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7effd00728d0 tx=0x7effc001c860 comp rx=0 tx=0).stop 2024-09-21T07:35:43.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- 172.21.15.64:0/3431454474 shutdown_connections 2024-09-21T07:35:43.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 --2- 172.21.15.64:0/3431454474 >> v2:172.21.15.90:3300/0 conn(0x7effd00b4700 0x7effd0072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 --2- 172.21.15.64:0/3431454474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd00b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 --2- 172.21.15.64:0/3431454474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd00700b0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- 172.21.15.64:0/3431454474 >> 172.21.15.64:0/3431454474 conn(0x7effd00ccbe0 msgr2=0x7effd00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:43.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- 172.21.15.64:0/3431454474 shutdown_connections 2024-09-21T07:35:43.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- 172.21.15.64:0/3431454474 wait complete. 2024-09-21T07:35:43.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 Processor -- start 2024-09-21T07:35:43.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.013+0000 7effd7200640 1 -- start start 2024-09-21T07:35:43.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 0x7effd0167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b2380 con 0x7effd015edb0 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b2200 con 0x7effd00b4700 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7effd00b2500 con 0x7effd00709b0 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55284/0 (socket says 172.21.15.64:55284) 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 -- 172.21.15.64:0/2389504468 learned_addr learned my addr 172.21.15.64:0/2389504468 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effcfe00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effc7e00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 0x7effd0167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 -- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 msgr2=0x7effd015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 -- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 msgr2=0x7effd0167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 0x7effd0167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 -- 172.21.15.64:0/2389504468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd0159750 con 0x7effd015edb0 2024-09-21T07:35:43.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effcfe00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:43.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effc7e00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 0x7effd0167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:43.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd5200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7effc800d970 tx=0x7effc800de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8017070 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effc800be00 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd0159a30 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80106c0 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd0159ff0 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.017+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd0072e20 con 0x7effd015edb0 2024-09-21T07:35:43.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.021+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7effc8010860 con 0x7effd015edb0 2024-09-21T07:35:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.021+0000 7effccc00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 0x7effac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.021+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7effc8094b50 con 0x7effd015edb0 2024-09-21T07:35:43.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.021+0000 7effcfe00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 0x7effac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.021+0000 7effcfe00640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 0x7effac075710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7effc00af000 tx=0x7effc001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.025+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7effc805f8f0 con 0x7effd015edb0 2024-09-21T07:35:43.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.237+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effd01594e0 con 0x7effd015edb0 2024-09-21T07:35:43.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effccc00640 1 -- 172.21.15.64:0/2389504468 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5240 (secure 0 0 0) 0x7effc805f1f0 con 0x7effd015edb0 2024-09-21T07:35:43.241 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:43.241 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":136,"btime":"2024-09-21T07:35:38:106449+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:38.106426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10065":{"gid":10065,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:43.242 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 136 2024-09-21T07:35:43.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 msgr2=0x7effac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 0x7effac075710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7effc00af000 tx=0x7effc001b100 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 msgr2=0x7effd01fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7effc800d970 tx=0x7effc800de30 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 shutdown_connections 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7effac073200 0x7effac075710 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effd015edb0 0x7effd01fc100 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd00b4700 0x7effd0167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 --2- 172.21.15.64:0/2389504468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effd00709b0 0x7effd015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 >> 172.21.15.64:0/2389504468 conn(0x7effd00ccbe0 msgr2=0x7effd00b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 shutdown_connections 2024-09-21T07:35:43.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.241+0000 7effd7200640 1 -- 172.21.15.64:0/2389504468 wait complete. 2024-09-21T07:35:43.265 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 -- 172.21.15.64:0/2977488290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd80707c0 msgr2=0x7f1cd80b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2977488290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd80707c0 0x7f1cd80b2cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009900 tx=0x7f1cc001f0d0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 -- 172.21.15.64:0/2977488290 shutdown_connections 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2977488290 >> v2:172.21.15.90:3300/0 conn(0x7f1cd80b3230 0x7f1cd80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2977488290 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd80707c0 0x7f1cd80b2cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 -- 172.21.15.64:0/2977488290 >> 172.21.15.64:0/2977488290 conn(0x7f1cd80cdcf0 msgr2=0x7f1cd80ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.421+0000 7f1cdf800640 1 -- 172.21.15.64:0/2977488290 shutdown_connections 2024-09-21T07:35:43.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 -- 172.21.15.64:0/2977488290 wait complete. 2024-09-21T07:35:43.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 Processor -- start 2024-09-21T07:35:43.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 -- start start 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cd80b3230 0x7f1cd81f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd815ee20 0x7f1cd81f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80b4a90 con 0x7f1cd80707c0 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80b4910 con 0x7f1cd80b3230 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.425+0000 7f1cdf800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd80b4c10 con 0x7f1cd815ee20 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55292/0 (socket says 172.21.15.64:55292) 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 -- 172.21.15.64:0/2499148271 learned_addr learned my addr 172.21.15.64:0/2499148271 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdd800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd815ee20 0x7f1cd81f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1ccfe00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cd80b3230 0x7f1cd81f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 -- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd815ee20 msgr2=0x7f1cd81f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd815ee20 0x7f1cd81f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 -- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cd80b3230 msgr2=0x7f1cd81f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cd80b3230 0x7f1cd81f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 -- 172.21.15.64:0/2499148271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd8149aa0 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdce00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c3c0 tx=0x7f1cc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8017070 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cc80053c0 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8003860 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd8148ce0 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd81492a0 con 0x7f1cd80707c0 2024-09-21T07:35:43.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd80b2cf0 con 0x7f1cd80707c0 2024-09-21T07:35:43.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.429+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1cc801a070 con 0x7f1cd80707c0 2024-09-21T07:35:43.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.433+0000 7f1cd5600640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 0x7f1cb4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.433+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f1cc8093b00 con 0x7f1cd80707c0 2024-09-21T07:35:43.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.433+0000 7f1ccfe00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 0x7f1cb4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.433+0000 7f1ccfe00640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 0x7f1cb4075710 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b2000 tx=0x7f1cc001d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.433+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1cc8021020 con 0x7f1cd80707c0 2024-09-21T07:35:43.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.645+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cd815c9b0 con 0x7f1cd80707c0 2024-09-21T07:35:43.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.645+0000 7f1cd5600640 1 -- 172.21.15.64:0/2499148271 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5240 (secure 0 0 0) 0x7f1cd80b3640 con 0x7f1cd80707c0 2024-09-21T07:35:43.648 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:43.648 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":136,"btime":"2024-09-21T07:35:38:106449+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:35:02.669172+0000","modified":"2024-09-21T07:35:38.106426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10065":{"gid":10065,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6833/1704179740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1704179740},{"type":"v1","addr":"172.21.15.64:6833","nonce":1704179740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10068":{"gid":10068,"name":"a","rank":0,"incarnation":129,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/650567742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":650567742},{"type":"v1","addr":"172.21.15.64:6835","nonce":650567742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10068,"qdb_cluster":[10068]},"id":12}]} 2024-09-21T07:35:43.648 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 136 2024-09-21T07:35:43.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 msgr2=0x7f1cb4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 0x7f1cb4075710 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b2000 tx=0x7f1cc001d910 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 msgr2=0x7f1cd8159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c3c0 tx=0x7f1cc800c880 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 shutdown_connections 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1cb4073200 0x7f1cb4075710 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cd815ee20 0x7f1cd81f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cd80b3230 0x7f1cd81f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 --2- 172.21.15.64:0/2499148271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd80707c0 0x7f1cd8159550 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 >> 172.21.15.64:0/2499148271 conn(0x7f1cd80cdcf0 msgr2=0x7f1cd815dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 shutdown_connections 2024-09-21T07:35:43.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.649+0000 7f1cdf800640 1 -- 172.21.15.64:0/2499148271 wait complete. 2024-09-21T07:35:43.669 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:43.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 -- 172.21.15.64:0/1571506609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e00d1d00 msgr2=0x7f47e00d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 --2- 172.21.15.64:0/1571506609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e00d1d00 0x7f47e00d03f0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009900 tx=0x7f47d001c640 comp rx=0 tx=0).stop 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 -- 172.21.15.64:0/1571506609 shutdown_connections 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 --2- 172.21.15.64:0/1571506609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 0x7f47e00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 --2- 172.21.15.64:0/1571506609 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e00d1d00 0x7f47e00d03f0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 -- 172.21.15.64:0/1571506609 >> 172.21.15.64:0/1571506609 conn(0x7f47e006d1c0 msgr2=0x7f47e006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 -- 172.21.15.64:0/1571506609 shutdown_connections 2024-09-21T07:35:43.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.825+0000 7f47e7400640 1 -- 172.21.15.64:0/1571506609 wait complete. 2024-09-21T07:35:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 Processor -- start 2024-09-21T07:35:43.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 -- start start 2024-09-21T07:35:43.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 0x7f47e0150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47e00d1d00 0x7f47e0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47e016a380 con 0x7f47e0071190 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47e016a200 con 0x7f47e00d1d00 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e7400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f47e016a500 con 0x7f47e00b3d60 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55304/0 (socket says 172.21.15.64:55304) 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e4a00640 1 -- 172.21.15.64:0/2343843481 learned_addr learned my addr 172.21.15.64:0/2343843481 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47d7e00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 0x7f47e0150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.829+0000 7f47e5400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47e00d1d00 0x7f47e0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 -- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 msgr2=0x7f47e0150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 0x7f47e0150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 -- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47e00d1d00 msgr2=0x7f47e0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47e00d1d00 0x7f47e0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:43.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 -- 172.21.15.64:0/2343843481 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e014d650 con 0x7f47e0071190 2024-09-21T07:35:43.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e4a00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f47d001cee0 tx=0x7f47d00a65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00ac070 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47d0004320 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e014d930 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00053a0 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e014ad50 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e014db70 con 0x7f47e0071190 2024-09-21T07:35:43.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f47d00af070 con 0x7f47e0071190 2024-09-21T07:35:43.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 0x7f47bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:43.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.833+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f47d012e0c0 con 0x7f47e0071190 2024-09-21T07:35:43.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.837+0000 7f47d7e00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 0x7f47bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:43.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.837+0000 7f47d7e00640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 0x7f47bc075710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f47c8006fd0 tx=0x7f47c8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:43.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:43.841+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f47d00bf020 con 0x7f47e0071190 2024-09-21T07:35:44.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.017+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47e00b4170 con 0x7f47e0071190 2024-09-21T07:35:44.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.017+0000 7f47dd600640 1 -- 172.21.15.64:0/2343843481 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+17099 (secure 0 0 0) 0x7f47d00b6070 con 0x7f47e0071190 2024-09-21T07:35:44.020 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:44.020 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":180,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:31.062569+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:00.450517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:01.627078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.3","mappings":[{"from":1,"to":0}]},{"pgid":"26.8","mappings":[{"from":1,"to":0}]},{"pgid":"26.c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 msgr2=0x7f47bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 0x7f47bc075710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f47c8006fd0 tx=0x7f47c8008040 comp rx=0 tx=0).stop 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 msgr2=0x7f47e014a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f47d001cee0 tx=0x7f47d00a65a0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 shutdown_connections 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f47bc073200 0x7f47bc075710 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47e00d1d00 0x7f47e0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f47e00b3d60 0x7f47e0150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 --2- 172.21.15.64:0/2343843481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47e0071190 0x7f47e014a640 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 >> 172.21.15.64:0/2343843481 conn(0x7f47e006d1c0 msgr2=0x7f47e00c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 shutdown_connections 2024-09-21T07:35:44.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.021+0000 7f47e7400640 1 -- 172.21.15.64:0/2343843481 wait complete. 2024-09-21T07:35:44.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:35:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 -- 172.21.15.64:0/2409360231 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 msgr2=0x7f79cc06cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 --2- 172.21.15.64:0/2409360231 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc06cdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009840 tx=0x7f79b401c820 comp rx=0 tx=0).stop 2024-09-21T07:35:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 -- 172.21.15.64:0/2409360231 shutdown_connections 2024-09-21T07:35:44.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 --2- 172.21.15.64:0/2409360231 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc06cdf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 --2- 172.21.15.64:0/2409360231 >> v2:172.21.15.90:3300/0 conn(0x7f79cc0b3820 0x7f79cc162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 -- 172.21.15.64:0/2409360231 >> 172.21.15.64:0/2409360231 conn(0x7f79cc0cdd10 msgr2=0x7f79cc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:44.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 -- 172.21.15.64:0/2409360231 shutdown_connections 2024-09-21T07:35:44.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.201+0000 7f79d3000640 1 -- 172.21.15.64:0/2409360231 wait complete. 2024-09-21T07:35:44.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 Processor -- start 2024-09-21T07:35:44.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 -- start start 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79cc0b3820 0x7f79cc0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc16ca80 con 0x7f79cc0750b0 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc16c900 con 0x7f79cc0b3820 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc16cc00 con 0x7f79cc074ca0 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55312/0 (socket says 172.21.15.64:55312) 2024-09-21T07:35:44.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 -- 172.21.15.64:0/2876377027 learned_addr learned my addr 172.21.15.64:0/2876377027 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79cbe00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d1000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79cc0b3820 0x7f79cc0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 -- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 msgr2=0x7f79cc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 -- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79cc0b3820 msgr2=0x7f79cc0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79cc0b3820 0x7f79cc0b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 -- 172.21.15.64:0/2876377027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc0b5220 con 0x7f79cc0750b0 2024-09-21T07:35:44.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c3e00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009790 tx=0x7f79b40a64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a66e0 con 0x7f79cc0750b0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79b4004130 con 0x7f79cc0750b0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4003600 con 0x7f79cc0750b0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.205+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc0af360 con 0x7f79cc0750b0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc0af920 con 0x7f79cc0750b0 2024-09-21T07:35:44.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc06cdf0 con 0x7f79cc0750b0 2024-09-21T07:35:44.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f79b40c1020 con 0x7f79cc0750b0 2024-09-21T07:35:44.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79c8c00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 0x7f79a80758e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6188+0+0 (secure 0 0 0) 0x7f79b412ee90 con 0x7f79cc0750b0 2024-09-21T07:35:44.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.209+0000 7f79cbe00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 0x7f79a80758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.213+0000 7f79cbe00640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 0x7f79a80758e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:44.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.213+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f79b40c8020 con 0x7f79cc0750b0 2024-09-21T07:35:44.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.425+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f79cc15e8f0 con 0x7f79cc0750b0 2024-09-21T07:35:44.427 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:35:44.425+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:35:44.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.429+0000 7f79c8c00640 1 -- 172.21.15.64:0/2876377027 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) ==== 161+0+0 (secure 0 0 0) 0x7f79b4130090 con 0x7f79cc0750b0 2024-09-21T07:35:44.430 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 msgr2=0x7f79a80758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 0x7f79a80758e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc005f40 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 msgr2=0x7f79cc152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009790 tx=0x7f79b40a64f0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 shutdown_connections 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f79a80733d0 0x7f79a80758e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79cc0b3820 0x7f79cc0b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79cc0750b0 0x7f79cc152020 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 --2- 172.21.15.64:0/2876377027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f79cc074ca0 0x7f79cc0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 >> 172.21.15.64:0/2876377027 conn(0x7f79cc0cdd10 msgr2=0x7f79cc070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:44.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 shutdown_connections 2024-09-21T07:35:44.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.433+0000 7f79d3000640 1 -- 172.21.15.64:0/2876377027 wait complete. 2024-09-21T07:35:44.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:35:44.588 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:35:44.589 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:35:44.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 -- 172.21.15.64:0/2047382781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c162450 msgr2=0x7f019c0cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 --2- 172.21.15.64:0/2047382781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c162450 0x7f019c0cf160 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f019c163490 tx=0x7f018401c7f0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 -- 172.21.15.64:0/2047382781 shutdown_connections 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 --2- 172.21.15.64:0/2047382781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c162450 0x7f019c0cf160 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 -- 172.21.15.64:0/2047382781 >> 172.21.15.64:0/2047382781 conn(0x7f019c06d1c0 msgr2=0x7f019c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 -- 172.21.15.64:0/2047382781 shutdown_connections 2024-09-21T07:35:44.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.629+0000 7f01a2400640 1 -- 172.21.15.64:0/2047382781 wait complete. 2024-09-21T07:35:44.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 Processor -- start 2024-09-21T07:35:44.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 -- start start 2024-09-21T07:35:44.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f019c162450 0x7f019c154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f019c162860 0x7f019c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f019c16d7a0 con 0x7f019c06e8d0 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f019c16d620 con 0x7f019c162860 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f01a2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f019c16d920 con 0x7f019c162450 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f019b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f019b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55366/0 (socket says 172.21.15.64:55366) 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f019b400640 1 -- 172.21.15.64:0/2873365199 learned_addr learned my addr 172.21.15.64:0/2873365199 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f0192a00640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f019c162450 0x7f019c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.633+0000 7f019be00640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f019c162860 0x7f019c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 -- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f019c162450 msgr2=0x7f019c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f019c162450 0x7f019c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 -- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f019c162860 msgr2=0x7f019c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:44.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f019c162860 0x7f019c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:44.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 -- 172.21.15.64:0/2873365199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0cb2b0 con 0x7f019c06e8d0 2024-09-21T07:35:44.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f019b400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c790 tx=0x7f018c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c003b80 con 0x7f019c06e8d0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f018c003d20 con 0x7f019c06e8d0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c0c93c0 con 0x7f019c06e8d0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c00aa30 con 0x7f019c06e8d0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c0c9980 con 0x7f019c06e8d0 2024-09-21T07:35:44.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c0cf160 con 0x7f019c06e8d0 2024-09-21T07:35:44.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.637+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f018c00abd0 con 0x7f019c06e8d0 2024-09-21T07:35:44.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.641+0000 7f0193e00640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 0x7f0178075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:44.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.641+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 6274+0+0 (secure 0 0 0) 0x7f018c0940c0 con 0x7f019c06e8d0 2024-09-21T07:35:44.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.641+0000 7f0192a00640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 0x7f0178075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:44.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.641+0000 7f0192a00640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 0x7f0178075710 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f01840af000 tx=0x7f018401b030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:44.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.645+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f018c05e8e0 con 0x7f019c06e8d0 2024-09-21T07:35:44.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:44.861+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f019c069310 con 0x7f019c06e8d0 2024-09-21T07:35:45.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.429+0000 7f0193e00640 1 -- 172.21.15.64:0/2873365199 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v138) ==== 104+0+0 (secure 0 0 0) 0x7f018c063310 con 0x7f019c06e8d0 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 msgr2=0x7f0178075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 0x7f0178075710 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f01840af000 tx=0x7f018401b030 comp rx=0 tx=0).stop 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 msgr2=0x7f019c0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c790 tx=0x7f018c00cc50 comp rx=0 tx=0).stop 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 shutdown_connections 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0178073200 0x7f0178075710 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f019c162860 0x7f019c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f019c162450 0x7f019c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 --2- 172.21.15.64:0/2873365199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f019c06e8d0 0x7f019c0b5110 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 >> 172.21.15.64:0/2873365199 conn(0x7f019c06d1c0 msgr2=0x7f019c0cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:45.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 shutdown_connections 2024-09-21T07:35:45.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.433+0000 7f01a2400640 1 -- 172.21.15.64:0/2873365199 wait complete. 2024-09-21T07:35:45.458 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:35:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- 172.21.15.64:0/1281838890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec15f660 msgr2=0x7f64ec06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 --2- 172.21.15.64:0/1281838890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec15f660 0x7f64ec06f500 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f64ec071d00 tx=0x7f64dc01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- 172.21.15.64:0/1281838890 shutdown_connections 2024-09-21T07:35:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 --2- 172.21.15.64:0/1281838890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec074580 0x7f64ec0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 --2- 172.21.15.64:0/1281838890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec15f660 0x7f64ec06f500 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- 172.21.15.64:0/1281838890 >> 172.21.15.64:0/1281838890 conn(0x7f64ec0d0170 msgr2=0x7f64ec0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- 172.21.15.64:0/1281838890 shutdown_connections 2024-09-21T07:35:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- 172.21.15.64:0/1281838890 wait complete. 2024-09-21T07:35:45.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 Processor -- start 2024-09-21T07:35:45.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.621+0000 7f64f1600640 1 -- start start 2024-09-21T07:35:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 0x7f64ec0ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 0x7f64ec15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06f1c0 con 0x7f64ec074580 2024-09-21T07:35:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06f040 con 0x7f64ec06fa40 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec06f340 con 0x7f64ec15f660 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36234/0 (socket says 172.21.15.64:36234) 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 -- 172.21.15.64:0/1556857862 learned_addr learned my addr 172.21.15.64:0/1556857862 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64eaa00640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 0x7f64ec0ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64eb400640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 0x7f64ec15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 -- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 msgr2=0x7f64ec15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 0x7f64ec15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 -- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 msgr2=0x7f64ec0ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 0x7f64ec0ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 -- 172.21.15.64:0/1556857862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec156b20 con 0x7f64ec074580 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64eaa00640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 0x7f64ec0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64eb400640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 0x7f64ec15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e2000640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b440 tx=0x7f64d400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4015020 con 0x7f64ec074580 2024-09-21T07:35:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64d4011980 con 0x7f64ec074580 2024-09-21T07:35:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec0c86d0 con 0x7f64ec074580 2024-09-21T07:35:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4011dd0 con 0x7f64ec074580 2024-09-21T07:35:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec0c8c90 con 0x7f64ec074580 2024-09-21T07:35:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.625+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec06f500 con 0x7f64ec074580 2024-09-21T07:35:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.629+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f64d4018020 con 0x7f64ec074580 2024-09-21T07:35:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.629+0000 7f64e3400640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 0x7f64c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.629+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 6274+0+0 (secure 0 0 0) 0x7f64d40942e0 con 0x7f64ec074580 2024-09-21T07:35:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.629+0000 7f64eaa00640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 0x7f64c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.629+0000 7f64eaa00640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 0x7f64c8075710 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0af000 tx=0x7f64dc0195f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:45.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.633+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f64d401f030 con 0x7f64ec074580 2024-09-21T07:35:45.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:45.813+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f64ec0c8460 con 0x7f64ec074580 2024-09-21T07:35:46.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.437+0000 7f64e3400640 1 -- 172.21.15.64:0/1556857862 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) ==== 181+0+0 (secure 0 0 0) 0x7f64d400d040 con 0x7f64ec074580 2024-09-21T07:35:46.438 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:35:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 msgr2=0x7f64c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 0x7f64c8075710 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0af000 tx=0x7f64dc0195f0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 msgr2=0x7f64ec0ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b440 tx=0x7f64d400b900 comp rx=0 tx=0).stop 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 shutdown_connections 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64c8073200 0x7f64c8075710 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64ec15f660 0x7f64ec15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ec074580 0x7f64ec0ae670 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 --2- 172.21.15.64:0/1556857862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec06fa40 0x7f64ec0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 >> 172.21.15.64:0/1556857862 conn(0x7f64ec0d0170 msgr2=0x7f64ec0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:46.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 shutdown_connections 2024-09-21T07:35:46.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.441+0000 7f64f1600640 1 -- 172.21.15.64:0/1556857862 wait complete. 2024-09-21T07:35:46.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- 172.21.15.64:0/4042906968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07406f1b0 msgr2=0x7fb07406f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- 172.21.15.64:0/4042906968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07406f1b0 0x7fb07406f5c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009900 tx=0x7fb05c01c850 comp rx=0 tx=0).stop 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- 172.21.15.64:0/4042906968 shutdown_connections 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- 172.21.15.64:0/4042906968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07406f1b0 0x7fb07406f5c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- 172.21.15.64:0/4042906968 >> v2:172.21.15.90:3300/0 conn(0x7fb07415f660 0x7fb07406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- 172.21.15.64:0/4042906968 >> 172.21.15.64:0/4042906968 conn(0x7fb0740d0170 msgr2=0x7fb0740d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- 172.21.15.64:0/4042906968 shutdown_connections 2024-09-21T07:35:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- 172.21.15.64:0/4042906968 wait complete. 2024-09-21T07:35:46.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 Processor -- start 2024-09-21T07:35:46.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- start start 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 0x7fb074156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07415f660 0x7fb07409ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb0740749c0 con 0x7fb07406fb00 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb074074840 con 0x7fb07406f1b0 2024-09-21T07:35:46.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.633+0000 7fb078c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb074169080 con 0x7fb07415f660 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb071e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 0x7fb074156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36246/0 (socket says 172.21.15.64:36246) 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 -- 172.21.15.64:0/151397035 learned_addr learned my addr 172.21.15.64:0/151397035 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb072800640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07415f660 0x7fb07409ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 -- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07415f660 msgr2=0x7fb07409ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07415f660 0x7fb07409ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 -- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 msgr2=0x7fb074156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 0x7fb074156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 -- 172.21.15.64:0/151397035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0741f98c0 con 0x7fb07406fb00 2024-09-21T07:35:46.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb071e00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 0x7fb074156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06be00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009850 tx=0x7fb05c0a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0b2040 con 0x7fb07406fb00 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb05c0042c0 con 0x7fb07406fb00 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0740ae6a0 con 0x7fb07406fb00 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c005030 con 0x7fb07406fb00 2024-09-21T07:35:46.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0740aec60 con 0x7fb07406fb00 2024-09-21T07:35:46.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07406f5c0 con 0x7fb07406fb00 2024-09-21T07:35:46.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.637+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb05c0051f0 con 0x7fb07406fb00 2024-09-21T07:35:46.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.641+0000 7fb06a000640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 0x7fb050075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:46.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.641+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5836+0+0 (secure 0 0 0) 0x7fb05c12dcb0 con 0x7fb07406fb00 2024-09-21T07:35:46.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.641+0000 7fb071e00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 0x7fb050075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:46.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.641+0000 7fb071e00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 0x7fb050075710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb064009f30 tx=0x7fb0640091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:46.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.645+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb05c0164d0 con 0x7fb07406fb00 2024-09-21T07:35:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:46.821+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb0740b60f0 con 0x7fb07406fb00 2024-09-21T07:35:47.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb06a000640 1 -- 172.21.15.64:0/151397035 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) ==== 169+0+0 (secure 0 0 0) 0x7fb05c0f8cd0 con 0x7fb07406fb00 2024-09-21T07:35:47.441 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 msgr2=0x7fb050075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 0x7fb050075710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb064009f30 tx=0x7fb0640091e0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 msgr2=0x7fb07409c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009850 tx=0x7fb05c0a5620 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 shutdown_connections 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb050073200 0x7fb050075710 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb07415f660 0x7fb07409ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb07406fb00 0x7fb07409c940 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 --2- 172.21.15.64:0/151397035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb07406f1b0 0x7fb074156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 >> 172.21.15.64:0/151397035 conn(0x7fb0740d0170 msgr2=0x7fb07415dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:47.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 shutdown_connections 2024-09-21T07:35:47.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.441+0000 7fb078c00640 1 -- 172.21.15.64:0/151397035 wait complete. 2024-09-21T07:35:47.484 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:35:47.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- 172.21.15.64:0/1322901216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac0d1700 msgr2=0x7f32ac0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 --2- 172.21.15.64:0/1322901216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac0d1700 0x7f32ac0d0820 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f329c009870 tx=0x7f329c01c760 comp rx=0 tx=0).stop 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- 172.21.15.64:0/1322901216 shutdown_connections 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 --2- 172.21.15.64:0/1322901216 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac15dae0 0x7f32ac0710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 --2- 172.21.15.64:0/1322901216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac0d1700 0x7f32ac0d0820 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- 172.21.15.64:0/1322901216 >> 172.21.15.64:0/1322901216 conn(0x7f32ac0d2400 msgr2=0x7f32ac0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- 172.21.15.64:0/1322901216 shutdown_connections 2024-09-21T07:35:47.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- 172.21.15.64:0/1322901216 wait complete. 2024-09-21T07:35:47.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 Processor -- start 2024-09-21T07:35:47.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.673+0000 7f32b1200640 1 -- start start 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac0d1700 0x7f32ac1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac15dae0 0x7f32ac0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac16a130 con 0x7f32ac0d0d60 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac169fb0 con 0x7f32ac15dae0 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac16a2b0 con 0x7f32ac0d1700 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36252/0 (socket says 172.21.15.64:36252) 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 -- 172.21.15.64:0/507284402 learned_addr learned my addr 172.21.15.64:0/507284402 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32aa800640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac15dae0 0x7f32ac0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a3e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac0d1700 0x7f32ac1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 -- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac0d1700 msgr2=0x7f32ac1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac0d1700 0x7f32ac1472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 -- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac15dae0 msgr2=0x7f32ac0b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac15dae0 0x7f32ac0b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 -- 172.21.15.64:0/507284402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac141a10 con 0x7f32ac0d0d60 2024-09-21T07:35:47.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a9e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f329c009790 tx=0x7f329c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c0b2040 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f329c0043e0 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac1449b0 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c0052d0 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac1fa840 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.677+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac141be0 con 0x7f32ac0d0d60 2024-09-21T07:35:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.681+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f329c005470 con 0x7f32ac0d0d60 2024-09-21T07:35:47.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.681+0000 7f32a2000640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:47.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.681+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f329c12df60 con 0x7f32ac0d0d60 2024-09-21T07:35:47.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.681+0000 7f32a3e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:47.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.681+0000 7f32a3e00640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 0x7f3288075740 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0c93f0 tx=0x7f3294009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:47.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.685+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f329c0bd060 con 0x7f32ac0d0d60 2024-09-21T07:35:47.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.861+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f32ac0d0820 con 0x7f32ac0d0d60 2024-09-21T07:35:47.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32a2000640 1 -- 172.21.15.64:0/507284402 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v61) ==== 71+0+0 (secure 0 0 0) 0x7f329c016410 con 0x7f32ac0d0d60 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 msgr2=0x7f3288075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 0x7f3288075740 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0c93f0 tx=0x7f3294009040 comp rx=0 tx=0).stop 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 msgr2=0x7f32ac144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f329c009790 tx=0x7f329c005db0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 shutdown_connections 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ac15dae0 0x7f32ac0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32ac0d1700 0x7f32ac1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 --2- 172.21.15.64:0/507284402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ac0d0d60 0x7f32ac144470 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 >> 172.21.15.64:0/507284402 conn(0x7f32ac0d2400 msgr2=0x7f32ac0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 shutdown_connections 2024-09-21T07:35:47.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:47.869+0000 7f32b1200640 1 -- 172.21.15.64:0/507284402 wait complete. 2024-09-21T07:35:47.892 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 -- 172.21.15.64:0/399348380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d015edb0 msgr2=0x7f97d00700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 --2- 172.21.15.64:0/399348380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d015edb0 0x7f97d00700b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009840 tx=0x7f97c001c7c0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 -- 172.21.15.64:0/399348380 shutdown_connections 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 --2- 172.21.15.64:0/399348380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 0x7f97d00b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 --2- 172.21.15.64:0/399348380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d015edb0 0x7f97d00700b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 -- 172.21.15.64:0/399348380 >> 172.21.15.64:0/399348380 conn(0x7f97d00ccbe0 msgr2=0x7f97d00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 -- 172.21.15.64:0/399348380 shutdown_connections 2024-09-21T07:35:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.049+0000 7f97d4a00640 1 -- 172.21.15.64:0/399348380 wait complete. 2024-09-21T07:35:48.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 Processor -- start 2024-09-21T07:35:48.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 -- start start 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 0x7f97d00cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00b4700 0x7f97d01f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0169010 con 0x7f97d015edb0 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0168e90 con 0x7f97d00b4700 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97d4a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f97d0169190 con 0x7f97d00709b0 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36264/0 (socket says 172.21.15.64:36264) 2024-09-21T07:35:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 -- 172.21.15.64:0/2203975408 learned_addr learned my addr 172.21.15.64:0/2203975408 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:48.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97c7e00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00b4700 0x7f97d01f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97cde00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 0x7f97d00cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 -- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 msgr2=0x7f97d00cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 0x7f97d00cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 -- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00b4700 msgr2=0x7f97d01f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00b4700 0x7f97d01f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.053+0000 7f97ce800640 1 -- 172.21.15.64:0/2203975408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d00cb960 con 0x7f97d015edb0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97ce800640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f97c800ca70 tx=0x7f97c800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8016020 con 0x7f97d015edb0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97c800a930 con 0x7f97d015edb0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c800adc0 con 0x7f97d015edb0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d00cbc40 con 0x7f97d015edb0 2024-09-21T07:35:48.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d009b340 con 0x7f97d015edb0 2024-09-21T07:35:48.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d009b130 con 0x7f97d015edb0 2024-09-21T07:35:48.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f97c8019020 con 0x7f97d015edb0 2024-09-21T07:35:48.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 0x7f97ac075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.057+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f97c8093e00 con 0x7f97d015edb0 2024-09-21T07:35:48.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.061+0000 7f97cde00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 0x7f97ac075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.061+0000 7f97cde00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 0x7f97ac075790 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97c00af000 tx=0x7f97c00b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:48.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.061+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f97c8020030 con 0x7f97d015edb0 2024-09-21T07:35:48.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.301+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f97d00cb6f0 con 0x7f97d015edb0 2024-09-21T07:35:48.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.445+0000 7f97c6000640 1 -- 172.21.15.64:0/2203975408 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v620) ==== 159+0+0 (secure 0 0 0) 0x7f97d00b4b10 con 0x7f97d015edb0 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 msgr2=0x7f97ac075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 0x7f97ac075790 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97c00af000 tx=0x7f97c00b2040 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 msgr2=0x7f97d0163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f97c800ca70 tx=0x7f97c800cb60 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 shutdown_connections 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f97ac073280 0x7f97ac075790 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97d015edb0 0x7f97d0163dc0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00b4700 0x7f97d01f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 --2- 172.21.15.64:0/2203975408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97d00709b0 0x7f97d00cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 >> 172.21.15.64:0/2203975408 conn(0x7f97d00ccbe0 msgr2=0x7f97d00ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:48.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 shutdown_connections 2024-09-21T07:35:48.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.449+0000 7f97d4a00640 1 -- 172.21.15.64:0/2203975408 wait complete. 2024-09-21T07:35:48.471 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-21T07:35:48.472 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-21T07:35:48.472 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 -- 172.21.15.64:0/3308030515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 msgr2=0x7f74e80b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 --2- 172.21.15.64:0/3308030515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e80b1b90 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009c80 tx=0x7f74e001cda0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 -- 172.21.15.64:0/3308030515 shutdown_connections 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 --2- 172.21.15.64:0/3308030515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e80b1b90 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 --2- 172.21.15.64:0/3308030515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cf030 0x7f74e80cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 -- 172.21.15.64:0/3308030515 >> 172.21.15.64:0/3308030515 conn(0x7f74e809b3f0 msgr2=0x7f74e80d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 -- 172.21.15.64:0/3308030515 shutdown_connections 2024-09-21T07:35:48.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.629+0000 7f74ed400640 1 -- 172.21.15.64:0/3308030515 wait complete. 2024-09-21T07:35:48.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 Processor -- start 2024-09-21T07:35:48.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- start start 2024-09-21T07:35:48.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cec20 0x7f74e8161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74e80cf030 0x7f74e8161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8169b10 con 0x7f74e80b1780 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8169990 con 0x7f74e80cf030 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f74e8169c90 con 0x7f74e80cec20 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36294/0 (socket says 172.21.15.64:36294) 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 -- 172.21.15.64:0/3878179716 learned_addr learned my addr 172.21.15.64:0/3878179716 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74df400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cec20 0x7f74e8161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74eca00640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74e80cf030 0x7f74e8161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 -- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cec20 msgr2=0x7f74e8161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cec20 0x7f74e8161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 -- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74e80cf030 msgr2=0x7f74e8161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74e80cf030 0x7f74e8161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 -- 172.21.15.64:0/3878179716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e815a180 con 0x7f74e80b1780 2024-09-21T07:35:48.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e7e00640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c3c0 tx=0x7f74d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8017070 con 0x7f74e80b1780 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d80053c0 con 0x7f74e80b1780 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e815c2d0 con 0x7f74e80b1780 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8003860 con 0x7f74e80b1780 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.633+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e815c890 con 0x7f74e80b1780 2024-09-21T07:35:48.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e80b1b90 con 0x7f74e80b1780 2024-09-21T07:35:48.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f74d801a070 con 0x7f74e80b1780 2024-09-21T07:35:48.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74e4c00640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 0x7f74c4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:48.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f74d80933b0 con 0x7f74e80b1780 2024-09-21T07:35:48.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74df400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 0x7f74c4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:48.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.637+0000 7f74df400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 0x7f74c4075740 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f74e80cd940 tx=0x7f74d000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:48.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.641+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f74e815a180 con 0x7f74e80b1780 2024-09-21T07:35:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.821+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74e80cd3b0 con 0x7f74e80b1780 2024-09-21T07:35:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.821+0000 7f74e4c00640 1 -- 172.21.15.64:0/3878179716 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+13265 (secure 0 0 0) 0x7f74d805de50 con 0x7f74e80b1780 2024-09-21T07:35:48.824 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:48.824 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":183,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:47.440902+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/650567742":"2024-09-22T07:35:44.430343+0000","172.21.15.64:6834/650567742":"2024-09-22T07:35:44.430343+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 msgr2=0x7f74c4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 0x7f74c4075740 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f74e80cd940 tx=0x7f74d000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 msgr2=0x7f74e8148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c3c0 tx=0x7f74d800c880 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 shutdown_connections 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f74c4073230 0x7f74c4075740 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74e80cf030 0x7f74e8161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74e80cec20 0x7f74e8161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 --2- 172.21.15.64:0/3878179716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e80b1780 0x7f74e8148360 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 >> 172.21.15.64:0/3878179716 conn(0x7f74e809b3f0 msgr2=0x7f74e8070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 shutdown_connections 2024-09-21T07:35:48.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:48.825+0000 7f74ed400640 1 -- 172.21.15.64:0/3878179716 wait complete. 2024-09-21T07:35:48.847 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:35:48.847 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:35:49.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- 172.21.15.64:0/1911038823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fb8004070 msgr2=0x7f1fb8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 --2- 172.21.15.64:0/1911038823 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fb8004070 0x7f1fb8004810 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b2ec0 tx=0x7f1fbc01d1b0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fd8e00640 1 -- 172.21.15.64:0/1911038823 reap_dead start 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- 172.21.15.64:0/1911038823 shutdown_connections 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- 172.21.15.64:0/1911038823 >> 172.21.15.64:0/1911038823 conn(0x7f1fd406d450 msgr2=0x7f1fd40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- 172.21.15.64:0/1911038823 shutdown_connections 2024-09-21T07:35:49.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- 172.21.15.64:0/1911038823 wait complete. 2024-09-21T07:35:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 Processor -- start 2024-09-21T07:35:49.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.009+0000 7f1fdae00640 1 -- start start 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 0x7f1fd40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 0x7f1fd4150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd4070530 con 0x7f1fd40b0c50 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40703b0 con 0x7f1fd4157a80 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd40706b0 con 0x7f1fb8004070 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36312/0 (socket says 172.21.15.64:36312) 2024-09-21T07:35:49.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 -- 172.21.15.64:0/730989812 learned_addr learned my addr 172.21.15.64:0/730989812 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd3e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 0x7f1fd40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fcb400640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 0x7f1fd4150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 -- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 msgr2=0x7f1fd40c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 0x7f1fd40c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 -- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 msgr2=0x7f1fd4150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 0x7f1fd4150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 -- 172.21.15.64:0/730989812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd41582a0 con 0x7f1fd40b0c50 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd3e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 0x7f1fd40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fcb400640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 0x7f1fd4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:49.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd8e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40c3a90 tx=0x7f1fcc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0139e0 con 0x7f1fd40b0c50 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fcc013c90 con 0x7f1fd40b0c50 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd40afbb0 con 0x7f1fd40b0c50 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0126a0 con 0x7f1fd40b0c50 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd40b0170 con 0x7f1fd40b0c50 2024-09-21T07:35:49.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.013+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd409d880 con 0x7f1fd40b0c50 2024-09-21T07:35:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.017+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1fcc012840 con 0x7f1fd40b0c50 2024-09-21T07:35:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.017+0000 7f1fd0c00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 0x7f1fb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.017+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f1fcc097b90 con 0x7f1fd40b0c50 2024-09-21T07:35:49.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.017+0000 7f1fd3e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 0x7f1fb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.017+0000 7f1fd3e00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 0x7f1fb0075710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4005fd0 tx=0x7f1fc4005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:49.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.021+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1fcc062c80 con 0x7f1fd40b0c50 2024-09-21T07:35:49.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.197+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1fd415ee70 con 0x7f1fd40b0c50 2024-09-21T07:35:49.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.197+0000 7f1fd0c00640 1 -- 172.21.15.64:0/730989812 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) ==== 93+0+10 (secure 0 0 0) 0x7f1fcc062580 con 0x7f1fd40b0c50 2024-09-21T07:35:49.200 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 msgr2=0x7f1fb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 0x7f1fb0075710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4005fd0 tx=0x7f1fc4005f40 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 msgr2=0x7f1fd40b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40c3a90 tx=0x7f1fcc011a30 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 shutdown_connections 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1fb0073200 0x7f1fb0075710 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd40b0c50 0x7f1fd40b1060 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fd4157a80 0x7f1fd4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 --2- 172.21.15.64:0/730989812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fb8004070 0x7f1fd40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 >> 172.21.15.64:0/730989812 conn(0x7f1fd406d450 msgr2=0x7f1fd406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:49.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 shutdown_connections 2024-09-21T07:35:49.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.201+0000 7f1fdae00640 1 -- 172.21.15.64:0/730989812 wait complete. 2024-09-21T07:35:49.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-21T07:35:49.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 -- 172.21.15.64:0/449355504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc0b4700 msgr2=0x7f4ea00051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 --2- 172.21.15.64:0/449355504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc0b4700 0x7f4ea00051a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0afb70 tx=0x7f4eb401d5b0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ebbe00640 1 -- 172.21.15.64:0/449355504 reap_dead start 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 -- 172.21.15.64:0/449355504 shutdown_connections 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 -- 172.21.15.64:0/449355504 >> 172.21.15.64:0/449355504 conn(0x7f4ebc0ccbe0 msgr2=0x7f4ebc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 -- 172.21.15.64:0/449355504 shutdown_connections 2024-09-21T07:35:49.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 -- 172.21.15.64:0/449355504 wait complete. 2024-09-21T07:35:49.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.381+0000 7f4ec2400640 1 Processor -- start 2024-09-21T07:35:49.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- start start 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 0x7f4ebc154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc1f5dd0 0x7f4ebc0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc0731b0 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc073030 con 0x7f4ebc0b4700 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4ebc073330 con 0x7f4ebc1f5dd0 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36328/0 (socket says 172.21.15.64:36328) 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 -- 172.21.15.64:0/1721330627 learned_addr learned my addr 172.21.15.64:0/1721330627 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ebb400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 0x7f4ebc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 -- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc1f5dd0 msgr2=0x7f4ebc0b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc1f5dd0 0x7f4ebc0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 -- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 msgr2=0x7f4ebc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 0x7f4ebc154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 -- 172.21.15.64:0/1721330627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc1f94c0 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ebb400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 0x7f4ebc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:35:49.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3e00640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4011d50 tx=0x7f4ea400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401e070 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea4019630 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4019a60 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc1f97a0 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc1f9d60 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.385+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc073840 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.389+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ea4021070 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.389+0000 7f4eb3400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 0x7f4e98075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:49.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.389+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f4ea4095230 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.389+0000 7f4ebb400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 0x7f4e98075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:49.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.389+0000 7f4ebb400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 0x7f4e98075740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4eac006760 tx=0x7f4eac001120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:49.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.393+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4ea405fce0 con 0x7f4ebc0b0f50 2024-09-21T07:35:49.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:49.629+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f4ebc09da20 con 0x7f4ebc0b0f50 2024-09-21T07:35:50.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.453+0000 7f4eb3400640 1 -- 172.21.15.64:0/1721330627 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v622) ==== 143+0+0 (secure 0 0 0) 0x7f4ea4064710 con 0x7f4ebc0b0f50 2024-09-21T07:35:50.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 msgr2=0x7f4e98075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 0x7f4e98075740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4eac006760 tx=0x7f4eac001120 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 msgr2=0x7f4ebc09bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4011d50 tx=0x7f4ea400f790 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 shutdown_connections 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4e98073230 0x7f4e98075740 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4ebc1f5dd0 0x7f4ebc0b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ebc0b0f50 0x7f4ebc09bea0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 --2- 172.21.15.64:0/1721330627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc0b4700 0x7f4ebc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 >> 172.21.15.64:0/1721330627 conn(0x7f4ebc0ccbe0 msgr2=0x7f4ebc0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 shutdown_connections 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.457+0000 7f4ec2400640 1 -- 172.21.15.64:0/1721330627 wait complete. 2024-09-21T07:35:50.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 -- 172.21.15.64:0/390157469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7500cc8d0 msgr2=0x7fe7500ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 --2- 172.21.15.64:0/390157469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ccce0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fe748009c80 tx=0x7fe74801cd70 comp rx=0 tx=0).stop 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 -- 172.21.15.64:0/390157469 shutdown_connections 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 --2- 172.21.15.64:0/390157469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ccce0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 --2- 172.21.15.64:0/390157469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe750073d50 0x7fe7500cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 -- 172.21.15.64:0/390157469 >> 172.21.15.64:0/390157469 conn(0x7fe7500b24f0 msgr2=0x7fe7500b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.637+0000 7fe754c00640 1 -- 172.21.15.64:0/390157469 shutdown_connections 2024-09-21T07:35:50.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 -- 172.21.15.64:0/390157469 wait complete. 2024-09-21T07:35:50.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 Processor -- start 2024-09-21T07:35:50.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 -- start start 2024-09-21T07:35:50.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 0x7fe7500ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe750169e50 con 0x7fe750074380 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe750169cd0 con 0x7fe7500cc8d0 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.641+0000 7fe754c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe750169fd0 con 0x7fe7500b3830 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36356/0 (socket says 172.21.15.64:36356) 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 -- 172.21.15.64:0/2775659299 learned_addr learned my addr 172.21.15.64:0/2775659299 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe745400640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74e800640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 0x7fe7500ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:50.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 -- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 msgr2=0x7fe7500ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 0x7fe7500ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 -- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 msgr2=0x7fe7500ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 -- 172.21.15.64:0/2775659299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75015d390 con 0x7fe750074380 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74e800640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 0x7fe7500ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe745400640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe74de00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c3f0 tx=0x7fe74000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740017070 con 0x7fe750074380 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7400053c0 con 0x7fe750074380 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740003860 con 0x7fe750074380 2024-09-21T07:35:50.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7500cf780 con 0x7fe750074380 2024-09-21T07:35:50.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75015ce10 con 0x7fe750074380 2024-09-21T07:35:50.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7500cc390 con 0x7fe750074380 2024-09-21T07:35:50.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.645+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe74001a070 con 0x7fe750074380 2024-09-21T07:35:50.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.649+0000 7fe746a00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 0x7fe72c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:50.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.649+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7fe7400933b0 con 0x7fe750074380 2024-09-21T07:35:50.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.649+0000 7fe745400640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 0x7fe72c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:50.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.649+0000 7fe745400640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 0x7fe72c075740 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe738005fd0 tx=0x7fe738005f00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:50.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.653+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe74005e5e0 con 0x7fe750074380 2024-09-21T07:35:50.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.829+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe7501561a0 con 0x7fe750074380 2024-09-21T07:35:50.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.829+0000 7fe746a00640 1 -- 172.21.15.64:0/2775659299 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v61) ==== 59+0+2294 (secure 0 0 0) 0x7fe74005dee0 con 0x7fe750074380 2024-09-21T07:35:50.831 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:35:50.831 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:35:50.832 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:35:50.833 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:35:50.834 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 msgr2=0x7fe72c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 0x7fe72c075740 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe738005fd0 tx=0x7fe738005f00 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 msgr2=0x7fe75015d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c3f0 tx=0x7fe74000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 shutdown_connections 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe72c073230 0x7fe72c075740 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7500b3830 0x7fe7500ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500cc8d0 0x7fe7500ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 --2- 172.21.15.64:0/2775659299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe750074380 0x7fe75015d870 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 >> 172.21.15.64:0/2775659299 conn(0x7fe7500b24f0 msgr2=0x7fe750070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 shutdown_connections 2024-09-21T07:35:50.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:50.833+0000 7fe754c00640 1 -- 172.21.15.64:0/2775659299 wait complete. 2024-09-21T07:35:50.854 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:35:51.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 -- 172.21.15.64:0/3366451030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 msgr2=0x7efc740b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 --2- 172.21.15.64:0/3366451030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc740b33d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc64009840 tx=0x7efc6401c760 comp rx=0 tx=0).stop 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 -- 172.21.15.64:0/3366451030 shutdown_connections 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 --2- 172.21.15.64:0/3366451030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc740b33d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 -- 172.21.15.64:0/3366451030 >> 172.21.15.64:0/3366451030 conn(0x7efc7406d450 msgr2=0x7efc740d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 -- 172.21.15.64:0/3366451030 shutdown_connections 2024-09-21T07:35:51.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 -- 172.21.15.64:0/3366451030 wait complete. 2024-09-21T07:35:51.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.017+0000 7efc7a800640 1 Processor -- start 2024-09-21T07:35:51.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- start start 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc741fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc740b3910 0x7efc741459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc7416a490 con 0x7efc740ce900 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc7416a310 con 0x7efc740b3910 2024-09-21T07:35:51.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efc7416a610 con 0x7efc7409df30 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36360/0 (socket says 172.21.15.64:36360) 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 -- 172.21.15.64:0/592731253 learned_addr learned my addr 172.21.15.64:0/592731253 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73400640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc741fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc6be00640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc740b3910 0x7efc741459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 -- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 msgr2=0x7efc741fcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc741fcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 -- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc740b3910 msgr2=0x7efc741459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc740b3910 0x7efc741459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 -- 172.21.15.64:0/592731253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc74145ef0 con 0x7efc740ce900 2024-09-21T07:35:51.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc73e00640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7efc6c001710 tx=0x7efc6c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c016020 con 0x7efc740ce900 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc6c00ab60 con 0x7efc740ce900 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc74072df0 con 0x7efc740ce900 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c012420 con 0x7efc740ce900 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.021+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc740730b0 con 0x7efc740ce900 2024-09-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc74157240 con 0x7efc740ce900 2024-09-21T07:35:51.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efc6c019020 con 0x7efc740ce900 2024-09-21T07:35:51.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc6b400640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 0x7efc50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7efc6c0944b0 con 0x7efc740ce900 2024-09-21T07:35:51.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc73400640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 0x7efc50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.025+0000 7efc73400640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 0x7efc50075710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad000 tx=0x7efc6401afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:51.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.029+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efc6c020020 con 0x7efc740ce900 2024-09-21T07:35:51.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.205+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc740b33d0 con 0x7efc740ce900 2024-09-21T07:35:51.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.209+0000 7efc6b400640 1 -- 172.21.15.64:0/592731253 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v62)=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7efc6c05ef50 con 0x7efc740ce900 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 msgr2=0x7efc50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 0x7efc50075710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad000 tx=0x7efc6401afa0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 msgr2=0x7efc740ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7efc6c001710 tx=0x7efc6c00cc80 comp rx=0 tx=0).stop 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 shutdown_connections 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efc50073200 0x7efc50075710 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc740ce900 0x7efc740ae330 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc740b3910 0x7efc741459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 --2- 172.21.15.64:0/592731253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7409df30 0x7efc741fcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 >> 172.21.15.64:0/592731253 conn(0x7efc7406d450 msgr2=0x7efc74159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:51.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 shutdown_connections 2024-09-21T07:35:51.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.213+0000 7efc7a800640 1 -- 172.21.15.64:0/592731253 wait complete. 2024-09-21T07:35:51.235 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:35:51.235 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:35:51.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:35:51.420 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:35:51.420 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:51.420 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:51.429 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:35:51.429 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:35:51.429 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:51.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:35:51.438 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:35:51.439 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:51.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:35:51.484 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:35:51.485 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:35:51.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:35:51.494 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:35:51.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3332168000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00cc360 msgr2=0x7f5ec015c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3332168000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00cc360 0x7f5ec015c880 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009840 tx=0x7f5ea801c700 comp rx=0 tx=0).stop 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3332168000 shutdown_connections 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3332168000 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 0x7f5ec0074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3332168000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00cc360 0x7f5ec015c880 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3332168000 >> 172.21.15.64:0/3332168000 conn(0x7f5ec00b2dc0 msgr2=0x7f5ec00b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:51.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3332168000 shutdown_connections 2024-09-21T07:35:51.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3332168000 wait complete. 2024-09-21T07:35:51.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 Processor -- start 2024-09-21T07:35:51.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.685+0000 7f5ec4c00640 1 -- start start 2024-09-21T07:35:51.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 0x7f5ec01658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec00b6bb0 0x7f5ec0165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec016a090 con 0x7f5ec00d0990 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0169f10 con 0x7f5ec00b6bb0 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec016a210 con 0x7f5ec0073e80 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36376/0 (socket says 172.21.15.64:36376) 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 -- 172.21.15.64:0/3585234628 learned_addr learned my addr 172.21.15.64:0/3585234628 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5eb7e00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec00b6bb0 0x7f5ec0165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebde00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 0x7f5ec01658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 -- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 msgr2=0x7f5ec01658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 0x7f5ec01658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 -- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec00b6bb0 msgr2=0x7f5ec0165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec00b6bb0 0x7f5ec0165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 -- 172.21.15.64:0/3585234628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec00cf950 con 0x7f5ec00d0990 2024-09-21T07:35:51.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ebe800640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e970 tx=0x7f5eb800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:51.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8004d30 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eb800cb20 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8005020 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec00cfc30 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec00d01f0 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.689+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec0074290 con 0x7f5ec00d0990 2024-09-21T07:35:51.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.693+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5eb80051c0 con 0x7f5ec00d0990 2024-09-21T07:35:51.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.693+0000 7f5eb6000640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 0x7f5e9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:51.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.693+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7f5eb8094990 con 0x7f5ec00d0990 2024-09-21T07:35:51.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.693+0000 7f5ebde00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 0x7f5e9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:51.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.693+0000 7f5ebde00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 0x7f5e9c075710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00046c0 tx=0x7f5eb0007ec0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:51.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.697+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5eb8016030 con 0x7f5ec00d0990 2024-09-21T07:35:51.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.913+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ec00d0e90 con 0x7f5ec00d0990 2024-09-21T07:35:51.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.913+0000 7f5eb6000640 1 -- 172.21.15.64:0/3585234628 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+3912 (secure 0 0 0) 0x7f5eb805f430 con 0x7f5ec00d0990 2024-09-21T07:35:51.914 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:51.914 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":138,"btime":"2024-09-21T07:35:45:432782+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/865008219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":865008219},{"type":"v1","addr":"172.21.15.90:6836","nonce":865008219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1171302625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":1171302625},{"type":"v1","addr":"172.21.15.90:6837","nonce":1171302625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":10419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/3442109467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3442109467},{"type":"v1","addr":"172.21.15.64:6833","nonce":3442109467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":138},{"gid":10422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/289418987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":289418987},{"type":"v1","addr":"172.21.15.64:6835","nonce":289418987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":138}],"filesystems":[]} 2024-09-21T07:35:51.915 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 138 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.913+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 msgr2=0x7f5e9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.913+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 0x7f5e9c075710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00046c0 tx=0x7f5eb0007ec0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 msgr2=0x7f5ec015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e970 tx=0x7f5eb800ee30 comp rx=0 tx=0).stop 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 shutdown_connections 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5e9c073200 0x7f5e9c075710 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ec00d0990 0x7f5ec015e2a0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec00b6bb0 0x7f5ec0165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 --2- 172.21.15.64:0/3585234628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ec0073e80 0x7f5ec01658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:51.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 >> 172.21.15.64:0/3585234628 conn(0x7f5ec00b2dc0 msgr2=0x7f5ec00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:51.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 shutdown_connections 2024-09-21T07:35:51.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:51.917+0000 7f5ec4c00640 1 -- 172.21.15.64:0/3585234628 wait complete. 2024-09-21T07:35:51.937 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:35:51.937 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:35:51.937 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:35:51.937 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:35:51.938 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:35:51.938 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:35:51.938 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:35:51.938 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:35:51.938 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:35:51.938 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:35:51.938 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:35:51.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:35:51.939 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:35:51.939 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:35:51.939 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:35:51.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:35:51.952 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:35:51.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:35:51.953 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:35:51.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:35:51.958 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:35:51.958 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:35:51.959 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:35:51.959 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:35:51.998 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:35:51.998 DEBUG:teuthology.parallel:result is None 2024-09-21T07:35:51.999 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:35:51.999 DEBUG:teuthology.parallel:result is None 2024-09-21T07:35:52.007 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:35:52.007 DEBUG:teuthology.parallel:result is None 2024-09-21T07:35:52.008 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:35:52.009 DEBUG:teuthology.parallel:result is None 2024-09-21T07:35:52.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:35:52.101 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:35:52.102 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:35:52.103 INFO:tasks.ceph.mds.b.smithi090.stderr:2024-09-21T07:35:52.103+0000 7f9d9a800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T07:35:52.108 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:35:52.110 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 -- 172.21.15.64:0/943218850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c1602f0 msgr2=0x7efe6c06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 --2- 172.21.15.64:0/943218850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c1602f0 0x7efe6c06f890 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efe64009bc0 tx=0x7efe6401cba0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 -- 172.21.15.64:0/943218850 shutdown_connections 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 --2- 172.21.15.64:0/943218850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c1602f0 0x7efe6c06f890 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 --2- 172.21.15.64:0/943218850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 0x7efe6c15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 -- 172.21.15.64:0/943218850 >> 172.21.15.64:0/943218850 conn(0x7efe6c06d450 msgr2=0x7efe6c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 -- 172.21.15.64:0/943218850 shutdown_connections 2024-09-21T07:35:52.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.172+0000 7efe72a00640 1 -- 172.21.15.64:0/943218850 wait complete. 2024-09-21T07:35:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 Processor -- start 2024-09-21T07:35:52.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 -- start start 2024-09-21T07:35:52.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 0x7efe6c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 0x7efe6c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c0ccef0 con 0x7efe6c1602f0 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c0ccd70 con 0x7efe6c09df30 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe72a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c0cd070 con 0x7efe6c15f9a0 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe70a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 0x7efe6c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe70a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36408/0 (socket says 172.21.15.64:36408) 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe70a00640 1 -- 172.21.15.64:0/2741589522 learned_addr learned my addr 172.21.15.64:0/2741589522 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe63e00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 0x7efe6c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 -- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 msgr2=0x7efe6c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 0x7efe6c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 -- 172.21.15.64:0/2741589522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 msgr2=0x7efe6c157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 -- 172.21.15.64:0/2741589522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c09d970 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe70a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.176+0000 7efe6be00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 0x7efe6c150730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c3c0 tx=0x7efe5c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c011790 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe5c017070 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c151a20 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c011ce0 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c151fe0 con 0x7efe6c09df30 2024-09-21T07:35:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c09d490 con 0x7efe6c09df30 2024-09-21T07:35:52.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe5c005020 con 0x7efe6c09df30 2024-09-21T07:35:52.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 0x7efe48075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5335+0+0 (secure 0 0 0) 0x7efe5c093e10 con 0x7efe6c09df30 2024-09-21T07:35:52.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.180+0000 7efe63e00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 0x7efe48075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.184+0000 7efe63e00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 0x7efe48075740 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe54009600 tx=0x7efe540091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:52.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.184+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efe6c09d490 con 0x7efe6c09df30 2024-09-21T07:35:52.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.368+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efe6c15fdb0 con 0x7efe6c09df30 2024-09-21T07:35:52.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.476+0000 7efe68c00640 1 -- 172.21.15.64:0/2741589522 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v185) ==== 97+0+0 (secure 0 0 0) 0x7efe5c05e930 con 0x7efe6c09df30 2024-09-21T07:35:52.480 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 msgr2=0x7efe48075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 0x7efe48075740 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe54009600 tx=0x7efe540091e0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 msgr2=0x7efe6c150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 0x7efe6c150730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c3c0 tx=0x7efe5c00c880 comp rx=0 tx=0).stop 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 shutdown_connections 2024-09-21T07:35:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efe48073230 0x7efe48075740 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe6c1602f0 0x7efe6c157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe6c15f9a0 0x7efe6c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 --2- 172.21.15.64:0/2741589522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe6c09df30 0x7efe6c150730 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 >> 172.21.15.64:0/2741589522 conn(0x7efe6c06d450 msgr2=0x7efe6c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 shutdown_connections 2024-09-21T07:35:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.480+0000 7efe72a00640 1 -- 172.21.15.64:0/2741589522 wait complete. 2024-09-21T07:35:52.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 -- 172.21.15.64:0/3508387803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 msgr2=0x7fe0dc0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/3508387803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc0b41c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009870 tx=0x7fe0c401c860 comp rx=0 tx=0).stop 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 -- 172.21.15.64:0/3508387803 shutdown_connections 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/3508387803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc0b41c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 -- 172.21.15.64:0/3508387803 >> 172.21.15.64:0/3508387803 conn(0x7fe0dc0ccbe0 msgr2=0x7fe0dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 -- 172.21.15.64:0/3508387803 shutdown_connections 2024-09-21T07:35:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.660+0000 7fe0e0c00640 1 -- 172.21.15.64:0/3508387803 wait complete. 2024-09-21T07:35:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 Processor -- start 2024-09-21T07:35:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- start start 2024-09-21T07:35:52.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc14e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 0x7fe0dc0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc16a240 con 0x7fe0dc15edb0 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc16a0c0 con 0x7fe0dc0b4700 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc16a3c0 con 0x7fe0dc0709b0 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc14e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 0x7fe0dc0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36414/0 (socket says 172.21.15.64:36414) 2024-09-21T07:35:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 -- 172.21.15.64:0/1815674062 learned_addr learned my addr 172.21.15.64:0/1815674062 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 -- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 msgr2=0x7fe0dc14e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc14e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 -- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 msgr2=0x7fe0dc0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 0x7fe0dc0ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 -- 172.21.15.64:0/1815674062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0b2a90 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d3e00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 0x7fe0dc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0da800640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400caa0 tx=0x7fe0d400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4016020 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d400a930 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc14eb50 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d400ae00 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.664+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc0b27b0 con 0x7fe0dc15edb0 2024-09-21T07:35:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc0b41c0 con 0x7fe0dc15edb0 2024-09-21T07:35:52.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0d4019020 con 0x7fe0dc15edb0 2024-09-21T07:35:52.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0d2000640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 0x7fe0b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:52.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7fe0d4094530 con 0x7fe0dc15edb0 2024-09-21T07:35:52.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0d9e00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 0x7fe0b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:52.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.668+0000 7fe0d9e00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 0x7fe0b8075740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001710 tx=0x7fe0cc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:52.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.672+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe0d4020020 con 0x7fe0dc15edb0 2024-09-21T07:35:52.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe0dc14ede0 con 0x7fe0dc15edb0 2024-09-21T07:35:52.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0d2000640 1 -- 172.21.15.64:0/1815674062 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) ==== 80+0+5304 (secure 0 0 0) 0x7fe0dc0b4b10 con 0x7fe0dc15edb0 2024-09-21T07:35:52.914 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.915 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.916 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.917 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.920 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:35:52.921 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.922 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:35:52.923 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:35:52.924 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.925 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:35:52.926 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:35:52.927 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:35:52.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 msgr2=0x7fe0b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 0x7fe0b8075740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001710 tx=0x7fe0cc009040 comp rx=0 tx=0).stop 2024-09-21T07:35:52.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 msgr2=0x7fe0dc0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400caa0 tx=0x7fe0d400cb90 comp rx=0 tx=0).stop 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 shutdown_connections 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b8073230 0x7fe0b8075740 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0dc15edb0 0x7fe0dc0ae870 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0dc0b4700 0x7fe0dc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 --2- 172.21.15.64:0/1815674062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0dc0709b0 0x7fe0dc14e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.912+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 >> 172.21.15.64:0/1815674062 conn(0x7fe0dc0ccbe0 msgr2=0x7fe0dc15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.916+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 shutdown_connections 2024-09-21T07:35:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:52.916+0000 7fe0e0c00640 1 -- 172.21.15.64:0/1815674062 wait complete. 2024-09-21T07:35:52.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 -- 172.21.15.64:0/2657726565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f950415edb0 msgr2=0x7f95040700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 --2- 172.21.15.64:0/2657726565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f950415edb0 0x7f95040700b0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f950406f220 tx=0x7f94f401c8a0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 -- 172.21.15.64:0/2657726565 shutdown_connections 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 --2- 172.21.15.64:0/2657726565 >> v2:172.21.15.90:3300/0 conn(0x7f95040709b0 0x7f95040b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 --2- 172.21.15.64:0/2657726565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f950415edb0 0x7f95040700b0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 -- 172.21.15.64:0/2657726565 >> 172.21.15.64:0/2657726565 conn(0x7f95040ccbe0 msgr2=0x7f95040ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 -- 172.21.15.64:0/2657726565 shutdown_connections 2024-09-21T07:35:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.092+0000 7f9508a00640 1 -- 172.21.15.64:0/2657726565 wait complete. 2024-09-21T07:35:53.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 Processor -- start 2024-09-21T07:35:53.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 -- start start 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 0x7f9504155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f950415edb0 0x7f9504158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9504169010 con 0x7f95040b4700 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9504168e90 con 0x7f95040709b0 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9508a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9504169190 con 0x7f950415edb0 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 0x7f9504155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:44522/0 (socket says 172.21.15.64:44522) 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501e00640 1 -- 172.21.15.64:0/2451278241 learned_addr learned my addr 172.21.15.64:0/2451278241 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9502800640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f950415edb0 0x7f9504158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 -- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f950415edb0 msgr2=0x7f9504158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f950415edb0 0x7f9504158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 -- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 msgr2=0x7f95041f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 -- 172.21.15.64:0/2451278241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9504155e70 con 0x7f95040b4700 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501e00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.096+0000 7f9501400640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 0x7f9504155930 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f94f000e6c0 tx=0x7f94f000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0004220 con 0x7f95040b4700 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94f000c8b0 con 0x7f95040b4700 2024-09-21T07:35:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f000cd00 con 0x7f95040b4700 2024-09-21T07:35:53.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95041fa5c0 con 0x7f95040b4700 2024-09-21T07:35:53.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95041fab80 con 0x7f95040b4700 2024-09-21T07:35:53.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95040b41c0 con 0x7f95040b4700 2024-09-21T07:35:53.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f94f0003600 con 0x7f95040b4700 2024-09-21T07:35:53.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 0x7f94e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7f94f0094610 con 0x7f95040b4700 2024-09-21T07:35:53.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.100+0000 7f9501e00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 0x7f94e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.104+0000 7f9501e00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 0x7f94e4075710 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009230 tx=0x7f94f401b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:53.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.104+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9504155e70 con 0x7f95040b4700 2024-09-21T07:35:53.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.284+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f950409da20 con 0x7f95040b4700 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.284+0000 7f94fa000640 1 -- 172.21.15.64:0/2451278241 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) ==== 84+0+65 (secure 0 0 0) 0x7f94f005f110 con 0x7f95040b4700 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:35:53.287 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:35:53.288 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:35:53.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 msgr2=0x7f94e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 0x7f94e4075710 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009230 tx=0x7f94f401b0e0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 msgr2=0x7f9504155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 0x7f9504155930 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f94f000e6c0 tx=0x7f94f000eb80 comp rx=0 tx=0).stop 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 shutdown_connections 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f94e4073200 0x7f94e4075710 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f950415edb0 0x7f9504158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95040b4700 0x7f9504155930 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 --2- 172.21.15.64:0/2451278241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95040709b0 0x7f95041f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 >> 172.21.15.64:0/2451278241 conn(0x7f95040ccbe0 msgr2=0x7f95040ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 shutdown_connections 2024-09-21T07:35:53.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.288+0000 7f9508a00640 1 -- 172.21.15.64:0/2451278241 wait complete. 2024-09-21T07:35:53.309 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:35:53.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 -- 172.21.15.64:0/2889529993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c1594c0 msgr2=0x7f175c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 --2- 172.21.15.64:0/2889529993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c1594c0 0x7f175c0aee20 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f175c073fa0 tx=0x7f174801c820 comp rx=0 tx=0).stop 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 -- 172.21.15.64:0/2889529993 shutdown_connections 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 --2- 172.21.15.64:0/2889529993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c1594c0 0x7f175c0aee20 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 -- 172.21.15.64:0/2889529993 >> 172.21.15.64:0/2889529993 conn(0x7f175c0d0170 msgr2=0x7f175c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 -- 172.21.15.64:0/2889529993 shutdown_connections 2024-09-21T07:35:53.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.472+0000 7f1761200640 1 -- 172.21.15.64:0/2889529993 wait complete. 2024-09-21T07:35:53.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 Processor -- start 2024-09-21T07:35:53.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 -- start start 2024-09-21T07:35:53.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 0x7f175c145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 0x7f175c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f175c16a310 con 0x7f175c06ec70 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f175c16a190 con 0x7f175c0af360 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1761200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f175c16a490 con 0x7f175c15b350 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1759e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 0x7f175c145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1759400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f175a800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 0x7f175c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1759400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:44532/0 (socket says 172.21.15.64:44532) 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.476+0000 7f1759400640 1 -- 172.21.15.64:0/136880300 learned_addr learned my addr 172.21.15.64:0/136880300 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 -- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 msgr2=0x7f175c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 0x7f175c1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 -- 172.21.15.64:0/136880300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 msgr2=0x7f175c145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 0x7f175c145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 -- 172.21.15.64:0/136880300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c1fc8a0 con 0x7f175c0af360 2024-09-21T07:35:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759e00640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 0x7f175c145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f175a800640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 0x7f175c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1759400640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c10 tx=0x7f17480a55d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480bb070 con 0x7f175c0af360 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1748004470 con 0x7f175c0af360 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c1fcb80 con 0x7f175c0af360 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480b2040 con 0x7f175c0af360 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c0b4be0 con 0x7f175c0af360 2024-09-21T07:35:53.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c0aee20 con 0x7f175c0af360 2024-09-21T07:35:53.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.480+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f17480be070 con 0x7f175c0af360 2024-09-21T07:35:53.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.484+0000 7f1752000640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 0x7f173c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:53.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.484+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7f174812d7a0 con 0x7f175c0af360 2024-09-21T07:35:53.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.484+0000 7f1759e00640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 0x7f173c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:53.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.484+0000 7f1759e00640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 0x7f173c075710 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f174c007f30 tx=0x7f174c007ec0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:53.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.488+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1748016410 con 0x7f175c0af360 2024-09-21T07:35:53.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:53.664+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f175c0cbb40 con 0x7f175c0af360 2024-09-21T07:35:54.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.488+0000 7f1752000640 1 -- 172.21.15.64:0/136880300 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) ==== 138+0+0 (secure 0 0 0) 0x7f17480f83b0 con 0x7f175c0af360 2024-09-21T07:35:54.493 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:35:54.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 msgr2=0x7f173c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:54.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 0x7f173c075710 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f174c007f30 tx=0x7f174c007ec0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 msgr2=0x7f175c1583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:54.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c10 tx=0x7f17480a55d0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 shutdown_connections 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f173c073200 0x7f173c075710 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f175c15b350 0x7f175c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f175c0af360 0x7f175c1583b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 --2- 172.21.15.64:0/136880300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f175c06ec70 0x7f175c145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 >> 172.21.15.64:0/136880300 conn(0x7f175c0d0170 msgr2=0x7f175c15c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 shutdown_connections 2024-09-21T07:35:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.492+0000 7f1761200640 1 -- 172.21.15.64:0/136880300 wait complete. 2024-09-21T07:35:54.520 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 -- 172.21.15.64:0/2029302500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd8073db0 msgr2=0x7f8fd81663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 --2- 172.21.15.64:0/2029302500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd8073db0 0x7f8fd81663a0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009c80 tx=0x7f8fd001cda0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 -- 172.21.15.64:0/2029302500 shutdown_connections 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 --2- 172.21.15.64:0/2029302500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd8073db0 0x7f8fd81663a0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 -- 172.21.15.64:0/2029302500 >> 172.21.15.64:0/2029302500 conn(0x7f8fd80d0c10 msgr2=0x7f8fd80d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:54.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 -- 172.21.15.64:0/2029302500 shutdown_connections 2024-09-21T07:35:54.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.688+0000 7f8fdda00640 1 -- 172.21.15.64:0/2029302500 wait complete. 2024-09-21T07:35:54.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 Processor -- start 2024-09-21T07:35:54.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- start start 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8fd80d0130 0x7f8fd8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd8154610 0x7f8fd81561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd816a170 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8169ff0 con 0x7f8fd8154610 2024-09-21T07:35:54.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd816a2f0 con 0x7f8fd80d0130 2024-09-21T07:35:54.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:54.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36452/0 (socket says 172.21.15.64:36452) 2024-09-21T07:35:54.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 -- 172.21.15.64:0/1787728111 learned_addr learned my addr 172.21.15.64:0/1787728111 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:54.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd7400640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd8154610 0x7f8fd81561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:54.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fcfe00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8fd80d0130 0x7f8fd8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 -- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8fd80d0130 msgr2=0x7f8fd8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8fd80d0130 0x7f8fd8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 -- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd8154610 msgr2=0x7f8fd81561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd8154610 0x7f8fd81561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 -- 172.21.15.64:0/1787728111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd80b05f0 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fd6a00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800b440 tx=0x7f8fc800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8015020 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fc8011920 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd80b08d0 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011d70 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.692+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd80b0e90 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.696+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd815fc30 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.696+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8fc8018020 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.696+0000 7f8fcea00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 0x7f8fb4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:54.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.696+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5619+0+0 (secure 0 0 0) 0x7f8fc80940a0 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.696+0000 7f8fcfe00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 0x7f8fb4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:54.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.700+0000 7f8fcfe00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 0x7f8fb4075710 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8155020 tx=0x7f8fc0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.700+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8fc801f030 con 0x7f8fd80cc1d0 2024-09-21T07:35:54.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:54.880+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8fd80b0320 con 0x7f8fd80cc1d0 2024-09-21T07:35:55.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.480+0000 7f8fcea00640 1 -- 172.21.15.64:0/1787728111 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) ==== 170+0+0 (secure 0 0 0) 0x7f8fc805ebc0 con 0x7f8fd80cc1d0 2024-09-21T07:35:55.484 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 msgr2=0x7f8fb4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 0x7f8fb4075710 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8155020 tx=0x7f8fc0009040 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 msgr2=0x7f8fd814fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800b440 tx=0x7f8fc800b900 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 shutdown_connections 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8fb4073200 0x7f8fb4075710 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd8154610 0x7f8fd81561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8fd80d0130 0x7f8fd8155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 --2- 172.21.15.64:0/1787728111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd80cc1d0 0x7f8fd814fec0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 >> 172.21.15.64:0/1787728111 conn(0x7f8fd80d0c10 msgr2=0x7f8fd815e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 shutdown_connections 2024-09-21T07:35:55.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.484+0000 7f8fdda00640 1 -- 172.21.15.64:0/1787728111 wait complete. 2024-09-21T07:35:55.529 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 -- 172.21.15.64:0/2439348165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee94074ca0 msgr2=0x7fee9406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 --2- 172.21.15.64:0/2439348165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee94074ca0 0x7fee9406cdf0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fee94072e60 tx=0x7fee7c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 -- 172.21.15.64:0/2439348165 shutdown_connections 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 --2- 172.21.15.64:0/2439348165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940750b0 0x7fee9406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 --2- 172.21.15.64:0/2439348165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee94074ca0 0x7fee9406cdf0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 --2- 172.21.15.64:0/2439348165 >> v2:172.21.15.90:3300/0 conn(0x7fee940b3820 0x7fee94162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 -- 172.21.15.64:0/2439348165 >> 172.21.15.64:0/2439348165 conn(0x7fee940cdd10 msgr2=0x7fee940ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:55.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.688+0000 7fee99200640 1 -- 172.21.15.64:0/2439348165 shutdown_connections 2024-09-21T07:35:55.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 -- 172.21.15.64:0/2439348165 wait complete. 2024-09-21T07:35:55.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 Processor -- start 2024-09-21T07:35:55.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 -- start start 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee94074ca0 0x7fee941577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940b3820 0x7fee941fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fee94070b70 con 0x7fee940750b0 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee940709f0 con 0x7fee94074ca0 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.692+0000 7fee99200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fee94070cf0 con 0x7fee940b3820 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53162/0 (socket says 172.21.15.64:53162) 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 -- 172.21.15.64:0/1394742172 learned_addr learned my addr 172.21.15.64:0/1394742172 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee91e00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee94074ca0 0x7fee941577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee92800640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940b3820 0x7fee941fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 -- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940b3820 msgr2=0x7fee941fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940b3820 0x7fee941fc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 -- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee94074ca0 msgr2=0x7fee941577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee94074ca0 0x7fee941577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 -- 172.21.15.64:0/1394742172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9415d090 con 0x7fee940750b0 2024-09-21T07:35:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8be00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fee7c01af70 tx=0x7fee7c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0b2040 con 0x7fee940750b0 2024-09-21T07:35:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee7c004330 con 0x7fee940750b0 2024-09-21T07:35:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee941601d0 con 0x7fee940750b0 2024-09-21T07:35:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c005290 con 0x7fee940750b0 2024-09-21T07:35:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee94160790 con 0x7fee940750b0 2024-09-21T07:35:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee94157d30 con 0x7fee940750b0 2024-09-21T07:35:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.696+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fee7c005430 con 0x7fee940750b0 2024-09-21T07:35:55.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.700+0000 7fee8a000640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 0x7fee70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:55.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.700+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6001+0+0 (secure 0 0 0) 0x7fee7c12dd60 con 0x7fee940750b0 2024-09-21T07:35:55.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.700+0000 7fee91e00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 0x7fee70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:55.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.700+0000 7fee91e00640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 0x7fee70075710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fee84005fd0 tx=0x7fee8400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:55.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.704+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fee94157d30 con 0x7fee940750b0 2024-09-21T07:35:55.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:55.916+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fee94071210 con 0x7fee940750b0 2024-09-21T07:35:56.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.500+0000 7fee8a000640 1 -- 172.21.15.64:0/1394742172 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v141) ==== 174+0+0 (secure 0 0 0) 0x7fee7c0bc060 con 0x7fee940750b0 2024-09-21T07:35:56.501 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 27 and data pool 28 2024-09-21T07:35:56.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.500+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 msgr2=0x7fee70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.500+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 0x7fee70075710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fee84005fd0 tx=0x7fee8400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.500+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 msgr2=0x7fee941fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.500+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fee7c01af70 tx=0x7fee7c005e70 comp rx=0 tx=0).stop 2024-09-21T07:35:56.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 shutdown_connections 2024-09-21T07:35:56.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee70073200 0x7fee70075710 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee940b3820 0x7fee941fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee940750b0 0x7fee941fc230 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 --2- 172.21.15.64:0/1394742172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee94074ca0 0x7fee941577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 >> 172.21.15.64:0/1394742172 conn(0x7fee940cdd10 msgr2=0x7fee941592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:56.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.504+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 shutdown_connections 2024-09-21T07:35:56.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.508+0000 7fee99200640 1 -- 172.21.15.64:0/1394742172 wait complete. 2024-09-21T07:35:56.554 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:56.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 -- 172.21.15.64:0/2821341097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 msgr2=0x7f5f8c00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 --2- 172.21.15.64:0/2821341097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5f8c00dbe0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8071150 tx=0x7f5fa001d5b0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 -- 172.21.15.64:0/2821341097 shutdown_connections 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 --2- 172.21.15.64:0/2821341097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5f8c00dbe0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 -- 172.21.15.64:0/2821341097 >> 172.21.15.64:0/2821341097 conn(0x7f5fa80ccbe0 msgr2=0x7f5fa80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 -- 172.21.15.64:0/2821341097 shutdown_connections 2024-09-21T07:35:56.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.712+0000 7f5fad000640 1 -- 172.21.15.64:0/2821341097 wait complete. 2024-09-21T07:35:56.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 Processor -- start 2024-09-21T07:35:56.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 -- start start 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fa8159580 0x7f5fa80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fa814e500 0x7f5fa81f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa80704f0 con 0x7f5f8c005360 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8070370 con 0x7f5fa814e500 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.716+0000 7f5fad000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa8072e20 con 0x7f5fa8159580 2024-09-21T07:35:56.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53178/0 (socket says 172.21.15.64:53178) 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 -- 172.21.15.64:0/2286469374 learned_addr learned my addr 172.21.15.64:0/2286469374 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa6800640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fa814e500 0x7f5fa81f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5400640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fa8159580 0x7f5fa80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 -- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fa8159580 msgr2=0x7f5fa80b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fa8159580 0x7f5fa80b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 -- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fa814e500 msgr2=0x7f5fa81f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fa814e500 0x7f5fa81f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 -- 172.21.15.64:0/2286469374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80ca090 con 0x7f5f8c005360 2024-09-21T07:35:56.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fa5e00640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f5f98006630 tx=0x7f5f980039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98015070 con 0x7f5f8c005360 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f98011840 con 0x7f5f8c005360 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa80ca370 con 0x7f5f8c005360 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98011c90 con 0x7f5f8c005360 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa80c64c0 con 0x7f5f8c005360 2024-09-21T07:35:56.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa8073380 con 0x7f5f8c005360 2024-09-21T07:35:56.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.720+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5f98018070 con 0x7f5f8c005360 2024-09-21T07:35:56.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.724+0000 7f5f9e000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 0x7f5f88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:56.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.724+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f5f98095170 con 0x7f5f8c005360 2024-09-21T07:35:56.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.724+0000 7f5fa5400640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 0x7f5f88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:56.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.724+0000 7f5fa5400640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 0x7f5f88075710 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000c10 tx=0x7f5f94006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:56.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.728+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5f9805fee0 con 0x7f5f8c005360 2024-09-21T07:35:56.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.904+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fa80ca540 con 0x7f5f8c005360 2024-09-21T07:35:56.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5f9e000640 1 -- 172.21.15.64:0/2286469374 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16977 (secure 0 0 0) 0x7f5f9805f7e0 con 0x7f5f8c005360 2024-09-21T07:35:56.909 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:56.909 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":190,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:55.922777+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:53.680211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:54.895055+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:56.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 msgr2=0x7f5f88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 0x7f5f88075710 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000c10 tx=0x7f5f94006b80 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 msgr2=0x7f5fa80c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f5f98006630 tx=0x7f5f980039d0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 shutdown_connections 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5f88073200 0x7f5f88075710 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fa814e500 0x7f5fa81f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fa8159580 0x7f5fa80b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 --2- 172.21.15.64:0/2286469374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f8c005360 0x7f5fa80c5f80 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 >> 172.21.15.64:0/2286469374 conn(0x7f5fa80ccbe0 msgr2=0x7f5fa809ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 shutdown_connections 2024-09-21T07:35:56.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:56.908+0000 7f5fad000640 1 -- 172.21.15.64:0/2286469374 wait complete. 2024-09-21T07:35:56.932 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:35:57.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 -- 172.21.15.64:0/2776949318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40cb6f0 msgr2=0x7fe0d40cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/2776949318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d40cbb00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009840 tx=0x7fe0bc01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 -- 172.21.15.64:0/2776949318 shutdown_connections 2024-09-21T07:35:57.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/2776949318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 0x7fe0d40cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/2776949318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d40cbb00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 -- 172.21.15.64:0/2776949318 >> 172.21.15.64:0/2776949318 conn(0x7fe0d40d10a0 msgr2=0x7fe0d40d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:57.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 -- 172.21.15.64:0/2776949318 shutdown_connections 2024-09-21T07:35:57.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.088+0000 7fe0d8a00640 1 -- 172.21.15.64:0/2776949318 wait complete. 2024-09-21T07:35:57.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 Processor -- start 2024-09-21T07:35:57.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 -- start start 2024-09-21T07:35:57.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40746e0 0x7fe0d40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 0x7fe0d41fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d416a130 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4169fb0 con 0x7fe0d40746e0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d8a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d416a2b0 con 0x7fe0d40cefa0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53190/0 (socket says 172.21.15.64:53190) 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0cbe00640 1 -- 172.21.15.64:0/122369276 learned_addr learned my addr 172.21.15.64:0/122369276 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d3e00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 0x7fe0d41fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.092+0000 7fe0d3400640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40746e0 0x7fe0d40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 -- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 msgr2=0x7fe0d41fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 0x7fe0d41fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 -- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40746e0 msgr2=0x7fe0d40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40746e0 0x7fe0d40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 -- 172.21.15.64:0/122369276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d40c4550 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cbe00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009790 tx=0x7fe0bc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0b2040 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0bc0043e0 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d40b2ee0 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0052d0 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d40b34a0 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d40cbb00 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.096+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0bc005470 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.100+0000 7fe0cb400640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 0x7fe0b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.100+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7fe0bc12de20 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.100+0000 7fe0d3400640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 0x7fe0b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.100+0000 7fe0d3400640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 0x7fe0b0075710 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4001400 tx=0x7fe0c4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:57.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.104+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe0bc0bc060 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.280+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0d40b7020 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0cb400640 1 -- 172.21.15.64:0/122369276 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16977 (secure 0 0 0) 0x7fe0d40c4550 con 0x7fe0d40cb6f0 2024-09-21T07:35:57.285 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:57.285 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":190,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:55.922777+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:53.680211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:54.895055+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:35:57.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 msgr2=0x7fe0b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 0x7fe0b0075710 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4001400 tx=0x7fe0c4009040 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 msgr2=0x7fe0d41fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009790 tx=0x7fe0bc005db0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 shutdown_connections 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0b0073200 0x7fe0b0075710 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe0d40cefa0 0x7fe0d41fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0d40cb6f0 0x7fe0d41fc7d0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 --2- 172.21.15.64:0/122369276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0d40746e0 0x7fe0d40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 >> 172.21.15.64:0/122369276 conn(0x7fe0d40d10a0 msgr2=0x7fe0d40b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 shutdown_connections 2024-09-21T07:35:57.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.284+0000 7fe0d8a00640 1 -- 172.21.15.64:0/122369276 wait complete. 2024-09-21T07:35:57.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:35:57.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- 172.21.15.64:0/2888633853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c1602f0 msgr2=0x7f5a7c06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 --2- 172.21.15.64:0/2888633853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c1602f0 0x7f5a7c06f890 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009bc0 tx=0x7f5a7401cba0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- 172.21.15.64:0/2888633853 shutdown_connections 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 --2- 172.21.15.64:0/2888633853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c1602f0 0x7f5a7c06f890 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 --2- 172.21.15.64:0/2888633853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c15f9a0 0x7f5a7c15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- 172.21.15.64:0/2888633853 >> 172.21.15.64:0/2888633853 conn(0x7f5a7c06d450 msgr2=0x7f5a7c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- 172.21.15.64:0/2888633853 shutdown_connections 2024-09-21T07:35:57.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- 172.21.15.64:0/2888633853 wait complete. 2024-09-21T07:35:57.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 Processor -- start 2024-09-21T07:35:57.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.468+0000 7f5a81c00640 1 -- start start 2024-09-21T07:35:57.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a7c09df30 0x7f5a7c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c1602f0 0x7f5a7c072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c168df0 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c168c70 con 0x7f5a7c09df30 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c168f70 con 0x7f5a7c1602f0 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53218/0 (socket says 172.21.15.64:53218) 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 -- 172.21.15.64:0/1954871543 learned_addr learned my addr 172.21.15.64:0/1954871543 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a7aa00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a7c09df30 0x7f5a7c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a7b400640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c1602f0 0x7f5a7c072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 -- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c1602f0 msgr2=0x7f5a7c072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c1602f0 0x7f5a7c072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 -- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a7c09df30 msgr2=0x7f5a7c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:57.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a7c09df30 0x7f5a7c15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:57.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 -- 172.21.15.64:0/1954871543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0c9ba0 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a73e00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400d750 tx=0x7f5a6400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64017070 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a64004310 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400de60 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c0c98c0 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1fd190 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.472+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c1fccd0 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.476+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a64009c30 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.476+0000 7f5a72a00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 0x7f5a58075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:57.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.476+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f5a64094480 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.476+0000 7f5a7aa00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 0x7f5a58075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:57.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.476+0000 7f5a7aa00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 0x7f5a58075740 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007fd0 tx=0x7f5a6c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:57.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.480+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5a7c1fccd0 con 0x7f5a7c15f9a0 2024-09-21T07:35:57.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:57.696+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5a7c15fdb0 con 0x7f5a7c15f9a0 2024-09-21T07:35:58.481 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:35:58.480+0000 7f1a06400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:35:58.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.520+0000 7f5a72a00640 1 -- 172.21.15.64:0/1954871543 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v143) ==== 118+0+0 (secure 0 0 0) 0x7f5a6405ec20 con 0x7f5a7c15f9a0 2024-09-21T07:35:58.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 msgr2=0x7f5a58075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:58.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 0x7f5a58075740 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007fd0 tx=0x7f5a6c009040 comp rx=0 tx=0).stop 2024-09-21T07:35:58.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 msgr2=0x7f5a7c073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:58.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400d750 tx=0x7f5a6400dc10 comp rx=0 tx=0).stop 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 shutdown_connections 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5a58073230 0x7f5a58075740 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5a7c1602f0 0x7f5a7c072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7c15f9a0 0x7f5a7c073cc0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 --2- 172.21.15.64:0/1954871543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a7c09df30 0x7f5a7c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 >> 172.21.15.64:0/1954871543 conn(0x7f5a7c06d450 msgr2=0x7f5a7c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 shutdown_connections 2024-09-21T07:35:58.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.524+0000 7f5a81c00640 1 -- 172.21.15.64:0/1954871543 wait complete. 2024-09-21T07:35:58.551 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:35:58.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:35:58.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- 172.21.15.64:0/1221441828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 msgr2=0x7fe4740ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:58.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 --2- 172.21.15.64:0/1221441828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe4740ce900 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009bc0 tx=0x7fe46c01cba0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- 172.21.15.64:0/1221441828 shutdown_connections 2024-09-21T07:35:58.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 --2- 172.21.15.64:0/1221441828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe4740ce900 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- 172.21.15.64:0/1221441828 >> 172.21.15.64:0/1221441828 conn(0x7fe47406d450 msgr2=0x7fe4740d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:58.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- 172.21.15.64:0/1221441828 shutdown_connections 2024-09-21T07:35:58.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- 172.21.15.64:0/1221441828 wait complete. 2024-09-21T07:35:58.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 Processor -- start 2024-09-21T07:35:58.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.716+0000 7fe47ac00640 1 -- start start 2024-09-21T07:35:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 0x7fe4740c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe474154060 0x7fe4740ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:58.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe47416b2a0 con 0x7fe4740d0df0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe47416b120 con 0x7fe4740b4de0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe47416b420 con 0x7fe474154060 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53228/0 (socket says 172.21.15.64:53228) 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 -- 172.21.15.64:0/928522842 learned_addr learned my addr 172.21.15.64:0/928522842 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe478c00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe474154060 0x7fe4740ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe473e00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 0x7fe4740c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 -- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe474154060 msgr2=0x7fe4740ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe474154060 0x7fe4740ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 -- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 msgr2=0x7fe4740c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 0x7fe4740c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 -- 172.21.15.64:0/928522842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4740b2570 con 0x7fe4740d0df0 2024-09-21T07:35:58.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe473e00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 0x7fe4740c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:35:58.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe46be00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c3c0 tx=0x7fe45c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:58.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c017070 con 0x7fe4740d0df0 2024-09-21T07:35:58.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe45c0053c0 con 0x7fe4740d0df0 2024-09-21T07:35:58.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4740c82d0 con 0x7fe4740d0df0 2024-09-21T07:35:58.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c003860 con 0x7fe4740d0df0 2024-09-21T07:35:58.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4740c8890 con 0x7fe4740d0df0 2024-09-21T07:35:58.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.720+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4740ccce0 con 0x7fe4740d0df0 2024-09-21T07:35:58.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.724+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe45c01a070 con 0x7fe4740d0df0 2024-09-21T07:35:58.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.724+0000 7fe470c00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 0x7fe450075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:58.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.724+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fe45c093740 con 0x7fe4740d0df0 2024-09-21T07:35:58.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.724+0000 7fe473e00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 0x7fe450075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:58.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.724+0000 7fe473e00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 0x7fe450075740 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe464007fd0 tx=0x7fe464009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:58.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.728+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe45c05dee0 con 0x7fe4740d0df0 2024-09-21T07:35:58.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:58.944+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe4740cfc60 con 0x7fe4740d0df0 2024-09-21T07:35:59.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.528+0000 7fe470c00640 1 -- 172.21.15.64:0/928522842 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v144) ==== 122+0+0 (secure 0 0 0) 0x7fe45c062910 con 0x7fe4740d0df0 2024-09-21T07:35:59.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.528+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 msgr2=0x7fe450075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.528+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 0x7fe450075740 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe464007fd0 tx=0x7fe464009040 comp rx=0 tx=0).stop 2024-09-21T07:35:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.528+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 msgr2=0x7fe474153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.528+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c3c0 tx=0x7fe45c00c880 comp rx=0 tx=0).stop 2024-09-21T07:35:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 shutdown_connections 2024-09-21T07:35:59.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe450073230 0x7fe450075740 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe474154060 0x7fe4740ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4740d0df0 0x7fe474153b20 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 --2- 172.21.15.64:0/928522842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4740b4de0 0x7fe4740c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 >> 172.21.15.64:0/928522842 conn(0x7fe47406d450 msgr2=0x7fe474072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 shutdown_connections 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.532+0000 7fe47ac00640 1 -- 172.21.15.64:0/928522842 wait complete. 2024-09-21T07:35:59.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:35:59.556 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:35:59.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- 172.21.15.64:0/2752995802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035415b810 msgr2=0x7f03540ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 --2- 172.21.15.64:0/2752995802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035415b810 0x7f03540ce5b0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f0354072af0 tx=0x7f034401c890 comp rx=0 tx=0).stop 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- 172.21.15.64:0/2752995802 shutdown_connections 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 --2- 172.21.15.64:0/2752995802 >> v2:172.21.15.90:3300/0 conn(0x7f035406d020 0x7f035406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 --2- 172.21.15.64:0/2752995802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035415b810 0x7f03540ce5b0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- 172.21.15.64:0/2752995802 >> 172.21.15.64:0/2752995802 conn(0x7f03540d0de0 msgr2=0x7f03540d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- 172.21.15.64:0/2752995802 shutdown_connections 2024-09-21T07:35:59.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- 172.21.15.64:0/2752995802 wait complete. 2024-09-21T07:35:59.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 Processor -- start 2024-09-21T07:35:59.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.716+0000 7f035a600640 1 -- start start 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035406d020 0x7f03540c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035415b810 0x7f03540b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0354169050 con 0x7f03540cc070 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0354168ed0 con 0x7f035406d020 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f03541691d0 con 0x7f035415b810 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53254/0 (socket says 172.21.15.64:53254) 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 -- 172.21.15.64:0/1417608408 learned_addr learned my addr 172.21.15.64:0/1417608408 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:35:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f0353400640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035406d020 0x7f03540c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f0353e00640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035415b810 0x7f03540b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 -- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035415b810 msgr2=0x7f03540b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035415b810 0x7f03540b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 -- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035406d020 msgr2=0x7f03540c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035406d020 0x7f03540c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 -- 172.21.15.64:0/1417608408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03540ada10 con 0x7f03540cc070 2024-09-21T07:35:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034be00640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f033c00d720 tx=0x7f033c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c017070 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f033c009d20 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03540adcf0 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c005280 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03540ae2b0 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.720+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035406d430 con 0x7f03540cc070 2024-09-21T07:35:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.724+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f033c005420 con 0x7f03540cc070 2024-09-21T07:35:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.724+0000 7f034b400640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 0x7f0330075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:35:59.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.724+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f033c0943f0 con 0x7f03540cc070 2024-09-21T07:35:59.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.724+0000 7f0353400640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 0x7f0330075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:35:59.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.724+0000 7f0353400640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 0x7f0330075710 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f03440af000 tx=0x7f034401b0d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:35:59.731 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.728+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f033c05ec20 con 0x7f03540cc070 2024-09-21T07:35:59.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.940+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03540b4ec0 con 0x7f03540cc070 2024-09-21T07:35:59.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f034b400640 1 -- 172.21.15.64:0/1417608408 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f033c063650 con 0x7f03540cc070 2024-09-21T07:35:59.945 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:35:59.945 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:35:59.945 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 msgr2=0x7f0330075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 0x7f0330075710 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f03440af000 tx=0x7f034401b0d0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 msgr2=0x7f03540af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f033c00d720 tx=0x7f033c00dbe0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 shutdown_connections 2024-09-21T07:35:59.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0330073200 0x7f0330075710 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f035415b810 0x7f03540b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03540cc070 0x7f03540af4f0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 --2- 172.21.15.64:0/1417608408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035406d020 0x7f03540c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 >> 172.21.15.64:0/1417608408 conn(0x7f03540d0de0 msgr2=0x7f035406f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 shutdown_connections 2024-09-21T07:35:59.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:35:59.944+0000 7f035a600640 1 -- 172.21.15.64:0/1417608408 wait complete. 2024-09-21T07:35:59.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 -- 172.21.15.64:0/1124902374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 msgr2=0x7f35e4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 --2- 172.21.15.64:0/1124902374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e4070310 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009c80 tx=0x7f35dc01cd30 comp rx=0 tx=0).stop 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 -- 172.21.15.64:0/1124902374 shutdown_connections 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 --2- 172.21.15.64:0/1124902374 >> v2:172.21.15.90:3300/0 conn(0x7f35e4070850 0x7f35e40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 --2- 172.21.15.64:0/1124902374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e4070310 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 -- 172.21.15.64:0/1124902374 >> 172.21.15.64:0/1124902374 conn(0x7f35e40ccbe0 msgr2=0x7f35e40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 -- 172.21.15.64:0/1124902374 shutdown_connections 2024-09-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.124+0000 7f35eb600640 1 -- 172.21.15.64:0/1124902374 wait complete. 2024-09-21T07:36:00.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 Processor -- start 2024-09-21T07:36:00.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 -- start start 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35e4070850 0x7f35e41531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35e40b2120 0x7f35e41f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40b4120 con 0x7f35e415cbd0 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40b3fa0 con 0x7f35e40b2120 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35eb600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f35e40b42a0 con 0x7f35e4070850 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53264/0 (socket says 172.21.15.64:53264) 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 -- 172.21.15.64:0/2599734769 learned_addr learned my addr 172.21.15.64:0/2599734769 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e3e00640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35e40b2120 0x7f35e41f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e8c00640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35e4070850 0x7f35e41531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 -- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35e4070850 msgr2=0x7f35e41531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35e4070850 0x7f35e41531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 -- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35e40b2120 msgr2=0x7f35e41f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35e40b2120 0x7f35e41f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.128+0000 7f35e9600640 1 -- 172.21.15.64:0/2599734769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e40cfd00 con 0x7f35e415cbd0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e9600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c390 tx=0x7f35d400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4005220 con 0x7f35e415cbd0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d40054b0 con 0x7f35e415cbd0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e41fd590 con 0x7f35e415cbd0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4006a40 con 0x7f35e415cbd0 2024-09-21T07:36:00.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e40cfa20 con 0x7f35e415cbd0 2024-09-21T07:36:00.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e40b1be0 con 0x7f35e415cbd0 2024-09-21T07:36:00.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f35d4019020 con 0x7f35e415cbd0 2024-09-21T07:36:00.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 0x7f35c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.132+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f35d4093940 con 0x7f35e415cbd0 2024-09-21T07:36:00.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.136+0000 7f35e8c00640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 0x7f35c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.136+0000 7f35e8c00640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 0x7f35c4075710 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af000 tx=0x7f35dc01b570 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.136+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f35d4020020 con 0x7f35e415cbd0 2024-09-21T07:36:00.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.316+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35e40b4d20 con 0x7f35e415cbd0 2024-09-21T07:36:00.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.316+0000 7f35e0c00640 1 -- 172.21.15.64:0/2599734769 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16964 (secure 0 0 0) 0x7f35e40b2530 con 0x7f35e415cbd0 2024-09-21T07:36:00.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:00.320 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":191,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:35:57.512179+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:53.680211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:54.895055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 msgr2=0x7f35c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 0x7f35c4075710 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af000 tx=0x7f35dc01b570 comp rx=0 tx=0).stop 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 msgr2=0x7f35e41f9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c390 tx=0x7f35d400c790 comp rx=0 tx=0).stop 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 shutdown_connections 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f35c4073200 0x7f35c4075710 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35e415cbd0 0x7f35e41f9c70 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35e40b2120 0x7f35e41f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 --2- 172.21.15.64:0/2599734769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35e4070850 0x7f35e41531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 >> 172.21.15.64:0/2599734769 conn(0x7f35e40ccbe0 msgr2=0x7f35e40b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:00.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 shutdown_connections 2024-09-21T07:36:00.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.320+0000 7f35eb600640 1 -- 172.21.15.64:0/2599734769 wait complete. 2024-09-21T07:36:00.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:36:00.343 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:36:00.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- 172.21.15.64:0/3853585179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b80b48d0 msgr2=0x7f84b8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 --2- 172.21.15.64:0/3853585179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b80b48d0 0x7f84b8072e20 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009bc0 tx=0x7f84b001cba0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- 172.21.15.64:0/3853585179 shutdown_connections 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 --2- 172.21.15.64:0/3853585179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b80b48d0 0x7f84b8072e20 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- 172.21.15.64:0/3853585179 >> 172.21.15.64:0/3853585179 conn(0x7f84b80ccbe0 msgr2=0x7f84b80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- 172.21.15.64:0/3853585179 shutdown_connections 2024-09-21T07:36:00.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- 172.21.15.64:0/3853585179 wait complete. 2024-09-21T07:36:00.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 Processor -- start 2024-09-21T07:36:00.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.500+0000 7f84bfc00640 1 -- start start 2024-09-21T07:36:00.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84b80709b0 0x7f84b81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84b815edb0 0x7f84b81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84b816a470 con 0x7f84b809b670 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84b816a2f0 con 0x7f84b815edb0 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f84b816a5f0 con 0x7f84b80709b0 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53288/0 (socket says 172.21.15.64:53288) 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 -- 172.21.15.64:0/1014989360 learned_addr learned my addr 172.21.15.64:0/1014989360 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84afe00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84b815edb0 0x7f84b81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bd200640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84b80709b0 0x7f84b81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 -- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84b80709b0 msgr2=0x7f84b81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84b80709b0 0x7f84b81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 -- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84b815edb0 msgr2=0x7f84b81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84b815edb0 0x7f84b81505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 -- 172.21.15.64:0/1014989360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b8157aa0 con 0x7f84b809b670 2024-09-21T07:36:00.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bdc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f84b00197b0 tx=0x7f84b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00bb070 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84b0004d40 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b8156610 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b2040 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b809ab90 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.504+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b8157d10 con 0x7f84b809b670 2024-09-21T07:36:00.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.508+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f84b00a5d10 con 0x7f84b809b670 2024-09-21T07:36:00.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.508+0000 7f84b5600640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 0x7f8494075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.508+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f84b012e110 con 0x7f84b809b670 2024-09-21T07:36:00.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.508+0000 7f84bd200640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 0x7f8494075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.508+0000 7f84bd200640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 0x7f8494075710 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000f70 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.512+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f84b0016790 con 0x7f84b809b670 2024-09-21T07:36:00.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.684+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84b8072e20 con 0x7f8494073200 2024-09-21T07:36:00.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.692+0000 7f84b5600640 1 -- 172.21.15.64:0/1014989360 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252054 (secure 0 0 0) 0x7f84b8072e20 con 0x7f8494073200 2024-09-21T07:36:00.696 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:00.697 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:36:00.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 msgr2=0x7f8494075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 0x7f8494075710 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000f70 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2024-09-21T07:36:00.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 msgr2=0x7f84b80c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f84b00197b0 tx=0x7f84b0009260 comp rx=0 tx=0).stop 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 shutdown_connections 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8494073200 0x7f8494075710 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84b809b670 0x7f84b80c8720 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84b815edb0 0x7f84b81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 --2- 172.21.15.64:0/1014989360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84b80709b0 0x7f84b81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 >> 172.21.15.64:0/1014989360 conn(0x7f84b80ccbe0 msgr2=0x7f84b80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 shutdown_connections 2024-09-21T07:36:00.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.696+0000 7f84bfc00640 1 -- 172.21.15.64:0/1014989360 wait complete. 2024-09-21T07:36:00.717 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-21T07:35:59.638747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":499724,"kb_used_data":19856,"kb_used_omap":12,"kb_used_meta":479667,"kb_avail":754474996,"statfs":{"total":773094113280,"available":772582395904,"internally_reserved":0,"allocated":20332544,"data_stored":10207991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":491179571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.152141"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535189+0000","last_change":"2024-09-21T07:35:56.532076+0000","last_active":"2024-09-21T07:35:56.535189+0000","last_peered":"2024-09-21T07:35:56.535189+0000","last_clean":"2024-09-21T07:35:56.535189+0000","last_became_active":"2024-09-21T07:35:56.531712+0000","last_became_peered":"2024-09-21T07:35:56.531712+0000","last_unstale":"2024-09-21T07:35:56.535189+0000","last_undegraded":"2024-09-21T07:35:56.535189+0000","last_fullsized":"2024-09-21T07:35:56.535189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:08.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499718+0000","last_change":"2024-09-21T07:35:55.499718+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499718+0000","last_undegraded":"2024-09-21T07:35:55.499718+0000","last_fullsized":"2024-09-21T07:35:55.499718+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541694+0000","last_change":"2024-09-21T07:35:56.539434+0000","last_active":"2024-09-21T07:35:56.541694+0000","last_peered":"2024-09-21T07:35:56.541694+0000","last_clean":"2024-09-21T07:35:56.541694+0000","last_became_active":"2024-09-21T07:35:56.538261+0000","last_became_peered":"2024-09-21T07:35:56.538261+0000","last_unstale":"2024-09-21T07:35:56.541694+0000","last_undegraded":"2024-09-21T07:35:56.541694+0000","last_fullsized":"2024-09-21T07:35:56.541694+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:06.743615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549725+0000","last_change":"2024-09-21T07:35:56.541396+0000","last_active":"2024-09-21T07:35:56.549725+0000","last_peered":"2024-09-21T07:35:56.549725+0000","last_clean":"2024-09-21T07:35:56.549725+0000","last_became_active":"2024-09-21T07:35:56.540086+0000","last_became_peered":"2024-09-21T07:35:56.540086+0000","last_unstale":"2024-09-21T07:35:56.549725+0000","last_undegraded":"2024-09-21T07:35:56.549725+0000","last_fullsized":"2024-09-21T07:35:56.549725+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:11.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518252+0000","last_change":"2024-09-21T07:35:56.546056+0000","last_active":"2024-09-21T07:35:57.518252+0000","last_peered":"2024-09-21T07:35:57.518252+0000","last_clean":"2024-09-21T07:35:57.518252+0000","last_became_active":"2024-09-21T07:35:56.545732+0000","last_became_peered":"2024-09-21T07:35:56.545732+0000","last_unstale":"2024-09-21T07:35:57.518252+0000","last_undegraded":"2024-09-21T07:35:57.518252+0000","last_fullsized":"2024-09-21T07:35:57.518252+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:21.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541633+0000","last_change":"2024-09-21T07:35:56.537816+0000","last_active":"2024-09-21T07:35:56.541633+0000","last_peered":"2024-09-21T07:35:56.541633+0000","last_clean":"2024-09-21T07:35:56.541633+0000","last_became_active":"2024-09-21T07:35:56.536912+0000","last_became_peered":"2024-09-21T07:35:56.536912+0000","last_unstale":"2024-09-21T07:35:56.541633+0000","last_undegraded":"2024-09-21T07:35:56.541633+0000","last_fullsized":"2024-09-21T07:35:56.541633+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:00.409316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517848+0000","last_change":"2024-09-21T07:35:56.547623+0000","last_active":"2024-09-21T07:35:57.517848+0000","last_peered":"2024-09-21T07:35:57.517848+0000","last_clean":"2024-09-21T07:35:57.517848+0000","last_became_active":"2024-09-21T07:35:56.547341+0000","last_became_peered":"2024-09-21T07:35:56.547341+0000","last_unstale":"2024-09-21T07:35:57.517848+0000","last_undegraded":"2024-09-21T07:35:57.517848+0000","last_fullsized":"2024-09-21T07:35:57.517848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529072+0000","last_change":"2024-09-21T07:35:56.523945+0000","last_active":"2024-09-21T07:35:56.529072+0000","last_peered":"2024-09-21T07:35:56.529072+0000","last_clean":"2024-09-21T07:35:56.529072+0000","last_became_active":"2024-09-21T07:35:56.523614+0000","last_became_peered":"2024-09-21T07:35:56.523614+0000","last_unstale":"2024-09-21T07:35:56.529072+0000","last_undegraded":"2024-09-21T07:35:56.529072+0000","last_fullsized":"2024-09-21T07:35:56.529072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:46.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517191+0000","last_change":"2024-09-21T07:35:56.530699+0000","last_active":"2024-09-21T07:35:57.517191+0000","last_peered":"2024-09-21T07:35:57.517191+0000","last_clean":"2024-09-21T07:35:57.517191+0000","last_became_active":"2024-09-21T07:35:56.530406+0000","last_became_peered":"2024-09-21T07:35:56.530406+0000","last_unstale":"2024-09-21T07:35:57.517191+0000","last_undegraded":"2024-09-21T07:35:57.517191+0000","last_fullsized":"2024-09-21T07:35:57.517191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:30.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541230+0000","last_change":"2024-09-21T07:35:56.534740+0000","last_active":"2024-09-21T07:35:56.541230+0000","last_peered":"2024-09-21T07:35:56.541230+0000","last_clean":"2024-09-21T07:35:56.541230+0000","last_became_active":"2024-09-21T07:35:56.534420+0000","last_became_peered":"2024-09-21T07:35:56.534420+0000","last_unstale":"2024-09-21T07:35:56.541230+0000","last_undegraded":"2024-09-21T07:35:56.541230+0000","last_fullsized":"2024-09-21T07:35:56.541230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:22.523823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537965+0000","last_change":"2024-09-21T07:35:56.534031+0000","last_active":"2024-09-21T07:35:56.537965+0000","last_peered":"2024-09-21T07:35:56.537965+0000","last_clean":"2024-09-21T07:35:56.537965+0000","last_became_active":"2024-09-21T07:35:56.533080+0000","last_became_peered":"2024-09-21T07:35:56.533080+0000","last_unstale":"2024-09-21T07:35:56.537965+0000","last_undegraded":"2024-09-21T07:35:56.537965+0000","last_fullsized":"2024-09-21T07:35:56.537965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:17.039270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518497+0000","last_change":"2024-09-21T07:35:56.542875+0000","last_active":"2024-09-21T07:35:57.518497+0000","last_peered":"2024-09-21T07:35:57.518497+0000","last_clean":"2024-09-21T07:35:57.518497+0000","last_became_active":"2024-09-21T07:35:56.541115+0000","last_became_peered":"2024-09-21T07:35:56.541115+0000","last_unstale":"2024-09-21T07:35:57.518497+0000","last_undegraded":"2024-09-21T07:35:57.518497+0000","last_fullsized":"2024-09-21T07:35:57.518497+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:17.995132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553046+0000","last_change":"2024-09-21T07:35:56.546633+0000","last_active":"2024-09-21T07:35:56.553046+0000","last_peered":"2024-09-21T07:35:56.553046+0000","last_clean":"2024-09-21T07:35:56.553046+0000","last_became_active":"2024-09-21T07:35:56.546330+0000","last_became_peered":"2024-09-21T07:35:56.546330+0000","last_unstale":"2024-09-21T07:35:56.553046+0000","last_undegraded":"2024-09-21T07:35:56.553046+0000","last_fullsized":"2024-09-21T07:35:56.553046+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.103527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527661+0000","last_change":"2024-09-21T07:35:56.522008+0000","last_active":"2024-09-21T07:35:56.527661+0000","last_peered":"2024-09-21T07:35:56.527661+0000","last_clean":"2024-09-21T07:35:56.527661+0000","last_became_active":"2024-09-21T07:35:56.521403+0000","last_became_peered":"2024-09-21T07:35:56.521403+0000","last_unstale":"2024-09-21T07:35:56.527661+0000","last_undegraded":"2024-09-21T07:35:56.527661+0000","last_fullsized":"2024-09-21T07:35:56.527661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:43.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517004+0000","last_change":"2024-09-21T07:35:56.515225+0000","last_active":"2024-09-21T07:35:57.517004+0000","last_peered":"2024-09-21T07:35:57.517004+0000","last_clean":"2024-09-21T07:35:57.517004+0000","last_became_active":"2024-09-21T07:35:56.513973+0000","last_became_peered":"2024-09-21T07:35:56.513973+0000","last_unstale":"2024-09-21T07:35:57.517004+0000","last_undegraded":"2024-09-21T07:35:57.517004+0000","last_fullsized":"2024-09-21T07:35:57.517004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:22.147149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536045+0000","last_change":"2024-09-21T07:35:56.530415+0000","last_active":"2024-09-21T07:35:56.536045+0000","last_peered":"2024-09-21T07:35:56.536045+0000","last_clean":"2024-09-21T07:35:56.536045+0000","last_became_active":"2024-09-21T07:35:56.530079+0000","last_became_peered":"2024-09-21T07:35:56.530079+0000","last_unstale":"2024-09-21T07:35:56.536045+0000","last_undegraded":"2024-09-21T07:35:56.536045+0000","last_fullsized":"2024-09-21T07:35:56.536045+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:05.322121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517424+0000","last_change":"2024-09-21T07:35:56.546948+0000","last_active":"2024-09-21T07:35:57.517424+0000","last_peered":"2024-09-21T07:35:57.517424+0000","last_clean":"2024-09-21T07:35:57.517424+0000","last_became_active":"2024-09-21T07:35:56.546426+0000","last_became_peered":"2024-09-21T07:35:56.546426+0000","last_unstale":"2024-09-21T07:35:57.517424+0000","last_undegraded":"2024-09-21T07:35:57.517424+0000","last_fullsized":"2024-09-21T07:35:57.517424+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:00.228007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517159+0000","last_change":"2024-09-21T07:35:56.546840+0000","last_active":"2024-09-21T07:35:57.517159+0000","last_peered":"2024-09-21T07:35:57.517159+0000","last_clean":"2024-09-21T07:35:57.517159+0000","last_became_active":"2024-09-21T07:35:56.546528+0000","last_became_peered":"2024-09-21T07:35:56.546528+0000","last_unstale":"2024-09-21T07:35:57.517159+0000","last_undegraded":"2024-09-21T07:35:57.517159+0000","last_fullsized":"2024-09-21T07:35:57.517159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:42.508204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549823+0000","last_change":"2024-09-21T07:35:56.545732+0000","last_active":"2024-09-21T07:35:56.549823+0000","last_peered":"2024-09-21T07:35:56.549823+0000","last_clean":"2024-09-21T07:35:56.549823+0000","last_became_active":"2024-09-21T07:35:56.545386+0000","last_became_peered":"2024-09-21T07:35:56.545386+0000","last_unstale":"2024-09-21T07:35:56.549823+0000","last_undegraded":"2024-09-21T07:35:56.549823+0000","last_fullsized":"2024-09-21T07:35:56.549823+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:04.460865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529944+0000","last_change":"2024-09-21T07:35:56.516896+0000","last_active":"2024-09-21T07:35:56.529944+0000","last_peered":"2024-09-21T07:35:56.529944+0000","last_clean":"2024-09-21T07:35:56.529944+0000","last_became_active":"2024-09-21T07:35:56.516577+0000","last_became_peered":"2024-09-21T07:35:56.516577+0000","last_unstale":"2024-09-21T07:35:56.529944+0000","last_undegraded":"2024-09-21T07:35:56.529944+0000","last_fullsized":"2024-09-21T07:35:56.529944+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:29.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544185+0000","last_change":"2024-09-21T07:35:56.538492+0000","last_active":"2024-09-21T07:35:56.544185+0000","last_peered":"2024-09-21T07:35:56.544185+0000","last_clean":"2024-09-21T07:35:56.544185+0000","last_became_active":"2024-09-21T07:35:56.537941+0000","last_became_peered":"2024-09-21T07:35:56.537941+0000","last_unstale":"2024-09-21T07:35:56.544185+0000","last_undegraded":"2024-09-21T07:35:56.544185+0000","last_fullsized":"2024-09-21T07:35:56.544185+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.199413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527631+0000","last_change":"2024-09-21T07:35:56.521689+0000","last_active":"2024-09-21T07:35:56.527631+0000","last_peered":"2024-09-21T07:35:56.527631+0000","last_clean":"2024-09-21T07:35:56.527631+0000","last_became_active":"2024-09-21T07:35:56.521019+0000","last_became_peered":"2024-09-21T07:35:56.521019+0000","last_unstale":"2024-09-21T07:35:56.527631+0000","last_undegraded":"2024-09-21T07:35:56.527631+0000","last_fullsized":"2024-09-21T07:35:56.527631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.590257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499044+0000","last_change":"2024-09-21T07:35:55.499044+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499044+0000","last_undegraded":"2024-09-21T07:35:55.499044+0000","last_fullsized":"2024-09-21T07:35:55.499044+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517795+0000","last_change":"2024-09-21T07:35:56.537610+0000","last_active":"2024-09-21T07:35:57.517795+0000","last_peered":"2024-09-21T07:35:57.517795+0000","last_clean":"2024-09-21T07:35:57.517795+0000","last_became_active":"2024-09-21T07:35:56.537302+0000","last_became_peered":"2024-09-21T07:35:56.537302+0000","last_unstale":"2024-09-21T07:35:57.517795+0000","last_undegraded":"2024-09-21T07:35:57.517795+0000","last_fullsized":"2024-09-21T07:35:57.517795+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:23.891119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517828+0000","last_change":"2024-09-21T07:35:56.530013+0000","last_active":"2024-09-21T07:35:57.517828+0000","last_peered":"2024-09-21T07:35:57.517828+0000","last_clean":"2024-09-21T07:35:57.517828+0000","last_became_active":"2024-09-21T07:35:56.529553+0000","last_became_peered":"2024-09-21T07:35:56.529553+0000","last_unstale":"2024-09-21T07:35:57.517828+0000","last_undegraded":"2024-09-21T07:35:57.517828+0000","last_fullsized":"2024-09-21T07:35:57.517828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:36.273322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.538335+0000","last_change":"2024-09-21T07:35:56.535980+0000","last_active":"2024-09-21T07:35:56.538335+0000","last_peered":"2024-09-21T07:35:56.538335+0000","last_clean":"2024-09-21T07:35:56.538335+0000","last_became_active":"2024-09-21T07:35:56.532666+0000","last_became_peered":"2024-09-21T07:35:56.532666+0000","last_unstale":"2024-09-21T07:35:56.538335+0000","last_undegraded":"2024-09-21T07:35:56.538335+0000","last_fullsized":"2024-09-21T07:35:56.538335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:17.343454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537998+0000","last_change":"2024-09-21T07:35:56.535093+0000","last_active":"2024-09-21T07:35:56.537998+0000","last_peered":"2024-09-21T07:35:56.537998+0000","last_clean":"2024-09-21T07:35:56.537998+0000","last_became_active":"2024-09-21T07:35:56.532682+0000","last_became_peered":"2024-09-21T07:35:56.532682+0000","last_unstale":"2024-09-21T07:35:56.537998+0000","last_undegraded":"2024-09-21T07:35:56.537998+0000","last_fullsized":"2024-09-21T07:35:56.537998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:23.972535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519035+0000","last_change":"2024-09-21T07:35:56.541017+0000","last_active":"2024-09-21T07:35:57.519035+0000","last_peered":"2024-09-21T07:35:57.519035+0000","last_clean":"2024-09-21T07:35:57.519035+0000","last_became_active":"2024-09-21T07:35:56.540691+0000","last_became_peered":"2024-09-21T07:35:56.540691+0000","last_unstale":"2024-09-21T07:35:57.519035+0000","last_undegraded":"2024-09-21T07:35:57.519035+0000","last_fullsized":"2024-09-21T07:35:57.519035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:40.675743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516622+0000","last_change":"2024-09-21T07:35:56.543465+0000","last_active":"2024-09-21T07:35:57.516622+0000","last_peered":"2024-09-21T07:35:57.516622+0000","last_clean":"2024-09-21T07:35:57.516622+0000","last_became_active":"2024-09-21T07:35:56.543121+0000","last_became_peered":"2024-09-21T07:35:56.543121+0000","last_unstale":"2024-09-21T07:35:57.516622+0000","last_undegraded":"2024-09-21T07:35:57.516622+0000","last_fullsized":"2024-09-21T07:35:57.516622+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:35.776811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517089+0000","last_change":"2024-09-21T07:35:56.521670+0000","last_active":"2024-09-21T07:35:57.517089+0000","last_peered":"2024-09-21T07:35:57.517089+0000","last_clean":"2024-09-21T07:35:57.517089+0000","last_became_active":"2024-09-21T07:35:56.521335+0000","last_became_peered":"2024-09-21T07:35:56.521335+0000","last_unstale":"2024-09-21T07:35:57.517089+0000","last_undegraded":"2024-09-21T07:35:57.517089+0000","last_fullsized":"2024-09-21T07:35:57.517089+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:44.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553103+0000","last_change":"2024-09-21T07:35:56.549097+0000","last_active":"2024-09-21T07:35:56.553103+0000","last_peered":"2024-09-21T07:35:56.553103+0000","last_clean":"2024-09-21T07:35:56.553103+0000","last_became_active":"2024-09-21T07:35:56.548774+0000","last_became_peered":"2024-09-21T07:35:56.548774+0000","last_unstale":"2024-09-21T07:35:56.553103+0000","last_undegraded":"2024-09-21T07:35:56.553103+0000","last_fullsized":"2024-09-21T07:35:56.553103+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:47.203701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541674+0000","last_change":"2024-09-21T07:35:56.537307+0000","last_active":"2024-09-21T07:35:56.541674+0000","last_peered":"2024-09-21T07:35:56.541674+0000","last_clean":"2024-09-21T07:35:56.541674+0000","last_became_active":"2024-09-21T07:35:56.536464+0000","last_became_peered":"2024-09-21T07:35:56.536464+0000","last_unstale":"2024-09-21T07:35:56.541674+0000","last_undegraded":"2024-09-21T07:35:56.541674+0000","last_fullsized":"2024-09-21T07:35:56.541674+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:10.782198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499552+0000","last_change":"2024-09-21T07:35:55.499552+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499552+0000","last_undegraded":"2024-09-21T07:35:55.499552+0000","last_fullsized":"2024-09-21T07:35:55.499552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517754+0000","last_change":"2024-09-21T07:35:55.507617+0000","last_active":"2024-09-21T07:35:57.517754+0000","last_peered":"2024-09-21T07:35:57.517754+0000","last_clean":"2024-09-21T07:35:57.517754+0000","last_became_active":"2024-09-21T07:35:55.507237+0000","last_became_peered":"2024-09-21T07:35:55.507237+0000","last_unstale":"2024-09-21T07:35:57.517754+0000","last_undegraded":"2024-09-21T07:35:57.517754+0000","last_fullsized":"2024-09-21T07:35:57.517754+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:33.418156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.528141+0000","last_change":"2024-09-21T07:35:56.525646+0000","last_active":"2024-09-21T07:35:56.528141+0000","last_peered":"2024-09-21T07:35:56.528141+0000","last_clean":"2024-09-21T07:35:56.528141+0000","last_became_active":"2024-09-21T07:35:56.525314+0000","last_became_peered":"2024-09-21T07:35:56.525314+0000","last_unstale":"2024-09-21T07:35:56.528141+0000","last_undegraded":"2024-09-21T07:35:56.528141+0000","last_fullsized":"2024-09-21T07:35:56.528141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:30.881896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.530655+0000","last_change":"2024-09-21T07:35:55.512414+0000","last_active":"2024-09-21T07:35:56.530655+0000","last_peered":"2024-09-21T07:35:56.530655+0000","last_clean":"2024-09-21T07:35:56.530655+0000","last_became_active":"2024-09-21T07:35:55.511521+0000","last_became_peered":"2024-09-21T07:35:55.511521+0000","last_unstale":"2024-09-21T07:35:56.530655+0000","last_undegraded":"2024-09-21T07:35:56.530655+0000","last_fullsized":"2024-09-21T07:35:56.530655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:32.733910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541575+0000","last_change":"2024-09-21T07:35:56.535286+0000","last_active":"2024-09-21T07:35:56.541575+0000","last_peered":"2024-09-21T07:35:56.541575+0000","last_clean":"2024-09-21T07:35:56.541575+0000","last_became_active":"2024-09-21T07:35:56.531371+0000","last_became_peered":"2024-09-21T07:35:56.531371+0000","last_unstale":"2024-09-21T07:35:56.541575+0000","last_undegraded":"2024-09-21T07:35:56.541575+0000","last_fullsized":"2024-09-21T07:35:56.541575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:12.067873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.514618+0000","last_change":"2024-09-21T07:35:55.513756+0000","last_active":"2024-09-21T07:35:55.514618+0000","last_peered":"2024-09-21T07:35:55.514618+0000","last_clean":"2024-09-21T07:35:55.514618+0000","last_became_active":"2024-09-21T07:35:55.513321+0000","last_became_peered":"2024-09-21T07:35:55.513321+0000","last_unstale":"2024-09-21T07:35:55.514618+0000","last_undegraded":"2024-09-21T07:35:55.514618+0000","last_fullsized":"2024-09-21T07:35:55.514618+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:16.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518481+0000","last_change":"2024-09-21T07:35:56.539610+0000","last_active":"2024-09-21T07:35:57.518481+0000","last_peered":"2024-09-21T07:35:57.518481+0000","last_clean":"2024-09-21T07:35:57.518481+0000","last_became_active":"2024-09-21T07:35:56.539303+0000","last_became_peered":"2024-09-21T07:35:56.539303+0000","last_unstale":"2024-09-21T07:35:57.518481+0000","last_undegraded":"2024-09-21T07:35:57.518481+0000","last_fullsized":"2024-09-21T07:35:57.518481+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:44.962547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516758+0000","last_change":"2024-09-21T07:35:55.510443+0000","last_active":"2024-09-21T07:35:57.516758+0000","last_peered":"2024-09-21T07:35:57.516758+0000","last_clean":"2024-09-21T07:35:57.516758+0000","last_became_active":"2024-09-21T07:35:55.510085+0000","last_became_peered":"2024-09-21T07:35:55.510085+0000","last_unstale":"2024-09-21T07:35:57.516758+0000","last_undegraded":"2024-09-21T07:35:57.516758+0000","last_fullsized":"2024-09-21T07:35:57.516758+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:04.391176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517372+0000","last_change":"2024-09-21T07:35:56.522754+0000","last_active":"2024-09-21T07:35:57.517372+0000","last_peered":"2024-09-21T07:35:57.517372+0000","last_clean":"2024-09-21T07:35:57.517372+0000","last_became_active":"2024-09-21T07:35:56.522452+0000","last_became_peered":"2024-09-21T07:35:56.522452+0000","last_unstale":"2024-09-21T07:35:57.517372+0000","last_undegraded":"2024-09-21T07:35:57.517372+0000","last_fullsized":"2024-09-21T07:35:57.517372+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:43.361943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536213+0000","last_change":"2024-09-21T07:35:55.517500+0000","last_active":"2024-09-21T07:35:56.536213+0000","last_peered":"2024-09-21T07:35:56.536213+0000","last_clean":"2024-09-21T07:35:56.536213+0000","last_became_active":"2024-09-21T07:35:55.517201+0000","last_became_peered":"2024-09-21T07:35:55.517201+0000","last_unstale":"2024-09-21T07:35:56.536213+0000","last_undegraded":"2024-09-21T07:35:56.536213+0000","last_fullsized":"2024-09-21T07:35:56.536213+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.619469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517331+0000","last_change":"2024-09-21T07:35:56.531499+0000","last_active":"2024-09-21T07:35:57.517331+0000","last_peered":"2024-09-21T07:35:57.517331+0000","last_clean":"2024-09-21T07:35:57.517331+0000","last_became_active":"2024-09-21T07:35:56.531146+0000","last_became_peered":"2024-09-21T07:35:56.531146+0000","last_unstale":"2024-09-21T07:35:57.517331+0000","last_undegraded":"2024-09-21T07:35:57.517331+0000","last_fullsized":"2024-09-21T07:35:57.517331+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522120+0000","last_change":"2024-09-21T07:35:55.517407+0000","last_active":"2024-09-21T07:35:56.522120+0000","last_peered":"2024-09-21T07:35:56.522120+0000","last_clean":"2024-09-21T07:35:56.522120+0000","last_became_active":"2024-09-21T07:35:55.517062+0000","last_became_peered":"2024-09-21T07:35:55.517062+0000","last_unstale":"2024-09-21T07:35:56.522120+0000","last_undegraded":"2024-09-21T07:35:56.522120+0000","last_fullsized":"2024-09-21T07:35:56.522120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:32.359923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517647+0000","last_change":"2024-09-21T07:35:56.536125+0000","last_active":"2024-09-21T07:35:57.517647+0000","last_peered":"2024-09-21T07:35:57.517647+0000","last_clean":"2024-09-21T07:35:57.517647+0000","last_became_active":"2024-09-21T07:35:56.535400+0000","last_became_peered":"2024-09-21T07:35:56.535400+0000","last_unstale":"2024-09-21T07:35:57.517647+0000","last_undegraded":"2024-09-21T07:35:57.517647+0000","last_fullsized":"2024-09-21T07:35:57.517647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.519168+0000","last_change":"2024-09-21T07:35:55.514583+0000","last_active":"2024-09-21T07:35:56.519168+0000","last_peered":"2024-09-21T07:35:56.519168+0000","last_clean":"2024-09-21T07:35:56.519168+0000","last_became_active":"2024-09-21T07:35:55.514197+0000","last_became_peered":"2024-09-21T07:35:55.514197+0000","last_unstale":"2024-09-21T07:35:56.519168+0000","last_undegraded":"2024-09-21T07:35:56.519168+0000","last_fullsized":"2024-09-21T07:35:56.519168+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:46.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516910+0000","last_change":"2024-09-21T07:35:56.515734+0000","last_active":"2024-09-21T07:35:57.516910+0000","last_peered":"2024-09-21T07:35:57.516910+0000","last_clean":"2024-09-21T07:35:57.516910+0000","last_became_active":"2024-09-21T07:35:56.515411+0000","last_became_peered":"2024-09-21T07:35:56.515411+0000","last_unstale":"2024-09-21T07:35:57.516910+0000","last_undegraded":"2024-09-21T07:35:57.516910+0000","last_fullsized":"2024-09-21T07:35:57.516910+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:26.754127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518959+0000","last_change":"2024-09-21T07:35:55.509338+0000","last_active":"2024-09-21T07:35:57.518959+0000","last_peered":"2024-09-21T07:35:57.518959+0000","last_clean":"2024-09-21T07:35:57.518959+0000","last_became_active":"2024-09-21T07:35:55.508913+0000","last_became_peered":"2024-09-21T07:35:55.508913+0000","last_unstale":"2024-09-21T07:35:57.518959+0000","last_undegraded":"2024-09-21T07:35:57.518959+0000","last_fullsized":"2024-09-21T07:35:57.518959+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:25.868297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541192+0000","last_change":"2024-09-21T07:35:56.534293+0000","last_active":"2024-09-21T07:35:56.541192+0000","last_peered":"2024-09-21T07:35:56.541192+0000","last_clean":"2024-09-21T07:35:56.541192+0000","last_became_active":"2024-09-21T07:35:56.533756+0000","last_became_peered":"2024-09-21T07:35:56.533756+0000","last_unstale":"2024-09-21T07:35:56.541192+0000","last_undegraded":"2024-09-21T07:35:56.541192+0000","last_fullsized":"2024-09-21T07:35:56.541192+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:19.301721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526134+0000","last_change":"2024-09-21T07:35:55.520395+0000","last_active":"2024-09-21T07:35:56.526134+0000","last_peered":"2024-09-21T07:35:56.526134+0000","last_clean":"2024-09-21T07:35:56.526134+0000","last_became_active":"2024-09-21T07:35:55.520048+0000","last_became_peered":"2024-09-21T07:35:55.520048+0000","last_unstale":"2024-09-21T07:35:56.526134+0000","last_undegraded":"2024-09-21T07:35:56.526134+0000","last_fullsized":"2024-09-21T07:35:56.526134+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:38.598370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516626+0000","last_change":"2024-09-21T07:35:56.535112+0000","last_active":"2024-09-21T07:35:57.516626+0000","last_peered":"2024-09-21T07:35:57.516626+0000","last_clean":"2024-09-21T07:35:57.516626+0000","last_became_active":"2024-09-21T07:35:56.534778+0000","last_became_peered":"2024-09-21T07:35:56.534778+0000","last_unstale":"2024-09-21T07:35:57.516626+0000","last_undegraded":"2024-09-21T07:35:57.516626+0000","last_fullsized":"2024-09-21T07:35:57.516626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:08.412784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517130+0000","last_change":"2024-09-21T07:35:55.516818+0000","last_active":"2024-09-21T07:35:57.517130+0000","last_peered":"2024-09-21T07:35:57.517130+0000","last_clean":"2024-09-21T07:35:57.517130+0000","last_became_active":"2024-09-21T07:35:55.516404+0000","last_became_peered":"2024-09-21T07:35:55.516404+0000","last_unstale":"2024-09-21T07:35:57.517130+0000","last_undegraded":"2024-09-21T07:35:57.517130+0000","last_fullsized":"2024-09-21T07:35:57.517130+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:28.596997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518816+0000","last_change":"2024-09-21T07:35:56.534487+0000","last_active":"2024-09-21T07:35:57.518816+0000","last_peered":"2024-09-21T07:35:57.518816+0000","last_clean":"2024-09-21T07:35:57.518816+0000","last_became_active":"2024-09-21T07:35:56.533641+0000","last_became_peered":"2024-09-21T07:35:56.533641+0000","last_unstale":"2024-09-21T07:35:57.518816+0000","last_undegraded":"2024-09-21T07:35:57.518816+0000","last_fullsized":"2024-09-21T07:35:57.518816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:06.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.552972+0000","last_change":"2024-09-21T07:35:55.518211+0000","last_active":"2024-09-21T07:35:56.552972+0000","last_peered":"2024-09-21T07:35:56.552972+0000","last_clean":"2024-09-21T07:35:56.552972+0000","last_became_active":"2024-09-21T07:35:55.517091+0000","last_became_peered":"2024-09-21T07:35:55.517091+0000","last_unstale":"2024-09-21T07:35:56.552972+0000","last_undegraded":"2024-09-21T07:35:56.552972+0000","last_fullsized":"2024-09-21T07:35:56.552972+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499051+0000","last_change":"2024-09-21T07:35:55.499051+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499051+0000","last_undegraded":"2024-09-21T07:35:55.499051+0000","last_fullsized":"2024-09-21T07:35:55.499051+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513089+0000","last_change":"2024-09-21T07:35:55.506824+0000","last_active":"2024-09-21T07:35:55.513089+0000","last_peered":"2024-09-21T07:35:55.513089+0000","last_clean":"2024-09-21T07:35:55.513089+0000","last_became_active":"2024-09-21T07:35:55.506484+0000","last_became_peered":"2024-09-21T07:35:55.506484+0000","last_unstale":"2024-09-21T07:35:55.513089+0000","last_undegraded":"2024-09-21T07:35:55.513089+0000","last_fullsized":"2024-09-21T07:35:55.513089+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:16.595081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.551653+0000","last_change":"2024-09-21T07:35:56.550098+0000","last_active":"2024-09-21T07:35:56.551653+0000","last_peered":"2024-09-21T07:35:56.551653+0000","last_clean":"2024-09-21T07:35:56.551653+0000","last_became_active":"2024-09-21T07:35:56.549567+0000","last_became_peered":"2024-09-21T07:35:56.549567+0000","last_unstale":"2024-09-21T07:35:56.551653+0000","last_undegraded":"2024-09-21T07:35:56.551653+0000","last_fullsized":"2024-09-21T07:35:56.551653+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:36.902299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.518734+0000","last_change":"2024-09-21T07:35:55.500793+0000","last_active":"2024-09-21T07:35:56.518734+0000","last_peered":"2024-09-21T07:35:56.518734+0000","last_clean":"2024-09-21T07:35:56.518734+0000","last_became_active":"2024-09-21T07:35:55.500461+0000","last_became_peered":"2024-09-21T07:35:55.500461+0000","last_unstale":"2024-09-21T07:35:56.518734+0000","last_undegraded":"2024-09-21T07:35:56.518734+0000","last_fullsized":"2024-09-21T07:35:56.518734+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:55.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517253+0000","last_change":"2024-09-21T07:35:56.548523+0000","last_active":"2024-09-21T07:35:57.517253+0000","last_peered":"2024-09-21T07:35:57.517253+0000","last_clean":"2024-09-21T07:35:57.517253+0000","last_became_active":"2024-09-21T07:35:56.548223+0000","last_became_peered":"2024-09-21T07:35:56.548223+0000","last_unstale":"2024-09-21T07:35:57.517253+0000","last_undegraded":"2024-09-21T07:35:57.517253+0000","last_fullsized":"2024-09-21T07:35:57.517253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:55.796410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516547+0000","last_change":"2024-09-21T07:35:55.518059+0000","last_active":"2024-09-21T07:35:57.516547+0000","last_peered":"2024-09-21T07:35:57.516547+0000","last_clean":"2024-09-21T07:35:57.516547+0000","last_became_active":"2024-09-21T07:35:55.517406+0000","last_became_peered":"2024-09-21T07:35:55.517406+0000","last_unstale":"2024-09-21T07:35:57.516547+0000","last_undegraded":"2024-09-21T07:35:57.516547+0000","last_fullsized":"2024-09-21T07:35:57.516547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:19.228872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.539212+0000","last_change":"2024-09-21T07:35:56.533846+0000","last_active":"2024-09-21T07:35:56.539212+0000","last_peered":"2024-09-21T07:35:56.539212+0000","last_clean":"2024-09-21T07:35:56.539212+0000","last_became_active":"2024-09-21T07:35:56.533430+0000","last_became_peered":"2024-09-21T07:35:56.533430+0000","last_unstale":"2024-09-21T07:35:56.539212+0000","last_undegraded":"2024-09-21T07:35:56.539212+0000","last_fullsized":"2024-09-21T07:35:56.539212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:59.062863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":23,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517932+0000","last_change":"2024-09-21T07:35:55.514195+0000","last_active":"2024-09-21T07:35:57.517932+0000","last_peered":"2024-09-21T07:35:57.517932+0000","last_clean":"2024-09-21T07:35:57.517932+0000","last_became_active":"2024-09-21T07:35:55.513310+0000","last_became_peered":"2024-09-21T07:35:55.513310+0000","last_unstale":"2024-09-21T07:35:57.517932+0000","last_undegraded":"2024-09-21T07:35:57.517932+0000","last_fullsized":"2024-09-21T07:35:57.517932+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541511+0000","last_change":"2024-09-21T07:35:56.537670+0000","last_active":"2024-09-21T07:35:56.541511+0000","last_peered":"2024-09-21T07:35:56.541511+0000","last_clean":"2024-09-21T07:35:56.541511+0000","last_became_active":"2024-09-21T07:35:56.535095+0000","last_became_peered":"2024-09-21T07:35:56.535095+0000","last_unstale":"2024-09-21T07:35:56.541511+0000","last_undegraded":"2024-09-21T07:35:56.541511+0000","last_fullsized":"2024-09-21T07:35:56.541511+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:34.569090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535689+0000","last_change":"2024-09-21T07:35:55.508297+0000","last_active":"2024-09-21T07:35:56.535689+0000","last_peered":"2024-09-21T07:35:56.535689+0000","last_clean":"2024-09-21T07:35:56.535689+0000","last_became_active":"2024-09-21T07:35:55.507986+0000","last_became_peered":"2024-09-21T07:35:55.507986+0000","last_unstale":"2024-09-21T07:35:56.535689+0000","last_undegraded":"2024-09-21T07:35:56.535689+0000","last_fullsized":"2024-09-21T07:35:56.535689+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:00.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526722+0000","last_change":"2024-09-21T07:35:56.523458+0000","last_active":"2024-09-21T07:35:56.526722+0000","last_peered":"2024-09-21T07:35:56.526722+0000","last_clean":"2024-09-21T07:35:56.526722+0000","last_became_active":"2024-09-21T07:35:56.522634+0000","last_became_peered":"2024-09-21T07:35:56.522634+0000","last_unstale":"2024-09-21T07:35:56.526722+0000","last_undegraded":"2024-09-21T07:35:56.526722+0000","last_fullsized":"2024-09-21T07:35:56.526722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:35.163475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":15,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537684+0000","last_change":"2024-09-21T07:35:55.511813+0000","last_active":"2024-09-21T07:35:56.537684+0000","last_peered":"2024-09-21T07:35:56.537684+0000","last_clean":"2024-09-21T07:35:56.537684+0000","last_became_active":"2024-09-21T07:35:55.511137+0000","last_became_peered":"2024-09-21T07:35:55.511137+0000","last_unstale":"2024-09-21T07:35:56.537684+0000","last_undegraded":"2024-09-21T07:35:56.537684+0000","last_fullsized":"2024-09-21T07:35:56.537684+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:20.145930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537342+0000","last_change":"2024-09-21T07:35:56.533636+0000","last_active":"2024-09-21T07:35:56.537342+0000","last_peered":"2024-09-21T07:35:56.537342+0000","last_clean":"2024-09-21T07:35:56.537342+0000","last_became_active":"2024-09-21T07:35:56.533340+0000","last_became_peered":"2024-09-21T07:35:56.533340+0000","last_unstale":"2024-09-21T07:35:56.537342+0000","last_undegraded":"2024-09-21T07:35:56.537342+0000","last_fullsized":"2024-09-21T07:35:56.537342+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:41.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513979+0000","last_change":"2024-09-21T07:35:55.512632+0000","last_active":"2024-09-21T07:35:55.513979+0000","last_peered":"2024-09-21T07:35:55.513979+0000","last_clean":"2024-09-21T07:35:55.513979+0000","last_became_active":"2024-09-21T07:35:55.511701+0000","last_became_peered":"2024-09-21T07:35:55.511701+0000","last_unstale":"2024-09-21T07:35:55.513979+0000","last_undegraded":"2024-09-21T07:35:55.513979+0000","last_fullsized":"2024-09-21T07:35:55.513979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:08.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541367+0000","last_change":"2024-09-21T07:35:56.535182+0000","last_active":"2024-09-21T07:35:56.541367+0000","last_peered":"2024-09-21T07:35:56.541367+0000","last_clean":"2024-09-21T07:35:56.541367+0000","last_became_active":"2024-09-21T07:35:56.530549+0000","last_became_peered":"2024-09-21T07:35:56.530549+0000","last_unstale":"2024-09-21T07:35:56.541367+0000","last_undegraded":"2024-09-21T07:35:56.541367+0000","last_fullsized":"2024-09-21T07:35:56.541367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:45.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518975+0000","last_change":"2024-09-21T07:35:55.511997+0000","last_active":"2024-09-21T07:35:57.518975+0000","last_peered":"2024-09-21T07:35:57.518975+0000","last_clean":"2024-09-21T07:35:57.518975+0000","last_became_active":"2024-09-21T07:35:55.511282+0000","last_became_peered":"2024-09-21T07:35:55.511282+0000","last_unstale":"2024-09-21T07:35:57.518975+0000","last_undegraded":"2024-09-21T07:35:57.518975+0000","last_fullsized":"2024-09-21T07:35:57.518975+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:59.004838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.498401+0000","last_change":"2024-09-21T07:35:55.498401+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.498401+0000","last_undegraded":"2024-09-21T07:35:55.498401+0000","last_fullsized":"2024-09-21T07:35:55.498401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518648+0000","last_change":"2024-09-21T07:35:55.507126+0000","last_active":"2024-09-21T07:35:57.518648+0000","last_peered":"2024-09-21T07:35:57.518648+0000","last_clean":"2024-09-21T07:35:57.518648+0000","last_became_active":"2024-09-21T07:35:55.506666+0000","last_became_peered":"2024-09-21T07:35:55.506666+0000","last_unstale":"2024-09-21T07:35:57.518648+0000","last_undegraded":"2024-09-21T07:35:57.518648+0000","last_fullsized":"2024-09-21T07:35:57.518648+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553096+0000","last_change":"2024-09-21T07:35:56.548916+0000","last_active":"2024-09-21T07:35:56.553096+0000","last_peered":"2024-09-21T07:35:56.553096+0000","last_clean":"2024-09-21T07:35:56.553096+0000","last_became_active":"2024-09-21T07:35:56.548631+0000","last_became_peered":"2024-09-21T07:35:56.548631+0000","last_unstale":"2024-09-21T07:35:56.553096+0000","last_undegraded":"2024-09-21T07:35:56.553096+0000","last_fullsized":"2024-09-21T07:35:56.553096+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:07.211518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.512630+0000","last_change":"2024-09-21T07:35:55.504973+0000","last_active":"2024-09-21T07:35:55.512630+0000","last_peered":"2024-09-21T07:35:55.512630+0000","last_clean":"2024-09-21T07:35:55.512630+0000","last_became_active":"2024-09-21T07:35:55.504600+0000","last_became_peered":"2024-09-21T07:35:55.504600+0000","last_unstale":"2024-09-21T07:35:55.512630+0000","last_undegraded":"2024-09-21T07:35:55.512630+0000","last_fullsized":"2024-09-21T07:35:55.512630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:08.767720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517377+0000","last_change":"2024-09-21T07:35:56.538836+0000","last_active":"2024-09-21T07:35:57.517377+0000","last_peered":"2024-09-21T07:35:57.517377+0000","last_clean":"2024-09-21T07:35:57.517377+0000","last_became_active":"2024-09-21T07:35:56.538514+0000","last_became_peered":"2024-09-21T07:35:56.538514+0000","last_unstale":"2024-09-21T07:35:57.517377+0000","last_undegraded":"2024-09-21T07:35:57.517377+0000","last_fullsized":"2024-09-21T07:35:57.517377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:23.823985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516955+0000","last_change":"2024-09-21T07:35:55.504947+0000","last_active":"2024-09-21T07:35:57.516955+0000","last_peered":"2024-09-21T07:35:57.516955+0000","last_clean":"2024-09-21T07:35:57.516955+0000","last_became_active":"2024-09-21T07:35:55.504601+0000","last_became_peered":"2024-09-21T07:35:55.504601+0000","last_unstale":"2024-09-21T07:35:57.516955+0000","last_undegraded":"2024-09-21T07:35:57.516955+0000","last_fullsized":"2024-09-21T07:35:57.516955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.728969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544576+0000","last_change":"2024-09-21T07:35:56.540065+0000","last_active":"2024-09-21T07:35:56.544576+0000","last_peered":"2024-09-21T07:35:56.544576+0000","last_clean":"2024-09-21T07:35:56.544576+0000","last_became_active":"2024-09-21T07:35:56.535568+0000","last_became_peered":"2024-09-21T07:35:56.535568+0000","last_unstale":"2024-09-21T07:35:56.544576+0000","last_undegraded":"2024-09-21T07:35:56.544576+0000","last_fullsized":"2024-09-21T07:35:56.544576+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:35.442810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514483+0000","last_change":"2024-09-21T07:35:55.514068+0000","last_active":"2024-09-21T07:35:56.514483+0000","last_peered":"2024-09-21T07:35:56.514483+0000","last_clean":"2024-09-21T07:35:56.514483+0000","last_became_active":"2024-09-21T07:35:55.513611+0000","last_became_peered":"2024-09-21T07:35:55.513611+0000","last_unstale":"2024-09-21T07:35:56.514483+0000","last_undegraded":"2024-09-21T07:35:56.514483+0000","last_fullsized":"2024-09-21T07:35:56.514483+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:50.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.542293+0000","last_change":"2024-09-21T07:35:56.538134+0000","last_active":"2024-09-21T07:35:56.542293+0000","last_peered":"2024-09-21T07:35:56.542293+0000","last_clean":"2024-09-21T07:35:56.542293+0000","last_became_active":"2024-09-21T07:35:56.535487+0000","last_became_peered":"2024-09-21T07:35:56.535487+0000","last_unstale":"2024-09-21T07:35:56.542293+0000","last_undegraded":"2024-09-21T07:35:56.542293+0000","last_fullsized":"2024-09-21T07:35:56.542293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:28.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517774+0000","last_change":"2024-09-21T07:35:55.517204+0000","last_active":"2024-09-21T07:35:57.517774+0000","last_peered":"2024-09-21T07:35:57.517774+0000","last_clean":"2024-09-21T07:35:57.517774+0000","last_became_active":"2024-09-21T07:35:55.516611+0000","last_became_peered":"2024-09-21T07:35:55.516611+0000","last_unstale":"2024-09-21T07:35:57.517774+0000","last_undegraded":"2024-09-21T07:35:57.517774+0000","last_fullsized":"2024-09-21T07:35:57.517774+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.047521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549490+0000","last_change":"2024-09-21T07:35:56.540592+0000","last_active":"2024-09-21T07:35:56.549490+0000","last_peered":"2024-09-21T07:35:56.549490+0000","last_clean":"2024-09-21T07:35:56.549490+0000","last_became_active":"2024-09-21T07:35:56.540269+0000","last_became_peered":"2024-09-21T07:35:56.540269+0000","last_unstale":"2024-09-21T07:35:56.549490+0000","last_undegraded":"2024-09-21T07:35:56.549490+0000","last_fullsized":"2024-09-21T07:35:56.549490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:58.810275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.515349+0000","last_change":"2024-09-21T07:35:55.503498+0000","last_active":"2024-09-21T07:35:57.515349+0000","last_peered":"2024-09-21T07:35:57.515349+0000","last_clean":"2024-09-21T07:35:57.515349+0000","last_became_active":"2024-09-21T07:35:55.503073+0000","last_became_peered":"2024-09-21T07:35:55.503073+0000","last_unstale":"2024-09-21T07:35:57.515349+0000","last_undegraded":"2024-09-21T07:35:57.515349+0000","last_fullsized":"2024-09-21T07:35:57.515349+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.889708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516961+0000","last_change":"2024-09-21T07:35:56.547899+0000","last_active":"2024-09-21T07:35:57.516961+0000","last_peered":"2024-09-21T07:35:57.516961+0000","last_clean":"2024-09-21T07:35:57.516961+0000","last_became_active":"2024-09-21T07:35:56.547572+0000","last_became_peered":"2024-09-21T07:35:56.547572+0000","last_unstale":"2024-09-21T07:35:57.516961+0000","last_undegraded":"2024-09-21T07:35:57.516961+0000","last_fullsized":"2024-09-21T07:35:57.516961+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:18.327833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517486+0000","last_change":"2024-09-21T07:35:55.506133+0000","last_active":"2024-09-21T07:35:57.517486+0000","last_peered":"2024-09-21T07:35:57.517486+0000","last_clean":"2024-09-21T07:35:57.517486+0000","last_became_active":"2024-09-21T07:35:55.505819+0000","last_became_peered":"2024-09-21T07:35:55.505819+0000","last_unstale":"2024-09-21T07:35:57.517486+0000","last_undegraded":"2024-09-21T07:35:57.517486+0000","last_fullsized":"2024-09-21T07:35:57.517486+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:50.225417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.531311+0000","last_change":"2024-09-21T07:35:56.528239+0000","last_active":"2024-09-21T07:35:56.531311+0000","last_peered":"2024-09-21T07:35:56.531311+0000","last_clean":"2024-09-21T07:35:56.531311+0000","last_became_active":"2024-09-21T07:35:56.527890+0000","last_became_peered":"2024-09-21T07:35:56.527890+0000","last_unstale":"2024-09-21T07:35:56.531311+0000","last_undegraded":"2024-09-21T07:35:56.531311+0000","last_fullsized":"2024-09-21T07:35:56.531311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:55.369124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514253+0000","last_change":"2024-09-21T07:35:55.516129+0000","last_active":"2024-09-21T07:35:56.514253+0000","last_peered":"2024-09-21T07:35:56.514253+0000","last_clean":"2024-09-21T07:35:56.514253+0000","last_became_active":"2024-09-21T07:35:55.515802+0000","last_became_peered":"2024-09-21T07:35:55.515802+0000","last_unstale":"2024-09-21T07:35:56.514253+0000","last_undegraded":"2024-09-21T07:35:56.514253+0000","last_fullsized":"2024-09-21T07:35:56.514253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:42.354336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.540281+0000","last_change":"2024-09-21T07:35:56.530807+0000","last_active":"2024-09-21T07:35:56.540281+0000","last_peered":"2024-09-21T07:35:56.540281+0000","last_clean":"2024-09-21T07:35:56.540281+0000","last_became_active":"2024-09-21T07:35:56.528662+0000","last_became_peered":"2024-09-21T07:35:56.528662+0000","last_unstale":"2024-09-21T07:35:56.540281+0000","last_undegraded":"2024-09-21T07:35:56.540281+0000","last_fullsized":"2024-09-21T07:35:56.540281+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:06.977730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.511669+0000","last_change":"2024-09-21T07:35:55.503586+0000","last_active":"2024-09-21T07:35:56.511669+0000","last_peered":"2024-09-21T07:35:56.511669+0000","last_clean":"2024-09-21T07:35:56.511669+0000","last_became_active":"2024-09-21T07:35:55.503160+0000","last_became_peered":"2024-09-21T07:35:55.503160+0000","last_unstale":"2024-09-21T07:35:56.511669+0000","last_undegraded":"2024-09-21T07:35:56.511669+0000","last_fullsized":"2024-09-21T07:35:56.511669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:20.237989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536253+0000","last_change":"2024-09-21T07:35:56.532396+0000","last_active":"2024-09-21T07:35:56.536253+0000","last_peered":"2024-09-21T07:35:56.536253+0000","last_clean":"2024-09-21T07:35:56.536253+0000","last_became_active":"2024-09-21T07:35:56.532062+0000","last_became_peered":"2024-09-21T07:35:56.532062+0000","last_unstale":"2024-09-21T07:35:56.536253+0000","last_undegraded":"2024-09-21T07:35:56.536253+0000","last_fullsized":"2024-09-21T07:35:56.536253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.129335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516875+0000","last_change":"2024-09-21T07:35:55.511105+0000","last_active":"2024-09-21T07:35:57.516875+0000","last_peered":"2024-09-21T07:35:57.516875+0000","last_clean":"2024-09-21T07:35:57.516875+0000","last_became_active":"2024-09-21T07:35:55.510724+0000","last_became_peered":"2024-09-21T07:35:55.510724+0000","last_unstale":"2024-09-21T07:35:57.516875+0000","last_undegraded":"2024-09-21T07:35:57.516875+0000","last_fullsized":"2024-09-21T07:35:57.516875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:13.044173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553026+0000","last_change":"2024-09-21T07:35:56.545891+0000","last_active":"2024-09-21T07:35:56.553026+0000","last_peered":"2024-09-21T07:35:56.553026+0000","last_clean":"2024-09-21T07:35:56.553026+0000","last_became_active":"2024-09-21T07:35:56.545486+0000","last_became_peered":"2024-09-21T07:35:56.545486+0000","last_unstale":"2024-09-21T07:35:56.553026+0000","last_undegraded":"2024-09-21T07:35:56.553026+0000","last_fullsized":"2024-09-21T07:35:56.553026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:28.119364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.516814+0000","last_change":"2024-09-21T07:35:55.506044+0000","last_active":"2024-09-21T07:35:56.516814+0000","last_peered":"2024-09-21T07:35:56.516814+0000","last_clean":"2024-09-21T07:35:56.516814+0000","last_became_active":"2024-09-21T07:35:55.505749+0000","last_became_peered":"2024-09-21T07:35:55.505749+0000","last_unstale":"2024-09-21T07:35:56.516814+0000","last_undegraded":"2024-09-21T07:35:56.516814+0000","last_fullsized":"2024-09-21T07:35:56.516814+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:14.718347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549536+0000","last_change":"2024-09-21T07:35:56.543636+0000","last_active":"2024-09-21T07:35:56.549536+0000","last_peered":"2024-09-21T07:35:56.549536+0000","last_clean":"2024-09-21T07:35:56.549536+0000","last_became_active":"2024-09-21T07:35:56.543332+0000","last_became_peered":"2024-09-21T07:35:56.543332+0000","last_unstale":"2024-09-21T07:35:56.549536+0000","last_undegraded":"2024-09-21T07:35:56.549536+0000","last_fullsized":"2024-09-21T07:35:56.549536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:30.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519097+0000","last_change":"2024-09-21T07:35:55.504949+0000","last_active":"2024-09-21T07:35:57.519097+0000","last_peered":"2024-09-21T07:35:57.519097+0000","last_clean":"2024-09-21T07:35:57.519097+0000","last_became_active":"2024-09-21T07:35:55.504623+0000","last_became_peered":"2024-09-21T07:35:55.504623+0000","last_unstale":"2024-09-21T07:35:57.519097+0000","last_undegraded":"2024-09-21T07:35:57.519097+0000","last_fullsized":"2024-09-21T07:35:57.519097+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:14.464426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.532329+0000","last_change":"2024-09-21T07:35:56.531233+0000","last_active":"2024-09-21T07:35:56.532329+0000","last_peered":"2024-09-21T07:35:56.532329+0000","last_clean":"2024-09-21T07:35:56.532329+0000","last_became_active":"2024-09-21T07:35:56.529247+0000","last_became_peered":"2024-09-21T07:35:56.529247+0000","last_unstale":"2024-09-21T07:35:56.532329+0000","last_undegraded":"2024-09-21T07:35:56.532329+0000","last_fullsized":"2024-09-21T07:35:56.532329+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:24.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516761+0000","last_change":"2024-09-21T07:35:55.513811+0000","last_active":"2024-09-21T07:35:57.516761+0000","last_peered":"2024-09-21T07:35:57.516761+0000","last_clean":"2024-09-21T07:35:57.516761+0000","last_became_active":"2024-09-21T07:35:55.513193+0000","last_became_peered":"2024-09-21T07:35:55.513193+0000","last_unstale":"2024-09-21T07:35:57.516761+0000","last_undegraded":"2024-09-21T07:35:57.516761+0000","last_fullsized":"2024-09-21T07:35:57.516761+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":419,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522727+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:56.522727+0000","last_peered":"2024-09-21T07:35:56.522727+0000","last_clean":"2024-09-21T07:35:56.522727+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:56.522727+0000","last_undegraded":"2024-09-21T07:35:56.522727+0000","last_fullsized":"2024-09-21T07:35:56.522727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55752,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316088,"statfs":{"total":96636764160,"available":96579674112,"internally_reserved":0,"allocated":2404352,"data_stored":1130910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1128772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64060,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307780,"statfs":{"total":96636764160,"available":96571166720,"internally_reserved":0,"allocated":2392064,"data_stored":1129298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509604,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2392064,"data_stored":1128806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1128716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509604,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56316,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315524,"statfs":{"total":96636764160,"available":96579096576,"internally_reserved":0,"allocated":2985984,"data_stored":1719174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542308,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56328,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315512,"statfs":{"total":96636764160,"available":96579084288,"internally_reserved":0,"allocated":2998272,"data_stored":1720766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87588,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284252,"statfs":{"total":96636764160,"available":96547074048,"internally_reserved":0,"allocated":2375680,"data_stored":1121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:36:00.721 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 -- 172.21.15.64:0/1867108596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 msgr2=0x7fb2000b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 --2- 172.21.15.64:0/1867108596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2000b1ff0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009900 tx=0x7fb1e801c8b0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 -- 172.21.15.64:0/1867108596 shutdown_connections 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 --2- 172.21.15.64:0/1867108596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2000cbcd0 0x7fb2000cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 --2- 172.21.15.64:0/1867108596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2000b1ff0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 -- 172.21.15.64:0/1867108596 >> 172.21.15.64:0/1867108596 conn(0x7fb2000ccbe0 msgr2=0x7fb2000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 -- 172.21.15.64:0/1867108596 shutdown_connections 2024-09-21T07:36:00.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.916+0000 7fb204c00640 1 -- 172.21.15.64:0/1867108596 wait complete. 2024-09-21T07:36:00.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 Processor -- start 2024-09-21T07:36:00.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- start start 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2000cbcd0 0x7fb20009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb20015cbd0 0x7fb20009d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2000b4150 con 0x7fb2000b1be0 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2000b3fd0 con 0x7fb2000cbcd0 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb2000b42d0 con 0x7fb20015cbd0 2024-09-21T07:36:00.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53314/0 (socket says 172.21.15.64:53314) 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 -- 172.21.15.64:0/4122344615 learned_addr learned my addr 172.21.15.64:0/4122344615 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 -- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb20015cbd0 msgr2=0x7fb20009d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb20015cbd0 0x7fb20009d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 -- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2000cbcd0 msgr2=0x7fb20009ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2000cbcd0 0x7fb20009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 -- 172.21.15.64:0/4122344615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20009dd10 con 0x7fb2000b1be0 2024-09-21T07:36:00.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1fde00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0001ec0 tx=0x7fb1f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0017070 con 0x7fb2000b1be0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1f0003600 con 0x7fb2000b1be0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2000ad7f0 con 0x7fb2000b1be0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0003a50 con 0x7fb2000b1be0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.920+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2000adad0 con 0x7fb2000b1be0 2024-09-21T07:36:00.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2000b1ff0 con 0x7fb2000b1be0 2024-09-21T07:36:00.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb1f001a070 con 0x7fb2000b1be0 2024-09-21T07:36:00.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb1f6000640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 0x7fb1dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:00.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fb1f0093750 con 0x7fb2000b1be0 2024-09-21T07:36:00.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb1f7e00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 0x7fb1dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:00.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.924+0000 7fb1f7e00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 0x7fb1dc075710 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80af000 tx=0x7fb1e8019650 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:00.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:00.928+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2000b2530 con 0x7fb2000b1be0 2024-09-21T07:36:01.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.104+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb20015bea0 con 0x7fb1dc073200 2024-09-21T07:36:01.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.108+0000 7fb1f6000640 1 -- 172.21.15.64:0/4122344615 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252054 (secure 0 0 0) 0x7fb20015bea0 con 0x7fb1dc073200 2024-09-21T07:36:01.114 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:01.115 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 msgr2=0x7fb1dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 0x7fb1dc075710 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80af000 tx=0x7fb1e8019650 comp rx=0 tx=0).stop 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 msgr2=0x7fb2001494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0001ec0 tx=0x7fb1f000c890 comp rx=0 tx=0).stop 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 shutdown_connections 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1dc073200 0x7fb1dc075710 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb20015cbd0 0x7fb20009d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2000cbcd0 0x7fb20009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 --2- 172.21.15.64:0/4122344615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2000b1be0 0x7fb2001494f0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 >> 172.21.15.64:0/4122344615 conn(0x7fb2000ccbe0 msgr2=0x7fb200157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 shutdown_connections 2024-09-21T07:36:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.112+0000 7fb204c00640 1 -- 172.21.15.64:0/4122344615 wait complete. 2024-09-21T07:36:01.136 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-21T07:35:59.638747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":499724,"kb_used_data":19856,"kb_used_omap":12,"kb_used_meta":479667,"kb_avail":754474996,"statfs":{"total":773094113280,"available":772582395904,"internally_reserved":0,"allocated":20332544,"data_stored":10207991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":491179571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.152141"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535189+0000","last_change":"2024-09-21T07:35:56.532076+0000","last_active":"2024-09-21T07:35:56.535189+0000","last_peered":"2024-09-21T07:35:56.535189+0000","last_clean":"2024-09-21T07:35:56.535189+0000","last_became_active":"2024-09-21T07:35:56.531712+0000","last_became_peered":"2024-09-21T07:35:56.531712+0000","last_unstale":"2024-09-21T07:35:56.535189+0000","last_undegraded":"2024-09-21T07:35:56.535189+0000","last_fullsized":"2024-09-21T07:35:56.535189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:08.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499718+0000","last_change":"2024-09-21T07:35:55.499718+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499718+0000","last_undegraded":"2024-09-21T07:35:55.499718+0000","last_fullsized":"2024-09-21T07:35:55.499718+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541694+0000","last_change":"2024-09-21T07:35:56.539434+0000","last_active":"2024-09-21T07:35:56.541694+0000","last_peered":"2024-09-21T07:35:56.541694+0000","last_clean":"2024-09-21T07:35:56.541694+0000","last_became_active":"2024-09-21T07:35:56.538261+0000","last_became_peered":"2024-09-21T07:35:56.538261+0000","last_unstale":"2024-09-21T07:35:56.541694+0000","last_undegraded":"2024-09-21T07:35:56.541694+0000","last_fullsized":"2024-09-21T07:35:56.541694+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:06.743615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549725+0000","last_change":"2024-09-21T07:35:56.541396+0000","last_active":"2024-09-21T07:35:56.549725+0000","last_peered":"2024-09-21T07:35:56.549725+0000","last_clean":"2024-09-21T07:35:56.549725+0000","last_became_active":"2024-09-21T07:35:56.540086+0000","last_became_peered":"2024-09-21T07:35:56.540086+0000","last_unstale":"2024-09-21T07:35:56.549725+0000","last_undegraded":"2024-09-21T07:35:56.549725+0000","last_fullsized":"2024-09-21T07:35:56.549725+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:11.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518252+0000","last_change":"2024-09-21T07:35:56.546056+0000","last_active":"2024-09-21T07:35:57.518252+0000","last_peered":"2024-09-21T07:35:57.518252+0000","last_clean":"2024-09-21T07:35:57.518252+0000","last_became_active":"2024-09-21T07:35:56.545732+0000","last_became_peered":"2024-09-21T07:35:56.545732+0000","last_unstale":"2024-09-21T07:35:57.518252+0000","last_undegraded":"2024-09-21T07:35:57.518252+0000","last_fullsized":"2024-09-21T07:35:57.518252+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:21.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541633+0000","last_change":"2024-09-21T07:35:56.537816+0000","last_active":"2024-09-21T07:35:56.541633+0000","last_peered":"2024-09-21T07:35:56.541633+0000","last_clean":"2024-09-21T07:35:56.541633+0000","last_became_active":"2024-09-21T07:35:56.536912+0000","last_became_peered":"2024-09-21T07:35:56.536912+0000","last_unstale":"2024-09-21T07:35:56.541633+0000","last_undegraded":"2024-09-21T07:35:56.541633+0000","last_fullsized":"2024-09-21T07:35:56.541633+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:00.409316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517848+0000","last_change":"2024-09-21T07:35:56.547623+0000","last_active":"2024-09-21T07:35:57.517848+0000","last_peered":"2024-09-21T07:35:57.517848+0000","last_clean":"2024-09-21T07:35:57.517848+0000","last_became_active":"2024-09-21T07:35:56.547341+0000","last_became_peered":"2024-09-21T07:35:56.547341+0000","last_unstale":"2024-09-21T07:35:57.517848+0000","last_undegraded":"2024-09-21T07:35:57.517848+0000","last_fullsized":"2024-09-21T07:35:57.517848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529072+0000","last_change":"2024-09-21T07:35:56.523945+0000","last_active":"2024-09-21T07:35:56.529072+0000","last_peered":"2024-09-21T07:35:56.529072+0000","last_clean":"2024-09-21T07:35:56.529072+0000","last_became_active":"2024-09-21T07:35:56.523614+0000","last_became_peered":"2024-09-21T07:35:56.523614+0000","last_unstale":"2024-09-21T07:35:56.529072+0000","last_undegraded":"2024-09-21T07:35:56.529072+0000","last_fullsized":"2024-09-21T07:35:56.529072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:46.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517191+0000","last_change":"2024-09-21T07:35:56.530699+0000","last_active":"2024-09-21T07:35:57.517191+0000","last_peered":"2024-09-21T07:35:57.517191+0000","last_clean":"2024-09-21T07:35:57.517191+0000","last_became_active":"2024-09-21T07:35:56.530406+0000","last_became_peered":"2024-09-21T07:35:56.530406+0000","last_unstale":"2024-09-21T07:35:57.517191+0000","last_undegraded":"2024-09-21T07:35:57.517191+0000","last_fullsized":"2024-09-21T07:35:57.517191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:30.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541230+0000","last_change":"2024-09-21T07:35:56.534740+0000","last_active":"2024-09-21T07:35:56.541230+0000","last_peered":"2024-09-21T07:35:56.541230+0000","last_clean":"2024-09-21T07:35:56.541230+0000","last_became_active":"2024-09-21T07:35:56.534420+0000","last_became_peered":"2024-09-21T07:35:56.534420+0000","last_unstale":"2024-09-21T07:35:56.541230+0000","last_undegraded":"2024-09-21T07:35:56.541230+0000","last_fullsized":"2024-09-21T07:35:56.541230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:22.523823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537965+0000","last_change":"2024-09-21T07:35:56.534031+0000","last_active":"2024-09-21T07:35:56.537965+0000","last_peered":"2024-09-21T07:35:56.537965+0000","last_clean":"2024-09-21T07:35:56.537965+0000","last_became_active":"2024-09-21T07:35:56.533080+0000","last_became_peered":"2024-09-21T07:35:56.533080+0000","last_unstale":"2024-09-21T07:35:56.537965+0000","last_undegraded":"2024-09-21T07:35:56.537965+0000","last_fullsized":"2024-09-21T07:35:56.537965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:17.039270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518497+0000","last_change":"2024-09-21T07:35:56.542875+0000","last_active":"2024-09-21T07:35:57.518497+0000","last_peered":"2024-09-21T07:35:57.518497+0000","last_clean":"2024-09-21T07:35:57.518497+0000","last_became_active":"2024-09-21T07:35:56.541115+0000","last_became_peered":"2024-09-21T07:35:56.541115+0000","last_unstale":"2024-09-21T07:35:57.518497+0000","last_undegraded":"2024-09-21T07:35:57.518497+0000","last_fullsized":"2024-09-21T07:35:57.518497+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:17.995132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553046+0000","last_change":"2024-09-21T07:35:56.546633+0000","last_active":"2024-09-21T07:35:56.553046+0000","last_peered":"2024-09-21T07:35:56.553046+0000","last_clean":"2024-09-21T07:35:56.553046+0000","last_became_active":"2024-09-21T07:35:56.546330+0000","last_became_peered":"2024-09-21T07:35:56.546330+0000","last_unstale":"2024-09-21T07:35:56.553046+0000","last_undegraded":"2024-09-21T07:35:56.553046+0000","last_fullsized":"2024-09-21T07:35:56.553046+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.103527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527661+0000","last_change":"2024-09-21T07:35:56.522008+0000","last_active":"2024-09-21T07:35:56.527661+0000","last_peered":"2024-09-21T07:35:56.527661+0000","last_clean":"2024-09-21T07:35:56.527661+0000","last_became_active":"2024-09-21T07:35:56.521403+0000","last_became_peered":"2024-09-21T07:35:56.521403+0000","last_unstale":"2024-09-21T07:35:56.527661+0000","last_undegraded":"2024-09-21T07:35:56.527661+0000","last_fullsized":"2024-09-21T07:35:56.527661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:43.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517004+0000","last_change":"2024-09-21T07:35:56.515225+0000","last_active":"2024-09-21T07:35:57.517004+0000","last_peered":"2024-09-21T07:35:57.517004+0000","last_clean":"2024-09-21T07:35:57.517004+0000","last_became_active":"2024-09-21T07:35:56.513973+0000","last_became_peered":"2024-09-21T07:35:56.513973+0000","last_unstale":"2024-09-21T07:35:57.517004+0000","last_undegraded":"2024-09-21T07:35:57.517004+0000","last_fullsized":"2024-09-21T07:35:57.517004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:22.147149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536045+0000","last_change":"2024-09-21T07:35:56.530415+0000","last_active":"2024-09-21T07:35:56.536045+0000","last_peered":"2024-09-21T07:35:56.536045+0000","last_clean":"2024-09-21T07:35:56.536045+0000","last_became_active":"2024-09-21T07:35:56.530079+0000","last_became_peered":"2024-09-21T07:35:56.530079+0000","last_unstale":"2024-09-21T07:35:56.536045+0000","last_undegraded":"2024-09-21T07:35:56.536045+0000","last_fullsized":"2024-09-21T07:35:56.536045+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:05.322121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517424+0000","last_change":"2024-09-21T07:35:56.546948+0000","last_active":"2024-09-21T07:35:57.517424+0000","last_peered":"2024-09-21T07:35:57.517424+0000","last_clean":"2024-09-21T07:35:57.517424+0000","last_became_active":"2024-09-21T07:35:56.546426+0000","last_became_peered":"2024-09-21T07:35:56.546426+0000","last_unstale":"2024-09-21T07:35:57.517424+0000","last_undegraded":"2024-09-21T07:35:57.517424+0000","last_fullsized":"2024-09-21T07:35:57.517424+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:00.228007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517159+0000","last_change":"2024-09-21T07:35:56.546840+0000","last_active":"2024-09-21T07:35:57.517159+0000","last_peered":"2024-09-21T07:35:57.517159+0000","last_clean":"2024-09-21T07:35:57.517159+0000","last_became_active":"2024-09-21T07:35:56.546528+0000","last_became_peered":"2024-09-21T07:35:56.546528+0000","last_unstale":"2024-09-21T07:35:57.517159+0000","last_undegraded":"2024-09-21T07:35:57.517159+0000","last_fullsized":"2024-09-21T07:35:57.517159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:42.508204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549823+0000","last_change":"2024-09-21T07:35:56.545732+0000","last_active":"2024-09-21T07:35:56.549823+0000","last_peered":"2024-09-21T07:35:56.549823+0000","last_clean":"2024-09-21T07:35:56.549823+0000","last_became_active":"2024-09-21T07:35:56.545386+0000","last_became_peered":"2024-09-21T07:35:56.545386+0000","last_unstale":"2024-09-21T07:35:56.549823+0000","last_undegraded":"2024-09-21T07:35:56.549823+0000","last_fullsized":"2024-09-21T07:35:56.549823+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:04.460865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529944+0000","last_change":"2024-09-21T07:35:56.516896+0000","last_active":"2024-09-21T07:35:56.529944+0000","last_peered":"2024-09-21T07:35:56.529944+0000","last_clean":"2024-09-21T07:35:56.529944+0000","last_became_active":"2024-09-21T07:35:56.516577+0000","last_became_peered":"2024-09-21T07:35:56.516577+0000","last_unstale":"2024-09-21T07:35:56.529944+0000","last_undegraded":"2024-09-21T07:35:56.529944+0000","last_fullsized":"2024-09-21T07:35:56.529944+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:29.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544185+0000","last_change":"2024-09-21T07:35:56.538492+0000","last_active":"2024-09-21T07:35:56.544185+0000","last_peered":"2024-09-21T07:35:56.544185+0000","last_clean":"2024-09-21T07:35:56.544185+0000","last_became_active":"2024-09-21T07:35:56.537941+0000","last_became_peered":"2024-09-21T07:35:56.537941+0000","last_unstale":"2024-09-21T07:35:56.544185+0000","last_undegraded":"2024-09-21T07:35:56.544185+0000","last_fullsized":"2024-09-21T07:35:56.544185+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.199413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527631+0000","last_change":"2024-09-21T07:35:56.521689+0000","last_active":"2024-09-21T07:35:56.527631+0000","last_peered":"2024-09-21T07:35:56.527631+0000","last_clean":"2024-09-21T07:35:56.527631+0000","last_became_active":"2024-09-21T07:35:56.521019+0000","last_became_peered":"2024-09-21T07:35:56.521019+0000","last_unstale":"2024-09-21T07:35:56.527631+0000","last_undegraded":"2024-09-21T07:35:56.527631+0000","last_fullsized":"2024-09-21T07:35:56.527631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.590257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499044+0000","last_change":"2024-09-21T07:35:55.499044+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499044+0000","last_undegraded":"2024-09-21T07:35:55.499044+0000","last_fullsized":"2024-09-21T07:35:55.499044+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517795+0000","last_change":"2024-09-21T07:35:56.537610+0000","last_active":"2024-09-21T07:35:57.517795+0000","last_peered":"2024-09-21T07:35:57.517795+0000","last_clean":"2024-09-21T07:35:57.517795+0000","last_became_active":"2024-09-21T07:35:56.537302+0000","last_became_peered":"2024-09-21T07:35:56.537302+0000","last_unstale":"2024-09-21T07:35:57.517795+0000","last_undegraded":"2024-09-21T07:35:57.517795+0000","last_fullsized":"2024-09-21T07:35:57.517795+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:23.891119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517828+0000","last_change":"2024-09-21T07:35:56.530013+0000","last_active":"2024-09-21T07:35:57.517828+0000","last_peered":"2024-09-21T07:35:57.517828+0000","last_clean":"2024-09-21T07:35:57.517828+0000","last_became_active":"2024-09-21T07:35:56.529553+0000","last_became_peered":"2024-09-21T07:35:56.529553+0000","last_unstale":"2024-09-21T07:35:57.517828+0000","last_undegraded":"2024-09-21T07:35:57.517828+0000","last_fullsized":"2024-09-21T07:35:57.517828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:36.273322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.538335+0000","last_change":"2024-09-21T07:35:56.535980+0000","last_active":"2024-09-21T07:35:56.538335+0000","last_peered":"2024-09-21T07:35:56.538335+0000","last_clean":"2024-09-21T07:35:56.538335+0000","last_became_active":"2024-09-21T07:35:56.532666+0000","last_became_peered":"2024-09-21T07:35:56.532666+0000","last_unstale":"2024-09-21T07:35:56.538335+0000","last_undegraded":"2024-09-21T07:35:56.538335+0000","last_fullsized":"2024-09-21T07:35:56.538335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:17.343454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537998+0000","last_change":"2024-09-21T07:35:56.535093+0000","last_active":"2024-09-21T07:35:56.537998+0000","last_peered":"2024-09-21T07:35:56.537998+0000","last_clean":"2024-09-21T07:35:56.537998+0000","last_became_active":"2024-09-21T07:35:56.532682+0000","last_became_peered":"2024-09-21T07:35:56.532682+0000","last_unstale":"2024-09-21T07:35:56.537998+0000","last_undegraded":"2024-09-21T07:35:56.537998+0000","last_fullsized":"2024-09-21T07:35:56.537998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:23.972535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519035+0000","last_change":"2024-09-21T07:35:56.541017+0000","last_active":"2024-09-21T07:35:57.519035+0000","last_peered":"2024-09-21T07:35:57.519035+0000","last_clean":"2024-09-21T07:35:57.519035+0000","last_became_active":"2024-09-21T07:35:56.540691+0000","last_became_peered":"2024-09-21T07:35:56.540691+0000","last_unstale":"2024-09-21T07:35:57.519035+0000","last_undegraded":"2024-09-21T07:35:57.519035+0000","last_fullsized":"2024-09-21T07:35:57.519035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:40.675743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516622+0000","last_change":"2024-09-21T07:35:56.543465+0000","last_active":"2024-09-21T07:35:57.516622+0000","last_peered":"2024-09-21T07:35:57.516622+0000","last_clean":"2024-09-21T07:35:57.516622+0000","last_became_active":"2024-09-21T07:35:56.543121+0000","last_became_peered":"2024-09-21T07:35:56.543121+0000","last_unstale":"2024-09-21T07:35:57.516622+0000","last_undegraded":"2024-09-21T07:35:57.516622+0000","last_fullsized":"2024-09-21T07:35:57.516622+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:35.776811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517089+0000","last_change":"2024-09-21T07:35:56.521670+0000","last_active":"2024-09-21T07:35:57.517089+0000","last_peered":"2024-09-21T07:35:57.517089+0000","last_clean":"2024-09-21T07:35:57.517089+0000","last_became_active":"2024-09-21T07:35:56.521335+0000","last_became_peered":"2024-09-21T07:35:56.521335+0000","last_unstale":"2024-09-21T07:35:57.517089+0000","last_undegraded":"2024-09-21T07:35:57.517089+0000","last_fullsized":"2024-09-21T07:35:57.517089+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:44.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553103+0000","last_change":"2024-09-21T07:35:56.549097+0000","last_active":"2024-09-21T07:35:56.553103+0000","last_peered":"2024-09-21T07:35:56.553103+0000","last_clean":"2024-09-21T07:35:56.553103+0000","last_became_active":"2024-09-21T07:35:56.548774+0000","last_became_peered":"2024-09-21T07:35:56.548774+0000","last_unstale":"2024-09-21T07:35:56.553103+0000","last_undegraded":"2024-09-21T07:35:56.553103+0000","last_fullsized":"2024-09-21T07:35:56.553103+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:47.203701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541674+0000","last_change":"2024-09-21T07:35:56.537307+0000","last_active":"2024-09-21T07:35:56.541674+0000","last_peered":"2024-09-21T07:35:56.541674+0000","last_clean":"2024-09-21T07:35:56.541674+0000","last_became_active":"2024-09-21T07:35:56.536464+0000","last_became_peered":"2024-09-21T07:35:56.536464+0000","last_unstale":"2024-09-21T07:35:56.541674+0000","last_undegraded":"2024-09-21T07:35:56.541674+0000","last_fullsized":"2024-09-21T07:35:56.541674+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:10.782198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499552+0000","last_change":"2024-09-21T07:35:55.499552+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499552+0000","last_undegraded":"2024-09-21T07:35:55.499552+0000","last_fullsized":"2024-09-21T07:35:55.499552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517754+0000","last_change":"2024-09-21T07:35:55.507617+0000","last_active":"2024-09-21T07:35:57.517754+0000","last_peered":"2024-09-21T07:35:57.517754+0000","last_clean":"2024-09-21T07:35:57.517754+0000","last_became_active":"2024-09-21T07:35:55.507237+0000","last_became_peered":"2024-09-21T07:35:55.507237+0000","last_unstale":"2024-09-21T07:35:57.517754+0000","last_undegraded":"2024-09-21T07:35:57.517754+0000","last_fullsized":"2024-09-21T07:35:57.517754+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:33.418156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.528141+0000","last_change":"2024-09-21T07:35:56.525646+0000","last_active":"2024-09-21T07:35:56.528141+0000","last_peered":"2024-09-21T07:35:56.528141+0000","last_clean":"2024-09-21T07:35:56.528141+0000","last_became_active":"2024-09-21T07:35:56.525314+0000","last_became_peered":"2024-09-21T07:35:56.525314+0000","last_unstale":"2024-09-21T07:35:56.528141+0000","last_undegraded":"2024-09-21T07:35:56.528141+0000","last_fullsized":"2024-09-21T07:35:56.528141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:30.881896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.530655+0000","last_change":"2024-09-21T07:35:55.512414+0000","last_active":"2024-09-21T07:35:56.530655+0000","last_peered":"2024-09-21T07:35:56.530655+0000","last_clean":"2024-09-21T07:35:56.530655+0000","last_became_active":"2024-09-21T07:35:55.511521+0000","last_became_peered":"2024-09-21T07:35:55.511521+0000","last_unstale":"2024-09-21T07:35:56.530655+0000","last_undegraded":"2024-09-21T07:35:56.530655+0000","last_fullsized":"2024-09-21T07:35:56.530655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:32.733910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541575+0000","last_change":"2024-09-21T07:35:56.535286+0000","last_active":"2024-09-21T07:35:56.541575+0000","last_peered":"2024-09-21T07:35:56.541575+0000","last_clean":"2024-09-21T07:35:56.541575+0000","last_became_active":"2024-09-21T07:35:56.531371+0000","last_became_peered":"2024-09-21T07:35:56.531371+0000","last_unstale":"2024-09-21T07:35:56.541575+0000","last_undegraded":"2024-09-21T07:35:56.541575+0000","last_fullsized":"2024-09-21T07:35:56.541575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:12.067873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.514618+0000","last_change":"2024-09-21T07:35:55.513756+0000","last_active":"2024-09-21T07:35:55.514618+0000","last_peered":"2024-09-21T07:35:55.514618+0000","last_clean":"2024-09-21T07:35:55.514618+0000","last_became_active":"2024-09-21T07:35:55.513321+0000","last_became_peered":"2024-09-21T07:35:55.513321+0000","last_unstale":"2024-09-21T07:35:55.514618+0000","last_undegraded":"2024-09-21T07:35:55.514618+0000","last_fullsized":"2024-09-21T07:35:55.514618+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:16.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518481+0000","last_change":"2024-09-21T07:35:56.539610+0000","last_active":"2024-09-21T07:35:57.518481+0000","last_peered":"2024-09-21T07:35:57.518481+0000","last_clean":"2024-09-21T07:35:57.518481+0000","last_became_active":"2024-09-21T07:35:56.539303+0000","last_became_peered":"2024-09-21T07:35:56.539303+0000","last_unstale":"2024-09-21T07:35:57.518481+0000","last_undegraded":"2024-09-21T07:35:57.518481+0000","last_fullsized":"2024-09-21T07:35:57.518481+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:44.962547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516758+0000","last_change":"2024-09-21T07:35:55.510443+0000","last_active":"2024-09-21T07:35:57.516758+0000","last_peered":"2024-09-21T07:35:57.516758+0000","last_clean":"2024-09-21T07:35:57.516758+0000","last_became_active":"2024-09-21T07:35:55.510085+0000","last_became_peered":"2024-09-21T07:35:55.510085+0000","last_unstale":"2024-09-21T07:35:57.516758+0000","last_undegraded":"2024-09-21T07:35:57.516758+0000","last_fullsized":"2024-09-21T07:35:57.516758+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:04.391176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517372+0000","last_change":"2024-09-21T07:35:56.522754+0000","last_active":"2024-09-21T07:35:57.517372+0000","last_peered":"2024-09-21T07:35:57.517372+0000","last_clean":"2024-09-21T07:35:57.517372+0000","last_became_active":"2024-09-21T07:35:56.522452+0000","last_became_peered":"2024-09-21T07:35:56.522452+0000","last_unstale":"2024-09-21T07:35:57.517372+0000","last_undegraded":"2024-09-21T07:35:57.517372+0000","last_fullsized":"2024-09-21T07:35:57.517372+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:43.361943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536213+0000","last_change":"2024-09-21T07:35:55.517500+0000","last_active":"2024-09-21T07:35:56.536213+0000","last_peered":"2024-09-21T07:35:56.536213+0000","last_clean":"2024-09-21T07:35:56.536213+0000","last_became_active":"2024-09-21T07:35:55.517201+0000","last_became_peered":"2024-09-21T07:35:55.517201+0000","last_unstale":"2024-09-21T07:35:56.536213+0000","last_undegraded":"2024-09-21T07:35:56.536213+0000","last_fullsized":"2024-09-21T07:35:56.536213+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.619469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517331+0000","last_change":"2024-09-21T07:35:56.531499+0000","last_active":"2024-09-21T07:35:57.517331+0000","last_peered":"2024-09-21T07:35:57.517331+0000","last_clean":"2024-09-21T07:35:57.517331+0000","last_became_active":"2024-09-21T07:35:56.531146+0000","last_became_peered":"2024-09-21T07:35:56.531146+0000","last_unstale":"2024-09-21T07:35:57.517331+0000","last_undegraded":"2024-09-21T07:35:57.517331+0000","last_fullsized":"2024-09-21T07:35:57.517331+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522120+0000","last_change":"2024-09-21T07:35:55.517407+0000","last_active":"2024-09-21T07:35:56.522120+0000","last_peered":"2024-09-21T07:35:56.522120+0000","last_clean":"2024-09-21T07:35:56.522120+0000","last_became_active":"2024-09-21T07:35:55.517062+0000","last_became_peered":"2024-09-21T07:35:55.517062+0000","last_unstale":"2024-09-21T07:35:56.522120+0000","last_undegraded":"2024-09-21T07:35:56.522120+0000","last_fullsized":"2024-09-21T07:35:56.522120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:32.359923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517647+0000","last_change":"2024-09-21T07:35:56.536125+0000","last_active":"2024-09-21T07:35:57.517647+0000","last_peered":"2024-09-21T07:35:57.517647+0000","last_clean":"2024-09-21T07:35:57.517647+0000","last_became_active":"2024-09-21T07:35:56.535400+0000","last_became_peered":"2024-09-21T07:35:56.535400+0000","last_unstale":"2024-09-21T07:35:57.517647+0000","last_undegraded":"2024-09-21T07:35:57.517647+0000","last_fullsized":"2024-09-21T07:35:57.517647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.519168+0000","last_change":"2024-09-21T07:35:55.514583+0000","last_active":"2024-09-21T07:35:56.519168+0000","last_peered":"2024-09-21T07:35:56.519168+0000","last_clean":"2024-09-21T07:35:56.519168+0000","last_became_active":"2024-09-21T07:35:55.514197+0000","last_became_peered":"2024-09-21T07:35:55.514197+0000","last_unstale":"2024-09-21T07:35:56.519168+0000","last_undegraded":"2024-09-21T07:35:56.519168+0000","last_fullsized":"2024-09-21T07:35:56.519168+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:46.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516910+0000","last_change":"2024-09-21T07:35:56.515734+0000","last_active":"2024-09-21T07:35:57.516910+0000","last_peered":"2024-09-21T07:35:57.516910+0000","last_clean":"2024-09-21T07:35:57.516910+0000","last_became_active":"2024-09-21T07:35:56.515411+0000","last_became_peered":"2024-09-21T07:35:56.515411+0000","last_unstale":"2024-09-21T07:35:57.516910+0000","last_undegraded":"2024-09-21T07:35:57.516910+0000","last_fullsized":"2024-09-21T07:35:57.516910+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:26.754127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518959+0000","last_change":"2024-09-21T07:35:55.509338+0000","last_active":"2024-09-21T07:35:57.518959+0000","last_peered":"2024-09-21T07:35:57.518959+0000","last_clean":"2024-09-21T07:35:57.518959+0000","last_became_active":"2024-09-21T07:35:55.508913+0000","last_became_peered":"2024-09-21T07:35:55.508913+0000","last_unstale":"2024-09-21T07:35:57.518959+0000","last_undegraded":"2024-09-21T07:35:57.518959+0000","last_fullsized":"2024-09-21T07:35:57.518959+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:25.868297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541192+0000","last_change":"2024-09-21T07:35:56.534293+0000","last_active":"2024-09-21T07:35:56.541192+0000","last_peered":"2024-09-21T07:35:56.541192+0000","last_clean":"2024-09-21T07:35:56.541192+0000","last_became_active":"2024-09-21T07:35:56.533756+0000","last_became_peered":"2024-09-21T07:35:56.533756+0000","last_unstale":"2024-09-21T07:35:56.541192+0000","last_undegraded":"2024-09-21T07:35:56.541192+0000","last_fullsized":"2024-09-21T07:35:56.541192+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:19.301721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526134+0000","last_change":"2024-09-21T07:35:55.520395+0000","last_active":"2024-09-21T07:35:56.526134+0000","last_peered":"2024-09-21T07:35:56.526134+0000","last_clean":"2024-09-21T07:35:56.526134+0000","last_became_active":"2024-09-21T07:35:55.520048+0000","last_became_peered":"2024-09-21T07:35:55.520048+0000","last_unstale":"2024-09-21T07:35:56.526134+0000","last_undegraded":"2024-09-21T07:35:56.526134+0000","last_fullsized":"2024-09-21T07:35:56.526134+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:38.598370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516626+0000","last_change":"2024-09-21T07:35:56.535112+0000","last_active":"2024-09-21T07:35:57.516626+0000","last_peered":"2024-09-21T07:35:57.516626+0000","last_clean":"2024-09-21T07:35:57.516626+0000","last_became_active":"2024-09-21T07:35:56.534778+0000","last_became_peered":"2024-09-21T07:35:56.534778+0000","last_unstale":"2024-09-21T07:35:57.516626+0000","last_undegraded":"2024-09-21T07:35:57.516626+0000","last_fullsized":"2024-09-21T07:35:57.516626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:08.412784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517130+0000","last_change":"2024-09-21T07:35:55.516818+0000","last_active":"2024-09-21T07:35:57.517130+0000","last_peered":"2024-09-21T07:35:57.517130+0000","last_clean":"2024-09-21T07:35:57.517130+0000","last_became_active":"2024-09-21T07:35:55.516404+0000","last_became_peered":"2024-09-21T07:35:55.516404+0000","last_unstale":"2024-09-21T07:35:57.517130+0000","last_undegraded":"2024-09-21T07:35:57.517130+0000","last_fullsized":"2024-09-21T07:35:57.517130+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:28.596997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518816+0000","last_change":"2024-09-21T07:35:56.534487+0000","last_active":"2024-09-21T07:35:57.518816+0000","last_peered":"2024-09-21T07:35:57.518816+0000","last_clean":"2024-09-21T07:35:57.518816+0000","last_became_active":"2024-09-21T07:35:56.533641+0000","last_became_peered":"2024-09-21T07:35:56.533641+0000","last_unstale":"2024-09-21T07:35:57.518816+0000","last_undegraded":"2024-09-21T07:35:57.518816+0000","last_fullsized":"2024-09-21T07:35:57.518816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:06.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.552972+0000","last_change":"2024-09-21T07:35:55.518211+0000","last_active":"2024-09-21T07:35:56.552972+0000","last_peered":"2024-09-21T07:35:56.552972+0000","last_clean":"2024-09-21T07:35:56.552972+0000","last_became_active":"2024-09-21T07:35:55.517091+0000","last_became_peered":"2024-09-21T07:35:55.517091+0000","last_unstale":"2024-09-21T07:35:56.552972+0000","last_undegraded":"2024-09-21T07:35:56.552972+0000","last_fullsized":"2024-09-21T07:35:56.552972+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499051+0000","last_change":"2024-09-21T07:35:55.499051+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499051+0000","last_undegraded":"2024-09-21T07:35:55.499051+0000","last_fullsized":"2024-09-21T07:35:55.499051+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513089+0000","last_change":"2024-09-21T07:35:55.506824+0000","last_active":"2024-09-21T07:35:55.513089+0000","last_peered":"2024-09-21T07:35:55.513089+0000","last_clean":"2024-09-21T07:35:55.513089+0000","last_became_active":"2024-09-21T07:35:55.506484+0000","last_became_peered":"2024-09-21T07:35:55.506484+0000","last_unstale":"2024-09-21T07:35:55.513089+0000","last_undegraded":"2024-09-21T07:35:55.513089+0000","last_fullsized":"2024-09-21T07:35:55.513089+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:16.595081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.551653+0000","last_change":"2024-09-21T07:35:56.550098+0000","last_active":"2024-09-21T07:35:56.551653+0000","last_peered":"2024-09-21T07:35:56.551653+0000","last_clean":"2024-09-21T07:35:56.551653+0000","last_became_active":"2024-09-21T07:35:56.549567+0000","last_became_peered":"2024-09-21T07:35:56.549567+0000","last_unstale":"2024-09-21T07:35:56.551653+0000","last_undegraded":"2024-09-21T07:35:56.551653+0000","last_fullsized":"2024-09-21T07:35:56.551653+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:36.902299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.518734+0000","last_change":"2024-09-21T07:35:55.500793+0000","last_active":"2024-09-21T07:35:56.518734+0000","last_peered":"2024-09-21T07:35:56.518734+0000","last_clean":"2024-09-21T07:35:56.518734+0000","last_became_active":"2024-09-21T07:35:55.500461+0000","last_became_peered":"2024-09-21T07:35:55.500461+0000","last_unstale":"2024-09-21T07:35:56.518734+0000","last_undegraded":"2024-09-21T07:35:56.518734+0000","last_fullsized":"2024-09-21T07:35:56.518734+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:55.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517253+0000","last_change":"2024-09-21T07:35:56.548523+0000","last_active":"2024-09-21T07:35:57.517253+0000","last_peered":"2024-09-21T07:35:57.517253+0000","last_clean":"2024-09-21T07:35:57.517253+0000","last_became_active":"2024-09-21T07:35:56.548223+0000","last_became_peered":"2024-09-21T07:35:56.548223+0000","last_unstale":"2024-09-21T07:35:57.517253+0000","last_undegraded":"2024-09-21T07:35:57.517253+0000","last_fullsized":"2024-09-21T07:35:57.517253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:55.796410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516547+0000","last_change":"2024-09-21T07:35:55.518059+0000","last_active":"2024-09-21T07:35:57.516547+0000","last_peered":"2024-09-21T07:35:57.516547+0000","last_clean":"2024-09-21T07:35:57.516547+0000","last_became_active":"2024-09-21T07:35:55.517406+0000","last_became_peered":"2024-09-21T07:35:55.517406+0000","last_unstale":"2024-09-21T07:35:57.516547+0000","last_undegraded":"2024-09-21T07:35:57.516547+0000","last_fullsized":"2024-09-21T07:35:57.516547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:19.228872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.539212+0000","last_change":"2024-09-21T07:35:56.533846+0000","last_active":"2024-09-21T07:35:56.539212+0000","last_peered":"2024-09-21T07:35:56.539212+0000","last_clean":"2024-09-21T07:35:56.539212+0000","last_became_active":"2024-09-21T07:35:56.533430+0000","last_became_peered":"2024-09-21T07:35:56.533430+0000","last_unstale":"2024-09-21T07:35:56.539212+0000","last_undegraded":"2024-09-21T07:35:56.539212+0000","last_fullsized":"2024-09-21T07:35:56.539212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:59.062863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":23,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517932+0000","last_change":"2024-09-21T07:35:55.514195+0000","last_active":"2024-09-21T07:35:57.517932+0000","last_peered":"2024-09-21T07:35:57.517932+0000","last_clean":"2024-09-21T07:35:57.517932+0000","last_became_active":"2024-09-21T07:35:55.513310+0000","last_became_peered":"2024-09-21T07:35:55.513310+0000","last_unstale":"2024-09-21T07:35:57.517932+0000","last_undegraded":"2024-09-21T07:35:57.517932+0000","last_fullsized":"2024-09-21T07:35:57.517932+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541511+0000","last_change":"2024-09-21T07:35:56.537670+0000","last_active":"2024-09-21T07:35:56.541511+0000","last_peered":"2024-09-21T07:35:56.541511+0000","last_clean":"2024-09-21T07:35:56.541511+0000","last_became_active":"2024-09-21T07:35:56.535095+0000","last_became_peered":"2024-09-21T07:35:56.535095+0000","last_unstale":"2024-09-21T07:35:56.541511+0000","last_undegraded":"2024-09-21T07:35:56.541511+0000","last_fullsized":"2024-09-21T07:35:56.541511+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:34.569090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535689+0000","last_change":"2024-09-21T07:35:55.508297+0000","last_active":"2024-09-21T07:35:56.535689+0000","last_peered":"2024-09-21T07:35:56.535689+0000","last_clean":"2024-09-21T07:35:56.535689+0000","last_became_active":"2024-09-21T07:35:55.507986+0000","last_became_peered":"2024-09-21T07:35:55.507986+0000","last_unstale":"2024-09-21T07:35:56.535689+0000","last_undegraded":"2024-09-21T07:35:56.535689+0000","last_fullsized":"2024-09-21T07:35:56.535689+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:00.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526722+0000","last_change":"2024-09-21T07:35:56.523458+0000","last_active":"2024-09-21T07:35:56.526722+0000","last_peered":"2024-09-21T07:35:56.526722+0000","last_clean":"2024-09-21T07:35:56.526722+0000","last_became_active":"2024-09-21T07:35:56.522634+0000","last_became_peered":"2024-09-21T07:35:56.522634+0000","last_unstale":"2024-09-21T07:35:56.526722+0000","last_undegraded":"2024-09-21T07:35:56.526722+0000","last_fullsized":"2024-09-21T07:35:56.526722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:35.163475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":15,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537684+0000","last_change":"2024-09-21T07:35:55.511813+0000","last_active":"2024-09-21T07:35:56.537684+0000","last_peered":"2024-09-21T07:35:56.537684+0000","last_clean":"2024-09-21T07:35:56.537684+0000","last_became_active":"2024-09-21T07:35:55.511137+0000","last_became_peered":"2024-09-21T07:35:55.511137+0000","last_unstale":"2024-09-21T07:35:56.537684+0000","last_undegraded":"2024-09-21T07:35:56.537684+0000","last_fullsized":"2024-09-21T07:35:56.537684+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:20.145930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537342+0000","last_change":"2024-09-21T07:35:56.533636+0000","last_active":"2024-09-21T07:35:56.537342+0000","last_peered":"2024-09-21T07:35:56.537342+0000","last_clean":"2024-09-21T07:35:56.537342+0000","last_became_active":"2024-09-21T07:35:56.533340+0000","last_became_peered":"2024-09-21T07:35:56.533340+0000","last_unstale":"2024-09-21T07:35:56.537342+0000","last_undegraded":"2024-09-21T07:35:56.537342+0000","last_fullsized":"2024-09-21T07:35:56.537342+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:41.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513979+0000","last_change":"2024-09-21T07:35:55.512632+0000","last_active":"2024-09-21T07:35:55.513979+0000","last_peered":"2024-09-21T07:35:55.513979+0000","last_clean":"2024-09-21T07:35:55.513979+0000","last_became_active":"2024-09-21T07:35:55.511701+0000","last_became_peered":"2024-09-21T07:35:55.511701+0000","last_unstale":"2024-09-21T07:35:55.513979+0000","last_undegraded":"2024-09-21T07:35:55.513979+0000","last_fullsized":"2024-09-21T07:35:55.513979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:08.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541367+0000","last_change":"2024-09-21T07:35:56.535182+0000","last_active":"2024-09-21T07:35:56.541367+0000","last_peered":"2024-09-21T07:35:56.541367+0000","last_clean":"2024-09-21T07:35:56.541367+0000","last_became_active":"2024-09-21T07:35:56.530549+0000","last_became_peered":"2024-09-21T07:35:56.530549+0000","last_unstale":"2024-09-21T07:35:56.541367+0000","last_undegraded":"2024-09-21T07:35:56.541367+0000","last_fullsized":"2024-09-21T07:35:56.541367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:45.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518975+0000","last_change":"2024-09-21T07:35:55.511997+0000","last_active":"2024-09-21T07:35:57.518975+0000","last_peered":"2024-09-21T07:35:57.518975+0000","last_clean":"2024-09-21T07:35:57.518975+0000","last_became_active":"2024-09-21T07:35:55.511282+0000","last_became_peered":"2024-09-21T07:35:55.511282+0000","last_unstale":"2024-09-21T07:35:57.518975+0000","last_undegraded":"2024-09-21T07:35:57.518975+0000","last_fullsized":"2024-09-21T07:35:57.518975+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:59.004838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.498401+0000","last_change":"2024-09-21T07:35:55.498401+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.498401+0000","last_undegraded":"2024-09-21T07:35:55.498401+0000","last_fullsized":"2024-09-21T07:35:55.498401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518648+0000","last_change":"2024-09-21T07:35:55.507126+0000","last_active":"2024-09-21T07:35:57.518648+0000","last_peered":"2024-09-21T07:35:57.518648+0000","last_clean":"2024-09-21T07:35:57.518648+0000","last_became_active":"2024-09-21T07:35:55.506666+0000","last_became_peered":"2024-09-21T07:35:55.506666+0000","last_unstale":"2024-09-21T07:35:57.518648+0000","last_undegraded":"2024-09-21T07:35:57.518648+0000","last_fullsized":"2024-09-21T07:35:57.518648+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553096+0000","last_change":"2024-09-21T07:35:56.548916+0000","last_active":"2024-09-21T07:35:56.553096+0000","last_peered":"2024-09-21T07:35:56.553096+0000","last_clean":"2024-09-21T07:35:56.553096+0000","last_became_active":"2024-09-21T07:35:56.548631+0000","last_became_peered":"2024-09-21T07:35:56.548631+0000","last_unstale":"2024-09-21T07:35:56.553096+0000","last_undegraded":"2024-09-21T07:35:56.553096+0000","last_fullsized":"2024-09-21T07:35:56.553096+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:07.211518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.512630+0000","last_change":"2024-09-21T07:35:55.504973+0000","last_active":"2024-09-21T07:35:55.512630+0000","last_peered":"2024-09-21T07:35:55.512630+0000","last_clean":"2024-09-21T07:35:55.512630+0000","last_became_active":"2024-09-21T07:35:55.504600+0000","last_became_peered":"2024-09-21T07:35:55.504600+0000","last_unstale":"2024-09-21T07:35:55.512630+0000","last_undegraded":"2024-09-21T07:35:55.512630+0000","last_fullsized":"2024-09-21T07:35:55.512630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:08.767720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517377+0000","last_change":"2024-09-21T07:35:56.538836+0000","last_active":"2024-09-21T07:35:57.517377+0000","last_peered":"2024-09-21T07:35:57.517377+0000","last_clean":"2024-09-21T07:35:57.517377+0000","last_became_active":"2024-09-21T07:35:56.538514+0000","last_became_peered":"2024-09-21T07:35:56.538514+0000","last_unstale":"2024-09-21T07:35:57.517377+0000","last_undegraded":"2024-09-21T07:35:57.517377+0000","last_fullsized":"2024-09-21T07:35:57.517377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:23.823985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516955+0000","last_change":"2024-09-21T07:35:55.504947+0000","last_active":"2024-09-21T07:35:57.516955+0000","last_peered":"2024-09-21T07:35:57.516955+0000","last_clean":"2024-09-21T07:35:57.516955+0000","last_became_active":"2024-09-21T07:35:55.504601+0000","last_became_peered":"2024-09-21T07:35:55.504601+0000","last_unstale":"2024-09-21T07:35:57.516955+0000","last_undegraded":"2024-09-21T07:35:57.516955+0000","last_fullsized":"2024-09-21T07:35:57.516955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.728969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544576+0000","last_change":"2024-09-21T07:35:56.540065+0000","last_active":"2024-09-21T07:35:56.544576+0000","last_peered":"2024-09-21T07:35:56.544576+0000","last_clean":"2024-09-21T07:35:56.544576+0000","last_became_active":"2024-09-21T07:35:56.535568+0000","last_became_peered":"2024-09-21T07:35:56.535568+0000","last_unstale":"2024-09-21T07:35:56.544576+0000","last_undegraded":"2024-09-21T07:35:56.544576+0000","last_fullsized":"2024-09-21T07:35:56.544576+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:35.442810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514483+0000","last_change":"2024-09-21T07:35:55.514068+0000","last_active":"2024-09-21T07:35:56.514483+0000","last_peered":"2024-09-21T07:35:56.514483+0000","last_clean":"2024-09-21T07:35:56.514483+0000","last_became_active":"2024-09-21T07:35:55.513611+0000","last_became_peered":"2024-09-21T07:35:55.513611+0000","last_unstale":"2024-09-21T07:35:56.514483+0000","last_undegraded":"2024-09-21T07:35:56.514483+0000","last_fullsized":"2024-09-21T07:35:56.514483+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:50.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.542293+0000","last_change":"2024-09-21T07:35:56.538134+0000","last_active":"2024-09-21T07:35:56.542293+0000","last_peered":"2024-09-21T07:35:56.542293+0000","last_clean":"2024-09-21T07:35:56.542293+0000","last_became_active":"2024-09-21T07:35:56.535487+0000","last_became_peered":"2024-09-21T07:35:56.535487+0000","last_unstale":"2024-09-21T07:35:56.542293+0000","last_undegraded":"2024-09-21T07:35:56.542293+0000","last_fullsized":"2024-09-21T07:35:56.542293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:28.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517774+0000","last_change":"2024-09-21T07:35:55.517204+0000","last_active":"2024-09-21T07:35:57.517774+0000","last_peered":"2024-09-21T07:35:57.517774+0000","last_clean":"2024-09-21T07:35:57.517774+0000","last_became_active":"2024-09-21T07:35:55.516611+0000","last_became_peered":"2024-09-21T07:35:55.516611+0000","last_unstale":"2024-09-21T07:35:57.517774+0000","last_undegraded":"2024-09-21T07:35:57.517774+0000","last_fullsized":"2024-09-21T07:35:57.517774+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.047521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549490+0000","last_change":"2024-09-21T07:35:56.540592+0000","last_active":"2024-09-21T07:35:56.549490+0000","last_peered":"2024-09-21T07:35:56.549490+0000","last_clean":"2024-09-21T07:35:56.549490+0000","last_became_active":"2024-09-21T07:35:56.540269+0000","last_became_peered":"2024-09-21T07:35:56.540269+0000","last_unstale":"2024-09-21T07:35:56.549490+0000","last_undegraded":"2024-09-21T07:35:56.549490+0000","last_fullsized":"2024-09-21T07:35:56.549490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:58.810275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.515349+0000","last_change":"2024-09-21T07:35:55.503498+0000","last_active":"2024-09-21T07:35:57.515349+0000","last_peered":"2024-09-21T07:35:57.515349+0000","last_clean":"2024-09-21T07:35:57.515349+0000","last_became_active":"2024-09-21T07:35:55.503073+0000","last_became_peered":"2024-09-21T07:35:55.503073+0000","last_unstale":"2024-09-21T07:35:57.515349+0000","last_undegraded":"2024-09-21T07:35:57.515349+0000","last_fullsized":"2024-09-21T07:35:57.515349+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.889708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516961+0000","last_change":"2024-09-21T07:35:56.547899+0000","last_active":"2024-09-21T07:35:57.516961+0000","last_peered":"2024-09-21T07:35:57.516961+0000","last_clean":"2024-09-21T07:35:57.516961+0000","last_became_active":"2024-09-21T07:35:56.547572+0000","last_became_peered":"2024-09-21T07:35:56.547572+0000","last_unstale":"2024-09-21T07:35:57.516961+0000","last_undegraded":"2024-09-21T07:35:57.516961+0000","last_fullsized":"2024-09-21T07:35:57.516961+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:18.327833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517486+0000","last_change":"2024-09-21T07:35:55.506133+0000","last_active":"2024-09-21T07:35:57.517486+0000","last_peered":"2024-09-21T07:35:57.517486+0000","last_clean":"2024-09-21T07:35:57.517486+0000","last_became_active":"2024-09-21T07:35:55.505819+0000","last_became_peered":"2024-09-21T07:35:55.505819+0000","last_unstale":"2024-09-21T07:35:57.517486+0000","last_undegraded":"2024-09-21T07:35:57.517486+0000","last_fullsized":"2024-09-21T07:35:57.517486+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:50.225417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.531311+0000","last_change":"2024-09-21T07:35:56.528239+0000","last_active":"2024-09-21T07:35:56.531311+0000","last_peered":"2024-09-21T07:35:56.531311+0000","last_clean":"2024-09-21T07:35:56.531311+0000","last_became_active":"2024-09-21T07:35:56.527890+0000","last_became_peered":"2024-09-21T07:35:56.527890+0000","last_unstale":"2024-09-21T07:35:56.531311+0000","last_undegraded":"2024-09-21T07:35:56.531311+0000","last_fullsized":"2024-09-21T07:35:56.531311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:55.369124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514253+0000","last_change":"2024-09-21T07:35:55.516129+0000","last_active":"2024-09-21T07:35:56.514253+0000","last_peered":"2024-09-21T07:35:56.514253+0000","last_clean":"2024-09-21T07:35:56.514253+0000","last_became_active":"2024-09-21T07:35:55.515802+0000","last_became_peered":"2024-09-21T07:35:55.515802+0000","last_unstale":"2024-09-21T07:35:56.514253+0000","last_undegraded":"2024-09-21T07:35:56.514253+0000","last_fullsized":"2024-09-21T07:35:56.514253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:42.354336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.540281+0000","last_change":"2024-09-21T07:35:56.530807+0000","last_active":"2024-09-21T07:35:56.540281+0000","last_peered":"2024-09-21T07:35:56.540281+0000","last_clean":"2024-09-21T07:35:56.540281+0000","last_became_active":"2024-09-21T07:35:56.528662+0000","last_became_peered":"2024-09-21T07:35:56.528662+0000","last_unstale":"2024-09-21T07:35:56.540281+0000","last_undegraded":"2024-09-21T07:35:56.540281+0000","last_fullsized":"2024-09-21T07:35:56.540281+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:06.977730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.511669+0000","last_change":"2024-09-21T07:35:55.503586+0000","last_active":"2024-09-21T07:35:56.511669+0000","last_peered":"2024-09-21T07:35:56.511669+0000","last_clean":"2024-09-21T07:35:56.511669+0000","last_became_active":"2024-09-21T07:35:55.503160+0000","last_became_peered":"2024-09-21T07:35:55.503160+0000","last_unstale":"2024-09-21T07:35:56.511669+0000","last_undegraded":"2024-09-21T07:35:56.511669+0000","last_fullsized":"2024-09-21T07:35:56.511669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:20.237989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536253+0000","last_change":"2024-09-21T07:35:56.532396+0000","last_active":"2024-09-21T07:35:56.536253+0000","last_peered":"2024-09-21T07:35:56.536253+0000","last_clean":"2024-09-21T07:35:56.536253+0000","last_became_active":"2024-09-21T07:35:56.532062+0000","last_became_peered":"2024-09-21T07:35:56.532062+0000","last_unstale":"2024-09-21T07:35:56.536253+0000","last_undegraded":"2024-09-21T07:35:56.536253+0000","last_fullsized":"2024-09-21T07:35:56.536253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.129335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516875+0000","last_change":"2024-09-21T07:35:55.511105+0000","last_active":"2024-09-21T07:35:57.516875+0000","last_peered":"2024-09-21T07:35:57.516875+0000","last_clean":"2024-09-21T07:35:57.516875+0000","last_became_active":"2024-09-21T07:35:55.510724+0000","last_became_peered":"2024-09-21T07:35:55.510724+0000","last_unstale":"2024-09-21T07:35:57.516875+0000","last_undegraded":"2024-09-21T07:35:57.516875+0000","last_fullsized":"2024-09-21T07:35:57.516875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:13.044173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553026+0000","last_change":"2024-09-21T07:35:56.545891+0000","last_active":"2024-09-21T07:35:56.553026+0000","last_peered":"2024-09-21T07:35:56.553026+0000","last_clean":"2024-09-21T07:35:56.553026+0000","last_became_active":"2024-09-21T07:35:56.545486+0000","last_became_peered":"2024-09-21T07:35:56.545486+0000","last_unstale":"2024-09-21T07:35:56.553026+0000","last_undegraded":"2024-09-21T07:35:56.553026+0000","last_fullsized":"2024-09-21T07:35:56.553026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:28.119364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.516814+0000","last_change":"2024-09-21T07:35:55.506044+0000","last_active":"2024-09-21T07:35:56.516814+0000","last_peered":"2024-09-21T07:35:56.516814+0000","last_clean":"2024-09-21T07:35:56.516814+0000","last_became_active":"2024-09-21T07:35:55.505749+0000","last_became_peered":"2024-09-21T07:35:55.505749+0000","last_unstale":"2024-09-21T07:35:56.516814+0000","last_undegraded":"2024-09-21T07:35:56.516814+0000","last_fullsized":"2024-09-21T07:35:56.516814+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:14.718347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549536+0000","last_change":"2024-09-21T07:35:56.543636+0000","last_active":"2024-09-21T07:35:56.549536+0000","last_peered":"2024-09-21T07:35:56.549536+0000","last_clean":"2024-09-21T07:35:56.549536+0000","last_became_active":"2024-09-21T07:35:56.543332+0000","last_became_peered":"2024-09-21T07:35:56.543332+0000","last_unstale":"2024-09-21T07:35:56.549536+0000","last_undegraded":"2024-09-21T07:35:56.549536+0000","last_fullsized":"2024-09-21T07:35:56.549536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:30.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519097+0000","last_change":"2024-09-21T07:35:55.504949+0000","last_active":"2024-09-21T07:35:57.519097+0000","last_peered":"2024-09-21T07:35:57.519097+0000","last_clean":"2024-09-21T07:35:57.519097+0000","last_became_active":"2024-09-21T07:35:55.504623+0000","last_became_peered":"2024-09-21T07:35:55.504623+0000","last_unstale":"2024-09-21T07:35:57.519097+0000","last_undegraded":"2024-09-21T07:35:57.519097+0000","last_fullsized":"2024-09-21T07:35:57.519097+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:14.464426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.532329+0000","last_change":"2024-09-21T07:35:56.531233+0000","last_active":"2024-09-21T07:35:56.532329+0000","last_peered":"2024-09-21T07:35:56.532329+0000","last_clean":"2024-09-21T07:35:56.532329+0000","last_became_active":"2024-09-21T07:35:56.529247+0000","last_became_peered":"2024-09-21T07:35:56.529247+0000","last_unstale":"2024-09-21T07:35:56.532329+0000","last_undegraded":"2024-09-21T07:35:56.532329+0000","last_fullsized":"2024-09-21T07:35:56.532329+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:24.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516761+0000","last_change":"2024-09-21T07:35:55.513811+0000","last_active":"2024-09-21T07:35:57.516761+0000","last_peered":"2024-09-21T07:35:57.516761+0000","last_clean":"2024-09-21T07:35:57.516761+0000","last_became_active":"2024-09-21T07:35:55.513193+0000","last_became_peered":"2024-09-21T07:35:55.513193+0000","last_unstale":"2024-09-21T07:35:57.516761+0000","last_undegraded":"2024-09-21T07:35:57.516761+0000","last_fullsized":"2024-09-21T07:35:57.516761+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":419,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522727+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:56.522727+0000","last_peered":"2024-09-21T07:35:56.522727+0000","last_clean":"2024-09-21T07:35:56.522727+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:56.522727+0000","last_undegraded":"2024-09-21T07:35:56.522727+0000","last_fullsized":"2024-09-21T07:35:56.522727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55752,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316088,"statfs":{"total":96636764160,"available":96579674112,"internally_reserved":0,"allocated":2404352,"data_stored":1130910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1128772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64060,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307780,"statfs":{"total":96636764160,"available":96571166720,"internally_reserved":0,"allocated":2392064,"data_stored":1129298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509604,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2392064,"data_stored":1128806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1128716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509604,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56316,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315524,"statfs":{"total":96636764160,"available":96579096576,"internally_reserved":0,"allocated":2985984,"data_stored":1719174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542308,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56328,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315512,"statfs":{"total":96636764160,"available":96579084288,"internally_reserved":0,"allocated":2998272,"data_stored":1720766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87588,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284252,"statfs":{"total":96636764160,"available":96547074048,"internally_reserved":0,"allocated":2375680,"data_stored":1121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:36:01.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:36:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- 172.21.15.64:0/3237747217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 msgr2=0x7f39700cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 --2- 172.21.15.64:0/3237747217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39700cbcd0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f3968009c80 tx=0x7f396801cd30 comp rx=0 tx=0).stop 2024-09-21T07:36:01.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- 172.21.15.64:0/3237747217 shutdown_connections 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 --2- 172.21.15.64:0/3237747217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39700cbcd0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 --2- 172.21.15.64:0/3237747217 >> v2:172.21.15.90:3300/0 conn(0x7f3970070850 0x7f39700b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 --2- 172.21.15.64:0/3237747217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f397015cbd0 0x7f3970070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- 172.21.15.64:0/3237747217 >> 172.21.15.64:0/3237747217 conn(0x7f39700ccbe0 msgr2=0x7f39700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- 172.21.15.64:0/3237747217 shutdown_connections 2024-09-21T07:36:01.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- 172.21.15.64:0/3237747217 wait complete. 2024-09-21T07:36:01.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 Processor -- start 2024-09-21T07:36:01.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.340+0000 7f3974e00640 1 -- start start 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3970070850 0x7f397015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f397015cbd0 0x7f397009afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f397006fa80 con 0x7f39700b2120 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f397006f900 con 0x7f397015cbd0 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f39700b2fb0 con 0x7f3970070850 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53338/0 (socket says 172.21.15.64:53338) 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 -- 172.21.15.64:0/1617650750 learned_addr learned my addr 172.21.15.64:0/1617650750 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f396de00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3970070850 0x7f397015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f396e800640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f397015cbd0 0x7f397009afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 -- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3970070850 msgr2=0x7f397015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3970070850 0x7f397015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 -- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f397015cbd0 msgr2=0x7f397009afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f397015cbd0 0x7f397009afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 -- 172.21.15.64:0/1617650750 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397015bda0 con 0x7f39700b2120 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3965400640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f395800d5f0 tx=0x7f395800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958017070 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3958005310 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39580047b0 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39701f8ff0 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39701f95b0 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39700cbcd0 con 0x7f39700b2120 2024-09-21T07:36:01.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.344+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3958004950 con 0x7f39700b2120 2024-09-21T07:36:01.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.348+0000 7f3966a00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 0x7f394c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.348+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f39580941d0 con 0x7f39700b2120 2024-09-21T07:36:01.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.348+0000 7f396de00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 0x7f394c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.348+0000 7f396de00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 0x7f394c075740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f396000bb50 tx=0x7f396000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:01.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.352+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f395805ea80 con 0x7f39700b2120 2024-09-21T07:36:01.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.524+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39700cd200 con 0x7f394c073230 2024-09-21T07:36:01.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.528+0000 7f3966a00640 1 -- 172.21.15.64:0/1617650750 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252054 (secure 0 0 0) 0x7f39700cd200 con 0x7f394c073230 2024-09-21T07:36:01.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:01.536 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 msgr2=0x7f394c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 0x7f394c075740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f396000bb50 tx=0x7f396000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 msgr2=0x7f39701511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f395800d5f0 tx=0x7f395800dab0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 shutdown_connections 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f394c073230 0x7f394c075740 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f397015cbd0 0x7f397009afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39700b2120 0x7f39701511b0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 --2- 172.21.15.64:0/1617650750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3970070850 0x7f397015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 >> 172.21.15.64:0/1617650750 conn(0x7f39700ccbe0 msgr2=0x7f39700c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:01.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 shutdown_connections 2024-09-21T07:36:01.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.532+0000 7f3974e00640 1 -- 172.21.15.64:0/1617650750 wait complete. 2024-09-21T07:36:01.557 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-21T07:35:59.638747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":499724,"kb_used_data":19856,"kb_used_omap":12,"kb_used_meta":479667,"kb_avail":754474996,"statfs":{"total":773094113280,"available":772582395904,"internally_reserved":0,"allocated":20332544,"data_stored":10207991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":491179571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.152141"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535189+0000","last_change":"2024-09-21T07:35:56.532076+0000","last_active":"2024-09-21T07:35:56.535189+0000","last_peered":"2024-09-21T07:35:56.535189+0000","last_clean":"2024-09-21T07:35:56.535189+0000","last_became_active":"2024-09-21T07:35:56.531712+0000","last_became_peered":"2024-09-21T07:35:56.531712+0000","last_unstale":"2024-09-21T07:35:56.535189+0000","last_undegraded":"2024-09-21T07:35:56.535189+0000","last_fullsized":"2024-09-21T07:35:56.535189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:08.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499718+0000","last_change":"2024-09-21T07:35:55.499718+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499718+0000","last_undegraded":"2024-09-21T07:35:55.499718+0000","last_fullsized":"2024-09-21T07:35:55.499718+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541694+0000","last_change":"2024-09-21T07:35:56.539434+0000","last_active":"2024-09-21T07:35:56.541694+0000","last_peered":"2024-09-21T07:35:56.541694+0000","last_clean":"2024-09-21T07:35:56.541694+0000","last_became_active":"2024-09-21T07:35:56.538261+0000","last_became_peered":"2024-09-21T07:35:56.538261+0000","last_unstale":"2024-09-21T07:35:56.541694+0000","last_undegraded":"2024-09-21T07:35:56.541694+0000","last_fullsized":"2024-09-21T07:35:56.541694+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:06.743615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549725+0000","last_change":"2024-09-21T07:35:56.541396+0000","last_active":"2024-09-21T07:35:56.549725+0000","last_peered":"2024-09-21T07:35:56.549725+0000","last_clean":"2024-09-21T07:35:56.549725+0000","last_became_active":"2024-09-21T07:35:56.540086+0000","last_became_peered":"2024-09-21T07:35:56.540086+0000","last_unstale":"2024-09-21T07:35:56.549725+0000","last_undegraded":"2024-09-21T07:35:56.549725+0000","last_fullsized":"2024-09-21T07:35:56.549725+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:11.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518252+0000","last_change":"2024-09-21T07:35:56.546056+0000","last_active":"2024-09-21T07:35:57.518252+0000","last_peered":"2024-09-21T07:35:57.518252+0000","last_clean":"2024-09-21T07:35:57.518252+0000","last_became_active":"2024-09-21T07:35:56.545732+0000","last_became_peered":"2024-09-21T07:35:56.545732+0000","last_unstale":"2024-09-21T07:35:57.518252+0000","last_undegraded":"2024-09-21T07:35:57.518252+0000","last_fullsized":"2024-09-21T07:35:57.518252+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:21.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541633+0000","last_change":"2024-09-21T07:35:56.537816+0000","last_active":"2024-09-21T07:35:56.541633+0000","last_peered":"2024-09-21T07:35:56.541633+0000","last_clean":"2024-09-21T07:35:56.541633+0000","last_became_active":"2024-09-21T07:35:56.536912+0000","last_became_peered":"2024-09-21T07:35:56.536912+0000","last_unstale":"2024-09-21T07:35:56.541633+0000","last_undegraded":"2024-09-21T07:35:56.541633+0000","last_fullsized":"2024-09-21T07:35:56.541633+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:00.409316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517848+0000","last_change":"2024-09-21T07:35:56.547623+0000","last_active":"2024-09-21T07:35:57.517848+0000","last_peered":"2024-09-21T07:35:57.517848+0000","last_clean":"2024-09-21T07:35:57.517848+0000","last_became_active":"2024-09-21T07:35:56.547341+0000","last_became_peered":"2024-09-21T07:35:56.547341+0000","last_unstale":"2024-09-21T07:35:57.517848+0000","last_undegraded":"2024-09-21T07:35:57.517848+0000","last_fullsized":"2024-09-21T07:35:57.517848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529072+0000","last_change":"2024-09-21T07:35:56.523945+0000","last_active":"2024-09-21T07:35:56.529072+0000","last_peered":"2024-09-21T07:35:56.529072+0000","last_clean":"2024-09-21T07:35:56.529072+0000","last_became_active":"2024-09-21T07:35:56.523614+0000","last_became_peered":"2024-09-21T07:35:56.523614+0000","last_unstale":"2024-09-21T07:35:56.529072+0000","last_undegraded":"2024-09-21T07:35:56.529072+0000","last_fullsized":"2024-09-21T07:35:56.529072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:46.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517191+0000","last_change":"2024-09-21T07:35:56.530699+0000","last_active":"2024-09-21T07:35:57.517191+0000","last_peered":"2024-09-21T07:35:57.517191+0000","last_clean":"2024-09-21T07:35:57.517191+0000","last_became_active":"2024-09-21T07:35:56.530406+0000","last_became_peered":"2024-09-21T07:35:56.530406+0000","last_unstale":"2024-09-21T07:35:57.517191+0000","last_undegraded":"2024-09-21T07:35:57.517191+0000","last_fullsized":"2024-09-21T07:35:57.517191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:30.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541230+0000","last_change":"2024-09-21T07:35:56.534740+0000","last_active":"2024-09-21T07:35:56.541230+0000","last_peered":"2024-09-21T07:35:56.541230+0000","last_clean":"2024-09-21T07:35:56.541230+0000","last_became_active":"2024-09-21T07:35:56.534420+0000","last_became_peered":"2024-09-21T07:35:56.534420+0000","last_unstale":"2024-09-21T07:35:56.541230+0000","last_undegraded":"2024-09-21T07:35:56.541230+0000","last_fullsized":"2024-09-21T07:35:56.541230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:22.523823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537965+0000","last_change":"2024-09-21T07:35:56.534031+0000","last_active":"2024-09-21T07:35:56.537965+0000","last_peered":"2024-09-21T07:35:56.537965+0000","last_clean":"2024-09-21T07:35:56.537965+0000","last_became_active":"2024-09-21T07:35:56.533080+0000","last_became_peered":"2024-09-21T07:35:56.533080+0000","last_unstale":"2024-09-21T07:35:56.537965+0000","last_undegraded":"2024-09-21T07:35:56.537965+0000","last_fullsized":"2024-09-21T07:35:56.537965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:17.039270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518497+0000","last_change":"2024-09-21T07:35:56.542875+0000","last_active":"2024-09-21T07:35:57.518497+0000","last_peered":"2024-09-21T07:35:57.518497+0000","last_clean":"2024-09-21T07:35:57.518497+0000","last_became_active":"2024-09-21T07:35:56.541115+0000","last_became_peered":"2024-09-21T07:35:56.541115+0000","last_unstale":"2024-09-21T07:35:57.518497+0000","last_undegraded":"2024-09-21T07:35:57.518497+0000","last_fullsized":"2024-09-21T07:35:57.518497+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:17.995132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553046+0000","last_change":"2024-09-21T07:35:56.546633+0000","last_active":"2024-09-21T07:35:56.553046+0000","last_peered":"2024-09-21T07:35:56.553046+0000","last_clean":"2024-09-21T07:35:56.553046+0000","last_became_active":"2024-09-21T07:35:56.546330+0000","last_became_peered":"2024-09-21T07:35:56.546330+0000","last_unstale":"2024-09-21T07:35:56.553046+0000","last_undegraded":"2024-09-21T07:35:56.553046+0000","last_fullsized":"2024-09-21T07:35:56.553046+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.103527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527661+0000","last_change":"2024-09-21T07:35:56.522008+0000","last_active":"2024-09-21T07:35:56.527661+0000","last_peered":"2024-09-21T07:35:56.527661+0000","last_clean":"2024-09-21T07:35:56.527661+0000","last_became_active":"2024-09-21T07:35:56.521403+0000","last_became_peered":"2024-09-21T07:35:56.521403+0000","last_unstale":"2024-09-21T07:35:56.527661+0000","last_undegraded":"2024-09-21T07:35:56.527661+0000","last_fullsized":"2024-09-21T07:35:56.527661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:43.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517004+0000","last_change":"2024-09-21T07:35:56.515225+0000","last_active":"2024-09-21T07:35:57.517004+0000","last_peered":"2024-09-21T07:35:57.517004+0000","last_clean":"2024-09-21T07:35:57.517004+0000","last_became_active":"2024-09-21T07:35:56.513973+0000","last_became_peered":"2024-09-21T07:35:56.513973+0000","last_unstale":"2024-09-21T07:35:57.517004+0000","last_undegraded":"2024-09-21T07:35:57.517004+0000","last_fullsized":"2024-09-21T07:35:57.517004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:22.147149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536045+0000","last_change":"2024-09-21T07:35:56.530415+0000","last_active":"2024-09-21T07:35:56.536045+0000","last_peered":"2024-09-21T07:35:56.536045+0000","last_clean":"2024-09-21T07:35:56.536045+0000","last_became_active":"2024-09-21T07:35:56.530079+0000","last_became_peered":"2024-09-21T07:35:56.530079+0000","last_unstale":"2024-09-21T07:35:56.536045+0000","last_undegraded":"2024-09-21T07:35:56.536045+0000","last_fullsized":"2024-09-21T07:35:56.536045+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:05.322121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517424+0000","last_change":"2024-09-21T07:35:56.546948+0000","last_active":"2024-09-21T07:35:57.517424+0000","last_peered":"2024-09-21T07:35:57.517424+0000","last_clean":"2024-09-21T07:35:57.517424+0000","last_became_active":"2024-09-21T07:35:56.546426+0000","last_became_peered":"2024-09-21T07:35:56.546426+0000","last_unstale":"2024-09-21T07:35:57.517424+0000","last_undegraded":"2024-09-21T07:35:57.517424+0000","last_fullsized":"2024-09-21T07:35:57.517424+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:00.228007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517159+0000","last_change":"2024-09-21T07:35:56.546840+0000","last_active":"2024-09-21T07:35:57.517159+0000","last_peered":"2024-09-21T07:35:57.517159+0000","last_clean":"2024-09-21T07:35:57.517159+0000","last_became_active":"2024-09-21T07:35:56.546528+0000","last_became_peered":"2024-09-21T07:35:56.546528+0000","last_unstale":"2024-09-21T07:35:57.517159+0000","last_undegraded":"2024-09-21T07:35:57.517159+0000","last_fullsized":"2024-09-21T07:35:57.517159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:42.508204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549823+0000","last_change":"2024-09-21T07:35:56.545732+0000","last_active":"2024-09-21T07:35:56.549823+0000","last_peered":"2024-09-21T07:35:56.549823+0000","last_clean":"2024-09-21T07:35:56.549823+0000","last_became_active":"2024-09-21T07:35:56.545386+0000","last_became_peered":"2024-09-21T07:35:56.545386+0000","last_unstale":"2024-09-21T07:35:56.549823+0000","last_undegraded":"2024-09-21T07:35:56.549823+0000","last_fullsized":"2024-09-21T07:35:56.549823+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:04.460865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529944+0000","last_change":"2024-09-21T07:35:56.516896+0000","last_active":"2024-09-21T07:35:56.529944+0000","last_peered":"2024-09-21T07:35:56.529944+0000","last_clean":"2024-09-21T07:35:56.529944+0000","last_became_active":"2024-09-21T07:35:56.516577+0000","last_became_peered":"2024-09-21T07:35:56.516577+0000","last_unstale":"2024-09-21T07:35:56.529944+0000","last_undegraded":"2024-09-21T07:35:56.529944+0000","last_fullsized":"2024-09-21T07:35:56.529944+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:29.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544185+0000","last_change":"2024-09-21T07:35:56.538492+0000","last_active":"2024-09-21T07:35:56.544185+0000","last_peered":"2024-09-21T07:35:56.544185+0000","last_clean":"2024-09-21T07:35:56.544185+0000","last_became_active":"2024-09-21T07:35:56.537941+0000","last_became_peered":"2024-09-21T07:35:56.537941+0000","last_unstale":"2024-09-21T07:35:56.544185+0000","last_undegraded":"2024-09-21T07:35:56.544185+0000","last_fullsized":"2024-09-21T07:35:56.544185+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.199413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527631+0000","last_change":"2024-09-21T07:35:56.521689+0000","last_active":"2024-09-21T07:35:56.527631+0000","last_peered":"2024-09-21T07:35:56.527631+0000","last_clean":"2024-09-21T07:35:56.527631+0000","last_became_active":"2024-09-21T07:35:56.521019+0000","last_became_peered":"2024-09-21T07:35:56.521019+0000","last_unstale":"2024-09-21T07:35:56.527631+0000","last_undegraded":"2024-09-21T07:35:56.527631+0000","last_fullsized":"2024-09-21T07:35:56.527631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.590257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499044+0000","last_change":"2024-09-21T07:35:55.499044+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499044+0000","last_undegraded":"2024-09-21T07:35:55.499044+0000","last_fullsized":"2024-09-21T07:35:55.499044+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517795+0000","last_change":"2024-09-21T07:35:56.537610+0000","last_active":"2024-09-21T07:35:57.517795+0000","last_peered":"2024-09-21T07:35:57.517795+0000","last_clean":"2024-09-21T07:35:57.517795+0000","last_became_active":"2024-09-21T07:35:56.537302+0000","last_became_peered":"2024-09-21T07:35:56.537302+0000","last_unstale":"2024-09-21T07:35:57.517795+0000","last_undegraded":"2024-09-21T07:35:57.517795+0000","last_fullsized":"2024-09-21T07:35:57.517795+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:23.891119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517828+0000","last_change":"2024-09-21T07:35:56.530013+0000","last_active":"2024-09-21T07:35:57.517828+0000","last_peered":"2024-09-21T07:35:57.517828+0000","last_clean":"2024-09-21T07:35:57.517828+0000","last_became_active":"2024-09-21T07:35:56.529553+0000","last_became_peered":"2024-09-21T07:35:56.529553+0000","last_unstale":"2024-09-21T07:35:57.517828+0000","last_undegraded":"2024-09-21T07:35:57.517828+0000","last_fullsized":"2024-09-21T07:35:57.517828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:36.273322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.538335+0000","last_change":"2024-09-21T07:35:56.535980+0000","last_active":"2024-09-21T07:35:56.538335+0000","last_peered":"2024-09-21T07:35:56.538335+0000","last_clean":"2024-09-21T07:35:56.538335+0000","last_became_active":"2024-09-21T07:35:56.532666+0000","last_became_peered":"2024-09-21T07:35:56.532666+0000","last_unstale":"2024-09-21T07:35:56.538335+0000","last_undegraded":"2024-09-21T07:35:56.538335+0000","last_fullsized":"2024-09-21T07:35:56.538335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:17.343454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537998+0000","last_change":"2024-09-21T07:35:56.535093+0000","last_active":"2024-09-21T07:35:56.537998+0000","last_peered":"2024-09-21T07:35:56.537998+0000","last_clean":"2024-09-21T07:35:56.537998+0000","last_became_active":"2024-09-21T07:35:56.532682+0000","last_became_peered":"2024-09-21T07:35:56.532682+0000","last_unstale":"2024-09-21T07:35:56.537998+0000","last_undegraded":"2024-09-21T07:35:56.537998+0000","last_fullsized":"2024-09-21T07:35:56.537998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:23.972535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519035+0000","last_change":"2024-09-21T07:35:56.541017+0000","last_active":"2024-09-21T07:35:57.519035+0000","last_peered":"2024-09-21T07:35:57.519035+0000","last_clean":"2024-09-21T07:35:57.519035+0000","last_became_active":"2024-09-21T07:35:56.540691+0000","last_became_peered":"2024-09-21T07:35:56.540691+0000","last_unstale":"2024-09-21T07:35:57.519035+0000","last_undegraded":"2024-09-21T07:35:57.519035+0000","last_fullsized":"2024-09-21T07:35:57.519035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:40.675743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516622+0000","last_change":"2024-09-21T07:35:56.543465+0000","last_active":"2024-09-21T07:35:57.516622+0000","last_peered":"2024-09-21T07:35:57.516622+0000","last_clean":"2024-09-21T07:35:57.516622+0000","last_became_active":"2024-09-21T07:35:56.543121+0000","last_became_peered":"2024-09-21T07:35:56.543121+0000","last_unstale":"2024-09-21T07:35:57.516622+0000","last_undegraded":"2024-09-21T07:35:57.516622+0000","last_fullsized":"2024-09-21T07:35:57.516622+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:35.776811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517089+0000","last_change":"2024-09-21T07:35:56.521670+0000","last_active":"2024-09-21T07:35:57.517089+0000","last_peered":"2024-09-21T07:35:57.517089+0000","last_clean":"2024-09-21T07:35:57.517089+0000","last_became_active":"2024-09-21T07:35:56.521335+0000","last_became_peered":"2024-09-21T07:35:56.521335+0000","last_unstale":"2024-09-21T07:35:57.517089+0000","last_undegraded":"2024-09-21T07:35:57.517089+0000","last_fullsized":"2024-09-21T07:35:57.517089+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:44.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553103+0000","last_change":"2024-09-21T07:35:56.549097+0000","last_active":"2024-09-21T07:35:56.553103+0000","last_peered":"2024-09-21T07:35:56.553103+0000","last_clean":"2024-09-21T07:35:56.553103+0000","last_became_active":"2024-09-21T07:35:56.548774+0000","last_became_peered":"2024-09-21T07:35:56.548774+0000","last_unstale":"2024-09-21T07:35:56.553103+0000","last_undegraded":"2024-09-21T07:35:56.553103+0000","last_fullsized":"2024-09-21T07:35:56.553103+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:47.203701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541674+0000","last_change":"2024-09-21T07:35:56.537307+0000","last_active":"2024-09-21T07:35:56.541674+0000","last_peered":"2024-09-21T07:35:56.541674+0000","last_clean":"2024-09-21T07:35:56.541674+0000","last_became_active":"2024-09-21T07:35:56.536464+0000","last_became_peered":"2024-09-21T07:35:56.536464+0000","last_unstale":"2024-09-21T07:35:56.541674+0000","last_undegraded":"2024-09-21T07:35:56.541674+0000","last_fullsized":"2024-09-21T07:35:56.541674+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:10.782198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499552+0000","last_change":"2024-09-21T07:35:55.499552+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499552+0000","last_undegraded":"2024-09-21T07:35:55.499552+0000","last_fullsized":"2024-09-21T07:35:55.499552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517754+0000","last_change":"2024-09-21T07:35:55.507617+0000","last_active":"2024-09-21T07:35:57.517754+0000","last_peered":"2024-09-21T07:35:57.517754+0000","last_clean":"2024-09-21T07:35:57.517754+0000","last_became_active":"2024-09-21T07:35:55.507237+0000","last_became_peered":"2024-09-21T07:35:55.507237+0000","last_unstale":"2024-09-21T07:35:57.517754+0000","last_undegraded":"2024-09-21T07:35:57.517754+0000","last_fullsized":"2024-09-21T07:35:57.517754+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:33.418156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.528141+0000","last_change":"2024-09-21T07:35:56.525646+0000","last_active":"2024-09-21T07:35:56.528141+0000","last_peered":"2024-09-21T07:35:56.528141+0000","last_clean":"2024-09-21T07:35:56.528141+0000","last_became_active":"2024-09-21T07:35:56.525314+0000","last_became_peered":"2024-09-21T07:35:56.525314+0000","last_unstale":"2024-09-21T07:35:56.528141+0000","last_undegraded":"2024-09-21T07:35:56.528141+0000","last_fullsized":"2024-09-21T07:35:56.528141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:30.881896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.530655+0000","last_change":"2024-09-21T07:35:55.512414+0000","last_active":"2024-09-21T07:35:56.530655+0000","last_peered":"2024-09-21T07:35:56.530655+0000","last_clean":"2024-09-21T07:35:56.530655+0000","last_became_active":"2024-09-21T07:35:55.511521+0000","last_became_peered":"2024-09-21T07:35:55.511521+0000","last_unstale":"2024-09-21T07:35:56.530655+0000","last_undegraded":"2024-09-21T07:35:56.530655+0000","last_fullsized":"2024-09-21T07:35:56.530655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:32.733910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541575+0000","last_change":"2024-09-21T07:35:56.535286+0000","last_active":"2024-09-21T07:35:56.541575+0000","last_peered":"2024-09-21T07:35:56.541575+0000","last_clean":"2024-09-21T07:35:56.541575+0000","last_became_active":"2024-09-21T07:35:56.531371+0000","last_became_peered":"2024-09-21T07:35:56.531371+0000","last_unstale":"2024-09-21T07:35:56.541575+0000","last_undegraded":"2024-09-21T07:35:56.541575+0000","last_fullsized":"2024-09-21T07:35:56.541575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:12.067873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.514618+0000","last_change":"2024-09-21T07:35:55.513756+0000","last_active":"2024-09-21T07:35:55.514618+0000","last_peered":"2024-09-21T07:35:55.514618+0000","last_clean":"2024-09-21T07:35:55.514618+0000","last_became_active":"2024-09-21T07:35:55.513321+0000","last_became_peered":"2024-09-21T07:35:55.513321+0000","last_unstale":"2024-09-21T07:35:55.514618+0000","last_undegraded":"2024-09-21T07:35:55.514618+0000","last_fullsized":"2024-09-21T07:35:55.514618+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:16.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518481+0000","last_change":"2024-09-21T07:35:56.539610+0000","last_active":"2024-09-21T07:35:57.518481+0000","last_peered":"2024-09-21T07:35:57.518481+0000","last_clean":"2024-09-21T07:35:57.518481+0000","last_became_active":"2024-09-21T07:35:56.539303+0000","last_became_peered":"2024-09-21T07:35:56.539303+0000","last_unstale":"2024-09-21T07:35:57.518481+0000","last_undegraded":"2024-09-21T07:35:57.518481+0000","last_fullsized":"2024-09-21T07:35:57.518481+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:44.962547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516758+0000","last_change":"2024-09-21T07:35:55.510443+0000","last_active":"2024-09-21T07:35:57.516758+0000","last_peered":"2024-09-21T07:35:57.516758+0000","last_clean":"2024-09-21T07:35:57.516758+0000","last_became_active":"2024-09-21T07:35:55.510085+0000","last_became_peered":"2024-09-21T07:35:55.510085+0000","last_unstale":"2024-09-21T07:35:57.516758+0000","last_undegraded":"2024-09-21T07:35:57.516758+0000","last_fullsized":"2024-09-21T07:35:57.516758+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:04.391176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517372+0000","last_change":"2024-09-21T07:35:56.522754+0000","last_active":"2024-09-21T07:35:57.517372+0000","last_peered":"2024-09-21T07:35:57.517372+0000","last_clean":"2024-09-21T07:35:57.517372+0000","last_became_active":"2024-09-21T07:35:56.522452+0000","last_became_peered":"2024-09-21T07:35:56.522452+0000","last_unstale":"2024-09-21T07:35:57.517372+0000","last_undegraded":"2024-09-21T07:35:57.517372+0000","last_fullsized":"2024-09-21T07:35:57.517372+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:43.361943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536213+0000","last_change":"2024-09-21T07:35:55.517500+0000","last_active":"2024-09-21T07:35:56.536213+0000","last_peered":"2024-09-21T07:35:56.536213+0000","last_clean":"2024-09-21T07:35:56.536213+0000","last_became_active":"2024-09-21T07:35:55.517201+0000","last_became_peered":"2024-09-21T07:35:55.517201+0000","last_unstale":"2024-09-21T07:35:56.536213+0000","last_undegraded":"2024-09-21T07:35:56.536213+0000","last_fullsized":"2024-09-21T07:35:56.536213+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.619469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517331+0000","last_change":"2024-09-21T07:35:56.531499+0000","last_active":"2024-09-21T07:35:57.517331+0000","last_peered":"2024-09-21T07:35:57.517331+0000","last_clean":"2024-09-21T07:35:57.517331+0000","last_became_active":"2024-09-21T07:35:56.531146+0000","last_became_peered":"2024-09-21T07:35:56.531146+0000","last_unstale":"2024-09-21T07:35:57.517331+0000","last_undegraded":"2024-09-21T07:35:57.517331+0000","last_fullsized":"2024-09-21T07:35:57.517331+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522120+0000","last_change":"2024-09-21T07:35:55.517407+0000","last_active":"2024-09-21T07:35:56.522120+0000","last_peered":"2024-09-21T07:35:56.522120+0000","last_clean":"2024-09-21T07:35:56.522120+0000","last_became_active":"2024-09-21T07:35:55.517062+0000","last_became_peered":"2024-09-21T07:35:55.517062+0000","last_unstale":"2024-09-21T07:35:56.522120+0000","last_undegraded":"2024-09-21T07:35:56.522120+0000","last_fullsized":"2024-09-21T07:35:56.522120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:32.359923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517647+0000","last_change":"2024-09-21T07:35:56.536125+0000","last_active":"2024-09-21T07:35:57.517647+0000","last_peered":"2024-09-21T07:35:57.517647+0000","last_clean":"2024-09-21T07:35:57.517647+0000","last_became_active":"2024-09-21T07:35:56.535400+0000","last_became_peered":"2024-09-21T07:35:56.535400+0000","last_unstale":"2024-09-21T07:35:57.517647+0000","last_undegraded":"2024-09-21T07:35:57.517647+0000","last_fullsized":"2024-09-21T07:35:57.517647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.519168+0000","last_change":"2024-09-21T07:35:55.514583+0000","last_active":"2024-09-21T07:35:56.519168+0000","last_peered":"2024-09-21T07:35:56.519168+0000","last_clean":"2024-09-21T07:35:56.519168+0000","last_became_active":"2024-09-21T07:35:55.514197+0000","last_became_peered":"2024-09-21T07:35:55.514197+0000","last_unstale":"2024-09-21T07:35:56.519168+0000","last_undegraded":"2024-09-21T07:35:56.519168+0000","last_fullsized":"2024-09-21T07:35:56.519168+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:46.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516910+0000","last_change":"2024-09-21T07:35:56.515734+0000","last_active":"2024-09-21T07:35:57.516910+0000","last_peered":"2024-09-21T07:35:57.516910+0000","last_clean":"2024-09-21T07:35:57.516910+0000","last_became_active":"2024-09-21T07:35:56.515411+0000","last_became_peered":"2024-09-21T07:35:56.515411+0000","last_unstale":"2024-09-21T07:35:57.516910+0000","last_undegraded":"2024-09-21T07:35:57.516910+0000","last_fullsized":"2024-09-21T07:35:57.516910+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:26.754127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518959+0000","last_change":"2024-09-21T07:35:55.509338+0000","last_active":"2024-09-21T07:35:57.518959+0000","last_peered":"2024-09-21T07:35:57.518959+0000","last_clean":"2024-09-21T07:35:57.518959+0000","last_became_active":"2024-09-21T07:35:55.508913+0000","last_became_peered":"2024-09-21T07:35:55.508913+0000","last_unstale":"2024-09-21T07:35:57.518959+0000","last_undegraded":"2024-09-21T07:35:57.518959+0000","last_fullsized":"2024-09-21T07:35:57.518959+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:25.868297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541192+0000","last_change":"2024-09-21T07:35:56.534293+0000","last_active":"2024-09-21T07:35:56.541192+0000","last_peered":"2024-09-21T07:35:56.541192+0000","last_clean":"2024-09-21T07:35:56.541192+0000","last_became_active":"2024-09-21T07:35:56.533756+0000","last_became_peered":"2024-09-21T07:35:56.533756+0000","last_unstale":"2024-09-21T07:35:56.541192+0000","last_undegraded":"2024-09-21T07:35:56.541192+0000","last_fullsized":"2024-09-21T07:35:56.541192+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:19.301721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526134+0000","last_change":"2024-09-21T07:35:55.520395+0000","last_active":"2024-09-21T07:35:56.526134+0000","last_peered":"2024-09-21T07:35:56.526134+0000","last_clean":"2024-09-21T07:35:56.526134+0000","last_became_active":"2024-09-21T07:35:55.520048+0000","last_became_peered":"2024-09-21T07:35:55.520048+0000","last_unstale":"2024-09-21T07:35:56.526134+0000","last_undegraded":"2024-09-21T07:35:56.526134+0000","last_fullsized":"2024-09-21T07:35:56.526134+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:38.598370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516626+0000","last_change":"2024-09-21T07:35:56.535112+0000","last_active":"2024-09-21T07:35:57.516626+0000","last_peered":"2024-09-21T07:35:57.516626+0000","last_clean":"2024-09-21T07:35:57.516626+0000","last_became_active":"2024-09-21T07:35:56.534778+0000","last_became_peered":"2024-09-21T07:35:56.534778+0000","last_unstale":"2024-09-21T07:35:57.516626+0000","last_undegraded":"2024-09-21T07:35:57.516626+0000","last_fullsized":"2024-09-21T07:35:57.516626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:08.412784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517130+0000","last_change":"2024-09-21T07:35:55.516818+0000","last_active":"2024-09-21T07:35:57.517130+0000","last_peered":"2024-09-21T07:35:57.517130+0000","last_clean":"2024-09-21T07:35:57.517130+0000","last_became_active":"2024-09-21T07:35:55.516404+0000","last_became_peered":"2024-09-21T07:35:55.516404+0000","last_unstale":"2024-09-21T07:35:57.517130+0000","last_undegraded":"2024-09-21T07:35:57.517130+0000","last_fullsized":"2024-09-21T07:35:57.517130+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:28.596997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518816+0000","last_change":"2024-09-21T07:35:56.534487+0000","last_active":"2024-09-21T07:35:57.518816+0000","last_peered":"2024-09-21T07:35:57.518816+0000","last_clean":"2024-09-21T07:35:57.518816+0000","last_became_active":"2024-09-21T07:35:56.533641+0000","last_became_peered":"2024-09-21T07:35:56.533641+0000","last_unstale":"2024-09-21T07:35:57.518816+0000","last_undegraded":"2024-09-21T07:35:57.518816+0000","last_fullsized":"2024-09-21T07:35:57.518816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:06.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.552972+0000","last_change":"2024-09-21T07:35:55.518211+0000","last_active":"2024-09-21T07:35:56.552972+0000","last_peered":"2024-09-21T07:35:56.552972+0000","last_clean":"2024-09-21T07:35:56.552972+0000","last_became_active":"2024-09-21T07:35:55.517091+0000","last_became_peered":"2024-09-21T07:35:55.517091+0000","last_unstale":"2024-09-21T07:35:56.552972+0000","last_undegraded":"2024-09-21T07:35:56.552972+0000","last_fullsized":"2024-09-21T07:35:56.552972+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.499051+0000","last_change":"2024-09-21T07:35:55.499051+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.499051+0000","last_undegraded":"2024-09-21T07:35:55.499051+0000","last_fullsized":"2024-09-21T07:35:55.499051+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513089+0000","last_change":"2024-09-21T07:35:55.506824+0000","last_active":"2024-09-21T07:35:55.513089+0000","last_peered":"2024-09-21T07:35:55.513089+0000","last_clean":"2024-09-21T07:35:55.513089+0000","last_became_active":"2024-09-21T07:35:55.506484+0000","last_became_peered":"2024-09-21T07:35:55.506484+0000","last_unstale":"2024-09-21T07:35:55.513089+0000","last_undegraded":"2024-09-21T07:35:55.513089+0000","last_fullsized":"2024-09-21T07:35:55.513089+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:16.595081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.551653+0000","last_change":"2024-09-21T07:35:56.550098+0000","last_active":"2024-09-21T07:35:56.551653+0000","last_peered":"2024-09-21T07:35:56.551653+0000","last_clean":"2024-09-21T07:35:56.551653+0000","last_became_active":"2024-09-21T07:35:56.549567+0000","last_became_peered":"2024-09-21T07:35:56.549567+0000","last_unstale":"2024-09-21T07:35:56.551653+0000","last_undegraded":"2024-09-21T07:35:56.551653+0000","last_fullsized":"2024-09-21T07:35:56.551653+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:36.902299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.518734+0000","last_change":"2024-09-21T07:35:55.500793+0000","last_active":"2024-09-21T07:35:56.518734+0000","last_peered":"2024-09-21T07:35:56.518734+0000","last_clean":"2024-09-21T07:35:56.518734+0000","last_became_active":"2024-09-21T07:35:55.500461+0000","last_became_peered":"2024-09-21T07:35:55.500461+0000","last_unstale":"2024-09-21T07:35:56.518734+0000","last_undegraded":"2024-09-21T07:35:56.518734+0000","last_fullsized":"2024-09-21T07:35:56.518734+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:55.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517253+0000","last_change":"2024-09-21T07:35:56.548523+0000","last_active":"2024-09-21T07:35:57.517253+0000","last_peered":"2024-09-21T07:35:57.517253+0000","last_clean":"2024-09-21T07:35:57.517253+0000","last_became_active":"2024-09-21T07:35:56.548223+0000","last_became_peered":"2024-09-21T07:35:56.548223+0000","last_unstale":"2024-09-21T07:35:57.517253+0000","last_undegraded":"2024-09-21T07:35:57.517253+0000","last_fullsized":"2024-09-21T07:35:57.517253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:55.796410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516547+0000","last_change":"2024-09-21T07:35:55.518059+0000","last_active":"2024-09-21T07:35:57.516547+0000","last_peered":"2024-09-21T07:35:57.516547+0000","last_clean":"2024-09-21T07:35:57.516547+0000","last_became_active":"2024-09-21T07:35:55.517406+0000","last_became_peered":"2024-09-21T07:35:55.517406+0000","last_unstale":"2024-09-21T07:35:57.516547+0000","last_undegraded":"2024-09-21T07:35:57.516547+0000","last_fullsized":"2024-09-21T07:35:57.516547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:19.228872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.539212+0000","last_change":"2024-09-21T07:35:56.533846+0000","last_active":"2024-09-21T07:35:56.539212+0000","last_peered":"2024-09-21T07:35:56.539212+0000","last_clean":"2024-09-21T07:35:56.539212+0000","last_became_active":"2024-09-21T07:35:56.533430+0000","last_became_peered":"2024-09-21T07:35:56.533430+0000","last_unstale":"2024-09-21T07:35:56.539212+0000","last_undegraded":"2024-09-21T07:35:56.539212+0000","last_fullsized":"2024-09-21T07:35:56.539212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:59.062863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":23,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517932+0000","last_change":"2024-09-21T07:35:55.514195+0000","last_active":"2024-09-21T07:35:57.517932+0000","last_peered":"2024-09-21T07:35:57.517932+0000","last_clean":"2024-09-21T07:35:57.517932+0000","last_became_active":"2024-09-21T07:35:55.513310+0000","last_became_peered":"2024-09-21T07:35:55.513310+0000","last_unstale":"2024-09-21T07:35:57.517932+0000","last_undegraded":"2024-09-21T07:35:57.517932+0000","last_fullsized":"2024-09-21T07:35:57.517932+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541511+0000","last_change":"2024-09-21T07:35:56.537670+0000","last_active":"2024-09-21T07:35:56.541511+0000","last_peered":"2024-09-21T07:35:56.541511+0000","last_clean":"2024-09-21T07:35:56.541511+0000","last_became_active":"2024-09-21T07:35:56.535095+0000","last_became_peered":"2024-09-21T07:35:56.535095+0000","last_unstale":"2024-09-21T07:35:56.541511+0000","last_undegraded":"2024-09-21T07:35:56.541511+0000","last_fullsized":"2024-09-21T07:35:56.541511+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:34.569090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535689+0000","last_change":"2024-09-21T07:35:55.508297+0000","last_active":"2024-09-21T07:35:56.535689+0000","last_peered":"2024-09-21T07:35:56.535689+0000","last_clean":"2024-09-21T07:35:56.535689+0000","last_became_active":"2024-09-21T07:35:55.507986+0000","last_became_peered":"2024-09-21T07:35:55.507986+0000","last_unstale":"2024-09-21T07:35:56.535689+0000","last_undegraded":"2024-09-21T07:35:56.535689+0000","last_fullsized":"2024-09-21T07:35:56.535689+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:00.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526722+0000","last_change":"2024-09-21T07:35:56.523458+0000","last_active":"2024-09-21T07:35:56.526722+0000","last_peered":"2024-09-21T07:35:56.526722+0000","last_clean":"2024-09-21T07:35:56.526722+0000","last_became_active":"2024-09-21T07:35:56.522634+0000","last_became_peered":"2024-09-21T07:35:56.522634+0000","last_unstale":"2024-09-21T07:35:56.526722+0000","last_undegraded":"2024-09-21T07:35:56.526722+0000","last_fullsized":"2024-09-21T07:35:56.526722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:35.163475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":15,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537684+0000","last_change":"2024-09-21T07:35:55.511813+0000","last_active":"2024-09-21T07:35:56.537684+0000","last_peered":"2024-09-21T07:35:56.537684+0000","last_clean":"2024-09-21T07:35:56.537684+0000","last_became_active":"2024-09-21T07:35:55.511137+0000","last_became_peered":"2024-09-21T07:35:55.511137+0000","last_unstale":"2024-09-21T07:35:56.537684+0000","last_undegraded":"2024-09-21T07:35:56.537684+0000","last_fullsized":"2024-09-21T07:35:56.537684+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:20.145930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537342+0000","last_change":"2024-09-21T07:35:56.533636+0000","last_active":"2024-09-21T07:35:56.537342+0000","last_peered":"2024-09-21T07:35:56.537342+0000","last_clean":"2024-09-21T07:35:56.537342+0000","last_became_active":"2024-09-21T07:35:56.533340+0000","last_became_peered":"2024-09-21T07:35:56.533340+0000","last_unstale":"2024-09-21T07:35:56.537342+0000","last_undegraded":"2024-09-21T07:35:56.537342+0000","last_fullsized":"2024-09-21T07:35:56.537342+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:41.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.513979+0000","last_change":"2024-09-21T07:35:55.512632+0000","last_active":"2024-09-21T07:35:55.513979+0000","last_peered":"2024-09-21T07:35:55.513979+0000","last_clean":"2024-09-21T07:35:55.513979+0000","last_became_active":"2024-09-21T07:35:55.511701+0000","last_became_peered":"2024-09-21T07:35:55.511701+0000","last_unstale":"2024-09-21T07:35:55.513979+0000","last_undegraded":"2024-09-21T07:35:55.513979+0000","last_fullsized":"2024-09-21T07:35:55.513979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:08.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541367+0000","last_change":"2024-09-21T07:35:56.535182+0000","last_active":"2024-09-21T07:35:56.541367+0000","last_peered":"2024-09-21T07:35:56.541367+0000","last_clean":"2024-09-21T07:35:56.541367+0000","last_became_active":"2024-09-21T07:35:56.530549+0000","last_became_peered":"2024-09-21T07:35:56.530549+0000","last_unstale":"2024-09-21T07:35:56.541367+0000","last_undegraded":"2024-09-21T07:35:56.541367+0000","last_fullsized":"2024-09-21T07:35:56.541367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:45.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518975+0000","last_change":"2024-09-21T07:35:55.511997+0000","last_active":"2024-09-21T07:35:57.518975+0000","last_peered":"2024-09-21T07:35:57.518975+0000","last_clean":"2024-09-21T07:35:57.518975+0000","last_became_active":"2024-09-21T07:35:55.511282+0000","last_became_peered":"2024-09-21T07:35:55.511282+0000","last_unstale":"2024-09-21T07:35:57.518975+0000","last_undegraded":"2024-09-21T07:35:57.518975+0000","last_fullsized":"2024-09-21T07:35:57.518975+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:59.004838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-21T07:35:55.498401+0000","last_change":"2024-09-21T07:35:55.498401+0000","last_active":"2024-09-21T07:35:55.483754+0000","last_peered":"2024-09-21T07:35:55.483754+0000","last_clean":"2024-09-21T07:35:55.483754+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:35:55.498401+0000","last_undegraded":"2024-09-21T07:35:55.498401+0000","last_fullsized":"2024-09-21T07:35:55.498401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518648+0000","last_change":"2024-09-21T07:35:55.507126+0000","last_active":"2024-09-21T07:35:57.518648+0000","last_peered":"2024-09-21T07:35:57.518648+0000","last_clean":"2024-09-21T07:35:57.518648+0000","last_became_active":"2024-09-21T07:35:55.506666+0000","last_became_peered":"2024-09-21T07:35:55.506666+0000","last_unstale":"2024-09-21T07:35:57.518648+0000","last_undegraded":"2024-09-21T07:35:57.518648+0000","last_fullsized":"2024-09-21T07:35:57.518648+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553096+0000","last_change":"2024-09-21T07:35:56.548916+0000","last_active":"2024-09-21T07:35:56.553096+0000","last_peered":"2024-09-21T07:35:56.553096+0000","last_clean":"2024-09-21T07:35:56.553096+0000","last_became_active":"2024-09-21T07:35:56.548631+0000","last_became_peered":"2024-09-21T07:35:56.548631+0000","last_unstale":"2024-09-21T07:35:56.553096+0000","last_undegraded":"2024-09-21T07:35:56.553096+0000","last_fullsized":"2024-09-21T07:35:56.553096+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:07.211518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-21T07:35:55.512630+0000","last_change":"2024-09-21T07:35:55.504973+0000","last_active":"2024-09-21T07:35:55.512630+0000","last_peered":"2024-09-21T07:35:55.512630+0000","last_clean":"2024-09-21T07:35:55.512630+0000","last_became_active":"2024-09-21T07:35:55.504600+0000","last_became_peered":"2024-09-21T07:35:55.504600+0000","last_unstale":"2024-09-21T07:35:55.512630+0000","last_undegraded":"2024-09-21T07:35:55.512630+0000","last_fullsized":"2024-09-21T07:35:55.512630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:08.767720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517377+0000","last_change":"2024-09-21T07:35:56.538836+0000","last_active":"2024-09-21T07:35:57.517377+0000","last_peered":"2024-09-21T07:35:57.517377+0000","last_clean":"2024-09-21T07:35:57.517377+0000","last_became_active":"2024-09-21T07:35:56.538514+0000","last_became_peered":"2024-09-21T07:35:56.538514+0000","last_unstale":"2024-09-21T07:35:57.517377+0000","last_undegraded":"2024-09-21T07:35:57.517377+0000","last_fullsized":"2024-09-21T07:35:57.517377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:23.823985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516955+0000","last_change":"2024-09-21T07:35:55.504947+0000","last_active":"2024-09-21T07:35:57.516955+0000","last_peered":"2024-09-21T07:35:57.516955+0000","last_clean":"2024-09-21T07:35:57.516955+0000","last_became_active":"2024-09-21T07:35:55.504601+0000","last_became_peered":"2024-09-21T07:35:55.504601+0000","last_unstale":"2024-09-21T07:35:57.516955+0000","last_undegraded":"2024-09-21T07:35:57.516955+0000","last_fullsized":"2024-09-21T07:35:57.516955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.728969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544576+0000","last_change":"2024-09-21T07:35:56.540065+0000","last_active":"2024-09-21T07:35:56.544576+0000","last_peered":"2024-09-21T07:35:56.544576+0000","last_clean":"2024-09-21T07:35:56.544576+0000","last_became_active":"2024-09-21T07:35:56.535568+0000","last_became_peered":"2024-09-21T07:35:56.535568+0000","last_unstale":"2024-09-21T07:35:56.544576+0000","last_undegraded":"2024-09-21T07:35:56.544576+0000","last_fullsized":"2024-09-21T07:35:56.544576+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:35.442810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514483+0000","last_change":"2024-09-21T07:35:55.514068+0000","last_active":"2024-09-21T07:35:56.514483+0000","last_peered":"2024-09-21T07:35:56.514483+0000","last_clean":"2024-09-21T07:35:56.514483+0000","last_became_active":"2024-09-21T07:35:55.513611+0000","last_became_peered":"2024-09-21T07:35:55.513611+0000","last_unstale":"2024-09-21T07:35:56.514483+0000","last_undegraded":"2024-09-21T07:35:56.514483+0000","last_fullsized":"2024-09-21T07:35:56.514483+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:50.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.542293+0000","last_change":"2024-09-21T07:35:56.538134+0000","last_active":"2024-09-21T07:35:56.542293+0000","last_peered":"2024-09-21T07:35:56.542293+0000","last_clean":"2024-09-21T07:35:56.542293+0000","last_became_active":"2024-09-21T07:35:56.535487+0000","last_became_peered":"2024-09-21T07:35:56.535487+0000","last_unstale":"2024-09-21T07:35:56.542293+0000","last_undegraded":"2024-09-21T07:35:56.542293+0000","last_fullsized":"2024-09-21T07:35:56.542293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:28.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517774+0000","last_change":"2024-09-21T07:35:55.517204+0000","last_active":"2024-09-21T07:35:57.517774+0000","last_peered":"2024-09-21T07:35:57.517774+0000","last_clean":"2024-09-21T07:35:57.517774+0000","last_became_active":"2024-09-21T07:35:55.516611+0000","last_became_peered":"2024-09-21T07:35:55.516611+0000","last_unstale":"2024-09-21T07:35:57.517774+0000","last_undegraded":"2024-09-21T07:35:57.517774+0000","last_fullsized":"2024-09-21T07:35:57.517774+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.047521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549490+0000","last_change":"2024-09-21T07:35:56.540592+0000","last_active":"2024-09-21T07:35:56.549490+0000","last_peered":"2024-09-21T07:35:56.549490+0000","last_clean":"2024-09-21T07:35:56.549490+0000","last_became_active":"2024-09-21T07:35:56.540269+0000","last_became_peered":"2024-09-21T07:35:56.540269+0000","last_unstale":"2024-09-21T07:35:56.549490+0000","last_undegraded":"2024-09-21T07:35:56.549490+0000","last_fullsized":"2024-09-21T07:35:56.549490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:58.810275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.515349+0000","last_change":"2024-09-21T07:35:55.503498+0000","last_active":"2024-09-21T07:35:57.515349+0000","last_peered":"2024-09-21T07:35:57.515349+0000","last_clean":"2024-09-21T07:35:57.515349+0000","last_became_active":"2024-09-21T07:35:55.503073+0000","last_became_peered":"2024-09-21T07:35:55.503073+0000","last_unstale":"2024-09-21T07:35:57.515349+0000","last_undegraded":"2024-09-21T07:35:57.515349+0000","last_fullsized":"2024-09-21T07:35:57.515349+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.889708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516961+0000","last_change":"2024-09-21T07:35:56.547899+0000","last_active":"2024-09-21T07:35:57.516961+0000","last_peered":"2024-09-21T07:35:57.516961+0000","last_clean":"2024-09-21T07:35:57.516961+0000","last_became_active":"2024-09-21T07:35:56.547572+0000","last_became_peered":"2024-09-21T07:35:56.547572+0000","last_unstale":"2024-09-21T07:35:57.516961+0000","last_undegraded":"2024-09-21T07:35:57.516961+0000","last_fullsized":"2024-09-21T07:35:57.516961+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:18.327833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517486+0000","last_change":"2024-09-21T07:35:55.506133+0000","last_active":"2024-09-21T07:35:57.517486+0000","last_peered":"2024-09-21T07:35:57.517486+0000","last_clean":"2024-09-21T07:35:57.517486+0000","last_became_active":"2024-09-21T07:35:55.505819+0000","last_became_peered":"2024-09-21T07:35:55.505819+0000","last_unstale":"2024-09-21T07:35:57.517486+0000","last_undegraded":"2024-09-21T07:35:57.517486+0000","last_fullsized":"2024-09-21T07:35:57.517486+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:50.225417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.531311+0000","last_change":"2024-09-21T07:35:56.528239+0000","last_active":"2024-09-21T07:35:56.531311+0000","last_peered":"2024-09-21T07:35:56.531311+0000","last_clean":"2024-09-21T07:35:56.531311+0000","last_became_active":"2024-09-21T07:35:56.527890+0000","last_became_peered":"2024-09-21T07:35:56.527890+0000","last_unstale":"2024-09-21T07:35:56.531311+0000","last_undegraded":"2024-09-21T07:35:56.531311+0000","last_fullsized":"2024-09-21T07:35:56.531311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:55.369124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514253+0000","last_change":"2024-09-21T07:35:55.516129+0000","last_active":"2024-09-21T07:35:56.514253+0000","last_peered":"2024-09-21T07:35:56.514253+0000","last_clean":"2024-09-21T07:35:56.514253+0000","last_became_active":"2024-09-21T07:35:55.515802+0000","last_became_peered":"2024-09-21T07:35:55.515802+0000","last_unstale":"2024-09-21T07:35:56.514253+0000","last_undegraded":"2024-09-21T07:35:56.514253+0000","last_fullsized":"2024-09-21T07:35:56.514253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:42.354336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.540281+0000","last_change":"2024-09-21T07:35:56.530807+0000","last_active":"2024-09-21T07:35:56.540281+0000","last_peered":"2024-09-21T07:35:56.540281+0000","last_clean":"2024-09-21T07:35:56.540281+0000","last_became_active":"2024-09-21T07:35:56.528662+0000","last_became_peered":"2024-09-21T07:35:56.528662+0000","last_unstale":"2024-09-21T07:35:56.540281+0000","last_undegraded":"2024-09-21T07:35:56.540281+0000","last_fullsized":"2024-09-21T07:35:56.540281+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:06.977730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.511669+0000","last_change":"2024-09-21T07:35:55.503586+0000","last_active":"2024-09-21T07:35:56.511669+0000","last_peered":"2024-09-21T07:35:56.511669+0000","last_clean":"2024-09-21T07:35:56.511669+0000","last_became_active":"2024-09-21T07:35:55.503160+0000","last_became_peered":"2024-09-21T07:35:55.503160+0000","last_unstale":"2024-09-21T07:35:56.511669+0000","last_undegraded":"2024-09-21T07:35:56.511669+0000","last_fullsized":"2024-09-21T07:35:56.511669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:20.237989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536253+0000","last_change":"2024-09-21T07:35:56.532396+0000","last_active":"2024-09-21T07:35:56.536253+0000","last_peered":"2024-09-21T07:35:56.536253+0000","last_clean":"2024-09-21T07:35:56.536253+0000","last_became_active":"2024-09-21T07:35:56.532062+0000","last_became_peered":"2024-09-21T07:35:56.532062+0000","last_unstale":"2024-09-21T07:35:56.536253+0000","last_undegraded":"2024-09-21T07:35:56.536253+0000","last_fullsized":"2024-09-21T07:35:56.536253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.129335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516875+0000","last_change":"2024-09-21T07:35:55.511105+0000","last_active":"2024-09-21T07:35:57.516875+0000","last_peered":"2024-09-21T07:35:57.516875+0000","last_clean":"2024-09-21T07:35:57.516875+0000","last_became_active":"2024-09-21T07:35:55.510724+0000","last_became_peered":"2024-09-21T07:35:55.510724+0000","last_unstale":"2024-09-21T07:35:57.516875+0000","last_undegraded":"2024-09-21T07:35:57.516875+0000","last_fullsized":"2024-09-21T07:35:57.516875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:13.044173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553026+0000","last_change":"2024-09-21T07:35:56.545891+0000","last_active":"2024-09-21T07:35:56.553026+0000","last_peered":"2024-09-21T07:35:56.553026+0000","last_clean":"2024-09-21T07:35:56.553026+0000","last_became_active":"2024-09-21T07:35:56.545486+0000","last_became_peered":"2024-09-21T07:35:56.545486+0000","last_unstale":"2024-09-21T07:35:56.553026+0000","last_undegraded":"2024-09-21T07:35:56.553026+0000","last_fullsized":"2024-09-21T07:35:56.553026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:28.119364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.516814+0000","last_change":"2024-09-21T07:35:55.506044+0000","last_active":"2024-09-21T07:35:56.516814+0000","last_peered":"2024-09-21T07:35:56.516814+0000","last_clean":"2024-09-21T07:35:56.516814+0000","last_became_active":"2024-09-21T07:35:55.505749+0000","last_became_peered":"2024-09-21T07:35:55.505749+0000","last_unstale":"2024-09-21T07:35:56.516814+0000","last_undegraded":"2024-09-21T07:35:56.516814+0000","last_fullsized":"2024-09-21T07:35:56.516814+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:14.718347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549536+0000","last_change":"2024-09-21T07:35:56.543636+0000","last_active":"2024-09-21T07:35:56.549536+0000","last_peered":"2024-09-21T07:35:56.549536+0000","last_clean":"2024-09-21T07:35:56.549536+0000","last_became_active":"2024-09-21T07:35:56.543332+0000","last_became_peered":"2024-09-21T07:35:56.543332+0000","last_unstale":"2024-09-21T07:35:56.549536+0000","last_undegraded":"2024-09-21T07:35:56.549536+0000","last_fullsized":"2024-09-21T07:35:56.549536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:30.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519097+0000","last_change":"2024-09-21T07:35:55.504949+0000","last_active":"2024-09-21T07:35:57.519097+0000","last_peered":"2024-09-21T07:35:57.519097+0000","last_clean":"2024-09-21T07:35:57.519097+0000","last_became_active":"2024-09-21T07:35:55.504623+0000","last_became_peered":"2024-09-21T07:35:55.504623+0000","last_unstale":"2024-09-21T07:35:57.519097+0000","last_undegraded":"2024-09-21T07:35:57.519097+0000","last_fullsized":"2024-09-21T07:35:57.519097+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:14.464426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.532329+0000","last_change":"2024-09-21T07:35:56.531233+0000","last_active":"2024-09-21T07:35:56.532329+0000","last_peered":"2024-09-21T07:35:56.532329+0000","last_clean":"2024-09-21T07:35:56.532329+0000","last_became_active":"2024-09-21T07:35:56.529247+0000","last_became_peered":"2024-09-21T07:35:56.529247+0000","last_unstale":"2024-09-21T07:35:56.532329+0000","last_undegraded":"2024-09-21T07:35:56.532329+0000","last_fullsized":"2024-09-21T07:35:56.532329+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:24.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516761+0000","last_change":"2024-09-21T07:35:55.513811+0000","last_active":"2024-09-21T07:35:57.516761+0000","last_peered":"2024-09-21T07:35:57.516761+0000","last_clean":"2024-09-21T07:35:57.516761+0000","last_became_active":"2024-09-21T07:35:55.513193+0000","last_became_peered":"2024-09-21T07:35:55.513193+0000","last_unstale":"2024-09-21T07:35:57.516761+0000","last_undegraded":"2024-09-21T07:35:57.516761+0000","last_fullsized":"2024-09-21T07:35:57.516761+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":419,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522727+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:56.522727+0000","last_peered":"2024-09-21T07:35:56.522727+0000","last_clean":"2024-09-21T07:35:56.522727+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:56.522727+0000","last_undegraded":"2024-09-21T07:35:56.522727+0000","last_fullsized":"2024-09-21T07:35:56.522727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55752,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316088,"statfs":{"total":96636764160,"available":96579674112,"internally_reserved":0,"allocated":2404352,"data_stored":1130910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1128772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64060,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307780,"statfs":{"total":96636764160,"available":96571166720,"internally_reserved":0,"allocated":2392064,"data_stored":1129298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509604,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2392064,"data_stored":1128806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1128716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509604,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56316,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315524,"statfs":{"total":96636764160,"available":96579096576,"internally_reserved":0,"allocated":2985984,"data_stored":1719174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542308,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56328,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315512,"statfs":{"total":96636764160,"available":96579084288,"internally_reserved":0,"allocated":2998272,"data_stored":1720766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87588,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284252,"statfs":{"total":96636764160,"available":96547074048,"internally_reserved":0,"allocated":2375680,"data_stored":1121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:36:01.560 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3e is not active+clean 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:55.499718+0000', 'last_change': '2024-09-21T07:35:55.499718+0000', 'last_active': '2024-09-21T07:35:55.483754+0000', 'last_peered': '2024-09-21T07:35:55.483754+0000', 'last_clean': '2024-09-21T07:35:55.483754+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:55.499718+0000', 'last_undegraded': '2024-09-21T07:35:55.499718+0000', 'last_fullsized': '2024-09-21T07:35:55.499718+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:PG 28.29 is not active+clean 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:55.499044+0000', 'last_change': '2024-09-21T07:35:55.499044+0000', 'last_active': '2024-09-21T07:35:55.483754+0000', 'last_peered': '2024-09-21T07:35:55.483754+0000', 'last_clean': '2024-09-21T07:35:55.483754+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:55.499044+0000', 'last_undegraded': '2024-09-21T07:35:55.499044+0000', 'last_fullsized': '2024-09-21T07:35:55.499044+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:PG 28.18 is not active+clean 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:55.499552+0000', 'last_change': '2024-09-21T07:35:55.499552+0000', 'last_active': '2024-09-21T07:35:55.483754+0000', 'last_peered': '2024-09-21T07:35:55.483754+0000', 'last_clean': '2024-09-21T07:35:55.483754+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:55.499552+0000', 'last_undegraded': '2024-09-21T07:35:55.499552+0000', 'last_fullsized': '2024-09-21T07:35:55.499552+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:PG 28.14 is not active+clean 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:55.499051+0000', 'last_change': '2024-09-21T07:35:55.499051+0000', 'last_active': '2024-09-21T07:35:55.483754+0000', 'last_peered': '2024-09-21T07:35:55.483754+0000', 'last_clean': '2024-09-21T07:35:55.483754+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:55.499051+0000', 'last_undegraded': '2024-09-21T07:35:55.499051+0000', 'last_fullsized': '2024-09-21T07:35:55.499051+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:PG 28.c is not active+clean 2024-09-21T07:36:01.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:35:55.498401+0000', 'last_change': '2024-09-21T07:35:55.498401+0000', 'last_active': '2024-09-21T07:35:55.483754+0000', 'last_peered': '2024-09-21T07:35:55.483754+0000', 'last_clean': '2024-09-21T07:35:55.483754+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:35:55.498401+0000', 'last_undegraded': '2024-09-21T07:35:55.498401+0000', 'last_fullsized': '2024-09-21T07:35:55.498401+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'last_clean_scrub_stamp': '2024-09-21T07:35:55.483754+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:36:01.562 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- 172.21.15.64:0/3616827040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 msgr2=0x7f76100b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 --2- 172.21.15.64:0/3616827040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f76100b41c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f761006f220 tx=0x7f760001c6c0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- 172.21.15.64:0/3616827040 shutdown_connections 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 --2- 172.21.15.64:0/3616827040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f76100b41c0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 --2- 172.21.15.64:0/3616827040 >> v2:172.21.15.90:3300/0 conn(0x7f761015edb0 0x7f76100700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- 172.21.15.64:0/3616827040 >> 172.21.15.64:0/3616827040 conn(0x7f76100ccbe0 msgr2=0x7f76100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- 172.21.15.64:0/3616827040 shutdown_connections 2024-09-21T07:36:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- 172.21.15.64:0/3616827040 wait complete. 2024-09-21T07:36:01.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 Processor -- start 2024-09-21T07:36:01.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.756+0000 7f7618800640 1 -- start start 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76100b4700 0x7f76100c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761015edb0 0x7f76100c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7610168fb0 con 0x7f76100709b0 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7610168e30 con 0x7f761015edb0 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7610169130 con 0x7f76100b4700 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53370/0 (socket says 172.21.15.64:53370) 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 -- 172.21.15.64:0/3947216157 learned_addr learned my addr 172.21.15.64:0/3947216157 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7616800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761015edb0 0x7f76100c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615400640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76100b4700 0x7f76100c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 -- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76100b4700 msgr2=0x7f76100c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76100b4700 0x7f76100c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 -- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761015edb0 msgr2=0x7f76100c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761015edb0 0x7f76100c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 -- 172.21.15.64:0/3947216157 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761015a000 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7615e00640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f760400b440 tx=0x7f760400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604015020 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76040119a0 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604011df0 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761015a2e0 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761015a8a0 con 0x7f76100709b0 2024-09-21T07:36:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.760+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76100b41c0 con 0x7f76100709b0 2024-09-21T07:36:01.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.764+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7604018020 con 0x7f76100709b0 2024-09-21T07:36:01.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.764+0000 7f760a000640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 0x7f75f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:01.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.764+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f7604094430 con 0x7f76100709b0 2024-09-21T07:36:01.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.764+0000 7f7615400640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 0x7f75f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:01.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.764+0000 7f7615400640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 0x7f75f4075710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f76000af000 tx=0x7f760001af00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:01.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:01.768+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f760401f020 con 0x7f76100709b0 2024-09-21T07:36:02.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.008+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f761009da20 con 0x7f76100709b0 2024-09-21T07:36:02.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.008+0000 7f760a000640 1 -- 172.21.15.64:0/3947216157 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1147 (secure 0 0 0) 0x7f760400d040 con 0x7f76100709b0 2024-09-21T07:36:02.011 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:02.011 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":820,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":191,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592674,"bytes_used":511717376,"bytes_avail":772582395904,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":1192,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"c","status":"up:active","gid":10503}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-21T07:34:51.621102+0000","services":{}},"progress_events":{}} 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 msgr2=0x7f75f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 0x7f75f4075710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f76000af000 tx=0x7f760001af00 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 msgr2=0x7f7610153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f760400b440 tx=0x7f760400b900 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 shutdown_connections 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f75f4073200 0x7f75f4075710 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f761015edb0 0x7f76100c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76100b4700 0x7f76100c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 --2- 172.21.15.64:0/3947216157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76100709b0 0x7f7610153690 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 >> 172.21.15.64:0/3947216157 conn(0x7f76100ccbe0 msgr2=0x7f76100af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:02.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 shutdown_connections 2024-09-21T07:36:02.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.012+0000 7f7618800640 1 -- 172.21.15.64:0/3947216157 wait complete. 2024-09-21T07:36:02.033 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:36:02.034 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:36:02.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 -- 172.21.15.64:0/1041651075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80709b0 msgr2=0x7f2db80b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1041651075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80709b0 0x7f2db80b41c0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009840 tx=0x7f2da401c820 comp rx=0 tx=0).stop 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 -- 172.21.15.64:0/1041651075 shutdown_connections 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1041651075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80709b0 0x7f2db80b41c0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 -- 172.21.15.64:0/1041651075 >> 172.21.15.64:0/1041651075 conn(0x7f2db80ccbe0 msgr2=0x7f2db80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 -- 172.21.15.64:0/1041651075 shutdown_connections 2024-09-21T07:36:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.188+0000 7f2dc0000640 1 -- 172.21.15.64:0/1041651075 wait complete. 2024-09-21T07:36:02.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 Processor -- start 2024-09-21T07:36:02.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 -- start start 2024-09-21T07:36:02.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2db80709b0 0x7f2db815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 0x7f2db81fa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2db816a290 con 0x7f2db80b4700 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2db816a110 con 0x7f2db815edb0 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dc0000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2db816a410 con 0x7f2db80709b0 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dbcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dbcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53380/0 (socket says 172.21.15.64:53380) 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.192+0000 7f2dbcc00640 1 -- 172.21.15.64:0/1206248468 learned_addr learned my addr 172.21.15.64:0/1206248468 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbd600640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2db80709b0 0x7f2db815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbe000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 0x7f2db81fa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 -- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2db80709b0 msgr2=0x7f2db815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2db80709b0 0x7f2db815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 -- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 msgr2=0x7f2db81fa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 0x7f2db81fa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 -- 172.21.15.64:0/1206248468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81f71d0 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbe000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 0x7f2db81fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dbcc00640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f2da40b0040 tx=0x7f2da40a6760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004140 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da40043d0 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db81f74b0 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4003600 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81f7a70 con 0x7f2db80b4700 2024-09-21T07:36:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db80b41c0 con 0x7f2db80b4700 2024-09-21T07:36:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.196+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2da40c1030 con 0x7f2db80b4700 2024-09-21T07:36:02.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.200+0000 7f2db5600640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 0x7f2d98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:02.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.200+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2da412f1a0 con 0x7f2db80b4700 2024-09-21T07:36:02.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.200+0000 7f2dbd600640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 0x7f2d98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:02.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.200+0000 7f2dbd600640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 0x7f2d98075710 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2dac007d70 tx=0x7f2dac007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:02.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.200+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2da40c8060 con 0x7f2db80b4700 2024-09-21T07:36:02.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.376+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2db809da20 con 0x7f2d98073200 2024-09-21T07:36:02.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.380+0000 7f2db5600640 1 -- 172.21.15.64:0/1206248468 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f2db809da20 con 0x7f2d98073200 2024-09-21T07:36:02.385 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:02.386 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:36:02.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 msgr2=0x7f2d98075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 0x7f2d98075710 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2dac007d70 tx=0x7f2dac007d00 comp rx=0 tx=0).stop 2024-09-21T07:36:02.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 msgr2=0x7f2db815e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:02.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f2da40b0040 tx=0x7f2da40a6760 comp rx=0 tx=0).stop 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 shutdown_connections 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2d98073200 0x7f2d98075710 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2db815edb0 0x7f2db81fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2db80b4700 0x7f2db815e330 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 --2- 172.21.15.64:0/1206248468 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2db80709b0 0x7f2db815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 >> 172.21.15.64:0/1206248468 conn(0x7f2db80ccbe0 msgr2=0x7f2db815d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 shutdown_connections 2024-09-21T07:36:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:02.384+0000 7f2dc0000640 1 -- 172.21.15.64:0/1206248468 wait complete. 2024-09-21T07:36:02.406 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-21T07:36:01.639317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":499760,"kb_used_data":19892,"kb_used_omap":12,"kb_used_meta":479667,"kb_avail":754474960,"statfs":{"total":773094113280,"available":772582359040,"internally_reserved":0,"allocated":20369408,"data_stored":10221976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":491179571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.150620"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535189+0000","last_change":"2024-09-21T07:35:56.532076+0000","last_active":"2024-09-21T07:35:56.535189+0000","last_peered":"2024-09-21T07:35:56.535189+0000","last_clean":"2024-09-21T07:35:56.535189+0000","last_became_active":"2024-09-21T07:35:56.531712+0000","last_became_peered":"2024-09-21T07:35:56.531712+0000","last_unstale":"2024-09-21T07:35:56.535189+0000","last_undegraded":"2024-09-21T07:35:56.535189+0000","last_fullsized":"2024-09-21T07:35:56.535189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:08.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464535+0000","last_change":"2024-09-21T07:35:56.545492+0000","last_active":"2024-09-21T07:35:58.464535+0000","last_peered":"2024-09-21T07:35:58.464535+0000","last_clean":"2024-09-21T07:35:58.464535+0000","last_became_active":"2024-09-21T07:35:56.545193+0000","last_became_peered":"2024-09-21T07:35:56.545193+0000","last_unstale":"2024-09-21T07:35:58.464535+0000","last_undegraded":"2024-09-21T07:35:58.464535+0000","last_fullsized":"2024-09-21T07:35:58.464535+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.834431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541694+0000","last_change":"2024-09-21T07:35:56.539434+0000","last_active":"2024-09-21T07:35:56.541694+0000","last_peered":"2024-09-21T07:35:56.541694+0000","last_clean":"2024-09-21T07:35:56.541694+0000","last_became_active":"2024-09-21T07:35:56.538261+0000","last_became_peered":"2024-09-21T07:35:56.538261+0000","last_unstale":"2024-09-21T07:35:56.541694+0000","last_undegraded":"2024-09-21T07:35:56.541694+0000","last_fullsized":"2024-09-21T07:35:56.541694+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:06.743615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549725+0000","last_change":"2024-09-21T07:35:56.541396+0000","last_active":"2024-09-21T07:35:56.549725+0000","last_peered":"2024-09-21T07:35:56.549725+0000","last_clean":"2024-09-21T07:35:56.549725+0000","last_became_active":"2024-09-21T07:35:56.540086+0000","last_became_peered":"2024-09-21T07:35:56.540086+0000","last_unstale":"2024-09-21T07:35:56.549725+0000","last_undegraded":"2024-09-21T07:35:56.549725+0000","last_fullsized":"2024-09-21T07:35:56.549725+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:11.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518252+0000","last_change":"2024-09-21T07:35:56.546056+0000","last_active":"2024-09-21T07:35:57.518252+0000","last_peered":"2024-09-21T07:35:57.518252+0000","last_clean":"2024-09-21T07:35:57.518252+0000","last_became_active":"2024-09-21T07:35:56.545732+0000","last_became_peered":"2024-09-21T07:35:56.545732+0000","last_unstale":"2024-09-21T07:35:57.518252+0000","last_undegraded":"2024-09-21T07:35:57.518252+0000","last_fullsized":"2024-09-21T07:35:57.518252+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:21.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541633+0000","last_change":"2024-09-21T07:35:56.537816+0000","last_active":"2024-09-21T07:35:56.541633+0000","last_peered":"2024-09-21T07:35:56.541633+0000","last_clean":"2024-09-21T07:35:56.541633+0000","last_became_active":"2024-09-21T07:35:56.536912+0000","last_became_peered":"2024-09-21T07:35:56.536912+0000","last_unstale":"2024-09-21T07:35:56.541633+0000","last_undegraded":"2024-09-21T07:35:56.541633+0000","last_fullsized":"2024-09-21T07:35:56.541633+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:00.409316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517848+0000","last_change":"2024-09-21T07:35:56.547623+0000","last_active":"2024-09-21T07:35:57.517848+0000","last_peered":"2024-09-21T07:35:57.517848+0000","last_clean":"2024-09-21T07:35:57.517848+0000","last_became_active":"2024-09-21T07:35:56.547341+0000","last_became_peered":"2024-09-21T07:35:56.547341+0000","last_unstale":"2024-09-21T07:35:57.517848+0000","last_undegraded":"2024-09-21T07:35:57.517848+0000","last_fullsized":"2024-09-21T07:35:57.517848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529072+0000","last_change":"2024-09-21T07:35:56.523945+0000","last_active":"2024-09-21T07:35:56.529072+0000","last_peered":"2024-09-21T07:35:56.529072+0000","last_clean":"2024-09-21T07:35:56.529072+0000","last_became_active":"2024-09-21T07:35:56.523614+0000","last_became_peered":"2024-09-21T07:35:56.523614+0000","last_unstale":"2024-09-21T07:35:56.529072+0000","last_undegraded":"2024-09-21T07:35:56.529072+0000","last_fullsized":"2024-09-21T07:35:56.529072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:46.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517191+0000","last_change":"2024-09-21T07:35:56.530699+0000","last_active":"2024-09-21T07:35:57.517191+0000","last_peered":"2024-09-21T07:35:57.517191+0000","last_clean":"2024-09-21T07:35:57.517191+0000","last_became_active":"2024-09-21T07:35:56.530406+0000","last_became_peered":"2024-09-21T07:35:56.530406+0000","last_unstale":"2024-09-21T07:35:57.517191+0000","last_undegraded":"2024-09-21T07:35:57.517191+0000","last_fullsized":"2024-09-21T07:35:57.517191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:30.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541230+0000","last_change":"2024-09-21T07:35:56.534740+0000","last_active":"2024-09-21T07:35:56.541230+0000","last_peered":"2024-09-21T07:35:56.541230+0000","last_clean":"2024-09-21T07:35:56.541230+0000","last_became_active":"2024-09-21T07:35:56.534420+0000","last_became_peered":"2024-09-21T07:35:56.534420+0000","last_unstale":"2024-09-21T07:35:56.541230+0000","last_undegraded":"2024-09-21T07:35:56.541230+0000","last_fullsized":"2024-09-21T07:35:56.541230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:22.523823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537965+0000","last_change":"2024-09-21T07:35:56.534031+0000","last_active":"2024-09-21T07:35:56.537965+0000","last_peered":"2024-09-21T07:35:56.537965+0000","last_clean":"2024-09-21T07:35:56.537965+0000","last_became_active":"2024-09-21T07:35:56.533080+0000","last_became_peered":"2024-09-21T07:35:56.533080+0000","last_unstale":"2024-09-21T07:35:56.537965+0000","last_undegraded":"2024-09-21T07:35:56.537965+0000","last_fullsized":"2024-09-21T07:35:56.537965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:17.039270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518497+0000","last_change":"2024-09-21T07:35:56.542875+0000","last_active":"2024-09-21T07:35:57.518497+0000","last_peered":"2024-09-21T07:35:57.518497+0000","last_clean":"2024-09-21T07:35:57.518497+0000","last_became_active":"2024-09-21T07:35:56.541115+0000","last_became_peered":"2024-09-21T07:35:56.541115+0000","last_unstale":"2024-09-21T07:35:57.518497+0000","last_undegraded":"2024-09-21T07:35:57.518497+0000","last_fullsized":"2024-09-21T07:35:57.518497+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:17.995132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553046+0000","last_change":"2024-09-21T07:35:56.546633+0000","last_active":"2024-09-21T07:35:56.553046+0000","last_peered":"2024-09-21T07:35:56.553046+0000","last_clean":"2024-09-21T07:35:56.553046+0000","last_became_active":"2024-09-21T07:35:56.546330+0000","last_became_peered":"2024-09-21T07:35:56.546330+0000","last_unstale":"2024-09-21T07:35:56.553046+0000","last_undegraded":"2024-09-21T07:35:56.553046+0000","last_fullsized":"2024-09-21T07:35:56.553046+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.103527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527661+0000","last_change":"2024-09-21T07:35:56.522008+0000","last_active":"2024-09-21T07:35:56.527661+0000","last_peered":"2024-09-21T07:35:56.527661+0000","last_clean":"2024-09-21T07:35:56.527661+0000","last_became_active":"2024-09-21T07:35:56.521403+0000","last_became_peered":"2024-09-21T07:35:56.521403+0000","last_unstale":"2024-09-21T07:35:56.527661+0000","last_undegraded":"2024-09-21T07:35:56.527661+0000","last_fullsized":"2024-09-21T07:35:56.527661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:43.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517004+0000","last_change":"2024-09-21T07:35:56.515225+0000","last_active":"2024-09-21T07:35:57.517004+0000","last_peered":"2024-09-21T07:35:57.517004+0000","last_clean":"2024-09-21T07:35:57.517004+0000","last_became_active":"2024-09-21T07:35:56.513973+0000","last_became_peered":"2024-09-21T07:35:56.513973+0000","last_unstale":"2024-09-21T07:35:57.517004+0000","last_undegraded":"2024-09-21T07:35:57.517004+0000","last_fullsized":"2024-09-21T07:35:57.517004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:22.147149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536045+0000","last_change":"2024-09-21T07:35:56.530415+0000","last_active":"2024-09-21T07:35:56.536045+0000","last_peered":"2024-09-21T07:35:56.536045+0000","last_clean":"2024-09-21T07:35:56.536045+0000","last_became_active":"2024-09-21T07:35:56.530079+0000","last_became_peered":"2024-09-21T07:35:56.530079+0000","last_unstale":"2024-09-21T07:35:56.536045+0000","last_undegraded":"2024-09-21T07:35:56.536045+0000","last_fullsized":"2024-09-21T07:35:56.536045+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:05.322121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517424+0000","last_change":"2024-09-21T07:35:56.546948+0000","last_active":"2024-09-21T07:35:57.517424+0000","last_peered":"2024-09-21T07:35:57.517424+0000","last_clean":"2024-09-21T07:35:57.517424+0000","last_became_active":"2024-09-21T07:35:56.546426+0000","last_became_peered":"2024-09-21T07:35:56.546426+0000","last_unstale":"2024-09-21T07:35:57.517424+0000","last_undegraded":"2024-09-21T07:35:57.517424+0000","last_fullsized":"2024-09-21T07:35:57.517424+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:00.228007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517159+0000","last_change":"2024-09-21T07:35:56.546840+0000","last_active":"2024-09-21T07:35:57.517159+0000","last_peered":"2024-09-21T07:35:57.517159+0000","last_clean":"2024-09-21T07:35:57.517159+0000","last_became_active":"2024-09-21T07:35:56.546528+0000","last_became_peered":"2024-09-21T07:35:56.546528+0000","last_unstale":"2024-09-21T07:35:57.517159+0000","last_undegraded":"2024-09-21T07:35:57.517159+0000","last_fullsized":"2024-09-21T07:35:57.517159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:42.508204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549823+0000","last_change":"2024-09-21T07:35:56.545732+0000","last_active":"2024-09-21T07:35:56.549823+0000","last_peered":"2024-09-21T07:35:56.549823+0000","last_clean":"2024-09-21T07:35:56.549823+0000","last_became_active":"2024-09-21T07:35:56.545386+0000","last_became_peered":"2024-09-21T07:35:56.545386+0000","last_unstale":"2024-09-21T07:35:56.549823+0000","last_undegraded":"2024-09-21T07:35:56.549823+0000","last_fullsized":"2024-09-21T07:35:56.549823+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:04.460865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.529944+0000","last_change":"2024-09-21T07:35:56.516896+0000","last_active":"2024-09-21T07:35:56.529944+0000","last_peered":"2024-09-21T07:35:56.529944+0000","last_clean":"2024-09-21T07:35:56.529944+0000","last_became_active":"2024-09-21T07:35:56.516577+0000","last_became_peered":"2024-09-21T07:35:56.516577+0000","last_unstale":"2024-09-21T07:35:56.529944+0000","last_undegraded":"2024-09-21T07:35:56.529944+0000","last_fullsized":"2024-09-21T07:35:56.529944+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:29.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544185+0000","last_change":"2024-09-21T07:35:56.538492+0000","last_active":"2024-09-21T07:35:56.544185+0000","last_peered":"2024-09-21T07:35:56.544185+0000","last_clean":"2024-09-21T07:35:56.544185+0000","last_became_active":"2024-09-21T07:35:56.537941+0000","last_became_peered":"2024-09-21T07:35:56.537941+0000","last_unstale":"2024-09-21T07:35:56.544185+0000","last_undegraded":"2024-09-21T07:35:56.544185+0000","last_fullsized":"2024-09-21T07:35:56.544185+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.199413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.527631+0000","last_change":"2024-09-21T07:35:56.521689+0000","last_active":"2024-09-21T07:35:56.527631+0000","last_peered":"2024-09-21T07:35:56.527631+0000","last_clean":"2024-09-21T07:35:56.527631+0000","last_became_active":"2024-09-21T07:35:56.521019+0000","last_became_peered":"2024-09-21T07:35:56.521019+0000","last_unstale":"2024-09-21T07:35:56.527631+0000","last_undegraded":"2024-09-21T07:35:56.527631+0000","last_fullsized":"2024-09-21T07:35:56.527631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.590257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463927+0000","last_change":"2024-09-21T07:35:56.528185+0000","last_active":"2024-09-21T07:35:58.463927+0000","last_peered":"2024-09-21T07:35:58.463927+0000","last_clean":"2024-09-21T07:35:58.463927+0000","last_became_active":"2024-09-21T07:35:56.524714+0000","last_became_peered":"2024-09-21T07:35:56.524714+0000","last_unstale":"2024-09-21T07:35:58.463927+0000","last_undegraded":"2024-09-21T07:35:58.463927+0000","last_fullsized":"2024-09-21T07:35:58.463927+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:43.346270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517795+0000","last_change":"2024-09-21T07:35:56.537610+0000","last_active":"2024-09-21T07:35:57.517795+0000","last_peered":"2024-09-21T07:35:57.517795+0000","last_clean":"2024-09-21T07:35:57.517795+0000","last_became_active":"2024-09-21T07:35:56.537302+0000","last_became_peered":"2024-09-21T07:35:56.537302+0000","last_unstale":"2024-09-21T07:35:57.517795+0000","last_undegraded":"2024-09-21T07:35:57.517795+0000","last_fullsized":"2024-09-21T07:35:57.517795+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:23.891119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517828+0000","last_change":"2024-09-21T07:35:56.530013+0000","last_active":"2024-09-21T07:35:57.517828+0000","last_peered":"2024-09-21T07:35:57.517828+0000","last_clean":"2024-09-21T07:35:57.517828+0000","last_became_active":"2024-09-21T07:35:56.529553+0000","last_became_peered":"2024-09-21T07:35:56.529553+0000","last_unstale":"2024-09-21T07:35:57.517828+0000","last_undegraded":"2024-09-21T07:35:57.517828+0000","last_fullsized":"2024-09-21T07:35:57.517828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:36.273322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.538335+0000","last_change":"2024-09-21T07:35:56.535980+0000","last_active":"2024-09-21T07:35:56.538335+0000","last_peered":"2024-09-21T07:35:56.538335+0000","last_clean":"2024-09-21T07:35:56.538335+0000","last_became_active":"2024-09-21T07:35:56.532666+0000","last_became_peered":"2024-09-21T07:35:56.532666+0000","last_unstale":"2024-09-21T07:35:56.538335+0000","last_undegraded":"2024-09-21T07:35:56.538335+0000","last_fullsized":"2024-09-21T07:35:56.538335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:17.343454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537998+0000","last_change":"2024-09-21T07:35:56.535093+0000","last_active":"2024-09-21T07:35:56.537998+0000","last_peered":"2024-09-21T07:35:56.537998+0000","last_clean":"2024-09-21T07:35:56.537998+0000","last_became_active":"2024-09-21T07:35:56.532682+0000","last_became_peered":"2024-09-21T07:35:56.532682+0000","last_unstale":"2024-09-21T07:35:56.537998+0000","last_undegraded":"2024-09-21T07:35:56.537998+0000","last_fullsized":"2024-09-21T07:35:56.537998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:23.972535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519035+0000","last_change":"2024-09-21T07:35:56.541017+0000","last_active":"2024-09-21T07:35:57.519035+0000","last_peered":"2024-09-21T07:35:57.519035+0000","last_clean":"2024-09-21T07:35:57.519035+0000","last_became_active":"2024-09-21T07:35:56.540691+0000","last_became_peered":"2024-09-21T07:35:56.540691+0000","last_unstale":"2024-09-21T07:35:57.519035+0000","last_undegraded":"2024-09-21T07:35:57.519035+0000","last_fullsized":"2024-09-21T07:35:57.519035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:40.675743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516622+0000","last_change":"2024-09-21T07:35:56.543465+0000","last_active":"2024-09-21T07:35:57.516622+0000","last_peered":"2024-09-21T07:35:57.516622+0000","last_clean":"2024-09-21T07:35:57.516622+0000","last_became_active":"2024-09-21T07:35:56.543121+0000","last_became_peered":"2024-09-21T07:35:56.543121+0000","last_unstale":"2024-09-21T07:35:57.516622+0000","last_undegraded":"2024-09-21T07:35:57.516622+0000","last_fullsized":"2024-09-21T07:35:57.516622+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:35.776811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517089+0000","last_change":"2024-09-21T07:35:56.521670+0000","last_active":"2024-09-21T07:35:57.517089+0000","last_peered":"2024-09-21T07:35:57.517089+0000","last_clean":"2024-09-21T07:35:57.517089+0000","last_became_active":"2024-09-21T07:35:56.521335+0000","last_became_peered":"2024-09-21T07:35:56.521335+0000","last_unstale":"2024-09-21T07:35:57.517089+0000","last_undegraded":"2024-09-21T07:35:57.517089+0000","last_fullsized":"2024-09-21T07:35:57.517089+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:44.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553103+0000","last_change":"2024-09-21T07:35:56.549097+0000","last_active":"2024-09-21T07:35:56.553103+0000","last_peered":"2024-09-21T07:35:56.553103+0000","last_clean":"2024-09-21T07:35:56.553103+0000","last_became_active":"2024-09-21T07:35:56.548774+0000","last_became_peered":"2024-09-21T07:35:56.548774+0000","last_unstale":"2024-09-21T07:35:56.553103+0000","last_undegraded":"2024-09-21T07:35:56.553103+0000","last_fullsized":"2024-09-21T07:35:56.553103+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:47.203701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541674+0000","last_change":"2024-09-21T07:35:56.537307+0000","last_active":"2024-09-21T07:35:56.541674+0000","last_peered":"2024-09-21T07:35:56.541674+0000","last_clean":"2024-09-21T07:35:56.541674+0000","last_became_active":"2024-09-21T07:35:56.536464+0000","last_became_peered":"2024-09-21T07:35:56.536464+0000","last_unstale":"2024-09-21T07:35:56.541674+0000","last_undegraded":"2024-09-21T07:35:56.541674+0000","last_fullsized":"2024-09-21T07:35:56.541674+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:10.782198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464085+0000","last_change":"2024-09-21T07:35:56.518864+0000","last_active":"2024-09-21T07:35:58.464085+0000","last_peered":"2024-09-21T07:35:58.464085+0000","last_clean":"2024-09-21T07:35:58.464085+0000","last_became_active":"2024-09-21T07:35:56.518111+0000","last_became_peered":"2024-09-21T07:35:56.518111+0000","last_unstale":"2024-09-21T07:35:58.464085+0000","last_undegraded":"2024-09-21T07:35:58.464085+0000","last_fullsized":"2024-09-21T07:35:58.464085+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:04.342184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517754+0000","last_change":"2024-09-21T07:35:55.507617+0000","last_active":"2024-09-21T07:35:57.517754+0000","last_peered":"2024-09-21T07:35:57.517754+0000","last_clean":"2024-09-21T07:35:57.517754+0000","last_became_active":"2024-09-21T07:35:55.507237+0000","last_became_peered":"2024-09-21T07:35:55.507237+0000","last_unstale":"2024-09-21T07:35:57.517754+0000","last_undegraded":"2024-09-21T07:35:57.517754+0000","last_fullsized":"2024-09-21T07:35:57.517754+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:33.418156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.528141+0000","last_change":"2024-09-21T07:35:56.525646+0000","last_active":"2024-09-21T07:35:56.528141+0000","last_peered":"2024-09-21T07:35:56.528141+0000","last_clean":"2024-09-21T07:35:56.528141+0000","last_became_active":"2024-09-21T07:35:56.525314+0000","last_became_peered":"2024-09-21T07:35:56.525314+0000","last_unstale":"2024-09-21T07:35:56.528141+0000","last_undegraded":"2024-09-21T07:35:56.528141+0000","last_fullsized":"2024-09-21T07:35:56.528141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:30.881896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.530655+0000","last_change":"2024-09-21T07:35:55.512414+0000","last_active":"2024-09-21T07:35:56.530655+0000","last_peered":"2024-09-21T07:35:56.530655+0000","last_clean":"2024-09-21T07:35:56.530655+0000","last_became_active":"2024-09-21T07:35:55.511521+0000","last_became_peered":"2024-09-21T07:35:55.511521+0000","last_unstale":"2024-09-21T07:35:56.530655+0000","last_undegraded":"2024-09-21T07:35:56.530655+0000","last_fullsized":"2024-09-21T07:35:56.530655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:32.733910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541575+0000","last_change":"2024-09-21T07:35:56.535286+0000","last_active":"2024-09-21T07:35:56.541575+0000","last_peered":"2024-09-21T07:35:56.541575+0000","last_clean":"2024-09-21T07:35:56.541575+0000","last_became_active":"2024-09-21T07:35:56.531371+0000","last_became_peered":"2024-09-21T07:35:56.531371+0000","last_unstale":"2024-09-21T07:35:56.541575+0000","last_undegraded":"2024-09-21T07:35:56.541575+0000","last_fullsized":"2024-09-21T07:35:56.541575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:12.067873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464318+0000","last_change":"2024-09-21T07:35:55.513756+0000","last_active":"2024-09-21T07:35:58.464318+0000","last_peered":"2024-09-21T07:35:58.464318+0000","last_clean":"2024-09-21T07:35:58.464318+0000","last_became_active":"2024-09-21T07:35:55.513321+0000","last_became_peered":"2024-09-21T07:35:55.513321+0000","last_unstale":"2024-09-21T07:35:58.464318+0000","last_undegraded":"2024-09-21T07:35:58.464318+0000","last_fullsized":"2024-09-21T07:35:58.464318+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:07.401606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518481+0000","last_change":"2024-09-21T07:35:56.539610+0000","last_active":"2024-09-21T07:35:57.518481+0000","last_peered":"2024-09-21T07:35:57.518481+0000","last_clean":"2024-09-21T07:35:57.518481+0000","last_became_active":"2024-09-21T07:35:56.539303+0000","last_became_peered":"2024-09-21T07:35:56.539303+0000","last_unstale":"2024-09-21T07:35:57.518481+0000","last_undegraded":"2024-09-21T07:35:57.518481+0000","last_fullsized":"2024-09-21T07:35:57.518481+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:44.962547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516758+0000","last_change":"2024-09-21T07:35:55.510443+0000","last_active":"2024-09-21T07:35:57.516758+0000","last_peered":"2024-09-21T07:35:57.516758+0000","last_clean":"2024-09-21T07:35:57.516758+0000","last_became_active":"2024-09-21T07:35:55.510085+0000","last_became_peered":"2024-09-21T07:35:55.510085+0000","last_unstale":"2024-09-21T07:35:57.516758+0000","last_undegraded":"2024-09-21T07:35:57.516758+0000","last_fullsized":"2024-09-21T07:35:57.516758+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:04.391176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517372+0000","last_change":"2024-09-21T07:35:56.522754+0000","last_active":"2024-09-21T07:35:57.517372+0000","last_peered":"2024-09-21T07:35:57.517372+0000","last_clean":"2024-09-21T07:35:57.517372+0000","last_became_active":"2024-09-21T07:35:56.522452+0000","last_became_peered":"2024-09-21T07:35:56.522452+0000","last_unstale":"2024-09-21T07:35:57.517372+0000","last_undegraded":"2024-09-21T07:35:57.517372+0000","last_fullsized":"2024-09-21T07:35:57.517372+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:43.361943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536213+0000","last_change":"2024-09-21T07:35:55.517500+0000","last_active":"2024-09-21T07:35:56.536213+0000","last_peered":"2024-09-21T07:35:56.536213+0000","last_clean":"2024-09-21T07:35:56.536213+0000","last_became_active":"2024-09-21T07:35:55.517201+0000","last_became_peered":"2024-09-21T07:35:55.517201+0000","last_unstale":"2024-09-21T07:35:56.536213+0000","last_undegraded":"2024-09-21T07:35:56.536213+0000","last_fullsized":"2024-09-21T07:35:56.536213+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.619469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517331+0000","last_change":"2024-09-21T07:35:56.531499+0000","last_active":"2024-09-21T07:35:57.517331+0000","last_peered":"2024-09-21T07:35:57.517331+0000","last_clean":"2024-09-21T07:35:57.517331+0000","last_became_active":"2024-09-21T07:35:56.531146+0000","last_became_peered":"2024-09-21T07:35:56.531146+0000","last_unstale":"2024-09-21T07:35:57.517331+0000","last_undegraded":"2024-09-21T07:35:57.517331+0000","last_fullsized":"2024-09-21T07:35:57.517331+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522120+0000","last_change":"2024-09-21T07:35:55.517407+0000","last_active":"2024-09-21T07:35:56.522120+0000","last_peered":"2024-09-21T07:35:56.522120+0000","last_clean":"2024-09-21T07:35:56.522120+0000","last_became_active":"2024-09-21T07:35:55.517062+0000","last_became_peered":"2024-09-21T07:35:55.517062+0000","last_unstale":"2024-09-21T07:35:56.522120+0000","last_undegraded":"2024-09-21T07:35:56.522120+0000","last_fullsized":"2024-09-21T07:35:56.522120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:32.359923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517647+0000","last_change":"2024-09-21T07:35:56.536125+0000","last_active":"2024-09-21T07:35:57.517647+0000","last_peered":"2024-09-21T07:35:57.517647+0000","last_clean":"2024-09-21T07:35:57.517647+0000","last_became_active":"2024-09-21T07:35:56.535400+0000","last_became_peered":"2024-09-21T07:35:56.535400+0000","last_unstale":"2024-09-21T07:35:57.517647+0000","last_undegraded":"2024-09-21T07:35:57.517647+0000","last_fullsized":"2024-09-21T07:35:57.517647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.519168+0000","last_change":"2024-09-21T07:35:55.514583+0000","last_active":"2024-09-21T07:35:56.519168+0000","last_peered":"2024-09-21T07:35:56.519168+0000","last_clean":"2024-09-21T07:35:56.519168+0000","last_became_active":"2024-09-21T07:35:55.514197+0000","last_became_peered":"2024-09-21T07:35:55.514197+0000","last_unstale":"2024-09-21T07:35:56.519168+0000","last_undegraded":"2024-09-21T07:35:56.519168+0000","last_fullsized":"2024-09-21T07:35:56.519168+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:46.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516910+0000","last_change":"2024-09-21T07:35:56.515734+0000","last_active":"2024-09-21T07:35:57.516910+0000","last_peered":"2024-09-21T07:35:57.516910+0000","last_clean":"2024-09-21T07:35:57.516910+0000","last_became_active":"2024-09-21T07:35:56.515411+0000","last_became_peered":"2024-09-21T07:35:56.515411+0000","last_unstale":"2024-09-21T07:35:57.516910+0000","last_undegraded":"2024-09-21T07:35:57.516910+0000","last_fullsized":"2024-09-21T07:35:57.516910+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:26.754127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518959+0000","last_change":"2024-09-21T07:35:55.509338+0000","last_active":"2024-09-21T07:35:57.518959+0000","last_peered":"2024-09-21T07:35:57.518959+0000","last_clean":"2024-09-21T07:35:57.518959+0000","last_became_active":"2024-09-21T07:35:55.508913+0000","last_became_peered":"2024-09-21T07:35:55.508913+0000","last_unstale":"2024-09-21T07:35:57.518959+0000","last_undegraded":"2024-09-21T07:35:57.518959+0000","last_fullsized":"2024-09-21T07:35:57.518959+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:25.868297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541192+0000","last_change":"2024-09-21T07:35:56.534293+0000","last_active":"2024-09-21T07:35:56.541192+0000","last_peered":"2024-09-21T07:35:56.541192+0000","last_clean":"2024-09-21T07:35:56.541192+0000","last_became_active":"2024-09-21T07:35:56.533756+0000","last_became_peered":"2024-09-21T07:35:56.533756+0000","last_unstale":"2024-09-21T07:35:56.541192+0000","last_undegraded":"2024-09-21T07:35:56.541192+0000","last_fullsized":"2024-09-21T07:35:56.541192+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:19.301721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526134+0000","last_change":"2024-09-21T07:35:55.520395+0000","last_active":"2024-09-21T07:35:56.526134+0000","last_peered":"2024-09-21T07:35:56.526134+0000","last_clean":"2024-09-21T07:35:56.526134+0000","last_became_active":"2024-09-21T07:35:55.520048+0000","last_became_peered":"2024-09-21T07:35:55.520048+0000","last_unstale":"2024-09-21T07:35:56.526134+0000","last_undegraded":"2024-09-21T07:35:56.526134+0000","last_fullsized":"2024-09-21T07:35:56.526134+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:38.598370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516626+0000","last_change":"2024-09-21T07:35:56.535112+0000","last_active":"2024-09-21T07:35:57.516626+0000","last_peered":"2024-09-21T07:35:57.516626+0000","last_clean":"2024-09-21T07:35:57.516626+0000","last_became_active":"2024-09-21T07:35:56.534778+0000","last_became_peered":"2024-09-21T07:35:56.534778+0000","last_unstale":"2024-09-21T07:35:57.516626+0000","last_undegraded":"2024-09-21T07:35:57.516626+0000","last_fullsized":"2024-09-21T07:35:57.516626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:08.412784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517130+0000","last_change":"2024-09-21T07:35:55.516818+0000","last_active":"2024-09-21T07:35:57.517130+0000","last_peered":"2024-09-21T07:35:57.517130+0000","last_clean":"2024-09-21T07:35:57.517130+0000","last_became_active":"2024-09-21T07:35:55.516404+0000","last_became_peered":"2024-09-21T07:35:55.516404+0000","last_unstale":"2024-09-21T07:35:57.517130+0000","last_undegraded":"2024-09-21T07:35:57.517130+0000","last_fullsized":"2024-09-21T07:35:57.517130+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:28.596997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518816+0000","last_change":"2024-09-21T07:35:56.534487+0000","last_active":"2024-09-21T07:35:57.518816+0000","last_peered":"2024-09-21T07:35:57.518816+0000","last_clean":"2024-09-21T07:35:57.518816+0000","last_became_active":"2024-09-21T07:35:56.533641+0000","last_became_peered":"2024-09-21T07:35:56.533641+0000","last_unstale":"2024-09-21T07:35:57.518816+0000","last_undegraded":"2024-09-21T07:35:57.518816+0000","last_fullsized":"2024-09-21T07:35:57.518816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:06.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.552972+0000","last_change":"2024-09-21T07:35:55.518211+0000","last_active":"2024-09-21T07:35:56.552972+0000","last_peered":"2024-09-21T07:35:56.552972+0000","last_clean":"2024-09-21T07:35:56.552972+0000","last_became_active":"2024-09-21T07:35:55.517091+0000","last_became_peered":"2024-09-21T07:35:55.517091+0000","last_unstale":"2024-09-21T07:35:56.552972+0000","last_undegraded":"2024-09-21T07:35:56.552972+0000","last_fullsized":"2024-09-21T07:35:56.552972+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464297+0000","last_change":"2024-09-21T07:35:56.532444+0000","last_active":"2024-09-21T07:35:58.464297+0000","last_peered":"2024-09-21T07:35:58.464297+0000","last_clean":"2024-09-21T07:35:58.464297+0000","last_became_active":"2024-09-21T07:35:56.532083+0000","last_became_peered":"2024-09-21T07:35:56.532083+0000","last_unstale":"2024-09-21T07:35:58.464297+0000","last_undegraded":"2024-09-21T07:35:58.464297+0000","last_fullsized":"2024-09-21T07:35:58.464297+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:13.337108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464254+0000","last_change":"2024-09-21T07:35:55.506824+0000","last_active":"2024-09-21T07:35:58.464254+0000","last_peered":"2024-09-21T07:35:58.464254+0000","last_clean":"2024-09-21T07:35:58.464254+0000","last_became_active":"2024-09-21T07:35:55.506484+0000","last_became_peered":"2024-09-21T07:35:55.506484+0000","last_unstale":"2024-09-21T07:35:58.464254+0000","last_undegraded":"2024-09-21T07:35:58.464254+0000","last_fullsized":"2024-09-21T07:35:58.464254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:43.784411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.551653+0000","last_change":"2024-09-21T07:35:56.550098+0000","last_active":"2024-09-21T07:35:56.551653+0000","last_peered":"2024-09-21T07:35:56.551653+0000","last_clean":"2024-09-21T07:35:56.551653+0000","last_became_active":"2024-09-21T07:35:56.549567+0000","last_became_peered":"2024-09-21T07:35:56.549567+0000","last_unstale":"2024-09-21T07:35:56.551653+0000","last_undegraded":"2024-09-21T07:35:56.551653+0000","last_fullsized":"2024-09-21T07:35:56.551653+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:36.902299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.518734+0000","last_change":"2024-09-21T07:35:55.500793+0000","last_active":"2024-09-21T07:35:56.518734+0000","last_peered":"2024-09-21T07:35:56.518734+0000","last_clean":"2024-09-21T07:35:56.518734+0000","last_became_active":"2024-09-21T07:35:55.500461+0000","last_became_peered":"2024-09-21T07:35:55.500461+0000","last_unstale":"2024-09-21T07:35:56.518734+0000","last_undegraded":"2024-09-21T07:35:56.518734+0000","last_fullsized":"2024-09-21T07:35:56.518734+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:55.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517253+0000","last_change":"2024-09-21T07:35:56.548523+0000","last_active":"2024-09-21T07:35:57.517253+0000","last_peered":"2024-09-21T07:35:57.517253+0000","last_clean":"2024-09-21T07:35:57.517253+0000","last_became_active":"2024-09-21T07:35:56.548223+0000","last_became_peered":"2024-09-21T07:35:56.548223+0000","last_unstale":"2024-09-21T07:35:57.517253+0000","last_undegraded":"2024-09-21T07:35:57.517253+0000","last_fullsized":"2024-09-21T07:35:57.517253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:55.796410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516547+0000","last_change":"2024-09-21T07:35:55.518059+0000","last_active":"2024-09-21T07:35:57.516547+0000","last_peered":"2024-09-21T07:35:57.516547+0000","last_clean":"2024-09-21T07:35:57.516547+0000","last_became_active":"2024-09-21T07:35:55.517406+0000","last_became_peered":"2024-09-21T07:35:55.517406+0000","last_unstale":"2024-09-21T07:35:57.516547+0000","last_undegraded":"2024-09-21T07:35:57.516547+0000","last_fullsized":"2024-09-21T07:35:57.516547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:19.228872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.539212+0000","last_change":"2024-09-21T07:35:56.533846+0000","last_active":"2024-09-21T07:35:56.539212+0000","last_peered":"2024-09-21T07:35:56.539212+0000","last_clean":"2024-09-21T07:35:56.539212+0000","last_became_active":"2024-09-21T07:35:56.533430+0000","last_became_peered":"2024-09-21T07:35:56.533430+0000","last_unstale":"2024-09-21T07:35:56.539212+0000","last_undegraded":"2024-09-21T07:35:56.539212+0000","last_fullsized":"2024-09-21T07:35:56.539212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:59.062863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":23,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517932+0000","last_change":"2024-09-21T07:35:55.514195+0000","last_active":"2024-09-21T07:35:57.517932+0000","last_peered":"2024-09-21T07:35:57.517932+0000","last_clean":"2024-09-21T07:35:57.517932+0000","last_became_active":"2024-09-21T07:35:55.513310+0000","last_became_peered":"2024-09-21T07:35:55.513310+0000","last_unstale":"2024-09-21T07:35:57.517932+0000","last_undegraded":"2024-09-21T07:35:57.517932+0000","last_fullsized":"2024-09-21T07:35:57.517932+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541511+0000","last_change":"2024-09-21T07:35:56.537670+0000","last_active":"2024-09-21T07:35:56.541511+0000","last_peered":"2024-09-21T07:35:56.541511+0000","last_clean":"2024-09-21T07:35:56.541511+0000","last_became_active":"2024-09-21T07:35:56.535095+0000","last_became_peered":"2024-09-21T07:35:56.535095+0000","last_unstale":"2024-09-21T07:35:56.541511+0000","last_undegraded":"2024-09-21T07:35:56.541511+0000","last_fullsized":"2024-09-21T07:35:56.541511+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:34.569090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.535689+0000","last_change":"2024-09-21T07:35:55.508297+0000","last_active":"2024-09-21T07:35:56.535689+0000","last_peered":"2024-09-21T07:35:56.535689+0000","last_clean":"2024-09-21T07:35:56.535689+0000","last_became_active":"2024-09-21T07:35:55.507986+0000","last_became_peered":"2024-09-21T07:35:55.507986+0000","last_unstale":"2024-09-21T07:35:56.535689+0000","last_undegraded":"2024-09-21T07:35:56.535689+0000","last_fullsized":"2024-09-21T07:35:56.535689+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:00.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.526722+0000","last_change":"2024-09-21T07:35:56.523458+0000","last_active":"2024-09-21T07:35:56.526722+0000","last_peered":"2024-09-21T07:35:56.526722+0000","last_clean":"2024-09-21T07:35:56.526722+0000","last_became_active":"2024-09-21T07:35:56.522634+0000","last_became_peered":"2024-09-21T07:35:56.522634+0000","last_unstale":"2024-09-21T07:35:56.526722+0000","last_undegraded":"2024-09-21T07:35:56.526722+0000","last_fullsized":"2024-09-21T07:35:56.526722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:35.163475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":15,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537684+0000","last_change":"2024-09-21T07:35:55.511813+0000","last_active":"2024-09-21T07:35:56.537684+0000","last_peered":"2024-09-21T07:35:56.537684+0000","last_clean":"2024-09-21T07:35:56.537684+0000","last_became_active":"2024-09-21T07:35:55.511137+0000","last_became_peered":"2024-09-21T07:35:55.511137+0000","last_unstale":"2024-09-21T07:35:56.537684+0000","last_undegraded":"2024-09-21T07:35:56.537684+0000","last_fullsized":"2024-09-21T07:35:56.537684+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:20.145930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.537342+0000","last_change":"2024-09-21T07:35:56.533636+0000","last_active":"2024-09-21T07:35:56.537342+0000","last_peered":"2024-09-21T07:35:56.537342+0000","last_clean":"2024-09-21T07:35:56.537342+0000","last_became_active":"2024-09-21T07:35:56.533340+0000","last_became_peered":"2024-09-21T07:35:56.533340+0000","last_unstale":"2024-09-21T07:35:56.537342+0000","last_undegraded":"2024-09-21T07:35:56.537342+0000","last_fullsized":"2024-09-21T07:35:56.537342+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:41.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464422+0000","last_change":"2024-09-21T07:35:55.512632+0000","last_active":"2024-09-21T07:35:58.464422+0000","last_peered":"2024-09-21T07:35:58.464422+0000","last_clean":"2024-09-21T07:35:58.464422+0000","last_became_active":"2024-09-21T07:35:55.511701+0000","last_became_peered":"2024-09-21T07:35:55.511701+0000","last_unstale":"2024-09-21T07:35:58.464422+0000","last_undegraded":"2024-09-21T07:35:58.464422+0000","last_fullsized":"2024-09-21T07:35:58.464422+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:49.093391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.541367+0000","last_change":"2024-09-21T07:35:56.535182+0000","last_active":"2024-09-21T07:35:56.541367+0000","last_peered":"2024-09-21T07:35:56.541367+0000","last_clean":"2024-09-21T07:35:56.541367+0000","last_became_active":"2024-09-21T07:35:56.530549+0000","last_became_peered":"2024-09-21T07:35:56.530549+0000","last_unstale":"2024-09-21T07:35:56.541367+0000","last_undegraded":"2024-09-21T07:35:56.541367+0000","last_fullsized":"2024-09-21T07:35:56.541367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:45.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518975+0000","last_change":"2024-09-21T07:35:55.511997+0000","last_active":"2024-09-21T07:35:57.518975+0000","last_peered":"2024-09-21T07:35:57.518975+0000","last_clean":"2024-09-21T07:35:57.518975+0000","last_became_active":"2024-09-21T07:35:55.511282+0000","last_became_peered":"2024-09-21T07:35:55.511282+0000","last_unstale":"2024-09-21T07:35:57.518975+0000","last_undegraded":"2024-09-21T07:35:57.518975+0000","last_fullsized":"2024-09-21T07:35:57.518975+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:59.004838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464585+0000","last_change":"2024-09-21T07:35:56.545326+0000","last_active":"2024-09-21T07:35:58.464585+0000","last_peered":"2024-09-21T07:35:58.464585+0000","last_clean":"2024-09-21T07:35:58.464585+0000","last_became_active":"2024-09-21T07:35:56.544025+0000","last_became_peered":"2024-09-21T07:35:56.544025+0000","last_unstale":"2024-09-21T07:35:58.464585+0000","last_undegraded":"2024-09-21T07:35:58.464585+0000","last_fullsized":"2024-09-21T07:35:58.464585+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:20.664111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518648+0000","last_change":"2024-09-21T07:35:55.507126+0000","last_active":"2024-09-21T07:35:57.518648+0000","last_peered":"2024-09-21T07:35:57.518648+0000","last_clean":"2024-09-21T07:35:57.518648+0000","last_became_active":"2024-09-21T07:35:55.506666+0000","last_became_peered":"2024-09-21T07:35:55.506666+0000","last_unstale":"2024-09-21T07:35:57.518648+0000","last_undegraded":"2024-09-21T07:35:57.518648+0000","last_fullsized":"2024-09-21T07:35:57.518648+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553096+0000","last_change":"2024-09-21T07:35:56.548916+0000","last_active":"2024-09-21T07:35:56.553096+0000","last_peered":"2024-09-21T07:35:56.553096+0000","last_clean":"2024-09-21T07:35:56.553096+0000","last_became_active":"2024-09-21T07:35:56.548631+0000","last_became_peered":"2024-09-21T07:35:56.548631+0000","last_unstale":"2024-09-21T07:35:56.553096+0000","last_undegraded":"2024-09-21T07:35:56.553096+0000","last_fullsized":"2024-09-21T07:35:56.553096+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:07.211518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464031+0000","last_change":"2024-09-21T07:35:55.504973+0000","last_active":"2024-09-21T07:35:58.464031+0000","last_peered":"2024-09-21T07:35:58.464031+0000","last_clean":"2024-09-21T07:35:58.464031+0000","last_became_active":"2024-09-21T07:35:55.504600+0000","last_became_peered":"2024-09-21T07:35:55.504600+0000","last_unstale":"2024-09-21T07:35:58.464031+0000","last_undegraded":"2024-09-21T07:35:58.464031+0000","last_fullsized":"2024-09-21T07:35:58.464031+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:14.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517377+0000","last_change":"2024-09-21T07:35:56.538836+0000","last_active":"2024-09-21T07:35:57.517377+0000","last_peered":"2024-09-21T07:35:57.517377+0000","last_clean":"2024-09-21T07:35:57.517377+0000","last_became_active":"2024-09-21T07:35:56.538514+0000","last_became_peered":"2024-09-21T07:35:56.538514+0000","last_unstale":"2024-09-21T07:35:57.517377+0000","last_undegraded":"2024-09-21T07:35:57.517377+0000","last_fullsized":"2024-09-21T07:35:57.517377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:23.823985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516955+0000","last_change":"2024-09-21T07:35:55.504947+0000","last_active":"2024-09-21T07:35:57.516955+0000","last_peered":"2024-09-21T07:35:57.516955+0000","last_clean":"2024-09-21T07:35:57.516955+0000","last_became_active":"2024-09-21T07:35:55.504601+0000","last_became_peered":"2024-09-21T07:35:55.504601+0000","last_unstale":"2024-09-21T07:35:57.516955+0000","last_undegraded":"2024-09-21T07:35:57.516955+0000","last_fullsized":"2024-09-21T07:35:57.516955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.728969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.544576+0000","last_change":"2024-09-21T07:35:56.540065+0000","last_active":"2024-09-21T07:35:56.544576+0000","last_peered":"2024-09-21T07:35:56.544576+0000","last_clean":"2024-09-21T07:35:56.544576+0000","last_became_active":"2024-09-21T07:35:56.535568+0000","last_became_peered":"2024-09-21T07:35:56.535568+0000","last_unstale":"2024-09-21T07:35:56.544576+0000","last_undegraded":"2024-09-21T07:35:56.544576+0000","last_fullsized":"2024-09-21T07:35:56.544576+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:35.442810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514483+0000","last_change":"2024-09-21T07:35:55.514068+0000","last_active":"2024-09-21T07:35:56.514483+0000","last_peered":"2024-09-21T07:35:56.514483+0000","last_clean":"2024-09-21T07:35:56.514483+0000","last_became_active":"2024-09-21T07:35:55.513611+0000","last_became_peered":"2024-09-21T07:35:55.513611+0000","last_unstale":"2024-09-21T07:35:56.514483+0000","last_undegraded":"2024-09-21T07:35:56.514483+0000","last_fullsized":"2024-09-21T07:35:56.514483+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:50.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.542293+0000","last_change":"2024-09-21T07:35:56.538134+0000","last_active":"2024-09-21T07:35:56.542293+0000","last_peered":"2024-09-21T07:35:56.542293+0000","last_clean":"2024-09-21T07:35:56.542293+0000","last_became_active":"2024-09-21T07:35:56.535487+0000","last_became_peered":"2024-09-21T07:35:56.535487+0000","last_unstale":"2024-09-21T07:35:56.542293+0000","last_undegraded":"2024-09-21T07:35:56.542293+0000","last_fullsized":"2024-09-21T07:35:56.542293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:28.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517774+0000","last_change":"2024-09-21T07:35:55.517204+0000","last_active":"2024-09-21T07:35:57.517774+0000","last_peered":"2024-09-21T07:35:57.517774+0000","last_clean":"2024-09-21T07:35:57.517774+0000","last_became_active":"2024-09-21T07:35:55.516611+0000","last_became_peered":"2024-09-21T07:35:55.516611+0000","last_unstale":"2024-09-21T07:35:57.517774+0000","last_undegraded":"2024-09-21T07:35:57.517774+0000","last_fullsized":"2024-09-21T07:35:57.517774+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.047521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549490+0000","last_change":"2024-09-21T07:35:56.540592+0000","last_active":"2024-09-21T07:35:56.549490+0000","last_peered":"2024-09-21T07:35:56.549490+0000","last_clean":"2024-09-21T07:35:56.549490+0000","last_became_active":"2024-09-21T07:35:56.540269+0000","last_became_peered":"2024-09-21T07:35:56.540269+0000","last_unstale":"2024-09-21T07:35:56.549490+0000","last_undegraded":"2024-09-21T07:35:56.549490+0000","last_fullsized":"2024-09-21T07:35:56.549490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:58.810275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"190'1","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.515349+0000","last_change":"2024-09-21T07:35:55.503498+0000","last_active":"2024-09-21T07:35:57.515349+0000","last_peered":"2024-09-21T07:35:57.515349+0000","last_clean":"2024-09-21T07:35:57.515349+0000","last_became_active":"2024-09-21T07:35:55.503073+0000","last_became_peered":"2024-09-21T07:35:55.503073+0000","last_unstale":"2024-09-21T07:35:57.515349+0000","last_undegraded":"2024-09-21T07:35:57.515349+0000","last_fullsized":"2024-09-21T07:35:57.515349+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.889708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516961+0000","last_change":"2024-09-21T07:35:56.547899+0000","last_active":"2024-09-21T07:35:57.516961+0000","last_peered":"2024-09-21T07:35:57.516961+0000","last_clean":"2024-09-21T07:35:57.516961+0000","last_became_active":"2024-09-21T07:35:56.547572+0000","last_became_peered":"2024-09-21T07:35:56.547572+0000","last_unstale":"2024-09-21T07:35:57.516961+0000","last_undegraded":"2024-09-21T07:35:57.516961+0000","last_fullsized":"2024-09-21T07:35:57.516961+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:18.327833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517486+0000","last_change":"2024-09-21T07:35:55.506133+0000","last_active":"2024-09-21T07:35:57.517486+0000","last_peered":"2024-09-21T07:35:57.517486+0000","last_clean":"2024-09-21T07:35:57.517486+0000","last_became_active":"2024-09-21T07:35:55.505819+0000","last_became_peered":"2024-09-21T07:35:55.505819+0000","last_unstale":"2024-09-21T07:35:57.517486+0000","last_undegraded":"2024-09-21T07:35:57.517486+0000","last_fullsized":"2024-09-21T07:35:57.517486+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:50.225417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.531311+0000","last_change":"2024-09-21T07:35:56.528239+0000","last_active":"2024-09-21T07:35:56.531311+0000","last_peered":"2024-09-21T07:35:56.531311+0000","last_clean":"2024-09-21T07:35:56.531311+0000","last_became_active":"2024-09-21T07:35:56.527890+0000","last_became_peered":"2024-09-21T07:35:56.527890+0000","last_unstale":"2024-09-21T07:35:56.531311+0000","last_undegraded":"2024-09-21T07:35:56.531311+0000","last_fullsized":"2024-09-21T07:35:56.531311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:55.369124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.514253+0000","last_change":"2024-09-21T07:35:55.516129+0000","last_active":"2024-09-21T07:35:56.514253+0000","last_peered":"2024-09-21T07:35:56.514253+0000","last_clean":"2024-09-21T07:35:56.514253+0000","last_became_active":"2024-09-21T07:35:55.515802+0000","last_became_peered":"2024-09-21T07:35:55.515802+0000","last_unstale":"2024-09-21T07:35:56.514253+0000","last_undegraded":"2024-09-21T07:35:56.514253+0000","last_fullsized":"2024-09-21T07:35:56.514253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:42.354336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.540281+0000","last_change":"2024-09-21T07:35:56.530807+0000","last_active":"2024-09-21T07:35:56.540281+0000","last_peered":"2024-09-21T07:35:56.540281+0000","last_clean":"2024-09-21T07:35:56.540281+0000","last_became_active":"2024-09-21T07:35:56.528662+0000","last_became_peered":"2024-09-21T07:35:56.528662+0000","last_unstale":"2024-09-21T07:35:56.540281+0000","last_undegraded":"2024-09-21T07:35:56.540281+0000","last_fullsized":"2024-09-21T07:35:56.540281+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:06.977730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.511669+0000","last_change":"2024-09-21T07:35:55.503586+0000","last_active":"2024-09-21T07:35:56.511669+0000","last_peered":"2024-09-21T07:35:56.511669+0000","last_clean":"2024-09-21T07:35:56.511669+0000","last_became_active":"2024-09-21T07:35:55.503160+0000","last_became_peered":"2024-09-21T07:35:55.503160+0000","last_unstale":"2024-09-21T07:35:56.511669+0000","last_undegraded":"2024-09-21T07:35:56.511669+0000","last_fullsized":"2024-09-21T07:35:56.511669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:20.237989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.536253+0000","last_change":"2024-09-21T07:35:56.532396+0000","last_active":"2024-09-21T07:35:56.536253+0000","last_peered":"2024-09-21T07:35:56.536253+0000","last_clean":"2024-09-21T07:35:56.536253+0000","last_became_active":"2024-09-21T07:35:56.532062+0000","last_became_peered":"2024-09-21T07:35:56.532062+0000","last_unstale":"2024-09-21T07:35:56.536253+0000","last_undegraded":"2024-09-21T07:35:56.536253+0000","last_fullsized":"2024-09-21T07:35:56.536253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.129335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516875+0000","last_change":"2024-09-21T07:35:55.511105+0000","last_active":"2024-09-21T07:35:57.516875+0000","last_peered":"2024-09-21T07:35:57.516875+0000","last_clean":"2024-09-21T07:35:57.516875+0000","last_became_active":"2024-09-21T07:35:55.510724+0000","last_became_peered":"2024-09-21T07:35:55.510724+0000","last_unstale":"2024-09-21T07:35:57.516875+0000","last_undegraded":"2024-09-21T07:35:57.516875+0000","last_fullsized":"2024-09-21T07:35:57.516875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:13.044173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.553026+0000","last_change":"2024-09-21T07:35:56.545891+0000","last_active":"2024-09-21T07:35:56.553026+0000","last_peered":"2024-09-21T07:35:56.553026+0000","last_clean":"2024-09-21T07:35:56.553026+0000","last_became_active":"2024-09-21T07:35:56.545486+0000","last_became_peered":"2024-09-21T07:35:56.545486+0000","last_unstale":"2024-09-21T07:35:56.553026+0000","last_undegraded":"2024-09-21T07:35:56.553026+0000","last_fullsized":"2024-09-21T07:35:56.553026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:28.119364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.516814+0000","last_change":"2024-09-21T07:35:55.506044+0000","last_active":"2024-09-21T07:35:56.516814+0000","last_peered":"2024-09-21T07:35:56.516814+0000","last_clean":"2024-09-21T07:35:56.516814+0000","last_became_active":"2024-09-21T07:35:55.505749+0000","last_became_peered":"2024-09-21T07:35:55.505749+0000","last_unstale":"2024-09-21T07:35:56.516814+0000","last_undegraded":"2024-09-21T07:35:56.516814+0000","last_fullsized":"2024-09-21T07:35:56.516814+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:14.718347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.549536+0000","last_change":"2024-09-21T07:35:56.543636+0000","last_active":"2024-09-21T07:35:56.549536+0000","last_peered":"2024-09-21T07:35:56.549536+0000","last_clean":"2024-09-21T07:35:56.549536+0000","last_became_active":"2024-09-21T07:35:56.543332+0000","last_became_peered":"2024-09-21T07:35:56.543332+0000","last_unstale":"2024-09-21T07:35:56.549536+0000","last_undegraded":"2024-09-21T07:35:56.549536+0000","last_fullsized":"2024-09-21T07:35:56.549536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:30.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519097+0000","last_change":"2024-09-21T07:35:55.504949+0000","last_active":"2024-09-21T07:35:57.519097+0000","last_peered":"2024-09-21T07:35:57.519097+0000","last_clean":"2024-09-21T07:35:57.519097+0000","last_became_active":"2024-09-21T07:35:55.504623+0000","last_became_peered":"2024-09-21T07:35:55.504623+0000","last_unstale":"2024-09-21T07:35:57.519097+0000","last_undegraded":"2024-09-21T07:35:57.519097+0000","last_fullsized":"2024-09-21T07:35:57.519097+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:14.464426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.532329+0000","last_change":"2024-09-21T07:35:56.531233+0000","last_active":"2024-09-21T07:35:56.532329+0000","last_peered":"2024-09-21T07:35:56.532329+0000","last_clean":"2024-09-21T07:35:56.532329+0000","last_became_active":"2024-09-21T07:35:56.529247+0000","last_became_peered":"2024-09-21T07:35:56.529247+0000","last_unstale":"2024-09-21T07:35:56.532329+0000","last_undegraded":"2024-09-21T07:35:56.532329+0000","last_fullsized":"2024-09-21T07:35:56.532329+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:24.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516761+0000","last_change":"2024-09-21T07:35:55.513811+0000","last_active":"2024-09-21T07:35:57.516761+0000","last_peered":"2024-09-21T07:35:57.516761+0000","last_clean":"2024-09-21T07:35:57.516761+0000","last_became_active":"2024-09-21T07:35:55.513193+0000","last_became_peered":"2024-09-21T07:35:55.513193+0000","last_unstale":"2024-09-21T07:35:57.516761+0000","last_undegraded":"2024-09-21T07:35:57.516761+0000","last_fullsized":"2024-09-21T07:35:57.516761+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":419,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-21T07:35:56.522727+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:56.522727+0000","last_peered":"2024-09-21T07:35:56.522727+0000","last_clean":"2024-09-21T07:35:56.522727+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:56.522727+0000","last_undegraded":"2024-09-21T07:35:56.522727+0000","last_fullsized":"2024-09-21T07:35:56.522727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55752,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316088,"statfs":{"total":96636764160,"available":96579674112,"internally_reserved":0,"allocated":2404352,"data_stored":1130910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1128772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64060,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307780,"statfs":{"total":96636764160,"available":96571166720,"internally_reserved":0,"allocated":2392064,"data_stored":1129298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509604,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2392064,"data_stored":1128806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1128716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509604,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56316,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315524,"statfs":{"total":96636764160,"available":96579096576,"internally_reserved":0,"allocated":2985984,"data_stored":1719174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542308,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56328,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315512,"statfs":{"total":96636764160,"available":96579084288,"internally_reserved":0,"allocated":2998272,"data_stored":1720766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87624,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284216,"statfs":{"total":96636764160,"available":96547037184,"internally_reserved":0,"allocated":2412544,"data_stored":1135534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:36:05.411 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- 172.21.15.64:0/1163948256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 msgr2=0x7f7b14005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 --2- 172.21.15.64:0/1163948256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b14005160 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009e90 tx=0x7f7b2801d590 comp rx=0 tx=0).stop 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b2fe00640 1 -- 172.21.15.64:0/1163948256 reap_dead start 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- 172.21.15.64:0/1163948256 shutdown_connections 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- 172.21.15.64:0/1163948256 >> 172.21.15.64:0/1163948256 conn(0x7f7b3006d1c0 msgr2=0x7f7b3006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- 172.21.15.64:0/1163948256 shutdown_connections 2024-09-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- 172.21.15.64:0/1163948256 wait complete. 2024-09-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 Processor -- start 2024-09-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.584+0000 7f7b36400640 1 -- start start 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 0x7f7b30150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 0x7f7b301e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7b300c6860 con 0x7f7b14004d50 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7b300c66e0 con 0x7f7b301e9430 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300c69e0 con 0x7f7b301fa0a0 2024-09-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33056/0 (socket says 172.21.15.64:33056) 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 -- 172.21.15.64:0/3134456584 learned_addr learned my addr 172.21.15.64:0/3134456584 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b27e00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 0x7f7b30150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2fe00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 0x7f7b301e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 -- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 msgr2=0x7f7b30150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 0x7f7b30150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 -- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 msgr2=0x7f7b301e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 0x7f7b301e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 -- 172.21.15.64:0/3134456584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b301e9d80 con 0x7f7b14004d50 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b27e00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 0x7f7b30150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2fe00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 0x7f7b301e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b2f400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f7b20011ae0 tx=0x7f7b20009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000fcd0 con 0x7f7b14004d50 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b2000fe70 con 0x7f7b14004d50 2024-09-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20004260 con 0x7f7b14004d50 2024-09-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3006fc70 con 0x7f7b14004d50 2024-09-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b301f98a0 con 0x7f7b14004d50 2024-09-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.588+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b300c80f0 con 0x7f7b14004d50 2024-09-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.592+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7b20003600 con 0x7f7b14004d50 2024-09-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.592+0000 7f7b27400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 0x7f7b0c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.592+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f7b20094ef0 con 0x7f7b14004d50 2024-09-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.592+0000 7f7b27e00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 0x7f7b0c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.592+0000 7f7b27e00640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 0x7f7b0c075710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7b301ea0e0 tx=0x7f7b180067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.596+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7b301e9d80 con 0x7f7b14004d50 2024-09-21T07:36:05.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.772+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b300cc560 con 0x7f7b0c073200 2024-09-21T07:36:05.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.776+0000 7f7b27400640 1 -- 172.21.15.64:0/3134456584 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252419 (secure 0 0 0) 0x7f7b300cc560 con 0x7f7b0c073200 2024-09-21T07:36:05.783 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:05.784 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:36:05.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 msgr2=0x7f7b0c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:05.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 0x7f7b0c075710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7b301ea0e0 tx=0x7f7b180067b0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 msgr2=0x7f7b300cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f7b20011ae0 tx=0x7f7b20009f20 comp rx=0 tx=0).stop 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 shutdown_connections 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7b0c073200 0x7f7b0c075710 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b301e9430 0x7f7b301e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b301fa0a0 0x7f7b30150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 --2- 172.21.15.64:0/3134456584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b14004d50 0x7f7b300cbb80 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 >> 172.21.15.64:0/3134456584 conn(0x7f7b3006d1c0 msgr2=0x7f7b3015c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 shutdown_connections 2024-09-21T07:36:05.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:05.780+0000 7f7b36400640 1 -- 172.21.15.64:0/3134456584 wait complete. 2024-09-21T07:36:05.805 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":589,"stamp":"2024-09-21T07:36:05.640477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":499840,"kb_used_data":19976,"kb_used_omap":12,"kb_used_meta":479667,"kb_avail":754474880,"statfs":{"total":773094113280,"available":772582277120,"internally_reserved":0,"allocated":20455424,"data_stored":10268820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":491179571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.135356"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927554+0000","last_change":"2024-09-21T07:35:56.532076+0000","last_active":"2024-09-21T07:35:57.927554+0000","last_peered":"2024-09-21T07:35:57.927554+0000","last_clean":"2024-09-21T07:35:57.927554+0000","last_became_active":"2024-09-21T07:35:56.531712+0000","last_became_peered":"2024-09-21T07:35:56.531712+0000","last_unstale":"2024-09-21T07:35:57.927554+0000","last_undegraded":"2024-09-21T07:35:57.927554+0000","last_fullsized":"2024-09-21T07:35:57.927554+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:32.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464535+0000","last_change":"2024-09-21T07:35:56.545492+0000","last_active":"2024-09-21T07:35:58.464535+0000","last_peered":"2024-09-21T07:35:58.464535+0000","last_clean":"2024-09-21T07:35:58.464535+0000","last_became_active":"2024-09-21T07:35:56.545193+0000","last_became_peered":"2024-09-21T07:35:56.545193+0000","last_unstale":"2024-09-21T07:35:58.464535+0000","last_undegraded":"2024-09-21T07:35:58.464535+0000","last_fullsized":"2024-09-21T07:35:58.464535+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.834431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744093+0000","last_change":"2024-09-21T07:35:56.539434+0000","last_active":"2024-09-21T07:35:57.744093+0000","last_peered":"2024-09-21T07:35:57.744093+0000","last_clean":"2024-09-21T07:35:57.744093+0000","last_became_active":"2024-09-21T07:35:56.538261+0000","last_became_peered":"2024-09-21T07:35:56.538261+0000","last_unstale":"2024-09-21T07:35:57.744093+0000","last_undegraded":"2024-09-21T07:35:57.744093+0000","last_fullsized":"2024-09-21T07:35:57.744093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:05.062554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016668+0000","last_change":"2024-09-21T07:35:56.541396+0000","last_active":"2024-09-21T07:35:58.016668+0000","last_peered":"2024-09-21T07:35:58.016668+0000","last_clean":"2024-09-21T07:35:58.016668+0000","last_became_active":"2024-09-21T07:35:56.540086+0000","last_became_peered":"2024-09-21T07:35:56.540086+0000","last_unstale":"2024-09-21T07:35:58.016668+0000","last_undegraded":"2024-09-21T07:35:58.016668+0000","last_fullsized":"2024-09-21T07:35:58.016668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:28.075497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518252+0000","last_change":"2024-09-21T07:35:56.546056+0000","last_active":"2024-09-21T07:35:57.518252+0000","last_peered":"2024-09-21T07:35:57.518252+0000","last_clean":"2024-09-21T07:35:57.518252+0000","last_became_active":"2024-09-21T07:35:56.545732+0000","last_became_peered":"2024-09-21T07:35:56.545732+0000","last_unstale":"2024-09-21T07:35:57.518252+0000","last_undegraded":"2024-09-21T07:35:57.518252+0000","last_fullsized":"2024-09-21T07:35:57.518252+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:21.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016271+0000","last_change":"2024-09-21T07:35:56.537816+0000","last_active":"2024-09-21T07:35:58.016271+0000","last_peered":"2024-09-21T07:35:58.016271+0000","last_clean":"2024-09-21T07:35:58.016271+0000","last_became_active":"2024-09-21T07:35:56.536912+0000","last_became_peered":"2024-09-21T07:35:56.536912+0000","last_unstale":"2024-09-21T07:35:58.016271+0000","last_undegraded":"2024-09-21T07:35:58.016271+0000","last_fullsized":"2024-09-21T07:35:58.016271+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:13.972577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517848+0000","last_change":"2024-09-21T07:35:56.547623+0000","last_active":"2024-09-21T07:35:57.517848+0000","last_peered":"2024-09-21T07:35:57.517848+0000","last_clean":"2024-09-21T07:35:57.517848+0000","last_became_active":"2024-09-21T07:35:56.547341+0000","last_became_peered":"2024-09-21T07:35:56.547341+0000","last_unstale":"2024-09-21T07:35:57.517848+0000","last_undegraded":"2024-09-21T07:35:57.517848+0000","last_fullsized":"2024-09-21T07:35:57.517848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464355+0000","last_change":"2024-09-21T07:35:56.523945+0000","last_active":"2024-09-21T07:35:58.464355+0000","last_peered":"2024-09-21T07:35:58.464355+0000","last_clean":"2024-09-21T07:35:58.464355+0000","last_became_active":"2024-09-21T07:35:56.523614+0000","last_became_peered":"2024-09-21T07:35:56.523614+0000","last_unstale":"2024-09-21T07:35:58.464355+0000","last_undegraded":"2024-09-21T07:35:58.464355+0000","last_fullsized":"2024-09-21T07:35:58.464355+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:04.482033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517191+0000","last_change":"2024-09-21T07:35:56.530699+0000","last_active":"2024-09-21T07:35:57.517191+0000","last_peered":"2024-09-21T07:35:57.517191+0000","last_clean":"2024-09-21T07:35:57.517191+0000","last_became_active":"2024-09-21T07:35:56.530406+0000","last_became_peered":"2024-09-21T07:35:56.530406+0000","last_unstale":"2024-09-21T07:35:57.517191+0000","last_undegraded":"2024-09-21T07:35:57.517191+0000","last_fullsized":"2024-09-21T07:35:57.517191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:30.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463670+0000","last_change":"2024-09-21T07:35:56.534740+0000","last_active":"2024-09-21T07:35:58.463670+0000","last_peered":"2024-09-21T07:35:58.463670+0000","last_clean":"2024-09-21T07:35:58.463670+0000","last_became_active":"2024-09-21T07:35:56.534420+0000","last_became_peered":"2024-09-21T07:35:56.534420+0000","last_unstale":"2024-09-21T07:35:58.463670+0000","last_undegraded":"2024-09-21T07:35:58.463670+0000","last_fullsized":"2024-09-21T07:35:58.463670+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:02.916025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744211+0000","last_change":"2024-09-21T07:35:56.534031+0000","last_active":"2024-09-21T07:35:57.744211+0000","last_peered":"2024-09-21T07:35:57.744211+0000","last_clean":"2024-09-21T07:35:57.744211+0000","last_became_active":"2024-09-21T07:35:56.533080+0000","last_became_peered":"2024-09-21T07:35:56.533080+0000","last_unstale":"2024-09-21T07:35:57.744211+0000","last_undegraded":"2024-09-21T07:35:57.744211+0000","last_fullsized":"2024-09-21T07:35:57.744211+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:15.854476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518497+0000","last_change":"2024-09-21T07:35:56.542875+0000","last_active":"2024-09-21T07:35:57.518497+0000","last_peered":"2024-09-21T07:35:57.518497+0000","last_clean":"2024-09-21T07:35:57.518497+0000","last_became_active":"2024-09-21T07:35:56.541115+0000","last_became_peered":"2024-09-21T07:35:56.541115+0000","last_unstale":"2024-09-21T07:35:57.518497+0000","last_undegraded":"2024-09-21T07:35:57.518497+0000","last_fullsized":"2024-09-21T07:35:57.518497+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:17.995132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016610+0000","last_change":"2024-09-21T07:35:56.546633+0000","last_active":"2024-09-21T07:35:58.016610+0000","last_peered":"2024-09-21T07:35:58.016610+0000","last_clean":"2024-09-21T07:35:58.016610+0000","last_became_active":"2024-09-21T07:35:56.546330+0000","last_became_peered":"2024-09-21T07:35:56.546330+0000","last_unstale":"2024-09-21T07:35:58.016610+0000","last_undegraded":"2024-09-21T07:35:58.016610+0000","last_fullsized":"2024-09-21T07:35:58.016610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:56.201408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463335+0000","last_change":"2024-09-21T07:35:56.522008+0000","last_active":"2024-09-21T07:35:58.463335+0000","last_peered":"2024-09-21T07:35:58.463335+0000","last_clean":"2024-09-21T07:35:58.463335+0000","last_became_active":"2024-09-21T07:35:56.521403+0000","last_became_peered":"2024-09-21T07:35:56.521403+0000","last_unstale":"2024-09-21T07:35:58.463335+0000","last_undegraded":"2024-09-21T07:35:58.463335+0000","last_fullsized":"2024-09-21T07:35:58.463335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:12.429517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517004+0000","last_change":"2024-09-21T07:35:56.515225+0000","last_active":"2024-09-21T07:35:57.517004+0000","last_peered":"2024-09-21T07:35:57.517004+0000","last_clean":"2024-09-21T07:35:57.517004+0000","last_became_active":"2024-09-21T07:35:56.513973+0000","last_became_peered":"2024-09-21T07:35:56.513973+0000","last_unstale":"2024-09-21T07:35:57.517004+0000","last_undegraded":"2024-09-21T07:35:57.517004+0000","last_fullsized":"2024-09-21T07:35:57.517004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:22.147149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744003+0000","last_change":"2024-09-21T07:35:56.530415+0000","last_active":"2024-09-21T07:35:57.744003+0000","last_peered":"2024-09-21T07:35:57.744003+0000","last_clean":"2024-09-21T07:35:57.744003+0000","last_became_active":"2024-09-21T07:35:56.530079+0000","last_became_peered":"2024-09-21T07:35:56.530079+0000","last_unstale":"2024-09-21T07:35:57.744003+0000","last_undegraded":"2024-09-21T07:35:57.744003+0000","last_fullsized":"2024-09-21T07:35:57.744003+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:17.155242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517424+0000","last_change":"2024-09-21T07:35:56.546948+0000","last_active":"2024-09-21T07:35:57.517424+0000","last_peered":"2024-09-21T07:35:57.517424+0000","last_clean":"2024-09-21T07:35:57.517424+0000","last_became_active":"2024-09-21T07:35:56.546426+0000","last_became_peered":"2024-09-21T07:35:56.546426+0000","last_unstale":"2024-09-21T07:35:57.517424+0000","last_undegraded":"2024-09-21T07:35:57.517424+0000","last_fullsized":"2024-09-21T07:35:57.517424+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:00.228007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517159+0000","last_change":"2024-09-21T07:35:56.546840+0000","last_active":"2024-09-21T07:35:57.517159+0000","last_peered":"2024-09-21T07:35:57.517159+0000","last_clean":"2024-09-21T07:35:57.517159+0000","last_became_active":"2024-09-21T07:35:56.546528+0000","last_became_peered":"2024-09-21T07:35:56.546528+0000","last_unstale":"2024-09-21T07:35:57.517159+0000","last_undegraded":"2024-09-21T07:35:57.517159+0000","last_fullsized":"2024-09-21T07:35:57.517159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:42.508204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463838+0000","last_change":"2024-09-21T07:35:56.545732+0000","last_active":"2024-09-21T07:35:58.463838+0000","last_peered":"2024-09-21T07:35:58.463838+0000","last_clean":"2024-09-21T07:35:58.463838+0000","last_became_active":"2024-09-21T07:35:56.545386+0000","last_became_peered":"2024-09-21T07:35:56.545386+0000","last_unstale":"2024-09-21T07:35:58.463838+0000","last_undegraded":"2024-09-21T07:35:58.463838+0000","last_fullsized":"2024-09-21T07:35:58.463838+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:13.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464142+0000","last_change":"2024-09-21T07:35:56.516896+0000","last_active":"2024-09-21T07:35:58.464142+0000","last_peered":"2024-09-21T07:35:58.464142+0000","last_clean":"2024-09-21T07:35:58.464142+0000","last_became_active":"2024-09-21T07:35:56.516577+0000","last_became_peered":"2024-09-21T07:35:56.516577+0000","last_unstale":"2024-09-21T07:35:58.464142+0000","last_undegraded":"2024-09-21T07:35:58.464142+0000","last_fullsized":"2024-09-21T07:35:58.464142+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:59.881567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463353+0000","last_change":"2024-09-21T07:35:56.538492+0000","last_active":"2024-09-21T07:35:58.463353+0000","last_peered":"2024-09-21T07:35:58.463353+0000","last_clean":"2024-09-21T07:35:58.463353+0000","last_became_active":"2024-09-21T07:35:56.537941+0000","last_became_peered":"2024-09-21T07:35:56.537941+0000","last_unstale":"2024-09-21T07:35:58.463353+0000","last_undegraded":"2024-09-21T07:35:58.463353+0000","last_fullsized":"2024-09-21T07:35:58.463353+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:30.222708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463867+0000","last_change":"2024-09-21T07:35:56.521689+0000","last_active":"2024-09-21T07:35:58.463867+0000","last_peered":"2024-09-21T07:35:58.463867+0000","last_clean":"2024-09-21T07:35:58.463867+0000","last_became_active":"2024-09-21T07:35:56.521019+0000","last_became_peered":"2024-09-21T07:35:56.521019+0000","last_unstale":"2024-09-21T07:35:58.463867+0000","last_undegraded":"2024-09-21T07:35:58.463867+0000","last_fullsized":"2024-09-21T07:35:58.463867+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:45.552777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463927+0000","last_change":"2024-09-21T07:35:56.528185+0000","last_active":"2024-09-21T07:35:58.463927+0000","last_peered":"2024-09-21T07:35:58.463927+0000","last_clean":"2024-09-21T07:35:58.463927+0000","last_became_active":"2024-09-21T07:35:56.524714+0000","last_became_peered":"2024-09-21T07:35:56.524714+0000","last_unstale":"2024-09-21T07:35:58.463927+0000","last_undegraded":"2024-09-21T07:35:58.463927+0000","last_fullsized":"2024-09-21T07:35:58.463927+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:43.346270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517795+0000","last_change":"2024-09-21T07:35:56.537610+0000","last_active":"2024-09-21T07:35:57.517795+0000","last_peered":"2024-09-21T07:35:57.517795+0000","last_clean":"2024-09-21T07:35:57.517795+0000","last_became_active":"2024-09-21T07:35:56.537302+0000","last_became_peered":"2024-09-21T07:35:56.537302+0000","last_unstale":"2024-09-21T07:35:57.517795+0000","last_undegraded":"2024-09-21T07:35:57.517795+0000","last_fullsized":"2024-09-21T07:35:57.517795+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:23.891119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517828+0000","last_change":"2024-09-21T07:35:56.530013+0000","last_active":"2024-09-21T07:35:57.517828+0000","last_peered":"2024-09-21T07:35:57.517828+0000","last_clean":"2024-09-21T07:35:57.517828+0000","last_became_active":"2024-09-21T07:35:56.529553+0000","last_became_peered":"2024-09-21T07:35:56.529553+0000","last_unstale":"2024-09-21T07:35:57.517828+0000","last_undegraded":"2024-09-21T07:35:57.517828+0000","last_fullsized":"2024-09-21T07:35:57.517828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:36.273322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927414+0000","last_change":"2024-09-21T07:35:56.535980+0000","last_active":"2024-09-21T07:35:57.927414+0000","last_peered":"2024-09-21T07:35:57.927414+0000","last_clean":"2024-09-21T07:35:57.927414+0000","last_became_active":"2024-09-21T07:35:56.532666+0000","last_became_peered":"2024-09-21T07:35:56.532666+0000","last_unstale":"2024-09-21T07:35:57.927414+0000","last_undegraded":"2024-09-21T07:35:57.927414+0000","last_fullsized":"2024-09-21T07:35:57.927414+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:49.284091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744377+0000","last_change":"2024-09-21T07:35:56.535093+0000","last_active":"2024-09-21T07:35:57.744377+0000","last_peered":"2024-09-21T07:35:57.744377+0000","last_clean":"2024-09-21T07:35:57.744377+0000","last_became_active":"2024-09-21T07:35:56.532682+0000","last_became_peered":"2024-09-21T07:35:56.532682+0000","last_unstale":"2024-09-21T07:35:57.744377+0000","last_undegraded":"2024-09-21T07:35:57.744377+0000","last_fullsized":"2024-09-21T07:35:57.744377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:58.347975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519035+0000","last_change":"2024-09-21T07:35:56.541017+0000","last_active":"2024-09-21T07:35:57.519035+0000","last_peered":"2024-09-21T07:35:57.519035+0000","last_clean":"2024-09-21T07:35:57.519035+0000","last_became_active":"2024-09-21T07:35:56.540691+0000","last_became_peered":"2024-09-21T07:35:56.540691+0000","last_unstale":"2024-09-21T07:35:57.519035+0000","last_undegraded":"2024-09-21T07:35:57.519035+0000","last_fullsized":"2024-09-21T07:35:57.519035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:40.675743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516622+0000","last_change":"2024-09-21T07:35:56.543465+0000","last_active":"2024-09-21T07:35:57.516622+0000","last_peered":"2024-09-21T07:35:57.516622+0000","last_clean":"2024-09-21T07:35:57.516622+0000","last_became_active":"2024-09-21T07:35:56.543121+0000","last_became_peered":"2024-09-21T07:35:56.543121+0000","last_unstale":"2024-09-21T07:35:57.516622+0000","last_undegraded":"2024-09-21T07:35:57.516622+0000","last_fullsized":"2024-09-21T07:35:57.516622+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:35.776811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517089+0000","last_change":"2024-09-21T07:35:56.521670+0000","last_active":"2024-09-21T07:35:57.517089+0000","last_peered":"2024-09-21T07:35:57.517089+0000","last_clean":"2024-09-21T07:35:57.517089+0000","last_became_active":"2024-09-21T07:35:56.521335+0000","last_became_peered":"2024-09-21T07:35:56.521335+0000","last_unstale":"2024-09-21T07:35:57.517089+0000","last_undegraded":"2024-09-21T07:35:57.517089+0000","last_fullsized":"2024-09-21T07:35:57.517089+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:44.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016618+0000","last_change":"2024-09-21T07:35:56.549097+0000","last_active":"2024-09-21T07:35:58.016618+0000","last_peered":"2024-09-21T07:35:58.016618+0000","last_clean":"2024-09-21T07:35:58.016618+0000","last_became_active":"2024-09-21T07:35:56.548774+0000","last_became_peered":"2024-09-21T07:35:56.548774+0000","last_unstale":"2024-09-21T07:35:58.016618+0000","last_undegraded":"2024-09-21T07:35:58.016618+0000","last_fullsized":"2024-09-21T07:35:58.016618+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:31.142364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016230+0000","last_change":"2024-09-21T07:35:56.537307+0000","last_active":"2024-09-21T07:35:58.016230+0000","last_peered":"2024-09-21T07:35:58.016230+0000","last_clean":"2024-09-21T07:35:58.016230+0000","last_became_active":"2024-09-21T07:35:56.536464+0000","last_became_peered":"2024-09-21T07:35:56.536464+0000","last_unstale":"2024-09-21T07:35:58.016230+0000","last_undegraded":"2024-09-21T07:35:58.016230+0000","last_fullsized":"2024-09-21T07:35:58.016230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:09.212535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464085+0000","last_change":"2024-09-21T07:35:56.518864+0000","last_active":"2024-09-21T07:35:58.464085+0000","last_peered":"2024-09-21T07:35:58.464085+0000","last_clean":"2024-09-21T07:35:58.464085+0000","last_became_active":"2024-09-21T07:35:56.518111+0000","last_became_peered":"2024-09-21T07:35:56.518111+0000","last_unstale":"2024-09-21T07:35:58.464085+0000","last_undegraded":"2024-09-21T07:35:58.464085+0000","last_fullsized":"2024-09-21T07:35:58.464085+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:04.342184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517754+0000","last_change":"2024-09-21T07:35:55.507617+0000","last_active":"2024-09-21T07:35:57.517754+0000","last_peered":"2024-09-21T07:35:57.517754+0000","last_clean":"2024-09-21T07:35:57.517754+0000","last_became_active":"2024-09-21T07:35:55.507237+0000","last_became_peered":"2024-09-21T07:35:55.507237+0000","last_unstale":"2024-09-21T07:35:57.517754+0000","last_undegraded":"2024-09-21T07:35:57.517754+0000","last_fullsized":"2024-09-21T07:35:57.517754+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:33.418156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.926992+0000","last_change":"2024-09-21T07:35:56.525646+0000","last_active":"2024-09-21T07:35:57.926992+0000","last_peered":"2024-09-21T07:35:57.926992+0000","last_clean":"2024-09-21T07:35:57.926992+0000","last_became_active":"2024-09-21T07:35:56.525314+0000","last_became_peered":"2024-09-21T07:35:56.525314+0000","last_unstale":"2024-09-21T07:35:57.926992+0000","last_undegraded":"2024-09-21T07:35:57.926992+0000","last_fullsized":"2024-09-21T07:35:57.926992+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.914379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927355+0000","last_change":"2024-09-21T07:35:55.512414+0000","last_active":"2024-09-21T07:35:57.927355+0000","last_peered":"2024-09-21T07:35:57.927355+0000","last_clean":"2024-09-21T07:35:57.927355+0000","last_became_active":"2024-09-21T07:35:55.511521+0000","last_became_peered":"2024-09-21T07:35:55.511521+0000","last_unstale":"2024-09-21T07:35:57.927355+0000","last_undegraded":"2024-09-21T07:35:57.927355+0000","last_fullsized":"2024-09-21T07:35:57.927355+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:32.733910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464157+0000","last_change":"2024-09-21T07:35:56.535286+0000","last_active":"2024-09-21T07:35:58.464157+0000","last_peered":"2024-09-21T07:35:58.464157+0000","last_clean":"2024-09-21T07:35:58.464157+0000","last_became_active":"2024-09-21T07:35:56.531371+0000","last_became_peered":"2024-09-21T07:35:56.531371+0000","last_unstale":"2024-09-21T07:35:58.464157+0000","last_undegraded":"2024-09-21T07:35:58.464157+0000","last_fullsized":"2024-09-21T07:35:58.464157+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:24.485452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464318+0000","last_change":"2024-09-21T07:35:55.513756+0000","last_active":"2024-09-21T07:35:58.464318+0000","last_peered":"2024-09-21T07:35:58.464318+0000","last_clean":"2024-09-21T07:35:58.464318+0000","last_became_active":"2024-09-21T07:35:55.513321+0000","last_became_peered":"2024-09-21T07:35:55.513321+0000","last_unstale":"2024-09-21T07:35:58.464318+0000","last_undegraded":"2024-09-21T07:35:58.464318+0000","last_fullsized":"2024-09-21T07:35:58.464318+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:07.401606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518481+0000","last_change":"2024-09-21T07:35:56.539610+0000","last_active":"2024-09-21T07:35:57.518481+0000","last_peered":"2024-09-21T07:35:57.518481+0000","last_clean":"2024-09-21T07:35:57.518481+0000","last_became_active":"2024-09-21T07:35:56.539303+0000","last_became_peered":"2024-09-21T07:35:56.539303+0000","last_unstale":"2024-09-21T07:35:57.518481+0000","last_undegraded":"2024-09-21T07:35:57.518481+0000","last_fullsized":"2024-09-21T07:35:57.518481+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:44.962547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516758+0000","last_change":"2024-09-21T07:35:55.510443+0000","last_active":"2024-09-21T07:35:57.516758+0000","last_peered":"2024-09-21T07:35:57.516758+0000","last_clean":"2024-09-21T07:35:57.516758+0000","last_became_active":"2024-09-21T07:35:55.510085+0000","last_became_peered":"2024-09-21T07:35:55.510085+0000","last_unstale":"2024-09-21T07:35:57.516758+0000","last_undegraded":"2024-09-21T07:35:57.516758+0000","last_fullsized":"2024-09-21T07:35:57.516758+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:04.391176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517372+0000","last_change":"2024-09-21T07:35:56.522754+0000","last_active":"2024-09-21T07:35:57.517372+0000","last_peered":"2024-09-21T07:35:57.517372+0000","last_clean":"2024-09-21T07:35:57.517372+0000","last_became_active":"2024-09-21T07:35:56.522452+0000","last_became_peered":"2024-09-21T07:35:56.522452+0000","last_unstale":"2024-09-21T07:35:57.517372+0000","last_undegraded":"2024-09-21T07:35:57.517372+0000","last_fullsized":"2024-09-21T07:35:57.517372+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:43.361943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016416+0000","last_change":"2024-09-21T07:35:55.517500+0000","last_active":"2024-09-21T07:35:58.016416+0000","last_peered":"2024-09-21T07:35:58.016416+0000","last_clean":"2024-09-21T07:35:58.016416+0000","last_became_active":"2024-09-21T07:35:55.517201+0000","last_became_peered":"2024-09-21T07:35:55.517201+0000","last_unstale":"2024-09-21T07:35:58.016416+0000","last_undegraded":"2024-09-21T07:35:58.016416+0000","last_fullsized":"2024-09-21T07:35:58.016416+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:35.619469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517331+0000","last_change":"2024-09-21T07:35:56.531499+0000","last_active":"2024-09-21T07:35:57.517331+0000","last_peered":"2024-09-21T07:35:57.517331+0000","last_clean":"2024-09-21T07:35:57.517331+0000","last_became_active":"2024-09-21T07:35:56.531146+0000","last_became_peered":"2024-09-21T07:35:56.531146+0000","last_unstale":"2024-09-21T07:35:57.517331+0000","last_undegraded":"2024-09-21T07:35:57.517331+0000","last_fullsized":"2024-09-21T07:35:57.517331+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016164+0000","last_change":"2024-09-21T07:35:55.517407+0000","last_active":"2024-09-21T07:35:58.016164+0000","last_peered":"2024-09-21T07:35:58.016164+0000","last_clean":"2024-09-21T07:35:58.016164+0000","last_became_active":"2024-09-21T07:35:55.517062+0000","last_became_peered":"2024-09-21T07:35:55.517062+0000","last_unstale":"2024-09-21T07:35:58.016164+0000","last_undegraded":"2024-09-21T07:35:58.016164+0000","last_fullsized":"2024-09-21T07:35:58.016164+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:32.359923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517647+0000","last_change":"2024-09-21T07:35:56.536125+0000","last_active":"2024-09-21T07:35:57.517647+0000","last_peered":"2024-09-21T07:35:57.517647+0000","last_clean":"2024-09-21T07:35:57.517647+0000","last_became_active":"2024-09-21T07:35:56.535400+0000","last_became_peered":"2024-09-21T07:35:56.535400+0000","last_unstale":"2024-09-21T07:35:57.517647+0000","last_undegraded":"2024-09-21T07:35:57.517647+0000","last_fullsized":"2024-09-21T07:35:57.517647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:59.834847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744232+0000","last_change":"2024-09-21T07:35:55.514583+0000","last_active":"2024-09-21T07:35:57.744232+0000","last_peered":"2024-09-21T07:35:57.744232+0000","last_clean":"2024-09-21T07:35:57.744232+0000","last_became_active":"2024-09-21T07:35:55.514197+0000","last_became_peered":"2024-09-21T07:35:55.514197+0000","last_unstale":"2024-09-21T07:35:57.744232+0000","last_undegraded":"2024-09-21T07:35:57.744232+0000","last_fullsized":"2024-09-21T07:35:57.744232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:46.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516910+0000","last_change":"2024-09-21T07:35:56.515734+0000","last_active":"2024-09-21T07:35:57.516910+0000","last_peered":"2024-09-21T07:35:57.516910+0000","last_clean":"2024-09-21T07:35:57.516910+0000","last_became_active":"2024-09-21T07:35:56.515411+0000","last_became_peered":"2024-09-21T07:35:56.515411+0000","last_unstale":"2024-09-21T07:35:57.516910+0000","last_undegraded":"2024-09-21T07:35:57.516910+0000","last_fullsized":"2024-09-21T07:35:57.516910+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:26.754127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518959+0000","last_change":"2024-09-21T07:35:55.509338+0000","last_active":"2024-09-21T07:35:57.518959+0000","last_peered":"2024-09-21T07:35:57.518959+0000","last_clean":"2024-09-21T07:35:57.518959+0000","last_became_active":"2024-09-21T07:35:55.508913+0000","last_became_peered":"2024-09-21T07:35:55.508913+0000","last_unstale":"2024-09-21T07:35:57.518959+0000","last_undegraded":"2024-09-21T07:35:57.518959+0000","last_fullsized":"2024-09-21T07:35:57.518959+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:25.868297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744046+0000","last_change":"2024-09-21T07:35:56.534293+0000","last_active":"2024-09-21T07:35:57.744046+0000","last_peered":"2024-09-21T07:35:57.744046+0000","last_clean":"2024-09-21T07:35:57.744046+0000","last_became_active":"2024-09-21T07:35:56.533756+0000","last_became_peered":"2024-09-21T07:35:56.533756+0000","last_unstale":"2024-09-21T07:35:57.744046+0000","last_undegraded":"2024-09-21T07:35:57.744046+0000","last_fullsized":"2024-09-21T07:35:57.744046+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:20.165954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016904+0000","last_change":"2024-09-21T07:35:55.520395+0000","last_active":"2024-09-21T07:35:58.016904+0000","last_peered":"2024-09-21T07:35:58.016904+0000","last_clean":"2024-09-21T07:35:58.016904+0000","last_became_active":"2024-09-21T07:35:55.520048+0000","last_became_peered":"2024-09-21T07:35:55.520048+0000","last_unstale":"2024-09-21T07:35:58.016904+0000","last_undegraded":"2024-09-21T07:35:58.016904+0000","last_fullsized":"2024-09-21T07:35:58.016904+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:38.598370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516626+0000","last_change":"2024-09-21T07:35:56.535112+0000","last_active":"2024-09-21T07:35:57.516626+0000","last_peered":"2024-09-21T07:35:57.516626+0000","last_clean":"2024-09-21T07:35:57.516626+0000","last_became_active":"2024-09-21T07:35:56.534778+0000","last_became_peered":"2024-09-21T07:35:56.534778+0000","last_unstale":"2024-09-21T07:35:57.516626+0000","last_undegraded":"2024-09-21T07:35:57.516626+0000","last_fullsized":"2024-09-21T07:35:57.516626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:08.412784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517130+0000","last_change":"2024-09-21T07:35:55.516818+0000","last_active":"2024-09-21T07:35:57.517130+0000","last_peered":"2024-09-21T07:35:57.517130+0000","last_clean":"2024-09-21T07:35:57.517130+0000","last_became_active":"2024-09-21T07:35:55.516404+0000","last_became_peered":"2024-09-21T07:35:55.516404+0000","last_unstale":"2024-09-21T07:35:57.517130+0000","last_undegraded":"2024-09-21T07:35:57.517130+0000","last_fullsized":"2024-09-21T07:35:57.517130+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:28.596997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518816+0000","last_change":"2024-09-21T07:35:56.534487+0000","last_active":"2024-09-21T07:35:57.518816+0000","last_peered":"2024-09-21T07:35:57.518816+0000","last_clean":"2024-09-21T07:35:57.518816+0000","last_became_active":"2024-09-21T07:35:56.533641+0000","last_became_peered":"2024-09-21T07:35:56.533641+0000","last_unstale":"2024-09-21T07:35:57.518816+0000","last_undegraded":"2024-09-21T07:35:57.518816+0000","last_fullsized":"2024-09-21T07:35:57.518816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:06.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":21,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016587+0000","last_change":"2024-09-21T07:35:55.518211+0000","last_active":"2024-09-21T07:35:58.016587+0000","last_peered":"2024-09-21T07:35:58.016587+0000","last_clean":"2024-09-21T07:35:58.016587+0000","last_became_active":"2024-09-21T07:35:55.517091+0000","last_became_peered":"2024-09-21T07:35:55.517091+0000","last_unstale":"2024-09-21T07:35:58.016587+0000","last_undegraded":"2024-09-21T07:35:58.016587+0000","last_fullsized":"2024-09-21T07:35:58.016587+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464297+0000","last_change":"2024-09-21T07:35:56.532444+0000","last_active":"2024-09-21T07:35:58.464297+0000","last_peered":"2024-09-21T07:35:58.464297+0000","last_clean":"2024-09-21T07:35:58.464297+0000","last_became_active":"2024-09-21T07:35:56.532083+0000","last_became_peered":"2024-09-21T07:35:56.532083+0000","last_unstale":"2024-09-21T07:35:58.464297+0000","last_undegraded":"2024-09-21T07:35:58.464297+0000","last_fullsized":"2024-09-21T07:35:58.464297+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:13.337108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464254+0000","last_change":"2024-09-21T07:35:55.506824+0000","last_active":"2024-09-21T07:35:58.464254+0000","last_peered":"2024-09-21T07:35:58.464254+0000","last_clean":"2024-09-21T07:35:58.464254+0000","last_became_active":"2024-09-21T07:35:55.506484+0000","last_became_peered":"2024-09-21T07:35:55.506484+0000","last_unstale":"2024-09-21T07:35:58.464254+0000","last_undegraded":"2024-09-21T07:35:58.464254+0000","last_fullsized":"2024-09-21T07:35:58.464254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:43.784411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744429+0000","last_change":"2024-09-21T07:35:56.550098+0000","last_active":"2024-09-21T07:35:57.744429+0000","last_peered":"2024-09-21T07:35:57.744429+0000","last_clean":"2024-09-21T07:35:57.744429+0000","last_became_active":"2024-09-21T07:35:56.549567+0000","last_became_peered":"2024-09-21T07:35:56.549567+0000","last_unstale":"2024-09-21T07:35:57.744429+0000","last_undegraded":"2024-09-21T07:35:57.744429+0000","last_fullsized":"2024-09-21T07:35:57.744429+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:40.343798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744062+0000","last_change":"2024-09-21T07:35:55.500793+0000","last_active":"2024-09-21T07:35:57.744062+0000","last_peered":"2024-09-21T07:35:57.744062+0000","last_clean":"2024-09-21T07:35:57.744062+0000","last_became_active":"2024-09-21T07:35:55.500461+0000","last_became_peered":"2024-09-21T07:35:55.500461+0000","last_unstale":"2024-09-21T07:35:57.744062+0000","last_undegraded":"2024-09-21T07:35:57.744062+0000","last_fullsized":"2024-09-21T07:35:57.744062+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:55.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517253+0000","last_change":"2024-09-21T07:35:56.548523+0000","last_active":"2024-09-21T07:35:57.517253+0000","last_peered":"2024-09-21T07:35:57.517253+0000","last_clean":"2024-09-21T07:35:57.517253+0000","last_became_active":"2024-09-21T07:35:56.548223+0000","last_became_peered":"2024-09-21T07:35:56.548223+0000","last_unstale":"2024-09-21T07:35:57.517253+0000","last_undegraded":"2024-09-21T07:35:57.517253+0000","last_fullsized":"2024-09-21T07:35:57.517253+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:55.796410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516547+0000","last_change":"2024-09-21T07:35:55.518059+0000","last_active":"2024-09-21T07:35:57.516547+0000","last_peered":"2024-09-21T07:35:57.516547+0000","last_clean":"2024-09-21T07:35:57.516547+0000","last_became_active":"2024-09-21T07:35:55.517406+0000","last_became_peered":"2024-09-21T07:35:55.517406+0000","last_unstale":"2024-09-21T07:35:57.516547+0000","last_undegraded":"2024-09-21T07:35:57.516547+0000","last_fullsized":"2024-09-21T07:35:57.516547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:19.228872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016859+0000","last_change":"2024-09-21T07:35:56.533846+0000","last_active":"2024-09-21T07:35:58.016859+0000","last_peered":"2024-09-21T07:35:58.016859+0000","last_clean":"2024-09-21T07:35:58.016859+0000","last_became_active":"2024-09-21T07:35:56.533430+0000","last_became_peered":"2024-09-21T07:35:56.533430+0000","last_unstale":"2024-09-21T07:35:58.016859+0000","last_undegraded":"2024-09-21T07:35:58.016859+0000","last_fullsized":"2024-09-21T07:35:58.016859+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:52.619384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":23,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517932+0000","last_change":"2024-09-21T07:35:55.514195+0000","last_active":"2024-09-21T07:35:57.517932+0000","last_peered":"2024-09-21T07:35:57.517932+0000","last_clean":"2024-09-21T07:35:57.517932+0000","last_became_active":"2024-09-21T07:35:55.513310+0000","last_became_peered":"2024-09-21T07:35:55.513310+0000","last_unstale":"2024-09-21T07:35:57.517932+0000","last_undegraded":"2024-09-21T07:35:57.517932+0000","last_fullsized":"2024-09-21T07:35:57.517932+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463360+0000","last_change":"2024-09-21T07:35:56.537670+0000","last_active":"2024-09-21T07:35:58.463360+0000","last_peered":"2024-09-21T07:35:58.463360+0000","last_clean":"2024-09-21T07:35:58.463360+0000","last_became_active":"2024-09-21T07:35:56.535095+0000","last_became_peered":"2024-09-21T07:35:56.535095+0000","last_unstale":"2024-09-21T07:35:58.463360+0000","last_undegraded":"2024-09-21T07:35:58.463360+0000","last_fullsized":"2024-09-21T07:35:58.463360+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927529+0000","last_change":"2024-09-21T07:35:55.508297+0000","last_active":"2024-09-21T07:35:57.927529+0000","last_peered":"2024-09-21T07:35:57.927529+0000","last_clean":"2024-09-21T07:35:57.927529+0000","last_became_active":"2024-09-21T07:35:55.507986+0000","last_became_peered":"2024-09-21T07:35:55.507986+0000","last_unstale":"2024-09-21T07:35:57.927529+0000","last_undegraded":"2024-09-21T07:35:57.927529+0000","last_fullsized":"2024-09-21T07:35:57.927529+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:00.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927056+0000","last_change":"2024-09-21T07:35:56.523458+0000","last_active":"2024-09-21T07:35:57.927056+0000","last_peered":"2024-09-21T07:35:57.927056+0000","last_clean":"2024-09-21T07:35:57.927056+0000","last_became_active":"2024-09-21T07:35:56.522634+0000","last_became_peered":"2024-09-21T07:35:56.522634+0000","last_unstale":"2024-09-21T07:35:57.927056+0000","last_undegraded":"2024-09-21T07:35:57.927056+0000","last_fullsized":"2024-09-21T07:35:57.927056+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:06.515743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927497+0000","last_change":"2024-09-21T07:35:55.511813+0000","last_active":"2024-09-21T07:35:57.927497+0000","last_peered":"2024-09-21T07:35:57.927497+0000","last_clean":"2024-09-21T07:35:57.927497+0000","last_became_active":"2024-09-21T07:35:55.511137+0000","last_became_peered":"2024-09-21T07:35:55.511137+0000","last_unstale":"2024-09-21T07:35:57.927497+0000","last_undegraded":"2024-09-21T07:35:57.927497+0000","last_fullsized":"2024-09-21T07:35:57.927497+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:20.145930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927322+0000","last_change":"2024-09-21T07:35:56.533636+0000","last_active":"2024-09-21T07:35:57.927322+0000","last_peered":"2024-09-21T07:35:57.927322+0000","last_clean":"2024-09-21T07:35:57.927322+0000","last_became_active":"2024-09-21T07:35:56.533340+0000","last_became_peered":"2024-09-21T07:35:56.533340+0000","last_unstale":"2024-09-21T07:35:57.927322+0000","last_undegraded":"2024-09-21T07:35:57.927322+0000","last_fullsized":"2024-09-21T07:35:57.927322+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:45.030080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464422+0000","last_change":"2024-09-21T07:35:55.512632+0000","last_active":"2024-09-21T07:35:58.464422+0000","last_peered":"2024-09-21T07:35:58.464422+0000","last_clean":"2024-09-21T07:35:58.464422+0000","last_became_active":"2024-09-21T07:35:55.511701+0000","last_became_peered":"2024-09-21T07:35:55.511701+0000","last_unstale":"2024-09-21T07:35:58.464422+0000","last_undegraded":"2024-09-21T07:35:58.464422+0000","last_fullsized":"2024-09-21T07:35:58.464422+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:49.093391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463685+0000","last_change":"2024-09-21T07:35:56.535182+0000","last_active":"2024-09-21T07:35:58.463685+0000","last_peered":"2024-09-21T07:35:58.463685+0000","last_clean":"2024-09-21T07:35:58.463685+0000","last_became_active":"2024-09-21T07:35:56.530549+0000","last_became_peered":"2024-09-21T07:35:56.530549+0000","last_unstale":"2024-09-21T07:35:58.463685+0000","last_undegraded":"2024-09-21T07:35:58.463685+0000","last_fullsized":"2024-09-21T07:35:58.463685+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:21.736576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518975+0000","last_change":"2024-09-21T07:35:55.511997+0000","last_active":"2024-09-21T07:35:57.518975+0000","last_peered":"2024-09-21T07:35:57.518975+0000","last_clean":"2024-09-21T07:35:57.518975+0000","last_became_active":"2024-09-21T07:35:55.511282+0000","last_became_peered":"2024-09-21T07:35:55.511282+0000","last_unstale":"2024-09-21T07:35:57.518975+0000","last_undegraded":"2024-09-21T07:35:57.518975+0000","last_fullsized":"2024-09-21T07:35:57.518975+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:59.004838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464585+0000","last_change":"2024-09-21T07:35:56.545326+0000","last_active":"2024-09-21T07:35:58.464585+0000","last_peered":"2024-09-21T07:35:58.464585+0000","last_clean":"2024-09-21T07:35:58.464585+0000","last_became_active":"2024-09-21T07:35:56.544025+0000","last_became_peered":"2024-09-21T07:35:56.544025+0000","last_unstale":"2024-09-21T07:35:58.464585+0000","last_undegraded":"2024-09-21T07:35:58.464585+0000","last_fullsized":"2024-09-21T07:35:58.464585+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:20.664111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.518648+0000","last_change":"2024-09-21T07:35:55.507126+0000","last_active":"2024-09-21T07:35:57.518648+0000","last_peered":"2024-09-21T07:35:57.518648+0000","last_clean":"2024-09-21T07:35:57.518648+0000","last_became_active":"2024-09-21T07:35:55.506666+0000","last_became_peered":"2024-09-21T07:35:55.506666+0000","last_unstale":"2024-09-21T07:35:57.518648+0000","last_undegraded":"2024-09-21T07:35:57.518648+0000","last_fullsized":"2024-09-21T07:35:57.518648+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016544+0000","last_change":"2024-09-21T07:35:56.548916+0000","last_active":"2024-09-21T07:35:58.016544+0000","last_peered":"2024-09-21T07:35:58.016544+0000","last_clean":"2024-09-21T07:35:58.016544+0000","last_became_active":"2024-09-21T07:35:56.548631+0000","last_became_peered":"2024-09-21T07:35:56.548631+0000","last_unstale":"2024-09-21T07:35:58.016544+0000","last_undegraded":"2024-09-21T07:35:58.016544+0000","last_fullsized":"2024-09-21T07:35:58.016544+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:47.990544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464031+0000","last_change":"2024-09-21T07:35:55.504973+0000","last_active":"2024-09-21T07:35:58.464031+0000","last_peered":"2024-09-21T07:35:58.464031+0000","last_clean":"2024-09-21T07:35:58.464031+0000","last_became_active":"2024-09-21T07:35:55.504600+0000","last_became_peered":"2024-09-21T07:35:55.504600+0000","last_unstale":"2024-09-21T07:35:58.464031+0000","last_undegraded":"2024-09-21T07:35:58.464031+0000","last_fullsized":"2024-09-21T07:35:58.464031+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:14.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517377+0000","last_change":"2024-09-21T07:35:56.538836+0000","last_active":"2024-09-21T07:35:57.517377+0000","last_peered":"2024-09-21T07:35:57.517377+0000","last_clean":"2024-09-21T07:35:57.517377+0000","last_became_active":"2024-09-21T07:35:56.538514+0000","last_became_peered":"2024-09-21T07:35:56.538514+0000","last_unstale":"2024-09-21T07:35:57.517377+0000","last_undegraded":"2024-09-21T07:35:57.517377+0000","last_fullsized":"2024-09-21T07:35:57.517377+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:23.823985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516955+0000","last_change":"2024-09-21T07:35:55.504947+0000","last_active":"2024-09-21T07:35:57.516955+0000","last_peered":"2024-09-21T07:35:57.516955+0000","last_clean":"2024-09-21T07:35:57.516955+0000","last_became_active":"2024-09-21T07:35:55.504601+0000","last_became_peered":"2024-09-21T07:35:55.504601+0000","last_unstale":"2024-09-21T07:35:57.516955+0000","last_undegraded":"2024-09-21T07:35:57.516955+0000","last_fullsized":"2024-09-21T07:35:57.516955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.728969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464055+0000","last_change":"2024-09-21T07:35:56.540065+0000","last_active":"2024-09-21T07:35:58.464055+0000","last_peered":"2024-09-21T07:35:58.464055+0000","last_clean":"2024-09-21T07:35:58.464055+0000","last_became_active":"2024-09-21T07:35:56.535568+0000","last_became_peered":"2024-09-21T07:35:56.535568+0000","last_unstale":"2024-09-21T07:35:58.464055+0000","last_undegraded":"2024-09-21T07:35:58.464055+0000","last_fullsized":"2024-09-21T07:35:58.464055+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:07.901334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.926877+0000","last_change":"2024-09-21T07:35:55.514068+0000","last_active":"2024-09-21T07:35:57.926877+0000","last_peered":"2024-09-21T07:35:57.926877+0000","last_clean":"2024-09-21T07:35:57.926877+0000","last_became_active":"2024-09-21T07:35:55.513611+0000","last_became_peered":"2024-09-21T07:35:55.513611+0000","last_unstale":"2024-09-21T07:35:57.926877+0000","last_undegraded":"2024-09-21T07:35:57.926877+0000","last_fullsized":"2024-09-21T07:35:57.926877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:50.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463783+0000","last_change":"2024-09-21T07:35:56.538134+0000","last_active":"2024-09-21T07:35:58.463783+0000","last_peered":"2024-09-21T07:35:58.463783+0000","last_clean":"2024-09-21T07:35:58.463783+0000","last_became_active":"2024-09-21T07:35:56.535487+0000","last_became_peered":"2024-09-21T07:35:56.535487+0000","last_unstale":"2024-09-21T07:35:58.463783+0000","last_undegraded":"2024-09-21T07:35:58.463783+0000","last_fullsized":"2024-09-21T07:35:58.463783+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:11.215368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517774+0000","last_change":"2024-09-21T07:35:55.517204+0000","last_active":"2024-09-21T07:35:57.517774+0000","last_peered":"2024-09-21T07:35:57.517774+0000","last_clean":"2024-09-21T07:35:57.517774+0000","last_became_active":"2024-09-21T07:35:55.516611+0000","last_became_peered":"2024-09-21T07:35:55.516611+0000","last_unstale":"2024-09-21T07:35:57.517774+0000","last_undegraded":"2024-09-21T07:35:57.517774+0000","last_fullsized":"2024-09-21T07:35:57.517774+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.047521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744017+0000","last_change":"2024-09-21T07:35:56.540592+0000","last_active":"2024-09-21T07:35:57.744017+0000","last_peered":"2024-09-21T07:35:57.744017+0000","last_clean":"2024-09-21T07:35:57.744017+0000","last_became_active":"2024-09-21T07:35:56.540269+0000","last_became_peered":"2024-09-21T07:35:56.540269+0000","last_unstale":"2024-09-21T07:35:57.744017+0000","last_undegraded":"2024-09-21T07:35:57.744017+0000","last_fullsized":"2024-09-21T07:35:57.744017+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:30.637969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463636+0000","last_change":"2024-09-21T07:35:55.503498+0000","last_active":"2024-09-21T07:35:58.463636+0000","last_peered":"2024-09-21T07:35:58.463636+0000","last_clean":"2024-09-21T07:35:58.463636+0000","last_became_active":"2024-09-21T07:35:55.503073+0000","last_became_peered":"2024-09-21T07:35:55.503073+0000","last_unstale":"2024-09-21T07:35:58.463636+0000","last_undegraded":"2024-09-21T07:35:58.463636+0000","last_fullsized":"2024-09-21T07:35:58.463636+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:07.889708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516961+0000","last_change":"2024-09-21T07:35:56.547899+0000","last_active":"2024-09-21T07:35:57.516961+0000","last_peered":"2024-09-21T07:35:57.516961+0000","last_clean":"2024-09-21T07:35:57.516961+0000","last_became_active":"2024-09-21T07:35:56.547572+0000","last_became_peered":"2024-09-21T07:35:56.547572+0000","last_unstale":"2024-09-21T07:35:57.516961+0000","last_undegraded":"2024-09-21T07:35:57.516961+0000","last_fullsized":"2024-09-21T07:35:57.516961+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:18.327833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.517486+0000","last_change":"2024-09-21T07:35:55.506133+0000","last_active":"2024-09-21T07:35:57.517486+0000","last_peered":"2024-09-21T07:35:57.517486+0000","last_clean":"2024-09-21T07:35:57.517486+0000","last_became_active":"2024-09-21T07:35:55.505819+0000","last_became_peered":"2024-09-21T07:35:55.505819+0000","last_unstale":"2024-09-21T07:35:57.517486+0000","last_undegraded":"2024-09-21T07:35:57.517486+0000","last_fullsized":"2024-09-21T07:35:57.517486+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:50.225417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927022+0000","last_change":"2024-09-21T07:35:56.528239+0000","last_active":"2024-09-21T07:35:57.927022+0000","last_peered":"2024-09-21T07:35:57.927022+0000","last_clean":"2024-09-21T07:35:57.927022+0000","last_became_active":"2024-09-21T07:35:56.527890+0000","last_became_peered":"2024-09-21T07:35:56.527890+0000","last_unstale":"2024-09-21T07:35:57.927022+0000","last_undegraded":"2024-09-21T07:35:57.927022+0000","last_fullsized":"2024-09-21T07:35:57.927022+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:14.602446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927018+0000","last_change":"2024-09-21T07:35:55.516129+0000","last_active":"2024-09-21T07:35:57.927018+0000","last_peered":"2024-09-21T07:35:57.927018+0000","last_clean":"2024-09-21T07:35:57.927018+0000","last_became_active":"2024-09-21T07:35:55.515802+0000","last_became_peered":"2024-09-21T07:35:55.515802+0000","last_unstale":"2024-09-21T07:35:57.927018+0000","last_undegraded":"2024-09-21T07:35:57.927018+0000","last_fullsized":"2024-09-21T07:35:57.927018+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:42.354336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.464256+0000","last_change":"2024-09-21T07:35:56.530807+0000","last_active":"2024-09-21T07:35:58.464256+0000","last_peered":"2024-09-21T07:35:58.464256+0000","last_clean":"2024-09-21T07:35:58.464256+0000","last_became_active":"2024-09-21T07:35:56.528662+0000","last_became_peered":"2024-09-21T07:35:56.528662+0000","last_unstale":"2024-09-21T07:35:58.464256+0000","last_undegraded":"2024-09-21T07:35:58.464256+0000","last_fullsized":"2024-09-21T07:35:58.464256+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:12.431510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.463654+0000","last_change":"2024-09-21T07:35:55.503586+0000","last_active":"2024-09-21T07:35:58.463654+0000","last_peered":"2024-09-21T07:35:58.463654+0000","last_clean":"2024-09-21T07:35:58.463654+0000","last_became_active":"2024-09-21T07:35:55.503160+0000","last_became_peered":"2024-09-21T07:35:55.503160+0000","last_unstale":"2024-09-21T07:35:58.463654+0000","last_undegraded":"2024-09-21T07:35:58.463654+0000","last_fullsized":"2024-09-21T07:35:58.463654+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:20.237989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016643+0000","last_change":"2024-09-21T07:35:56.532396+0000","last_active":"2024-09-21T07:35:58.016643+0000","last_peered":"2024-09-21T07:35:58.016643+0000","last_clean":"2024-09-21T07:35:58.016643+0000","last_became_active":"2024-09-21T07:35:56.532062+0000","last_became_peered":"2024-09-21T07:35:56.532062+0000","last_unstale":"2024-09-21T07:35:58.016643+0000","last_undegraded":"2024-09-21T07:35:58.016643+0000","last_fullsized":"2024-09-21T07:35:58.016643+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:58.148861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516875+0000","last_change":"2024-09-21T07:35:55.511105+0000","last_active":"2024-09-21T07:35:57.516875+0000","last_peered":"2024-09-21T07:35:57.516875+0000","last_clean":"2024-09-21T07:35:57.516875+0000","last_became_active":"2024-09-21T07:35:55.510724+0000","last_became_peered":"2024-09-21T07:35:55.510724+0000","last_unstale":"2024-09-21T07:35:57.516875+0000","last_undegraded":"2024-09-21T07:35:57.516875+0000","last_fullsized":"2024-09-21T07:35:57.516875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:13.044173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016930+0000","last_change":"2024-09-21T07:35:56.545891+0000","last_active":"2024-09-21T07:35:58.016930+0000","last_peered":"2024-09-21T07:35:58.016930+0000","last_clean":"2024-09-21T07:35:58.016930+0000","last_became_active":"2024-09-21T07:35:56.545486+0000","last_became_peered":"2024-09-21T07:35:56.545486+0000","last_unstale":"2024-09-21T07:35:58.016930+0000","last_undegraded":"2024-09-21T07:35:58.016930+0000","last_fullsized":"2024-09-21T07:35:58.016930+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:05.959347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927217+0000","last_change":"2024-09-21T07:35:55.506044+0000","last_active":"2024-09-21T07:35:57.927217+0000","last_peered":"2024-09-21T07:35:57.927217+0000","last_clean":"2024-09-21T07:35:57.927217+0000","last_became_active":"2024-09-21T07:35:55.505749+0000","last_became_peered":"2024-09-21T07:35:55.505749+0000","last_unstale":"2024-09-21T07:35:57.927217+0000","last_undegraded":"2024-09-21T07:35:57.927217+0000","last_fullsized":"2024-09-21T07:35:57.927217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:14.718347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.744420+0000","last_change":"2024-09-21T07:35:56.543636+0000","last_active":"2024-09-21T07:35:57.744420+0000","last_peered":"2024-09-21T07:35:57.744420+0000","last_clean":"2024-09-21T07:35:57.744420+0000","last_became_active":"2024-09-21T07:35:56.543332+0000","last_became_peered":"2024-09-21T07:35:56.543332+0000","last_unstale":"2024-09-21T07:35:57.744420+0000","last_undegraded":"2024-09-21T07:35:57.744420+0000","last_fullsized":"2024-09-21T07:35:57.744420+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:40.588729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.519097+0000","last_change":"2024-09-21T07:35:55.504949+0000","last_active":"2024-09-21T07:35:57.519097+0000","last_peered":"2024-09-21T07:35:57.519097+0000","last_clean":"2024-09-21T07:35:57.519097+0000","last_became_active":"2024-09-21T07:35:55.504623+0000","last_became_peered":"2024-09-21T07:35:55.504623+0000","last_unstale":"2024-09-21T07:35:57.519097+0000","last_undegraded":"2024-09-21T07:35:57.519097+0000","last_fullsized":"2024-09-21T07:35:57.519097+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:14.464426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.927310+0000","last_change":"2024-09-21T07:35:56.531233+0000","last_active":"2024-09-21T07:35:57.927310+0000","last_peered":"2024-09-21T07:35:57.927310+0000","last_clean":"2024-09-21T07:35:57.927310+0000","last_became_active":"2024-09-21T07:35:56.529247+0000","last_became_peered":"2024-09-21T07:35:56.529247+0000","last_unstale":"2024-09-21T07:35:57.927310+0000","last_undegraded":"2024-09-21T07:35:57.927310+0000","last_fullsized":"2024-09-21T07:35:57.927310+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:55.483754+0000","last_clean_scrub_stamp":"2024-09-21T07:35:55.483754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:29.217224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:57.516761+0000","last_change":"2024-09-21T07:35:55.513811+0000","last_active":"2024-09-21T07:35:57.516761+0000","last_peered":"2024-09-21T07:35:57.516761+0000","last_clean":"2024-09-21T07:35:57.516761+0000","last_became_active":"2024-09-21T07:35:55.513193+0000","last_became_peered":"2024-09-21T07:35:55.513193+0000","last_unstale":"2024-09-21T07:35:57.516761+0000","last_undegraded":"2024-09-21T07:35:57.516761+0000","last_fullsized":"2024-09-21T07:35:57.516761+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:35:54.476147+0000","last_clean_scrub_stamp":"2024-09-21T07:35:54.476147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":421,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-21T07:35:58.016235+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:35:58.016235+0000","last_peered":"2024-09-21T07:35:58.016235+0000","last_clean":"2024-09-21T07:35:58.016235+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:35:58.016235+0000","last_undegraded":"2024-09-21T07:35:58.016235+0000","last_fullsized":"2024-09-21T07:35:58.016235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509605,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55756,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316084,"statfs":{"total":96636764160,"available":96579670016,"internally_reserved":0,"allocated":2416640,"data_stored":1137602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509605,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55748,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316092,"statfs":{"total":96636764160,"available":96579678208,"internally_reserved":0,"allocated":2408448,"data_stored":1135464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509605,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64064,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307776,"statfs":{"total":96636764160,"available":96571162624,"internally_reserved":0,"allocated":2404352,"data_stored":1135990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509605,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59908,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311932,"statfs":{"total":96636764160,"available":96575418368,"internally_reserved":0,"allocated":2404352,"data_stored":1135498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64064,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307776,"statfs":{"total":96636764160,"available":96571162624,"internally_reserved":0,"allocated":2400256,"data_stored":1135408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509605,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56332,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315508,"statfs":{"total":96636764160,"available":96579080192,"internally_reserved":0,"allocated":2998272,"data_stored":1725866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542309,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56344,"kb_used_data":2940,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315496,"statfs":{"total":96636764160,"available":96579067904,"internally_reserved":0,"allocated":3010560,"data_stored":1727458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575012,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87624,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284216,"statfs":{"total":96636764160,"available":96547037184,"internally_reserved":0,"allocated":2412544,"data_stored":1135534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:36:05.808 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:36:05.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 -- 172.21.15.64:0/4063415764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80706c0 msgr2=0x7fa5f80ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 --2- 172.21.15.64:0/4063415764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80706c0 0x7fa5f80ce740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009840 tx=0x7fa5e001c790 comp rx=0 tx=0).stop 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 -- 172.21.15.64:0/4063415764 shutdown_connections 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 --2- 172.21.15.64:0/4063415764 >> v2:172.21.15.90:3300/0 conn(0x7fa5f80ca990 0x7fa5f80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 --2- 172.21.15.64:0/4063415764 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80706c0 0x7fa5f80ce740 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 -- 172.21.15.64:0/4063415764 >> 172.21.15.64:0/4063415764 conn(0x7fa5f80ccbe0 msgr2=0x7fa5f80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 -- 172.21.15.64:0/4063415764 shutdown_connections 2024-09-21T07:36:06.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.012+0000 7fa5fec00640 1 -- 172.21.15.64:0/4063415764 wait complete. 2024-09-21T07:36:06.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 Processor -- start 2024-09-21T07:36:06.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- start start 2024-09-21T07:36:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80ca990 0x7fa5f80c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f8158ae0 0x7fa5f80af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8168c30 con 0x7fa5f815ec20 2024-09-21T07:36:06.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8168ab0 con 0x7fa5f8158ae0 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f8168db0 con 0x7fa5f80ca990 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33064/0 (socket says 172.21.15.64:33064) 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 -- 172.21.15.64:0/505769476 learned_addr learned my addr 172.21.15.64:0/505769476 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fcc00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f8158ae0 0x7fa5f80af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5f7e00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80ca990 0x7fa5f80c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 -- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80ca990 msgr2=0x7fa5f80c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80ca990 0x7fa5f80c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 -- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f8158ae0 msgr2=0x7fa5f80af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f8158ae0 0x7fa5f80af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 -- 172.21.15.64:0/505769476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f815ab50 con 0x7fa5f815ec20 2024-09-21T07:36:06.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5efe00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fa5e001cc70 tx=0x7fa5e0005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00b2040 con 0x7fa5f815ec20 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5e00a5850 con 0x7fa5f815ec20 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f80c8220 con 0x7fa5f815ec20 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00a5c20 con 0x7fa5f815ec20 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.016+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f80b0490 con 0x7fa5f815ec20 2024-09-21T07:36:06.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.020+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f80ce740 con 0x7fa5f815ec20 2024-09-21T07:36:06.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.020+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa5e00bd030 con 0x7fa5f815ec20 2024-09-21T07:36:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.020+0000 7fa5f4c00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 0x7fa5d4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.020+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fa5e012dd00 con 0x7fa5f815ec20 2024-09-21T07:36:06.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.020+0000 7fa5f7e00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 0x7fa5d4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.024+0000 7fa5f7e00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 0x7fa5d4075740 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80046c0 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:06.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.024+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa5e00c4060 con 0x7fa5f815ec20 2024-09-21T07:36:06.270 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.268+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa5f815a8e0 con 0x7fa5f815ec20 2024-09-21T07:36:06.273 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5f4c00640 1 -- 172.21.15.64:0/505769476 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v36) ==== 190+0+147 (secure 0 0 0) 0x7fa5e0016410 con 0x7fa5f815ec20 2024-09-21T07:36:06.273 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:36:06.273 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:36:06.273 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:36:06.274 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:36:06.274 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:36:06.274 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:36:06.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 msgr2=0x7fa5d4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 0x7fa5d4075740 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80046c0 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 msgr2=0x7fa5f8145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fa5e001cc70 tx=0x7fa5e0005ca0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 shutdown_connections 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa5d4073230 0x7fa5d4075740 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f8158ae0 0x7fa5f80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5f815ec20 0x7fa5f8145420 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 --2- 172.21.15.64:0/505769476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f80ca990 0x7fa5f80c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 >> 172.21.15.64:0/505769476 conn(0x7fa5f80ccbe0 msgr2=0x7fa5f80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 shutdown_connections 2024-09-21T07:36:06.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.272+0000 7fa5fec00640 1 -- 172.21.15.64:0/505769476 wait complete. 2024-09-21T07:36:06.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 -- 172.21.15.64:0/2400649390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f6c004810 msgr2=0x7f3f6c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 --2- 172.21.15.64:0/2400649390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f6c004810 0x7f3f6c004c20 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f3f70001680 tx=0x7f3f7001c7a0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8a200640 1 -- 172.21.15.64:0/2400649390 reap_dead start 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 -- 172.21.15.64:0/2400649390 shutdown_connections 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 -- 172.21.15.64:0/2400649390 >> 172.21.15.64:0/2400649390 conn(0x7f3f840ccbe0 msgr2=0x7f3f840ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 -- 172.21.15.64:0/2400649390 shutdown_connections 2024-09-21T07:36:06.456 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.452+0000 7f3f8c200640 1 -- 172.21.15.64:0/2400649390 wait complete. 2024-09-21T07:36:06.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 Processor -- start 2024-09-21T07:36:06.458 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 -- start start 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 0x7f3f841f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f840cb590 0x7f3f840cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3f840731b0 con 0x7f3f84155090 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f84073030 con 0x7f3f6c004810 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8c200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3f84073330 con 0x7f3f840cb590 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33082/0 (socket says 172.21.15.64:33082) 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 -- 172.21.15.64:0/1114592810 learned_addr learned my addr 172.21.15.64:0/1114592810 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f88e00640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f840cb590 0x7f3f840cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f89800640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 0x7f3f841f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 -- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f840cb590 msgr2=0x7f3f840cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f840cb590 0x7f3f840cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 -- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 msgr2=0x7f3f841f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 0x7f3f841f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f8a200640 1 -- 172.21.15.64:0/1114592810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f840b65b0 con 0x7f3f84155090 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.456+0000 7f3f89800640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 0x7f3f841f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f8a200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f3f84072dd0 tx=0x7f3f7c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004b30 con 0x7f3f84155090 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7c004cd0 con 0x7f3f84155090 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f840cbee0 con 0x7f3f84155090 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c003be0 con 0x7f3f84155090 2024-09-21T07:36:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f841524d0 con 0x7f3f84155090 2024-09-21T07:36:06.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f84073890 con 0x7f3f84155090 2024-09-21T07:36:06.463 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.460+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f7c004030 con 0x7f3f84155090 2024-09-21T07:36:06.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.464+0000 7f3f81600640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 0x7f3f64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.464+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f3f7c094d50 con 0x7f3f84155090 2024-09-21T07:36:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.464+0000 7f3f89800640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 0x7f3f64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:06.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.464+0000 7f3f89800640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 0x7f3f64075710 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001720 tx=0x7f3f780067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:06.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.468+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3f840cbee0 con 0x7f3f84155090 2024-09-21T07:36:06.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.684+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f84151f80 con 0x7f3f84155090 2024-09-21T07:36:06.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.684+0000 7f3f81600640 1 -- 172.21.15.64:0/1114592810 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f3f7c05fb40 con 0x7f3f84155090 2024-09-21T07:36:06.687 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:06.687 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:36:06.687 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 msgr2=0x7f3f64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 0x7f3f64075710 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001720 tx=0x7f3f780067b0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 msgr2=0x7f3f841554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f3f84072dd0 tx=0x7f3f7c00f3c0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 shutdown_connections 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3f64073200 0x7f3f64075710 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f84155090 0x7f3f841554a0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f840cb590 0x7f3f840cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 --2- 172.21.15.64:0/1114592810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f6c004810 0x7f3f841f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 >> 172.21.15.64:0/1114592810 conn(0x7f3f840ccbe0 msgr2=0x7f3f84074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 shutdown_connections 2024-09-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:06.688+0000 7f3f8c200640 1 -- 172.21.15.64:0/1114592810 wait complete. 2024-09-21T07:36:07.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 144, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:35:55.922738+0000', 'modified': '2024-09-21T07:35:58.948667+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10503}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10503': {'gid': 10503, 'name': 'c', 'rank': 0, 'incarnation': 141, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/39075560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 39075560}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 39075560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10503, 'qdb_cluster': [10503]} 2024-09-21T07:36:07.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:36:07.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:36:07.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 -- 172.21.15.64:0/3771216227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ce1f0 msgr2=0x7f28a00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 --2- 172.21.15.64:0/3771216227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ce1f0 0x7f28a00ce600 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f28a0071000 tx=0x7f289801cd80 comp rx=0 tx=0).stop 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 -- 172.21.15.64:0/3771216227 shutdown_connections 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 --2- 172.21.15.64:0/3771216227 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ce1f0 0x7f28a00ce600 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 --2- 172.21.15.64:0/3771216227 >> v2:172.21.15.90:3300/0 conn(0x7f28a00ccce0 0x7f28a00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 --2- 172.21.15.64:0/3771216227 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00b4de0 0x7f28a00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 -- 172.21.15.64:0/3771216227 >> 172.21.15.64:0/3771216227 conn(0x7f28a006d450 msgr2=0x7f28a00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 -- 172.21.15.64:0/3771216227 shutdown_connections 2024-09-21T07:36:07.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.272+0000 7f28a5400640 1 -- 172.21.15.64:0/3771216227 wait complete. 2024-09-21T07:36:07.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 Processor -- start 2024-09-21T07:36:07.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 -- start start 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28a00b4de0 0x7f28a00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 0x7f28a00b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0169340 con 0x7f28a00ccce0 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28a01691c0 con 0x7f28a00b4de0 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f28a5400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f28a01694c0 con 0x7f28a00ce1f0 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33104/0 (socket says 172.21.15.64:33104) 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f2895e00640 1 -- 172.21.15.64:0/530538589 learned_addr learned my addr 172.21.15.64:0/530538589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.276+0000 7f289e800640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28a00b4de0 0x7f28a00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f289f200640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 0x7f28a00b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 -- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 msgr2=0x7f28a00b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 0x7f28a00b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 -- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28a00b4de0 msgr2=0x7f28a00b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28a00b4de0 0x7f28a00b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 -- 172.21.15.64:0/530538589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01faa20 con 0x7f28a00ccce0 2024-09-21T07:36:07.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f289f200640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 0x7f28a00b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2895e00640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f288800d750 tx=0x7f288800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2897400640 1 -- 172.21.15.64:0/530538589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888017070 con 0x7f28a00ccce0 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2897400640 1 -- 172.21.15.64:0/530538589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2888009d20 con 0x7f28a00ccce0 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2897400640 1 -- 172.21.15.64:0/530538589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800de60 con 0x7f28a00ccce0 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01fad00 con 0x7f28a00ccce0 2024-09-21T07:36:07.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01fb2c0 con 0x7f28a00ccce0 2024-09-21T07:36:07.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.280+0000 7f2897400640 1 -- 172.21.15.64:0/530538589 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2888004280 con 0x7f28a00ccce0 2024-09-21T07:36:07.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2897400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 0x7f287c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2897400640 1 -- 172.21.15.64:0/530538589 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2888094760 con 0x7f28a00ccce0 2024-09-21T07:36:07.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 Processor -- start 2024-09-21T07:36:07.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f289e800640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 0x7f287c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 -- start start 2024-09-21T07:36:07.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f289e800640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 0x7f287c075710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2890005fd0 tx=0x7f289000b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6752460 0x55c3b6c936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c94120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6b68410 con 0x55c3b6b42950 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6aa5b40 con 0x55c3b6b2bca0 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b6a94f70 con 0x55c3b6752460 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33112/0 (socket says 172.21.15.64:33112) 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 -- 172.21.15.64:0/1449394795 learned_addr learned my addr 172.21.15.64:0/1449394795 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f289e800640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6752460 0x55c3b6c936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f289f200640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c94120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 -- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6752460 msgr2=0x55c3b6c936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6752460 0x55c3b6c936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 -- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 msgr2=0x55c3b6c94120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c94120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 -- 172.21.15.64:0/1449394795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b6a5c5b0 con 0x55c3b6b42950 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f289f200640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f2895e00640 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f2888009fd0 tx=0x7f288805ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c573537f19a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f288f000640 1 -- 172.21.15.64:0/1449394795 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888084070 con 0x55c3b6b42950 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f288f000640 1 -- 172.21.15.64:0/1449394795 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f288805eef0 con 0x55c3b6b42950 2024-09-21T07:36:07.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.284+0000 7f288f000640 1 -- 172.21.15.64:0/1449394795 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288805e390 con 0x55c3b6b42950 2024-09-21T07:36:07.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1449394795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 msgr2=0x55c3b6c93be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f2888009fd0 tx=0x7f288805ea00 comp rx=0 tx=0).stop 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1449394795 shutdown_connections 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c93be0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1449394795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6752460 0x55c3b6c936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1449394795 >> 172.21.15.64:0/1449394795 conn(0x55c3b6c18d90 msgr2=0x55c3b6c48690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1449394795 shutdown_connections 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1449394795 wait complete. 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- start start 2024-09-21T07:36:07.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 Processor -- start 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c9a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6a2f5f0 con 0x55c3b6b42950 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6a98d80 con 0x55c3b6752460 2024-09-21T07:36:07.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b6a3b520 con 0x55c3b6b2bca0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f28ac9ca000 10 client.0 _ll_register_callbacks cb 0x55c3b6a3f830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33114/0 (socket says 172.21.15.64:33114) 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 -- 172.21.15.64:0/122024754 learned_addr learned my addr 172.21.15.64:0/122024754 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f2895e00640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289e800640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c9a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 -- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 msgr2=0x55c3b6c9ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c9ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 -- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 msgr2=0x55c3b6c9a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c9a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.288+0000 7f289f200640 1 -- 172.21.15.64:0/122024754 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b6a33190 con 0x55c3b6b42950 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f289f200640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f28980b0040 tx=0x7f2898004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b533272c0dd79dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:07.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28980bc060 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3b6a2d110 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2898003980 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f28980c2050 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 10 client.10647 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55c3b6b19f10 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c3b6a2d110 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f28980c5020 con 0x55c3b6b42950 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 10 client.10647 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 10 client.10647 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 20 client.10647 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b67377d0 0x55c3b6ca4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 4 client.10647 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b6aa7a90 con 0x55c3b67377d0 2024-09-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f289e800640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b67377d0 0x55c3b6ca4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 10 client.10647 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f289e800640 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b67377d0 0x55c3b6ca4d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfee7a5d83904b3d server_cookie=dc901398fbb067f5 in_seq=0 out_seq=0 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 1 -- 172.21.15.64:0/122024754 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3b6aa7a90 con 0x55c3b67377d0 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 10 client.10647 handle_command_reply: tid=0 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 client.10647 shutdown 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 msgr2=0x55c3b6c9b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f28980b0040 tx=0x7f2898004f90 comp rx=0 tx=0).stop 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 shutdown_connections 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b67377d0 0x55c3b6ca4d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b42950 0x55c3b6c9b3a0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c9ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/122024754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c9a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f2883400640 0 client.10647 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 >> 172.21.15.64:0/122024754 conn(0x55c3b6c18d90 msgr2=0x55c3b6c4f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 shutdown_connections 2024-09-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 1 -- 172.21.15.64:0/122024754 wait complete. 2024-09-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.292+0000 7f28ac9ca000 20 client.10647 trim_cache size 0 max 16384 2024-09-21T07:36:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.312+0000 7f28ac9ca000 1 Processor -- start 2024-09-21T07:36:07.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.312+0000 7f28ac9ca000 1 -- start start 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c92630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 0x55c3b6c47cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0203c40 con 0x55c3b6b2bca0 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0202c90 con 0x55c3b6752460 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f28a009b760 con 0x55c3b6b42950 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33130/0 (socket says 172.21.15.64:33130) 2024-09-21T07:36:07.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 -- 172.21.15.64:0/2208274058 learned_addr learned my addr 172.21.15.64:0/2208274058 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f289f200640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 0x55c3b6c47cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f289e800640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c92630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 -- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 msgr2=0x55c3b6c47cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 0x55c3b6c47cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 -- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 msgr2=0x55c3b6c92630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c92630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 -- 172.21.15.64:0/2208274058 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b6af0db0 con 0x55c3b6b2bca0 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f289f200640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 0x55c3b6c47cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f289e800640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c92630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f2895e00640 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f288805c160 tx=0x7f2888063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e6cd0a07a41960 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f288e600640 1 -- 172.21.15.64:0/2208274058 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288807e070 con 0x55c3b6b2bca0 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f288e600640 1 -- 172.21.15.64:0/2208274058 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2888068910 con 0x55c3b6b2bca0 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f288e600640 1 -- 172.21.15.64:0/2208274058 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888084040 con 0x55c3b6b2bca0 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- 172.21.15.64:0/2208274058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 msgr2=0x55c3b6c92b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f288805c160 tx=0x7f2888063000 comp rx=0 tx=0).stop 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- 172.21.15.64:0/2208274058 shutdown_connections 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b42950 0x55c3b6c47cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6b2bca0 0x55c3b6c92b70 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/2208274058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6752460 0x55c3b6c92630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- 172.21.15.64:0/2208274058 >> 172.21.15.64:0/2208274058 conn(0x55c3b6c18d90 msgr2=0x55c3b6c550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- 172.21.15.64:0/2208274058 shutdown_connections 2024-09-21T07:36:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- 172.21.15.64:0/2208274058 wait complete. 2024-09-21T07:36:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 -- start start 2024-09-21T07:36:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.316+0000 7f28ac9ca000 1 Processor -- start 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c4b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b42950 0x55c3b6cc9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6a9d3b0 con 0x55c3b6752460 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c3b6b19a80 con 0x55c3b6b42950 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c3b6a98090 con 0x55c3b6b2bca0 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 10 client.0 _ll_register_callbacks cb 0x7f28980b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33138/0 (socket says 172.21.15.64:33138) 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 -- 172.21.15.64:0/1146692432 learned_addr learned my addr 172.21.15.64:0/1146692432 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2895e00640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c4b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289f200640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b42950 0x55c3b6cc9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 -- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 msgr2=0x55c3b6c4b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c4b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 -- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b42950 msgr2=0x55c3b6cc9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b42950 0x55c3b6cc9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 -- 172.21.15.64:0/1146692432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b6a5bab0 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f289e800640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f2890011010 tx=0x7f2890013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd1fd3d494c18ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890011e60 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2890032c90 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2888068910 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f289002a830 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 10 client.10653 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55c3b6a3a070 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2888068910 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f289002a9d0 con 0x55c3b6752460 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 10 client.10653 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 10 client.10653 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 20 client.10653 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:07.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b6725830 0x55c3b6d0d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 4 client.10653 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:36:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "status"}) -- 0x55c3b6aa3540 con 0x55c3b6725830 2024-09-21T07:36:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2895e00640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b6725830 0x55c3b6d0d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2895e00640 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b6725830 0x55c3b6d0d4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541ab78c7ba750fb server_cookie=efe95771c136652e in_seq=0 out_seq=0 2024-09-21T07:36:07.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.320+0000 7f2883400640 10 client.10653 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f2883400640 1 -- 172.21.15.64:0/1146692432 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55c3b6aa3540 con 0x55c3b6725830 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f2883400640 10 client.10653 handle_command_reply: tid=0 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 client.10653 shutdown 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 msgr2=0x55c3b6c4acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f2890011010 tx=0x7f2890013070 comp rx=0 tx=0).stop 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 shutdown_connections 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55c3b6725830 0x55c3b6d0d4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c3b6b42950 0x55c3b6cc9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c3b6b2bca0 0x55c3b6c4b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 --2- 172.21.15.64:0/1146692432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c3b6752460 0x55c3b6c4acd0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f2883400640 0 client.10653 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 >> 172.21.15.64:0/1146692432 conn(0x55c3b6c18d90 msgr2=0x55c3b6ca48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 shutdown_connections 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 1 -- 172.21.15.64:0/1146692432 wait complete. 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28ac9ca000 20 client.10653 trim_cache size 0 max 16384 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 10503, 2024-09-21T07:36:07.328 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.822882455, 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 144, 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 191, 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 191, 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.211051153 2024-09-21T07:36:07.329 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 msgr2=0x7f287c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 0x7f287c075710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2890005fd0 tx=0x7f289000b260 comp rx=0 tx=0).stop 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 msgr2=0x7f28a015e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f288800d750 tx=0x7f288800dc10 comp rx=0 tx=0).stop 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 shutdown_connections 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f287c073200 0x7f287c075710 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28a00ce1f0 0x7f28a00b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28a00ccce0 0x7f28a015e570 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 --2- 172.21.15.64:0/530538589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28a00b4de0 0x7f28a00b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 >> 172.21.15.64:0/530538589 conn(0x7f28a006d450 msgr2=0x7f28a0159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 shutdown_connections 2024-09-21T07:36:07.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.324+0000 7f28a5400640 1 -- 172.21.15.64:0/530538589 wait complete. 2024-09-21T07:36:07.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:36:07.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 -- 172.21.15.64:0/2726669238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 msgr2=0x7f21880cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 --2- 172.21.15.64:0/2726669238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21880cfb50 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f21880cf4c0 tx=0x7f217c01c890 comp rx=0 tx=0).stop 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 -- 172.21.15.64:0/2726669238 shutdown_connections 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 --2- 172.21.15.64:0/2726669238 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 0x7f21880ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 --2- 172.21.15.64:0/2726669238 >> v2:172.21.15.90:3300/0 conn(0x7f2188073450 0x7f2188073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 --2- 172.21.15.64:0/2726669238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21880cfb50 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 -- 172.21.15.64:0/2726669238 >> 172.21.15.64:0/2726669238 conn(0x7f21880cd2b0 msgr2=0x7f21880cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 -- 172.21.15.64:0/2726669238 shutdown_connections 2024-09-21T07:36:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.500+0000 7f218ea00640 1 -- 172.21.15.64:0/2726669238 wait complete. 2024-09-21T07:36:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 Processor -- start 2024-09-21T07:36:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 -- start start 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2188073450 0x7f21880c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 0x7f218814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2188070050 con 0x7f21880cf740 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f218806fed0 con 0x7f2188073450 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218ea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f21880701d0 con 0x7f21880ce400 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.504+0000 7f218e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33152/0 (socket says 172.21.15.64:33152) 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 -- 172.21.15.64:0/2310379840 learned_addr learned my addr 172.21.15.64:0/2310379840 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218d600640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2188073450 0x7f21880c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218cc00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 0x7f218814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 -- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 msgr2=0x7f218814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 0x7f218814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 -- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2188073450 msgr2=0x7f21880c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2188073450 0x7f21880c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 -- 172.21.15.64:0/2310379840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881f9e80 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218e000640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f218000eab0 tx=0x7f218000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218000cea0 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2180004b30 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180005020 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21881fa160 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21881fa720 con 0x7f21880cf740 2024-09-21T07:36:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21880ce810 con 0x7f21880cf740 2024-09-21T07:36:07.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.508+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f21800051c0 con 0x7f21880cf740 2024-09-21T07:36:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.512+0000 7f2185600640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 0x7f2168075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.512+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2180094f50 con 0x7f21880cf740 2024-09-21T07:36:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.512+0000 7f218d600640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 0x7f2168075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.512+0000 7f218d600640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 0x7f2168075740 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f217c0af000 tx=0x7f217c01b0d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.516+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f218005f6f0 con 0x7f21880cf740 2024-09-21T07:36:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.728+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f21880c6c00 con 0x7f21880cf740 2024-09-21T07:36:07.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f2185600640 1 -- 172.21.15.64:0/2310379840 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v144) ==== 53+0+73 (secure 0 0 0) 0x7f2180064120 con 0x7f21880cf740 2024-09-21T07:36:07.733 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 msgr2=0x7f2168075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 0x7f2168075740 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f217c0af000 tx=0x7f217c01b0d0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 msgr2=0x7f21881fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f218000eab0 tx=0x7f218000ef70 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 shutdown_connections 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2168073230 0x7f2168075740 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21880cf740 0x7f21881fc2b0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21880ce400 0x7f218814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 --2- 172.21.15.64:0/2310379840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2188073450 0x7f21880c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 >> 172.21.15.64:0/2310379840 conn(0x7f21880cd2b0 msgr2=0x7f21881ecf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:07.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 shutdown_connections 2024-09-21T07:36:07.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07.732+0000 7f218ea00640 1 -- 172.21.15.64:0/2310379840 wait complete. 2024-09-21T07:36:07.755 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:36:07.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:36:07.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:07.756 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.765 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41616sec preferred_lft 41616sec 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:36:07.766 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:36:07.767 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:36:07.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:07.768 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:36:07.830 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:36:07.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:07.832 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:36:07.887 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:36:07.887 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:36:07.887 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:36:07.887 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:36:07.887 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:36:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:36:07.888 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:36:07.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:36:08.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:36:08.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:08.025 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:36:08.034 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:36:08.034 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:36:08.034 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:36:08.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:08.034 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:36:08.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:36:08.100 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:36:08.152 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:36:08.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:36:08.152 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:36:08.203 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:36:08.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:08.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:36:08.309 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:36:08.310 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:36:08.323 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:36:08.323 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:36:08.323 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:36:08.323 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:36:08.323 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:36:08.327 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:36:08.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:08.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:36:08.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:36:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:36:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:36:08.456 INFO:teuthology.orchestra.run.smithi064.stdout:client10662 2024-09-21T07:36:08.457 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:08.457 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:08.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-21T07:36:08.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- 172.21.15.64:0/147770656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700706c0 msgr2=0x7fd0700b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 --2- 172.21.15.64:0/147770656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700706c0 0x7fd0700b3ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b3130 tx=0x7fd06801ccb0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- 172.21.15.64:0/147770656 shutdown_connections 2024-09-21T07:36:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 --2- 172.21.15.64:0/147770656 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700706c0 0x7fd0700b3ce0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 --2- 172.21.15.64:0/147770656 >> v2:172.21.15.90:3300/0 conn(0x7fd07015ec20 0x7fd0700ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- 172.21.15.64:0/147770656 >> 172.21.15.64:0/147770656 conn(0x7fd0700ccbe0 msgr2=0x7fd0700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- 172.21.15.64:0/147770656 shutdown_connections 2024-09-21T07:36:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- 172.21.15.64:0/147770656 wait complete. 2024-09-21T07:36:08.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 Processor -- start 2024-09-21T07:36:08.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.668+0000 7fd077200640 1 -- start start 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700ca990 0x7fd0701f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd070154450 0x7fd070163e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd070168e10 con 0x7fd07015ec20 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd070168c90 con 0x7fd070154450 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd070168f90 con 0x7fd0700ca990 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700ca990 0x7fd0701f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33166/0 (socket says 172.21.15.64:33166) 2024-09-21T07:36:08.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd075200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd070154450 0x7fd070163e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 -- 172.21.15.64:0/1249402125 learned_addr learned my addr 172.21.15.64:0/1249402125 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 -- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700ca990 msgr2=0x7fd0701f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700ca990 0x7fd0701f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 -- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd070154450 msgr2=0x7fd070163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd070154450 0x7fd070163e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 -- 172.21.15.64:0/1249402125 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0701fc520 con 0x7fd07015ec20 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd067400640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c390 tx=0x7fd05800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd06cc00640 1 -- 172.21.15.64:0/1249402125 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058017070 con 0x7fd07015ec20 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd070166010 con 0x7fd07015ec20 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd06cc00640 1 -- 172.21.15.64:0/1249402125 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0580053c0 con 0x7fd07015ec20 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd06cc00640 1 -- 172.21.15.64:0/1249402125 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058003840 con 0x7fd07015ec20 2024-09-21T07:36:08.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.672+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0701f8a90 con 0x7fd07015ec20 2024-09-21T07:36:08.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd06cc00640 1 -- 172.21.15.64:0/1249402125 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd05801a070 con 0x7fd07015ec20 2024-09-21T07:36:08.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd06cc00640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 0x7fd04c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd06cc00640 1 -- 172.21.15.64:0/1249402125 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fd0580936c0 con 0x7fd07015ec20 2024-09-21T07:36:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd06fe00640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 0x7fd04c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 Processor -- start 2024-09-21T07:36:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 -- start start 2024-09-21T07:36:08.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd06fe00640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 0x7fd04c075710 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd060009600 tx=0x7fd0600091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94fa1a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a15a0 0x55f94fa1aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f94f8b8d50 con 0x55f94f8a1db0 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f94f82cb10 con 0x55f94f8a15a0 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.676+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f94f81bf40 con 0x55f94f8a8320 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33168/0 (socket says 172.21.15.64:33168) 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 -- 172.21.15.64:0/1995770332 learned_addr learned my addr 172.21.15.64:0/1995770332 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd06fe00640 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94fa1a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd067400640 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a15a0 0x55f94fa1aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 -- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 msgr2=0x55f94fa1a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94fa1a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 -- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a15a0 msgr2=0x55f94fa1aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a15a0 0x55f94fa1aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 -- 172.21.15.64:0/1995770332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94f79d120 con 0x55f94f8a1db0 2024-09-21T07:36:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd075200640 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fd068009bd0 tx=0x7fd068019ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc8923152cd0cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd064c00640 1 -- 172.21.15.64:0/1995770332 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bc020 con 0x55f94f8a1db0 2024-09-21T07:36:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd064c00640 1 -- 172.21.15.64:0/1995770332 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd068004b40 con 0x55f94f8a1db0 2024-09-21T07:36:08.683 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd064c00640 1 -- 172.21.15.64:0/1995770332 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680b2040 con 0x55f94f8a1db0 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- 172.21.15.64:0/1995770332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 msgr2=0x55f94fa1b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fd068009bd0 tx=0x7fd068019ab0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- 172.21.15.64:0/1995770332 shutdown_connections 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94fa1b3e0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a15a0 0x55f94fa1aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 --2- 172.21.15.64:0/1995770332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94fa1a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- 172.21.15.64:0/1995770332 >> 172.21.15.64:0/1995770332 conn(0x55f94f4d9920 msgr2=0x55f94f9fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- 172.21.15.64:0/1995770332 shutdown_connections 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- 172.21.15.64:0/1995770332 wait complete. 2024-09-21T07:36:08.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 -- start start 2024-09-21T07:36:08.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.680+0000 7fd07e932000 1 Processor -- start 2024-09-21T07:36:08.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94f9fd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94f9fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f94f7c1500 con 0x55f94f8a15a0 2024-09-21T07:36:08.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f94f81fd50 con 0x55f94f8a1db0 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f94f4e1680 con 0x55f94f8a8320 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 10 client.0 _ll_register_callbacks cb 0x55f94f9bc100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33180/0 (socket says 172.21.15.64:33180) 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 -- 172.21.15.64:0/342897150 learned_addr learned my addr 172.21.15.64:0/342897150 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd075200640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94f9fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd067400640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94f9fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 -- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 msgr2=0x55f94f9fd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94f9fd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 -- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 msgr2=0x55f94f9fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94f9fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.687 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 -- 172.21.15.64:0/342897150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94f7d0c60 con 0x55f94f8a15a0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd06fe00640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fd060004520 tx=0x7fd060004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef16c00dc11200d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06001f9c0 con 0x55f94f8a15a0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fd060029c80 con 0x55f94f8a15a0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f94f7b4330 con 0x55f94f8a15a0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fd06001fb60 con 0x55f94f8a15a0 2024-09-21T07:36:08.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 10 client.10671 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55f94f81abe0 con 0x55f94f8a15a0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f94f7b4330 con 0x55f94f8a15a0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fd060030050 con 0x55f94f8a15a0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 10 client.10671 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 10 client.10671 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 20 client.10671 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4be930 0x55f94fa2bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 4 client.10671 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f94f82ea60 con 0x55f94f4be930 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.684+0000 7fd067400640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4be930 0x55f94fa2bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd067400640 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4be930 0x55f94fa2bf20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a336a949266ffeb5 server_cookie=abe898f23782c97a in_seq=0 out_seq=0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd05d600640 10 client.10671 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd05d600640 1 -- 172.21.15.64:0/342897150 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f94f82ea60 con 0x55f94f4be930 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd05d600640 10 client.10671 handle_command_reply: tid=0 2024-09-21T07:36:08.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 client.10671 shutdown 2024-09-21T07:36:08.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 msgr2=0x55f94f9fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fd060004520 tx=0x7fd060004740 comp rx=0 tx=0).stop 2024-09-21T07:36:08.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 shutdown_connections 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4be930 0x55f94fa2bf20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a8320 0x55f94f9fd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94f9fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 --2- 172.21.15.64:0/342897150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a15a0 0x55f94f9fcf50 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd05d600640 0 client.10671 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 >> 172.21.15.64:0/342897150 conn(0x55f94f4d9920 msgr2=0x55f94f9ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 shutdown_connections 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 1 -- 172.21.15.64:0/342897150 wait complete. 2024-09-21T07:36:08.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.688+0000 7fd07e932000 20 client.10671 trim_cache size 0 max 16384 2024-09-21T07:36:08.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 Processor -- start 2024-09-21T07:36:08.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 -- start start 2024-09-21T07:36:08.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94f9d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 0x55f94f9d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f94f9d42b0 con 0x55f94f8a1db0 2024-09-21T07:36:08.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd070205960 con 0x55f94f8a8320 2024-09-21T07:36:08.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd070204960 con 0x55f94f8a15a0 2024-09-21T07:36:08.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd067400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd067400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33190/0 (socket says 172.21.15.64:33190) 2024-09-21T07:36:08.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.704+0000 7fd067400640 1 -- 172.21.15.64:0/4138274282 learned_addr learned my addr 172.21.15.64:0/4138274282 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 -- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 msgr2=0x55f94f9d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd06fe00640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94f9d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd075200640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 0x55f94f9d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94f9d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 -- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 msgr2=0x55f94f9d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 0x55f94f9d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 -- 172.21.15.64:0/4138274282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94f7ba1f0 con 0x55f94f8a1db0 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd075200640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 0x55f94f9d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd06fe00640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94f9d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd067400640 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fd058007fd0 tx=0x7fd058091890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadd75a8173cad33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd05fe00640 1 -- 172.21.15.64:0/4138274282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058067750 con 0x55f94f8a1db0 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd05fe00640 1 -- 172.21.15.64:0/4138274282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd058078070 con 0x55f94f8a1db0 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd05fe00640 1 -- 172.21.15.64:0/4138274282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05805a0e0 con 0x55f94f8a1db0 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- 172.21.15.64:0/4138274282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 msgr2=0x55f94f9d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fd058007fd0 tx=0x7fd058091890 comp rx=0 tx=0).stop 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- 172.21.15.64:0/4138274282 shutdown_connections 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a8320 0x55f94f9d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a1db0 0x55f94f9d0d30 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 --2- 172.21.15.64:0/4138274282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94f9d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- 172.21.15.64:0/4138274282 >> 172.21.15.64:0/4138274282 conn(0x55f94f4d9920 msgr2=0x55f94fa31ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- 172.21.15.64:0/4138274282 shutdown_connections 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- 172.21.15.64:0/4138274282 wait complete. 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 -- start start 2024-09-21T07:36:08.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.708+0000 7fd07e932000 1 Processor -- start 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94fa2e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94fa2ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55f94f9d9d90 con 0x55f94f8a8320 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f94f81f060 con 0x55f94f8a1db0 2024-09-21T07:36:08.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55f94f7e78b0 con 0x55f94f8a15a0 2024-09-21T07:36:08.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 10 client.0 _ll_register_callbacks cb 0x7fd060005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:08.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33206/0 (socket says 172.21.15.64:33206) 2024-09-21T07:36:08.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 -- 172.21.15.64:0/4064741032 learned_addr learned my addr 172.21.15.64:0/4064741032 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd06fe00640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94fa2e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd067400640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94fa2ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 -- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 msgr2=0x55f94fa2e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94fa2e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 -- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 msgr2=0x55f94fa2ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94fa2ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 -- 172.21.15.64:0/4064741032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94f7e2990 con 0x55f94f8a8320 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd067400640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94fa2ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd075200640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fd068009bd0 tx=0x7fd068003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1515b166b20d540e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680c5060 con 0x55f94f8a8320 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fd068004a50 con 0x55f94f8a8320 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd058078070 con 0x55f94f8a8320 2024-09-21T07:36:08.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fd0680cb050 con 0x55f94f8a8320 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 10 client.10677 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55f94f7b2580 con 0x55f94f8a8320 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd058078070 con 0x55f94f8a8320 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fd0680ce020 con 0x55f94f8a8320 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 10 client.10677 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 10 client.10677 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 20 client.10677 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4ac990 0x55f94fa4ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 4 client.10677 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f94f82a510 con 0x55f94f4ac990 2024-09-21T07:36:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd06fe00640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4ac990 0x55f94fa4ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 10 client.10677 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:08.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd06fe00640 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4ac990 0x55f94fa4ce00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e09eb5f025bb1f server_cookie=98ae11e9357e1227 in_seq=0 out_seq=0 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 1 -- 172.21.15.64:0/4064741032 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f94f82a510 con 0x55f94f4ac990 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd05d600640 10 client.10677 handle_command_reply: tid=0 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.712+0000 7fd07e932000 1 client.10677 shutdown 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 msgr2=0x55f94fa4c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fd068009bd0 tx=0x7fd068003e10 comp rx=0 tx=0).stop 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 shutdown_connections 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x55f94f4ac990 0x55f94fa4ce00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55f94f8a8320 0x55f94fa4c440 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f94f8a1db0 0x55f94fa2ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 --2- 172.21.15.64:0/4064741032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f94f8a15a0 0x55f94fa2e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd05d600640 0 client.10677 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 >> 172.21.15.64:0/4064741032 conn(0x55f94f4d9920 msgr2=0x55f94f9d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 shutdown_connections 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 1 -- 172.21.15.64:0/4064741032 wait complete. 2024-09-21T07:36:08.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd07e932000 20 client.10677 trim_cache size 0 max 16384 2024-09-21T07:36:08.720 INFO:teuthology.orchestra.run.smithi064.stdout:[] 2024-09-21T07:36:08.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 msgr2=0x7fd04c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 0x7fd04c075710 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd060009600 tx=0x7fd0600091e0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 msgr2=0x7fd070153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c390 tx=0x7fd05800c850 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 shutdown_connections 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd04c073200 0x7fd04c075710 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd070154450 0x7fd070163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd07015ec20 0x7fd070153d50 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 --2- 172.21.15.64:0/1249402125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0700ca990 0x7fd0701f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 >> 172.21.15.64:0/1249402125 conn(0x7fd0700ccbe0 msgr2=0x7fd07015cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 shutdown_connections 2024-09-21T07:36:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.716+0000 7fd077200640 1 -- 172.21.15.64:0/1249402125 wait complete. 2024-09-21T07:36:08.737 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T07:36:08.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 -- 172.21.15.64:0/2912632877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c06f650 msgr2=0x7f935c15ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 --2- 172.21.15.64:0/2912632877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c06f650 0x7f935c15ff80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9348009840 tx=0x7f934801c4d0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 -- 172.21.15.64:0/2912632877 shutdown_connections 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 --2- 172.21.15.64:0/2912632877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c1604c0 0x7f935c162be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 --2- 172.21.15.64:0/2912632877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c06f650 0x7f935c15ff80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 -- 172.21.15.64:0/2912632877 >> 172.21.15.64:0/2912632877 conn(0x7f935c06d480 msgr2=0x7f935c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 -- 172.21.15.64:0/2912632877 shutdown_connections 2024-09-21T07:36:08.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.892+0000 7f9361000640 1 -- 172.21.15.64:0/2912632877 wait complete. 2024-09-21T07:36:08.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 Processor -- start 2024-09-21T07:36:08.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- start start 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c06f240 0x7f935c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 0x7f935c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f935c16c050 con 0x7f935c1604c0 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f935c0d0460 con 0x7f935c158ac0 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f935c16c1d0 con 0x7f935c06f240 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33212/0 (socket says 172.21.15.64:33212) 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 -- 172.21.15.64:0/273485807 learned_addr learned my addr 172.21.15.64:0/273485807 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f935a800640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 0x7f935c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359e00640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c06f240 0x7f935c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 -- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c06f240 msgr2=0x7f935c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c06f240 0x7f935c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 -- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 msgr2=0x7f935c14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 0x7f935c14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 -- 172.21.15.64:0/273485807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c0d0b20 con 0x7f935c1604c0 2024-09-21T07:36:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f935a800640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 0x7f935c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9359400640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f934801ab80 tx=0x7f9348005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93480052f0 con 0x7f935c1604c0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9348005580 con 0x7f935c1604c0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93480aa9a0 con 0x7f935c1604c0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c14cb80 con 0x7f935c1604c0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.896+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1f92c0 con 0x7f935c1604c0 2024-09-21T07:36:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.900+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c1f8d50 con 0x7f935c1604c0 2024-09-21T07:36:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.900+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f93480aab40 con 0x7f935c1604c0 2024-09-21T07:36:08.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.904+0000 7f9352000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 0x7f933c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:08.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.904+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f934812f210 con 0x7f935c1604c0 2024-09-21T07:36:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.904+0000 7f9359e00640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 0x7f933c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.904+0000 7f9359e00640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 0x7f933c075710 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f934c0015f0 tx=0x7f934c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:08.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:08.904+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9348016410 con 0x7f935c1604c0 2024-09-21T07:36:09.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f935c06f650 con 0x7f935c1604c0 2024-09-21T07:36:09.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9352000640 1 -- 172.21.15.64:0/273485807 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f93480fa180 con 0x7f935c1604c0 2024-09-21T07:36:09.123 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:09.123 INFO:teuthology.orchestra.run.smithi064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 msgr2=0x7f933c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 0x7f933c075710 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f934c0015f0 tx=0x7f934c009040 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 msgr2=0x7f935c158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.120+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f934801ab80 tx=0x7f9348005ca0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 shutdown_connections 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f933c073200 0x7f933c075710 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f935c158ac0 0x7f935c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935c1604c0 0x7f935c158580 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 --2- 172.21.15.64:0/273485807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f935c06f240 0x7f935c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 >> 172.21.15.64:0/273485807 conn(0x7f935c06d480 msgr2=0x7f935c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 shutdown_connections 2024-09-21T07:36:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.124+0000 7f9361000640 1 -- 172.21.15.64:0/273485807 wait complete. 2024-09-21T07:36:09.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:09.145 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- 172.21.15.64:0/822290095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d00af360 msgr2=0x7f15d015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- 172.21.15.64:0/822290095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d00af360 0x7f15d015f480 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009bc0 tx=0x7f15c801cba0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- 172.21.15.64:0/822290095 shutdown_connections 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- 172.21.15.64:0/822290095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d00af360 0x7f15d015f480 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- 172.21.15.64:0/822290095 >> v2:172.21.15.90:3300/0 conn(0x7f15d01594c0 0x7f15d00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- 172.21.15.64:0/822290095 >> 172.21.15.64:0/822290095 conn(0x7f15d00d0170 msgr2=0x7f15d00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- 172.21.15.64:0/822290095 shutdown_connections 2024-09-21T07:36:09.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- 172.21.15.64:0/822290095 wait complete. 2024-09-21T07:36:09.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 Processor -- start 2024-09-21T07:36:09.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- start start 2024-09-21T07:36:09.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d006ec70 0x7f15d014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d00af360 0x7f15d014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015c490 con 0x7f15d014f3d0 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015c310 con 0x7f15d00af360 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.308+0000 7f15d6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f15d015c610 con 0x7f15d006ec70 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33224/0 (socket says 172.21.15.64:33224) 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 -- 172.21.15.64:0/3514630902 learned_addr learned my addr 172.21.15.64:0/3514630902 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15c6a00640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d00af360 0x7f15d014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cf400640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d006ec70 0x7f15d014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 -- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d006ec70 msgr2=0x7f15d014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d006ec70 0x7f15d014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 -- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d00af360 msgr2=0x7f15d014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d00af360 0x7f15d014e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 -- 172.21.15.64:0/3514630902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d014f0d0 con 0x7f15d014f3d0 2024-09-21T07:36:09.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15cfe00640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f15c801c610 tx=0x7f15c8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15c7e00640 1 -- 172.21.15.64:0/3514630902 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80b2040 con 0x7f15d014f3d0 2024-09-21T07:36:09.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15c7e00640 1 -- 172.21.15.64:0/3514630902 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c80bb070 con 0x7f15d014f3d0 2024-09-21T07:36:09.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d0153d00 con 0x7f15d014f3d0 2024-09-21T07:36:09.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15c7e00640 1 -- 172.21.15.64:0/3514630902 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8004370 con 0x7f15d014f3d0 2024-09-21T07:36:09.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01542c0 con 0x7f15d014f3d0 2024-09-21T07:36:09.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.312+0000 7f15c7e00640 1 -- 172.21.15.64:0/3514630902 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f15c8004510 con 0x7f15d014f3d0 2024-09-21T07:36:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15c7e00640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 0x7f15ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15c7e00640 1 -- 172.21.15.64:0/3514630902 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f15c812ec60 con 0x7f15d014f3d0 2024-09-21T07:36:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15cf400640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 0x7f15ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 Processor -- start 2024-09-21T07:36:09.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 -- start start 2024-09-21T07:36:09.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15cf400640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 0x7f15ac075710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f15d00cc8f0 tx=0x7f15c0001380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x559684796a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596846199a0 0x559684797500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5596845a4a60 con 0x55968461fce0 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559684593e90 con 0x5596846199a0 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559684597ca0 con 0x559684633940 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33240/0 (socket says 172.21.15.64:33240) 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15c6a00640 1 -- 172.21.15.64:0/2088769614 learned_addr learned my addr 172.21.15.64:0/2088769614 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15cf400640 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x559684796a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.316+0000 7f15cfe00640 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596846199a0 0x559684797500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 -- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 msgr2=0x559684796a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x559684796a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 -- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596846199a0 msgr2=0x559684797500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596846199a0 0x559684797500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 -- 172.21.15.64:0/2088769614 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596845dd060 con 0x55968461fce0 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15c6a00640 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009b70 tx=0x7f15b8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b4a2c7ab85eab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15bfe00640 1 -- 172.21.15.64:0/2088769614 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8004020 con 0x55968461fce0 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15bfe00640 1 -- 172.21.15.64:0/2088769614 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b80042b0 con 0x55968461fce0 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15bfe00640 1 -- 172.21.15.64:0/2088769614 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003840 con 0x55968461fce0 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- 172.21.15.64:0/2088769614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 msgr2=0x559684796fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009b70 tx=0x7f15b8011810 comp rx=0 tx=0).stop 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- 172.21.15.64:0/2088769614 shutdown_connections 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596846199a0 0x559684797500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684796fc0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 --2- 172.21.15.64:0/2088769614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x559684796a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- 172.21.15.64:0/2088769614 >> 172.21.15.64:0/2088769614 conn(0x559684252330 msgr2=0x5596847475d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- 172.21.15.64:0/2088769614 shutdown_connections 2024-09-21T07:36:09.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- 172.21.15.64:0/2088769614 wait complete. 2024-09-21T07:36:09.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 -- start start 2024-09-21T07:36:09.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.320+0000 7f15ddccf000 1 Processor -- start 2024-09-21T07:36:09.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55968461fce0 0x55968479d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x55968479d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5596845d7b80 con 0x5596846199a0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55968453d970 con 0x55968461fce0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559684549bd0 con 0x559684633940 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 10 client.0 _ll_register_callbacks cb 0x55968453a410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33256/0 (socket says 172.21.15.64:33256) 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 -- 172.21.15.64:0/1665864457 learned_addr learned my addr 172.21.15.64:0/1665864457 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55968461fce0 0x55968479d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cfe00640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x55968479d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 -- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 msgr2=0x55968479d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x55968479d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 -- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55968461fce0 msgr2=0x55968479d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55968461fce0 0x55968479d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 -- 172.21.15.64:0/1665864457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55968453cb50 con 0x5596846199a0 2024-09-21T07:36:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15cf400640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f15c00016a0 tx=0x7f15c0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb7eb44e89218f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0025020 con 0x5596846199a0 2024-09-21T07:36:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f15c00157d0 con 0x5596846199a0 2024-09-21T07:36:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55968452c200 con 0x5596846199a0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f15c002f050 con 0x5596846199a0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 10 client.10692 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x5596845320c0 con 0x5596846199a0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55968452c200 con 0x5596846199a0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f15c0032020 con 0x5596846199a0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 10 client.10692 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 10 client.10692 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 20 client.10692 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684236b10 0x5596847a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 4 client.10692 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596845a69b0 con 0x559684236b10 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684236b10 0x5596847a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684236b10 0x5596847a70d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ca8e40c3586bd5a server_cookie=3611261a67779cd in_seq=0 out_seq=0 2024-09-21T07:36:09.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.324+0000 7f15bcc00640 10 client.10692 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15bcc00640 1 -- 172.21.15.64:0/1665864457 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596845a69b0 con 0x559684236b10 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15bcc00640 10 client.10692 handle_command_reply: tid=0 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 client.10692 shutdown 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 msgr2=0x55968479ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f15c00016a0 tx=0x7f15c0004630 comp rx=0 tx=0).stop 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 shutdown_connections 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684236b10 0x5596847a70d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559684633940 0x55968479d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55968461fce0 0x55968479d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1665864457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968479ccf0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15bcc00640 0 client.10692 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 >> 172.21.15.64:0/1665864457 conn(0x559684252330 msgr2=0x55968474e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 shutdown_connections 2024-09-21T07:36:09.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 1 -- 172.21.15.64:0/1665864457 wait complete. 2024-09-21T07:36:09.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.328+0000 7f15ddccf000 20 client.10692 trim_cache size 0 max 16384 2024-09-21T07:36:09.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.344+0000 7f15ddccf000 1 Processor -- start 2024-09-21T07:36:09.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.344+0000 7f15ddccf000 1 -- start start 2024-09-21T07:36:09.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5596846199a0 0x559684808640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x5596848090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015ea30 con 0x55968461fce0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015dd90 con 0x559684633940 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f15d015e3e0 con 0x5596846199a0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33270/0 (socket says 172.21.15.64:33270) 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 -- 172.21.15.64:0/1274486211 learned_addr learned my addr 172.21.15.64:0/1274486211 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15cf400640 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5596846199a0 0x559684808640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15cfe00640 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x5596848090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 -- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5596846199a0 msgr2=0x559684808640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5596846199a0 0x559684808640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 -- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 msgr2=0x5596848090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x5596848090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 -- 172.21.15.64:0/1274486211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559684755820 con 0x55968461fce0 2024-09-21T07:36:09.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15c6a00640 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f15b8018000 tx=0x7f15b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0a9a7ee6200734 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15bf400640 1 -- 172.21.15.64:0/1274486211 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003600 con 0x55968461fce0 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15bf400640 1 -- 172.21.15.64:0/1274486211 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b80037c0 con 0x55968461fce0 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15bf400640 1 -- 172.21.15.64:0/1274486211 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003c10 con 0x55968461fce0 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- 172.21.15.64:0/1274486211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 msgr2=0x559684808b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f15b8018000 tx=0x7f15b8004740 comp rx=0 tx=0).stop 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- 172.21.15.64:0/1274486211 shutdown_connections 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x5596848090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55968461fce0 0x559684808b80 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 --2- 172.21.15.64:0/1274486211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5596846199a0 0x559684808640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- 172.21.15.64:0/1274486211 >> 172.21.15.64:0/1274486211 conn(0x559684252330 msgr2=0x55968474d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- 172.21.15.64:0/1274486211 shutdown_connections 2024-09-21T07:36:09.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.348+0000 7f15ddccf000 1 -- 172.21.15.64:0/1274486211 wait complete. 2024-09-21T07:36:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- start start 2024-09-21T07:36:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 Processor -- start 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55968461fce0 0x55968480cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x55968480d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55968455ff60 con 0x5596846199a0 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55968455f780 con 0x559684633940 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559684596fb0 con 0x55968461fce0 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 10 client.0 _ll_register_callbacks cb 0x7f15c0001240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33284/0 (socket says 172.21.15.64:33284) 2024-09-21T07:36:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 -- 172.21.15.64:0/3402841305 learned_addr learned my addr 172.21.15.64:0/3402841305 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15c6a00640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55968461fce0 0x55968480cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cfe00640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x55968480d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 -- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55968461fce0 msgr2=0x55968480cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55968461fce0 0x55968480cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 -- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 msgr2=0x55968480d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x55968480d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 -- 172.21.15.64:0/3402841305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559684618de0 con 0x5596846199a0 2024-09-21T07:36:09.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15cf400640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f15c0015e40 tx=0x7f15c000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449550743b56f12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0037020 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15b80037c0 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f15c0021630 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f15c0041050 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 10 client.10698 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55968452a640 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b80037c0 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f15c0044020 con 0x5596846199a0 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 10 client.10698 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 10 client.10698 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 20 client.10698 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684224b70 0x5596847a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 4 client.10698 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-21T07:36:09.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.352+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x5596845a2460 con 0x559684224b70 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15c6a00640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684224b70 0x5596847a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15c6a00640 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684224b70 0x5596847a2290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa241f2aca7d1f0 server_cookie=fc3e142c2e486f3d in_seq=0 out_seq=0 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15bcc00640 10 client.10698 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15bcc00640 1 -- 172.21.15.64:0/3402841305 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5596845a2460 con 0x559684224b70 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15bcc00640 10 client.10698 handle_command_reply: tid=0 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 client.10698 shutdown 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 msgr2=0x55968480c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f15c0015e40 tx=0x7f15c000f740 comp rx=0 tx=0).stop 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 shutdown_connections 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x559684224b70 0x5596847a2290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559684633940 0x55968480d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55968461fce0 0x55968480cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 --2- 172.21.15.64:0/3402841305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596846199a0 0x55968480c890 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 >> 172.21.15.64:0/3402841305 conn(0x559684252330 msgr2=0x559684745390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15bcc00640 0 client.10698 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 shutdown_connections 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 1 -- 172.21.15.64:0/3402841305 wait complete. 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15ddccf000 20 client.10698 trim_cache size 0 max 16384 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "95823c54-ae17-44e0-8491-69cc48033b24", 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:36:09.361 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 msgr2=0x7f15ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 0x7f15ac075710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f15d00cc8f0 tx=0x7f15c0001380 comp rx=0 tx=0).stop 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 msgr2=0x7f15d015af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f15c801c610 tx=0x7f15c8003f40 comp rx=0 tx=0).stop 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 shutdown_connections 2024-09-21T07:36:09.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f15ac073200 0x7f15ac075710 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15d014f3d0 0x7f15d015af70 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d00af360 0x7f15d014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 --2- 172.21.15.64:0/3514630902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15d006ec70 0x7f15d014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 >> 172.21.15.64:0/3514630902 conn(0x7f15d00d0170 msgr2=0x7f15d00b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 shutdown_connections 2024-09-21T07:36:09.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.356+0000 7f15d6600640 1 -- 172.21.15.64:0/3514630902 wait complete. 2024-09-21T07:36:09.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:09.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-21T07:36:09.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 -- 172.21.15.64:0/2579810738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfac003ab0 msgr2=0x7fcfac003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/2579810738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfac003ab0 0x7fcfac003f20 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009eb0 tx=0x7fcfb801d5d0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfc9c00640 1 -- 172.21.15.64:0/2579810738 reap_dead start 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 -- 172.21.15.64:0/2579810738 shutdown_connections 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 -- 172.21.15.64:0/2579810738 >> 172.21.15.64:0/2579810738 conn(0x7fcfc40ccbe0 msgr2=0x7fcfc40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 -- 172.21.15.64:0/2579810738 shutdown_connections 2024-09-21T07:36:09.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.536+0000 7fcfcbc00640 1 -- 172.21.15.64:0/2579810738 wait complete. 2024-09-21T07:36:09.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 Processor -- start 2024-09-21T07:36:09.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 -- start start 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfac003ab0 0x7fcfc40c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfc41f8da0 0x7fcfc41f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4167f40 con 0x7fcfc41f99e0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4167dc0 con 0x7fcfc41f8da0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfcbc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc41680c0 con 0x7fcfac003ab0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33304/0 (socket says 172.21.15.64:33304) 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfc3e00640 1 -- 172.21.15.64:0/3434812472 learned_addr learned my addr 172.21.15.64:0/3434812472 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfc41f8da0 0x7fcfc41f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.540+0000 7fcfc9200640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfac003ab0 0x7fcfc40c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 -- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfac003ab0 msgr2=0x7fcfc40c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfac003ab0 0x7fcfc40c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 -- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfc41f8da0 msgr2=0x7fcfc41f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfc41f8da0 0x7fcfc41f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 -- 172.21.15.64:0/3434812472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc40ca3b0 con 0x7fcfc41f99e0 2024-09-21T07:36:09.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0000fe0 tx=0x7fcfb000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc0c00640 1 -- 172.21.15.64:0/3434812472 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0015070 con 0x7fcfc41f99e0 2024-09-21T07:36:09.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc0c00640 1 -- 172.21.15.64:0/3434812472 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb0010980 con 0x7fcfc41f99e0 2024-09-21T07:36:09.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc0c00640 1 -- 172.21.15.64:0/3434812472 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0010db0 con 0x7fcfc41f99e0 2024-09-21T07:36:09.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc40b2b50 con 0x7fcfc41f99e0 2024-09-21T07:36:09.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc40c62d0 con 0x7fcfc41f99e0 2024-09-21T07:36:09.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.544+0000 7fcfc0c00640 1 -- 172.21.15.64:0/3434812472 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcfb0018070 con 0x7fcfc41f99e0 2024-09-21T07:36:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc0c00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 0x7fcfa4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc0c00640 1 -- 172.21.15.64:0/3434812472 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fcfb0094770 con 0x7fcfc41f99e0 2024-09-21T07:36:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 Processor -- start 2024-09-21T07:36:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 -- start start 2024-09-21T07:36:09.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9200640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 0x7fcfa4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9200640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 0x7fcfa4075740 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80af000 tx=0x7fcfb801a370 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe269f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56328fcc5cd0 con 0x56328f9d5aa0 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56328fbdb330 con 0x56328f911890 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56328fc38bb0 con 0x56328fcba6d0 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33310/0 (socket says 172.21.15.64:33310) 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 -- 172.21.15.64:0/1801537522 learned_addr learned my addr 172.21.15.64:0/1801537522 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9200640 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 -- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 msgr2=0x56328fe269f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe269f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 -- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 msgr2=0x56328fe26f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe26f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 -- 172.21.15.64:0/1801537522 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328fbdcc80 con 0x56328f9d5aa0 2024-09-21T07:36:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4072b60 tx=0x7fcfbc0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f53d86cf624fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfb5600640 1 -- 172.21.15.64:0/1801537522 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc0127c0 con 0x56328f9d5aa0 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfb5600640 1 -- 172.21.15.64:0/1801537522 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfbc016070 con 0x56328f9d5aa0 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.548+0000 7fcfb5600640 1 -- 172.21.15.64:0/1801537522 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc012c50 con 0x56328f9d5aa0 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- 172.21.15.64:0/1801537522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 msgr2=0x56328fe27470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4072b60 tx=0x7fcfbc0049e0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- 172.21.15.64:0/1801537522 shutdown_connections 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe27470 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe26f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/1801537522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe269f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- 172.21.15.64:0/1801537522 >> 172.21.15.64:0/1801537522 conn(0x56328f8e55c0 msgr2=0x56328fde3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- 172.21.15.64:0/1801537522 shutdown_connections 2024-09-21T07:36:09.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- 172.21.15.64:0/1801537522 wait complete. 2024-09-21T07:36:09.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- start start 2024-09-21T07:36:09.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 Processor -- start 2024-09-21T07:36:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fde2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fde95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56328fc2bdf0 con 0x56328f911890 2024-09-21T07:36:09.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56328fc27fe0 con 0x56328fcba6d0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56328fbcd4d0 con 0x56328f9d5aa0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfd32d5000 10 client.0 _ll_register_callbacks cb 0x56328fbab7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33316/0 (socket says 172.21.15.64:33316) 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 -- 172.21.15.64:0/4154054949 learned_addr learned my addr 172.21.15.64:0/4154054949 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fde95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fde2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 -- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 msgr2=0x56328fde2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fde2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 -- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 msgr2=0x56328fde95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fde95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9200640 1 -- 172.21.15.64:0/4154054949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328fbc6210 con 0x56328f911890 2024-09-21T07:36:09.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.552+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fde95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfc9200640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009eb0 tx=0x7fcfb8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7c764898824b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80d0060 con 0x56328f911890 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56328fbc0350 con 0x56328f911890 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fcfb80ab980 con 0x56328f911890 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fcfb80d6050 con 0x56328f911890 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 10 client.10710 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:09.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x56328fbacfc0 con 0x56328f911890 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56328fbc0350 con 0x56328f911890 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fcfb80d9020 con 0x56328f911890 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 10 client.10710 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 10 client.10710 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 20 client.10710 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8ca930 0x56328fe2de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 4 client.10710 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56328fc3ab00 con 0x56328f8ca930 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8ca930 0x56328fe2de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8ca930 0x56328fe2de80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb63912bfe4bdd7 server_cookie=f4873ae1623c36a5 in_seq=0 out_seq=0 2024-09-21T07:36:09.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 10 client.10710 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 1 -- 172.21.15.64:0/4154054949 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56328fc3ab00 con 0x56328f8ca930 2024-09-21T07:36:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 10 client.10710 handle_command_reply: tid=0 2024-09-21T07:36:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 client.10710 shutdown 2024-09-21T07:36:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 msgr2=0x56328fde2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009eb0 tx=0x7fcfb8009500 comp rx=0 tx=0).stop 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 shutdown_connections 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8ca930 0x56328fe2de80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fde95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fde2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfaa000640 0 client.10710 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/4154054949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fde2a00 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 >> 172.21.15.64:0/4154054949 conn(0x56328f8e55c0 msgr2=0x56328fddbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 shutdown_connections 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 1 -- 172.21.15.64:0/4154054949 wait complete. 2024-09-21T07:36:09.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.556+0000 7fcfd32d5000 20 client.10710 trim_cache size 0 max 16384 2024-09-21T07:36:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 Processor -- start 2024-09-21T07:36:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 -- start start 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe97de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe98860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56328fde1b20 con 0x56328f9d5aa0 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4206210 con 0x56328f911890 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc4205270 con 0x56328fcba6d0 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfc3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33320/0 (socket says 172.21.15.64:33320) 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.576+0000 7fcfc3e00640 1 -- 172.21.15.64:0/2093671163 learned_addr learned my addr 172.21.15.64:0/2093671163 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe98860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc9200640 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe97de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 -- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 msgr2=0x56328fe98860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe98860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 -- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 msgr2=0x56328fe97de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe97de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 -- 172.21.15.64:0/2093671163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328fc85680 con 0x56328f9d5aa0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fcfb005eea0 tx=0x7fcfb005b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cfafcb14fe09b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfb4c00640 1 -- 172.21.15.64:0/2093671163 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb001f040 con 0x56328f9d5aa0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfb4c00640 1 -- 172.21.15.64:0/2093671163 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb0068880 con 0x56328f9d5aa0 2024-09-21T07:36:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfb4c00640 1 -- 172.21.15.64:0/2093671163 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb005b180 con 0x56328f9d5aa0 2024-09-21T07:36:09.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2093671163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 msgr2=0x56328fe98320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fcfb005eea0 tx=0x7fcfb005b560 comp rx=0 tx=0).stop 2024-09-21T07:36:09.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2093671163 shutdown_connections 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328fcba6d0 0x56328fe98860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f9d5aa0 0x56328fe98320 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2093671163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328f911890 0x56328fe97de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2093671163 >> 172.21.15.64:0/2093671163 conn(0x56328f8e55c0 msgr2=0x56328fe37d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2093671163 shutdown_connections 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2093671163 wait complete. 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 -- start start 2024-09-21T07:36:09.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.580+0000 7fcfd32d5000 1 Processor -- start 2024-09-21T07:36:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fe573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fe578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4204c50 con 0x56328f911890 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4204730 con 0x56328fcba6d0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56328f8ed680 con 0x56328f9d5aa0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 10 client.0 _ll_register_callbacks cb 0x7fcfac0046f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33332/0 (socket says 172.21.15.64:33332) 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 -- 172.21.15.64:0/2957957696 learned_addr learned my addr 172.21.15.64:0/2957957696 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9c00640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fe578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fe573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 -- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 msgr2=0x56328fe573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fe573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 -- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 msgr2=0x56328fe578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fe578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 -- 172.21.15.64:0/2957957696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328fbf20b0 con 0x56328f911890 2024-09-21T07:36:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc9200640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000f90 tx=0x7fcfb80b6880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5881c97a7f9f4e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80c6020 con 0x56328f911890 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fcfb80ab980 con 0x56328f911890 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb0068880 con 0x56328f911890 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fcfb80d0020 con 0x56328f911890 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 10 client.10716 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x56328fbbe610 con 0x56328f911890 2024-09-21T07:36:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb0068880 con 0x56328f911890 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fcfb80d9050 con 0x56328f911890 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 10 client.10716 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 10 client.10716 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 20 client.10716 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8b8990 0x56328fe57e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 4 client.10716 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56328fc365b0 con 0x56328f8b8990 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8b8990 0x56328fe57e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfc3e00640 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8b8990 0x56328fe57e30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121c4db8b7f476b5 server_cookie=9619718368738005 in_seq=0 out_seq=0 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 10 client.10716 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 1 -- 172.21.15.64:0/2957957696 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+574 (crc 0 0 0) 0x56328fc365b0 con 0x56328f8b8990 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 10 client.10716 handle_command_reply: tid=0 2024-09-21T07:36:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 client.10716 shutdown 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 msgr2=0x56328fe98350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000f90 tx=0x7fcfb80b6880 comp rx=0 tx=0).stop 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 shutdown_connections 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x56328f8b8990 0x56328fe57e30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56328fcba6d0 0x56328fe578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56328f9d5aa0 0x56328fe573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 --2- 172.21.15.64:0/2957957696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56328f911890 0x56328fe98350 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 >> 172.21.15.64:0/2957957696 conn(0x56328f8e55c0 msgr2=0x56328fde85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfaa000640 0 client.10716 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 shutdown_connections 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 1 -- 172.21.15.64:0/2957957696 wait complete. 2024-09-21T07:36:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.584+0000 7fcfd32d5000 20 client.10716 trim_cache size 0 max 16384 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "95823c54-ae17-44e0-8491-69cc48033b24": { 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mds0", 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "95823c54-ae17-44e0-8491-69cc48033b24", 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive" 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "95823c54-ae17-44e0-8491-69cc48033b24": { 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:36:09.356709+0000", 2024-09-21T07:36:09.592 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mdsdir", 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:09.593 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 msgr2=0x7fcfa4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 0x7fcfa4075740 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80af000 tx=0x7fcfb801a370 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 msgr2=0x7fcfc40c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0000fe0 tx=0x7fcfb000ea20 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 shutdown_connections 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcfa4073230 0x7fcfa4075740 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfc41f8da0 0x7fcfc41f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfc41f99e0 0x7fcfc40c9e70 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 --2- 172.21.15.64:0/3434812472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfac003ab0 0x7fcfc40c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:09.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 >> 172.21.15.64:0/3434812472 conn(0x7fcfc40ccbe0 msgr2=0x7fcfc415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:09.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 shutdown_connections 2024-09-21T07:36:09.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:09.588+0000 7fcfcbc00640 1 -- 172.21.15.64:0/3434812472 wait complete. 2024-09-21T07:36:09.609 INFO:tasks.cephfs.filesystem:scrub status for tag:95823c54-ae17-44e0-8491-69cc48033b24 - {'path': '~mds0', 'tag': '95823c54-ae17-44e0-8491-69cc48033b24', 'options': 'recursive'} 2024-09-21T07:36:10.575 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:36:10.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:36:39.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:39.610 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-21T07:36:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- 172.21.15.64:0/2189953847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb40b22f0 msgr2=0x7f4fb415d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 --2- 172.21.15.64:0/2189953847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb40b22f0 0x7f4fb415d0b0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009bc0 tx=0x7f4fac01cb10 comp rx=0 tx=0).stop 2024-09-21T07:36:39.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- 172.21.15.64:0/2189953847 shutdown_connections 2024-09-21T07:36:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 --2- 172.21.15.64:0/2189953847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb40b22f0 0x7f4fb415d0b0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 --2- 172.21.15.64:0/2189953847 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb4159db0 0x7f4fb415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- 172.21.15.64:0/2189953847 >> 172.21.15.64:0/2189953847 conn(0x7f4fb40ccbe0 msgr2=0x7f4fb40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- 172.21.15.64:0/2189953847 shutdown_connections 2024-09-21T07:36:39.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- 172.21.15.64:0/2189953847 wait complete. 2024-09-21T07:36:39.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 Processor -- start 2024-09-21T07:36:39.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.784+0000 7f4fbb800640 1 -- start start 2024-09-21T07:36:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb4159db0 0x7f4fb40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb41532d0 0x7f4fb41fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb406f5e0 con 0x7f4fb415cca0 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb406f460 con 0x7f4fb4159db0 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb406f760 con 0x7f4fb41532d0 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45792/0 (socket says 172.21.15.64:45792) 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 -- 172.21.15.64:0/1906689610 learned_addr learned my addr 172.21.15.64:0/1906689610 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb4159db0 0x7f4fb40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb9800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb41532d0 0x7f4fb41fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 -- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb41532d0 msgr2=0x7f4fb41fbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb41532d0 0x7f4fb41fbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 -- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb4159db0 msgr2=0x7f4fb40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb4159db0 0x7f4fb40b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 -- 172.21.15.64:0/1906689610 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb415b5e0 con 0x7f4fb415cca0 2024-09-21T07:36:39.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c400 tx=0x7f4fa000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb0c00640 1 -- 172.21.15.64:0/1906689610 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0011790 con 0x7f4fb415cca0 2024-09-21T07:36:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb0c00640 1 -- 172.21.15.64:0/1906689610 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa0017070 con 0x7f4fb415cca0 2024-09-21T07:36:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb40c3ee0 con 0x7f4fb415cca0 2024-09-21T07:36:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fb0c00640 1 -- 172.21.15.64:0/1906689610 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0011cc0 con 0x7f4fb415cca0 2024-09-21T07:36:39.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.788+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb40c44a0 con 0x7f4fb415cca0 2024-09-21T07:36:39.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fb0c00640 1 -- 172.21.15.64:0/1906689610 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4fa001c460 con 0x7f4fb415cca0 2024-09-21T07:36:39.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fb0c00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 0x7f4f94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fb0c00640 1 -- 172.21.15.64:0/1906689610 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f4fa00940b0 con 0x7f4fb415cca0 2024-09-21T07:36:39.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 0x7f4f94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fc2eed000 1 Processor -- start 2024-09-21T07:36:39.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fc2eed000 1 -- start start 2024-09-21T07:36:39.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.792+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 0x7f4f94075710 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009b40 tx=0x7f4fa80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b17ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b180470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564c1b01ecd0 con 0x564c1b0136d0 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564c1af34330 con 0x564c1ac6a890 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564c1af91bb0 con 0x564c1ad2eaa0 2024-09-21T07:36:39.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45800/0 (socket says 172.21.15.64:45800) 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 -- 172.21.15.64:0/928850567 learned_addr learned my addr 172.21.15.64:0/928850567 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb9800640 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b180470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b17ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 -- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 msgr2=0x564c1b180470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b180470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 -- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 msgr2=0x564c1b17ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b17ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 -- 172.21.15.64:0/928850567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1af35c80 con 0x564c1b0136d0 2024-09-21T07:36:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80058d0 tx=0x7f4fa8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb745607f7d2ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fa5600640 1 -- 172.21.15.64:0/928850567 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8003d80 con 0x564c1b0136d0 2024-09-21T07:36:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fa5600640 1 -- 172.21.15.64:0/928850567 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa8005020 con 0x564c1b0136d0 2024-09-21T07:36:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fa5600640 1 -- 172.21.15.64:0/928850567 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8005430 con 0x564c1b0136d0 2024-09-21T07:36:39.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- 172.21.15.64:0/928850567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 msgr2=0x564c1b17f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80058d0 tx=0x7f4fa8014000 comp rx=0 tx=0).stop 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- 172.21.15.64:0/928850567 shutdown_connections 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b180470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b17ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/928850567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b17f9f0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- 172.21.15.64:0/928850567 >> 172.21.15.64:0/928850567 conn(0x564c1ac3e5c0 msgr2=0x564c1b13cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- 172.21.15.64:0/928850567 shutdown_connections 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- 172.21.15.64:0/928850567 wait complete. 2024-09-21T07:36:39.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 -- start start 2024-09-21T07:36:39.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.796+0000 7f4fc2eed000 1 Processor -- start 2024-09-21T07:36:39.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b13ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564c1af84df0 con 0x564c1b0136d0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564c1af80fe0 con 0x564c1ac6a890 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564c1af264d0 con 0x564c1ad2eaa0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 10 client.0 _ll_register_callbacks cb 0x564c1af047f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b13ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:37060/0 (socket says 172.21.15.64:37060) 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 -- 172.21.15.64:0/271023422 learned_addr learned my addr 172.21.15.64:0/271023422 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb9800640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1425f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45808/0 (socket says 172.21.15.64:45808) 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 -- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 msgr2=0x564c1b13ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b13ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 -- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 msgr2=0x564c1b1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 -- 172.21.15.64:0/271023422 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x564c1af1f210 con 0x564c1ad2eaa0 2024-09-21T07:36:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0092360 tx=0x7f4fa005e310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da2ad174f9b7c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa005dcf0 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c1af19350 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f4fa005fb10 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f4fa0068170 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 10 client.8924 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x564c1af05fc0 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564c1af19350 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f4fa005a1e0 con 0x564c1ad2eaa0 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 10 client.8924 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 10 client.8924 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:39.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 20 client.8924 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac23930 0x564c1b186e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 4 client.8924 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c1af93b00 con 0x564c1ac23930 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.800+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac23930 0x564c1b186e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4f9a000640 10 client.8924 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac23930 0x564c1b186e80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4caa3032bfdd1b55 server_cookie=cfe1f8c639a2a0f5 in_seq=0 out_seq=0 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4f9a000640 1 -- 172.21.15.64:0/271023422 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c1af93b00 con 0x564c1ac23930 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4f9a000640 10 client.8924 handle_command_reply: tid=0 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 client.8924 shutdown 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 msgr2=0x564c1b13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0092360 tx=0x7f4fa005e310 comp rx=0 tx=0).stop 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 shutdown_connections 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac23930 0x564c1b186e80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.807 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4f9a000640 0 client.8924 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ad2eaa0 0x564c1b13bf40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/271023422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ac6a890 0x564c1b13ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 >> 172.21.15.64:0/271023422 conn(0x564c1ac3e5c0 msgr2=0x564c1b134d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 shutdown_connections 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 1 -- 172.21.15.64:0/271023422 wait complete. 2024-09-21T07:36:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.804+0000 7f4fc2eed000 20 client.8924 trim_cache size 0 max 16384 2024-09-21T07:36:39.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 Processor -- start 2024-09-21T07:36:39.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- start start 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1b0136d0 0x564c1b1f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564c1b13ab20 con 0x564c1ac6a890 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb4205a10 con 0x564c1ad2eaa0 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb4204ab0 con 0x564c1b0136d0 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45820/0 (socket says 172.21.15.64:45820) 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 -- 172.21.15.64:0/3273271774 learned_addr learned my addr 172.21.15.64:0/3273271774 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb9800640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1b0136d0 0x564c1b1f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 -- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1b0136d0 msgr2=0x564c1b1f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1b0136d0 0x564c1b1f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 -- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 msgr2=0x564c1b1f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 -- 172.21.15.64:0/3273271774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1afde680 con 0x564c1ac6a890 2024-09-21T07:36:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8022000 tx=0x7f4fa8011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c206b38d03d46545 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fa4c00640 1 -- 172.21.15.64:0/3273271774 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8005220 con 0x564c1ac6a890 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fa4c00640 1 -- 172.21.15.64:0/3273271774 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa80053c0 con 0x564c1ac6a890 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fa4c00640 1 -- 172.21.15.64:0/3273271774 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80047b0 con 0x564c1ac6a890 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- 172.21.15.64:0/3273271774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 msgr2=0x564c1b1f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8022000 tx=0x7f4fa8011f90 comp rx=0 tx=0).stop 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- 172.21.15.64:0/3273271774 shutdown_connections 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1b0136d0 0x564c1b1f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/3273271774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1ac6a890 0x564c1b1f1400 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- 172.21.15.64:0/3273271774 >> 172.21.15.64:0/3273271774 conn(0x564c1ac3e5c0 msgr2=0x564c1b191fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- 172.21.15.64:0/3273271774 shutdown_connections 2024-09-21T07:36:39.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.824+0000 7f4fc2eed000 1 -- 172.21.15.64:0/3273271774 wait complete. 2024-09-21T07:36:39.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- start start 2024-09-21T07:36:39.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 Processor -- start 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ac6a890 0x564c1b1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb4204460 con 0x564c1b0136d0 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb40c5780 con 0x564c1ad2eaa0 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564c1ac46680 con 0x564c1ac6a890 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 10 client.0 _ll_register_callbacks cb 0x7f4fa005e0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:39.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45832/0 (socket says 172.21.15.64:45832) 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 -- 172.21.15.64:0/4062064226 learned_addr learned my addr 172.21.15.64:0/4062064226 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb3e00640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ac6a890 0x564c1b1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 -- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ac6a890 msgr2=0x564c1b1f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ac6a890 0x564c1b1f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 -- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 msgr2=0x564c1b1f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 -- 172.21.15.64:0/4062064226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1af4b0b0 con 0x564c1b0136d0 2024-09-21T07:36:39.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fb9800640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f4fac01a740 tx=0x7f4fac009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e77c4d97a241 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:39.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4f9a000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:39.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0b2040 con 0x564c1b0136d0 2024-09-21T07:36:39.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f4fac003b80 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa80053c0 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f4fac0c8050 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 10 client.10734 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.828+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x564c1af17610 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa80053c0 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f4fac0cb020 con 0x564c1b0136d0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 10 client.10734 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 10 client.10734 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 20 client.10734 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac11990 0x564c1b136c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 4 client.10734 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c1af8f5b0 con 0x564c1ac11990 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac11990 0x564c1b136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:39.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 10 client.10734 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fb8e00640 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac11990 0x564c1b136c50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a20e7946404093a7 server_cookie=dfe5106f6fa344e1 in_seq=0 out_seq=0 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 1 -- 172.21.15.64:0/4062064226 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x564c1af8f5b0 con 0x564c1ac11990 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 10 client.10734 handle_command_reply: tid=0 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 client.10734 shutdown 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 msgr2=0x564c1b1f5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f4fac01a740 tx=0x7f4fac009200 comp rx=0 tx=0).stop 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 shutdown_connections 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x564c1ac11990 0x564c1b136c50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c1b0136d0 0x564c1b1f5ec0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564c1ad2eaa0 0x564c1b1f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 --2- 172.21.15.64:0/4062064226 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564c1ac6a890 0x564c1b1f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4f9a000640 0 client.10734 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 >> 172.21.15.64:0/4062064226 conn(0x564c1ac3e5c0 msgr2=0x564c1b1415a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 shutdown_connections 2024-09-21T07:36:39.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 1 -- 172.21.15.64:0/4062064226 wait complete. 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fc2eed000 20 client.10734 trim_cache size 0 max 16384 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "95823c54-ae17-44e0-8491-69cc48033b24": { 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:36:09.356709+0000", 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "~mdsdir", 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:36:39.837 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:36:39.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 msgr2=0x7f4f94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 0x7f4f94075710 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009b40 tx=0x7f4fa80091e0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 msgr2=0x7f4fb40b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c400 tx=0x7f4fa000c8c0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 shutdown_connections 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4f94073200 0x7f4f94075710 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4fb41532d0 0x7f4fb41fbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fb415cca0 0x7f4fb40b1150 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 --2- 172.21.15.64:0/1906689610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fb4159db0 0x7f4fb40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 >> 172.21.15.64:0/1906689610 conn(0x7f4fb40ccbe0 msgr2=0x7f4fb4159510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 shutdown_connections 2024-09-21T07:36:39.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:39.832+0000 7f4fbb800640 1 -- 172.21.15.64:0/1906689610 wait complete. 2024-09-21T07:36:39.855 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:36:39.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-21T07:36:40.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 -- 172.21.15.64:0/403378431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680ceaa0 msgr2=0x7f5d680ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 --2- 172.21.15.64:0/403378431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680ceaa0 0x7f5d680ceeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009870 tx=0x7f5d5801c740 comp rx=0 tx=0).stop 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 -- 172.21.15.64:0/403378431 shutdown_connections 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 --2- 172.21.15.64:0/403378431 >> v2:172.21.15.90:3300/0 conn(0x7f5d680b2b50 0x7f5d68167210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 --2- 172.21.15.64:0/403378431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680ceaa0 0x7f5d680ceeb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 -- 172.21.15.64:0/403378431 >> 172.21.15.64:0/403378431 conn(0x7f5d6808bf80 msgr2=0x7f5d680d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 -- 172.21.15.64:0/403378431 shutdown_connections 2024-09-21T07:36:40.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.012+0000 7f5d6da00640 1 -- 172.21.15.64:0/403378431 wait complete. 2024-09-21T07:36:40.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 Processor -- start 2024-09-21T07:36:40.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 -- start start 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680b2b50 0x7f5d6814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d680cfec0 0x7f5d681f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6816a0f0 con 0x7f5d680ceaa0 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68169f70 con 0x7f5d680cfec0 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6da00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6816a270 con 0x7f5d680b2b50 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45834/0 (socket says 172.21.15.64:45834) 2024-09-21T07:36:40.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1501547649 learned_addr learned my addr 172.21.15.64:0/1501547649 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680b2b50 0x7f5d6814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d6d000640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d680cfec0 0x7f5d681f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680b2b50 msgr2=0x7f5d6814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680b2b50 0x7f5d6814e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d680cfec0 msgr2=0x7f5d681f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d680cfec0 0x7f5d681f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1501547649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6814edf0 con 0x7f5d680ceaa0 2024-09-21T07:36:40.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.016+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000c500 tx=0x7f5d5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d64c00640 1 -- 172.21.15.64:0/1501547649 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50016020 con 0x7f5d680ceaa0 2024-09-21T07:36:40.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d64c00640 1 -- 172.21.15.64:0/1501547649 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d50012940 con 0x7f5d680ceaa0 2024-09-21T07:36:40.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6814f0d0 con 0x7f5d680ceaa0 2024-09-21T07:36:40.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d64c00640 1 -- 172.21.15.64:0/1501547649 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50012d90 con 0x7f5d680ceaa0 2024-09-21T07:36:40.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6814f690 con 0x7f5d680ceaa0 2024-09-21T07:36:40.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.020+0000 7f5d64c00640 1 -- 172.21.15.64:0/1501547649 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5d50019020 con 0x7f5d680ceaa0 2024-09-21T07:36:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d64c00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 0x7f5d44075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d64c00640 1 -- 172.21.15.64:0/1501547649 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f5d50094380 con 0x7f5d680ceaa0 2024-09-21T07:36:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 Processor -- start 2024-09-21T07:36:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 0x7f5d44075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 -- start start 2024-09-21T07:36:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 0x7f5d44075740 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5d580af000 tx=0x7f5d5801af80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f95ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f963e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563546e33d50 con 0x563546e23320 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563546da7b10 con 0x563546e1c5a0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563546d96f40 con 0x563546e1cdb0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45838/0 (socket says 172.21.15.64:45838) 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 -- 172.21.15.64:0/633986329 learned_addr learned my addr 172.21.15.64:0/633986329 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d6d000640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f95ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 -- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 msgr2=0x563546f963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 -- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 msgr2=0x563546f95ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f95ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 -- 172.21.15.64:0/633986329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563546d18120 con 0x563546e23320 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f95ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d67e00640 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f5d58000c10 tx=0x7f5d580b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29da8dbaefb45749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d5cc00640 1 -- 172.21.15.64:0/633986329 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58004d20 con 0x563546e23320 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d5cc00640 1 -- 172.21.15.64:0/633986329 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d580c5070 con 0x563546e23320 2024-09-21T07:36:40.029 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.024+0000 7f5d5cc00640 1 -- 172.21.15.64:0/633986329 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580a9760 con 0x563546e23320 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- 172.21.15.64:0/633986329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 msgr2=0x563546f95960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f5d58000c10 tx=0x7f5d580b8000 comp rx=0 tx=0).stop 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- 172.21.15.64:0/633986329 shutdown_connections 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f95ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- 172.21.15.64:0/633986329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f95960 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- 172.21.15.64:0/633986329 >> 172.21.15.64:0/633986329 conn(0x563546a54920 msgr2=0x563546f78e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- 172.21.15.64:0/633986329 shutdown_connections 2024-09-21T07:36:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- 172.21.15.64:0/633986329 wait complete. 2024-09-21T07:36:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- start start 2024-09-21T07:36:40.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 Processor -- start 2024-09-21T07:36:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f77f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f78490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563546d3c500 con 0x563546e23320 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563546d9ad50 con 0x563546e1c5a0 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563546a5c680 con 0x563546e1cdb0 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d766b2000 10 client.0 _ll_register_callbacks cb 0x563546f37100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d6d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d6d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45842/0 (socket says 172.21.15.64:45842) 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d6d000640 1 -- 172.21.15.64:0/3924240101 learned_addr learned my addr 172.21.15.64:0/3924240101 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.028+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f78490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 -- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 msgr2=0x563546f78490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f78490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 -- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 msgr2=0x563546f77f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f77f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 -- 172.21.15.64:0/3924240101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563546d4bc60 con 0x563546e23320 2024-09-21T07:36:40.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d6d000640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f5d600119b0 tx=0x7f5d60011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6088eb45f821387 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:40.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60003c50 con 0x563546e23320 2024-09-21T07:36:40.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f5d60003df0 con 0x563546e23320 2024-09-21T07:36:40.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563546d2f330 con 0x563546e23320 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f5d60004b30 con 0x563546e23320 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 10 client.10746 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x563546d95be0 con 0x563546e23320 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563546d2f330 con 0x563546e23320 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f5d60026080 con 0x563546e23320 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 10 client.10746 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 10 client.10746 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 20 client.10746 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a39930 0x563546fa6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 4 client.10746 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563546da9a60 con 0x563546a39930 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d67e00640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a39930 0x563546fa6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 10 client.10746 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d67e00640 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a39930 0x563546fa6f20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2806d9e713ae1ab server_cookie=4cadcceb9a1b13d3 in_seq=0 out_seq=0 2024-09-21T07:36:40.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 1 -- 172.21.15.64:0/3924240101 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563546da9a60 con 0x563546a39930 2024-09-21T07:36:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 10 client.10746 handle_command_reply: tid=0 2024-09-21T07:36:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 client.10746 shutdown 2024-09-21T07:36:40.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 msgr2=0x563546f789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f5d600119b0 tx=0x7f5d60011e70 comp rx=0 tx=0).stop 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 shutdown_connections 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a39930 0x563546fa6f20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e23320 0x563546f789d0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546f78490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 --2- 172.21.15.64:0/3924240101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546f77f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 >> 172.21.15.64:0/3924240101 conn(0x563546a54920 msgr2=0x563546f497e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d55600640 0 client.10746 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 shutdown_connections 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 1 -- 172.21.15.64:0/3924240101 wait complete. 2024-09-21T07:36:40.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.032+0000 7f5d766b2000 20 client.10746 trim_cache size 0 max 16384 2024-09-21T07:36:40.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 Processor -- start 2024-09-21T07:36:40.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 -- start start 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546a54920 0x563546f508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546faa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563546f4f300 con 0x563546e1c5a0 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68203a40 con 0x563546a54920 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5d68202ad0 con 0x563546e1cdb0 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45854/0 (socket says 172.21.15.64:45854) 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1759886200 learned_addr learned my addr 172.21.15.64:0/1759886200 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d6d000640 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546faa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.048+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546a54920 0x563546f508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 msgr2=0x563546faa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546faa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546a54920 msgr2=0x563546f508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546a54920 0x563546f508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 -- 172.21.15.64:0/1759886200 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563546d351f0 con 0x563546e1c5a0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5d50015040 tx=0x7f5d50092590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa94f960aac0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d57e00640 1 -- 172.21.15.64:0/1759886200 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d500635a0 con 0x563546e1c5a0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d57e00640 1 -- 172.21.15.64:0/1759886200 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d50092740 con 0x563546e1c5a0 2024-09-21T07:36:40.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d57e00640 1 -- 172.21.15.64:0/1759886200 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5005ade0 con 0x563546e1c5a0 2024-09-21T07:36:40.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- 172.21.15.64:0/1759886200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 msgr2=0x563546f50e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5d50015040 tx=0x7f5d50092590 comp rx=0 tx=0).stop 2024-09-21T07:36:40.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- 172.21.15.64:0/1759886200 shutdown_connections 2024-09-21T07:36:40.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546faa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546e1c5a0 0x563546f50e30 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1759886200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546a54920 0x563546f508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- 172.21.15.64:0/1759886200 >> 172.21.15.64:0/1759886200 conn(0x563546fa2800 msgr2=0x563546f501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- 172.21.15.64:0/1759886200 shutdown_connections 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- 172.21.15.64:0/1759886200 wait complete. 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 -- start start 2024-09-21T07:36:40.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.052+0000 7f5d766b2000 1 Processor -- start 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546faa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546fcb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563546e57010 con 0x563546a54920 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563546d9a060 con 0x563546e1c5a0 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x563546d628b0 con 0x563546e1cdb0 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 10 client.0 _ll_register_callbacks cb 0x7f5d600093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45868/0 (socket says 172.21.15.64:45868) 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 -- 172.21.15.64:0/1811430063 learned_addr learned my addr 172.21.15.64:0/1811430063 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546faa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d6d000640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546fcb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 -- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 msgr2=0x563546fcb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546fcb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 -- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 msgr2=0x563546faa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546faa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 -- 172.21.15.64:0/1811430063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563546d5d990 con 0x563546a54920 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d67e00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f5d58005ec0 tx=0x7f5d58009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221af7caa898e651 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58004e80 con 0x563546a54920 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f5d58004040 con 0x563546a54920 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d50092740 con 0x563546a54920 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f5d58004240 con 0x563546a54920 2024-09-21T07:36:40.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 10 client.10752 fetch_fsmap learned FSMap version 144 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x563546d2d580 con 0x563546a54920 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d50092740 con 0x563546a54920 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f5d58003600 con 0x563546a54920 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 10 client.10752 fetch_fsmap finished waiting for FSMap version 144 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 10 client.10752 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 20 client.10752 populate_metadata read hostname 'smithi064' 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a52fe0 0x563546fcc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 4 client.10752 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 --> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563546da5510 con 0x563546a52fe0 2024-09-21T07:36:40.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a52fe0 0x563546fcc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 10 client.10752 ms_handle_connect on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:40.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d5fe00640 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a52fe0 0x563546fcc210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c758e1081adb8148 server_cookie=cb92909ed864998 in_seq=0 out_seq=0 2024-09-21T07:36:40.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 1 -- 172.21.15.64:0/1811430063 <== mds.0 v2:172.21.15.64:6834/39075560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563546da5510 con 0x563546a52fe0 2024-09-21T07:36:40.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 10 client.10752 handle_command_reply: tid=0 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 client.10752 shutdown 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 msgr2=0x563546fa9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f5d58005ec0 tx=0x7f5d58009530 comp rx=0 tx=0).stop 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 shutdown_connections 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:6834/39075560,v1:172.21.15.64:6835/39075560] conn(0x563546a52fe0 0x563546fcc210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563546e1cdb0 0x563546fcb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563546e1c5a0 0x563546faa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d55600640 0 client.10752 ms_handle_reset on v2:172.21.15.64:6834/39075560 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 --2- 172.21.15.64:0/1811430063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563546a54920 0x563546fa9f20 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 >> 172.21.15.64:0/1811430063 conn(0x563546fa2800 msgr2=0x563546f50ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 shutdown_connections 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 1 -- 172.21.15.64:0/1811430063 wait complete. 2024-09-21T07:36:40.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.056+0000 7f5d766b2000 20 client.10752 trim_cache size 0 max 16384 2024-09-21T07:36:40.064 INFO:teuthology.orchestra.run.smithi064.stdout:[] 2024-09-21T07:36:40.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 msgr2=0x7f5d44075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 0x7f5d44075740 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5d580af000 tx=0x7f5d5801af80 comp rx=0 tx=0).stop 2024-09-21T07:36:40.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 msgr2=0x7f5d680cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000c500 tx=0x7f5d5000c9c0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 shutdown_connections 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5d44073230 0x7f5d44075740 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d680cfec0 0x7f5d681f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d680ceaa0 0x7f5d680cbda0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 --2- 172.21.15.64:0/1501547649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d680b2b50 0x7f5d6814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 >> 172.21.15.64:0/1501547649 conn(0x7f5d6808bf80 msgr2=0x7f5d680b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 shutdown_connections 2024-09-21T07:36:40.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.060+0000 7f5d6da00640 1 -- 172.21.15.64:0/1501547649 wait complete. 2024-09-21T07:36:40.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- 172.21.15.64:0/3429287946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740b24e0 msgr2=0x7f0d740ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 --2- 172.21.15.64:0/3429287946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740b24e0 0x7f0d740ca7b0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ce390 tx=0x7f0d6401c8c0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- 172.21.15.64:0/3429287946 shutdown_connections 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 --2- 172.21.15.64:0/3429287946 >> v2:172.21.15.90:3300/0 conn(0x7f0d7415e9b0 0x7f0d7415edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 --2- 172.21.15.64:0/3429287946 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d740cacf0 0x7f0d740cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 --2- 172.21.15.64:0/3429287946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740b24e0 0x7f0d740ca7b0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- 172.21.15.64:0/3429287946 >> 172.21.15.64:0/3429287946 conn(0x7f0d740ccbe0 msgr2=0x7f0d740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- 172.21.15.64:0/3429287946 shutdown_connections 2024-09-21T07:36:40.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- 172.21.15.64:0/3429287946 wait complete. 2024-09-21T07:36:40.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 Processor -- start 2024-09-21T07:36:40.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.236+0000 7f0d7b000640 1 -- start start 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d740b24e0 0x7f0d741fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 0x7f0d74153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740b3860 con 0x7f0d740cacf0 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740b36e0 con 0x7f0d740b24e0 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0d740b39e0 con 0x7f0d7415e9b0 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45884/0 (socket says 172.21.15.64:45884) 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 -- 172.21.15.64:0/1773097939 learned_addr learned my addr 172.21.15.64:0/1773097939 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d79000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 0x7f0d74153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d73e00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d740b24e0 0x7f0d741fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 -- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 msgr2=0x7f0d74153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 0x7f0d74153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 -- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d740b24e0 msgr2=0x7f0d741fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d740b24e0 0x7f0d741fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 -- 172.21.15.64:0/1773097939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7415c5e0 con 0x7f0d740cacf0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d79000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 0x7f0d74153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d6be00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0d740cef00 tx=0x7f0d5c00da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0098d0 con 0x7f0d740cacf0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d5c009b60 con 0x7f0d740cacf0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7415d7c0 con 0x7f0d740cacf0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c010460 con 0x7f0d740cacf0 2024-09-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7409c9b0 con 0x7f0d740cacf0 2024-09-21T07:36:40.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.240+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d741fac90 con 0x7f0d740cacf0 2024-09-21T07:36:40.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.244+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0d5c010600 con 0x7f0d740cacf0 2024-09-21T07:36:40.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.244+0000 7f0d70c00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 0x7f0d50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.244+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f0d5c094720 con 0x7f0d740cacf0 2024-09-21T07:36:40.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.244+0000 7f0d73e00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 0x7f0d50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.244+0000 7f0d73e00640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 0x7f0d50075710 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0d640af000 tx=0x7f0d6401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.248+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0d5c05ef90 con 0x7f0d740cacf0 2024-09-21T07:36:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.460+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d740cb100 con 0x7f0d740cacf0 2024-09-21T07:36:40.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d70c00640 1 -- 172.21.15.64:0/1773097939 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0d5c0639c0 con 0x7f0d740cacf0 2024-09-21T07:36:40.465 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:40.465 INFO:teuthology.orchestra.run.smithi064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:36:40.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 msgr2=0x7f0d50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 0x7f0d50075710 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0d640af000 tx=0x7f0d6401b100 comp rx=0 tx=0).stop 2024-09-21T07:36:40.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 msgr2=0x7f0d741fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0d740cef00 tx=0x7f0d5c00da70 comp rx=0 tx=0).stop 2024-09-21T07:36:40.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 shutdown_connections 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0d50073200 0x7f0d50075710 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d7415e9b0 0x7f0d74153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d740cacf0 0x7f0d741fa670 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 --2- 172.21.15.64:0/1773097939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d740b24e0 0x7f0d741fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 >> 172.21.15.64:0/1773097939 conn(0x7f0d740ccbe0 msgr2=0x7f0d740afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 shutdown_connections 2024-09-21T07:36:40.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.464+0000 7f0d7b000640 1 -- 172.21.15.64:0/1773097939 wait complete. 2024-09-21T07:36:40.488 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:36:40.488 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:36:40.571 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:36:40.632 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:36:40.634 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:36:40.652 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:36:40.652 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:36:40.652 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:40.652 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:40.684 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:40.684 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:40.736 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 -- 172.21.15.64:0/1777867282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940d0e60 msgr2=0x7f3b940b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 --2- 172.21.15.64:0/1777867282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940d0e60 0x7f3b940b4de0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f3b88005fd0 tx=0x7f3b8801c7c0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 -- 172.21.15.64:0/1777867282 shutdown_connections 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 --2- 172.21.15.64:0/1777867282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 --2- 172.21.15.64:0/1777867282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b940d0e60 0x7f3b940b4de0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 -- 172.21.15.64:0/1777867282 >> 172.21.15.64:0/1777867282 conn(0x7f3b9406d450 msgr2=0x7f3b940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 -- 172.21.15.64:0/1777867282 shutdown_connections 2024-09-21T07:36:40.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.940+0000 7f3b9c000640 1 -- 172.21.15.64:0/1777867282 wait complete. 2024-09-21T07:36:40.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 Processor -- start 2024-09-21T07:36:40.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 -- start start 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 0x7f3b9415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94169dc0 con 0x7f3b9406ee80 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94169c40 con 0x7f3b940d0e60 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3b94169f40 con 0x7f3b940ccd00 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45904/0 (socket says 172.21.15.64:45904) 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 -- 172.21.15.64:0/2123753176 learned_addr learned my addr 172.21.15.64:0/2123753176 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b98c00640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 -- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 msgr2=0x7f3b940b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9a000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 0x7f3b9415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 -- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 msgr2=0x7f3b9415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 0x7f3b9415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 -- 172.21.15.64:0/2123753176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9415aad0 con 0x7f3b9406ee80 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b98c00640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b9a000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 0x7f3b9415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.944+0000 7f3b99600640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009790 tx=0x7f3b88005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880046d0 con 0x7f3b9406ee80 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b880bd070 con 0x7f3b9406ee80 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88004bc0 con 0x7f3b9406ee80 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b941f9cd0 con 0x7f3b9406ee80 2024-09-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941fa250 con 0x7f3b9406ee80 2024-09-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b940cd110 con 0x7f3b9406ee80 2024-09-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b88003600 con 0x7f3b9406ee80 2024-09-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 0x7f3b74075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.948+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f3b8812ee70 con 0x7f3b9406ee80 2024-09-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.952+0000 7f3b98c00640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 0x7f3b74075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:40.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.952+0000 7f3b98c00640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 0x7f3b74075740 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3b9406f940 tx=0x7f3b800091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:40.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:40.952+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3b88016410 con 0x7f3b9406ee80 2024-09-21T07:36:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.140+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b940ae850 con 0x7f3b9406ee80 2024-09-21T07:36:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.140+0000 7f3b91600640 1 -- 172.21.15.64:0/2123753176 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v193) ==== 80+0+0 (secure 0 0 0) 0x7f3b880f9c10 con 0x7f3b9406ee80 2024-09-21T07:36:41.144 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 msgr2=0x7f3b74075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 0x7f3b74075740 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3b9406f940 tx=0x7f3b800091e0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 msgr2=0x7f3b9415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009790 tx=0x7f3b88005770 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 shutdown_connections 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b74073230 0x7f3b74075740 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b940d0e60 0x7f3b9415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b940ccd00 0x7f3b940b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 --2- 172.21.15.64:0/2123753176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b9406ee80 0x7f3b9415a590 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 >> 172.21.15.64:0/2123753176 conn(0x7f3b9406d450 msgr2=0x7f3b94072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 shutdown_connections 2024-09-21T07:36:41.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.144+0000 7f3b9c000640 1 -- 172.21.15.64:0/2123753176 wait complete. 2024-09-21T07:36:41.167 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:36:41.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:41.167 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:36:41.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:36:41.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:36:41.194 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:36:41.244 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:36:41.245 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:36:41.245 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:41.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:36:41.254 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:36:41.254 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:41.254 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:41.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:36:41.300 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:36:41.300 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:36:41.300 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:41.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:36:41.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:41.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 -- 172.21.15.64:0/929224433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fa4005200 msgr2=0x7f0fa400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/929224433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fa4005200 0x7f0fa400b9d0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00cafe0 tx=0x7f0fb801cc20 comp rx=0 tx=0).stop 2024-09-21T07:36:41.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc4a00640 1 -- 172.21.15.64:0/929224433 reap_dead start 2024-09-21T07:36:41.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 -- 172.21.15.64:0/929224433 shutdown_connections 2024-09-21T07:36:41.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 -- 172.21.15.64:0/929224433 >> 172.21.15.64:0/929224433 conn(0x7f0fc00d0de0 msgr2=0x7f0fc00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:41.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 -- 172.21.15.64:0/929224433 shutdown_connections 2024-09-21T07:36:41.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.500+0000 7f0fc6a00640 1 -- 172.21.15.64:0/929224433 wait complete. 2024-09-21T07:36:41.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 Processor -- start 2024-09-21T07:36:41.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- start start 2024-09-21T07:36:41.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fa4005200 0x7f0fc014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc00ae540 0x7f0fc014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc00c5b50 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc006d940 con 0x7f0fc00ae540 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc00c5cd0 con 0x7f0fa4005200 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45918/0 (socket says 172.21.15.64:45918) 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 -- 172.21.15.64:0/3387121651 learned_addr learned my addr 172.21.15.64:0/3387121651 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fb7400640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc00ae540 0x7f0fc014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fbfe00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fa4005200 0x7f0fc014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 -- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fa4005200 msgr2=0x7f0fc014f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fa4005200 0x7f0fc014f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 -- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc00ae540 msgr2=0x7f0fc014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc00ae540 0x7f0fc014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 -- 172.21.15.64:0/3387121651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc00a9500 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc4a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8000f90 tx=0x7f0fb8006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:41.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8001ba0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.509 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb80b4030 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8006c50 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc00a97e0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.504+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc00a9da0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.508+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc00c4bd0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.508+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fb8006660 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.508+0000 7f0fbcc00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.508+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f0fb812ebb0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.508+0000 7f0fbfe00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.512+0000 7f0fbfe00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 0x7f0f9c075710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00018f0 tx=0x7f0fb0004610 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:41.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.516+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0fb80169d0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fc00c6960 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fbcc00640 1 -- 172.21.15.64:0/3387121651 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f0fb80015e0 con 0x7f0fc00aa5a0 2024-09-21T07:36:41.730 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:41.730 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:36:41.731 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 msgr2=0x7f0f9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 0x7f0f9c075710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00018f0 tx=0x7f0fb0004610 comp rx=0 tx=0).stop 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 msgr2=0x7f0fc00aa9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8000f90 tx=0x7f0fb8006e20 comp rx=0 tx=0).stop 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 shutdown_connections 2024-09-21T07:36:41.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fc00aa5a0 0x7f0fc00aa9b0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc00ae540 0x7f0fc014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 --2- 172.21.15.64:0/3387121651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fa4005200 0x7f0fc014f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 >> 172.21.15.64:0/3387121651 conn(0x7f0fc00d0de0 msgr2=0x7f0fc00c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 shutdown_connections 2024-09-21T07:36:41.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.728+0000 7f0fc6a00640 1 -- 172.21.15.64:0/3387121651 wait complete. 2024-09-21T07:36:41.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 -- 172.21.15.64:0/812053138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700b3d60 msgr2=0x7f0b700b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 --2- 172.21.15.64:0/812053138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700b3d60 0x7f0b700b4170 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009840 tx=0x7f0b5801c760 comp rx=0 tx=0).stop 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 -- 172.21.15.64:0/812053138 shutdown_connections 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 --2- 172.21.15.64:0/812053138 >> v2:172.21.15.90:3300/0 conn(0x7f0b700c5ea0 0x7f0b700c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 --2- 172.21.15.64:0/812053138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700b3d60 0x7f0b700b4170 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 -- 172.21.15.64:0/812053138 >> 172.21.15.64:0/812053138 conn(0x7f0b7006d1c0 msgr2=0x7f0b7006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 -- 172.21.15.64:0/812053138 shutdown_connections 2024-09-21T07:36:41.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.908+0000 7f0b76a00640 1 -- 172.21.15.64:0/812053138 wait complete. 2024-09-21T07:36:41.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 Processor -- start 2024-09-21T07:36:41.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- start start 2024-09-21T07:36:41.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700c5ea0 0x7f0b701f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b700d1d00 0x7f0b7015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70169e90 con 0x7f0b700b3d60 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70169d10 con 0x7f0b700d1d00 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7016a010 con 0x7f0b700c5ea0 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45928/0 (socket says 172.21.15.64:45928) 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 -- 172.21.15.64:0/4077230803 learned_addr learned my addr 172.21.15.64:0/4077230803 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b67e00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700c5ea0 0x7f0b701f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b74a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b700d1d00 0x7f0b7015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 -- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700c5ea0 msgr2=0x7f0b701f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700c5ea0 0x7f0b701f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 -- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b700d1d00 msgr2=0x7f0b7015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b700d1d00 0x7f0b7015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 -- 172.21.15.64:0/4077230803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b70165640 con 0x7f0b700b3d60 2024-09-21T07:36:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6fe00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c760 tx=0x7f0b6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60016020 con 0x7f0b700b3d60 2024-09-21T07:36:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b6000a950 con 0x7f0b700b3d60 2024-09-21T07:36:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b70165ca0 con 0x7f0b700b3d60 2024-09-21T07:36:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000ada0 con 0x7f0b700b3d60 2024-09-21T07:36:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.912+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7006e110 con 0x7f0b700b3d60 2024-09-21T07:36:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.916+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b701661c0 con 0x7f0b700b3d60 2024-09-21T07:36:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.916+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0b60019020 con 0x7f0b700b3d60 2024-09-21T07:36:41.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.916+0000 7f0b6cc00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 0x7f0b4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:41.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.916+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f0b600941a0 con 0x7f0b700b3d60 2024-09-21T07:36:41.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.916+0000 7f0b67e00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 0x7f0b4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:41.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.920+0000 7f0b67e00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 0x7f0b4c075740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b580af000 tx=0x7f0b5801afa0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:41.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:41.920+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0b60020020 con 0x7f0b700b3d60 2024-09-21T07:36:42.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7006df00 con 0x7f0b700b3d60 2024-09-21T07:36:42.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b6cc00640 1 -- 172.21.15.64:0/4077230803 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f0b700b46b0 con 0x7f0b700b3d60 2024-09-21T07:36:42.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:42.137 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:36:42.138 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:36:42.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 msgr2=0x7f0b4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 0x7f0b4c075740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b580af000 tx=0x7f0b5801afa0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 msgr2=0x7f0b70165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c760 tx=0x7f0b6000cc20 comp rx=0 tx=0).stop 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 shutdown_connections 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b4c073230 0x7f0b4c075740 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b700d1d00 0x7f0b7015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b700c5ea0 0x7f0b701f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 --2- 172.21.15.64:0/4077230803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b700b3d60 0x7f0b70165100 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 >> 172.21.15.64:0/4077230803 conn(0x7f0b7006d1c0 msgr2=0x7f0b700d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 shutdown_connections 2024-09-21T07:36:42.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.136+0000 7f0b76a00640 1 -- 172.21.15.64:0/4077230803 wait complete. 2024-09-21T07:36:42.159 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- 172.21.15.64:0/3876634668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 msgr2=0x7fcccc0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 --2- 172.21.15.64:0/3876634668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc0b36c0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fcccc06b090 tx=0x7fccc401cd80 comp rx=0 tx=0).stop 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- 172.21.15.64:0/3876634668 shutdown_connections 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 --2- 172.21.15.64:0/3876634668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc0b36c0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 --2- 172.21.15.64:0/3876634668 >> v2:172.21.15.90:3300/0 conn(0x7fcccc0b4170 0x7fcccc0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- 172.21.15.64:0/3876634668 >> 172.21.15.64:0/3876634668 conn(0x7fcccc0ccbe0 msgr2=0x7fcccc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- 172.21.15.64:0/3876634668 shutdown_connections 2024-09-21T07:36:42.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- 172.21.15.64:0/3876634668 wait complete. 2024-09-21T07:36:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 Processor -- start 2024-09-21T07:36:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.316+0000 7fccd3c00640 1 -- start start 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcccc0b4170 0x7fcccc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcccc0cc4e0 0x7fcccc164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc165e80 con 0x7fcccc0b2120 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc165d00 con 0x7fcccc0cc4e0 2024-09-21T07:36:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc166000 con 0x7fcccc0b4170 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45954/0 (socket says 172.21.15.64:45954) 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 -- 172.21.15.64:0/2270616949 learned_addr learned my addr 172.21.15.64:0/2270616949 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fcccbe00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcccc0b4170 0x7fcccc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcccc0cc4e0 0x7fcccc164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 -- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcccc0b4170 msgr2=0x7fcccc153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcccc0b4170 0x7fcccc153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 -- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcccc0cc4e0 msgr2=0x7fcccc164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcccc0cc4e0 0x7fcccc164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 -- 172.21.15.64:0/2270616949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc157720 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd1200640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fccc000e970 tx=0x7fccc000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc000cd80 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccc0004020 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc156fd0 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0004470 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc154460 con 0x7fcccc0b2120 2024-09-21T07:36:42.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc157440 con 0x7fcccc0b2120 2024-09-21T07:36:42.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.320+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fccc0003600 con 0x7fcccc0b2120 2024-09-21T07:36:42.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.324+0000 7fccc8c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 0x7fccac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.324+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fccc0094df0 con 0x7fcccc0b2120 2024-09-21T07:36:42.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.324+0000 7fcccbe00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 0x7fccac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.324+0000 7fcccbe00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 0x7fccac075710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcccc074ba0 tx=0x7fccb8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:42.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.328+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fccc005fc20 con 0x7fcccc0b2120 2024-09-21T07:36:42.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.504+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcccc15a3a0 con 0x7fcccc0b2120 2024-09-21T07:36:42.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.504+0000 7fccc8c00640 1 -- 172.21.15.64:0/2270616949 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+17108 (secure 0 0 0) 0x7fccc005f520 con 0x7fcccc0b2120 2024-09-21T07:36:42.508 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:42.508 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":193,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:31.761410+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:53.680211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:54.895055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.9","mappings":[{"from":6,"to":1}]},{"pgid":"28.25","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:42.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 msgr2=0x7fccac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 0x7fccac075710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcccc074ba0 tx=0x7fccb8009040 comp rx=0 tx=0).stop 2024-09-21T07:36:42.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 msgr2=0x7fcccc1f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fccc000e970 tx=0x7fccc000ee30 comp rx=0 tx=0).stop 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 shutdown_connections 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fccac073200 0x7fccac075710 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcccc0cc4e0 0x7fcccc164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcccc0b4170 0x7fcccc153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 --2- 172.21.15.64:0/2270616949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcccc0b2120 0x7fcccc1f7980 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 >> 172.21.15.64:0/2270616949 conn(0x7fcccc0ccbe0 msgr2=0x7fcccc166f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 shutdown_connections 2024-09-21T07:36:42.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.508+0000 7fccd3c00640 1 -- 172.21.15.64:0/2270616949 wait complete. 2024-09-21T07:36:42.532 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:36:42.532 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 -- 172.21.15.64:0/345643282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4815b810 msgr2=0x7f9e480ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/345643282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4815b810 0x7f9e480ce5b0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f9e480748b0 tx=0x7f9e3801cd50 comp rx=0 tx=0).stop 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 -- 172.21.15.64:0/345643282 shutdown_connections 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/345643282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4806f620 0x7f9e4806fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/345643282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4815b810 0x7f9e480ce5b0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 -- 172.21.15.64:0/345643282 >> 172.21.15.64:0/345643282 conn(0x7f9e480d0de0 msgr2=0x7f9e480d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 -- 172.21.15.64:0/345643282 shutdown_connections 2024-09-21T07:36:42.691 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.688+0000 7f9e4ea00640 1 -- 172.21.15.64:0/345643282 wait complete. 2024-09-21T07:36:42.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 Processor -- start 2024-09-21T07:36:42.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- start start 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4806f620 0x7f9e481f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4815b810 0x7f9e4815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48168cb0 con 0x7f9e4806d020 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48168b30 con 0x7f9e4806f620 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9e48168e30 con 0x7f9e4815b810 2024-09-21T07:36:42.695 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45972/0 (socket says 172.21.15.64:45972) 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 -- 172.21.15.64:0/415200427 learned_addr learned my addr 172.21.15.64:0/415200427 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e3f400640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4806f620 0x7f9e481f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ca00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4815b810 0x7f9e4815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 -- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4815b810 msgr2=0x7f9e4815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4815b810 0x7f9e4815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 -- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4806f620 msgr2=0x7f9e481f8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4806f620 0x7f9e481f8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 -- 172.21.15.64:0/415200427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e481f9190 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e47e00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801d5f0 tx=0x7f9e380a5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380bb070 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e38004e00 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e481f9bd0 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380b2040 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.692+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e481f98f0 con 0x7f9e4806d020 2024-09-21T07:36:42.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.696+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4806fa30 con 0x7f9e4806d020 2024-09-21T07:36:42.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.696+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e380be070 con 0x7f9e4806d020 2024-09-21T07:36:42.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.696+0000 7f9e44c00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 0x7f9e24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:42.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.696+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f9e3812e770 con 0x7f9e4806d020 2024-09-21T07:36:42.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.700+0000 7f9e3f400640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 0x7f9e24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:42.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.700+0000 7f9e3f400640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 0x7f9e24075710 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098e0 tx=0x7f9e30009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:42.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.700+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9e38016970 con 0x7f9e4806d020 2024-09-21T07:36:42.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.916+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e480cfe60 con 0x7f9e4806d020 2024-09-21T07:36:42.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e44c00640 1 -- 172.21.15.64:0/415200427 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f9e380f9060 con 0x7f9e4806d020 2024-09-21T07:36:42.921 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:42.921 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:36:42.921 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 msgr2=0x7f9e24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 0x7f9e24075710 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098e0 tx=0x7f9e30009060 comp rx=0 tx=0).stop 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 msgr2=0x7f9e481fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801d5f0 tx=0x7f9e380a5ba0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 shutdown_connections 2024-09-21T07:36:42.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9e24073200 0x7f9e24075710 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9e4815b810 0x7f9e4815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4806f620 0x7f9e481f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 --2- 172.21.15.64:0/415200427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e4806d020 0x7f9e481fbc30 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 >> 172.21.15.64:0/415200427 conn(0x7f9e480d0de0 msgr2=0x7f9e48073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 shutdown_connections 2024-09-21T07:36:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:42.920+0000 7f9e4ea00640 1 -- 172.21.15.64:0/415200427 wait complete. 2024-09-21T07:36:42.943 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 -- 172.21.15.64:0/2456841859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 msgr2=0x7f6a84003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2456841859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a84003eb0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f6a90001770 tx=0x7f6a9001c860 comp rx=0 tx=0).stop 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 -- 172.21.15.64:0/2456841859 shutdown_connections 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2456841859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a84003eb0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 -- 172.21.15.64:0/2456841859 >> 172.21.15.64:0/2456841859 conn(0x7f6a9c0ccbe0 msgr2=0x7f6a9c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 -- 172.21.15.64:0/2456841859 shutdown_connections 2024-09-21T07:36:43.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.100+0000 7f6aa4400640 1 -- 172.21.15.64:0/2456841859 wait complete. 2024-09-21T07:36:43.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 Processor -- start 2024-09-21T07:36:43.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- start start 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a9c1fbaf0 0x7f6a9c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a9c1fbf00 0x7f6a9c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b1d60 con 0x7f6a84003a80 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b1be0 con 0x7f6a9c1fbaf0 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b1ee0 con 0x7f6a9c1fbf00 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45996/0 (socket says 172.21.15.64:45996) 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 -- 172.21.15.64:0/2496883841 learned_addr learned my addr 172.21.15.64:0/2496883841 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:43.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa2400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a9c1fbf00 0x7f6a9c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1000640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a9c1fbaf0 0x7f6a9c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 -- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a9c1fbf00 msgr2=0x7f6a9c0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a9c1fbf00 0x7f6a9c0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 -- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a9c1fbaf0 msgr2=0x7f6a9c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a9c1fbaf0 0x7f6a9c0c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 -- 172.21.15.64:0/2496883841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c09ab90 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa1a00640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f6a9001c690 tx=0x7f6a90006610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90004850 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a900b6030 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c09ae70 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90004d60 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.104+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c1f9ef0 con 0x7f6a84003a80 2024-09-21T07:36:43.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c1fa1b0 con 0x7f6a84003a80 2024-09-21T07:36:43.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6a900a7430 con 0x7f6a84003a80 2024-09-21T07:36:43.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6a99600640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 0x7f6a7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f6a9012e8e0 con 0x7f6a84003a80 2024-09-21T07:36:43.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6aa1000640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 0x7f6a7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.108+0000 7f6aa1000640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 0x7f6a7c075710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005ec0 tx=0x7f6a880091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.112+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6a90016570 con 0x7f6a84003a80 2024-09-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.324+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a9c0b2440 con 0x7f6a84003a80 2024-09-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.324+0000 7f6a99600640 1 -- 172.21.15.64:0/2496883841 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5234 (secure 0 0 0) 0x7f6a900f9710 con 0x7f6a84003a80 2024-09-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":144,"btime":"2024-09-21T07:35:59:526424+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:35:55.922738+0000","modified":"2024-09-21T07:35:58.948667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":141,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/39075560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":39075560},{"type":"v1","addr":"172.21.15.64:6835","nonce":39075560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10503,"qdb_cluster":[10503]},"id":13}]} 2024-09-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 144 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 msgr2=0x7f6a7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 0x7f6a7c075710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005ec0 tx=0x7f6a880091e0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 msgr2=0x7f6a9c0c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f6a9001c690 tx=0x7f6a90006610 comp rx=0 tx=0).stop 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 shutdown_connections 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a7c073200 0x7f6a7c075710 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a9c1fbf00 0x7f6a9c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a9c1fbaf0 0x7f6a9c0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 --2- 172.21.15.64:0/2496883841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a84003a80 0x7f6a9c0c7b90 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 >> 172.21.15.64:0/2496883841 conn(0x7f6a9c0ccbe0 msgr2=0x7f6a9c0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 shutdown_connections 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.328+0000 7f6aa4400640 1 -- 172.21.15.64:0/2496883841 wait complete. 2024-09-21T07:36:43.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 -- 172.21.15.64:0/1006174031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b4400 msgr2=0x7fa7d40c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 --2- 172.21.15.64:0/1006174031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b4400 0x7fa7d40c5d30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009870 tx=0x7fa7c001c740 comp rx=0 tx=0).stop 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 -- 172.21.15.64:0/1006174031 shutdown_connections 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 --2- 172.21.15.64:0/1006174031 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b4400 0x7fa7d40c5d30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 -- 172.21.15.64:0/1006174031 >> 172.21.15.64:0/1006174031 conn(0x7fa7d406d480 msgr2=0x7fa7d40d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 -- 172.21.15.64:0/1006174031 shutdown_connections 2024-09-21T07:36:43.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.504+0000 7fa7db600640 1 -- 172.21.15.64:0/1006174031 wait complete. 2024-09-21T07:36:43.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 Processor -- start 2024-09-21T07:36:43.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 -- start start 2024-09-21T07:36:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 0x7fa7d40b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 0x7fa7d406df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d416b2c0 con 0x7fa7d415c8a0 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d416b140 con 0x7fa7d4141a40 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7db600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d416b440 con 0x7fa7d40b1670 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46000/0 (socket says 172.21.15.64:46000) 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7d3e00640 1 -- 172.21.15.64:0/1406887172 learned_addr learned my addr 172.21.15.64:0/1406887172 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7d8c00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 0x7fa7d40b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.508+0000 7fa7d9600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 0x7fa7d406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 -- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 msgr2=0x7fa7d40b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 0x7fa7d40b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 -- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 msgr2=0x7fa7d406df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 0x7fa7d406df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 -- 172.21.15.64:0/1406887172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d40b7700 con 0x7fa7d415c8a0 2024-09-21T07:36:43.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d8c00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 0x7fa7d40b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:43.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d9600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 0x7fa7d406df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:43.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d3e00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0000c10 tx=0x7fa7c0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00a6590 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7c0005030 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0005460 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d40b79e0 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d4166a60 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d40b51f0 con 0x7fa7d415c8a0 2024-09-21T07:36:43.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.512+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa7c00b8030 con 0x7fa7d415c8a0 2024-09-21T07:36:43.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.516+0000 7fa7d0c00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 0x7fa7b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.516+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fa7c012dd90 con 0x7fa7d415c8a0 2024-09-21T07:36:43.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.516+0000 7fa7d8c00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 0x7fa7b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.516+0000 7fa7d8c00640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 0x7fa7b4075710 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8001700 tx=0x7fa7c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.520+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa7c00bf070 con 0x7fa7d415c8a0 2024-09-21T07:36:43.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.696+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7d40c5d30 con 0x7fa7d415c8a0 2024-09-21T07:36:43.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.696+0000 7fa7d0c00640 1 -- 172.21.15.64:0/1406887172 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+17108 (secure 0 0 0) 0x7fa7c00ac030 con 0x7fa7d415c8a0 2024-09-21T07:36:43.700 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:43.701 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":193,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:31.761410+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:35:53.680211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-21T07:35:54.895055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.9","mappings":[{"from":6,"to":1}]},{"pgid":"28.25","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 msgr2=0x7fa7b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 0x7fa7b4075710 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8001700 tx=0x7fa7c8009040 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 msgr2=0x7fa7d40b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0000c10 tx=0x7fa7c0005dd0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 shutdown_connections 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7b4073200 0x7fa7b4075710 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d4141a40 0x7fa7d406df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7d415c8a0 0x7fa7d40b6f70 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 --2- 172.21.15.64:0/1406887172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7d40b1670 0x7fa7d40b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 >> 172.21.15.64:0/1406887172 conn(0x7fa7d406d480 msgr2=0x7fa7d4151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 shutdown_connections 2024-09-21T07:36:43.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.700+0000 7fa7db600640 1 -- 172.21.15.64:0/1406887172 wait complete. 2024-09-21T07:36:43.724 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:36:43.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 -- 172.21.15.64:0/4224497088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f80ce900 msgr2=0x7fc3f806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/4224497088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f80ce900 0x7fc3f806f890 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009c80 tx=0x7fc3f001cda0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 -- 172.21.15.64:0/4224497088 shutdown_connections 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/4224497088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f80ce900 0x7fc3f806f890 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/4224497088 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f809df30 0x7fc3f80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 -- 172.21.15.64:0/4224497088 >> 172.21.15.64:0/4224497088 conn(0x7fc3f806d450 msgr2=0x7fc3f80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 -- 172.21.15.64:0/4224497088 shutdown_connections 2024-09-21T07:36:43.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.880+0000 7fc3ffc00640 1 -- 172.21.15.64:0/4224497088 wait complete. 2024-09-21T07:36:43.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 Processor -- start 2024-09-21T07:36:43.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 -- start start 2024-09-21T07:36:43.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 0x7fc3f815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 0x7fc3f80b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8169000 con 0x7fc3f809df30 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8168e80 con 0x7fc3f80ce900 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3ffc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f8169180 con 0x7fc3f80b3910 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3fd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3fd200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46012/0 (socket says 172.21.15.64:46012) 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.884+0000 7fc3fd200640 1 -- 172.21.15.64:0/478793877 learned_addr learned my addr 172.21.15.64:0/478793877 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 -- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 msgr2=0x7fc3f815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fdc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 0x7fc3f80b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f7e00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 0x7fc3f815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 0x7fc3f815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 -- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 msgr2=0x7fc3f80b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 0x7fc3f80b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 -- 172.21.15.64:0/478793877 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f80afc80 con 0x7fc3f809df30 2024-09-21T07:36:43.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fdc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 0x7fc3f80b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f7e00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 0x7fc3f815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3fd200640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00e9f0 tx=0x7fc3ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00ccc0 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3ec010430 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec010880 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f80c4550 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f80c4b10 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f80b33d0 con 0x7fc3f809df30 2024-09-21T07:36:43.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc3ec010a20 con 0x7fc3f809df30 2024-09-21T07:36:43.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.888+0000 7fc3f4c00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 0x7fc3d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:43.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.892+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fc3ec094fe0 con 0x7fc3f809df30 2024-09-21T07:36:43.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.892+0000 7fc3f7e00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 0x7fc3d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:43.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.892+0000 7fc3f7e00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 0x7fc3d8075710 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc3f809b6e0 tx=0x7fc3e4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:43.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:43.896+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc3ec05fdc0 con 0x7fc3f809df30 2024-09-21T07:36:44.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.108+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc3f80ce290 con 0x7fc3f809df30 2024-09-21T07:36:44.109 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:36:44.108+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:36:44.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.112+0000 7fc3f4c00640 1 -- 172.21.15.64:0/478793877 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v145) ==== 161+0+0 (secure 0 0 0) 0x7fc3ec05f6c0 con 0x7fc3f809df30 2024-09-21T07:36:44.113 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:36:44.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.112+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 msgr2=0x7fc3d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:44.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.112+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 0x7fc3d8075710 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc3f809b6e0 tx=0x7fc3e4009040 comp rx=0 tx=0).stop 2024-09-21T07:36:44.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.112+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 msgr2=0x7fc3f815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:44.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.112+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00e9f0 tx=0x7fc3ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 shutdown_connections 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc3d8073200 0x7fc3d8075710 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f80ce900 0x7fc3f80b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3f80b3910 0x7fc3f815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 --2- 172.21.15.64:0/478793877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3f809df30 0x7fc3f815d480 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 >> 172.21.15.64:0/478793877 conn(0x7fc3f806d450 msgr2=0x7fc3f809bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 shutdown_connections 2024-09-21T07:36:44.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.116+0000 7fc3ffc00640 1 -- 172.21.15.64:0/478793877 wait complete. 2024-09-21T07:36:44.124 INFO:tasks.ceph.mds.c.smithi064.stderr: -3851> 2024-09-21T07:35:58.480+0000 7f1a06400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:36:44.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:36:44.249 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:36:44.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- 172.21.15.64:0/2959197551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a015b2d0 msgr2=0x7fc6a015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:44.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 --2- 172.21.15.64:0/2959197551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a015b2d0 0x7fc6a015b6e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00c3c60 tx=0x7fc69801caf0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- 172.21.15.64:0/2959197551 shutdown_connections 2024-09-21T07:36:44.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 --2- 172.21.15.64:0/2959197551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a015b2d0 0x7fc6a015b6e0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 --2- 172.21.15.64:0/2959197551 >> v2:172.21.15.90:3300/0 conn(0x7fc6a006efa0 0x7fc6a00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- 172.21.15.64:0/2959197551 >> 172.21.15.64:0/2959197551 conn(0x7fc6a00ccbe0 msgr2=0x7fc6a00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:44.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- 172.21.15.64:0/2959197551 shutdown_connections 2024-09-21T07:36:44.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- 172.21.15.64:0/2959197551 wait complete. 2024-09-21T07:36:44.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 Processor -- start 2024-09-21T07:36:44.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.304+0000 7fc6a6600640 1 -- start start 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6a006f3b0 0x7fc6a0074370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a015b2d0 0x7fc6a00b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a015ed60 con 0x7fc6a006efa0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a015ebe0 con 0x7fc6a015b2d0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a015eee0 con 0x7fc6a006f3b0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46034/0 (socket says 172.21.15.64:46034) 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 -- 172.21.15.64:0/4117296733 learned_addr learned my addr 172.21.15.64:0/4117296733 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc696a00640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6a006f3b0 0x7fc6a0074370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69fe00640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a015b2d0 0x7fc6a00b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:44.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 -- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6a006f3b0 msgr2=0x7fc6a0074370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6a006f3b0 0x7fc6a0074370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 -- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a015b2d0 msgr2=0x7fc6a00b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a015b2d0 0x7fc6a00b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 -- 172.21.15.64:0/4117296733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a0154760 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc69f400640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fc69000ea90 tx=0x7fc69000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69000cc20 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc690005020 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a01536c0 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690005470 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a0153c80 con 0x7fc6a006efa0 2024-09-21T07:36:44.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.308+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a01531e0 con 0x7fc6a006efa0 2024-09-21T07:36:44.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.312+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc6900047b0 con 0x7fc6a006efa0 2024-09-21T07:36:44.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.312+0000 7fc697e00640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 0x7fc67c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:44.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.312+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7fc690094840 con 0x7fc6a006efa0 2024-09-21T07:36:44.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.312+0000 7fc696a00640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 0x7fc67c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:44.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.312+0000 7fc696a00640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 0x7fc67c075740 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc688007d70 tx=0x7fc688007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:44.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.316+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc6a01531e0 con 0x7fc6a006efa0 2024-09-21T07:36:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:44.532+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6a00cd240 con 0x7fc6a006efa0 2024-09-21T07:36:45.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc697e00640 1 -- 172.21.15.64:0/4117296733 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v146) ==== 104+0+0 (secure 0 0 0) 0x7fc69005ef30 con 0x7fc6a006efa0 2024-09-21T07:36:45.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 msgr2=0x7fc67c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:45.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 0x7fc67c075740 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc688007d70 tx=0x7fc688007d00 comp rx=0 tx=0).stop 2024-09-21T07:36:45.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 msgr2=0x7fc6a015a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:45.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fc69000ea90 tx=0x7fc69000ef50 comp rx=0 tx=0).stop 2024-09-21T07:36:45.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 shutdown_connections 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc67c073230 0x7fc67c075740 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a015b2d0 0x7fc6a00b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6a006f3b0 0x7fc6a0074370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 --2- 172.21.15.64:0/4117296733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6a006efa0 0x7fc6a015a620 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 >> 172.21.15.64:0/4117296733 conn(0x7fc6a00ccbe0 msgr2=0x7fc6a00ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 shutdown_connections 2024-09-21T07:36:45.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.116+0000 7fc6a6600640 1 -- 172.21.15.64:0/4117296733 wait complete. 2024-09-21T07:36:45.142 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- 172.21.15.64:0/819899763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c0c003c20 msgr2=0x7f0c0c004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/819899763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c0c003c20 0x7f0c0c004070 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009b40 tx=0x7f0c1801d270 comp rx=0 tx=0).stop 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2cc00640 1 -- 172.21.15.64:0/819899763 reap_dead start 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- 172.21.15.64:0/819899763 shutdown_connections 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- 172.21.15.64:0/819899763 >> 172.21.15.64:0/819899763 conn(0x7f0c2806d480 msgr2=0x7f0c280710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:45.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- 172.21.15.64:0/819899763 shutdown_connections 2024-09-21T07:36:45.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- 172.21.15.64:0/819899763 wait complete. 2024-09-21T07:36:45.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 Processor -- start 2024-09-21T07:36:45.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.304+0000 7f0c2ec00640 1 -- start start 2024-09-21T07:36:45.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0c003c20 0x7f0c280cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:45.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c28157370 0x7f0c280b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:45.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28169100 con 0x7f0c280b2210 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28168f80 con 0x7f0c28157370 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0c28169280 con 0x7f0c0c003c20 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42984/0 (socket says 172.21.15.64:42984) 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1337598430 learned_addr learned my addr 172.21.15.64:0/1337598430 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c27e00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0c003c20 0x7f0c280cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c1fe00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c28157370 0x7f0c280b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0c003c20 msgr2=0x7f0c280cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0c003c20 0x7f0c280cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c28157370 msgr2=0x7f0c280b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c28157370 0x7f0c280b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 -- 172.21.15.64:0/1337598430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c280c8620 con 0x7f0c280b2210 2024-09-21T07:36:45.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2cc00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c5ca0 tx=0x7f0c20001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20011870 con 0x7f0c280b2210 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c20017070 con 0x7f0c280b2210 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c280ca3b0 con 0x7f0c280b2210 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20011cd0 con 0x7f0c280b2210 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c280ca970 con 0x7f0c280b2210 2024-09-21T07:36:45.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.308+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c280d1530 con 0x7f0c280b2210 2024-09-21T07:36:45.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.312+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0c2001c460 con 0x7f0c280b2210 2024-09-21T07:36:45.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.312+0000 7f0c24c00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 0x7f0c04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:45.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.312+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7f0c20094ca0 con 0x7f0c280b2210 2024-09-21T07:36:45.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.312+0000 7f0c27e00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 0x7f0c04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:45.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.312+0000 7f0c27e00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 0x7f0c04075710 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0c180ad000 tx=0x7f0c1801a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:45.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.316+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0c2005fa70 con 0x7f0c280b2210 2024-09-21T07:36:45.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:45.496+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c280b2670 con 0x7f0c280b2210 2024-09-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.120+0000 7f0c24c00640 1 -- 172.21.15.64:0/1337598430 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v195) ==== 181+0+0 (secure 0 0 0) 0x7f0c280b2670 con 0x7f0c280b2210 2024-09-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:36:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 msgr2=0x7f0c04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 0x7f0c04075710 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0c180ad000 tx=0x7f0c1801a010 comp rx=0 tx=0).stop 2024-09-21T07:36:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 msgr2=0x7f0c281fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c5ca0 tx=0x7f0c20001b90 comp rx=0 tx=0).stop 2024-09-21T07:36:46.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 shutdown_connections 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0c04073200 0x7f0c04075710 secure :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0c180ad000 tx=0x7f0c1801a010 comp rx=0 tx=0).stop 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c280b2210 0x7f0c281fa470 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c28157370 0x7f0c280b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 --2- 172.21.15.64:0/1337598430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0c003c20 0x7f0c280cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 >> 172.21.15.64:0/1337598430 conn(0x7f0c2806d480 msgr2=0x7f0c2815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.124+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 shutdown_connections 2024-09-21T07:36:46.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.128+0000 7f0c2ec00640 1 -- 172.21.15.64:0/1337598430 wait complete. 2024-09-21T07:36:46.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:36:46.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 -- 172.21.15.64:0/2366577364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995006ec70 msgr2=0x7f9950158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:46.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 --2- 172.21.15.64:0/2366577364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995006ec70 0x7f9950158db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9940009bf0 tx=0x7f994001cb00 comp rx=0 tx=0).stop 2024-09-21T07:36:46.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 -- 172.21.15.64:0/2366577364 shutdown_connections 2024-09-21T07:36:46.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 --2- 172.21.15.64:0/2366577364 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f995006ec70 0x7f9950158db0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 -- 172.21.15.64:0/2366577364 >> 172.21.15.64:0/2366577364 conn(0x7f99500d0170 msgr2=0x7f99500d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:46.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 -- 172.21.15.64:0/2366577364 shutdown_connections 2024-09-21T07:36:46.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.312+0000 7f9956200640 1 -- 172.21.15.64:0/2366577364 wait complete. 2024-09-21T07:36:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 Processor -- start 2024-09-21T07:36:46.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 -- start start 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995006ec70 0x7f99501564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99501592f0 0x7f995015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f995016a370 con 0x7f99500af530 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f995016a1f0 con 0x7f995006ec70 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9956200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f995016a4f0 con 0x7f99501592f0 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43000/0 (socket says 172.21.15.64:43000) 2024-09-21T07:36:46.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 -- 172.21.15.64:0/3326457625 learned_addr learned my addr 172.21.15.64:0/3326457625 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f994f400640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995006ec70 0x7f99501564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f994fe00640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99501592f0 0x7f995015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 -- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99501592f0 msgr2=0x7f995015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99501592f0 0x7f995015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 -- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995006ec70 msgr2=0x7f99501564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995006ec70 0x7f99501564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 -- 172.21.15.64:0/3326457625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995015a930 con 0x7f99500af530 2024-09-21T07:36:46.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.316+0000 7f9946a00640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f993800c530 tx=0x7f993800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938017070 con 0x7f99500af530 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99380053e0 con 0x7f99500af530 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938003860 con 0x7f99500af530 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995009a9f0 con 0x7f99500af530 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995009acb0 con 0x7f99500af530 2024-09-21T07:36:46.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9950158db0 con 0x7f99500af530 2024-09-21T07:36:46.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f993801a070 con 0x7f99500af530 2024-09-21T07:36:46.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 0x7f992c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:46.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.320+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5836+0+0 (secure 0 0 0) 0x7f9938093520 con 0x7f99500af530 2024-09-21T07:36:46.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.324+0000 7f994f400640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 0x7f992c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:46.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.324+0000 7f994f400640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 0x7f992c075740 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f99400af000 tx=0x7f994001b340 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:46.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.328+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9950159700 con 0x7f99500af530 2024-09-21T07:36:46.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:46.500+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9950070370 con 0x7f99500af530 2024-09-21T07:36:47.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.124+0000 7f9947e00640 1 -- 172.21.15.64:0/3326457625 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v196) ==== 169+0+0 (secure 0 0 0) 0x7f993805df00 con 0x7f99500af530 2024-09-21T07:36:47.127 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 msgr2=0x7f992c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 0x7f992c075740 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f99400af000 tx=0x7f994001b340 comp rx=0 tx=0).stop 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 msgr2=0x7f99501552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f993800c530 tx=0x7f993800c9f0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 shutdown_connections 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f992c073230 0x7f992c075740 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99501592f0 0x7f995015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99500af530 0x7f99501552f0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 --2- 172.21.15.64:0/3326457625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995006ec70 0x7f99501564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 >> 172.21.15.64:0/3326457625 conn(0x7f99500d0170 msgr2=0x7f99500d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:47.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 shutdown_connections 2024-09-21T07:36:47.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.128+0000 7f9956200640 1 -- 172.21.15.64:0/3326457625 wait complete. 2024-09-21T07:36:47.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.308+0000 7fb49d000640 1 -- 172.21.15.64:0/2911094258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4980cc910 msgr2=0x7fb4980ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.308+0000 7fb49d000640 1 --2- 172.21.15.64:0/2911094258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4980cc910 0x7fb4980ccd20 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fb480009840 tx=0x7fb48001c690 comp rx=0 tx=0).stop 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- 172.21.15.64:0/2911094258 shutdown_connections 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 --2- 172.21.15.64:0/2911094258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4980cc910 0x7fb4980ccd20 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 --2- 172.21.15.64:0/2911094258 >> v2:172.21.15.90:3300/0 conn(0x7fb49815fa60 0x7fb4980ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- 172.21.15.64:0/2911094258 >> 172.21.15.64:0/2911094258 conn(0x7fb4980b1c60 msgr2=0x7fb4980b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- 172.21.15.64:0/2911094258 shutdown_connections 2024-09-21T07:36:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- 172.21.15.64:0/2911094258 wait complete. 2024-09-21T07:36:47.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 Processor -- start 2024-09-21T07:36:47.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- start start 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 0x7fb498157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980cc910 0x7fb4980c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980ceac0 con 0x7fb49815fa60 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980ce940 con 0x7fb498073ea0 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.312+0000 7fb49d000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb4981689f0 con 0x7fb4980cc910 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43028/0 (socket says 172.21.15.64:43028) 2024-09-21T07:36:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 -- 172.21.15.64:0/429814477 learned_addr learned my addr 172.21.15.64:0/429814477 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb48fe00640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980cc910 0x7fb4980c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497400640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 0x7fb498157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 -- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980cc910 msgr2=0x7fb4980c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980cc910 0x7fb4980c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 -- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 msgr2=0x7fb498157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 0x7fb498157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 -- 172.21.15.64:0/429814477 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4980b5a70 con 0x7fb49815fa60 2024-09-21T07:36:47.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497400640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 0x7fb498157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb497e00640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cb10 tx=0x7fb49000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490016020 con 0x7fb49815fa60 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb49000ce50 con 0x7fb49815fa60 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49000adc0 con 0x7fb49815fa60 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4980b5d50 con 0x7fb49815fa60 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4980c5a30 con 0x7fb49815fa60 2024-09-21T07:36:47.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4980ccd20 con 0x7fb49815fa60 2024-09-21T07:36:47.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.316+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb490019020 con 0x7fb49815fa60 2024-09-21T07:36:47.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.320+0000 7fb48f400640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 0x7fb474075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.320+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fb490093ff0 con 0x7fb49815fa60 2024-09-21T07:36:47.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.320+0000 7fb497400640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 0x7fb474075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.320+0000 7fb497400640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 0x7fb474075710 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb488009b90 tx=0x7fb4880091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:47.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.324+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb490020030 con 0x7fb49815fa60 2024-09-21T07:36:47.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.504+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fb49806de00 con 0x7fb49815fa60 2024-09-21T07:36:47.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.508+0000 7fb48f400640 1 -- 172.21.15.64:0/429814477 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v63) ==== 71+0+0 (secure 0 0 0) 0x7fb4980cd260 con 0x7fb49815fa60 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 msgr2=0x7fb474075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 0x7fb474075710 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb488009b90 tx=0x7fb4880091e0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 msgr2=0x7fb4981456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cb10 tx=0x7fb49000cc00 comp rx=0 tx=0).stop 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 shutdown_connections 2024-09-21T07:36:47.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb474073200 0x7fb474075710 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb49815fa60 0x7fb4981456a0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980cc910 0x7fb4980c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 --2- 172.21.15.64:0/429814477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb498073ea0 0x7fb498157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 >> 172.21.15.64:0/429814477 conn(0x7fb4980b1c60 msgr2=0x7fb49815e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 shutdown_connections 2024-09-21T07:36:47.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.512+0000 7fb49d000640 1 -- 172.21.15.64:0/429814477 wait complete. 2024-09-21T07:36:47.534 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 -- 172.21.15.64:0/1724903758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 msgr2=0x7f1f2c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 --2- 172.21.15.64:0/1724903758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c072e20 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009c80 tx=0x7f1f2401cda0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 -- 172.21.15.64:0/1724903758 shutdown_connections 2024-09-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 --2- 172.21.15.64:0/1724903758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c072e20 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 --2- 172.21.15.64:0/1724903758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 0x7f1f2c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 -- 172.21.15.64:0/1724903758 >> 172.21.15.64:0/1724903758 conn(0x7f1f2c0ccbe0 msgr2=0x7f1f2c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:47.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 -- 172.21.15.64:0/1724903758 shutdown_connections 2024-09-21T07:36:47.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.696+0000 7f1f31a00640 1 -- 172.21.15.64:0/1724903758 wait complete. 2024-09-21T07:36:47.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 Processor -- start 2024-09-21T07:36:47.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 -- start start 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 0x7f1f2c0af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f2c15edb0 0x7f1f2c0adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c168c40 con 0x7f1f2c0b4700 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c168ac0 con 0x7f1f2c15edb0 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f31a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c168dc0 con 0x7f1f2c0709b0 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43054/0 (socket says 172.21.15.64:43054) 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 -- 172.21.15.64:0/136168301 learned_addr learned my addr 172.21.15.64:0/136168301 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2b400640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f2c15edb0 0x7f1f2c0adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2aa00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 0x7f1f2c0af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 -- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 msgr2=0x7f1f2c0af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 0x7f1f2c0af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 -- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f2c15edb0 msgr2=0x7f1f2c0adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f2c15edb0 0x7f1f2c0adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.700+0000 7f1f2a000640 1 -- 172.21.15.64:0/136168301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0b0340 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f2a000640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f1f180058d0 tx=0x7f1f1800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18017070 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f18009d20 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180106c0 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c1fc0d0 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c1fc690 con 0x7f1f2c0b4700 2024-09-21T07:36:47.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c0b41c0 con 0x7f1f2c0b4700 2024-09-21T07:36:47.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.704+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1f1801a070 con 0x7f1f2c0b4700 2024-09-21T07:36:47.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.708+0000 7f1f22a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 0x7f1f0c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:47.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.708+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f1f18094580 con 0x7f1f2c0b4700 2024-09-21T07:36:47.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.708+0000 7f1f2aa00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 0x7f1f0c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:47.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.708+0000 7f1f2aa00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 0x7f1f0c075710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c001650 tx=0x7f1f1c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:47.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.708+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1f1805f1a0 con 0x7f1f2c0b4700 2024-09-21T07:36:47.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:47.948+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f1f2c09da20 con 0x7f1f2c0b4700 2024-09-21T07:36:48.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f22a00640 1 -- 172.21.15.64:0/136168301 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v664) ==== 140+0+0 (secure 0 0 0) 0x7f1f18063bd0 con 0x7f1f2c0b4700 2024-09-21T07:36:48.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 msgr2=0x7f1f0c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 0x7f1f0c075710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c001650 tx=0x7f1f1c009040 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 msgr2=0x7f1f2c157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f1f180058d0 tx=0x7f1f1800dde0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 shutdown_connections 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1f0c073200 0x7f1f0c075710 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f2c15edb0 0x7f1f2c0adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f2c0b4700 0x7f1f2c157180 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 --2- 172.21.15.64:0/136168301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f2c0709b0 0x7f1f2c0af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 >> 172.21.15.64:0/136168301 conn(0x7f1f2c0ccbe0 msgr2=0x7f1f2c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 shutdown_connections 2024-09-21T07:36:48.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.140+0000 7f1f31a00640 1 -- 172.21.15.64:0/136168301 wait complete. 2024-09-21T07:36:48.164 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-21T07:36:48.164 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-21T07:36:48.165 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 -- 172.21.15.64:0/2441759352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a5c003a80 msgr2=0x7f7a5c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 --2- 172.21.15.64:0/2441759352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a5c003a80 0x7f7a5c003ed0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009b40 tx=0x7f7a6801d250 comp rx=0 tx=0).stop 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 -- 172.21.15.64:0/2441759352 shutdown_connections 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 --2- 172.21.15.64:0/2441759352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a5c003a80 0x7f7a5c003ed0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 -- 172.21.15.64:0/2441759352 >> 172.21.15.64:0/2441759352 conn(0x7f7a740ccbe0 msgr2=0x7f7a740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 -- 172.21.15.64:0/2441759352 shutdown_connections 2024-09-21T07:36:48.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.320+0000 7f7a7b800640 1 -- 172.21.15.64:0/2441759352 wait complete. 2024-09-21T07:36:48.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 Processor -- start 2024-09-21T07:36:48.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 -- start start 2024-09-21T07:36:48.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 0x7f7a74151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 0x7f7a741f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74070440 con 0x7f7a740c40f0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a740702c0 con 0x7f7a741f8ee0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a7b800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7a740b41c0 con 0x7f7a5c003a80 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43072/0 (socket says 172.21.15.64:43072) 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 -- 172.21.15.64:0/4175454917 learned_addr learned my addr 172.21.15.64:0/4175454917 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 -- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 msgr2=0x7f7a74151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a78e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 0x7f7a74151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a79800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 0x7f7a741f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 0x7f7a74151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 -- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 msgr2=0x7f7a741f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 0x7f7a741f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a73e00640 1 -- 172.21.15.64:0/4175454917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a741551a0 con 0x7f7a740c40f0 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a78e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 0x7f7a74151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:48.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.324+0000 7f7a79800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 0x7f7a741f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a73e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000e310 tx=0x7f7a6000e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60016070 con 0x7f7a740c40f0 2024-09-21T07:36:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a60003600 con 0x7f7a740c40f0 2024-09-21T07:36:48.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60003a30 con 0x7f7a740c40f0 2024-09-21T07:36:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a74155480 con 0x7f7a740c40f0 2024-09-21T07:36:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a740c74c0 con 0x7f7a740c40f0 2024-09-21T07:36:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a740b4720 con 0x7f7a740c40f0 2024-09-21T07:36:48.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7a6000d070 con 0x7f7a740c40f0 2024-09-21T07:36:48.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 0x7f7a54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.328+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f7a60097ee0 con 0x7f7a740c40f0 2024-09-21T07:36:48.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.332+0000 7f7a78e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 0x7f7a54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.332+0000 7f7a78e00640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 0x7f7a54075710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad000 tx=0x7f7a68019ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:48.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.332+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7a60063060 con 0x7f7a740c40f0 2024-09-21T07:36:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.512+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a7409da20 con 0x7f7a740c40f0 2024-09-21T07:36:48.516 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.512+0000 7f7a70c00640 1 -- 172.21.15.64:0/4175454917 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) ==== 74+0+13263 (secure 0 0 0) 0x7f7a6007ce20 con 0x7f7a740c40f0 2024-09-21T07:36:48.517 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:48.517 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":196,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:47.127561+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/39075560":"2024-09-22T07:36:44.112611+0000","172.21.15.64:6834/39075560":"2024-09-22T07:36:44.112611+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 msgr2=0x7f7a54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 0x7f7a54075710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad000 tx=0x7f7a68019ff0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 msgr2=0x7f7a741f89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000e310 tx=0x7f7a6000e7d0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 shutdown_connections 2024-09-21T07:36:48.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7a54073200 0x7f7a54075710 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a741f8ee0 0x7f7a741f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a740c40f0 0x7f7a741f89a0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 --2- 172.21.15.64:0/4175454917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003a80 0x7f7a74151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 >> 172.21.15.64:0/4175454917 conn(0x7f7a740ccbe0 msgr2=0x7f7a740ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 shutdown_connections 2024-09-21T07:36:48.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.516+0000 7f7a7b800640 1 -- 172.21.15.64:0/4175454917 wait complete. 2024-09-21T07:36:48.539 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:36:48.540 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1335772659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc41604c0 msgr2=0x7f5fc4166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1335772659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc41604c0 0x7f5fc4166c60 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009c80 tx=0x7f5fbc01cda0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1335772659 shutdown_connections 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1335772659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc41604c0 0x7f5fc4166c60 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1335772659 >> 172.21.15.64:0/1335772659 conn(0x7f5fc406d450 msgr2=0x7f5fc40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1335772659 shutdown_connections 2024-09-21T07:36:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1335772659 wait complete. 2024-09-21T07:36:48.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 Processor -- start 2024-09-21T07:36:48.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 -- start start 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.700+0000 7f5fc8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc409df30 0x7f5fc41595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc41604c0 0x7f5fc41fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4169f10 con 0x7f5fc415f9a0 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4169d90 con 0x7f5fc409df30 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc416a090 con 0x7f5fc41604c0 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43084/0 (socket says 172.21.15.64:43084) 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 -- 172.21.15.64:0/1202895928 learned_addr learned my addr 172.21.15.64:0/1202895928 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc2800640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc41604c0 0x7f5fc41fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc1e00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc409df30 0x7f5fc41595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 -- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc41604c0 msgr2=0x7f5fc41fcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc41604c0 0x7f5fc41fcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 -- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc409df30 msgr2=0x7f5fc41595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc409df30 0x7f5fc41595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 -- 172.21.15.64:0/1202895928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc415db20 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fbbe00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c430 tx=0x7f5fac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fac0053c0 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac003860 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc4164f60 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc4165520 con 0x7f5fc415f9a0 2024-09-21T07:36:48.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc415d890 con 0x7f5fc415f9a0 2024-09-21T07:36:48.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.704+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5fac01a070 con 0x7f5fc415f9a0 2024-09-21T07:36:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.708+0000 7f5fba000640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 0x7f5fa0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.708+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f5fac0934b0 con 0x7f5fc415f9a0 2024-09-21T07:36:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.708+0000 7f5fc1e00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 0x7f5fa0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.708+0000 7f5fc1e00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 0x7f5fa0075710 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4007fd0 tx=0x7f5fb4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:48.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.712+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5fac05df50 con 0x7f5fc415f9a0 2024-09-21T07:36:48.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.888+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5fc40b33d0 con 0x7f5fc415f9a0 2024-09-21T07:36:48.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.888+0000 7f5fba000640 1 -- 172.21.15.64:0/1202895928 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) ==== 93+0+10 (secure 0 0 0) 0x7f5fac062980 con 0x7f5fc415f9a0 2024-09-21T07:36:48.892 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 msgr2=0x7f5fa0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 0x7f5fa0075710 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4007fd0 tx=0x7f5fb4009040 comp rx=0 tx=0).stop 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 msgr2=0x7f5fc41fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c430 tx=0x7f5fac00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 shutdown_connections 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073200 0x7f5fa0075710 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc41604c0 0x7f5fc41fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc415f9a0 0x7f5fc41fc670 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 --2- 172.21.15.64:0/1202895928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc409df30 0x7f5fc41595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:48.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 >> 172.21.15.64:0/1202895928 conn(0x7f5fc406d450 msgr2=0x7f5fc40cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:48.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 shutdown_connections 2024-09-21T07:36:48.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:48.892+0000 7f5fc8a00640 1 -- 172.21.15.64:0/1202895928 wait complete. 2024-09-21T07:36:48.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-21T07:36:49.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- 172.21.15.64:0/3941629819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f00b4700 msgr2=0x7f63f0072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 --2- 172.21.15.64:0/3941629819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f00b4700 0x7f63f0072e20 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f63f006adf0 tx=0x7f63e801cd20 comp rx=0 tx=0).stop 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- 172.21.15.64:0/3941629819 shutdown_connections 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 --2- 172.21.15.64:0/3941629819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f00b4700 0x7f63f0072e20 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 --2- 172.21.15.64:0/3941629819 >> v2:172.21.15.90:3300/0 conn(0x7f63f00709b0 0x7f63f00b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 --2- 172.21.15.64:0/3941629819 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f015edb0 0x7f63f00700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- 172.21.15.64:0/3941629819 >> 172.21.15.64:0/3941629819 conn(0x7f63f00ccbe0 msgr2=0x7f63f00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- 172.21.15.64:0/3941629819 shutdown_connections 2024-09-21T07:36:49.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- 172.21.15.64:0/3941629819 wait complete. 2024-09-21T07:36:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 Processor -- start 2024-09-21T07:36:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.072+0000 7f63f5c00640 1 -- start start 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f00709b0 0x7f63f00c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63f00b4700 0x7f63f00c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63f00b2380 con 0x7f63f015edb0 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63f00b2200 con 0x7f63f00b4700 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f63f00b2500 con 0x7f63f00709b0 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43102/0 (socket says 172.21.15.64:43102) 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 -- 172.21.15.64:0/2086832018 learned_addr learned my addr 172.21.15.64:0/2086832018 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:49.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63eea00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f00709b0 0x7f63f00c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63e6000640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63f00b4700 0x7f63f00c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 -- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f00709b0 msgr2=0x7f63f00c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f00709b0 0x7f63f00c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 -- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63f00b4700 msgr2=0x7f63f00c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63f00b4700 0x7f63f00c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 -- 172.21.15.64:0/2086832018 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f0156cd0 con 0x7f63f015edb0 2024-09-21T07:36:49.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63ef400640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f63e801b430 tx=0x7f63e8005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80bc070 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63e80a5e50 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80b2040 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f015dce0 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f00c9ae0 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.076+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f00b2980 con 0x7f63f015edb0 2024-09-21T07:36:49.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.080+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63e8004590 con 0x7f63f015edb0 2024-09-21T07:36:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.080+0000 7f63e7400640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 0x7f63cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.080+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f63e812de40 con 0x7f63f015edb0 2024-09-21T07:36:49.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.080+0000 7f63eea00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 0x7f63cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:49.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.080+0000 7f63eea00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 0x7f63cc075740 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f63e0004630 tx=0x7f63e000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:49.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.084+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f63f0156cd0 con 0x7f63f015edb0 2024-09-21T07:36:49.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:49.332+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f63f009da20 con 0x7f63f015edb0 2024-09-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.144+0000 7f63e7400640 1 -- 172.21.15.64:0/2086832018 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v666) ==== 136+0+0 (secure 0 0 0) 0x7f63e8016970 con 0x7f63f015edb0 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 msgr2=0x7f63cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 0x7f63cc075740 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f63e0004630 tx=0x7f63e000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 msgr2=0x7f63f009ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f63e801b430 tx=0x7f63e8005b10 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 shutdown_connections 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f63cc073230 0x7f63cc075740 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f015edb0 0x7f63f009ca00 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63f00b4700 0x7f63f00c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 --2- 172.21.15.64:0/2086832018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63f00709b0 0x7f63f00c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 >> 172.21.15.64:0/2086832018 conn(0x7f63f00ccbe0 msgr2=0x7f63f0159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 shutdown_connections 2024-09-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.148+0000 7f63f5c00640 1 -- 172.21.15.64:0/2086832018 wait complete. 2024-09-21T07:36:50.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 -- 172.21.15.64:0/694342344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c0b2120 msgr2=0x7f885c0cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 --2- 172.21.15.64:0/694342344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c0b2120 0x7f885c0cbcd0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f8854009c80 tx=0x7f885401cd30 comp rx=0 tx=0).stop 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 -- 172.21.15.64:0/694342344 shutdown_connections 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 --2- 172.21.15.64:0/694342344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c0b2120 0x7f885c0cbcd0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 --2- 172.21.15.64:0/694342344 >> v2:172.21.15.90:3300/0 conn(0x7f885c070850 0x7f885c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 --2- 172.21.15.64:0/694342344 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 0x7f885c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 -- 172.21.15.64:0/694342344 >> 172.21.15.64:0/694342344 conn(0x7f885c0ccbe0 msgr2=0x7f885c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:50.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 -- 172.21.15.64:0/694342344 shutdown_connections 2024-09-21T07:36:50.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.328+0000 7f8861400640 1 -- 172.21.15.64:0/694342344 wait complete. 2024-09-21T07:36:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 Processor -- start 2024-09-21T07:36:50.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- start start 2024-09-21T07:36:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f885c0b2120 0x7f885c145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 0x7f885c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f885c06fa80 con 0x7f885c070850 2024-09-21T07:36:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f885c06f900 con 0x7f885c0b2120 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f885c0b2fb0 con 0x7f885c15cbd0 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43116/0 (socket says 172.21.15.64:43116) 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 -- 172.21.15.64:0/1929305403 learned_addr learned my addr 172.21.15.64:0/1929305403 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8853e00640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f885c0b2120 0x7f885c145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885b200640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 0x7f885c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 -- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 msgr2=0x7f885c0afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 0x7f885c0afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 -- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f885c0b2120 msgr2=0x7f885c145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f885c0b2120 0x7f885c145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 -- 172.21.15.64:0/1929305403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c157480 con 0x7f885c070850 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f885a800640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e7c0 tx=0x7f884c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c00ccc0 con 0x7f885c070850 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f884c00ce80 con 0x7f885c070850 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c005280 con 0x7f885c070850 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c09ac40 con 0x7f885c070850 2024-09-21T07:36:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.332+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c09b200 con 0x7f885c070850 2024-09-21T07:36:50.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c0cbcd0 con 0x7f885c070850 2024-09-21T07:36:50.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f884c005420 con 0x7f885c070850 2024-09-21T07:36:50.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8852a00640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 0x7f8838075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f884c0948d0 con 0x7f885c070850 2024-09-21T07:36:50.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8853e00640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 0x7f8838075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.336+0000 7f8853e00640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 0x7f8838075710 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f885c156430 tx=0x7f884400b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:50.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.340+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f884c05f490 con 0x7f885c070850 2024-09-21T07:36:50.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.516+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f885c072ec0 con 0x7f885c070850 2024-09-21T07:36:50.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.516+0000 7f8852a00640 1 -- 172.21.15.64:0/1929305403 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v63) ==== 59+0+2294 (secure 0 0 0) 0x7f884c068020 con 0x7f885c070850 2024-09-21T07:36:50.520 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:36:50.520 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:36:50.521 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:36:50.522 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:36:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 msgr2=0x7f8838075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 0x7f8838075710 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f885c156430 tx=0x7f884400b260 comp rx=0 tx=0).stop 2024-09-21T07:36:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 msgr2=0x7f885c156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e7c0 tx=0x7f884c00ec80 comp rx=0 tx=0).stop 2024-09-21T07:36:50.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 shutdown_connections 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8838073200 0x7f8838075710 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f885c15cbd0 0x7f885c0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f885c0b2120 0x7f885c145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 --2- 172.21.15.64:0/1929305403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f885c070850 0x7f885c156f40 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 >> 172.21.15.64:0/1929305403 conn(0x7f885c0ccbe0 msgr2=0x7f885c0cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 shutdown_connections 2024-09-21T07:36:50.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.520+0000 7f8861400640 1 -- 172.21.15.64:0/1929305403 wait complete. 2024-09-21T07:36:50.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 -- 172.21.15.64:0/3257356367 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 msgr2=0x7fc9c00ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/3257356367 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c00ce1f0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009900 tx=0x7fc9ac01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 -- 172.21.15.64:0/3257356367 shutdown_connections 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/3257356367 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c00ce1f0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/3257356367 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 0x7fc9c00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 -- 172.21.15.64:0/3257356367 >> 172.21.15.64:0/3257356367 conn(0x7fc9c006d450 msgr2=0x7fc9c00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:50.704 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 -- 172.21.15.64:0/3257356367 shutdown_connections 2024-09-21T07:36:50.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.700+0000 7fc9c7c00640 1 -- 172.21.15.64:0/3257356367 wait complete. 2024-09-21T07:36:50.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 Processor -- start 2024-09-21T07:36:50.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 -- start start 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 0x7fc9c009b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c00ce730 0x7fc9c01f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01691f0 con 0x7fc9c00b3910 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0169070 con 0x7fc9c00ce730 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c7c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c0169370 con 0x7fc9c009df30 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43140/0 (socket says 172.21.15.64:43140) 2024-09-21T07:36:50.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 -- 172.21.15.64:0/4084171687 learned_addr learned my addr 172.21.15.64:0/4084171687 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c5200640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 0x7fc9c009b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9c5c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c00ce730 0x7fc9c01f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 -- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 msgr2=0x7fc9c009b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 0x7fc9c009b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 -- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c00ce730 msgr2=0x7fc9c01f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.704+0000 7fc9bfe00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c00ce730 0x7fc9c01f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bfe00640 1 -- 172.21.15.64:0/4084171687 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c01f8d80 con 0x7fc9c00b3910 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bfe00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009850 tx=0x7fc9ac005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0b2040 con 0x7fc9c00b3910 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ac0a5c40 con 0x7fc9c00b3910 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c009d070 con 0x7fc9c00b3910 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac005030 con 0x7fc9c00b3910 2024-09-21T07:36:50.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c009d630 con 0x7fc9c00b3910 2024-09-21T07:36:50.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c00b33d0 con 0x7fc9c00b3910 2024-09-21T07:36:50.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.708+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9ac0051d0 con 0x7fc9c00b3910 2024-09-21T07:36:50.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.712+0000 7fc9bcc00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 0x7fc9a0075700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:50.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.712+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fc9ac12dd50 con 0x7fc9c00b3910 2024-09-21T07:36:50.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.712+0000 7fc9c5200640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 0x7fc9a0075700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:50.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.712+0000 7fc9c5200640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 0x7fc9a0075700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005fd0 tx=0x7fc9b4005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:50.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.716+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc9ac0164d0 con 0x7fc9c00b3910 2024-09-21T07:36:50.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.892+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc9c00cf450 con 0x7fc9c00b3910 2024-09-21T07:36:50.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9bcc00640 1 -- 172.21.15.64:0/4084171687 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) ==== 122+0+0 (secure 0 0 0) 0x7fc9ac0f8ed0 con 0x7fc9c00b3910 2024-09-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 msgr2=0x7fc9a0075700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 0x7fc9a0075700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005fd0 tx=0x7fc9b4005f40 comp rx=0 tx=0).stop 2024-09-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 msgr2=0x7fc9c015b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009850 tx=0x7fc9ac005de0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 shutdown_connections 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc9a00731f0 0x7fc9a0075700 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c00ce730 0x7fc9c01f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9c00b3910 0x7fc9c015b650 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 --2- 172.21.15.64:0/4084171687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9c009df30 0x7fc9c009b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 >> 172.21.15.64:0/4084171687 conn(0x7fc9c006d450 msgr2=0x7fc9c00cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 shutdown_connections 2024-09-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:50.896+0000 7fc9c7c00640 1 -- 172.21.15.64:0/4084171687 wait complete. 2024-09-21T07:36:50.920 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:36:50.920 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:36:51.019 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:36:51.108 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:36:51.108 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:51.109 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:51.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:36:51.117 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:36:51.118 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:51.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:36:51.127 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:36:51.127 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:51.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:36:51.168 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:36:51.168 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:36:51.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:36:51.182 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:36:51.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- 172.21.15.64:0/609504679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c06d020 msgr2=0x7fbf6c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 --2- 172.21.15.64:0/609504679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c06d020 0x7fbf6c06d430 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0748b0 tx=0x7fbf5401c890 comp rx=0 tx=0).stop 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- 172.21.15.64:0/609504679 shutdown_connections 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 --2- 172.21.15.64:0/609504679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c0cc070 0x7fbf6c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 --2- 172.21.15.64:0/609504679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c06d020 0x7fbf6c06d430 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 --2- 172.21.15.64:0/609504679 >> v2:172.21.15.90:3300/0 conn(0x7fbf6c15b810 0x7fbf6c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- 172.21.15.64:0/609504679 >> 172.21.15.64:0/609504679 conn(0x7fbf6c0d0de0 msgr2=0x7fbf6c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- 172.21.15.64:0/609504679 shutdown_connections 2024-09-21T07:36:51.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- 172.21.15.64:0/609504679 wait complete. 2024-09-21T07:36:51.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 Processor -- start 2024-09-21T07:36:51.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.372+0000 7fbf72a00640 1 -- start start 2024-09-21T07:36:51.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 0x7fbf6c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 0x7fbf6c1fa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c0742f0 con 0x7fbf6c0cc070 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c074170 con 0x7fbf6c15b810 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6c074470 con 0x7fbf6c06d020 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43160/0 (socket says 172.21.15.64:43160) 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 -- 172.21.15.64:0/1764250961 learned_addr learned my addr 172.21.15.64:0/1764250961 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf70a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 0x7fbf6c1fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf6be00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 0x7fbf6c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 -- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 msgr2=0x7fbf6c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 0x7fbf6c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 -- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 msgr2=0x7fbf6c1fa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 0x7fbf6c1fa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 -- 172.21.15.64:0/1764250961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c156150 con 0x7fbf6c0cc070 2024-09-21T07:36:51.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf70a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 0x7fbf6c1fa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf6be00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 0x7fbf6c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf63e00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fbf540b0040 tx=0x7fbf540a5610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540b2040 con 0x7fbf6c0cc070 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf540043b0 con 0x7fbf6c0cc070 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c0c9070 con 0x7fbf6c0cc070 2024-09-21T07:36:51.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540052d0 con 0x7fbf6c0cc070 2024-09-21T07:36:51.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c0c9630 con 0x7fbf6c0cc070 2024-09-21T07:36:51.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c0cc480 con 0x7fbf6c0cc070 2024-09-21T07:36:51.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.376+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf54005470 con 0x7fbf6c0cc070 2024-09-21T07:36:51.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.380+0000 7fbf68c00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 0x7fbf48075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.380+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fbf5412d940 con 0x7fbf6c0cc070 2024-09-21T07:36:51.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.380+0000 7fbf6be00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 0x7fbf48075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.380+0000 7fbf6be00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 0x7fbf48075710 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c005d10 tx=0x7fbf5c005dc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:51.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.384+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbf540bc060 con 0x7fbf6c0cc070 2024-09-21T07:36:51.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.600+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf6c0b5c10 con 0x7fbf6c0cc070 2024-09-21T07:36:51.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.600+0000 7fbf68c00640 1 -- 172.21.15.64:0/1764250961 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+3919 (secure 0 0 0) 0x7fbf540164b0 con 0x7fbf6c0cc070 2024-09-21T07:36:51.603 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:51.603 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":146,"btime":"2024-09-21T07:36:45:116384+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3210715296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3210715296},{"type":"v1","addr":"172.21.15.90:6836","nonce":3210715296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2516108418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2516108418},{"type":"v1","addr":"172.21.15.90:6837","nonce":2516108418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1783514383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1783514383},{"type":"v1","addr":"172.21.15.64:6833","nonce":1783514383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":10815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/2649526463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2649526463},{"type":"v1","addr":"172.21.15.64:6835","nonce":2649526463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":146}],"filesystems":[]} 2024-09-21T07:36:51.603 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 146 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 msgr2=0x7fbf48075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 0x7fbf48075710 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c005d10 tx=0x7fbf5c005dc0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 msgr2=0x7fbf6c1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fbf540b0040 tx=0x7fbf540a5610 comp rx=0 tx=0).stop 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 shutdown_connections 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf48073200 0x7fbf48075710 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf6c15b810 0x7fbf6c1fa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf6c0cc070 0x7fbf6c1592b0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 --2- 172.21.15.64:0/1764250961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf6c06d020 0x7fbf6c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 >> 172.21.15.64:0/1764250961 conn(0x7fbf6c0d0de0 msgr2=0x7fbf6c070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:51.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 shutdown_connections 2024-09-21T07:36:51.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.604+0000 7fbf72a00640 1 -- 172.21.15.64:0/1764250961 wait complete. 2024-09-21T07:36:51.626 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:36:51.626 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:36:51.626 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:36:51.626 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:36:51.627 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:36:51.627 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:36:51.627 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:36:51.627 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:36:51.627 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:36:51.627 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:36:51.627 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:36:51.627 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:36:51.628 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:36:51.628 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:36:51.628 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:36:51.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:36:51.637 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:36:51.637 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:36:51.643 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:36:51.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:36:51.644 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:36:51.644 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:36:51.647 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:36:51.647 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:36:51.688 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:36:51.688 DEBUG:teuthology.parallel:result is None 2024-09-21T07:36:51.690 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:36:51.690 DEBUG:teuthology.parallel:result is None 2024-09-21T07:36:51.691 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:36:51.691 DEBUG:teuthology.parallel:result is None 2024-09-21T07:36:51.692 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:36:51.692 DEBUG:teuthology.parallel:result is None 2024-09-21T07:36:51.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:36:51.790 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:36:51.791 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:36:51.794 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:36:51.794 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:36:51.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.856+0000 7fa806600640 1 -- 172.21.15.64:0/3644840948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7e4004da0 msgr2=0x7fa7e40051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.856+0000 7fa806600640 1 --2- 172.21.15.64:0/3644840948 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7e4004da0 0x7fa7e40051f0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009b50 tx=0x7fa7f001d270 comp rx=0 tx=0).stop 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.856+0000 7fa7ffe00640 1 -- 172.21.15.64:0/3644840948 reap_dead start 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.856+0000 7fa806600640 1 -- 172.21.15.64:0/3644840948 shutdown_connections 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.856+0000 7fa806600640 1 -- 172.21.15.64:0/3644840948 >> 172.21.15.64:0/3644840948 conn(0x7fa80006d450 msgr2=0x7fa8000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- 172.21.15.64:0/3644840948 shutdown_connections 2024-09-21T07:36:51.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- 172.21.15.64:0/3644840948 wait complete. 2024-09-21T07:36:51.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 Processor -- start 2024-09-21T07:36:51.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- start start 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e4004da0 0x7fa80009c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8000ad9b0 0x7fa8000addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8001673c0 con 0x7fa8001fb090 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa800167240 con 0x7fa7e4004da0 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.860+0000 7fa806600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa800167540 con 0x7fa8000ad9b0 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43200/0 (socket says 172.21.15.64:43200) 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 -- 172.21.15.64:0/3380038540 learned_addr learned my addr 172.21.15.64:0/3380038540 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7ff400640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e4004da0 0x7fa80009c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7ffe00640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8000ad9b0 0x7fa8000addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 -- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8000ad9b0 msgr2=0x7fa8000addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8000ad9b0 0x7fa8000addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 -- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e4004da0 msgr2=0x7fa80009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e4004da0 0x7fa80009c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 -- 172.21.15.64:0/3380038540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8000ae300 con 0x7fa8001fb090 2024-09-21T07:36:51.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7e00640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006de0 tx=0x7fa7e80049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8015020 con 0x7fa8001fb090 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7e8010980 con 0x7fa8001fb090 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8010dd0 con 0x7fa8001fb090 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80009cfe0 con 0x7fa8001fb090 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80009d5a0 con 0x7fa8001fb090 2024-09-21T07:36:51.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80009cd50 con 0x7fa8001fb090 2024-09-21T07:36:51.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.864+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa7e8018020 con 0x7fa8001fb090 2024-09-21T07:36:51.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.868+0000 7fa7f7400640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 0x7fa7dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:51.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.868+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fa7e8094dc0 con 0x7fa8001fb090 2024-09-21T07:36:51.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.868+0000 7fa7ff400640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 0x7fa7dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:51.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.868+0000 7fa7ff400640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 0x7fa7dc075710 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00ad000 tx=0x7fa7f00af040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:51.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:51.872+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa7e801f020 con 0x7fa8001fb090 2024-09-21T07:36:52.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.060+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa8000c3e00 con 0x7fa8001fb090 2024-09-21T07:36:52.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.168+0000 7fa7f7400640 1 -- 172.21.15.64:0/3380038540 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v198) ==== 97+0+0 (secure 0 0 0) 0x7fa8000ae300 con 0x7fa8001fb090 2024-09-21T07:36:52.171 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 msgr2=0x7fa7dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 0x7fa7dc075710 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00ad000 tx=0x7fa7f00af040 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 msgr2=0x7fa800165400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006de0 tx=0x7fa7e80049e0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 shutdown_connections 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa7dc073200 0x7fa7dc075710 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8000ad9b0 0x7fa8000addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8001fb090 0x7fa800165400 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 --2- 172.21.15.64:0/3380038540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e4004da0 0x7fa80009c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 >> 172.21.15.64:0/3380038540 conn(0x7fa80006d450 msgr2=0x7fa800073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:52.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 shutdown_connections 2024-09-21T07:36:52.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.172+0000 7fa806600640 1 -- 172.21.15.64:0/3380038540 wait complete. 2024-09-21T07:36:52.199 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:36:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 -- 172.21.15.64:0/1643730592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 msgr2=0x7f3af406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 --2- 172.21.15.64:0/1643730592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af406d020 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f3af40cc350 tx=0x7f3ae801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 -- 172.21.15.64:0/1643730592 shutdown_connections 2024-09-21T07:36:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 --2- 172.21.15.64:0/1643730592 >> v2:172.21.15.90:3300/0 conn(0x7f3af406d560 0x7f3af4073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 --2- 172.21.15.64:0/1643730592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af406d020 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 -- 172.21.15.64:0/1643730592 >> 172.21.15.64:0/1643730592 conn(0x7f3af40d0de0 msgr2=0x7f3af40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 -- 172.21.15.64:0/1643730592 shutdown_connections 2024-09-21T07:36:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 -- 172.21.15.64:0/1643730592 wait complete. 2024-09-21T07:36:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.356+0000 7f3afb600640 1 Processor -- start 2024-09-21T07:36:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- start start 2024-09-21T07:36:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 0x7f3af41f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af4156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3af40c5da0 con 0x7f3af40cf8b0 2024-09-21T07:36:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3af40c5c20 con 0x7f3af406d560 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3af416a260 con 0x7f3af4073b40 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af4156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af3e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 0x7f3af41f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:40302/0 (socket says 172.21.15.64:40302) 2024-09-21T07:36:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 -- 172.21.15.64:0/2750401401 learned_addr learned my addr 172.21.15.64:0/2750401401 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 -- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 msgr2=0x7f3af41f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 0x7f3af41f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 -- 172.21.15.64:0/2750401401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 msgr2=0x7f3af4156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af4156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 -- 172.21.15.64:0/2750401401 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af40c9b20 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af3e00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 0x7f3af41f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af9600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af4156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af8c00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80194d0 tx=0x7f3ae80a5740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80bc070 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ae8004430 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80b2040 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af40c9fa0 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.360+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41fcb80 con 0x7f3af406d560 2024-09-21T07:36:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af4073600 con 0x7f3af406d560 2024-09-21T07:36:52.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3ae8005290 con 0x7f3af406d560 2024-09-21T07:36:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3af0c00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 0x7f3ad4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7f3ae812d7f0 con 0x7f3af406d560 2024-09-21T07:36:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3af3e00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 0x7f3ad4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.364+0000 7f3af3e00640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 0x7f3ad4075710 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3af4160140 tx=0x7f3ae000b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.368+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3ae80164b0 con 0x7f3af406d560 2024-09-21T07:36:52.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.608+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3af4070a80 con 0x7f3af406d560 2024-09-21T07:36:52.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.608+0000 7f3af0c00640 1 -- 172.21.15.64:0/2750401401 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v36) ==== 80+0+5304 (secure 0 0 0) 0x7f3ae80f83f0 con 0x7f3af406d560 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:36:52.612 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.613 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.615 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.616 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.617 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.618 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.619 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:36:52.620 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:36:52.621 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.622 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:36:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.624 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:36:52.625 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 msgr2=0x7f3ad4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 0x7f3ad4075710 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3af4160140 tx=0x7f3ae000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 msgr2=0x7f3af40c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80194d0 tx=0x7f3ae80a5740 comp rx=0 tx=0).stop 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 shutdown_connections 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ad4073200 0x7f3ad4075710 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3af40cf8b0 0x7f3af4156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3af4073b40 0x7f3af41f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 --2- 172.21.15.64:0/2750401401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3af406d560 0x7f3af40c95e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 >> 172.21.15.64:0/2750401401 conn(0x7f3af40d0de0 msgr2=0x7f3af415b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 shutdown_connections 2024-09-21T07:36:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.612+0000 7f3afb600640 1 -- 172.21.15.64:0/2750401401 wait complete. 2024-09-21T07:36:52.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:36:52.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- 172.21.15.64:0/1324216470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 msgr2=0x7f21580700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 --2- 172.21.15.64:0/1324216470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f21580700b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f215806f220 tx=0x7f214801c680 comp rx=0 tx=0).stop 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- 172.21.15.64:0/1324216470 shutdown_connections 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 --2- 172.21.15.64:0/1324216470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f21580700b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- 172.21.15.64:0/1324216470 >> 172.21.15.64:0/1324216470 conn(0x7f21580ccbe0 msgr2=0x7f21580ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- 172.21.15.64:0/1324216470 shutdown_connections 2024-09-21T07:36:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- 172.21.15.64:0/1324216470 wait complete. 2024-09-21T07:36:52.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 Processor -- start 2024-09-21T07:36:52.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.792+0000 7f215cc00640 1 -- start start 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f2158154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2158153550 0x7f21581546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f215816a240 con 0x7f21580709b0 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f215816a0c0 con 0x7f215815edb0 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f215816a3c0 con 0x7f2158153550 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43236/0 (socket says 172.21.15.64:43236) 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 -- 172.21.15.64:0/279005994 learned_addr learned my addr 172.21.15.64:0/279005994 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2156800640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2158153550 0x7f21581546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f214fe00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f2158154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 -- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2158153550 msgr2=0x7f21581546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2158153550 0x7f21581546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 -- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 msgr2=0x7f2158154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f2158154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 -- 172.21.15.64:0/279005994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215815b4b0 con 0x7f21580709b0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f214fe00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f2158154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f2155e00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f214801cf20 tx=0x7f2148005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480ad050 con 0x7f21580709b0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2148004310 con 0x7f21580709b0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215815b790 con 0x7f21580709b0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150001a60 con 0x7f21580709b0 2024-09-21T07:36:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215815bd50 con 0x7f21580709b0 2024-09-21T07:36:52.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.796+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21580700b0 con 0x7f21580709b0 2024-09-21T07:36:52.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.800+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f21480b0070 con 0x7f21580709b0 2024-09-21T07:36:52.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.800+0000 7f214e000640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 0x7f2134075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:52.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.800+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7f214812e220 con 0x7f21580709b0 2024-09-21T07:36:52.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.800+0000 7f214fe00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 0x7f2134075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:52.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.800+0000 7f214fe00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 0x7f2134075770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2158073300 tx=0x7f2140009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:52.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.804+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f21480b8070 con 0x7f21580709b0 2024-09-21T07:36:52.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.984+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f215809da20 con 0x7f21580709b0 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.984+0000 7f214e000640 1 -- 172.21.15.64:0/279005994 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v200) ==== 84+0+65 (secure 0 0 0) 0x7f2148016330 con 0x7f21580709b0 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:36:52.987 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:36:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 msgr2=0x7f2134075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 0x7f2134075770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2158073300 tx=0x7f2140009040 comp rx=0 tx=0).stop 2024-09-21T07:36:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 msgr2=0x7f2158166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f214801cf20 tx=0x7f2148005750 comp rx=0 tx=0).stop 2024-09-21T07:36:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 shutdown_connections 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2134073260 0x7f2134075770 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2158153550 0x7f21581546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f215815edb0 0x7f2158154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 --2- 172.21.15.64:0/279005994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21580709b0 0x7f2158166bc0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 >> 172.21.15.64:0/279005994 conn(0x7f21580ccbe0 msgr2=0x7f2158156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 shutdown_connections 2024-09-21T07:36:52.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:52.988+0000 7f215cc00640 1 -- 172.21.15.64:0/279005994 wait complete. 2024-09-21T07:36:53.010 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:36:53.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:36:53.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 -- 172.21.15.64:0/2264411164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a200add30 msgr2=0x7f4a200b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 --2- 172.21.15.64:0/2264411164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a200add30 0x7f4a200b0240 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f4a20075cd0 tx=0x7f4a1401c800 comp rx=0 tx=0).stop 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 -- 172.21.15.64:0/2264411164 shutdown_connections 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 --2- 172.21.15.64:0/2264411164 >> v2:172.21.15.90:3300/0 conn(0x7f4a2006cdf0 0x7f4a2006d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 --2- 172.21.15.64:0/2264411164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a200add30 0x7f4a200b0240 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 -- 172.21.15.64:0/2264411164 >> 172.21.15.64:0/2264411164 conn(0x7f4a200d1020 msgr2=0x7f4a200d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 -- 172.21.15.64:0/2264411164 shutdown_connections 2024-09-21T07:36:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.172+0000 7f4a26200640 1 -- 172.21.15.64:0/2264411164 wait complete. 2024-09-21T07:36:53.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 Processor -- start 2024-09-21T07:36:53.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 -- start start 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2006cdf0 0x7f4a201f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a200add30 0x7f4a2006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4a20153400 con 0x7f4a20073fa0 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2015cc50 con 0x7f4a2006cdf0 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a26200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f4a20153580 con 0x7f4a200add30 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43254/0 (socket says 172.21.15.64:43254) 2024-09-21T07:36:53.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 -- 172.21.15.64:0/1910045536 learned_addr learned my addr 172.21.15.64:0/1910045536 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a24e00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2006cdf0 0x7f4a201f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a25800640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a200add30 0x7f4a2006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 -- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a200add30 msgr2=0x7f4a2006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a200add30 0x7f4a2006fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 -- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2006cdf0 msgr2=0x7f4a201f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2006cdf0 0x7f4a201f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 -- 172.21.15.64:0/1910045536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2014c730 con 0x7f4a20073fa0 2024-09-21T07:36:53.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1fe00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00e7c0 tx=0x7f4a0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.176+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00cc60 con 0x7f4a20073fa0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a0c00ce20 con 0x7f4a20073fa0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c005280 con 0x7f4a20073fa0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2014ca10 con 0x7f4a20073fa0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2006f930 con 0x7f4a20073fa0 2024-09-21T07:36:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2014cf30 con 0x7f4a20073fa0 2024-09-21T07:36:53.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4a0c005420 con 0x7f4a20073fa0 2024-09-21T07:36:53.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a1cc00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 0x7f4a00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:53.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7f4a0c094870 con 0x7f4a20073fa0 2024-09-21T07:36:53.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.180+0000 7f4a24e00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 0x7f4a00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:53.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.184+0000 7f4a24e00640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 0x7f4a00075740 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4a140af000 tx=0x7f4a1401b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:53.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.184+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4a0c05f400 con 0x7f4a20073fa0 2024-09-21T07:36:53.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:53.360+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4a2006f720 con 0x7f4a20073fa0 2024-09-21T07:36:54.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.171+0000 7f4a1cc00640 1 -- 172.21.15.64:0/1910045536 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v201) ==== 138+0+0 (secure 0 0 0) 0x7f4a0c063e30 con 0x7f4a20073fa0 2024-09-21T07:36:54.173 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:36:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.171+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 msgr2=0x7f4a00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.171+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 0x7f4a00075740 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4a140af000 tx=0x7f4a1401b040 comp rx=0 tx=0).stop 2024-09-21T07:36:54.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.171+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 msgr2=0x7f4a201f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.171+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00e7c0 tx=0x7f4a0c00ec80 comp rx=0 tx=0).stop 2024-09-21T07:36:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 shutdown_connections 2024-09-21T07:36:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4a00073230 0x7f4a00075740 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a200add30 0x7f4a2006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a20073fa0 0x7f4a201f9640 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 --2- 172.21.15.64:0/1910045536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2006cdf0 0x7f4a201f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 >> 172.21.15.64:0/1910045536 conn(0x7f4a200d1020 msgr2=0x7f4a200b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 shutdown_connections 2024-09-21T07:36:54.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.175+0000 7f4a26200640 1 -- 172.21.15.64:0/1910045536 wait complete. 2024-09-21T07:36:54.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:36:54.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- 172.21.15.64:0/3050160883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd940706c0 msgr2=0x7fdd940b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3050160883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd940706c0 0x7fdd940b3ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd940b3130 tx=0x7fdd8c01ccb0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- 172.21.15.64:0/3050160883 shutdown_connections 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3050160883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd940706c0 0x7fdd940b3ce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3050160883 >> v2:172.21.15.90:3300/0 conn(0x7fdd9415ec20 0x7fdd940ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- 172.21.15.64:0/3050160883 >> 172.21.15.64:0/3050160883 conn(0x7fdd940ccbe0 msgr2=0x7fdd940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- 172.21.15.64:0/3050160883 shutdown_connections 2024-09-21T07:36:54.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- 172.21.15.64:0/3050160883 wait complete. 2024-09-21T07:36:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 Processor -- start 2024-09-21T07:36:54.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.367+0000 7fdd9b800640 1 -- start start 2024-09-21T07:36:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd9415ec20 0x7fdd94154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 0x7fdd941fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:54.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94168e10 con 0x7fdd940ca990 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94168c90 con 0x7fdd9415ec20 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdd94168f90 con 0x7fdd941555d0 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43258/0 (socket says 172.21.15.64:43258) 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 -- 172.21.15.64:0/3031865131 learned_addr learned my addr 172.21.15.64:0/3031865131 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd99800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 0x7fdd941fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd93e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd9415ec20 0x7fdd94154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 -- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 msgr2=0x7fdd941fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 0x7fdd941fbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 -- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd9415ec20 msgr2=0x7fdd94154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd9415ec20 0x7fdd94154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 -- 172.21.15.64:0/3031865131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd940b1300 con 0x7fdd940ca990 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd99800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 0x7fdd941fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd98e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e770 tx=0x7fdd8800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:54.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800ccc0 con 0x7fdd940ca990 2024-09-21T07:36:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd8800ee80 con 0x7fdd940ca990 2024-09-21T07:36:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd940b15e0 con 0x7fdd940ca990 2024-09-21T07:36:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800ce60 con 0x7fdd940ca990 2024-09-21T07:36:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd940adec0 con 0x7fdd940ca990 2024-09-21T07:36:54.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd940b3ce0 con 0x7fdd940ca990 2024-09-21T07:36:54.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdd88004260 con 0x7fdd940ca990 2024-09-21T07:36:54.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 0x7fdd74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:54.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5619+0+0 (secure 0 0 0) 0x7fdd88094c40 con 0x7fdd940ca990 2024-09-21T07:36:54.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd93e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 0x7fdd74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:54.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.375+0000 7fdd93e00640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 0x7fdd74075710 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fdd940b0750 tx=0x7fdd80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:54.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.379+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdd8805f6d0 con 0x7fdd940ca990 2024-09-21T07:36:54.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:54.555+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdd94156d30 con 0x7fdd940ca990 2024-09-21T07:36:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.171+0000 7fdd90c00640 1 -- 172.21.15.64:0/3031865131 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v202) ==== 170+0+0 (secure 0 0 0) 0x7fdd88064100 con 0x7fdd940ca990 2024-09-21T07:36:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 msgr2=0x7fdd74075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 0x7fdd74075710 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fdd940b0750 tx=0x7fdd80009040 comp rx=0 tx=0).stop 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 msgr2=0x7fdd940ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e770 tx=0x7fdd8800ec30 comp rx=0 tx=0).stop 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 shutdown_connections 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd74073200 0x7fdd74075710 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd941555d0 0x7fdd941fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd9415ec20 0x7fdd94154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 --2- 172.21.15.64:0/3031865131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd940ca990 0x7fdd940ae6c0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 >> 172.21.15.64:0/3031865131 conn(0x7fdd940ccbe0 msgr2=0x7fdd9415caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 shutdown_connections 2024-09-21T07:36:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.175+0000 7fdd9b800640 1 -- 172.21.15.64:0/3031865131 wait complete. 2024-09-21T07:36:55.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- 172.21.15.64:0/3768901676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac15ee70 msgr2=0x7f8cac06ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/3768901676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac15ee70 0x7f8cac06ffa0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009c80 tx=0x7f8ca401cd60 comp rx=0 tx=0).stop 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- 172.21.15.64:0/3768901676 shutdown_connections 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/3768901676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac15ee70 0x7f8cac06ffa0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- 172.21.15.64:0/3768901676 >> 172.21.15.64:0/3768901676 conn(0x7f8cac06d450 msgr2=0x7f8cac0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- 172.21.15.64:0/3768901676 shutdown_connections 2024-09-21T07:36:55.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- 172.21.15.64:0/3768901676 wait complete. 2024-09-21T07:36:55.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 Processor -- start 2024-09-21T07:36:55.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.379+0000 7f8cb2e00640 1 -- start start 2024-09-21T07:36:55.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 0x7f8cac14bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cac15ee70 0x7f8cac1fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac16a1c0 con 0x7f8cac0cc960 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac16a040 con 0x7f8cac0b3850 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac16a340 con 0x7f8cac15ee70 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44298/0 (socket says 172.21.15.64:44298) 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 -- 172.21.15.64:0/2037027329 learned_addr learned my addr 172.21.15.64:0/2037027329 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb0e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cac15ee70 0x7f8cac1fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cabe00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 0x7f8cac14bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 -- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cac15ee70 msgr2=0x7f8cac1fc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cac15ee70 0x7f8cac1fc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 -- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 msgr2=0x7f8cac14bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:55.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 0x7f8cac14bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:55.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 -- 172.21.15.64:0/2037027329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac1fd2e0 con 0x7f8cac0cc960 2024-09-21T07:36:55.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cabe00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 0x7f8cac14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:55.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca3e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b3e0 tx=0x7f8c9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:55.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94015020 con 0x7f8cac0cc960 2024-09-21T07:36:55.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c94011920 con 0x7f8cac0cc960 2024-09-21T07:36:55.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94011d70 con 0x7f8cac0cc960 2024-09-21T07:36:55.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac0b1f40 con 0x7f8cac0cc960 2024-09-21T07:36:55.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac14c2a0 con 0x7f8cac0cc960 2024-09-21T07:36:55.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.383+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cac0b3140 con 0x7f8cac0cc960 2024-09-21T07:36:55.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.387+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c94018020 con 0x7f8cac0cc960 2024-09-21T07:36:55.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.387+0000 7f8ca8c00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 0x7f8c88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:55.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.387+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6001+0+0 (secure 0 0 0) 0x7f8c940943e0 con 0x7f8cac0cc960 2024-09-21T07:36:55.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.387+0000 7f8cabe00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 0x7f8c88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:55.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.387+0000 7f8cabe00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 0x7f8c88075740 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0016a0 tx=0x7f8c9c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:55.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.391+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8c9401f030 con 0x7f8cac0cc960 2024-09-21T07:36:55.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:55.607+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8cac1fd000 con 0x7f8cac0cc960 2024-09-21T07:36:56.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.203+0000 7f8ca8c00640 1 -- 172.21.15.64:0/2037027329 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 29 and data pool 30 v149) ==== 174+0+0 (secure 0 0 0) 0x7f8c9405ec70 con 0x7f8cac0cc960 2024-09-21T07:36:56.207 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 29 and data pool 30 2024-09-21T07:36:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.211+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 msgr2=0x7f8c88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.211+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 0x7f8c88075740 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0016a0 tx=0x7f8c9c009040 comp rx=0 tx=0).stop 2024-09-21T07:36:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.211+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 msgr2=0x7f8cac1fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.211+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b3e0 tx=0x7f8c9400b8a0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 shutdown_connections 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c88073230 0x7f8c88075740 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cac15ee70 0x7f8cac1fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cac0cc960 0x7f8cac1fc3a0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 --2- 172.21.15.64:0/2037027329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cac0b3850 0x7f8cac14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.215+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 >> 172.21.15.64:0/2037027329 conn(0x7f8cac06d450 msgr2=0x7f8cac073c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:56.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.219+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 shutdown_connections 2024-09-21T07:36:56.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.219+0000 7f8cb2e00640 1 -- 172.21.15.64:0/2037027329 wait complete. 2024-09-21T07:36:56.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:56.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 -- 172.21.15.64:0/3737922822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b4170 msgr2=0x7fe1180b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 --2- 172.21.15.64:0/3737922822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b4170 0x7fe1180b1be0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fe1180ced50 tx=0x7fe10801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 -- 172.21.15.64:0/3737922822 shutdown_connections 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 --2- 172.21.15.64:0/3737922822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b2fb0 0x7fe1180b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 --2- 172.21.15.64:0/3737922822 >> v2:172.21.15.90:3300/0 conn(0x7fe1180cc4e0 0x7fe1180b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 --2- 172.21.15.64:0/3737922822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b4170 0x7fe1180b1be0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 -- 172.21.15.64:0/3737922822 >> 172.21.15.64:0/3737922822 conn(0x7fe1180ccbe0 msgr2=0x7fe1180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 -- 172.21.15.64:0/3737922822 shutdown_connections 2024-09-21T07:36:56.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.411+0000 7fe11da00640 1 -- 172.21.15.64:0/3737922822 wait complete. 2024-09-21T07:36:56.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 Processor -- start 2024-09-21T07:36:56.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- start start 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b4170 0x7fe118151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1180cc4e0 0x7fe1180cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe118167130 con 0x7fe1180b2fb0 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1180cc270 con 0x7fe1180cc4e0 2024-09-21T07:36:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe1181672b0 con 0x7fe1180b4170 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44322/0 (socket says 172.21.15.64:44322) 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 -- 172.21.15.64:0/2079280813 learned_addr learned my addr 172.21.15.64:0/2079280813 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe117400640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1180cc4e0 0x7fe1180cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116000640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b4170 0x7fe118151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 -- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b4170 msgr2=0x7fe118151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b4170 0x7fe118151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 -- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1180cc4e0 msgr2=0x7fe1180cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1180cc4e0 0x7fe1180cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 -- 172.21.15.64:0/2079280813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11809bdd0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe116a00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fe10801cda0 tx=0x7fe1080a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080bc070 con 0x7fe1180b2fb0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1080043b0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080b2040 con 0x7fe1180b2fb0 2024-09-21T07:36:56.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe118200de0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.415+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1180ada20 con 0x7fe1180b2fb0 2024-09-21T07:36:56.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.419+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1180b33c0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.419+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe108003860 con 0x7fe1180b2fb0 2024-09-21T07:36:56.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.419+0000 7fe10ea00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 0x7fe0f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.419+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7fe10812dc90 con 0x7fe1180b2fb0 2024-09-21T07:36:56.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.423+0000 7fe116000640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 0x7fe0f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.423+0000 7fe116000640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 0x7fe0f8075710 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe11809ae40 tx=0x7fe10400d4b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:56.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.427+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe1080f3290 con 0x7fe1180b2fb0 2024-09-21T07:36:56.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe11806f3f0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe10ea00640 1 -- 172.21.15.64:0/2079280813 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) ==== 74+0+16909 (secure 0 0 0) 0x7fe1080164b0 con 0x7fe1180b2fb0 2024-09-21T07:36:56.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:56.607 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":203,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:55.615250+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:36:53.378206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-21T07:36:54.572346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:56.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 msgr2=0x7fe0f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 0x7fe0f8075710 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe11809ae40 tx=0x7fe10400d4b0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 msgr2=0x7fe11809b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fe10801cda0 tx=0x7fe1080a5650 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 shutdown_connections 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe0f8073200 0x7fe0f8075710 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1180cc4e0 0x7fe1180cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe1180b4170 0x7fe118151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 --2- 172.21.15.64:0/2079280813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1180b2fb0 0x7fe11809b610 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 >> 172.21.15.64:0/2079280813 conn(0x7fe1180ccbe0 msgr2=0x7fe1180b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.607+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 shutdown_connections 2024-09-21T07:36:56.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.611+0000 7fe11da00640 1 -- 172.21.15.64:0/2079280813 wait complete. 2024-09-21T07:36:56.629 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:56.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 -- 172.21.15.64:0/4284717729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc15edb0 msgr2=0x7fc4cc0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/4284717729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc15edb0 0x7fc4cc0700b0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc06f220 tx=0x7fc4bc01c820 comp rx=0 tx=0).stop 2024-09-21T07:36:56.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 -- 172.21.15.64:0/4284717729 shutdown_connections 2024-09-21T07:36:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/4284717729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc15edb0 0x7fc4cc0700b0 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 -- 172.21.15.64:0/4284717729 >> 172.21.15.64:0/4284717729 conn(0x7fc4cc0ccbe0 msgr2=0x7fc4cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 -- 172.21.15.64:0/4284717729 shutdown_connections 2024-09-21T07:36:56.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.787+0000 7fc4d0e00640 1 -- 172.21.15.64:0/4284717729 wait complete. 2024-09-21T07:36:56.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 Processor -- start 2024-09-21T07:36:56.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- start start 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 0x7fc4cc14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 0x7fc4cc154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc16a240 con 0x7fc4cc0709b0 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc16a0c0 con 0x7fc4cc14cd70 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc16a3c0 con 0x7fc4cc15edb0 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44338/0 (socket says 172.21.15.64:44338) 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 -- 172.21.15.64:0/661716258 learned_addr learned my addr 172.21.15.64:0/661716258 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:56.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4ca800640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 0x7fc4cc154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 -- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 msgr2=0x7fc4cc14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c3e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 0x7fc4cc14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 0x7fc4cc14c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 -- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 msgr2=0x7fc4cc154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 0x7fc4cc154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 -- 172.21.15.64:0/661716258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc14cb60 con 0x7fc4cc0709b0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4ca800640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 0x7fc4cc154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c3e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 0x7fc4cc14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c9e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c10 tx=0x7fc4bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0042f0 con 0x7fc4cc0709b0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4bc005030 con 0x7fc4cc0709b0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc09d760 con 0x7fc4cc0709b0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc005480 con 0x7fc4cc0709b0 2024-09-21T07:36:56.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.791+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc09c120 con 0x7fc4cc0709b0 2024-09-21T07:36:56.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.795+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc0700b0 con 0x7fc4cc0709b0 2024-09-21T07:36:56.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.795+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4bc0bf020 con 0x7fc4cc0709b0 2024-09-21T07:36:56.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.795+0000 7fc4c2000640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 0x7fc4a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:56.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.795+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7fc4bc12f180 con 0x7fc4cc0709b0 2024-09-21T07:36:56.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.795+0000 7fc4c3e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 0x7fc4a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:56.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.799+0000 7fc4c3e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 0x7fc4a8075740 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc09d240 tx=0x7fc4b4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:56.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.799+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc4bc016410 con 0x7fc4cc0709b0 2024-09-21T07:36:56.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.975+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4cc09da20 con 0x7fc4cc0709b0 2024-09-21T07:36:56.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4c2000640 1 -- 172.21.15.64:0/661716258 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) ==== 74+0+16909 (secure 0 0 0) 0x7fc4bc0fa080 con 0x7fc4cc0709b0 2024-09-21T07:36:56.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:56.978 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":203,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:55.615250+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:36:53.378206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-21T07:36:54.572346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 msgr2=0x7fc4a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 0x7fc4a8075740 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc09d240 tx=0x7fc4b4009040 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 msgr2=0x7fc4cc09cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c10 tx=0x7fc4bc004040 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 shutdown_connections 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4a8073230 0x7fc4a8075740 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4cc14cd70 0x7fc4cc154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4cc15edb0 0x7fc4cc14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 --2- 172.21.15.64:0/661716258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4cc0709b0 0x7fc4cc09cc00 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:56.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 >> 172.21.15.64:0/661716258 conn(0x7fc4cc0ccbe0 msgr2=0x7fc4cc15a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:56.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 shutdown_connections 2024-09-21T07:36:56.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:56.979+0000 7fc4d0e00640 1 -- 172.21.15.64:0/661716258 wait complete. 2024-09-21T07:36:57.000 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 -- 172.21.15.64:0/404046279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 msgr2=0x7f274c0b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 --2- 172.21.15.64:0/404046279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c0b4cd0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f274c15fb40 tx=0x7f273c01c720 comp rx=0 tx=0).stop 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 -- 172.21.15.64:0/404046279 shutdown_connections 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 --2- 172.21.15.64:0/404046279 >> v2:172.21.15.90:3300/0 conn(0x7f274c0aefe0 0x7f274c0af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 --2- 172.21.15.64:0/404046279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c0b4cd0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 -- 172.21.15.64:0/404046279 >> 172.21.15.64:0/404046279 conn(0x7f274c06d450 msgr2=0x7f274c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 -- 172.21.15.64:0/404046279 shutdown_connections 2024-09-21T07:36:57.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.163+0000 7f2753000640 1 -- 172.21.15.64:0/404046279 wait complete. 2024-09-21T07:36:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 Processor -- start 2024-09-21T07:36:57.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- start start 2024-09-21T07:36:57.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f274c0aefe0 0x7f274c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:57.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:57.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 0x7f274c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:57.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0ce920 con 0x7f274c155560 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0ce7a0 con 0x7f274c15eb80 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f274c0ceaa0 con 0x7f274c0aefe0 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44352/0 (socket says 172.21.15.64:44352) 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 -- 172.21.15.64:0/1055315253 learned_addr learned my addr 172.21.15.64:0/1055315253 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:57.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f274be00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f274c0aefe0 0x7f274c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2751000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 0x7f274c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 -- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f274c0aefe0 msgr2=0x7f274c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f274c0aefe0 0x7f274c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 -- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 msgr2=0x7f274c15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 0x7f274c15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 -- 172.21.15.64:0/1055315253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c1f88f0 con 0x7f274c155560 2024-09-21T07:36:57.171 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2751000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 0x7f274c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2743e00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f273400c3f0 tx=0x7f273400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734017070 con 0x7f274c155560 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2734003600 con 0x7f274c155560 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734003a50 con 0x7f274c155560 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c0cb3d0 con 0x7f274c155560 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.167+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c0cb990 con 0x7f274c155560 2024-09-21T07:36:57.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274c0af3f0 con 0x7f274c155560 2024-09-21T07:36:57.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f273401a070 con 0x7f274c155560 2024-09-21T07:36:57.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f2748c00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 0x7f2728075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:57.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7f2734093510 con 0x7f274c155560 2024-09-21T07:36:57.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f274be00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 0x7f2728075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:57.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.171+0000 7f274be00640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 0x7f2728075740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f273c0ae000 tx=0x7f273c01af60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:57.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.175+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f274c0b5210 con 0x7f274c155560 2024-09-21T07:36:57.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:57.395+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f274c0704c0 con 0x7f274c155560 2024-09-21T07:36:58.174 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:36:58.175+0000 7fef3bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:36:58.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.215+0000 7f2748c00640 1 -- 172.21.15.64:0/1055315253 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v151) ==== 118+0+0 (secure 0 0 0) 0x7f273405dd40 con 0x7f274c155560 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 msgr2=0x7f2728075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 0x7f2728075740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f273c0ae000 tx=0x7f273c01af60 comp rx=0 tx=0).stop 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 msgr2=0x7f274c15a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f273400c3f0 tx=0x7f273400c8b0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 shutdown_connections 2024-09-21T07:36:58.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2728073230 0x7f2728075740 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f274c15eb80 0x7f274c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f274c155560 0x7f274c15a060 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 --2- 172.21.15.64:0/1055315253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f274c0aefe0 0x7f274c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 >> 172.21.15.64:0/1055315253 conn(0x7f274c06d450 msgr2=0x7f274c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 shutdown_connections 2024-09-21T07:36:58.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.219+0000 7f2753000640 1 -- 172.21.15.64:0/1055315253 wait complete. 2024-09-21T07:36:58.244 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:36:58.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 -- 172.21.15.64:0/3793624183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f528c004810 msgr2=0x7f528c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 --2- 172.21.15.64:0/3793624183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f528c004810 0x7f528c004c20 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f5290009b40 tx=0x7f529001d250 comp rx=0 tx=0).stop 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 -- 172.21.15.64:0/3793624183 shutdown_connections 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 --2- 172.21.15.64:0/3793624183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f528c004810 0x7f528c004c20 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 -- 172.21.15.64:0/3793624183 >> 172.21.15.64:0/3793624183 conn(0x7f52a806feb0 msgr2=0x7f52a80702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 -- 172.21.15.64:0/3793624183 shutdown_connections 2024-09-21T07:36:58.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.411+0000 7f52ad000640 1 -- 172.21.15.64:0/3793624183 wait complete. 2024-09-21T07:36:58.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 Processor -- start 2024-09-21T07:36:58.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 -- start start 2024-09-21T07:36:58.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f528c004810 0x7f52a814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:58.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52a814de90 0x7f52a81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:58.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:58.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f52a8074ec0 con 0x7f52a8151f20 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52a8074d40 con 0x7f528c004810 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52ad000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f52a80cf840 con 0x7f52a814de90 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44376/0 (socket says 172.21.15.64:44376) 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 -- 172.21.15.64:0/1643681701 learned_addr learned my addr 172.21.15.64:0/1643681701 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f529fe00640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52a814de90 0x7f52a81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7400640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f528c004810 0x7f52a814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 -- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52a814de90 msgr2=0x7f52a81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52a814de90 0x7f52a81519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 -- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f528c004810 msgr2=0x7f52a814d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f528c004810 0x7f52a814d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.415+0000 7f52a7e00640 1 -- 172.21.15.64:0/1643681701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a8152330 con 0x7f52a8151f20 2024-09-21T07:36:58.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f52a7e00640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f90 tx=0x7f52a000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0010950 con 0x7f52a8151f20 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a0017070 con 0x7f52a8151f20 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a8150440 con 0x7f52a8151f20 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0011460 con 0x7f52a8151f20 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a814fba0 con 0x7f52a8151f20 2024-09-21T07:36:58.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a814f630 con 0x7f52a8151f20 2024-09-21T07:36:58.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f52a0011600 con 0x7f52a8151f20 2024-09-21T07:36:58.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 0x7f5284075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:58.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.419+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f52a0094800 con 0x7f52a8151f20 2024-09-21T07:36:58.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.423+0000 7f52a7400640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 0x7f5284075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:58.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.423+0000 7f52a7400640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 0x7f5284075710 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5298000c10 tx=0x7f529800aac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:58.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.423+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f52a8152330 con 0x7f52a8151f20 2024-09-21T07:36:58.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-21T07:36:58.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:58.635+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f52a80d0190 con 0x7f52a8151f20 2024-09-21T07:36:59.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.223+0000 7f529f400640 1 -- 172.21.15.64:0/1643681701 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v152) ==== 122+0+0 (secure 0 0 0) 0x7f52a005f5f0 con 0x7f52a8151f20 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 msgr2=0x7f5284075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 0x7f5284075710 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5298000c10 tx=0x7f529800aac0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 msgr2=0x7f52a80b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f90 tx=0x7f52a000ea10 comp rx=0 tx=0).stop 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 shutdown_connections 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5284073200 0x7f5284075710 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52a8151f20 0x7f52a80b3ef0 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52a814de90 0x7f52a81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 --2- 172.21.15.64:0/1643681701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f528c004810 0x7f52a814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 >> 172.21.15.64:0/1643681701 conn(0x7f52a806feb0 msgr2=0x7f52a80715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:59.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 shutdown_connections 2024-09-21T07:36:59.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.227+0000 7f52ad000640 1 -- 172.21.15.64:0/1643681701 wait complete. 2024-09-21T07:36:59.249 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:36:59.249 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:36:59.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 -- 172.21.15.64:0/2814596289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa538003b20 msgr2=0x7fa538003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 --2- 172.21.15.64:0/2814596289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa538003b20 0x7fa538003f90 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fa544009b60 tx=0x7fa54401d1f0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa559200640 1 -- 172.21.15.64:0/2814596289 reap_dead start 2024-09-21T07:36:59.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 -- 172.21.15.64:0/2814596289 shutdown_connections 2024-09-21T07:36:59.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 -- 172.21.15.64:0/2814596289 >> 172.21.15.64:0/2814596289 conn(0x7fa5540ccbe0 msgr2=0x7fa5540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:59.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 -- 172.21.15.64:0/2814596289 shutdown_connections 2024-09-21T07:36:59.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.411+0000 7fa55b200640 1 -- 172.21.15.64:0/2814596289 wait complete. 2024-09-21T07:36:59.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 Processor -- start 2024-09-21T07:36:59.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 -- start start 2024-09-21T07:36:59.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa538003b20 0x7fa5540cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5541f6730 0x7fa5540d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa554166ef0 con 0x7fa5541f6b40 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa554166d70 con 0x7fa538003b20 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa55b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa554167070 con 0x7fa5541f6730 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.415+0000 7fa559200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44390/0 (socket says 172.21.15.64:44390) 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 -- 172.21.15.64:0/1094255883 learned_addr learned my addr 172.21.15.64:0/1094255883 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa553e00640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa538003b20 0x7fa5540cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa553400640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5541f6730 0x7fa5540d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 -- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5541f6730 msgr2=0x7fa5540d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5541f6730 0x7fa5540d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 -- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa538003b20 msgr2=0x7fa5540cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa538003b20 0x7fa5540cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 -- 172.21.15.64:0/1094255883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55409bd20 con 0x7fa5541f6b40 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa559200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fa54c006fd0 tx=0x7fa54c006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00fa20 con 0x7fa5541f6b40 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa54c00fc00 con 0x7fa5541f6b40 2024-09-21T07:36:59.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c011430 con 0x7fa5541f6b40 2024-09-21T07:36:59.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55409c000 con 0x7fa5541f6b40 2024-09-21T07:36:59.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55409c5c0 con 0x7fa5541f6b40 2024-09-21T07:36:59.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5540700b0 con 0x7fa5541f6b40 2024-09-21T07:36:59.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.419+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa54c018020 con 0x7fa5541f6b40 2024-09-21T07:36:59.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.423+0000 7fa54be00640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 0x7fa534075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.423+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fa54c094b00 con 0x7fa5541f6b40 2024-09-21T07:36:59.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.423+0000 7fa553e00640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 0x7fa534075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.423+0000 7fa553e00640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 0x7fa534075740 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ae000 tx=0x7fa544019f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:59.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.431+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa54c015030 con 0x7fa5541f6b40 2024-09-21T07:36:59.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.643+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa55409bab0 con 0x7fa5541f6b40 2024-09-21T07:36:59.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.643+0000 7fa54be00640 1 -- 172.21.15.64:0/1094255883 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7fa5540b4b10 con 0x7fa5541f6b40 2024-09-21T07:36:59.642 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:36:59.642 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:36:59.643 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 msgr2=0x7fa534075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 0x7fa534075740 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ae000 tx=0x7fa544019f90 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 msgr2=0x7fa5540d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fa54c006fd0 tx=0x7fa54c006660 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 shutdown_connections 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa534073230 0x7fa534075740 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5541f6b40 0x7fa5540d06a0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5541f6730 0x7fa5540d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 --2- 172.21.15.64:0/1094255883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa538003b20 0x7fa5540cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 >> 172.21.15.64:0/1094255883 conn(0x7fa5540ccbe0 msgr2=0x7fa5540af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 shutdown_connections 2024-09-21T07:36:59.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.647+0000 7fa55b200640 1 -- 172.21.15.64:0/1094255883 wait complete. 2024-09-21T07:36:59.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- 172.21.15.64:0/4056688365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 msgr2=0x7f4190070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 --2- 172.21.15.64:0/4056688365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190070310 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f4180009930 tx=0x7f418001c8b0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- 172.21.15.64:0/4056688365 shutdown_connections 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 --2- 172.21.15.64:0/4056688365 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4190070850 0x7f41900b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 --2- 172.21.15.64:0/4056688365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190070310 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- 172.21.15.64:0/4056688365 >> 172.21.15.64:0/4056688365 conn(0x7f41900ccbe0 msgr2=0x7f41900ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- 172.21.15.64:0/4056688365 shutdown_connections 2024-09-21T07:36:59.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- 172.21.15.64:0/4056688365 wait complete. 2024-09-21T07:36:59.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 Processor -- start 2024-09-21T07:36:59.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.827+0000 7f4197000640 1 -- start start 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4190070850 0x7f419014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41900b2120 0x7f4190154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f41900b41f0 con 0x7f419015cbd0 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41900b4070 con 0x7f4190070850 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f41900b4370 con 0x7f41900b2120 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44410/0 (socket says 172.21.15.64:44410) 2024-09-21T07:36:59.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 -- 172.21.15.64:0/3370383050 learned_addr learned my addr 172.21.15.64:0/3370383050 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4187e00640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41900b2120 0x7f4190154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f418fe00640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4190070850 0x7f419014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 -- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41900b2120 msgr2=0x7f4190154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41900b2120 0x7f4190154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 -- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4190070850 msgr2=0x7f419014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4190070850 0x7f419014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 -- 172.21.15.64:0/3370383050 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419015bf90 con 0x7f419015cbd0 2024-09-21T07:36:59.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4195000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f418800c760 tx=0x7f418800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188003b80 con 0x7f419015cbd0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4188003d20 con 0x7f419015cbd0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419015c270 con 0x7f419015cbd0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800aab0 con 0x7f419015cbd0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419015a230 con 0x7f419015cbd0 2024-09-21T07:36:59.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.831+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41900b1be0 con 0x7f419015cbd0 2024-09-21T07:36:59.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.835+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f418800ac50 con 0x7f419015cbd0 2024-09-21T07:36:59.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.835+0000 7f418cc00640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 0x7f416c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:36:59.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.835+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f4188094160 con 0x7f419015cbd0 2024-09-21T07:36:59.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.835+0000 7f418fe00640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 0x7f416c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:36:59.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.835+0000 7f418fe00640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 0x7f416c075710 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f41800af000 tx=0x7f418001b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:36:59.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:36:59.839+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f41900b2530 con 0x7f419015cbd0 2024-09-21T07:37:00.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.019+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f419009dee0 con 0x7f419015cbd0 2024-09-21T07:37:00.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f418cc00640 1 -- 172.21.15.64:0/3370383050 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+16896 (secure 0 0 0) 0x7f418805efe0 con 0x7f419015cbd0 2024-09-21T07:37:00.021 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:00.021 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":204,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:36:57.203494+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:36:53.378206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-21T07:36:54.572346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:00.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 msgr2=0x7f416c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 0x7f416c075710 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f41800af000 tx=0x7f418001b0f0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 msgr2=0x7f4190154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f418800c760 tx=0x7f418800cc20 comp rx=0 tx=0).stop 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 shutdown_connections 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f416c073200 0x7f416c075710 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f419015cbd0 0x7f4190154ac0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41900b2120 0x7f4190154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 --2- 172.21.15.64:0/3370383050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4190070850 0x7f419014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 >> 172.21.15.64:0/3370383050 conn(0x7f41900ccbe0 msgr2=0x7f41900b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 shutdown_connections 2024-09-21T07:37:00.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.023+0000 7f4197000640 1 -- 172.21.15.64:0/3370383050 wait complete. 2024-09-21T07:37:00.044 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:37:00.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:37:00.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 -- 172.21.15.64:0/1602572579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a40d05f0 msgr2=0x7f20a40d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 --2- 172.21.15.64:0/1602572579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a40d05f0 0x7f20a40d0a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f209c009c80 tx=0x7f209c01cd10 comp rx=0 tx=0).stop 2024-09-21T07:37:00.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 -- 172.21.15.64:0/1602572579 shutdown_connections 2024-09-21T07:37:00.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 --2- 172.21.15.64:0/1602572579 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a40d05f0 0x7f20a40d0a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 --2- 172.21.15.64:0/1602572579 >> v2:172.21.15.90:3300/0 conn(0x7f20a4071880 0x7f20a41606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 -- 172.21.15.64:0/1602572579 >> 172.21.15.64:0/1602572579 conn(0x7f20a40cecd0 msgr2=0x7f20a40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:00.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 -- 172.21.15.64:0/1602572579 shutdown_connections 2024-09-21T07:37:00.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.203+0000 7f20ab400640 1 -- 172.21.15.64:0/1602572579 wait complete. 2024-09-21T07:37:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 Processor -- start 2024-09-21T07:37:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- start start 2024-09-21T07:37:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 0x7f20a40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a40b4920 0x7f20a40b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f20a416a1f0 con 0x7f20a40d05f0 2024-09-21T07:37:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20a416a070 con 0x7f20a40b4920 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f20a416a370 con 0x7f20a41602d0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44426/0 (socket says 172.21.15.64:44426) 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 -- 172.21.15.64:0/1589892168 learned_addr learned my addr 172.21.15.64:0/1589892168 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a9400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a40b4920 0x7f20a40b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f209be00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 0x7f20a40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 -- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 msgr2=0x7f20a40b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 0x7f20a40b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 -- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a40b4920 msgr2=0x7f20a40b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a40b4920 0x7f20a40b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 -- 172.21.15.64:0/1589892168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a4151820 con 0x7f20a40d05f0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f209be00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 0x7f20a40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a8a00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f209400c460 tx=0x7f209400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:00.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940052d0 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2094005490 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a4151b00 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094012890 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.207+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a41520c0 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.211+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a41606e0 con 0x7f20a40d05f0 2024-09-21T07:37:00.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.211+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2094012a30 con 0x7f20a40d05f0 2024-09-21T07:37:00.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.211+0000 7f20a1600640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 0x7f2080075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.211+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f2094093eb0 con 0x7f20a40d05f0 2024-09-21T07:37:00.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.211+0000 7f209be00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 0x7f2080075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.215+0000 7f209be00640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 0x7f2080075740 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f20a40b1c80 tx=0x7f208c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:00.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.215+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f209405ee00 con 0x7f20a40d05f0 2024-09-21T07:37:00.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.391+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20a415bbe0 con 0x7f2080073230 2024-09-21T07:37:00.396 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20a1600640 1 -- 172.21.15.64:0/1589892168 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251155 (secure 0 0 0) 0x7f20a415bbe0 con 0x7f2080073230 2024-09-21T07:37:00.399 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:00.400 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 msgr2=0x7f2080075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 0x7f2080075740 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f20a40b1c80 tx=0x7f208c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 msgr2=0x7f20a40b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f209400c460 tx=0x7f209400c920 comp rx=0 tx=0).stop 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 shutdown_connections 2024-09-21T07:37:00.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2080073230 0x7f2080075740 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a40b4920 0x7f20a40b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20a41602d0 0x7f20a40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 --2- 172.21.15.64:0/1589892168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20a40d05f0 0x7f20a40b2960 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 >> 172.21.15.64:0/1589892168 conn(0x7f20a40cecd0 msgr2=0x7f20a40cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 shutdown_connections 2024-09-21T07:37:00.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.399+0000 7f20ab400640 1 -- 172.21.15.64:0/1589892168 wait complete. 2024-09-21T07:37:00.421 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-21T07:36:59.656304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":484400,"kb_used_data":21176,"kb_used_omap":12,"kb_used_meta":463027,"kb_avail":754490320,"statfs":{"total":773094113280,"available":772598087680,"internally_reserved":0,"allocated":21684224,"data_stored":10853023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":474140211},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479617"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222685+0000","last_change":"2024-09-21T07:36:56.220146+0000","last_active":"2024-09-21T07:36:56.222685+0000","last_peered":"2024-09-21T07:36:56.222685+0000","last_clean":"2024-09-21T07:36:56.222685+0000","last_became_active":"2024-09-21T07:36:56.218923+0000","last_became_peered":"2024-09-21T07:36:56.218923+0000","last_unstale":"2024-09-21T07:36:56.222685+0000","last_undegraded":"2024-09-21T07:36:56.222685+0000","last_fullsized":"2024-09-21T07:36:56.222685+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.793247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.218604+0000","last_change":"2024-09-21T07:36:56.216256+0000","last_active":"2024-09-21T07:36:56.218604+0000","last_peered":"2024-09-21T07:36:56.218604+0000","last_clean":"2024-09-21T07:36:56.218604+0000","last_became_active":"2024-09-21T07:36:56.215921+0000","last_became_peered":"2024-09-21T07:36:56.215921+0000","last_unstale":"2024-09-21T07:36:56.218604+0000","last_undegraded":"2024-09-21T07:36:56.218604+0000","last_fullsized":"2024-09-21T07:36:56.218604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:38.871128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.192236+0000","last_change":"2024-09-21T07:36:55.192236+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.192236+0000","last_undegraded":"2024-09-21T07:36:55.192236+0000","last_fullsized":"2024-09-21T07:36:55.192236+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209382+0000","last_change":"2024-09-21T07:36:56.226641+0000","last_active":"2024-09-21T07:36:57.209382+0000","last_peered":"2024-09-21T07:36:57.209382+0000","last_clean":"2024-09-21T07:36:57.209382+0000","last_became_active":"2024-09-21T07:36:56.226315+0000","last_became_peered":"2024-09-21T07:36:56.226315+0000","last_unstale":"2024-09-21T07:36:57.209382+0000","last_undegraded":"2024-09-21T07:36:57.209382+0000","last_fullsized":"2024-09-21T07:36:57.209382+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:28.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.230623+0000","last_change":"2024-09-21T07:36:56.226972+0000","last_active":"2024-09-21T07:36:56.230623+0000","last_peered":"2024-09-21T07:36:56.230623+0000","last_clean":"2024-09-21T07:36:56.230623+0000","last_became_active":"2024-09-21T07:36:56.226668+0000","last_became_peered":"2024-09-21T07:36:56.226668+0000","last_unstale":"2024-09-21T07:36:56.230623+0000","last_undegraded":"2024-09-21T07:36:56.230623+0000","last_fullsized":"2024-09-21T07:36:56.230623+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.950933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337085+0000","last_change":"2024-09-21T07:36:56.227380+0000","last_active":"2024-09-21T07:36:57.337085+0000","last_peered":"2024-09-21T07:36:57.337085+0000","last_clean":"2024-09-21T07:36:57.337085+0000","last_became_active":"2024-09-21T07:36:56.227054+0000","last_became_peered":"2024-09-21T07:36:56.227054+0000","last_unstale":"2024-09-21T07:36:57.337085+0000","last_undegraded":"2024-09-21T07:36:57.337085+0000","last_fullsized":"2024-09-21T07:36:57.337085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:52.133345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190300+0000","last_change":"2024-09-21T07:36:55.190300+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190300+0000","last_undegraded":"2024-09-21T07:36:55.190300+0000","last_fullsized":"2024-09-21T07:36:55.190300+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336638+0000","last_change":"2024-09-21T07:36:56.226508+0000","last_active":"2024-09-21T07:36:57.336638+0000","last_peered":"2024-09-21T07:36:57.336638+0000","last_clean":"2024-09-21T07:36:57.336638+0000","last_became_active":"2024-09-21T07:36:56.226137+0000","last_became_peered":"2024-09-21T07:36:56.226137+0000","last_unstale":"2024-09-21T07:36:57.336638+0000","last_undegraded":"2024-09-21T07:36:57.336638+0000","last_fullsized":"2024-09-21T07:36:57.336638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:57.754951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222936+0000","last_change":"2024-09-21T07:36:56.219507+0000","last_active":"2024-09-21T07:36:56.222936+0000","last_peered":"2024-09-21T07:36:56.222936+0000","last_clean":"2024-09-21T07:36:56.222936+0000","last_became_active":"2024-09-21T07:36:56.218848+0000","last_became_peered":"2024-09-21T07:36:56.218848+0000","last_unstale":"2024-09-21T07:36:56.222936+0000","last_undegraded":"2024-09-21T07:36:56.222936+0000","last_fullsized":"2024-09-21T07:36:56.222936+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:59.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191723+0000","last_change":"2024-09-21T07:36:55.191723+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191723+0000","last_undegraded":"2024-09-21T07:36:55.191723+0000","last_fullsized":"2024-09-21T07:36:55.191723+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209534+0000","last_change":"2024-09-21T07:36:56.228467+0000","last_active":"2024-09-21T07:36:57.209534+0000","last_peered":"2024-09-21T07:36:57.209534+0000","last_clean":"2024-09-21T07:36:57.209534+0000","last_became_active":"2024-09-21T07:36:56.228120+0000","last_became_peered":"2024-09-21T07:36:56.228120+0000","last_unstale":"2024-09-21T07:36:57.209534+0000","last_undegraded":"2024-09-21T07:36:57.209534+0000","last_fullsized":"2024-09-21T07:36:57.209534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:48.976340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210044+0000","last_change":"2024-09-21T07:36:56.219132+0000","last_active":"2024-09-21T07:36:57.210044+0000","last_peered":"2024-09-21T07:36:57.210044+0000","last_clean":"2024-09-21T07:36:57.210044+0000","last_became_active":"2024-09-21T07:36:56.218824+0000","last_became_peered":"2024-09-21T07:36:56.218824+0000","last_unstale":"2024-09-21T07:36:57.210044+0000","last_undegraded":"2024-09-21T07:36:57.210044+0000","last_fullsized":"2024-09-21T07:36:57.210044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:37.141989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337303+0000","last_change":"2024-09-21T07:36:56.232879+0000","last_active":"2024-09-21T07:36:57.337303+0000","last_peered":"2024-09-21T07:36:57.337303+0000","last_clean":"2024-09-21T07:36:57.337303+0000","last_became_active":"2024-09-21T07:36:56.232253+0000","last_became_peered":"2024-09-21T07:36:56.232253+0000","last_unstale":"2024-09-21T07:36:57.337303+0000","last_undegraded":"2024-09-21T07:36:57.337303+0000","last_fullsized":"2024-09-21T07:36:57.337303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:18.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208981+0000","last_change":"2024-09-21T07:36:56.203575+0000","last_active":"2024-09-21T07:36:57.208981+0000","last_peered":"2024-09-21T07:36:57.208981+0000","last_clean":"2024-09-21T07:36:57.208981+0000","last_became_active":"2024-09-21T07:36:56.203239+0000","last_became_peered":"2024-09-21T07:36:56.203239+0000","last_unstale":"2024-09-21T07:36:57.208981+0000","last_undegraded":"2024-09-21T07:36:57.208981+0000","last_fullsized":"2024-09-21T07:36:57.208981+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:05.938973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225710+0000","last_change":"2024-09-21T07:36:56.202116+0000","last_active":"2024-09-21T07:36:57.225710+0000","last_peered":"2024-09-21T07:36:57.225710+0000","last_clean":"2024-09-21T07:36:57.225710+0000","last_became_active":"2024-09-21T07:36:56.201784+0000","last_became_peered":"2024-09-21T07:36:56.201784+0000","last_unstale":"2024-09-21T07:36:57.225710+0000","last_undegraded":"2024-09-21T07:36:57.225710+0000","last_fullsized":"2024-09-21T07:36:57.225710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:30.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336659+0000","last_change":"2024-09-21T07:36:56.220846+0000","last_active":"2024-09-21T07:36:57.336659+0000","last_peered":"2024-09-21T07:36:57.336659+0000","last_clean":"2024-09-21T07:36:57.336659+0000","last_became_active":"2024-09-21T07:36:56.218536+0000","last_became_peered":"2024-09-21T07:36:56.218536+0000","last_unstale":"2024-09-21T07:36:57.336659+0000","last_undegraded":"2024-09-21T07:36:57.336659+0000","last_fullsized":"2024-09-21T07:36:57.336659+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:48.683975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209762+0000","last_change":"2024-09-21T07:36:56.221685+0000","last_active":"2024-09-21T07:36:57.209762+0000","last_peered":"2024-09-21T07:36:57.209762+0000","last_clean":"2024-09-21T07:36:57.209762+0000","last_became_active":"2024-09-21T07:36:56.221305+0000","last_became_peered":"2024-09-21T07:36:56.221305+0000","last_unstale":"2024-09-21T07:36:57.209762+0000","last_undegraded":"2024-09-21T07:36:57.209762+0000","last_fullsized":"2024-09-21T07:36:57.209762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:17.092807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191272+0000","last_change":"2024-09-21T07:36:55.191272+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191272+0000","last_undegraded":"2024-09-21T07:36:55.191272+0000","last_fullsized":"2024-09-21T07:36:55.191272+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.220366+0000","last_change":"2024-09-21T07:36:56.217839+0000","last_active":"2024-09-21T07:36:56.220366+0000","last_peered":"2024-09-21T07:36:56.220366+0000","last_clean":"2024-09-21T07:36:56.220366+0000","last_became_active":"2024-09-21T07:36:56.217407+0000","last_became_peered":"2024-09-21T07:36:56.217407+0000","last_unstale":"2024-09-21T07:36:56.220366+0000","last_undegraded":"2024-09-21T07:36:56.220366+0000","last_fullsized":"2024-09-21T07:36:56.220366+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337202+0000","last_change":"2024-09-21T07:36:56.230192+0000","last_active":"2024-09-21T07:36:57.337202+0000","last_peered":"2024-09-21T07:36:57.337202+0000","last_clean":"2024-09-21T07:36:57.337202+0000","last_became_active":"2024-09-21T07:36:56.229899+0000","last_became_peered":"2024-09-21T07:36:56.229899+0000","last_unstale":"2024-09-21T07:36:57.337202+0000","last_undegraded":"2024-09-21T07:36:57.337202+0000","last_fullsized":"2024-09-21T07:36:57.337202+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190038+0000","last_change":"2024-09-21T07:36:55.190038+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190038+0000","last_undegraded":"2024-09-21T07:36:55.190038+0000","last_fullsized":"2024-09-21T07:36:55.190038+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225373+0000","last_change":"2024-09-21T07:36:56.216982+0000","last_active":"2024-09-21T07:36:57.225373+0000","last_peered":"2024-09-21T07:36:57.225373+0000","last_clean":"2024-09-21T07:36:57.225373+0000","last_became_active":"2024-09-21T07:36:56.216675+0000","last_became_peered":"2024-09-21T07:36:56.216675+0000","last_unstale":"2024-09-21T07:36:57.225373+0000","last_undegraded":"2024-09-21T07:36:57.225373+0000","last_fullsized":"2024-09-21T07:36:57.225373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:23.387580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224168+0000","last_change":"2024-09-21T07:36:56.220450+0000","last_active":"2024-09-21T07:36:56.224168+0000","last_peered":"2024-09-21T07:36:56.224168+0000","last_clean":"2024-09-21T07:36:56.224168+0000","last_became_active":"2024-09-21T07:36:56.220136+0000","last_became_peered":"2024-09-21T07:36:56.220136+0000","last_unstale":"2024-09-21T07:36:56.224168+0000","last_undegraded":"2024-09-21T07:36:56.224168+0000","last_fullsized":"2024-09-21T07:36:56.224168+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:12.123759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228273+0000","last_change":"2024-09-21T07:36:56.225330+0000","last_active":"2024-09-21T07:36:56.228273+0000","last_peered":"2024-09-21T07:36:56.228273+0000","last_clean":"2024-09-21T07:36:56.228273+0000","last_became_active":"2024-09-21T07:36:56.224756+0000","last_became_peered":"2024-09-21T07:36:56.224756+0000","last_unstale":"2024-09-21T07:36:56.228273+0000","last_undegraded":"2024-09-21T07:36:56.228273+0000","last_fullsized":"2024-09-21T07:36:56.228273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:23.684068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228052+0000","last_change":"2024-09-21T07:36:56.224291+0000","last_active":"2024-09-21T07:36:56.228052+0000","last_peered":"2024-09-21T07:36:56.228052+0000","last_clean":"2024-09-21T07:36:56.228052+0000","last_became_active":"2024-09-21T07:36:56.223882+0000","last_became_peered":"2024-09-21T07:36:56.223882+0000","last_unstale":"2024-09-21T07:36:56.228052+0000","last_undegraded":"2024-09-21T07:36:56.228052+0000","last_fullsized":"2024-09-21T07:36:56.228052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:09.061762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190829+0000","last_change":"2024-09-21T07:36:55.190829+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190829+0000","last_undegraded":"2024-09-21T07:36:55.190829+0000","last_fullsized":"2024-09-21T07:36:55.190829+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209740+0000","last_change":"2024-09-21T07:36:56.231954+0000","last_active":"2024-09-21T07:36:57.209740+0000","last_peered":"2024-09-21T07:36:57.209740+0000","last_clean":"2024-09-21T07:36:57.209740+0000","last_became_active":"2024-09-21T07:36:56.231645+0000","last_became_peered":"2024-09-21T07:36:56.231645+0000","last_unstale":"2024-09-21T07:36:57.209740+0000","last_undegraded":"2024-09-21T07:36:57.209740+0000","last_fullsized":"2024-09-21T07:36:57.209740+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:31.811145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209268+0000","last_change":"2024-09-21T07:36:56.212089+0000","last_active":"2024-09-21T07:36:57.209268+0000","last_peered":"2024-09-21T07:36:57.209268+0000","last_clean":"2024-09-21T07:36:57.209268+0000","last_became_active":"2024-09-21T07:36:56.211747+0000","last_became_peered":"2024-09-21T07:36:56.211747+0000","last_unstale":"2024-09-21T07:36:57.209268+0000","last_undegraded":"2024-09-21T07:36:57.209268+0000","last_fullsized":"2024-09-21T07:36:57.209268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:28.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.226852+0000","last_change":"2024-09-21T07:36:56.224194+0000","last_active":"2024-09-21T07:36:56.226852+0000","last_peered":"2024-09-21T07:36:56.226852+0000","last_clean":"2024-09-21T07:36:56.226852+0000","last_became_active":"2024-09-21T07:36:56.223128+0000","last_became_peered":"2024-09-21T07:36:56.223128+0000","last_unstale":"2024-09-21T07:36:56.226852+0000","last_undegraded":"2024-09-21T07:36:56.226852+0000","last_fullsized":"2024-09-21T07:36:56.226852+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337165+0000","last_change":"2024-09-21T07:36:56.215274+0000","last_active":"2024-09-21T07:36:57.337165+0000","last_peered":"2024-09-21T07:36:57.337165+0000","last_clean":"2024-09-21T07:36:57.337165+0000","last_became_active":"2024-09-21T07:36:56.214442+0000","last_became_peered":"2024-09-21T07:36:56.214442+0000","last_unstale":"2024-09-21T07:36:57.337165+0000","last_undegraded":"2024-09-21T07:36:57.337165+0000","last_fullsized":"2024-09-21T07:36:57.337165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:14.011653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224196+0000","last_change":"2024-09-21T07:36:56.221559+0000","last_active":"2024-09-21T07:36:56.224196+0000","last_peered":"2024-09-21T07:36:56.224196+0000","last_clean":"2024-09-21T07:36:56.224196+0000","last_became_active":"2024-09-21T07:36:56.221199+0000","last_became_peered":"2024-09-21T07:36:56.221199+0000","last_unstale":"2024-09-21T07:36:56.224196+0000","last_undegraded":"2024-09-21T07:36:56.224196+0000","last_fullsized":"2024-09-21T07:36:56.224196+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.963469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337225+0000","last_change":"2024-09-21T07:36:56.213521+0000","last_active":"2024-09-21T07:36:57.337225+0000","last_peered":"2024-09-21T07:36:57.337225+0000","last_clean":"2024-09-21T07:36:57.337225+0000","last_became_active":"2024-09-21T07:36:56.213022+0000","last_became_peered":"2024-09-21T07:36:56.213022+0000","last_unstale":"2024-09-21T07:36:57.337225+0000","last_undegraded":"2024-09-21T07:36:57.337225+0000","last_fullsized":"2024-09-21T07:36:57.337225+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:35.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189060+0000","last_change":"2024-09-21T07:36:55.189060+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189060+0000","last_undegraded":"2024-09-21T07:36:55.189060+0000","last_fullsized":"2024-09-21T07:36:55.189060+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":17,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240232+0000","last_change":"2024-09-21T07:36:55.208936+0000","last_active":"2024-09-21T07:36:56.240232+0000","last_peered":"2024-09-21T07:36:56.240232+0000","last_clean":"2024-09-21T07:36:56.240232+0000","last_became_active":"2024-09-21T07:36:55.208637+0000","last_became_peered":"2024-09-21T07:36:55.208637+0000","last_unstale":"2024-09-21T07:36:56.240232+0000","last_undegraded":"2024-09-21T07:36:56.240232+0000","last_fullsized":"2024-09-21T07:36:56.240232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:44.237771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189626+0000","last_change":"2024-09-21T07:36:55.189626+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189626+0000","last_undegraded":"2024-09-21T07:36:55.189626+0000","last_fullsized":"2024-09-21T07:36:55.189626+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209586+0000","last_change":"2024-09-21T07:36:55.208486+0000","last_active":"2024-09-21T07:36:57.209586+0000","last_peered":"2024-09-21T07:36:57.209586+0000","last_clean":"2024-09-21T07:36:57.209586+0000","last_became_active":"2024-09-21T07:36:55.207826+0000","last_became_peered":"2024-09-21T07:36:55.207826+0000","last_unstale":"2024-09-21T07:36:57.209586+0000","last_undegraded":"2024-09-21T07:36:57.209586+0000","last_fullsized":"2024-09-21T07:36:57.209586+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:55.679055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209488+0000","last_change":"2024-09-21T07:36:56.222112+0000","last_active":"2024-09-21T07:36:57.209488+0000","last_peered":"2024-09-21T07:36:57.209488+0000","last_clean":"2024-09-21T07:36:57.209488+0000","last_became_active":"2024-09-21T07:36:56.221751+0000","last_became_peered":"2024-09-21T07:36:56.221751+0000","last_unstale":"2024-09-21T07:36:57.209488+0000","last_undegraded":"2024-09-21T07:36:57.209488+0000","last_fullsized":"2024-09-21T07:36:57.209488+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:50.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337205+0000","last_change":"2024-09-21T07:36:55.201067+0000","last_active":"2024-09-21T07:36:57.337205+0000","last_peered":"2024-09-21T07:36:57.337205+0000","last_clean":"2024-09-21T07:36:57.337205+0000","last_became_active":"2024-09-21T07:36:55.200701+0000","last_became_peered":"2024-09-21T07:36:55.200701+0000","last_unstale":"2024-09-21T07:36:57.337205+0000","last_undegraded":"2024-09-21T07:36:57.337205+0000","last_fullsized":"2024-09-21T07:36:57.337205+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:12.736774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188516+0000","last_change":"2024-09-21T07:36:55.188516+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188516+0000","last_undegraded":"2024-09-21T07:36:55.188516+0000","last_fullsized":"2024-09-21T07:36:55.188516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225551+0000","last_change":"2024-09-21T07:36:55.205908+0000","last_active":"2024-09-21T07:36:57.225551+0000","last_peered":"2024-09-21T07:36:57.225551+0000","last_clean":"2024-09-21T07:36:57.225551+0000","last_became_active":"2024-09-21T07:36:55.205436+0000","last_became_peered":"2024-09-21T07:36:55.205436+0000","last_unstale":"2024-09-21T07:36:57.225551+0000","last_undegraded":"2024-09-21T07:36:57.225551+0000","last_fullsized":"2024-09-21T07:36:57.225551+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:56.199982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208667+0000","last_change":"2024-09-21T07:36:56.214216+0000","last_active":"2024-09-21T07:36:57.208667+0000","last_peered":"2024-09-21T07:36:57.208667+0000","last_clean":"2024-09-21T07:36:57.208667+0000","last_became_active":"2024-09-21T07:36:56.213795+0000","last_became_peered":"2024-09-21T07:36:56.213795+0000","last_unstale":"2024-09-21T07:36:57.208667+0000","last_undegraded":"2024-09-21T07:36:57.208667+0000","last_fullsized":"2024-09-21T07:36:57.208667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:27.786546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.237402+0000","last_change":"2024-09-21T07:36:55.208547+0000","last_active":"2024-09-21T07:36:56.237402+0000","last_peered":"2024-09-21T07:36:56.237402+0000","last_clean":"2024-09-21T07:36:56.237402+0000","last_became_active":"2024-09-21T07:36:55.208213+0000","last_became_peered":"2024-09-21T07:36:55.208213+0000","last_unstale":"2024-09-21T07:36:56.237402+0000","last_undegraded":"2024-09-21T07:36:56.237402+0000","last_fullsized":"2024-09-21T07:36:56.237402+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:16.287683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225477+0000","last_change":"2024-09-21T07:36:56.221370+0000","last_active":"2024-09-21T07:36:57.225477+0000","last_peered":"2024-09-21T07:36:57.225477+0000","last_clean":"2024-09-21T07:36:57.225477+0000","last_became_active":"2024-09-21T07:36:56.221018+0000","last_became_peered":"2024-09-21T07:36:56.221018+0000","last_unstale":"2024-09-21T07:36:57.225477+0000","last_undegraded":"2024-09-21T07:36:57.225477+0000","last_fullsized":"2024-09-21T07:36:57.225477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:47.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208803+0000","last_change":"2024-09-21T07:36:55.202201+0000","last_active":"2024-09-21T07:36:57.208803+0000","last_peered":"2024-09-21T07:36:57.208803+0000","last_clean":"2024-09-21T07:36:57.208803+0000","last_became_active":"2024-09-21T07:36:55.201905+0000","last_became_peered":"2024-09-21T07:36:55.201905+0000","last_unstale":"2024-09-21T07:36:57.208803+0000","last_undegraded":"2024-09-21T07:36:57.208803+0000","last_fullsized":"2024-09-21T07:36:57.208803+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:16.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228909+0000","last_change":"2024-09-21T07:36:56.227247+0000","last_active":"2024-09-21T07:36:56.228909+0000","last_peered":"2024-09-21T07:36:56.228909+0000","last_clean":"2024-09-21T07:36:56.228909+0000","last_became_active":"2024-09-21T07:36:56.226637+0000","last_became_peered":"2024-09-21T07:36:56.226637+0000","last_unstale":"2024-09-21T07:36:56.228909+0000","last_undegraded":"2024-09-21T07:36:56.228909+0000","last_fullsized":"2024-09-21T07:36:56.228909+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:46.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206816+0000","last_change":"2024-09-21T07:36:55.204178+0000","last_active":"2024-09-21T07:36:55.206816+0000","last_peered":"2024-09-21T07:36:55.206816+0000","last_clean":"2024-09-21T07:36:55.206816+0000","last_became_active":"2024-09-21T07:36:55.199695+0000","last_became_peered":"2024-09-21T07:36:55.199695+0000","last_unstale":"2024-09-21T07:36:55.206816+0000","last_undegraded":"2024-09-21T07:36:55.206816+0000","last_fullsized":"2024-09-21T07:36:55.206816+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:33.997906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225888+0000","last_change":"2024-09-21T07:36:56.228149+0000","last_active":"2024-09-21T07:36:57.225888+0000","last_peered":"2024-09-21T07:36:57.225888+0000","last_clean":"2024-09-21T07:36:57.225888+0000","last_became_active":"2024-09-21T07:36:56.227785+0000","last_became_peered":"2024-09-21T07:36:56.227785+0000","last_unstale":"2024-09-21T07:36:57.225888+0000","last_undegraded":"2024-09-21T07:36:57.225888+0000","last_fullsized":"2024-09-21T07:36:57.225888+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:25:44.487949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207067+0000","last_change":"2024-09-21T07:36:55.207507+0000","last_active":"2024-09-21T07:36:56.207067+0000","last_peered":"2024-09-21T07:36:56.207067+0000","last_clean":"2024-09-21T07:36:56.207067+0000","last_became_active":"2024-09-21T07:36:55.207028+0000","last_became_peered":"2024-09-21T07:36:55.207028+0000","last_unstale":"2024-09-21T07:36:56.207067+0000","last_undegraded":"2024-09-21T07:36:56.207067+0000","last_fullsized":"2024-09-21T07:36:56.207067+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:14.332670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225784+0000","last_change":"2024-09-21T07:36:56.211579+0000","last_active":"2024-09-21T07:36:57.225784+0000","last_peered":"2024-09-21T07:36:57.225784+0000","last_clean":"2024-09-21T07:36:57.225784+0000","last_became_active":"2024-09-21T07:36:56.211261+0000","last_became_peered":"2024-09-21T07:36:56.211261+0000","last_unstale":"2024-09-21T07:36:57.225784+0000","last_undegraded":"2024-09-21T07:36:57.225784+0000","last_fullsized":"2024-09-21T07:36:57.225784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:04.216771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209913+0000","last_change":"2024-09-21T07:36:55.200523+0000","last_active":"2024-09-21T07:36:57.209913+0000","last_peered":"2024-09-21T07:36:57.209913+0000","last_clean":"2024-09-21T07:36:57.209913+0000","last_became_active":"2024-09-21T07:36:55.200171+0000","last_became_peered":"2024-09-21T07:36:55.200171+0000","last_unstale":"2024-09-21T07:36:57.209913+0000","last_undegraded":"2024-09-21T07:36:57.209913+0000","last_fullsized":"2024-09-21T07:36:57.209913+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:29.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188195+0000","last_change":"2024-09-21T07:36:55.188195+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188195+0000","last_undegraded":"2024-09-21T07:36:55.188195+0000","last_fullsized":"2024-09-21T07:36:55.188195+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":16,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240321+0000","last_change":"2024-09-21T07:36:55.208006+0000","last_active":"2024-09-21T07:36:56.240321+0000","last_peered":"2024-09-21T07:36:56.240321+0000","last_clean":"2024-09-21T07:36:56.240321+0000","last_became_active":"2024-09-21T07:36:55.207715+0000","last_became_peered":"2024-09-21T07:36:55.207715+0000","last_unstale":"2024-09-21T07:36:56.240321+0000","last_undegraded":"2024-09-21T07:36:56.240321+0000","last_fullsized":"2024-09-21T07:36:56.240321+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:15.980896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210132+0000","last_change":"2024-09-21T07:36:56.223296+0000","last_active":"2024-09-21T07:36:57.210132+0000","last_peered":"2024-09-21T07:36:57.210132+0000","last_clean":"2024-09-21T07:36:57.210132+0000","last_became_active":"2024-09-21T07:36:56.222802+0000","last_became_peered":"2024-09-21T07:36:56.222802+0000","last_unstale":"2024-09-21T07:36:57.210132+0000","last_undegraded":"2024-09-21T07:36:57.210132+0000","last_fullsized":"2024-09-21T07:36:57.210132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:20.625782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":21,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337124+0000","last_change":"2024-09-21T07:36:55.195328+0000","last_active":"2024-09-21T07:36:57.337124+0000","last_peered":"2024-09-21T07:36:57.337124+0000","last_clean":"2024-09-21T07:36:57.337124+0000","last_became_active":"2024-09-21T07:36:55.194804+0000","last_became_peered":"2024-09-21T07:36:55.194804+0000","last_unstale":"2024-09-21T07:36:57.337124+0000","last_undegraded":"2024-09-21T07:36:57.337124+0000","last_fullsized":"2024-09-21T07:36:57.337124+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:18.921474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.229935+0000","last_change":"2024-09-21T07:36:56.228831+0000","last_active":"2024-09-21T07:36:56.229935+0000","last_peered":"2024-09-21T07:36:56.229935+0000","last_clean":"2024-09-21T07:36:56.229935+0000","last_became_active":"2024-09-21T07:36:56.228056+0000","last_became_peered":"2024-09-21T07:36:56.228056+0000","last_unstale":"2024-09-21T07:36:56.229935+0000","last_undegraded":"2024-09-21T07:36:56.229935+0000","last_fullsized":"2024-09-21T07:36:56.229935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:35.309506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209152+0000","last_change":"2024-09-21T07:36:55.200997+0000","last_active":"2024-09-21T07:36:57.209152+0000","last_peered":"2024-09-21T07:36:57.209152+0000","last_clean":"2024-09-21T07:36:57.209152+0000","last_became_active":"2024-09-21T07:36:55.200396+0000","last_became_peered":"2024-09-21T07:36:55.200396+0000","last_unstale":"2024-09-21T07:36:57.209152+0000","last_undegraded":"2024-09-21T07:36:57.209152+0000","last_fullsized":"2024-09-21T07:36:57.209152+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:19.618528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208835+0000","last_change":"2024-09-21T07:36:56.219624+0000","last_active":"2024-09-21T07:36:57.208835+0000","last_peered":"2024-09-21T07:36:57.208835+0000","last_clean":"2024-09-21T07:36:57.208835+0000","last_became_active":"2024-09-21T07:36:56.216161+0000","last_became_peered":"2024-09-21T07:36:56.216161+0000","last_unstale":"2024-09-21T07:36:57.208835+0000","last_undegraded":"2024-09-21T07:36:57.208835+0000","last_fullsized":"2024-09-21T07:36:57.208835+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:36.243592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207357+0000","last_change":"2024-09-21T07:36:55.198647+0000","last_active":"2024-09-21T07:36:56.207357+0000","last_peered":"2024-09-21T07:36:56.207357+0000","last_clean":"2024-09-21T07:36:56.207357+0000","last_became_active":"2024-09-21T07:36:55.198253+0000","last_became_peered":"2024-09-21T07:36:55.198253+0000","last_unstale":"2024-09-21T07:36:56.207357+0000","last_undegraded":"2024-09-21T07:36:56.207357+0000","last_fullsized":"2024-09-21T07:36:56.207357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:21.793379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187308+0000","last_change":"2024-09-21T07:36:55.187308+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187308+0000","last_undegraded":"2024-09-21T07:36:55.187308+0000","last_fullsized":"2024-09-21T07:36:55.187308+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336481+0000","last_change":"2024-09-21T07:36:55.194123+0000","last_active":"2024-09-21T07:36:57.336481+0000","last_peered":"2024-09-21T07:36:57.336481+0000","last_clean":"2024-09-21T07:36:57.336481+0000","last_became_active":"2024-09-21T07:36:55.193443+0000","last_became_peered":"2024-09-21T07:36:55.193443+0000","last_unstale":"2024-09-21T07:36:57.336481+0000","last_undegraded":"2024-09-21T07:36:57.336481+0000","last_fullsized":"2024-09-21T07:36:57.336481+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:58.513398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.226004+0000","last_change":"2024-09-21T07:36:56.211258+0000","last_active":"2024-09-21T07:36:57.226004+0000","last_peered":"2024-09-21T07:36:57.226004+0000","last_clean":"2024-09-21T07:36:57.226004+0000","last_became_active":"2024-09-21T07:36:56.210949+0000","last_became_peered":"2024-09-21T07:36:56.210949+0000","last_unstale":"2024-09-21T07:36:57.226004+0000","last_undegraded":"2024-09-21T07:36:57.226004+0000","last_fullsized":"2024-09-21T07:36:57.226004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:08.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":23,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208224+0000","last_change":"2024-09-21T07:36:55.195611+0000","last_active":"2024-09-21T07:36:57.208224+0000","last_peered":"2024-09-21T07:36:57.208224+0000","last_clean":"2024-09-21T07:36:57.208224+0000","last_became_active":"2024-09-21T07:36:55.195346+0000","last_became_peered":"2024-09-21T07:36:55.195346+0000","last_unstale":"2024-09-21T07:36:57.208224+0000","last_undegraded":"2024-09-21T07:36:57.208224+0000","last_fullsized":"2024-09-21T07:36:57.208224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:47.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224577+0000","last_change":"2024-09-21T07:36:56.219414+0000","last_active":"2024-09-21T07:36:56.224577+0000","last_peered":"2024-09-21T07:36:56.224577+0000","last_clean":"2024-09-21T07:36:56.224577+0000","last_became_active":"2024-09-21T07:36:56.214646+0000","last_became_peered":"2024-09-21T07:36:56.214646+0000","last_unstale":"2024-09-21T07:36:56.224577+0000","last_undegraded":"2024-09-21T07:36:56.224577+0000","last_fullsized":"2024-09-21T07:36:56.224577+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:34.398725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206617+0000","last_change":"2024-09-21T07:36:55.199617+0000","last_active":"2024-09-21T07:36:55.206617+0000","last_peered":"2024-09-21T07:36:55.206617+0000","last_clean":"2024-09-21T07:36:55.206617+0000","last_became_active":"2024-09-21T07:36:55.199251+0000","last_became_peered":"2024-09-21T07:36:55.199251+0000","last_unstale":"2024-09-21T07:36:55.206617+0000","last_undegraded":"2024-09-21T07:36:55.206617+0000","last_fullsized":"2024-09-21T07:36:55.206617+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:48.336056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.231589+0000","last_change":"2024-09-21T07:36:56.229275+0000","last_active":"2024-09-21T07:36:56.231589+0000","last_peered":"2024-09-21T07:36:56.231589+0000","last_clean":"2024-09-21T07:36:56.231589+0000","last_became_active":"2024-09-21T07:36:56.228759+0000","last_became_peered":"2024-09-21T07:36:56.228759+0000","last_unstale":"2024-09-21T07:36:56.231589+0000","last_undegraded":"2024-09-21T07:36:56.231589+0000","last_fullsized":"2024-09-21T07:36:56.231589+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.801290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.236277+0000","last_change":"2024-09-21T07:36:55.206279+0000","last_active":"2024-09-21T07:36:56.236277+0000","last_peered":"2024-09-21T07:36:56.236277+0000","last_clean":"2024-09-21T07:36:56.236277+0000","last_became_active":"2024-09-21T07:36:55.205963+0000","last_became_peered":"2024-09-21T07:36:55.205963+0000","last_unstale":"2024-09-21T07:36:56.236277+0000","last_undegraded":"2024-09-21T07:36:56.236277+0000","last_fullsized":"2024-09-21T07:36:56.236277+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187188+0000","last_change":"2024-09-21T07:36:55.187188+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187188+0000","last_undegraded":"2024-09-21T07:36:55.187188+0000","last_fullsized":"2024-09-21T07:36:55.187188+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209810+0000","last_change":"2024-09-21T07:36:55.195028+0000","last_active":"2024-09-21T07:36:57.209810+0000","last_peered":"2024-09-21T07:36:57.209810+0000","last_clean":"2024-09-21T07:36:57.209810+0000","last_became_active":"2024-09-21T07:36:55.194670+0000","last_became_peered":"2024-09-21T07:36:55.194670+0000","last_unstale":"2024-09-21T07:36:57.209810+0000","last_undegraded":"2024-09-21T07:36:57.209810+0000","last_fullsized":"2024-09-21T07:36:57.209810+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:05.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210062+0000","last_change":"2024-09-21T07:36:56.218458+0000","last_active":"2024-09-21T07:36:57.210062+0000","last_peered":"2024-09-21T07:36:57.210062+0000","last_clean":"2024-09-21T07:36:57.210062+0000","last_became_active":"2024-09-21T07:36:56.216457+0000","last_became_peered":"2024-09-21T07:36:56.216457+0000","last_unstale":"2024-09-21T07:36:57.210062+0000","last_undegraded":"2024-09-21T07:36:57.210062+0000","last_fullsized":"2024-09-21T07:36:57.210062+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:52.209400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209427+0000","last_change":"2024-09-21T07:36:55.195031+0000","last_active":"2024-09-21T07:36:57.209427+0000","last_peered":"2024-09-21T07:36:57.209427+0000","last_clean":"2024-09-21T07:36:57.209427+0000","last_became_active":"2024-09-21T07:36:55.194562+0000","last_became_peered":"2024-09-21T07:36:55.194562+0000","last_unstale":"2024-09-21T07:36:57.209427+0000","last_undegraded":"2024-09-21T07:36:57.209427+0000","last_fullsized":"2024-09-21T07:36:57.209427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:13.287440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208070+0000","last_change":"2024-09-21T07:36:56.217928+0000","last_active":"2024-09-21T07:36:57.208070+0000","last_peered":"2024-09-21T07:36:57.208070+0000","last_clean":"2024-09-21T07:36:57.208070+0000","last_became_active":"2024-09-21T07:36:56.217476+0000","last_became_peered":"2024-09-21T07:36:56.217476+0000","last_unstale":"2024-09-21T07:36:57.208070+0000","last_undegraded":"2024-09-21T07:36:57.208070+0000","last_fullsized":"2024-09-21T07:36:57.208070+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:39.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209270+0000","last_change":"2024-09-21T07:36:55.207808+0000","last_active":"2024-09-21T07:36:57.209270+0000","last_peered":"2024-09-21T07:36:57.209270+0000","last_clean":"2024-09-21T07:36:57.209270+0000","last_became_active":"2024-09-21T07:36:55.207491+0000","last_became_peered":"2024-09-21T07:36:55.207491+0000","last_unstale":"2024-09-21T07:36:57.209270+0000","last_undegraded":"2024-09-21T07:36:57.209270+0000","last_fullsized":"2024-09-21T07:36:57.209270+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:35.464049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.221605+0000","last_change":"2024-09-21T07:36:56.217953+0000","last_active":"2024-09-21T07:36:56.221605+0000","last_peered":"2024-09-21T07:36:56.221605+0000","last_clean":"2024-09-21T07:36:56.221605+0000","last_became_active":"2024-09-21T07:36:56.217601+0000","last_became_peered":"2024-09-21T07:36:56.217601+0000","last_unstale":"2024-09-21T07:36:56.221605+0000","last_undegraded":"2024-09-21T07:36:56.221605+0000","last_fullsized":"2024-09-21T07:36:56.221605+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:08.101461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225528+0000","last_change":"2024-09-21T07:36:55.204439+0000","last_active":"2024-09-21T07:36:57.225528+0000","last_peered":"2024-09-21T07:36:57.225528+0000","last_clean":"2024-09-21T07:36:57.225528+0000","last_became_active":"2024-09-21T07:36:55.203956+0000","last_became_peered":"2024-09-21T07:36:55.203956+0000","last_unstale":"2024-09-21T07:36:57.225528+0000","last_undegraded":"2024-09-21T07:36:57.225528+0000","last_fullsized":"2024-09-21T07:36:57.225528+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:34.118668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.216941+0000","last_change":"2024-09-21T07:36:56.215366+0000","last_active":"2024-09-21T07:36:56.216941+0000","last_peered":"2024-09-21T07:36:56.216941+0000","last_clean":"2024-09-21T07:36:56.216941+0000","last_became_active":"2024-09-21T07:36:56.214875+0000","last_became_peered":"2024-09-21T07:36:56.214875+0000","last_unstale":"2024-09-21T07:36:56.216941+0000","last_undegraded":"2024-09-21T07:36:56.216941+0000","last_fullsized":"2024-09-21T07:36:56.216941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:16.041708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225393+0000","last_change":"2024-09-21T07:36:55.207655+0000","last_active":"2024-09-21T07:36:57.225393+0000","last_peered":"2024-09-21T07:36:57.225393+0000","last_clean":"2024-09-21T07:36:57.225393+0000","last_became_active":"2024-09-21T07:36:55.207342+0000","last_became_peered":"2024-09-21T07:36:55.207342+0000","last_unstale":"2024-09-21T07:36:57.225393+0000","last_undegraded":"2024-09-21T07:36:57.225393+0000","last_fullsized":"2024-09-21T07:36:57.225393+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:41.475513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187422+0000","last_change":"2024-09-21T07:36:55.187422+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187422+0000","last_undegraded":"2024-09-21T07:36:55.187422+0000","last_fullsized":"2024-09-21T07:36:55.187422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.208174+0000","last_change":"2024-09-21T07:36:55.206596+0000","last_active":"2024-09-21T07:36:56.208174+0000","last_peered":"2024-09-21T07:36:56.208174+0000","last_clean":"2024-09-21T07:36:56.208174+0000","last_became_active":"2024-09-21T07:36:55.206270+0000","last_became_peered":"2024-09-21T07:36:55.206270+0000","last_unstale":"2024-09-21T07:36:56.208174+0000","last_undegraded":"2024-09-21T07:36:56.208174+0000","last_fullsized":"2024-09-21T07:36:56.208174+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:09.900363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224604+0000","last_change":"2024-09-21T07:36:56.219605+0000","last_active":"2024-09-21T07:36:56.224604+0000","last_peered":"2024-09-21T07:36:56.224604+0000","last_clean":"2024-09-21T07:36:56.224604+0000","last_became_active":"2024-09-21T07:36:56.216745+0000","last_became_peered":"2024-09-21T07:36:56.216745+0000","last_unstale":"2024-09-21T07:36:56.224604+0000","last_undegraded":"2024-09-21T07:36:56.224604+0000","last_fullsized":"2024-09-21T07:36:56.224604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:40.290073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209996+0000","last_change":"2024-09-21T07:36:55.201898+0000","last_active":"2024-09-21T07:36:57.209996+0000","last_peered":"2024-09-21T07:36:57.209996+0000","last_clean":"2024-09-21T07:36:57.209996+0000","last_became_active":"2024-09-21T07:36:55.201581+0000","last_became_peered":"2024-09-21T07:36:55.201581+0000","last_unstale":"2024-09-21T07:36:57.209996+0000","last_undegraded":"2024-09-21T07:36:57.209996+0000","last_fullsized":"2024-09-21T07:36:57.209996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:27.902218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227992+0000","last_change":"2024-09-21T07:36:56.223740+0000","last_active":"2024-09-21T07:36:56.227992+0000","last_peered":"2024-09-21T07:36:56.227992+0000","last_clean":"2024-09-21T07:36:56.227992+0000","last_became_active":"2024-09-21T07:36:56.223305+0000","last_became_peered":"2024-09-21T07:36:56.223305+0000","last_unstale":"2024-09-21T07:36:56.227992+0000","last_undegraded":"2024-09-21T07:36:56.227992+0000","last_fullsized":"2024-09-21T07:36:56.227992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:26.707788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"204'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.227384+0000","last_change":"2024-09-21T07:36:55.202987+0000","last_active":"2024-09-21T07:36:57.227384+0000","last_peered":"2024-09-21T07:36:57.227384+0000","last_clean":"2024-09-21T07:36:57.227384+0000","last_became_active":"2024-09-21T07:36:55.202656+0000","last_became_peered":"2024-09-21T07:36:55.202656+0000","last_unstale":"2024-09-21T07:36:57.227384+0000","last_undegraded":"2024-09-21T07:36:57.227384+0000","last_fullsized":"2024-09-21T07:36:57.227384+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:18.120081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337229+0000","last_change":"2024-09-21T07:36:56.231483+0000","last_active":"2024-09-21T07:36:57.337229+0000","last_peered":"2024-09-21T07:36:57.337229+0000","last_clean":"2024-09-21T07:36:57.337229+0000","last_became_active":"2024-09-21T07:36:56.231174+0000","last_became_peered":"2024-09-21T07:36:56.231174+0000","last_unstale":"2024-09-21T07:36:57.337229+0000","last_undegraded":"2024-09-21T07:36:57.337229+0000","last_fullsized":"2024-09-21T07:36:57.337229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:23.639764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225789+0000","last_change":"2024-09-21T07:36:55.201998+0000","last_active":"2024-09-21T07:36:57.225789+0000","last_peered":"2024-09-21T07:36:57.225789+0000","last_clean":"2024-09-21T07:36:57.225789+0000","last_became_active":"2024-09-21T07:36:55.201662+0000","last_became_peered":"2024-09-21T07:36:55.201662+0000","last_unstale":"2024-09-21T07:36:57.225789+0000","last_undegraded":"2024-09-21T07:36:57.225789+0000","last_fullsized":"2024-09-21T07:36:57.225789+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:35.647330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222865+0000","last_change":"2024-09-21T07:36:56.219161+0000","last_active":"2024-09-21T07:36:56.222865+0000","last_peered":"2024-09-21T07:36:56.222865+0000","last_clean":"2024-09-21T07:36:56.222865+0000","last_became_active":"2024-09-21T07:36:56.218372+0000","last_became_peered":"2024-09-21T07:36:56.218372+0000","last_unstale":"2024-09-21T07:36:56.222865+0000","last_undegraded":"2024-09-21T07:36:56.222865+0000","last_fullsized":"2024-09-21T07:36:56.222865+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:07.593583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210308+0000","last_change":"2024-09-21T07:36:55.206649+0000","last_active":"2024-09-21T07:36:57.210308+0000","last_peered":"2024-09-21T07:36:57.210308+0000","last_clean":"2024-09-21T07:36:57.210308+0000","last_became_active":"2024-09-21T07:36:55.206341+0000","last_became_peered":"2024-09-21T07:36:55.206341+0000","last_unstale":"2024-09-21T07:36:57.210308+0000","last_undegraded":"2024-09-21T07:36:57.210308+0000","last_fullsized":"2024-09-21T07:36:57.210308+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:43.715074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187142+0000","last_change":"2024-09-21T07:36:55.187142+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187142+0000","last_undegraded":"2024-09-21T07:36:55.187142+0000","last_fullsized":"2024-09-21T07:36:55.187142+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209612+0000","last_change":"2024-09-21T07:36:55.200687+0000","last_active":"2024-09-21T07:36:57.209612+0000","last_peered":"2024-09-21T07:36:57.209612+0000","last_clean":"2024-09-21T07:36:57.209612+0000","last_became_active":"2024-09-21T07:36:55.200028+0000","last_became_peered":"2024-09-21T07:36:55.200028+0000","last_unstale":"2024-09-21T07:36:57.209612+0000","last_undegraded":"2024-09-21T07:36:57.209612+0000","last_fullsized":"2024-09-21T07:36:57.209612+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:10.111404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187186+0000","last_change":"2024-09-21T07:36:55.187186+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187186+0000","last_undegraded":"2024-09-21T07:36:55.187186+0000","last_fullsized":"2024-09-21T07:36:55.187186+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209172+0000","last_change":"2024-09-21T07:36:55.198983+0000","last_active":"2024-09-21T07:36:57.209172+0000","last_peered":"2024-09-21T07:36:57.209172+0000","last_clean":"2024-09-21T07:36:57.209172+0000","last_became_active":"2024-09-21T07:36:55.198513+0000","last_became_peered":"2024-09-21T07:36:55.198513+0000","last_unstale":"2024-09-21T07:36:57.209172+0000","last_undegraded":"2024-09-21T07:36:57.209172+0000","last_fullsized":"2024-09-21T07:36:57.209172+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:40.003553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227066+0000","last_change":"2024-09-21T07:36:56.225875+0000","last_active":"2024-09-21T07:36:56.227066+0000","last_peered":"2024-09-21T07:36:56.227066+0000","last_clean":"2024-09-21T07:36:56.227066+0000","last_became_active":"2024-09-21T07:36:56.225520+0000","last_became_peered":"2024-09-21T07:36:56.225520+0000","last_unstale":"2024-09-21T07:36:56.227066+0000","last_undegraded":"2024-09-21T07:36:56.227066+0000","last_fullsized":"2024-09-21T07:36:56.227066+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.174282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.205102+0000","last_change":"2024-09-21T07:36:55.211026+0000","last_active":"2024-09-21T07:36:56.205102+0000","last_peered":"2024-09-21T07:36:56.205102+0000","last_clean":"2024-09-21T07:36:56.205102+0000","last_became_active":"2024-09-21T07:36:55.210636+0000","last_became_peered":"2024-09-21T07:36:55.210636+0000","last_unstale":"2024-09-21T07:36:56.205102+0000","last_undegraded":"2024-09-21T07:36:56.205102+0000","last_fullsized":"2024-09-21T07:36:56.205102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:08.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209029+0000","last_change":"2024-09-21T07:36:56.222090+0000","last_active":"2024-09-21T07:36:57.209029+0000","last_peered":"2024-09-21T07:36:57.209029+0000","last_clean":"2024-09-21T07:36:57.209029+0000","last_became_active":"2024-09-21T07:36:56.221728+0000","last_became_peered":"2024-09-21T07:36:56.221728+0000","last_unstale":"2024-09-21T07:36:57.209029+0000","last_undegraded":"2024-09-21T07:36:57.209029+0000","last_fullsized":"2024-09-21T07:36:57.209029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:30.692530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208405+0000","last_change":"2024-09-21T07:36:55.194087+0000","last_active":"2024-09-21T07:36:57.208405+0000","last_peered":"2024-09-21T07:36:57.208405+0000","last_clean":"2024-09-21T07:36:57.208405+0000","last_became_active":"2024-09-21T07:36:55.193807+0000","last_became_peered":"2024-09-21T07:36:55.193807+0000","last_unstale":"2024-09-21T07:36:57.208405+0000","last_undegraded":"2024-09-21T07:36:57.208405+0000","last_fullsized":"2024-09-21T07:36:57.208405+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.803891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188614+0000","last_change":"2024-09-21T07:36:55.188614+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188614+0000","last_undegraded":"2024-09-21T07:36:55.188614+0000","last_fullsized":"2024-09-21T07:36:55.188614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.238326+0000","last_change":"2024-09-21T07:36:55.207312+0000","last_active":"2024-09-21T07:36:56.238326+0000","last_peered":"2024-09-21T07:36:56.238326+0000","last_clean":"2024-09-21T07:36:56.238326+0000","last_became_active":"2024-09-21T07:36:55.206468+0000","last_became_peered":"2024-09-21T07:36:55.206468+0000","last_unstale":"2024-09-21T07:36:56.238326+0000","last_undegraded":"2024-09-21T07:36:56.238326+0000","last_fullsized":"2024-09-21T07:36:56.238326+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.912021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":444,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.204117+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:36:56.204117+0000","last_peered":"2024-09-21T07:36:56.204117+0000","last_clean":"2024-09-21T07:36:56.204117+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:36:56.204117+0000","last_undegraded":"2024-09-21T07:36:56.204117+0000","last_fullsized":"2024-09-21T07:36:56.204117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55920,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315920,"statfs":{"total":96636764160,"available":96579502080,"internally_reserved":0,"allocated":2580480,"data_stored":1211070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2572288,"data_stored":1211014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47580,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324260,"statfs":{"total":96636764160,"available":96588042240,"internally_reserved":0,"allocated":2560000,"data_stored":1209422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60068,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311772,"statfs":{"total":96636764160,"available":96575254528,"internally_reserved":0,"allocated":2564096,"data_stored":1209948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509615,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64212,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307628,"statfs":{"total":96636764160,"available":96571011072,"internally_reserved":0,"allocated":2555904,"data_stored":1209332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509616,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56472,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315368,"statfs":{"total":96636764160,"available":96578936832,"internally_reserved":0,"allocated":3149824,"data_stored":1799700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542320,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":3084,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":3158016,"data_stored":1800372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87756,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284084,"statfs":{"total":96636764160,"available":96546902016,"internally_reserved":0,"allocated":2543616,"data_stored":1202165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:37:00.424 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 -- 172.21.15.64:0/3259657082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce4004070 msgr2=0x7f3ce4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3259657082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3ce4004070 0x7f3ce4004810 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f3d000b50c0 tx=0x7f3cec01d1b0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d04e00640 1 -- 172.21.15.64:0/3259657082 reap_dead start 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 -- 172.21.15.64:0/3259657082 shutdown_connections 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 -- 172.21.15.64:0/3259657082 >> 172.21.15.64:0/3259657082 conn(0x7f3d000ccbe0 msgr2=0x7f3d000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 -- 172.21.15.64:0/3259657082 shutdown_connections 2024-09-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.623+0000 7f3d06e00640 1 -- 172.21.15.64:0/3259657082 wait complete. 2024-09-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 Processor -- start 2024-09-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- start start 2024-09-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce4004070 0x7f3d0015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d0015b250 0x7f3d000ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cc770 con 0x7f3d0015b810 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cc5f0 con 0x7f3d0015b250 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3d000cc8f0 con 0x7f3ce4004070 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44442/0 (socket says 172.21.15.64:44442) 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 -- 172.21.15.64:0/3007968735 learned_addr learned my addr 172.21.15.64:0/3007968735 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cffe00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce4004070 0x7f3d0015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d04e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d0015b250 0x7f3d000ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 -- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce4004070 msgr2=0x7f3d0015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce4004070 0x7f3d0015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 -- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d0015b250 msgr2=0x7f3d000ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d0015b250 0x7f3d000ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 -- 172.21.15.64:0/3007968735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000c81d0 con 0x7f3d0015b810 2024-09-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cff400640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f3cec01cc20 tx=0x7f3cec005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0bb030 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cec0047c0 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec004bd0 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d000c84b0 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.627+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d000c8a70 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.631+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d000c7f40 con 0x7f3d0015b810 2024-09-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.631+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3cec0be030 con 0x7f3d0015b810 2024-09-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.631+0000 7f3cf7e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 0x7f3ce0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.631+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f3cec12f810 con 0x7f3d0015b810 2024-09-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.631+0000 7f3cffe00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 0x7f3ce0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.635+0000 7f3cffe00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 0x7f3ce0075710 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009ce0 tx=0x7f3cf00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.635+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3cec016ec0 con 0x7f3d0015b810 2024-09-21T07:37:00.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.811+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d00070310 con 0x7f3ce0073200 2024-09-21T07:37:00.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.815+0000 7f3cf7e00640 1 -- 172.21.15.64:0/3007968735 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251155 (secure 0 0 0) 0x7f3cf005e530 con 0x7f3ce0073200 2024-09-21T07:37:00.817 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:00.818 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 msgr2=0x7f3ce0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 0x7f3ce0075710 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009ce0 tx=0x7f3cf00091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 msgr2=0x7f3d000adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f3cec01cc20 tx=0x7f3cec005790 comp rx=0 tx=0).stop 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 shutdown_connections 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ce0073200 0x7f3ce0075710 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d0015b250 0x7f3d000ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d0015b810 0x7f3d000adec0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 --2- 172.21.15.64:0/3007968735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ce4004070 0x7f3d0015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:00.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 >> 172.21.15.64:0/3007968735 conn(0x7f3d000ccbe0 msgr2=0x7f3d000afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:00.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 shutdown_connections 2024-09-21T07:37:00.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:00.819+0000 7f3d06e00640 1 -- 172.21.15.64:0/3007968735 wait complete. 2024-09-21T07:37:00.838 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-21T07:36:59.656304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":484400,"kb_used_data":21176,"kb_used_omap":12,"kb_used_meta":463027,"kb_avail":754490320,"statfs":{"total":773094113280,"available":772598087680,"internally_reserved":0,"allocated":21684224,"data_stored":10853023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":474140211},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479617"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222685+0000","last_change":"2024-09-21T07:36:56.220146+0000","last_active":"2024-09-21T07:36:56.222685+0000","last_peered":"2024-09-21T07:36:56.222685+0000","last_clean":"2024-09-21T07:36:56.222685+0000","last_became_active":"2024-09-21T07:36:56.218923+0000","last_became_peered":"2024-09-21T07:36:56.218923+0000","last_unstale":"2024-09-21T07:36:56.222685+0000","last_undegraded":"2024-09-21T07:36:56.222685+0000","last_fullsized":"2024-09-21T07:36:56.222685+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.793247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.218604+0000","last_change":"2024-09-21T07:36:56.216256+0000","last_active":"2024-09-21T07:36:56.218604+0000","last_peered":"2024-09-21T07:36:56.218604+0000","last_clean":"2024-09-21T07:36:56.218604+0000","last_became_active":"2024-09-21T07:36:56.215921+0000","last_became_peered":"2024-09-21T07:36:56.215921+0000","last_unstale":"2024-09-21T07:36:56.218604+0000","last_undegraded":"2024-09-21T07:36:56.218604+0000","last_fullsized":"2024-09-21T07:36:56.218604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:38.871128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.192236+0000","last_change":"2024-09-21T07:36:55.192236+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.192236+0000","last_undegraded":"2024-09-21T07:36:55.192236+0000","last_fullsized":"2024-09-21T07:36:55.192236+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209382+0000","last_change":"2024-09-21T07:36:56.226641+0000","last_active":"2024-09-21T07:36:57.209382+0000","last_peered":"2024-09-21T07:36:57.209382+0000","last_clean":"2024-09-21T07:36:57.209382+0000","last_became_active":"2024-09-21T07:36:56.226315+0000","last_became_peered":"2024-09-21T07:36:56.226315+0000","last_unstale":"2024-09-21T07:36:57.209382+0000","last_undegraded":"2024-09-21T07:36:57.209382+0000","last_fullsized":"2024-09-21T07:36:57.209382+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:28.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.230623+0000","last_change":"2024-09-21T07:36:56.226972+0000","last_active":"2024-09-21T07:36:56.230623+0000","last_peered":"2024-09-21T07:36:56.230623+0000","last_clean":"2024-09-21T07:36:56.230623+0000","last_became_active":"2024-09-21T07:36:56.226668+0000","last_became_peered":"2024-09-21T07:36:56.226668+0000","last_unstale":"2024-09-21T07:36:56.230623+0000","last_undegraded":"2024-09-21T07:36:56.230623+0000","last_fullsized":"2024-09-21T07:36:56.230623+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.950933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337085+0000","last_change":"2024-09-21T07:36:56.227380+0000","last_active":"2024-09-21T07:36:57.337085+0000","last_peered":"2024-09-21T07:36:57.337085+0000","last_clean":"2024-09-21T07:36:57.337085+0000","last_became_active":"2024-09-21T07:36:56.227054+0000","last_became_peered":"2024-09-21T07:36:56.227054+0000","last_unstale":"2024-09-21T07:36:57.337085+0000","last_undegraded":"2024-09-21T07:36:57.337085+0000","last_fullsized":"2024-09-21T07:36:57.337085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:52.133345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190300+0000","last_change":"2024-09-21T07:36:55.190300+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190300+0000","last_undegraded":"2024-09-21T07:36:55.190300+0000","last_fullsized":"2024-09-21T07:36:55.190300+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336638+0000","last_change":"2024-09-21T07:36:56.226508+0000","last_active":"2024-09-21T07:36:57.336638+0000","last_peered":"2024-09-21T07:36:57.336638+0000","last_clean":"2024-09-21T07:36:57.336638+0000","last_became_active":"2024-09-21T07:36:56.226137+0000","last_became_peered":"2024-09-21T07:36:56.226137+0000","last_unstale":"2024-09-21T07:36:57.336638+0000","last_undegraded":"2024-09-21T07:36:57.336638+0000","last_fullsized":"2024-09-21T07:36:57.336638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:57.754951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222936+0000","last_change":"2024-09-21T07:36:56.219507+0000","last_active":"2024-09-21T07:36:56.222936+0000","last_peered":"2024-09-21T07:36:56.222936+0000","last_clean":"2024-09-21T07:36:56.222936+0000","last_became_active":"2024-09-21T07:36:56.218848+0000","last_became_peered":"2024-09-21T07:36:56.218848+0000","last_unstale":"2024-09-21T07:36:56.222936+0000","last_undegraded":"2024-09-21T07:36:56.222936+0000","last_fullsized":"2024-09-21T07:36:56.222936+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:59.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191723+0000","last_change":"2024-09-21T07:36:55.191723+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191723+0000","last_undegraded":"2024-09-21T07:36:55.191723+0000","last_fullsized":"2024-09-21T07:36:55.191723+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209534+0000","last_change":"2024-09-21T07:36:56.228467+0000","last_active":"2024-09-21T07:36:57.209534+0000","last_peered":"2024-09-21T07:36:57.209534+0000","last_clean":"2024-09-21T07:36:57.209534+0000","last_became_active":"2024-09-21T07:36:56.228120+0000","last_became_peered":"2024-09-21T07:36:56.228120+0000","last_unstale":"2024-09-21T07:36:57.209534+0000","last_undegraded":"2024-09-21T07:36:57.209534+0000","last_fullsized":"2024-09-21T07:36:57.209534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:48.976340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210044+0000","last_change":"2024-09-21T07:36:56.219132+0000","last_active":"2024-09-21T07:36:57.210044+0000","last_peered":"2024-09-21T07:36:57.210044+0000","last_clean":"2024-09-21T07:36:57.210044+0000","last_became_active":"2024-09-21T07:36:56.218824+0000","last_became_peered":"2024-09-21T07:36:56.218824+0000","last_unstale":"2024-09-21T07:36:57.210044+0000","last_undegraded":"2024-09-21T07:36:57.210044+0000","last_fullsized":"2024-09-21T07:36:57.210044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:37.141989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337303+0000","last_change":"2024-09-21T07:36:56.232879+0000","last_active":"2024-09-21T07:36:57.337303+0000","last_peered":"2024-09-21T07:36:57.337303+0000","last_clean":"2024-09-21T07:36:57.337303+0000","last_became_active":"2024-09-21T07:36:56.232253+0000","last_became_peered":"2024-09-21T07:36:56.232253+0000","last_unstale":"2024-09-21T07:36:57.337303+0000","last_undegraded":"2024-09-21T07:36:57.337303+0000","last_fullsized":"2024-09-21T07:36:57.337303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:18.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208981+0000","last_change":"2024-09-21T07:36:56.203575+0000","last_active":"2024-09-21T07:36:57.208981+0000","last_peered":"2024-09-21T07:36:57.208981+0000","last_clean":"2024-09-21T07:36:57.208981+0000","last_became_active":"2024-09-21T07:36:56.203239+0000","last_became_peered":"2024-09-21T07:36:56.203239+0000","last_unstale":"2024-09-21T07:36:57.208981+0000","last_undegraded":"2024-09-21T07:36:57.208981+0000","last_fullsized":"2024-09-21T07:36:57.208981+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:05.938973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225710+0000","last_change":"2024-09-21T07:36:56.202116+0000","last_active":"2024-09-21T07:36:57.225710+0000","last_peered":"2024-09-21T07:36:57.225710+0000","last_clean":"2024-09-21T07:36:57.225710+0000","last_became_active":"2024-09-21T07:36:56.201784+0000","last_became_peered":"2024-09-21T07:36:56.201784+0000","last_unstale":"2024-09-21T07:36:57.225710+0000","last_undegraded":"2024-09-21T07:36:57.225710+0000","last_fullsized":"2024-09-21T07:36:57.225710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:30.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336659+0000","last_change":"2024-09-21T07:36:56.220846+0000","last_active":"2024-09-21T07:36:57.336659+0000","last_peered":"2024-09-21T07:36:57.336659+0000","last_clean":"2024-09-21T07:36:57.336659+0000","last_became_active":"2024-09-21T07:36:56.218536+0000","last_became_peered":"2024-09-21T07:36:56.218536+0000","last_unstale":"2024-09-21T07:36:57.336659+0000","last_undegraded":"2024-09-21T07:36:57.336659+0000","last_fullsized":"2024-09-21T07:36:57.336659+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:48.683975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209762+0000","last_change":"2024-09-21T07:36:56.221685+0000","last_active":"2024-09-21T07:36:57.209762+0000","last_peered":"2024-09-21T07:36:57.209762+0000","last_clean":"2024-09-21T07:36:57.209762+0000","last_became_active":"2024-09-21T07:36:56.221305+0000","last_became_peered":"2024-09-21T07:36:56.221305+0000","last_unstale":"2024-09-21T07:36:57.209762+0000","last_undegraded":"2024-09-21T07:36:57.209762+0000","last_fullsized":"2024-09-21T07:36:57.209762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:17.092807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191272+0000","last_change":"2024-09-21T07:36:55.191272+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191272+0000","last_undegraded":"2024-09-21T07:36:55.191272+0000","last_fullsized":"2024-09-21T07:36:55.191272+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.220366+0000","last_change":"2024-09-21T07:36:56.217839+0000","last_active":"2024-09-21T07:36:56.220366+0000","last_peered":"2024-09-21T07:36:56.220366+0000","last_clean":"2024-09-21T07:36:56.220366+0000","last_became_active":"2024-09-21T07:36:56.217407+0000","last_became_peered":"2024-09-21T07:36:56.217407+0000","last_unstale":"2024-09-21T07:36:56.220366+0000","last_undegraded":"2024-09-21T07:36:56.220366+0000","last_fullsized":"2024-09-21T07:36:56.220366+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337202+0000","last_change":"2024-09-21T07:36:56.230192+0000","last_active":"2024-09-21T07:36:57.337202+0000","last_peered":"2024-09-21T07:36:57.337202+0000","last_clean":"2024-09-21T07:36:57.337202+0000","last_became_active":"2024-09-21T07:36:56.229899+0000","last_became_peered":"2024-09-21T07:36:56.229899+0000","last_unstale":"2024-09-21T07:36:57.337202+0000","last_undegraded":"2024-09-21T07:36:57.337202+0000","last_fullsized":"2024-09-21T07:36:57.337202+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190038+0000","last_change":"2024-09-21T07:36:55.190038+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190038+0000","last_undegraded":"2024-09-21T07:36:55.190038+0000","last_fullsized":"2024-09-21T07:36:55.190038+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225373+0000","last_change":"2024-09-21T07:36:56.216982+0000","last_active":"2024-09-21T07:36:57.225373+0000","last_peered":"2024-09-21T07:36:57.225373+0000","last_clean":"2024-09-21T07:36:57.225373+0000","last_became_active":"2024-09-21T07:36:56.216675+0000","last_became_peered":"2024-09-21T07:36:56.216675+0000","last_unstale":"2024-09-21T07:36:57.225373+0000","last_undegraded":"2024-09-21T07:36:57.225373+0000","last_fullsized":"2024-09-21T07:36:57.225373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:23.387580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224168+0000","last_change":"2024-09-21T07:36:56.220450+0000","last_active":"2024-09-21T07:36:56.224168+0000","last_peered":"2024-09-21T07:36:56.224168+0000","last_clean":"2024-09-21T07:36:56.224168+0000","last_became_active":"2024-09-21T07:36:56.220136+0000","last_became_peered":"2024-09-21T07:36:56.220136+0000","last_unstale":"2024-09-21T07:36:56.224168+0000","last_undegraded":"2024-09-21T07:36:56.224168+0000","last_fullsized":"2024-09-21T07:36:56.224168+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:12.123759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228273+0000","last_change":"2024-09-21T07:36:56.225330+0000","last_active":"2024-09-21T07:36:56.228273+0000","last_peered":"2024-09-21T07:36:56.228273+0000","last_clean":"2024-09-21T07:36:56.228273+0000","last_became_active":"2024-09-21T07:36:56.224756+0000","last_became_peered":"2024-09-21T07:36:56.224756+0000","last_unstale":"2024-09-21T07:36:56.228273+0000","last_undegraded":"2024-09-21T07:36:56.228273+0000","last_fullsized":"2024-09-21T07:36:56.228273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:23.684068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228052+0000","last_change":"2024-09-21T07:36:56.224291+0000","last_active":"2024-09-21T07:36:56.228052+0000","last_peered":"2024-09-21T07:36:56.228052+0000","last_clean":"2024-09-21T07:36:56.228052+0000","last_became_active":"2024-09-21T07:36:56.223882+0000","last_became_peered":"2024-09-21T07:36:56.223882+0000","last_unstale":"2024-09-21T07:36:56.228052+0000","last_undegraded":"2024-09-21T07:36:56.228052+0000","last_fullsized":"2024-09-21T07:36:56.228052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:09.061762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190829+0000","last_change":"2024-09-21T07:36:55.190829+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190829+0000","last_undegraded":"2024-09-21T07:36:55.190829+0000","last_fullsized":"2024-09-21T07:36:55.190829+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209740+0000","last_change":"2024-09-21T07:36:56.231954+0000","last_active":"2024-09-21T07:36:57.209740+0000","last_peered":"2024-09-21T07:36:57.209740+0000","last_clean":"2024-09-21T07:36:57.209740+0000","last_became_active":"2024-09-21T07:36:56.231645+0000","last_became_peered":"2024-09-21T07:36:56.231645+0000","last_unstale":"2024-09-21T07:36:57.209740+0000","last_undegraded":"2024-09-21T07:36:57.209740+0000","last_fullsized":"2024-09-21T07:36:57.209740+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:31.811145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209268+0000","last_change":"2024-09-21T07:36:56.212089+0000","last_active":"2024-09-21T07:36:57.209268+0000","last_peered":"2024-09-21T07:36:57.209268+0000","last_clean":"2024-09-21T07:36:57.209268+0000","last_became_active":"2024-09-21T07:36:56.211747+0000","last_became_peered":"2024-09-21T07:36:56.211747+0000","last_unstale":"2024-09-21T07:36:57.209268+0000","last_undegraded":"2024-09-21T07:36:57.209268+0000","last_fullsized":"2024-09-21T07:36:57.209268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:28.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.226852+0000","last_change":"2024-09-21T07:36:56.224194+0000","last_active":"2024-09-21T07:36:56.226852+0000","last_peered":"2024-09-21T07:36:56.226852+0000","last_clean":"2024-09-21T07:36:56.226852+0000","last_became_active":"2024-09-21T07:36:56.223128+0000","last_became_peered":"2024-09-21T07:36:56.223128+0000","last_unstale":"2024-09-21T07:36:56.226852+0000","last_undegraded":"2024-09-21T07:36:56.226852+0000","last_fullsized":"2024-09-21T07:36:56.226852+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337165+0000","last_change":"2024-09-21T07:36:56.215274+0000","last_active":"2024-09-21T07:36:57.337165+0000","last_peered":"2024-09-21T07:36:57.337165+0000","last_clean":"2024-09-21T07:36:57.337165+0000","last_became_active":"2024-09-21T07:36:56.214442+0000","last_became_peered":"2024-09-21T07:36:56.214442+0000","last_unstale":"2024-09-21T07:36:57.337165+0000","last_undegraded":"2024-09-21T07:36:57.337165+0000","last_fullsized":"2024-09-21T07:36:57.337165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:14.011653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224196+0000","last_change":"2024-09-21T07:36:56.221559+0000","last_active":"2024-09-21T07:36:56.224196+0000","last_peered":"2024-09-21T07:36:56.224196+0000","last_clean":"2024-09-21T07:36:56.224196+0000","last_became_active":"2024-09-21T07:36:56.221199+0000","last_became_peered":"2024-09-21T07:36:56.221199+0000","last_unstale":"2024-09-21T07:36:56.224196+0000","last_undegraded":"2024-09-21T07:36:56.224196+0000","last_fullsized":"2024-09-21T07:36:56.224196+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.963469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337225+0000","last_change":"2024-09-21T07:36:56.213521+0000","last_active":"2024-09-21T07:36:57.337225+0000","last_peered":"2024-09-21T07:36:57.337225+0000","last_clean":"2024-09-21T07:36:57.337225+0000","last_became_active":"2024-09-21T07:36:56.213022+0000","last_became_peered":"2024-09-21T07:36:56.213022+0000","last_unstale":"2024-09-21T07:36:57.337225+0000","last_undegraded":"2024-09-21T07:36:57.337225+0000","last_fullsized":"2024-09-21T07:36:57.337225+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:35.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189060+0000","last_change":"2024-09-21T07:36:55.189060+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189060+0000","last_undegraded":"2024-09-21T07:36:55.189060+0000","last_fullsized":"2024-09-21T07:36:55.189060+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":17,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240232+0000","last_change":"2024-09-21T07:36:55.208936+0000","last_active":"2024-09-21T07:36:56.240232+0000","last_peered":"2024-09-21T07:36:56.240232+0000","last_clean":"2024-09-21T07:36:56.240232+0000","last_became_active":"2024-09-21T07:36:55.208637+0000","last_became_peered":"2024-09-21T07:36:55.208637+0000","last_unstale":"2024-09-21T07:36:56.240232+0000","last_undegraded":"2024-09-21T07:36:56.240232+0000","last_fullsized":"2024-09-21T07:36:56.240232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:44.237771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189626+0000","last_change":"2024-09-21T07:36:55.189626+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189626+0000","last_undegraded":"2024-09-21T07:36:55.189626+0000","last_fullsized":"2024-09-21T07:36:55.189626+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209586+0000","last_change":"2024-09-21T07:36:55.208486+0000","last_active":"2024-09-21T07:36:57.209586+0000","last_peered":"2024-09-21T07:36:57.209586+0000","last_clean":"2024-09-21T07:36:57.209586+0000","last_became_active":"2024-09-21T07:36:55.207826+0000","last_became_peered":"2024-09-21T07:36:55.207826+0000","last_unstale":"2024-09-21T07:36:57.209586+0000","last_undegraded":"2024-09-21T07:36:57.209586+0000","last_fullsized":"2024-09-21T07:36:57.209586+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:55.679055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209488+0000","last_change":"2024-09-21T07:36:56.222112+0000","last_active":"2024-09-21T07:36:57.209488+0000","last_peered":"2024-09-21T07:36:57.209488+0000","last_clean":"2024-09-21T07:36:57.209488+0000","last_became_active":"2024-09-21T07:36:56.221751+0000","last_became_peered":"2024-09-21T07:36:56.221751+0000","last_unstale":"2024-09-21T07:36:57.209488+0000","last_undegraded":"2024-09-21T07:36:57.209488+0000","last_fullsized":"2024-09-21T07:36:57.209488+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:50.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337205+0000","last_change":"2024-09-21T07:36:55.201067+0000","last_active":"2024-09-21T07:36:57.337205+0000","last_peered":"2024-09-21T07:36:57.337205+0000","last_clean":"2024-09-21T07:36:57.337205+0000","last_became_active":"2024-09-21T07:36:55.200701+0000","last_became_peered":"2024-09-21T07:36:55.200701+0000","last_unstale":"2024-09-21T07:36:57.337205+0000","last_undegraded":"2024-09-21T07:36:57.337205+0000","last_fullsized":"2024-09-21T07:36:57.337205+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:12.736774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188516+0000","last_change":"2024-09-21T07:36:55.188516+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188516+0000","last_undegraded":"2024-09-21T07:36:55.188516+0000","last_fullsized":"2024-09-21T07:36:55.188516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225551+0000","last_change":"2024-09-21T07:36:55.205908+0000","last_active":"2024-09-21T07:36:57.225551+0000","last_peered":"2024-09-21T07:36:57.225551+0000","last_clean":"2024-09-21T07:36:57.225551+0000","last_became_active":"2024-09-21T07:36:55.205436+0000","last_became_peered":"2024-09-21T07:36:55.205436+0000","last_unstale":"2024-09-21T07:36:57.225551+0000","last_undegraded":"2024-09-21T07:36:57.225551+0000","last_fullsized":"2024-09-21T07:36:57.225551+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:56.199982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208667+0000","last_change":"2024-09-21T07:36:56.214216+0000","last_active":"2024-09-21T07:36:57.208667+0000","last_peered":"2024-09-21T07:36:57.208667+0000","last_clean":"2024-09-21T07:36:57.208667+0000","last_became_active":"2024-09-21T07:36:56.213795+0000","last_became_peered":"2024-09-21T07:36:56.213795+0000","last_unstale":"2024-09-21T07:36:57.208667+0000","last_undegraded":"2024-09-21T07:36:57.208667+0000","last_fullsized":"2024-09-21T07:36:57.208667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:27.786546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.237402+0000","last_change":"2024-09-21T07:36:55.208547+0000","last_active":"2024-09-21T07:36:56.237402+0000","last_peered":"2024-09-21T07:36:56.237402+0000","last_clean":"2024-09-21T07:36:56.237402+0000","last_became_active":"2024-09-21T07:36:55.208213+0000","last_became_peered":"2024-09-21T07:36:55.208213+0000","last_unstale":"2024-09-21T07:36:56.237402+0000","last_undegraded":"2024-09-21T07:36:56.237402+0000","last_fullsized":"2024-09-21T07:36:56.237402+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:16.287683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225477+0000","last_change":"2024-09-21T07:36:56.221370+0000","last_active":"2024-09-21T07:36:57.225477+0000","last_peered":"2024-09-21T07:36:57.225477+0000","last_clean":"2024-09-21T07:36:57.225477+0000","last_became_active":"2024-09-21T07:36:56.221018+0000","last_became_peered":"2024-09-21T07:36:56.221018+0000","last_unstale":"2024-09-21T07:36:57.225477+0000","last_undegraded":"2024-09-21T07:36:57.225477+0000","last_fullsized":"2024-09-21T07:36:57.225477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:47.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208803+0000","last_change":"2024-09-21T07:36:55.202201+0000","last_active":"2024-09-21T07:36:57.208803+0000","last_peered":"2024-09-21T07:36:57.208803+0000","last_clean":"2024-09-21T07:36:57.208803+0000","last_became_active":"2024-09-21T07:36:55.201905+0000","last_became_peered":"2024-09-21T07:36:55.201905+0000","last_unstale":"2024-09-21T07:36:57.208803+0000","last_undegraded":"2024-09-21T07:36:57.208803+0000","last_fullsized":"2024-09-21T07:36:57.208803+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:16.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228909+0000","last_change":"2024-09-21T07:36:56.227247+0000","last_active":"2024-09-21T07:36:56.228909+0000","last_peered":"2024-09-21T07:36:56.228909+0000","last_clean":"2024-09-21T07:36:56.228909+0000","last_became_active":"2024-09-21T07:36:56.226637+0000","last_became_peered":"2024-09-21T07:36:56.226637+0000","last_unstale":"2024-09-21T07:36:56.228909+0000","last_undegraded":"2024-09-21T07:36:56.228909+0000","last_fullsized":"2024-09-21T07:36:56.228909+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:46.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206816+0000","last_change":"2024-09-21T07:36:55.204178+0000","last_active":"2024-09-21T07:36:55.206816+0000","last_peered":"2024-09-21T07:36:55.206816+0000","last_clean":"2024-09-21T07:36:55.206816+0000","last_became_active":"2024-09-21T07:36:55.199695+0000","last_became_peered":"2024-09-21T07:36:55.199695+0000","last_unstale":"2024-09-21T07:36:55.206816+0000","last_undegraded":"2024-09-21T07:36:55.206816+0000","last_fullsized":"2024-09-21T07:36:55.206816+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:33.997906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225888+0000","last_change":"2024-09-21T07:36:56.228149+0000","last_active":"2024-09-21T07:36:57.225888+0000","last_peered":"2024-09-21T07:36:57.225888+0000","last_clean":"2024-09-21T07:36:57.225888+0000","last_became_active":"2024-09-21T07:36:56.227785+0000","last_became_peered":"2024-09-21T07:36:56.227785+0000","last_unstale":"2024-09-21T07:36:57.225888+0000","last_undegraded":"2024-09-21T07:36:57.225888+0000","last_fullsized":"2024-09-21T07:36:57.225888+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:25:44.487949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207067+0000","last_change":"2024-09-21T07:36:55.207507+0000","last_active":"2024-09-21T07:36:56.207067+0000","last_peered":"2024-09-21T07:36:56.207067+0000","last_clean":"2024-09-21T07:36:56.207067+0000","last_became_active":"2024-09-21T07:36:55.207028+0000","last_became_peered":"2024-09-21T07:36:55.207028+0000","last_unstale":"2024-09-21T07:36:56.207067+0000","last_undegraded":"2024-09-21T07:36:56.207067+0000","last_fullsized":"2024-09-21T07:36:56.207067+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:14.332670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225784+0000","last_change":"2024-09-21T07:36:56.211579+0000","last_active":"2024-09-21T07:36:57.225784+0000","last_peered":"2024-09-21T07:36:57.225784+0000","last_clean":"2024-09-21T07:36:57.225784+0000","last_became_active":"2024-09-21T07:36:56.211261+0000","last_became_peered":"2024-09-21T07:36:56.211261+0000","last_unstale":"2024-09-21T07:36:57.225784+0000","last_undegraded":"2024-09-21T07:36:57.225784+0000","last_fullsized":"2024-09-21T07:36:57.225784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:04.216771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209913+0000","last_change":"2024-09-21T07:36:55.200523+0000","last_active":"2024-09-21T07:36:57.209913+0000","last_peered":"2024-09-21T07:36:57.209913+0000","last_clean":"2024-09-21T07:36:57.209913+0000","last_became_active":"2024-09-21T07:36:55.200171+0000","last_became_peered":"2024-09-21T07:36:55.200171+0000","last_unstale":"2024-09-21T07:36:57.209913+0000","last_undegraded":"2024-09-21T07:36:57.209913+0000","last_fullsized":"2024-09-21T07:36:57.209913+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:29.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188195+0000","last_change":"2024-09-21T07:36:55.188195+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188195+0000","last_undegraded":"2024-09-21T07:36:55.188195+0000","last_fullsized":"2024-09-21T07:36:55.188195+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":16,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240321+0000","last_change":"2024-09-21T07:36:55.208006+0000","last_active":"2024-09-21T07:36:56.240321+0000","last_peered":"2024-09-21T07:36:56.240321+0000","last_clean":"2024-09-21T07:36:56.240321+0000","last_became_active":"2024-09-21T07:36:55.207715+0000","last_became_peered":"2024-09-21T07:36:55.207715+0000","last_unstale":"2024-09-21T07:36:56.240321+0000","last_undegraded":"2024-09-21T07:36:56.240321+0000","last_fullsized":"2024-09-21T07:36:56.240321+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:15.980896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210132+0000","last_change":"2024-09-21T07:36:56.223296+0000","last_active":"2024-09-21T07:36:57.210132+0000","last_peered":"2024-09-21T07:36:57.210132+0000","last_clean":"2024-09-21T07:36:57.210132+0000","last_became_active":"2024-09-21T07:36:56.222802+0000","last_became_peered":"2024-09-21T07:36:56.222802+0000","last_unstale":"2024-09-21T07:36:57.210132+0000","last_undegraded":"2024-09-21T07:36:57.210132+0000","last_fullsized":"2024-09-21T07:36:57.210132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:20.625782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":21,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337124+0000","last_change":"2024-09-21T07:36:55.195328+0000","last_active":"2024-09-21T07:36:57.337124+0000","last_peered":"2024-09-21T07:36:57.337124+0000","last_clean":"2024-09-21T07:36:57.337124+0000","last_became_active":"2024-09-21T07:36:55.194804+0000","last_became_peered":"2024-09-21T07:36:55.194804+0000","last_unstale":"2024-09-21T07:36:57.337124+0000","last_undegraded":"2024-09-21T07:36:57.337124+0000","last_fullsized":"2024-09-21T07:36:57.337124+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:18.921474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.229935+0000","last_change":"2024-09-21T07:36:56.228831+0000","last_active":"2024-09-21T07:36:56.229935+0000","last_peered":"2024-09-21T07:36:56.229935+0000","last_clean":"2024-09-21T07:36:56.229935+0000","last_became_active":"2024-09-21T07:36:56.228056+0000","last_became_peered":"2024-09-21T07:36:56.228056+0000","last_unstale":"2024-09-21T07:36:56.229935+0000","last_undegraded":"2024-09-21T07:36:56.229935+0000","last_fullsized":"2024-09-21T07:36:56.229935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:35.309506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209152+0000","last_change":"2024-09-21T07:36:55.200997+0000","last_active":"2024-09-21T07:36:57.209152+0000","last_peered":"2024-09-21T07:36:57.209152+0000","last_clean":"2024-09-21T07:36:57.209152+0000","last_became_active":"2024-09-21T07:36:55.200396+0000","last_became_peered":"2024-09-21T07:36:55.200396+0000","last_unstale":"2024-09-21T07:36:57.209152+0000","last_undegraded":"2024-09-21T07:36:57.209152+0000","last_fullsized":"2024-09-21T07:36:57.209152+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:19.618528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208835+0000","last_change":"2024-09-21T07:36:56.219624+0000","last_active":"2024-09-21T07:36:57.208835+0000","last_peered":"2024-09-21T07:36:57.208835+0000","last_clean":"2024-09-21T07:36:57.208835+0000","last_became_active":"2024-09-21T07:36:56.216161+0000","last_became_peered":"2024-09-21T07:36:56.216161+0000","last_unstale":"2024-09-21T07:36:57.208835+0000","last_undegraded":"2024-09-21T07:36:57.208835+0000","last_fullsized":"2024-09-21T07:36:57.208835+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:36.243592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207357+0000","last_change":"2024-09-21T07:36:55.198647+0000","last_active":"2024-09-21T07:36:56.207357+0000","last_peered":"2024-09-21T07:36:56.207357+0000","last_clean":"2024-09-21T07:36:56.207357+0000","last_became_active":"2024-09-21T07:36:55.198253+0000","last_became_peered":"2024-09-21T07:36:55.198253+0000","last_unstale":"2024-09-21T07:36:56.207357+0000","last_undegraded":"2024-09-21T07:36:56.207357+0000","last_fullsized":"2024-09-21T07:36:56.207357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:21.793379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187308+0000","last_change":"2024-09-21T07:36:55.187308+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187308+0000","last_undegraded":"2024-09-21T07:36:55.187308+0000","last_fullsized":"2024-09-21T07:36:55.187308+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336481+0000","last_change":"2024-09-21T07:36:55.194123+0000","last_active":"2024-09-21T07:36:57.336481+0000","last_peered":"2024-09-21T07:36:57.336481+0000","last_clean":"2024-09-21T07:36:57.336481+0000","last_became_active":"2024-09-21T07:36:55.193443+0000","last_became_peered":"2024-09-21T07:36:55.193443+0000","last_unstale":"2024-09-21T07:36:57.336481+0000","last_undegraded":"2024-09-21T07:36:57.336481+0000","last_fullsized":"2024-09-21T07:36:57.336481+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:58.513398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.226004+0000","last_change":"2024-09-21T07:36:56.211258+0000","last_active":"2024-09-21T07:36:57.226004+0000","last_peered":"2024-09-21T07:36:57.226004+0000","last_clean":"2024-09-21T07:36:57.226004+0000","last_became_active":"2024-09-21T07:36:56.210949+0000","last_became_peered":"2024-09-21T07:36:56.210949+0000","last_unstale":"2024-09-21T07:36:57.226004+0000","last_undegraded":"2024-09-21T07:36:57.226004+0000","last_fullsized":"2024-09-21T07:36:57.226004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:08.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":23,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208224+0000","last_change":"2024-09-21T07:36:55.195611+0000","last_active":"2024-09-21T07:36:57.208224+0000","last_peered":"2024-09-21T07:36:57.208224+0000","last_clean":"2024-09-21T07:36:57.208224+0000","last_became_active":"2024-09-21T07:36:55.195346+0000","last_became_peered":"2024-09-21T07:36:55.195346+0000","last_unstale":"2024-09-21T07:36:57.208224+0000","last_undegraded":"2024-09-21T07:36:57.208224+0000","last_fullsized":"2024-09-21T07:36:57.208224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:47.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224577+0000","last_change":"2024-09-21T07:36:56.219414+0000","last_active":"2024-09-21T07:36:56.224577+0000","last_peered":"2024-09-21T07:36:56.224577+0000","last_clean":"2024-09-21T07:36:56.224577+0000","last_became_active":"2024-09-21T07:36:56.214646+0000","last_became_peered":"2024-09-21T07:36:56.214646+0000","last_unstale":"2024-09-21T07:36:56.224577+0000","last_undegraded":"2024-09-21T07:36:56.224577+0000","last_fullsized":"2024-09-21T07:36:56.224577+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:34.398725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206617+0000","last_change":"2024-09-21T07:36:55.199617+0000","last_active":"2024-09-21T07:36:55.206617+0000","last_peered":"2024-09-21T07:36:55.206617+0000","last_clean":"2024-09-21T07:36:55.206617+0000","last_became_active":"2024-09-21T07:36:55.199251+0000","last_became_peered":"2024-09-21T07:36:55.199251+0000","last_unstale":"2024-09-21T07:36:55.206617+0000","last_undegraded":"2024-09-21T07:36:55.206617+0000","last_fullsized":"2024-09-21T07:36:55.206617+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:48.336056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.231589+0000","last_change":"2024-09-21T07:36:56.229275+0000","last_active":"2024-09-21T07:36:56.231589+0000","last_peered":"2024-09-21T07:36:56.231589+0000","last_clean":"2024-09-21T07:36:56.231589+0000","last_became_active":"2024-09-21T07:36:56.228759+0000","last_became_peered":"2024-09-21T07:36:56.228759+0000","last_unstale":"2024-09-21T07:36:56.231589+0000","last_undegraded":"2024-09-21T07:36:56.231589+0000","last_fullsized":"2024-09-21T07:36:56.231589+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.801290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.236277+0000","last_change":"2024-09-21T07:36:55.206279+0000","last_active":"2024-09-21T07:36:56.236277+0000","last_peered":"2024-09-21T07:36:56.236277+0000","last_clean":"2024-09-21T07:36:56.236277+0000","last_became_active":"2024-09-21T07:36:55.205963+0000","last_became_peered":"2024-09-21T07:36:55.205963+0000","last_unstale":"2024-09-21T07:36:56.236277+0000","last_undegraded":"2024-09-21T07:36:56.236277+0000","last_fullsized":"2024-09-21T07:36:56.236277+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187188+0000","last_change":"2024-09-21T07:36:55.187188+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187188+0000","last_undegraded":"2024-09-21T07:36:55.187188+0000","last_fullsized":"2024-09-21T07:36:55.187188+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209810+0000","last_change":"2024-09-21T07:36:55.195028+0000","last_active":"2024-09-21T07:36:57.209810+0000","last_peered":"2024-09-21T07:36:57.209810+0000","last_clean":"2024-09-21T07:36:57.209810+0000","last_became_active":"2024-09-21T07:36:55.194670+0000","last_became_peered":"2024-09-21T07:36:55.194670+0000","last_unstale":"2024-09-21T07:36:57.209810+0000","last_undegraded":"2024-09-21T07:36:57.209810+0000","last_fullsized":"2024-09-21T07:36:57.209810+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:05.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210062+0000","last_change":"2024-09-21T07:36:56.218458+0000","last_active":"2024-09-21T07:36:57.210062+0000","last_peered":"2024-09-21T07:36:57.210062+0000","last_clean":"2024-09-21T07:36:57.210062+0000","last_became_active":"2024-09-21T07:36:56.216457+0000","last_became_peered":"2024-09-21T07:36:56.216457+0000","last_unstale":"2024-09-21T07:36:57.210062+0000","last_undegraded":"2024-09-21T07:36:57.210062+0000","last_fullsized":"2024-09-21T07:36:57.210062+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:52.209400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209427+0000","last_change":"2024-09-21T07:36:55.195031+0000","last_active":"2024-09-21T07:36:57.209427+0000","last_peered":"2024-09-21T07:36:57.209427+0000","last_clean":"2024-09-21T07:36:57.209427+0000","last_became_active":"2024-09-21T07:36:55.194562+0000","last_became_peered":"2024-09-21T07:36:55.194562+0000","last_unstale":"2024-09-21T07:36:57.209427+0000","last_undegraded":"2024-09-21T07:36:57.209427+0000","last_fullsized":"2024-09-21T07:36:57.209427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:13.287440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208070+0000","last_change":"2024-09-21T07:36:56.217928+0000","last_active":"2024-09-21T07:36:57.208070+0000","last_peered":"2024-09-21T07:36:57.208070+0000","last_clean":"2024-09-21T07:36:57.208070+0000","last_became_active":"2024-09-21T07:36:56.217476+0000","last_became_peered":"2024-09-21T07:36:56.217476+0000","last_unstale":"2024-09-21T07:36:57.208070+0000","last_undegraded":"2024-09-21T07:36:57.208070+0000","last_fullsized":"2024-09-21T07:36:57.208070+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:39.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209270+0000","last_change":"2024-09-21T07:36:55.207808+0000","last_active":"2024-09-21T07:36:57.209270+0000","last_peered":"2024-09-21T07:36:57.209270+0000","last_clean":"2024-09-21T07:36:57.209270+0000","last_became_active":"2024-09-21T07:36:55.207491+0000","last_became_peered":"2024-09-21T07:36:55.207491+0000","last_unstale":"2024-09-21T07:36:57.209270+0000","last_undegraded":"2024-09-21T07:36:57.209270+0000","last_fullsized":"2024-09-21T07:36:57.209270+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:35.464049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.221605+0000","last_change":"2024-09-21T07:36:56.217953+0000","last_active":"2024-09-21T07:36:56.221605+0000","last_peered":"2024-09-21T07:36:56.221605+0000","last_clean":"2024-09-21T07:36:56.221605+0000","last_became_active":"2024-09-21T07:36:56.217601+0000","last_became_peered":"2024-09-21T07:36:56.217601+0000","last_unstale":"2024-09-21T07:36:56.221605+0000","last_undegraded":"2024-09-21T07:36:56.221605+0000","last_fullsized":"2024-09-21T07:36:56.221605+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:08.101461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225528+0000","last_change":"2024-09-21T07:36:55.204439+0000","last_active":"2024-09-21T07:36:57.225528+0000","last_peered":"2024-09-21T07:36:57.225528+0000","last_clean":"2024-09-21T07:36:57.225528+0000","last_became_active":"2024-09-21T07:36:55.203956+0000","last_became_peered":"2024-09-21T07:36:55.203956+0000","last_unstale":"2024-09-21T07:36:57.225528+0000","last_undegraded":"2024-09-21T07:36:57.225528+0000","last_fullsized":"2024-09-21T07:36:57.225528+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:34.118668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.216941+0000","last_change":"2024-09-21T07:36:56.215366+0000","last_active":"2024-09-21T07:36:56.216941+0000","last_peered":"2024-09-21T07:36:56.216941+0000","last_clean":"2024-09-21T07:36:56.216941+0000","last_became_active":"2024-09-21T07:36:56.214875+0000","last_became_peered":"2024-09-21T07:36:56.214875+0000","last_unstale":"2024-09-21T07:36:56.216941+0000","last_undegraded":"2024-09-21T07:36:56.216941+0000","last_fullsized":"2024-09-21T07:36:56.216941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:16.041708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225393+0000","last_change":"2024-09-21T07:36:55.207655+0000","last_active":"2024-09-21T07:36:57.225393+0000","last_peered":"2024-09-21T07:36:57.225393+0000","last_clean":"2024-09-21T07:36:57.225393+0000","last_became_active":"2024-09-21T07:36:55.207342+0000","last_became_peered":"2024-09-21T07:36:55.207342+0000","last_unstale":"2024-09-21T07:36:57.225393+0000","last_undegraded":"2024-09-21T07:36:57.225393+0000","last_fullsized":"2024-09-21T07:36:57.225393+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:41.475513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187422+0000","last_change":"2024-09-21T07:36:55.187422+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187422+0000","last_undegraded":"2024-09-21T07:36:55.187422+0000","last_fullsized":"2024-09-21T07:36:55.187422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.208174+0000","last_change":"2024-09-21T07:36:55.206596+0000","last_active":"2024-09-21T07:36:56.208174+0000","last_peered":"2024-09-21T07:36:56.208174+0000","last_clean":"2024-09-21T07:36:56.208174+0000","last_became_active":"2024-09-21T07:36:55.206270+0000","last_became_peered":"2024-09-21T07:36:55.206270+0000","last_unstale":"2024-09-21T07:36:56.208174+0000","last_undegraded":"2024-09-21T07:36:56.208174+0000","last_fullsized":"2024-09-21T07:36:56.208174+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:09.900363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224604+0000","last_change":"2024-09-21T07:36:56.219605+0000","last_active":"2024-09-21T07:36:56.224604+0000","last_peered":"2024-09-21T07:36:56.224604+0000","last_clean":"2024-09-21T07:36:56.224604+0000","last_became_active":"2024-09-21T07:36:56.216745+0000","last_became_peered":"2024-09-21T07:36:56.216745+0000","last_unstale":"2024-09-21T07:36:56.224604+0000","last_undegraded":"2024-09-21T07:36:56.224604+0000","last_fullsized":"2024-09-21T07:36:56.224604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:40.290073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209996+0000","last_change":"2024-09-21T07:36:55.201898+0000","last_active":"2024-09-21T07:36:57.209996+0000","last_peered":"2024-09-21T07:36:57.209996+0000","last_clean":"2024-09-21T07:36:57.209996+0000","last_became_active":"2024-09-21T07:36:55.201581+0000","last_became_peered":"2024-09-21T07:36:55.201581+0000","last_unstale":"2024-09-21T07:36:57.209996+0000","last_undegraded":"2024-09-21T07:36:57.209996+0000","last_fullsized":"2024-09-21T07:36:57.209996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:27.902218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227992+0000","last_change":"2024-09-21T07:36:56.223740+0000","last_active":"2024-09-21T07:36:56.227992+0000","last_peered":"2024-09-21T07:36:56.227992+0000","last_clean":"2024-09-21T07:36:56.227992+0000","last_became_active":"2024-09-21T07:36:56.223305+0000","last_became_peered":"2024-09-21T07:36:56.223305+0000","last_unstale":"2024-09-21T07:36:56.227992+0000","last_undegraded":"2024-09-21T07:36:56.227992+0000","last_fullsized":"2024-09-21T07:36:56.227992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:26.707788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"204'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.227384+0000","last_change":"2024-09-21T07:36:55.202987+0000","last_active":"2024-09-21T07:36:57.227384+0000","last_peered":"2024-09-21T07:36:57.227384+0000","last_clean":"2024-09-21T07:36:57.227384+0000","last_became_active":"2024-09-21T07:36:55.202656+0000","last_became_peered":"2024-09-21T07:36:55.202656+0000","last_unstale":"2024-09-21T07:36:57.227384+0000","last_undegraded":"2024-09-21T07:36:57.227384+0000","last_fullsized":"2024-09-21T07:36:57.227384+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:18.120081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337229+0000","last_change":"2024-09-21T07:36:56.231483+0000","last_active":"2024-09-21T07:36:57.337229+0000","last_peered":"2024-09-21T07:36:57.337229+0000","last_clean":"2024-09-21T07:36:57.337229+0000","last_became_active":"2024-09-21T07:36:56.231174+0000","last_became_peered":"2024-09-21T07:36:56.231174+0000","last_unstale":"2024-09-21T07:36:57.337229+0000","last_undegraded":"2024-09-21T07:36:57.337229+0000","last_fullsized":"2024-09-21T07:36:57.337229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:23.639764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225789+0000","last_change":"2024-09-21T07:36:55.201998+0000","last_active":"2024-09-21T07:36:57.225789+0000","last_peered":"2024-09-21T07:36:57.225789+0000","last_clean":"2024-09-21T07:36:57.225789+0000","last_became_active":"2024-09-21T07:36:55.201662+0000","last_became_peered":"2024-09-21T07:36:55.201662+0000","last_unstale":"2024-09-21T07:36:57.225789+0000","last_undegraded":"2024-09-21T07:36:57.225789+0000","last_fullsized":"2024-09-21T07:36:57.225789+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:35.647330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222865+0000","last_change":"2024-09-21T07:36:56.219161+0000","last_active":"2024-09-21T07:36:56.222865+0000","last_peered":"2024-09-21T07:36:56.222865+0000","last_clean":"2024-09-21T07:36:56.222865+0000","last_became_active":"2024-09-21T07:36:56.218372+0000","last_became_peered":"2024-09-21T07:36:56.218372+0000","last_unstale":"2024-09-21T07:36:56.222865+0000","last_undegraded":"2024-09-21T07:36:56.222865+0000","last_fullsized":"2024-09-21T07:36:56.222865+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:07.593583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210308+0000","last_change":"2024-09-21T07:36:55.206649+0000","last_active":"2024-09-21T07:36:57.210308+0000","last_peered":"2024-09-21T07:36:57.210308+0000","last_clean":"2024-09-21T07:36:57.210308+0000","last_became_active":"2024-09-21T07:36:55.206341+0000","last_became_peered":"2024-09-21T07:36:55.206341+0000","last_unstale":"2024-09-21T07:36:57.210308+0000","last_undegraded":"2024-09-21T07:36:57.210308+0000","last_fullsized":"2024-09-21T07:36:57.210308+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:43.715074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187142+0000","last_change":"2024-09-21T07:36:55.187142+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187142+0000","last_undegraded":"2024-09-21T07:36:55.187142+0000","last_fullsized":"2024-09-21T07:36:55.187142+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209612+0000","last_change":"2024-09-21T07:36:55.200687+0000","last_active":"2024-09-21T07:36:57.209612+0000","last_peered":"2024-09-21T07:36:57.209612+0000","last_clean":"2024-09-21T07:36:57.209612+0000","last_became_active":"2024-09-21T07:36:55.200028+0000","last_became_peered":"2024-09-21T07:36:55.200028+0000","last_unstale":"2024-09-21T07:36:57.209612+0000","last_undegraded":"2024-09-21T07:36:57.209612+0000","last_fullsized":"2024-09-21T07:36:57.209612+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:10.111404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187186+0000","last_change":"2024-09-21T07:36:55.187186+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187186+0000","last_undegraded":"2024-09-21T07:36:55.187186+0000","last_fullsized":"2024-09-21T07:36:55.187186+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209172+0000","last_change":"2024-09-21T07:36:55.198983+0000","last_active":"2024-09-21T07:36:57.209172+0000","last_peered":"2024-09-21T07:36:57.209172+0000","last_clean":"2024-09-21T07:36:57.209172+0000","last_became_active":"2024-09-21T07:36:55.198513+0000","last_became_peered":"2024-09-21T07:36:55.198513+0000","last_unstale":"2024-09-21T07:36:57.209172+0000","last_undegraded":"2024-09-21T07:36:57.209172+0000","last_fullsized":"2024-09-21T07:36:57.209172+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:40.003553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227066+0000","last_change":"2024-09-21T07:36:56.225875+0000","last_active":"2024-09-21T07:36:56.227066+0000","last_peered":"2024-09-21T07:36:56.227066+0000","last_clean":"2024-09-21T07:36:56.227066+0000","last_became_active":"2024-09-21T07:36:56.225520+0000","last_became_peered":"2024-09-21T07:36:56.225520+0000","last_unstale":"2024-09-21T07:36:56.227066+0000","last_undegraded":"2024-09-21T07:36:56.227066+0000","last_fullsized":"2024-09-21T07:36:56.227066+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.174282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.205102+0000","last_change":"2024-09-21T07:36:55.211026+0000","last_active":"2024-09-21T07:36:56.205102+0000","last_peered":"2024-09-21T07:36:56.205102+0000","last_clean":"2024-09-21T07:36:56.205102+0000","last_became_active":"2024-09-21T07:36:55.210636+0000","last_became_peered":"2024-09-21T07:36:55.210636+0000","last_unstale":"2024-09-21T07:36:56.205102+0000","last_undegraded":"2024-09-21T07:36:56.205102+0000","last_fullsized":"2024-09-21T07:36:56.205102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:08.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209029+0000","last_change":"2024-09-21T07:36:56.222090+0000","last_active":"2024-09-21T07:36:57.209029+0000","last_peered":"2024-09-21T07:36:57.209029+0000","last_clean":"2024-09-21T07:36:57.209029+0000","last_became_active":"2024-09-21T07:36:56.221728+0000","last_became_peered":"2024-09-21T07:36:56.221728+0000","last_unstale":"2024-09-21T07:36:57.209029+0000","last_undegraded":"2024-09-21T07:36:57.209029+0000","last_fullsized":"2024-09-21T07:36:57.209029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:30.692530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208405+0000","last_change":"2024-09-21T07:36:55.194087+0000","last_active":"2024-09-21T07:36:57.208405+0000","last_peered":"2024-09-21T07:36:57.208405+0000","last_clean":"2024-09-21T07:36:57.208405+0000","last_became_active":"2024-09-21T07:36:55.193807+0000","last_became_peered":"2024-09-21T07:36:55.193807+0000","last_unstale":"2024-09-21T07:36:57.208405+0000","last_undegraded":"2024-09-21T07:36:57.208405+0000","last_fullsized":"2024-09-21T07:36:57.208405+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.803891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188614+0000","last_change":"2024-09-21T07:36:55.188614+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188614+0000","last_undegraded":"2024-09-21T07:36:55.188614+0000","last_fullsized":"2024-09-21T07:36:55.188614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.238326+0000","last_change":"2024-09-21T07:36:55.207312+0000","last_active":"2024-09-21T07:36:56.238326+0000","last_peered":"2024-09-21T07:36:56.238326+0000","last_clean":"2024-09-21T07:36:56.238326+0000","last_became_active":"2024-09-21T07:36:55.206468+0000","last_became_peered":"2024-09-21T07:36:55.206468+0000","last_unstale":"2024-09-21T07:36:56.238326+0000","last_undegraded":"2024-09-21T07:36:56.238326+0000","last_fullsized":"2024-09-21T07:36:56.238326+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.912021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":444,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.204117+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:36:56.204117+0000","last_peered":"2024-09-21T07:36:56.204117+0000","last_clean":"2024-09-21T07:36:56.204117+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:36:56.204117+0000","last_undegraded":"2024-09-21T07:36:56.204117+0000","last_fullsized":"2024-09-21T07:36:56.204117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55920,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315920,"statfs":{"total":96636764160,"available":96579502080,"internally_reserved":0,"allocated":2580480,"data_stored":1211070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2572288,"data_stored":1211014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47580,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324260,"statfs":{"total":96636764160,"available":96588042240,"internally_reserved":0,"allocated":2560000,"data_stored":1209422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60068,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311772,"statfs":{"total":96636764160,"available":96575254528,"internally_reserved":0,"allocated":2564096,"data_stored":1209948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509615,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64212,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307628,"statfs":{"total":96636764160,"available":96571011072,"internally_reserved":0,"allocated":2555904,"data_stored":1209332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509616,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56472,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315368,"statfs":{"total":96636764160,"available":96578936832,"internally_reserved":0,"allocated":3149824,"data_stored":1799700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542320,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":3084,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":3158016,"data_stored":1800372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87756,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284084,"statfs":{"total":96636764160,"available":96546902016,"internally_reserved":0,"allocated":2543616,"data_stored":1202165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:37:00.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- 172.21.15.64:0/3586239252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074420 msgr2=0x7fdb6806cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 --2- 172.21.15.64:0/3586239252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074420 0x7fdb6806cdf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005fd0 tx=0x7fdb5801c790 comp rx=0 tx=0).stop 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- 172.21.15.64:0/3586239252 shutdown_connections 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 --2- 172.21.15.64:0/3586239252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074420 0x7fdb6806cdf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- 172.21.15.64:0/3586239252 >> 172.21.15.64:0/3586239252 conn(0x7fdb680cdd00 msgr2=0x7fdb680ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- 172.21.15.64:0/3586239252 shutdown_connections 2024-09-21T07:37:01.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- 172.21.15.64:0/3586239252 wait complete. 2024-09-21T07:37:01.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 Processor -- start 2024-09-21T07:37:01.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.043+0000 7fdb6e800640 1 -- start start 2024-09-21T07:37:01.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb68074420 0x7fdb680d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074830 0x7fdb681f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6816b260 con 0x7fdb6806d330 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6816b0e0 con 0x7fdb68074830 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6816b3e0 con 0x7fdb68074420 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44456/0 (socket says 172.21.15.64:44456) 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 -- 172.21.15.64:0/877614502 learned_addr learned my addr 172.21.15.64:0/877614502 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67e00640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074830 0x7fdb681f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb5fe00640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb68074420 0x7fdb680d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 -- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb68074420 msgr2=0x7fdb680d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb68074420 0x7fdb680d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 -- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074830 msgr2=0x7fdb681f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074830 0x7fdb681f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 -- 172.21.15.64:0/877614502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb680b2540 con 0x7fdb6806d330 2024-09-21T07:37:01.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb67400640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fdb580193a0 tx=0x7fdb58005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58004130 con 0x7fdb6806d330 2024-09-21T07:37:01.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb580046d0 con 0x7fdb6806d330 2024-09-21T07:37:01.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58004ac0 con 0x7fdb6806d330 2024-09-21T07:37:01.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb680b2820 con 0x7fdb6806d330 2024-09-21T07:37:01.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb680b2de0 con 0x7fdb6806d330 2024-09-21T07:37:01.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.047+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6806cdf0 con 0x7fdb6806d330 2024-09-21T07:37:01.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.051+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb580bf020 con 0x7fdb6806d330 2024-09-21T07:37:01.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.051+0000 7fdb5f400640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 0x7fdb44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.051+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fdb5812e680 con 0x7fdb6806d330 2024-09-21T07:37:01.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.051+0000 7fdb5fe00640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 0x7fdb44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.051+0000 7fdb5fe00640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 0x7fdb44075710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001400 tx=0x7fdb50009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.055+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdb580c6020 con 0x7fdb6806d330 2024-09-21T07:37:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.231+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb68151c90 con 0x7fdb44073200 2024-09-21T07:37:01.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.235+0000 7fdb5f400640 1 -- 172.21.15.64:0/877614502 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251155 (secure 0 0 0) 0x7fdb68151c90 con 0x7fdb44073200 2024-09-21T07:37:01.238 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:01.239 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 msgr2=0x7fdb44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 0x7fdb44075710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001400 tx=0x7fdb50009040 comp rx=0 tx=0).stop 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 msgr2=0x7fdb68157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fdb580193a0 tx=0x7fdb58005cc0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 shutdown_connections 2024-09-21T07:37:01.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdb44073200 0x7fdb44075710 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb68074830 0x7fdb681f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb68074420 0x7fdb680d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 --2- 172.21.15.64:0/877614502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb6806d330 0x7fdb68157200 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 >> 172.21.15.64:0/877614502 conn(0x7fdb680cdd00 msgr2=0x7fdb680b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 shutdown_connections 2024-09-21T07:37:01.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.239+0000 7fdb6e800640 1 -- 172.21.15.64:0/877614502 wait complete. 2024-09-21T07:37:01.259 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-21T07:36:59.656304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":484400,"kb_used_data":21176,"kb_used_omap":12,"kb_used_meta":463027,"kb_avail":754490320,"statfs":{"total":773094113280,"available":772598087680,"internally_reserved":0,"allocated":21684224,"data_stored":10853023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":474140211},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479617"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222685+0000","last_change":"2024-09-21T07:36:56.220146+0000","last_active":"2024-09-21T07:36:56.222685+0000","last_peered":"2024-09-21T07:36:56.222685+0000","last_clean":"2024-09-21T07:36:56.222685+0000","last_became_active":"2024-09-21T07:36:56.218923+0000","last_became_peered":"2024-09-21T07:36:56.218923+0000","last_unstale":"2024-09-21T07:36:56.222685+0000","last_undegraded":"2024-09-21T07:36:56.222685+0000","last_fullsized":"2024-09-21T07:36:56.222685+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.793247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.218604+0000","last_change":"2024-09-21T07:36:56.216256+0000","last_active":"2024-09-21T07:36:56.218604+0000","last_peered":"2024-09-21T07:36:56.218604+0000","last_clean":"2024-09-21T07:36:56.218604+0000","last_became_active":"2024-09-21T07:36:56.215921+0000","last_became_peered":"2024-09-21T07:36:56.215921+0000","last_unstale":"2024-09-21T07:36:56.218604+0000","last_undegraded":"2024-09-21T07:36:56.218604+0000","last_fullsized":"2024-09-21T07:36:56.218604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:38.871128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.192236+0000","last_change":"2024-09-21T07:36:55.192236+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.192236+0000","last_undegraded":"2024-09-21T07:36:55.192236+0000","last_fullsized":"2024-09-21T07:36:55.192236+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209382+0000","last_change":"2024-09-21T07:36:56.226641+0000","last_active":"2024-09-21T07:36:57.209382+0000","last_peered":"2024-09-21T07:36:57.209382+0000","last_clean":"2024-09-21T07:36:57.209382+0000","last_became_active":"2024-09-21T07:36:56.226315+0000","last_became_peered":"2024-09-21T07:36:56.226315+0000","last_unstale":"2024-09-21T07:36:57.209382+0000","last_undegraded":"2024-09-21T07:36:57.209382+0000","last_fullsized":"2024-09-21T07:36:57.209382+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:28.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.230623+0000","last_change":"2024-09-21T07:36:56.226972+0000","last_active":"2024-09-21T07:36:56.230623+0000","last_peered":"2024-09-21T07:36:56.230623+0000","last_clean":"2024-09-21T07:36:56.230623+0000","last_became_active":"2024-09-21T07:36:56.226668+0000","last_became_peered":"2024-09-21T07:36:56.226668+0000","last_unstale":"2024-09-21T07:36:56.230623+0000","last_undegraded":"2024-09-21T07:36:56.230623+0000","last_fullsized":"2024-09-21T07:36:56.230623+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.950933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337085+0000","last_change":"2024-09-21T07:36:56.227380+0000","last_active":"2024-09-21T07:36:57.337085+0000","last_peered":"2024-09-21T07:36:57.337085+0000","last_clean":"2024-09-21T07:36:57.337085+0000","last_became_active":"2024-09-21T07:36:56.227054+0000","last_became_peered":"2024-09-21T07:36:56.227054+0000","last_unstale":"2024-09-21T07:36:57.337085+0000","last_undegraded":"2024-09-21T07:36:57.337085+0000","last_fullsized":"2024-09-21T07:36:57.337085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:52.133345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190300+0000","last_change":"2024-09-21T07:36:55.190300+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190300+0000","last_undegraded":"2024-09-21T07:36:55.190300+0000","last_fullsized":"2024-09-21T07:36:55.190300+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336638+0000","last_change":"2024-09-21T07:36:56.226508+0000","last_active":"2024-09-21T07:36:57.336638+0000","last_peered":"2024-09-21T07:36:57.336638+0000","last_clean":"2024-09-21T07:36:57.336638+0000","last_became_active":"2024-09-21T07:36:56.226137+0000","last_became_peered":"2024-09-21T07:36:56.226137+0000","last_unstale":"2024-09-21T07:36:57.336638+0000","last_undegraded":"2024-09-21T07:36:57.336638+0000","last_fullsized":"2024-09-21T07:36:57.336638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:57.754951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222936+0000","last_change":"2024-09-21T07:36:56.219507+0000","last_active":"2024-09-21T07:36:56.222936+0000","last_peered":"2024-09-21T07:36:56.222936+0000","last_clean":"2024-09-21T07:36:56.222936+0000","last_became_active":"2024-09-21T07:36:56.218848+0000","last_became_peered":"2024-09-21T07:36:56.218848+0000","last_unstale":"2024-09-21T07:36:56.222936+0000","last_undegraded":"2024-09-21T07:36:56.222936+0000","last_fullsized":"2024-09-21T07:36:56.222936+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:59.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191723+0000","last_change":"2024-09-21T07:36:55.191723+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191723+0000","last_undegraded":"2024-09-21T07:36:55.191723+0000","last_fullsized":"2024-09-21T07:36:55.191723+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209534+0000","last_change":"2024-09-21T07:36:56.228467+0000","last_active":"2024-09-21T07:36:57.209534+0000","last_peered":"2024-09-21T07:36:57.209534+0000","last_clean":"2024-09-21T07:36:57.209534+0000","last_became_active":"2024-09-21T07:36:56.228120+0000","last_became_peered":"2024-09-21T07:36:56.228120+0000","last_unstale":"2024-09-21T07:36:57.209534+0000","last_undegraded":"2024-09-21T07:36:57.209534+0000","last_fullsized":"2024-09-21T07:36:57.209534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:48.976340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210044+0000","last_change":"2024-09-21T07:36:56.219132+0000","last_active":"2024-09-21T07:36:57.210044+0000","last_peered":"2024-09-21T07:36:57.210044+0000","last_clean":"2024-09-21T07:36:57.210044+0000","last_became_active":"2024-09-21T07:36:56.218824+0000","last_became_peered":"2024-09-21T07:36:56.218824+0000","last_unstale":"2024-09-21T07:36:57.210044+0000","last_undegraded":"2024-09-21T07:36:57.210044+0000","last_fullsized":"2024-09-21T07:36:57.210044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:37.141989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337303+0000","last_change":"2024-09-21T07:36:56.232879+0000","last_active":"2024-09-21T07:36:57.337303+0000","last_peered":"2024-09-21T07:36:57.337303+0000","last_clean":"2024-09-21T07:36:57.337303+0000","last_became_active":"2024-09-21T07:36:56.232253+0000","last_became_peered":"2024-09-21T07:36:56.232253+0000","last_unstale":"2024-09-21T07:36:57.337303+0000","last_undegraded":"2024-09-21T07:36:57.337303+0000","last_fullsized":"2024-09-21T07:36:57.337303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:18.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208981+0000","last_change":"2024-09-21T07:36:56.203575+0000","last_active":"2024-09-21T07:36:57.208981+0000","last_peered":"2024-09-21T07:36:57.208981+0000","last_clean":"2024-09-21T07:36:57.208981+0000","last_became_active":"2024-09-21T07:36:56.203239+0000","last_became_peered":"2024-09-21T07:36:56.203239+0000","last_unstale":"2024-09-21T07:36:57.208981+0000","last_undegraded":"2024-09-21T07:36:57.208981+0000","last_fullsized":"2024-09-21T07:36:57.208981+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:05.938973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225710+0000","last_change":"2024-09-21T07:36:56.202116+0000","last_active":"2024-09-21T07:36:57.225710+0000","last_peered":"2024-09-21T07:36:57.225710+0000","last_clean":"2024-09-21T07:36:57.225710+0000","last_became_active":"2024-09-21T07:36:56.201784+0000","last_became_peered":"2024-09-21T07:36:56.201784+0000","last_unstale":"2024-09-21T07:36:57.225710+0000","last_undegraded":"2024-09-21T07:36:57.225710+0000","last_fullsized":"2024-09-21T07:36:57.225710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:30.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336659+0000","last_change":"2024-09-21T07:36:56.220846+0000","last_active":"2024-09-21T07:36:57.336659+0000","last_peered":"2024-09-21T07:36:57.336659+0000","last_clean":"2024-09-21T07:36:57.336659+0000","last_became_active":"2024-09-21T07:36:56.218536+0000","last_became_peered":"2024-09-21T07:36:56.218536+0000","last_unstale":"2024-09-21T07:36:57.336659+0000","last_undegraded":"2024-09-21T07:36:57.336659+0000","last_fullsized":"2024-09-21T07:36:57.336659+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:48.683975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209762+0000","last_change":"2024-09-21T07:36:56.221685+0000","last_active":"2024-09-21T07:36:57.209762+0000","last_peered":"2024-09-21T07:36:57.209762+0000","last_clean":"2024-09-21T07:36:57.209762+0000","last_became_active":"2024-09-21T07:36:56.221305+0000","last_became_peered":"2024-09-21T07:36:56.221305+0000","last_unstale":"2024-09-21T07:36:57.209762+0000","last_undegraded":"2024-09-21T07:36:57.209762+0000","last_fullsized":"2024-09-21T07:36:57.209762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:17.092807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.191272+0000","last_change":"2024-09-21T07:36:55.191272+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.191272+0000","last_undegraded":"2024-09-21T07:36:55.191272+0000","last_fullsized":"2024-09-21T07:36:55.191272+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.220366+0000","last_change":"2024-09-21T07:36:56.217839+0000","last_active":"2024-09-21T07:36:56.220366+0000","last_peered":"2024-09-21T07:36:56.220366+0000","last_clean":"2024-09-21T07:36:56.220366+0000","last_became_active":"2024-09-21T07:36:56.217407+0000","last_became_peered":"2024-09-21T07:36:56.217407+0000","last_unstale":"2024-09-21T07:36:56.220366+0000","last_undegraded":"2024-09-21T07:36:56.220366+0000","last_fullsized":"2024-09-21T07:36:56.220366+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337202+0000","last_change":"2024-09-21T07:36:56.230192+0000","last_active":"2024-09-21T07:36:57.337202+0000","last_peered":"2024-09-21T07:36:57.337202+0000","last_clean":"2024-09-21T07:36:57.337202+0000","last_became_active":"2024-09-21T07:36:56.229899+0000","last_became_peered":"2024-09-21T07:36:56.229899+0000","last_unstale":"2024-09-21T07:36:57.337202+0000","last_undegraded":"2024-09-21T07:36:57.337202+0000","last_fullsized":"2024-09-21T07:36:57.337202+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190038+0000","last_change":"2024-09-21T07:36:55.190038+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190038+0000","last_undegraded":"2024-09-21T07:36:55.190038+0000","last_fullsized":"2024-09-21T07:36:55.190038+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225373+0000","last_change":"2024-09-21T07:36:56.216982+0000","last_active":"2024-09-21T07:36:57.225373+0000","last_peered":"2024-09-21T07:36:57.225373+0000","last_clean":"2024-09-21T07:36:57.225373+0000","last_became_active":"2024-09-21T07:36:56.216675+0000","last_became_peered":"2024-09-21T07:36:56.216675+0000","last_unstale":"2024-09-21T07:36:57.225373+0000","last_undegraded":"2024-09-21T07:36:57.225373+0000","last_fullsized":"2024-09-21T07:36:57.225373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:23.387580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224168+0000","last_change":"2024-09-21T07:36:56.220450+0000","last_active":"2024-09-21T07:36:56.224168+0000","last_peered":"2024-09-21T07:36:56.224168+0000","last_clean":"2024-09-21T07:36:56.224168+0000","last_became_active":"2024-09-21T07:36:56.220136+0000","last_became_peered":"2024-09-21T07:36:56.220136+0000","last_unstale":"2024-09-21T07:36:56.224168+0000","last_undegraded":"2024-09-21T07:36:56.224168+0000","last_fullsized":"2024-09-21T07:36:56.224168+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:12.123759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228273+0000","last_change":"2024-09-21T07:36:56.225330+0000","last_active":"2024-09-21T07:36:56.228273+0000","last_peered":"2024-09-21T07:36:56.228273+0000","last_clean":"2024-09-21T07:36:56.228273+0000","last_became_active":"2024-09-21T07:36:56.224756+0000","last_became_peered":"2024-09-21T07:36:56.224756+0000","last_unstale":"2024-09-21T07:36:56.228273+0000","last_undegraded":"2024-09-21T07:36:56.228273+0000","last_fullsized":"2024-09-21T07:36:56.228273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:23.684068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228052+0000","last_change":"2024-09-21T07:36:56.224291+0000","last_active":"2024-09-21T07:36:56.228052+0000","last_peered":"2024-09-21T07:36:56.228052+0000","last_clean":"2024-09-21T07:36:56.228052+0000","last_became_active":"2024-09-21T07:36:56.223882+0000","last_became_peered":"2024-09-21T07:36:56.223882+0000","last_unstale":"2024-09-21T07:36:56.228052+0000","last_undegraded":"2024-09-21T07:36:56.228052+0000","last_fullsized":"2024-09-21T07:36:56.228052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:09.061762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.190829+0000","last_change":"2024-09-21T07:36:55.190829+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.190829+0000","last_undegraded":"2024-09-21T07:36:55.190829+0000","last_fullsized":"2024-09-21T07:36:55.190829+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209740+0000","last_change":"2024-09-21T07:36:56.231954+0000","last_active":"2024-09-21T07:36:57.209740+0000","last_peered":"2024-09-21T07:36:57.209740+0000","last_clean":"2024-09-21T07:36:57.209740+0000","last_became_active":"2024-09-21T07:36:56.231645+0000","last_became_peered":"2024-09-21T07:36:56.231645+0000","last_unstale":"2024-09-21T07:36:57.209740+0000","last_undegraded":"2024-09-21T07:36:57.209740+0000","last_fullsized":"2024-09-21T07:36:57.209740+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:31.811145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209268+0000","last_change":"2024-09-21T07:36:56.212089+0000","last_active":"2024-09-21T07:36:57.209268+0000","last_peered":"2024-09-21T07:36:57.209268+0000","last_clean":"2024-09-21T07:36:57.209268+0000","last_became_active":"2024-09-21T07:36:56.211747+0000","last_became_peered":"2024-09-21T07:36:56.211747+0000","last_unstale":"2024-09-21T07:36:57.209268+0000","last_undegraded":"2024-09-21T07:36:57.209268+0000","last_fullsized":"2024-09-21T07:36:57.209268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:28.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.226852+0000","last_change":"2024-09-21T07:36:56.224194+0000","last_active":"2024-09-21T07:36:56.226852+0000","last_peered":"2024-09-21T07:36:56.226852+0000","last_clean":"2024-09-21T07:36:56.226852+0000","last_became_active":"2024-09-21T07:36:56.223128+0000","last_became_peered":"2024-09-21T07:36:56.223128+0000","last_unstale":"2024-09-21T07:36:56.226852+0000","last_undegraded":"2024-09-21T07:36:56.226852+0000","last_fullsized":"2024-09-21T07:36:56.226852+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337165+0000","last_change":"2024-09-21T07:36:56.215274+0000","last_active":"2024-09-21T07:36:57.337165+0000","last_peered":"2024-09-21T07:36:57.337165+0000","last_clean":"2024-09-21T07:36:57.337165+0000","last_became_active":"2024-09-21T07:36:56.214442+0000","last_became_peered":"2024-09-21T07:36:56.214442+0000","last_unstale":"2024-09-21T07:36:57.337165+0000","last_undegraded":"2024-09-21T07:36:57.337165+0000","last_fullsized":"2024-09-21T07:36:57.337165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:14.011653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224196+0000","last_change":"2024-09-21T07:36:56.221559+0000","last_active":"2024-09-21T07:36:56.224196+0000","last_peered":"2024-09-21T07:36:56.224196+0000","last_clean":"2024-09-21T07:36:56.224196+0000","last_became_active":"2024-09-21T07:36:56.221199+0000","last_became_peered":"2024-09-21T07:36:56.221199+0000","last_unstale":"2024-09-21T07:36:56.224196+0000","last_undegraded":"2024-09-21T07:36:56.224196+0000","last_fullsized":"2024-09-21T07:36:56.224196+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.963469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337225+0000","last_change":"2024-09-21T07:36:56.213521+0000","last_active":"2024-09-21T07:36:57.337225+0000","last_peered":"2024-09-21T07:36:57.337225+0000","last_clean":"2024-09-21T07:36:57.337225+0000","last_became_active":"2024-09-21T07:36:56.213022+0000","last_became_peered":"2024-09-21T07:36:56.213022+0000","last_unstale":"2024-09-21T07:36:57.337225+0000","last_undegraded":"2024-09-21T07:36:57.337225+0000","last_fullsized":"2024-09-21T07:36:57.337225+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:35.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189060+0000","last_change":"2024-09-21T07:36:55.189060+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189060+0000","last_undegraded":"2024-09-21T07:36:55.189060+0000","last_fullsized":"2024-09-21T07:36:55.189060+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":17,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240232+0000","last_change":"2024-09-21T07:36:55.208936+0000","last_active":"2024-09-21T07:36:56.240232+0000","last_peered":"2024-09-21T07:36:56.240232+0000","last_clean":"2024-09-21T07:36:56.240232+0000","last_became_active":"2024-09-21T07:36:55.208637+0000","last_became_peered":"2024-09-21T07:36:55.208637+0000","last_unstale":"2024-09-21T07:36:56.240232+0000","last_undegraded":"2024-09-21T07:36:56.240232+0000","last_fullsized":"2024-09-21T07:36:56.240232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:44.237771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.189626+0000","last_change":"2024-09-21T07:36:55.189626+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.189626+0000","last_undegraded":"2024-09-21T07:36:55.189626+0000","last_fullsized":"2024-09-21T07:36:55.189626+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209586+0000","last_change":"2024-09-21T07:36:55.208486+0000","last_active":"2024-09-21T07:36:57.209586+0000","last_peered":"2024-09-21T07:36:57.209586+0000","last_clean":"2024-09-21T07:36:57.209586+0000","last_became_active":"2024-09-21T07:36:55.207826+0000","last_became_peered":"2024-09-21T07:36:55.207826+0000","last_unstale":"2024-09-21T07:36:57.209586+0000","last_undegraded":"2024-09-21T07:36:57.209586+0000","last_fullsized":"2024-09-21T07:36:57.209586+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:55.679055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209488+0000","last_change":"2024-09-21T07:36:56.222112+0000","last_active":"2024-09-21T07:36:57.209488+0000","last_peered":"2024-09-21T07:36:57.209488+0000","last_clean":"2024-09-21T07:36:57.209488+0000","last_became_active":"2024-09-21T07:36:56.221751+0000","last_became_peered":"2024-09-21T07:36:56.221751+0000","last_unstale":"2024-09-21T07:36:57.209488+0000","last_undegraded":"2024-09-21T07:36:57.209488+0000","last_fullsized":"2024-09-21T07:36:57.209488+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:50.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337205+0000","last_change":"2024-09-21T07:36:55.201067+0000","last_active":"2024-09-21T07:36:57.337205+0000","last_peered":"2024-09-21T07:36:57.337205+0000","last_clean":"2024-09-21T07:36:57.337205+0000","last_became_active":"2024-09-21T07:36:55.200701+0000","last_became_peered":"2024-09-21T07:36:55.200701+0000","last_unstale":"2024-09-21T07:36:57.337205+0000","last_undegraded":"2024-09-21T07:36:57.337205+0000","last_fullsized":"2024-09-21T07:36:57.337205+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:12.736774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188516+0000","last_change":"2024-09-21T07:36:55.188516+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188516+0000","last_undegraded":"2024-09-21T07:36:55.188516+0000","last_fullsized":"2024-09-21T07:36:55.188516+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225551+0000","last_change":"2024-09-21T07:36:55.205908+0000","last_active":"2024-09-21T07:36:57.225551+0000","last_peered":"2024-09-21T07:36:57.225551+0000","last_clean":"2024-09-21T07:36:57.225551+0000","last_became_active":"2024-09-21T07:36:55.205436+0000","last_became_peered":"2024-09-21T07:36:55.205436+0000","last_unstale":"2024-09-21T07:36:57.225551+0000","last_undegraded":"2024-09-21T07:36:57.225551+0000","last_fullsized":"2024-09-21T07:36:57.225551+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:56.199982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208667+0000","last_change":"2024-09-21T07:36:56.214216+0000","last_active":"2024-09-21T07:36:57.208667+0000","last_peered":"2024-09-21T07:36:57.208667+0000","last_clean":"2024-09-21T07:36:57.208667+0000","last_became_active":"2024-09-21T07:36:56.213795+0000","last_became_peered":"2024-09-21T07:36:56.213795+0000","last_unstale":"2024-09-21T07:36:57.208667+0000","last_undegraded":"2024-09-21T07:36:57.208667+0000","last_fullsized":"2024-09-21T07:36:57.208667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:27.786546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.237402+0000","last_change":"2024-09-21T07:36:55.208547+0000","last_active":"2024-09-21T07:36:56.237402+0000","last_peered":"2024-09-21T07:36:56.237402+0000","last_clean":"2024-09-21T07:36:56.237402+0000","last_became_active":"2024-09-21T07:36:55.208213+0000","last_became_peered":"2024-09-21T07:36:55.208213+0000","last_unstale":"2024-09-21T07:36:56.237402+0000","last_undegraded":"2024-09-21T07:36:56.237402+0000","last_fullsized":"2024-09-21T07:36:56.237402+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:16.287683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225477+0000","last_change":"2024-09-21T07:36:56.221370+0000","last_active":"2024-09-21T07:36:57.225477+0000","last_peered":"2024-09-21T07:36:57.225477+0000","last_clean":"2024-09-21T07:36:57.225477+0000","last_became_active":"2024-09-21T07:36:56.221018+0000","last_became_peered":"2024-09-21T07:36:56.221018+0000","last_unstale":"2024-09-21T07:36:57.225477+0000","last_undegraded":"2024-09-21T07:36:57.225477+0000","last_fullsized":"2024-09-21T07:36:57.225477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:47.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208803+0000","last_change":"2024-09-21T07:36:55.202201+0000","last_active":"2024-09-21T07:36:57.208803+0000","last_peered":"2024-09-21T07:36:57.208803+0000","last_clean":"2024-09-21T07:36:57.208803+0000","last_became_active":"2024-09-21T07:36:55.201905+0000","last_became_peered":"2024-09-21T07:36:55.201905+0000","last_unstale":"2024-09-21T07:36:57.208803+0000","last_undegraded":"2024-09-21T07:36:57.208803+0000","last_fullsized":"2024-09-21T07:36:57.208803+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:16.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228909+0000","last_change":"2024-09-21T07:36:56.227247+0000","last_active":"2024-09-21T07:36:56.228909+0000","last_peered":"2024-09-21T07:36:56.228909+0000","last_clean":"2024-09-21T07:36:56.228909+0000","last_became_active":"2024-09-21T07:36:56.226637+0000","last_became_peered":"2024-09-21T07:36:56.226637+0000","last_unstale":"2024-09-21T07:36:56.228909+0000","last_undegraded":"2024-09-21T07:36:56.228909+0000","last_fullsized":"2024-09-21T07:36:56.228909+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:46.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206816+0000","last_change":"2024-09-21T07:36:55.204178+0000","last_active":"2024-09-21T07:36:55.206816+0000","last_peered":"2024-09-21T07:36:55.206816+0000","last_clean":"2024-09-21T07:36:55.206816+0000","last_became_active":"2024-09-21T07:36:55.199695+0000","last_became_peered":"2024-09-21T07:36:55.199695+0000","last_unstale":"2024-09-21T07:36:55.206816+0000","last_undegraded":"2024-09-21T07:36:55.206816+0000","last_fullsized":"2024-09-21T07:36:55.206816+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:33.997906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225888+0000","last_change":"2024-09-21T07:36:56.228149+0000","last_active":"2024-09-21T07:36:57.225888+0000","last_peered":"2024-09-21T07:36:57.225888+0000","last_clean":"2024-09-21T07:36:57.225888+0000","last_became_active":"2024-09-21T07:36:56.227785+0000","last_became_peered":"2024-09-21T07:36:56.227785+0000","last_unstale":"2024-09-21T07:36:57.225888+0000","last_undegraded":"2024-09-21T07:36:57.225888+0000","last_fullsized":"2024-09-21T07:36:57.225888+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:25:44.487949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207067+0000","last_change":"2024-09-21T07:36:55.207507+0000","last_active":"2024-09-21T07:36:56.207067+0000","last_peered":"2024-09-21T07:36:56.207067+0000","last_clean":"2024-09-21T07:36:56.207067+0000","last_became_active":"2024-09-21T07:36:55.207028+0000","last_became_peered":"2024-09-21T07:36:55.207028+0000","last_unstale":"2024-09-21T07:36:56.207067+0000","last_undegraded":"2024-09-21T07:36:56.207067+0000","last_fullsized":"2024-09-21T07:36:56.207067+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:14.332670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225784+0000","last_change":"2024-09-21T07:36:56.211579+0000","last_active":"2024-09-21T07:36:57.225784+0000","last_peered":"2024-09-21T07:36:57.225784+0000","last_clean":"2024-09-21T07:36:57.225784+0000","last_became_active":"2024-09-21T07:36:56.211261+0000","last_became_peered":"2024-09-21T07:36:56.211261+0000","last_unstale":"2024-09-21T07:36:57.225784+0000","last_undegraded":"2024-09-21T07:36:57.225784+0000","last_fullsized":"2024-09-21T07:36:57.225784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:04.216771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209913+0000","last_change":"2024-09-21T07:36:55.200523+0000","last_active":"2024-09-21T07:36:57.209913+0000","last_peered":"2024-09-21T07:36:57.209913+0000","last_clean":"2024-09-21T07:36:57.209913+0000","last_became_active":"2024-09-21T07:36:55.200171+0000","last_became_peered":"2024-09-21T07:36:55.200171+0000","last_unstale":"2024-09-21T07:36:57.209913+0000","last_undegraded":"2024-09-21T07:36:57.209913+0000","last_fullsized":"2024-09-21T07:36:57.209913+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:29.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188195+0000","last_change":"2024-09-21T07:36:55.188195+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188195+0000","last_undegraded":"2024-09-21T07:36:55.188195+0000","last_fullsized":"2024-09-21T07:36:55.188195+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":16,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240321+0000","last_change":"2024-09-21T07:36:55.208006+0000","last_active":"2024-09-21T07:36:56.240321+0000","last_peered":"2024-09-21T07:36:56.240321+0000","last_clean":"2024-09-21T07:36:56.240321+0000","last_became_active":"2024-09-21T07:36:55.207715+0000","last_became_peered":"2024-09-21T07:36:55.207715+0000","last_unstale":"2024-09-21T07:36:56.240321+0000","last_undegraded":"2024-09-21T07:36:56.240321+0000","last_fullsized":"2024-09-21T07:36:56.240321+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:15.980896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210132+0000","last_change":"2024-09-21T07:36:56.223296+0000","last_active":"2024-09-21T07:36:57.210132+0000","last_peered":"2024-09-21T07:36:57.210132+0000","last_clean":"2024-09-21T07:36:57.210132+0000","last_became_active":"2024-09-21T07:36:56.222802+0000","last_became_peered":"2024-09-21T07:36:56.222802+0000","last_unstale":"2024-09-21T07:36:57.210132+0000","last_undegraded":"2024-09-21T07:36:57.210132+0000","last_fullsized":"2024-09-21T07:36:57.210132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:20.625782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":21,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337124+0000","last_change":"2024-09-21T07:36:55.195328+0000","last_active":"2024-09-21T07:36:57.337124+0000","last_peered":"2024-09-21T07:36:57.337124+0000","last_clean":"2024-09-21T07:36:57.337124+0000","last_became_active":"2024-09-21T07:36:55.194804+0000","last_became_peered":"2024-09-21T07:36:55.194804+0000","last_unstale":"2024-09-21T07:36:57.337124+0000","last_undegraded":"2024-09-21T07:36:57.337124+0000","last_fullsized":"2024-09-21T07:36:57.337124+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:18.921474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.229935+0000","last_change":"2024-09-21T07:36:56.228831+0000","last_active":"2024-09-21T07:36:56.229935+0000","last_peered":"2024-09-21T07:36:56.229935+0000","last_clean":"2024-09-21T07:36:56.229935+0000","last_became_active":"2024-09-21T07:36:56.228056+0000","last_became_peered":"2024-09-21T07:36:56.228056+0000","last_unstale":"2024-09-21T07:36:56.229935+0000","last_undegraded":"2024-09-21T07:36:56.229935+0000","last_fullsized":"2024-09-21T07:36:56.229935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:35.309506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209152+0000","last_change":"2024-09-21T07:36:55.200997+0000","last_active":"2024-09-21T07:36:57.209152+0000","last_peered":"2024-09-21T07:36:57.209152+0000","last_clean":"2024-09-21T07:36:57.209152+0000","last_became_active":"2024-09-21T07:36:55.200396+0000","last_became_peered":"2024-09-21T07:36:55.200396+0000","last_unstale":"2024-09-21T07:36:57.209152+0000","last_undegraded":"2024-09-21T07:36:57.209152+0000","last_fullsized":"2024-09-21T07:36:57.209152+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:19.618528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208835+0000","last_change":"2024-09-21T07:36:56.219624+0000","last_active":"2024-09-21T07:36:57.208835+0000","last_peered":"2024-09-21T07:36:57.208835+0000","last_clean":"2024-09-21T07:36:57.208835+0000","last_became_active":"2024-09-21T07:36:56.216161+0000","last_became_peered":"2024-09-21T07:36:56.216161+0000","last_unstale":"2024-09-21T07:36:57.208835+0000","last_undegraded":"2024-09-21T07:36:57.208835+0000","last_fullsized":"2024-09-21T07:36:57.208835+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:36.243592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207357+0000","last_change":"2024-09-21T07:36:55.198647+0000","last_active":"2024-09-21T07:36:56.207357+0000","last_peered":"2024-09-21T07:36:56.207357+0000","last_clean":"2024-09-21T07:36:56.207357+0000","last_became_active":"2024-09-21T07:36:55.198253+0000","last_became_peered":"2024-09-21T07:36:55.198253+0000","last_unstale":"2024-09-21T07:36:56.207357+0000","last_undegraded":"2024-09-21T07:36:56.207357+0000","last_fullsized":"2024-09-21T07:36:56.207357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:21.793379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187308+0000","last_change":"2024-09-21T07:36:55.187308+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187308+0000","last_undegraded":"2024-09-21T07:36:55.187308+0000","last_fullsized":"2024-09-21T07:36:55.187308+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336481+0000","last_change":"2024-09-21T07:36:55.194123+0000","last_active":"2024-09-21T07:36:57.336481+0000","last_peered":"2024-09-21T07:36:57.336481+0000","last_clean":"2024-09-21T07:36:57.336481+0000","last_became_active":"2024-09-21T07:36:55.193443+0000","last_became_peered":"2024-09-21T07:36:55.193443+0000","last_unstale":"2024-09-21T07:36:57.336481+0000","last_undegraded":"2024-09-21T07:36:57.336481+0000","last_fullsized":"2024-09-21T07:36:57.336481+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:58.513398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.226004+0000","last_change":"2024-09-21T07:36:56.211258+0000","last_active":"2024-09-21T07:36:57.226004+0000","last_peered":"2024-09-21T07:36:57.226004+0000","last_clean":"2024-09-21T07:36:57.226004+0000","last_became_active":"2024-09-21T07:36:56.210949+0000","last_became_peered":"2024-09-21T07:36:56.210949+0000","last_unstale":"2024-09-21T07:36:57.226004+0000","last_undegraded":"2024-09-21T07:36:57.226004+0000","last_fullsized":"2024-09-21T07:36:57.226004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:08.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":23,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208224+0000","last_change":"2024-09-21T07:36:55.195611+0000","last_active":"2024-09-21T07:36:57.208224+0000","last_peered":"2024-09-21T07:36:57.208224+0000","last_clean":"2024-09-21T07:36:57.208224+0000","last_became_active":"2024-09-21T07:36:55.195346+0000","last_became_peered":"2024-09-21T07:36:55.195346+0000","last_unstale":"2024-09-21T07:36:57.208224+0000","last_undegraded":"2024-09-21T07:36:57.208224+0000","last_fullsized":"2024-09-21T07:36:57.208224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:47.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224577+0000","last_change":"2024-09-21T07:36:56.219414+0000","last_active":"2024-09-21T07:36:56.224577+0000","last_peered":"2024-09-21T07:36:56.224577+0000","last_clean":"2024-09-21T07:36:56.224577+0000","last_became_active":"2024-09-21T07:36:56.214646+0000","last_became_peered":"2024-09-21T07:36:56.214646+0000","last_unstale":"2024-09-21T07:36:56.224577+0000","last_undegraded":"2024-09-21T07:36:56.224577+0000","last_fullsized":"2024-09-21T07:36:56.224577+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:34.398725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-21T07:36:55.206617+0000","last_change":"2024-09-21T07:36:55.199617+0000","last_active":"2024-09-21T07:36:55.206617+0000","last_peered":"2024-09-21T07:36:55.206617+0000","last_clean":"2024-09-21T07:36:55.206617+0000","last_became_active":"2024-09-21T07:36:55.199251+0000","last_became_peered":"2024-09-21T07:36:55.199251+0000","last_unstale":"2024-09-21T07:36:55.206617+0000","last_undegraded":"2024-09-21T07:36:55.206617+0000","last_fullsized":"2024-09-21T07:36:55.206617+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:48.336056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.231589+0000","last_change":"2024-09-21T07:36:56.229275+0000","last_active":"2024-09-21T07:36:56.231589+0000","last_peered":"2024-09-21T07:36:56.231589+0000","last_clean":"2024-09-21T07:36:56.231589+0000","last_became_active":"2024-09-21T07:36:56.228759+0000","last_became_peered":"2024-09-21T07:36:56.228759+0000","last_unstale":"2024-09-21T07:36:56.231589+0000","last_undegraded":"2024-09-21T07:36:56.231589+0000","last_fullsized":"2024-09-21T07:36:56.231589+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.801290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.236277+0000","last_change":"2024-09-21T07:36:55.206279+0000","last_active":"2024-09-21T07:36:56.236277+0000","last_peered":"2024-09-21T07:36:56.236277+0000","last_clean":"2024-09-21T07:36:56.236277+0000","last_became_active":"2024-09-21T07:36:55.205963+0000","last_became_peered":"2024-09-21T07:36:55.205963+0000","last_unstale":"2024-09-21T07:36:56.236277+0000","last_undegraded":"2024-09-21T07:36:56.236277+0000","last_fullsized":"2024-09-21T07:36:56.236277+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187188+0000","last_change":"2024-09-21T07:36:55.187188+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187188+0000","last_undegraded":"2024-09-21T07:36:55.187188+0000","last_fullsized":"2024-09-21T07:36:55.187188+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209810+0000","last_change":"2024-09-21T07:36:55.195028+0000","last_active":"2024-09-21T07:36:57.209810+0000","last_peered":"2024-09-21T07:36:57.209810+0000","last_clean":"2024-09-21T07:36:57.209810+0000","last_became_active":"2024-09-21T07:36:55.194670+0000","last_became_peered":"2024-09-21T07:36:55.194670+0000","last_unstale":"2024-09-21T07:36:57.209810+0000","last_undegraded":"2024-09-21T07:36:57.209810+0000","last_fullsized":"2024-09-21T07:36:57.209810+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:05.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210062+0000","last_change":"2024-09-21T07:36:56.218458+0000","last_active":"2024-09-21T07:36:57.210062+0000","last_peered":"2024-09-21T07:36:57.210062+0000","last_clean":"2024-09-21T07:36:57.210062+0000","last_became_active":"2024-09-21T07:36:56.216457+0000","last_became_peered":"2024-09-21T07:36:56.216457+0000","last_unstale":"2024-09-21T07:36:57.210062+0000","last_undegraded":"2024-09-21T07:36:57.210062+0000","last_fullsized":"2024-09-21T07:36:57.210062+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:52.209400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209427+0000","last_change":"2024-09-21T07:36:55.195031+0000","last_active":"2024-09-21T07:36:57.209427+0000","last_peered":"2024-09-21T07:36:57.209427+0000","last_clean":"2024-09-21T07:36:57.209427+0000","last_became_active":"2024-09-21T07:36:55.194562+0000","last_became_peered":"2024-09-21T07:36:55.194562+0000","last_unstale":"2024-09-21T07:36:57.209427+0000","last_undegraded":"2024-09-21T07:36:57.209427+0000","last_fullsized":"2024-09-21T07:36:57.209427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:13.287440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208070+0000","last_change":"2024-09-21T07:36:56.217928+0000","last_active":"2024-09-21T07:36:57.208070+0000","last_peered":"2024-09-21T07:36:57.208070+0000","last_clean":"2024-09-21T07:36:57.208070+0000","last_became_active":"2024-09-21T07:36:56.217476+0000","last_became_peered":"2024-09-21T07:36:56.217476+0000","last_unstale":"2024-09-21T07:36:57.208070+0000","last_undegraded":"2024-09-21T07:36:57.208070+0000","last_fullsized":"2024-09-21T07:36:57.208070+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:39.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209270+0000","last_change":"2024-09-21T07:36:55.207808+0000","last_active":"2024-09-21T07:36:57.209270+0000","last_peered":"2024-09-21T07:36:57.209270+0000","last_clean":"2024-09-21T07:36:57.209270+0000","last_became_active":"2024-09-21T07:36:55.207491+0000","last_became_peered":"2024-09-21T07:36:55.207491+0000","last_unstale":"2024-09-21T07:36:57.209270+0000","last_undegraded":"2024-09-21T07:36:57.209270+0000","last_fullsized":"2024-09-21T07:36:57.209270+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:35.464049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.221605+0000","last_change":"2024-09-21T07:36:56.217953+0000","last_active":"2024-09-21T07:36:56.221605+0000","last_peered":"2024-09-21T07:36:56.221605+0000","last_clean":"2024-09-21T07:36:56.221605+0000","last_became_active":"2024-09-21T07:36:56.217601+0000","last_became_peered":"2024-09-21T07:36:56.217601+0000","last_unstale":"2024-09-21T07:36:56.221605+0000","last_undegraded":"2024-09-21T07:36:56.221605+0000","last_fullsized":"2024-09-21T07:36:56.221605+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:08.101461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225528+0000","last_change":"2024-09-21T07:36:55.204439+0000","last_active":"2024-09-21T07:36:57.225528+0000","last_peered":"2024-09-21T07:36:57.225528+0000","last_clean":"2024-09-21T07:36:57.225528+0000","last_became_active":"2024-09-21T07:36:55.203956+0000","last_became_peered":"2024-09-21T07:36:55.203956+0000","last_unstale":"2024-09-21T07:36:57.225528+0000","last_undegraded":"2024-09-21T07:36:57.225528+0000","last_fullsized":"2024-09-21T07:36:57.225528+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:34.118668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.216941+0000","last_change":"2024-09-21T07:36:56.215366+0000","last_active":"2024-09-21T07:36:56.216941+0000","last_peered":"2024-09-21T07:36:56.216941+0000","last_clean":"2024-09-21T07:36:56.216941+0000","last_became_active":"2024-09-21T07:36:56.214875+0000","last_became_peered":"2024-09-21T07:36:56.214875+0000","last_unstale":"2024-09-21T07:36:56.216941+0000","last_undegraded":"2024-09-21T07:36:56.216941+0000","last_fullsized":"2024-09-21T07:36:56.216941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:16.041708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225393+0000","last_change":"2024-09-21T07:36:55.207655+0000","last_active":"2024-09-21T07:36:57.225393+0000","last_peered":"2024-09-21T07:36:57.225393+0000","last_clean":"2024-09-21T07:36:57.225393+0000","last_became_active":"2024-09-21T07:36:55.207342+0000","last_became_peered":"2024-09-21T07:36:55.207342+0000","last_unstale":"2024-09-21T07:36:57.225393+0000","last_undegraded":"2024-09-21T07:36:57.225393+0000","last_fullsized":"2024-09-21T07:36:57.225393+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:41.475513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187422+0000","last_change":"2024-09-21T07:36:55.187422+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187422+0000","last_undegraded":"2024-09-21T07:36:55.187422+0000","last_fullsized":"2024-09-21T07:36:55.187422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.208174+0000","last_change":"2024-09-21T07:36:55.206596+0000","last_active":"2024-09-21T07:36:56.208174+0000","last_peered":"2024-09-21T07:36:56.208174+0000","last_clean":"2024-09-21T07:36:56.208174+0000","last_became_active":"2024-09-21T07:36:55.206270+0000","last_became_peered":"2024-09-21T07:36:55.206270+0000","last_unstale":"2024-09-21T07:36:56.208174+0000","last_undegraded":"2024-09-21T07:36:56.208174+0000","last_fullsized":"2024-09-21T07:36:56.208174+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:09.900363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224604+0000","last_change":"2024-09-21T07:36:56.219605+0000","last_active":"2024-09-21T07:36:56.224604+0000","last_peered":"2024-09-21T07:36:56.224604+0000","last_clean":"2024-09-21T07:36:56.224604+0000","last_became_active":"2024-09-21T07:36:56.216745+0000","last_became_peered":"2024-09-21T07:36:56.216745+0000","last_unstale":"2024-09-21T07:36:56.224604+0000","last_undegraded":"2024-09-21T07:36:56.224604+0000","last_fullsized":"2024-09-21T07:36:56.224604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:40.290073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209996+0000","last_change":"2024-09-21T07:36:55.201898+0000","last_active":"2024-09-21T07:36:57.209996+0000","last_peered":"2024-09-21T07:36:57.209996+0000","last_clean":"2024-09-21T07:36:57.209996+0000","last_became_active":"2024-09-21T07:36:55.201581+0000","last_became_peered":"2024-09-21T07:36:55.201581+0000","last_unstale":"2024-09-21T07:36:57.209996+0000","last_undegraded":"2024-09-21T07:36:57.209996+0000","last_fullsized":"2024-09-21T07:36:57.209996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:27.902218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227992+0000","last_change":"2024-09-21T07:36:56.223740+0000","last_active":"2024-09-21T07:36:56.227992+0000","last_peered":"2024-09-21T07:36:56.227992+0000","last_clean":"2024-09-21T07:36:56.227992+0000","last_became_active":"2024-09-21T07:36:56.223305+0000","last_became_peered":"2024-09-21T07:36:56.223305+0000","last_unstale":"2024-09-21T07:36:56.227992+0000","last_undegraded":"2024-09-21T07:36:56.227992+0000","last_fullsized":"2024-09-21T07:36:56.227992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:26.707788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"204'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.227384+0000","last_change":"2024-09-21T07:36:55.202987+0000","last_active":"2024-09-21T07:36:57.227384+0000","last_peered":"2024-09-21T07:36:57.227384+0000","last_clean":"2024-09-21T07:36:57.227384+0000","last_became_active":"2024-09-21T07:36:55.202656+0000","last_became_peered":"2024-09-21T07:36:55.202656+0000","last_unstale":"2024-09-21T07:36:57.227384+0000","last_undegraded":"2024-09-21T07:36:57.227384+0000","last_fullsized":"2024-09-21T07:36:57.227384+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:18.120081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337229+0000","last_change":"2024-09-21T07:36:56.231483+0000","last_active":"2024-09-21T07:36:57.337229+0000","last_peered":"2024-09-21T07:36:57.337229+0000","last_clean":"2024-09-21T07:36:57.337229+0000","last_became_active":"2024-09-21T07:36:56.231174+0000","last_became_peered":"2024-09-21T07:36:56.231174+0000","last_unstale":"2024-09-21T07:36:57.337229+0000","last_undegraded":"2024-09-21T07:36:57.337229+0000","last_fullsized":"2024-09-21T07:36:57.337229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:23.639764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225789+0000","last_change":"2024-09-21T07:36:55.201998+0000","last_active":"2024-09-21T07:36:57.225789+0000","last_peered":"2024-09-21T07:36:57.225789+0000","last_clean":"2024-09-21T07:36:57.225789+0000","last_became_active":"2024-09-21T07:36:55.201662+0000","last_became_peered":"2024-09-21T07:36:55.201662+0000","last_unstale":"2024-09-21T07:36:57.225789+0000","last_undegraded":"2024-09-21T07:36:57.225789+0000","last_fullsized":"2024-09-21T07:36:57.225789+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:35.647330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222865+0000","last_change":"2024-09-21T07:36:56.219161+0000","last_active":"2024-09-21T07:36:56.222865+0000","last_peered":"2024-09-21T07:36:56.222865+0000","last_clean":"2024-09-21T07:36:56.222865+0000","last_became_active":"2024-09-21T07:36:56.218372+0000","last_became_peered":"2024-09-21T07:36:56.218372+0000","last_unstale":"2024-09-21T07:36:56.222865+0000","last_undegraded":"2024-09-21T07:36:56.222865+0000","last_fullsized":"2024-09-21T07:36:56.222865+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:07.593583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210308+0000","last_change":"2024-09-21T07:36:55.206649+0000","last_active":"2024-09-21T07:36:57.210308+0000","last_peered":"2024-09-21T07:36:57.210308+0000","last_clean":"2024-09-21T07:36:57.210308+0000","last_became_active":"2024-09-21T07:36:55.206341+0000","last_became_peered":"2024-09-21T07:36:55.206341+0000","last_unstale":"2024-09-21T07:36:57.210308+0000","last_undegraded":"2024-09-21T07:36:57.210308+0000","last_fullsized":"2024-09-21T07:36:57.210308+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:43.715074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187142+0000","last_change":"2024-09-21T07:36:55.187142+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187142+0000","last_undegraded":"2024-09-21T07:36:55.187142+0000","last_fullsized":"2024-09-21T07:36:55.187142+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209612+0000","last_change":"2024-09-21T07:36:55.200687+0000","last_active":"2024-09-21T07:36:57.209612+0000","last_peered":"2024-09-21T07:36:57.209612+0000","last_clean":"2024-09-21T07:36:57.209612+0000","last_became_active":"2024-09-21T07:36:55.200028+0000","last_became_peered":"2024-09-21T07:36:55.200028+0000","last_unstale":"2024-09-21T07:36:57.209612+0000","last_undegraded":"2024-09-21T07:36:57.209612+0000","last_fullsized":"2024-09-21T07:36:57.209612+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:10.111404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.187186+0000","last_change":"2024-09-21T07:36:55.187186+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.187186+0000","last_undegraded":"2024-09-21T07:36:55.187186+0000","last_fullsized":"2024-09-21T07:36:55.187186+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209172+0000","last_change":"2024-09-21T07:36:55.198983+0000","last_active":"2024-09-21T07:36:57.209172+0000","last_peered":"2024-09-21T07:36:57.209172+0000","last_clean":"2024-09-21T07:36:57.209172+0000","last_became_active":"2024-09-21T07:36:55.198513+0000","last_became_peered":"2024-09-21T07:36:55.198513+0000","last_unstale":"2024-09-21T07:36:57.209172+0000","last_undegraded":"2024-09-21T07:36:57.209172+0000","last_fullsized":"2024-09-21T07:36:57.209172+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:40.003553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227066+0000","last_change":"2024-09-21T07:36:56.225875+0000","last_active":"2024-09-21T07:36:56.227066+0000","last_peered":"2024-09-21T07:36:56.227066+0000","last_clean":"2024-09-21T07:36:56.227066+0000","last_became_active":"2024-09-21T07:36:56.225520+0000","last_became_peered":"2024-09-21T07:36:56.225520+0000","last_unstale":"2024-09-21T07:36:56.227066+0000","last_undegraded":"2024-09-21T07:36:56.227066+0000","last_fullsized":"2024-09-21T07:36:56.227066+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.174282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.205102+0000","last_change":"2024-09-21T07:36:55.211026+0000","last_active":"2024-09-21T07:36:56.205102+0000","last_peered":"2024-09-21T07:36:56.205102+0000","last_clean":"2024-09-21T07:36:56.205102+0000","last_became_active":"2024-09-21T07:36:55.210636+0000","last_became_peered":"2024-09-21T07:36:55.210636+0000","last_unstale":"2024-09-21T07:36:56.205102+0000","last_undegraded":"2024-09-21T07:36:56.205102+0000","last_fullsized":"2024-09-21T07:36:56.205102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:08.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209029+0000","last_change":"2024-09-21T07:36:56.222090+0000","last_active":"2024-09-21T07:36:57.209029+0000","last_peered":"2024-09-21T07:36:57.209029+0000","last_clean":"2024-09-21T07:36:57.209029+0000","last_became_active":"2024-09-21T07:36:56.221728+0000","last_became_peered":"2024-09-21T07:36:56.221728+0000","last_unstale":"2024-09-21T07:36:57.209029+0000","last_undegraded":"2024-09-21T07:36:57.209029+0000","last_fullsized":"2024-09-21T07:36:57.209029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:30.692530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208405+0000","last_change":"2024-09-21T07:36:55.194087+0000","last_active":"2024-09-21T07:36:57.208405+0000","last_peered":"2024-09-21T07:36:57.208405+0000","last_clean":"2024-09-21T07:36:57.208405+0000","last_became_active":"2024-09-21T07:36:55.193807+0000","last_became_peered":"2024-09-21T07:36:55.193807+0000","last_unstale":"2024-09-21T07:36:57.208405+0000","last_undegraded":"2024-09-21T07:36:57.208405+0000","last_fullsized":"2024-09-21T07:36:57.208405+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.803891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-21T07:36:55.188614+0000","last_change":"2024-09-21T07:36:55.188614+0000","last_active":"2024-09-21T07:36:55.176003+0000","last_peered":"2024-09-21T07:36:55.176003+0000","last_clean":"2024-09-21T07:36:55.176003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:36:55.188614+0000","last_undegraded":"2024-09-21T07:36:55.188614+0000","last_fullsized":"2024-09-21T07:36:55.188614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.238326+0000","last_change":"2024-09-21T07:36:55.207312+0000","last_active":"2024-09-21T07:36:56.238326+0000","last_peered":"2024-09-21T07:36:56.238326+0000","last_clean":"2024-09-21T07:36:56.238326+0000","last_became_active":"2024-09-21T07:36:55.206468+0000","last_became_peered":"2024-09-21T07:36:55.206468+0000","last_unstale":"2024-09-21T07:36:56.238326+0000","last_undegraded":"2024-09-21T07:36:56.238326+0000","last_fullsized":"2024-09-21T07:36:56.238326+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.912021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":444,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.204117+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:36:56.204117+0000","last_peered":"2024-09-21T07:36:56.204117+0000","last_clean":"2024-09-21T07:36:56.204117+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:36:56.204117+0000","last_undegraded":"2024-09-21T07:36:56.204117+0000","last_fullsized":"2024-09-21T07:36:56.204117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55920,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315920,"statfs":{"total":96636764160,"available":96579502080,"internally_reserved":0,"allocated":2580480,"data_stored":1211070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2572288,"data_stored":1211014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47580,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324260,"statfs":{"total":96636764160,"available":96588042240,"internally_reserved":0,"allocated":2560000,"data_stored":1209422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60068,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311772,"statfs":{"total":96636764160,"available":96575254528,"internally_reserved":0,"allocated":2564096,"data_stored":1209948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509615,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64212,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307628,"statfs":{"total":96636764160,"available":96571011072,"internally_reserved":0,"allocated":2555904,"data_stored":1209332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509616,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56472,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315368,"statfs":{"total":96636764160,"available":96578936832,"internally_reserved":0,"allocated":3149824,"data_stored":1799700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542320,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":3084,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":3158016,"data_stored":1800372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87756,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284084,"statfs":{"total":96636764160,"available":96546902016,"internally_reserved":0,"allocated":2543616,"data_stored":1202165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:37:01.263 INFO:tasks.ceph.ceph_manager.ceph:PG 30.3d is not active+clean 2024-09-21T07:37:01.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.192236+0000', 'last_change': '2024-09-21T07:36:55.192236+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.192236+0000', 'last_undegraded': '2024-09-21T07:36:55.192236+0000', 'last_fullsized': '2024-09-21T07:36:55.192236+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.263 INFO:tasks.ceph.ceph_manager.ceph:PG 30.39 is not active+clean 2024-09-21T07:37:01.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.190300+0000', 'last_change': '2024-09-21T07:36:55.190300+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.190300+0000', 'last_undegraded': '2024-09-21T07:36:55.190300+0000', 'last_fullsized': '2024-09-21T07:36:55.190300+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.263 INFO:tasks.ceph.ceph_manager.ceph:PG 30.36 is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.191723+0000', 'last_change': '2024-09-21T07:36:55.191723+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.191723+0000', 'last_undegraded': '2024-09-21T07:36:55.191723+0000', 'last_fullsized': '2024-09-21T07:36:55.191723+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2e is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.191272+0000', 'last_change': '2024-09-21T07:36:55.191272+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.191272+0000', 'last_undegraded': '2024-09-21T07:36:55.191272+0000', 'last_fullsized': '2024-09-21T07:36:55.191272+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2b is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.190038+0000', 'last_change': '2024-09-21T07:36:55.190038+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.190038+0000', 'last_undegraded': '2024-09-21T07:36:55.190038+0000', 'last_fullsized': '2024-09-21T07:36:55.190038+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.26 is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.190829+0000', 'last_change': '2024-09-21T07:36:55.190829+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.190829+0000', 'last_undegraded': '2024-09-21T07:36:55.190829+0000', 'last_fullsized': '2024-09-21T07:36:55.190829+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1c is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.189060+0000', 'last_change': '2024-09-21T07:36:55.189060+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.189060+0000', 'last_undegraded': '2024-09-21T07:36:55.189060+0000', 'last_fullsized': '2024-09-21T07:36:55.189060+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1d is not active+clean 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.189626+0000', 'last_change': '2024-09-21T07:36:55.189626+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.189626+0000', 'last_undegraded': '2024-09-21T07:36:55.189626+0000', 'last_fullsized': '2024-09-21T07:36:55.189626+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.264 INFO:tasks.ceph.ceph_manager.ceph:PG 30.18 is not active+clean 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.188516+0000', 'last_change': '2024-09-21T07:36:55.188516+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.188516+0000', 'last_undegraded': '2024-09-21T07:36:55.188516+0000', 'last_fullsized': '2024-09-21T07:36:55.188516+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:PG 30.16 is not active+clean 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.188195+0000', 'last_change': '2024-09-21T07:36:55.188195+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.188195+0000', 'last_undegraded': '2024-09-21T07:36:55.188195+0000', 'last_fullsized': '2024-09-21T07:36:55.188195+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:PG 30.12 is not active+clean 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.187308+0000', 'last_change': '2024-09-21T07:36:55.187308+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.187308+0000', 'last_undegraded': '2024-09-21T07:36:55.187308+0000', 'last_fullsized': '2024-09-21T07:36:55.187308+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:PG 30.e is not active+clean 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.187188+0000', 'last_change': '2024-09-21T07:36:55.187188+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.187188+0000', 'last_undegraded': '2024-09-21T07:36:55.187188+0000', 'last_fullsized': '2024-09-21T07:36:55.187188+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:PG 30.b is not active+clean 2024-09-21T07:37:01.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.187422+0000', 'last_change': '2024-09-21T07:36:55.187422+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.187422+0000', 'last_undegraded': '2024-09-21T07:36:55.187422+0000', 'last_fullsized': '2024-09-21T07:36:55.187422+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:PG 30.0 is not active+clean 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.187142+0000', 'last_change': '2024-09-21T07:36:55.187142+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.187142+0000', 'last_undegraded': '2024-09-21T07:36:55.187142+0000', 'last_fullsized': '2024-09-21T07:36:55.187142+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1 is not active+clean 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.187186+0000', 'last_change': '2024-09-21T07:36:55.187186+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.187186+0000', 'last_undegraded': '2024-09-21T07:36:55.187186+0000', 'last_fullsized': '2024-09-21T07:36:55.187186+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1f is not active+clean 2024-09-21T07:37:01.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 202, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:36:55.188614+0000', 'last_change': '2024-09-21T07:36:55.188614+0000', 'last_active': '2024-09-21T07:36:55.176003+0000', 'last_peered': '2024-09-21T07:36:55.176003+0000', 'last_clean': '2024-09-21T07:36:55.176003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:36:55.188614+0000', 'last_undegraded': '2024-09-21T07:36:55.188614+0000', 'last_fullsized': '2024-09-21T07:36:55.188614+0000', 'mapping_epoch': 202, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 202, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'last_clean_scrub_stamp': '2024-09-21T07:36:55.176003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:37:01.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- 172.21.15.64:0/669651804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 msgr2=0x7fb1f80040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 --2- 172.21.15.64:0/669651804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb1f80040e0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fb204006fb0 tx=0x7fb20401ceb0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb212800640 1 -- 172.21.15.64:0/669651804 reap_dead start 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- 172.21.15.64:0/669651804 shutdown_connections 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- 172.21.15.64:0/669651804 >> 172.21.15.64:0/669651804 conn(0x7fb21406d1c0 msgr2=0x7fb21406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- 172.21.15.64:0/669651804 shutdown_connections 2024-09-21T07:37:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- 172.21.15.64:0/669651804 wait complete. 2024-09-21T07:37:01.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 Processor -- start 2024-09-21T07:37:01.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.463+0000 7fb218e00640 1 -- start start 2024-09-21T07:37:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21415dce0 0x7fb214149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb214159ff0 0x7fb21415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb214168510 con 0x7fb1f8003c90 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb214168390 con 0x7fb21415dce0 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb214168690 con 0x7fb214159ff0 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44478/0 (socket says 172.21.15.64:44478) 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 -- 172.21.15.64:0/4114116421 learned_addr learned my addr 172.21.15.64:0/4114116421 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb212800640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb214159ff0 0x7fb21415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb209400640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21415dce0 0x7fb214149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 -- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb214159ff0 msgr2=0x7fb21415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb214159ff0 0x7fb21415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 -- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21415dce0 msgr2=0x7fb214149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21415dce0 0x7fb214149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 -- 172.21.15.64:0/4114116421 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21415a940 con 0x7fb1f8003c90 2024-09-21T07:37:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb211e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fb204006ed0 tx=0x7fb204001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204006090 con 0x7fb1f8003c90 2024-09-21T07:37:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb204003600 con 0x7fb1f8003c90 2024-09-21T07:37:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb214155b00 con 0x7fb1f8003c90 2024-09-21T07:37:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040039f0 con 0x7fb1f8003c90 2024-09-21T07:37:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141560c0 con 0x7fb1f8003c90 2024-09-21T07:37:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.467+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2140d03f0 con 0x7fb1f8003c90 2024-09-21T07:37:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.471+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb204003b90 con 0x7fb1f8003c90 2024-09-21T07:37:01.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.471+0000 7fb20aa00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 0x7fb1f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.471+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fb20412ecf0 con 0x7fb1f8003c90 2024-09-21T07:37:01.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.471+0000 7fb209400640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 0x7fb1f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.471+0000 7fb209400640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 0x7fb1f0075710 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb2140c8160 tx=0x7fb1fc006ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.475+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb21415a940 con 0x7fb1f8003c90 2024-09-21T07:37:01.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb214158f40 con 0x7fb1f8003c90 2024-09-21T07:37:01.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb20aa00640 1 -- 172.21.15.64:0/4114116421 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1147 (secure 0 0 0) 0x7fb204016c90 con 0x7fb1f8003c90 2024-09-21T07:37:01.713 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:01.714 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":879,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":204,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592756,"bytes_used":496025600,"bytes_avail":772598087680,"bytes_total":773094113280,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":2429,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"a","status":"up:active","gid":10276}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-21T07:34:51.621102+0000","services":{}},"progress_events":{}} 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 msgr2=0x7fb1f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 0x7fb1f0075710 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb2140c8160 tx=0x7fb1fc006ea0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 msgr2=0x7fb2141f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fb204006ed0 tx=0x7fb204001cc0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 shutdown_connections 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb1f0073200 0x7fb1f0075710 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb214159ff0 0x7fb21415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21415dce0 0x7fb214149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 --2- 172.21.15.64:0/4114116421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1f8003c90 0x7fb2141f6ac0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 >> 172.21.15.64:0/4114116421 conn(0x7fb21406d1c0 msgr2=0x7fb2140c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:01.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 shutdown_connections 2024-09-21T07:37:01.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.715+0000 7fb218e00640 1 -- 172.21.15.64:0/4114116421 wait complete. 2024-09-21T07:37:01.735 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:37:01.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 -- 172.21.15.64:0/1188697926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 msgr2=0x7fe860072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 --2- 172.21.15.64:0/1188697926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe860072e20 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7fe86006adf0 tx=0x7fe85801cd20 comp rx=0 tx=0).stop 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 -- 172.21.15.64:0/1188697926 shutdown_connections 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 --2- 172.21.15.64:0/1188697926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe860072e20 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 --2- 172.21.15.64:0/1188697926 >> v2:172.21.15.90:3300/0 conn(0x7fe8600709b0 0x7fe8600b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 --2- 172.21.15.64:0/1188697926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 0x7fe8600700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 -- 172.21.15.64:0/1188697926 >> 172.21.15.64:0/1188697926 conn(0x7fe8600ccbe0 msgr2=0x7fe8600ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 -- 172.21.15.64:0/1188697926 shutdown_connections 2024-09-21T07:37:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.895+0000 7fe868000640 1 -- 172.21.15.64:0/1188697926 wait complete. 2024-09-21T07:37:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 Processor -- start 2024-09-21T07:37:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- start start 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8600709b0 0x7fe8600cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 0x7fe8600b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b2380 con 0x7fe8600b4700 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b2200 con 0x7fe8600709b0 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe8600b2500 con 0x7fe86015edb0 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44496/0 (socket says 172.21.15.64:44496) 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 -- 172.21.15.64:0/3197085563 learned_addr learned my addr 172.21.15.64:0/3197085563 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe865600640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8600709b0 0x7fe8600cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe866000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 0x7fe8600b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 -- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 msgr2=0x7fe8600b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 0x7fe8600b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 -- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8600709b0 msgr2=0x7fe8600cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8600709b0 0x7fe8600cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 -- 172.21.15.64:0/3197085563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8601fc470 con 0x7fe8600b4700 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe864c00640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e6c0 tx=0x7fe84c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c004220 con 0x7fe8600b4700 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe84c0043c0 con 0x7fe8600b4700 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00cb10 con 0x7fe8600b4700 2024-09-21T07:37:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8601fc750 con 0x7fe8600b4700 2024-09-21T07:37:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.899+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8601fcd10 con 0x7fe8600b4700 2024-09-21T07:37:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.903+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8600b2980 con 0x7fe8600b4700 2024-09-21T07:37:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.903+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe84c00ccb0 con 0x7fe8600b4700 2024-09-21T07:37:01.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.903+0000 7fe85d600640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 0x7fe840075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:01.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.903+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fe84c094bd0 con 0x7fe8600b4700 2024-09-21T07:37:01.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.903+0000 7fe865600640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 0x7fe840075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:01.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.907+0000 7fe865600640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 0x7fe840075710 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe854009b40 tx=0x7fe8540091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:01.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:01.907+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe84c05f370 con 0x7fe8600b4700 2024-09-21T07:37:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.083+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe860159c90 con 0x7fe840073200 2024-09-21T07:37:02.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.087+0000 7fe85d600640 1 -- 172.21.15.64:0/3197085563 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252476 (secure 0 0 0) 0x7fe860159c90 con 0x7fe840073200 2024-09-21T07:37:02.090 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:37:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 msgr2=0x7fe840075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 0x7fe840075710 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe854009b40 tx=0x7fe8540091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 msgr2=0x7fe8600ad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e6c0 tx=0x7fe84c00eb80 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 shutdown_connections 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe840073200 0x7fe840075710 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe86015edb0 0x7fe8600b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8600b4700 0x7fe8600ad520 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 --2- 172.21.15.64:0/3197085563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8600709b0 0x7fe8600cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 >> 172.21.15.64:0/3197085563 conn(0x7fe8600ccbe0 msgr2=0x7fe86015d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 shutdown_connections 2024-09-21T07:37:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:02.091+0000 7fe868000640 1 -- 172.21.15.64:0/3197085563 wait complete. 2024-09-21T07:37:02.111 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":630,"stamp":"2024-09-21T07:37:01.656933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":484428,"kb_used_data":21204,"kb_used_omap":12,"kb_used_meta":463027,"kb_avail":754490292,"statfs":{"total":773094113280,"available":772598059008,"internally_reserved":0,"allocated":21712896,"data_stored":10866904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":474140211},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.477260"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222685+0000","last_change":"2024-09-21T07:36:56.220146+0000","last_active":"2024-09-21T07:36:56.222685+0000","last_peered":"2024-09-21T07:36:56.222685+0000","last_clean":"2024-09-21T07:36:56.222685+0000","last_became_active":"2024-09-21T07:36:56.218923+0000","last_became_peered":"2024-09-21T07:36:56.218923+0000","last_unstale":"2024-09-21T07:36:56.222685+0000","last_undegraded":"2024-09-21T07:36:56.222685+0000","last_fullsized":"2024-09-21T07:36:56.222685+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:49.793247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.218604+0000","last_change":"2024-09-21T07:36:56.216256+0000","last_active":"2024-09-21T07:36:56.218604+0000","last_peered":"2024-09-21T07:36:56.218604+0000","last_clean":"2024-09-21T07:36:56.218604+0000","last_became_active":"2024-09-21T07:36:56.215921+0000","last_became_peered":"2024-09-21T07:36:56.215921+0000","last_unstale":"2024-09-21T07:36:56.218604+0000","last_undegraded":"2024-09-21T07:36:56.218604+0000","last_fullsized":"2024-09-21T07:36:56.218604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:38.871128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208916+0000","last_change":"2024-09-21T07:36:56.219422+0000","last_active":"2024-09-21T07:36:57.208916+0000","last_peered":"2024-09-21T07:36:57.208916+0000","last_clean":"2024-09-21T07:36:57.208916+0000","last_became_active":"2024-09-21T07:36:56.219090+0000","last_became_peered":"2024-09-21T07:36:56.219090+0000","last_unstale":"2024-09-21T07:36:57.208916+0000","last_undegraded":"2024-09-21T07:36:57.208916+0000","last_fullsized":"2024-09-21T07:36:57.208916+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:07.909839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209382+0000","last_change":"2024-09-21T07:36:56.226641+0000","last_active":"2024-09-21T07:36:57.209382+0000","last_peered":"2024-09-21T07:36:57.209382+0000","last_clean":"2024-09-21T07:36:57.209382+0000","last_became_active":"2024-09-21T07:36:56.226315+0000","last_became_peered":"2024-09-21T07:36:56.226315+0000","last_unstale":"2024-09-21T07:36:57.209382+0000","last_undegraded":"2024-09-21T07:36:57.209382+0000","last_fullsized":"2024-09-21T07:36:57.209382+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:28.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.230623+0000","last_change":"2024-09-21T07:36:56.226972+0000","last_active":"2024-09-21T07:36:56.230623+0000","last_peered":"2024-09-21T07:36:56.230623+0000","last_clean":"2024-09-21T07:36:56.230623+0000","last_became_active":"2024-09-21T07:36:56.226668+0000","last_became_peered":"2024-09-21T07:36:56.226668+0000","last_unstale":"2024-09-21T07:36:56.230623+0000","last_undegraded":"2024-09-21T07:36:56.230623+0000","last_fullsized":"2024-09-21T07:36:56.230623+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.950933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337085+0000","last_change":"2024-09-21T07:36:56.227380+0000","last_active":"2024-09-21T07:36:57.337085+0000","last_peered":"2024-09-21T07:36:57.337085+0000","last_clean":"2024-09-21T07:36:57.337085+0000","last_became_active":"2024-09-21T07:36:56.227054+0000","last_became_peered":"2024-09-21T07:36:56.227054+0000","last_unstale":"2024-09-21T07:36:57.337085+0000","last_undegraded":"2024-09-21T07:36:57.337085+0000","last_fullsized":"2024-09-21T07:36:57.337085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:52.133345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208497+0000","last_change":"2024-09-21T07:36:56.221582+0000","last_active":"2024-09-21T07:36:57.208497+0000","last_peered":"2024-09-21T07:36:57.208497+0000","last_clean":"2024-09-21T07:36:57.208497+0000","last_became_active":"2024-09-21T07:36:56.220949+0000","last_became_peered":"2024-09-21T07:36:56.220949+0000","last_unstale":"2024-09-21T07:36:57.208497+0000","last_undegraded":"2024-09-21T07:36:57.208497+0000","last_fullsized":"2024-09-21T07:36:57.208497+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.958126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336638+0000","last_change":"2024-09-21T07:36:56.226508+0000","last_active":"2024-09-21T07:36:57.336638+0000","last_peered":"2024-09-21T07:36:57.336638+0000","last_clean":"2024-09-21T07:36:57.336638+0000","last_became_active":"2024-09-21T07:36:56.226137+0000","last_became_peered":"2024-09-21T07:36:56.226137+0000","last_unstale":"2024-09-21T07:36:57.336638+0000","last_undegraded":"2024-09-21T07:36:57.336638+0000","last_fullsized":"2024-09-21T07:36:57.336638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:57.754951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222936+0000","last_change":"2024-09-21T07:36:56.219507+0000","last_active":"2024-09-21T07:36:56.222936+0000","last_peered":"2024-09-21T07:36:56.222936+0000","last_clean":"2024-09-21T07:36:56.222936+0000","last_became_active":"2024-09-21T07:36:56.218848+0000","last_became_peered":"2024-09-21T07:36:56.218848+0000","last_unstale":"2024-09-21T07:36:56.222936+0000","last_undegraded":"2024-09-21T07:36:56.222936+0000","last_fullsized":"2024-09-21T07:36:56.222936+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:59.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208937+0000","last_change":"2024-09-21T07:36:56.217852+0000","last_active":"2024-09-21T07:36:57.208937+0000","last_peered":"2024-09-21T07:36:57.208937+0000","last_clean":"2024-09-21T07:36:57.208937+0000","last_became_active":"2024-09-21T07:36:56.217504+0000","last_became_peered":"2024-09-21T07:36:56.217504+0000","last_unstale":"2024-09-21T07:36:57.208937+0000","last_undegraded":"2024-09-21T07:36:57.208937+0000","last_fullsized":"2024-09-21T07:36:57.208937+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:12.385119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209534+0000","last_change":"2024-09-21T07:36:56.228467+0000","last_active":"2024-09-21T07:36:57.209534+0000","last_peered":"2024-09-21T07:36:57.209534+0000","last_clean":"2024-09-21T07:36:57.209534+0000","last_became_active":"2024-09-21T07:36:56.228120+0000","last_became_peered":"2024-09-21T07:36:56.228120+0000","last_unstale":"2024-09-21T07:36:57.209534+0000","last_undegraded":"2024-09-21T07:36:57.209534+0000","last_fullsized":"2024-09-21T07:36:57.209534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:48.976340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210044+0000","last_change":"2024-09-21T07:36:56.219132+0000","last_active":"2024-09-21T07:36:57.210044+0000","last_peered":"2024-09-21T07:36:57.210044+0000","last_clean":"2024-09-21T07:36:57.210044+0000","last_became_active":"2024-09-21T07:36:56.218824+0000","last_became_peered":"2024-09-21T07:36:56.218824+0000","last_unstale":"2024-09-21T07:36:57.210044+0000","last_undegraded":"2024-09-21T07:36:57.210044+0000","last_fullsized":"2024-09-21T07:36:57.210044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:37.141989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337303+0000","last_change":"2024-09-21T07:36:56.232879+0000","last_active":"2024-09-21T07:36:57.337303+0000","last_peered":"2024-09-21T07:36:57.337303+0000","last_clean":"2024-09-21T07:36:57.337303+0000","last_became_active":"2024-09-21T07:36:56.232253+0000","last_became_peered":"2024-09-21T07:36:56.232253+0000","last_unstale":"2024-09-21T07:36:57.337303+0000","last_undegraded":"2024-09-21T07:36:57.337303+0000","last_fullsized":"2024-09-21T07:36:57.337303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:18.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208981+0000","last_change":"2024-09-21T07:36:56.203575+0000","last_active":"2024-09-21T07:36:57.208981+0000","last_peered":"2024-09-21T07:36:57.208981+0000","last_clean":"2024-09-21T07:36:57.208981+0000","last_became_active":"2024-09-21T07:36:56.203239+0000","last_became_peered":"2024-09-21T07:36:56.203239+0000","last_unstale":"2024-09-21T07:36:57.208981+0000","last_undegraded":"2024-09-21T07:36:57.208981+0000","last_fullsized":"2024-09-21T07:36:57.208981+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:05.938973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225710+0000","last_change":"2024-09-21T07:36:56.202116+0000","last_active":"2024-09-21T07:36:57.225710+0000","last_peered":"2024-09-21T07:36:57.225710+0000","last_clean":"2024-09-21T07:36:57.225710+0000","last_became_active":"2024-09-21T07:36:56.201784+0000","last_became_peered":"2024-09-21T07:36:56.201784+0000","last_unstale":"2024-09-21T07:36:57.225710+0000","last_undegraded":"2024-09-21T07:36:57.225710+0000","last_fullsized":"2024-09-21T07:36:57.225710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:30.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336659+0000","last_change":"2024-09-21T07:36:56.220846+0000","last_active":"2024-09-21T07:36:57.336659+0000","last_peered":"2024-09-21T07:36:57.336659+0000","last_clean":"2024-09-21T07:36:57.336659+0000","last_became_active":"2024-09-21T07:36:56.218536+0000","last_became_peered":"2024-09-21T07:36:56.218536+0000","last_unstale":"2024-09-21T07:36:57.336659+0000","last_undegraded":"2024-09-21T07:36:57.336659+0000","last_fullsized":"2024-09-21T07:36:57.336659+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:48.683975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209762+0000","last_change":"2024-09-21T07:36:56.221685+0000","last_active":"2024-09-21T07:36:57.209762+0000","last_peered":"2024-09-21T07:36:57.209762+0000","last_clean":"2024-09-21T07:36:57.209762+0000","last_became_active":"2024-09-21T07:36:56.221305+0000","last_became_peered":"2024-09-21T07:36:56.221305+0000","last_unstale":"2024-09-21T07:36:57.209762+0000","last_undegraded":"2024-09-21T07:36:57.209762+0000","last_fullsized":"2024-09-21T07:36:57.209762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:17.092807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209200+0000","last_change":"2024-09-21T07:36:56.233243+0000","last_active":"2024-09-21T07:36:57.209200+0000","last_peered":"2024-09-21T07:36:57.209200+0000","last_clean":"2024-09-21T07:36:57.209200+0000","last_became_active":"2024-09-21T07:36:56.232924+0000","last_became_peered":"2024-09-21T07:36:56.232924+0000","last_unstale":"2024-09-21T07:36:57.209200+0000","last_undegraded":"2024-09-21T07:36:57.209200+0000","last_fullsized":"2024-09-21T07:36:57.209200+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.263716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.220366+0000","last_change":"2024-09-21T07:36:56.217839+0000","last_active":"2024-09-21T07:36:56.220366+0000","last_peered":"2024-09-21T07:36:56.220366+0000","last_clean":"2024-09-21T07:36:56.220366+0000","last_became_active":"2024-09-21T07:36:56.217407+0000","last_became_peered":"2024-09-21T07:36:56.217407+0000","last_unstale":"2024-09-21T07:36:56.220366+0000","last_undegraded":"2024-09-21T07:36:56.220366+0000","last_fullsized":"2024-09-21T07:36:56.220366+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337202+0000","last_change":"2024-09-21T07:36:56.230192+0000","last_active":"2024-09-21T07:36:57.337202+0000","last_peered":"2024-09-21T07:36:57.337202+0000","last_clean":"2024-09-21T07:36:57.337202+0000","last_became_active":"2024-09-21T07:36:56.229899+0000","last_became_peered":"2024-09-21T07:36:56.229899+0000","last_unstale":"2024-09-21T07:36:57.337202+0000","last_undegraded":"2024-09-21T07:36:57.337202+0000","last_fullsized":"2024-09-21T07:36:57.337202+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208621+0000","last_change":"2024-09-21T07:36:56.213896+0000","last_active":"2024-09-21T07:36:57.208621+0000","last_peered":"2024-09-21T07:36:57.208621+0000","last_clean":"2024-09-21T07:36:57.208621+0000","last_became_active":"2024-09-21T07:36:56.210922+0000","last_became_peered":"2024-09-21T07:36:56.210922+0000","last_unstale":"2024-09-21T07:36:57.208621+0000","last_undegraded":"2024-09-21T07:36:57.208621+0000","last_fullsized":"2024-09-21T07:36:57.208621+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:01.416039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225373+0000","last_change":"2024-09-21T07:36:56.216982+0000","last_active":"2024-09-21T07:36:57.225373+0000","last_peered":"2024-09-21T07:36:57.225373+0000","last_clean":"2024-09-21T07:36:57.225373+0000","last_became_active":"2024-09-21T07:36:56.216675+0000","last_became_peered":"2024-09-21T07:36:56.216675+0000","last_unstale":"2024-09-21T07:36:57.225373+0000","last_undegraded":"2024-09-21T07:36:57.225373+0000","last_fullsized":"2024-09-21T07:36:57.225373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:23.387580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224168+0000","last_change":"2024-09-21T07:36:56.220450+0000","last_active":"2024-09-21T07:36:56.224168+0000","last_peered":"2024-09-21T07:36:56.224168+0000","last_clean":"2024-09-21T07:36:56.224168+0000","last_became_active":"2024-09-21T07:36:56.220136+0000","last_became_peered":"2024-09-21T07:36:56.220136+0000","last_unstale":"2024-09-21T07:36:56.224168+0000","last_undegraded":"2024-09-21T07:36:56.224168+0000","last_fullsized":"2024-09-21T07:36:56.224168+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:12.123759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228273+0000","last_change":"2024-09-21T07:36:56.225330+0000","last_active":"2024-09-21T07:36:56.228273+0000","last_peered":"2024-09-21T07:36:56.228273+0000","last_clean":"2024-09-21T07:36:56.228273+0000","last_became_active":"2024-09-21T07:36:56.224756+0000","last_became_peered":"2024-09-21T07:36:56.224756+0000","last_unstale":"2024-09-21T07:36:56.228273+0000","last_undegraded":"2024-09-21T07:36:56.228273+0000","last_fullsized":"2024-09-21T07:36:56.228273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:23.684068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228052+0000","last_change":"2024-09-21T07:36:56.224291+0000","last_active":"2024-09-21T07:36:56.228052+0000","last_peered":"2024-09-21T07:36:56.228052+0000","last_clean":"2024-09-21T07:36:56.228052+0000","last_became_active":"2024-09-21T07:36:56.223882+0000","last_became_peered":"2024-09-21T07:36:56.223882+0000","last_unstale":"2024-09-21T07:36:56.228052+0000","last_undegraded":"2024-09-21T07:36:56.228052+0000","last_fullsized":"2024-09-21T07:36:56.228052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:09.061762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209229+0000","last_change":"2024-09-21T07:36:56.214025+0000","last_active":"2024-09-21T07:36:57.209229+0000","last_peered":"2024-09-21T07:36:57.209229+0000","last_clean":"2024-09-21T07:36:57.209229+0000","last_became_active":"2024-09-21T07:36:56.211797+0000","last_became_peered":"2024-09-21T07:36:56.211797+0000","last_unstale":"2024-09-21T07:36:57.209229+0000","last_undegraded":"2024-09-21T07:36:57.209229+0000","last_fullsized":"2024-09-21T07:36:57.209229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:06.853358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209740+0000","last_change":"2024-09-21T07:36:56.231954+0000","last_active":"2024-09-21T07:36:57.209740+0000","last_peered":"2024-09-21T07:36:57.209740+0000","last_clean":"2024-09-21T07:36:57.209740+0000","last_became_active":"2024-09-21T07:36:56.231645+0000","last_became_peered":"2024-09-21T07:36:56.231645+0000","last_unstale":"2024-09-21T07:36:57.209740+0000","last_undegraded":"2024-09-21T07:36:57.209740+0000","last_fullsized":"2024-09-21T07:36:57.209740+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:31.811145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209268+0000","last_change":"2024-09-21T07:36:56.212089+0000","last_active":"2024-09-21T07:36:57.209268+0000","last_peered":"2024-09-21T07:36:57.209268+0000","last_clean":"2024-09-21T07:36:57.209268+0000","last_became_active":"2024-09-21T07:36:56.211747+0000","last_became_peered":"2024-09-21T07:36:56.211747+0000","last_unstale":"2024-09-21T07:36:57.209268+0000","last_undegraded":"2024-09-21T07:36:57.209268+0000","last_fullsized":"2024-09-21T07:36:57.209268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:28.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.226852+0000","last_change":"2024-09-21T07:36:56.224194+0000","last_active":"2024-09-21T07:36:56.226852+0000","last_peered":"2024-09-21T07:36:56.226852+0000","last_clean":"2024-09-21T07:36:56.226852+0000","last_became_active":"2024-09-21T07:36:56.223128+0000","last_became_peered":"2024-09-21T07:36:56.223128+0000","last_unstale":"2024-09-21T07:36:56.226852+0000","last_undegraded":"2024-09-21T07:36:56.226852+0000","last_fullsized":"2024-09-21T07:36:56.226852+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:51.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337165+0000","last_change":"2024-09-21T07:36:56.215274+0000","last_active":"2024-09-21T07:36:57.337165+0000","last_peered":"2024-09-21T07:36:57.337165+0000","last_clean":"2024-09-21T07:36:57.337165+0000","last_became_active":"2024-09-21T07:36:56.214442+0000","last_became_peered":"2024-09-21T07:36:56.214442+0000","last_unstale":"2024-09-21T07:36:57.337165+0000","last_undegraded":"2024-09-21T07:36:57.337165+0000","last_fullsized":"2024-09-21T07:36:57.337165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:14.011653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224196+0000","last_change":"2024-09-21T07:36:56.221559+0000","last_active":"2024-09-21T07:36:56.224196+0000","last_peered":"2024-09-21T07:36:56.224196+0000","last_clean":"2024-09-21T07:36:56.224196+0000","last_became_active":"2024-09-21T07:36:56.221199+0000","last_became_peered":"2024-09-21T07:36:56.221199+0000","last_unstale":"2024-09-21T07:36:56.224196+0000","last_undegraded":"2024-09-21T07:36:56.224196+0000","last_fullsized":"2024-09-21T07:36:56.224196+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.963469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337225+0000","last_change":"2024-09-21T07:36:56.213521+0000","last_active":"2024-09-21T07:36:57.337225+0000","last_peered":"2024-09-21T07:36:57.337225+0000","last_clean":"2024-09-21T07:36:57.337225+0000","last_became_active":"2024-09-21T07:36:56.213022+0000","last_became_peered":"2024-09-21T07:36:56.213022+0000","last_unstale":"2024-09-21T07:36:57.337225+0000","last_undegraded":"2024-09-21T07:36:57.337225+0000","last_fullsized":"2024-09-21T07:36:57.337225+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:35.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208858+0000","last_change":"2024-09-21T07:36:56.223434+0000","last_active":"2024-09-21T07:36:57.208858+0000","last_peered":"2024-09-21T07:36:57.208858+0000","last_clean":"2024-09-21T07:36:57.208858+0000","last_became_active":"2024-09-21T07:36:56.223084+0000","last_became_peered":"2024-09-21T07:36:56.223084+0000","last_unstale":"2024-09-21T07:36:57.208858+0000","last_undegraded":"2024-09-21T07:36:57.208858+0000","last_fullsized":"2024-09-21T07:36:57.208858+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:54.190672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":17,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240232+0000","last_change":"2024-09-21T07:36:55.208936+0000","last_active":"2024-09-21T07:36:56.240232+0000","last_peered":"2024-09-21T07:36:56.240232+0000","last_clean":"2024-09-21T07:36:56.240232+0000","last_became_active":"2024-09-21T07:36:55.208637+0000","last_became_peered":"2024-09-21T07:36:55.208637+0000","last_unstale":"2024-09-21T07:36:56.240232+0000","last_undegraded":"2024-09-21T07:36:56.240232+0000","last_fullsized":"2024-09-21T07:36:56.240232+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:44.237771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208946+0000","last_change":"2024-09-21T07:36:56.204460+0000","last_active":"2024-09-21T07:36:57.208946+0000","last_peered":"2024-09-21T07:36:57.208946+0000","last_clean":"2024-09-21T07:36:57.208946+0000","last_became_active":"2024-09-21T07:36:56.203999+0000","last_became_peered":"2024-09-21T07:36:56.203999+0000","last_unstale":"2024-09-21T07:36:57.208946+0000","last_undegraded":"2024-09-21T07:36:57.208946+0000","last_fullsized":"2024-09-21T07:36:57.208946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:13.987823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209586+0000","last_change":"2024-09-21T07:36:55.208486+0000","last_active":"2024-09-21T07:36:57.209586+0000","last_peered":"2024-09-21T07:36:57.209586+0000","last_clean":"2024-09-21T07:36:57.209586+0000","last_became_active":"2024-09-21T07:36:55.207826+0000","last_became_peered":"2024-09-21T07:36:55.207826+0000","last_unstale":"2024-09-21T07:36:57.209586+0000","last_undegraded":"2024-09-21T07:36:57.209586+0000","last_fullsized":"2024-09-21T07:36:57.209586+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:55.679055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209488+0000","last_change":"2024-09-21T07:36:56.222112+0000","last_active":"2024-09-21T07:36:57.209488+0000","last_peered":"2024-09-21T07:36:57.209488+0000","last_clean":"2024-09-21T07:36:57.209488+0000","last_became_active":"2024-09-21T07:36:56.221751+0000","last_became_peered":"2024-09-21T07:36:56.221751+0000","last_unstale":"2024-09-21T07:36:57.209488+0000","last_undegraded":"2024-09-21T07:36:57.209488+0000","last_fullsized":"2024-09-21T07:36:57.209488+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:50.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337205+0000","last_change":"2024-09-21T07:36:55.201067+0000","last_active":"2024-09-21T07:36:57.337205+0000","last_peered":"2024-09-21T07:36:57.337205+0000","last_clean":"2024-09-21T07:36:57.337205+0000","last_became_active":"2024-09-21T07:36:55.200701+0000","last_became_peered":"2024-09-21T07:36:55.200701+0000","last_unstale":"2024-09-21T07:36:57.337205+0000","last_undegraded":"2024-09-21T07:36:57.337205+0000","last_fullsized":"2024-09-21T07:36:57.337205+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:12.736774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208375+0000","last_change":"2024-09-21T07:36:56.217769+0000","last_active":"2024-09-21T07:36:57.208375+0000","last_peered":"2024-09-21T07:36:57.208375+0000","last_clean":"2024-09-21T07:36:57.208375+0000","last_became_active":"2024-09-21T07:36:56.217454+0000","last_became_peered":"2024-09-21T07:36:56.217454+0000","last_unstale":"2024-09-21T07:36:57.208375+0000","last_undegraded":"2024-09-21T07:36:57.208375+0000","last_fullsized":"2024-09-21T07:36:57.208375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225551+0000","last_change":"2024-09-21T07:36:55.205908+0000","last_active":"2024-09-21T07:36:57.225551+0000","last_peered":"2024-09-21T07:36:57.225551+0000","last_clean":"2024-09-21T07:36:57.225551+0000","last_became_active":"2024-09-21T07:36:55.205436+0000","last_became_peered":"2024-09-21T07:36:55.205436+0000","last_unstale":"2024-09-21T07:36:57.225551+0000","last_undegraded":"2024-09-21T07:36:57.225551+0000","last_fullsized":"2024-09-21T07:36:57.225551+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:56.199982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208667+0000","last_change":"2024-09-21T07:36:56.214216+0000","last_active":"2024-09-21T07:36:57.208667+0000","last_peered":"2024-09-21T07:36:57.208667+0000","last_clean":"2024-09-21T07:36:57.208667+0000","last_became_active":"2024-09-21T07:36:56.213795+0000","last_became_peered":"2024-09-21T07:36:56.213795+0000","last_unstale":"2024-09-21T07:36:57.208667+0000","last_undegraded":"2024-09-21T07:36:57.208667+0000","last_fullsized":"2024-09-21T07:36:57.208667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:27.786546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.237402+0000","last_change":"2024-09-21T07:36:55.208547+0000","last_active":"2024-09-21T07:36:56.237402+0000","last_peered":"2024-09-21T07:36:56.237402+0000","last_clean":"2024-09-21T07:36:56.237402+0000","last_became_active":"2024-09-21T07:36:55.208213+0000","last_became_peered":"2024-09-21T07:36:55.208213+0000","last_unstale":"2024-09-21T07:36:56.237402+0000","last_undegraded":"2024-09-21T07:36:56.237402+0000","last_fullsized":"2024-09-21T07:36:56.237402+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:16.287683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225477+0000","last_change":"2024-09-21T07:36:56.221370+0000","last_active":"2024-09-21T07:36:57.225477+0000","last_peered":"2024-09-21T07:36:57.225477+0000","last_clean":"2024-09-21T07:36:57.225477+0000","last_became_active":"2024-09-21T07:36:56.221018+0000","last_became_peered":"2024-09-21T07:36:56.221018+0000","last_unstale":"2024-09-21T07:36:57.225477+0000","last_undegraded":"2024-09-21T07:36:57.225477+0000","last_fullsized":"2024-09-21T07:36:57.225477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:47.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208803+0000","last_change":"2024-09-21T07:36:55.202201+0000","last_active":"2024-09-21T07:36:57.208803+0000","last_peered":"2024-09-21T07:36:57.208803+0000","last_clean":"2024-09-21T07:36:57.208803+0000","last_became_active":"2024-09-21T07:36:55.201905+0000","last_became_peered":"2024-09-21T07:36:55.201905+0000","last_unstale":"2024-09-21T07:36:57.208803+0000","last_undegraded":"2024-09-21T07:36:57.208803+0000","last_fullsized":"2024-09-21T07:36:57.208803+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:16.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.228909+0000","last_change":"2024-09-21T07:36:56.227247+0000","last_active":"2024-09-21T07:36:56.228909+0000","last_peered":"2024-09-21T07:36:56.228909+0000","last_clean":"2024-09-21T07:36:56.228909+0000","last_became_active":"2024-09-21T07:36:56.226637+0000","last_became_peered":"2024-09-21T07:36:56.226637+0000","last_unstale":"2024-09-21T07:36:56.228909+0000","last_undegraded":"2024-09-21T07:36:56.228909+0000","last_fullsized":"2024-09-21T07:36:56.228909+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:46.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208575+0000","last_change":"2024-09-21T07:36:55.204178+0000","last_active":"2024-09-21T07:36:57.208575+0000","last_peered":"2024-09-21T07:36:57.208575+0000","last_clean":"2024-09-21T07:36:57.208575+0000","last_became_active":"2024-09-21T07:36:55.199695+0000","last_became_peered":"2024-09-21T07:36:55.199695+0000","last_unstale":"2024-09-21T07:36:57.208575+0000","last_undegraded":"2024-09-21T07:36:57.208575+0000","last_fullsized":"2024-09-21T07:36:57.208575+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:36.499430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225888+0000","last_change":"2024-09-21T07:36:56.228149+0000","last_active":"2024-09-21T07:36:57.225888+0000","last_peered":"2024-09-21T07:36:57.225888+0000","last_clean":"2024-09-21T07:36:57.225888+0000","last_became_active":"2024-09-21T07:36:56.227785+0000","last_became_peered":"2024-09-21T07:36:56.227785+0000","last_unstale":"2024-09-21T07:36:57.225888+0000","last_undegraded":"2024-09-21T07:36:57.225888+0000","last_fullsized":"2024-09-21T07:36:57.225888+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:25:44.487949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207067+0000","last_change":"2024-09-21T07:36:55.207507+0000","last_active":"2024-09-21T07:36:56.207067+0000","last_peered":"2024-09-21T07:36:56.207067+0000","last_clean":"2024-09-21T07:36:56.207067+0000","last_became_active":"2024-09-21T07:36:55.207028+0000","last_became_peered":"2024-09-21T07:36:55.207028+0000","last_unstale":"2024-09-21T07:36:56.207067+0000","last_undegraded":"2024-09-21T07:36:56.207067+0000","last_fullsized":"2024-09-21T07:36:56.207067+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:14.332670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225784+0000","last_change":"2024-09-21T07:36:56.211579+0000","last_active":"2024-09-21T07:36:57.225784+0000","last_peered":"2024-09-21T07:36:57.225784+0000","last_clean":"2024-09-21T07:36:57.225784+0000","last_became_active":"2024-09-21T07:36:56.211261+0000","last_became_peered":"2024-09-21T07:36:56.211261+0000","last_unstale":"2024-09-21T07:36:57.225784+0000","last_undegraded":"2024-09-21T07:36:57.225784+0000","last_fullsized":"2024-09-21T07:36:57.225784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:04.216771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209913+0000","last_change":"2024-09-21T07:36:55.200523+0000","last_active":"2024-09-21T07:36:57.209913+0000","last_peered":"2024-09-21T07:36:57.209913+0000","last_clean":"2024-09-21T07:36:57.209913+0000","last_became_active":"2024-09-21T07:36:55.200171+0000","last_became_peered":"2024-09-21T07:36:55.200171+0000","last_unstale":"2024-09-21T07:36:57.209913+0000","last_undegraded":"2024-09-21T07:36:57.209913+0000","last_fullsized":"2024-09-21T07:36:57.209913+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:29.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209448+0000","last_change":"2024-09-21T07:36:56.212107+0000","last_active":"2024-09-21T07:36:57.209448+0000","last_peered":"2024-09-21T07:36:57.209448+0000","last_clean":"2024-09-21T07:36:57.209448+0000","last_became_active":"2024-09-21T07:36:56.211010+0000","last_became_peered":"2024-09-21T07:36:56.211010+0000","last_unstale":"2024-09-21T07:36:57.209448+0000","last_undegraded":"2024-09-21T07:36:57.209448+0000","last_fullsized":"2024-09-21T07:36:57.209448+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.055682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":16,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.240321+0000","last_change":"2024-09-21T07:36:55.208006+0000","last_active":"2024-09-21T07:36:56.240321+0000","last_peered":"2024-09-21T07:36:56.240321+0000","last_clean":"2024-09-21T07:36:56.240321+0000","last_became_active":"2024-09-21T07:36:55.207715+0000","last_became_peered":"2024-09-21T07:36:55.207715+0000","last_unstale":"2024-09-21T07:36:56.240321+0000","last_undegraded":"2024-09-21T07:36:56.240321+0000","last_fullsized":"2024-09-21T07:36:56.240321+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:15.980896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210132+0000","last_change":"2024-09-21T07:36:56.223296+0000","last_active":"2024-09-21T07:36:57.210132+0000","last_peered":"2024-09-21T07:36:57.210132+0000","last_clean":"2024-09-21T07:36:57.210132+0000","last_became_active":"2024-09-21T07:36:56.222802+0000","last_became_peered":"2024-09-21T07:36:56.222802+0000","last_unstale":"2024-09-21T07:36:57.210132+0000","last_undegraded":"2024-09-21T07:36:57.210132+0000","last_fullsized":"2024-09-21T07:36:57.210132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:20.625782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":21,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337124+0000","last_change":"2024-09-21T07:36:55.195328+0000","last_active":"2024-09-21T07:36:57.337124+0000","last_peered":"2024-09-21T07:36:57.337124+0000","last_clean":"2024-09-21T07:36:57.337124+0000","last_became_active":"2024-09-21T07:36:55.194804+0000","last_became_peered":"2024-09-21T07:36:55.194804+0000","last_unstale":"2024-09-21T07:36:57.337124+0000","last_undegraded":"2024-09-21T07:36:57.337124+0000","last_fullsized":"2024-09-21T07:36:57.337124+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:18.921474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.229935+0000","last_change":"2024-09-21T07:36:56.228831+0000","last_active":"2024-09-21T07:36:56.229935+0000","last_peered":"2024-09-21T07:36:56.229935+0000","last_clean":"2024-09-21T07:36:56.229935+0000","last_became_active":"2024-09-21T07:36:56.228056+0000","last_became_peered":"2024-09-21T07:36:56.228056+0000","last_unstale":"2024-09-21T07:36:56.229935+0000","last_undegraded":"2024-09-21T07:36:56.229935+0000","last_fullsized":"2024-09-21T07:36:56.229935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:35.309506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209152+0000","last_change":"2024-09-21T07:36:55.200997+0000","last_active":"2024-09-21T07:36:57.209152+0000","last_peered":"2024-09-21T07:36:57.209152+0000","last_clean":"2024-09-21T07:36:57.209152+0000","last_became_active":"2024-09-21T07:36:55.200396+0000","last_became_peered":"2024-09-21T07:36:55.200396+0000","last_unstale":"2024-09-21T07:36:57.209152+0000","last_undegraded":"2024-09-21T07:36:57.209152+0000","last_fullsized":"2024-09-21T07:36:57.209152+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:19.618528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208835+0000","last_change":"2024-09-21T07:36:56.219624+0000","last_active":"2024-09-21T07:36:57.208835+0000","last_peered":"2024-09-21T07:36:57.208835+0000","last_clean":"2024-09-21T07:36:57.208835+0000","last_became_active":"2024-09-21T07:36:56.216161+0000","last_became_peered":"2024-09-21T07:36:56.216161+0000","last_unstale":"2024-09-21T07:36:57.208835+0000","last_undegraded":"2024-09-21T07:36:57.208835+0000","last_fullsized":"2024-09-21T07:36:57.208835+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:36.243592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.207357+0000","last_change":"2024-09-21T07:36:55.198647+0000","last_active":"2024-09-21T07:36:56.207357+0000","last_peered":"2024-09-21T07:36:56.207357+0000","last_clean":"2024-09-21T07:36:56.207357+0000","last_became_active":"2024-09-21T07:36:55.198253+0000","last_became_peered":"2024-09-21T07:36:55.198253+0000","last_unstale":"2024-09-21T07:36:56.207357+0000","last_undegraded":"2024-09-21T07:36:56.207357+0000","last_fullsized":"2024-09-21T07:36:56.207357+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:21.793379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208620+0000","last_change":"2024-09-21T07:36:56.224388+0000","last_active":"2024-09-21T07:36:57.208620+0000","last_peered":"2024-09-21T07:36:57.208620+0000","last_clean":"2024-09-21T07:36:57.208620+0000","last_became_active":"2024-09-21T07:36:56.224101+0000","last_became_peered":"2024-09-21T07:36:56.224101+0000","last_unstale":"2024-09-21T07:36:57.208620+0000","last_undegraded":"2024-09-21T07:36:57.208620+0000","last_fullsized":"2024-09-21T07:36:57.208620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:55.944456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336481+0000","last_change":"2024-09-21T07:36:55.194123+0000","last_active":"2024-09-21T07:36:57.336481+0000","last_peered":"2024-09-21T07:36:57.336481+0000","last_clean":"2024-09-21T07:36:57.336481+0000","last_became_active":"2024-09-21T07:36:55.193443+0000","last_became_peered":"2024-09-21T07:36:55.193443+0000","last_unstale":"2024-09-21T07:36:57.336481+0000","last_undegraded":"2024-09-21T07:36:57.336481+0000","last_fullsized":"2024-09-21T07:36:57.336481+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:58.513398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.226004+0000","last_change":"2024-09-21T07:36:56.211258+0000","last_active":"2024-09-21T07:36:57.226004+0000","last_peered":"2024-09-21T07:36:57.226004+0000","last_clean":"2024-09-21T07:36:57.226004+0000","last_became_active":"2024-09-21T07:36:56.210949+0000","last_became_peered":"2024-09-21T07:36:56.210949+0000","last_unstale":"2024-09-21T07:36:57.226004+0000","last_undegraded":"2024-09-21T07:36:57.226004+0000","last_fullsized":"2024-09-21T07:36:57.226004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:08.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":23,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208224+0000","last_change":"2024-09-21T07:36:55.195611+0000","last_active":"2024-09-21T07:36:57.208224+0000","last_peered":"2024-09-21T07:36:57.208224+0000","last_clean":"2024-09-21T07:36:57.208224+0000","last_became_active":"2024-09-21T07:36:55.195346+0000","last_became_peered":"2024-09-21T07:36:55.195346+0000","last_unstale":"2024-09-21T07:36:57.208224+0000","last_undegraded":"2024-09-21T07:36:57.208224+0000","last_fullsized":"2024-09-21T07:36:57.208224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:47.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224577+0000","last_change":"2024-09-21T07:36:56.219414+0000","last_active":"2024-09-21T07:36:56.224577+0000","last_peered":"2024-09-21T07:36:56.224577+0000","last_clean":"2024-09-21T07:36:56.224577+0000","last_became_active":"2024-09-21T07:36:56.214646+0000","last_became_peered":"2024-09-21T07:36:56.214646+0000","last_unstale":"2024-09-21T07:36:56.224577+0000","last_undegraded":"2024-09-21T07:36:56.224577+0000","last_fullsized":"2024-09-21T07:36:56.224577+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:34.398725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209434+0000","last_change":"2024-09-21T07:36:55.199617+0000","last_active":"2024-09-21T07:36:57.209434+0000","last_peered":"2024-09-21T07:36:57.209434+0000","last_clean":"2024-09-21T07:36:57.209434+0000","last_became_active":"2024-09-21T07:36:55.199251+0000","last_became_peered":"2024-09-21T07:36:55.199251+0000","last_unstale":"2024-09-21T07:36:57.209434+0000","last_undegraded":"2024-09-21T07:36:57.209434+0000","last_fullsized":"2024-09-21T07:36:57.209434+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:11.244071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.231589+0000","last_change":"2024-09-21T07:36:56.229275+0000","last_active":"2024-09-21T07:36:56.231589+0000","last_peered":"2024-09-21T07:36:56.231589+0000","last_clean":"2024-09-21T07:36:56.231589+0000","last_became_active":"2024-09-21T07:36:56.228759+0000","last_became_peered":"2024-09-21T07:36:56.228759+0000","last_unstale":"2024-09-21T07:36:56.231589+0000","last_undegraded":"2024-09-21T07:36:56.231589+0000","last_fullsized":"2024-09-21T07:36:56.231589+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:52.801290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.236277+0000","last_change":"2024-09-21T07:36:55.206279+0000","last_active":"2024-09-21T07:36:56.236277+0000","last_peered":"2024-09-21T07:36:56.236277+0000","last_clean":"2024-09-21T07:36:56.236277+0000","last_became_active":"2024-09-21T07:36:55.205963+0000","last_became_peered":"2024-09-21T07:36:55.205963+0000","last_unstale":"2024-09-21T07:36:56.236277+0000","last_undegraded":"2024-09-21T07:36:56.236277+0000","last_fullsized":"2024-09-21T07:36:56.236277+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209444+0000","last_change":"2024-09-21T07:36:56.212459+0000","last_active":"2024-09-21T07:36:57.209444+0000","last_peered":"2024-09-21T07:36:57.209444+0000","last_clean":"2024-09-21T07:36:57.209444+0000","last_became_active":"2024-09-21T07:36:56.211395+0000","last_became_peered":"2024-09-21T07:36:56.211395+0000","last_unstale":"2024-09-21T07:36:57.209444+0000","last_undegraded":"2024-09-21T07:36:57.209444+0000","last_fullsized":"2024-09-21T07:36:57.209444+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:18.816832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209810+0000","last_change":"2024-09-21T07:36:55.195028+0000","last_active":"2024-09-21T07:36:57.209810+0000","last_peered":"2024-09-21T07:36:57.209810+0000","last_clean":"2024-09-21T07:36:57.209810+0000","last_became_active":"2024-09-21T07:36:55.194670+0000","last_became_peered":"2024-09-21T07:36:55.194670+0000","last_unstale":"2024-09-21T07:36:57.209810+0000","last_undegraded":"2024-09-21T07:36:57.209810+0000","last_fullsized":"2024-09-21T07:36:57.209810+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:05.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210062+0000","last_change":"2024-09-21T07:36:56.218458+0000","last_active":"2024-09-21T07:36:57.210062+0000","last_peered":"2024-09-21T07:36:57.210062+0000","last_clean":"2024-09-21T07:36:57.210062+0000","last_became_active":"2024-09-21T07:36:56.216457+0000","last_became_peered":"2024-09-21T07:36:56.216457+0000","last_unstale":"2024-09-21T07:36:57.210062+0000","last_undegraded":"2024-09-21T07:36:57.210062+0000","last_fullsized":"2024-09-21T07:36:57.210062+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:52.209400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209427+0000","last_change":"2024-09-21T07:36:55.195031+0000","last_active":"2024-09-21T07:36:57.209427+0000","last_peered":"2024-09-21T07:36:57.209427+0000","last_clean":"2024-09-21T07:36:57.209427+0000","last_became_active":"2024-09-21T07:36:55.194562+0000","last_became_peered":"2024-09-21T07:36:55.194562+0000","last_unstale":"2024-09-21T07:36:57.209427+0000","last_undegraded":"2024-09-21T07:36:57.209427+0000","last_fullsized":"2024-09-21T07:36:57.209427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:13.287440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208070+0000","last_change":"2024-09-21T07:36:56.217928+0000","last_active":"2024-09-21T07:36:57.208070+0000","last_peered":"2024-09-21T07:36:57.208070+0000","last_clean":"2024-09-21T07:36:57.208070+0000","last_became_active":"2024-09-21T07:36:56.217476+0000","last_became_peered":"2024-09-21T07:36:56.217476+0000","last_unstale":"2024-09-21T07:36:57.208070+0000","last_undegraded":"2024-09-21T07:36:57.208070+0000","last_fullsized":"2024-09-21T07:36:57.208070+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:39.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209270+0000","last_change":"2024-09-21T07:36:55.207808+0000","last_active":"2024-09-21T07:36:57.209270+0000","last_peered":"2024-09-21T07:36:57.209270+0000","last_clean":"2024-09-21T07:36:57.209270+0000","last_became_active":"2024-09-21T07:36:55.207491+0000","last_became_peered":"2024-09-21T07:36:55.207491+0000","last_unstale":"2024-09-21T07:36:57.209270+0000","last_undegraded":"2024-09-21T07:36:57.209270+0000","last_fullsized":"2024-09-21T07:36:57.209270+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:35.464049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.221605+0000","last_change":"2024-09-21T07:36:56.217953+0000","last_active":"2024-09-21T07:36:56.221605+0000","last_peered":"2024-09-21T07:36:56.221605+0000","last_clean":"2024-09-21T07:36:56.221605+0000","last_became_active":"2024-09-21T07:36:56.217601+0000","last_became_peered":"2024-09-21T07:36:56.217601+0000","last_unstale":"2024-09-21T07:36:56.221605+0000","last_undegraded":"2024-09-21T07:36:56.221605+0000","last_fullsized":"2024-09-21T07:36:56.221605+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:08.101461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225528+0000","last_change":"2024-09-21T07:36:55.204439+0000","last_active":"2024-09-21T07:36:57.225528+0000","last_peered":"2024-09-21T07:36:57.225528+0000","last_clean":"2024-09-21T07:36:57.225528+0000","last_became_active":"2024-09-21T07:36:55.203956+0000","last_became_peered":"2024-09-21T07:36:55.203956+0000","last_unstale":"2024-09-21T07:36:57.225528+0000","last_undegraded":"2024-09-21T07:36:57.225528+0000","last_fullsized":"2024-09-21T07:36:57.225528+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:34.118668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.216941+0000","last_change":"2024-09-21T07:36:56.215366+0000","last_active":"2024-09-21T07:36:56.216941+0000","last_peered":"2024-09-21T07:36:56.216941+0000","last_clean":"2024-09-21T07:36:56.216941+0000","last_became_active":"2024-09-21T07:36:56.214875+0000","last_became_peered":"2024-09-21T07:36:56.214875+0000","last_unstale":"2024-09-21T07:36:56.216941+0000","last_undegraded":"2024-09-21T07:36:56.216941+0000","last_fullsized":"2024-09-21T07:36:56.216941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:16.041708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225393+0000","last_change":"2024-09-21T07:36:55.207655+0000","last_active":"2024-09-21T07:36:57.225393+0000","last_peered":"2024-09-21T07:36:57.225393+0000","last_clean":"2024-09-21T07:36:57.225393+0000","last_became_active":"2024-09-21T07:36:55.207342+0000","last_became_peered":"2024-09-21T07:36:55.207342+0000","last_unstale":"2024-09-21T07:36:57.225393+0000","last_undegraded":"2024-09-21T07:36:57.225393+0000","last_fullsized":"2024-09-21T07:36:57.225393+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:41.475513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208765+0000","last_change":"2024-09-21T07:36:56.208637+0000","last_active":"2024-09-21T07:36:57.208765+0000","last_peered":"2024-09-21T07:36:57.208765+0000","last_clean":"2024-09-21T07:36:57.208765+0000","last_became_active":"2024-09-21T07:36:56.208330+0000","last_became_peered":"2024-09-21T07:36:56.208330+0000","last_unstale":"2024-09-21T07:36:57.208765+0000","last_undegraded":"2024-09-21T07:36:57.208765+0000","last_fullsized":"2024-09-21T07:36:57.208765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:40.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.208174+0000","last_change":"2024-09-21T07:36:55.206596+0000","last_active":"2024-09-21T07:36:56.208174+0000","last_peered":"2024-09-21T07:36:56.208174+0000","last_clean":"2024-09-21T07:36:56.208174+0000","last_became_active":"2024-09-21T07:36:55.206270+0000","last_became_peered":"2024-09-21T07:36:55.206270+0000","last_unstale":"2024-09-21T07:36:56.208174+0000","last_undegraded":"2024-09-21T07:36:56.208174+0000","last_fullsized":"2024-09-21T07:36:56.208174+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:09.900363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.224604+0000","last_change":"2024-09-21T07:36:56.219605+0000","last_active":"2024-09-21T07:36:56.224604+0000","last_peered":"2024-09-21T07:36:56.224604+0000","last_clean":"2024-09-21T07:36:56.224604+0000","last_became_active":"2024-09-21T07:36:56.216745+0000","last_became_peered":"2024-09-21T07:36:56.216745+0000","last_unstale":"2024-09-21T07:36:56.224604+0000","last_undegraded":"2024-09-21T07:36:56.224604+0000","last_fullsized":"2024-09-21T07:36:56.224604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:40.290073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209996+0000","last_change":"2024-09-21T07:36:55.201898+0000","last_active":"2024-09-21T07:36:57.209996+0000","last_peered":"2024-09-21T07:36:57.209996+0000","last_clean":"2024-09-21T07:36:57.209996+0000","last_became_active":"2024-09-21T07:36:55.201581+0000","last_became_peered":"2024-09-21T07:36:55.201581+0000","last_unstale":"2024-09-21T07:36:57.209996+0000","last_undegraded":"2024-09-21T07:36:57.209996+0000","last_fullsized":"2024-09-21T07:36:57.209996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:27.902218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227992+0000","last_change":"2024-09-21T07:36:56.223740+0000","last_active":"2024-09-21T07:36:56.227992+0000","last_peered":"2024-09-21T07:36:56.227992+0000","last_clean":"2024-09-21T07:36:56.227992+0000","last_became_active":"2024-09-21T07:36:56.223305+0000","last_became_peered":"2024-09-21T07:36:56.223305+0000","last_unstale":"2024-09-21T07:36:56.227992+0000","last_undegraded":"2024-09-21T07:36:56.227992+0000","last_fullsized":"2024-09-21T07:36:56.227992+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:26.707788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"204'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.227384+0000","last_change":"2024-09-21T07:36:55.202987+0000","last_active":"2024-09-21T07:36:57.227384+0000","last_peered":"2024-09-21T07:36:57.227384+0000","last_clean":"2024-09-21T07:36:57.227384+0000","last_became_active":"2024-09-21T07:36:55.202656+0000","last_became_peered":"2024-09-21T07:36:55.202656+0000","last_unstale":"2024-09-21T07:36:57.227384+0000","last_undegraded":"2024-09-21T07:36:57.227384+0000","last_fullsized":"2024-09-21T07:36:57.227384+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:18.120081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337229+0000","last_change":"2024-09-21T07:36:56.231483+0000","last_active":"2024-09-21T07:36:57.337229+0000","last_peered":"2024-09-21T07:36:57.337229+0000","last_clean":"2024-09-21T07:36:57.337229+0000","last_became_active":"2024-09-21T07:36:56.231174+0000","last_became_peered":"2024-09-21T07:36:56.231174+0000","last_unstale":"2024-09-21T07:36:57.337229+0000","last_undegraded":"2024-09-21T07:36:57.337229+0000","last_fullsized":"2024-09-21T07:36:57.337229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:23.639764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225789+0000","last_change":"2024-09-21T07:36:55.201998+0000","last_active":"2024-09-21T07:36:57.225789+0000","last_peered":"2024-09-21T07:36:57.225789+0000","last_clean":"2024-09-21T07:36:57.225789+0000","last_became_active":"2024-09-21T07:36:55.201662+0000","last_became_peered":"2024-09-21T07:36:55.201662+0000","last_unstale":"2024-09-21T07:36:57.225789+0000","last_undegraded":"2024-09-21T07:36:57.225789+0000","last_fullsized":"2024-09-21T07:36:57.225789+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:35.647330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.222865+0000","last_change":"2024-09-21T07:36:56.219161+0000","last_active":"2024-09-21T07:36:56.222865+0000","last_peered":"2024-09-21T07:36:56.222865+0000","last_clean":"2024-09-21T07:36:56.222865+0000","last_became_active":"2024-09-21T07:36:56.218372+0000","last_became_peered":"2024-09-21T07:36:56.218372+0000","last_unstale":"2024-09-21T07:36:56.222865+0000","last_undegraded":"2024-09-21T07:36:56.222865+0000","last_fullsized":"2024-09-21T07:36:56.222865+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:07.593583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210308+0000","last_change":"2024-09-21T07:36:55.206649+0000","last_active":"2024-09-21T07:36:57.210308+0000","last_peered":"2024-09-21T07:36:57.210308+0000","last_clean":"2024-09-21T07:36:57.210308+0000","last_became_active":"2024-09-21T07:36:55.206341+0000","last_became_peered":"2024-09-21T07:36:55.206341+0000","last_unstale":"2024-09-21T07:36:57.210308+0000","last_undegraded":"2024-09-21T07:36:57.210308+0000","last_fullsized":"2024-09-21T07:36:57.210308+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:43.715074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208381+0000","last_change":"2024-09-21T07:36:56.209605+0000","last_active":"2024-09-21T07:36:57.208381+0000","last_peered":"2024-09-21T07:36:57.208381+0000","last_clean":"2024-09-21T07:36:57.208381+0000","last_became_active":"2024-09-21T07:36:56.209298+0000","last_became_peered":"2024-09-21T07:36:56.209298+0000","last_unstale":"2024-09-21T07:36:57.208381+0000","last_undegraded":"2024-09-21T07:36:57.208381+0000","last_fullsized":"2024-09-21T07:36:57.208381+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:06.549305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209612+0000","last_change":"2024-09-21T07:36:55.200687+0000","last_active":"2024-09-21T07:36:57.209612+0000","last_peered":"2024-09-21T07:36:57.209612+0000","last_clean":"2024-09-21T07:36:57.209612+0000","last_became_active":"2024-09-21T07:36:55.200028+0000","last_became_peered":"2024-09-21T07:36:55.200028+0000","last_unstale":"2024-09-21T07:36:57.209612+0000","last_undegraded":"2024-09-21T07:36:57.209612+0000","last_fullsized":"2024-09-21T07:36:57.209612+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:10.111404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208413+0000","last_change":"2024-09-21T07:36:56.221260+0000","last_active":"2024-09-21T07:36:57.208413+0000","last_peered":"2024-09-21T07:36:57.208413+0000","last_clean":"2024-09-21T07:36:57.208413+0000","last_became_active":"2024-09-21T07:36:56.220493+0000","last_became_peered":"2024-09-21T07:36:56.220493+0000","last_unstale":"2024-09-21T07:36:57.208413+0000","last_undegraded":"2024-09-21T07:36:57.208413+0000","last_fullsized":"2024-09-21T07:36:57.208413+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:01.010095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209172+0000","last_change":"2024-09-21T07:36:55.198983+0000","last_active":"2024-09-21T07:36:57.209172+0000","last_peered":"2024-09-21T07:36:57.209172+0000","last_clean":"2024-09-21T07:36:57.209172+0000","last_became_active":"2024-09-21T07:36:55.198513+0000","last_became_peered":"2024-09-21T07:36:55.198513+0000","last_unstale":"2024-09-21T07:36:57.209172+0000","last_undegraded":"2024-09-21T07:36:57.209172+0000","last_fullsized":"2024-09-21T07:36:57.209172+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:40.003553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.227066+0000","last_change":"2024-09-21T07:36:56.225875+0000","last_active":"2024-09-21T07:36:56.227066+0000","last_peered":"2024-09-21T07:36:56.227066+0000","last_clean":"2024-09-21T07:36:56.227066+0000","last_became_active":"2024-09-21T07:36:56.225520+0000","last_became_peered":"2024-09-21T07:36:56.225520+0000","last_unstale":"2024-09-21T07:36:56.227066+0000","last_undegraded":"2024-09-21T07:36:56.227066+0000","last_fullsized":"2024-09-21T07:36:56.227066+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.174282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.205102+0000","last_change":"2024-09-21T07:36:55.211026+0000","last_active":"2024-09-21T07:36:56.205102+0000","last_peered":"2024-09-21T07:36:56.205102+0000","last_clean":"2024-09-21T07:36:56.205102+0000","last_became_active":"2024-09-21T07:36:55.210636+0000","last_became_peered":"2024-09-21T07:36:55.210636+0000","last_unstale":"2024-09-21T07:36:56.205102+0000","last_undegraded":"2024-09-21T07:36:56.205102+0000","last_fullsized":"2024-09-21T07:36:56.205102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:08.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209029+0000","last_change":"2024-09-21T07:36:56.222090+0000","last_active":"2024-09-21T07:36:57.209029+0000","last_peered":"2024-09-21T07:36:57.209029+0000","last_clean":"2024-09-21T07:36:57.209029+0000","last_became_active":"2024-09-21T07:36:56.221728+0000","last_became_peered":"2024-09-21T07:36:56.221728+0000","last_unstale":"2024-09-21T07:36:57.209029+0000","last_undegraded":"2024-09-21T07:36:57.209029+0000","last_fullsized":"2024-09-21T07:36:57.209029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:30.692530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208405+0000","last_change":"2024-09-21T07:36:55.194087+0000","last_active":"2024-09-21T07:36:57.208405+0000","last_peered":"2024-09-21T07:36:57.208405+0000","last_clean":"2024-09-21T07:36:57.208405+0000","last_became_active":"2024-09-21T07:36:55.193807+0000","last_became_peered":"2024-09-21T07:36:55.193807+0000","last_unstale":"2024-09-21T07:36:57.208405+0000","last_undegraded":"2024-09-21T07:36:57.208405+0000","last_fullsized":"2024-09-21T07:36:57.208405+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.803891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209351+0000","last_change":"2024-09-21T07:36:56.205336+0000","last_active":"2024-09-21T07:36:57.209351+0000","last_peered":"2024-09-21T07:36:57.209351+0000","last_clean":"2024-09-21T07:36:57.209351+0000","last_became_active":"2024-09-21T07:36:56.204976+0000","last_became_peered":"2024-09-21T07:36:56.204976+0000","last_unstale":"2024-09-21T07:36:57.209351+0000","last_undegraded":"2024-09-21T07:36:57.209351+0000","last_fullsized":"2024-09-21T07:36:57.209351+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:07.488160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.238326+0000","last_change":"2024-09-21T07:36:55.207312+0000","last_active":"2024-09-21T07:36:56.238326+0000","last_peered":"2024-09-21T07:36:56.238326+0000","last_clean":"2024-09-21T07:36:56.238326+0000","last_became_active":"2024-09-21T07:36:55.206468+0000","last_became_peered":"2024-09-21T07:36:55.206468+0000","last_unstale":"2024-09-21T07:36:56.238326+0000","last_undegraded":"2024-09-21T07:36:56.238326+0000","last_fullsized":"2024-09-21T07:36:56.238326+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.912021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":444,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-21T07:36:56.204117+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:36:56.204117+0000","last_peered":"2024-09-21T07:36:56.204117+0000","last_clean":"2024-09-21T07:36:56.204117+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:36:56.204117+0000","last_undegraded":"2024-09-21T07:36:56.204117+0000","last_fullsized":"2024-09-21T07:36:56.204117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55920,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315920,"statfs":{"total":96636764160,"available":96579502080,"internally_reserved":0,"allocated":2580480,"data_stored":1211070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2572288,"data_stored":1211014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47580,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324260,"statfs":{"total":96636764160,"available":96588042240,"internally_reserved":0,"allocated":2560000,"data_stored":1209422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60068,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311772,"statfs":{"total":96636764160,"available":96575254528,"internally_reserved":0,"allocated":2564096,"data_stored":1209948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509615,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64212,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307628,"statfs":{"total":96636764160,"available":96571011072,"internally_reserved":0,"allocated":2555904,"data_stored":1209332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509616,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56472,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315368,"statfs":{"total":96636764160,"available":96578936832,"internally_reserved":0,"allocated":3149824,"data_stored":1799700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542320,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":3084,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":3158016,"data_stored":1800372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87784,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284056,"statfs":{"total":96636764160,"available":96546873344,"internally_reserved":0,"allocated":2572288,"data_stored":1216046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:37:05.116 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:37:05.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- 172.21.15.64:0/3167196190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec06cdf0 msgr2=0x7f0bec06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3167196190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec06cdf0 0x7f0bec06d200 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009870 tx=0x7f0bd401c790 comp rx=0 tx=0).stop 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- 172.21.15.64:0/3167196190 shutdown_connections 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3167196190 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec0af060 0x7f0bec0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3167196190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec06cdf0 0x7f0bec06d200 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- 172.21.15.64:0/3167196190 >> 172.21.15.64:0/3167196190 conn(0x7f0bec06e890 msgr2=0x7f0bec0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- 172.21.15.64:0/3167196190 shutdown_connections 2024-09-21T07:37:05.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- 172.21.15.64:0/3167196190 wait complete. 2024-09-21T07:37:05.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 Processor -- start 2024-09-21T07:37:05.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.291+0000 7f0bf2400640 1 -- start start 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec06cdf0 0x7f0bec1f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec074dd0 0x7f0bec1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec16c120 con 0x7f0bec0af060 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec16bfa0 con 0x7f0bec074dd0 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec16c2a0 con 0x7f0bec06cdf0 2024-09-21T07:37:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44730/0 (socket says 172.21.15.64:44730) 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 -- 172.21.15.64:0/3215082068 learned_addr learned my addr 172.21.15.64:0/3215082068 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0beb400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec06cdf0 0x7f0bec1f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0be3e00640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec074dd0 0x7f0bec1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 -- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec06cdf0 msgr2=0x7f0bec1f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec06cdf0 0x7f0bec1f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 -- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec074dd0 msgr2=0x7f0bec1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec074dd0 0x7f0bec1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 -- 172.21.15.64:0/3215082068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec0c5d00 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bebe00640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f0be400eca0 tx=0x7f0be400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4003b80 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bec0c5fe0 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be4003d20 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4004280 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bec0c65a0 con 0x7f0bec0af060 2024-09-21T07:37:05.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.295+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bec06d200 con 0x7f0bec0af060 2024-09-21T07:37:05.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.299+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0be4004420 con 0x7f0bec0af060 2024-09-21T07:37:05.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.299+0000 7f0be3400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 0x7f0bc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.299+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f0be4095100 con 0x7f0bec0af060 2024-09-21T07:37:05.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.299+0000 7f0beb400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 0x7f0bc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.299+0000 7f0beb400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 0x7f0bc8075710 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc007d70 tx=0x7f0bdc007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:05.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.303+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0be405f820 con 0x7f0bec0af060 2024-09-21T07:37:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.483+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0bec157c20 con 0x7f0bc8073200 2024-09-21T07:37:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.487+0000 7f0be3400640 1 -- 172.21.15.64:0/3215082068 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252402 (secure 0 0 0) 0x7f0bdc007de0 con 0x7f0bc8073200 2024-09-21T07:37:05.489 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:05.490 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 msgr2=0x7f0bc8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 0x7f0bc8075710 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc007d70 tx=0x7f0bdc007d00 comp rx=0 tx=0).stop 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 msgr2=0x7f0bec15cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f0be400eca0 tx=0x7f0be400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 shutdown_connections 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bc8073200 0x7f0bc8075710 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bec0af060 0x7f0bec15cee0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bec074dd0 0x7f0bec1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 --2- 172.21.15.64:0/3215082068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bec06cdf0 0x7f0bec1f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 >> 172.21.15.64:0/3215082068 conn(0x7f0bec06e890 msgr2=0x7f0bec0adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 shutdown_connections 2024-09-21T07:37:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.491+0000 7f0bf2400640 1 -- 172.21.15.64:0/3215082068 wait complete. 2024-09-21T07:37:05.510 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":631,"stamp":"2024-09-21T07:37:03.657678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":484528,"kb_used_data":21288,"kb_used_omap":12,"kb_used_meta":463027,"kb_avail":754490192,"statfs":{"total":773094113280,"available":772597956608,"internally_reserved":0,"allocated":21798912,"data_stored":10913748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":474140211},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002510"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705964+0000","last_change":"2024-09-21T07:36:56.220146+0000","last_active":"2024-09-21T07:36:57.705964+0000","last_peered":"2024-09-21T07:36:57.705964+0000","last_clean":"2024-09-21T07:36:57.705964+0000","last_became_active":"2024-09-21T07:36:56.218923+0000","last_became_peered":"2024-09-21T07:36:56.218923+0000","last_unstale":"2024-09-21T07:36:57.705964+0000","last_undegraded":"2024-09-21T07:36:57.705964+0000","last_fullsized":"2024-09-21T07:36:57.705964+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:35.148291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.707038+0000","last_change":"2024-09-21T07:36:56.216256+0000","last_active":"2024-09-21T07:36:57.707038+0000","last_peered":"2024-09-21T07:36:57.707038+0000","last_clean":"2024-09-21T07:36:57.707038+0000","last_became_active":"2024-09-21T07:36:56.215921+0000","last_became_peered":"2024-09-21T07:36:56.215921+0000","last_unstale":"2024-09-21T07:36:57.707038+0000","last_undegraded":"2024-09-21T07:36:57.707038+0000","last_fullsized":"2024-09-21T07:36:57.707038+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:17.306552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208916+0000","last_change":"2024-09-21T07:36:56.219422+0000","last_active":"2024-09-21T07:36:57.208916+0000","last_peered":"2024-09-21T07:36:57.208916+0000","last_clean":"2024-09-21T07:36:57.208916+0000","last_became_active":"2024-09-21T07:36:56.219090+0000","last_became_peered":"2024-09-21T07:36:56.219090+0000","last_unstale":"2024-09-21T07:36:57.208916+0000","last_undegraded":"2024-09-21T07:36:57.208916+0000","last_fullsized":"2024-09-21T07:36:57.208916+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:07.909839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209382+0000","last_change":"2024-09-21T07:36:56.226641+0000","last_active":"2024-09-21T07:36:57.209382+0000","last_peered":"2024-09-21T07:36:57.209382+0000","last_clean":"2024-09-21T07:36:57.209382+0000","last_became_active":"2024-09-21T07:36:56.226315+0000","last_became_peered":"2024-09-21T07:36:56.226315+0000","last_unstale":"2024-09-21T07:36:57.209382+0000","last_undegraded":"2024-09-21T07:36:57.209382+0000","last_fullsized":"2024-09-21T07:36:57.209382+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:28.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705960+0000","last_change":"2024-09-21T07:36:56.226972+0000","last_active":"2024-09-21T07:36:57.705960+0000","last_peered":"2024-09-21T07:36:57.705960+0000","last_clean":"2024-09-21T07:36:57.705960+0000","last_became_active":"2024-09-21T07:36:56.226668+0000","last_became_peered":"2024-09-21T07:36:56.226668+0000","last_unstale":"2024-09-21T07:36:57.705960+0000","last_undegraded":"2024-09-21T07:36:57.705960+0000","last_fullsized":"2024-09-21T07:36:57.705960+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:18.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337085+0000","last_change":"2024-09-21T07:36:56.227380+0000","last_active":"2024-09-21T07:36:57.337085+0000","last_peered":"2024-09-21T07:36:57.337085+0000","last_clean":"2024-09-21T07:36:57.337085+0000","last_became_active":"2024-09-21T07:36:56.227054+0000","last_became_peered":"2024-09-21T07:36:56.227054+0000","last_unstale":"2024-09-21T07:36:57.337085+0000","last_undegraded":"2024-09-21T07:36:57.337085+0000","last_fullsized":"2024-09-21T07:36:57.337085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:52.133345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208497+0000","last_change":"2024-09-21T07:36:56.221582+0000","last_active":"2024-09-21T07:36:57.208497+0000","last_peered":"2024-09-21T07:36:57.208497+0000","last_clean":"2024-09-21T07:36:57.208497+0000","last_became_active":"2024-09-21T07:36:56.220949+0000","last_became_peered":"2024-09-21T07:36:56.220949+0000","last_unstale":"2024-09-21T07:36:57.208497+0000","last_undegraded":"2024-09-21T07:36:57.208497+0000","last_fullsized":"2024-09-21T07:36:57.208497+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.958126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336638+0000","last_change":"2024-09-21T07:36:56.226508+0000","last_active":"2024-09-21T07:36:57.336638+0000","last_peered":"2024-09-21T07:36:57.336638+0000","last_clean":"2024-09-21T07:36:57.336638+0000","last_became_active":"2024-09-21T07:36:56.226137+0000","last_became_peered":"2024-09-21T07:36:56.226137+0000","last_unstale":"2024-09-21T07:36:57.336638+0000","last_undegraded":"2024-09-21T07:36:57.336638+0000","last_fullsized":"2024-09-21T07:36:57.336638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:57.754951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.707005+0000","last_change":"2024-09-21T07:36:56.219507+0000","last_active":"2024-09-21T07:36:57.707005+0000","last_peered":"2024-09-21T07:36:57.707005+0000","last_clean":"2024-09-21T07:36:57.707005+0000","last_became_active":"2024-09-21T07:36:56.218848+0000","last_became_peered":"2024-09-21T07:36:56.218848+0000","last_unstale":"2024-09-21T07:36:57.707005+0000","last_undegraded":"2024-09-21T07:36:57.707005+0000","last_fullsized":"2024-09-21T07:36:57.707005+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:13.628652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208937+0000","last_change":"2024-09-21T07:36:56.217852+0000","last_active":"2024-09-21T07:36:57.208937+0000","last_peered":"2024-09-21T07:36:57.208937+0000","last_clean":"2024-09-21T07:36:57.208937+0000","last_became_active":"2024-09-21T07:36:56.217504+0000","last_became_peered":"2024-09-21T07:36:56.217504+0000","last_unstale":"2024-09-21T07:36:57.208937+0000","last_undegraded":"2024-09-21T07:36:57.208937+0000","last_fullsized":"2024-09-21T07:36:57.208937+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:12.385119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209534+0000","last_change":"2024-09-21T07:36:56.228467+0000","last_active":"2024-09-21T07:36:57.209534+0000","last_peered":"2024-09-21T07:36:57.209534+0000","last_clean":"2024-09-21T07:36:57.209534+0000","last_became_active":"2024-09-21T07:36:56.228120+0000","last_became_peered":"2024-09-21T07:36:56.228120+0000","last_unstale":"2024-09-21T07:36:57.209534+0000","last_undegraded":"2024-09-21T07:36:57.209534+0000","last_fullsized":"2024-09-21T07:36:57.209534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:48.976340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210044+0000","last_change":"2024-09-21T07:36:56.219132+0000","last_active":"2024-09-21T07:36:57.210044+0000","last_peered":"2024-09-21T07:36:57.210044+0000","last_clean":"2024-09-21T07:36:57.210044+0000","last_became_active":"2024-09-21T07:36:56.218824+0000","last_became_peered":"2024-09-21T07:36:56.218824+0000","last_unstale":"2024-09-21T07:36:57.210044+0000","last_undegraded":"2024-09-21T07:36:57.210044+0000","last_fullsized":"2024-09-21T07:36:57.210044+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:37.141989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337303+0000","last_change":"2024-09-21T07:36:56.232879+0000","last_active":"2024-09-21T07:36:57.337303+0000","last_peered":"2024-09-21T07:36:57.337303+0000","last_clean":"2024-09-21T07:36:57.337303+0000","last_became_active":"2024-09-21T07:36:56.232253+0000","last_became_peered":"2024-09-21T07:36:56.232253+0000","last_unstale":"2024-09-21T07:36:57.337303+0000","last_undegraded":"2024-09-21T07:36:57.337303+0000","last_fullsized":"2024-09-21T07:36:57.337303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:18.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208981+0000","last_change":"2024-09-21T07:36:56.203575+0000","last_active":"2024-09-21T07:36:57.208981+0000","last_peered":"2024-09-21T07:36:57.208981+0000","last_clean":"2024-09-21T07:36:57.208981+0000","last_became_active":"2024-09-21T07:36:56.203239+0000","last_became_peered":"2024-09-21T07:36:56.203239+0000","last_unstale":"2024-09-21T07:36:57.208981+0000","last_undegraded":"2024-09-21T07:36:57.208981+0000","last_fullsized":"2024-09-21T07:36:57.208981+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:05.938973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225710+0000","last_change":"2024-09-21T07:36:56.202116+0000","last_active":"2024-09-21T07:36:57.225710+0000","last_peered":"2024-09-21T07:36:57.225710+0000","last_clean":"2024-09-21T07:36:57.225710+0000","last_became_active":"2024-09-21T07:36:56.201784+0000","last_became_peered":"2024-09-21T07:36:56.201784+0000","last_unstale":"2024-09-21T07:36:57.225710+0000","last_undegraded":"2024-09-21T07:36:57.225710+0000","last_fullsized":"2024-09-21T07:36:57.225710+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:30.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336659+0000","last_change":"2024-09-21T07:36:56.220846+0000","last_active":"2024-09-21T07:36:57.336659+0000","last_peered":"2024-09-21T07:36:57.336659+0000","last_clean":"2024-09-21T07:36:57.336659+0000","last_became_active":"2024-09-21T07:36:56.218536+0000","last_became_peered":"2024-09-21T07:36:56.218536+0000","last_unstale":"2024-09-21T07:36:57.336659+0000","last_undegraded":"2024-09-21T07:36:57.336659+0000","last_fullsized":"2024-09-21T07:36:57.336659+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:48.683975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209762+0000","last_change":"2024-09-21T07:36:56.221685+0000","last_active":"2024-09-21T07:36:57.209762+0000","last_peered":"2024-09-21T07:36:57.209762+0000","last_clean":"2024-09-21T07:36:57.209762+0000","last_became_active":"2024-09-21T07:36:56.221305+0000","last_became_peered":"2024-09-21T07:36:56.221305+0000","last_unstale":"2024-09-21T07:36:57.209762+0000","last_undegraded":"2024-09-21T07:36:57.209762+0000","last_fullsized":"2024-09-21T07:36:57.209762+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:17.092807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209200+0000","last_change":"2024-09-21T07:36:56.233243+0000","last_active":"2024-09-21T07:36:57.209200+0000","last_peered":"2024-09-21T07:36:57.209200+0000","last_clean":"2024-09-21T07:36:57.209200+0000","last_became_active":"2024-09-21T07:36:56.232924+0000","last_became_peered":"2024-09-21T07:36:56.232924+0000","last_unstale":"2024-09-21T07:36:57.209200+0000","last_undegraded":"2024-09-21T07:36:57.209200+0000","last_fullsized":"2024-09-21T07:36:57.209200+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:43.263716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705768+0000","last_change":"2024-09-21T07:36:56.217839+0000","last_active":"2024-09-21T07:36:57.705768+0000","last_peered":"2024-09-21T07:36:57.705768+0000","last_clean":"2024-09-21T07:36:57.705768+0000","last_became_active":"2024-09-21T07:36:56.217407+0000","last_became_peered":"2024-09-21T07:36:56.217407+0000","last_unstale":"2024-09-21T07:36:57.705768+0000","last_undegraded":"2024-09-21T07:36:57.705768+0000","last_fullsized":"2024-09-21T07:36:57.705768+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:31.345673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337202+0000","last_change":"2024-09-21T07:36:56.230192+0000","last_active":"2024-09-21T07:36:57.337202+0000","last_peered":"2024-09-21T07:36:57.337202+0000","last_clean":"2024-09-21T07:36:57.337202+0000","last_became_active":"2024-09-21T07:36:56.229899+0000","last_became_peered":"2024-09-21T07:36:56.229899+0000","last_unstale":"2024-09-21T07:36:57.337202+0000","last_undegraded":"2024-09-21T07:36:57.337202+0000","last_fullsized":"2024-09-21T07:36:57.337202+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208621+0000","last_change":"2024-09-21T07:36:56.213896+0000","last_active":"2024-09-21T07:36:57.208621+0000","last_peered":"2024-09-21T07:36:57.208621+0000","last_clean":"2024-09-21T07:36:57.208621+0000","last_became_active":"2024-09-21T07:36:56.210922+0000","last_became_peered":"2024-09-21T07:36:56.210922+0000","last_unstale":"2024-09-21T07:36:57.208621+0000","last_undegraded":"2024-09-21T07:36:57.208621+0000","last_fullsized":"2024-09-21T07:36:57.208621+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:01.416039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225373+0000","last_change":"2024-09-21T07:36:56.216982+0000","last_active":"2024-09-21T07:36:57.225373+0000","last_peered":"2024-09-21T07:36:57.225373+0000","last_clean":"2024-09-21T07:36:57.225373+0000","last_became_active":"2024-09-21T07:36:56.216675+0000","last_became_peered":"2024-09-21T07:36:56.216675+0000","last_unstale":"2024-09-21T07:36:57.225373+0000","last_undegraded":"2024-09-21T07:36:57.225373+0000","last_fullsized":"2024-09-21T07:36:57.225373+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:23.387580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706482+0000","last_change":"2024-09-21T07:36:56.220450+0000","last_active":"2024-09-21T07:36:57.706482+0000","last_peered":"2024-09-21T07:36:57.706482+0000","last_clean":"2024-09-21T07:36:57.706482+0000","last_became_active":"2024-09-21T07:36:56.220136+0000","last_became_peered":"2024-09-21T07:36:56.220136+0000","last_unstale":"2024-09-21T07:36:57.706482+0000","last_undegraded":"2024-09-21T07:36:57.706482+0000","last_fullsized":"2024-09-21T07:36:57.706482+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:03.477700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705613+0000","last_change":"2024-09-21T07:36:56.225330+0000","last_active":"2024-09-21T07:36:57.705613+0000","last_peered":"2024-09-21T07:36:57.705613+0000","last_clean":"2024-09-21T07:36:57.705613+0000","last_became_active":"2024-09-21T07:36:56.224756+0000","last_became_peered":"2024-09-21T07:36:56.224756+0000","last_unstale":"2024-09-21T07:36:57.705613+0000","last_undegraded":"2024-09-21T07:36:57.705613+0000","last_fullsized":"2024-09-21T07:36:57.705613+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:43.038519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706089+0000","last_change":"2024-09-21T07:36:56.224291+0000","last_active":"2024-09-21T07:36:57.706089+0000","last_peered":"2024-09-21T07:36:57.706089+0000","last_clean":"2024-09-21T07:36:57.706089+0000","last_became_active":"2024-09-21T07:36:56.223882+0000","last_became_peered":"2024-09-21T07:36:56.223882+0000","last_unstale":"2024-09-21T07:36:57.706089+0000","last_undegraded":"2024-09-21T07:36:57.706089+0000","last_fullsized":"2024-09-21T07:36:57.706089+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:55.195263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209229+0000","last_change":"2024-09-21T07:36:56.214025+0000","last_active":"2024-09-21T07:36:57.209229+0000","last_peered":"2024-09-21T07:36:57.209229+0000","last_clean":"2024-09-21T07:36:57.209229+0000","last_became_active":"2024-09-21T07:36:56.211797+0000","last_became_peered":"2024-09-21T07:36:56.211797+0000","last_unstale":"2024-09-21T07:36:57.209229+0000","last_undegraded":"2024-09-21T07:36:57.209229+0000","last_fullsized":"2024-09-21T07:36:57.209229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:06.853358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209740+0000","last_change":"2024-09-21T07:36:56.231954+0000","last_active":"2024-09-21T07:36:57.209740+0000","last_peered":"2024-09-21T07:36:57.209740+0000","last_clean":"2024-09-21T07:36:57.209740+0000","last_became_active":"2024-09-21T07:36:56.231645+0000","last_became_peered":"2024-09-21T07:36:56.231645+0000","last_unstale":"2024-09-21T07:36:57.209740+0000","last_undegraded":"2024-09-21T07:36:57.209740+0000","last_fullsized":"2024-09-21T07:36:57.209740+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:31.811145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209268+0000","last_change":"2024-09-21T07:36:56.212089+0000","last_active":"2024-09-21T07:36:57.209268+0000","last_peered":"2024-09-21T07:36:57.209268+0000","last_clean":"2024-09-21T07:36:57.209268+0000","last_became_active":"2024-09-21T07:36:56.211747+0000","last_became_peered":"2024-09-21T07:36:56.211747+0000","last_unstale":"2024-09-21T07:36:57.209268+0000","last_undegraded":"2024-09-21T07:36:57.209268+0000","last_fullsized":"2024-09-21T07:36:57.209268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:28.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706984+0000","last_change":"2024-09-21T07:36:56.224194+0000","last_active":"2024-09-21T07:36:57.706984+0000","last_peered":"2024-09-21T07:36:57.706984+0000","last_clean":"2024-09-21T07:36:57.706984+0000","last_became_active":"2024-09-21T07:36:56.223128+0000","last_became_peered":"2024-09-21T07:36:56.223128+0000","last_unstale":"2024-09-21T07:36:57.706984+0000","last_undegraded":"2024-09-21T07:36:57.706984+0000","last_fullsized":"2024-09-21T07:36:57.706984+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:41.140631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337165+0000","last_change":"2024-09-21T07:36:56.215274+0000","last_active":"2024-09-21T07:36:57.337165+0000","last_peered":"2024-09-21T07:36:57.337165+0000","last_clean":"2024-09-21T07:36:57.337165+0000","last_became_active":"2024-09-21T07:36:56.214442+0000","last_became_peered":"2024-09-21T07:36:56.214442+0000","last_unstale":"2024-09-21T07:36:57.337165+0000","last_undegraded":"2024-09-21T07:36:57.337165+0000","last_fullsized":"2024-09-21T07:36:57.337165+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:14.011653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706729+0000","last_change":"2024-09-21T07:36:56.221559+0000","last_active":"2024-09-21T07:36:57.706729+0000","last_peered":"2024-09-21T07:36:57.706729+0000","last_clean":"2024-09-21T07:36:57.706729+0000","last_became_active":"2024-09-21T07:36:56.221199+0000","last_became_peered":"2024-09-21T07:36:56.221199+0000","last_unstale":"2024-09-21T07:36:57.706729+0000","last_undegraded":"2024-09-21T07:36:57.706729+0000","last_fullsized":"2024-09-21T07:36:57.706729+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:59.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337225+0000","last_change":"2024-09-21T07:36:56.213521+0000","last_active":"2024-09-21T07:36:57.337225+0000","last_peered":"2024-09-21T07:36:57.337225+0000","last_clean":"2024-09-21T07:36:57.337225+0000","last_became_active":"2024-09-21T07:36:56.213022+0000","last_became_peered":"2024-09-21T07:36:56.213022+0000","last_unstale":"2024-09-21T07:36:57.337225+0000","last_undegraded":"2024-09-21T07:36:57.337225+0000","last_fullsized":"2024-09-21T07:36:57.337225+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:35.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208858+0000","last_change":"2024-09-21T07:36:56.223434+0000","last_active":"2024-09-21T07:36:57.208858+0000","last_peered":"2024-09-21T07:36:57.208858+0000","last_clean":"2024-09-21T07:36:57.208858+0000","last_became_active":"2024-09-21T07:36:56.223084+0000","last_became_peered":"2024-09-21T07:36:56.223084+0000","last_unstale":"2024-09-21T07:36:57.208858+0000","last_undegraded":"2024-09-21T07:36:57.208858+0000","last_fullsized":"2024-09-21T07:36:57.208858+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:54.190672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":19,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.707129+0000","last_change":"2024-09-21T07:36:55.208936+0000","last_active":"2024-09-21T07:36:57.707129+0000","last_peered":"2024-09-21T07:36:57.707129+0000","last_clean":"2024-09-21T07:36:57.707129+0000","last_became_active":"2024-09-21T07:36:55.208637+0000","last_became_peered":"2024-09-21T07:36:55.208637+0000","last_unstale":"2024-09-21T07:36:57.707129+0000","last_undegraded":"2024-09-21T07:36:57.707129+0000","last_fullsized":"2024-09-21T07:36:57.707129+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:44.237771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208946+0000","last_change":"2024-09-21T07:36:56.204460+0000","last_active":"2024-09-21T07:36:57.208946+0000","last_peered":"2024-09-21T07:36:57.208946+0000","last_clean":"2024-09-21T07:36:57.208946+0000","last_became_active":"2024-09-21T07:36:56.203999+0000","last_became_peered":"2024-09-21T07:36:56.203999+0000","last_unstale":"2024-09-21T07:36:57.208946+0000","last_undegraded":"2024-09-21T07:36:57.208946+0000","last_fullsized":"2024-09-21T07:36:57.208946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:13.987823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209586+0000","last_change":"2024-09-21T07:36:55.208486+0000","last_active":"2024-09-21T07:36:57.209586+0000","last_peered":"2024-09-21T07:36:57.209586+0000","last_clean":"2024-09-21T07:36:57.209586+0000","last_became_active":"2024-09-21T07:36:55.207826+0000","last_became_peered":"2024-09-21T07:36:55.207826+0000","last_unstale":"2024-09-21T07:36:57.209586+0000","last_undegraded":"2024-09-21T07:36:57.209586+0000","last_fullsized":"2024-09-21T07:36:57.209586+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:55.679055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209488+0000","last_change":"2024-09-21T07:36:56.222112+0000","last_active":"2024-09-21T07:36:57.209488+0000","last_peered":"2024-09-21T07:36:57.209488+0000","last_clean":"2024-09-21T07:36:57.209488+0000","last_became_active":"2024-09-21T07:36:56.221751+0000","last_became_peered":"2024-09-21T07:36:56.221751+0000","last_unstale":"2024-09-21T07:36:57.209488+0000","last_undegraded":"2024-09-21T07:36:57.209488+0000","last_fullsized":"2024-09-21T07:36:57.209488+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:50.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337205+0000","last_change":"2024-09-21T07:36:55.201067+0000","last_active":"2024-09-21T07:36:57.337205+0000","last_peered":"2024-09-21T07:36:57.337205+0000","last_clean":"2024-09-21T07:36:57.337205+0000","last_became_active":"2024-09-21T07:36:55.200701+0000","last_became_peered":"2024-09-21T07:36:55.200701+0000","last_unstale":"2024-09-21T07:36:57.337205+0000","last_undegraded":"2024-09-21T07:36:57.337205+0000","last_fullsized":"2024-09-21T07:36:57.337205+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:12.736774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208375+0000","last_change":"2024-09-21T07:36:56.217769+0000","last_active":"2024-09-21T07:36:57.208375+0000","last_peered":"2024-09-21T07:36:57.208375+0000","last_clean":"2024-09-21T07:36:57.208375+0000","last_became_active":"2024-09-21T07:36:56.217454+0000","last_became_peered":"2024-09-21T07:36:56.217454+0000","last_unstale":"2024-09-21T07:36:57.208375+0000","last_undegraded":"2024-09-21T07:36:57.208375+0000","last_fullsized":"2024-09-21T07:36:57.208375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225551+0000","last_change":"2024-09-21T07:36:55.205908+0000","last_active":"2024-09-21T07:36:57.225551+0000","last_peered":"2024-09-21T07:36:57.225551+0000","last_clean":"2024-09-21T07:36:57.225551+0000","last_became_active":"2024-09-21T07:36:55.205436+0000","last_became_peered":"2024-09-21T07:36:55.205436+0000","last_unstale":"2024-09-21T07:36:57.225551+0000","last_undegraded":"2024-09-21T07:36:57.225551+0000","last_fullsized":"2024-09-21T07:36:57.225551+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:56.199982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208667+0000","last_change":"2024-09-21T07:36:56.214216+0000","last_active":"2024-09-21T07:36:57.208667+0000","last_peered":"2024-09-21T07:36:57.208667+0000","last_clean":"2024-09-21T07:36:57.208667+0000","last_became_active":"2024-09-21T07:36:56.213795+0000","last_became_peered":"2024-09-21T07:36:56.213795+0000","last_unstale":"2024-09-21T07:36:57.208667+0000","last_undegraded":"2024-09-21T07:36:57.208667+0000","last_fullsized":"2024-09-21T07:36:57.208667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:27.786546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705841+0000","last_change":"2024-09-21T07:36:55.208547+0000","last_active":"2024-09-21T07:36:57.705841+0000","last_peered":"2024-09-21T07:36:57.705841+0000","last_clean":"2024-09-21T07:36:57.705841+0000","last_became_active":"2024-09-21T07:36:55.208213+0000","last_became_peered":"2024-09-21T07:36:55.208213+0000","last_unstale":"2024-09-21T07:36:57.705841+0000","last_undegraded":"2024-09-21T07:36:57.705841+0000","last_fullsized":"2024-09-21T07:36:57.705841+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:16.287683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225477+0000","last_change":"2024-09-21T07:36:56.221370+0000","last_active":"2024-09-21T07:36:57.225477+0000","last_peered":"2024-09-21T07:36:57.225477+0000","last_clean":"2024-09-21T07:36:57.225477+0000","last_became_active":"2024-09-21T07:36:56.221018+0000","last_became_peered":"2024-09-21T07:36:56.221018+0000","last_unstale":"2024-09-21T07:36:57.225477+0000","last_undegraded":"2024-09-21T07:36:57.225477+0000","last_fullsized":"2024-09-21T07:36:57.225477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:47.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208803+0000","last_change":"2024-09-21T07:36:55.202201+0000","last_active":"2024-09-21T07:36:57.208803+0000","last_peered":"2024-09-21T07:36:57.208803+0000","last_clean":"2024-09-21T07:36:57.208803+0000","last_became_active":"2024-09-21T07:36:55.201905+0000","last_became_peered":"2024-09-21T07:36:55.201905+0000","last_unstale":"2024-09-21T07:36:57.208803+0000","last_undegraded":"2024-09-21T07:36:57.208803+0000","last_fullsized":"2024-09-21T07:36:57.208803+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:16.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706527+0000","last_change":"2024-09-21T07:36:56.227247+0000","last_active":"2024-09-21T07:36:57.706527+0000","last_peered":"2024-09-21T07:36:57.706527+0000","last_clean":"2024-09-21T07:36:57.706527+0000","last_became_active":"2024-09-21T07:36:56.226637+0000","last_became_peered":"2024-09-21T07:36:56.226637+0000","last_unstale":"2024-09-21T07:36:57.706527+0000","last_undegraded":"2024-09-21T07:36:57.706527+0000","last_fullsized":"2024-09-21T07:36:57.706527+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:30.287467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208575+0000","last_change":"2024-09-21T07:36:55.204178+0000","last_active":"2024-09-21T07:36:57.208575+0000","last_peered":"2024-09-21T07:36:57.208575+0000","last_clean":"2024-09-21T07:36:57.208575+0000","last_became_active":"2024-09-21T07:36:55.199695+0000","last_became_peered":"2024-09-21T07:36:55.199695+0000","last_unstale":"2024-09-21T07:36:57.208575+0000","last_undegraded":"2024-09-21T07:36:57.208575+0000","last_fullsized":"2024-09-21T07:36:57.208575+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:36.499430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225888+0000","last_change":"2024-09-21T07:36:56.228149+0000","last_active":"2024-09-21T07:36:57.225888+0000","last_peered":"2024-09-21T07:36:57.225888+0000","last_clean":"2024-09-21T07:36:57.225888+0000","last_became_active":"2024-09-21T07:36:56.227785+0000","last_became_peered":"2024-09-21T07:36:56.227785+0000","last_unstale":"2024-09-21T07:36:57.225888+0000","last_undegraded":"2024-09-21T07:36:57.225888+0000","last_fullsized":"2024-09-21T07:36:57.225888+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:25:44.487949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706272+0000","last_change":"2024-09-21T07:36:55.207507+0000","last_active":"2024-09-21T07:36:57.706272+0000","last_peered":"2024-09-21T07:36:57.706272+0000","last_clean":"2024-09-21T07:36:57.706272+0000","last_became_active":"2024-09-21T07:36:55.207028+0000","last_became_peered":"2024-09-21T07:36:55.207028+0000","last_unstale":"2024-09-21T07:36:57.706272+0000","last_undegraded":"2024-09-21T07:36:57.706272+0000","last_fullsized":"2024-09-21T07:36:57.706272+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:14.332670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225784+0000","last_change":"2024-09-21T07:36:56.211579+0000","last_active":"2024-09-21T07:36:57.225784+0000","last_peered":"2024-09-21T07:36:57.225784+0000","last_clean":"2024-09-21T07:36:57.225784+0000","last_became_active":"2024-09-21T07:36:56.211261+0000","last_became_peered":"2024-09-21T07:36:56.211261+0000","last_unstale":"2024-09-21T07:36:57.225784+0000","last_undegraded":"2024-09-21T07:36:57.225784+0000","last_fullsized":"2024-09-21T07:36:57.225784+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:04.216771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209913+0000","last_change":"2024-09-21T07:36:55.200523+0000","last_active":"2024-09-21T07:36:57.209913+0000","last_peered":"2024-09-21T07:36:57.209913+0000","last_clean":"2024-09-21T07:36:57.209913+0000","last_became_active":"2024-09-21T07:36:55.200171+0000","last_became_peered":"2024-09-21T07:36:55.200171+0000","last_unstale":"2024-09-21T07:36:57.209913+0000","last_undegraded":"2024-09-21T07:36:57.209913+0000","last_fullsized":"2024-09-21T07:36:57.209913+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:29.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209448+0000","last_change":"2024-09-21T07:36:56.212107+0000","last_active":"2024-09-21T07:36:57.209448+0000","last_peered":"2024-09-21T07:36:57.209448+0000","last_clean":"2024-09-21T07:36:57.209448+0000","last_became_active":"2024-09-21T07:36:56.211010+0000","last_became_peered":"2024-09-21T07:36:56.211010+0000","last_unstale":"2024-09-21T07:36:57.209448+0000","last_undegraded":"2024-09-21T07:36:57.209448+0000","last_fullsized":"2024-09-21T07:36:57.209448+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.055682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":18,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706296+0000","last_change":"2024-09-21T07:36:55.208006+0000","last_active":"2024-09-21T07:36:57.706296+0000","last_peered":"2024-09-21T07:36:57.706296+0000","last_clean":"2024-09-21T07:36:57.706296+0000","last_became_active":"2024-09-21T07:36:55.207715+0000","last_became_peered":"2024-09-21T07:36:55.207715+0000","last_unstale":"2024-09-21T07:36:57.706296+0000","last_undegraded":"2024-09-21T07:36:57.706296+0000","last_fullsized":"2024-09-21T07:36:57.706296+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:15.980896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210132+0000","last_change":"2024-09-21T07:36:56.223296+0000","last_active":"2024-09-21T07:36:57.210132+0000","last_peered":"2024-09-21T07:36:57.210132+0000","last_clean":"2024-09-21T07:36:57.210132+0000","last_became_active":"2024-09-21T07:36:56.222802+0000","last_became_peered":"2024-09-21T07:36:56.222802+0000","last_unstale":"2024-09-21T07:36:57.210132+0000","last_undegraded":"2024-09-21T07:36:57.210132+0000","last_fullsized":"2024-09-21T07:36:57.210132+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:20.625782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":21,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337124+0000","last_change":"2024-09-21T07:36:55.195328+0000","last_active":"2024-09-21T07:36:57.337124+0000","last_peered":"2024-09-21T07:36:57.337124+0000","last_clean":"2024-09-21T07:36:57.337124+0000","last_became_active":"2024-09-21T07:36:55.194804+0000","last_became_peered":"2024-09-21T07:36:55.194804+0000","last_unstale":"2024-09-21T07:36:57.337124+0000","last_undegraded":"2024-09-21T07:36:57.337124+0000","last_fullsized":"2024-09-21T07:36:57.337124+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:18.921474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706300+0000","last_change":"2024-09-21T07:36:56.228831+0000","last_active":"2024-09-21T07:36:57.706300+0000","last_peered":"2024-09-21T07:36:57.706300+0000","last_clean":"2024-09-21T07:36:57.706300+0000","last_became_active":"2024-09-21T07:36:56.228056+0000","last_became_peered":"2024-09-21T07:36:56.228056+0000","last_unstale":"2024-09-21T07:36:57.706300+0000","last_undegraded":"2024-09-21T07:36:57.706300+0000","last_fullsized":"2024-09-21T07:36:57.706300+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:41.657536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209152+0000","last_change":"2024-09-21T07:36:55.200997+0000","last_active":"2024-09-21T07:36:57.209152+0000","last_peered":"2024-09-21T07:36:57.209152+0000","last_clean":"2024-09-21T07:36:57.209152+0000","last_became_active":"2024-09-21T07:36:55.200396+0000","last_became_peered":"2024-09-21T07:36:55.200396+0000","last_unstale":"2024-09-21T07:36:57.209152+0000","last_undegraded":"2024-09-21T07:36:57.209152+0000","last_fullsized":"2024-09-21T07:36:57.209152+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:19.618528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208835+0000","last_change":"2024-09-21T07:36:56.219624+0000","last_active":"2024-09-21T07:36:57.208835+0000","last_peered":"2024-09-21T07:36:57.208835+0000","last_clean":"2024-09-21T07:36:57.208835+0000","last_became_active":"2024-09-21T07:36:56.216161+0000","last_became_peered":"2024-09-21T07:36:56.216161+0000","last_unstale":"2024-09-21T07:36:57.208835+0000","last_undegraded":"2024-09-21T07:36:57.208835+0000","last_fullsized":"2024-09-21T07:36:57.208835+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:36.243592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706984+0000","last_change":"2024-09-21T07:36:55.198647+0000","last_active":"2024-09-21T07:36:57.706984+0000","last_peered":"2024-09-21T07:36:57.706984+0000","last_clean":"2024-09-21T07:36:57.706984+0000","last_became_active":"2024-09-21T07:36:55.198253+0000","last_became_peered":"2024-09-21T07:36:55.198253+0000","last_unstale":"2024-09-21T07:36:57.706984+0000","last_undegraded":"2024-09-21T07:36:57.706984+0000","last_fullsized":"2024-09-21T07:36:57.706984+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:21.793379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208620+0000","last_change":"2024-09-21T07:36:56.224388+0000","last_active":"2024-09-21T07:36:57.208620+0000","last_peered":"2024-09-21T07:36:57.208620+0000","last_clean":"2024-09-21T07:36:57.208620+0000","last_became_active":"2024-09-21T07:36:56.224101+0000","last_became_peered":"2024-09-21T07:36:56.224101+0000","last_unstale":"2024-09-21T07:36:57.208620+0000","last_undegraded":"2024-09-21T07:36:57.208620+0000","last_fullsized":"2024-09-21T07:36:57.208620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:55.944456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.336481+0000","last_change":"2024-09-21T07:36:55.194123+0000","last_active":"2024-09-21T07:36:57.336481+0000","last_peered":"2024-09-21T07:36:57.336481+0000","last_clean":"2024-09-21T07:36:57.336481+0000","last_became_active":"2024-09-21T07:36:55.193443+0000","last_became_peered":"2024-09-21T07:36:55.193443+0000","last_unstale":"2024-09-21T07:36:57.336481+0000","last_undegraded":"2024-09-21T07:36:57.336481+0000","last_fullsized":"2024-09-21T07:36:57.336481+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:58.513398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.226004+0000","last_change":"2024-09-21T07:36:56.211258+0000","last_active":"2024-09-21T07:36:57.226004+0000","last_peered":"2024-09-21T07:36:57.226004+0000","last_clean":"2024-09-21T07:36:57.226004+0000","last_became_active":"2024-09-21T07:36:56.210949+0000","last_became_peered":"2024-09-21T07:36:56.210949+0000","last_unstale":"2024-09-21T07:36:57.226004+0000","last_undegraded":"2024-09-21T07:36:57.226004+0000","last_fullsized":"2024-09-21T07:36:57.226004+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:08.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":23,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208224+0000","last_change":"2024-09-21T07:36:55.195611+0000","last_active":"2024-09-21T07:36:57.208224+0000","last_peered":"2024-09-21T07:36:57.208224+0000","last_clean":"2024-09-21T07:36:57.208224+0000","last_became_active":"2024-09-21T07:36:55.195346+0000","last_became_peered":"2024-09-21T07:36:55.195346+0000","last_unstale":"2024-09-21T07:36:57.208224+0000","last_undegraded":"2024-09-21T07:36:57.208224+0000","last_fullsized":"2024-09-21T07:36:57.208224+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:47.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706426+0000","last_change":"2024-09-21T07:36:56.219414+0000","last_active":"2024-09-21T07:36:57.706426+0000","last_peered":"2024-09-21T07:36:57.706426+0000","last_clean":"2024-09-21T07:36:57.706426+0000","last_became_active":"2024-09-21T07:36:56.214646+0000","last_became_peered":"2024-09-21T07:36:56.214646+0000","last_unstale":"2024-09-21T07:36:57.706426+0000","last_undegraded":"2024-09-21T07:36:57.706426+0000","last_fullsized":"2024-09-21T07:36:57.706426+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:34.772075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209434+0000","last_change":"2024-09-21T07:36:55.199617+0000","last_active":"2024-09-21T07:36:57.209434+0000","last_peered":"2024-09-21T07:36:57.209434+0000","last_clean":"2024-09-21T07:36:57.209434+0000","last_became_active":"2024-09-21T07:36:55.199251+0000","last_became_peered":"2024-09-21T07:36:55.199251+0000","last_unstale":"2024-09-21T07:36:57.209434+0000","last_undegraded":"2024-09-21T07:36:57.209434+0000","last_fullsized":"2024-09-21T07:36:57.209434+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:11.244071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706057+0000","last_change":"2024-09-21T07:36:56.229275+0000","last_active":"2024-09-21T07:36:57.706057+0000","last_peered":"2024-09-21T07:36:57.706057+0000","last_clean":"2024-09-21T07:36:57.706057+0000","last_became_active":"2024-09-21T07:36:56.228759+0000","last_became_peered":"2024-09-21T07:36:56.228759+0000","last_unstale":"2024-09-21T07:36:57.706057+0000","last_undegraded":"2024-09-21T07:36:57.706057+0000","last_fullsized":"2024-09-21T07:36:57.706057+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:36.669920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706727+0000","last_change":"2024-09-21T07:36:55.206279+0000","last_active":"2024-09-21T07:36:57.706727+0000","last_peered":"2024-09-21T07:36:57.706727+0000","last_clean":"2024-09-21T07:36:57.706727+0000","last_became_active":"2024-09-21T07:36:55.205963+0000","last_became_peered":"2024-09-21T07:36:55.205963+0000","last_unstale":"2024-09-21T07:36:57.706727+0000","last_undegraded":"2024-09-21T07:36:57.706727+0000","last_fullsized":"2024-09-21T07:36:57.706727+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.429416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209444+0000","last_change":"2024-09-21T07:36:56.212459+0000","last_active":"2024-09-21T07:36:57.209444+0000","last_peered":"2024-09-21T07:36:57.209444+0000","last_clean":"2024-09-21T07:36:57.209444+0000","last_became_active":"2024-09-21T07:36:56.211395+0000","last_became_peered":"2024-09-21T07:36:56.211395+0000","last_unstale":"2024-09-21T07:36:57.209444+0000","last_undegraded":"2024-09-21T07:36:57.209444+0000","last_fullsized":"2024-09-21T07:36:57.209444+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:18.816832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209810+0000","last_change":"2024-09-21T07:36:55.195028+0000","last_active":"2024-09-21T07:36:57.209810+0000","last_peered":"2024-09-21T07:36:57.209810+0000","last_clean":"2024-09-21T07:36:57.209810+0000","last_became_active":"2024-09-21T07:36:55.194670+0000","last_became_peered":"2024-09-21T07:36:55.194670+0000","last_unstale":"2024-09-21T07:36:57.209810+0000","last_undegraded":"2024-09-21T07:36:57.209810+0000","last_fullsized":"2024-09-21T07:36:57.209810+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:05.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210062+0000","last_change":"2024-09-21T07:36:56.218458+0000","last_active":"2024-09-21T07:36:57.210062+0000","last_peered":"2024-09-21T07:36:57.210062+0000","last_clean":"2024-09-21T07:36:57.210062+0000","last_became_active":"2024-09-21T07:36:56.216457+0000","last_became_peered":"2024-09-21T07:36:56.216457+0000","last_unstale":"2024-09-21T07:36:57.210062+0000","last_undegraded":"2024-09-21T07:36:57.210062+0000","last_fullsized":"2024-09-21T07:36:57.210062+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:52.209400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209427+0000","last_change":"2024-09-21T07:36:55.195031+0000","last_active":"2024-09-21T07:36:57.209427+0000","last_peered":"2024-09-21T07:36:57.209427+0000","last_clean":"2024-09-21T07:36:57.209427+0000","last_became_active":"2024-09-21T07:36:55.194562+0000","last_became_peered":"2024-09-21T07:36:55.194562+0000","last_unstale":"2024-09-21T07:36:57.209427+0000","last_undegraded":"2024-09-21T07:36:57.209427+0000","last_fullsized":"2024-09-21T07:36:57.209427+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:13.287440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208070+0000","last_change":"2024-09-21T07:36:56.217928+0000","last_active":"2024-09-21T07:36:57.208070+0000","last_peered":"2024-09-21T07:36:57.208070+0000","last_clean":"2024-09-21T07:36:57.208070+0000","last_became_active":"2024-09-21T07:36:56.217476+0000","last_became_peered":"2024-09-21T07:36:56.217476+0000","last_unstale":"2024-09-21T07:36:57.208070+0000","last_undegraded":"2024-09-21T07:36:57.208070+0000","last_fullsized":"2024-09-21T07:36:57.208070+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:39.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209270+0000","last_change":"2024-09-21T07:36:55.207808+0000","last_active":"2024-09-21T07:36:57.209270+0000","last_peered":"2024-09-21T07:36:57.209270+0000","last_clean":"2024-09-21T07:36:57.209270+0000","last_became_active":"2024-09-21T07:36:55.207491+0000","last_became_peered":"2024-09-21T07:36:55.207491+0000","last_unstale":"2024-09-21T07:36:57.209270+0000","last_undegraded":"2024-09-21T07:36:57.209270+0000","last_fullsized":"2024-09-21T07:36:57.209270+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:35.464049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705675+0000","last_change":"2024-09-21T07:36:56.217953+0000","last_active":"2024-09-21T07:36:57.705675+0000","last_peered":"2024-09-21T07:36:57.705675+0000","last_clean":"2024-09-21T07:36:57.705675+0000","last_became_active":"2024-09-21T07:36:56.217601+0000","last_became_peered":"2024-09-21T07:36:56.217601+0000","last_unstale":"2024-09-21T07:36:57.705675+0000","last_undegraded":"2024-09-21T07:36:57.705675+0000","last_fullsized":"2024-09-21T07:36:57.705675+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:04.034433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225528+0000","last_change":"2024-09-21T07:36:55.204439+0000","last_active":"2024-09-21T07:36:57.225528+0000","last_peered":"2024-09-21T07:36:57.225528+0000","last_clean":"2024-09-21T07:36:57.225528+0000","last_became_active":"2024-09-21T07:36:55.203956+0000","last_became_peered":"2024-09-21T07:36:55.203956+0000","last_unstale":"2024-09-21T07:36:57.225528+0000","last_undegraded":"2024-09-21T07:36:57.225528+0000","last_fullsized":"2024-09-21T07:36:57.225528+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:34.118668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706776+0000","last_change":"2024-09-21T07:36:56.215366+0000","last_active":"2024-09-21T07:36:57.706776+0000","last_peered":"2024-09-21T07:36:57.706776+0000","last_clean":"2024-09-21T07:36:57.706776+0000","last_became_active":"2024-09-21T07:36:56.214875+0000","last_became_peered":"2024-09-21T07:36:56.214875+0000","last_unstale":"2024-09-21T07:36:57.706776+0000","last_undegraded":"2024-09-21T07:36:57.706776+0000","last_fullsized":"2024-09-21T07:36:57.706776+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:38.239763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225393+0000","last_change":"2024-09-21T07:36:55.207655+0000","last_active":"2024-09-21T07:36:57.225393+0000","last_peered":"2024-09-21T07:36:57.225393+0000","last_clean":"2024-09-21T07:36:57.225393+0000","last_became_active":"2024-09-21T07:36:55.207342+0000","last_became_peered":"2024-09-21T07:36:55.207342+0000","last_unstale":"2024-09-21T07:36:57.225393+0000","last_undegraded":"2024-09-21T07:36:57.225393+0000","last_fullsized":"2024-09-21T07:36:57.225393+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:41.475513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208765+0000","last_change":"2024-09-21T07:36:56.208637+0000","last_active":"2024-09-21T07:36:57.208765+0000","last_peered":"2024-09-21T07:36:57.208765+0000","last_clean":"2024-09-21T07:36:57.208765+0000","last_became_active":"2024-09-21T07:36:56.208330+0000","last_became_peered":"2024-09-21T07:36:56.208330+0000","last_unstale":"2024-09-21T07:36:57.208765+0000","last_undegraded":"2024-09-21T07:36:57.208765+0000","last_fullsized":"2024-09-21T07:36:57.208765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:40.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706117+0000","last_change":"2024-09-21T07:36:55.206596+0000","last_active":"2024-09-21T07:36:57.706117+0000","last_peered":"2024-09-21T07:36:57.706117+0000","last_clean":"2024-09-21T07:36:57.706117+0000","last_became_active":"2024-09-21T07:36:55.206270+0000","last_became_peered":"2024-09-21T07:36:55.206270+0000","last_unstale":"2024-09-21T07:36:57.706117+0000","last_undegraded":"2024-09-21T07:36:57.706117+0000","last_fullsized":"2024-09-21T07:36:57.706117+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:09.900363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706657+0000","last_change":"2024-09-21T07:36:56.219605+0000","last_active":"2024-09-21T07:36:57.706657+0000","last_peered":"2024-09-21T07:36:57.706657+0000","last_clean":"2024-09-21T07:36:57.706657+0000","last_became_active":"2024-09-21T07:36:56.216745+0000","last_became_peered":"2024-09-21T07:36:56.216745+0000","last_unstale":"2024-09-21T07:36:57.706657+0000","last_undegraded":"2024-09-21T07:36:57.706657+0000","last_fullsized":"2024-09-21T07:36:57.706657+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:10.195929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209996+0000","last_change":"2024-09-21T07:36:55.201898+0000","last_active":"2024-09-21T07:36:57.209996+0000","last_peered":"2024-09-21T07:36:57.209996+0000","last_clean":"2024-09-21T07:36:57.209996+0000","last_became_active":"2024-09-21T07:36:55.201581+0000","last_became_peered":"2024-09-21T07:36:55.201581+0000","last_unstale":"2024-09-21T07:36:57.209996+0000","last_undegraded":"2024-09-21T07:36:57.209996+0000","last_fullsized":"2024-09-21T07:36:57.209996+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:27.902218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706120+0000","last_change":"2024-09-21T07:36:56.223740+0000","last_active":"2024-09-21T07:36:57.706120+0000","last_peered":"2024-09-21T07:36:57.706120+0000","last_clean":"2024-09-21T07:36:57.706120+0000","last_became_active":"2024-09-21T07:36:56.223305+0000","last_became_peered":"2024-09-21T07:36:56.223305+0000","last_unstale":"2024-09-21T07:36:57.706120+0000","last_undegraded":"2024-09-21T07:36:57.706120+0000","last_fullsized":"2024-09-21T07:36:57.706120+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:35.490235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"204'1","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.227384+0000","last_change":"2024-09-21T07:36:55.202987+0000","last_active":"2024-09-21T07:36:57.227384+0000","last_peered":"2024-09-21T07:36:57.227384+0000","last_clean":"2024-09-21T07:36:57.227384+0000","last_became_active":"2024-09-21T07:36:55.202656+0000","last_became_peered":"2024-09-21T07:36:55.202656+0000","last_unstale":"2024-09-21T07:36:57.227384+0000","last_undegraded":"2024-09-21T07:36:57.227384+0000","last_fullsized":"2024-09-21T07:36:57.227384+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:18.120081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.337229+0000","last_change":"2024-09-21T07:36:56.231483+0000","last_active":"2024-09-21T07:36:57.337229+0000","last_peered":"2024-09-21T07:36:57.337229+0000","last_clean":"2024-09-21T07:36:57.337229+0000","last_became_active":"2024-09-21T07:36:56.231174+0000","last_became_peered":"2024-09-21T07:36:56.231174+0000","last_unstale":"2024-09-21T07:36:57.337229+0000","last_undegraded":"2024-09-21T07:36:57.337229+0000","last_fullsized":"2024-09-21T07:36:57.337229+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:23.639764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.225789+0000","last_change":"2024-09-21T07:36:55.201998+0000","last_active":"2024-09-21T07:36:57.225789+0000","last_peered":"2024-09-21T07:36:57.225789+0000","last_clean":"2024-09-21T07:36:57.225789+0000","last_became_active":"2024-09-21T07:36:55.201662+0000","last_became_peered":"2024-09-21T07:36:55.201662+0000","last_unstale":"2024-09-21T07:36:57.225789+0000","last_undegraded":"2024-09-21T07:36:57.225789+0000","last_fullsized":"2024-09-21T07:36:57.225789+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:35.647330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706948+0000","last_change":"2024-09-21T07:36:56.219161+0000","last_active":"2024-09-21T07:36:57.706948+0000","last_peered":"2024-09-21T07:36:57.706948+0000","last_clean":"2024-09-21T07:36:57.706948+0000","last_became_active":"2024-09-21T07:36:56.218372+0000","last_became_peered":"2024-09-21T07:36:56.218372+0000","last_unstale":"2024-09-21T07:36:57.706948+0000","last_undegraded":"2024-09-21T07:36:57.706948+0000","last_fullsized":"2024-09-21T07:36:57.706948+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:13.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.210308+0000","last_change":"2024-09-21T07:36:55.206649+0000","last_active":"2024-09-21T07:36:57.210308+0000","last_peered":"2024-09-21T07:36:57.210308+0000","last_clean":"2024-09-21T07:36:57.210308+0000","last_became_active":"2024-09-21T07:36:55.206341+0000","last_became_peered":"2024-09-21T07:36:55.206341+0000","last_unstale":"2024-09-21T07:36:57.210308+0000","last_undegraded":"2024-09-21T07:36:57.210308+0000","last_fullsized":"2024-09-21T07:36:57.210308+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:43.715074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208381+0000","last_change":"2024-09-21T07:36:56.209605+0000","last_active":"2024-09-21T07:36:57.208381+0000","last_peered":"2024-09-21T07:36:57.208381+0000","last_clean":"2024-09-21T07:36:57.208381+0000","last_became_active":"2024-09-21T07:36:56.209298+0000","last_became_peered":"2024-09-21T07:36:56.209298+0000","last_unstale":"2024-09-21T07:36:57.208381+0000","last_undegraded":"2024-09-21T07:36:57.208381+0000","last_fullsized":"2024-09-21T07:36:57.208381+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:06.549305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209612+0000","last_change":"2024-09-21T07:36:55.200687+0000","last_active":"2024-09-21T07:36:57.209612+0000","last_peered":"2024-09-21T07:36:57.209612+0000","last_clean":"2024-09-21T07:36:57.209612+0000","last_became_active":"2024-09-21T07:36:55.200028+0000","last_became_peered":"2024-09-21T07:36:55.200028+0000","last_unstale":"2024-09-21T07:36:57.209612+0000","last_undegraded":"2024-09-21T07:36:57.209612+0000","last_fullsized":"2024-09-21T07:36:57.209612+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:10.111404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208413+0000","last_change":"2024-09-21T07:36:56.221260+0000","last_active":"2024-09-21T07:36:57.208413+0000","last_peered":"2024-09-21T07:36:57.208413+0000","last_clean":"2024-09-21T07:36:57.208413+0000","last_became_active":"2024-09-21T07:36:56.220493+0000","last_became_peered":"2024-09-21T07:36:56.220493+0000","last_unstale":"2024-09-21T07:36:57.208413+0000","last_undegraded":"2024-09-21T07:36:57.208413+0000","last_fullsized":"2024-09-21T07:36:57.208413+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:01.010095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209172+0000","last_change":"2024-09-21T07:36:55.198983+0000","last_active":"2024-09-21T07:36:57.209172+0000","last_peered":"2024-09-21T07:36:57.209172+0000","last_clean":"2024-09-21T07:36:57.209172+0000","last_became_active":"2024-09-21T07:36:55.198513+0000","last_became_peered":"2024-09-21T07:36:55.198513+0000","last_unstale":"2024-09-21T07:36:57.209172+0000","last_undegraded":"2024-09-21T07:36:57.209172+0000","last_fullsized":"2024-09-21T07:36:57.209172+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:40.003553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.706441+0000","last_change":"2024-09-21T07:36:56.225875+0000","last_active":"2024-09-21T07:36:57.706441+0000","last_peered":"2024-09-21T07:36:57.706441+0000","last_clean":"2024-09-21T07:36:57.706441+0000","last_became_active":"2024-09-21T07:36:56.225520+0000","last_became_peered":"2024-09-21T07:36:56.225520+0000","last_unstale":"2024-09-21T07:36:57.706441+0000","last_undegraded":"2024-09-21T07:36:57.706441+0000","last_fullsized":"2024-09-21T07:36:57.706441+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:26.108429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705677+0000","last_change":"2024-09-21T07:36:55.211026+0000","last_active":"2024-09-21T07:36:57.705677+0000","last_peered":"2024-09-21T07:36:57.705677+0000","last_clean":"2024-09-21T07:36:57.705677+0000","last_became_active":"2024-09-21T07:36:55.210636+0000","last_became_peered":"2024-09-21T07:36:55.210636+0000","last_unstale":"2024-09-21T07:36:57.705677+0000","last_undegraded":"2024-09-21T07:36:57.705677+0000","last_fullsized":"2024-09-21T07:36:57.705677+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:08.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209029+0000","last_change":"2024-09-21T07:36:56.222090+0000","last_active":"2024-09-21T07:36:57.209029+0000","last_peered":"2024-09-21T07:36:57.209029+0000","last_clean":"2024-09-21T07:36:57.209029+0000","last_became_active":"2024-09-21T07:36:56.221728+0000","last_became_peered":"2024-09-21T07:36:56.221728+0000","last_unstale":"2024-09-21T07:36:57.209029+0000","last_undegraded":"2024-09-21T07:36:57.209029+0000","last_fullsized":"2024-09-21T07:36:57.209029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:30.692530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.208405+0000","last_change":"2024-09-21T07:36:55.194087+0000","last_active":"2024-09-21T07:36:57.208405+0000","last_peered":"2024-09-21T07:36:57.208405+0000","last_clean":"2024-09-21T07:36:57.208405+0000","last_became_active":"2024-09-21T07:36:55.193807+0000","last_became_peered":"2024-09-21T07:36:55.193807+0000","last_unstale":"2024-09-21T07:36:57.208405+0000","last_undegraded":"2024-09-21T07:36:57.208405+0000","last_fullsized":"2024-09-21T07:36:57.208405+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:30.803891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.209351+0000","last_change":"2024-09-21T07:36:56.205336+0000","last_active":"2024-09-21T07:36:57.209351+0000","last_peered":"2024-09-21T07:36:57.209351+0000","last_clean":"2024-09-21T07:36:57.209351+0000","last_became_active":"2024-09-21T07:36:56.204976+0000","last_became_peered":"2024-09-21T07:36:56.204976+0000","last_unstale":"2024-09-21T07:36:57.209351+0000","last_undegraded":"2024-09-21T07:36:57.209351+0000","last_fullsized":"2024-09-21T07:36:57.209351+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:55.176003+0000","last_clean_scrub_stamp":"2024-09-21T07:36:55.176003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:07.488160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":17,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705742+0000","last_change":"2024-09-21T07:36:55.207312+0000","last_active":"2024-09-21T07:36:57.705742+0000","last_peered":"2024-09-21T07:36:57.705742+0000","last_clean":"2024-09-21T07:36:57.705742+0000","last_became_active":"2024-09-21T07:36:55.206468+0000","last_became_peered":"2024-09-21T07:36:55.206468+0000","last_unstale":"2024-09-21T07:36:57.705742+0000","last_undegraded":"2024-09-21T07:36:57.705742+0000","last_fullsized":"2024-09-21T07:36:57.705742+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:36:54.168748+0000","last_clean_scrub_stamp":"2024-09-21T07:36:54.168748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.912021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":446,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-21T07:36:57.705652+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:36:57.705652+0000","last_peered":"2024-09-21T07:36:57.705652+0000","last_clean":"2024-09-21T07:36:57.705652+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:36:57.705652+0000","last_undegraded":"2024-09-21T07:36:57.705652+0000","last_fullsized":"2024-09-21T07:36:57.705652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509617,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55936,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315904,"statfs":{"total":96636764160,"available":96579485696,"internally_reserved":0,"allocated":2592768,"data_stored":1217762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55928,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315912,"statfs":{"total":96636764160,"available":96579493888,"internally_reserved":0,"allocated":2584576,"data_stored":1217706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509617,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47596,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324244,"statfs":{"total":96636764160,"available":96588025856,"internally_reserved":0,"allocated":2572288,"data_stored":1216114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509617,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60072,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311768,"statfs":{"total":96636764160,"available":96575250432,"internally_reserved":0,"allocated":2576384,"data_stored":1216640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509616,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64228,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307612,"statfs":{"total":96636764160,"available":96570994688,"internally_reserved":0,"allocated":2568192,"data_stored":1216024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509617,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":3088,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":3162112,"data_stored":1806392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542321,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56496,"kb_used_data":3096,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315344,"statfs":{"total":96636764160,"available":96578912256,"internally_reserved":0,"allocated":3170304,"data_stored":1807064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87784,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94284056,"statfs":{"total":96636764160,"available":96546873344,"internally_reserved":0,"allocated":2572288,"data_stored":1216046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:37:05.513 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:37:05.514 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:37:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- 172.21.15.64:0/2027749852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f415b2d0 msgr2=0x7f08f415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 --2- 172.21.15.64:0/2027749852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f415b2d0 0x7f08f415b6e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009bc0 tx=0x7f08f001cba0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- 172.21.15.64:0/2027749852 shutdown_connections 2024-09-21T07:37:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 --2- 172.21.15.64:0/2027749852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f415b2d0 0x7f08f415b6e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 --2- 172.21.15.64:0/2027749852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406efa0 0x7f08f40aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- 172.21.15.64:0/2027749852 >> 172.21.15.64:0/2027749852 conn(0x7f08f40ccbe0 msgr2=0x7f08f40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- 172.21.15.64:0/2027749852 shutdown_connections 2024-09-21T07:37:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- 172.21.15.64:0/2027749852 wait complete. 2024-09-21T07:37:05.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 Processor -- start 2024-09-21T07:37:05.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.723+0000 7f08fc800640 1 -- start start 2024-09-21T07:37:05.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f406efa0 0x7f08f41fd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 0x7f08f4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415ed90 con 0x7f08f415b2d0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415ec10 con 0x7f08f406efa0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f08f415ef10 con 0x7f08f406f3b0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08f9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f406efa0 0x7f08f41fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44740/0 (socket says 172.21.15.64:44740) 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 -- 172.21.15.64:0/4213692961 learned_addr learned my addr 172.21.15.64:0/4213692961 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08f9400640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 0x7f08f4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 -- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 msgr2=0x7f08f4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 0x7f08f4159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 -- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f406efa0 msgr2=0x7f08f41fd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f406efa0 0x7f08f41fd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 -- 172.21.15.64:0/4213692961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f41fd540 con 0x7f08f415b2d0 2024-09-21T07:37:05.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08f9400640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 0x7f08f4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fa800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f08f001c610 tx=0x7f08f0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f00b2040 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08f00bb070 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f40b32e0 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004370 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f4158bc0 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.727+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f415b6e0 con 0x7f08f415b2d0 2024-09-21T07:37:05.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.731+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f08f0004510 con 0x7f08f415b2d0 2024-09-21T07:37:05.729 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.731+0000 7f08ee000640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 0x7f08d8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:05.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.731+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f08f012ebe0 con 0x7f08f415b2d0 2024-09-21T07:37:05.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.731+0000 7f08f9e00640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 0x7f08d8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:05.730 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.731+0000 7f08f9e00640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 0x7f08d8075740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f08e80096c0 tx=0x7f08e8009260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:05.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.735+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f08f41fd540 con 0x7f08f415b2d0 2024-09-21T07:37:05.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.975+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f08f41594c0 con 0x7f08f415b2d0 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08ee000640 1 -- 172.21.15.64:0/4213692961 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v37) ==== 190+0+147 (secure 0 0 0) 0x7f08f0016790 con 0x7f08f415b2d0 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:37:05.978 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:37:05.979 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 msgr2=0x7f08d8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 0x7f08d8075740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f08e80096c0 tx=0x7f08e8009260 comp rx=0 tx=0).stop 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 msgr2=0x7f08f41f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f08f001c610 tx=0x7f08f0003f40 comp rx=0 tx=0).stop 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 shutdown_connections 2024-09-21T07:37:05.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f08d8073230 0x7f08d8075740 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08f415b2d0 0x7f08f41f9000 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08f406f3b0 0x7f08f4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 --2- 172.21.15.64:0/4213692961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08f406efa0 0x7f08f41fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 >> 172.21.15.64:0/4213692961 conn(0x7f08f40ccbe0 msgr2=0x7f08f40b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 shutdown_connections 2024-09-21T07:37:05.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:05.979+0000 7f08fc800640 1 -- 172.21.15.64:0/4213692961 wait complete. 2024-09-21T07:37:06.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 -- 172.21.15.64:0/3034403086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 msgr2=0x7efdc40740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 --2- 172.21.15.64:0/3034403086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc40740e0 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7efdc4071090 tx=0x7efdb401c8c0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 -- 172.21.15.64:0/3034403086 shutdown_connections 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 --2- 172.21.15.64:0/3034403086 >> v2:172.21.15.90:3300/0 conn(0x7efdc406d330 0x7efdc406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 --2- 172.21.15.64:0/3034403086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 0x7efdc406cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 --2- 172.21.15.64:0/3034403086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc40740e0 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 -- 172.21.15.64:0/3034403086 >> 172.21.15.64:0/3034403086 conn(0x7efdc40b2b50 msgr2=0x7efdc40b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 -- 172.21.15.64:0/3034403086 shutdown_connections 2024-09-21T07:37:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.159+0000 7efdc9e00640 1 -- 172.21.15.64:0/3034403086 wait complete. 2024-09-21T07:37:06.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 Processor -- start 2024-09-21T07:37:06.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 -- start start 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 0x7efdc40b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 0x7efdc40c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efdc415d410 con 0x7efdc4073cd0 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdc415d290 con 0x7efdc406d330 2024-09-21T07:37:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7efdc415d590 con 0x7efdc4074620 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 0x7efdc40b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44766/0 (socket says 172.21.15.64:44766) 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdbbe00640 1 -- 172.21.15.64:0/953937653 learned_addr learned my addr 172.21.15.64:0/953937653 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.163+0000 7efdc9400640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 0x7efdc40c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 -- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 msgr2=0x7efdc40c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 0x7efdc40c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 -- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 msgr2=0x7efdc40b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 0x7efdc40b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 -- 172.21.15.64:0/953937653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc40b3270 con 0x7efdc4073cd0 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc8a00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 0x7efdc40b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:37:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdbbe00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e7f0 tx=0x7efdac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac00ccc0 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdac00ce80 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac005280 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc40b45d0 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc40b4010 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc40740e0 con 0x7efdc4073cd0 2024-09-21T07:37:06.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.167+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efdac005420 con 0x7efdc4073cd0 2024-09-21T07:37:06.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.171+0000 7efdc1600640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 0x7efda0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.171+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7efdac094ce0 con 0x7efdc4073cd0 2024-09-21T07:37:06.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.171+0000 7efdc8a00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 0x7efda0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.171+0000 7efdc8a00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 0x7efda0075710 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efdb40af000 tx=0x7efdb401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.175+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7efdac05f520 con 0x7efdc4073cd0 2024-09-21T07:37:06.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.387+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdc40725f0 con 0x7efdc4073cd0 2024-09-21T07:37:06.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.387+0000 7efdc1600640 1 -- 172.21.15.64:0/953937653 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7efdac063f50 con 0x7efdc4073cd0 2024-09-21T07:37:06.387 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:06.387 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:06.387 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:06.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 msgr2=0x7efda0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 0x7efda0075710 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efdb40af000 tx=0x7efdb401b100 comp rx=0 tx=0).stop 2024-09-21T07:37:06.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 msgr2=0x7efdc4151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e7f0 tx=0x7efdac00ecb0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 shutdown_connections 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efda0073200 0x7efda0075710 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdc4074620 0x7efdc40c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdc4073cd0 0x7efdc4151ae0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 --2- 172.21.15.64:0/953937653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc406d330 0x7efdc40b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 >> 172.21.15.64:0/953937653 conn(0x7efdc40b2b50 msgr2=0x7efdc4156220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 shutdown_connections 2024-09-21T07:37:06.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.391+0000 7efdc9e00640 1 -- 172.21.15.64:0/953937653 wait complete. 2024-09-21T07:37:06.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 152, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:36:55.615208+0000', 'modified': '2024-09-21T07:36:58.640332+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10276': {'gid': 10276, 'name': 'a', 'rank': 0, 'incarnation': 149, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/1772905039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 1772905039}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1772905039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10276, 'qdb_cluster': [10276]} 2024-09-21T07:37:06.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:37:06.811 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 -- 172.21.15.64:0/642368321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580cd410 msgr2=0x7fea580b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 --2- 172.21.15.64:0/642368321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580cd410 0x7fea580b4de0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fea58075260 tx=0x7fea4401c6e0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 -- 172.21.15.64:0/642368321 shutdown_connections 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 --2- 172.21.15.64:0/642368321 >> v2:172.21.15.90:3300/0 conn(0x7fea5806ee80 0x7fea5806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 --2- 172.21.15.64:0/642368321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580cd410 0x7fea580b4de0 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 -- 172.21.15.64:0/642368321 >> 172.21.15.64:0/642368321 conn(0x7fea5806d450 msgr2=0x7fea580d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 -- 172.21.15.64:0/642368321 shutdown_connections 2024-09-21T07:37:06.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.971+0000 7fea5fc00640 1 -- 172.21.15.64:0/642368321 wait complete. 2024-09-21T07:37:06.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 Processor -- start 2024-09-21T07:37:06.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 -- start start 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea5806ee80 0x7fea580b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 0x7fea5809d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea5816a1a0 con 0x7fea580d0e60 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea5816a020 con 0x7fea5806ee80 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5fc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea5816a320 con 0x7fea580b2660 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44788/0 (socket says 172.21.15.64:44788) 2024-09-21T07:37:06.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea57e00640 1 -- 172.21.15.64:0/3438195007 learned_addr learned my addr 172.21.15.64:0/3438195007 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5d200640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea5806ee80 0x7fea580b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.975+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 0x7fea5809d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 -- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 msgr2=0x7fea5809d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 0x7fea5809d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 -- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea5806ee80 msgr2=0x7fea580b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea5806ee80 0x7fea580b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 -- 172.21.15.64:0/3438195007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58166e30 con 0x7fea580d0e60 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 0x7fea5809d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea57e00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fea4401ad90 tx=0x7fea440a65b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea54c00640 1 -- 172.21.15.64:0/3438195007 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440ac070 con 0x7fea580d0e60 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea54c00640 1 -- 172.21.15.64:0/3438195007 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea440054b0 con 0x7fea580d0e60 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea54c00640 1 -- 172.21.15.64:0/3438195007 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44004290 con 0x7fea580d0e60 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5815a350 con 0x7fea580d0e60 2024-09-21T07:37:06.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea581668c0 con 0x7fea580d0e60 2024-09-21T07:37:06.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.979+0000 7fea54c00640 1 -- 172.21.15.64:0/3438195007 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea440af070 con 0x7fea580d0e60 2024-09-21T07:37:06.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea54c00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 0x7fea38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea54c00640 1 -- 172.21.15.64:0/3438195007 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fea4412e870 con 0x7fea580d0e60 2024-09-21T07:37:06.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5d200640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 0x7fea38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 Processor -- start 2024-09-21T07:37:06.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 -- start start 2024-09-21T07:37:06.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5d200640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 0x7fea38075710 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c9bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9bb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558d7c88b410 con 0x558d7c84eca0 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558d7c7c8b40 con 0x558d7c475460 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558d7c7b7f70 con 0x558d7c865950 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44800/0 (socket says 172.21.15.64:44800) 2024-09-21T07:37:06.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 -- 172.21.15.64:0/3636836096 learned_addr learned my addr 172.21.15.64:0/3636836096 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5d200640 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c9bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea57e00640 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9bb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 -- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 msgr2=0x558d7c9bb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9bb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 -- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 msgr2=0x558d7c9bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c9bab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 -- 172.21.15.64:0/3636836096 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7c77f5b0 con 0x558d7c84eca0 2024-09-21T07:37:06.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.983+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fea50008df0 tx=0x7fea5000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4aaf966f76a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea49600640 1 -- 172.21.15.64:0/3636836096 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50003b80 con 0x558d7c84eca0 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea49600640 1 -- 172.21.15.64:0/3636836096 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea50003e10 con 0x558d7c84eca0 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea49600640 1 -- 172.21.15.64:0/3636836096 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50004280 con 0x558d7c84eca0 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- 172.21.15.64:0/3636836096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 msgr2=0x558d7c9bb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fea50008df0 tx=0x7fea5000d710 comp rx=0 tx=0).stop 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- 172.21.15.64:0/3636836096 shutdown_connections 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9bb580 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9bb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- 172.21.15.64:0/3636836096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c9bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- 172.21.15.64:0/3636836096 >> 172.21.15.64:0/3636836096 conn(0x558d7c93bd90 msgr2=0x558d7c96b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- 172.21.15.64:0/3636836096 shutdown_connections 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- 172.21.15.64:0/3636836096 wait complete. 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- start start 2024-09-21T07:37:06.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 Processor -- start 2024-09-21T07:37:06.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c475460 0x558d7c9a9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7c9a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558d7c7525f0 con 0x558d7c84eca0 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558d7c7bbd80 con 0x558d7c865950 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.987+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558d7c75e520 con 0x558d7c475460 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 10 client.0 _ll_register_callbacks cb 0x558d7c762830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44804/0 (socket says 172.21.15.64:44804) 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 -- 172.21.15.64:0/3815967321 learned_addr learned my addr 172.21.15.64:0/3815967321 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea5d200640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c475460 0x558d7c9a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7c9a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 -- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c475460 msgr2=0x558d7c9a9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c475460 0x558d7c9a9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 -- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 msgr2=0x558d7c9a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7c9a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 -- 172.21.15.64:0/3815967321 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7c756190 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea5dc00640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7c9a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea57e00640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fea4401cbc0 tx=0x7fea440f88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f139f330e23628bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44005680 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fea4411ab70 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d7c750110 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fea440f9130 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 10 client.11055 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x558d7c83cf10 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558d7c750110 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fea440c3060 con 0x558d7c84eca0 2024-09-21T07:37:06.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 10 client.11055 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 10 client.11055 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 20 client.11055 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c45a7d0 0x558d7c9aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 4 client.11055 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d7c7caa90 con 0x558d7c45a7d0 2024-09-21T07:37:06.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea5d200640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c45a7d0 0x558d7c9aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea5d200640 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c45a7d0 0x558d7c9aa5b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e024b62396cb15 server_cookie=f923810a2f4f7e3a in_seq=0 out_seq=0 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 10 client.11055 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 1 -- 172.21.15.64:0/3815967321 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d7c7caa90 con 0x558d7c45a7d0 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 10 client.11055 handle_command_reply: tid=0 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 client.11055 shutdown 2024-09-21T07:37:06.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 msgr2=0x558d7c9a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fea4401cbc0 tx=0x7fea440f88a0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 shutdown_connections 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c45a7d0 0x558d7c9aa5b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7c9a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea3e000640 0 client.11055 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9a9660 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 --2- 172.21.15.64:0/3815967321 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c475460 0x558d7c9a9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.991+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 >> 172.21.15.64:0/3815967321 conn(0x558d7c93bd90 msgr2=0x558d7c973050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.995+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 shutdown_connections 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.995+0000 7fea6745f000 1 -- 172.21.15.64:0/3815967321 wait complete. 2024-09-21T07:37:06.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:06.995+0000 7fea6745f000 20 client.11055 trim_cache size 0 max 16384 2024-09-21T07:37:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.011+0000 7fea6745f000 1 Processor -- start 2024-09-21T07:37:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.011+0000 7fea6745f000 1 -- start start 2024-09-21T07:37:07.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c978190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea580cc550 con 0x558d7c84eca0 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea58159e00 con 0x558d7c475460 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea580cbf00 con 0x558d7c865950 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44810/0 (socket says 172.21.15.64:44810) 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 -- 172.21.15.64:0/4252527939 learned_addr learned my addr 172.21.15.64:0/4252527939 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea5dc00640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea5d200640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c978190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 -- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 msgr2=0x558d7c9d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 -- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 msgr2=0x558d7c978190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:07.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c978190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 -- 172.21.15.64:0/4252527939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7c813db0 con 0x558d7c84eca0 2024-09-21T07:37:07.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea5dc00640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:07.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea5d200640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c978190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:07.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea57e00640 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fea440f63a0 tx=0x7fea440f8a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f4e7d9c97908d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea48c00640 1 -- 172.21.15.64:0/4252527939 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44102a10 con 0x558d7c84eca0 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea48c00640 1 -- 172.21.15.64:0/4252527939 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea44100e50 con 0x558d7c84eca0 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea48c00640 1 -- 172.21.15.64:0/4252527939 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4411ad70 con 0x558d7c84eca0 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- 172.21.15.64:0/4252527939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 msgr2=0x558d7c9786d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fea440f63a0 tx=0x7fea440f8a80 comp rx=0 tx=0).stop 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- 172.21.15.64:0/4252527939 shutdown_connections 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c865950 0x558d7c9d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c84eca0 0x558d7c9786d0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 --2- 172.21.15.64:0/4252527939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c475460 0x558d7c978190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- 172.21.15.64:0/4252527939 >> 172.21.15.64:0/4252527939 conn(0x558d7c93bd90 msgr2=0x558d7c977a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:07.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- 172.21.15.64:0/4252527939 shutdown_connections 2024-09-21T07:37:07.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- 172.21.15.64:0/4252527939 wait complete. 2024-09-21T07:37:07.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 -- start start 2024-09-21T07:37:07.017 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.015+0000 7fea6745f000 1 Processor -- start 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 0x558d7ca30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7ca30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558d7c7525f0 con 0x558d7c475460 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558d7c783ee0 con 0x558d7c865950 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558d7c7bbd80 con 0x558d7c84eca0 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 10 client.0 _ll_register_callbacks cb 0x7fea440f5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44822/0 (socket says 172.21.15.64:44822) 2024-09-21T07:37:07.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 -- 172.21.15.64:0/338004849 learned_addr learned my addr 172.21.15.64:0/338004849 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea57e00640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 0x558d7ca30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5dc00640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7ca30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 -- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 msgr2=0x558d7ca30440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 0x558d7ca30440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 -- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 msgr2=0x558d7ca30980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7ca30980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 -- 172.21.15.64:0/338004849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7c77eab0 con 0x558d7c475460 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea57e00640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 0x558d7ca30440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea5d200640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d530 tx=0x7fea4c0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793d7139fcb52d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c014c70 con 0x558d7c475460 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fea4c00f040 con 0x558d7c475460 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea44100e50 con 0x558d7c475460 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fea4c014e10 con 0x558d7c475460 2024-09-21T07:37:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 10 client.11061 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:07.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x558d7c75d070 con 0x558d7c475460 2024-09-21T07:37:07.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea44100e50 con 0x558d7c475460 2024-09-21T07:37:07.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fea4c013070 con 0x558d7c475460 2024-09-21T07:37:07.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 10 client.11061 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 10 client.11061 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 20 client.11061 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c448830 0x558d7c9ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 4 client.11061 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "status"}) -- 0x558d7c7c6540 con 0x558d7c448830 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea57e00640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c448830 0x558d7c9ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea57e00640 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c448830 0x558d7c9ce530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330abb45beefabe4 server_cookie=887f488996ebabcd in_seq=0 out_seq=0 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.019+0000 7fea3e000640 10 client.11061 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea3e000640 1 -- 172.21.15.64:0/338004849 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x558d7c7c6540 con 0x558d7c448830 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea3e000640 10 client.11061 handle_command_reply: tid=0 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 client.11061 shutdown 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 msgr2=0x558d7ca2ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d530 tx=0x7fea4c0046e0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 shutdown_connections 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x558d7c448830 0x558d7c9ce530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d7c865950 0x558d7ca30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558d7c84eca0 0x558d7ca30440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 --2- 172.21.15.64:0/338004849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558d7c475460 0x558d7ca2ff00 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea3e000640 0 client.11061 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 >> 172.21.15.64:0/338004849 conn(0x558d7c93bd90 msgr2=0x558d7c978440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 shutdown_connections 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 1 -- 172.21.15.64:0/338004849 wait complete. 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea6745f000 20 client.11061 trim_cache size 0 max 16384 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:37:07.024 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 10276, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.810591141, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 152, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 204, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 204, 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.221920179 2024-09-21T07:37:07.025 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 msgr2=0x7fea38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 0x7fea38075710 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c008040 comp rx=0 tx=0).stop 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 msgr2=0x7fea5815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fea4401ad90 tx=0x7fea440a65b0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 shutdown_connections 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea38073200 0x7fea38075710 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea580b2660 0x7fea5809d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea580d0e60 0x7fea5815ae30 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 --2- 172.21.15.64:0/3438195007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea5806ee80 0x7fea580b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 >> 172.21.15.64:0/3438195007 conn(0x7fea5806d450 msgr2=0x7fea58072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:07.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 shutdown_connections 2024-09-21T07:37:07.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.023+0000 7fea5fc00640 1 -- 172.21.15.64:0/3438195007 wait complete. 2024-09-21T07:37:07.041 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 -- 172.21.15.64:0/24850397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 msgr2=0x7f64fc0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 --2- 172.21.15.64:0/24850397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc0b2060 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009840 tx=0x7f64ec01c820 comp rx=0 tx=0).stop 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 -- 172.21.15.64:0/24850397 shutdown_connections 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 --2- 172.21.15.64:0/24850397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc0b4130 0x7f64fc0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 --2- 172.21.15.64:0/24850397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc0b2060 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 -- 172.21.15.64:0/24850397 >> 172.21.15.64:0/24850397 conn(0x7f64fc0ccbe0 msgr2=0x7f64fc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 -- 172.21.15.64:0/24850397 shutdown_connections 2024-09-21T07:37:07.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.199+0000 7f6502200640 1 -- 172.21.15.64:0/24850397 wait complete. 2024-09-21T07:37:07.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 Processor -- start 2024-09-21T07:37:07.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 -- start start 2024-09-21T07:37:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 0x7f64fc09c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 0x7f64fc0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc168b60 con 0x7f64fc0b1c50 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc1689e0 con 0x7f64fc0b4130 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f6502200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f64fc168ce0 con 0x7f64fc09c610 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44838/0 (socket says 172.21.15.64:44838) 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 -- 172.21.15.64:0/1499432259 learned_addr learned my addr 172.21.15.64:0/1499432259 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64f2a00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 0x7f64fc09c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fbe00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 0x7f64fc0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 -- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 msgr2=0x7f64fc0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 0x7f64fc0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 -- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 msgr2=0x7f64fc09c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 0x7f64fc09c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fb400640 1 -- 172.21.15.64:0/1499432259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64fc15f840 con 0x7f64fc0b1c50 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64f2a00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 0x7f64fc09c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.203+0000 7f64fbe00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 0x7f64fc0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:07.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64fb400640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f64ec01aed0 tx=0x7f64ec0a67b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:07.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0043c0 con 0x7f64fc0b1c50 2024-09-21T07:37:07.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64ec0be070 con 0x7f64fc0b1c50 2024-09-21T07:37:07.206 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64fc0c5eb0 con 0x7f64fc0b1c50 2024-09-21T07:37:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec003860 con 0x7f64fc0b1c50 2024-09-21T07:37:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64fc0c6470 con 0x7f64fc0b1c50 2024-09-21T07:37:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64fc0b2060 con 0x7f64fc0b1c50 2024-09-21T07:37:07.207 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f64ec003a00 con 0x7f64fc0b1c50 2024-09-21T07:37:07.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 0x7f64d8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:07.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.207+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f64ec130300 con 0x7f64fc0b1c50 2024-09-21T07:37:07.208 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.211+0000 7f64f2a00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 0x7f64d8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:07.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.211+0000 7f64f2a00640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 0x7f64d8075740 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f64fc073040 tx=0x7f64e4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:07.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.211+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f64ec016410 con 0x7f64fc0b1c50 2024-09-21T07:37:07.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f64fc0742c0 con 0x7f64fc0b1c50 2024-09-21T07:37:07.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f64f3e00640 1 -- 172.21.15.64:0/1499432259 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v152) ==== 53+0+73 (secure 0 0 0) 0x7f64ec0fb300 con 0x7f64fc0b1c50 2024-09-21T07:37:07.426 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 msgr2=0x7f64d8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 0x7f64d8075740 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f64fc073040 tx=0x7f64e4009040 comp rx=0 tx=0).stop 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 msgr2=0x7f64fc1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f64ec01aed0 tx=0x7f64ec0a67b0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 shutdown_connections 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f64d8073230 0x7f64d8075740 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64fc09c610 0x7f64fc0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64fc0b4130 0x7f64fc09c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 --2- 172.21.15.64:0/1499432259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64fc0b1c50 0x7f64fc1591a0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:07.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 >> 172.21.15.64:0/1499432259 conn(0x7f64fc0ccbe0 msgr2=0x7f64fc073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:07.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 shutdown_connections 2024-09-21T07:37:07.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07.427+0000 7f6502200640 1 -- 172.21.15.64:0/1499432259 wait complete. 2024-09-21T07:37:07.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:37:07.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:37:07.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:37:07.449 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:37:07.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.449 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:37:07.458 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:37:07.458 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:37:07.458 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:37:07.458 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.458 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41556sec preferred_lft 41556sec 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.459 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:37:07.460 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:37:07.461 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:37:07.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.461 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:37:07.521 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:37:07.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.524 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:37:07.575 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:37:07.576 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:37:07.576 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:37:07.576 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:37:07.576 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:37:07.576 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:37:07.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.717 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:37:07.768 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:37:07.768 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:37:07.769 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:37:07.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.769 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:37:07.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:37:07.832 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:37:07.880 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:37:07.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:37:07.880 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:37:07.931 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:37:07.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:07.932 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:37:08.033 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:37:08.033 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:37:08.046 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:37:08.047 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:37:08.047 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:37:08.047 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:37:08.047 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:37:08.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:37:08.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:08.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:37:08.071 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:37:08.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:37:08.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:37:08.176 INFO:teuthology.orchestra.run.smithi064.stdout:client11073 2024-09-21T07:37:08.176 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:08.176 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:08.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:08.186 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-21T07:37:08.247 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:08.247 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:08.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:08.300 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-21T07:37:08.424 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records in 2024-09-21T07:37:08.424 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records out 2024-09-21T07:37:08.424 INFO:teuthology.orchestra.run.smithi064.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0709121 s, 88.7 MB/s 2024-09-21T07:37:08.426 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:37:08.429 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:37:08.469 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-09-21T07:37:08.469 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-09-21T07:37:08.469 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:37:08.470 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:37:08.471 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:37:08.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-09-21T07:37:08.473 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-09-21T07:37:08.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:37:08.475 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:37:08.476 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:37:08.477 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-09-21T07:37:08.478 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout: mds cache max size = 1000 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout: mds log max segments = 1 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = False 2024-09-21T07:37:08.479 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T07:37:08.480 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:37:08.481 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:37:08.482 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T07:37:08.483 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.484 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T07:37:08.485 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T07:37:08.486 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.487 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:37:08.488 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:37:08.489 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:37:08.489 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T07:37:08.489 INFO:teuthology.orchestra.run.smithi090.stdout: mds cache max size = 1000 2024-09-21T07:37:08.489 INFO:teuthology.orchestra.run.smithi090.stdout: mds log max segments = 1 2024-09-21T07:37:08.489 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = False 2024-09-21T07:37:08.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:37:08.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:37:08.578 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.579 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-09-21T07:37:08.580 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-09-21T07:37:08.581 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-09-21T07:37:08.582 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-09-21T07:37:08.583 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.584 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.585 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:37:08.586 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-09-21T07:37:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout: mds cache max size = 1000 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout: mds log max segments = 1 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = False 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = False 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T07:37:08.588 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T07:37:08.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:37:08.590 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T07:37:08.591 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T07:37:08.592 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T07:37:08.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T07:37:08.594 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T07:37:08.595 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T07:37:08.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:37:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout: mds cache max size = 1000 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout: mds log max segments = 1 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = False 2024-09-21T07:37:08.598 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = False 2024-09-21T07:37:08.599 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> import json 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> import sys 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> except OSError as e: 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> sys.exit(e.errno) 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> print(json.dumps( 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> indent=2)) 2024-09-21T07:37:08.600 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:37:08.714 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:08.714 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mode": 33204, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ino": 1099511627777, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_dev": 44, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_nlink": 1, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_uid": 1000, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_gid": 1271, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_size": 6291456, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_atime": 1726904228.3517697, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mtime": 1726904228.387769, 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ctime": 1726904228.387769 2024-09-21T07:37:08.715 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:08.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:37:08.725 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.927+0000 7f385aa00640 1 -- 172.21.15.64:0/1828514075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 msgr2=0x7f38540b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.927+0000 7f385aa00640 1 --2- 172.21.15.64:0/1828514075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b0fc0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f384c009c80 tx=0x7f384c01cda0 comp rx=0 tx=0).stop 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- 172.21.15.64:0/1828514075 shutdown_connections 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 --2- 172.21.15.64:0/1828514075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b0fc0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 --2- 172.21.15.64:0/1828514075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 0x7f38540cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- 172.21.15.64:0/1828514075 >> 172.21.15.64:0/1828514075 conn(0x7f38540d13b0 msgr2=0x7f38540d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- 172.21.15.64:0/1828514075 shutdown_connections 2024-09-21T07:37:08.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- 172.21.15.64:0/1828514075 wait complete. 2024-09-21T07:37:08.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 Processor -- start 2024-09-21T07:37:08.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- start start 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540b6750 0x7f38540b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 0x7f38541fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3854168c80 con 0x7f38540b0bb0 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3854168b00 con 0x7f38540b6750 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.931+0000 7f385aa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3854168e00 con 0x7f38540d00a0 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:08.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44864/0 (socket says 172.21.15.64:44864) 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 -- 172.21.15.64:0/574059984 learned_addr learned my addr 172.21.15.64:0/574059984 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f384be00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540b6750 0x7f38540b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3858a00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 0x7f38541fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 -- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 msgr2=0x7f38541fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 0x7f38541fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 -- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540b6750 msgr2=0x7f38540b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540b6750 0x7f38540b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 -- 172.21.15.64:0/574059984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38540c88d0 con 0x7f38540b0bb0 2024-09-21T07:37:08.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3853e00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f384400c3f0 tx=0x7f384400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844017070 con 0x7f38540b0bb0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38440053c0 con 0x7f38540b0bb0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38540c8bb0 con 0x7f38540b0bb0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844003860 con 0x7f38540b0bb0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38540c8360 con 0x7f38540b0bb0 2024-09-21T07:37:08.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38540b0fc0 con 0x7f38540b0bb0 2024-09-21T07:37:08.936 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.935+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f384401a070 con 0x7f38540b0bb0 2024-09-21T07:37:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.939+0000 7f3850c00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 0x7f3830075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.939+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f3844093a90 con 0x7f38540b0bb0 2024-09-21T07:37:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.939+0000 7f384be00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 0x7f3830075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:08.938 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.939+0000 7f384be00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 0x7f3830075710 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3854165d50 tx=0x7f383c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:08.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:08.939+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3844021020 con 0x7f38540b0bb0 2024-09-21T07:37:09.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.151+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38540cb7e0 con 0x7f38540b0bb0 2024-09-21T07:37:09.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f3850c00640 1 -- 172.21.15.64:0/574059984 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7f384405e340 con 0x7f38540b0bb0 2024-09-21T07:37:09.153 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:09.153 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:09.153 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:09.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 msgr2=0x7f3830075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 0x7f3830075710 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3854165d50 tx=0x7f383c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 msgr2=0x7f38540b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f384400c3f0 tx=0x7f384400c8b0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 shutdown_connections 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073200 0x7f3830075710 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38540d00a0 0x7f38541fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540b6750 0x7f38540b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 --2- 172.21.15.64:0/574059984 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540b0bb0 0x7f38540b5230 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 >> 172.21.15.64:0/574059984 conn(0x7f38540d13b0 msgr2=0x7f3854071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 shutdown_connections 2024-09-21T07:37:09.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.155+0000 7f385aa00640 1 -- 172.21.15.64:0/574059984 wait complete. 2024-09-21T07:37:09.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-21T07:37:09.359 INFO:teuthology.orchestra.run.smithi064.stdout:{"message":"","return_code":0} 2024-09-21T07:37:09.359 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-21T07:37:09.360 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-21T07:37:09.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.419+0000 7fd482b09080 1 Processor -- start 2024-09-21T07:37:09.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.419+0000 7fd482b09080 1 -- start start 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d6f3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d784ff0 0x55910d6c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55910d6f67a0 con 0x55910d70fc90 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55910d616a00 con 0x55910d784ff0 2024-09-21T07:37:09.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55910d785400 con 0x55910d6c8820 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44884/0 (socket says 172.21.15.64:44884) 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 -- 172.21.15.64:0/1124004203 learned_addr learned my addr 172.21.15.64:0/1124004203 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47bc00640 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d6f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47c600640 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d784ff0 0x55910d6c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 -- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 msgr2=0x55910d6f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d6f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 -- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d784ff0 msgr2=0x55910d6c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d784ff0 0x55910d6c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 -- 172.21.15.64:0/1124004203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d615a20 con 0x55910d70fc90 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd47b200640 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b580 tx=0x7fd46800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a701dd4c3aca9477 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd479e00640 1 -- 172.21.15.64:0/1124004203 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46800a8d0 con 0x55910d70fc90 2024-09-21T07:37:09.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd479e00640 1 -- 172.21.15.64:0/1124004203 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd46800aa70 con 0x55910d70fc90 2024-09-21T07:37:09.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd479e00640 1 -- 172.21.15.64:0/1124004203 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468008460 con 0x55910d70fc90 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- 172.21.15.64:0/1124004203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 msgr2=0x55910d780bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b580 tx=0x7fd46800ba40 comp rx=0 tx=0).stop 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- 172.21.15.64:0/1124004203 shutdown_connections 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d784ff0 0x55910d6c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d70fc90 0x55910d780bc0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 --2- 172.21.15.64:0/1124004203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d6f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- 172.21.15.64:0/1124004203 >> 172.21.15.64:0/1124004203 conn(0x55910d6b4da0 msgr2=0x55910d6c7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- 172.21.15.64:0/1124004203 shutdown_connections 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 -- 172.21.15.64:0/1124004203 wait complete. 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.423+0000 7fd482b09080 1 Processor -- start 2024-09-21T07:37:09.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- start start 2024-09-21T07:37:09.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d783dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d70fc90 0x55910d836120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 0x55910d77ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55910d70bfa0 con 0x55910d784ff0 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55910d70bd40 con 0x55910d70fc90 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55910d70d7a0 con 0x55910d6c8820 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 0x55910d77ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 0x55910d77ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44894/0 (socket says 172.21.15.64:44894) 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 -- 172.21.15.64:0/2959043537 learned_addr learned my addr 172.21.15.64:0/2959043537 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47b200640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d70fc90 0x55910d836120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47bc00640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d783dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 -- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 msgr2=0x55910d783dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d783dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 -- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d70fc90 msgr2=0x55910d836120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55910d70fc90 0x55910d836120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 -- 172.21.15.64:0/2959043537 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d5efc10 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47bc00640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55910d6c8820 0x55910d783dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd47c600640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 0x55910d77ea10 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fd47401c3c0 tx=0x7fd4740afb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd478a00640 1 -- 172.21.15.64:0/2959043537 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740049d0 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd478a00640 1 -- 172.21.15.64:0/2959043537 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4740a78e0 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd478a00640 1 -- 172.21.15.64:0/2959043537 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740c4610 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910d77f200 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.427+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910d835c80 con 0x55910d784ff0 2024-09-21T07:37:09.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd478a00640 1 -- 172.21.15.64:0/2959043537 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd4740c2020 con 0x55910d784ff0 2024-09-21T07:37:09.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd478a00640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd45c071be0 0x7fd45c0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd478a00640 1 -- 172.21.15.64:0/2959043537 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fd474131860 con 0x55910d784ff0 2024-09-21T07:37:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd482b09080 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x55910d79b330 0x55910d6f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e204) -- 0x55910d836660 con 0x55910d79b330 2024-09-21T07:37:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd47bc00640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd45c071be0 0x7fd45c0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd47b200640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x55910d79b330 0x55910d6f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd47bc00640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd45c071be0 0x7fd45c0740f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00d860 tx=0x7fd46c00f040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.431+0000 7fd47b200640 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x55910d79b330 0x55910d6f3f80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd47b200640 1 -- 172.21.15.64:0/2959043537 <== osd.2 v2:172.21.15.64:6808/3196938996 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v204'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd46800ab10 con 0x55910d79b330 2024-09-21T07:37:09.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x55910d79b330 msgr2=0x55910d6f3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x55910d79b330 0x55910d6f3f80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd45c071be0 msgr2=0x7fd45c0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd45c071be0 0x7fd45c0740f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00d860 tx=0x7fd46c00f040 comp rx=0 tx=0).stop 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 msgr2=0x55910d77ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 --2- 172.21.15.64:0/2959043537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55910d784ff0 0x55910d77ea10 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fd47401c3c0 tx=0x7fd4740afb50 comp rx=0 tx=0).stop 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd47c600640 1 -- 172.21.15.64:0/2959043537 reap_dead start 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 shutdown_connections 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 >> 172.21.15.64:0/2959043537 conn(0x55910d6b4da0 msgr2=0x55910d6c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 shutdown_connections 2024-09-21T07:37:09.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.435+0000 7fd482b09080 1 -- 172.21.15.64:0/2959043537 wait complete. 2024-09-21T07:37:09.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:09.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- 172.21.15.64:0/346453442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac15af70 msgr2=0x7f54ac0b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- 172.21.15.64:0/346453442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac15af70 0x7f54ac0b2580 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009840 tx=0x7f54a001c6e0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- 172.21.15.64:0/346453442 shutdown_connections 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- 172.21.15.64:0/346453442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 0x7f54ac165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- 172.21.15.64:0/346453442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac15af70 0x7f54ac0b2580 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- 172.21.15.64:0/346453442 >> 172.21.15.64:0/346453442 conn(0x7f54ac06d570 msgr2=0x7f54ac0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- 172.21.15.64:0/346453442 shutdown_connections 2024-09-21T07:37:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- 172.21.15.64:0/346453442 wait complete. 2024-09-21T07:37:09.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 Processor -- start 2024-09-21T07:37:09.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- start start 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac06f0d0 0x7f54ac0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 0x7f54ac1fb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac168b20 con 0x7f54ac15af70 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1689a0 con 0x7f54ac06f0d0 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.603+0000 7f54b3400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac168ca0 con 0x7f54ac074af0 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44898/0 (socket says 172.21.15.64:44898) 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 -- 172.21.15.64:0/288528013 learned_addr learned my addr 172.21.15.64:0/288528013 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b0a00640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac06f0d0 0x7f54ac0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54abe00640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 0x7f54ac1fb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 -- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 msgr2=0x7f54ac1fb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 0x7f54ac1fb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 -- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac06f0d0 msgr2=0x7f54ac0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac06f0d0 0x7f54ac0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 -- 172.21.15.64:0/288528013 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0c8c40 con 0x7f54ac15af70 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b1400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009fd0 tx=0x7f54a400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54a8c00640 1 -- 172.21.15.64:0/288528013 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a400ce20 con 0x7f54ac15af70 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54a8c00640 1 -- 172.21.15.64:0/288528013 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a4004b30 con 0x7f54ac15af70 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54a8c00640 1 -- 172.21.15.64:0/288528013 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005020 con 0x7f54ac15af70 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac0cd230 con 0x7f54ac15af70 2024-09-21T07:37:09.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac165bf0 con 0x7f54ac15af70 2024-09-21T07:37:09.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.607+0000 7f54a8c00640 1 -- 172.21.15.64:0/288528013 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f54a40051c0 con 0x7f54ac15af70 2024-09-21T07:37:09.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54a8c00640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 0x7f548c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54a8c00640 1 -- 172.21.15.64:0/288528013 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f54a4094fb0 con 0x7f54ac15af70 2024-09-21T07:37:09.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 Processor -- start 2024-09-21T07:37:09.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b0a00640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 0x7f548c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 -- start start 2024-09-21T07:37:09.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b0a00640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 0x7f548c075740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f54a00ae000 tx=0x7f54a001af80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc0d1a0 0x56141cd56640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd56b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56141cb1bbd0 con 0x56141cbef970 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56141cb0c430 con 0x56141cc05ae0 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56141cb69ce0 con 0x56141cc0d1a0 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44914/0 (socket says 172.21.15.64:44914) 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b0a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc0d1a0 0x56141cd56640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 -- 172.21.15.64:0/3015183033 learned_addr learned my addr 172.21.15.64:0/3015183033 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54abe00640 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd56b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 -- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc0d1a0 msgr2=0x56141cd56640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc0d1a0 0x56141cd56640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 -- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 msgr2=0x56141cd56b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd56b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 -- 172.21.15.64:0/3015183033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141cb0dd80 con 0x56141cbef970 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f54b1400640 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f54a405ca50 tx=0x7f54a405f010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2166c2df3d99329 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f549d200640 1 -- 172.21.15.64:0/3015183033 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4064210 con 0x56141cbef970 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f549d200640 1 -- 172.21.15.64:0/3015183033 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a40690c0 con 0x56141cbef970 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.611+0000 7f549d200640 1 -- 172.21.15.64:0/3015183033 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4068e50 con 0x56141cbef970 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- 172.21.15.64:0/3015183033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 msgr2=0x56141cd570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f54a405ca50 tx=0x7f54a405f010 comp rx=0 tx=0).stop 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- 172.21.15.64:0/3015183033 shutdown_connections 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd570c0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd56b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- 172.21.15.64:0/3015183033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc0d1a0 0x56141cd56640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- 172.21.15.64:0/3015183033 >> 172.21.15.64:0/3015183033 conn(0x56141cc138c0 msgr2=0x56141cd0b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- 172.21.15.64:0/3015183033 shutdown_connections 2024-09-21T07:37:09.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- 172.21.15.64:0/3015183033 wait complete. 2024-09-21T07:37:09.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- start start 2024-09-21T07:37:09.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 Processor -- start 2024-09-21T07:37:09.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 0x56141cd44a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc0d1a0 0x56141cd44f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56141cb5cf20 con 0x56141cbef970 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56141cb59110 con 0x56141cc0d1a0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56141cafe6d0 con 0x56141cc05ae0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54ba963000 10 client.0 _ll_register_callbacks cb 0x56141cafd330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54b0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54b0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44916/0 (socket says 172.21.15.64:44916) 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54b0a00640 1 -- 172.21.15.64:0/3994634276 learned_addr learned my addr 172.21.15.64:0/3994634276 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54abe00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 0x56141cd44a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.615+0000 7f54b1400640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc0d1a0 0x56141cd44f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 -- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 msgr2=0x56141cd44a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 0x56141cd44a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 -- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc0d1a0 msgr2=0x56141cd44f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc0d1a0 0x56141cd44f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 -- 172.21.15.64:0/3994634276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141caf7310 con 0x56141cbef970 2024-09-21T07:37:09.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54abe00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 0x56141cd44a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54b0a00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f54a001c510 tx=0x7f54a00091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5b454b04db8265 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00a6630 con 0x56141cbef970 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f54a00b7030 con 0x56141cbef970 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56141caf1450 con 0x56141cbef970 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f54a00a67d0 con 0x56141cbef970 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 10 client.11100 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x56141cb14f60 con 0x56141cbef970 2024-09-21T07:37:09.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56141caf1450 con 0x56141cbef970 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f54a00a6970 con 0x56141cbef970 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 10 client.11100 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 10 client.11100 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 20 client.11100 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7fbb80 0x56141cd45ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 4 client.11100 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56141cb6bc30 con 0x56141c7fbb80 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54abe00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7fbb80 0x56141cd45ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 10 client.11100 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54abe00640 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7fbb80 0x56141cd45ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00c7263e22550be server_cookie=3c04645e18a21fae in_seq=0 out_seq=0 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 1 -- 172.21.15.64:0/3994634276 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56141cb6bc30 con 0x56141c7fbb80 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 10 client.11100 handle_command_reply: tid=0 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 client.11100 shutdown 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 msgr2=0x56141cd44100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f54a001c510 tx=0x7f54a00091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 shutdown_connections 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7fbb80 0x56141cd45ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc0d1a0 0x56141cd44f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cc05ae0 0x56141cd44a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f5491600640 0 client.11100 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 --2- 172.21.15.64:0/3994634276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cbef970 0x56141cd44100 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 >> 172.21.15.64:0/3994634276 conn(0x56141cc138c0 msgr2=0x56141cd0b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 shutdown_connections 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 1 -- 172.21.15.64:0/3994634276 wait complete. 2024-09-21T07:37:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.619+0000 7f54ba963000 20 client.11100 trim_cache size 0 max 16384 2024-09-21T07:37:09.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 Processor -- start 2024-09-21T07:37:09.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 -- start start 2024-09-21T07:37:09.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cd6c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd6cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac2058f0 con 0x56141cc0d1a0 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac204940 con 0x56141cc05ae0 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.639+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac1fc910 con 0x56141cbef970 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44920/0 (socket says 172.21.15.64:44920) 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 -- 172.21.15.64:0/1887779936 learned_addr learned my addr 172.21.15.64:0/1887779936 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54abe00640 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd6cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b0a00640 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cd6c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 -- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 msgr2=0x56141cd6c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cd6c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 -- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 msgr2=0x56141cd6cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd6cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 -- 172.21.15.64:0/1887779936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141cbddf30 con 0x56141cc0d1a0 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54b1400640 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f54a4004a00 tx=0x7f54a4063040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322ae819f52d1c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f5493e00640 1 -- 172.21.15.64:0/1887779936 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4064210 con 0x56141cc0d1a0 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f5493e00640 1 -- 172.21.15.64:0/1887779936 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a4068c30 con 0x56141cc0d1a0 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f5493e00640 1 -- 172.21.15.64:0/1887779936 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a405ea40 con 0x56141cc0d1a0 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- 172.21.15.64:0/1887779936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 msgr2=0x56141cd6d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f54a4004a00 tx=0x7f54a4063040 comp rx=0 tx=0).stop 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- 172.21.15.64:0/1887779936 shutdown_connections 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cd6d260 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cd6cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 --2- 172.21.15.64:0/1887779936 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cd6c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- 172.21.15.64:0/1887779936 >> 172.21.15.64:0/1887779936 conn(0x56141cc138c0 msgr2=0x56141cd63270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- 172.21.15.64:0/1887779936 shutdown_connections 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- 172.21.15.64:0/1887779936 wait complete. 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 -- start start 2024-09-21T07:37:09.644 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.643+0000 7f54ba963000 1 Processor -- start 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cdcca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cdccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56141cb59110 con 0x56141cc0d1a0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56141cb5cf20 con 0x56141cc05ae0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56141cbddaa0 con 0x56141cbef970 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 10 client.0 _ll_register_callbacks cb 0x7f54a00096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44936/0 (socket says 172.21.15.64:44936) 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 -- 172.21.15.64:0/36870681 learned_addr learned my addr 172.21.15.64:0/36870681 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b0a00640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cdcca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54abe00640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cdccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 -- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 msgr2=0x56141cdcca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cdcca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 -- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 msgr2=0x56141cdccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cdccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 -- 172.21.15.64:0/36870681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141cbb4dd0 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b1400640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f54a40932b0 tx=0x7f54a4068ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaca659af0826c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4064210 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f54a4066420 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54a4068c30 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f54a4066620 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 10 client.11106 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x56141caef840 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a4068c30 con 0x56141cc0d1a0 2024-09-21T07:37:09.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f54a4075350 con 0x56141cc0d1a0 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 10 client.11106 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 10 client.11106 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 20 client.11106 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7e9be0 0x56141cd0cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 4 client.11106 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x56141cb676e0 con 0x56141c7e9be0 2024-09-21T07:37:09.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b0a00640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7e9be0 0x56141cd0cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f54b0a00640 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7e9be0 0x56141cd0cb10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=391b2d53ea0dd428 server_cookie=d0c72987c3d5fff5 in_seq=0 out_seq=0 2024-09-21T07:37:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.647+0000 7f5491600640 10 client.11106 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f5491600640 1 -- 172.21.15.64:0/36870681 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56141cb676e0 con 0x56141c7e9be0 2024-09-21T07:37:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f5491600640 10 client.11106 handle_command_reply: tid=0 2024-09-21T07:37:09.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 client.11106 shutdown 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 msgr2=0x56141cdcd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f54a40932b0 tx=0x7f54a4068ff0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 shutdown_connections 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x56141c7e9be0 0x56141cd0cb10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56141cc0d1a0 0x56141cdcd4a0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56141cc05ae0 0x56141cdccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 --2- 172.21.15.64:0/36870681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56141cbef970 0x56141cdcca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 >> 172.21.15.64:0/36870681 conn(0x56141cc138c0 msgr2=0x56141cd43b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f5491600640 0 client.11106 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 shutdown_connections 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 1 -- 172.21.15.64:0/36870681 wait complete. 2024-09-21T07:37:09.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54ba963000 20 client.11106 trim_cache size 0 max 16384 2024-09-21T07:37:09.652 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:37:09.651+0000 7fef36c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-21T07:37:08.383769+0000 b5242880 1=1+0)->n(v0 rc2024-09-21T07:37:08.387769+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={11073=0-12582912@1} caps={11073=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=11073 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x5631134aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-21T07:37:09.652 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:09.652 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:37:09.652 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7", 2024-09-21T07:37:09.652 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:37:09.652 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 msgr2=0x7f548c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 0x7f548c075740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f54a00ae000 tx=0x7f54a001af80 comp rx=0 tx=0).stop 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 msgr2=0x7f54ac14cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009fd0 tx=0x7f54a400ef10 comp rx=0 tx=0).stop 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 shutdown_connections 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f548c073230 0x7f548c075740 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15af70 0x7f54ac14cee0 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f54ac074af0 0x7f54ac1fb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 --2- 172.21.15.64:0/288528013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54ac06f0d0 0x7f54ac0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 >> 172.21.15.64:0/288528013 conn(0x7f54ac06d570 msgr2=0x7f54ac0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 shutdown_connections 2024-09-21T07:37:09.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.651+0000 7f54b3400640 1 -- 172.21.15.64:0/288528013 wait complete. 2024-09-21T07:37:09.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:09.670 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-21T07:37:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- 172.21.15.64:0/1054881831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b3170 msgr2=0x7fa1b80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 --2- 172.21.15.64:0/1054881831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b3170 0x7fa1b80b3580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009840 tx=0x7fa1a001c740 comp rx=0 tx=0).stop 2024-09-21T07:37:09.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- 172.21.15.64:0/1054881831 shutdown_connections 2024-09-21T07:37:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 --2- 172.21.15.64:0/1054881831 >> v2:172.21.15.90:3300/0 conn(0x7fa1b80ccd30 0x7fa1b80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 --2- 172.21.15.64:0/1054881831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b3170 0x7fa1b80b3580 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- 172.21.15.64:0/1054881831 >> 172.21.15.64:0/1054881831 conn(0x7fa1b806d570 msgr2=0x7fa1b80b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- 172.21.15.64:0/1054881831 shutdown_connections 2024-09-21T07:37:09.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- 172.21.15.64:0/1054881831 wait complete. 2024-09-21T07:37:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 Processor -- start 2024-09-21T07:37:09.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.835+0000 7fa1bd800640 1 -- start start 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b28e0 0x7fa1b80c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1b80b3170 0x7fa1b80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8169f70 con 0x7fa1b80ccd30 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8169df0 con 0x7fa1b80b3170 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b816a0f0 con 0x7fa1b80b28e0 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44940/0 (socket says 172.21.15.64:44940) 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 -- 172.21.15.64:0/503345189 learned_addr learned my addr 172.21.15.64:0/503345189 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1afe00640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1b80b3170 0x7fa1b80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b28e0 0x7fa1b80c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 -- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b28e0 msgr2=0x7fa1b80c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b28e0 0x7fa1b80c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 -- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1b80b3170 msgr2=0x7fa1b80ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1b80b3170 0x7fa1b80ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 -- 172.21.15.64:0/503345189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b81fd580 con 0x7fa1b80ccd30 2024-09-21T07:37:09.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1b7400640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009fd0 tx=0x7fa1b000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1aea00640 1 -- 172.21.15.64:0/503345189 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000cd60 con 0x7fa1b80ccd30 2024-09-21T07:37:09.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1aea00640 1 -- 172.21.15.64:0/503345189 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b0004b30 con 0x7fa1b80ccd30 2024-09-21T07:37:09.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b80caeb0 con 0x7fa1b80ccd30 2024-09-21T07:37:09.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1aea00640 1 -- 172.21.15.64:0/503345189 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0005020 con 0x7fa1b80ccd30 2024-09-21T07:37:09.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.839+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b80b08d0 con 0x7fa1b80ccd30 2024-09-21T07:37:09.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1aea00640 1 -- 172.21.15.64:0/503345189 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa1b0005210 con 0x7fa1b80ccd30 2024-09-21T07:37:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1aea00640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 0x7fa194075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1aea00640 1 -- 172.21.15.64:0/503345189 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fa1b0094fd0 con 0x7fa1b80ccd30 2024-09-21T07:37:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 0x7fa194075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 Processor -- start 2024-09-21T07:37:09.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 -- start start 2024-09-21T07:37:09.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 0x7fa194075740 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8007fd0 tx=0x7fa1a8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5b456d0 0x5571f5cb19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5cb1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5571f5b50cd0 con 0x5571f5860aa0 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5571f5a66330 con 0x5571f5b456d0 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5571f5ac3bb0 con 0x5571f579c890 2024-09-21T07:37:09.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.843+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44956/0 (socket says 172.21.15.64:44956) 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 -- 172.21.15.64:0/3705757236 learned_addr learned my addr 172.21.15.64:0/3705757236 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5b456d0 0x5571f5cb19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1afe00640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5cb1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 -- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 msgr2=0x5571f5cb1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5cb1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 -- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5b456d0 msgr2=0x5571f5cb19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5b456d0 0x5571f5cb19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 -- 172.21.15.64:0/3705757236 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f5a67c80 con 0x5571f5860aa0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1afe00640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5cb1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00049e0 tx=0x7fa1b005ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08218f99866ad75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1a7400640 1 -- 172.21.15.64:0/3705757236 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b005f6d0 con 0x5571f5860aa0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1a7400640 1 -- 172.21.15.64:0/3705757236 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b00641b0 con 0x5571f5860aa0 2024-09-21T07:37:09.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1a7400640 1 -- 172.21.15.64:0/3705757236 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0068e30 con 0x5571f5860aa0 2024-09-21T07:37:09.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3705757236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 msgr2=0x5571f5cb2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00049e0 tx=0x7fa1b005ee40 comp rx=0 tx=0).stop 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3705757236 shutdown_connections 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5cb2470 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5cb1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3705757236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5b456d0 0x5571f5cb19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3705757236 >> 172.21.15.64:0/3705757236 conn(0x5571f57705c0 msgr2=0x5571f5c6eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3705757236 shutdown_connections 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3705757236 wait complete. 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 -- start start 2024-09-21T07:37:09.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.847+0000 7fa1c4f0c000 1 Processor -- start 2024-09-21T07:37:09.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5c6da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5b456d0 0x5571f5c745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5571f5ab6df0 con 0x5571f5860aa0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5571f5ab2fe0 con 0x5571f579c890 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5571f5a584d0 con 0x5571f5b456d0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 10 client.0 _ll_register_callbacks cb 0x5571f5a367f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1b6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5c6da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44962/0 (socket says 172.21.15.64:44962) 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 -- 172.21.15.64:0/2088851424 learned_addr learned my addr 172.21.15.64:0/2088851424 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1b7400640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5b456d0 0x5571f5c745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 -- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5b456d0 msgr2=0x5571f5c745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5b456d0 0x5571f5c745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 -- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 msgr2=0x5571f5c6da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5c6da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 -- 172.21.15.64:0/2088851424 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f5a51210 con 0x5571f5860aa0 2024-09-21T07:37:09.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1afe00640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009840 tx=0x7fa1a00054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e342ed7370de377d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00ac070 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fa1a0005ca0 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571f5a4b350 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fa1a0004020 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 10 client.11118 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x5571f5a37fc0 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5571f5a4b350 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fa1a00041c0 con 0x5571f5860aa0 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 10 client.11118 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 10 client.11118 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 20 client.11118 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5755930 0x5571f5cb8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 4 client.11118 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571f5ac5b00 con 0x5571f5755930 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5755930 0x5571f5cb8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5755930 0x5571f5cb8e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8995eeb2fe7ef16a server_cookie=7a48ea5729004979 in_seq=0 out_seq=0 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.851+0000 7fa19be00640 10 client.11118 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa19be00640 1 -- 172.21.15.64:0/2088851424 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571f5ac5b00 con 0x5571f5755930 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa19be00640 10 client.11118 handle_command_reply: tid=0 2024-09-21T07:37:09.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 client.11118 shutdown 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 msgr2=0x5571f5c6df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009840 tx=0x7fa1a00054f0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 shutdown_connections 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5755930 0x5571f5cb8e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5b456d0 0x5571f5c745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5860aa0 0x5571f5c6df40 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa19be00640 0 client.11118 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/2088851424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5c6da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 >> 172.21.15.64:0/2088851424 conn(0x5571f57705c0 msgr2=0x5571f5c66d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 shutdown_connections 2024-09-21T07:37:09.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/2088851424 wait complete. 2024-09-21T07:37:09.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.855+0000 7fa1c4f0c000 20 client.11118 trim_cache size 0 max 16384 2024-09-21T07:37:09.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.871+0000 7fa1c4f0c000 1 Processor -- start 2024-09-21T07:37:09.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.871+0000 7fa1c4f0c000 1 -- start start 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5d22de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5860aa0 0x5571f5d23320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5571f5c6cb20 con 0x5571f5b456d0 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8205f00 con 0x5571f5860aa0 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b8204f40 con 0x5571f579c890 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44972/0 (socket says 172.21.15.64:44972) 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 -- 172.21.15.64:0/1536400068 learned_addr learned my addr 172.21.15.64:0/1536400068 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1afe00640 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5860aa0 0x5571f5d23320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5d22de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 -- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 msgr2=0x5571f5d22de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5d22de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 -- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5860aa0 msgr2=0x5571f5d23320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5860aa0 0x5571f5d23320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 -- 172.21.15.64:0/1536400068 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f5b10680 con 0x5571f5b456d0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1b7400640 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00049e0 tx=0x7fa1b00931a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c10b44da91a742d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1a6a00640 1 -- 172.21.15.64:0/1536400068 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00641b0 con 0x5571f5b456d0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1a6a00640 1 -- 172.21.15.64:0/1536400068 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b005f6d0 con 0x5571f5b456d0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1a6a00640 1 -- 172.21.15.64:0/1536400068 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0068e30 con 0x5571f5b456d0 2024-09-21T07:37:09.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/1536400068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 msgr2=0x5571f5d23860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00049e0 tx=0x7fa1b00931a0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/1536400068 shutdown_connections 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d23860 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f5860aa0 0x5571f5d23320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/1536400068 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f579c890 0x5571f5d22de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/1536400068 >> 172.21.15.64:0/1536400068 conn(0x5571f57705c0 msgr2=0x5571f5cc2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/1536400068 shutdown_connections 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.875+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/1536400068 wait complete. 2024-09-21T07:37:09.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- start start 2024-09-21T07:37:09.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 Processor -- start 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5d27180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5860aa0 0x5571f5d276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8204ab0 con 0x5571f5b456d0 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b81f9a60 con 0x5571f579c890 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5571f5778680 con 0x5571f5860aa0 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 10 client.0 _ll_register_callbacks cb 0x7fa19c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:44988/0 (socket says 172.21.15.64:44988) 2024-09-21T07:37:09.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 -- 172.21.15.64:0/3963305064 learned_addr learned my addr 172.21.15.64:0/3963305064 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5d27180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1afe00640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5860aa0 0x5571f5d276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 -- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5860aa0 msgr2=0x5571f5d276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5860aa0 0x5571f5d276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 -- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 msgr2=0x5571f5d27180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5d27180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 -- 172.21.15.64:0/3963305064 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f5a7d0b0 con 0x5571f5b456d0 2024-09-21T07:37:09.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1b7400640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00932d0 tx=0x7fa1b005bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaf499f9d5bab85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:09.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:09.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0071060 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fa1b0079b90 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b005f6d0 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fa1b00641b0 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 10 client.11124 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x5571f5a49610 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b005f6d0 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fa1b00663e0 con 0x5571f5b456d0 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 10 client.11124 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 10 client.11124 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 20 client.11124 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5743990 0x5571f5ce2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 4 client.11124 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.879+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571f5ac15b0 con 0x5571f5743990 2024-09-21T07:37:09.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5743990 0x5571f5ce2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1b6a00640 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5743990 0x5571f5ce2830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=468155c8904c869 server_cookie=3ced936caf1e264e in_seq=0 out_seq=0 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa19be00640 10 client.11124 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa19be00640 1 -- 172.21.15.64:0/3963305064 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x5571f5ac15b0 con 0x5571f5743990 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa19be00640 10 client.11124 handle_command_reply: tid=0 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 client.11124 shutdown 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 msgr2=0x5571f5d27c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00932d0 tx=0x7fa1b005bbf0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 shutdown_connections 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x5571f5743990 0x5571f5ce2830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5571f5b456d0 0x5571f5d27c00 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5571f5860aa0 0x5571f5d276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 --2- 172.21.15.64:0/3963305064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5571f579c890 0x5571f5d27180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa19be00640 0 client.11124 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:09.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 >> 172.21.15.64:0/3963305064 conn(0x5571f57705c0 msgr2=0x5571f5c735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 shutdown_connections 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 1 -- 172.21.15.64:0/3963305064 wait complete. 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1c4f0c000 20 client.11124 trim_cache size 0 max 16384 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7": { 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7", 2024-09-21T07:37:09.885 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive,repair" 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7": { 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:37:09.647749+0000", 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:09.886 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 msgr2=0x7fa194075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 0x7fa194075740 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8007fd0 tx=0x7fa1a8009040 comp rx=0 tx=0).stop 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 msgr2=0x7fa1b80b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009fd0 tx=0x7fa1b000ef10 comp rx=0 tx=0).stop 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 shutdown_connections 2024-09-21T07:37:09.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa194073230 0x7fa194075740 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1b80ccd30 0x7fa1b80b13b0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1b80b3170 0x7fa1b80ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 --2- 172.21.15.64:0/503345189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1b80b28e0 0x7fa1b80c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 >> 172.21.15.64:0/503345189 conn(0x7fa1b806d570 msgr2=0x7fa1b81584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 shutdown_connections 2024-09-21T07:37:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:09.883+0000 7fa1bd800640 1 -- 172.21.15.64:0/503345189 wait complete. 2024-09-21T07:37:09.902 INFO:tasks.cephfs.filesystem:scrub status for tag:ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7 - {'path': '/', 'tag': 'ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7', 'options': 'recursive,repair'} 2024-09-21T07:37:10.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:10.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:39.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:39.904 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-21T07:37:40.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 -- 172.21.15.64:0/4060742708 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac640b4c70 msgr2=0x7fac6406ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 --2- 172.21.15.64:0/4060742708 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac640b4c70 0x7fac6406ef30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009bc0 tx=0x7fac5c01ca80 comp rx=0 tx=0).stop 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 -- 172.21.15.64:0/4060742708 shutdown_connections 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 --2- 172.21.15.64:0/4060742708 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac640b4c70 0x7fac6406ef30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 --2- 172.21.15.64:0/4060742708 >> v2:172.21.15.90:3300/0 conn(0x7fac640cd230 0x7fac640709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 -- 172.21.15.64:0/4060742708 >> 172.21.15.64:0/4060742708 conn(0x7fac640b1c60 msgr2=0x7fac640b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 -- 172.21.15.64:0/4060742708 shutdown_connections 2024-09-21T07:37:40.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.079+0000 7fac63e00640 1 -- 172.21.15.64:0/4060742708 wait complete. 2024-09-21T07:37:40.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 Processor -- start 2024-09-21T07:37:40.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 -- start start 2024-09-21T07:37:40.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac640b4c70 0x7fac641fa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac6415ff90 0x7fac6415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac6416a510 con 0x7fac640c9f40 2024-09-21T07:37:40.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac6416a390 con 0x7fac640b4c70 2024-09-21T07:37:40.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac6416a690 con 0x7fac6415ff90 2024-09-21T07:37:40.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54462/0 (socket says 172.21.15.64:54462) 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 -- 172.21.15.64:0/1970988820 learned_addr learned my addr 172.21.15.64:0/1970988820 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac62a00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac640b4c70 0x7fac641fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac62000640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac6415ff90 0x7fac6415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 -- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac6415ff90 msgr2=0x7fac6415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac6415ff90 0x7fac6415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 -- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac640b4c70 msgr2=0x7fac641fa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac640b4c70 0x7fac641fa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 -- 172.21.15.64:0/1970988820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6415a660 con 0x7fac640c9f40 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.083+0000 7fac63400640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fac5c01a6b0 tx=0x7fac5c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac5b400640 1 -- 172.21.15.64:0/1970988820 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0bb070 con 0x7fac640c9f40 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac5b400640 1 -- 172.21.15.64:0/1970988820 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac5c004d40 con 0x7fac640c9f40 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac5b400640 1 -- 172.21.15.64:0/1970988820 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0b2040 con 0x7fac640c9f40 2024-09-21T07:37:40.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac641fab70 con 0x7fac640c9f40 2024-09-21T07:37:40.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac6409c540 con 0x7fac640c9f40 2024-09-21T07:37:40.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.087+0000 7fac5b400640 1 -- 172.21.15.64:0/1970988820 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac6406fc80 con 0x7fac640c9f40 2024-09-21T07:37:40.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac5b400640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 0x7fac44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac5b400640 1 -- 172.21.15.64:0/1970988820 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fac5c12df40 con 0x7fac640c9f40 2024-09-21T07:37:40.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 Processor -- start 2024-09-21T07:37:40.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 -- start start 2024-09-21T07:37:40.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62a00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 0x7fac44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62a00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 0x7fac44075710 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fac54001870 tx=0x7fac54001380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaaed86d0 0x55cdab048de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab049860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cdaaee3cd0 con 0x55cdaab2f890 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdaadf9330 con 0x55cdaabf3aa0 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cdaae56bb0 con 0x55cdaaed86d0 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54470/0 (socket says 172.21.15.64:54470) 2024-09-21T07:37:40.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 -- 172.21.15.64:0/1386402531 learned_addr learned my addr 172.21.15.64:0/1386402531 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac63400640 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab049860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62a00640 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaaed86d0 0x55cdab048de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 -- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaaed86d0 msgr2=0x55cdab048de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaaed86d0 0x55cdab048de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 -- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 msgr2=0x55cdab049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab049860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 -- 172.21.15.64:0/1386402531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdaadfac80 con 0x55cdaab2f890 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac62000640 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fac50009bd0 tx=0x7fac50011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d1e1433d25441 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac4f400640 1 -- 172.21.15.64:0/1386402531 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50004230 con 0x55cdaab2f890 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac4f400640 1 -- 172.21.15.64:0/1386402531 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac500043d0 con 0x55cdaab2f890 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.091+0000 7fac4f400640 1 -- 172.21.15.64:0/1386402531 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50003800 con 0x55cdaab2f890 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- 172.21.15.64:0/1386402531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 msgr2=0x55cdab049320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fac50009bd0 tx=0x7fac50011810 comp rx=0 tx=0).stop 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- 172.21.15.64:0/1386402531 shutdown_connections 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab049860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaab2f890 0x55cdab049320 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- 172.21.15.64:0/1386402531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaaed86d0 0x55cdab048de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- 172.21.15.64:0/1386402531 >> 172.21.15.64:0/1386402531 conn(0x55cdaab035c0 msgr2=0x55cdaaffe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- 172.21.15.64:0/1386402531 shutdown_connections 2024-09-21T07:37:40.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- 172.21.15.64:0/1386402531 wait complete. 2024-09-21T07:37:40.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- start start 2024-09-21T07:37:40.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 Processor -- start 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab036610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab037610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cdaae49df0 con 0x55cdaabf3aa0 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdaae45fe0 con 0x55cdaaed86d0 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cdaadeb4d0 con 0x55cdaab2f890 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac713a7000 10 client.0 _ll_register_callbacks cb 0x55cdaadc97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54486/0 (socket says 172.21.15.64:54486) 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac62000640 1 -- 172.21.15.64:0/1325113161 learned_addr learned my addr 172.21.15.64:0/1325113161 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.095+0000 7fac62a00640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab036610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac63400640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab037610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 -- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 msgr2=0x55cdab036610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab036610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 -- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 msgr2=0x55cdab037610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab037610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 -- 172.21.15.64:0/1325113161 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdaade4210 con 0x55cdaabf3aa0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62000640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fac50000c10 tx=0x7fac50004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a45809b08ffeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5002a060 con 0x55cdaabf3aa0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fac50009e40 con 0x55cdaabf3aa0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cdaadde350 con 0x55cdaabf3aa0 2024-09-21T07:37:40.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fac50030050 con 0x55cdaabf3aa0 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 10 client.11133 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x55cdaadcafc0 con 0x55cdaabf3aa0 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cdaadde350 con 0x55cdaabf3aa0 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fac50033020 con 0x55cdaabf3aa0 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 10 client.11133 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 10 client.11133 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 20 client.11133 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaae8930 0x55cdab038020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 4 client.11133 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdaae58b00 con 0x55cdaaae8930 2024-09-21T07:37:40.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62a00640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaae8930 0x55cdab038020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac62a00640 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaae8930 0x55cdab038020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a96631be430155df server_cookie=561b7cbd74c86633 in_seq=0 out_seq=0 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 10 client.11133 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 1 -- 172.21.15.64:0/1325113161 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cdaae58b00 con 0x55cdaaae8930 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 10 client.11133 handle_command_reply: tid=0 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 client.11133 shutdown 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 msgr2=0x55cdab0370d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fac50000c10 tx=0x7fac50004650 comp rx=0 tx=0).stop 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 shutdown_connections 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaae8930 0x55cdab038020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab037610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0370d0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac43e00640 0 client.11133 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 --2- 172.21.15.64:0/1325113161 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab036610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 >> 172.21.15.64:0/1325113161 conn(0x55cdaab035c0 msgr2=0x55cdaaffe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 shutdown_connections 2024-09-21T07:37:40.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 1 -- 172.21.15.64:0/1325113161 wait complete. 2024-09-21T07:37:40.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.099+0000 7fac713a7000 20 client.11133 trim_cache size 0 max 16384 2024-09-21T07:37:40.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.119+0000 7fac713a7000 1 Processor -- start 2024-09-21T07:37:40.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.119+0000 7fac713a7000 1 -- start start 2024-09-21T07:37:40.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.119+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab05f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.119+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab05fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.119+0000 7fac713a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac64201e90 con 0x55cdaaed86d0 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac640cc4e0 con 0x55cdaabf3aa0 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac640cb840 con 0x55cdaab2f890 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54492/0 (socket says 172.21.15.64:54492) 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac62000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab05fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 -- 172.21.15.64:0/3592840395 learned_addr learned my addr 172.21.15.64:0/3592840395 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac62a00640 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab05f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 -- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 msgr2=0x55cdab05f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab05f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 -- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 msgr2=0x55cdab05fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab05fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 -- 172.21.15.64:0/3592840395 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdaaea3680 con 0x55cdaaed86d0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac62000640 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab05fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac63400640 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac5c098470 tx=0x7fac5c12c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51416959f5d2dbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac4ea00640 1 -- 172.21.15.64:0/3592840395 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0a5a40 con 0x55cdaaed86d0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac4ea00640 1 -- 172.21.15.64:0/3592840395 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac5c0f8710 con 0x55cdaaed86d0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac4ea00640 1 -- 172.21.15.64:0/3592840395 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0fd140 con 0x55cdaaed86d0 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- 172.21.15.64:0/3592840395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 msgr2=0x55cdaaffc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac5c098470 tx=0x7fac5c12c140 comp rx=0 tx=0).stop 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- 172.21.15.64:0/3592840395 shutdown_connections 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaaed86d0 0x55cdaaffc120 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaabf3aa0 0x55cdab05fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 --2- 172.21.15.64:0/3592840395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab05f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- 172.21.15.64:0/3592840395 >> 172.21.15.64:0/3592840395 conn(0x55cdaab035c0 msgr2=0x55cdab0480a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- 172.21.15.64:0/3592840395 shutdown_connections 2024-09-21T07:37:40.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- 172.21.15.64:0/3592840395 wait complete. 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 -- start start 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.123+0000 7fac713a7000 1 Processor -- start 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab0bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab0be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cdaae03450 con 0x55cdaabf3aa0 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdaae45fe0 con 0x55cdaaed86d0 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cdaae49df0 con 0x55cdaab2f890 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 10 client.0 _ll_register_callbacks cb 0x7fac50009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54506/0 (socket says 172.21.15.64:54506) 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 -- 172.21.15.64:0/2131354944 learned_addr learned my addr 172.21.15.64:0/2131354944 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac63400640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab0be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62a00640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab0bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 -- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 msgr2=0x55cdab0bddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab0bddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 -- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 msgr2=0x55cdab0be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab0be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 -- 172.21.15.64:0/2131354944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdaae100b0 con 0x55cdaabf3aa0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62000640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fac50000c10 tx=0x7fac500256a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2eedf6dd5655910 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50009a20 con 0x55cdaabf3aa0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fac50009e40 con 0x55cdaabf3aa0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac5c0f8710 con 0x55cdaabf3aa0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fac5003c050 con 0x55cdaabf3aa0 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 10 client.11139 fetch_fsmap learned FSMap version 152 2024-09-21T07:37:40.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x55cdaaddc610 con 0x55cdaabf3aa0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac5c0f8710 con 0x55cdaabf3aa0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fac5003f020 con 0x55cdaabf3aa0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 10 client.11139 fetch_fsmap finished waiting for FSMap version 152 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 10 client.11139 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 20 client.11139 populate_metadata read hostname 'smithi064' 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaad6990 0x55cdab05d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 4 client.11139 mds_command: new command op to 10276 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 --> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cdaae545b0 con 0x55cdaaad6990 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62a00640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaad6990 0x55cdab05d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 10 client.11139 ms_handle_connect on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac62a00640 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaad6990 0x55cdab05d330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a0a812ea75abc0 server_cookie=7312157384360c2a in_seq=0 out_seq=0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 1 -- 172.21.15.64:0/2131354944 <== mds.0 v2:172.21.15.64:6833/1772905039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55cdaae545b0 con 0x55cdaaad6990 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac43e00640 10 client.11139 handle_command_reply: tid=0 2024-09-21T07:37:40.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.127+0000 7fac713a7000 1 client.11139 shutdown 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 msgr2=0x55cdab0be310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fac50000c10 tx=0x7fac500256a0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 shutdown_connections 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:6833/1772905039,v1:172.21.15.64:6835/1772905039] conn(0x55cdaaad6990 0x55cdab05d330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cdaaed86d0 0x55cdab0be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cdaabf3aa0 0x55cdab0be310 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 --2- 172.21.15.64:0/2131354944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cdaab2f890 0x55cdab0bddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac43e00640 0 client.11139 ms_handle_reset on v2:172.21.15.64:6833/1772905039 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 >> 172.21.15.64:0/2131354944 conn(0x55cdaab035c0 msgr2=0x55cdab055050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 shutdown_connections 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 1 -- 172.21.15.64:0/2131354944 wait complete. 2024-09-21T07:37:40.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac713a7000 20 client.11139 trim_cache size 0 max 16384 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "ab658c6f-38e4-4ad6-83ba-dbe7a7ea93c7": { 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:37:09.647749+0000", 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:37:40.132 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:40.133 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:40.133 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:40.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 msgr2=0x7fac44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 0x7fac44075710 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fac54001870 tx=0x7fac54001380 comp rx=0 tx=0).stop 2024-09-21T07:37:40.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 msgr2=0x7fac6409cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fac5c01a6b0 tx=0x7fac5c003f60 comp rx=0 tx=0).stop 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 shutdown_connections 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac44073200 0x7fac44075710 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac640c9f40 0x7fac6409cd40 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac6415ff90 0x7fac6415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 --2- 172.21.15.64:0/1970988820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac640b4c70 0x7fac641fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 >> 172.21.15.64:0/1970988820 conn(0x7fac640b1c60 msgr2=0x7fac640b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 shutdown_connections 2024-09-21T07:37:40.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.131+0000 7fac63e00640 1 -- 172.21.15.64:0/1970988820 wait complete. 2024-09-21T07:37:40.149 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> import stat 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> import json 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> import sys 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> except OSError as e: 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> sys.exit(e.errno) 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> print(json.dumps( 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-21T07:37:40.150 DEBUG:teuthology.orchestra.run.smithi064:> indent=2)) 2024-09-21T07:37:40.151 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mode": 33204, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ino": 1099511627777, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_dev": 44, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_nlink": 1, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_uid": 1000, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_gid": 1271, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_size": 6291456, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_atime": 1726904228.3517697, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_mtime": 1726904228.387769, 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout: "st_ctime": 1726904228.387769 2024-09-21T07:37:40.223 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:40.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:37:40.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- 172.21.15.64:0/1736424026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 msgr2=0x7f9a08073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 --2- 172.21.15.64:0/1736424026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a08073960 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f9a08070370 tx=0x7f99f801c820 comp rx=0 tx=0).stop 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- 172.21.15.64:0/1736424026 shutdown_connections 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 --2- 172.21.15.64:0/1736424026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a08073960 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- 172.21.15.64:0/1736424026 >> 172.21.15.64:0/1736424026 conn(0x7f9a080b29e0 msgr2=0x7f9a080b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- 172.21.15.64:0/1736424026 shutdown_connections 2024-09-21T07:37:40.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- 172.21.15.64:0/1736424026 wait complete. 2024-09-21T07:37:40.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 Processor -- start 2024-09-21T07:37:40.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.435+0000 7f9a0f800640 1 -- start start 2024-09-21T07:37:40.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a08073ea0 0x7f9a081435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 0x7f9a080b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0816b080 con 0x7f9a080d04b0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0816af00 con 0x7f9a0815d480 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0816b200 con 0x7f9a08073ea0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54528/0 (socket says 172.21.15.64:54528) 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 -- 172.21.15.64:0/2408867004 learned_addr learned my addr 172.21.15.64:0/2408867004 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0ce00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a08073ea0 0x7f9a081435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0d800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 0x7f9a080b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 -- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a08073ea0 msgr2=0x7f9a081435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a08073ea0 0x7f9a081435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 -- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 msgr2=0x7f9a080b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 0x7f9a080b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 -- 172.21.15.64:0/2408867004 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0815b0c0 con 0x7f9a080d04b0 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0d800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 0x7f9a080b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:40.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f99ffe00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c390 tx=0x7f99f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0017070 con 0x7f9a080d04b0 2024-09-21T07:37:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f00053c0 con 0x7f9a080d04b0 2024-09-21T07:37:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a080af9f0 con 0x7f9a080d04b0 2024-09-21T07:37:40.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0003840 con 0x7f9a080d04b0 2024-09-21T07:37:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a080ae8b0 con 0x7f9a080d04b0 2024-09-21T07:37:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.439+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a080af760 con 0x7f9a080d04b0 2024-09-21T07:37:40.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.443+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99f001a070 con 0x7f9a080d04b0 2024-09-21T07:37:40.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.443+0000 7f9a05600640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 0x7f99e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.443+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f99f00936f0 con 0x7f9a080d04b0 2024-09-21T07:37:40.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.443+0000 7f9a0ce00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 0x7f99e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.443+0000 7f9a0ce00640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 0x7f99e4075710 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f99f80af000 tx=0x7f99f801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.447+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f99f005deb0 con 0x7f9a080d04b0 2024-09-21T07:37:40.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.659+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a08073960 con 0x7f9a080d04b0 2024-09-21T07:37:40.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.659+0000 7f9a05600640 1 -- 172.21.15.64:0/2408867004 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7f99f00628e0 con 0x7f9a080d04b0 2024-09-21T07:37:40.659 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:40.659 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:40.659 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 msgr2=0x7f99e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 0x7f99e4075710 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f99f80af000 tx=0x7f99f801b060 comp rx=0 tx=0).stop 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 msgr2=0x7f9a0815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c390 tx=0x7f99f000c850 comp rx=0 tx=0).stop 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 shutdown_connections 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f99e4073200 0x7f99e4075710 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a0815d480 0x7f9a080b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a080d04b0 0x7f9a0815ab80 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 --2- 172.21.15.64:0/2408867004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a08073ea0 0x7f9a081435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 >> 172.21.15.64:0/2408867004 conn(0x7f9a080b29e0 msgr2=0x7f9a080b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 shutdown_connections 2024-09-21T07:37:40.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.663+0000 7f9a0f800640 1 -- 172.21.15.64:0/2408867004 wait complete. 2024-09-21T07:37:40.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-21T07:37:40.761 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:40.764 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:40.863 INFO:teuthology.orchestra.run.smithi064.stdout:{"message":"","return_code":0} 2024-09-21T07:37:40.864 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-21T07:37:40.864 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-21T07:37:40.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 Processor -- start 2024-09-21T07:37:40.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- start start 2024-09-21T07:37:40.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f663c003100 0x5610c0f54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 0x5610c1028e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610c0f02f40 con 0x5610c0f55000 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5610c0f0fd00 con 0x5610c0f80c50 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5610c0ea4a00 con 0x7f663c003100 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54544/0 (socket says 172.21.15.64:54544) 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 -- 172.21.15.64:0/2672930289 learned_addr learned my addr 172.21.15.64:0/2672930289 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656a00640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f663c003100 0x5610c0f54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6657400640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 0x5610c1028e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 -- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f663c003100 msgr2=0x5610c0f54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f663c003100 0x5610c0f54ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 -- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 msgr2=0x5610c1028e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:37:40.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 0x5610c1028e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 -- 172.21.15.64:0/2672930289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610c0f82430 con 0x5610c0f55000 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6657400640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 0x5610c1028e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6656000640 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f664401b0b0 tx=0x7f663c004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f50d195e89ec652 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6654c00640 1 -- 172.21.15.64:0/2672930289 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66440bb070 con 0x5610c0f55000 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6654c00640 1 -- 172.21.15.64:0/2672930289 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66440ab6f0 con 0x5610c0f55000 2024-09-21T07:37:40.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f6654c00640 1 -- 172.21.15.64:0/2672930289 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66440b0040 con 0x5610c0f55000 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- 172.21.15.64:0/2672930289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 msgr2=0x5610c0f80710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f664401b0b0 tx=0x7f663c004130 comp rx=0 tx=0).stop 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- 172.21.15.64:0/2672930289 shutdown_connections 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f80c50 0x5610c1028e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610c0f55000 0x5610c0f80710 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 --2- 172.21.15.64:0/2672930289 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f663c003100 0x5610c0f54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.967+0000 7f665d7e8080 1 -- 172.21.15.64:0/2672930289 >> 172.21.15.64:0/2672930289 conn(0x5610c0f42da0 msgr2=0x5610c0f55a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- 172.21.15.64:0/2672930289 shutdown_connections 2024-09-21T07:37:40.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- 172.21.15.64:0/2672930289 wait complete. 2024-09-21T07:37:40.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 Processor -- start 2024-09-21T07:37:40.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- start start 2024-09-21T07:37:40.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f55000 0x5610c100f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610c0f80c50 0x5610c0f7f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 0x5610c0f557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610c0f826d0 con 0x7f663c003100 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5610c0f82970 con 0x5610c0f55000 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f665d7e8080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x5610c0f82c10 con 0x5610c0f80c50 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 0x5610c0f557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 0x5610c0f557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54560/0 (socket says 172.21.15.64:54560) 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 -- 172.21.15.64:0/293068008 learned_addr learned my addr 172.21.15.64:0/293068008 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6656000640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610c0f80c50 0x5610c0f7f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6656a00640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f55000 0x5610c100f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 -- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610c0f80c50 msgr2=0x5610c0f7f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610c0f80c50 0x5610c0f7f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 -- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f55000 msgr2=0x5610c100f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610c0f55000 0x5610c100f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 -- 172.21.15.64:0/293068008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610c10ba230 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.971+0000 7f6657400640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 0x5610c0f557a0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f665000b610 tx=0x7f665000bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 -- 172.21.15.64:0/293068008 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000e7d0 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 -- 172.21.15.64:0/293068008 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f665000e970 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610c0f9a010 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 -- 172.21.15.64:0/293068008 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000eda0 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610c0f9a550 con 0x7f663c003100 2024-09-21T07:37:40.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 -- 172.21.15.64:0/293068008 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f665000d3c0 con 0x7f663c003100 2024-09-21T07:37:40.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6638071be0 0x7f66380740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f664f400640 1 -- 172.21.15.64:0/293068008 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f6650093e40 con 0x7f663c003100 2024-09-21T07:37:40.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f6656a00640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6638071be0 0x7f66380740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f665d7e8080 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x5610c10c6eb0 0x5610c10c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:40.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e206) -- 0x5610c10c7800 con 0x5610c10c6eb0 2024-09-21T07:37:40.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.975+0000 7f6656000640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x5610c10c6eb0 0x5610c10c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:40.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f6656a00640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6638071be0 0x7f66380740f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6648001870 tx=0x7f6648012040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f6656000640 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x5610c10c6eb0 0x5610c10c72c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f6656000640 1 -- 172.21.15.64:0/293068008 <== osd.2 v2:172.21.15.64:6808/3196938996 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f66440be040 con 0x5610c10c6eb0 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x5610c10c6eb0 msgr2=0x5610c10c72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x5610c10c6eb0 0x5610c10c72c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6638071be0 msgr2=0x7f66380740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6638071be0 0x7f66380740f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6648001870 tx=0x7f6648012040 comp rx=0 tx=0).stop 2024-09-21T07:37:40.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 msgr2=0x5610c0f557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 --2- 172.21.15.64:0/293068008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f663c003100 0x5610c0f557a0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f665000b610 tx=0x7f665000bad0 comp rx=0 tx=0).stop 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f6657400640 1 -- 172.21.15.64:0/293068008 reap_dead start 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 shutdown_connections 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 >> 172.21.15.64:0/293068008 conn(0x5610c0f42da0 msgr2=0x5610c0f9fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 shutdown_connections 2024-09-21T07:37:40.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:40.979+0000 7f665d7e8080 1 -- 172.21.15.64:0/293068008 wait complete. 2024-09-21T07:37:40.983 INFO:teuthology.orchestra.run.smithi064.stdout:Ysixmegssubdir  2024-09-21T07:37:40.984 DEBUG:teuthology.orchestra.run.smithi064:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-21T07:37:41.057 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:41.057 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 1099511627777, 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "ancestors": [ 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "dirino": 1099511627776, 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "dname": "sixmegs", 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "version": 8 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "dirino": 1, 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "dname": "subdir", 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "version": 11 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2024-09-21T07:37:41.058 INFO:teuthology.orchestra.run.smithi064.stdout: "pool": 30, 2024-09-21T07:37:41.059 INFO:teuthology.orchestra.run.smithi064.stdout: "old_pools": [] 2024-09-21T07:37:41.059 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:41.059 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:41.063 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:37:41.063 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:37:41.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:37:41.304 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:37:41.304 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:37:41.305 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:41.305 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:41.314 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:41.314 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:41.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:37:41.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 -- 172.21.15.64:0/1152664404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 msgr2=0x7fada8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:41.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 --2- 172.21.15.64:0/1152664404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada8070e30 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fada0009bc0 tx=0x7fada001cba0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 -- 172.21.15.64:0/1152664404 shutdown_connections 2024-09-21T07:37:41.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 --2- 172.21.15.64:0/1152664404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada8070e30 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 --2- 172.21.15.64:0/1152664404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada80d04b0 0x7fada8073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 -- 172.21.15.64:0/1152664404 >> 172.21.15.64:0/1152664404 conn(0x7fada80b29e0 msgr2=0x7fada80b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:41.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 -- 172.21.15.64:0/1152664404 shutdown_connections 2024-09-21T07:37:41.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.571+0000 7fadad800640 1 -- 172.21.15.64:0/1152664404 wait complete. 2024-09-21T07:37:41.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 Processor -- start 2024-09-21T07:37:41.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 -- start start 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada8073ea0 0x7fada815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada80d04b0 0x7fada815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fada8169fd0 con 0x7fada815d480 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fada8169e50 con 0x7fada80d04b0 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fadad800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fada816a150 con 0x7fada8073ea0 2024-09-21T07:37:41.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fada7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fada7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54578/0 (socket says 172.21.15.64:54578) 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fada7400640 1 -- 172.21.15.64:0/1838150016 learned_addr learned my addr 172.21.15.64:0/1838150016 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fada6a00640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada8073ea0 0x7fada815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.575+0000 7fad9e000640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada80d04b0 0x7fada815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 -- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada8073ea0 msgr2=0x7fada815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada8073ea0 0x7fada815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 -- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada80d04b0 msgr2=0x7fada815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada80d04b0 0x7fada815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 -- 172.21.15.64:0/1838150016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada80b5c30 con 0x7fada815d480 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fada7400640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fada00b0040 tx=0x7fada0005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00b2040 con 0x7fada815d480 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada00bb070 con 0x7fada815d480 2024-09-21T07:37:41.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada80b4270 con 0x7fada815d480 2024-09-21T07:37:41.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00045b0 con 0x7fada815d480 2024-09-21T07:37:41.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada81fcea0 con 0x7fada815d480 2024-09-21T07:37:41.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada8073960 con 0x7fada815d480 2024-09-21T07:37:41.580 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.579+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fada8071b80 con 0x7fada815d480 2024-09-21T07:37:41.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.583+0000 7fad9f400640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 0x7fad84075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:41.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.583+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fada012ea00 con 0x7fada815d480 2024-09-21T07:37:41.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.583+0000 7fada6a00640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 0x7fad84075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:41.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.583+0000 7fada6a00640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 0x7fad84075740 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fad98004630 tx=0x7fad9800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:41.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.587+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fada00a5e20 con 0x7fada815d480 2024-09-21T07:37:41.777 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fada815e690 con 0x7fada815d480 2024-09-21T07:37:41.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fad9f400640 1 -- 172.21.15.64:0/1838150016 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v206) ==== 80+0+0 (secure 0 0 0) 0x7fada0016790 con 0x7fada815d480 2024-09-21T07:37:41.778 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:37:41.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 msgr2=0x7fad84075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:41.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 0x7fad84075740 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fad98004630 tx=0x7fad9800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 msgr2=0x7fada80b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fada00b0040 tx=0x7fada0005a60 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 shutdown_connections 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad84073230 0x7fad84075740 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fada815d480 0x7fada80b4c00 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada80d04b0 0x7fada815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 --2- 172.21.15.64:0/1838150016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada8073ea0 0x7fada815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:41.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 >> 172.21.15.64:0/1838150016 conn(0x7fada80b29e0 msgr2=0x7fada80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:41.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 shutdown_connections 2024-09-21T07:37:41.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:41.779+0000 7fadad800640 1 -- 172.21.15.64:0/1838150016 wait complete. 2024-09-21T07:37:41.801 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:37:41.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:41.801 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:37:41.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:37:41.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:37:41.873 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:37:41.891 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:37:41.891 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:37:41.892 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:41.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:37:41.901 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:37:41.901 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:41.901 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:41.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:37:41.940 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:37:41.940 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:37:41.940 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:41.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:37:41.954 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:42.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 -- 172.21.15.64:0/3973900950 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb415af70 msgr2=0x7fbbb406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/3973900950 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb415af70 0x7fbbb406f0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40cfff0 tx=0x7fbba401cd40 comp rx=0 tx=0).stop 2024-09-21T07:37:42.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 -- 172.21.15.64:0/3973900950 shutdown_connections 2024-09-21T07:37:42.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/3973900950 >> v2:172.21.15.90:3300/0 conn(0x7fbbb4074af0 0x7fbbb40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/3973900950 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb415af70 0x7fbbb406f0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 -- 172.21.15.64:0/3973900950 >> 172.21.15.64:0/3973900950 conn(0x7fbbb406d570 msgr2=0x7fbbb40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:42.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 -- 172.21.15.64:0/3973900950 shutdown_connections 2024-09-21T07:37:42.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 -- 172.21.15.64:0/3973900950 wait complete. 2024-09-21T07:37:42.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.143+0000 7fbbb8a00640 1 Processor -- start 2024-09-21T07:37:42.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- start start 2024-09-21T07:37:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb406f610 0x7fbbb40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 0x7fbbb40cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4167dd0 con 0x7fbbb4074af0 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4167c50 con 0x7fbbb415af70 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb4167f50 con 0x7fbbb406f610 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb1e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb406f610 0x7fbbb40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54594/0 (socket says 172.21.15.64:54594) 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 0x7fbbb40cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 -- 172.21.15.64:0/776999952 learned_addr learned my addr 172.21.15.64:0/776999952 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 -- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb406f610 msgr2=0x7fbbb40aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb406f610 0x7fbbb40aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 -- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 msgr2=0x7fbbb40cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 0x7fbbb40cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 -- 172.21.15.64:0/776999952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb4158970 con 0x7fbbb4074af0 2024-09-21T07:37:42.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb2800640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 0x7fbbb40cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:37:42.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbba9400640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c430 tx=0x7fbb9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c017070 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb9c0053e0 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb4158c50 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c003860 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb4159210 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.147+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb41586e0 con 0x7fbbb4074af0 2024-09-21T07:37:42.149 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.151+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbb9c01a070 con 0x7fbbb4074af0 2024-09-21T07:37:42.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.151+0000 7fbbaaa00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 0x7fbb90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.151+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fbb9c0937e0 con 0x7fbbb4074af0 2024-09-21T07:37:42.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.151+0000 7fbbb1e00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 0x7fbb90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.151+0000 7fbbb1e00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 0x7fbb90075710 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fbba40af000 tx=0x7fbba401b5e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.155+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbb9c05dfd0 con 0x7fbbb4074af0 2024-09-21T07:37:42.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.379+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbb406f0d0 con 0x7fbbb4074af0 2024-09-21T07:37:42.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbaaa00640 1 -- 172.21.15.64:0/776999952 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7fbb9c062a00 con 0x7fbbb4074af0 2024-09-21T07:37:42.381 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:42.381 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:42.381 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 msgr2=0x7fbb90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 0x7fbb90075710 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fbba40af000 tx=0x7fbba401b5e0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 msgr2=0x7fbbb41fbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c430 tx=0x7fbb9c00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 shutdown_connections 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbb90073200 0x7fbb90075710 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbb415af70 0x7fbbb40cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbbb4074af0 0x7fbbb41fbac0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 --2- 172.21.15.64:0/776999952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbbb406f610 0x7fbbb40aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 >> 172.21.15.64:0/776999952 conn(0x7fbbb406d570 msgr2=0x7fbbb4073b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:42.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 shutdown_connections 2024-09-21T07:37:42.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.383+0000 7fbbb8a00640 1 -- 172.21.15.64:0/776999952 wait complete. 2024-09-21T07:37:42.403 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 -- 172.21.15.64:0/3906438485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 msgr2=0x7f478c1674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 --2- 172.21.15.64:0/3906438485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c1674e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4784009bf0 tx=0x7f478401cbe0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 -- 172.21.15.64:0/3906438485 shutdown_connections 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 --2- 172.21.15.64:0/3906438485 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c1674e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 -- 172.21.15.64:0/3906438485 >> 172.21.15.64:0/3906438485 conn(0x7f478c0b29e0 msgr2=0x7f478c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:42.563 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 -- 172.21.15.64:0/3906438485 shutdown_connections 2024-09-21T07:37:42.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.563+0000 7f4791400640 1 -- 172.21.15.64:0/3906438485 wait complete. 2024-09-21T07:37:42.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 Processor -- start 2024-09-21T07:37:42.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- start start 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 0x7f478c150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f478c16b180 con 0x7f478c0d04b0 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f478c16b000 con 0x7f478c153250 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f478c16b300 con 0x7f478c15d480 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54600/0 (socket says 172.21.15.64:54600) 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 -- 172.21.15.64:0/1678997070 learned_addr learned my addr 172.21.15.64:0/1678997070 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478b200640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 0x7f478c150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4781e00640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 -- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 msgr2=0x7f478c152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 -- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 msgr2=0x7f478c150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 0x7f478c150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 -- 172.21.15.64:0/1678997070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c153660 con 0x7f478c0d04b0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478b200640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 0x7f478c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f478a800640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c430 tx=0x7f477c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c011790 con 0x7f478c0d04b0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f477c017070 con 0x7f478c0d04b0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c011cc0 con 0x7f478c0d04b0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c151660 con 0x7f478c0d04b0 2024-09-21T07:37:42.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.567+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c151c20 con 0x7f478c0d04b0 2024-09-21T07:37:42.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.571+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c151e60 con 0x7f478c0d04b0 2024-09-21T07:37:42.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.571+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f477c01c460 con 0x7f478c0d04b0 2024-09-21T07:37:42.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.571+0000 7f4783400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 0x7f4768075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.571+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f477c094340 con 0x7f478c0d04b0 2024-09-21T07:37:42.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.571+0000 7f4781e00640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 0x7f4768075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.575+0000 7f4781e00640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 0x7f4768075740 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f478c14ec10 tx=0x7f4774009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.575+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f478c153660 con 0x7f478c0d04b0 2024-09-21T07:37:42.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.791+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f478c15cd70 con 0x7f478c0d04b0 2024-09-21T07:37:42.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.791+0000 7f4783400640 1 -- 172.21.15.64:0/1678997070 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7f477c05f040 con 0x7f478c0d04b0 2024-09-21T07:37:42.791 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:42.791 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:42.792 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:42.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 msgr2=0x7f4768075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 0x7f4768075740 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f478c14ec10 tx=0x7f4774009040 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 msgr2=0x7f478c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c430 tx=0x7f477c00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 shutdown_connections 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4768073230 0x7f4768075740 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f478c153250 0x7f478c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f478c15d480 0x7f478c152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 --2- 172.21.15.64:0/1678997070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0d04b0 0x7f478c15be00 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 >> 172.21.15.64:0/1678997070 conn(0x7f478c0b29e0 msgr2=0x7f478c153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 shutdown_connections 2024-09-21T07:37:42.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.795+0000 7f4791400640 1 -- 172.21.15.64:0/1678997070 wait complete. 2024-09-21T07:37:42.814 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 -- 172.21.15.64:0/3096334894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 msgr2=0x7fa7440b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 --2- 172.21.15.64:0/3096334894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa7440b4160 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fa74406a1d0 tx=0x7fa72c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 -- 172.21.15.64:0/3096334894 shutdown_connections 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 --2- 172.21.15.64:0/3096334894 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa7440715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 --2- 172.21.15.64:0/3096334894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa7440b4160 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 --2- 172.21.15.64:0/3096334894 >> v2:172.21.15.90:3300/0 conn(0x7fa74415c800 0x7fa7440ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 -- 172.21.15.64:0/3096334894 >> 172.21.15.64:0/3096334894 conn(0x7fa74406d430 msgr2=0x7fa7440ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:42.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 -- 172.21.15.64:0/3096334894 shutdown_connections 2024-09-21T07:37:42.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 -- 172.21.15.64:0/3096334894 wait complete. 2024-09-21T07:37:42.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.975+0000 7fa749000640 1 Processor -- start 2024-09-21T07:37:42.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- start start 2024-09-21T07:37:42.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa744158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 0x7fa74415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440b5f30 con 0x7fa7440b3d50 2024-09-21T07:37:42.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440b5db0 con 0x7fa74415c800 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa7441692e0 con 0x7fa7440711d0 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54618/0 (socket says 172.21.15.64:54618) 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 -- 172.21.15.64:0/4016898714 learned_addr learned my addr 172.21.15.64:0/4016898714 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa743400640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa744158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa743e00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 0x7fa74415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 -- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 msgr2=0x7fa744158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa744158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 -- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 msgr2=0x7fa74415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 0x7fa74415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 -- 172.21.15.64:0/4016898714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa744152770 con 0x7fa7440b3d50 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa743400640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa744158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa743e00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 0x7fa74415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:42.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73aa00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01af70 tx=0x7fa72c005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0b2040 con 0x7fa7440b3d50 2024-09-21T07:37:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa72c004320 con 0x7fa7440b3d50 2024-09-21T07:37:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7441f7040 con 0x7fa7440b3d50 2024-09-21T07:37:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0052d0 con 0x7fa7440b3d50 2024-09-21T07:37:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7441f72c0 con 0x7fa7440b3d50 2024-09-21T07:37:42.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.979+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7440b4160 con 0x7fa7440b3d50 2024-09-21T07:37:42.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.983+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa72c005470 con 0x7fa7440b3d50 2024-09-21T07:37:42.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.983+0000 7fa73be00640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 0x7fa720075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:42.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.983+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fa72c12e240 con 0x7fa7440b3d50 2024-09-21T07:37:42.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.983+0000 7fa743400640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 0x7fa720075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:42.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.983+0000 7fa743400640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 0x7fa720075740 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ac0 tx=0x7fa7340091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:42.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:42.987+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa7441f7040 con 0x7fa7440b3d50 2024-09-21T07:37:43.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.167+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa744159710 con 0x7fa7440b3d50 2024-09-21T07:37:43.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.167+0000 7fa73be00640 1 -- 172.21.15.64:0/4016898714 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+17094 (secure 0 0 0) 0x7fa72c0bd060 con 0x7fa7440b3d50 2024-09-21T07:37:43.178 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:43.178 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":206,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:31.788781+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:36:53.378206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-21T07:36:54.572346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.10","mappings":[{"from":6,"to":0}]},{"pgid":"29.13","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:43.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 msgr2=0x7fa720075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 0x7fa720075740 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ac0 tx=0x7fa7340091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 msgr2=0x7fa74414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01af70 tx=0x7fa72c005d60 comp rx=0 tx=0).stop 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 shutdown_connections 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa720073230 0x7fa720075740 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74415c800 0x7fa74415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7440b3d50 0x7fa74414f500 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 --2- 172.21.15.64:0/4016898714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa7440711d0 0x7fa744158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 >> 172.21.15.64:0/4016898714 conn(0x7fa74406d430 msgr2=0x7fa74415d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 shutdown_connections 2024-09-21T07:37:43.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.171+0000 7fa749000640 1 -- 172.21.15.64:0/4016898714 wait complete. 2024-09-21T07:37:43.192 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:37:43.192 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:43.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- 172.21.15.64:0/3173131284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78200caf00 msgr2=0x7f78200cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 --2- 172.21.15.64:0/3173131284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78200caf00 0x7f78200cb310 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f7818009bf0 tx=0x7f781801cba0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- 172.21.15.64:0/3173131284 shutdown_connections 2024-09-21T07:37:43.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 --2- 172.21.15.64:0/3173131284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78200caf00 0x7f78200cb310 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 --2- 172.21.15.64:0/3173131284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200b4e00 0x7f78200af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- 172.21.15.64:0/3173131284 >> 172.21.15.64:0/3173131284 conn(0x7f782006d570 msgr2=0x7f78200b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:43.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- 172.21.15.64:0/3173131284 shutdown_connections 2024-09-21T07:37:43.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- 172.21.15.64:0/3173131284 wait complete. 2024-09-21T07:37:43.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 Processor -- start 2024-09-21T07:37:43.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.355+0000 7f7825c00640 1 -- start start 2024-09-21T07:37:43.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200caf00 0x7f78200b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78200c5e20 0x7f78200b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7820168e60 con 0x7f782006fae0 2024-09-21T07:37:43.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7820168ce0 con 0x7f78200c5e20 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7820168fe0 con 0x7f78200caf00 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54626/0 (socket says 172.21.15.64:54626) 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 -- 172.21.15.64:0/4037010822 learned_addr learned my addr 172.21.15.64:0/4037010822 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781f400640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78200c5e20 0x7f78200b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7817e00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200caf00 0x7f78200b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 -- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200caf00 msgr2=0x7f78200b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200caf00 0x7f78200b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 -- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78200c5e20 msgr2=0x7f78200b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78200c5e20 0x7f78200b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 -- 172.21.15.64:0/4037010822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782015a020 con 0x7f782006fae0 2024-09-21T07:37:43.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f781ea00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f781000c460 tx=0x7f781000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810016020 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7810012940 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782015a300 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810012d90 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782015a8c0 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.359+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78200af790 con 0x7f782006fae0 2024-09-21T07:37:43.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.363+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7810019020 con 0x7f782006fae0 2024-09-21T07:37:43.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.363+0000 7f7816a00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 0x7f77fc075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.363+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f7810094400 con 0x7f782006fae0 2024-09-21T07:37:43.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.363+0000 7f7817e00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 0x7f77fc075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.363+0000 7f7817e00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 0x7f77fc075770 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f78080058d0 tx=0x7f7808005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:43.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.367+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7810020020 con 0x7f782006fae0 2024-09-21T07:37:43.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78200cced0 con 0x7f782006fae0 2024-09-21T07:37:43.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7816a00640 1 -- 172.21.15.64:0/4037010822 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7f781005f240 con 0x7f782006fae0 2024-09-21T07:37:43.582 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:43.582 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:43.582 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 msgr2=0x7f77fc075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 0x7f77fc075770 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f78080058d0 tx=0x7f7808005860 comp rx=0 tx=0).stop 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 msgr2=0x7f782015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f781000c460 tx=0x7f781000c920 comp rx=0 tx=0).stop 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 shutdown_connections 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f77fc073260 0x7f77fc075770 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78200c5e20 0x7f78200b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78200caf00 0x7f78200b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 --2- 172.21.15.64:0/4037010822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f782006fae0 0x7f782015b370 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 >> 172.21.15.64:0/4037010822 conn(0x7f782006d570 msgr2=0x7f78200cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 shutdown_connections 2024-09-21T07:37:43.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.583+0000 7f7825c00640 1 -- 172.21.15.64:0/4037010822 wait complete. 2024-09-21T07:37:43.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 -- 172.21.15.64:0/1019736659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82a8005290 msgr2=0x7f82a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 --2- 172.21.15.64:0/1019736659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82a8005290 0x7f82a800b9d0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f82bc002120 tx=0x7f82bc01cc40 comp rx=0 tx=0).stop 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 -- 172.21.15.64:0/1019736659 shutdown_connections 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 --2- 172.21.15.64:0/1019736659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82a8005290 0x7f82a800b9d0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 -- 172.21.15.64:0/1019736659 >> 172.21.15.64:0/1019736659 conn(0x7f82c406d570 msgr2=0x7f82c40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 -- 172.21.15.64:0/1019736659 shutdown_connections 2024-09-21T07:37:43.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.763+0000 7f82c8c00640 1 -- 172.21.15.64:0/1019736659 wait complete. 2024-09-21T07:37:43.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 Processor -- start 2024-09-21T07:37:43.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- start start 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005290 0x7f82c4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c4154d30 0x7f82c41f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82c40afb20 con 0x7f82c41f3770 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82c40af9a0 con 0x7f82c4154d30 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f82c40b4b00 con 0x7f82a8005290 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54632/0 (socket says 172.21.15.64:54632) 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 -- 172.21.15.64:0/476158350 learned_addr learned my addr 172.21.15.64:0/476158350 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 -- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005290 msgr2=0x7f82c4157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005290 0x7f82c4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 -- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c4154d30 msgr2=0x7f82c41f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c4154d30 0x7f82c41f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 -- 172.21.15.64:0/476158350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c40bf920 con 0x7f82c41f3770 2024-09-21T07:37:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c2800640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f82bc01d4e0 tx=0x7f82bc004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:43.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0a59e0 con 0x7f82c41f3770 2024-09-21T07:37:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82bc0015b0 con 0x7f82c41f3770 2024-09-21T07:37:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc006360 con 0x7f82c41f3770 2024-09-21T07:37:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c40bc800 con 0x7f82c41f3770 2024-09-21T07:37:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.767+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c4157520 con 0x7f82c41f3770 2024-09-21T07:37:43.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c40ca340 con 0x7f82c41f3770 2024-09-21T07:37:43.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f82bc0bb020 con 0x7f82c41f3770 2024-09-21T07:37:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82baa00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 0x7f82a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f82bc12e420 con 0x7f82c41f3770 2024-09-21T07:37:43.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82c1e00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 0x7f82a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:43.772 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.771+0000 7f82c1e00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 0x7f82a0075710 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009510 tx=0x7f82b40093c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.775+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f82bc0c2020 con 0x7f82c41f3770 2024-09-21T07:37:43.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.987+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82c40b3170 con 0x7f82c41f3770 2024-09-21T07:37:43.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82baa00640 1 -- 172.21.15.64:0/476158350 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5237 (secure 0 0 0) 0x7f82c40ccbc0 con 0x7f82c41f3770 2024-09-21T07:37:43.989 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:43.989 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":152,"btime":"2024-09-21T07:36:59:219749+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:36:55.615208+0000","modified":"2024-09-21T07:36:58.640332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10276":{"gid":10276,"name":"a","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1772905039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1772905039},{"type":"v1","addr":"172.21.15.64:6835","nonce":1772905039}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10276,"qdb_cluster":[10276]},"id":14}]} 2024-09-21T07:37:43.989 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 152 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 msgr2=0x7f82a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 0x7f82a0075710 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009510 tx=0x7f82b40093c0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 msgr2=0x7f82c415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f82bc01d4e0 tx=0x7f82bc004f70 comp rx=0 tx=0).stop 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 shutdown_connections 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f82a0073200 0x7f82a0075710 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c41f3770 0x7f82c415cc30 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c4154d30 0x7f82c41f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 --2- 172.21.15.64:0/476158350 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005290 0x7f82c4157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:43.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 >> 172.21.15.64:0/476158350 conn(0x7f82c406d570 msgr2=0x7f82c4072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:43.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 shutdown_connections 2024-09-21T07:37:43.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:43.991+0000 7f82c8c00640 1 -- 172.21.15.64:0/476158350 wait complete. 2024-09-21T07:37:44.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:37:44.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- 172.21.15.64:0/2744761622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 msgr2=0x7f92940af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 --2- 172.21.15.64:0/2744761622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92940af790 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f9284009900 tx=0x7f928401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- 172.21.15.64:0/2744761622 shutdown_connections 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 --2- 172.21.15.64:0/2744761622 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92940caf00 0x7f92940cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 --2- 172.21.15.64:0/2744761622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92940af790 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- 172.21.15.64:0/2744761622 >> 172.21.15.64:0/2744761622 conn(0x7f929406d570 msgr2=0x7f92940b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- 172.21.15.64:0/2744761622 shutdown_connections 2024-09-21T07:37:44.170 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- 172.21.15.64:0/2744761622 wait complete. 2024-09-21T07:37:44.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 Processor -- start 2024-09-21T07:37:44.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.171+0000 7f9299600640 1 -- start start 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92940b46f0 0x7f92940ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92940caf00 0x7f9294157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9294168eb0 con 0x7f929406fae0 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9294168d30 con 0x7f92940b46f0 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9294169030 con 0x7f92940caf00 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54636/0 (socket says 172.21.15.64:54636) 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 -- 172.21.15.64:0/2638530186 learned_addr learned my addr 172.21.15.64:0/2638530186 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 -- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92940caf00 msgr2=0x7f9294157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92940caf00 0x7f9294157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 -- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92940b46f0 msgr2=0x7f92940ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92940b46f0 0x7f92940ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 -- 172.21.15.64:0/2638530186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92940aea60 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9292a00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f9284009850 tx=0x7f92840a5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92840b2040 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92840044b0 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284003860 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92940ad480 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92940ada40 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.175+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92940af790 con 0x7f929406fae0 2024-09-21T07:37:44.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.179+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9284003a00 con 0x7f929406fae0 2024-09-21T07:37:44.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.179+0000 7f928aa00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 0x7f9270075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.179+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f928412e800 con 0x7f929406fae0 2024-09-21T07:37:44.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.179+0000 7f928be00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 0x7f9270075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.179+0000 7f928be00640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 0x7f9270075740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f92940c6a60 tx=0x7f927c006bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.183+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f92840164d0 con 0x7f929406fae0 2024-09-21T07:37:44.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.363+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92940691c0 con 0x7f929406fae0 2024-09-21T07:37:44.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.363+0000 7f928aa00640 1 -- 172.21.15.64:0/2638530186 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+17094 (secure 0 0 0) 0x7f92840f9600 con 0x7f929406fae0 2024-09-21T07:37:44.364 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:44.364 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":206,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:31.788781+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:36:53.378206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-21T07:36:54.572346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.10","mappings":[{"from":6,"to":0}]},{"pgid":"29.13","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 msgr2=0x7f9270075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 0x7f9270075740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f92940c6a60 tx=0x7f927c006bd0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 msgr2=0x7f92941f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f9284009850 tx=0x7f92840a5740 comp rx=0 tx=0).stop 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 shutdown_connections 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9270073230 0x7f9270075740 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92940caf00 0x7f9294157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92940b46f0 0x7f92940ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 --2- 172.21.15.64:0/2638530186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929406fae0 0x7f92941f9080 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 >> 172.21.15.64:0/2638530186 conn(0x7f929406d570 msgr2=0x7f929415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:44.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 shutdown_connections 2024-09-21T07:37:44.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.367+0000 7f9299600640 1 -- 172.21.15.64:0/2638530186 wait complete. 2024-09-21T07:37:44.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 -- 172.21.15.64:0/3684460403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c000b4e00 msgr2=0x7f1c000af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 --2- 172.21.15.64:0/3684460403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c000b4e00 0x7f1c000af790 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f1c00070d40 tx=0x7f1be801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 -- 172.21.15.64:0/3684460403 shutdown_connections 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 --2- 172.21.15.64:0/3684460403 >> v2:172.21.15.90:3300/0 conn(0x7f1c000caf00 0x7f1c000cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 --2- 172.21.15.64:0/3684460403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c000b4e00 0x7f1c000af790 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 -- 172.21.15.64:0/3684460403 >> 172.21.15.64:0/3684460403 conn(0x7f1c0006d570 msgr2=0x7f1c000b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 -- 172.21.15.64:0/3684460403 shutdown_connections 2024-09-21T07:37:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.547+0000 7f1c06800640 1 -- 172.21.15.64:0/3684460403 wait complete. 2024-09-21T07:37:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 Processor -- start 2024-09-21T07:37:44.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- start start 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c0006fae0 0x7f1c00157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c000caf00 0x7f1c00073630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1c00168e60 con 0x7f1c0015c9f0 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1c00168ce0 con 0x7f1c0006fae0 2024-09-21T07:37:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1c00168fe0 con 0x7f1c000caf00 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54658/0 (socket says 172.21.15.64:54658) 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 -- 172.21.15.64:0/278676240 learned_addr learned my addr 172.21.15.64:0/278676240 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bf6a00640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c000caf00 0x7f1c00073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bff400640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c0006fae0 0x7f1c00157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 -- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c000caf00 msgr2=0x7f1c00073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c000caf00 0x7f1c00073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 -- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c0006fae0 msgr2=0x7f1c00157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c0006fae0 0x7f1c00157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 -- 172.21.15.64:0/278676240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c00159ac0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bffe00640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800eab0 tx=0x7f1bf800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800cea0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bf8004b30 con 0x7f1c0015c9f0 2024-09-21T07:37:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8005020 con 0x7f1c0015c9f0 2024-09-21T07:37:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c00159da0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.551+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c00074170 con 0x7f1c0015c9f0 2024-09-21T07:37:44.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.555+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c000743d0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.555+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1bf80051c0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.555+0000 7f1bf7e00640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 0x7f1bdc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.555+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f1bf8094fd0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.555+0000 7f1bff400640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 0x7f1bdc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.559+0000 7f1bff400640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 0x7f1bdc075710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0007fd0 tx=0x7f1bf0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.559 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.559+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1bf805f790 con 0x7f1c0015c9f0 2024-09-21T07:37:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.775+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1c000af790 con 0x7f1c0015c9f0 2024-09-21T07:37:44.773 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:37:44.775+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:37:44.775 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.775+0000 7f1bf7e00640 1 -- 172.21.15.64:0/278676240 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v153) ==== 161+0+0 (secure 0 0 0) 0x7f1bf80641c0 con 0x7f1c0015c9f0 2024-09-21T07:37:44.776 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:37:44.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 msgr2=0x7f1bdc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 0x7f1bdc075710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0007fd0 tx=0x7f1bf0009040 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 msgr2=0x7f1c00073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800eab0 tx=0x7f1bf800ef70 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 shutdown_connections 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1bdc073200 0x7f1bdc075710 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c0015c9f0 0x7f1c00073b70 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c000caf00 0x7f1c00073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 --2- 172.21.15.64:0/278676240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c0006fae0 0x7f1c00157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 >> 172.21.15.64:0/278676240 conn(0x7f1c0006d570 msgr2=0x7f1c000ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 shutdown_connections 2024-09-21T07:37:44.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.779+0000 7f1c06800640 1 -- 172.21.15.64:0/278676240 wait complete. 2024-09-21T07:37:44.791 INFO:tasks.ceph.mds.a.smithi064.stderr: -7636> 2024-09-21T07:36:58.175+0000 7fef3bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:37:44.796 INFO:tasks.ceph.mds.a.smithi064.stderr: -3958> 2024-09-21T07:37:09.651+0000 7fef36c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-21T07:37:08.383769+0000 b5242880 1=1+0)->n(v0 rc2024-09-21T07:37:08.387769+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={11073=0-12582912@1} caps={11073=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=11073 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x5631134aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-21T07:37:44.800 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:37:44.916 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:37:44.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 -- 172.21.15.64:0/910446094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09b730 msgr2=0x7fc98c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 --2- 172.21.15.64:0/910446094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09b730 0x7fc98c0ce340 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0c6000 tx=0x7fc97c01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 -- 172.21.15.64:0/910446094 shutdown_connections 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 --2- 172.21.15.64:0/910446094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c0b7370 0x7fc98c0b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 --2- 172.21.15.64:0/910446094 >> v2:172.21.15.90:3300/0 conn(0x7fc98c09a9e0 0x7fc98c09adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 --2- 172.21.15.64:0/910446094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09b730 0x7fc98c0ce340 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 -- 172.21.15.64:0/910446094 >> 172.21.15.64:0/910446094 conn(0x7fc98c0b3ff0 msgr2=0x7fc98c0b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 -- 172.21.15.64:0/910446094 shutdown_connections 2024-09-21T07:37:44.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.967+0000 7fc992c00640 1 -- 172.21.15.64:0/910446094 wait complete. 2024-09-21T07:37:44.968 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 Processor -- start 2024-09-21T07:37:44.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- start start 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 0x7fc98c0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc98c0b7370 0x7fc98c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c163390 con 0x7fc98c09a9e0 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c163210 con 0x7fc98c0b7370 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c163510 con 0x7fc98c09b730 2024-09-21T07:37:44.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54596/0 (socket says 172.21.15.64:54596) 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 -- 172.21.15.64:0/3622523306 learned_addr learned my addr 172.21.15.64:0/3622523306 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc983400640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 0x7fc98c0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc990c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc98c0b7370 0x7fc98c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 -- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 msgr2=0x7fc98c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 0x7fc98c0cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 -- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc98c0b7370 msgr2=0x7fc98c1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc98c0b7370 0x7fc98c1539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 -- 172.21.15.64:0/3622523306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c1567d0 con 0x7fc98c09a9e0 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc983400640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 0x7fc98c0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:44.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc98be00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fc97c01af70 tx=0x7fc97c0a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0b2040 con 0x7fc98c09a9e0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc97c0043b0 con 0x7fc98c09a9e0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c003860 con 0x7fc98c09a9e0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c156ab0 con 0x7fc98c09a9e0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.971+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c157070 con 0x7fc98c09a9e0 2024-09-21T07:37:44.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c0ce340 con 0x7fc98c09a9e0 2024-09-21T07:37:44.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc97c0bf060 con 0x7fc98c09a9e0 2024-09-21T07:37:44.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc988c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 0x7fc968075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:44.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6303+0+0 (secure 0 0 0) 0x7fc97c12dfe0 con 0x7fc98c09a9e0 2024-09-21T07:37:44.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc983400640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 0x7fc968075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:44.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.975+0000 7fc983400640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 0x7fc968075740 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc974005fd0 tx=0x7fc974005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:44.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:44.979+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc97c0164b0 con 0x7fc98c09a9e0 2024-09-21T07:37:45.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.195+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc98c151010 con 0x7fc98c09a9e0 2024-09-21T07:37:45.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc988c00640 1 -- 172.21.15.64:0/3622523306 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v154) ==== 104+0+0 (secure 0 0 0) 0x7fc97c0f8e10 con 0x7fc98c09a9e0 2024-09-21T07:37:45.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 msgr2=0x7fc968075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:45.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 0x7fc968075740 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc974005fd0 tx=0x7fc974005e40 comp rx=0 tx=0).stop 2024-09-21T07:37:45.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 msgr2=0x7fc98c14f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:45.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fc97c01af70 tx=0x7fc97c0a55c0 comp rx=0 tx=0).stop 2024-09-21T07:37:45.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 shutdown_connections 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc968073230 0x7fc968075740 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc98c0b7370 0x7fc98c1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc98c09b730 0x7fc98c0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 --2- 172.21.15.64:0/3622523306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc98c09a9e0 0x7fc98c14f4f0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 >> 172.21.15.64:0/3622523306 conn(0x7fc98c0b3ff0 msgr2=0x7fc98c155950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 shutdown_connections 2024-09-21T07:37:45.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:45.839+0000 7fc992c00640 1 -- 172.21.15.64:0/3622523306 wait complete. 2024-09-21T07:37:45.863 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:37:46.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 -- 172.21.15.64:0/3846221226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40cf610 msgr2=0x7f60a40b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:46.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 --2- 172.21.15.64:0/3846221226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40cf610 0x7f60a40b56e0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ccc90 tx=0x7f608c01cb80 comp rx=0 tx=0).stop 2024-09-21T07:37:46.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 -- 172.21.15.64:0/3846221226 shutdown_connections 2024-09-21T07:37:46.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 --2- 172.21.15.64:0/3846221226 >> v2:172.21.15.90:3300/0 conn(0x7f60a40b5c20 0x7f60a40b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 --2- 172.21.15.64:0/3846221226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40cf610 0x7f60a40b56e0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 -- 172.21.15.64:0/3846221226 >> 172.21.15.64:0/3846221226 conn(0x7f60a40d24f0 msgr2=0x7f60a40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:46.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 -- 172.21.15.64:0/3846221226 shutdown_connections 2024-09-21T07:37:46.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 -- 172.21.15.64:0/3846221226 wait complete. 2024-09-21T07:37:46.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.031+0000 7f60a8a00640 1 Processor -- start 2024-09-21T07:37:46.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- start start 2024-09-21T07:37:46.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a40b3990 0x7f60a40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:46.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415b990 0x7f60a409ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f60a416a0a0 con 0x7f60a40b5c20 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60a4169f20 con 0x7f60a415b990 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f60a416a220 con 0x7f60a40b3990 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54602/0 (socket says 172.21.15.64:54602) 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 -- 172.21.15.64:0/2840467832 learned_addr learned my addr 172.21.15.64:0/2840467832 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a2800640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415b990 0x7f60a409ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a1e00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a40b3990 0x7f60a40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 -- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a40b3990 msgr2=0x7f60a40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a40b3990 0x7f60a40ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 -- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415b990 msgr2=0x7f60a409ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415b990 0x7f60a409ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 -- 172.21.15.64:0/2840467832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a415c400 con 0x7f60a40b5c20 2024-09-21T07:37:46.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f6099400640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f608c01c5f0 tx=0x7f608c009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:46.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c0b2040 con 0x7f60a40b5c20 2024-09-21T07:37:46.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f608c004040 con 0x7f60a40b5c20 2024-09-21T07:37:46.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a406fed0 con 0x7f60a40b5c20 2024-09-21T07:37:46.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c004470 con 0x7f60a40b5c20 2024-09-21T07:37:46.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.035+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a40a0180 con 0x7f60a40b5c20 2024-09-21T07:37:46.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a40b6030 con 0x7f60a40b5c20 2024-09-21T07:37:46.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f608c0bd030 con 0x7f60a40b5c20 2024-09-21T07:37:46.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f609aa00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:46.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6303+0+0 (secure 0 0 0) 0x7f608c12e6f0 con 0x7f60a40b5c20 2024-09-21T07:37:46.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f60a1e00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:46.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.039+0000 7f60a1e00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6094007fd0 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:46.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.043+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f608c0c4020 con 0x7f60a40b5c20 2024-09-21T07:37:46.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.219+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f60a415d320 con 0x7f60a40b5c20 2024-09-21T07:37:46.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.847+0000 7f609aa00640 1 -- 172.21.15.64:0/2840467832 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v208) ==== 181+0+0 (secure 0 0 0) 0x7f608c016770 con 0x7f60a40b5c20 2024-09-21T07:37:46.845 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:37:46.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.847+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 msgr2=0x7f6080075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:46.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.847+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6094007fd0 tx=0x7f6094009040 comp rx=0 tx=0).stop 2024-09-21T07:37:46.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.847+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 msgr2=0x7f60a406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:46.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.847+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f608c01c5f0 tx=0x7f608c009200 comp rx=0 tx=0).stop 2024-09-21T07:37:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 shutdown_connections 2024-09-21T07:37:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6080073200 0x7f6080075710 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a415b990 0x7f60a409ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a40b5c20 0x7f60a406f990 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 --2- 172.21.15.64:0/2840467832 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60a40b3990 0x7f60a40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:46.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 >> 172.21.15.64:0/2840467832 conn(0x7f60a40d24f0 msgr2=0x7f60a40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:46.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 shutdown_connections 2024-09-21T07:37:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:46.851+0000 7f60a8a00640 1 -- 172.21.15.64:0/2840467832 wait complete. 2024-09-21T07:37:46.874 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:37:47.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 -- 172.21.15.64:0/1312581473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 msgr2=0x7fd0180d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:47.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 --2- 172.21.15.64:0/1312581473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0180d0ff0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fd004009840 tx=0x7fd00401c820 comp rx=0 tx=0).stop 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 -- 172.21.15.64:0/1312581473 shutdown_connections 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 --2- 172.21.15.64:0/1312581473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0180d0ff0 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 -- 172.21.15.64:0/1312581473 >> 172.21.15.64:0/1312581473 conn(0x7fd01806d430 msgr2=0x7fd018071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 -- 172.21.15.64:0/1312581473 shutdown_connections 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.043+0000 7fd01f000640 1 -- 172.21.15.64:0/1312581473 wait complete. 2024-09-21T07:37:47.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 Processor -- start 2024-09-21T07:37:47.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 -- start start 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 0x7fd0180cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 0x7fd0180cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd01816b160 con 0x7fd0180cf230 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd01816afe0 con 0x7fd0180d1530 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01f000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd01816b2e0 con 0x7fd0180ccbe0 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54620/0 (socket says 172.21.15.64:54620) 2024-09-21T07:37:47.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.047+0000 7fd01d200640 1 -- 172.21.15.64:0/784394580 learned_addr learned my addr 172.21.15.64:0/784394580 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:47.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01e600640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 0x7fd0180cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:47.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01dc00640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 0x7fd0180cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 -- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 msgr2=0x7fd0180cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 0x7fd0180cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 -- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 msgr2=0x7fd0180cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 0x7fd0180cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 -- 172.21.15.64:0/784394580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0181fcff0 con 0x7fd0180cf230 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01e600640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 0x7fd0180cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01dc00640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 0x7fd0180cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01d200640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fd004009790 tx=0x7fd0040a8580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040a8a80 con 0x7fd0180cf230 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0040a8c20 con 0x7fd0180cf230 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004005030 con 0x7fd0180cf230 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0181f8cc0 con 0x7fd0180cf230 2024-09-21T07:37:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01815c2b0 con 0x7fd0180cf230 2024-09-21T07:37:47.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0181f8ab0 con 0x7fd0180cf230 2024-09-21T07:37:47.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd0040b8030 con 0x7fd0180cf230 2024-09-21T07:37:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 0x7fcff8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.051+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5749+0+0 (secure 0 0 0) 0x7fd00412e180 con 0x7fd0180cf230 2024-09-21T07:37:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.055+0000 7fd01dc00640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 0x7fcff8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.055+0000 7fd01dc00640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 0x7fcff8075710 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0046c0 tx=0x7fd00c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:47.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.059+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd0181fcff0 con 0x7fd0180cf230 2024-09-21T07:37:47.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.235+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0180d0ff0 con 0x7fd0180cf230 2024-09-21T07:37:47.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.851+0000 7fd015600640 1 -- 172.21.15.64:0/784394580 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v209) ==== 169+0+0 (secure 0 0 0) 0x7fd0040ac030 con 0x7fd0180cf230 2024-09-21T07:37:47.852 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:37:47.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 msgr2=0x7fcff8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:47.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 0x7fcff8075710 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0046c0 tx=0x7fd00c009040 comp rx=0 tx=0).stop 2024-09-21T07:37:47.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 msgr2=0x7fd0181fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:47.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fd004009790 tx=0x7fd0040a8580 comp rx=0 tx=0).stop 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 shutdown_connections 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcff8073200 0x7fcff8075710 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0180d1530 0x7fd0180cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0180cf230 0x7fd0181fcab0 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 --2- 172.21.15.64:0/784394580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0180ccbe0 0x7fd0180cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 >> 172.21.15.64:0/784394580 conn(0x7fd01806d430 msgr2=0x7fd018160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:47.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 shutdown_connections 2024-09-21T07:37:47.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:47.859+0000 7fd01f000640 1 -- 172.21.15.64:0/784394580 wait complete. 2024-09-21T07:37:47.880 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- 172.21.15.64:0/2999813890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5858004010 msgr2=0x7f5858004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 --2- 172.21.15.64:0/2999813890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5858004010 0x7f5858004810 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f585c0016f0 tx=0x7f585c01c5d0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5873400640 1 -- 172.21.15.64:0/2999813890 reap_dead start 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- 172.21.15.64:0/2999813890 shutdown_connections 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- 172.21.15.64:0/2999813890 >> 172.21.15.64:0/2999813890 conn(0x7f587406d570 msgr2=0x7f58740b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- 172.21.15.64:0/2999813890 shutdown_connections 2024-09-21T07:37:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- 172.21.15.64:0/2999813890 wait complete. 2024-09-21T07:37:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 Processor -- start 2024-09-21T07:37:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.043+0000 7f5879c00640 1 -- start start 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5858004010 0x7f5874156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58740c98b0 0x7f587415e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58740cb9a0 con 0x7f58740c94a0 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58740cb820 con 0x7f5858004010 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f58740cbb20 con 0x7f58740c98b0 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54638/0 (socket says 172.21.15.64:54638) 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 -- 172.21.15.64:0/2936416154 learned_addr learned my addr 172.21.15.64:0/2936416154 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5872a00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5858004010 0x7f5874156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5873400640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58740c98b0 0x7f587415e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 -- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58740c98b0 msgr2=0x7f587415e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58740c98b0 0x7f587415e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 -- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5858004010 msgr2=0x7f5874156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5858004010 0x7f5874156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 -- 172.21.15.64:0/2936416154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58741572c0 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586be00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f585c01acd0 tx=0x7f585c0069d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c0ad070 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f585c003800 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c003c30 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58741f3be0 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58741f41a0 con 0x7f58740c94a0 2024-09-21T07:37:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58741f3950 con 0x7f58740c94a0 2024-09-21T07:37:48.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.047+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f585c0a7420 con 0x7f58740c94a0 2024-09-21T07:37:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.051+0000 7f586aa00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 0x7f5850075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.051+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f585c12de20 con 0x7f58740c94a0 2024-09-21T07:37:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.051+0000 7f5872a00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 0x7f5850075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.051+0000 7f5872a00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 0x7f5850075710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5864001870 tx=0x7f58640011a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.055+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f58740ccbc0 con 0x7f58740c94a0 2024-09-21T07:37:48.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.239+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f58740cc060 con 0x7f58740c94a0 2024-09-21T07:37:48.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.243+0000 7f586aa00640 1 -- 172.21.15.64:0/2936416154 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v65) ==== 71+0+0 (secure 0 0 0) 0x7f585c0f9070 con 0x7f58740c94a0 2024-09-21T07:37:48.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 msgr2=0x7f5850075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 0x7f5850075710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5864001870 tx=0x7f58640011a0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 msgr2=0x7f587415e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f585c01acd0 tx=0x7f585c0069d0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 shutdown_connections 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5850073200 0x7f5850075710 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58740c98b0 0x7f587415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740c94a0 0x7f587415e190 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 --2- 172.21.15.64:0/2936416154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5858004010 0x7f5874156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 >> 172.21.15.64:0/2936416154 conn(0x7f587406d570 msgr2=0x7f5874074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 shutdown_connections 2024-09-21T07:37:48.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.247+0000 7f5879c00640 1 -- 172.21.15.64:0/2936416154 wait complete. 2024-09-21T07:37:48.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- 172.21.15.64:0/4120690950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 msgr2=0x7fe5dc0cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/4120690950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc0cfa30 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009370 tx=0x7fe5cc01c8b0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- 172.21.15.64:0/4120690950 shutdown_connections 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/4120690950 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 0x7fe5dc06f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/4120690950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc0cfa30 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- 172.21.15.64:0/4120690950 >> 172.21.15.64:0/4120690950 conn(0x7fe5dc06d570 msgr2=0x7fe5dc0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- 172.21.15.64:0/4120690950 shutdown_connections 2024-09-21T07:37:48.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- 172.21.15.64:0/4120690950 wait complete. 2024-09-21T07:37:48.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 Processor -- start 2024-09-21T07:37:48.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.427+0000 7fe5e0c00640 1 -- start start 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 0x7fe5dc154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5dc0cc990 0x7fe5dc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0740c0 con 0x7fe5dc0cf620 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0713d0 con 0x7fe5dc0cc990 2024-09-21T07:37:48.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc074240 con 0x7fe5dc06f0d0 2024-09-21T07:37:48.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54642/0 (socket says 172.21.15.64:54642) 2024-09-21T07:37:48.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 -- 172.21.15.64:0/2281755968 learned_addr learned my addr 172.21.15.64:0/2281755968 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:48.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5d9400640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5dc0cc990 0x7fe5dc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5d9e00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 0x7fe5dc154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 -- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 msgr2=0x7fe5dc154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 0x7fe5dc154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 -- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5dc0cc990 msgr2=0x7fe5dc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5dc0cc990 0x7fe5dc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 -- 172.21.15.64:0/2281755968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0b1380 con 0x7fe5dc0cf620 2024-09-21T07:37:48.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5da800640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c6e0 tx=0x7fe5d400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4003b80 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5d4003d20 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc0b1660 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4005330 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc0b1c20 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.431+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc0b10f0 con 0x7fe5dc0cf620 2024-09-21T07:37:48.432 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.435+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe5d40054d0 con 0x7fe5dc0cf620 2024-09-21T07:37:48.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.435+0000 7fe5d2000640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 0x7fe5bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:48.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.435+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fe5d4093db0 con 0x7fe5dc0cf620 2024-09-21T07:37:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.435+0000 7fe5d9e00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 0x7fe5bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:48.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.435+0000 7fe5d9e00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 0x7fe5bc075710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0af000 tx=0x7fe5cc01b0f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:48.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.439+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe5d4098070 con 0x7fe5dc0cf620 2024-09-21T07:37:48.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.675+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7fe5dc06f4e0 con 0x7fe5dc0cf620 2024-09-21T07:37:48.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5d2000640 1 -- 172.21.15.64:0/2281755968 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v709) ==== 133+0+0 (secure 0 0 0) 0x7fe5d405e850 con 0x7fe5dc0cf620 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 msgr2=0x7fe5bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 0x7fe5bc075710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0af000 tx=0x7fe5cc01b0f0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 msgr2=0x7fe5dc158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c6e0 tx=0x7fe5d400cba0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 shutdown_connections 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe5bc073200 0x7fe5bc075710 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5dc0cf620 0x7fe5dc158b90 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5dc0cc990 0x7fe5dc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 --2- 172.21.15.64:0/2281755968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe5dc06f0d0 0x7fe5dc154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:48.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 >> 172.21.15.64:0/2281755968 conn(0x7fe5dc06d570 msgr2=0x7fe5dc099720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:48.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 shutdown_connections 2024-09-21T07:37:48.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:48.855+0000 7fe5e0c00640 1 -- 172.21.15.64:0/2281755968 wait complete. 2024-09-21T07:37:48.877 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-21T07:37:48.877 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2024-09-21T07:37:48.878 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- 172.21.15.64:0/2580761458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08600b4e00 msgr2=0x7f08600af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 --2- 172.21.15.64:0/2580761458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08600b4e00 0x7f08600af790 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f0848009840 tx=0x7f084801c820 comp rx=0 tx=0).stop 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- 172.21.15.64:0/2580761458 shutdown_connections 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 --2- 172.21.15.64:0/2580761458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08600b4e00 0x7f08600af790 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- 172.21.15.64:0/2580761458 >> 172.21.15.64:0/2580761458 conn(0x7f086006d570 msgr2=0x7f08600b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- 172.21.15.64:0/2580761458 shutdown_connections 2024-09-21T07:37:49.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- 172.21.15.64:0/2580761458 wait complete. 2024-09-21T07:37:49.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 Processor -- start 2024-09-21T07:37:49.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.039+0000 7f0867000640 1 -- start start 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f086006fae0 0x7f08601661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08600caf00 0x7f08601fb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0860169eb0 con 0x7f086015ade0 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0860169d30 con 0x7f086006fae0 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f086016a030 con 0x7f08600caf00 2024-09-21T07:37:49.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54672/0 (socket says 172.21.15.64:54672) 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 -- 172.21.15.64:0/1484719643 learned_addr learned my addr 172.21.15.64:0/1484719643 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f085fe00640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f086006fae0 0x7f08601661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0857e00640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08600caf00 0x7f08601fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 -- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08600caf00 msgr2=0x7f08601fb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08600caf00 0x7f08601fb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 -- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f086006fae0 msgr2=0x7f08601661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f086006fae0 0x7f08601661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 -- 172.21.15.64:0/1484719643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0860147a10 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0865000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f085800c710 tx=0x7f085800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858003b80 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0858003d20 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085800aab0 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0860166710 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0860147730 con 0x7f086015ade0 2024-09-21T07:37:49.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.043+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08600af790 con 0x7f086015ade0 2024-09-21T07:37:49.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.047+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f085800ac50 con 0x7f086015ade0 2024-09-21T07:37:49.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.047+0000 7f085cc00640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 0x7f083c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.047+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f0858093fd0 con 0x7f086015ade0 2024-09-21T07:37:49.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.047+0000 7f085fe00640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 0x7f083c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.047+0000 7f085fe00640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 0x7f083c075740 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f08500046c0 tx=0x7f0850009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.051+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f08600ccbc0 con 0x7f086015ade0 2024-09-21T07:37:49.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08600ad740 con 0x7f086015ade0 2024-09-21T07:37:49.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f085cc00640 1 -- 172.21.15.64:0/1484719643 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) ==== 74+0+13267 (secure 0 0 0) 0x7f085800ce20 con 0x7f086015ade0 2024-09-21T07:37:49.233 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:49.234 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":209,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:47.848985+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/1772905039":"2024-09-22T07:37:44.776878+0000","172.21.15.64:6833/1772905039":"2024-09-22T07:37:44.776878+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 msgr2=0x7f083c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 0x7f083c075740 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f08500046c0 tx=0x7f0850009040 comp rx=0 tx=0).stop 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 msgr2=0x7f08601fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f085800c710 tx=0x7f085800cbd0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 shutdown_connections 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f083c073230 0x7f083c075740 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f086015ade0 0x7f08601fbe90 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08600caf00 0x7f08601fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 --2- 172.21.15.64:0/1484719643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f086006fae0 0x7f08601661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 >> 172.21.15.64:0/1484719643 conn(0x7f086006d570 msgr2=0x7f08600ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:49.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 shutdown_connections 2024-09-21T07:37:49.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.235+0000 7f0867000640 1 -- 172.21.15.64:0/1484719643 wait complete. 2024-09-21T07:37:49.256 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:37:49.257 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- 172.21.15.64:0/52674282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 msgr2=0x7f770c0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 --2- 172.21.15.64:0/52674282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c0af790 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009840 tx=0x7f76fc01c820 comp rx=0 tx=0).stop 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- 172.21.15.64:0/52674282 shutdown_connections 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 --2- 172.21.15.64:0/52674282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 --2- 172.21.15.64:0/52674282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c0af790 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- 172.21.15.64:0/52674282 >> 172.21.15.64:0/52674282 conn(0x7f770c06d570 msgr2=0x7f770c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- 172.21.15.64:0/52674282 shutdown_connections 2024-09-21T07:37:49.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- 172.21.15.64:0/52674282 wait complete. 2024-09-21T07:37:49.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 Processor -- start 2024-09-21T07:37:49.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.419+0000 7f7711200640 1 -- start start 2024-09-21T07:37:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c0b46f0 0x7f770c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f770c168eb0 con 0x7f770c06fae0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f770c168d30 con 0x7f770c0b46f0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f770c169030 con 0x7f770c0caf00 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54696/0 (socket says 172.21.15.64:54696) 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 -- 172.21.15.64:0/667419444 learned_addr learned my addr 172.21.15.64:0/667419444 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f770a800640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7703e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c0b46f0 0x7f770c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 -- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 msgr2=0x7f770c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 -- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c0b46f0 msgr2=0x7f770c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c0b46f0 0x7f770c0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 -- 172.21.15.64:0/667419444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c0ad150 con 0x7f770c06fae0 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f770a800640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7709e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f76fc01aed0 tx=0x7f76fc0a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0bb070 con 0x7f770c06fae0 2024-09-21T07:37:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76fc004470 con 0x7f770c06fae0 2024-09-21T07:37:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b2040 con 0x7f770c06fae0 2024-09-21T07:37:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c099b00 con 0x7f770c06fae0 2024-09-21T07:37:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c0c1780 con 0x7f770c06fae0 2024-09-21T07:37:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.423+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770c0af790 con 0x7f770c06fae0 2024-09-21T07:37:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.427+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f76fc005290 con 0x7f770c06fae0 2024-09-21T07:37:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.427+0000 7f7702000640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 0x7f76e8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.427+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f76fc12daa0 con 0x7f770c06fae0 2024-09-21T07:37:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.427+0000 7f7703e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 0x7f76e8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.427+0000 7f7703e00640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 0x7f76e8075740 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f70 tx=0x7f76f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.431+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f76fc016410 con 0x7f770c06fae0 2024-09-21T07:37:49.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f770c0b0160 con 0x7f770c06fae0 2024-09-21T07:37:49.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7702000640 1 -- 172.21.15.64:0/667419444 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v209) ==== 93+0+10 (secure 0 0 0) 0x7f76fc0f8ba0 con 0x7f770c06fae0 2024-09-21T07:37:49.606 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 msgr2=0x7f76e8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 0x7f76e8075740 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f70 tx=0x7f76f4009040 comp rx=0 tx=0).stop 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 msgr2=0x7f770c098ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f76fc01aed0 tx=0x7f76fc0a5650 comp rx=0 tx=0).stop 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 shutdown_connections 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f76e8073230 0x7f76e8075740 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f770c0caf00 0x7f770c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.608 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c0b46f0 0x7f770c0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 --2- 172.21.15.64:0/667419444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f770c06fae0 0x7f770c098ca0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 >> 172.21.15.64:0/667419444 conn(0x7f770c06d570 msgr2=0x7f770c0c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:49.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 shutdown_connections 2024-09-21T07:37:49.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.607+0000 7f7711200640 1 -- 172.21.15.64:0/667419444 wait complete. 2024-09-21T07:37:49.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 -- 172.21.15.64:0/994138089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 msgr2=0x7f6c700b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 --2- 172.21.15.64:0/994138089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c700b4b00 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f6c700712c0 tx=0x7f6c5801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 -- 172.21.15.64:0/994138089 shutdown_connections 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 --2- 172.21.15.64:0/994138089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c700b4b00 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 --2- 172.21.15.64:0/994138089 >> v2:172.21.15.90:3300/0 conn(0x7f6c7006fae0 0x7f6c700af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 -- 172.21.15.64:0/994138089 >> 172.21.15.64:0/994138089 conn(0x7f6c7006d570 msgr2=0x7f6c700b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 -- 172.21.15.64:0/994138089 shutdown_connections 2024-09-21T07:37:49.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.787+0000 7f6c77400640 1 -- 172.21.15.64:0/994138089 wait complete. 2024-09-21T07:37:49.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 Processor -- start 2024-09-21T07:37:49.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- start start 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7006fae0 0x7f6c7015e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c700b3170 0x7f6c701f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70169380 con 0x7f6c700b46f0 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70169200 con 0x7f6c700b3170 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6c70169500 con 0x7f6c7006fae0 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54718/0 (socket says 172.21.15.64:54718) 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 -- 172.21.15.64:0/3294216237 learned_addr learned my addr 172.21.15.64:0/3294216237 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c74a00640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7006fae0 0x7f6c7015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c67e00640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c700b3170 0x7f6c701f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 -- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7006fae0 msgr2=0x7f6c7015e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7006fae0 0x7f6c7015e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 -- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c700b3170 msgr2=0x7f6c701f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c700b3170 0x7f6c701f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 -- 172.21.15.64:0/3294216237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c70163ae0 con 0x7f6c700b46f0 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c75400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c740 tx=0x7f6c6800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68003b80 con 0x7f6c700b46f0 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c6800ce50 con 0x7f6c700b46f0 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800a850 con 0x7f6c700b46f0 2024-09-21T07:37:49.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7015c880 con 0x7f6c700b46f0 2024-09-21T07:37:49.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.791+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c700ad2f0 con 0x7f6c700b46f0 2024-09-21T07:37:49.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.795+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c70163cb0 con 0x7f6c700b46f0 2024-09-21T07:37:49.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.795+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6c6800a9f0 con 0x7f6c700b46f0 2024-09-21T07:37:49.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.795+0000 7f6c6d600640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 0x7f6c4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:49.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.795+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f6c68093fe0 con 0x7f6c700b46f0 2024-09-21T07:37:49.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.795+0000 7f6c74a00640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 0x7f6c4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:49.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.799+0000 7f6c74a00640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 0x7f6c4c075710 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009b40 tx=0x7f6c600091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:49.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:49.799+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6c6805ebf0 con 0x7f6c700b46f0 2024-09-21T07:37:50.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.043+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f6c700af790 con 0x7f6c700b46f0 2024-09-21T07:37:50.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.867+0000 7f6c6d600640 1 -- 172.21.15.64:0/3294216237 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v711) ==== 150+0+0 (secure 0 0 0) 0x7f6c68063620 con 0x7f6c700b46f0 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 msgr2=0x7f6c4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 0x7f6c4c075710 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009b40 tx=0x7f6c600091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 msgr2=0x7f6c70098710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c740 tx=0x7f6c6800cc00 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 shutdown_connections 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6c4c073200 0x7f6c4c075710 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c700b46f0 0x7f6c70098710 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c700b3170 0x7f6c701f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 --2- 172.21.15.64:0/3294216237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7006fae0 0x7f6c7015e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 >> 172.21.15.64:0/3294216237 conn(0x7f6c7006d570 msgr2=0x7f6c7015b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 shutdown_connections 2024-09-21T07:37:50.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:50.871+0000 7f6c77400640 1 -- 172.21.15.64:0/3294216237 wait complete. 2024-09-21T07:37:50.895 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:37:51.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- 172.21.15.64:0/1118839925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c0af790 msgr2=0x7f8b9c0cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/1118839925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0cb610 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009bc0 tx=0x7f8b9401cb70 comp rx=0 tx=0).stop 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- 172.21.15.64:0/1118839925 shutdown_connections 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/1118839925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0cb610 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- 172.21.15.64:0/1118839925 >> 172.21.15.64:0/1118839925 conn(0x7f8b9c06d570 msgr2=0x7f8b9c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- 172.21.15.64:0/1118839925 shutdown_connections 2024-09-21T07:37:51.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- 172.21.15.64:0/1118839925 wait complete. 2024-09-21T07:37:51.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 Processor -- start 2024-09-21T07:37:51.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.059+0000 7f8ba1a00640 1 -- start start 2024-09-21T07:37:51.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b9c0ad690 0x7f8b9c0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c169cc0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c169b40 con 0x7f8b9c0af790 2024-09-21T07:37:51.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c169e40 con 0x7f8b9c0ad690 2024-09-21T07:37:51.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54744/0 (socket says 172.21.15.64:54744) 2024-09-21T07:37:51.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 -- 172.21.15.64:0/935910535 learned_addr learned my addr 172.21.15.64:0/935910535 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b93e00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9b400640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b9c0ad690 0x7f8b9c0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 -- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b9c0ad690 msgr2=0x7f8b9c0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b9c0ad690 0x7f8b9c0c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 -- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b9c0af790 msgr2=0x7f8b9c0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 -- 172.21.15.64:0/935910535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c15dd70 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b9aa00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c420 tx=0x7f8b8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c017070 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b8c0053c0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c15dff0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c003860 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c15e5b0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.063+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c0b46f0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.067+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8b8c01a070 con 0x7f8b9c06fae0 2024-09-21T07:37:51.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.067+0000 7f8b92a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 0x7f8b78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.067+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f8b8c093510 con 0x7f8b9c06fae0 2024-09-21T07:37:51.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.067+0000 7f8b93e00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 0x7f8b78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.067+0000 7f8b93e00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 0x7f8b78075710 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8b840046c0 tx=0x7f8b84009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:51.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.071+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8b9c15dd70 con 0x7f8b9c06fae0 2024-09-21T07:37:51.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.247+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8b9c158560 con 0x7f8b9c06fae0 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.247+0000 7f8b92a00640 1 -- 172.21.15.64:0/935910535 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v65) ==== 59+0+2294 (secure 0 0 0) 0x7f8b9c0ccbc0 con 0x7f8b9c06fae0 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:37:51.248 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:37:51.249 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:37:51.250 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 msgr2=0x7f8b78075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 0x7f8b78075710 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8b840046c0 tx=0x7f8b84009040 comp rx=0 tx=0).stop 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 msgr2=0x7f8b9c0ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c420 tx=0x7f8b8c00c8e0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 shutdown_connections 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8b78073200 0x7f8b78075710 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b9c0ad690 0x7f8b9c0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b9c0af790 0x7f8b9c0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 --2- 172.21.15.64:0/935910535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b9c06fae0 0x7f8b9c0ae710 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 >> 172.21.15.64:0/935910535 conn(0x7f8b9c06d570 msgr2=0x7f8b9c073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:51.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 shutdown_connections 2024-09-21T07:37:51.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.251+0000 7f8ba1a00640 1 -- 172.21.15.64:0/935910535 wait complete. 2024-09-21T07:37:51.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- 172.21.15.64:0/1159136834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3d0003fe0 msgr2=0x7fe3d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 --2- 172.21.15.64:0/1159136834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3d0003fe0 0x7fe3d0004810 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0cff00 tx=0x7fe3d401d190 comp rx=0 tx=0).stop 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3ea800640 1 -- 172.21.15.64:0/1159136834 reap_dead start 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- 172.21.15.64:0/1159136834 shutdown_connections 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- 172.21.15.64:0/1159136834 >> 172.21.15.64:0/1159136834 conn(0x7fe3ec06d430 msgr2=0x7fe3ec071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:51.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- 172.21.15.64:0/1159136834 shutdown_connections 2024-09-21T07:37:51.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- 172.21.15.64:0/1159136834 wait complete. 2024-09-21T07:37:51.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 Processor -- start 2024-09-21T07:37:51.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.435+0000 7fe3eb200640 1 -- start start 2024-09-21T07:37:51.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3d0003fe0 0x7fe3ec1ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 0x7fe3ec0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec0ceb20 con 0x7fe3ec158470 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec15cb30 con 0x7fe3d0003fe0 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ec0ceca0 con 0x7fe3ec0b6200 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54762/0 (socket says 172.21.15.64:54762) 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 -- 172.21.15.64:0/3555985496 learned_addr learned my addr 172.21.15.64:0/3555985496 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:51.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e9e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3d0003fe0 0x7fe3ec1ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3ea800640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 0x7fe3ec0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 -- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 msgr2=0x7fe3ec0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 0x7fe3ec0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 -- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3d0003fe0 msgr2=0x7fe3ec1ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3d0003fe0 0x7fe3ec1ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 -- 172.21.15.64:0/3555985496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec1eff00 con 0x7fe3ec158470 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3ea800640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 0x7fe3ec0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e3e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401cfc0 tx=0x7fe3d40acd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40bc020 con 0x7fe3ec158470 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d40b7470 con 0x7fe3ec158470 2024-09-21T07:37:51.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec0b6b50 con 0x7fe3ec158470 2024-09-21T07:37:51.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40b1040 con 0x7fe3ec158470 2024-09-21T07:37:51.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1f5b40 con 0x7fe3ec158470 2024-09-21T07:37:51.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.439+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec0b4960 con 0x7fe3ec158470 2024-09-21T07:37:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.443+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe3d40bf020 con 0x7fe3ec158470 2024-09-21T07:37:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.443+0000 7fe3e2000640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 0x7fe3c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.443+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fe3d412f4e0 con 0x7fe3ec158470 2024-09-21T07:37:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.443+0000 7fe3e9e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 0x7fe3c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:51.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.443+0000 7fe3e9e00640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 0x7fe3c8075710 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009bc0 tx=0x7fe3dc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:51.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.447+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe3d40c6070 con 0x7fe3ec158470 2024-09-21T07:37:51.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.623+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe3ec0cd1c0 con 0x7fe3ec158470 2024-09-21T07:37:51.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.627+0000 7fe3e2000640 1 -- 172.21.15.64:0/3555985496 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7fe3ec0b6b50 con 0x7fe3ec158470 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 msgr2=0x7fe3c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 0x7fe3c8075710 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009bc0 tx=0x7fe3dc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 msgr2=0x7fe3ec158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401cfc0 tx=0x7fe3d40acd40 comp rx=0 tx=0).stop 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 shutdown_connections 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe3c8073200 0x7fe3c8075710 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3ec0b6200 0x7fe3ec0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3ec158470 0x7fe3ec158880 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 --2- 172.21.15.64:0/3555985496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3d0003fe0 0x7fe3ec1ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:51.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 >> 172.21.15.64:0/3555985496 conn(0x7fe3ec06d430 msgr2=0x7fe3ec06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:51.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 shutdown_connections 2024-09-21T07:37:51.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:51.631+0000 7fe3eb200640 1 -- 172.21.15.64:0/3555985496 wait complete. 2024-09-21T07:37:51.651 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:37:51.651 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:37:51.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:37:51.821 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:37:51.821 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:51.821 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:51.830 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:37:51.830 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:37:51.830 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:51.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:37:51.839 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:37:51.840 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:51.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:37:51.884 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:37:51.884 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:37:51.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:37:51.893 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:37:51.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 -- 172.21.15.64:0/681872057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0cd440 msgr2=0x7f8d4c0b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 --2- 172.21.15.64:0/681872057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0cd440 0x7f8d4c0b3580 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009bc0 tx=0x7f8d4401cba0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 -- 172.21.15.64:0/681872057 shutdown_connections 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 --2- 172.21.15.64:0/681872057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0cd440 0x7f8d4c0b3580 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 -- 172.21.15.64:0/681872057 >> 172.21.15.64:0/681872057 conn(0x7f8d4c06d570 msgr2=0x7f8d4c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 -- 172.21.15.64:0/681872057 shutdown_connections 2024-09-21T07:37:52.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.087+0000 7f8d54200640 1 -- 172.21.15.64:0/681872057 wait complete. 2024-09-21T07:37:52.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 Processor -- start 2024-09-21T07:37:52.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- start start 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d4c0b3170 0x7f8d4c15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d4c074ef0 0x7f8d4c0c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c16b170 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c16aff0 con 0x7f8d4c074ef0 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4c16b2f0 con 0x7f8d4c0b3170 2024-09-21T07:37:52.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54782/0 (socket says 172.21.15.64:54782) 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 -- 172.21.15.64:0/3188452976 learned_addr learned my addr 172.21.15.64:0/3188452976 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d52200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d4c074ef0 0x7f8d4c0c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d50e00640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d4c0b3170 0x7f8d4c15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 -- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d4c0b3170 msgr2=0x7f8d4c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d4c0b3170 0x7f8d4c15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 -- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d4c074ef0 msgr2=0x7f8d4c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d4c074ef0 0x7f8d4c0c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 -- 172.21.15.64:0/3188452976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c158940 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d51800640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c3f0 tx=0x7f8d4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011790 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d40017070 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011ce0 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4c0caf60 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.091+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4c0c2cd0 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.095+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4c0b3580 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.095+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8d4001c460 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.095+0000 7f8d49600640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 0x7f8d2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.095+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f8d40093ef0 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.095+0000 7f8d50e00640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 0x7f8d2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.099+0000 7f8d50e00640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 0x7f8d2c075710 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0b4e00 tx=0x7f8d38009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:52.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.103+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8d4005ef60 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d4c156ec0 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d49600640 1 -- 172.21.15.64:0/3188452976 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+3913 (secure 0 0 0) 0x7f8d4005e860 con 0x7f8d4c0b28e0 2024-09-21T07:37:52.313 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:52.314 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":154,"btime":"2024-09-21T07:37:45:832487+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1174789504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1174789504},{"type":"v1","addr":"172.21.15.64:6834","nonce":1174789504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":10270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/4199231277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4199231277},{"type":"v1","addr":"172.21.15.90:6836","nonce":4199231277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":10273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/449144243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":449144243},{"type":"v1","addr":"172.21.15.90:6837","nonce":449144243}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148},{"gid":11217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/136295955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":136295955},{"type":"v1","addr":"172.21.15.64:6835","nonce":136295955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[]} 2024-09-21T07:37:52.314 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 154 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 msgr2=0x7f8d2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 0x7f8d2c075710 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0b4e00 tx=0x7f8d38009040 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 msgr2=0x7f8d4c15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c3f0 tx=0x7f8d4000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 shutdown_connections 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8d2c073200 0x7f8d2c075710 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d4c074ef0 0x7f8d4c0c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d4c0b3170 0x7f8d4c15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 --2- 172.21.15.64:0/3188452976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d4c0b28e0 0x7f8d4c15b3a0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 >> 172.21.15.64:0/3188452976 conn(0x7f8d4c06d570 msgr2=0x7f8d4c1564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 shutdown_connections 2024-09-21T07:37:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.315+0000 7f8d54200640 1 -- 172.21.15.64:0/3188452976 wait complete. 2024-09-21T07:37:52.336 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:37:52.336 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:37:52.336 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:37:52.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:37:52.337 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:37:52.337 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:37:52.337 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:37:52.337 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:37:52.337 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:37:52.337 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:37:52.337 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:37:52.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:37:52.338 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:37:52.338 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:37:52.338 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:37:52.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:37:52.349 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:37:52.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:37:52.355 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:37:52.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:37:52.356 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:37:52.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:37:52.357 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:37:52.358 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:37:52.402 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:37:52.402 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:52.404 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:37:52.404 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:52.405 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:37:52.405 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:52.407 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:37:52.407 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:52.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:37:52.501 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:37:52.505 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:37:52.513 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:37:52.514 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:37:52.515 INFO:tasks.ceph.mds.b.smithi090.stderr:2024-09-21T07:37:52.513+0000 7f7548c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- 172.21.15.64:0/3730281832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e0074af0 msgr2=0x7f00e00b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 --2- 172.21.15.64:0/3730281832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e0074af0 0x7f00e00b3880 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f00e00728a0 tx=0x7f00d801c710 comp rx=0 tx=0).stop 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- 172.21.15.64:0/3730281832 shutdown_connections 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 --2- 172.21.15.64:0/3730281832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e0074af0 0x7f00e00b3880 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 --2- 172.21.15.64:0/3730281832 >> v2:172.21.15.90:3300/0 conn(0x7f00e015af70 0x7f00e006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.577 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- 172.21.15.64:0/3730281832 >> 172.21.15.64:0/3730281832 conn(0x7f00e006d570 msgr2=0x7f00e00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:52.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- 172.21.15.64:0/3730281832 shutdown_connections 2024-09-21T07:37:52.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- 172.21.15.64:0/3730281832 wait complete. 2024-09-21T07:37:52.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 Processor -- start 2024-09-21T07:37:52.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.579+0000 7f00e6600640 1 -- start start 2024-09-21T07:37:52.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e0074af0 0x7f00e0157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 0x7f00e0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0167dd0 con 0x7f00e006f610 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0167c50 con 0x7f00e015af70 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f00e0167f50 con 0x7f00e0074af0 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54842/0 (socket says 172.21.15.64:54842) 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 -- 172.21.15.64:0/2223565056 learned_addr learned my addr 172.21.15.64:0/2223565056 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00d6a00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e0074af0 0x7f00e0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00dfe00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 0x7f00e0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 -- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e0074af0 msgr2=0x7f00e0157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e0074af0 0x7f00e0157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 -- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 msgr2=0x7f00e0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:52.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 0x7f00e0157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:52.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 -- 172.21.15.64:0/2223565056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e015a7c0 con 0x7f00e006f610 2024-09-21T07:37:52.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00dfe00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 0x7f00e0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:52.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00df400640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f00d000ec10 tx=0x7f00d000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0004d30 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00d000b570 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d000b980 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01fc8b0 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01fce70 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.583+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e006f0d0 con 0x7f00e006f610 2024-09-21T07:37:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.587+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f00d000bb20 con 0x7f00e006f610 2024-09-21T07:37:52.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.587+0000 7f00d7e00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 0x7f00bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:52.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.587+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f00d0094c20 con 0x7f00e006f610 2024-09-21T07:37:52.585 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.587+0000 7f00d6a00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 0x7f00bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:52.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.587+0000 7f00d6a00640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 0x7f00bc075710 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f00e00b15a0 tx=0x7f00c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:52.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.591+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f00e015a7c0 con 0x7f00e006f610 2024-09-21T07:37:52.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:52.787+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f00e0070c80 con 0x7f00e006f610 2024-09-21T07:37:53.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.647+0000 7f00d7e00640 1 -- 172.21.15.64:0/2223565056 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v214) ==== 97+0+0 (secure 0 0 0) 0x7f00d005fed0 con 0x7f00e006f610 2024-09-21T07:37:53.648 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 msgr2=0x7f00bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 0x7f00bc075710 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f00e00b15a0 tx=0x7f00c8009040 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 msgr2=0x7f00e015a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f00d000ec10 tx=0x7f00d000c7a0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 shutdown_connections 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f00bc073200 0x7f00bc075710 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00e015af70 0x7f00e0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f00e0074af0 0x7f00e0157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 --2- 172.21.15.64:0/2223565056 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e006f610 0x7f00e015a280 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 >> 172.21.15.64:0/2223565056 conn(0x7f00e006d570 msgr2=0x7f00e00b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 shutdown_connections 2024-09-21T07:37:53.651 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.651+0000 7f00e6600640 1 -- 172.21.15.64:0/2223565056 wait complete. 2024-09-21T07:37:53.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:37:53.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.839+0000 7f9afe000640 1 -- 172.21.15.64:0/156918406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80b3990 msgr2=0x7f9af80cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:53.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.839+0000 7f9afe000640 1 --2- 172.21.15.64:0/156918406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80b3990 0x7f9af80cef00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009840 tx=0x7f9ae801c820 comp rx=0 tx=0).stop 2024-09-21T07:37:53.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.839+0000 7f9afe000640 1 -- 172.21.15.64:0/156918406 shutdown_connections 2024-09-21T07:37:53.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.839+0000 7f9afe000640 1 --2- 172.21.15.64:0/156918406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80b3990 0x7f9af80cef00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.839+0000 7f9afe000640 1 -- 172.21.15.64:0/156918406 >> 172.21.15.64:0/156918406 conn(0x7f9af80d24f0 msgr2=0x7f9af80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:53.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- 172.21.15.64:0/156918406 shutdown_connections 2024-09-21T07:37:53.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- 172.21.15.64:0/156918406 wait complete. 2024-09-21T07:37:53.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 Processor -- start 2024-09-21T07:37:53.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- start start 2024-09-21T07:37:53.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:53.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9af80b66f0 0x7f9af806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:53.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80cf440 0x7f9af806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:53.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9af816b0b0 con 0x7f9af80b3990 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9af816af30 con 0x7f9af80cf440 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.843+0000 7f9afe000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9af816b230 con 0x7f9af80b66f0 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54854/0 (socket says 172.21.15.64:54854) 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 -- 172.21.15.64:0/2587717444 learned_addr learned my addr 172.21.15.64:0/2587717444 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 -- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9af80b66f0 msgr2=0x7f9af806ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9af80b66f0 0x7f9af806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 -- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80cf440 msgr2=0x7f9af806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80cf440 0x7f9af806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 -- 172.21.15.64:0/2587717444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af8153820 con 0x7f9af80b3990 2024-09-21T07:37:53.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9af7400640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009790 tx=0x7f9ae80a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80bb070 con 0x7f9af80b3990 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ae8004470 con 0x7f9af80b3990 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80b2040 con 0x7f9af80b3990 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af8153540 con 0x7f9af80b3990 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af8155930 con 0x7f9af80b3990 2024-09-21T07:37:53.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af80cef00 con 0x7f9af80b3990 2024-09-21T07:37:53.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.847+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ae80be070 con 0x7f9af80b3990 2024-09-21T07:37:53.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.851+0000 7f9aef400640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 0x7f9ad4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:53.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.851+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5249+0+0 (secure 0 0 0) 0x7f9ae812dbf0 con 0x7f9af80b3990 2024-09-21T07:37:53.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.851+0000 7f9aefe00640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 0x7f9ad4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:53.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.851+0000 7f9aefe00640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 0x7f9ad4075710 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0007fd0 tx=0x7f9ae0007980 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:53.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:53.851+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9ae8016410 con 0x7f9af80b3990 2024-09-21T07:37:54.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9af8076700 con 0x7f9af80b3990 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9aef400640 1 -- 172.21.15.64:0/2587717444 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v37) ==== 80+0+5304 (secure 0 0 0) 0x7f9ae80f8e50 con 0x7f9af80b3990 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:37:54.094 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:37:54.095 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.096 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:37:54.097 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:37:54.099 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.101 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:37:54.102 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.103 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:37:54.104 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:37:54.105 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.106 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:37:54.107 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.109 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:37:54.109 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:37:54.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 msgr2=0x7f9ad4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 0x7f9ad4075710 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0007fd0 tx=0x7f9ae0007980 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 msgr2=0x7f9af8152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009790 tx=0x7f9ae80a5650 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 shutdown_connections 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9ad4073200 0x7f9ad4075710 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af80cf440 0x7f9af806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9af80b66f0 0x7f9af806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 --2- 172.21.15.64:0/2587717444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af80b3990 0x7f9af8152e40 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.095+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 >> 172.21.15.64:0/2587717444 conn(0x7f9af80d24f0 msgr2=0x7f9af8157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.099+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 shutdown_connections 2024-09-21T07:37:54.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.099+0000 7f9afe000640 1 -- 172.21.15.64:0/2587717444 wait complete. 2024-09-21T07:37:54.116 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:37:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 -- 172.21.15.64:0/1490592158 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0cf8d0 msgr2=0x7f287c0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 --2- 172.21.15.64:0/1490592158 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0cf8d0 0x7f287c0cfce0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2874009c80 tx=0x7f287401cc20 comp rx=0 tx=0).stop 2024-09-21T07:37:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 -- 172.21.15.64:0/1490592158 shutdown_connections 2024-09-21T07:37:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 --2- 172.21.15.64:0/1490592158 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0cf8d0 0x7f287c0cfce0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 --2- 172.21.15.64:0/1490592158 >> v2:172.21.15.90:3300/0 conn(0x7f287c0738b0 0x7f287c073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 -- 172.21.15.64:0/1490592158 >> 172.21.15.64:0/1490592158 conn(0x7f287c0d0be0 msgr2=0x7f287c0d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 -- 172.21.15.64:0/1490592158 shutdown_connections 2024-09-21T07:37:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.275+0000 7f2884600640 1 -- 172.21.15.64:0/1490592158 wait complete. 2024-09-21T07:37:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 Processor -- start 2024-09-21T07:37:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 -- start start 2024-09-21T07:37:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0738b0 0x7f287c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f287c0cf8d0 0x7f287c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f287c070000 con 0x7f287c15eb90 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f287c06fe80 con 0x7f287c0cf8d0 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2884600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f287c070180 con 0x7f287c0738b0 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2882600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.279+0000 7f2882600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54870/0 (socket says 172.21.15.64:54870) 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 -- 172.21.15.64:0/587010237 learned_addr learned my addr 172.21.15.64:0/587010237 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2881200640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f287c0cf8d0 0x7f287c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2881c00640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0738b0 0x7f287c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 -- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0738b0 msgr2=0x7f287c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0738b0 0x7f287c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 -- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f287c0cf8d0 msgr2=0x7f287c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f287c0cf8d0 0x7f287c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 -- 172.21.15.64:0/587010237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c15abb0 con 0x7f287c15eb90 2024-09-21T07:37:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2882600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f2874009bd0 tx=0x7f2874005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28740bc070 con 0x7f287c15eb90 2024-09-21T07:37:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c150c70 con 0x7f287c15eb90 2024-09-21T07:37:54.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2874004130 con 0x7f287c15eb90 2024-09-21T07:37:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28740b2040 con 0x7f287c15eb90 2024-09-21T07:37:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c1507a0 con 0x7f287c15eb90 2024-09-21T07:37:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.283+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c073cc0 con 0x7f287c15eb90 2024-09-21T07:37:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.287+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2874004500 con 0x7f287c15eb90 2024-09-21T07:37:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.287+0000 7f2879600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 0x7f285c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.287+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5249+0+0 (secure 0 0 0) 0x7f287412e110 con 0x7f287c15eb90 2024-09-21T07:37:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.287+0000 7f2881c00640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 0x7f285c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.287+0000 7f2881c00640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 0x7f285c075740 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f2870001650 tx=0x7f2870009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.291+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f28740c5080 con 0x7f287c15eb90 2024-09-21T07:37:54.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f287c0b6b60 con 0x7f287c15eb90 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2879600640 1 -- 172.21.15.64:0/587010237 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v214) ==== 84+0+65 (secure 0 0 0) 0x7f2874016990 con 0x7f287c15eb90 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:37:54.466 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:37:54.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 msgr2=0x7f285c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 0x7f285c075740 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f2870001650 tx=0x7f2870009040 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 msgr2=0x7f287c0c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f2874009bd0 tx=0x7f2874005ae0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 shutdown_connections 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f285c073230 0x7f285c075740 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f287c15eb90 0x7f287c0c46d0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f287c0cf8d0 0x7f287c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 --2- 172.21.15.64:0/587010237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f287c0738b0 0x7f287c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.467+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 >> 172.21.15.64:0/587010237 conn(0x7f287c0d0be0 msgr2=0x7f287c15e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.471+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 shutdown_connections 2024-09-21T07:37:54.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.471+0000 7f2884600640 1 -- 172.21.15.64:0/587010237 wait complete. 2024-09-21T07:37:54.489 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:37:54.489 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- 172.21.15.64:0/1385653742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80d0930 msgr2=0x7fadc80d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/1385653742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80d0930 0x7fadc80d0d40 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7fadc8074b10 tx=0x7fadc001cd80 comp rx=0 tx=0).stop 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- 172.21.15.64:0/1385653742 shutdown_connections 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/1385653742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80d0930 0x7fadc80d0d40 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/1385653742 >> v2:172.21.15.90:3300/0 conn(0x7fadc80cf440 0x7fadc80d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/1385653742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 0x7fadc80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- 172.21.15.64:0/1385653742 >> 172.21.15.64:0/1385653742 conn(0x7fadc80d24f0 msgr2=0x7fadc80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- 172.21.15.64:0/1385653742 shutdown_connections 2024-09-21T07:37:54.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- 172.21.15.64:0/1385653742 wait complete. 2024-09-21T07:37:54.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 Processor -- start 2024-09-21T07:37:54.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.655+0000 7fadcf000640 1 -- start start 2024-09-21T07:37:54.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 0x7fadc815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc80d0930 0x7fadc814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80b6070 con 0x7fadc80cf440 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80b5ef0 con 0x7fadc80d0930 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fadc80b61f0 con 0x7fadc80b3990 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54892/0 (socket says 172.21.15.64:54892) 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 -- 172.21.15.64:0/60366662 learned_addr learned my addr 172.21.15.64:0/60366662 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcd000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc80d0930 0x7fadc814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadc7e00640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 0x7fadc815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 -- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 msgr2=0x7fadc815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 0x7fadc815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 -- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc80d0930 msgr2=0x7fadc814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc80d0930 0x7fadc814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:54.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 -- 172.21.15.64:0/60366662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc814e000 con 0x7fadc80cf440 2024-09-21T07:37:54.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadbf400640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e7d0 tx=0x7fadb000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:54.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000ccc0 con 0x7fadc80cf440 2024-09-21T07:37:54.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadb0010430 con 0x7fadc80cf440 2024-09-21T07:37:54.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0010860 con 0x7fadc80cf440 2024-09-21T07:37:54.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc806e640 con 0x7fadc80cf440 2024-09-21T07:37:54.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc806ec00 con 0x7fadc80cf440 2024-09-21T07:37:54.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.659+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc80d03f0 con 0x7fadc80cf440 2024-09-21T07:37:54.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.663+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fadb0010a00 con 0x7fadc80cf440 2024-09-21T07:37:54.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.663+0000 7fadc4c00640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 0x7fada4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:54.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.663+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5249+0+0 (secure 0 0 0) 0x7fadb0095160 con 0x7fadc80cf440 2024-09-21T07:37:54.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.663+0000 7fadc7e00640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 0x7fada4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:54.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.663+0000 7fadc7e00640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 0x7fada4075740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b50a0 tx=0x7fadb800b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:54.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.667+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fadb005fdf0 con 0x7fadc80cf440 2024-09-21T07:37:54.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:54.843+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fadc8076820 con 0x7fadc80cf440 2024-09-21T07:37:55.652 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.651+0000 7fadc4c00640 1 -- 172.21.15.64:0/60366662 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v215) ==== 138+0+0 (secure 0 0 0) 0x7fadb0064820 con 0x7fadc80cf440 2024-09-21T07:37:55.652 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:37:55.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 msgr2=0x7fada4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:55.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 0x7fada4075740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b50a0 tx=0x7fadb800b260 comp rx=0 tx=0).stop 2024-09-21T07:37:55.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 msgr2=0x7fadc80ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:55.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e7d0 tx=0x7fadb000ec90 comp rx=0 tx=0).stop 2024-09-21T07:37:55.655 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 shutdown_connections 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fada4073230 0x7fada4075740 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadc80d0930 0x7fadc814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc80cf440 0x7fadc80ca270 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 --2- 172.21.15.64:0/60366662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadc80b3990 0x7fadc815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 >> 172.21.15.64:0/60366662 conn(0x7fadc80d24f0 msgr2=0x7fadc815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.655+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 shutdown_connections 2024-09-21T07:37:55.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.659+0000 7fadcf000640 1 -- 172.21.15.64:0/60366662 wait complete. 2024-09-21T07:37:55.683 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 -- 172.21.15.64:0/369109705 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe35815b930 msgr2=0x7fe358073830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 --2- 172.21.15.64:0/369109705 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe35815b930 0x7fe358073830 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fe350009c80 tx=0x7fe35001cd10 comp rx=0 tx=0).stop 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 -- 172.21.15.64:0/369109705 shutdown_connections 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 --2- 172.21.15.64:0/369109705 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe35815b930 0x7fe358073830 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 -- 172.21.15.64:0/369109705 >> 172.21.15.64:0/369109705 conn(0x7fe35806d490 msgr2=0x7fe3580d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 -- 172.21.15.64:0/369109705 shutdown_connections 2024-09-21T07:37:55.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.851+0000 7fe35d000640 1 -- 172.21.15.64:0/369109705 wait complete. 2024-09-21T07:37:55.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 Processor -- start 2024-09-21T07:37:55.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 -- start start 2024-09-21T07:37:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3580cb010 0x7fe3580c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:55.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe35815b930 0x7fe3580994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe35816a360 con 0x7fe3580cc2d0 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe35816a1e0 con 0x7fe35815b930 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe35d000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe35816a4e0 con 0x7fe3580cb010 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe34d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe34d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55846/0 (socket says 172.21.15.64:55846) 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe34d400640 1 -- 172.21.15.64:0/1704698415 learned_addr learned my addr 172.21.15.64:0/1704698415 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe356800640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe35815b930 0x7fe3580994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.855+0000 7fe355e00640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3580cb010 0x7fe3580c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 -- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3580cb010 msgr2=0x7fe3580c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3580cb010 0x7fe3580c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 -- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe35815b930 msgr2=0x7fe3580994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe35815b930 0x7fe3580994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:55.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 -- 172.21.15.64:0/1704698415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580982c0 con 0x7fe3580cc2d0 2024-09-21T07:37:55.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34d400640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c3c0 tx=0x7fe34000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:55.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340017070 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3580c35d0 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3400053c0 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340003860 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35809b7a0 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.859+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3580ca900 con 0x7fe3580cc2d0 2024-09-21T07:37:55.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.863+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe34001a070 con 0x7fe3580cc2d0 2024-09-21T07:37:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.863+0000 7fe34ea00640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 0x7fe334075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.863+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5619+0+0 (secure 0 0 0) 0x7fe3400938d0 con 0x7fe3580cc2d0 2024-09-21T07:37:55.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.863+0000 7fe355e00640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 0x7fe334075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:55.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.863+0000 7fe355e00640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 0x7fe334075740 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f70 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:55.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:55.867+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe340021020 con 0x7fe3580cc2d0 2024-09-21T07:37:56.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.047+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe3580ad4c0 con 0x7fe3580cc2d0 2024-09-21T07:37:56.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.659+0000 7fe34ea00640 1 -- 172.21.15.64:0/1704698415 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v216) ==== 170+0+0 (secure 0 0 0) 0x7fe34005e380 con 0x7fe3580cc2d0 2024-09-21T07:37:56.660 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 msgr2=0x7fe334075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 0x7fe334075740 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f70 tx=0x7fe348009040 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 msgr2=0x7fe358098f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c3c0 tx=0x7fe34000c880 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 shutdown_connections 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe334073230 0x7fe334075740 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe35815b930 0x7fe3580994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe3580cc2d0 0x7fe358098f70 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 --2- 172.21.15.64:0/1704698415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3580cb010 0x7fe3580c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 >> 172.21.15.64:0/1704698415 conn(0x7fe35806d490 msgr2=0x7fe35809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 shutdown_connections 2024-09-21T07:37:56.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.663+0000 7fe35d000640 1 -- 172.21.15.64:0/1704698415 wait complete. 2024-09-21T07:37:56.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:37:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 -- 172.21.15.64:0/648479875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540caf00 msgr2=0x7f87540cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 --2- 172.21.15.64:0/648479875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540caf00 0x7f87540cb310 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f874c009cb0 tx=0x7f874c01cda0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 -- 172.21.15.64:0/648479875 shutdown_connections 2024-09-21T07:37:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 --2- 172.21.15.64:0/648479875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540caf00 0x7f87540cb310 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 --2- 172.21.15.64:0/648479875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540b4e00 0x7f87540af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 -- 172.21.15.64:0/648479875 >> 172.21.15.64:0/648479875 conn(0x7f875406d570 msgr2=0x7f87540b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 -- 172.21.15.64:0/648479875 shutdown_connections 2024-09-21T07:37:56.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.863+0000 7f875ae00640 1 -- 172.21.15.64:0/648479875 wait complete. 2024-09-21T07:37:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 Processor -- start 2024-09-21T07:37:56.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- start start 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f875406fae0 0x7f87540c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540caf00 0x7f87540c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8754168f00 con 0x7f87540ae670 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8754168d80 con 0x7f875406fae0 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8754169080 con 0x7f87540caf00 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:56.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55852/0 (socket says 172.21.15.64:55852) 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 -- 172.21.15.64:0/1282332541 learned_addr learned my addr 172.21.15.64:0/1282332541 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f874b400640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540caf00 0x7f87540c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8753e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f875406fae0 0x7f87540c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 -- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540caf00 msgr2=0x7f87540c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540caf00 0x7f87540c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 -- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f875406fae0 msgr2=0x7f87540c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f875406fae0 0x7f87540c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 -- 172.21.15.64:0/1282332541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540b07f0 con 0x7f87540ae670 2024-09-21T07:37:56.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8758e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f874c01a9d0 tx=0x7f874c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c0b2040 con 0x7f87540ae670 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f874c004d40 con 0x7f87540ae670 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87540b0c60 con 0x7f87540ae670 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c004260 con 0x7f87540ae670 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.867+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87540b1220 con 0x7f87540ae670 2024-09-21T07:37:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.871+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87540b09c0 con 0x7f87540ae670 2024-09-21T07:37:56.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.871+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f874c0be060 con 0x7f87540ae670 2024-09-21T07:37:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.871+0000 7f8750c00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 0x7f8730075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.871+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(216..216 src has 1..216) ==== 6001+0+0 (secure 0 0 0) 0x7f874c12e210 con 0x7f87540ae670 2024-09-21T07:37:56.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.871+0000 7f8753e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 0x7f8730075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:56.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.875+0000 7f8753e00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 0x7f8730075710 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8744007fd0 tx=0x7f8744009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:56.875 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:56.875+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f87540b09c0 con 0x7f87540ae670 2024-09-21T07:37:57.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.091+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f87540d0d60 con 0x7f87540ae670 2024-09-21T07:37:57.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.663+0000 7f8750c00640 1 -- 172.21.15.64:0/1282332541 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v156) ==== 174+0+0 (secure 0 0 0) 0x7f874c016990 con 0x7f87540ae670 2024-09-21T07:37:57.662 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 31 and data pool 32 2024-09-21T07:37:57.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 msgr2=0x7f8730075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:57.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 0x7f8730075710 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8744007fd0 tx=0x7f8744009040 comp rx=0 tx=0).stop 2024-09-21T07:37:57.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 msgr2=0x7f87540c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f874c01a9d0 tx=0x7f874c0092c0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 shutdown_connections 2024-09-21T07:37:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8730073200 0x7f8730075710 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87540ae670 0x7f87540c99e0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87540caf00 0x7f87540c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 --2- 172.21.15.64:0/1282332541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f875406fae0 0x7f87540c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.667+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 >> 172.21.15.64:0/1282332541 conn(0x7f875406d570 msgr2=0x7f8754157110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:57.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.671+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 shutdown_connections 2024-09-21T07:37:57.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.675+0000 7f875ae00640 1 -- 172.21.15.64:0/1282332541 wait complete. 2024-09-21T07:37:57.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:37:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 -- 172.21.15.64:0/1462745677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 msgr2=0x7fd3300ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 --2- 172.21.15.64:0/1462745677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ce440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd318009870 tx=0x7fd31801c860 comp rx=0 tx=0).stop 2024-09-21T07:37:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 -- 172.21.15.64:0/1462745677 shutdown_connections 2024-09-21T07:37:57.879 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 --2- 172.21.15.64:0/1462745677 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ce440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 -- 172.21.15.64:0/1462745677 >> 172.21.15.64:0/1462745677 conn(0x7fd3300b2f80 msgr2=0x7fd3300b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:57.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 -- 172.21.15.64:0/1462745677 shutdown_connections 2024-09-21T07:37:57.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.879+0000 7fd334e00640 1 -- 172.21.15.64:0/1462745677 wait complete. 2024-09-21T07:37:57.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 Processor -- start 2024-09-21T07:37:57.881 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 -- start start 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3300b1300 0x7fd330163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd33016a9c0 con 0x7fd3300ce030 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd33016a840 con 0x7fd3300b1300 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd334e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd33016ab40 con 0x7fd3300cd170 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55868/0 (socket says 172.21.15.64:55868) 2024-09-21T07:37:57.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 -- 172.21.15.64:0/2105613085 learned_addr learned my addr 172.21.15.64:0/2105613085 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:57.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32de00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3300b1300 0x7fd330163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd327e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 -- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 msgr2=0x7fd3300ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 -- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3300b1300 msgr2=0x7fd330163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3300b1300 0x7fd330163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 -- 172.21.15.64:0/2105613085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3300aef90 con 0x7fd3300ce030 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd327e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.883+0000 7fd32e800640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c730 tx=0x7fd32800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328003b80 con 0x7fd3300ce030 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd328003d60 con 0x7fd3300ce030 2024-09-21T07:37:57.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328005330 con 0x7fd3300ce030 2024-09-21T07:37:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3300af270 con 0x7fd3300ce030 2024-09-21T07:37:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3300af830 con 0x7fd3300ce030 2024-09-21T07:37:57.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3300aed00 con 0x7fd3300ce030 2024-09-21T07:37:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd3280056e0 con 0x7fd3300ce030 2024-09-21T07:37:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.887+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(217..217 src has 1..217) ==== 6101+0+0 (secure 0 0 0) 0x7fd328094490 con 0x7fd3300ce030 2024-09-21T07:37:57.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.891+0000 7fd32de00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:57.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.891+0000 7fd32de00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd320007fd0 tx=0x7fd320009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:57.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:57.895+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd32805f280 con 0x7fd3300ce030 2024-09-21T07:37:58.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3300ce440 con 0x7fd3300ce030 2024-09-21T07:37:58.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd326000640 1 -- 172.21.15.64:0/2105613085 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) ==== 74+0+16977 (secure 0 0 0) 0x7fd32805eb80 con 0x7fd3300ce030 2024-09-21T07:37:58.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:58.070 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":217,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:57.095220+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:37:54.857926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-21T07:37:56.058916+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:58.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 msgr2=0x7fd30c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd320007fd0 tx=0x7fd320009040 comp rx=0 tx=0).stop 2024-09-21T07:37:58.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 msgr2=0x7fd330151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c730 tx=0x7fd32800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 shutdown_connections 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd30c073200 0x7fd30c075710 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3300ce030 0x7fd330151780 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3300cd170 0x7fd3300ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.071+0000 7fd334e00640 1 --2- 172.21.15.64:0/2105613085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3300b1300 0x7fd330163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.075+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 >> 172.21.15.64:0/2105613085 conn(0x7fd3300b2f80 msgr2=0x7fd330071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.075+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 shutdown_connections 2024-09-21T07:37:58.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.075+0000 7fd334e00640 1 -- 172.21.15.64:0/2105613085 wait complete. 2024-09-21T07:37:58.094 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 -- 172.21.15.64:0/74298159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040b3170 msgr2=0x7f3e040b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 --2- 172.21.15.64:0/74298159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040b3170 0x7f3e040b3580 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009900 tx=0x7f3dec01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 -- 172.21.15.64:0/74298159 shutdown_connections 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 --2- 172.21.15.64:0/74298159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040b3170 0x7f3e040b3580 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 -- 172.21.15.64:0/74298159 >> 172.21.15.64:0/74298159 conn(0x7f3e0406d570 msgr2=0x7f3e040b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 -- 172.21.15.64:0/74298159 shutdown_connections 2024-09-21T07:37:58.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.251+0000 7f3e09a00640 1 -- 172.21.15.64:0/74298159 wait complete. 2024-09-21T07:37:58.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 Processor -- start 2024-09-21T07:37:58.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 -- start start 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e040b28e0 0x7f3e040c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e040b3170 0x7f3e040977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0416b1d0 con 0x7f3e040ccd30 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0416b050 con 0x7f3e040b3170 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e09a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0416b350 con 0x7f3e040b28e0 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.255+0000 7f3e03400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55890/0 (socket says 172.21.15.64:55890) 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 -- 172.21.15.64:0/2405901022 learned_addr learned my addr 172.21.15.64:0/2405901022 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3dfa000640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e040b3170 0x7f3e040977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e02a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e040b28e0 0x7f3e040c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 -- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e040b28e0 msgr2=0x7f3e040c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e040b28e0 0x7f3e040c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 -- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e040b3170 msgr2=0x7f3e040977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e040b3170 0x7f3e040977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 -- 172.21.15.64:0/2405901022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040c8c50 con 0x7f3e040ccd30 2024-09-21T07:37:58.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e03400640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00ba10 tx=0x7f3dfc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc019070 con 0x7f3e040ccd30 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dfc00cc30 con 0x7f3e040ccd30 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00ce60 con 0x7f3e040ccd30 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e040c8f30 con 0x7f3e040ccd30 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e040c94f0 con 0x7f3e040ccd30 2024-09-21T07:37:58.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e040c89c0 con 0x7f3e040ccd30 2024-09-21T07:37:58.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.259+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3dfc01c070 con 0x7f3e040ccd30 2024-09-21T07:37:58.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.263+0000 7f3dfb400640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 0x7f3de0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.263+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(217..217 src has 1..217) ==== 6101+0+0 (secure 0 0 0) 0x7f3dfc094240 con 0x7f3e040ccd30 2024-09-21T07:37:58.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.263+0000 7f3e02a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 0x7f3de0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.263+0000 7f3e02a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 0x7f3de0075710 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:58.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.263+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3dfc05eb80 con 0x7f3e040ccd30 2024-09-21T07:37:58.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e040b3580 con 0x7f3e040ccd30 2024-09-21T07:37:58.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3dfb400640 1 -- 172.21.15.64:0/2405901022 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) ==== 74+0+16977 (secure 0 0 0) 0x7f3dfc0635b0 con 0x7f3e040ccd30 2024-09-21T07:37:58.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:37:58.442 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":217,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:57.095220+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:37:54.857926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-21T07:37:56.058916+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 msgr2=0x7f3de0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 0x7f3de0075710 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4009040 comp rx=0 tx=0).stop 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 msgr2=0x7f3e040c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00ba10 tx=0x7f3dfc00bed0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 shutdown_connections 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3de0073200 0x7f3de0075710 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e040ccd30 0x7f3e040c9cf0 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e040b3170 0x7f3e040977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 --2- 172.21.15.64:0/2405901022 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e040b28e0 0x7f3e040c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 >> 172.21.15.64:0/2405901022 conn(0x7f3e0406d570 msgr2=0x7f3e040ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:58.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 shutdown_connections 2024-09-21T07:37:58.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.443+0000 7f3e09a00640 1 -- 172.21.15.64:0/2405901022 wait complete. 2024-09-21T07:37:58.465 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:37:58.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 -- 172.21.15.64:0/4216247568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c15af70 msgr2=0x7fc88c0b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 --2- 172.21.15.64:0/4216247568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c15af70 0x7fc88c0b2580 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fc88c15eb60 tx=0x7fc87c01c860 comp rx=0 tx=0).stop 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 -- 172.21.15.64:0/4216247568 shutdown_connections 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 --2- 172.21.15.64:0/4216247568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c073ae0 0x7fc88c073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 --2- 172.21.15.64:0/4216247568 >> v2:172.21.15.90:3300/0 conn(0x7fc88c06f0d0 0x7fc88c06f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 --2- 172.21.15.64:0/4216247568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c15af70 0x7fc88c0b2580 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 -- 172.21.15.64:0/4216247568 >> 172.21.15.64:0/4216247568 conn(0x7fc88c06d570 msgr2=0x7fc88c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 -- 172.21.15.64:0/4216247568 shutdown_connections 2024-09-21T07:37:58.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.627+0000 7fc893200640 1 -- 172.21.15.64:0/4216247568 wait complete. 2024-09-21T07:37:58.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 Processor -- start 2024-09-21T07:37:58.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 -- start start 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 0x7fc88c09aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c15af70 0x7fc88c09b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c0b3500 con 0x7fc88c06f0d0 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c0b3380 con 0x7fc88c073ae0 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc893200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c0b3680 con 0x7fc88c15af70 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55902/0 (socket says 172.21.15.64:55902) 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 -- 172.21.15.64:0/3274614702 learned_addr learned my addr 172.21.15.64:0/3274614702 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:58.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc883e00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 0x7fc88c09aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc891200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c15af70 0x7fc88c09b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 -- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c15af70 msgr2=0x7fc88c09b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c15af70 0x7fc88c09b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 -- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 msgr2=0x7fc88c09aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 0x7fc88c09aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 -- 172.21.15.64:0/3274614702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c09ce10 con 0x7fc88c06f0d0 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc883e00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 0x7fc88c09aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:37:58.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.631+0000 7fc88be00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0b0040 tx=0x7fc87c0a5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0b2040 con 0x7fc88c06f0d0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc87c0044b0 con 0x7fc88c06f0d0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c09d0f0 con 0x7fc88c06f0d0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0052d0 con 0x7fc88c06f0d0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c09d6b0 con 0x7fc88c06f0d0 2024-09-21T07:37:58.634 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c09c930 con 0x7fc88c06f0d0 2024-09-21T07:37:58.635 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc87c0bd060 con 0x7fc88c06f0d0 2024-09-21T07:37:58.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 0x7fc868075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:58.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.635+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(217..217 src has 1..217) ==== 6101+0+0 (secure 0 0 0) 0x7fc87c12df60 con 0x7fc88c06f0d0 2024-09-21T07:37:58.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.639+0000 7fc883e00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 0x7fc868075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:58.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.639+0000 7fc883e00640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 0x7fc868075710 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc874005fd0 tx=0x7fc874005e80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:58.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.639+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc88c09c930 con 0x7fc88c06f0d0 2024-09-21T07:37:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:58.859+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc88c073ef0 con 0x7fc88c06f0d0 2024-09-21T07:37:59.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.703+0000 7fc888c00640 1 -- 172.21.15.64:0/3274614702 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v159) ==== 118+0+0 (secure 0 0 0) 0x7fc87c0164b0 con 0x7fc88c06f0d0 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 msgr2=0x7fc868075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 0x7fc868075710 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc874005fd0 tx=0x7fc874005e80 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 msgr2=0x7fc88c099440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0b0040 tx=0x7fc87c0a5800 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 shutdown_connections 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc868073200 0x7fc868075710 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc88c15af70 0x7fc88c09b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88c073ae0 0x7fc88c09aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 --2- 172.21.15.64:0/3274614702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc88c06f0d0 0x7fc88c099440 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 >> 172.21.15.64:0/3274614702 conn(0x7fc88c06d570 msgr2=0x7fc88c159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 shutdown_connections 2024-09-21T07:37:59.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.707+0000 7fc893200640 1 -- 172.21.15.64:0/3274614702 wait complete. 2024-09-21T07:37:59.730 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:37:59.730 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 -- 172.21.15.64:0/1117137348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3006f7e0 msgr2=0x7f8c30074020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 --2- 172.21.15.64:0/1117137348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3006f7e0 0x7f8c30074020 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f8c3015eb60 tx=0x7f8c2801cb20 comp rx=0 tx=0).stop 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 -- 172.21.15.64:0/1117137348 shutdown_connections 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 --2- 172.21.15.64:0/1117137348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3006f7e0 0x7f8c30074020 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 --2- 172.21.15.64:0/1117137348 >> v2:172.21.15.90:3300/0 conn(0x7f8c300b4180 0x7f8c30073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 -- 172.21.15.64:0/1117137348 >> 172.21.15.64:0/1117137348 conn(0x7f8c3006d570 msgr2=0x7f8c300b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 -- 172.21.15.64:0/1117137348 shutdown_connections 2024-09-21T07:37:59.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.895+0000 7f8c34a00640 1 -- 172.21.15.64:0/1117137348 wait complete. 2024-09-21T07:37:59.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 Processor -- start 2024-09-21T07:37:59.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 -- start start 2024-09-21T07:37:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c3006f7e0 0x7f8c30153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c300b4180 0x7f8c301526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:59.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30074ce0 con 0x7f8c3015af70 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30074b60 con 0x7f8c300b4180 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c34a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8c30167c50 con 0x7f8c3006f7e0 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55924/0 (socket says 172.21.15.64:55924) 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.899+0000 7f8c2e800640 1 -- 172.21.15.64:0/2133779167 learned_addr learned my addr 172.21.15.64:0/2133779167 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c27e00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c300b4180 0x7f8c301526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2de00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c3006f7e0 0x7f8c30153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 -- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c3006f7e0 msgr2=0x7f8c30153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c3006f7e0 0x7f8c30153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 -- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c300b4180 msgr2=0x7f8c301526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c300b4180 0x7f8c301526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 -- 172.21.15.64:0/2133779167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c30154050 con 0x7f8c3015af70 2024-09-21T07:37:59.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c2e800640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009b10 tx=0x7f8c28009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280bc070 con 0x7f8c3015af70 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c280042f0 con 0x7f8c3015af70 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c301fcf70 con 0x7f8c3015af70 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280b2040 con 0x7f8c3015af70 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301f9180 con 0x7f8c3015af70 2024-09-21T07:37:59.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3006f0d0 con 0x7f8c3015af70 2024-09-21T07:37:59.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.903+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c280bf070 con 0x7f8c3015af70 2024-09-21T07:37:59.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.907+0000 7f8c26000640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 0x7f8c0c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:37:59.904 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.907+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f8c2812e230 con 0x7f8c3015af70 2024-09-21T07:37:59.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.907+0000 7f8c2de00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 0x7f8c0c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:37:59.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.907+0000 7f8c2de00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 0x7f8c0c075710 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8c200046c0 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:37:59.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:37:59.911+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8c30154050 con 0x7f8c3015af70 2024-09-21T07:38:00.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.123+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8c301556b0 con 0x7f8c3015af70 2024-09-21T07:38:00.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.710+0000 7f8c26000640 1 -- 172.21.15.64:0/2133779167 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v160) ==== 122+0+0 (secure 0 0 0) 0x7f8c28016770 con 0x7f8c3015af70 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 msgr2=0x7f8c0c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 0x7f8c0c075710 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8c200046c0 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 msgr2=0x7f8c30152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009b10 tx=0x7f8c28009310 comp rx=0 tx=0).stop 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 shutdown_connections 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8c0c073200 0x7f8c0c075710 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c3015af70 0x7f8c30152c30 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c300b4180 0x7f8c301526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 --2- 172.21.15.64:0/2133779167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8c3006f7e0 0x7f8c30153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 >> 172.21.15.64:0/2133779167 conn(0x7f8c3006d570 msgr2=0x7f8c300b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:00.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 shutdown_connections 2024-09-21T07:38:00.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.714+0000 7f8c34a00640 1 -- 172.21.15.64:0/2133779167 wait complete. 2024-09-21T07:38:00.734 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:38:00.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- 172.21.15.64:0/1939392681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 msgr2=0x7f854c0d0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 --2- 172.21.15.64:0/1939392681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c0d0b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8544009c80 tx=0x7f854401cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- 172.21.15.64:0/1939392681 shutdown_connections 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 --2- 172.21.15.64:0/1939392681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c0d0b00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 --2- 172.21.15.64:0/1939392681 >> v2:172.21.15.90:3300/0 conn(0x7f854c0b3990 0x7f854c0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- 172.21.15.64:0/1939392681 >> 172.21.15.64:0/1939392681 conn(0x7f854c0d24f0 msgr2=0x7f854c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- 172.21.15.64:0/1939392681 shutdown_connections 2024-09-21T07:38:00.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- 172.21.15.64:0/1939392681 wait complete. 2024-09-21T07:38:00.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 Processor -- start 2024-09-21T07:38:00.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.894+0000 7f8552800640 1 -- start start 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c0cf440 0x7f854c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b8030 con 0x7f854c0b3990 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0d1250 con 0x7f854c0cf440 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f854c169f20 con 0x7f854c0b66f0 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:00.897 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55936/0 (socket says 172.21.15.64:55936) 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 -- 172.21.15.64:0/1791192436 learned_addr learned my addr 172.21.15.64:0/1791192436 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8543e00640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854be00640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c0cf440 0x7f854c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 -- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 msgr2=0x7f854c153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 -- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c0cf440 msgr2=0x7f854c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c0cf440 0x7f854c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:00.898 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 -- 172.21.15.64:0/1791192436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c1542f0 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f854b400640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f853c00e9c0 tx=0x7f853c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c00cd80 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c09fc40 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c010520 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c010970 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c0b0e70 con 0x7f854c0b3990 2024-09-21T07:38:00.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.898+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c0b10d0 con 0x7f854c0b3990 2024-09-21T07:38:00.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.902+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f853c010b10 con 0x7f854c0b3990 2024-09-21T07:38:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.902+0000 7f8543400640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 0x7f8528075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.902+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f853c094f00 con 0x7f854c0b3990 2024-09-21T07:38:00.901 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.902+0000 7f8543e00640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 0x7f8528075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:00.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.902+0000 7f8543e00640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 0x7f8528075710 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f854c071760 tx=0x7f8534009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:00.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:00.906+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f853c05f620 con 0x7f854c0b3990 2024-09-21T07:38:01.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f854c157bb0 con 0x7f854c0b3990 2024-09-21T07:38:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8543400640 1 -- 172.21.15.64:0/1791192436 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7f853c064050 con 0x7f854c0b3990 2024-09-21T07:38:01.117 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:01.117 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:01.117 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 msgr2=0x7f8528075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 0x7f8528075710 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f854c071760 tx=0x7f8534009040 comp rx=0 tx=0).stop 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 msgr2=0x7f854c15bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f853c00e9c0 tx=0x7f853c00ee80 comp rx=0 tx=0).stop 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 shutdown_connections 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8528073200 0x7f8528075710 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c0cf440 0x7f854c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0b66f0 0x7f854c153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 --2- 172.21.15.64:0/1791192436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f854c0b3990 0x7f854c15bb70 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 >> 172.21.15.64:0/1791192436 conn(0x7f854c0d24f0 msgr2=0x7f854c15d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 shutdown_connections 2024-09-21T07:38:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.118+0000 7f8552800640 1 -- 172.21.15.64:0/1791192436 wait complete. 2024-09-21T07:38:01.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:01.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 -- 172.21.15.64:0/3899250587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980cd440 msgr2=0x7f6f980b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 --2- 172.21.15.64:0/3899250587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980cd440 0x7f6f980b3580 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009c80 tx=0x7f6f9001cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 -- 172.21.15.64:0/3899250587 shutdown_connections 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 --2- 172.21.15.64:0/3899250587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980cd440 0x7f6f980b3580 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 --2- 172.21.15.64:0/3899250587 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f980b28e0 0x7f6f9815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 -- 172.21.15.64:0/3899250587 >> 172.21.15.64:0/3899250587 conn(0x7f6f9806d570 msgr2=0x7f6f980b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 -- 172.21.15.64:0/3899250587 shutdown_connections 2024-09-21T07:38:01.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.298+0000 7f6f9d200640 1 -- 172.21.15.64:0/3899250587 wait complete. 2024-09-21T07:38:01.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 Processor -- start 2024-09-21T07:38:01.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- start start 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 0x7f6f98156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f98099c00 0x7f6f98155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98169fd0 con 0x7f6f980b28e0 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98169e50 con 0x7f6f980b3170 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9816a150 con 0x7f6f98099c00 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55960/0 (socket says 172.21.15.64:55960) 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 -- 172.21.15.64:0/42138540 learned_addr learned my addr 172.21.15.64:0/42138540 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f8fe00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 0x7f6f98156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f96800640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f98099c00 0x7f6f98155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 -- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f98099c00 msgr2=0x7f6f98155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f98099c00 0x7f6f98155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 -- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 msgr2=0x7f6f98156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 0x7f6f98156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 -- 172.21.15.64:0/42138540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f980c9fa0 con 0x7f6f980b28e0 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f8fe00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 0x7f6f98156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:01.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f95e00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800d780 tx=0x7f6f8800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88017070 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f88004310 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88005280 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f980ca280 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.302+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f98154810 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9815c6f0 con 0x7f6f980b28e0 2024-09-21T07:38:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f88005420 con 0x7f6f980b28e0 2024-09-21T07:38:01.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f8e000640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 0x7f6f74075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f6f880945a0 con 0x7f6f980b28e0 2024-09-21T07:38:01.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f8fe00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 0x7f6f74075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.306+0000 7f6f8fe00640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 0x7f6f74075740 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6f980b2430 tx=0x7f6f80009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:01.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.310+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6f88020020 con 0x7f6f980b28e0 2024-09-21T07:38:01.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.486+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f9815af60 con 0x7f6f980b28e0 2024-09-21T07:38:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.486+0000 7f6f8e000640 1 -- 172.21.15.64:0/42138540 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) ==== 74+0+16964 (secure 0 0 0) 0x7f6f8805f550 con 0x7f6f980b28e0 2024-09-21T07:38:01.488 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:01.488 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":218,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:58.665379+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:37:54.857926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-21T07:37:56.058916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 msgr2=0x7f6f74075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 0x7f6f74075740 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6f980b2430 tx=0x7f6f80009040 comp rx=0 tx=0).stop 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 msgr2=0x7f6f98156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800d780 tx=0x7f6f8800dc40 comp rx=0 tx=0).stop 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 shutdown_connections 2024-09-21T07:38:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6f74073230 0x7f6f74075740 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6f98099c00 0x7f6f98155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f980b3170 0x7f6f98156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 --2- 172.21.15.64:0/42138540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f980b28e0 0x7f6f98156800 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 >> 172.21.15.64:0/42138540 conn(0x7f6f9806d570 msgr2=0x7f6f981595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 shutdown_connections 2024-09-21T07:38:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.490+0000 7f6f9d200640 1 -- 172.21.15.64:0/42138540 wait complete. 2024-09-21T07:38:01.510 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:38:01.511 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 -- 172.21.15.64:0/2144431858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dc4005260 msgr2=0x7f2dc400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 --2- 172.21.15.64:0/2144431858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dc4005260 0x7f2dc400b9d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c660 tx=0x7f2dd801d2e0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 -- 172.21.15.64:0/2144431858 shutdown_connections 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 --2- 172.21.15.64:0/2144431858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dc4005260 0x7f2dc400b9d0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 -- 172.21.15.64:0/2144431858 >> 172.21.15.64:0/2144431858 conn(0x7f2de006d570 msgr2=0x7f2de00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 -- 172.21.15.64:0/2144431858 shutdown_connections 2024-09-21T07:38:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.670+0000 7f2de5a00640 1 -- 172.21.15.64:0/2144431858 wait complete. 2024-09-21T07:38:01.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 Processor -- start 2024-09-21T07:38:01.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- start start 2024-09-21T07:38:01.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 0x7f2de01f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 0x7f2de00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2de00afb70 con 0x7f2de01f4e80 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2de00af9f0 con 0x7f2dc4005260 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2de00b46f0 con 0x7f2de009dbe0 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55976/0 (socket says 172.21.15.64:55976) 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 -- 172.21.15.64:0/3554738086 learned_addr learned my addr 172.21.15.64:0/3554738086 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2ddea00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 0x7f2de01f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2ddf400640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 0x7f2de00c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 -- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 msgr2=0x7f2de00c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 0x7f2de00c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 -- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 msgr2=0x7f2de01f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 0x7f2de01f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 -- 172.21.15.64:0/3554738086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de015d400 con 0x7f2de01f4e80 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2ddea00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 0x7f2de01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2ddf400640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 0x7f2de00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd7e00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8005e10 tx=0x7f2dc8011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc801f070 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dc800fc30 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de015d6e0 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8012450 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.674+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de00c7270 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de00b4c50 con 0x7f2de01f4e80 2024-09-21T07:38:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2dc8022070 con 0x7f2de01f4e80 2024-09-21T07:38:01.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2dd6a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 0x7f2dbc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:01.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2dc8094de0 con 0x7f2de01f4e80 2024-09-21T07:38:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2ddea00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 0x7f2dbc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.678+0000 7f2ddea00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 0x7f2dbc075740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0006fd0 tx=0x7f2dd0006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:01.682 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.682+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2dc805f580 con 0x7f2de01f4e80 2024-09-21T07:38:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.858+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2de00ad870 con 0x7f2dbc073230 2024-09-21T07:38:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.862+0000 7f2dd6a00640 1 -- 172.21.15.64:0/3554738086 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249311 (secure 0 0 0) 0x7f2de00ad870 con 0x7f2dbc073230 2024-09-21T07:38:01.866 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:01.868 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 msgr2=0x7f2dbc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 0x7f2dbc075740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0006fd0 tx=0x7f2dd0006b80 comp rx=0 tx=0).stop 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 msgr2=0x7f2de009d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8005e10 tx=0x7f2dc8011be0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 shutdown_connections 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2dbc073230 0x7f2dbc075740 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2de009dbe0 0x7f2de00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2de01f4e80 0x7f2de009d6a0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 --2- 172.21.15.64:0/3554738086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4005260 0x7f2de01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:01.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 >> 172.21.15.64:0/3554738086 conn(0x7f2de006d570 msgr2=0x7f2de0073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:01.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 shutdown_connections 2024-09-21T07:38:01.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:01.866+0000 7f2de5a00640 1 -- 172.21.15.64:0/3554738086 wait complete. 2024-09-21T07:38:01.888 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":674,"stamp":"2024-09-21T07:38:01.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":119,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469108,"kb_used_data":22520,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754505612,"statfs":{"total":773094113280,"available":772613746688,"internally_reserved":0,"allocated":23060480,"data_stored":11519100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671244+0000","last_change":"2024-09-21T07:37:57.686919+0000","last_active":"2024-09-21T07:37:58.671244+0000","last_peered":"2024-09-21T07:37:58.671244+0000","last_clean":"2024-09-21T07:37:58.671244+0000","last_became_active":"2024-09-21T07:37:57.686610+0000","last_became_peered":"2024-09-21T07:37:57.686610+0000","last_unstale":"2024-09-21T07:37:58.671244+0000","last_undegraded":"2024-09-21T07:37:58.671244+0000","last_fullsized":"2024-09-21T07:37:58.671244+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.888561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678707+0000","last_change":"2024-09-21T07:37:56.678707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678707+0000","last_undegraded":"2024-09-21T07:37:56.678707+0000","last_fullsized":"2024-09-21T07:37:56.678707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.699880+0000","last_change":"2024-09-21T07:37:57.692560+0000","last_active":"2024-09-21T07:37:57.699880+0000","last_peered":"2024-09-21T07:37:57.699880+0000","last_clean":"2024-09-21T07:37:57.699880+0000","last_became_active":"2024-09-21T07:37:57.686329+0000","last_became_peered":"2024-09-21T07:37:57.686329+0000","last_unstale":"2024-09-21T07:37:57.699880+0000","last_undegraded":"2024-09-21T07:37:57.699880+0000","last_fullsized":"2024-09-21T07:37:57.699880+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:30.089335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.701001+0000","last_change":"2024-09-21T07:37:57.692825+0000","last_active":"2024-09-21T07:37:57.701001+0000","last_peered":"2024-09-21T07:37:57.701001+0000","last_clean":"2024-09-21T07:37:57.701001+0000","last_became_active":"2024-09-21T07:37:57.692506+0000","last_became_peered":"2024-09-21T07:37:57.692506+0000","last_unstale":"2024-09-21T07:37:57.701001+0000","last_undegraded":"2024-09-21T07:37:57.701001+0000","last_fullsized":"2024-09-21T07:37:57.701001+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:47.392925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667034+0000","last_change":"2024-09-21T07:37:56.667034+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667034+0000","last_undegraded":"2024-09-21T07:37:56.667034+0000","last_fullsized":"2024-09-21T07:37:56.667034+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670585+0000","last_change":"2024-09-21T07:37:57.690137+0000","last_active":"2024-09-21T07:37:58.670585+0000","last_peered":"2024-09-21T07:37:58.670585+0000","last_clean":"2024-09-21T07:37:58.670585+0000","last_became_active":"2024-09-21T07:37:57.689839+0000","last_became_peered":"2024-09-21T07:37:57.689839+0000","last_unstale":"2024-09-21T07:37:58.670585+0000","last_undegraded":"2024-09-21T07:37:58.670585+0000","last_fullsized":"2024-09-21T07:37:58.670585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.086074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666479+0000","last_change":"2024-09-21T07:37:56.666479+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666479+0000","last_undegraded":"2024-09-21T07:37:56.666479+0000","last_fullsized":"2024-09-21T07:37:56.666479+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671385+0000","last_change":"2024-09-21T07:37:57.689677+0000","last_active":"2024-09-21T07:37:58.671385+0000","last_peered":"2024-09-21T07:37:58.671385+0000","last_clean":"2024-09-21T07:37:58.671385+0000","last_became_active":"2024-09-21T07:37:57.689320+0000","last_became_peered":"2024-09-21T07:37:57.689320+0000","last_unstale":"2024-09-21T07:37:58.671385+0000","last_undegraded":"2024-09-21T07:37:58.671385+0000","last_fullsized":"2024-09-21T07:37:58.671385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.136328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705127+0000","last_change":"2024-09-21T07:37:57.694043+0000","last_active":"2024-09-21T07:37:57.705127+0000","last_peered":"2024-09-21T07:37:57.705127+0000","last_clean":"2024-09-21T07:37:57.705127+0000","last_became_active":"2024-09-21T07:37:57.693686+0000","last_became_peered":"2024-09-21T07:37:57.693686+0000","last_unstale":"2024-09-21T07:37:57.705127+0000","last_undegraded":"2024-09-21T07:37:57.705127+0000","last_fullsized":"2024-09-21T07:37:57.705127+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:19.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.707799+0000","last_change":"2024-09-21T07:37:57.696681+0000","last_active":"2024-09-21T07:37:57.707799+0000","last_peered":"2024-09-21T07:37:57.707799+0000","last_clean":"2024-09-21T07:37:57.707799+0000","last_became_active":"2024-09-21T07:37:57.696311+0000","last_became_peered":"2024-09-21T07:37:57.696311+0000","last_unstale":"2024-09-21T07:37:57.707799+0000","last_undegraded":"2024-09-21T07:37:57.707799+0000","last_fullsized":"2024-09-21T07:37:57.707799+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:29.232647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670912+0000","last_change":"2024-09-21T07:37:57.679345+0000","last_active":"2024-09-21T07:37:58.670912+0000","last_peered":"2024-09-21T07:37:58.670912+0000","last_clean":"2024-09-21T07:37:58.670912+0000","last_became_active":"2024-09-21T07:37:57.678467+0000","last_became_peered":"2024-09-21T07:37:57.678467+0000","last_unstale":"2024-09-21T07:37:58.670912+0000","last_undegraded":"2024-09-21T07:37:58.670912+0000","last_fullsized":"2024-09-21T07:37:58.670912+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:41.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672277+0000","last_change":"2024-09-21T07:37:56.672277+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672277+0000","last_undegraded":"2024-09-21T07:37:56.672277+0000","last_fullsized":"2024-09-21T07:37:56.672277+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.685438+0000","last_change":"2024-09-21T07:37:56.685438+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.685438+0000","last_undegraded":"2024-09-21T07:37:56.685438+0000","last_fullsized":"2024-09-21T07:37:56.685438+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973985+0000","last_change":"2024-09-21T07:37:57.682989+0000","last_active":"2024-09-21T07:37:58.973985+0000","last_peered":"2024-09-21T07:37:58.973985+0000","last_clean":"2024-09-21T07:37:58.973985+0000","last_became_active":"2024-09-21T07:37:57.682619+0000","last_became_peered":"2024-09-21T07:37:57.682619+0000","last_unstale":"2024-09-21T07:37:58.973985+0000","last_undegraded":"2024-09-21T07:37:58.973985+0000","last_fullsized":"2024-09-21T07:37:58.973985+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:32.009487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.708901+0000","last_change":"2024-09-21T07:37:57.705839+0000","last_active":"2024-09-21T07:37:57.708901+0000","last_peered":"2024-09-21T07:37:57.708901+0000","last_clean":"2024-09-21T07:37:57.708901+0000","last_became_active":"2024-09-21T07:37:57.705526+0000","last_became_peered":"2024-09-21T07:37:57.705526+0000","last_unstale":"2024-09-21T07:37:57.708901+0000","last_undegraded":"2024-09-21T07:37:57.708901+0000","last_fullsized":"2024-09-21T07:37:57.708901+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:28.397601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673122+0000","last_change":"2024-09-21T07:37:56.673122+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673122+0000","last_undegraded":"2024-09-21T07:37:56.673122+0000","last_fullsized":"2024-09-21T07:37:56.673122+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.698334+0000","last_change":"2024-09-21T07:37:57.688241+0000","last_active":"2024-09-21T07:37:57.698334+0000","last_peered":"2024-09-21T07:37:57.698334+0000","last_clean":"2024-09-21T07:37:57.698334+0000","last_became_active":"2024-09-21T07:37:57.687847+0000","last_became_peered":"2024-09-21T07:37:57.687847+0000","last_unstale":"2024-09-21T07:37:57.698334+0000","last_undegraded":"2024-09-21T07:37:57.698334+0000","last_fullsized":"2024-09-21T07:37:57.698334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:32.911732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974306+0000","last_change":"2024-09-21T07:37:57.683606+0000","last_active":"2024-09-21T07:37:58.974306+0000","last_peered":"2024-09-21T07:37:58.974306+0000","last_clean":"2024-09-21T07:37:58.974306+0000","last_became_active":"2024-09-21T07:37:57.683282+0000","last_became_peered":"2024-09-21T07:37:57.683282+0000","last_unstale":"2024-09-21T07:37:58.974306+0000","last_undegraded":"2024-09-21T07:37:58.974306+0000","last_fullsized":"2024-09-21T07:37:58.974306+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:56.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672196+0000","last_change":"2024-09-21T07:37:56.672196+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672196+0000","last_undegraded":"2024-09-21T07:37:56.672196+0000","last_fullsized":"2024-09-21T07:37:56.672196+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667178+0000","last_change":"2024-09-21T07:37:56.667178+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667178+0000","last_undegraded":"2024-09-21T07:37:56.667178+0000","last_fullsized":"2024-09-21T07:37:56.667178+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673748+0000","last_change":"2024-09-21T07:37:56.673748+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673748+0000","last_undegraded":"2024-09-21T07:37:56.673748+0000","last_fullsized":"2024-09-21T07:37:56.673748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974319+0000","last_change":"2024-09-21T07:37:57.703344+0000","last_active":"2024-09-21T07:37:58.974319+0000","last_peered":"2024-09-21T07:37:58.974319+0000","last_clean":"2024-09-21T07:37:58.974319+0000","last_became_active":"2024-09-21T07:37:57.702763+0000","last_became_peered":"2024-09-21T07:37:57.702763+0000","last_unstale":"2024-09-21T07:37:58.974319+0000","last_undegraded":"2024-09-21T07:37:58.974319+0000","last_fullsized":"2024-09-21T07:37:58.974319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:12.340315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674813+0000","last_change":"2024-09-21T07:37:56.674813+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674813+0000","last_undegraded":"2024-09-21T07:37:56.674813+0000","last_fullsized":"2024-09-21T07:37:56.674813+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674609+0000","last_change":"2024-09-21T07:37:56.674609+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674609+0000","last_undegraded":"2024-09-21T07:37:56.674609+0000","last_fullsized":"2024-09-21T07:37:56.674609+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670498+0000","last_change":"2024-09-21T07:37:56.670498+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670498+0000","last_undegraded":"2024-09-21T07:37:56.670498+0000","last_fullsized":"2024-09-21T07:37:56.670498+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667488+0000","last_change":"2024-09-21T07:37:56.667488+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667488+0000","last_undegraded":"2024-09-21T07:37:56.667488+0000","last_fullsized":"2024-09-21T07:37:56.667488+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670927+0000","last_change":"2024-09-21T07:37:57.689041+0000","last_active":"2024-09-21T07:37:58.670927+0000","last_peered":"2024-09-21T07:37:58.670927+0000","last_clean":"2024-09-21T07:37:58.670927+0000","last_became_active":"2024-09-21T07:37:57.688683+0000","last_became_peered":"2024-09-21T07:37:57.688683+0000","last_unstale":"2024-09-21T07:37:58.670927+0000","last_undegraded":"2024-09-21T07:37:58.670927+0000","last_fullsized":"2024-09-21T07:37:58.670927+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:08.217425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678709+0000","last_change":"2024-09-21T07:37:56.678709+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678709+0000","last_undegraded":"2024-09-21T07:37:56.678709+0000","last_fullsized":"2024-09-21T07:37:56.678709+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679812+0000","last_change":"2024-09-21T07:37:56.679812+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679812+0000","last_undegraded":"2024-09-21T07:37:56.679812+0000","last_fullsized":"2024-09-21T07:37:56.679812+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672068+0000","last_change":"2024-09-21T07:37:56.672068+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672068+0000","last_undegraded":"2024-09-21T07:37:56.672068+0000","last_fullsized":"2024-09-21T07:37:56.672068+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670510+0000","last_change":"2024-09-21T07:37:57.688877+0000","last_active":"2024-09-21T07:37:58.670510+0000","last_peered":"2024-09-21T07:37:58.670510+0000","last_clean":"2024-09-21T07:37:58.670510+0000","last_became_active":"2024-09-21T07:37:57.688564+0000","last_became_peered":"2024-09-21T07:37:57.688564+0000","last_unstale":"2024-09-21T07:37:58.670510+0000","last_undegraded":"2024-09-21T07:37:58.670510+0000","last_fullsized":"2024-09-21T07:37:58.670510+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:49.285747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672601+0000","last_change":"2024-09-21T07:37:56.672601+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672601+0000","last_undegraded":"2024-09-21T07:37:56.672601+0000","last_fullsized":"2024-09-21T07:37:56.672601+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"217'4","reported_seq":19,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671169+0000","last_change":"2024-09-21T07:37:56.681003+0000","last_active":"2024-09-21T07:37:58.671169+0000","last_peered":"2024-09-21T07:37:58.671169+0000","last_clean":"2024-09-21T07:37:58.671169+0000","last_became_active":"2024-09-21T07:37:56.680677+0000","last_became_peered":"2024-09-21T07:37:56.680677+0000","last_unstale":"2024-09-21T07:37:58.671169+0000","last_undegraded":"2024-09-21T07:37:58.671169+0000","last_fullsized":"2024-09-21T07:37:58.671169+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.630114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974033+0000","last_change":"2024-09-21T07:37:57.696302+0000","last_active":"2024-09-21T07:37:58.974033+0000","last_peered":"2024-09-21T07:37:58.974033+0000","last_clean":"2024-09-21T07:37:58.974033+0000","last_became_active":"2024-09-21T07:37:57.695957+0000","last_became_peered":"2024-09-21T07:37:57.695957+0000","last_unstale":"2024-09-21T07:37:58.974033+0000","last_undegraded":"2024-09-21T07:37:58.974033+0000","last_fullsized":"2024-09-21T07:37:58.974033+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:01.310825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685152+0000","last_change":"2024-09-21T07:37:56.682377+0000","last_active":"2024-09-21T07:37:56.685152+0000","last_peered":"2024-09-21T07:37:56.685152+0000","last_clean":"2024-09-21T07:37:56.685152+0000","last_became_active":"2024-09-21T07:37:56.682050+0000","last_became_peered":"2024-09-21T07:37:56.682050+0000","last_unstale":"2024-09-21T07:37:56.685152+0000","last_undegraded":"2024-09-21T07:37:56.685152+0000","last_fullsized":"2024-09-21T07:37:56.685152+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:20.420448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670800+0000","last_change":"2024-09-21T07:37:57.685402+0000","last_active":"2024-09-21T07:37:58.670800+0000","last_peered":"2024-09-21T07:37:58.670800+0000","last_clean":"2024-09-21T07:37:58.670800+0000","last_became_active":"2024-09-21T07:37:57.684889+0000","last_became_peered":"2024-09-21T07:37:57.684889+0000","last_unstale":"2024-09-21T07:37:58.670800+0000","last_undegraded":"2024-09-21T07:37:58.670800+0000","last_fullsized":"2024-09-21T07:37:58.670800+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.332634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693589+0000","last_change":"2024-09-21T07:37:56.689098+0000","last_active":"2024-09-21T07:37:56.693589+0000","last_peered":"2024-09-21T07:37:56.693589+0000","last_clean":"2024-09-21T07:37:56.693589+0000","last_became_active":"2024-09-21T07:37:56.684546+0000","last_became_peered":"2024-09-21T07:37:56.684546+0000","last_unstale":"2024-09-21T07:37:56.693589+0000","last_undegraded":"2024-09-21T07:37:56.693589+0000","last_fullsized":"2024-09-21T07:37:56.693589+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.173866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678642+0000","last_change":"2024-09-21T07:37:56.678642+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678642+0000","last_undegraded":"2024-09-21T07:37:56.678642+0000","last_fullsized":"2024-09-21T07:37:56.678642+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973906+0000","last_change":"2024-09-21T07:37:56.693584+0000","last_active":"2024-09-21T07:37:58.973906+0000","last_peered":"2024-09-21T07:37:58.973906+0000","last_clean":"2024-09-21T07:37:58.973906+0000","last_became_active":"2024-09-21T07:37:56.693288+0000","last_became_peered":"2024-09-21T07:37:56.693288+0000","last_unstale":"2024-09-21T07:37:58.973906+0000","last_undegraded":"2024-09-21T07:37:58.973906+0000","last_fullsized":"2024-09-21T07:37:58.973906+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:01.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668226+0000","last_change":"2024-09-21T07:37:56.668226+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668226+0000","last_undegraded":"2024-09-21T07:37:56.668226+0000","last_fullsized":"2024-09-21T07:37:56.668226+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694021+0000","last_change":"2024-09-21T07:37:56.689298+0000","last_active":"2024-09-21T07:37:56.694021+0000","last_peered":"2024-09-21T07:37:56.694021+0000","last_clean":"2024-09-21T07:37:56.694021+0000","last_became_active":"2024-09-21T07:37:56.688807+0000","last_became_peered":"2024-09-21T07:37:56.688807+0000","last_unstale":"2024-09-21T07:37:56.694021+0000","last_undegraded":"2024-09-21T07:37:56.694021+0000","last_fullsized":"2024-09-21T07:37:56.694021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:59.971298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705101+0000","last_change":"2024-09-21T07:37:57.693164+0000","last_active":"2024-09-21T07:37:57.705101+0000","last_peered":"2024-09-21T07:37:57.705101+0000","last_clean":"2024-09-21T07:37:57.705101+0000","last_became_active":"2024-09-21T07:37:57.692831+0000","last_became_peered":"2024-09-21T07:37:57.692831+0000","last_unstale":"2024-09-21T07:37:57.705101+0000","last_undegraded":"2024-09-21T07:37:57.705101+0000","last_fullsized":"2024-09-21T07:37:57.705101+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:07.215948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680120+0000","last_change":"2024-09-21T07:37:56.696904+0000","last_active":"2024-09-21T07:37:57.680120+0000","last_peered":"2024-09-21T07:37:57.680120+0000","last_clean":"2024-09-21T07:37:57.680120+0000","last_became_active":"2024-09-21T07:37:56.696373+0000","last_became_peered":"2024-09-21T07:37:56.696373+0000","last_unstale":"2024-09-21T07:37:57.680120+0000","last_undegraded":"2024-09-21T07:37:57.680120+0000","last_fullsized":"2024-09-21T07:37:57.680120+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:12.535237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667847+0000","last_change":"2024-09-21T07:37:56.667847+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667847+0000","last_undegraded":"2024-09-21T07:37:56.667847+0000","last_fullsized":"2024-09-21T07:37:56.667847+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670323+0000","last_change":"2024-09-21T07:37:56.681896+0000","last_active":"2024-09-21T07:37:58.670323+0000","last_peered":"2024-09-21T07:37:58.670323+0000","last_clean":"2024-09-21T07:37:58.670323+0000","last_became_active":"2024-09-21T07:37:56.681584+0000","last_became_peered":"2024-09-21T07:37:56.681584+0000","last_unstale":"2024-09-21T07:37:58.670323+0000","last_undegraded":"2024-09-21T07:37:58.670323+0000","last_fullsized":"2024-09-21T07:37:58.670323+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:24.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689761+0000","last_change":"2024-09-21T07:37:56.687358+0000","last_active":"2024-09-21T07:37:56.689761+0000","last_peered":"2024-09-21T07:37:56.689761+0000","last_clean":"2024-09-21T07:37:56.689761+0000","last_became_active":"2024-09-21T07:37:56.685812+0000","last_became_peered":"2024-09-21T07:37:56.685812+0000","last_unstale":"2024-09-21T07:37:56.689761+0000","last_undegraded":"2024-09-21T07:37:56.689761+0000","last_fullsized":"2024-09-21T07:37:56.689761+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:06.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672823+0000","last_change":"2024-09-21T07:37:56.672823+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672823+0000","last_undegraded":"2024-09-21T07:37:56.672823+0000","last_fullsized":"2024-09-21T07:37:56.672823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.681430+0000","last_change":"2024-09-21T07:37:56.700571+0000","last_active":"2024-09-21T07:37:57.681430+0000","last_peered":"2024-09-21T07:37:57.681430+0000","last_clean":"2024-09-21T07:37:57.681430+0000","last_became_active":"2024-09-21T07:37:56.700152+0000","last_became_peered":"2024-09-21T07:37:56.700152+0000","last_unstale":"2024-09-21T07:37:57.681430+0000","last_undegraded":"2024-09-21T07:37:57.681430+0000","last_fullsized":"2024-09-21T07:37:57.681430+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:16.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705065+0000","last_change":"2024-09-21T07:37:57.694048+0000","last_active":"2024-09-21T07:37:57.705065+0000","last_peered":"2024-09-21T07:37:57.705065+0000","last_clean":"2024-09-21T07:37:57.705065+0000","last_became_active":"2024-09-21T07:37:57.693768+0000","last_became_peered":"2024-09-21T07:37:57.693768+0000","last_unstale":"2024-09-21T07:37:57.705065+0000","last_undegraded":"2024-09-21T07:37:57.705065+0000","last_fullsized":"2024-09-21T07:37:57.705065+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:09.584828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685220+0000","last_change":"2024-09-21T07:37:56.682914+0000","last_active":"2024-09-21T07:37:56.685220+0000","last_peered":"2024-09-21T07:37:56.685220+0000","last_clean":"2024-09-21T07:37:56.685220+0000","last_became_active":"2024-09-21T07:37:56.681968+0000","last_became_peered":"2024-09-21T07:37:56.681968+0000","last_unstale":"2024-09-21T07:37:56.685220+0000","last_undegraded":"2024-09-21T07:37:56.685220+0000","last_fullsized":"2024-09-21T07:37:56.685220+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:57.037229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667707+0000","last_change":"2024-09-21T07:37:56.667707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667707+0000","last_undegraded":"2024-09-21T07:37:56.667707+0000","last_fullsized":"2024-09-21T07:37:56.667707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"217'6","reported_seq":21,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671074+0000","last_change":"2024-09-21T07:37:56.681926+0000","last_active":"2024-09-21T07:37:58.671074+0000","last_peered":"2024-09-21T07:37:58.671074+0000","last_clean":"2024-09-21T07:37:58.671074+0000","last_became_active":"2024-09-21T07:37:56.681625+0000","last_became_peered":"2024-09-21T07:37:56.681625+0000","last_unstale":"2024-09-21T07:37:58.671074+0000","last_undegraded":"2024-09-21T07:37:58.671074+0000","last_fullsized":"2024-09-21T07:37:58.671074+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:04.257605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974068+0000","last_change":"2024-09-21T07:37:56.690462+0000","last_active":"2024-09-21T07:37:58.974068+0000","last_peered":"2024-09-21T07:37:58.974068+0000","last_clean":"2024-09-21T07:37:58.974068+0000","last_became_active":"2024-09-21T07:37:56.690094+0000","last_became_peered":"2024-09-21T07:37:56.690094+0000","last_unstale":"2024-09-21T07:37:58.974068+0000","last_undegraded":"2024-09-21T07:37:58.974068+0000","last_fullsized":"2024-09-21T07:37:58.974068+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:41.064369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668733+0000","last_change":"2024-09-21T07:37:56.668733+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668733+0000","last_undegraded":"2024-09-21T07:37:56.668733+0000","last_fullsized":"2024-09-21T07:37:56.668733+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.687335+0000","last_change":"2024-09-21T07:37:56.686422+0000","last_active":"2024-09-21T07:37:56.687335+0000","last_peered":"2024-09-21T07:37:56.687335+0000","last_clean":"2024-09-21T07:37:56.687335+0000","last_became_active":"2024-09-21T07:37:56.685790+0000","last_became_peered":"2024-09-21T07:37:56.685790+0000","last_unstale":"2024-09-21T07:37:56.687335+0000","last_undegraded":"2024-09-21T07:37:56.687335+0000","last_fullsized":"2024-09-21T07:37:56.687335+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:39.021255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974271+0000","last_change":"2024-09-21T07:37:57.696921+0000","last_active":"2024-09-21T07:37:58.974271+0000","last_peered":"2024-09-21T07:37:58.974271+0000","last_clean":"2024-09-21T07:37:58.974271+0000","last_became_active":"2024-09-21T07:37:57.695559+0000","last_became_peered":"2024-09-21T07:37:57.695559+0000","last_unstale":"2024-09-21T07:37:58.974271+0000","last_undegraded":"2024-09-21T07:37:58.974271+0000","last_fullsized":"2024-09-21T07:37:58.974271+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.675113+0000","last_change":"2024-09-21T07:37:56.671057+0000","last_active":"2024-09-21T07:37:56.675113+0000","last_peered":"2024-09-21T07:37:56.675113+0000","last_clean":"2024-09-21T07:37:56.675113+0000","last_became_active":"2024-09-21T07:37:56.670715+0000","last_became_peered":"2024-09-21T07:37:56.670715+0000","last_unstale":"2024-09-21T07:37:56.675113+0000","last_undegraded":"2024-09-21T07:37:56.675113+0000","last_fullsized":"2024-09-21T07:37:56.675113+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:51.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668334+0000","last_change":"2024-09-21T07:37:56.668334+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668334+0000","last_undegraded":"2024-09-21T07:37:56.668334+0000","last_fullsized":"2024-09-21T07:37:56.668334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.692726+0000","last_change":"2024-09-21T07:37:56.691680+0000","last_active":"2024-09-21T07:37:56.692726+0000","last_peered":"2024-09-21T07:37:56.692726+0000","last_clean":"2024-09-21T07:37:56.692726+0000","last_became_active":"2024-09-21T07:37:56.691374+0000","last_became_peered":"2024-09-21T07:37:56.691374+0000","last_unstale":"2024-09-21T07:37:56.692726+0000","last_undegraded":"2024-09-21T07:37:56.692726+0000","last_fullsized":"2024-09-21T07:37:56.692726+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:14.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667126+0000","last_change":"2024-09-21T07:37:56.667126+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667126+0000","last_undegraded":"2024-09-21T07:37:56.667126+0000","last_fullsized":"2024-09-21T07:37:56.667126+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671365+0000","last_change":"2024-09-21T07:37:56.674146+0000","last_active":"2024-09-21T07:37:58.671365+0000","last_peered":"2024-09-21T07:37:58.671365+0000","last_clean":"2024-09-21T07:37:58.671365+0000","last_became_active":"2024-09-21T07:37:56.673828+0000","last_became_peered":"2024-09-21T07:37:56.673828+0000","last_unstale":"2024-09-21T07:37:58.671365+0000","last_undegraded":"2024-09-21T07:37:58.671365+0000","last_fullsized":"2024-09-21T07:37:58.671365+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:27.388800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666907+0000","last_change":"2024-09-21T07:37:56.666907+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666907+0000","last_undegraded":"2024-09-21T07:37:56.666907+0000","last_fullsized":"2024-09-21T07:37:56.666907+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.691734+0000","last_change":"2024-09-21T07:37:56.688513+0000","last_active":"2024-09-21T07:37:56.691734+0000","last_peered":"2024-09-21T07:37:56.691734+0000","last_clean":"2024-09-21T07:37:56.691734+0000","last_became_active":"2024-09-21T07:37:56.688218+0000","last_became_peered":"2024-09-21T07:37:56.688218+0000","last_unstale":"2024-09-21T07:37:56.691734+0000","last_undegraded":"2024-09-21T07:37:56.691734+0000","last_fullsized":"2024-09-21T07:37:56.691734+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:39.083364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674896+0000","last_change":"2024-09-21T07:37:56.674896+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674896+0000","last_undegraded":"2024-09-21T07:37:56.674896+0000","last_fullsized":"2024-09-21T07:37:56.674896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685173+0000","last_change":"2024-09-21T07:37:56.682770+0000","last_active":"2024-09-21T07:37:56.685173+0000","last_peered":"2024-09-21T07:37:56.685173+0000","last_clean":"2024-09-21T07:37:56.685173+0000","last_became_active":"2024-09-21T07:37:56.682396+0000","last_became_peered":"2024-09-21T07:37:56.682396+0000","last_unstale":"2024-09-21T07:37:56.685173+0000","last_undegraded":"2024-09-21T07:37:56.685173+0000","last_fullsized":"2024-09-21T07:37:56.685173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:43.770342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709364+0000","last_change":"2024-09-21T07:37:57.695029+0000","last_active":"2024-09-21T07:37:57.709364+0000","last_peered":"2024-09-21T07:37:57.709364+0000","last_clean":"2024-09-21T07:37:57.709364+0000","last_became_active":"2024-09-21T07:37:57.694668+0000","last_became_peered":"2024-09-21T07:37:57.694668+0000","last_unstale":"2024-09-21T07:37:57.709364+0000","last_undegraded":"2024-09-21T07:37:57.709364+0000","last_fullsized":"2024-09-21T07:37:57.709364+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:48.536815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974095+0000","last_change":"2024-09-21T07:37:56.687413+0000","last_active":"2024-09-21T07:37:58.974095+0000","last_peered":"2024-09-21T07:37:58.974095+0000","last_clean":"2024-09-21T07:37:58.974095+0000","last_became_active":"2024-09-21T07:37:56.686855+0000","last_became_peered":"2024-09-21T07:37:56.686855+0000","last_unstale":"2024-09-21T07:37:58.974095+0000","last_undegraded":"2024-09-21T07:37:58.974095+0000","last_fullsized":"2024-09-21T07:37:58.974095+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:17.302940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.704995+0000","last_change":"2024-09-21T07:37:57.696258+0000","last_active":"2024-09-21T07:37:57.704995+0000","last_peered":"2024-09-21T07:37:57.704995+0000","last_clean":"2024-09-21T07:37:57.704995+0000","last_became_active":"2024-09-21T07:37:57.695921+0000","last_became_peered":"2024-09-21T07:37:57.695921+0000","last_unstale":"2024-09-21T07:37:57.704995+0000","last_undegraded":"2024-09-21T07:37:57.704995+0000","last_fullsized":"2024-09-21T07:37:57.704995+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:16.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709496+0000","last_change":"2024-09-21T07:37:56.695731+0000","last_active":"2024-09-21T07:37:57.709496+0000","last_peered":"2024-09-21T07:37:57.709496+0000","last_clean":"2024-09-21T07:37:57.709496+0000","last_became_active":"2024-09-21T07:37:56.695425+0000","last_became_peered":"2024-09-21T07:37:56.695425+0000","last_unstale":"2024-09-21T07:37:57.709496+0000","last_undegraded":"2024-09-21T07:37:57.709496+0000","last_fullsized":"2024-09-21T07:37:57.709496+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:33.472252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672698+0000","last_change":"2024-09-21T07:37:56.672698+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672698+0000","last_undegraded":"2024-09-21T07:37:56.672698+0000","last_fullsized":"2024-09-21T07:37:56.672698+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685695+0000","last_change":"2024-09-21T07:37:56.683690+0000","last_active":"2024-09-21T07:37:56.685695+0000","last_peered":"2024-09-21T07:37:56.685695+0000","last_clean":"2024-09-21T07:37:56.685695+0000","last_became_active":"2024-09-21T07:37:56.682542+0000","last_became_peered":"2024-09-21T07:37:56.682542+0000","last_unstale":"2024-09-21T07:37:56.685695+0000","last_undegraded":"2024-09-21T07:37:56.685695+0000","last_fullsized":"2024-09-21T07:37:56.685695+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:40.118009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672026+0000","last_change":"2024-09-21T07:37:56.672026+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672026+0000","last_undegraded":"2024-09-21T07:37:56.672026+0000","last_fullsized":"2024-09-21T07:37:56.672026+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685780+0000","last_change":"2024-09-21T07:37:56.684391+0000","last_active":"2024-09-21T07:37:56.685780+0000","last_peered":"2024-09-21T07:37:56.685780+0000","last_clean":"2024-09-21T07:37:56.685780+0000","last_became_active":"2024-09-21T07:37:56.683444+0000","last_became_peered":"2024-09-21T07:37:56.683444+0000","last_unstale":"2024-09-21T07:37:56.685780+0000","last_undegraded":"2024-09-21T07:37:56.685780+0000","last_fullsized":"2024-09-21T07:37:56.685780+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:36.720328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673672+0000","last_change":"2024-09-21T07:37:56.673672+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673672+0000","last_undegraded":"2024-09-21T07:37:56.673672+0000","last_fullsized":"2024-09-21T07:37:56.673672+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689555+0000","last_change":"2024-09-21T07:37:56.684444+0000","last_active":"2024-09-21T07:37:56.689555+0000","last_peered":"2024-09-21T07:37:56.689555+0000","last_clean":"2024-09-21T07:37:56.689555+0000","last_became_active":"2024-09-21T07:37:56.684047+0000","last_became_peered":"2024-09-21T07:37:56.684047+0000","last_unstale":"2024-09-21T07:37:56.689555+0000","last_undegraded":"2024-09-21T07:37:56.689555+0000","last_fullsized":"2024-09-21T07:37:56.689555+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.271604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670968+0000","last_change":"2024-09-21T07:37:56.670968+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670968+0000","last_undegraded":"2024-09-21T07:37:56.670968+0000","last_fullsized":"2024-09-21T07:37:56.670968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709473+0000","last_change":"2024-09-21T07:37:56.690896+0000","last_active":"2024-09-21T07:37:57.709473+0000","last_peered":"2024-09-21T07:37:57.709473+0000","last_clean":"2024-09-21T07:37:57.709473+0000","last_became_active":"2024-09-21T07:37:56.690438+0000","last_became_peered":"2024-09-21T07:37:56.690438+0000","last_unstale":"2024-09-21T07:37:57.709473+0000","last_undegraded":"2024-09-21T07:37:57.709473+0000","last_fullsized":"2024-09-21T07:37:57.709473+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:33.918994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974013+0000","last_change":"2024-09-21T07:37:57.697180+0000","last_active":"2024-09-21T07:37:58.974013+0000","last_peered":"2024-09-21T07:37:58.974013+0000","last_clean":"2024-09-21T07:37:58.974013+0000","last_became_active":"2024-09-21T07:37:57.696336+0000","last_became_peered":"2024-09-21T07:37:57.696336+0000","last_unstale":"2024-09-21T07:37:58.974013+0000","last_undegraded":"2024-09-21T07:37:58.974013+0000","last_fullsized":"2024-09-21T07:37:58.974013+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:35.468489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.680242+0000","last_change":"2024-09-21T07:37:56.676884+0000","last_active":"2024-09-21T07:37:56.680242+0000","last_peered":"2024-09-21T07:37:56.680242+0000","last_clean":"2024-09-21T07:37:56.680242+0000","last_became_active":"2024-09-21T07:37:56.676336+0000","last_became_peered":"2024-09-21T07:37:56.676336+0000","last_unstale":"2024-09-21T07:37:56.680242+0000","last_undegraded":"2024-09-21T07:37:56.680242+0000","last_fullsized":"2024-09-21T07:37:56.680242+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:45.909754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705041+0000","last_change":"2024-09-21T07:37:57.693339+0000","last_active":"2024-09-21T07:37:57.705041+0000","last_peered":"2024-09-21T07:37:57.705041+0000","last_clean":"2024-09-21T07:37:57.705041+0000","last_became_active":"2024-09-21T07:37:57.692967+0000","last_became_peered":"2024-09-21T07:37:57.692967+0000","last_unstale":"2024-09-21T07:37:57.705041+0000","last_undegraded":"2024-09-21T07:37:57.705041+0000","last_fullsized":"2024-09-21T07:37:57.705041+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:27.706291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693751+0000","last_change":"2024-09-21T07:37:56.688339+0000","last_active":"2024-09-21T07:37:56.693751+0000","last_peered":"2024-09-21T07:37:56.693751+0000","last_clean":"2024-09-21T07:37:56.693751+0000","last_became_active":"2024-09-21T07:37:56.684821+0000","last_became_peered":"2024-09-21T07:37:56.684821+0000","last_unstale":"2024-09-21T07:37:56.693751+0000","last_undegraded":"2024-09-21T07:37:56.693751+0000","last_fullsized":"2024-09-21T07:37:56.693751+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:23.930006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667603+0000","last_change":"2024-09-21T07:37:56.667603+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667603+0000","last_undegraded":"2024-09-21T07:37:56.667603+0000","last_fullsized":"2024-09-21T07:37:56.667603+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694168+0000","last_change":"2024-09-21T07:37:56.693400+0000","last_active":"2024-09-21T07:37:56.694168+0000","last_peered":"2024-09-21T07:37:56.694168+0000","last_clean":"2024-09-21T07:37:56.694168+0000","last_became_active":"2024-09-21T07:37:56.692901+0000","last_became_peered":"2024-09-21T07:37:56.692901+0000","last_unstale":"2024-09-21T07:37:56.694168+0000","last_undegraded":"2024-09-21T07:37:56.694168+0000","last_fullsized":"2024-09-21T07:37:56.694168+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:48.154618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679129+0000","last_change":"2024-09-21T07:37:56.679129+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679129+0000","last_undegraded":"2024-09-21T07:37:56.679129+0000","last_fullsized":"2024-09-21T07:37:56.679129+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685783+0000","last_change":"2024-09-21T07:37:56.684291+0000","last_active":"2024-09-21T07:37:56.685783+0000","last_peered":"2024-09-21T07:37:56.685783+0000","last_clean":"2024-09-21T07:37:56.685783+0000","last_became_active":"2024-09-21T07:37:56.682331+0000","last_became_peered":"2024-09-21T07:37:56.682331+0000","last_unstale":"2024-09-21T07:37:56.685783+0000","last_undegraded":"2024-09-21T07:37:56.685783+0000","last_fullsized":"2024-09-21T07:37:56.685783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:28.263282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670983+0000","last_change":"2024-09-21T07:37:57.682491+0000","last_active":"2024-09-21T07:37:58.670983+0000","last_peered":"2024-09-21T07:37:58.670983+0000","last_clean":"2024-09-21T07:37:58.670983+0000","last_became_active":"2024-09-21T07:37:57.682202+0000","last_became_peered":"2024-09-21T07:37:57.682202+0000","last_unstale":"2024-09-21T07:37:58.670983+0000","last_undegraded":"2024-09-21T07:37:58.670983+0000","last_fullsized":"2024-09-21T07:37:58.670983+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:35.056943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683236+0000","last_change":"2024-09-21T07:37:56.680005+0000","last_active":"2024-09-21T07:37:56.683236+0000","last_peered":"2024-09-21T07:37:56.683236+0000","last_clean":"2024-09-21T07:37:56.683236+0000","last_became_active":"2024-09-21T07:37:56.679613+0000","last_became_peered":"2024-09-21T07:37:56.679613+0000","last_unstale":"2024-09-21T07:37:56.683236+0000","last_undegraded":"2024-09-21T07:37:56.683236+0000","last_fullsized":"2024-09-21T07:37:56.683236+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:42.362978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680361+0000","last_change":"2024-09-21T07:37:56.700326+0000","last_active":"2024-09-21T07:37:57.680361+0000","last_peered":"2024-09-21T07:37:57.680361+0000","last_clean":"2024-09-21T07:37:57.680361+0000","last_became_active":"2024-09-21T07:37:56.700049+0000","last_became_peered":"2024-09-21T07:37:56.700049+0000","last_unstale":"2024-09-21T07:37:57.680361+0000","last_undegraded":"2024-09-21T07:37:57.680361+0000","last_fullsized":"2024-09-21T07:37:57.680361+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:56.974818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674181+0000","last_change":"2024-09-21T07:37:56.674181+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674181+0000","last_undegraded":"2024-09-21T07:37:56.674181+0000","last_fullsized":"2024-09-21T07:37:56.674181+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683621+0000","last_change":"2024-09-21T07:37:56.680549+0000","last_active":"2024-09-21T07:37:56.683621+0000","last_peered":"2024-09-21T07:37:56.683621+0000","last_clean":"2024-09-21T07:37:56.683621+0000","last_became_active":"2024-09-21T07:37:56.680165+0000","last_became_peered":"2024-09-21T07:37:56.680165+0000","last_unstale":"2024-09-21T07:37:56.683621+0000","last_undegraded":"2024-09-21T07:37:56.683621+0000","last_fullsized":"2024-09-21T07:37:56.683621+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:26.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670495+0000","last_change":"2024-09-21T07:37:57.699500+0000","last_active":"2024-09-21T07:37:58.670495+0000","last_peered":"2024-09-21T07:37:58.670495+0000","last_clean":"2024-09-21T07:37:58.670495+0000","last_became_active":"2024-09-21T07:37:57.699196+0000","last_became_peered":"2024-09-21T07:37:57.699196+0000","last_unstale":"2024-09-21T07:37:58.670495+0000","last_undegraded":"2024-09-21T07:37:58.670495+0000","last_fullsized":"2024-09-21T07:37:58.670495+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:16.002562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689103+0000","last_change":"2024-09-21T07:37:56.688161+0000","last_active":"2024-09-21T07:37:56.689103+0000","last_peered":"2024-09-21T07:37:56.689103+0000","last_clean":"2024-09-21T07:37:56.689103+0000","last_became_active":"2024-09-21T07:37:56.687601+0000","last_became_peered":"2024-09-21T07:37:56.687601+0000","last_unstale":"2024-09-21T07:37:56.689103+0000","last_undegraded":"2024-09-21T07:37:56.689103+0000","last_fullsized":"2024-09-21T07:37:56.689103+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:50.744275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":471,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973649+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:37:58.973649+0000","last_peered":"2024-09-21T07:37:58.973649+0000","last_clean":"2024-09-21T07:37:58.973649+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:37:58.973649+0000","last_undegraded":"2024-09-21T07:37:58.973649+0000","last_fullsized":"2024-09-21T07:37:58.973649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509628,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509628,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47740,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324100,"statfs":{"total":96636764160,"available":96587878400,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509628,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47736,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324104,"statfs":{"total":96636764160,"available":96587882496,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56640,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315200,"statfs":{"total":96636764160,"available":96578764800,"internally_reserved":0,"allocated":3317760,"data_stored":1878902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56668,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315172,"statfs":{"total":96636764160,"available":96578736128,"internally_reserved":0,"allocated":3350528,"data_stored":1892885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87976,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283864,"statfs":{"total":96636764160,"available":96546676736,"internally_reserved":0,"allocated":2772992,"data_stored":1304643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:01.892 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 -- 172.21.15.64:0/4068135838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0ccbe0 msgr2=0x7f66cc0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 --2- 172.21.15.64:0/4068135838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc0ceb20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009840 tx=0x7f66c001c820 comp rx=0 tx=0).stop 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 -- 172.21.15.64:0/4068135838 shutdown_connections 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 --2- 172.21.15.64:0/4068135838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0b4510 0x7f66cc167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 --2- 172.21.15.64:0/4068135838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc0ceb20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 -- 172.21.15.64:0/4068135838 >> 172.21.15.64:0/4068135838 conn(0x7f66cc06d430 msgr2=0x7f66cc071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 -- 172.21.15.64:0/4068135838 shutdown_connections 2024-09-21T07:38:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.090+0000 7f66d1e00640 1 -- 172.21.15.64:0/4068135838 wait complete. 2024-09-21T07:38:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 Processor -- start 2024-09-21T07:38:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- start start 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0b4510 0x7f66cc15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0cf060 0x7f66cc1f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc16a300 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc15cb40 con 0x7f66cc0b4510 2024-09-21T07:38:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc16a480 con 0x7f66cc0cf060 2024-09-21T07:38:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55982/0 (socket says 172.21.15.64:55982) 2024-09-21T07:38:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 -- 172.21.15.64:0/678420674 learned_addr learned my addr 172.21.15.64:0/678420674 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1400640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0cf060 0x7f66cc1f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d0a00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0b4510 0x7f66cc15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 -- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0cf060 msgr2=0x7f66cc1f9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0cf060 0x7f66cc1f9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 -- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0b4510 msgr2=0x7f66cc15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0b4510 0x7f66cc15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 -- 172.21.15.64:0/678420674 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc1f9da0 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66cbe00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c460 tx=0x7f66b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8011790 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b8017070 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8011ce0 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc14aad0 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.094+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc14b090 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc1f9b10 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f66b801c460 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66c8c00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 0x7f66ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f66b8094160 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66d0a00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 0x7f66ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.098+0000 7f66d0a00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 0x7f66ac075710 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f66c00af000 tx=0x7f66c001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.102+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f66b805ef90 con 0x7f66cc0ccbe0 2024-09-21T07:38:02.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.278+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66cc0ceb20 con 0x7f66ac073200 2024-09-21T07:38:02.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.282+0000 7f66c8c00640 1 -- 172.21.15.64:0/678420674 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249311 (secure 0 0 0) 0x7f66cc0ceb20 con 0x7f66ac073200 2024-09-21T07:38:02.284 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:02.285 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 msgr2=0x7f66ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 0x7f66ac075710 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f66c00af000 tx=0x7f66c001b060 comp rx=0 tx=0).stop 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 msgr2=0x7f66cc1f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c460 tx=0x7f66b800c860 comp rx=0 tx=0).stop 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 shutdown_connections 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f66ac073200 0x7f66ac075710 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66cc0cf060 0x7f66cc1f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66cc0ccbe0 0x7f66cc1f8fe0 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 --2- 172.21.15.64:0/678420674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66cc0b4510 0x7f66cc15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 >> 172.21.15.64:0/678420674 conn(0x7f66cc06d430 msgr2=0x7f66cc0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:02.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 shutdown_connections 2024-09-21T07:38:02.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.286+0000 7f66d1e00640 1 -- 172.21.15.64:0/678420674 wait complete. 2024-09-21T07:38:02.306 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":674,"stamp":"2024-09-21T07:38:01.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":119,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469108,"kb_used_data":22520,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754505612,"statfs":{"total":773094113280,"available":772613746688,"internally_reserved":0,"allocated":23060480,"data_stored":11519100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671244+0000","last_change":"2024-09-21T07:37:57.686919+0000","last_active":"2024-09-21T07:37:58.671244+0000","last_peered":"2024-09-21T07:37:58.671244+0000","last_clean":"2024-09-21T07:37:58.671244+0000","last_became_active":"2024-09-21T07:37:57.686610+0000","last_became_peered":"2024-09-21T07:37:57.686610+0000","last_unstale":"2024-09-21T07:37:58.671244+0000","last_undegraded":"2024-09-21T07:37:58.671244+0000","last_fullsized":"2024-09-21T07:37:58.671244+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.888561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678707+0000","last_change":"2024-09-21T07:37:56.678707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678707+0000","last_undegraded":"2024-09-21T07:37:56.678707+0000","last_fullsized":"2024-09-21T07:37:56.678707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.699880+0000","last_change":"2024-09-21T07:37:57.692560+0000","last_active":"2024-09-21T07:37:57.699880+0000","last_peered":"2024-09-21T07:37:57.699880+0000","last_clean":"2024-09-21T07:37:57.699880+0000","last_became_active":"2024-09-21T07:37:57.686329+0000","last_became_peered":"2024-09-21T07:37:57.686329+0000","last_unstale":"2024-09-21T07:37:57.699880+0000","last_undegraded":"2024-09-21T07:37:57.699880+0000","last_fullsized":"2024-09-21T07:37:57.699880+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:30.089335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.701001+0000","last_change":"2024-09-21T07:37:57.692825+0000","last_active":"2024-09-21T07:37:57.701001+0000","last_peered":"2024-09-21T07:37:57.701001+0000","last_clean":"2024-09-21T07:37:57.701001+0000","last_became_active":"2024-09-21T07:37:57.692506+0000","last_became_peered":"2024-09-21T07:37:57.692506+0000","last_unstale":"2024-09-21T07:37:57.701001+0000","last_undegraded":"2024-09-21T07:37:57.701001+0000","last_fullsized":"2024-09-21T07:37:57.701001+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:47.392925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667034+0000","last_change":"2024-09-21T07:37:56.667034+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667034+0000","last_undegraded":"2024-09-21T07:37:56.667034+0000","last_fullsized":"2024-09-21T07:37:56.667034+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670585+0000","last_change":"2024-09-21T07:37:57.690137+0000","last_active":"2024-09-21T07:37:58.670585+0000","last_peered":"2024-09-21T07:37:58.670585+0000","last_clean":"2024-09-21T07:37:58.670585+0000","last_became_active":"2024-09-21T07:37:57.689839+0000","last_became_peered":"2024-09-21T07:37:57.689839+0000","last_unstale":"2024-09-21T07:37:58.670585+0000","last_undegraded":"2024-09-21T07:37:58.670585+0000","last_fullsized":"2024-09-21T07:37:58.670585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.086074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666479+0000","last_change":"2024-09-21T07:37:56.666479+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666479+0000","last_undegraded":"2024-09-21T07:37:56.666479+0000","last_fullsized":"2024-09-21T07:37:56.666479+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671385+0000","last_change":"2024-09-21T07:37:57.689677+0000","last_active":"2024-09-21T07:37:58.671385+0000","last_peered":"2024-09-21T07:37:58.671385+0000","last_clean":"2024-09-21T07:37:58.671385+0000","last_became_active":"2024-09-21T07:37:57.689320+0000","last_became_peered":"2024-09-21T07:37:57.689320+0000","last_unstale":"2024-09-21T07:37:58.671385+0000","last_undegraded":"2024-09-21T07:37:58.671385+0000","last_fullsized":"2024-09-21T07:37:58.671385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.136328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705127+0000","last_change":"2024-09-21T07:37:57.694043+0000","last_active":"2024-09-21T07:37:57.705127+0000","last_peered":"2024-09-21T07:37:57.705127+0000","last_clean":"2024-09-21T07:37:57.705127+0000","last_became_active":"2024-09-21T07:37:57.693686+0000","last_became_peered":"2024-09-21T07:37:57.693686+0000","last_unstale":"2024-09-21T07:37:57.705127+0000","last_undegraded":"2024-09-21T07:37:57.705127+0000","last_fullsized":"2024-09-21T07:37:57.705127+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:19.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.707799+0000","last_change":"2024-09-21T07:37:57.696681+0000","last_active":"2024-09-21T07:37:57.707799+0000","last_peered":"2024-09-21T07:37:57.707799+0000","last_clean":"2024-09-21T07:37:57.707799+0000","last_became_active":"2024-09-21T07:37:57.696311+0000","last_became_peered":"2024-09-21T07:37:57.696311+0000","last_unstale":"2024-09-21T07:37:57.707799+0000","last_undegraded":"2024-09-21T07:37:57.707799+0000","last_fullsized":"2024-09-21T07:37:57.707799+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:29.232647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670912+0000","last_change":"2024-09-21T07:37:57.679345+0000","last_active":"2024-09-21T07:37:58.670912+0000","last_peered":"2024-09-21T07:37:58.670912+0000","last_clean":"2024-09-21T07:37:58.670912+0000","last_became_active":"2024-09-21T07:37:57.678467+0000","last_became_peered":"2024-09-21T07:37:57.678467+0000","last_unstale":"2024-09-21T07:37:58.670912+0000","last_undegraded":"2024-09-21T07:37:58.670912+0000","last_fullsized":"2024-09-21T07:37:58.670912+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:41.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672277+0000","last_change":"2024-09-21T07:37:56.672277+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672277+0000","last_undegraded":"2024-09-21T07:37:56.672277+0000","last_fullsized":"2024-09-21T07:37:56.672277+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.685438+0000","last_change":"2024-09-21T07:37:56.685438+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.685438+0000","last_undegraded":"2024-09-21T07:37:56.685438+0000","last_fullsized":"2024-09-21T07:37:56.685438+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973985+0000","last_change":"2024-09-21T07:37:57.682989+0000","last_active":"2024-09-21T07:37:58.973985+0000","last_peered":"2024-09-21T07:37:58.973985+0000","last_clean":"2024-09-21T07:37:58.973985+0000","last_became_active":"2024-09-21T07:37:57.682619+0000","last_became_peered":"2024-09-21T07:37:57.682619+0000","last_unstale":"2024-09-21T07:37:58.973985+0000","last_undegraded":"2024-09-21T07:37:58.973985+0000","last_fullsized":"2024-09-21T07:37:58.973985+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:32.009487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.708901+0000","last_change":"2024-09-21T07:37:57.705839+0000","last_active":"2024-09-21T07:37:57.708901+0000","last_peered":"2024-09-21T07:37:57.708901+0000","last_clean":"2024-09-21T07:37:57.708901+0000","last_became_active":"2024-09-21T07:37:57.705526+0000","last_became_peered":"2024-09-21T07:37:57.705526+0000","last_unstale":"2024-09-21T07:37:57.708901+0000","last_undegraded":"2024-09-21T07:37:57.708901+0000","last_fullsized":"2024-09-21T07:37:57.708901+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:28.397601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673122+0000","last_change":"2024-09-21T07:37:56.673122+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673122+0000","last_undegraded":"2024-09-21T07:37:56.673122+0000","last_fullsized":"2024-09-21T07:37:56.673122+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.698334+0000","last_change":"2024-09-21T07:37:57.688241+0000","last_active":"2024-09-21T07:37:57.698334+0000","last_peered":"2024-09-21T07:37:57.698334+0000","last_clean":"2024-09-21T07:37:57.698334+0000","last_became_active":"2024-09-21T07:37:57.687847+0000","last_became_peered":"2024-09-21T07:37:57.687847+0000","last_unstale":"2024-09-21T07:37:57.698334+0000","last_undegraded":"2024-09-21T07:37:57.698334+0000","last_fullsized":"2024-09-21T07:37:57.698334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:32.911732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974306+0000","last_change":"2024-09-21T07:37:57.683606+0000","last_active":"2024-09-21T07:37:58.974306+0000","last_peered":"2024-09-21T07:37:58.974306+0000","last_clean":"2024-09-21T07:37:58.974306+0000","last_became_active":"2024-09-21T07:37:57.683282+0000","last_became_peered":"2024-09-21T07:37:57.683282+0000","last_unstale":"2024-09-21T07:37:58.974306+0000","last_undegraded":"2024-09-21T07:37:58.974306+0000","last_fullsized":"2024-09-21T07:37:58.974306+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:56.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672196+0000","last_change":"2024-09-21T07:37:56.672196+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672196+0000","last_undegraded":"2024-09-21T07:37:56.672196+0000","last_fullsized":"2024-09-21T07:37:56.672196+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667178+0000","last_change":"2024-09-21T07:37:56.667178+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667178+0000","last_undegraded":"2024-09-21T07:37:56.667178+0000","last_fullsized":"2024-09-21T07:37:56.667178+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673748+0000","last_change":"2024-09-21T07:37:56.673748+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673748+0000","last_undegraded":"2024-09-21T07:37:56.673748+0000","last_fullsized":"2024-09-21T07:37:56.673748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974319+0000","last_change":"2024-09-21T07:37:57.703344+0000","last_active":"2024-09-21T07:37:58.974319+0000","last_peered":"2024-09-21T07:37:58.974319+0000","last_clean":"2024-09-21T07:37:58.974319+0000","last_became_active":"2024-09-21T07:37:57.702763+0000","last_became_peered":"2024-09-21T07:37:57.702763+0000","last_unstale":"2024-09-21T07:37:58.974319+0000","last_undegraded":"2024-09-21T07:37:58.974319+0000","last_fullsized":"2024-09-21T07:37:58.974319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:12.340315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674813+0000","last_change":"2024-09-21T07:37:56.674813+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674813+0000","last_undegraded":"2024-09-21T07:37:56.674813+0000","last_fullsized":"2024-09-21T07:37:56.674813+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674609+0000","last_change":"2024-09-21T07:37:56.674609+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674609+0000","last_undegraded":"2024-09-21T07:37:56.674609+0000","last_fullsized":"2024-09-21T07:37:56.674609+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670498+0000","last_change":"2024-09-21T07:37:56.670498+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670498+0000","last_undegraded":"2024-09-21T07:37:56.670498+0000","last_fullsized":"2024-09-21T07:37:56.670498+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667488+0000","last_change":"2024-09-21T07:37:56.667488+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667488+0000","last_undegraded":"2024-09-21T07:37:56.667488+0000","last_fullsized":"2024-09-21T07:37:56.667488+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670927+0000","last_change":"2024-09-21T07:37:57.689041+0000","last_active":"2024-09-21T07:37:58.670927+0000","last_peered":"2024-09-21T07:37:58.670927+0000","last_clean":"2024-09-21T07:37:58.670927+0000","last_became_active":"2024-09-21T07:37:57.688683+0000","last_became_peered":"2024-09-21T07:37:57.688683+0000","last_unstale":"2024-09-21T07:37:58.670927+0000","last_undegraded":"2024-09-21T07:37:58.670927+0000","last_fullsized":"2024-09-21T07:37:58.670927+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:08.217425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678709+0000","last_change":"2024-09-21T07:37:56.678709+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678709+0000","last_undegraded":"2024-09-21T07:37:56.678709+0000","last_fullsized":"2024-09-21T07:37:56.678709+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679812+0000","last_change":"2024-09-21T07:37:56.679812+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679812+0000","last_undegraded":"2024-09-21T07:37:56.679812+0000","last_fullsized":"2024-09-21T07:37:56.679812+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672068+0000","last_change":"2024-09-21T07:37:56.672068+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672068+0000","last_undegraded":"2024-09-21T07:37:56.672068+0000","last_fullsized":"2024-09-21T07:37:56.672068+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670510+0000","last_change":"2024-09-21T07:37:57.688877+0000","last_active":"2024-09-21T07:37:58.670510+0000","last_peered":"2024-09-21T07:37:58.670510+0000","last_clean":"2024-09-21T07:37:58.670510+0000","last_became_active":"2024-09-21T07:37:57.688564+0000","last_became_peered":"2024-09-21T07:37:57.688564+0000","last_unstale":"2024-09-21T07:37:58.670510+0000","last_undegraded":"2024-09-21T07:37:58.670510+0000","last_fullsized":"2024-09-21T07:37:58.670510+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:49.285747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672601+0000","last_change":"2024-09-21T07:37:56.672601+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672601+0000","last_undegraded":"2024-09-21T07:37:56.672601+0000","last_fullsized":"2024-09-21T07:37:56.672601+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"217'4","reported_seq":19,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671169+0000","last_change":"2024-09-21T07:37:56.681003+0000","last_active":"2024-09-21T07:37:58.671169+0000","last_peered":"2024-09-21T07:37:58.671169+0000","last_clean":"2024-09-21T07:37:58.671169+0000","last_became_active":"2024-09-21T07:37:56.680677+0000","last_became_peered":"2024-09-21T07:37:56.680677+0000","last_unstale":"2024-09-21T07:37:58.671169+0000","last_undegraded":"2024-09-21T07:37:58.671169+0000","last_fullsized":"2024-09-21T07:37:58.671169+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.630114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974033+0000","last_change":"2024-09-21T07:37:57.696302+0000","last_active":"2024-09-21T07:37:58.974033+0000","last_peered":"2024-09-21T07:37:58.974033+0000","last_clean":"2024-09-21T07:37:58.974033+0000","last_became_active":"2024-09-21T07:37:57.695957+0000","last_became_peered":"2024-09-21T07:37:57.695957+0000","last_unstale":"2024-09-21T07:37:58.974033+0000","last_undegraded":"2024-09-21T07:37:58.974033+0000","last_fullsized":"2024-09-21T07:37:58.974033+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:01.310825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685152+0000","last_change":"2024-09-21T07:37:56.682377+0000","last_active":"2024-09-21T07:37:56.685152+0000","last_peered":"2024-09-21T07:37:56.685152+0000","last_clean":"2024-09-21T07:37:56.685152+0000","last_became_active":"2024-09-21T07:37:56.682050+0000","last_became_peered":"2024-09-21T07:37:56.682050+0000","last_unstale":"2024-09-21T07:37:56.685152+0000","last_undegraded":"2024-09-21T07:37:56.685152+0000","last_fullsized":"2024-09-21T07:37:56.685152+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:20.420448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670800+0000","last_change":"2024-09-21T07:37:57.685402+0000","last_active":"2024-09-21T07:37:58.670800+0000","last_peered":"2024-09-21T07:37:58.670800+0000","last_clean":"2024-09-21T07:37:58.670800+0000","last_became_active":"2024-09-21T07:37:57.684889+0000","last_became_peered":"2024-09-21T07:37:57.684889+0000","last_unstale":"2024-09-21T07:37:58.670800+0000","last_undegraded":"2024-09-21T07:37:58.670800+0000","last_fullsized":"2024-09-21T07:37:58.670800+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.332634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693589+0000","last_change":"2024-09-21T07:37:56.689098+0000","last_active":"2024-09-21T07:37:56.693589+0000","last_peered":"2024-09-21T07:37:56.693589+0000","last_clean":"2024-09-21T07:37:56.693589+0000","last_became_active":"2024-09-21T07:37:56.684546+0000","last_became_peered":"2024-09-21T07:37:56.684546+0000","last_unstale":"2024-09-21T07:37:56.693589+0000","last_undegraded":"2024-09-21T07:37:56.693589+0000","last_fullsized":"2024-09-21T07:37:56.693589+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.173866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678642+0000","last_change":"2024-09-21T07:37:56.678642+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678642+0000","last_undegraded":"2024-09-21T07:37:56.678642+0000","last_fullsized":"2024-09-21T07:37:56.678642+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973906+0000","last_change":"2024-09-21T07:37:56.693584+0000","last_active":"2024-09-21T07:37:58.973906+0000","last_peered":"2024-09-21T07:37:58.973906+0000","last_clean":"2024-09-21T07:37:58.973906+0000","last_became_active":"2024-09-21T07:37:56.693288+0000","last_became_peered":"2024-09-21T07:37:56.693288+0000","last_unstale":"2024-09-21T07:37:58.973906+0000","last_undegraded":"2024-09-21T07:37:58.973906+0000","last_fullsized":"2024-09-21T07:37:58.973906+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:01.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668226+0000","last_change":"2024-09-21T07:37:56.668226+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668226+0000","last_undegraded":"2024-09-21T07:37:56.668226+0000","last_fullsized":"2024-09-21T07:37:56.668226+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694021+0000","last_change":"2024-09-21T07:37:56.689298+0000","last_active":"2024-09-21T07:37:56.694021+0000","last_peered":"2024-09-21T07:37:56.694021+0000","last_clean":"2024-09-21T07:37:56.694021+0000","last_became_active":"2024-09-21T07:37:56.688807+0000","last_became_peered":"2024-09-21T07:37:56.688807+0000","last_unstale":"2024-09-21T07:37:56.694021+0000","last_undegraded":"2024-09-21T07:37:56.694021+0000","last_fullsized":"2024-09-21T07:37:56.694021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:59.971298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705101+0000","last_change":"2024-09-21T07:37:57.693164+0000","last_active":"2024-09-21T07:37:57.705101+0000","last_peered":"2024-09-21T07:37:57.705101+0000","last_clean":"2024-09-21T07:37:57.705101+0000","last_became_active":"2024-09-21T07:37:57.692831+0000","last_became_peered":"2024-09-21T07:37:57.692831+0000","last_unstale":"2024-09-21T07:37:57.705101+0000","last_undegraded":"2024-09-21T07:37:57.705101+0000","last_fullsized":"2024-09-21T07:37:57.705101+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:07.215948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680120+0000","last_change":"2024-09-21T07:37:56.696904+0000","last_active":"2024-09-21T07:37:57.680120+0000","last_peered":"2024-09-21T07:37:57.680120+0000","last_clean":"2024-09-21T07:37:57.680120+0000","last_became_active":"2024-09-21T07:37:56.696373+0000","last_became_peered":"2024-09-21T07:37:56.696373+0000","last_unstale":"2024-09-21T07:37:57.680120+0000","last_undegraded":"2024-09-21T07:37:57.680120+0000","last_fullsized":"2024-09-21T07:37:57.680120+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:12.535237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667847+0000","last_change":"2024-09-21T07:37:56.667847+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667847+0000","last_undegraded":"2024-09-21T07:37:56.667847+0000","last_fullsized":"2024-09-21T07:37:56.667847+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670323+0000","last_change":"2024-09-21T07:37:56.681896+0000","last_active":"2024-09-21T07:37:58.670323+0000","last_peered":"2024-09-21T07:37:58.670323+0000","last_clean":"2024-09-21T07:37:58.670323+0000","last_became_active":"2024-09-21T07:37:56.681584+0000","last_became_peered":"2024-09-21T07:37:56.681584+0000","last_unstale":"2024-09-21T07:37:58.670323+0000","last_undegraded":"2024-09-21T07:37:58.670323+0000","last_fullsized":"2024-09-21T07:37:58.670323+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:24.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689761+0000","last_change":"2024-09-21T07:37:56.687358+0000","last_active":"2024-09-21T07:37:56.689761+0000","last_peered":"2024-09-21T07:37:56.689761+0000","last_clean":"2024-09-21T07:37:56.689761+0000","last_became_active":"2024-09-21T07:37:56.685812+0000","last_became_peered":"2024-09-21T07:37:56.685812+0000","last_unstale":"2024-09-21T07:37:56.689761+0000","last_undegraded":"2024-09-21T07:37:56.689761+0000","last_fullsized":"2024-09-21T07:37:56.689761+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:06.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672823+0000","last_change":"2024-09-21T07:37:56.672823+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672823+0000","last_undegraded":"2024-09-21T07:37:56.672823+0000","last_fullsized":"2024-09-21T07:37:56.672823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.681430+0000","last_change":"2024-09-21T07:37:56.700571+0000","last_active":"2024-09-21T07:37:57.681430+0000","last_peered":"2024-09-21T07:37:57.681430+0000","last_clean":"2024-09-21T07:37:57.681430+0000","last_became_active":"2024-09-21T07:37:56.700152+0000","last_became_peered":"2024-09-21T07:37:56.700152+0000","last_unstale":"2024-09-21T07:37:57.681430+0000","last_undegraded":"2024-09-21T07:37:57.681430+0000","last_fullsized":"2024-09-21T07:37:57.681430+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:16.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705065+0000","last_change":"2024-09-21T07:37:57.694048+0000","last_active":"2024-09-21T07:37:57.705065+0000","last_peered":"2024-09-21T07:37:57.705065+0000","last_clean":"2024-09-21T07:37:57.705065+0000","last_became_active":"2024-09-21T07:37:57.693768+0000","last_became_peered":"2024-09-21T07:37:57.693768+0000","last_unstale":"2024-09-21T07:37:57.705065+0000","last_undegraded":"2024-09-21T07:37:57.705065+0000","last_fullsized":"2024-09-21T07:37:57.705065+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:09.584828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685220+0000","last_change":"2024-09-21T07:37:56.682914+0000","last_active":"2024-09-21T07:37:56.685220+0000","last_peered":"2024-09-21T07:37:56.685220+0000","last_clean":"2024-09-21T07:37:56.685220+0000","last_became_active":"2024-09-21T07:37:56.681968+0000","last_became_peered":"2024-09-21T07:37:56.681968+0000","last_unstale":"2024-09-21T07:37:56.685220+0000","last_undegraded":"2024-09-21T07:37:56.685220+0000","last_fullsized":"2024-09-21T07:37:56.685220+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:57.037229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667707+0000","last_change":"2024-09-21T07:37:56.667707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667707+0000","last_undegraded":"2024-09-21T07:37:56.667707+0000","last_fullsized":"2024-09-21T07:37:56.667707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"217'6","reported_seq":21,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671074+0000","last_change":"2024-09-21T07:37:56.681926+0000","last_active":"2024-09-21T07:37:58.671074+0000","last_peered":"2024-09-21T07:37:58.671074+0000","last_clean":"2024-09-21T07:37:58.671074+0000","last_became_active":"2024-09-21T07:37:56.681625+0000","last_became_peered":"2024-09-21T07:37:56.681625+0000","last_unstale":"2024-09-21T07:37:58.671074+0000","last_undegraded":"2024-09-21T07:37:58.671074+0000","last_fullsized":"2024-09-21T07:37:58.671074+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:04.257605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974068+0000","last_change":"2024-09-21T07:37:56.690462+0000","last_active":"2024-09-21T07:37:58.974068+0000","last_peered":"2024-09-21T07:37:58.974068+0000","last_clean":"2024-09-21T07:37:58.974068+0000","last_became_active":"2024-09-21T07:37:56.690094+0000","last_became_peered":"2024-09-21T07:37:56.690094+0000","last_unstale":"2024-09-21T07:37:58.974068+0000","last_undegraded":"2024-09-21T07:37:58.974068+0000","last_fullsized":"2024-09-21T07:37:58.974068+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:41.064369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668733+0000","last_change":"2024-09-21T07:37:56.668733+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668733+0000","last_undegraded":"2024-09-21T07:37:56.668733+0000","last_fullsized":"2024-09-21T07:37:56.668733+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.687335+0000","last_change":"2024-09-21T07:37:56.686422+0000","last_active":"2024-09-21T07:37:56.687335+0000","last_peered":"2024-09-21T07:37:56.687335+0000","last_clean":"2024-09-21T07:37:56.687335+0000","last_became_active":"2024-09-21T07:37:56.685790+0000","last_became_peered":"2024-09-21T07:37:56.685790+0000","last_unstale":"2024-09-21T07:37:56.687335+0000","last_undegraded":"2024-09-21T07:37:56.687335+0000","last_fullsized":"2024-09-21T07:37:56.687335+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:39.021255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974271+0000","last_change":"2024-09-21T07:37:57.696921+0000","last_active":"2024-09-21T07:37:58.974271+0000","last_peered":"2024-09-21T07:37:58.974271+0000","last_clean":"2024-09-21T07:37:58.974271+0000","last_became_active":"2024-09-21T07:37:57.695559+0000","last_became_peered":"2024-09-21T07:37:57.695559+0000","last_unstale":"2024-09-21T07:37:58.974271+0000","last_undegraded":"2024-09-21T07:37:58.974271+0000","last_fullsized":"2024-09-21T07:37:58.974271+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.675113+0000","last_change":"2024-09-21T07:37:56.671057+0000","last_active":"2024-09-21T07:37:56.675113+0000","last_peered":"2024-09-21T07:37:56.675113+0000","last_clean":"2024-09-21T07:37:56.675113+0000","last_became_active":"2024-09-21T07:37:56.670715+0000","last_became_peered":"2024-09-21T07:37:56.670715+0000","last_unstale":"2024-09-21T07:37:56.675113+0000","last_undegraded":"2024-09-21T07:37:56.675113+0000","last_fullsized":"2024-09-21T07:37:56.675113+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:51.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668334+0000","last_change":"2024-09-21T07:37:56.668334+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668334+0000","last_undegraded":"2024-09-21T07:37:56.668334+0000","last_fullsized":"2024-09-21T07:37:56.668334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.692726+0000","last_change":"2024-09-21T07:37:56.691680+0000","last_active":"2024-09-21T07:37:56.692726+0000","last_peered":"2024-09-21T07:37:56.692726+0000","last_clean":"2024-09-21T07:37:56.692726+0000","last_became_active":"2024-09-21T07:37:56.691374+0000","last_became_peered":"2024-09-21T07:37:56.691374+0000","last_unstale":"2024-09-21T07:37:56.692726+0000","last_undegraded":"2024-09-21T07:37:56.692726+0000","last_fullsized":"2024-09-21T07:37:56.692726+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:14.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667126+0000","last_change":"2024-09-21T07:37:56.667126+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667126+0000","last_undegraded":"2024-09-21T07:37:56.667126+0000","last_fullsized":"2024-09-21T07:37:56.667126+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671365+0000","last_change":"2024-09-21T07:37:56.674146+0000","last_active":"2024-09-21T07:37:58.671365+0000","last_peered":"2024-09-21T07:37:58.671365+0000","last_clean":"2024-09-21T07:37:58.671365+0000","last_became_active":"2024-09-21T07:37:56.673828+0000","last_became_peered":"2024-09-21T07:37:56.673828+0000","last_unstale":"2024-09-21T07:37:58.671365+0000","last_undegraded":"2024-09-21T07:37:58.671365+0000","last_fullsized":"2024-09-21T07:37:58.671365+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:27.388800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666907+0000","last_change":"2024-09-21T07:37:56.666907+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666907+0000","last_undegraded":"2024-09-21T07:37:56.666907+0000","last_fullsized":"2024-09-21T07:37:56.666907+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.691734+0000","last_change":"2024-09-21T07:37:56.688513+0000","last_active":"2024-09-21T07:37:56.691734+0000","last_peered":"2024-09-21T07:37:56.691734+0000","last_clean":"2024-09-21T07:37:56.691734+0000","last_became_active":"2024-09-21T07:37:56.688218+0000","last_became_peered":"2024-09-21T07:37:56.688218+0000","last_unstale":"2024-09-21T07:37:56.691734+0000","last_undegraded":"2024-09-21T07:37:56.691734+0000","last_fullsized":"2024-09-21T07:37:56.691734+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:39.083364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674896+0000","last_change":"2024-09-21T07:37:56.674896+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674896+0000","last_undegraded":"2024-09-21T07:37:56.674896+0000","last_fullsized":"2024-09-21T07:37:56.674896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685173+0000","last_change":"2024-09-21T07:37:56.682770+0000","last_active":"2024-09-21T07:37:56.685173+0000","last_peered":"2024-09-21T07:37:56.685173+0000","last_clean":"2024-09-21T07:37:56.685173+0000","last_became_active":"2024-09-21T07:37:56.682396+0000","last_became_peered":"2024-09-21T07:37:56.682396+0000","last_unstale":"2024-09-21T07:37:56.685173+0000","last_undegraded":"2024-09-21T07:37:56.685173+0000","last_fullsized":"2024-09-21T07:37:56.685173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:43.770342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709364+0000","last_change":"2024-09-21T07:37:57.695029+0000","last_active":"2024-09-21T07:37:57.709364+0000","last_peered":"2024-09-21T07:37:57.709364+0000","last_clean":"2024-09-21T07:37:57.709364+0000","last_became_active":"2024-09-21T07:37:57.694668+0000","last_became_peered":"2024-09-21T07:37:57.694668+0000","last_unstale":"2024-09-21T07:37:57.709364+0000","last_undegraded":"2024-09-21T07:37:57.709364+0000","last_fullsized":"2024-09-21T07:37:57.709364+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:48.536815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974095+0000","last_change":"2024-09-21T07:37:56.687413+0000","last_active":"2024-09-21T07:37:58.974095+0000","last_peered":"2024-09-21T07:37:58.974095+0000","last_clean":"2024-09-21T07:37:58.974095+0000","last_became_active":"2024-09-21T07:37:56.686855+0000","last_became_peered":"2024-09-21T07:37:56.686855+0000","last_unstale":"2024-09-21T07:37:58.974095+0000","last_undegraded":"2024-09-21T07:37:58.974095+0000","last_fullsized":"2024-09-21T07:37:58.974095+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:17.302940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.704995+0000","last_change":"2024-09-21T07:37:57.696258+0000","last_active":"2024-09-21T07:37:57.704995+0000","last_peered":"2024-09-21T07:37:57.704995+0000","last_clean":"2024-09-21T07:37:57.704995+0000","last_became_active":"2024-09-21T07:37:57.695921+0000","last_became_peered":"2024-09-21T07:37:57.695921+0000","last_unstale":"2024-09-21T07:37:57.704995+0000","last_undegraded":"2024-09-21T07:37:57.704995+0000","last_fullsized":"2024-09-21T07:37:57.704995+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:16.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709496+0000","last_change":"2024-09-21T07:37:56.695731+0000","last_active":"2024-09-21T07:37:57.709496+0000","last_peered":"2024-09-21T07:37:57.709496+0000","last_clean":"2024-09-21T07:37:57.709496+0000","last_became_active":"2024-09-21T07:37:56.695425+0000","last_became_peered":"2024-09-21T07:37:56.695425+0000","last_unstale":"2024-09-21T07:37:57.709496+0000","last_undegraded":"2024-09-21T07:37:57.709496+0000","last_fullsized":"2024-09-21T07:37:57.709496+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:33.472252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672698+0000","last_change":"2024-09-21T07:37:56.672698+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672698+0000","last_undegraded":"2024-09-21T07:37:56.672698+0000","last_fullsized":"2024-09-21T07:37:56.672698+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685695+0000","last_change":"2024-09-21T07:37:56.683690+0000","last_active":"2024-09-21T07:37:56.685695+0000","last_peered":"2024-09-21T07:37:56.685695+0000","last_clean":"2024-09-21T07:37:56.685695+0000","last_became_active":"2024-09-21T07:37:56.682542+0000","last_became_peered":"2024-09-21T07:37:56.682542+0000","last_unstale":"2024-09-21T07:37:56.685695+0000","last_undegraded":"2024-09-21T07:37:56.685695+0000","last_fullsized":"2024-09-21T07:37:56.685695+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:40.118009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672026+0000","last_change":"2024-09-21T07:37:56.672026+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672026+0000","last_undegraded":"2024-09-21T07:37:56.672026+0000","last_fullsized":"2024-09-21T07:37:56.672026+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685780+0000","last_change":"2024-09-21T07:37:56.684391+0000","last_active":"2024-09-21T07:37:56.685780+0000","last_peered":"2024-09-21T07:37:56.685780+0000","last_clean":"2024-09-21T07:37:56.685780+0000","last_became_active":"2024-09-21T07:37:56.683444+0000","last_became_peered":"2024-09-21T07:37:56.683444+0000","last_unstale":"2024-09-21T07:37:56.685780+0000","last_undegraded":"2024-09-21T07:37:56.685780+0000","last_fullsized":"2024-09-21T07:37:56.685780+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:36.720328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673672+0000","last_change":"2024-09-21T07:37:56.673672+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673672+0000","last_undegraded":"2024-09-21T07:37:56.673672+0000","last_fullsized":"2024-09-21T07:37:56.673672+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689555+0000","last_change":"2024-09-21T07:37:56.684444+0000","last_active":"2024-09-21T07:37:56.689555+0000","last_peered":"2024-09-21T07:37:56.689555+0000","last_clean":"2024-09-21T07:37:56.689555+0000","last_became_active":"2024-09-21T07:37:56.684047+0000","last_became_peered":"2024-09-21T07:37:56.684047+0000","last_unstale":"2024-09-21T07:37:56.689555+0000","last_undegraded":"2024-09-21T07:37:56.689555+0000","last_fullsized":"2024-09-21T07:37:56.689555+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.271604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670968+0000","last_change":"2024-09-21T07:37:56.670968+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670968+0000","last_undegraded":"2024-09-21T07:37:56.670968+0000","last_fullsized":"2024-09-21T07:37:56.670968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709473+0000","last_change":"2024-09-21T07:37:56.690896+0000","last_active":"2024-09-21T07:37:57.709473+0000","last_peered":"2024-09-21T07:37:57.709473+0000","last_clean":"2024-09-21T07:37:57.709473+0000","last_became_active":"2024-09-21T07:37:56.690438+0000","last_became_peered":"2024-09-21T07:37:56.690438+0000","last_unstale":"2024-09-21T07:37:57.709473+0000","last_undegraded":"2024-09-21T07:37:57.709473+0000","last_fullsized":"2024-09-21T07:37:57.709473+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:33.918994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974013+0000","last_change":"2024-09-21T07:37:57.697180+0000","last_active":"2024-09-21T07:37:58.974013+0000","last_peered":"2024-09-21T07:37:58.974013+0000","last_clean":"2024-09-21T07:37:58.974013+0000","last_became_active":"2024-09-21T07:37:57.696336+0000","last_became_peered":"2024-09-21T07:37:57.696336+0000","last_unstale":"2024-09-21T07:37:58.974013+0000","last_undegraded":"2024-09-21T07:37:58.974013+0000","last_fullsized":"2024-09-21T07:37:58.974013+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:35.468489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.680242+0000","last_change":"2024-09-21T07:37:56.676884+0000","last_active":"2024-09-21T07:37:56.680242+0000","last_peered":"2024-09-21T07:37:56.680242+0000","last_clean":"2024-09-21T07:37:56.680242+0000","last_became_active":"2024-09-21T07:37:56.676336+0000","last_became_peered":"2024-09-21T07:37:56.676336+0000","last_unstale":"2024-09-21T07:37:56.680242+0000","last_undegraded":"2024-09-21T07:37:56.680242+0000","last_fullsized":"2024-09-21T07:37:56.680242+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:45.909754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705041+0000","last_change":"2024-09-21T07:37:57.693339+0000","last_active":"2024-09-21T07:37:57.705041+0000","last_peered":"2024-09-21T07:37:57.705041+0000","last_clean":"2024-09-21T07:37:57.705041+0000","last_became_active":"2024-09-21T07:37:57.692967+0000","last_became_peered":"2024-09-21T07:37:57.692967+0000","last_unstale":"2024-09-21T07:37:57.705041+0000","last_undegraded":"2024-09-21T07:37:57.705041+0000","last_fullsized":"2024-09-21T07:37:57.705041+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:27.706291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693751+0000","last_change":"2024-09-21T07:37:56.688339+0000","last_active":"2024-09-21T07:37:56.693751+0000","last_peered":"2024-09-21T07:37:56.693751+0000","last_clean":"2024-09-21T07:37:56.693751+0000","last_became_active":"2024-09-21T07:37:56.684821+0000","last_became_peered":"2024-09-21T07:37:56.684821+0000","last_unstale":"2024-09-21T07:37:56.693751+0000","last_undegraded":"2024-09-21T07:37:56.693751+0000","last_fullsized":"2024-09-21T07:37:56.693751+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:23.930006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667603+0000","last_change":"2024-09-21T07:37:56.667603+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667603+0000","last_undegraded":"2024-09-21T07:37:56.667603+0000","last_fullsized":"2024-09-21T07:37:56.667603+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694168+0000","last_change":"2024-09-21T07:37:56.693400+0000","last_active":"2024-09-21T07:37:56.694168+0000","last_peered":"2024-09-21T07:37:56.694168+0000","last_clean":"2024-09-21T07:37:56.694168+0000","last_became_active":"2024-09-21T07:37:56.692901+0000","last_became_peered":"2024-09-21T07:37:56.692901+0000","last_unstale":"2024-09-21T07:37:56.694168+0000","last_undegraded":"2024-09-21T07:37:56.694168+0000","last_fullsized":"2024-09-21T07:37:56.694168+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:48.154618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679129+0000","last_change":"2024-09-21T07:37:56.679129+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679129+0000","last_undegraded":"2024-09-21T07:37:56.679129+0000","last_fullsized":"2024-09-21T07:37:56.679129+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685783+0000","last_change":"2024-09-21T07:37:56.684291+0000","last_active":"2024-09-21T07:37:56.685783+0000","last_peered":"2024-09-21T07:37:56.685783+0000","last_clean":"2024-09-21T07:37:56.685783+0000","last_became_active":"2024-09-21T07:37:56.682331+0000","last_became_peered":"2024-09-21T07:37:56.682331+0000","last_unstale":"2024-09-21T07:37:56.685783+0000","last_undegraded":"2024-09-21T07:37:56.685783+0000","last_fullsized":"2024-09-21T07:37:56.685783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:28.263282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670983+0000","last_change":"2024-09-21T07:37:57.682491+0000","last_active":"2024-09-21T07:37:58.670983+0000","last_peered":"2024-09-21T07:37:58.670983+0000","last_clean":"2024-09-21T07:37:58.670983+0000","last_became_active":"2024-09-21T07:37:57.682202+0000","last_became_peered":"2024-09-21T07:37:57.682202+0000","last_unstale":"2024-09-21T07:37:58.670983+0000","last_undegraded":"2024-09-21T07:37:58.670983+0000","last_fullsized":"2024-09-21T07:37:58.670983+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:35.056943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683236+0000","last_change":"2024-09-21T07:37:56.680005+0000","last_active":"2024-09-21T07:37:56.683236+0000","last_peered":"2024-09-21T07:37:56.683236+0000","last_clean":"2024-09-21T07:37:56.683236+0000","last_became_active":"2024-09-21T07:37:56.679613+0000","last_became_peered":"2024-09-21T07:37:56.679613+0000","last_unstale":"2024-09-21T07:37:56.683236+0000","last_undegraded":"2024-09-21T07:37:56.683236+0000","last_fullsized":"2024-09-21T07:37:56.683236+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:42.362978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680361+0000","last_change":"2024-09-21T07:37:56.700326+0000","last_active":"2024-09-21T07:37:57.680361+0000","last_peered":"2024-09-21T07:37:57.680361+0000","last_clean":"2024-09-21T07:37:57.680361+0000","last_became_active":"2024-09-21T07:37:56.700049+0000","last_became_peered":"2024-09-21T07:37:56.700049+0000","last_unstale":"2024-09-21T07:37:57.680361+0000","last_undegraded":"2024-09-21T07:37:57.680361+0000","last_fullsized":"2024-09-21T07:37:57.680361+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:56.974818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674181+0000","last_change":"2024-09-21T07:37:56.674181+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674181+0000","last_undegraded":"2024-09-21T07:37:56.674181+0000","last_fullsized":"2024-09-21T07:37:56.674181+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683621+0000","last_change":"2024-09-21T07:37:56.680549+0000","last_active":"2024-09-21T07:37:56.683621+0000","last_peered":"2024-09-21T07:37:56.683621+0000","last_clean":"2024-09-21T07:37:56.683621+0000","last_became_active":"2024-09-21T07:37:56.680165+0000","last_became_peered":"2024-09-21T07:37:56.680165+0000","last_unstale":"2024-09-21T07:37:56.683621+0000","last_undegraded":"2024-09-21T07:37:56.683621+0000","last_fullsized":"2024-09-21T07:37:56.683621+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:26.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670495+0000","last_change":"2024-09-21T07:37:57.699500+0000","last_active":"2024-09-21T07:37:58.670495+0000","last_peered":"2024-09-21T07:37:58.670495+0000","last_clean":"2024-09-21T07:37:58.670495+0000","last_became_active":"2024-09-21T07:37:57.699196+0000","last_became_peered":"2024-09-21T07:37:57.699196+0000","last_unstale":"2024-09-21T07:37:58.670495+0000","last_undegraded":"2024-09-21T07:37:58.670495+0000","last_fullsized":"2024-09-21T07:37:58.670495+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:16.002562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689103+0000","last_change":"2024-09-21T07:37:56.688161+0000","last_active":"2024-09-21T07:37:56.689103+0000","last_peered":"2024-09-21T07:37:56.689103+0000","last_clean":"2024-09-21T07:37:56.689103+0000","last_became_active":"2024-09-21T07:37:56.687601+0000","last_became_peered":"2024-09-21T07:37:56.687601+0000","last_unstale":"2024-09-21T07:37:56.689103+0000","last_undegraded":"2024-09-21T07:37:56.689103+0000","last_fullsized":"2024-09-21T07:37:56.689103+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:50.744275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":471,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973649+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:37:58.973649+0000","last_peered":"2024-09-21T07:37:58.973649+0000","last_clean":"2024-09-21T07:37:58.973649+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:37:58.973649+0000","last_undegraded":"2024-09-21T07:37:58.973649+0000","last_fullsized":"2024-09-21T07:37:58.973649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509628,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509628,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47740,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324100,"statfs":{"total":96636764160,"available":96587878400,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509628,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47736,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324104,"statfs":{"total":96636764160,"available":96587882496,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56640,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315200,"statfs":{"total":96636764160,"available":96578764800,"internally_reserved":0,"allocated":3317760,"data_stored":1878902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56668,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315172,"statfs":{"total":96636764160,"available":96578736128,"internally_reserved":0,"allocated":3350528,"data_stored":1892885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87976,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283864,"statfs":{"total":96636764160,"available":96546676736,"internally_reserved":0,"allocated":2772992,"data_stored":1304643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:02.309 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:02.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 -- 172.21.15.64:0/337201033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 msgr2=0x7f3b2c166120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 --2- 172.21.15.64:0/337201033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c166120 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009bc0 tx=0x7f3b2401cac0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 -- 172.21.15.64:0/337201033 shutdown_connections 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 --2- 172.21.15.64:0/337201033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c166120 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 --2- 172.21.15.64:0/337201033 >> v2:172.21.15.90:3300/0 conn(0x7f3b2c0ce030 0x7f3b2c0ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 -- 172.21.15.64:0/337201033 >> 172.21.15.64:0/337201033 conn(0x7f3b2c0b2f80 msgr2=0x7f3b2c0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 -- 172.21.15.64:0/337201033 shutdown_connections 2024-09-21T07:38:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.506+0000 7f3b32000640 1 -- 172.21.15.64:0/337201033 wait complete. 2024-09-21T07:38:02.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 Processor -- start 2024-09-21T07:38:02.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- start start 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b2c0ce030 0x7f3b2c160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c169330 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c1691b0 con 0x7f3b2c0ce030 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2c1694b0 con 0x7f3b2c0cd170 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55986/0 (socket says 172.21.15.64:55986) 2024-09-21T07:38:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 -- 172.21.15.64:0/1397649150 learned_addr learned my addr 172.21.15.64:0/1397649150 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b23e00640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2be00640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b2c0ce030 0x7f3b2c160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 -- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 msgr2=0x7f3b2c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 -- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b2c0ce030 msgr2=0x7f3b2c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b2c0ce030 0x7f3b2c160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 -- 172.21.15.64:0/1397649150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c09ee10 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b2b400640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e7d0 tx=0x7f3b1c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00ccc0 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b1c010430 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c010860 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2c09f390 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.510+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2c09f0b0 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2c0ce440 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b1c010a00 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b23400640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 0x7f3b08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f3b1c094da0 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b23e00640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 0x7f3b08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.514+0000 7f3b23e00640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 0x7f3b08075710 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001ec0 tx=0x7f3b14009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.518+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3b1c05f5d0 con 0x7f3b2c0b0bf0 2024-09-21T07:38:02.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.690+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b2c159da0 con 0x7f3b08073200 2024-09-21T07:38:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.698+0000 7f3b23400640 1 -- 172.21.15.64:0/1397649150 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249311 (secure 0 0 0) 0x7f3b2c159da0 con 0x7f3b08073200 2024-09-21T07:38:02.699 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:02.701 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 msgr2=0x7f3b08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 0x7f3b08075710 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001ec0 tx=0x7f3b14009040 comp rx=0 tx=0).stop 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 msgr2=0x7f3b2c15e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e7d0 tx=0x7f3b1c00ec90 comp rx=0 tx=0).stop 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 shutdown_connections 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3b08073200 0x7f3b08075710 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b2c0ce030 0x7f3b2c160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3b2c0cd170 0x7f3b2c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 --2- 172.21.15.64:0/1397649150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b2c0b0bf0 0x7f3b2c15e300 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 >> 172.21.15.64:0/1397649150 conn(0x7f3b2c0b2f80 msgr2=0x7f3b2c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:02.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 shutdown_connections 2024-09-21T07:38:02.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.702+0000 7f3b32000640 1 -- 172.21.15.64:0/1397649150 wait complete. 2024-09-21T07:38:02.721 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":674,"stamp":"2024-09-21T07:38:01.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":119,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469108,"kb_used_data":22520,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754505612,"statfs":{"total":773094113280,"available":772613746688,"internally_reserved":0,"allocated":23060480,"data_stored":11519100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671244+0000","last_change":"2024-09-21T07:37:57.686919+0000","last_active":"2024-09-21T07:37:58.671244+0000","last_peered":"2024-09-21T07:37:58.671244+0000","last_clean":"2024-09-21T07:37:58.671244+0000","last_became_active":"2024-09-21T07:37:57.686610+0000","last_became_peered":"2024-09-21T07:37:57.686610+0000","last_unstale":"2024-09-21T07:37:58.671244+0000","last_undegraded":"2024-09-21T07:37:58.671244+0000","last_fullsized":"2024-09-21T07:37:58.671244+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.888561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678707+0000","last_change":"2024-09-21T07:37:56.678707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678707+0000","last_undegraded":"2024-09-21T07:37:56.678707+0000","last_fullsized":"2024-09-21T07:37:56.678707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.699880+0000","last_change":"2024-09-21T07:37:57.692560+0000","last_active":"2024-09-21T07:37:57.699880+0000","last_peered":"2024-09-21T07:37:57.699880+0000","last_clean":"2024-09-21T07:37:57.699880+0000","last_became_active":"2024-09-21T07:37:57.686329+0000","last_became_peered":"2024-09-21T07:37:57.686329+0000","last_unstale":"2024-09-21T07:37:57.699880+0000","last_undegraded":"2024-09-21T07:37:57.699880+0000","last_fullsized":"2024-09-21T07:37:57.699880+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:30.089335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.701001+0000","last_change":"2024-09-21T07:37:57.692825+0000","last_active":"2024-09-21T07:37:57.701001+0000","last_peered":"2024-09-21T07:37:57.701001+0000","last_clean":"2024-09-21T07:37:57.701001+0000","last_became_active":"2024-09-21T07:37:57.692506+0000","last_became_peered":"2024-09-21T07:37:57.692506+0000","last_unstale":"2024-09-21T07:37:57.701001+0000","last_undegraded":"2024-09-21T07:37:57.701001+0000","last_fullsized":"2024-09-21T07:37:57.701001+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:47.392925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667034+0000","last_change":"2024-09-21T07:37:56.667034+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667034+0000","last_undegraded":"2024-09-21T07:37:56.667034+0000","last_fullsized":"2024-09-21T07:37:56.667034+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670585+0000","last_change":"2024-09-21T07:37:57.690137+0000","last_active":"2024-09-21T07:37:58.670585+0000","last_peered":"2024-09-21T07:37:58.670585+0000","last_clean":"2024-09-21T07:37:58.670585+0000","last_became_active":"2024-09-21T07:37:57.689839+0000","last_became_peered":"2024-09-21T07:37:57.689839+0000","last_unstale":"2024-09-21T07:37:58.670585+0000","last_undegraded":"2024-09-21T07:37:58.670585+0000","last_fullsized":"2024-09-21T07:37:58.670585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.086074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666479+0000","last_change":"2024-09-21T07:37:56.666479+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666479+0000","last_undegraded":"2024-09-21T07:37:56.666479+0000","last_fullsized":"2024-09-21T07:37:56.666479+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671385+0000","last_change":"2024-09-21T07:37:57.689677+0000","last_active":"2024-09-21T07:37:58.671385+0000","last_peered":"2024-09-21T07:37:58.671385+0000","last_clean":"2024-09-21T07:37:58.671385+0000","last_became_active":"2024-09-21T07:37:57.689320+0000","last_became_peered":"2024-09-21T07:37:57.689320+0000","last_unstale":"2024-09-21T07:37:58.671385+0000","last_undegraded":"2024-09-21T07:37:58.671385+0000","last_fullsized":"2024-09-21T07:37:58.671385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.136328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705127+0000","last_change":"2024-09-21T07:37:57.694043+0000","last_active":"2024-09-21T07:37:57.705127+0000","last_peered":"2024-09-21T07:37:57.705127+0000","last_clean":"2024-09-21T07:37:57.705127+0000","last_became_active":"2024-09-21T07:37:57.693686+0000","last_became_peered":"2024-09-21T07:37:57.693686+0000","last_unstale":"2024-09-21T07:37:57.705127+0000","last_undegraded":"2024-09-21T07:37:57.705127+0000","last_fullsized":"2024-09-21T07:37:57.705127+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:19.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.707799+0000","last_change":"2024-09-21T07:37:57.696681+0000","last_active":"2024-09-21T07:37:57.707799+0000","last_peered":"2024-09-21T07:37:57.707799+0000","last_clean":"2024-09-21T07:37:57.707799+0000","last_became_active":"2024-09-21T07:37:57.696311+0000","last_became_peered":"2024-09-21T07:37:57.696311+0000","last_unstale":"2024-09-21T07:37:57.707799+0000","last_undegraded":"2024-09-21T07:37:57.707799+0000","last_fullsized":"2024-09-21T07:37:57.707799+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:29.232647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670912+0000","last_change":"2024-09-21T07:37:57.679345+0000","last_active":"2024-09-21T07:37:58.670912+0000","last_peered":"2024-09-21T07:37:58.670912+0000","last_clean":"2024-09-21T07:37:58.670912+0000","last_became_active":"2024-09-21T07:37:57.678467+0000","last_became_peered":"2024-09-21T07:37:57.678467+0000","last_unstale":"2024-09-21T07:37:58.670912+0000","last_undegraded":"2024-09-21T07:37:58.670912+0000","last_fullsized":"2024-09-21T07:37:58.670912+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:41.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672277+0000","last_change":"2024-09-21T07:37:56.672277+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672277+0000","last_undegraded":"2024-09-21T07:37:56.672277+0000","last_fullsized":"2024-09-21T07:37:56.672277+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.685438+0000","last_change":"2024-09-21T07:37:56.685438+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.685438+0000","last_undegraded":"2024-09-21T07:37:56.685438+0000","last_fullsized":"2024-09-21T07:37:56.685438+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973985+0000","last_change":"2024-09-21T07:37:57.682989+0000","last_active":"2024-09-21T07:37:58.973985+0000","last_peered":"2024-09-21T07:37:58.973985+0000","last_clean":"2024-09-21T07:37:58.973985+0000","last_became_active":"2024-09-21T07:37:57.682619+0000","last_became_peered":"2024-09-21T07:37:57.682619+0000","last_unstale":"2024-09-21T07:37:58.973985+0000","last_undegraded":"2024-09-21T07:37:58.973985+0000","last_fullsized":"2024-09-21T07:37:58.973985+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:32.009487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.708901+0000","last_change":"2024-09-21T07:37:57.705839+0000","last_active":"2024-09-21T07:37:57.708901+0000","last_peered":"2024-09-21T07:37:57.708901+0000","last_clean":"2024-09-21T07:37:57.708901+0000","last_became_active":"2024-09-21T07:37:57.705526+0000","last_became_peered":"2024-09-21T07:37:57.705526+0000","last_unstale":"2024-09-21T07:37:57.708901+0000","last_undegraded":"2024-09-21T07:37:57.708901+0000","last_fullsized":"2024-09-21T07:37:57.708901+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:28.397601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673122+0000","last_change":"2024-09-21T07:37:56.673122+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673122+0000","last_undegraded":"2024-09-21T07:37:56.673122+0000","last_fullsized":"2024-09-21T07:37:56.673122+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.698334+0000","last_change":"2024-09-21T07:37:57.688241+0000","last_active":"2024-09-21T07:37:57.698334+0000","last_peered":"2024-09-21T07:37:57.698334+0000","last_clean":"2024-09-21T07:37:57.698334+0000","last_became_active":"2024-09-21T07:37:57.687847+0000","last_became_peered":"2024-09-21T07:37:57.687847+0000","last_unstale":"2024-09-21T07:37:57.698334+0000","last_undegraded":"2024-09-21T07:37:57.698334+0000","last_fullsized":"2024-09-21T07:37:57.698334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:32.911732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974306+0000","last_change":"2024-09-21T07:37:57.683606+0000","last_active":"2024-09-21T07:37:58.974306+0000","last_peered":"2024-09-21T07:37:58.974306+0000","last_clean":"2024-09-21T07:37:58.974306+0000","last_became_active":"2024-09-21T07:37:57.683282+0000","last_became_peered":"2024-09-21T07:37:57.683282+0000","last_unstale":"2024-09-21T07:37:58.974306+0000","last_undegraded":"2024-09-21T07:37:58.974306+0000","last_fullsized":"2024-09-21T07:37:58.974306+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:56.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672196+0000","last_change":"2024-09-21T07:37:56.672196+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672196+0000","last_undegraded":"2024-09-21T07:37:56.672196+0000","last_fullsized":"2024-09-21T07:37:56.672196+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667178+0000","last_change":"2024-09-21T07:37:56.667178+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667178+0000","last_undegraded":"2024-09-21T07:37:56.667178+0000","last_fullsized":"2024-09-21T07:37:56.667178+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673748+0000","last_change":"2024-09-21T07:37:56.673748+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673748+0000","last_undegraded":"2024-09-21T07:37:56.673748+0000","last_fullsized":"2024-09-21T07:37:56.673748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974319+0000","last_change":"2024-09-21T07:37:57.703344+0000","last_active":"2024-09-21T07:37:58.974319+0000","last_peered":"2024-09-21T07:37:58.974319+0000","last_clean":"2024-09-21T07:37:58.974319+0000","last_became_active":"2024-09-21T07:37:57.702763+0000","last_became_peered":"2024-09-21T07:37:57.702763+0000","last_unstale":"2024-09-21T07:37:58.974319+0000","last_undegraded":"2024-09-21T07:37:58.974319+0000","last_fullsized":"2024-09-21T07:37:58.974319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:12.340315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674813+0000","last_change":"2024-09-21T07:37:56.674813+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674813+0000","last_undegraded":"2024-09-21T07:37:56.674813+0000","last_fullsized":"2024-09-21T07:37:56.674813+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674609+0000","last_change":"2024-09-21T07:37:56.674609+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674609+0000","last_undegraded":"2024-09-21T07:37:56.674609+0000","last_fullsized":"2024-09-21T07:37:56.674609+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670498+0000","last_change":"2024-09-21T07:37:56.670498+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670498+0000","last_undegraded":"2024-09-21T07:37:56.670498+0000","last_fullsized":"2024-09-21T07:37:56.670498+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667488+0000","last_change":"2024-09-21T07:37:56.667488+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667488+0000","last_undegraded":"2024-09-21T07:37:56.667488+0000","last_fullsized":"2024-09-21T07:37:56.667488+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670927+0000","last_change":"2024-09-21T07:37:57.689041+0000","last_active":"2024-09-21T07:37:58.670927+0000","last_peered":"2024-09-21T07:37:58.670927+0000","last_clean":"2024-09-21T07:37:58.670927+0000","last_became_active":"2024-09-21T07:37:57.688683+0000","last_became_peered":"2024-09-21T07:37:57.688683+0000","last_unstale":"2024-09-21T07:37:58.670927+0000","last_undegraded":"2024-09-21T07:37:58.670927+0000","last_fullsized":"2024-09-21T07:37:58.670927+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:08.217425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678709+0000","last_change":"2024-09-21T07:37:56.678709+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678709+0000","last_undegraded":"2024-09-21T07:37:56.678709+0000","last_fullsized":"2024-09-21T07:37:56.678709+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679812+0000","last_change":"2024-09-21T07:37:56.679812+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679812+0000","last_undegraded":"2024-09-21T07:37:56.679812+0000","last_fullsized":"2024-09-21T07:37:56.679812+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672068+0000","last_change":"2024-09-21T07:37:56.672068+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672068+0000","last_undegraded":"2024-09-21T07:37:56.672068+0000","last_fullsized":"2024-09-21T07:37:56.672068+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670510+0000","last_change":"2024-09-21T07:37:57.688877+0000","last_active":"2024-09-21T07:37:58.670510+0000","last_peered":"2024-09-21T07:37:58.670510+0000","last_clean":"2024-09-21T07:37:58.670510+0000","last_became_active":"2024-09-21T07:37:57.688564+0000","last_became_peered":"2024-09-21T07:37:57.688564+0000","last_unstale":"2024-09-21T07:37:58.670510+0000","last_undegraded":"2024-09-21T07:37:58.670510+0000","last_fullsized":"2024-09-21T07:37:58.670510+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:49.285747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672601+0000","last_change":"2024-09-21T07:37:56.672601+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672601+0000","last_undegraded":"2024-09-21T07:37:56.672601+0000","last_fullsized":"2024-09-21T07:37:56.672601+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"217'4","reported_seq":19,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671169+0000","last_change":"2024-09-21T07:37:56.681003+0000","last_active":"2024-09-21T07:37:58.671169+0000","last_peered":"2024-09-21T07:37:58.671169+0000","last_clean":"2024-09-21T07:37:58.671169+0000","last_became_active":"2024-09-21T07:37:56.680677+0000","last_became_peered":"2024-09-21T07:37:56.680677+0000","last_unstale":"2024-09-21T07:37:58.671169+0000","last_undegraded":"2024-09-21T07:37:58.671169+0000","last_fullsized":"2024-09-21T07:37:58.671169+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.630114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974033+0000","last_change":"2024-09-21T07:37:57.696302+0000","last_active":"2024-09-21T07:37:58.974033+0000","last_peered":"2024-09-21T07:37:58.974033+0000","last_clean":"2024-09-21T07:37:58.974033+0000","last_became_active":"2024-09-21T07:37:57.695957+0000","last_became_peered":"2024-09-21T07:37:57.695957+0000","last_unstale":"2024-09-21T07:37:58.974033+0000","last_undegraded":"2024-09-21T07:37:58.974033+0000","last_fullsized":"2024-09-21T07:37:58.974033+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:01.310825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685152+0000","last_change":"2024-09-21T07:37:56.682377+0000","last_active":"2024-09-21T07:37:56.685152+0000","last_peered":"2024-09-21T07:37:56.685152+0000","last_clean":"2024-09-21T07:37:56.685152+0000","last_became_active":"2024-09-21T07:37:56.682050+0000","last_became_peered":"2024-09-21T07:37:56.682050+0000","last_unstale":"2024-09-21T07:37:56.685152+0000","last_undegraded":"2024-09-21T07:37:56.685152+0000","last_fullsized":"2024-09-21T07:37:56.685152+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:20.420448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670800+0000","last_change":"2024-09-21T07:37:57.685402+0000","last_active":"2024-09-21T07:37:58.670800+0000","last_peered":"2024-09-21T07:37:58.670800+0000","last_clean":"2024-09-21T07:37:58.670800+0000","last_became_active":"2024-09-21T07:37:57.684889+0000","last_became_peered":"2024-09-21T07:37:57.684889+0000","last_unstale":"2024-09-21T07:37:58.670800+0000","last_undegraded":"2024-09-21T07:37:58.670800+0000","last_fullsized":"2024-09-21T07:37:58.670800+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.332634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693589+0000","last_change":"2024-09-21T07:37:56.689098+0000","last_active":"2024-09-21T07:37:56.693589+0000","last_peered":"2024-09-21T07:37:56.693589+0000","last_clean":"2024-09-21T07:37:56.693589+0000","last_became_active":"2024-09-21T07:37:56.684546+0000","last_became_peered":"2024-09-21T07:37:56.684546+0000","last_unstale":"2024-09-21T07:37:56.693589+0000","last_undegraded":"2024-09-21T07:37:56.693589+0000","last_fullsized":"2024-09-21T07:37:56.693589+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.173866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678642+0000","last_change":"2024-09-21T07:37:56.678642+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678642+0000","last_undegraded":"2024-09-21T07:37:56.678642+0000","last_fullsized":"2024-09-21T07:37:56.678642+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973906+0000","last_change":"2024-09-21T07:37:56.693584+0000","last_active":"2024-09-21T07:37:58.973906+0000","last_peered":"2024-09-21T07:37:58.973906+0000","last_clean":"2024-09-21T07:37:58.973906+0000","last_became_active":"2024-09-21T07:37:56.693288+0000","last_became_peered":"2024-09-21T07:37:56.693288+0000","last_unstale":"2024-09-21T07:37:58.973906+0000","last_undegraded":"2024-09-21T07:37:58.973906+0000","last_fullsized":"2024-09-21T07:37:58.973906+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:01.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668226+0000","last_change":"2024-09-21T07:37:56.668226+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668226+0000","last_undegraded":"2024-09-21T07:37:56.668226+0000","last_fullsized":"2024-09-21T07:37:56.668226+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694021+0000","last_change":"2024-09-21T07:37:56.689298+0000","last_active":"2024-09-21T07:37:56.694021+0000","last_peered":"2024-09-21T07:37:56.694021+0000","last_clean":"2024-09-21T07:37:56.694021+0000","last_became_active":"2024-09-21T07:37:56.688807+0000","last_became_peered":"2024-09-21T07:37:56.688807+0000","last_unstale":"2024-09-21T07:37:56.694021+0000","last_undegraded":"2024-09-21T07:37:56.694021+0000","last_fullsized":"2024-09-21T07:37:56.694021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:59.971298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705101+0000","last_change":"2024-09-21T07:37:57.693164+0000","last_active":"2024-09-21T07:37:57.705101+0000","last_peered":"2024-09-21T07:37:57.705101+0000","last_clean":"2024-09-21T07:37:57.705101+0000","last_became_active":"2024-09-21T07:37:57.692831+0000","last_became_peered":"2024-09-21T07:37:57.692831+0000","last_unstale":"2024-09-21T07:37:57.705101+0000","last_undegraded":"2024-09-21T07:37:57.705101+0000","last_fullsized":"2024-09-21T07:37:57.705101+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:07.215948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680120+0000","last_change":"2024-09-21T07:37:56.696904+0000","last_active":"2024-09-21T07:37:57.680120+0000","last_peered":"2024-09-21T07:37:57.680120+0000","last_clean":"2024-09-21T07:37:57.680120+0000","last_became_active":"2024-09-21T07:37:56.696373+0000","last_became_peered":"2024-09-21T07:37:56.696373+0000","last_unstale":"2024-09-21T07:37:57.680120+0000","last_undegraded":"2024-09-21T07:37:57.680120+0000","last_fullsized":"2024-09-21T07:37:57.680120+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:12.535237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667847+0000","last_change":"2024-09-21T07:37:56.667847+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667847+0000","last_undegraded":"2024-09-21T07:37:56.667847+0000","last_fullsized":"2024-09-21T07:37:56.667847+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670323+0000","last_change":"2024-09-21T07:37:56.681896+0000","last_active":"2024-09-21T07:37:58.670323+0000","last_peered":"2024-09-21T07:37:58.670323+0000","last_clean":"2024-09-21T07:37:58.670323+0000","last_became_active":"2024-09-21T07:37:56.681584+0000","last_became_peered":"2024-09-21T07:37:56.681584+0000","last_unstale":"2024-09-21T07:37:58.670323+0000","last_undegraded":"2024-09-21T07:37:58.670323+0000","last_fullsized":"2024-09-21T07:37:58.670323+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:24.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689761+0000","last_change":"2024-09-21T07:37:56.687358+0000","last_active":"2024-09-21T07:37:56.689761+0000","last_peered":"2024-09-21T07:37:56.689761+0000","last_clean":"2024-09-21T07:37:56.689761+0000","last_became_active":"2024-09-21T07:37:56.685812+0000","last_became_peered":"2024-09-21T07:37:56.685812+0000","last_unstale":"2024-09-21T07:37:56.689761+0000","last_undegraded":"2024-09-21T07:37:56.689761+0000","last_fullsized":"2024-09-21T07:37:56.689761+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:06.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672823+0000","last_change":"2024-09-21T07:37:56.672823+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672823+0000","last_undegraded":"2024-09-21T07:37:56.672823+0000","last_fullsized":"2024-09-21T07:37:56.672823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.681430+0000","last_change":"2024-09-21T07:37:56.700571+0000","last_active":"2024-09-21T07:37:57.681430+0000","last_peered":"2024-09-21T07:37:57.681430+0000","last_clean":"2024-09-21T07:37:57.681430+0000","last_became_active":"2024-09-21T07:37:56.700152+0000","last_became_peered":"2024-09-21T07:37:56.700152+0000","last_unstale":"2024-09-21T07:37:57.681430+0000","last_undegraded":"2024-09-21T07:37:57.681430+0000","last_fullsized":"2024-09-21T07:37:57.681430+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:16.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705065+0000","last_change":"2024-09-21T07:37:57.694048+0000","last_active":"2024-09-21T07:37:57.705065+0000","last_peered":"2024-09-21T07:37:57.705065+0000","last_clean":"2024-09-21T07:37:57.705065+0000","last_became_active":"2024-09-21T07:37:57.693768+0000","last_became_peered":"2024-09-21T07:37:57.693768+0000","last_unstale":"2024-09-21T07:37:57.705065+0000","last_undegraded":"2024-09-21T07:37:57.705065+0000","last_fullsized":"2024-09-21T07:37:57.705065+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:09.584828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685220+0000","last_change":"2024-09-21T07:37:56.682914+0000","last_active":"2024-09-21T07:37:56.685220+0000","last_peered":"2024-09-21T07:37:56.685220+0000","last_clean":"2024-09-21T07:37:56.685220+0000","last_became_active":"2024-09-21T07:37:56.681968+0000","last_became_peered":"2024-09-21T07:37:56.681968+0000","last_unstale":"2024-09-21T07:37:56.685220+0000","last_undegraded":"2024-09-21T07:37:56.685220+0000","last_fullsized":"2024-09-21T07:37:56.685220+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:57.037229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667707+0000","last_change":"2024-09-21T07:37:56.667707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667707+0000","last_undegraded":"2024-09-21T07:37:56.667707+0000","last_fullsized":"2024-09-21T07:37:56.667707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"217'6","reported_seq":21,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671074+0000","last_change":"2024-09-21T07:37:56.681926+0000","last_active":"2024-09-21T07:37:58.671074+0000","last_peered":"2024-09-21T07:37:58.671074+0000","last_clean":"2024-09-21T07:37:58.671074+0000","last_became_active":"2024-09-21T07:37:56.681625+0000","last_became_peered":"2024-09-21T07:37:56.681625+0000","last_unstale":"2024-09-21T07:37:58.671074+0000","last_undegraded":"2024-09-21T07:37:58.671074+0000","last_fullsized":"2024-09-21T07:37:58.671074+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:04.257605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974068+0000","last_change":"2024-09-21T07:37:56.690462+0000","last_active":"2024-09-21T07:37:58.974068+0000","last_peered":"2024-09-21T07:37:58.974068+0000","last_clean":"2024-09-21T07:37:58.974068+0000","last_became_active":"2024-09-21T07:37:56.690094+0000","last_became_peered":"2024-09-21T07:37:56.690094+0000","last_unstale":"2024-09-21T07:37:58.974068+0000","last_undegraded":"2024-09-21T07:37:58.974068+0000","last_fullsized":"2024-09-21T07:37:58.974068+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:41.064369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668733+0000","last_change":"2024-09-21T07:37:56.668733+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668733+0000","last_undegraded":"2024-09-21T07:37:56.668733+0000","last_fullsized":"2024-09-21T07:37:56.668733+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.687335+0000","last_change":"2024-09-21T07:37:56.686422+0000","last_active":"2024-09-21T07:37:56.687335+0000","last_peered":"2024-09-21T07:37:56.687335+0000","last_clean":"2024-09-21T07:37:56.687335+0000","last_became_active":"2024-09-21T07:37:56.685790+0000","last_became_peered":"2024-09-21T07:37:56.685790+0000","last_unstale":"2024-09-21T07:37:56.687335+0000","last_undegraded":"2024-09-21T07:37:56.687335+0000","last_fullsized":"2024-09-21T07:37:56.687335+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:39.021255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974271+0000","last_change":"2024-09-21T07:37:57.696921+0000","last_active":"2024-09-21T07:37:58.974271+0000","last_peered":"2024-09-21T07:37:58.974271+0000","last_clean":"2024-09-21T07:37:58.974271+0000","last_became_active":"2024-09-21T07:37:57.695559+0000","last_became_peered":"2024-09-21T07:37:57.695559+0000","last_unstale":"2024-09-21T07:37:58.974271+0000","last_undegraded":"2024-09-21T07:37:58.974271+0000","last_fullsized":"2024-09-21T07:37:58.974271+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.675113+0000","last_change":"2024-09-21T07:37:56.671057+0000","last_active":"2024-09-21T07:37:56.675113+0000","last_peered":"2024-09-21T07:37:56.675113+0000","last_clean":"2024-09-21T07:37:56.675113+0000","last_became_active":"2024-09-21T07:37:56.670715+0000","last_became_peered":"2024-09-21T07:37:56.670715+0000","last_unstale":"2024-09-21T07:37:56.675113+0000","last_undegraded":"2024-09-21T07:37:56.675113+0000","last_fullsized":"2024-09-21T07:37:56.675113+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:51.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668334+0000","last_change":"2024-09-21T07:37:56.668334+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668334+0000","last_undegraded":"2024-09-21T07:37:56.668334+0000","last_fullsized":"2024-09-21T07:37:56.668334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.692726+0000","last_change":"2024-09-21T07:37:56.691680+0000","last_active":"2024-09-21T07:37:56.692726+0000","last_peered":"2024-09-21T07:37:56.692726+0000","last_clean":"2024-09-21T07:37:56.692726+0000","last_became_active":"2024-09-21T07:37:56.691374+0000","last_became_peered":"2024-09-21T07:37:56.691374+0000","last_unstale":"2024-09-21T07:37:56.692726+0000","last_undegraded":"2024-09-21T07:37:56.692726+0000","last_fullsized":"2024-09-21T07:37:56.692726+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:14.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667126+0000","last_change":"2024-09-21T07:37:56.667126+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667126+0000","last_undegraded":"2024-09-21T07:37:56.667126+0000","last_fullsized":"2024-09-21T07:37:56.667126+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671365+0000","last_change":"2024-09-21T07:37:56.674146+0000","last_active":"2024-09-21T07:37:58.671365+0000","last_peered":"2024-09-21T07:37:58.671365+0000","last_clean":"2024-09-21T07:37:58.671365+0000","last_became_active":"2024-09-21T07:37:56.673828+0000","last_became_peered":"2024-09-21T07:37:56.673828+0000","last_unstale":"2024-09-21T07:37:58.671365+0000","last_undegraded":"2024-09-21T07:37:58.671365+0000","last_fullsized":"2024-09-21T07:37:58.671365+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:27.388800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666907+0000","last_change":"2024-09-21T07:37:56.666907+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666907+0000","last_undegraded":"2024-09-21T07:37:56.666907+0000","last_fullsized":"2024-09-21T07:37:56.666907+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.691734+0000","last_change":"2024-09-21T07:37:56.688513+0000","last_active":"2024-09-21T07:37:56.691734+0000","last_peered":"2024-09-21T07:37:56.691734+0000","last_clean":"2024-09-21T07:37:56.691734+0000","last_became_active":"2024-09-21T07:37:56.688218+0000","last_became_peered":"2024-09-21T07:37:56.688218+0000","last_unstale":"2024-09-21T07:37:56.691734+0000","last_undegraded":"2024-09-21T07:37:56.691734+0000","last_fullsized":"2024-09-21T07:37:56.691734+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:39.083364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674896+0000","last_change":"2024-09-21T07:37:56.674896+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674896+0000","last_undegraded":"2024-09-21T07:37:56.674896+0000","last_fullsized":"2024-09-21T07:37:56.674896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685173+0000","last_change":"2024-09-21T07:37:56.682770+0000","last_active":"2024-09-21T07:37:56.685173+0000","last_peered":"2024-09-21T07:37:56.685173+0000","last_clean":"2024-09-21T07:37:56.685173+0000","last_became_active":"2024-09-21T07:37:56.682396+0000","last_became_peered":"2024-09-21T07:37:56.682396+0000","last_unstale":"2024-09-21T07:37:56.685173+0000","last_undegraded":"2024-09-21T07:37:56.685173+0000","last_fullsized":"2024-09-21T07:37:56.685173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:43.770342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709364+0000","last_change":"2024-09-21T07:37:57.695029+0000","last_active":"2024-09-21T07:37:57.709364+0000","last_peered":"2024-09-21T07:37:57.709364+0000","last_clean":"2024-09-21T07:37:57.709364+0000","last_became_active":"2024-09-21T07:37:57.694668+0000","last_became_peered":"2024-09-21T07:37:57.694668+0000","last_unstale":"2024-09-21T07:37:57.709364+0000","last_undegraded":"2024-09-21T07:37:57.709364+0000","last_fullsized":"2024-09-21T07:37:57.709364+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:48.536815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974095+0000","last_change":"2024-09-21T07:37:56.687413+0000","last_active":"2024-09-21T07:37:58.974095+0000","last_peered":"2024-09-21T07:37:58.974095+0000","last_clean":"2024-09-21T07:37:58.974095+0000","last_became_active":"2024-09-21T07:37:56.686855+0000","last_became_peered":"2024-09-21T07:37:56.686855+0000","last_unstale":"2024-09-21T07:37:58.974095+0000","last_undegraded":"2024-09-21T07:37:58.974095+0000","last_fullsized":"2024-09-21T07:37:58.974095+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:17.302940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.704995+0000","last_change":"2024-09-21T07:37:57.696258+0000","last_active":"2024-09-21T07:37:57.704995+0000","last_peered":"2024-09-21T07:37:57.704995+0000","last_clean":"2024-09-21T07:37:57.704995+0000","last_became_active":"2024-09-21T07:37:57.695921+0000","last_became_peered":"2024-09-21T07:37:57.695921+0000","last_unstale":"2024-09-21T07:37:57.704995+0000","last_undegraded":"2024-09-21T07:37:57.704995+0000","last_fullsized":"2024-09-21T07:37:57.704995+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:16.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709496+0000","last_change":"2024-09-21T07:37:56.695731+0000","last_active":"2024-09-21T07:37:57.709496+0000","last_peered":"2024-09-21T07:37:57.709496+0000","last_clean":"2024-09-21T07:37:57.709496+0000","last_became_active":"2024-09-21T07:37:56.695425+0000","last_became_peered":"2024-09-21T07:37:56.695425+0000","last_unstale":"2024-09-21T07:37:57.709496+0000","last_undegraded":"2024-09-21T07:37:57.709496+0000","last_fullsized":"2024-09-21T07:37:57.709496+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:33.472252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672698+0000","last_change":"2024-09-21T07:37:56.672698+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672698+0000","last_undegraded":"2024-09-21T07:37:56.672698+0000","last_fullsized":"2024-09-21T07:37:56.672698+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685695+0000","last_change":"2024-09-21T07:37:56.683690+0000","last_active":"2024-09-21T07:37:56.685695+0000","last_peered":"2024-09-21T07:37:56.685695+0000","last_clean":"2024-09-21T07:37:56.685695+0000","last_became_active":"2024-09-21T07:37:56.682542+0000","last_became_peered":"2024-09-21T07:37:56.682542+0000","last_unstale":"2024-09-21T07:37:56.685695+0000","last_undegraded":"2024-09-21T07:37:56.685695+0000","last_fullsized":"2024-09-21T07:37:56.685695+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:40.118009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672026+0000","last_change":"2024-09-21T07:37:56.672026+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672026+0000","last_undegraded":"2024-09-21T07:37:56.672026+0000","last_fullsized":"2024-09-21T07:37:56.672026+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685780+0000","last_change":"2024-09-21T07:37:56.684391+0000","last_active":"2024-09-21T07:37:56.685780+0000","last_peered":"2024-09-21T07:37:56.685780+0000","last_clean":"2024-09-21T07:37:56.685780+0000","last_became_active":"2024-09-21T07:37:56.683444+0000","last_became_peered":"2024-09-21T07:37:56.683444+0000","last_unstale":"2024-09-21T07:37:56.685780+0000","last_undegraded":"2024-09-21T07:37:56.685780+0000","last_fullsized":"2024-09-21T07:37:56.685780+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:36.720328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673672+0000","last_change":"2024-09-21T07:37:56.673672+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673672+0000","last_undegraded":"2024-09-21T07:37:56.673672+0000","last_fullsized":"2024-09-21T07:37:56.673672+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689555+0000","last_change":"2024-09-21T07:37:56.684444+0000","last_active":"2024-09-21T07:37:56.689555+0000","last_peered":"2024-09-21T07:37:56.689555+0000","last_clean":"2024-09-21T07:37:56.689555+0000","last_became_active":"2024-09-21T07:37:56.684047+0000","last_became_peered":"2024-09-21T07:37:56.684047+0000","last_unstale":"2024-09-21T07:37:56.689555+0000","last_undegraded":"2024-09-21T07:37:56.689555+0000","last_fullsized":"2024-09-21T07:37:56.689555+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.271604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670968+0000","last_change":"2024-09-21T07:37:56.670968+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670968+0000","last_undegraded":"2024-09-21T07:37:56.670968+0000","last_fullsized":"2024-09-21T07:37:56.670968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709473+0000","last_change":"2024-09-21T07:37:56.690896+0000","last_active":"2024-09-21T07:37:57.709473+0000","last_peered":"2024-09-21T07:37:57.709473+0000","last_clean":"2024-09-21T07:37:57.709473+0000","last_became_active":"2024-09-21T07:37:56.690438+0000","last_became_peered":"2024-09-21T07:37:56.690438+0000","last_unstale":"2024-09-21T07:37:57.709473+0000","last_undegraded":"2024-09-21T07:37:57.709473+0000","last_fullsized":"2024-09-21T07:37:57.709473+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:33.918994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974013+0000","last_change":"2024-09-21T07:37:57.697180+0000","last_active":"2024-09-21T07:37:58.974013+0000","last_peered":"2024-09-21T07:37:58.974013+0000","last_clean":"2024-09-21T07:37:58.974013+0000","last_became_active":"2024-09-21T07:37:57.696336+0000","last_became_peered":"2024-09-21T07:37:57.696336+0000","last_unstale":"2024-09-21T07:37:58.974013+0000","last_undegraded":"2024-09-21T07:37:58.974013+0000","last_fullsized":"2024-09-21T07:37:58.974013+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:35.468489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.680242+0000","last_change":"2024-09-21T07:37:56.676884+0000","last_active":"2024-09-21T07:37:56.680242+0000","last_peered":"2024-09-21T07:37:56.680242+0000","last_clean":"2024-09-21T07:37:56.680242+0000","last_became_active":"2024-09-21T07:37:56.676336+0000","last_became_peered":"2024-09-21T07:37:56.676336+0000","last_unstale":"2024-09-21T07:37:56.680242+0000","last_undegraded":"2024-09-21T07:37:56.680242+0000","last_fullsized":"2024-09-21T07:37:56.680242+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:45.909754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705041+0000","last_change":"2024-09-21T07:37:57.693339+0000","last_active":"2024-09-21T07:37:57.705041+0000","last_peered":"2024-09-21T07:37:57.705041+0000","last_clean":"2024-09-21T07:37:57.705041+0000","last_became_active":"2024-09-21T07:37:57.692967+0000","last_became_peered":"2024-09-21T07:37:57.692967+0000","last_unstale":"2024-09-21T07:37:57.705041+0000","last_undegraded":"2024-09-21T07:37:57.705041+0000","last_fullsized":"2024-09-21T07:37:57.705041+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:27.706291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693751+0000","last_change":"2024-09-21T07:37:56.688339+0000","last_active":"2024-09-21T07:37:56.693751+0000","last_peered":"2024-09-21T07:37:56.693751+0000","last_clean":"2024-09-21T07:37:56.693751+0000","last_became_active":"2024-09-21T07:37:56.684821+0000","last_became_peered":"2024-09-21T07:37:56.684821+0000","last_unstale":"2024-09-21T07:37:56.693751+0000","last_undegraded":"2024-09-21T07:37:56.693751+0000","last_fullsized":"2024-09-21T07:37:56.693751+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:23.930006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667603+0000","last_change":"2024-09-21T07:37:56.667603+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667603+0000","last_undegraded":"2024-09-21T07:37:56.667603+0000","last_fullsized":"2024-09-21T07:37:56.667603+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694168+0000","last_change":"2024-09-21T07:37:56.693400+0000","last_active":"2024-09-21T07:37:56.694168+0000","last_peered":"2024-09-21T07:37:56.694168+0000","last_clean":"2024-09-21T07:37:56.694168+0000","last_became_active":"2024-09-21T07:37:56.692901+0000","last_became_peered":"2024-09-21T07:37:56.692901+0000","last_unstale":"2024-09-21T07:37:56.694168+0000","last_undegraded":"2024-09-21T07:37:56.694168+0000","last_fullsized":"2024-09-21T07:37:56.694168+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:48.154618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679129+0000","last_change":"2024-09-21T07:37:56.679129+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679129+0000","last_undegraded":"2024-09-21T07:37:56.679129+0000","last_fullsized":"2024-09-21T07:37:56.679129+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685783+0000","last_change":"2024-09-21T07:37:56.684291+0000","last_active":"2024-09-21T07:37:56.685783+0000","last_peered":"2024-09-21T07:37:56.685783+0000","last_clean":"2024-09-21T07:37:56.685783+0000","last_became_active":"2024-09-21T07:37:56.682331+0000","last_became_peered":"2024-09-21T07:37:56.682331+0000","last_unstale":"2024-09-21T07:37:56.685783+0000","last_undegraded":"2024-09-21T07:37:56.685783+0000","last_fullsized":"2024-09-21T07:37:56.685783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:28.263282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670983+0000","last_change":"2024-09-21T07:37:57.682491+0000","last_active":"2024-09-21T07:37:58.670983+0000","last_peered":"2024-09-21T07:37:58.670983+0000","last_clean":"2024-09-21T07:37:58.670983+0000","last_became_active":"2024-09-21T07:37:57.682202+0000","last_became_peered":"2024-09-21T07:37:57.682202+0000","last_unstale":"2024-09-21T07:37:58.670983+0000","last_undegraded":"2024-09-21T07:37:58.670983+0000","last_fullsized":"2024-09-21T07:37:58.670983+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:35.056943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683236+0000","last_change":"2024-09-21T07:37:56.680005+0000","last_active":"2024-09-21T07:37:56.683236+0000","last_peered":"2024-09-21T07:37:56.683236+0000","last_clean":"2024-09-21T07:37:56.683236+0000","last_became_active":"2024-09-21T07:37:56.679613+0000","last_became_peered":"2024-09-21T07:37:56.679613+0000","last_unstale":"2024-09-21T07:37:56.683236+0000","last_undegraded":"2024-09-21T07:37:56.683236+0000","last_fullsized":"2024-09-21T07:37:56.683236+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:42.362978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680361+0000","last_change":"2024-09-21T07:37:56.700326+0000","last_active":"2024-09-21T07:37:57.680361+0000","last_peered":"2024-09-21T07:37:57.680361+0000","last_clean":"2024-09-21T07:37:57.680361+0000","last_became_active":"2024-09-21T07:37:56.700049+0000","last_became_peered":"2024-09-21T07:37:56.700049+0000","last_unstale":"2024-09-21T07:37:57.680361+0000","last_undegraded":"2024-09-21T07:37:57.680361+0000","last_fullsized":"2024-09-21T07:37:57.680361+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:56.974818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674181+0000","last_change":"2024-09-21T07:37:56.674181+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674181+0000","last_undegraded":"2024-09-21T07:37:56.674181+0000","last_fullsized":"2024-09-21T07:37:56.674181+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683621+0000","last_change":"2024-09-21T07:37:56.680549+0000","last_active":"2024-09-21T07:37:56.683621+0000","last_peered":"2024-09-21T07:37:56.683621+0000","last_clean":"2024-09-21T07:37:56.683621+0000","last_became_active":"2024-09-21T07:37:56.680165+0000","last_became_peered":"2024-09-21T07:37:56.680165+0000","last_unstale":"2024-09-21T07:37:56.683621+0000","last_undegraded":"2024-09-21T07:37:56.683621+0000","last_fullsized":"2024-09-21T07:37:56.683621+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:26.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670495+0000","last_change":"2024-09-21T07:37:57.699500+0000","last_active":"2024-09-21T07:37:58.670495+0000","last_peered":"2024-09-21T07:37:58.670495+0000","last_clean":"2024-09-21T07:37:58.670495+0000","last_became_active":"2024-09-21T07:37:57.699196+0000","last_became_peered":"2024-09-21T07:37:57.699196+0000","last_unstale":"2024-09-21T07:37:58.670495+0000","last_undegraded":"2024-09-21T07:37:58.670495+0000","last_fullsized":"2024-09-21T07:37:58.670495+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:16.002562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689103+0000","last_change":"2024-09-21T07:37:56.688161+0000","last_active":"2024-09-21T07:37:56.689103+0000","last_peered":"2024-09-21T07:37:56.689103+0000","last_clean":"2024-09-21T07:37:56.689103+0000","last_became_active":"2024-09-21T07:37:56.687601+0000","last_became_peered":"2024-09-21T07:37:56.687601+0000","last_unstale":"2024-09-21T07:37:56.689103+0000","last_undegraded":"2024-09-21T07:37:56.689103+0000","last_fullsized":"2024-09-21T07:37:56.689103+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:50.744275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":471,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973649+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:37:58.973649+0000","last_peered":"2024-09-21T07:37:58.973649+0000","last_clean":"2024-09-21T07:37:58.973649+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:37:58.973649+0000","last_undegraded":"2024-09-21T07:37:58.973649+0000","last_fullsized":"2024-09-21T07:37:58.973649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509628,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509628,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47740,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324100,"statfs":{"total":96636764160,"available":96587878400,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509628,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47736,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324104,"statfs":{"total":96636764160,"available":96587882496,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56640,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315200,"statfs":{"total":96636764160,"available":96578764800,"internally_reserved":0,"allocated":3317760,"data_stored":1878902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56668,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315172,"statfs":{"total":96636764160,"available":96578736128,"internally_reserved":0,"allocated":3350528,"data_stored":1892885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87976,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283864,"statfs":{"total":96636764160,"available":96546676736,"internally_reserved":0,"allocated":2772992,"data_stored":1304643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:02.724 INFO:tasks.ceph.ceph_manager.ceph:PG 32.1e is not active+clean 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.678707+0000', 'last_change': '2024-09-21T07:37:56.678707+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.678707+0000', 'last_undegraded': '2024-09-21T07:37:56.678707+0000', 'last_fullsized': '2024-09-21T07:37:56.678707+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:PG 32.1b is not active+clean 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667034+0000', 'last_change': '2024-09-21T07:37:56.667034+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667034+0000', 'last_undegraded': '2024-09-21T07:37:56.667034+0000', 'last_fullsized': '2024-09-21T07:37:56.667034+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:PG 32.19 is not active+clean 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.666536+0000', 'last_change': '2024-09-21T07:37:56.666536+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.666536+0000', 'last_undegraded': '2024-09-21T07:37:56.666536+0000', 'last_fullsized': '2024-09-21T07:37:56.666536+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:PG 32.18 is not active+clean 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.666479+0000', 'last_change': '2024-09-21T07:37:56.666479+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.666479+0000', 'last_undegraded': '2024-09-21T07:37:56.666479+0000', 'last_fullsized': '2024-09-21T07:37:56.666479+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.725 INFO:tasks.ceph.ceph_manager.ceph:PG 32.13 is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672277+0000', 'last_change': '2024-09-21T07:37:56.672277+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672277+0000', 'last_undegraded': '2024-09-21T07:37:56.672277+0000', 'last_fullsized': '2024-09-21T07:37:56.672277+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:PG 32.12 is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.685438+0000', 'last_change': '2024-09-21T07:37:56.685438+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.685438+0000', 'last_undegraded': '2024-09-21T07:37:56.685438+0000', 'last_fullsized': '2024-09-21T07:37:56.685438+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:PG 32.f is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.673122+0000', 'last_change': '2024-09-21T07:37:56.673122+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.673122+0000', 'last_undegraded': '2024-09-21T07:37:56.673122+0000', 'last_fullsized': '2024-09-21T07:37:56.673122+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:PG 32.c is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672196+0000', 'last_change': '2024-09-21T07:37:56.672196+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672196+0000', 'last_undegraded': '2024-09-21T07:37:56.672196+0000', 'last_fullsized': '2024-09-21T07:37:56.672196+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:PG 32.b is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667178+0000', 'last_change': '2024-09-21T07:37:56.667178+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667178+0000', 'last_undegraded': '2024-09-21T07:37:56.667178+0000', 'last_fullsized': '2024-09-21T07:37:56.667178+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:PG 32.a is not active+clean 2024-09-21T07:38:02.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.673748+0000', 'last_change': '2024-09-21T07:37:56.673748+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.673748+0000', 'last_undegraded': '2024-09-21T07:37:56.673748+0000', 'last_fullsized': '2024-09-21T07:37:56.673748+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.8 is not active+clean 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.674813+0000', 'last_change': '2024-09-21T07:37:56.674813+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.674813+0000', 'last_undegraded': '2024-09-21T07:37:56.674813+0000', 'last_fullsized': '2024-09-21T07:37:56.674813+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.7 is not active+clean 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.674609+0000', 'last_change': '2024-09-21T07:37:56.674609+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.674609+0000', 'last_undegraded': '2024-09-21T07:37:56.674609+0000', 'last_fullsized': '2024-09-21T07:37:56.674609+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.6 is not active+clean 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.670498+0000', 'last_change': '2024-09-21T07:37:56.670498+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.670498+0000', 'last_undegraded': '2024-09-21T07:37:56.670498+0000', 'last_fullsized': '2024-09-21T07:37:56.670498+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.5 is not active+clean 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667488+0000', 'last_change': '2024-09-21T07:37:56.667488+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667488+0000', 'last_undegraded': '2024-09-21T07:37:56.667488+0000', 'last_fullsized': '2024-09-21T07:37:56.667488+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3 is not active+clean 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.678709+0000', 'last_change': '2024-09-21T07:37:56.678709+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.678709+0000', 'last_undegraded': '2024-09-21T07:37:56.678709+0000', 'last_fullsized': '2024-09-21T07:37:56.678709+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:02.727 INFO:tasks.ceph.ceph_manager.ceph:PG 32.2 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.679812+0000', 'last_change': '2024-09-21T07:37:56.679812+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.679812+0000', 'last_undegraded': '2024-09-21T07:37:56.679812+0000', 'last_fullsized': '2024-09-21T07:37:56.679812+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.1 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672068+0000', 'last_change': '2024-09-21T07:37:56.672068+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672068+0000', 'last_undegraded': '2024-09-21T07:37:56.672068+0000', 'last_fullsized': '2024-09-21T07:37:56.672068+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.20 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672601+0000', 'last_change': '2024-09-21T07:37:56.672601+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672601+0000', 'last_undegraded': '2024-09-21T07:37:56.672601+0000', 'last_fullsized': '2024-09-21T07:37:56.672601+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.24 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.678642+0000', 'last_change': '2024-09-21T07:37:56.678642+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.678642+0000', 'last_undegraded': '2024-09-21T07:37:56.678642+0000', 'last_fullsized': '2024-09-21T07:37:56.678642+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.25 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.668226+0000', 'last_change': '2024-09-21T07:37:56.668226+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.668226+0000', 'last_undegraded': '2024-09-21T07:37:56.668226+0000', 'last_fullsized': '2024-09-21T07:37:56.668226+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.27 is not active+clean 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667847+0000', 'last_change': '2024-09-21T07:37:56.667847+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667847+0000', 'last_undegraded': '2024-09-21T07:37:56.667847+0000', 'last_fullsized': '2024-09-21T07:37:56.667847+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.728 INFO:tasks.ceph.ceph_manager.ceph:PG 32.28 is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.666536+0000', 'last_change': '2024-09-21T07:37:56.666536+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.666536+0000', 'last_undegraded': '2024-09-21T07:37:56.666536+0000', 'last_fullsized': '2024-09-21T07:37:56.666536+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:PG 32.29 is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672823+0000', 'last_change': '2024-09-21T07:37:56.672823+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672823+0000', 'last_undegraded': '2024-09-21T07:37:56.672823+0000', 'last_fullsized': '2024-09-21T07:37:56.672823+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:PG 32.2b is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667707+0000', 'last_change': '2024-09-21T07:37:56.667707+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667707+0000', 'last_undegraded': '2024-09-21T07:37:56.667707+0000', 'last_fullsized': '2024-09-21T07:37:56.667707+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:PG 32.2c is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.677755+0000', 'last_change': '2024-09-21T07:37:56.677755+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.677755+0000', 'last_undegraded': '2024-09-21T07:37:56.677755+0000', 'last_fullsized': '2024-09-21T07:37:56.677755+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:PG 32.2d is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.668733+0000', 'last_change': '2024-09-21T07:37:56.668733+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.668733+0000', 'last_undegraded': '2024-09-21T07:37:56.668733+0000', 'last_fullsized': '2024-09-21T07:37:56.668733+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:PG 32.2f is not active+clean 2024-09-21T07:38:02.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.668334+0000', 'last_change': '2024-09-21T07:37:56.668334+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.668334+0000', 'last_undegraded': '2024-09-21T07:37:56.668334+0000', 'last_fullsized': '2024-09-21T07:37:56.668334+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:PG 32.30 is not active+clean 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667126+0000', 'last_change': '2024-09-21T07:37:56.667126+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667126+0000', 'last_undegraded': '2024-09-21T07:37:56.667126+0000', 'last_fullsized': '2024-09-21T07:37:56.667126+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:PG 32.31 is not active+clean 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.666907+0000', 'last_change': '2024-09-21T07:37:56.666907+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.666907+0000', 'last_undegraded': '2024-09-21T07:37:56.666907+0000', 'last_fullsized': '2024-09-21T07:37:56.666907+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:PG 32.32 is not active+clean 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.674896+0000', 'last_change': '2024-09-21T07:37:56.674896+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.674896+0000', 'last_undegraded': '2024-09-21T07:37:56.674896+0000', 'last_fullsized': '2024-09-21T07:37:56.674896+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:PG 32.35 is not active+clean 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672698+0000', 'last_change': '2024-09-21T07:37:56.672698+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672698+0000', 'last_undegraded': '2024-09-21T07:37:56.672698+0000', 'last_fullsized': '2024-09-21T07:37:56.672698+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:PG 32.36 is not active+clean 2024-09-21T07:38:02.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.672026+0000', 'last_change': '2024-09-21T07:37:56.672026+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.672026+0000', 'last_undegraded': '2024-09-21T07:37:56.672026+0000', 'last_fullsized': '2024-09-21T07:37:56.672026+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.37 is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.673672+0000', 'last_change': '2024-09-21T07:37:56.673672+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.673672+0000', 'last_undegraded': '2024-09-21T07:37:56.673672+0000', 'last_fullsized': '2024-09-21T07:37:56.673672+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.38 is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.670968+0000', 'last_change': '2024-09-21T07:37:56.670968+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.670968+0000', 'last_undegraded': '2024-09-21T07:37:56.670968+0000', 'last_fullsized': '2024-09-21T07:37:56.670968+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3b is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.667603+0000', 'last_change': '2024-09-21T07:37:56.667603+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.667603+0000', 'last_undegraded': '2024-09-21T07:37:56.667603+0000', 'last_fullsized': '2024-09-21T07:37:56.667603+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3c is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.679129+0000', 'last_change': '2024-09-21T07:37:56.679129+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.679129+0000', 'last_undegraded': '2024-09-21T07:37:56.679129+0000', 'last_fullsized': '2024-09-21T07:37:56.679129+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3e is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.677755+0000', 'last_change': '2024-09-21T07:37:56.677755+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.677755+0000', 'last_undegraded': '2024-09-21T07:37:56.677755+0000', 'last_fullsized': '2024-09-21T07:37:56.677755+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3f is not active+clean 2024-09-21T07:38:02.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 216, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:37:56.674181+0000', 'last_change': '2024-09-21T07:37:56.674181+0000', 'last_active': '2024-09-21T07:37:56.655609+0000', 'last_peered': '2024-09-21T07:37:56.655609+0000', 'last_clean': '2024-09-21T07:37:56.655609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:37:56.674181+0000', 'last_undegraded': '2024-09-21T07:37:56.674181+0000', 'last_fullsized': '2024-09-21T07:37:56.674181+0000', 'mapping_epoch': 216, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 216, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'last_clean_scrub_stamp': '2024-09-21T07:37:56.655609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:02.732 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:38:02.881 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:38:02.882+0000 7fb6d0600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 -- 172.21.15.64:0/185444432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80cf610 msgr2=0x7f30d80b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 --2- 172.21.15.64:0/185444432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80cf610 0x7f30d80b56e0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009840 tx=0x7f30c001c820 comp rx=0 tx=0).stop 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 -- 172.21.15.64:0/185444432 shutdown_connections 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 --2- 172.21.15.64:0/185444432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80cf610 0x7f30d80b56e0 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 -- 172.21.15.64:0/185444432 >> 172.21.15.64:0/185444432 conn(0x7f30d80d24f0 msgr2=0x7f30d80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 -- 172.21.15.64:0/185444432 shutdown_connections 2024-09-21T07:38:02.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.918+0000 7f30dcc00640 1 -- 172.21.15.64:0/185444432 wait complete. 2024-09-21T07:38:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 Processor -- start 2024-09-21T07:38:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 -- start start 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30d80b5c20 0x7f30d80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30d8159a40 0x7f30d80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30d816b2f0 con 0x7f30d80b3990 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30d816b170 con 0x7f30d8159a40 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30dcc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f30d816b470 con 0x7f30d80b5c20 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56010/0 (socket says 172.21.15.64:56010) 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.922+0000 7f30d5e00640 1 -- 172.21.15.64:0/1028593962 learned_addr learned my addr 172.21.15.64:0/1028593962 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30cd400640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30d80b5c20 0x7f30d80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d6800640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30d8159a40 0x7f30d80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 -- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30d80b5c20 msgr2=0x7f30d80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30d80b5c20 0x7f30d80b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 -- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30d8159a40 msgr2=0x7f30d80b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30d8159a40 0x7f30d80b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 -- 172.21.15.64:0/1028593962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d80c6920 con 0x7f30d80b3990 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30d5e00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c730 tx=0x7f30c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8003db0 con 0x7f30d80b3990 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30c800ce40 con 0x7f30d80b3990 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c80052d0 con 0x7f30d80b3990 2024-09-21T07:38:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d815a8d0 con 0x7f30d80b3990 2024-09-21T07:38:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d80c7390 con 0x7f30d80b3990 2024-09-21T07:38:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d80b56e0 con 0x7f30d80b3990 2024-09-21T07:38:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.926+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f30c8005530 con 0x7f30d80b3990 2024-09-21T07:38:02.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.930+0000 7f30cea00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 0x7f30b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:02.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.930+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f30c80940a0 con 0x7f30d80b3990 2024-09-21T07:38:02.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.930+0000 7f30cd400640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 0x7f30b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:02.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.930+0000 7f30cd400640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 0x7f30b4075710 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f30c00af000 tx=0x7f30c001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:02.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:02.934+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f30c805e8d0 con 0x7f30d80b3990 2024-09-21T07:38:03.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f30d80b6440 con 0x7f30d80b3990 2024-09-21T07:38:03.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30cea00640 1 -- 172.21.15.64:0/1028593962 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3084 (secure 0 0 0) 0x7f30c8063300 con 0x7f30d80b3990 2024-09-21T07:38:03.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:03.181 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":941,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":218,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":59},{"state_name":"creating+peering","count":38}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":592618,"bytes_used":480366592,"bytes_avail":772613746688,"bytes_total":773094113280,"inactive_pgs_ratio":0.39175257086753845,"write_bytes_sec":2047,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","id":15,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":15,"rank":0,"name":"c","status":"up:active","gid":11316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":34,"modified":"2024-09-21T07:37:45.670891+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 msgr2=0x7f30b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 0x7f30b4075710 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f30c00af000 tx=0x7f30c001b060 comp rx=0 tx=0).stop 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 msgr2=0x7f30d8158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c730 tx=0x7f30c800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 shutdown_connections 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f30b4073200 0x7f30b4075710 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30d8159a40 0x7f30d80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30d80b5c20 0x7f30d80b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 --2- 172.21.15.64:0/1028593962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30d80b3990 0x7f30d8158ef0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 >> 172.21.15.64:0/1028593962 conn(0x7f30d80d24f0 msgr2=0x7f30d80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 shutdown_connections 2024-09-21T07:38:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.182+0000 7f30dcc00640 1 -- 172.21.15.64:0/1028593962 wait complete. 2024-09-21T07:38:03.204 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:38:03.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- 172.21.15.64:0/3277196069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b3170 msgr2=0x7f19b80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 --2- 172.21.15.64:0/3277196069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b3170 0x7f19b80b3580 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009c80 tx=0x7f19b001cd60 comp rx=0 tx=0).stop 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- 172.21.15.64:0/3277196069 shutdown_connections 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 --2- 172.21.15.64:0/3277196069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b3170 0x7f19b80b3580 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 --2- 172.21.15.64:0/3277196069 >> v2:172.21.15.90:3300/0 conn(0x7f19b80b46f0 0x7f19b80b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 --2- 172.21.15.64:0/3277196069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- 172.21.15.64:0/3277196069 >> 172.21.15.64:0/3277196069 conn(0x7f19b806d570 msgr2=0x7f19b80b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- 172.21.15.64:0/3277196069 shutdown_connections 2024-09-21T07:38:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- 172.21.15.64:0/3277196069 wait complete. 2024-09-21T07:38:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 Processor -- start 2024-09-21T07:38:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.362+0000 7f19bf600640 1 -- start start 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b809acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 0x7f19b80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80cbc60 con 0x7f19b80b46f0 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80cbae0 con 0x7f19b80b3170 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f19b80cbde0 con 0x7f19b806fae0 2024-09-21T07:38:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56034/0 (socket says 172.21.15.64:56034) 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 -- 172.21.15.64:0/2464542742 learned_addr learned my addr 172.21.15.64:0/2464542742 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19b7e00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 0x7f19b80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bcc00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b809acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 -- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 msgr2=0x7f19b809acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b809acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 -- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 msgr2=0x7f19b80c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 0x7f19b80c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 -- 172.21.15.64:0/2464542742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b81f79f0 con 0x7f19b80b46f0 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19b7e00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 0x7f19b80c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bcc00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b809acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bd600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009bd0 tx=0x7f19b0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b00bb070 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19b0004b40 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b00b2040 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b81f7cd0 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b81f8a20 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.366+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b80b3580 con 0x7f19b80b46f0 2024-09-21T07:38:03.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.370+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19b0004000 con 0x7f19b80b46f0 2024-09-21T07:38:03.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.370+0000 7f19b4c00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 0x7f1998075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:03.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.370+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f19b012e580 con 0x7f19b80b46f0 2024-09-21T07:38:03.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.370+0000 7f19bcc00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 0x7f1998075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:03.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.370+0000 7f19bcc00640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 0x7f1998075710 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009b10 tx=0x7f19ac0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:03.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.374+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f19b00c4020 con 0x7f19b80b46f0 2024-09-21T07:38:03.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.546+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19b81f7780 con 0x7f1998073200 2024-09-21T07:38:03.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.550+0000 7f19b4c00640 1 -- 172.21.15.64:0/2464542742 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249311 (secure 0 0 0) 0x7f19b81f7780 con 0x7f1998073200 2024-09-21T07:38:03.554 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:03.555 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:03.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 msgr2=0x7f1998075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 0x7f1998075710 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009b10 tx=0x7f19ac0091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 msgr2=0x7f19b81f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009bd0 tx=0x7f19b0005b00 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 shutdown_connections 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1998073200 0x7f1998075710 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19b80b46f0 0x7f19b81f6ee0 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19b80b3170 0x7f19b80c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 --2- 172.21.15.64:0/2464542742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19b806fae0 0x7f19b809acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 >> 172.21.15.64:0/2464542742 conn(0x7f19b806d570 msgr2=0x7f19b815b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 shutdown_connections 2024-09-21T07:38:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:03.554+0000 7f19bf600640 1 -- 172.21.15.64:0/2464542742 wait complete. 2024-09-21T07:38:03.575 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":674,"stamp":"2024-09-21T07:38:01.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":119,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469108,"kb_used_data":22520,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754505612,"statfs":{"total":773094113280,"available":772613746688,"internally_reserved":0,"allocated":23060480,"data_stored":11519100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671244+0000","last_change":"2024-09-21T07:37:57.686919+0000","last_active":"2024-09-21T07:37:58.671244+0000","last_peered":"2024-09-21T07:37:58.671244+0000","last_clean":"2024-09-21T07:37:58.671244+0000","last_became_active":"2024-09-21T07:37:57.686610+0000","last_became_peered":"2024-09-21T07:37:57.686610+0000","last_unstale":"2024-09-21T07:37:58.671244+0000","last_undegraded":"2024-09-21T07:37:58.671244+0000","last_fullsized":"2024-09-21T07:37:58.671244+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.888561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678707+0000","last_change":"2024-09-21T07:37:56.678707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678707+0000","last_undegraded":"2024-09-21T07:37:56.678707+0000","last_fullsized":"2024-09-21T07:37:56.678707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.699880+0000","last_change":"2024-09-21T07:37:57.692560+0000","last_active":"2024-09-21T07:37:57.699880+0000","last_peered":"2024-09-21T07:37:57.699880+0000","last_clean":"2024-09-21T07:37:57.699880+0000","last_became_active":"2024-09-21T07:37:57.686329+0000","last_became_peered":"2024-09-21T07:37:57.686329+0000","last_unstale":"2024-09-21T07:37:57.699880+0000","last_undegraded":"2024-09-21T07:37:57.699880+0000","last_fullsized":"2024-09-21T07:37:57.699880+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:30.089335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.701001+0000","last_change":"2024-09-21T07:37:57.692825+0000","last_active":"2024-09-21T07:37:57.701001+0000","last_peered":"2024-09-21T07:37:57.701001+0000","last_clean":"2024-09-21T07:37:57.701001+0000","last_became_active":"2024-09-21T07:37:57.692506+0000","last_became_peered":"2024-09-21T07:37:57.692506+0000","last_unstale":"2024-09-21T07:37:57.701001+0000","last_undegraded":"2024-09-21T07:37:57.701001+0000","last_fullsized":"2024-09-21T07:37:57.701001+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:47.392925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667034+0000","last_change":"2024-09-21T07:37:56.667034+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667034+0000","last_undegraded":"2024-09-21T07:37:56.667034+0000","last_fullsized":"2024-09-21T07:37:56.667034+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670585+0000","last_change":"2024-09-21T07:37:57.690137+0000","last_active":"2024-09-21T07:37:58.670585+0000","last_peered":"2024-09-21T07:37:58.670585+0000","last_clean":"2024-09-21T07:37:58.670585+0000","last_became_active":"2024-09-21T07:37:57.689839+0000","last_became_peered":"2024-09-21T07:37:57.689839+0000","last_unstale":"2024-09-21T07:37:58.670585+0000","last_undegraded":"2024-09-21T07:37:58.670585+0000","last_fullsized":"2024-09-21T07:37:58.670585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.086074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666479+0000","last_change":"2024-09-21T07:37:56.666479+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666479+0000","last_undegraded":"2024-09-21T07:37:56.666479+0000","last_fullsized":"2024-09-21T07:37:56.666479+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671385+0000","last_change":"2024-09-21T07:37:57.689677+0000","last_active":"2024-09-21T07:37:58.671385+0000","last_peered":"2024-09-21T07:37:58.671385+0000","last_clean":"2024-09-21T07:37:58.671385+0000","last_became_active":"2024-09-21T07:37:57.689320+0000","last_became_peered":"2024-09-21T07:37:57.689320+0000","last_unstale":"2024-09-21T07:37:58.671385+0000","last_undegraded":"2024-09-21T07:37:58.671385+0000","last_fullsized":"2024-09-21T07:37:58.671385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.136328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705127+0000","last_change":"2024-09-21T07:37:57.694043+0000","last_active":"2024-09-21T07:37:57.705127+0000","last_peered":"2024-09-21T07:37:57.705127+0000","last_clean":"2024-09-21T07:37:57.705127+0000","last_became_active":"2024-09-21T07:37:57.693686+0000","last_became_peered":"2024-09-21T07:37:57.693686+0000","last_unstale":"2024-09-21T07:37:57.705127+0000","last_undegraded":"2024-09-21T07:37:57.705127+0000","last_fullsized":"2024-09-21T07:37:57.705127+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:19.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.707799+0000","last_change":"2024-09-21T07:37:57.696681+0000","last_active":"2024-09-21T07:37:57.707799+0000","last_peered":"2024-09-21T07:37:57.707799+0000","last_clean":"2024-09-21T07:37:57.707799+0000","last_became_active":"2024-09-21T07:37:57.696311+0000","last_became_peered":"2024-09-21T07:37:57.696311+0000","last_unstale":"2024-09-21T07:37:57.707799+0000","last_undegraded":"2024-09-21T07:37:57.707799+0000","last_fullsized":"2024-09-21T07:37:57.707799+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:29.232647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670912+0000","last_change":"2024-09-21T07:37:57.679345+0000","last_active":"2024-09-21T07:37:58.670912+0000","last_peered":"2024-09-21T07:37:58.670912+0000","last_clean":"2024-09-21T07:37:58.670912+0000","last_became_active":"2024-09-21T07:37:57.678467+0000","last_became_peered":"2024-09-21T07:37:57.678467+0000","last_unstale":"2024-09-21T07:37:58.670912+0000","last_undegraded":"2024-09-21T07:37:58.670912+0000","last_fullsized":"2024-09-21T07:37:58.670912+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:41.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672277+0000","last_change":"2024-09-21T07:37:56.672277+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672277+0000","last_undegraded":"2024-09-21T07:37:56.672277+0000","last_fullsized":"2024-09-21T07:37:56.672277+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.685438+0000","last_change":"2024-09-21T07:37:56.685438+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.685438+0000","last_undegraded":"2024-09-21T07:37:56.685438+0000","last_fullsized":"2024-09-21T07:37:56.685438+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973985+0000","last_change":"2024-09-21T07:37:57.682989+0000","last_active":"2024-09-21T07:37:58.973985+0000","last_peered":"2024-09-21T07:37:58.973985+0000","last_clean":"2024-09-21T07:37:58.973985+0000","last_became_active":"2024-09-21T07:37:57.682619+0000","last_became_peered":"2024-09-21T07:37:57.682619+0000","last_unstale":"2024-09-21T07:37:58.973985+0000","last_undegraded":"2024-09-21T07:37:58.973985+0000","last_fullsized":"2024-09-21T07:37:58.973985+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:32.009487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.708901+0000","last_change":"2024-09-21T07:37:57.705839+0000","last_active":"2024-09-21T07:37:57.708901+0000","last_peered":"2024-09-21T07:37:57.708901+0000","last_clean":"2024-09-21T07:37:57.708901+0000","last_became_active":"2024-09-21T07:37:57.705526+0000","last_became_peered":"2024-09-21T07:37:57.705526+0000","last_unstale":"2024-09-21T07:37:57.708901+0000","last_undegraded":"2024-09-21T07:37:57.708901+0000","last_fullsized":"2024-09-21T07:37:57.708901+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:28.397601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673122+0000","last_change":"2024-09-21T07:37:56.673122+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673122+0000","last_undegraded":"2024-09-21T07:37:56.673122+0000","last_fullsized":"2024-09-21T07:37:56.673122+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.698334+0000","last_change":"2024-09-21T07:37:57.688241+0000","last_active":"2024-09-21T07:37:57.698334+0000","last_peered":"2024-09-21T07:37:57.698334+0000","last_clean":"2024-09-21T07:37:57.698334+0000","last_became_active":"2024-09-21T07:37:57.687847+0000","last_became_peered":"2024-09-21T07:37:57.687847+0000","last_unstale":"2024-09-21T07:37:57.698334+0000","last_undegraded":"2024-09-21T07:37:57.698334+0000","last_fullsized":"2024-09-21T07:37:57.698334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:32.911732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974306+0000","last_change":"2024-09-21T07:37:57.683606+0000","last_active":"2024-09-21T07:37:58.974306+0000","last_peered":"2024-09-21T07:37:58.974306+0000","last_clean":"2024-09-21T07:37:58.974306+0000","last_became_active":"2024-09-21T07:37:57.683282+0000","last_became_peered":"2024-09-21T07:37:57.683282+0000","last_unstale":"2024-09-21T07:37:58.974306+0000","last_undegraded":"2024-09-21T07:37:58.974306+0000","last_fullsized":"2024-09-21T07:37:58.974306+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:56.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672196+0000","last_change":"2024-09-21T07:37:56.672196+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672196+0000","last_undegraded":"2024-09-21T07:37:56.672196+0000","last_fullsized":"2024-09-21T07:37:56.672196+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667178+0000","last_change":"2024-09-21T07:37:56.667178+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667178+0000","last_undegraded":"2024-09-21T07:37:56.667178+0000","last_fullsized":"2024-09-21T07:37:56.667178+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673748+0000","last_change":"2024-09-21T07:37:56.673748+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673748+0000","last_undegraded":"2024-09-21T07:37:56.673748+0000","last_fullsized":"2024-09-21T07:37:56.673748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974319+0000","last_change":"2024-09-21T07:37:57.703344+0000","last_active":"2024-09-21T07:37:58.974319+0000","last_peered":"2024-09-21T07:37:58.974319+0000","last_clean":"2024-09-21T07:37:58.974319+0000","last_became_active":"2024-09-21T07:37:57.702763+0000","last_became_peered":"2024-09-21T07:37:57.702763+0000","last_unstale":"2024-09-21T07:37:58.974319+0000","last_undegraded":"2024-09-21T07:37:58.974319+0000","last_fullsized":"2024-09-21T07:37:58.974319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:12.340315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674813+0000","last_change":"2024-09-21T07:37:56.674813+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674813+0000","last_undegraded":"2024-09-21T07:37:56.674813+0000","last_fullsized":"2024-09-21T07:37:56.674813+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674609+0000","last_change":"2024-09-21T07:37:56.674609+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674609+0000","last_undegraded":"2024-09-21T07:37:56.674609+0000","last_fullsized":"2024-09-21T07:37:56.674609+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670498+0000","last_change":"2024-09-21T07:37:56.670498+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670498+0000","last_undegraded":"2024-09-21T07:37:56.670498+0000","last_fullsized":"2024-09-21T07:37:56.670498+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667488+0000","last_change":"2024-09-21T07:37:56.667488+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667488+0000","last_undegraded":"2024-09-21T07:37:56.667488+0000","last_fullsized":"2024-09-21T07:37:56.667488+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670927+0000","last_change":"2024-09-21T07:37:57.689041+0000","last_active":"2024-09-21T07:37:58.670927+0000","last_peered":"2024-09-21T07:37:58.670927+0000","last_clean":"2024-09-21T07:37:58.670927+0000","last_became_active":"2024-09-21T07:37:57.688683+0000","last_became_peered":"2024-09-21T07:37:57.688683+0000","last_unstale":"2024-09-21T07:37:58.670927+0000","last_undegraded":"2024-09-21T07:37:58.670927+0000","last_fullsized":"2024-09-21T07:37:58.670927+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:08.217425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678709+0000","last_change":"2024-09-21T07:37:56.678709+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678709+0000","last_undegraded":"2024-09-21T07:37:56.678709+0000","last_fullsized":"2024-09-21T07:37:56.678709+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679812+0000","last_change":"2024-09-21T07:37:56.679812+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679812+0000","last_undegraded":"2024-09-21T07:37:56.679812+0000","last_fullsized":"2024-09-21T07:37:56.679812+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672068+0000","last_change":"2024-09-21T07:37:56.672068+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672068+0000","last_undegraded":"2024-09-21T07:37:56.672068+0000","last_fullsized":"2024-09-21T07:37:56.672068+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670510+0000","last_change":"2024-09-21T07:37:57.688877+0000","last_active":"2024-09-21T07:37:58.670510+0000","last_peered":"2024-09-21T07:37:58.670510+0000","last_clean":"2024-09-21T07:37:58.670510+0000","last_became_active":"2024-09-21T07:37:57.688564+0000","last_became_peered":"2024-09-21T07:37:57.688564+0000","last_unstale":"2024-09-21T07:37:58.670510+0000","last_undegraded":"2024-09-21T07:37:58.670510+0000","last_fullsized":"2024-09-21T07:37:58.670510+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:49.285747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672601+0000","last_change":"2024-09-21T07:37:56.672601+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672601+0000","last_undegraded":"2024-09-21T07:37:56.672601+0000","last_fullsized":"2024-09-21T07:37:56.672601+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"217'4","reported_seq":19,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671169+0000","last_change":"2024-09-21T07:37:56.681003+0000","last_active":"2024-09-21T07:37:58.671169+0000","last_peered":"2024-09-21T07:37:58.671169+0000","last_clean":"2024-09-21T07:37:58.671169+0000","last_became_active":"2024-09-21T07:37:56.680677+0000","last_became_peered":"2024-09-21T07:37:56.680677+0000","last_unstale":"2024-09-21T07:37:58.671169+0000","last_undegraded":"2024-09-21T07:37:58.671169+0000","last_fullsized":"2024-09-21T07:37:58.671169+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.630114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974033+0000","last_change":"2024-09-21T07:37:57.696302+0000","last_active":"2024-09-21T07:37:58.974033+0000","last_peered":"2024-09-21T07:37:58.974033+0000","last_clean":"2024-09-21T07:37:58.974033+0000","last_became_active":"2024-09-21T07:37:57.695957+0000","last_became_peered":"2024-09-21T07:37:57.695957+0000","last_unstale":"2024-09-21T07:37:58.974033+0000","last_undegraded":"2024-09-21T07:37:58.974033+0000","last_fullsized":"2024-09-21T07:37:58.974033+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:01.310825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685152+0000","last_change":"2024-09-21T07:37:56.682377+0000","last_active":"2024-09-21T07:37:56.685152+0000","last_peered":"2024-09-21T07:37:56.685152+0000","last_clean":"2024-09-21T07:37:56.685152+0000","last_became_active":"2024-09-21T07:37:56.682050+0000","last_became_peered":"2024-09-21T07:37:56.682050+0000","last_unstale":"2024-09-21T07:37:56.685152+0000","last_undegraded":"2024-09-21T07:37:56.685152+0000","last_fullsized":"2024-09-21T07:37:56.685152+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:20.420448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670800+0000","last_change":"2024-09-21T07:37:57.685402+0000","last_active":"2024-09-21T07:37:58.670800+0000","last_peered":"2024-09-21T07:37:58.670800+0000","last_clean":"2024-09-21T07:37:58.670800+0000","last_became_active":"2024-09-21T07:37:57.684889+0000","last_became_peered":"2024-09-21T07:37:57.684889+0000","last_unstale":"2024-09-21T07:37:58.670800+0000","last_undegraded":"2024-09-21T07:37:58.670800+0000","last_fullsized":"2024-09-21T07:37:58.670800+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.332634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693589+0000","last_change":"2024-09-21T07:37:56.689098+0000","last_active":"2024-09-21T07:37:56.693589+0000","last_peered":"2024-09-21T07:37:56.693589+0000","last_clean":"2024-09-21T07:37:56.693589+0000","last_became_active":"2024-09-21T07:37:56.684546+0000","last_became_peered":"2024-09-21T07:37:56.684546+0000","last_unstale":"2024-09-21T07:37:56.693589+0000","last_undegraded":"2024-09-21T07:37:56.693589+0000","last_fullsized":"2024-09-21T07:37:56.693589+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.173866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.678642+0000","last_change":"2024-09-21T07:37:56.678642+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.678642+0000","last_undegraded":"2024-09-21T07:37:56.678642+0000","last_fullsized":"2024-09-21T07:37:56.678642+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973906+0000","last_change":"2024-09-21T07:37:56.693584+0000","last_active":"2024-09-21T07:37:58.973906+0000","last_peered":"2024-09-21T07:37:58.973906+0000","last_clean":"2024-09-21T07:37:58.973906+0000","last_became_active":"2024-09-21T07:37:56.693288+0000","last_became_peered":"2024-09-21T07:37:56.693288+0000","last_unstale":"2024-09-21T07:37:58.973906+0000","last_undegraded":"2024-09-21T07:37:58.973906+0000","last_fullsized":"2024-09-21T07:37:58.973906+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:01.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668226+0000","last_change":"2024-09-21T07:37:56.668226+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668226+0000","last_undegraded":"2024-09-21T07:37:56.668226+0000","last_fullsized":"2024-09-21T07:37:56.668226+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694021+0000","last_change":"2024-09-21T07:37:56.689298+0000","last_active":"2024-09-21T07:37:56.694021+0000","last_peered":"2024-09-21T07:37:56.694021+0000","last_clean":"2024-09-21T07:37:56.694021+0000","last_became_active":"2024-09-21T07:37:56.688807+0000","last_became_peered":"2024-09-21T07:37:56.688807+0000","last_unstale":"2024-09-21T07:37:56.694021+0000","last_undegraded":"2024-09-21T07:37:56.694021+0000","last_fullsized":"2024-09-21T07:37:56.694021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:59.971298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705101+0000","last_change":"2024-09-21T07:37:57.693164+0000","last_active":"2024-09-21T07:37:57.705101+0000","last_peered":"2024-09-21T07:37:57.705101+0000","last_clean":"2024-09-21T07:37:57.705101+0000","last_became_active":"2024-09-21T07:37:57.692831+0000","last_became_peered":"2024-09-21T07:37:57.692831+0000","last_unstale":"2024-09-21T07:37:57.705101+0000","last_undegraded":"2024-09-21T07:37:57.705101+0000","last_fullsized":"2024-09-21T07:37:57.705101+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:07.215948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680120+0000","last_change":"2024-09-21T07:37:56.696904+0000","last_active":"2024-09-21T07:37:57.680120+0000","last_peered":"2024-09-21T07:37:57.680120+0000","last_clean":"2024-09-21T07:37:57.680120+0000","last_became_active":"2024-09-21T07:37:56.696373+0000","last_became_peered":"2024-09-21T07:37:56.696373+0000","last_unstale":"2024-09-21T07:37:57.680120+0000","last_undegraded":"2024-09-21T07:37:57.680120+0000","last_fullsized":"2024-09-21T07:37:57.680120+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:12.535237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667847+0000","last_change":"2024-09-21T07:37:56.667847+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667847+0000","last_undegraded":"2024-09-21T07:37:56.667847+0000","last_fullsized":"2024-09-21T07:37:56.667847+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670323+0000","last_change":"2024-09-21T07:37:56.681896+0000","last_active":"2024-09-21T07:37:58.670323+0000","last_peered":"2024-09-21T07:37:58.670323+0000","last_clean":"2024-09-21T07:37:58.670323+0000","last_became_active":"2024-09-21T07:37:56.681584+0000","last_became_peered":"2024-09-21T07:37:56.681584+0000","last_unstale":"2024-09-21T07:37:58.670323+0000","last_undegraded":"2024-09-21T07:37:58.670323+0000","last_fullsized":"2024-09-21T07:37:58.670323+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:24.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666536+0000","last_change":"2024-09-21T07:37:56.666536+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666536+0000","last_undegraded":"2024-09-21T07:37:56.666536+0000","last_fullsized":"2024-09-21T07:37:56.666536+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689761+0000","last_change":"2024-09-21T07:37:56.687358+0000","last_active":"2024-09-21T07:37:56.689761+0000","last_peered":"2024-09-21T07:37:56.689761+0000","last_clean":"2024-09-21T07:37:56.689761+0000","last_became_active":"2024-09-21T07:37:56.685812+0000","last_became_peered":"2024-09-21T07:37:56.685812+0000","last_unstale":"2024-09-21T07:37:56.689761+0000","last_undegraded":"2024-09-21T07:37:56.689761+0000","last_fullsized":"2024-09-21T07:37:56.689761+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:06.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672823+0000","last_change":"2024-09-21T07:37:56.672823+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672823+0000","last_undegraded":"2024-09-21T07:37:56.672823+0000","last_fullsized":"2024-09-21T07:37:56.672823+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.681430+0000","last_change":"2024-09-21T07:37:56.700571+0000","last_active":"2024-09-21T07:37:57.681430+0000","last_peered":"2024-09-21T07:37:57.681430+0000","last_clean":"2024-09-21T07:37:57.681430+0000","last_became_active":"2024-09-21T07:37:56.700152+0000","last_became_peered":"2024-09-21T07:37:56.700152+0000","last_unstale":"2024-09-21T07:37:57.681430+0000","last_undegraded":"2024-09-21T07:37:57.681430+0000","last_fullsized":"2024-09-21T07:37:57.681430+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:16.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705065+0000","last_change":"2024-09-21T07:37:57.694048+0000","last_active":"2024-09-21T07:37:57.705065+0000","last_peered":"2024-09-21T07:37:57.705065+0000","last_clean":"2024-09-21T07:37:57.705065+0000","last_became_active":"2024-09-21T07:37:57.693768+0000","last_became_peered":"2024-09-21T07:37:57.693768+0000","last_unstale":"2024-09-21T07:37:57.705065+0000","last_undegraded":"2024-09-21T07:37:57.705065+0000","last_fullsized":"2024-09-21T07:37:57.705065+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:09.584828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685220+0000","last_change":"2024-09-21T07:37:56.682914+0000","last_active":"2024-09-21T07:37:56.685220+0000","last_peered":"2024-09-21T07:37:56.685220+0000","last_clean":"2024-09-21T07:37:56.685220+0000","last_became_active":"2024-09-21T07:37:56.681968+0000","last_became_peered":"2024-09-21T07:37:56.681968+0000","last_unstale":"2024-09-21T07:37:56.685220+0000","last_undegraded":"2024-09-21T07:37:56.685220+0000","last_fullsized":"2024-09-21T07:37:56.685220+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:57.037229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667707+0000","last_change":"2024-09-21T07:37:56.667707+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667707+0000","last_undegraded":"2024-09-21T07:37:56.667707+0000","last_fullsized":"2024-09-21T07:37:56.667707+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"217'6","reported_seq":21,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671074+0000","last_change":"2024-09-21T07:37:56.681926+0000","last_active":"2024-09-21T07:37:58.671074+0000","last_peered":"2024-09-21T07:37:58.671074+0000","last_clean":"2024-09-21T07:37:58.671074+0000","last_became_active":"2024-09-21T07:37:56.681625+0000","last_became_peered":"2024-09-21T07:37:56.681625+0000","last_unstale":"2024-09-21T07:37:58.671074+0000","last_undegraded":"2024-09-21T07:37:58.671074+0000","last_fullsized":"2024-09-21T07:37:58.671074+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:04.257605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974068+0000","last_change":"2024-09-21T07:37:56.690462+0000","last_active":"2024-09-21T07:37:58.974068+0000","last_peered":"2024-09-21T07:37:58.974068+0000","last_clean":"2024-09-21T07:37:58.974068+0000","last_became_active":"2024-09-21T07:37:56.690094+0000","last_became_peered":"2024-09-21T07:37:56.690094+0000","last_unstale":"2024-09-21T07:37:58.974068+0000","last_undegraded":"2024-09-21T07:37:58.974068+0000","last_fullsized":"2024-09-21T07:37:58.974068+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:41.064369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668733+0000","last_change":"2024-09-21T07:37:56.668733+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668733+0000","last_undegraded":"2024-09-21T07:37:56.668733+0000","last_fullsized":"2024-09-21T07:37:56.668733+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.687335+0000","last_change":"2024-09-21T07:37:56.686422+0000","last_active":"2024-09-21T07:37:56.687335+0000","last_peered":"2024-09-21T07:37:56.687335+0000","last_clean":"2024-09-21T07:37:56.687335+0000","last_became_active":"2024-09-21T07:37:56.685790+0000","last_became_peered":"2024-09-21T07:37:56.685790+0000","last_unstale":"2024-09-21T07:37:56.687335+0000","last_undegraded":"2024-09-21T07:37:56.687335+0000","last_fullsized":"2024-09-21T07:37:56.687335+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:39.021255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974271+0000","last_change":"2024-09-21T07:37:57.696921+0000","last_active":"2024-09-21T07:37:58.974271+0000","last_peered":"2024-09-21T07:37:58.974271+0000","last_clean":"2024-09-21T07:37:58.974271+0000","last_became_active":"2024-09-21T07:37:57.695559+0000","last_became_peered":"2024-09-21T07:37:57.695559+0000","last_unstale":"2024-09-21T07:37:58.974271+0000","last_undegraded":"2024-09-21T07:37:58.974271+0000","last_fullsized":"2024-09-21T07:37:58.974271+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.675113+0000","last_change":"2024-09-21T07:37:56.671057+0000","last_active":"2024-09-21T07:37:56.675113+0000","last_peered":"2024-09-21T07:37:56.675113+0000","last_clean":"2024-09-21T07:37:56.675113+0000","last_became_active":"2024-09-21T07:37:56.670715+0000","last_became_peered":"2024-09-21T07:37:56.670715+0000","last_unstale":"2024-09-21T07:37:56.675113+0000","last_undegraded":"2024-09-21T07:37:56.675113+0000","last_fullsized":"2024-09-21T07:37:56.675113+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:51.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.668334+0000","last_change":"2024-09-21T07:37:56.668334+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.668334+0000","last_undegraded":"2024-09-21T07:37:56.668334+0000","last_fullsized":"2024-09-21T07:37:56.668334+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.692726+0000","last_change":"2024-09-21T07:37:56.691680+0000","last_active":"2024-09-21T07:37:56.692726+0000","last_peered":"2024-09-21T07:37:56.692726+0000","last_clean":"2024-09-21T07:37:56.692726+0000","last_became_active":"2024-09-21T07:37:56.691374+0000","last_became_peered":"2024-09-21T07:37:56.691374+0000","last_unstale":"2024-09-21T07:37:56.692726+0000","last_undegraded":"2024-09-21T07:37:56.692726+0000","last_fullsized":"2024-09-21T07:37:56.692726+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:14.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667126+0000","last_change":"2024-09-21T07:37:56.667126+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667126+0000","last_undegraded":"2024-09-21T07:37:56.667126+0000","last_fullsized":"2024-09-21T07:37:56.667126+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671365+0000","last_change":"2024-09-21T07:37:56.674146+0000","last_active":"2024-09-21T07:37:58.671365+0000","last_peered":"2024-09-21T07:37:58.671365+0000","last_clean":"2024-09-21T07:37:58.671365+0000","last_became_active":"2024-09-21T07:37:56.673828+0000","last_became_peered":"2024-09-21T07:37:56.673828+0000","last_unstale":"2024-09-21T07:37:58.671365+0000","last_undegraded":"2024-09-21T07:37:58.671365+0000","last_fullsized":"2024-09-21T07:37:58.671365+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:27.388800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.666907+0000","last_change":"2024-09-21T07:37:56.666907+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.666907+0000","last_undegraded":"2024-09-21T07:37:56.666907+0000","last_fullsized":"2024-09-21T07:37:56.666907+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.691734+0000","last_change":"2024-09-21T07:37:56.688513+0000","last_active":"2024-09-21T07:37:56.691734+0000","last_peered":"2024-09-21T07:37:56.691734+0000","last_clean":"2024-09-21T07:37:56.691734+0000","last_became_active":"2024-09-21T07:37:56.688218+0000","last_became_peered":"2024-09-21T07:37:56.688218+0000","last_unstale":"2024-09-21T07:37:56.691734+0000","last_undegraded":"2024-09-21T07:37:56.691734+0000","last_fullsized":"2024-09-21T07:37:56.691734+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:39.083364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674896+0000","last_change":"2024-09-21T07:37:56.674896+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674896+0000","last_undegraded":"2024-09-21T07:37:56.674896+0000","last_fullsized":"2024-09-21T07:37:56.674896+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685173+0000","last_change":"2024-09-21T07:37:56.682770+0000","last_active":"2024-09-21T07:37:56.685173+0000","last_peered":"2024-09-21T07:37:56.685173+0000","last_clean":"2024-09-21T07:37:56.685173+0000","last_became_active":"2024-09-21T07:37:56.682396+0000","last_became_peered":"2024-09-21T07:37:56.682396+0000","last_unstale":"2024-09-21T07:37:56.685173+0000","last_undegraded":"2024-09-21T07:37:56.685173+0000","last_fullsized":"2024-09-21T07:37:56.685173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:43.770342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709364+0000","last_change":"2024-09-21T07:37:57.695029+0000","last_active":"2024-09-21T07:37:57.709364+0000","last_peered":"2024-09-21T07:37:57.709364+0000","last_clean":"2024-09-21T07:37:57.709364+0000","last_became_active":"2024-09-21T07:37:57.694668+0000","last_became_peered":"2024-09-21T07:37:57.694668+0000","last_unstale":"2024-09-21T07:37:57.709364+0000","last_undegraded":"2024-09-21T07:37:57.709364+0000","last_fullsized":"2024-09-21T07:37:57.709364+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:48.536815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974095+0000","last_change":"2024-09-21T07:37:56.687413+0000","last_active":"2024-09-21T07:37:58.974095+0000","last_peered":"2024-09-21T07:37:58.974095+0000","last_clean":"2024-09-21T07:37:58.974095+0000","last_became_active":"2024-09-21T07:37:56.686855+0000","last_became_peered":"2024-09-21T07:37:56.686855+0000","last_unstale":"2024-09-21T07:37:58.974095+0000","last_undegraded":"2024-09-21T07:37:58.974095+0000","last_fullsized":"2024-09-21T07:37:58.974095+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:17.302940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.704995+0000","last_change":"2024-09-21T07:37:57.696258+0000","last_active":"2024-09-21T07:37:57.704995+0000","last_peered":"2024-09-21T07:37:57.704995+0000","last_clean":"2024-09-21T07:37:57.704995+0000","last_became_active":"2024-09-21T07:37:57.695921+0000","last_became_peered":"2024-09-21T07:37:57.695921+0000","last_unstale":"2024-09-21T07:37:57.704995+0000","last_undegraded":"2024-09-21T07:37:57.704995+0000","last_fullsized":"2024-09-21T07:37:57.704995+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:16.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709496+0000","last_change":"2024-09-21T07:37:56.695731+0000","last_active":"2024-09-21T07:37:57.709496+0000","last_peered":"2024-09-21T07:37:57.709496+0000","last_clean":"2024-09-21T07:37:57.709496+0000","last_became_active":"2024-09-21T07:37:56.695425+0000","last_became_peered":"2024-09-21T07:37:56.695425+0000","last_unstale":"2024-09-21T07:37:57.709496+0000","last_undegraded":"2024-09-21T07:37:57.709496+0000","last_fullsized":"2024-09-21T07:37:57.709496+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:33.472252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672698+0000","last_change":"2024-09-21T07:37:56.672698+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672698+0000","last_undegraded":"2024-09-21T07:37:56.672698+0000","last_fullsized":"2024-09-21T07:37:56.672698+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685695+0000","last_change":"2024-09-21T07:37:56.683690+0000","last_active":"2024-09-21T07:37:56.685695+0000","last_peered":"2024-09-21T07:37:56.685695+0000","last_clean":"2024-09-21T07:37:56.685695+0000","last_became_active":"2024-09-21T07:37:56.682542+0000","last_became_peered":"2024-09-21T07:37:56.682542+0000","last_unstale":"2024-09-21T07:37:56.685695+0000","last_undegraded":"2024-09-21T07:37:56.685695+0000","last_fullsized":"2024-09-21T07:37:56.685695+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:40.118009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.672026+0000","last_change":"2024-09-21T07:37:56.672026+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.672026+0000","last_undegraded":"2024-09-21T07:37:56.672026+0000","last_fullsized":"2024-09-21T07:37:56.672026+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685780+0000","last_change":"2024-09-21T07:37:56.684391+0000","last_active":"2024-09-21T07:37:56.685780+0000","last_peered":"2024-09-21T07:37:56.685780+0000","last_clean":"2024-09-21T07:37:56.685780+0000","last_became_active":"2024-09-21T07:37:56.683444+0000","last_became_peered":"2024-09-21T07:37:56.683444+0000","last_unstale":"2024-09-21T07:37:56.685780+0000","last_undegraded":"2024-09-21T07:37:56.685780+0000","last_fullsized":"2024-09-21T07:37:56.685780+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:36.720328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.673672+0000","last_change":"2024-09-21T07:37:56.673672+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.673672+0000","last_undegraded":"2024-09-21T07:37:56.673672+0000","last_fullsized":"2024-09-21T07:37:56.673672+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689555+0000","last_change":"2024-09-21T07:37:56.684444+0000","last_active":"2024-09-21T07:37:56.689555+0000","last_peered":"2024-09-21T07:37:56.689555+0000","last_clean":"2024-09-21T07:37:56.689555+0000","last_became_active":"2024-09-21T07:37:56.684047+0000","last_became_peered":"2024-09-21T07:37:56.684047+0000","last_unstale":"2024-09-21T07:37:56.689555+0000","last_undegraded":"2024-09-21T07:37:56.689555+0000","last_fullsized":"2024-09-21T07:37:56.689555+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.271604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.670968+0000","last_change":"2024-09-21T07:37:56.670968+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.670968+0000","last_undegraded":"2024-09-21T07:37:56.670968+0000","last_fullsized":"2024-09-21T07:37:56.670968+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"217'2","reported_seq":15,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.709473+0000","last_change":"2024-09-21T07:37:56.690896+0000","last_active":"2024-09-21T07:37:57.709473+0000","last_peered":"2024-09-21T07:37:57.709473+0000","last_clean":"2024-09-21T07:37:57.709473+0000","last_became_active":"2024-09-21T07:37:56.690438+0000","last_became_peered":"2024-09-21T07:37:56.690438+0000","last_unstale":"2024-09-21T07:37:57.709473+0000","last_undegraded":"2024-09-21T07:37:57.709473+0000","last_fullsized":"2024-09-21T07:37:57.709473+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:33.918994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974013+0000","last_change":"2024-09-21T07:37:57.697180+0000","last_active":"2024-09-21T07:37:58.974013+0000","last_peered":"2024-09-21T07:37:58.974013+0000","last_clean":"2024-09-21T07:37:58.974013+0000","last_became_active":"2024-09-21T07:37:57.696336+0000","last_became_peered":"2024-09-21T07:37:57.696336+0000","last_unstale":"2024-09-21T07:37:58.974013+0000","last_undegraded":"2024-09-21T07:37:58.974013+0000","last_fullsized":"2024-09-21T07:37:58.974013+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:35.468489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.680242+0000","last_change":"2024-09-21T07:37:56.676884+0000","last_active":"2024-09-21T07:37:56.680242+0000","last_peered":"2024-09-21T07:37:56.680242+0000","last_clean":"2024-09-21T07:37:56.680242+0000","last_became_active":"2024-09-21T07:37:56.676336+0000","last_became_peered":"2024-09-21T07:37:56.676336+0000","last_unstale":"2024-09-21T07:37:56.680242+0000","last_undegraded":"2024-09-21T07:37:56.680242+0000","last_fullsized":"2024-09-21T07:37:56.680242+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:45.909754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.705041+0000","last_change":"2024-09-21T07:37:57.693339+0000","last_active":"2024-09-21T07:37:57.705041+0000","last_peered":"2024-09-21T07:37:57.705041+0000","last_clean":"2024-09-21T07:37:57.705041+0000","last_became_active":"2024-09-21T07:37:57.692967+0000","last_became_peered":"2024-09-21T07:37:57.692967+0000","last_unstale":"2024-09-21T07:37:57.705041+0000","last_undegraded":"2024-09-21T07:37:57.705041+0000","last_fullsized":"2024-09-21T07:37:57.705041+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:27.706291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.693751+0000","last_change":"2024-09-21T07:37:56.688339+0000","last_active":"2024-09-21T07:37:56.693751+0000","last_peered":"2024-09-21T07:37:56.693751+0000","last_clean":"2024-09-21T07:37:56.693751+0000","last_became_active":"2024-09-21T07:37:56.684821+0000","last_became_peered":"2024-09-21T07:37:56.684821+0000","last_unstale":"2024-09-21T07:37:56.693751+0000","last_undegraded":"2024-09-21T07:37:56.693751+0000","last_fullsized":"2024-09-21T07:37:56.693751+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:23.930006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.667603+0000","last_change":"2024-09-21T07:37:56.667603+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.667603+0000","last_undegraded":"2024-09-21T07:37:56.667603+0000","last_fullsized":"2024-09-21T07:37:56.667603+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.694168+0000","last_change":"2024-09-21T07:37:56.693400+0000","last_active":"2024-09-21T07:37:56.694168+0000","last_peered":"2024-09-21T07:37:56.694168+0000","last_clean":"2024-09-21T07:37:56.694168+0000","last_became_active":"2024-09-21T07:37:56.692901+0000","last_became_peered":"2024-09-21T07:37:56.692901+0000","last_unstale":"2024-09-21T07:37:56.694168+0000","last_undegraded":"2024-09-21T07:37:56.694168+0000","last_fullsized":"2024-09-21T07:37:56.694168+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:48.154618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.679129+0000","last_change":"2024-09-21T07:37:56.679129+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.679129+0000","last_undegraded":"2024-09-21T07:37:56.679129+0000","last_fullsized":"2024-09-21T07:37:56.679129+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.685783+0000","last_change":"2024-09-21T07:37:56.684291+0000","last_active":"2024-09-21T07:37:56.685783+0000","last_peered":"2024-09-21T07:37:56.685783+0000","last_clean":"2024-09-21T07:37:56.685783+0000","last_became_active":"2024-09-21T07:37:56.682331+0000","last_became_peered":"2024-09-21T07:37:56.682331+0000","last_unstale":"2024-09-21T07:37:56.685783+0000","last_undegraded":"2024-09-21T07:37:56.685783+0000","last_fullsized":"2024-09-21T07:37:56.685783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:28.263282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670983+0000","last_change":"2024-09-21T07:37:57.682491+0000","last_active":"2024-09-21T07:37:58.670983+0000","last_peered":"2024-09-21T07:37:58.670983+0000","last_clean":"2024-09-21T07:37:58.670983+0000","last_became_active":"2024-09-21T07:37:57.682202+0000","last_became_peered":"2024-09-21T07:37:57.682202+0000","last_unstale":"2024-09-21T07:37:58.670983+0000","last_undegraded":"2024-09-21T07:37:58.670983+0000","last_fullsized":"2024-09-21T07:37:58.670983+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:35.056943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683236+0000","last_change":"2024-09-21T07:37:56.680005+0000","last_active":"2024-09-21T07:37:56.683236+0000","last_peered":"2024-09-21T07:37:56.683236+0000","last_clean":"2024-09-21T07:37:56.683236+0000","last_became_active":"2024-09-21T07:37:56.679613+0000","last_became_peered":"2024-09-21T07:37:56.679613+0000","last_unstale":"2024-09-21T07:37:56.683236+0000","last_undegraded":"2024-09-21T07:37:56.683236+0000","last_fullsized":"2024-09-21T07:37:56.683236+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:42.362978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.677755+0000","last_change":"2024-09-21T07:37:56.677755+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.677755+0000","last_undegraded":"2024-09-21T07:37:56.677755+0000","last_fullsized":"2024-09-21T07:37:56.677755+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-09-21T07:37:57.680361+0000","last_change":"2024-09-21T07:37:56.700326+0000","last_active":"2024-09-21T07:37:57.680361+0000","last_peered":"2024-09-21T07:37:57.680361+0000","last_clean":"2024-09-21T07:37:57.680361+0000","last_became_active":"2024-09-21T07:37:56.700049+0000","last_became_peered":"2024-09-21T07:37:56.700049+0000","last_unstale":"2024-09-21T07:37:57.680361+0000","last_undegraded":"2024-09-21T07:37:57.680361+0000","last_fullsized":"2024-09-21T07:37:57.680361+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:56.974818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":1,"reported_epoch":216,"state":"creating+peering","last_fresh":"2024-09-21T07:37:56.674181+0000","last_change":"2024-09-21T07:37:56.674181+0000","last_active":"2024-09-21T07:37:56.655609+0000","last_peered":"2024-09-21T07:37:56.655609+0000","last_clean":"2024-09-21T07:37:56.655609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:37:56.674181+0000","last_undegraded":"2024-09-21T07:37:56.674181+0000","last_fullsized":"2024-09-21T07:37:56.674181+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.683621+0000","last_change":"2024-09-21T07:37:56.680549+0000","last_active":"2024-09-21T07:37:56.683621+0000","last_peered":"2024-09-21T07:37:56.683621+0000","last_clean":"2024-09-21T07:37:56.683621+0000","last_became_active":"2024-09-21T07:37:56.680165+0000","last_became_peered":"2024-09-21T07:37:56.680165+0000","last_unstale":"2024-09-21T07:37:56.683621+0000","last_undegraded":"2024-09-21T07:37:56.683621+0000","last_fullsized":"2024-09-21T07:37:56.683621+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:26.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670495+0000","last_change":"2024-09-21T07:37:57.699500+0000","last_active":"2024-09-21T07:37:58.670495+0000","last_peered":"2024-09-21T07:37:58.670495+0000","last_clean":"2024-09-21T07:37:58.670495+0000","last_became_active":"2024-09-21T07:37:57.699196+0000","last_became_peered":"2024-09-21T07:37:57.699196+0000","last_unstale":"2024-09-21T07:37:58.670495+0000","last_undegraded":"2024-09-21T07:37:58.670495+0000","last_fullsized":"2024-09-21T07:37:58.670495+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:16.002562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":10,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-09-21T07:37:56.689103+0000","last_change":"2024-09-21T07:37:56.688161+0000","last_active":"2024-09-21T07:37:56.689103+0000","last_peered":"2024-09-21T07:37:56.689103+0000","last_clean":"2024-09-21T07:37:56.689103+0000","last_became_active":"2024-09-21T07:37:56.687601+0000","last_became_peered":"2024-09-21T07:37:56.687601+0000","last_unstale":"2024-09-21T07:37:56.689103+0000","last_undegraded":"2024-09-21T07:37:56.689103+0000","last_fullsized":"2024-09-21T07:37:56.689103+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:50.744275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":471,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973649+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:37:58.973649+0000","last_peered":"2024-09-21T07:37:58.973649+0000","last_clean":"2024-09-21T07:37:58.973649+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:37:58.973649+0000","last_undegraded":"2024-09-21T07:37:58.973649+0000","last_fullsized":"2024-09-21T07:37:58.973649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509628,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56060,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315780,"statfs":{"total":96636764160,"available":96579358720,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509628,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47740,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324100,"statfs":{"total":96636764160,"available":96587878400,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509628,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47736,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324104,"statfs":{"total":96636764160,"available":96587882496,"internally_reserved":0,"allocated":2723840,"data_stored":1288534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56640,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315200,"statfs":{"total":96636764160,"available":96578764800,"internally_reserved":0,"allocated":3317760,"data_stored":1878902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56668,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315172,"statfs":{"total":96636764160,"available":96578736128,"internally_reserved":0,"allocated":3350528,"data_stored":1892885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87976,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283864,"statfs":{"total":96636764160,"available":96546676736,"internally_reserved":0,"allocated":2772992,"data_stored":1304643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:06.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- 172.21.15.64:0/3627962461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00b28e0 msgr2=0x7f2be015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 --2- 172.21.15.64:0/3627962461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00b28e0 0x7f2be015c6f0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009c80 tx=0x7f2bd001cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- 172.21.15.64:0/3627962461 shutdown_connections 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 --2- 172.21.15.64:0/3627962461 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00cd440 0x7f2be00b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 --2- 172.21.15.64:0/3627962461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00b28e0 0x7f2be015c6f0 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- 172.21.15.64:0/3627962461 >> 172.21.15.64:0/3627962461 conn(0x7f2be006d570 msgr2=0x7f2be00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- 172.21.15.64:0/3627962461 shutdown_connections 2024-09-21T07:38:06.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- 172.21.15.64:0/3627962461 wait complete. 2024-09-21T07:38:06.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 Processor -- start 2024-09-21T07:38:06.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.754+0000 7f2be4c00640 1 -- start start 2024-09-21T07:38:06.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 0x7f2be0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:06.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00b3170 0x7f2be0099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:06.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0169f30 con 0x7f2be00cbba0 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0169db0 con 0x7f2be00b3170 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2be016a0b0 con 0x7f2be00b28e0 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48946/0 (socket says 172.21.15.64:48946) 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 -- 172.21.15.64:0/1978499957 learned_addr learned my addr 172.21.15.64:0/1978499957 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bdde00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 0x7f2be0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bd5400640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00b3170 0x7f2be0099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 -- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 msgr2=0x7f2be0155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 0x7f2be0155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 -- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00b3170 msgr2=0x7f2be0099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:06.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00b3170 0x7f2be0099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 -- 172.21.15.64:0/1978499957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be009ad90 con 0x7f2be00cbba0 2024-09-21T07:38:06.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bdde00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 0x7f2be0155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:38:06.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bde800640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e770 tx=0x7f2bd800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800cc60 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd800ce00 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8005280 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be009d570 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be00b2030 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.758+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be009b270 con 0x7f2be00cbba0 2024-09-21T07:38:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.762+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2bd8005420 con 0x7f2be00cbba0 2024-09-21T07:38:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.762+0000 7f2bd6a00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 0x7f2bbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.762+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2bd8094c00 con 0x7f2be00cbba0 2024-09-21T07:38:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.762+0000 7f2bdde00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 0x7f2bbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.762+0000 7f2bdde00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 0x7f2bbc075710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00af000 tx=0x7f2bd001b5e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:06.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.766+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2be009b270 con 0x7f2be00cbba0 2024-09-21T07:38:06.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.938+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2be01560a0 con 0x7f2bbc073200 2024-09-21T07:38:06.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2bd6a00640 1 -- 172.21.15.64:0/1978499957 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252467 (secure 0 0 0) 0x7f2be01560a0 con 0x7f2bbc073200 2024-09-21T07:38:06.947 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:06.948 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 msgr2=0x7f2bbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 0x7f2bbc075710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00af000 tx=0x7f2bd001b5e0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 msgr2=0x7f2be00b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e770 tx=0x7f2bd800ec30 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 shutdown_connections 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2bbc073200 0x7f2bbc075710 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2be00cbba0 0x7f2be00b1560 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00b3170 0x7f2be0099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 --2- 172.21.15.64:0/1978499957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b28e0 0x7f2be0155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 >> 172.21.15.64:0/1978499957 conn(0x7f2be006d570 msgr2=0x7f2be01595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 shutdown_connections 2024-09-21T07:38:06.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:06.946+0000 7f2be4c00640 1 -- 172.21.15.64:0/1978499957 wait complete. 2024-09-21T07:38:06.968 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":676,"stamp":"2024-09-21T07:38:05.675927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469268,"kb_used_data":22696,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754505452,"statfs":{"total":773094113280,"available":772613582848,"internally_reserved":0,"allocated":23240704,"data_stored":11604700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.010150"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671244+0000","last_change":"2024-09-21T07:37:57.686919+0000","last_active":"2024-09-21T07:37:58.671244+0000","last_peered":"2024-09-21T07:37:58.671244+0000","last_clean":"2024-09-21T07:37:58.671244+0000","last_became_active":"2024-09-21T07:37:57.686610+0000","last_became_peered":"2024-09-21T07:37:57.686610+0000","last_unstale":"2024-09-21T07:37:58.671244+0000","last_undegraded":"2024-09-21T07:37:58.671244+0000","last_fullsized":"2024-09-21T07:37:58.671244+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:24.888561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976787+0000","last_change":"2024-09-21T07:37:57.689549+0000","last_active":"2024-09-21T07:37:58.976787+0000","last_peered":"2024-09-21T07:37:58.976787+0000","last_clean":"2024-09-21T07:37:58.976787+0000","last_became_active":"2024-09-21T07:37:57.688876+0000","last_became_peered":"2024-09-21T07:37:57.688876+0000","last_unstale":"2024-09-21T07:37:58.976787+0000","last_undegraded":"2024-09-21T07:37:58.976787+0000","last_fullsized":"2024-09-21T07:37:58.976787+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:15.223636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975522+0000","last_change":"2024-09-21T07:37:57.692560+0000","last_active":"2024-09-21T07:37:58.975522+0000","last_peered":"2024-09-21T07:37:58.975522+0000","last_clean":"2024-09-21T07:37:58.975522+0000","last_became_active":"2024-09-21T07:37:57.686329+0000","last_became_peered":"2024-09-21T07:37:57.686329+0000","last_unstale":"2024-09-21T07:37:58.975522+0000","last_undegraded":"2024-09-21T07:37:58.975522+0000","last_fullsized":"2024-09-21T07:37:58.975522+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:22.339547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975665+0000","last_change":"2024-09-21T07:37:57.692825+0000","last_active":"2024-09-21T07:37:58.975665+0000","last_peered":"2024-09-21T07:37:58.975665+0000","last_clean":"2024-09-21T07:37:58.975665+0000","last_became_active":"2024-09-21T07:37:57.692506+0000","last_became_peered":"2024-09-21T07:37:57.692506+0000","last_unstale":"2024-09-21T07:37:58.975665+0000","last_undegraded":"2024-09-21T07:37:58.975665+0000","last_fullsized":"2024-09-21T07:37:58.975665+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:00.650281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672360+0000","last_change":"2024-09-21T07:37:57.685920+0000","last_active":"2024-09-21T07:37:58.672360+0000","last_peered":"2024-09-21T07:37:58.672360+0000","last_clean":"2024-09-21T07:37:58.672360+0000","last_became_active":"2024-09-21T07:37:57.685585+0000","last_became_peered":"2024-09-21T07:37:57.685585+0000","last_unstale":"2024-09-21T07:37:58.672360+0000","last_undegraded":"2024-09-21T07:37:58.672360+0000","last_fullsized":"2024-09-21T07:37:58.672360+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:53.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670585+0000","last_change":"2024-09-21T07:37:57.690137+0000","last_active":"2024-09-21T07:37:58.670585+0000","last_peered":"2024-09-21T07:37:58.670585+0000","last_clean":"2024-09-21T07:37:58.670585+0000","last_became_active":"2024-09-21T07:37:57.689839+0000","last_became_peered":"2024-09-21T07:37:57.689839+0000","last_unstale":"2024-09-21T07:37:58.670585+0000","last_undegraded":"2024-09-21T07:37:58.670585+0000","last_fullsized":"2024-09-21T07:37:58.670585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.086074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851295+0000","last_change":"2024-09-21T07:37:57.698031+0000","last_active":"2024-09-21T07:37:58.851295+0000","last_peered":"2024-09-21T07:37:58.851295+0000","last_clean":"2024-09-21T07:37:58.851295+0000","last_became_active":"2024-09-21T07:37:57.694640+0000","last_became_peered":"2024-09-21T07:37:57.694640+0000","last_unstale":"2024-09-21T07:37:58.851295+0000","last_undegraded":"2024-09-21T07:37:58.851295+0000","last_fullsized":"2024-09-21T07:37:58.851295+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:54.274156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672231+0000","last_change":"2024-09-21T07:37:57.688257+0000","last_active":"2024-09-21T07:37:58.672231+0000","last_peered":"2024-09-21T07:37:58.672231+0000","last_clean":"2024-09-21T07:37:58.672231+0000","last_became_active":"2024-09-21T07:37:57.687947+0000","last_became_peered":"2024-09-21T07:37:57.687947+0000","last_unstale":"2024-09-21T07:37:58.672231+0000","last_undegraded":"2024-09-21T07:37:58.672231+0000","last_fullsized":"2024-09-21T07:37:58.672231+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:41.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671385+0000","last_change":"2024-09-21T07:37:57.689677+0000","last_active":"2024-09-21T07:37:58.671385+0000","last_peered":"2024-09-21T07:37:58.671385+0000","last_clean":"2024-09-21T07:37:58.671385+0000","last_became_active":"2024-09-21T07:37:57.689320+0000","last_became_peered":"2024-09-21T07:37:57.689320+0000","last_unstale":"2024-09-21T07:37:58.671385+0000","last_undegraded":"2024-09-21T07:37:58.671385+0000","last_fullsized":"2024-09-21T07:37:58.671385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.136328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975718+0000","last_change":"2024-09-21T07:37:57.694043+0000","last_active":"2024-09-21T07:37:58.975718+0000","last_peered":"2024-09-21T07:37:58.975718+0000","last_clean":"2024-09-21T07:37:58.975718+0000","last_became_active":"2024-09-21T07:37:57.693686+0000","last_became_peered":"2024-09-21T07:37:57.693686+0000","last_unstale":"2024-09-21T07:37:58.975718+0000","last_undegraded":"2024-09-21T07:37:58.975718+0000","last_fullsized":"2024-09-21T07:37:58.975718+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975748+0000","last_change":"2024-09-21T07:37:57.696681+0000","last_active":"2024-09-21T07:37:58.975748+0000","last_peered":"2024-09-21T07:37:58.975748+0000","last_clean":"2024-09-21T07:37:58.975748+0000","last_became_active":"2024-09-21T07:37:57.696311+0000","last_became_peered":"2024-09-21T07:37:57.696311+0000","last_unstale":"2024-09-21T07:37:58.975748+0000","last_undegraded":"2024-09-21T07:37:58.975748+0000","last_fullsized":"2024-09-21T07:37:58.975748+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:44.737422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670912+0000","last_change":"2024-09-21T07:37:57.679345+0000","last_active":"2024-09-21T07:37:58.670912+0000","last_peered":"2024-09-21T07:37:58.670912+0000","last_clean":"2024-09-21T07:37:58.670912+0000","last_became_active":"2024-09-21T07:37:57.678467+0000","last_became_peered":"2024-09-21T07:37:57.678467+0000","last_unstale":"2024-09-21T07:37:58.670912+0000","last_undegraded":"2024-09-21T07:37:58.670912+0000","last_fullsized":"2024-09-21T07:37:58.670912+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:41.663864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673671+0000","last_change":"2024-09-21T07:37:57.684930+0000","last_active":"2024-09-21T07:37:58.673671+0000","last_peered":"2024-09-21T07:37:58.673671+0000","last_clean":"2024-09-21T07:37:58.673671+0000","last_became_active":"2024-09-21T07:37:57.684615+0000","last_became_peered":"2024-09-21T07:37:57.684615+0000","last_unstale":"2024-09-21T07:37:58.673671+0000","last_undegraded":"2024-09-21T07:37:58.673671+0000","last_fullsized":"2024-09-21T07:37:58.673671+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:56.968266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974582+0000","last_change":"2024-09-21T07:37:57.687704+0000","last_active":"2024-09-21T07:37:58.974582+0000","last_peered":"2024-09-21T07:37:58.974582+0000","last_clean":"2024-09-21T07:37:58.974582+0000","last_became_active":"2024-09-21T07:37:57.687306+0000","last_became_peered":"2024-09-21T07:37:57.687306+0000","last_unstale":"2024-09-21T07:37:58.974582+0000","last_undegraded":"2024-09-21T07:37:58.974582+0000","last_fullsized":"2024-09-21T07:37:58.974582+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:48.029574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973985+0000","last_change":"2024-09-21T07:37:57.682989+0000","last_active":"2024-09-21T07:37:58.973985+0000","last_peered":"2024-09-21T07:37:58.973985+0000","last_clean":"2024-09-21T07:37:58.973985+0000","last_became_active":"2024-09-21T07:37:57.682619+0000","last_became_peered":"2024-09-21T07:37:57.682619+0000","last_unstale":"2024-09-21T07:37:58.973985+0000","last_undegraded":"2024-09-21T07:37:58.973985+0000","last_fullsized":"2024-09-21T07:37:58.973985+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:32.009487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974758+0000","last_change":"2024-09-21T07:37:57.705839+0000","last_active":"2024-09-21T07:37:58.974758+0000","last_peered":"2024-09-21T07:37:58.974758+0000","last_clean":"2024-09-21T07:37:58.974758+0000","last_became_active":"2024-09-21T07:37:57.705526+0000","last_became_peered":"2024-09-21T07:37:57.705526+0000","last_unstale":"2024-09-21T07:37:58.974758+0000","last_undegraded":"2024-09-21T07:37:58.974758+0000","last_fullsized":"2024-09-21T07:37:58.974758+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:55.095935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674370+0000","last_change":"2024-09-21T07:37:57.689191+0000","last_active":"2024-09-21T07:37:58.674370+0000","last_peered":"2024-09-21T07:37:58.674370+0000","last_clean":"2024-09-21T07:37:58.674370+0000","last_became_active":"2024-09-21T07:37:57.688807+0000","last_became_peered":"2024-09-21T07:37:57.688807+0000","last_unstale":"2024-09-21T07:37:58.674370+0000","last_undegraded":"2024-09-21T07:37:58.674370+0000","last_fullsized":"2024-09-21T07:37:58.674370+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:37.445178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975990+0000","last_change":"2024-09-21T07:37:57.688241+0000","last_active":"2024-09-21T07:37:58.975990+0000","last_peered":"2024-09-21T07:37:58.975990+0000","last_clean":"2024-09-21T07:37:58.975990+0000","last_became_active":"2024-09-21T07:37:57.687847+0000","last_became_peered":"2024-09-21T07:37:57.687847+0000","last_unstale":"2024-09-21T07:37:58.975990+0000","last_undegraded":"2024-09-21T07:37:58.975990+0000","last_fullsized":"2024-09-21T07:37:58.975990+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:01.108841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974306+0000","last_change":"2024-09-21T07:37:57.683606+0000","last_active":"2024-09-21T07:37:58.974306+0000","last_peered":"2024-09-21T07:37:58.974306+0000","last_clean":"2024-09-21T07:37:58.974306+0000","last_became_active":"2024-09-21T07:37:57.683282+0000","last_became_peered":"2024-09-21T07:37:57.683282+0000","last_unstale":"2024-09-21T07:37:58.974306+0000","last_undegraded":"2024-09-21T07:37:58.974306+0000","last_fullsized":"2024-09-21T07:37:58.974306+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:56.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976237+0000","last_change":"2024-09-21T07:37:57.691515+0000","last_active":"2024-09-21T07:37:58.976237+0000","last_peered":"2024-09-21T07:37:58.976237+0000","last_clean":"2024-09-21T07:37:58.976237+0000","last_became_active":"2024-09-21T07:37:57.691013+0000","last_became_peered":"2024-09-21T07:37:57.691013+0000","last_unstale":"2024-09-21T07:37:58.976237+0000","last_undegraded":"2024-09-21T07:37:58.976237+0000","last_fullsized":"2024-09-21T07:37:58.976237+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:32.133566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851415+0000","last_change":"2024-09-21T07:37:57.692203+0000","last_active":"2024-09-21T07:37:58.851415+0000","last_peered":"2024-09-21T07:37:58.851415+0000","last_clean":"2024-09-21T07:37:58.851415+0000","last_became_active":"2024-09-21T07:37:57.691799+0000","last_became_peered":"2024-09-21T07:37:57.691799+0000","last_unstale":"2024-09-21T07:37:58.851415+0000","last_undegraded":"2024-09-21T07:37:58.851415+0000","last_fullsized":"2024-09-21T07:37:58.851415+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:39.719370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673443+0000","last_change":"2024-09-21T07:37:57.679630+0000","last_active":"2024-09-21T07:37:58.673443+0000","last_peered":"2024-09-21T07:37:58.673443+0000","last_clean":"2024-09-21T07:37:58.673443+0000","last_became_active":"2024-09-21T07:37:57.677909+0000","last_became_peered":"2024-09-21T07:37:57.677909+0000","last_unstale":"2024-09-21T07:37:58.673443+0000","last_undegraded":"2024-09-21T07:37:58.673443+0000","last_fullsized":"2024-09-21T07:37:58.673443+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:31.792047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974319+0000","last_change":"2024-09-21T07:37:57.703344+0000","last_active":"2024-09-21T07:37:58.974319+0000","last_peered":"2024-09-21T07:37:58.974319+0000","last_clean":"2024-09-21T07:37:58.974319+0000","last_became_active":"2024-09-21T07:37:57.702763+0000","last_became_peered":"2024-09-21T07:37:57.702763+0000","last_unstale":"2024-09-21T07:37:58.974319+0000","last_undegraded":"2024-09-21T07:37:58.974319+0000","last_fullsized":"2024-09-21T07:37:58.974319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:12.340315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671940+0000","last_change":"2024-09-21T07:37:57.685787+0000","last_active":"2024-09-21T07:37:58.671940+0000","last_peered":"2024-09-21T07:37:58.671940+0000","last_clean":"2024-09-21T07:37:58.671940+0000","last_became_active":"2024-09-21T07:37:57.685384+0000","last_became_peered":"2024-09-21T07:37:57.685384+0000","last_unstale":"2024-09-21T07:37:58.671940+0000","last_undegraded":"2024-09-21T07:37:58.671940+0000","last_fullsized":"2024-09-21T07:37:58.671940+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:19.499689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976513+0000","last_change":"2024-09-21T07:37:57.689956+0000","last_active":"2024-09-21T07:37:58.976513+0000","last_peered":"2024-09-21T07:37:58.976513+0000","last_clean":"2024-09-21T07:37:58.976513+0000","last_became_active":"2024-09-21T07:37:57.689635+0000","last_became_peered":"2024-09-21T07:37:57.689635+0000","last_unstale":"2024-09-21T07:37:58.976513+0000","last_undegraded":"2024-09-21T07:37:58.976513+0000","last_fullsized":"2024-09-21T07:37:58.976513+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:29.557123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851565+0000","last_change":"2024-09-21T07:37:57.697120+0000","last_active":"2024-09-21T07:37:58.851565+0000","last_peered":"2024-09-21T07:37:58.851565+0000","last_clean":"2024-09-21T07:37:58.851565+0000","last_became_active":"2024-09-21T07:37:57.696794+0000","last_became_peered":"2024-09-21T07:37:57.696794+0000","last_unstale":"2024-09-21T07:37:58.851565+0000","last_undegraded":"2024-09-21T07:37:58.851565+0000","last_fullsized":"2024-09-21T07:37:58.851565+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:43.137143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672661+0000","last_change":"2024-09-21T07:37:57.684791+0000","last_active":"2024-09-21T07:37:58.672661+0000","last_peered":"2024-09-21T07:37:58.672661+0000","last_clean":"2024-09-21T07:37:58.672661+0000","last_became_active":"2024-09-21T07:37:57.684075+0000","last_became_peered":"2024-09-21T07:37:57.684075+0000","last_unstale":"2024-09-21T07:37:58.672661+0000","last_undegraded":"2024-09-21T07:37:58.672661+0000","last_fullsized":"2024-09-21T07:37:58.672661+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:41.160146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670927+0000","last_change":"2024-09-21T07:37:57.689041+0000","last_active":"2024-09-21T07:37:58.670927+0000","last_peered":"2024-09-21T07:37:58.670927+0000","last_clean":"2024-09-21T07:37:58.670927+0000","last_became_active":"2024-09-21T07:37:57.688683+0000","last_became_peered":"2024-09-21T07:37:57.688683+0000","last_unstale":"2024-09-21T07:37:58.670927+0000","last_undegraded":"2024-09-21T07:37:58.670927+0000","last_fullsized":"2024-09-21T07:37:58.670927+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:47:08.217425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975448+0000","last_change":"2024-09-21T07:37:57.686007+0000","last_active":"2024-09-21T07:37:58.975448+0000","last_peered":"2024-09-21T07:37:58.975448+0000","last_clean":"2024-09-21T07:37:58.975448+0000","last_became_active":"2024-09-21T07:37:57.685708+0000","last_became_peered":"2024-09-21T07:37:57.685708+0000","last_unstale":"2024-09-21T07:37:58.975448+0000","last_undegraded":"2024-09-21T07:37:58.975448+0000","last_fullsized":"2024-09-21T07:37:58.975448+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:40.550681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976056+0000","last_change":"2024-09-21T07:37:57.689942+0000","last_active":"2024-09-21T07:37:58.976056+0000","last_peered":"2024-09-21T07:37:58.976056+0000","last_clean":"2024-09-21T07:37:58.976056+0000","last_became_active":"2024-09-21T07:37:57.689629+0000","last_became_peered":"2024-09-21T07:37:57.689629+0000","last_unstale":"2024-09-21T07:37:58.976056+0000","last_undegraded":"2024-09-21T07:37:58.976056+0000","last_fullsized":"2024-09-21T07:37:58.976056+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:56.138238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975319+0000","last_change":"2024-09-21T07:37:57.686180+0000","last_active":"2024-09-21T07:37:58.975319+0000","last_peered":"2024-09-21T07:37:58.975319+0000","last_clean":"2024-09-21T07:37:58.975319+0000","last_became_active":"2024-09-21T07:37:57.685834+0000","last_became_peered":"2024-09-21T07:37:57.685834+0000","last_unstale":"2024-09-21T07:37:58.975319+0000","last_undegraded":"2024-09-21T07:37:58.975319+0000","last_fullsized":"2024-09-21T07:37:58.975319+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:08.702004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670510+0000","last_change":"2024-09-21T07:37:57.688877+0000","last_active":"2024-09-21T07:37:58.670510+0000","last_peered":"2024-09-21T07:37:58.670510+0000","last_clean":"2024-09-21T07:37:58.670510+0000","last_became_active":"2024-09-21T07:37:57.688564+0000","last_became_peered":"2024-09-21T07:37:57.688564+0000","last_unstale":"2024-09-21T07:37:58.670510+0000","last_undegraded":"2024-09-21T07:37:58.670510+0000","last_fullsized":"2024-09-21T07:37:58.670510+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:49.285747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974849+0000","last_change":"2024-09-21T07:37:57.688478+0000","last_active":"2024-09-21T07:37:58.974849+0000","last_peered":"2024-09-21T07:37:58.974849+0000","last_clean":"2024-09-21T07:37:58.974849+0000","last_became_active":"2024-09-21T07:37:57.688171+0000","last_became_peered":"2024-09-21T07:37:57.688171+0000","last_unstale":"2024-09-21T07:37:58.974849+0000","last_undegraded":"2024-09-21T07:37:58.974849+0000","last_fullsized":"2024-09-21T07:37:58.974849+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:42.050242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"217'4","reported_seq":19,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671169+0000","last_change":"2024-09-21T07:37:56.681003+0000","last_active":"2024-09-21T07:37:58.671169+0000","last_peered":"2024-09-21T07:37:58.671169+0000","last_clean":"2024-09-21T07:37:58.671169+0000","last_became_active":"2024-09-21T07:37:56.680677+0000","last_became_peered":"2024-09-21T07:37:56.680677+0000","last_unstale":"2024-09-21T07:37:58.671169+0000","last_undegraded":"2024-09-21T07:37:58.671169+0000","last_fullsized":"2024-09-21T07:37:58.671169+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:04.630114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974033+0000","last_change":"2024-09-21T07:37:57.696302+0000","last_active":"2024-09-21T07:37:58.974033+0000","last_peered":"2024-09-21T07:37:58.974033+0000","last_clean":"2024-09-21T07:37:58.974033+0000","last_became_active":"2024-09-21T07:37:57.695957+0000","last_became_peered":"2024-09-21T07:37:57.695957+0000","last_unstale":"2024-09-21T07:37:58.974033+0000","last_undegraded":"2024-09-21T07:37:58.974033+0000","last_fullsized":"2024-09-21T07:37:58.974033+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:01.310825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674008+0000","last_change":"2024-09-21T07:37:56.682377+0000","last_active":"2024-09-21T07:37:58.674008+0000","last_peered":"2024-09-21T07:37:58.674008+0000","last_clean":"2024-09-21T07:37:58.674008+0000","last_became_active":"2024-09-21T07:37:56.682050+0000","last_became_peered":"2024-09-21T07:37:56.682050+0000","last_unstale":"2024-09-21T07:37:58.674008+0000","last_undegraded":"2024-09-21T07:37:58.674008+0000","last_fullsized":"2024-09-21T07:37:58.674008+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.169267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670800+0000","last_change":"2024-09-21T07:37:57.685402+0000","last_active":"2024-09-21T07:37:58.670800+0000","last_peered":"2024-09-21T07:37:58.670800+0000","last_clean":"2024-09-21T07:37:58.670800+0000","last_became_active":"2024-09-21T07:37:57.684889+0000","last_became_peered":"2024-09-21T07:37:57.684889+0000","last_unstale":"2024-09-21T07:37:58.670800+0000","last_undegraded":"2024-09-21T07:37:58.670800+0000","last_fullsized":"2024-09-21T07:37:58.670800+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:25.332634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.977114+0000","last_change":"2024-09-21T07:37:56.689098+0000","last_active":"2024-09-21T07:37:58.977114+0000","last_peered":"2024-09-21T07:37:58.977114+0000","last_clean":"2024-09-21T07:37:58.977114+0000","last_became_active":"2024-09-21T07:37:56.684546+0000","last_became_peered":"2024-09-21T07:37:56.684546+0000","last_unstale":"2024-09-21T07:37:58.977114+0000","last_undegraded":"2024-09-21T07:37:58.977114+0000","last_fullsized":"2024-09-21T07:37:58.977114+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:32.907234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975719+0000","last_change":"2024-09-21T07:37:57.696978+0000","last_active":"2024-09-21T07:37:58.975719+0000","last_peered":"2024-09-21T07:37:58.975719+0000","last_clean":"2024-09-21T07:37:58.975719+0000","last_became_active":"2024-09-21T07:37:57.696654+0000","last_became_peered":"2024-09-21T07:37:57.696654+0000","last_unstale":"2024-09-21T07:37:58.975719+0000","last_undegraded":"2024-09-21T07:37:58.975719+0000","last_fullsized":"2024-09-21T07:37:58.975719+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:15.873789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973906+0000","last_change":"2024-09-21T07:37:56.693584+0000","last_active":"2024-09-21T07:37:58.973906+0000","last_peered":"2024-09-21T07:37:58.973906+0000","last_clean":"2024-09-21T07:37:58.973906+0000","last_became_active":"2024-09-21T07:37:56.693288+0000","last_became_peered":"2024-09-21T07:37:56.693288+0000","last_unstale":"2024-09-21T07:37:58.973906+0000","last_undegraded":"2024-09-21T07:37:58.973906+0000","last_fullsized":"2024-09-21T07:37:58.973906+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:01.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851546+0000","last_change":"2024-09-21T07:37:57.691164+0000","last_active":"2024-09-21T07:37:58.851546+0000","last_peered":"2024-09-21T07:37:58.851546+0000","last_clean":"2024-09-21T07:37:58.851546+0000","last_became_active":"2024-09-21T07:37:57.690868+0000","last_became_peered":"2024-09-21T07:37:57.690868+0000","last_unstale":"2024-09-21T07:37:58.851546+0000","last_undegraded":"2024-09-21T07:37:58.851546+0000","last_fullsized":"2024-09-21T07:37:58.851546+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:47.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976217+0000","last_change":"2024-09-21T07:37:56.689298+0000","last_active":"2024-09-21T07:37:58.976217+0000","last_peered":"2024-09-21T07:37:58.976217+0000","last_clean":"2024-09-21T07:37:58.976217+0000","last_became_active":"2024-09-21T07:37:56.688807+0000","last_became_peered":"2024-09-21T07:37:56.688807+0000","last_unstale":"2024-09-21T07:37:58.976217+0000","last_undegraded":"2024-09-21T07:37:58.976217+0000","last_fullsized":"2024-09-21T07:37:58.976217+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:44.843680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975452+0000","last_change":"2024-09-21T07:37:57.693164+0000","last_active":"2024-09-21T07:37:58.975452+0000","last_peered":"2024-09-21T07:37:58.975452+0000","last_clean":"2024-09-21T07:37:58.975452+0000","last_became_active":"2024-09-21T07:37:57.692831+0000","last_became_peered":"2024-09-21T07:37:57.692831+0000","last_unstale":"2024-09-21T07:37:58.975452+0000","last_undegraded":"2024-09-21T07:37:58.975452+0000","last_fullsized":"2024-09-21T07:37:58.975452+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:36.825509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974811+0000","last_change":"2024-09-21T07:37:56.696904+0000","last_active":"2024-09-21T07:37:58.974811+0000","last_peered":"2024-09-21T07:37:58.974811+0000","last_clean":"2024-09-21T07:37:58.974811+0000","last_became_active":"2024-09-21T07:37:56.696373+0000","last_became_peered":"2024-09-21T07:37:56.696373+0000","last_unstale":"2024-09-21T07:37:58.974811+0000","last_undegraded":"2024-09-21T07:37:58.974811+0000","last_fullsized":"2024-09-21T07:37:58.974811+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:12.535237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673505+0000","last_change":"2024-09-21T07:37:57.682240+0000","last_active":"2024-09-21T07:37:58.673505+0000","last_peered":"2024-09-21T07:37:58.673505+0000","last_clean":"2024-09-21T07:37:58.673505+0000","last_became_active":"2024-09-21T07:37:57.681904+0000","last_became_peered":"2024-09-21T07:37:57.681904+0000","last_unstale":"2024-09-21T07:37:58.673505+0000","last_undegraded":"2024-09-21T07:37:58.673505+0000","last_fullsized":"2024-09-21T07:37:58.673505+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:36.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670323+0000","last_change":"2024-09-21T07:37:56.681896+0000","last_active":"2024-09-21T07:37:58.670323+0000","last_peered":"2024-09-21T07:37:58.670323+0000","last_clean":"2024-09-21T07:37:58.670323+0000","last_became_active":"2024-09-21T07:37:56.681584+0000","last_became_peered":"2024-09-21T07:37:56.681584+0000","last_unstale":"2024-09-21T07:37:58.670323+0000","last_undegraded":"2024-09-21T07:37:58.670323+0000","last_fullsized":"2024-09-21T07:37:58.670323+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:24.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851671+0000","last_change":"2024-09-21T07:37:57.692504+0000","last_active":"2024-09-21T07:37:58.851671+0000","last_peered":"2024-09-21T07:37:58.851671+0000","last_clean":"2024-09-21T07:37:58.851671+0000","last_became_active":"2024-09-21T07:37:57.692068+0000","last_became_peered":"2024-09-21T07:37:57.692068+0000","last_unstale":"2024-09-21T07:37:58.851671+0000","last_undegraded":"2024-09-21T07:37:58.851671+0000","last_fullsized":"2024-09-21T07:37:58.851671+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:42.620237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.977143+0000","last_change":"2024-09-21T07:37:56.687358+0000","last_active":"2024-09-21T07:37:58.977143+0000","last_peered":"2024-09-21T07:37:58.977143+0000","last_clean":"2024-09-21T07:37:58.977143+0000","last_became_active":"2024-09-21T07:37:56.685812+0000","last_became_peered":"2024-09-21T07:37:56.685812+0000","last_unstale":"2024-09-21T07:37:58.977143+0000","last_undegraded":"2024-09-21T07:37:58.977143+0000","last_fullsized":"2024-09-21T07:37:58.977143+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:11.931605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672914+0000","last_change":"2024-09-21T07:37:57.681145+0000","last_active":"2024-09-21T07:37:58.672914+0000","last_peered":"2024-09-21T07:37:58.672914+0000","last_clean":"2024-09-21T07:37:58.672914+0000","last_became_active":"2024-09-21T07:37:57.679823+0000","last_became_peered":"2024-09-21T07:37:57.679823+0000","last_unstale":"2024-09-21T07:37:58.672914+0000","last_undegraded":"2024-09-21T07:37:58.672914+0000","last_fullsized":"2024-09-21T07:37:58.672914+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.680059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975946+0000","last_change":"2024-09-21T07:37:56.700571+0000","last_active":"2024-09-21T07:37:58.975946+0000","last_peered":"2024-09-21T07:37:58.975946+0000","last_clean":"2024-09-21T07:37:58.975946+0000","last_became_active":"2024-09-21T07:37:56.700152+0000","last_became_peered":"2024-09-21T07:37:56.700152+0000","last_unstale":"2024-09-21T07:37:58.975946+0000","last_undegraded":"2024-09-21T07:37:58.975946+0000","last_fullsized":"2024-09-21T07:37:58.975946+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:16.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974963+0000","last_change":"2024-09-21T07:37:57.694048+0000","last_active":"2024-09-21T07:37:58.974963+0000","last_peered":"2024-09-21T07:37:58.974963+0000","last_clean":"2024-09-21T07:37:58.974963+0000","last_became_active":"2024-09-21T07:37:57.693768+0000","last_became_peered":"2024-09-21T07:37:57.693768+0000","last_unstale":"2024-09-21T07:37:58.974963+0000","last_undegraded":"2024-09-21T07:37:58.974963+0000","last_fullsized":"2024-09-21T07:37:58.974963+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:23.934637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"217'3","reported_seq":18,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672864+0000","last_change":"2024-09-21T07:37:56.682914+0000","last_active":"2024-09-21T07:37:58.672864+0000","last_peered":"2024-09-21T07:37:58.672864+0000","last_clean":"2024-09-21T07:37:58.672864+0000","last_became_active":"2024-09-21T07:37:56.681968+0000","last_became_peered":"2024-09-21T07:37:56.681968+0000","last_unstale":"2024-09-21T07:37:58.672864+0000","last_undegraded":"2024-09-21T07:37:58.672864+0000","last_fullsized":"2024-09-21T07:37:58.672864+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:17.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851298+0000","last_change":"2024-09-21T07:37:57.689290+0000","last_active":"2024-09-21T07:37:58.851298+0000","last_peered":"2024-09-21T07:37:58.851298+0000","last_clean":"2024-09-21T07:37:58.851298+0000","last_became_active":"2024-09-21T07:37:57.688982+0000","last_became_peered":"2024-09-21T07:37:57.688982+0000","last_unstale":"2024-09-21T07:37:58.851298+0000","last_undegraded":"2024-09-21T07:37:58.851298+0000","last_fullsized":"2024-09-21T07:37:58.851298+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:41.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"217'6","reported_seq":21,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671074+0000","last_change":"2024-09-21T07:37:56.681926+0000","last_active":"2024-09-21T07:37:58.671074+0000","last_peered":"2024-09-21T07:37:58.671074+0000","last_clean":"2024-09-21T07:37:58.671074+0000","last_became_active":"2024-09-21T07:37:56.681625+0000","last_became_peered":"2024-09-21T07:37:56.681625+0000","last_unstale":"2024-09-21T07:37:58.671074+0000","last_undegraded":"2024-09-21T07:37:58.671074+0000","last_fullsized":"2024-09-21T07:37:58.671074+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:04.257605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975879+0000","last_change":"2024-09-21T07:37:57.687803+0000","last_active":"2024-09-21T07:37:58.975879+0000","last_peered":"2024-09-21T07:37:58.975879+0000","last_clean":"2024-09-21T07:37:58.975879+0000","last_became_active":"2024-09-21T07:37:57.687481+0000","last_became_peered":"2024-09-21T07:37:57.687481+0000","last_unstale":"2024-09-21T07:37:58.975879+0000","last_undegraded":"2024-09-21T07:37:58.975879+0000","last_fullsized":"2024-09-21T07:37:58.975879+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:11.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974068+0000","last_change":"2024-09-21T07:37:56.690462+0000","last_active":"2024-09-21T07:37:58.974068+0000","last_peered":"2024-09-21T07:37:58.974068+0000","last_clean":"2024-09-21T07:37:58.974068+0000","last_became_active":"2024-09-21T07:37:56.690094+0000","last_became_peered":"2024-09-21T07:37:56.690094+0000","last_unstale":"2024-09-21T07:37:58.974068+0000","last_undegraded":"2024-09-21T07:37:58.974068+0000","last_fullsized":"2024-09-21T07:37:58.974068+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:41.064369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851504+0000","last_change":"2024-09-21T07:37:57.690447+0000","last_active":"2024-09-21T07:37:58.851504+0000","last_peered":"2024-09-21T07:37:58.851504+0000","last_clean":"2024-09-21T07:37:58.851504+0000","last_became_active":"2024-09-21T07:37:57.686623+0000","last_became_peered":"2024-09-21T07:37:57.686623+0000","last_unstale":"2024-09-21T07:37:58.851504+0000","last_undegraded":"2024-09-21T07:37:58.851504+0000","last_fullsized":"2024-09-21T07:37:58.851504+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:36.789112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672803+0000","last_change":"2024-09-21T07:37:56.686422+0000","last_active":"2024-09-21T07:37:58.672803+0000","last_peered":"2024-09-21T07:37:58.672803+0000","last_clean":"2024-09-21T07:37:58.672803+0000","last_became_active":"2024-09-21T07:37:56.685790+0000","last_became_peered":"2024-09-21T07:37:56.685790+0000","last_unstale":"2024-09-21T07:37:58.672803+0000","last_undegraded":"2024-09-21T07:37:58.672803+0000","last_fullsized":"2024-09-21T07:37:58.672803+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:14.048584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974271+0000","last_change":"2024-09-21T07:37:57.696921+0000","last_active":"2024-09-21T07:37:58.974271+0000","last_peered":"2024-09-21T07:37:58.974271+0000","last_clean":"2024-09-21T07:37:58.974271+0000","last_became_active":"2024-09-21T07:37:57.695559+0000","last_became_peered":"2024-09-21T07:37:57.695559+0000","last_unstale":"2024-09-21T07:37:58.974271+0000","last_undegraded":"2024-09-21T07:37:58.974271+0000","last_fullsized":"2024-09-21T07:37:58.974271+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:14.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672402+0000","last_change":"2024-09-21T07:37:56.671057+0000","last_active":"2024-09-21T07:37:58.672402+0000","last_peered":"2024-09-21T07:37:58.672402+0000","last_clean":"2024-09-21T07:37:58.672402+0000","last_became_active":"2024-09-21T07:37:56.670715+0000","last_became_peered":"2024-09-21T07:37:56.670715+0000","last_unstale":"2024-09-21T07:37:58.672402+0000","last_undegraded":"2024-09-21T07:37:58.672402+0000","last_fullsized":"2024-09-21T07:37:58.672402+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:38.167695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673320+0000","last_change":"2024-09-21T07:37:57.684690+0000","last_active":"2024-09-21T07:37:58.673320+0000","last_peered":"2024-09-21T07:37:58.673320+0000","last_clean":"2024-09-21T07:37:58.673320+0000","last_became_active":"2024-09-21T07:37:57.684229+0000","last_became_peered":"2024-09-21T07:37:57.684229+0000","last_unstale":"2024-09-21T07:37:58.673320+0000","last_undegraded":"2024-09-21T07:37:58.673320+0000","last_fullsized":"2024-09-21T07:37:58.673320+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:11.675536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"217'8","reported_seq":23,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975035+0000","last_change":"2024-09-21T07:37:56.691680+0000","last_active":"2024-09-21T07:37:58.975035+0000","last_peered":"2024-09-21T07:37:58.975035+0000","last_clean":"2024-09-21T07:37:58.975035+0000","last_became_active":"2024-09-21T07:37:56.691374+0000","last_became_peered":"2024-09-21T07:37:56.691374+0000","last_unstale":"2024-09-21T07:37:58.975035+0000","last_undegraded":"2024-09-21T07:37:58.975035+0000","last_fullsized":"2024-09-21T07:37:58.975035+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:06.684728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671974+0000","last_change":"2024-09-21T07:37:57.684891+0000","last_active":"2024-09-21T07:37:58.671974+0000","last_peered":"2024-09-21T07:37:58.671974+0000","last_clean":"2024-09-21T07:37:58.671974+0000","last_became_active":"2024-09-21T07:37:57.684479+0000","last_became_peered":"2024-09-21T07:37:57.684479+0000","last_unstale":"2024-09-21T07:37:58.671974+0000","last_undegraded":"2024-09-21T07:37:58.671974+0000","last_fullsized":"2024-09-21T07:37:58.671974+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:40.350735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671365+0000","last_change":"2024-09-21T07:37:56.674146+0000","last_active":"2024-09-21T07:37:58.671365+0000","last_peered":"2024-09-21T07:37:58.671365+0000","last_clean":"2024-09-21T07:37:58.671365+0000","last_became_active":"2024-09-21T07:37:56.673828+0000","last_became_peered":"2024-09-21T07:37:56.673828+0000","last_unstale":"2024-09-21T07:37:58.671365+0000","last_undegraded":"2024-09-21T07:37:58.671365+0000","last_fullsized":"2024-09-21T07:37:58.671365+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:27.388800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672198+0000","last_change":"2024-09-21T07:37:57.688479+0000","last_active":"2024-09-21T07:37:58.672198+0000","last_peered":"2024-09-21T07:37:58.672198+0000","last_clean":"2024-09-21T07:37:58.672198+0000","last_became_active":"2024-09-21T07:37:57.688163+0000","last_became_peered":"2024-09-21T07:37:57.688163+0000","last_unstale":"2024-09-21T07:37:58.672198+0000","last_undegraded":"2024-09-21T07:37:58.672198+0000","last_fullsized":"2024-09-21T07:37:58.672198+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:35.878332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976948+0000","last_change":"2024-09-21T07:37:56.688513+0000","last_active":"2024-09-21T07:37:58.976948+0000","last_peered":"2024-09-21T07:37:58.976948+0000","last_clean":"2024-09-21T07:37:58.976948+0000","last_became_active":"2024-09-21T07:37:56.688218+0000","last_became_peered":"2024-09-21T07:37:56.688218+0000","last_unstale":"2024-09-21T07:37:58.976948+0000","last_undegraded":"2024-09-21T07:37:58.976948+0000","last_fullsized":"2024-09-21T07:37:58.976948+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:45.199065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975260+0000","last_change":"2024-09-21T07:37:57.694690+0000","last_active":"2024-09-21T07:37:58.975260+0000","last_peered":"2024-09-21T07:37:58.975260+0000","last_clean":"2024-09-21T07:37:58.975260+0000","last_became_active":"2024-09-21T07:37:57.694401+0000","last_became_peered":"2024-09-21T07:37:57.694401+0000","last_unstale":"2024-09-21T07:37:58.975260+0000","last_undegraded":"2024-09-21T07:37:58.975260+0000","last_fullsized":"2024-09-21T07:37:58.975260+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:45.181073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674020+0000","last_change":"2024-09-21T07:37:56.682770+0000","last_active":"2024-09-21T07:37:58.674020+0000","last_peered":"2024-09-21T07:37:58.674020+0000","last_clean":"2024-09-21T07:37:58.674020+0000","last_became_active":"2024-09-21T07:37:56.682396+0000","last_became_peered":"2024-09-21T07:37:56.682396+0000","last_unstale":"2024-09-21T07:37:58.674020+0000","last_undegraded":"2024-09-21T07:37:58.674020+0000","last_fullsized":"2024-09-21T07:37:58.674020+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:51.183242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974975+0000","last_change":"2024-09-21T07:37:57.695029+0000","last_active":"2024-09-21T07:37:58.974975+0000","last_peered":"2024-09-21T07:37:58.974975+0000","last_clean":"2024-09-21T07:37:58.974975+0000","last_became_active":"2024-09-21T07:37:57.694668+0000","last_became_peered":"2024-09-21T07:37:57.694668+0000","last_unstale":"2024-09-21T07:37:58.974975+0000","last_undegraded":"2024-09-21T07:37:58.974975+0000","last_fullsized":"2024-09-21T07:37:58.974975+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:36.989259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974095+0000","last_change":"2024-09-21T07:37:56.687413+0000","last_active":"2024-09-21T07:37:58.974095+0000","last_peered":"2024-09-21T07:37:58.974095+0000","last_clean":"2024-09-21T07:37:58.974095+0000","last_became_active":"2024-09-21T07:37:56.686855+0000","last_became_peered":"2024-09-21T07:37:56.686855+0000","last_unstale":"2024-09-21T07:37:58.974095+0000","last_undegraded":"2024-09-21T07:37:58.974095+0000","last_fullsized":"2024-09-21T07:37:58.974095+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:17.302940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975427+0000","last_change":"2024-09-21T07:37:57.696258+0000","last_active":"2024-09-21T07:37:58.975427+0000","last_peered":"2024-09-21T07:37:58.975427+0000","last_clean":"2024-09-21T07:37:58.975427+0000","last_became_active":"2024-09-21T07:37:57.695921+0000","last_became_peered":"2024-09-21T07:37:57.695921+0000","last_unstale":"2024-09-21T07:37:58.975427+0000","last_undegraded":"2024-09-21T07:37:58.975427+0000","last_fullsized":"2024-09-21T07:37:58.975427+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:57.608375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975149+0000","last_change":"2024-09-21T07:37:56.695731+0000","last_active":"2024-09-21T07:37:58.975149+0000","last_peered":"2024-09-21T07:37:58.975149+0000","last_clean":"2024-09-21T07:37:58.975149+0000","last_became_active":"2024-09-21T07:37:56.695425+0000","last_became_peered":"2024-09-21T07:37:56.695425+0000","last_unstale":"2024-09-21T07:37:58.975149+0000","last_undegraded":"2024-09-21T07:37:58.975149+0000","last_fullsized":"2024-09-21T07:37:58.975149+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:33.472252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976585+0000","last_change":"2024-09-21T07:37:57.687273+0000","last_active":"2024-09-21T07:37:58.976585+0000","last_peered":"2024-09-21T07:37:58.976585+0000","last_clean":"2024-09-21T07:37:58.976585+0000","last_became_active":"2024-09-21T07:37:57.685826+0000","last_became_peered":"2024-09-21T07:37:57.685826+0000","last_unstale":"2024-09-21T07:37:58.976585+0000","last_undegraded":"2024-09-21T07:37:58.976585+0000","last_fullsized":"2024-09-21T07:37:58.976585+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:01.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673611+0000","last_change":"2024-09-21T07:37:56.683690+0000","last_active":"2024-09-21T07:37:58.673611+0000","last_peered":"2024-09-21T07:37:58.673611+0000","last_clean":"2024-09-21T07:37:58.673611+0000","last_became_active":"2024-09-21T07:37:56.682542+0000","last_became_peered":"2024-09-21T07:37:56.682542+0000","last_unstale":"2024-09-21T07:37:58.673611+0000","last_undegraded":"2024-09-21T07:37:58.673611+0000","last_fullsized":"2024-09-21T07:37:58.673611+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:17.569543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674201+0000","last_change":"2024-09-21T07:37:57.687525+0000","last_active":"2024-09-21T07:37:58.674201+0000","last_peered":"2024-09-21T07:37:58.674201+0000","last_clean":"2024-09-21T07:37:58.674201+0000","last_became_active":"2024-09-21T07:37:57.687218+0000","last_became_peered":"2024-09-21T07:37:57.687218+0000","last_unstale":"2024-09-21T07:37:58.674201+0000","last_undegraded":"2024-09-21T07:37:58.674201+0000","last_fullsized":"2024-09-21T07:37:58.674201+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:01.399862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673164+0000","last_change":"2024-09-21T07:37:56.684391+0000","last_active":"2024-09-21T07:37:58.673164+0000","last_peered":"2024-09-21T07:37:58.673164+0000","last_clean":"2024-09-21T07:37:58.673164+0000","last_became_active":"2024-09-21T07:37:56.683444+0000","last_became_peered":"2024-09-21T07:37:56.683444+0000","last_unstale":"2024-09-21T07:37:58.673164+0000","last_undegraded":"2024-09-21T07:37:58.673164+0000","last_fullsized":"2024-09-21T07:37:58.673164+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:37.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674186+0000","last_change":"2024-09-21T07:37:57.686328+0000","last_active":"2024-09-21T07:37:58.674186+0000","last_peered":"2024-09-21T07:37:58.674186+0000","last_clean":"2024-09-21T07:37:58.674186+0000","last_became_active":"2024-09-21T07:37:57.684465+0000","last_became_peered":"2024-09-21T07:37:57.684465+0000","last_unstale":"2024-09-21T07:37:58.674186+0000","last_undegraded":"2024-09-21T07:37:58.674186+0000","last_fullsized":"2024-09-21T07:37:58.674186+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:24.995840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976088+0000","last_change":"2024-09-21T07:37:56.684444+0000","last_active":"2024-09-21T07:37:58.976088+0000","last_peered":"2024-09-21T07:37:58.976088+0000","last_clean":"2024-09-21T07:37:58.976088+0000","last_became_active":"2024-09-21T07:37:56.684047+0000","last_became_peered":"2024-09-21T07:37:56.684047+0000","last_unstale":"2024-09-21T07:37:58.976088+0000","last_undegraded":"2024-09-21T07:37:58.976088+0000","last_fullsized":"2024-09-21T07:37:58.976088+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:30.292441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851584+0000","last_change":"2024-09-21T07:37:57.703604+0000","last_active":"2024-09-21T07:37:58.851584+0000","last_peered":"2024-09-21T07:37:58.851584+0000","last_clean":"2024-09-21T07:37:58.851584+0000","last_became_active":"2024-09-21T07:37:57.703294+0000","last_became_peered":"2024-09-21T07:37:57.703294+0000","last_unstale":"2024-09-21T07:37:58.851584+0000","last_undegraded":"2024-09-21T07:37:58.851584+0000","last_fullsized":"2024-09-21T07:37:58.851584+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:11.675536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"217'2","reported_seq":17,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976052+0000","last_change":"2024-09-21T07:37:56.690896+0000","last_active":"2024-09-21T07:37:58.976052+0000","last_peered":"2024-09-21T07:37:58.976052+0000","last_clean":"2024-09-21T07:37:58.976052+0000","last_became_active":"2024-09-21T07:37:56.690438+0000","last_became_peered":"2024-09-21T07:37:56.690438+0000","last_unstale":"2024-09-21T07:37:58.976052+0000","last_undegraded":"2024-09-21T07:37:58.976052+0000","last_fullsized":"2024-09-21T07:37:58.976052+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:33.918994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974013+0000","last_change":"2024-09-21T07:37:57.697180+0000","last_active":"2024-09-21T07:37:58.974013+0000","last_peered":"2024-09-21T07:37:58.974013+0000","last_clean":"2024-09-21T07:37:58.974013+0000","last_became_active":"2024-09-21T07:37:57.696336+0000","last_became_peered":"2024-09-21T07:37:57.696336+0000","last_unstale":"2024-09-21T07:37:58.974013+0000","last_undegraded":"2024-09-21T07:37:58.974013+0000","last_fullsized":"2024-09-21T07:37:58.974013+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:35.468489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"218'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672952+0000","last_change":"2024-09-21T07:37:56.676884+0000","last_active":"2024-09-21T07:37:58.672952+0000","last_peered":"2024-09-21T07:37:58.672952+0000","last_clean":"2024-09-21T07:37:58.672952+0000","last_became_active":"2024-09-21T07:37:56.676336+0000","last_became_peered":"2024-09-21T07:37:56.676336+0000","last_unstale":"2024-09-21T07:37:58.672952+0000","last_undegraded":"2024-09-21T07:37:58.672952+0000","last_fullsized":"2024-09-21T07:37:58.672952+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:23.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974897+0000","last_change":"2024-09-21T07:37:57.693339+0000","last_active":"2024-09-21T07:37:58.974897+0000","last_peered":"2024-09-21T07:37:58.974897+0000","last_clean":"2024-09-21T07:37:58.974897+0000","last_became_active":"2024-09-21T07:37:57.692967+0000","last_became_peered":"2024-09-21T07:37:57.692967+0000","last_unstale":"2024-09-21T07:37:58.974897+0000","last_undegraded":"2024-09-21T07:37:58.974897+0000","last_fullsized":"2024-09-21T07:37:58.974897+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:47.610736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.977013+0000","last_change":"2024-09-21T07:37:56.688339+0000","last_active":"2024-09-21T07:37:58.977013+0000","last_peered":"2024-09-21T07:37:58.977013+0000","last_clean":"2024-09-21T07:37:58.977013+0000","last_became_active":"2024-09-21T07:37:56.684821+0000","last_became_peered":"2024-09-21T07:37:56.684821+0000","last_unstale":"2024-09-21T07:37:58.977013+0000","last_undegraded":"2024-09-21T07:37:58.977013+0000","last_fullsized":"2024-09-21T07:37:58.977013+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:06.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672487+0000","last_change":"2024-09-21T07:37:57.694512+0000","last_active":"2024-09-21T07:37:58.672487+0000","last_peered":"2024-09-21T07:37:58.672487+0000","last_clean":"2024-09-21T07:37:58.672487+0000","last_became_active":"2024-09-21T07:37:57.694206+0000","last_became_peered":"2024-09-21T07:37:57.694206+0000","last_unstale":"2024-09-21T07:37:58.672487+0000","last_undegraded":"2024-09-21T07:37:58.672487+0000","last_fullsized":"2024-09-21T07:37:58.672487+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:36.789112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.977060+0000","last_change":"2024-09-21T07:37:56.693400+0000","last_active":"2024-09-21T07:37:58.977060+0000","last_peered":"2024-09-21T07:37:58.977060+0000","last_clean":"2024-09-21T07:37:58.977060+0000","last_became_active":"2024-09-21T07:37:56.692901+0000","last_became_peered":"2024-09-21T07:37:56.692901+0000","last_unstale":"2024-09-21T07:37:58.977060+0000","last_undegraded":"2024-09-21T07:37:58.977060+0000","last_fullsized":"2024-09-21T07:37:58.977060+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:10.293829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.975237+0000","last_change":"2024-09-21T07:37:57.684688+0000","last_active":"2024-09-21T07:37:58.975237+0000","last_peered":"2024-09-21T07:37:58.975237+0000","last_clean":"2024-09-21T07:37:58.975237+0000","last_became_active":"2024-09-21T07:37:57.683127+0000","last_became_peered":"2024-09-21T07:37:57.683127+0000","last_unstale":"2024-09-21T07:37:58.975237+0000","last_undegraded":"2024-09-21T07:37:58.975237+0000","last_fullsized":"2024-09-21T07:37:58.975237+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:45.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.673701+0000","last_change":"2024-09-21T07:37:56.684291+0000","last_active":"2024-09-21T07:37:58.673701+0000","last_peered":"2024-09-21T07:37:58.673701+0000","last_clean":"2024-09-21T07:37:58.673701+0000","last_became_active":"2024-09-21T07:37:56.682331+0000","last_became_peered":"2024-09-21T07:37:56.682331+0000","last_unstale":"2024-09-21T07:37:58.673701+0000","last_undegraded":"2024-09-21T07:37:58.673701+0000","last_fullsized":"2024-09-21T07:37:58.673701+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:28.689161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670983+0000","last_change":"2024-09-21T07:37:57.682491+0000","last_active":"2024-09-21T07:37:58.670983+0000","last_peered":"2024-09-21T07:37:58.670983+0000","last_clean":"2024-09-21T07:37:58.670983+0000","last_became_active":"2024-09-21T07:37:57.682202+0000","last_became_peered":"2024-09-21T07:37:57.682202+0000","last_unstale":"2024-09-21T07:37:58.670983+0000","last_undegraded":"2024-09-21T07:37:58.670983+0000","last_fullsized":"2024-09-21T07:37:58.670983+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:35.056943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.672921+0000","last_change":"2024-09-21T07:37:56.680005+0000","last_active":"2024-09-21T07:37:58.672921+0000","last_peered":"2024-09-21T07:37:58.672921+0000","last_clean":"2024-09-21T07:37:58.672921+0000","last_became_active":"2024-09-21T07:37:56.679613+0000","last_became_peered":"2024-09-21T07:37:56.679613+0000","last_unstale":"2024-09-21T07:37:58.672921+0000","last_undegraded":"2024-09-21T07:37:58.672921+0000","last_fullsized":"2024-09-21T07:37:58.672921+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:06.631456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.976874+0000","last_change":"2024-09-21T07:37:57.689859+0000","last_active":"2024-09-21T07:37:58.976874+0000","last_peered":"2024-09-21T07:37:58.976874+0000","last_clean":"2024-09-21T07:37:58.976874+0000","last_became_active":"2024-09-21T07:37:57.689269+0000","last_became_peered":"2024-09-21T07:37:57.689269+0000","last_unstale":"2024-09-21T07:37:58.976874+0000","last_undegraded":"2024-09-21T07:37:58.976874+0000","last_fullsized":"2024-09-21T07:37:58.976874+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:21.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.974936+0000","last_change":"2024-09-21T07:37:56.700326+0000","last_active":"2024-09-21T07:37:58.974936+0000","last_peered":"2024-09-21T07:37:58.974936+0000","last_clean":"2024-09-21T07:37:58.974936+0000","last_became_active":"2024-09-21T07:37:56.700049+0000","last_became_peered":"2024-09-21T07:37:56.700049+0000","last_unstale":"2024-09-21T07:37:58.974936+0000","last_undegraded":"2024-09-21T07:37:58.974936+0000","last_fullsized":"2024-09-21T07:37:58.974936+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:56.974818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.674187+0000","last_change":"2024-09-21T07:37:57.687580+0000","last_active":"2024-09-21T07:37:58.674187+0000","last_peered":"2024-09-21T07:37:58.674187+0000","last_clean":"2024-09-21T07:37:58.674187+0000","last_became_active":"2024-09-21T07:37:57.686750+0000","last_became_peered":"2024-09-21T07:37:57.686750+0000","last_unstale":"2024-09-21T07:37:58.674187+0000","last_undegraded":"2024-09-21T07:37:58.674187+0000","last_fullsized":"2024-09-21T07:37:58.674187+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:01.006702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.671863+0000","last_change":"2024-09-21T07:37:56.680549+0000","last_active":"2024-09-21T07:37:58.671863+0000","last_peered":"2024-09-21T07:37:58.671863+0000","last_clean":"2024-09-21T07:37:58.671863+0000","last_became_active":"2024-09-21T07:37:56.680165+0000","last_became_peered":"2024-09-21T07:37:56.680165+0000","last_unstale":"2024-09-21T07:37:58.671863+0000","last_undegraded":"2024-09-21T07:37:58.671863+0000","last_fullsized":"2024-09-21T07:37:58.671863+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:06.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.670495+0000","last_change":"2024-09-21T07:37:57.699500+0000","last_active":"2024-09-21T07:37:58.670495+0000","last_peered":"2024-09-21T07:37:58.670495+0000","last_clean":"2024-09-21T07:37:58.670495+0000","last_became_active":"2024-09-21T07:37:57.699196+0000","last_became_peered":"2024-09-21T07:37:57.699196+0000","last_unstale":"2024-09-21T07:37:58.670495+0000","last_undegraded":"2024-09-21T07:37:58.670495+0000","last_fullsized":"2024-09-21T07:37:58.670495+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:56.655609+0000","last_clean_scrub_stamp":"2024-09-21T07:37:56.655609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:16.002562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"217'1","reported_seq":16,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.851532+0000","last_change":"2024-09-21T07:37:56.688161+0000","last_active":"2024-09-21T07:37:58.851532+0000","last_peered":"2024-09-21T07:37:58.851532+0000","last_clean":"2024-09-21T07:37:58.851532+0000","last_became_active":"2024-09-21T07:37:56.687601+0000","last_became_peered":"2024-09-21T07:37:56.687601+0000","last_unstale":"2024-09-21T07:37:58.851532+0000","last_undegraded":"2024-09-21T07:37:58.851532+0000","last_fullsized":"2024-09-21T07:37:58.851532+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:37:55.652739+0000","last_clean_scrub_stamp":"2024-09-21T07:37:55.652739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:22.450233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":471,"reported_epoch":218,"state":"active+clean","last_fresh":"2024-09-21T07:37:58.973649+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:37:58.973649+0000","last_peered":"2024-09-21T07:37:58.973649+0000","last_clean":"2024-09-21T07:37:58.973649+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:37:58.973649+0000","last_undegraded":"2024-09-21T07:37:58.973649+0000","last_fullsized":"2024-09-21T07:37:58.973649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509629,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56088,"kb_used_data":2692,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315752,"statfs":{"total":96636764160,"available":96579330048,"internally_reserved":0,"allocated":2756608,"data_stored":1302505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509629,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56080,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315760,"statfs":{"total":96636764160,"available":96579338240,"internally_reserved":0,"allocated":2748416,"data_stored":1302393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509629,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47764,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324076,"statfs":{"total":96636764160,"available":96587853824,"internally_reserved":0,"allocated":2752512,"data_stored":1302463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509629,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60252,"kb_used_data":2692,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311588,"statfs":{"total":96636764160,"available":96575066112,"internally_reserved":0,"allocated":2756608,"data_stored":1303045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509628,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47768,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":2748416,"data_stored":1302393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509629,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56672,"kb_used_data":3276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315168,"statfs":{"total":96636764160,"available":96578732032,"internally_reserved":0,"allocated":3354624,"data_stored":1894373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56668,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315172,"statfs":{"total":96636764160,"available":96578736128,"internally_reserved":0,"allocated":3350528,"data_stored":1892885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87976,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283864,"statfs":{"total":96636764160,"available":96546676736,"internally_reserved":0,"allocated":2772992,"data_stored":1304643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:06.971 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:38:06.972 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:38:07.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- 172.21.15.64:0/2315904743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 msgr2=0x7f66a00d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2315904743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a00d05a0 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f66a0074100 tx=0x7f669001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- 172.21.15.64:0/2315904743 shutdown_connections 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2315904743 >> v2:172.21.15.90:3300/0 conn(0x7f66a00d0f40 0x7f66a00d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2315904743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a00d05a0 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- 172.21.15.64:0/2315904743 >> 172.21.15.64:0/2315904743 conn(0x7f66a00ceee0 msgr2=0x7f66a00cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- 172.21.15.64:0/2315904743 shutdown_connections 2024-09-21T07:38:07.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- 172.21.15.64:0/2315904743 wait complete. 2024-09-21T07:38:07.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 Processor -- start 2024-09-21T07:38:07.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.178+0000 7f66a6c00640 1 -- start start 2024-09-21T07:38:07.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00af9c0 0x7f66a01f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66a00d0f40 0x7f66a00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66a016a010 con 0x7f66a00b7690 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0169e90 con 0x7f66a00af9c0 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f66a016a190 con 0x7f66a00d0f40 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48972/0 (socket says 172.21.15.64:48972) 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 -- 172.21.15.64:0/2664392968 learned_addr learned my addr 172.21.15.64:0/2664392968 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f669fe00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00af9c0 0x7f66a01f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a4c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66a00d0f40 0x7f66a00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 -- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66a00d0f40 msgr2=0x7f66a00c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66a00d0f40 0x7f66a00c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 -- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00af9c0 msgr2=0x7f66a01f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00af9c0 0x7f66a01f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 -- 172.21.15.64:0/2664392968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00af1f0 con 0x7f66a00b7690 2024-09-21T07:38:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f6697400640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f668800e7c0 tx=0x7f668800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668800ccc0 con 0x7f66a00b7690 2024-09-21T07:38:07.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f668800ee70 con 0x7f66a00b7690 2024-09-21T07:38:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688004270 con 0x7f66a00b7690 2024-09-21T07:38:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01f73d0 con 0x7f66a00b7690 2024-09-21T07:38:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a01f7990 con 0x7f66a00b7690 2024-09-21T07:38:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.182+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a00d05a0 con 0x7f66a00b7690 2024-09-21T07:38:07.184 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.186+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6688003600 con 0x7f66a00b7690 2024-09-21T07:38:07.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.186+0000 7f669cc00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 0x7f667c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.186+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f6688094ad0 con 0x7f66a00b7690 2024-09-21T07:38:07.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.186+0000 7f669fe00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 0x7f667c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.186+0000 7f669fe00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 0x7f667c075710 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f66900af000 tx=0x7f66900a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:07.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.190+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f668805f430 con 0x7f66a00b7690 2024-09-21T07:38:07.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.430+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f66a01f7160 con 0x7f66a00b7690 2024-09-21T07:38:07.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f669cc00640 1 -- 172.21.15.64:0/2664392968 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v38) ==== 190+0+147 (secure 0 0 0) 0x7f6688063e60 con 0x7f66a00b7690 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:38:07.434 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 msgr2=0x7f667c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 0x7f667c075710 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f66900af000 tx=0x7f66900a7040 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 msgr2=0x7f66a015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f668800e7c0 tx=0x7f668800ec80 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 shutdown_connections 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f667c073200 0x7f667c075710 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66a00d0f40 0x7f66a00c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66a00b7690 0x7f66a015ea60 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 --2- 172.21.15.64:0/2664392968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00af9c0 0x7f66a01f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 >> 172.21.15.64:0/2664392968 conn(0x7f66a00ceee0 msgr2=0x7f66a00afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:07.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 shutdown_connections 2024-09-21T07:38:07.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.434+0000 7f66a6c00640 1 -- 172.21.15.64:0/2664392968 wait complete. 2024-09-21T07:38:07.456 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:07.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 -- 172.21.15.64:0/2303652799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 msgr2=0x7fe22c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 --2- 172.21.15.64:0/2303652799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0cd140 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0712b0 tx=0x7fe22401cd80 comp rx=0 tx=0).stop 2024-09-21T07:38:07.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 -- 172.21.15.64:0/2303652799 shutdown_connections 2024-09-21T07:38:07.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 --2- 172.21.15.64:0/2303652799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0cd140 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 --2- 172.21.15.64:0/2303652799 >> v2:172.21.15.90:3300/0 conn(0x7fe22c0b3170 0x7fe22c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 --2- 172.21.15.64:0/2303652799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 0x7fe22c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 -- 172.21.15.64:0/2303652799 >> 172.21.15.64:0/2303652799 conn(0x7fe22c06d570 msgr2=0x7fe22c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 -- 172.21.15.64:0/2303652799 shutdown_connections 2024-09-21T07:38:07.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.614+0000 7fe232600640 1 -- 172.21.15.64:0/2303652799 wait complete. 2024-09-21T07:38:07.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 Processor -- start 2024-09-21T07:38:07.616 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- start start 2024-09-21T07:38:07.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 0x7fe22c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe22c0b3170 0x7fe22c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c168d40 con 0x7fe22c0ccd30 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c168bc0 con 0x7fe22c0b3170 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c168ec0 con 0x7fe22c0b28e0 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49002/0 (socket says 172.21.15.64:49002) 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 -- 172.21.15.64:0/756706180 learned_addr learned my addr 172.21.15.64:0/756706180 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22b400640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 0x7fe22c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe223e00640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe22c0b3170 0x7fe22c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 -- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 msgr2=0x7fe22c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 0x7fe22c157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 -- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe22c0b3170 msgr2=0x7fe22c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe22c0b3170 0x7fe22c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 -- 172.21.15.64:0/756706180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0ae1a0 con 0x7fe22c0ccd30 2024-09-21T07:38:07.619 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe22be00640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7fe22401b430 tx=0x7fe224005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:07.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240bb070 con 0x7fe22c0ccd30 2024-09-21T07:38:07.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe224004d40 con 0x7fe22c0ccd30 2024-09-21T07:38:07.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c157d80 con 0x7fe22c0ccd30 2024-09-21T07:38:07.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240b2040 con 0x7fe22c0ccd30 2024-09-21T07:38:07.620 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c0ae980 con 0x7fe22c0ccd30 2024-09-21T07:38:07.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.618+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c0ae410 con 0x7fe22c0ccd30 2024-09-21T07:38:07.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.622+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe2240be070 con 0x7fe22c0ccd30 2024-09-21T07:38:07.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.622+0000 7fe223400640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 0x7fe208075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:07.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.622+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7fe22412e0b0 con 0x7fe22c0ccd30 2024-09-21T07:38:07.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.622+0000 7fe22b400640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 0x7fe208075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:07.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.622+0000 7fe22b400640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 0x7fe208075710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe21c004630 tx=0x7fe21c00b260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.626+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe224016970 con 0x7fe22c0ccd30 2024-09-21T07:38:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.842+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe22c0b3580 con 0x7fe22c0ccd30 2024-09-21T07:38:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.842+0000 7fe223400640 1 -- 172.21.15.64:0/756706180 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7fe2240f88e0 con 0x7fe22c0ccd30 2024-09-21T07:38:07.843 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:07.844 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:07.844 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 msgr2=0x7fe208075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 0x7fe208075710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe21c004630 tx=0x7fe21c00b260 comp rx=0 tx=0).stop 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 msgr2=0x7fe22c0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7fe22401b430 tx=0x7fe224005b00 comp rx=0 tx=0).stop 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 shutdown_connections 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe208073200 0x7fe208075710 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe22c0ccd30 0x7fe22c0c94a0 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe22c0b3170 0x7fe22c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 --2- 172.21.15.64:0/756706180 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe22c0b28e0 0x7fe22c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:07.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 >> 172.21.15.64:0/756706180 conn(0x7fe22c06d570 msgr2=0x7fe22c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:07.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 shutdown_connections 2024-09-21T07:38:07.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:07.846+0000 7fe232600640 1 -- 172.21.15.64:0/756706180 wait complete. 2024-09-21T07:38:08.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 160, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:37:57.095178+0000', 'modified': '2024-09-21T07:38:00.126957+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11316}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11316': {'gid': 11316, 'name': 'c', 'rank': 0, 'incarnation': 156, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/619754157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 619754157}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 619754157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11316, 'qdb_cluster': [11316]} 2024-09-21T07:38:08.269 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:38:08.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:38:08.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- 172.21.15.64:0/326075955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc071680 msgr2=0x7f9acc071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.429 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/326075955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc071680 0x7f9acc071a90 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009900 tx=0x7f9ab401c750 comp rx=0 tx=0).stop 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- 172.21.15.64:0/326075955 shutdown_connections 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/326075955 >> v2:172.21.15.90:3300/0 conn(0x7f9acc151d90 0x7f9acc1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/326075955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc071680 0x7f9acc071a90 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- 172.21.15.64:0/326075955 >> 172.21.15.64:0/326075955 conn(0x7f9acc0b29e0 msgr2=0x7f9acc0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- 172.21.15.64:0/326075955 shutdown_connections 2024-09-21T07:38:08.430 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- 172.21.15.64:0/326075955 wait complete. 2024-09-21T07:38:08.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 Processor -- start 2024-09-21T07:38:08.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.430+0000 7f9ad2e00640 1 -- start start 2024-09-21T07:38:08.433 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9acc071680 0x7f9acc144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9acc15fc60 0x7f9acc147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc0b4eb0 con 0x7f9acc151d90 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc0b4d30 con 0x7f9acc15fc60 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc0b5030 con 0x7f9acc071680 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49026/0 (socket says 172.21.15.64:49026) 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 -- 172.21.15.64:0/3278386148 learned_addr learned my addr 172.21.15.64:0/3278386148 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9acc15fc60 0x7f9acc147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9acbe00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9acc071680 0x7f9acc144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.434 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 -- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9acc071680 msgr2=0x7f9acc144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9acc071680 0x7f9acc144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 -- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9acc15fc60 msgr2=0x7f9acc147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9acc15fc60 0x7f9acc147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 -- 172.21.15.64:0/3278386148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc155c10 con 0x7f9acc151d90 2024-09-21T07:38:08.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40b0040 tx=0x7f9ab40a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac8c00640 1 -- 172.21.15.64:0/3278386148 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b2040 con 0x7f9acc151d90 2024-09-21T07:38:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac8c00640 1 -- 172.21.15.64:0/3278386148 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab4004400 con 0x7f9acc151d90 2024-09-21T07:38:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ac8c00640 1 -- 172.21.15.64:0/3278386148 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4005290 con 0x7f9acc151d90 2024-09-21T07:38:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc155ef0 con 0x7f9acc151d90 2024-09-21T07:38:08.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.434+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc14a540 con 0x7f9acc151d90 2024-09-21T07:38:08.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ac8c00640 1 -- 172.21.15.64:0/3278386148 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ab4005430 con 0x7f9acc151d90 2024-09-21T07:38:08.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ac8c00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 0x7f9aa8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ac8c00640 1 -- 172.21.15.64:0/3278386148 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f9ab412e230 con 0x7f9acc151d90 2024-09-21T07:38:08.438 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9acbe00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 0x7f9aa8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ada3bd000 1 Processor -- start 2024-09-21T07:38:08.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ada3bd000 1 -- start start 2024-09-21T07:38:08.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9acbe00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 0x7f9aa8075710 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007fd0 tx=0x7f9abc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.438+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda21f950 0x55bcda370be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 0x55bcda371120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bcda245410 con 0x55bcd9e2f460 2024-09-21T07:38:08.441 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcda182b40 con 0x55bcda208ca0 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bcda171f70 con 0x55bcda21f950 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49042/0 (socket says 172.21.15.64:49042) 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 -- 172.21.15.64:0/1076065565 learned_addr learned my addr 172.21.15.64:0/1076065565 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda21f950 0x55bcda370be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 0x55bcda371120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 -- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda21f950 msgr2=0x55bcda370be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda21f950 0x55bcda370be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 -- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 msgr2=0x55bcda371120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 0x55bcda371120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 -- 172.21.15.64:0/1076065565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcda1395b0 con 0x55bcd9e2f460 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 0x55bcda371120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00f990 tx=0x7f9abc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9601e75a57cd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ac0c00640 1 -- 172.21.15.64:0/1076065565 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc025070 con 0x55bcd9e2f460 2024-09-21T07:38:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ac0c00640 1 -- 172.21.15.64:0/1076065565 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9abc01b050 con 0x55bcd9e2f460 2024-09-21T07:38:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ac0c00640 1 -- 172.21.15.64:0/1076065565 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc014e40 con 0x55bcd9e2f460 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1076065565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 msgr2=0x55bcda3706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00f990 tx=0x7f9abc012000 comp rx=0 tx=0).stop 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1076065565 shutdown_connections 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda208ca0 0x55bcda371120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda21f950 0x55bcda370be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1076065565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda3706a0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1076065565 >> 172.21.15.64:0/1076065565 conn(0x55bcda2f5d90 msgr2=0x55bcda325690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1076065565 shutdown_connections 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1076065565 wait complete. 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 -- start start 2024-09-21T07:38:08.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.442+0000 7f9ada3bd000 1 Processor -- start 2024-09-21T07:38:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda208ca0 0x55bcda377e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bcda10c5f0 con 0x55bcd9e2f460 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcda175d80 con 0x55bcda21f950 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bcda118520 con 0x55bcda208ca0 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 10 client.0 _ll_register_callbacks cb 0x55bcda11c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49056/0 (socket says 172.21.15.64:49056) 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 -- 172.21.15.64:0/887857633 learned_addr learned my addr 172.21.15.64:0/887857633 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda208ca0 0x55bcda377e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 -- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda208ca0 msgr2=0x55bcda377e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda208ca0 0x55bcda377e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 -- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 msgr2=0x55bcda3783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3783a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 -- 172.21.15.64:0/887857633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcda110190 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9acbe00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f9abc020000 tx=0x7f9abc021b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22065a9f963676ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc025040 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f9abc029440 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bcda10a110 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f9abc029680 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 10 client.11460 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55bcda1f6f10 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bcda10a110 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f9abc029820 con 0x55bcd9e2f460 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 10 client.11460 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:08.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 10 client.11460 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:38:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 20 client.11460 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e147d0 0x55bcda381d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 4 client.11460 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcda184a90 con 0x55bcd9e147d0 2024-09-21T07:38:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e147d0 0x55bcda381d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e147d0 0x55bcda381d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385991e51f8d59f1 server_cookie=b94dfa3a77990fad in_seq=0 out_seq=0 2024-09-21T07:38:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.446+0000 7f9ab9600640 10 client.11460 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ab9600640 1 -- 172.21.15.64:0/887857633 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcda184a90 con 0x55bcd9e147d0 2024-09-21T07:38:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ab9600640 10 client.11460 handle_command_reply: tid=0 2024-09-21T07:38:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 client.11460 shutdown 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 msgr2=0x55bcda377920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f9abc020000 tx=0x7f9abc021b40 comp rx=0 tx=0).stop 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 shutdown_connections 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e147d0 0x55bcda381d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcda208ca0 0x55bcda377e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/887857633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcd9e2f460 0x55bcda377920 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ab9600640 0 client.11460 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 >> 172.21.15.64:0/887857633 conn(0x55bcda2f5d90 msgr2=0x55bcda32c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 shutdown_connections 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 1 -- 172.21.15.64:0/887857633 wait complete. 2024-09-21T07:38:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.450+0000 7f9ada3bd000 20 client.11460 trim_cache size 0 max 16384 2024-09-21T07:38:08.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 Processor -- start 2024-09-21T07:38:08.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- start start 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3263f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda326e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc205e20 con 0x55bcda208ca0 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc204e60 con 0x55bcda21f950 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc1fd670 con 0x55bcd9e2f460 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49058/0 (socket says 172.21.15.64:49058) 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 -- 172.21.15.64:0/45194305 learned_addr learned my addr 172.21.15.64:0/45194305 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9acbe00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3263f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda326e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 -- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 msgr2=0x55bcda3263f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3263f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 -- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 msgr2=0x55bcda326e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda326e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 -- 172.21.15.64:0/45194305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcda1cddb0 con 0x55bcda208ca0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda326e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9acbe00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3263f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4098330 tx=0x7f9ab40fc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0df69f973d9811 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9abbe00640 1 -- 172.21.15.64:0/45194305 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40f8600 con 0x55bcda208ca0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9abbe00640 1 -- 172.21.15.64:0/45194305 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab40f8af0 con 0x55bcda208ca0 2024-09-21T07:38:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9abbe00640 1 -- 172.21.15.64:0/45194305 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40fd520 con 0x55bcda208ca0 2024-09-21T07:38:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- 172.21.15.64:0/45194305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 msgr2=0x55bcda326930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4098330 tx=0x7f9ab40fc040 comp rx=0 tx=0).stop 2024-09-21T07:38:08.473 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- 172.21.15.64:0/45194305 shutdown_connections 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda326e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda326930 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/45194305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3263f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- 172.21.15.64:0/45194305 >> 172.21.15.64:0/45194305 conn(0x55bcda2f5d90 msgr2=0x55bcda324cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- 172.21.15.64:0/45194305 shutdown_connections 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.470+0000 7f9ada3bd000 1 -- 172.21.15.64:0/45194305 wait complete. 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 -- start start 2024-09-21T07:38:08.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 Processor -- start 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55bcda181910 con 0x55bcda208ca0 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcda13dee0 con 0x55bcda21f950 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55bcda17a3b0 con 0x55bcd9e2f460 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 10 client.0 _ll_register_callbacks cb 0x7f9abc023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49064/0 (socket says 172.21.15.64:49064) 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 -- 172.21.15.64:0/1840981193 learned_addr learned my addr 172.21.15.64:0/1840981193 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ad0e00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 -- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 msgr2=0x55bcda3e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 -- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 msgr2=0x55bcda3e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 -- 172.21.15.64:0/1840981193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcda138ab0 con 0x55bcda208ca0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ac3e00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40f8a80 tx=0x7f9ab40f86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261db694b9056ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ab9600640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40fd520 con 0x55bcda208ca0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f9ab411bd70 con 0x55bcda208ca0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.474+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ab40f8af0 con 0x55bcda208ca0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f9ab40f4d60 con 0x55bcda208ca0 2024-09-21T07:38:08.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 10 client.11466 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55bcda117070 con 0x55bcda208ca0 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab40f8af0 con 0x55bcda208ca0 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f9ab40fd120 con 0x55bcda208ca0 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 10 client.11466 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 10 client.11466 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 20 client.11466 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e02830 0x55bcda3a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 4 client.11466 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "status"}) -- 0x55bcda180540 con 0x55bcd9e02830 2024-09-21T07:38:08.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e02830 0x55bcda3a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9acbe00640 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e02830 0x55bcda3a16e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b359b0a5bd54c725 server_cookie=55ed005e9db3d58d in_seq=0 out_seq=0 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 10 client.11466 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 1 -- 172.21.15.64:0/1840981193 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55bcda180540 con 0x55bcd9e02830 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 10 client.11466 handle_command_reply: tid=0 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 client.11466 shutdown 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 msgr2=0x55bcda3e6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40f8a80 tx=0x7f9ab40f86f0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 shutdown_connections 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55bcd9e02830 0x55bcda3a16e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bcda21f950 0x55bcda3e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55bcda208ca0 0x55bcda3e6570 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ab9600640 0 client.11466 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 --2- 172.21.15.64:0/1840981193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55bcd9e2f460 0x55bcda3e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 >> 172.21.15.64:0/1840981193 conn(0x55bcda2f5d90 msgr2=0x55bcda3816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 shutdown_connections 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 1 -- 172.21.15.64:0/1840981193 wait complete. 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ada3bd000 20 client.11466 trim_cache size 0 max 16384 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 11316, 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:38:08.482 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.815064911, 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 160, 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 218, 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 218, 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.96764694 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:08.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 msgr2=0x7f9aa8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 0x7f9aa8075710 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007fd0 tx=0x7f9abc009040 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 msgr2=0x7f9acc146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40b0040 tx=0x7f9ab40a5720 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 shutdown_connections 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073200 0x7f9aa8075710 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9acc15fc60 0x7f9acc147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9acc151d90 0x7f9acc146b50 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 --2- 172.21.15.64:0/3278386148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9acc071680 0x7f9acc144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 >> 172.21.15.64:0/3278386148 conn(0x7f9acc0b29e0 msgr2=0x7f9acc0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 shutdown_connections 2024-09-21T07:38:08.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.478+0000 7f9ad2e00640 1 -- 172.21.15.64:0/3278386148 wait complete. 2024-09-21T07:38:08.498 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 -- 172.21.15.64:0/2748152136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 msgr2=0x7fcc0015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 --2- 172.21.15.64:0/2748152136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc0015c6f0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009840 tx=0x7fcbf001c820 comp rx=0 tx=0).stop 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 -- 172.21.15.64:0/2748152136 shutdown_connections 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 --2- 172.21.15.64:0/2748152136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000b3170 0x7fcc000b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 --2- 172.21.15.64:0/2748152136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc0015c6f0 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 -- 172.21.15.64:0/2748152136 >> 172.21.15.64:0/2748152136 conn(0x7fcc0006d570 msgr2=0x7fcc000b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 -- 172.21.15.64:0/2748152136 shutdown_connections 2024-09-21T07:38:08.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 -- 172.21.15.64:0/2748152136 wait complete. 2024-09-21T07:38:08.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.658+0000 7fcc07400640 1 Processor -- start 2024-09-21T07:38:08.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- start start 2024-09-21T07:38:08.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 0x7fcc00151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 0x7fcc00152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00169ee0 con 0x7fcc000b28e0 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00169d60 con 0x7fcc000b3170 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0016a060 con 0x7fcc000ccd30 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49082/0 (socket says 172.21.15.64:49082) 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 -- 172.21.15.64:0/3976259738 learned_addr learned my addr 172.21.15.64:0/3976259738 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc05400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 0x7fcc00152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcbf7e00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 0x7fcc00151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 -- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 msgr2=0x7fcc00152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 0x7fcc00152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 -- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 msgr2=0x7fcc00151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 0x7fcc00151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 -- 172.21.15.64:0/3976259738 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc00159580 con 0x7fcc000b28e0 2024-09-21T07:38:08.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc05400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 0x7fcc00152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:08.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcbf7e00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 0x7fcc00151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:08.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc04a00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001cd00 tx=0x7fcbf0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00b2040 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbf00bb070 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc000ad2f0 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0003600 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc00152720 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.662+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0015c6f0 con 0x7fcc000b28e0 2024-09-21T07:38:08.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.666+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcbf00037a0 con 0x7fcc000b28e0 2024-09-21T07:38:08.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.666+0000 7fcbfd600640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 0x7fcbdc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:08.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.666+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7fcbf012e7f0 con 0x7fcc000b28e0 2024-09-21T07:38:08.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.666+0000 7fcbf7e00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 0x7fcbdc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:08.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.666+0000 7fcbf7e00640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 0x7fcbdc075710 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcc0015a250 tx=0x7fcbe80091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:08.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.670+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcbf0016410 con 0x7fcc000b28e0 2024-09-21T07:38:08.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc000cc1e0 con 0x7fcc000b28e0 2024-09-21T07:38:08.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcbfd600640 1 -- 172.21.15.64:0/3976259738 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v160) ==== 53+0+73 (secure 0 0 0) 0x7fcbf00f9700 con 0x7fcc000b28e0 2024-09-21T07:38:08.885 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 msgr2=0x7fcbdc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 0x7fcbdc075710 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcc0015a250 tx=0x7fcbe80091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 msgr2=0x7fcc000aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001cd00 tx=0x7fcbf0005d20 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 shutdown_connections 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcbdc073200 0x7fcbdc075710 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc000ccd30 0x7fcc00152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc000b3170 0x7fcc00151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 --2- 172.21.15.64:0/3976259738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc000b28e0 0x7fcc000aeac0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 >> 172.21.15.64:0/3976259738 conn(0x7fcc0006d570 msgr2=0x7fcc00068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 shutdown_connections 2024-09-21T07:38:08.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:08.886+0000 7fcc07400640 1 -- 172.21.15.64:0/3976259738 wait complete. 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:08.908 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:38:08.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:38:08.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:38:08.909 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:08.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:08.909 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:08.918 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41495sec preferred_lft 41495sec 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.919 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:38:08.920 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:08.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:08.921 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:38:08.985 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:38:08.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:08.988 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:38:09.047 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:09.048 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:09.048 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:09.048 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:38:09.048 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:38:09.134 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:38:09.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:38:09.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:09.184 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:38:09.193 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:38:09.193 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:38:09.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:09.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:09.194 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:38:09.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:38:09.259 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:09.307 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:09.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:38:09.308 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:09.359 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:38:09.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:09.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:09.460 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:09.460 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:38:09.474 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:09.475 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:38:09.475 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:38:09.475 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:38:09.475 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:38:09.479 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:38:09.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:09.479 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:09.499 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:38:09.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:38:09.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:38:09.607 INFO:teuthology.orchestra.run.smithi064.stdout:client9443 2024-09-21T07:38:09.607 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:09.607 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:09.616 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:09.616 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> stdin-killer -- python3 -c ' 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> import os 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> import uuid 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> n = 1000 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = False 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> if 0 > 0: 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> create_hard_links = True 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:38:09.668 DEBUG:teuthology.orchestra.run.smithi064:> dpath = os.path.dirname(path) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> fnameprefix = os.path.basename(path) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> try: 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> for i in range(n): 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> f.write(f"{i}") 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> f.flush() 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(f.fileno()) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> os.unlink(fpath) 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:38:09.669 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> if create_hard_links: 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> for j in range(0): 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> if False: 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> os.fsync(dirfd) 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> finally: 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> os.close(dirfd) 2024-09-21T07:38:09.670 DEBUG:teuthology.orchestra.run.smithi064:> ' 2024-09-21T07:38:10.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:38:10.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:10.701 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.15:0 scrub status 2024-09-21T07:38:10.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:10.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- 172.21.15.64:0/4205777074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e180b4e00 msgr2=0x7f2e180af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/4205777074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e180b4e00 0x7f2e180af790 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009840 tx=0x7f2e0001c660 comp rx=0 tx=0).stop 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- 172.21.15.64:0/4205777074 shutdown_connections 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/4205777074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e180b4e00 0x7f2e180af790 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- 172.21.15.64:0/4205777074 >> 172.21.15.64:0/4205777074 conn(0x7f2e1806d570 msgr2=0x7f2e180b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- 172.21.15.64:0/4205777074 shutdown_connections 2024-09-21T07:38:10.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- 172.21.15.64:0/4205777074 wait complete. 2024-09-21T07:38:10.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 Processor -- start 2024-09-21T07:38:10.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.910+0000 7f2e1cc00640 1 -- start start 2024-09-21T07:38:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e180caf00 0x7f2e18157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e181fc8e0 0x7f2e18157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18169f00 con 0x7f2e1806fae0 2024-09-21T07:38:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18169d80 con 0x7f2e181fc8e0 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1816a080 con 0x7f2e180caf00 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49088/0 (socket says 172.21.15.64:49088) 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 -- 172.21.15.64:0/1650546402 learned_addr learned my addr 172.21.15.64:0/1650546402 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e180caf00 0x7f2e18157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e16800640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e181fc8e0 0x7f2e18157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 -- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e180caf00 msgr2=0x7f2e18157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e180caf00 0x7f2e18157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 -- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e181fc8e0 msgr2=0x7f2e18157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e181fc8e0 0x7f2e18157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 -- 172.21.15.64:0/1650546402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e181fbe40 con 0x7f2e1806fae0 2024-09-21T07:38:10.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e15e00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c760 tx=0x7f2e0800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e0e000640 1 -- 172.21.15.64:0/1650546402 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005480 con 0x7f2e1806fae0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e0e000640 1 -- 172.21.15.64:0/1650546402 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e0800a640 con 0x7f2e1806fae0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e180d0fe0 con 0x7f2e1806fae0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e0e000640 1 -- 172.21.15.64:0/1650546402 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800aa90 con 0x7f2e1806fae0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.914+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e180d0a70 con 0x7f2e1806fae0 2024-09-21T07:38:10.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e0e000640 1 -- 172.21.15.64:0/1650546402 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e0800ac30 con 0x7f2e1806fae0 2024-09-21T07:38:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e0e000640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 0x7f2df4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e0e000640 1 -- 172.21.15.64:0/1650546402 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2e080941f0 con 0x7f2e1806fae0 2024-09-21T07:38:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 0x7f2df4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 Processor -- start 2024-09-21T07:38:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 -- start start 2024-09-21T07:38:10.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 0x7f2df4075710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2e000af000 tx=0x7f2e000b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97321c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972d07890 0x55c97321cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c9730bbcd0 con 0x55c972dcbaa0 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c972fd1330 con 0x55c9730b06d0 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.918+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c97302ebb0 con 0x55c972d07890 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49100/0 (socket says 172.21.15.64:49100) 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 -- 172.21.15.64:0/4281938724 learned_addr learned my addr 172.21.15.64:0/4281938724 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972d07890 0x55c97321cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e15e00640 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97321c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 -- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972d07890 msgr2=0x55c97321cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972d07890 0x55c97321cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 -- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 msgr2=0x55c97321c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97321c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 -- 172.21.15.64:0/4281938724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c972fd2c80 con 0x55c972dcbaa0 2024-09-21T07:38:10.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e16800640 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001db0 tx=0x7f2e1000f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a564c8c861e318a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e06600640 1 -- 172.21.15.64:0/4281938724 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000fc10 con 0x55c972dcbaa0 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e06600640 1 -- 172.21.15.64:0/4281938724 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e10018070 con 0x55c972dcbaa0 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e06600640 1 -- 172.21.15.64:0/4281938724 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10003be0 con 0x55c972dcbaa0 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- 172.21.15.64:0/4281938724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 msgr2=0x55c97321d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001db0 tx=0x7f2e1000f1d0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- 172.21.15.64:0/4281938724 shutdown_connections 2024-09-21T07:38:10.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972dcbaa0 0x55c97321d470 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972d07890 0x55c97321cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 --2- 172.21.15.64:0/4281938724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97321c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- 172.21.15.64:0/4281938724 >> 172.21.15.64:0/4281938724 conn(0x55c972cdb5c0 msgr2=0x55c9731d9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- 172.21.15.64:0/4281938724 shutdown_connections 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- 172.21.15.64:0/4281938724 wait complete. 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 -- start start 2024-09-21T07:38:10.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.922+0000 7f2e24405000 1 Processor -- start 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c9731d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c9731df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c973021df0 con 0x55c972d07890 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c97301dfe0 con 0x55c9730b06d0 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c972fc34d0 con 0x55c972dcbaa0 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 10 client.0 _ll_register_callbacks cb 0x55c972fa17f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:10.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49110/0 (socket says 172.21.15.64:49110) 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 -- 172.21.15.64:0/2410694016 learned_addr learned my addr 172.21.15.64:0/2410694016 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e16800640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c9731df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c9731d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 -- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 msgr2=0x55c9731d8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c9731d8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 -- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 msgr2=0x55c9731df5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c9731df5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 -- 172.21.15.64:0/2410694016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c972fbc210 con 0x55c972d07890 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c9731d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c730 tx=0x7f2e0805efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ab85fb5325ccb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0805de70 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2e0805a360 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c972fb6350 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f2e0805e520 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 10 client.11487 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55c972fa2fc0 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c972fb6350 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f2e0805a560 con 0x55c972d07890 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 10 client.11487 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 10 client.11487 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 20 client.11487 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cc0930 0x55c973223e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 4 client.11487 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c973030b00 con 0x55c972cc0930 2024-09-21T07:38:10.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cc0930 0x55c973223e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cc0930 0x55c973223e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3add6c62d278bd4c server_cookie=9f9fb14adbe50ff5 in_seq=0 out_seq=0 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.926+0000 7f2dfaa00640 10 client.11487 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2dfaa00640 1 -- 172.21.15.64:0/2410694016 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c973030b00 con 0x55c972cc0930 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2dfaa00640 10 client.11487 handle_command_reply: tid=0 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 client.11487 shutdown 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 msgr2=0x55c9731d89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c730 tx=0x7f2e0805efb0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 shutdown_connections 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cc0930 0x55c973223e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c9731df5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c9731d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 --2- 172.21.15.64:0/2410694016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c9731d89b0 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2dfaa00640 0 client.11487 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:10.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 >> 172.21.15.64:0/2410694016 conn(0x55c972cdb5c0 msgr2=0x55c9731d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 shutdown_connections 2024-09-21T07:38:10.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 1 -- 172.21.15.64:0/2410694016 wait complete. 2024-09-21T07:38:10.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.930+0000 7f2e24405000 20 client.11487 trim_cache size 0 max 16384 2024-09-21T07:38:10.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.946+0000 7f2e24405000 1 Processor -- start 2024-09-21T07:38:10.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.946+0000 7f2e24405000 1 -- start start 2024-09-21T07:38:10.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c97328e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97328ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c9731d7b20 con 0x55c972d07890 2024-09-21T07:38:10.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18205910 con 0x55c9730b06d0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2e18204930 con 0x55c972dcbaa0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49116/0 (socket says 172.21.15.64:49116) 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 -- 172.21.15.64:0/2495607808 learned_addr learned my addr 172.21.15.64:0/2495607808 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c97328e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e16800640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97328ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 -- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 msgr2=0x55c97328e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c97328e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 -- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 msgr2=0x55c97328ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97328ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 -- 172.21.15.64:0/2495607808 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97307b680 con 0x55c972d07890 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e16800640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97328ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e15e00640 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f2e0805aac0 tx=0x7f2e080841c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3705b687d40f170d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e05c00640 1 -- 172.21.15.64:0/2495607808 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0805de70 con 0x55c972d07890 2024-09-21T07:38:10.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e05c00640 1 -- 172.21.15.64:0/2495607808 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e08080170 con 0x55c972d07890 2024-09-21T07:38:10.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e05c00640 1 -- 172.21.15.64:0/2495607808 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0805a580 con 0x55c972d07890 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- 172.21.15.64:0/2495607808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 msgr2=0x55c97328e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f2e0805aac0 tx=0x7f2e080841c0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- 172.21.15.64:0/2495607808 shutdown_connections 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9730b06d0 0x55c97328ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c972dcbaa0 0x55c97328e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 --2- 172.21.15.64:0/2495607808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c97328e400 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- 172.21.15.64:0/2495607808 >> 172.21.15.64:0/2495607808 conn(0x55c972cdb5c0 msgr2=0x55c97322efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- 172.21.15.64:0/2495607808 shutdown_connections 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.950+0000 7f2e24405000 1 -- 172.21.15.64:0/2495607808 wait complete. 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- start start 2024-09-21T07:38:10.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 Processor -- start 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 0x55c973292b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 0x55c9732930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e182042e0 con 0x55c972d07890 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e181f9430 con 0x55c972dcbaa0 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c972ce3680 con 0x55c9730b06d0 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 10 client.0 _ll_register_callbacks cb 0x7f2e0805a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49126/0 (socket says 172.21.15.64:49126) 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 -- 172.21.15.64:0/3847083917 learned_addr learned my addr 172.21.15.64:0/3847083917 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:10.956 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e16800640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 0x55c9732930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 0x55c973292b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 -- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 msgr2=0x55c9732930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 0x55c9732930d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 -- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 msgr2=0x55c973292b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 0x55c973292b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 -- 172.21.15.64:0/3847083917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c972fe80b0 con 0x55c972d07890 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e16800640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 0x55c9732930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 0x55c973292b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e15e00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f2e0805e9a0 tx=0x7f2e0805a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befd3810c8e5b903 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0805ea10 con 0x55c972d07890 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2e08074a90 con 0x55c972d07890 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e08080170 con 0x55c972d07890 2024-09-21T07:38:10.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f2e08063440 con 0x55c972d07890 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 10 client.11493 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55c972fb4610 con 0x55c972d07890 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e08080170 con 0x55c972d07890 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f2e08074c90 con 0x55c972d07890 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 10 client.11493 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 10 client.11493 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 20 client.11493 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cae990 0x55c9731d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 4 client.11493 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.954+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c97302c5b0 con 0x55c972cae990 2024-09-21T07:38:10.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cae990 0x55c9731d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:10.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e0fe00640 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cae990 0x55c9731d38c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd607280387bfc27 server_cookie=c1385c5cb1915eec in_seq=0 out_seq=0 2024-09-21T07:38:10.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2dfaa00640 10 client.11493 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2dfaa00640 1 -- 172.21.15.64:0/3847083917 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86 (crc 0 0 0) 0x55c97302c5b0 con 0x55c972cae990 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2dfaa00640 10 client.11493 handle_command_reply: tid=0 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 client.11493 shutdown 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 msgr2=0x55c973292650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f2e0805e9a0 tx=0x7f2e0805a590 comp rx=0 tx=0).stop 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 shutdown_connections 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x55c972cae990 0x55c9731d38c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9730b06d0 0x55c9732930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2dfaa00640 0 client.11493 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c972dcbaa0 0x55c973292b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 --2- 172.21.15.64:0/3847083917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c972d07890 0x55c973292650 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 >> 172.21.15.64:0/3847083917 conn(0x55c972cdb5c0 msgr2=0x55c9731de5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 shutdown_connections 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 1 -- 172.21.15.64:0/3847083917 wait complete. 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e24405000 20 client.11493 trim_cache size 0 max 16384 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": {} 2024-09-21T07:38:10.961 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 msgr2=0x7f2df4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 0x7f2df4075710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2e000af000 tx=0x7f2e000b2040 comp rx=0 tx=0).stop 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 msgr2=0x7f2e180ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c760 tx=0x7f2e0800cc20 comp rx=0 tx=0).stop 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 shutdown_connections 2024-09-21T07:38:10.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2df4073200 0x7f2df4075710 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e181fc8e0 0x7f2e18157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e180caf00 0x7f2e18157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 --2- 172.21.15.64:0/1650546402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e1806fae0 0x7f2e180ae560 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 >> 172.21.15.64:0/1650546402 conn(0x7f2e1806d570 msgr2=0x7f2e18072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 shutdown_connections 2024-09-21T07:38:10.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:10.958+0000 7f2e1cc00640 1 -- 172.21.15.64:0/1650546402 wait complete. 2024-09-21T07:38:10.977 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:38:10.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.15:0 damage ls 2024-09-21T07:38:11.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- 172.21.15.64:0/3291925823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00cc730 msgr2=0x7f21b00b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3291925823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00cc730 0x7f21b00b3170 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f21b00cc010 tx=0x7f219c01cf30 comp rx=0 tx=0).stop 2024-09-21T07:38:11.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- 172.21.15.64:0/3291925823 shutdown_connections 2024-09-21T07:38:11.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3291925823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00cc730 0x7f21b00b3170 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- 172.21.15.64:0/3291925823 >> 172.21.15.64:0/3291925823 conn(0x7f21b00d0320 msgr2=0x7f21b00d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- 172.21.15.64:0/3291925823 shutdown_connections 2024-09-21T07:38:11.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- 172.21.15.64:0/3291925823 wait complete. 2024-09-21T07:38:11.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 Processor -- start 2024-09-21T07:38:11.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.182+0000 7f21b7c00640 1 -- start start 2024-09-21T07:38:11.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00b36b0 0x7f21b0090b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21b00cc730 0x7f21b0094750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0179eb0 con 0x7f21b00cc320 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0179d30 con 0x7f21b00b36b0 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f21b017a030 con 0x7f21b00cc730 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49132/0 (socket says 172.21.15.64:49132) 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 -- 172.21.15.64:0/3953147317 learned_addr learned my addr 172.21.15.64:0/3953147317 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b5200640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00b36b0 0x7f21b0090b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b5c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21b00cc730 0x7f21b0094750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 -- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21b00cc730 msgr2=0x7f21b0094750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21b00cc730 0x7f21b0094750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 -- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00b36b0 msgr2=0x7f21b0090b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00b36b0 0x7f21b0090b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 -- 172.21.15.64:0/3953147317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b0091380 con 0x7f21b00cc320 2024-09-21T07:38:11.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21afe00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c10 tx=0x7f219c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21acc00640 1 -- 172.21.15.64:0/3953147317 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0bc070 con 0x7f21b00cc320 2024-09-21T07:38:11.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21acc00640 1 -- 172.21.15.64:0/3953147317 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219c00b5d0 con 0x7f21b00cc320 2024-09-21T07:38:11.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b0091660 con 0x7f21b00cc320 2024-09-21T07:38:11.187 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21acc00640 1 -- 172.21.15.64:0/3953147317 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b2040 con 0x7f21b00cc320 2024-09-21T07:38:11.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.186+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b020a240 con 0x7f21b00cc320 2024-09-21T07:38:11.188 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21acc00640 1 -- 172.21.15.64:0/3953147317 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f219c0bf070 con 0x7f21b00cc320 2024-09-21T07:38:11.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21acc00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 0x7f2190075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.189 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21acc00640 1 -- 172.21.15.64:0/3953147317 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f219c12ddb0 con 0x7f21b00cc320 2024-09-21T07:38:11.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21b5200640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 0x7f2190075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 Processor -- start 2024-09-21T07:38:11.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 -- start start 2024-09-21T07:38:11.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21b5200640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 0x7f2190075710 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f21a4000fc0 tx=0x7f21a4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afaaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56028ae48d50 con 0x56028ae38320 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56028adbcb10 con 0x56028ae31db0 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.190+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56028adabf40 con 0x56028ae315a0 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49138/0 (socket says 172.21.15.64:49138) 2024-09-21T07:38:11.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 -- 172.21.15.64:0/4130660941 learned_addr learned my addr 172.21.15.64:0/4130660941 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21afe00640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afaaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5c00640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 -- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 msgr2=0x56028afaaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afaaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 -- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 msgr2=0x56028afab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 -- 172.21.15.64:0/4130660941 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028ad2d120 con 0x56028ae38320 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5c00640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21b5200640 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f21a400fb50 tx=0x7f21a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14da459838b57ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21a1600640 1 -- 172.21.15.64:0/4130660941 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4025070 con 0x56028ae38320 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21a1600640 1 -- 172.21.15.64:0/4130660941 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21a401b050 con 0x56028ae38320 2024-09-21T07:38:11.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21a1600640 1 -- 172.21.15.64:0/4130660941 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4014e00 con 0x56028ae38320 2024-09-21T07:38:11.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- 172.21.15.64:0/4130660941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 msgr2=0x56028afaa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f21a400fb50 tx=0x7f21a4012000 comp rx=0 tx=0).stop 2024-09-21T07:38:11.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- 172.21.15.64:0/4130660941 shutdown_connections 2024-09-21T07:38:11.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afaaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 --2- 172.21.15.64:0/4130660941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae38320 0x56028afaa960 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- 172.21.15.64:0/4130660941 >> 172.21.15.64:0/4130660941 conn(0x56028aa69920 msgr2=0x56028af8de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- 172.21.15.64:0/4130660941 shutdown_connections 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- 172.21.15.64:0/4130660941 wait complete. 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 -- start start 2024-09-21T07:38:11.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.194+0000 7f21bf429000 1 Processor -- start 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae315a0 0x56028af8cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae38320 0x56028af8d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56028ad51500 con 0x56028ae31db0 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56028adafd50 con 0x56028ae315a0 2024-09-21T07:38:11.201 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56028aa71680 con 0x56028ae38320 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 10 client.0 _ll_register_callbacks cb 0x56028af4c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49142/0 (socket says 172.21.15.64:49142) 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 -- 172.21.15.64:0/339091027 learned_addr learned my addr 172.21.15.64:0/339091027 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21b5200640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae315a0 0x56028af8cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21b5c00640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae38320 0x56028af8d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 -- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae38320 msgr2=0x56028af8d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae38320 0x56028af8d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 -- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae315a0 msgr2=0x56028af8cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae315a0 0x56028af8cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 -- 172.21.15.64:0/339091027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028ad60c60 con 0x56028ae31db0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21afe00640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f219c009790 tx=0x7f219c0f7f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a51812a70b17c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0f8550 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f219c0f77b0 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56028ad44330 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f219c119050 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 10 client.11505 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x56028adaabe0 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56028ad44330 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f219c0b5070 con 0x56028ae31db0 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 10 client.11505 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 10 client.11505 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 20 client.11505 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa4e930 0x56028afbbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 4 client.11505 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56028adbea60 con 0x56028aa4e930 2024-09-21T07:38:11.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21b5200640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa4e930 0x56028afbbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f21b5200640 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa4e930 0x56028afbbf20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e86b198ffe4e20 server_cookie=5289d96c661cba20 in_seq=0 out_seq=0 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.198+0000 7f2196000640 10 client.11505 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f2196000640 1 -- 172.21.15.64:0/339091027 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56028adbea60 con 0x56028aa4e930 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f2196000640 10 client.11505 handle_command_reply: tid=0 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 client.11505 shutdown 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 msgr2=0x56028af8d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f219c009790 tx=0x7f219c0f7f60 comp rx=0 tx=0).stop 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 shutdown_connections 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa4e930 0x56028afbbf20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae38320 0x56028af8d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae31db0 0x56028af8d490 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 --2- 172.21.15.64:0/339091027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae315a0 0x56028af8cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f2196000640 0 client.11505 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:11.204 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 >> 172.21.15.64:0/339091027 conn(0x56028aa69920 msgr2=0x56028af5e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 shutdown_connections 2024-09-21T07:38:11.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 1 -- 172.21.15.64:0/339091027 wait complete. 2024-09-21T07:38:11.205 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.202+0000 7f21bf429000 20 client.11505 trim_cache size 0 max 16384 2024-09-21T07:38:11.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.214+0000 7f21bf429000 1 Processor -- start 2024-09-21T07:38:11.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.214+0000 7f21bf429000 1 -- start start 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028aa69920 0x56028af658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae31db0 0x56028afbf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56028af64300 con 0x56028ae315a0 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0216a80 con 0x56028aa69920 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f21b0215a90 con 0x56028ae31db0 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49152/0 (socket says 172.21.15.64:49152) 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 -- 172.21.15.64:0/3779724121 learned_addr learned my addr 172.21.15.64:0/3779724121 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 -- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae31db0 msgr2=0x56028afbf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae31db0 0x56028afbf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 -- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028aa69920 msgr2=0x56028af658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028aa69920 0x56028af658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 -- 172.21.15.64:0/3779724121 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028ad4a1f0 con 0x56028ae315a0 2024-09-21T07:38:11.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21afe00640 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f219c019b40 tx=0x7f219c01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266994ab219b326 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21a0c00640 1 -- 172.21.15.64:0/3779724121 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c104070 con 0x56028ae315a0 2024-09-21T07:38:11.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21a0c00640 1 -- 172.21.15.64:0/3779724121 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219c0f8550 con 0x56028ae315a0 2024-09-21T07:38:11.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21a0c00640 1 -- 172.21.15.64:0/3779724121 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0f8320 con 0x56028ae315a0 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- 172.21.15.64:0/3779724121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 msgr2=0x56028af65e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f219c019b40 tx=0x7f219c01cf30 comp rx=0 tx=0).stop 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- 172.21.15.64:0/3779724121 shutdown_connections 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae31db0 0x56028afbf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028ae315a0 0x56028af65e30 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 --2- 172.21.15.64:0/3779724121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028aa69920 0x56028af658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- 172.21.15.64:0/3779724121 >> 172.21.15.64:0/3779724121 conn(0x56028afb7800 msgr2=0x56028af651e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- 172.21.15.64:0/3779724121 shutdown_connections 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- 172.21.15.64:0/3779724121 wait complete. 2024-09-21T07:38:11.220 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 -- start start 2024-09-21T07:38:11.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.218+0000 7f21bf429000 1 Processor -- start 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afbef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afdc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56028ae6c010 con 0x56028aa69920 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56028adaf060 con 0x56028ae31db0 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56028ad778b0 con 0x56028ae315a0 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 10 client.0 _ll_register_callbacks cb 0x7f219c0f4bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49164/0 (socket says 172.21.15.64:49164) 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 -- 172.21.15.64:0/454624822 learned_addr learned my addr 172.21.15.64:0/454624822 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 -- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 msgr2=0x56028afbef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afbef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 -- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 msgr2=0x56028afdc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afdc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 -- 172.21.15.64:0/454624822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028ad72990 con 0x56028aa69920 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21b5200640 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f21a4023040 tx=0x7f21a40015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4c92debd4ba4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a402f070 con 0x56028aa69920 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f21a4034c60 con 0x56028aa69920 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f219c0f8550 con 0x56028aa69920 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f21a403b050 con 0x56028aa69920 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 10 client.11511 fetch_fsmap learned FSMap version 160 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x56028ad42580 con 0x56028aa69920 2024-09-21T07:38:11.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219c0f8550 con 0x56028aa69920 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f21a403e020 con 0x56028aa69920 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 10 client.11511 fetch_fsmap finished waiting for FSMap version 160 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 10 client.11511 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 20 client.11511 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa67fe0 0x56028afdce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 4 client.11511 mds_command: new command op to 11316 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 --> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56028adba510 con 0x56028aa67fe0 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21afe00640 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa67fe0 0x56028afdce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f2196000640 10 client.11511 ms_handle_connect on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.222+0000 7f21afe00640 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa67fe0 0x56028afdce00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e63b974f0bc344c server_cookie=b14ae04290699dc5 in_seq=0 out_seq=0 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f2196000640 1 -- 172.21.15.64:0/454624822 <== mds.0 v2:172.21.15.64:6834/619754157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56028adba510 con 0x56028aa67fe0 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f2196000640 10 client.11511 handle_command_reply: tid=0 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 client.11511 shutdown 2024-09-21T07:38:11.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 msgr2=0x56028afbea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f21a4023040 tx=0x7f21a40015e0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 shutdown_connections 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:6834/619754157,v1:172.21.15.64:6835/619754157] conn(0x56028aa67fe0 0x56028afdce00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56028ae31db0 0x56028afdc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56028ae315a0 0x56028afbef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f2196000640 0 client.11511 ms_handle_reset on v2:172.21.15.64:6834/619754157 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 --2- 172.21.15.64:0/454624822 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56028aa69920 0x56028afbea10 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 >> 172.21.15.64:0/454624822 conn(0x56028afb7800 msgr2=0x56028af65ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 shutdown_connections 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 1 -- 172.21.15.64:0/454624822 wait complete. 2024-09-21T07:38:11.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21bf429000 20 client.11511 trim_cache size 0 max 16384 2024-09-21T07:38:11.228 INFO:teuthology.orchestra.run.smithi064.stdout:[] 2024-09-21T07:38:11.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 msgr2=0x7f2190075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 0x7f2190075710 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f21a4000fc0 tx=0x7f21a4009040 comp rx=0 tx=0).stop 2024-09-21T07:38:11.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 msgr2=0x7f21b020a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c10 tx=0x7f219c005750 comp rx=0 tx=0).stop 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 shutdown_connections 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2190073200 0x7f2190075710 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21b00cc730 0x7f21b0094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b00cc320 0x7f21b020a760 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 --2- 172.21.15.64:0/3953147317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21b00b36b0 0x7f21b0090b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 >> 172.21.15.64:0/3953147317 conn(0x7f21b00d0320 msgr2=0x7f21b00d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 shutdown_connections 2024-09-21T07:38:11.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.226+0000 7f21b7c00640 1 -- 172.21.15.64:0/3953147317 wait complete. 2024-09-21T07:38:11.244 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:38:11.244 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:38:11.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:38:11.401 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:38:11.401 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:38:11.401 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:11.401 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:11.410 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:11.410 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:11.460 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 -- 172.21.15.64:0/1008076892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0caf00 msgr2=0x7f368c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 --2- 172.21.15.64:0/1008076892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0caf00 0x7f368c0cb310 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f3684009bf0 tx=0x7f368401cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 -- 172.21.15.64:0/1008076892 shutdown_connections 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 --2- 172.21.15.64:0/1008076892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0caf00 0x7f368c0cb310 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 --2- 172.21.15.64:0/1008076892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c06fae0 0x7f368c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 -- 172.21.15.64:0/1008076892 >> 172.21.15.64:0/1008076892 conn(0x7f368c06d570 msgr2=0x7f368c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 -- 172.21.15.64:0/1008076892 shutdown_connections 2024-09-21T07:38:11.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.662+0000 7f3693000640 1 -- 172.21.15.64:0/1008076892 wait complete. 2024-09-21T07:38:11.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 Processor -- start 2024-09-21T07:38:11.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 -- start start 2024-09-21T07:38:11.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f368c06fae0 0x7f368c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 0x7f368c074130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f368c168e60 con 0x7f368c0b46f0 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f368c168ce0 con 0x7f368c06fae0 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3693000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f368c168fe0 con 0x7f368c0caf00 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.666+0000 7f3683400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49182/0 (socket says 172.21.15.64:49182) 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 -- 172.21.15.64:0/2049039831 learned_addr learned my addr 172.21.15.64:0/2049039831 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3691000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 0x7f368c074130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f368be00640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f368c06fae0 0x7f368c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 -- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 msgr2=0x7f368c074130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 0x7f368c074130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 -- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f368c06fae0 msgr2=0x7f368c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f368c06fae0 0x7f368c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 -- 172.21.15.64:0/2049039831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c0c6860 con 0x7f368c0b46f0 2024-09-21T07:38:11.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3691000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 0x7f368c074130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:11.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3683400640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f3674001ec0 tx=0x7f367400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674017070 con 0x7f368c0b46f0 2024-09-21T07:38:11.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3674003600 con 0x7f368c0b46f0 2024-09-21T07:38:11.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674003a50 con 0x7f368c0b46f0 2024-09-21T07:38:11.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c099e20 con 0x7f368c0b46f0 2024-09-21T07:38:11.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c0c5aa0 con 0x7f368c0b46f0 2024-09-21T07:38:11.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c0af790 con 0x7f368c0b46f0 2024-09-21T07:38:11.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.670+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f367401a070 con 0x7f368c0b46f0 2024-09-21T07:38:11.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.674+0000 7f3688c00640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 0x7f3668075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:11.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.674+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f3674093880 con 0x7f368c0b46f0 2024-09-21T07:38:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.674+0000 7f368be00640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 0x7f3668075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.674+0000 7f368be00640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 0x7f3668075710 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f367c0058d0 tx=0x7f367c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:11.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.678+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f367405e670 con 0x7f368c0b46f0 2024-09-21T07:38:11.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f368c0b22f0 con 0x7f368c0b46f0 2024-09-21T07:38:11.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3688c00640 1 -- 172.21.15.64:0/2049039831 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v218) ==== 80+0+0 (secure 0 0 0) 0x7f367405df70 con 0x7f368c0b46f0 2024-09-21T07:38:11.866 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:38:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 msgr2=0x7f3668075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 0x7f3668075710 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f367c0058d0 tx=0x7f367c005860 comp rx=0 tx=0).stop 2024-09-21T07:38:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 msgr2=0x7f368c073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.866+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f3674001ec0 tx=0x7f367400c890 comp rx=0 tx=0).stop 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 shutdown_connections 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3668073200 0x7f3668075710 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f368c0caf00 0x7f368c074130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f368c0b46f0 0x7f368c073bf0 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 --2- 172.21.15.64:0/2049039831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f368c06fae0 0x7f368c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 >> 172.21.15.64:0/2049039831 conn(0x7f368c06d570 msgr2=0x7f368c073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 shutdown_connections 2024-09-21T07:38:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:11.870+0000 7f3693000640 1 -- 172.21.15.64:0/2049039831 wait complete. 2024-09-21T07:38:11.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:38:11.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:11.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:12.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:38:12.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:12.838 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:38:12.848 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:38:12.848 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:38:12.848 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:12.856 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:38:12.856 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:38:12.857 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:12.857 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:12.900 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:38:12.900 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:38:12.900 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:38:12.900 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:12.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:38:12.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- 172.21.15.64:0/64705355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a40cd440 msgr2=0x7f63a40b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 --2- 172.21.15.64:0/64705355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a40cd440 0x7f63a40b3580 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f639c009bc0 tx=0x7f639c01cac0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- 172.21.15.64:0/64705355 shutdown_connections 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 --2- 172.21.15.64:0/64705355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a40cd440 0x7f63a40b3580 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 --2- 172.21.15.64:0/64705355 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b28e0 0x7f63a415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- 172.21.15.64:0/64705355 >> 172.21.15.64:0/64705355 conn(0x7f63a406d570 msgr2=0x7f63a40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- 172.21.15.64:0/64705355 shutdown_connections 2024-09-21T07:38:13.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- 172.21.15.64:0/64705355 wait complete. 2024-09-21T07:38:13.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 Processor -- start 2024-09-21T07:38:13.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.102+0000 7f63ab600640 1 -- start start 2024-09-21T07:38:13.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b3170 0x7f63a40995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a4074880 0x7f63a4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f63a4169fd0 con 0x7f63a40b28e0 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63a4169e50 con 0x7f63a4074880 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f63a416a150 con 0x7f63a40b3170 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49190/0 (socket says 172.21.15.64:49190) 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 -- 172.21.15.64:0/2220593654 learned_addr learned my addr 172.21.15.64:0/2220593654 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a9600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a4074880 0x7f63a4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f639be00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b3170 0x7f63a40995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 -- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b3170 msgr2=0x7f63a40995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b3170 0x7f63a40995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 -- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a4074880 msgr2=0x7f63a4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a4074880 0x7f63a4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 -- 172.21.15.64:0/2220593654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a40cd800 con 0x7f63a40b28e0 2024-09-21T07:38:13.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a8c00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f639400e7d0 tx=0x7f639400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639400ccc0 con 0x7f63a40b28e0 2024-09-21T07:38:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a406a8c0 con 0x7f63a40b28e0 2024-09-21T07:38:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6394010430 con 0x7f63a40b28e0 2024-09-21T07:38:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394010860 con 0x7f63a40b28e0 2024-09-21T07:38:13.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a415a7f0 con 0x7f63a40b28e0 2024-09-21T07:38:13.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.106+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a415c6f0 con 0x7f63a40b28e0 2024-09-21T07:38:13.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.110+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6394010a00 con 0x7f63a40b28e0 2024-09-21T07:38:13.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.110+0000 7f63a1600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 0x7f6380075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.110+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f63940951f0 con 0x7f63a40b28e0 2024-09-21T07:38:13.110 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.110+0000 7f639be00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 0x7f6380075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.110+0000 7f639be00640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 0x7f6380075740 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f63a4074ff0 tx=0x7f638c001dc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.114+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f639405f990 con 0x7f63a40b28e0 2024-09-21T07:38:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63a4155da0 con 0x7f63a40b28e0 2024-09-21T07:38:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63a1600640 1 -- 172.21.15.64:0/2220593654 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7f63940643c0 con 0x7f63a40b28e0 2024-09-21T07:38:13.326 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:13.326 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 msgr2=0x7f6380075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 0x7f6380075740 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f63a4074ff0 tx=0x7f638c001dc0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 msgr2=0x7f63a41fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f639400e7d0 tx=0x7f639400ec90 comp rx=0 tx=0).stop 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 shutdown_connections 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6380073230 0x7f6380075740 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a4074880 0x7f63a4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63a40b3170 0x7f63a40995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 --2- 172.21.15.64:0/2220593654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a40b28e0 0x7f63a41fcda0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 >> 172.21.15.64:0/2220593654 conn(0x7f63a406d570 msgr2=0x7f63a40b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:13.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 shutdown_connections 2024-09-21T07:38:13.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.326+0000 7f63ab600640 1 -- 172.21.15.64:0/2220593654 wait complete. 2024-09-21T07:38:13.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 -- 172.21.15.64:0/1251219707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 msgr2=0x7f173c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 --2- 172.21.15.64:0/1251219707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c0cb310 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f1734009cb0 tx=0x7f173401cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 -- 172.21.15.64:0/1251219707 shutdown_connections 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 --2- 172.21.15.64:0/1251219707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c0cb310 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 --2- 172.21.15.64:0/1251219707 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 0x7f173c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 -- 172.21.15.64:0/1251219707 >> 172.21.15.64:0/1251219707 conn(0x7f173c06d570 msgr2=0x7f173c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:13.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 -- 172.21.15.64:0/1251219707 shutdown_connections 2024-09-21T07:38:13.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.506+0000 7f1742800640 1 -- 172.21.15.64:0/1251219707 wait complete. 2024-09-21T07:38:13.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 Processor -- start 2024-09-21T07:38:13.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- start start 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 0x7f173c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0b46f0 0x7f173c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f173c168f00 con 0x7f173c0caf00 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f173c168d80 con 0x7f173c0b46f0 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f173c169080 con 0x7f173c06fae0 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49206/0 (socket says 172.21.15.64:49206) 2024-09-21T07:38:13.510 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 -- 172.21.15.64:0/1508704448 learned_addr learned my addr 172.21.15.64:0/1508704448 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:13.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1733e00640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0b46f0 0x7f173c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173b400640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 0x7f173c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 -- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 msgr2=0x7f173c0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 0x7f173c0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 -- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0b46f0 msgr2=0x7f173c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0b46f0 0x7f173c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 -- 172.21.15.64:0/1508704448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c1fc680 con 0x7f173c0caf00 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f173be00640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f1734009bd0 tx=0x7f1734005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340b2040 con 0x7f173c0caf00 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1734004b40 con 0x7f173c0caf00 2024-09-21T07:38:13.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c1fc960 con 0x7f173c0caf00 2024-09-21T07:38:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734004000 con 0x7f173c0caf00 2024-09-21T07:38:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.510+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c1fcf20 con 0x7f173c0caf00 2024-09-21T07:38:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c1fc3f0 con 0x7f173c0caf00 2024-09-21T07:38:13.513 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f17340be060 con 0x7f173c0caf00 2024-09-21T07:38:13.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f1733400640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 0x7f1718075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f173412e170 con 0x7f173c0caf00 2024-09-21T07:38:13.514 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f173b400640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 0x7f1718075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.515 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.514+0000 7f173b400640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 0x7f1718075710 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f172c009b40 tx=0x7f172c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.517 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.518+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f1734016990 con 0x7f173c0caf00 2024-09-21T07:38:13.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f173c0af790 con 0x7f173c0caf00 2024-09-21T07:38:13.737 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1733400640 1 -- 172.21.15.64:0/1508704448 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7f17340f8a20 con 0x7f173c0caf00 2024-09-21T07:38:13.738 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:13.738 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:13.738 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 msgr2=0x7f1718075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 0x7f1718075710 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f172c009b40 tx=0x7f172c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 msgr2=0x7f173c1655b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f1734009bd0 tx=0x7f1734005ac0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 shutdown_connections 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1718073200 0x7f1718075710 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f173c0caf00 0x7f173c1655b0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0b46f0 0x7f173c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 --2- 172.21.15.64:0/1508704448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f173c06fae0 0x7f173c0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 >> 172.21.15.64:0/1508704448 conn(0x7f173c06d570 msgr2=0x7f173c1550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:13.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 shutdown_connections 2024-09-21T07:38:13.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.738+0000 7f1742800640 1 -- 172.21.15.64:0/1508704448 wait complete. 2024-09-21T07:38:13.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:13.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- 172.21.15.64:0/2377456423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c151d90 msgr2=0x7f389c1521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 --2- 172.21.15.64:0/2377456423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c151d90 0x7f389c1521a0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f3894009c80 tx=0x7f389401cc10 comp rx=0 tx=0).stop 2024-09-21T07:38:13.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- 172.21.15.64:0/2377456423 shutdown_connections 2024-09-21T07:38:13.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 --2- 172.21.15.64:0/2377456423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c151d90 0x7f389c1521a0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 --2- 172.21.15.64:0/2377456423 >> v2:172.21.15.90:3300/0 conn(0x7f389c15fc60 0x7f389c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- 172.21.15.64:0/2377456423 >> 172.21.15.64:0/2377456423 conn(0x7f389c0b29e0 msgr2=0x7f389c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:13.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- 172.21.15.64:0/2377456423 shutdown_connections 2024-09-21T07:38:13.929 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- 172.21.15.64:0/2377456423 wait complete. 2024-09-21T07:38:13.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 Processor -- start 2024-09-21T07:38:13.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.918+0000 7f38a2400640 1 -- start start 2024-09-21T07:38:13.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.931 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f389c151d90 0x7f389c1f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f389c15fc60 0x7f389c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f389c0b4f30 con 0x7f389c071680 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f389c0b4db0 con 0x7f389c151d90 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f389c0b50b0 con 0x7f389c15fc60 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49218/0 (socket says 172.21.15.64:49218) 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 -- 172.21.15.64:0/368264189 learned_addr learned my addr 172.21.15.64:0/368264189 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f3892a00640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f389c151d90 0x7f389c1f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389be00640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f389c15fc60 0x7f389c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 -- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f389c15fc60 msgr2=0x7f389c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f389c15fc60 0x7f389c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 -- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f389c151d90 msgr2=0x7f389c1f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:13.932 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f389c151d90 0x7f389c1f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 -- 172.21.15.64:0/368264189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c159400 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f389b400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d720 tx=0x7f388c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c017070 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f388c009d20 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c14cfd0 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c005280 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c14d590 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.922+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c1521a0 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.926+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f388c005420 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.926+0000 7f3893e00640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 0x7f3878075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.926+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f388c094490 con 0x7f389c071680 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.926+0000 7f3892a00640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 0x7f3878075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.926+0000 7f3892a00640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 0x7f3878075740 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f389c1f49c0 tx=0x7f3884009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:13.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:13.930+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f388c05ecc0 con 0x7f389c071680 2024-09-21T07:38:14.108 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.106+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f389c0cd070 con 0x7f389c071680 2024-09-21T07:38:14.109 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f3893e00640 1 -- 172.21.15.64:0/368264189 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) ==== 74+0+16964 (secure 0 0 0) 0x7f388c0636f0 con 0x7f389c071680 2024-09-21T07:38:14.110 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:14.110 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":218,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:58.665379+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:37:54.857926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-21T07:37:56.058916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 msgr2=0x7f3878075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 0x7f3878075740 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f389c1f49c0 tx=0x7f3884009040 comp rx=0 tx=0).stop 2024-09-21T07:38:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 msgr2=0x7f389c1f79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d720 tx=0x7f388c00dbe0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 shutdown_connections 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3878073230 0x7f3878075740 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f389c15fc60 0x7f389c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f389c151d90 0x7f389c1f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 --2- 172.21.15.64:0/368264189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c071680 0x7f389c1f79a0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.110+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 >> 172.21.15.64:0/368264189 conn(0x7f389c0b29e0 msgr2=0x7f389c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.114+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 shutdown_connections 2024-09-21T07:38:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.114+0000 7f38a2400640 1 -- 172.21.15.64:0/368264189 wait complete. 2024-09-21T07:38:14.133 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:38:14.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- 172.21.15.64:0/3651234571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 msgr2=0x7f7e0c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 --2- 172.21.15.64:0/3651234571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0d0ff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009840 tx=0x7f7df401c820 comp rx=0 tx=0).stop 2024-09-21T07:38:14.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- 172.21.15.64:0/3651234571 shutdown_connections 2024-09-21T07:38:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 --2- 172.21.15.64:0/3651234571 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0d1530 0x7f7e0c0d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 --2- 172.21.15.64:0/3651234571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0d0ff0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- 172.21.15.64:0/3651234571 >> 172.21.15.64:0/3651234571 conn(0x7f7e0c06d430 msgr2=0x7f7e0c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- 172.21.15.64:0/3651234571 shutdown_connections 2024-09-21T07:38:14.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- 172.21.15.64:0/3651234571 wait complete. 2024-09-21T07:38:14.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 Processor -- start 2024-09-21T07:38:14.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.294+0000 7f7e10c00640 1 -- start start 2024-09-21T07:38:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0ccbe0 0x7f7e0c166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c16a2c0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c16a140 con 0x7f7e0c0cf230 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c16a440 con 0x7f7e0c0ccbe0 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49232/0 (socket says 172.21.15.64:49232) 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 -- 172.21.15.64:0/779182363 learned_addr learned my addr 172.21.15.64:0/779182363 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0b400640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0ccbe0 0x7f7e0c166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e03e00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 -- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0ccbe0 msgr2=0x7f7e0c166150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0ccbe0 0x7f7e0c166150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 -- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 msgr2=0x7f7e0c0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 -- 172.21.15.64:0/779182363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c157770 con 0x7f7e0c0d1530 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e0be00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ea80 tx=0x7f7e0400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400cea0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e04004b30 con 0x7f7e0c0d1530 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04005020 con 0x7f7e0c0d1530 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c157a50 con 0x7f7e0c0d1530 2024-09-21T07:38:14.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c0ca520 con 0x7f7e0c0d1530 2024-09-21T07:38:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.298+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c0d0ff0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.302+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7e040051c0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.302+0000 7f7e03400640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 0x7f7de8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.302+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f7e04094fe0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.302+0000 7f7e0b400640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 0x7f7de8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.302+0000 7f7e0b400640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 0x7f7de8075710 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc001870 tx=0x7f7dfc001380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:14.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.306+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f7e0405f720 con 0x7f7e0c0d1530 2024-09-21T07:38:14.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.518+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e0c0cd1c0 con 0x7f7e0c0d1530 2024-09-21T07:38:14.519 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.518+0000 7f7e03400640 1 -- 172.21.15.64:0/779182363 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7f7e04064150 con 0x7f7e0c0d1530 2024-09-21T07:38:14.519 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:14.520 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:14.520 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 msgr2=0x7f7de8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 0x7f7de8075710 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc001870 tx=0x7f7dfc001380 comp rx=0 tx=0).stop 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 msgr2=0x7f7e0c0cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ea80 tx=0x7f7e0400ef40 comp rx=0 tx=0).stop 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 shutdown_connections 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7de8073200 0x7f7de8075710 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e0c0d1530 0x7f7e0c0cb260 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e0c0cf230 0x7f7e0c0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 --2- 172.21.15.64:0/779182363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e0c0ccbe0 0x7f7e0c166150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 >> 172.21.15.64:0/779182363 conn(0x7f7e0c06d430 msgr2=0x7f7e0c160480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:14.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 shutdown_connections 2024-09-21T07:38:14.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.522+0000 7f7e10c00640 1 -- 172.21.15.64:0/779182363 wait complete. 2024-09-21T07:38:14.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 -- 172.21.15.64:0/842096795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b28e0 msgr2=0x7f298015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 --2- 172.21.15.64:0/842096795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b28e0 0x7f298015c6f0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f2974009900 tx=0x7f297401c8e0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 -- 172.21.15.64:0/842096795 shutdown_connections 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 --2- 172.21.15.64:0/842096795 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800cd440 0x7f29800b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 --2- 172.21.15.64:0/842096795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b28e0 0x7f298015c6f0 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 -- 172.21.15.64:0/842096795 >> 172.21.15.64:0/842096795 conn(0x7f298006d570 msgr2=0x7f29800b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 -- 172.21.15.64:0/842096795 shutdown_connections 2024-09-21T07:38:14.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.702+0000 7f2987400640 1 -- 172.21.15.64:0/842096795 wait complete. 2024-09-21T07:38:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 Processor -- start 2024-09-21T07:38:14.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- start start 2024-09-21T07:38:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29800b28e0 0x7f2980098c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800b3170 0x7f29801546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2980169f30 con 0x7f29800b1e90 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2980169db0 con 0x7f29800b28e0 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f298016a0b0 con 0x7f29800b3170 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49260/0 (socket says 172.21.15.64:49260) 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 -- 172.21.15.64:0/2233935590 learned_addr learned my addr 172.21.15.64:0/2233935590 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2984a00640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29800b28e0 0x7f2980098c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f297fe00640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800b3170 0x7f29801546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 -- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800b3170 msgr2=0x7f29801546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800b3170 0x7f29801546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 -- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29800b28e0 msgr2=0x7f2980098c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29800b28e0 0x7f2980098c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 -- 172.21.15.64:0/2233935590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2980099300 con 0x7f29800b1e90 2024-09-21T07:38:14.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2985400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f297800cae0 tx=0x7f297800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297800ae30 con 0x7f29800b1e90 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f297800f560 con 0x7f29800b1e90 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29800ae560 con 0x7f29800b1e90 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297800f9b0 con 0x7f29800b1e90 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.706+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29800997b0 con 0x7f29800b1e90 2024-09-21T07:38:14.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29800995e0 con 0x7f29800b1e90 2024-09-21T07:38:14.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f297800fb50 con 0x7f29800b1e90 2024-09-21T07:38:14.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f297cc00640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 0x7f2960075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:14.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7f2978094dc0 con 0x7f29800b1e90 2024-09-21T07:38:14.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f2984a00640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 0x7f2960075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:14.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.710+0000 7f2984a00640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 0x7f2960075710 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f29740af000 tx=0x7f297401b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:14.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.714+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2978014030 con 0x7f29800b1e90 2024-09-21T07:38:14.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.930+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2980099ab0 con 0x7f29800b1e90 2024-09-21T07:38:14.930 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.930+0000 7f297cc00640 1 -- 172.21.15.64:0/2233935590 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5235 (secure 0 0 0) 0x7f297805fcd0 con 0x7f29800b1e90 2024-09-21T07:38:14.931 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:14.931 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":160,"btime":"2024-09-21T07:38:00:705593+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:37:57.095178+0000","modified":"2024-09-21T07:38:00.126957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11316":{"gid":11316,"name":"c","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/619754157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":619754157},{"type":"v1","addr":"172.21.15.64:6835","nonce":619754157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11316,"qdb_cluster":[11316]},"id":15}]} 2024-09-21T07:38:14.931 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 160 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 msgr2=0x7f2960075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 0x7f2960075710 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f29740af000 tx=0x7f297401b120 comp rx=0 tx=0).stop 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 msgr2=0x7f2980154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f297800cae0 tx=0x7f297800a250 comp rx=0 tx=0).stop 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 shutdown_connections 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2960073200 0x7f2960075710 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29800b1e90 0x7f2980154c20 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29800b3170 0x7f29801546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 --2- 172.21.15.64:0/2233935590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29800b28e0 0x7f2980098c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:14.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 >> 172.21.15.64:0/2233935590 conn(0x7f298006d570 msgr2=0x7f298015b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:14.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 shutdown_connections 2024-09-21T07:38:14.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:14.934+0000 7f2987400640 1 -- 172.21.15.64:0/2233935590 wait complete. 2024-09-21T07:38:14.953 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 -- 172.21.15.64:0/750123696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece40b4e00 msgr2=0x7fece40af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 --2- 172.21.15.64:0/750123696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece40b4e00 0x7fece40af790 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7feccc009840 tx=0x7feccc01c820 comp rx=0 tx=0).stop 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 -- 172.21.15.64:0/750123696 shutdown_connections 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 --2- 172.21.15.64:0/750123696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece40b4e00 0x7fece40af790 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 -- 172.21.15.64:0/750123696 >> 172.21.15.64:0/750123696 conn(0x7fece406d570 msgr2=0x7fece40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 -- 172.21.15.64:0/750123696 shutdown_connections 2024-09-21T07:38:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.110+0000 7feceb000640 1 -- 172.21.15.64:0/750123696 wait complete. 2024-09-21T07:38:15.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 Processor -- start 2024-09-21T07:38:15.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- start start 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 0x7fece415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fece415b060 0x7fece415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fece4169ed0 con 0x7fece406fae0 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fece4169d50 con 0x7fece415b060 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fece416a050 con 0x7fece40caf00 2024-09-21T07:38:15.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45154/0 (socket says 172.21.15.64:45154) 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 -- 172.21.15.64:0/1482946156 learned_addr learned my addr 172.21.15.64:0/1482946156 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece9000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fece415b060 0x7fece415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fecdbe00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 0x7fece415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 -- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 msgr2=0x7fece415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 0x7fece415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 -- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fece415b060 msgr2=0x7fece415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fece415b060 0x7fece415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 -- 172.21.15.64:0/1482946156 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece41672e0 con 0x7fece406fae0 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fecdbe00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 0x7fece415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:15.116 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece3e00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c420 tx=0x7fecd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4017070 con 0x7fece406fae0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecd40053c0 con 0x7fece406fae0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece41fd180 con 0x7fece406fae0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4003860 con 0x7fece406fae0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.114+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece40aea30 con 0x7fece406fae0 2024-09-21T07:38:15.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.118+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece40af790 con 0x7fece406fae0 2024-09-21T07:38:15.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.118+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fecd401a070 con 0x7fece406fae0 2024-09-21T07:38:15.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.118+0000 7fece0c00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 0x7fecc0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.118+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7fecd4093700 con 0x7fece406fae0 2024-09-21T07:38:15.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.118+0000 7fecdbe00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 0x7fecc0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.122+0000 7fecdbe00640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 0x7fecc0075710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7feccc0af000 tx=0x7feccc01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.123 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.122+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fece41fd180 con 0x7fece406fae0 2024-09-21T07:38:15.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.302+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fece409e4c0 con 0x7fece406fae0 2024-09-21T07:38:15.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.302+0000 7fece0c00640 1 -- 172.21.15.64:0/1482946156 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) ==== 74+0+16964 (secure 0 0 0) 0x7fece40ccbc0 con 0x7fece406fae0 2024-09-21T07:38:15.303 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:15.303 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":218,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:37:58.665379+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:37:54.857926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-21T07:37:56.058916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:15.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 msgr2=0x7fecc0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 0x7fecc0075710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7feccc0af000 tx=0x7feccc01b060 comp rx=0 tx=0).stop 2024-09-21T07:38:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 msgr2=0x7fece41fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c420 tx=0x7fecd400c8e0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 shutdown_connections 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fecc0073200 0x7fecc0075710 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fece415b060 0x7fece415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fece40caf00 0x7fece415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 --2- 172.21.15.64:0/1482946156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece406fae0 0x7fece41fcc40 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 >> 172.21.15.64:0/1482946156 conn(0x7fece406d570 msgr2=0x7fece40b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 shutdown_connections 2024-09-21T07:38:15.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.306+0000 7feceb000640 1 -- 172.21.15.64:0/1482946156 wait complete. 2024-09-21T07:38:15.326 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- 172.21.15.64:0/1159101564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea8415af70 msgr2=0x7fea8406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 --2- 172.21.15.64:0/1159101564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea8415af70 0x7fea8406f0d0 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7fea84070940 tx=0x7fea7401c7d0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- 172.21.15.64:0/1159101564 shutdown_connections 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 --2- 172.21.15.64:0/1159101564 >> v2:172.21.15.90:3300/0 conn(0x7fea840b36b0 0x7fea840b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 --2- 172.21.15.64:0/1159101564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 0x7fea840b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 --2- 172.21.15.64:0/1159101564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea8415af70 0x7fea8406f0d0 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- 172.21.15.64:0/1159101564 >> 172.21.15.64:0/1159101564 conn(0x7fea8406d570 msgr2=0x7fea840b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- 172.21.15.64:0/1159101564 shutdown_connections 2024-09-21T07:38:15.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- 172.21.15.64:0/1159101564 wait complete. 2024-09-21T07:38:15.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 Processor -- start 2024-09-21T07:38:15.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.486+0000 7fea88e00640 1 -- start start 2024-09-21T07:38:15.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 0x7fea840ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8415af70 0x7fea840c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea84073f80 con 0x7fea840b36b0 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea84073e00 con 0x7fea8415af70 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fea84074100 con 0x7fea8406f610 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45166/0 (socket says 172.21.15.64:45166) 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 -- 172.21.15.64:0/835171635 learned_addr learned my addr 172.21.15.64:0/835171635 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea81e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 0x7fea840ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea82800640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8415af70 0x7fea840c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 -- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 msgr2=0x7fea840ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 0x7fea840ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 -- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8415af70 msgr2=0x7fea840c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8415af70 0x7fea840c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 -- 172.21.15.64:0/835171635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea840cc550 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7be00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c940 tx=0x7fea6c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c007bb0 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea6c007e40 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00f690 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea840cc830 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea840ccdf0 con 0x7fea840b36b0 2024-09-21T07:38:15.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.490+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840b3ac0 con 0x7fea840b36b0 2024-09-21T07:38:15.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fea6c018400 con 0x7fea840b36b0 2024-09-21T07:38:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea7a000640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 6101+0+0 (secure 0 0 0) 0x7fea6c095130 con 0x7fea840b36b0 2024-09-21T07:38:15.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea81e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea81e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fea740af000 tx=0x7fea740a8040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.494+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fea6c026020 con 0x7fea840b36b0 2024-09-21T07:38:15.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.710+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fea840d0d80 con 0x7fea840b36b0 2024-09-21T07:38:15.709 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:38:15.710+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:38:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.710+0000 7fea7a000640 1 -- 172.21.15.64:0/835171635 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v161) ==== 161+0+0 (secure 0 0 0) 0x7fea6c014030 con 0x7fea840b36b0 2024-09-21T07:38:15.711 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:38:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 msgr2=0x7fea60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fea740af000 tx=0x7fea740a8040 comp rx=0 tx=0).stop 2024-09-21T07:38:15.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 msgr2=0x7fea840cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c940 tx=0x7fea6c00ce00 comp rx=0 tx=0).stop 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 shutdown_connections 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fea60073200 0x7fea60075710 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8415af70 0x7fea840c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea840b36b0 0x7fea840cb8b0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 --2- 172.21.15.64:0/835171635 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8406f610 0x7fea840ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 >> 172.21.15.64:0/835171635 conn(0x7fea8406d570 msgr2=0x7fea840c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 shutdown_connections 2024-09-21T07:38:15.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.714+0000 7fea88e00640 1 -- 172.21.15.64:0/835171635 wait complete. 2024-09-21T07:38:15.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:38:15.858 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- 172.21.15.64:0/2481873030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd248004810 msgr2=0x7fd248004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 --2- 172.21.15.64:0/2481873030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd248004810 0x7fd248004c20 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009b60 tx=0x7fd24c01d270 comp rx=0 tx=0).stop 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- 172.21.15.64:0/2481873030 shutdown_connections 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 --2- 172.21.15.64:0/2481873030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd248004810 0x7fd248004c20 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- 172.21.15.64:0/2481873030 >> 172.21.15.64:0/2481873030 conn(0x7fd26406d570 msgr2=0x7fd2640b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- 172.21.15.64:0/2481873030 shutdown_connections 2024-09-21T07:38:15.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- 172.21.15.64:0/2481873030 wait complete. 2024-09-21T07:38:15.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 Processor -- start 2024-09-21T07:38:15.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.906+0000 7fd268e00640 1 -- start start 2024-09-21T07:38:15.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 0x7fd264156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2641f7030 0x7fd2641f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd26415c870 con 0x7fd2640aeb10 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd26415c6f0 con 0x7fd248004810 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd26415c9f0 con 0x7fd2641f7030 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45192/0 (socket says 172.21.15.64:45192) 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 -- 172.21.15.64:0/2081132263 learned_addr learned my addr 172.21.15.64:0/2081132263 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd261e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 0x7fd264156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd262800640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2641f7030 0x7fd2641f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 -- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2641f7030 msgr2=0x7fd2641f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2641f7030 0x7fd2641f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 -- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 msgr2=0x7fd264156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:15.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 0x7fd264156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:15.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 -- 172.21.15.64:0/2081132263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2640b0370 con 0x7fd2640aeb10 2024-09-21T07:38:15.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd261e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 0x7fd264156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:15.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25be00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fd24c01d0a0 tx=0x7fd24c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0ba070 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd254006e50 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2640ae030 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0b1040 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2640ae5f0 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.910+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2640cd2b0 con 0x7fd2640aeb10 2024-09-21T07:38:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.914+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd24c0046d0 con 0x7fd2640aeb10 2024-09-21T07:38:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.914+0000 7fd25a000640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 0x7fd240075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.914+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 6187+0+0 (secure 0 0 0) 0x7fd24c12f0e0 con 0x7fd2640aeb10 2024-09-21T07:38:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.914+0000 7fd261e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 0x7fd240075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.914+0000 7fd261e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 0x7fd240075740 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd254006c10 tx=0x7fd254000ee0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:15.918+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd24c016f80 con 0x7fd2640aeb10 2024-09-21T07:38:16.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.130+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd264074700 con 0x7fd2640aeb10 2024-09-21T07:38:16.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.778+0000 7fd25a000640 1 -- 172.21.15.64:0/2081132263 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v162) ==== 104+0+0 (secure 0 0 0) 0x7fd24c0fa040 con 0x7fd2640aeb10 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 msgr2=0x7fd240075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 0x7fd240075740 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd254006c10 tx=0x7fd254000ee0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 msgr2=0x7fd2640aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fd24c01d0a0 tx=0x7fd24c005520 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 shutdown_connections 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd240073230 0x7fd240075740 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd2641f7030 0x7fd2641f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2640aeb10 0x7fd2640aef20 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 --2- 172.21.15.64:0/2081132263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd248004810 0x7fd264156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 >> 172.21.15.64:0/2081132263 conn(0x7fd26406d570 msgr2=0x7fd2641e9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 shutdown_connections 2024-09-21T07:38:16.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.782+0000 7fd268e00640 1 -- 172.21.15.64:0/2081132263 wait complete. 2024-09-21T07:38:16.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:38:16.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 -- 172.21.15.64:0/2194481423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c0caf00 msgr2=0x7ff71c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 --2- 172.21.15.64:0/2194481423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c0caf00 0x7ff71c0cb310 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff714009bf0 tx=0x7ff71401cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 -- 172.21.15.64:0/2194481423 shutdown_connections 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 --2- 172.21.15.64:0/2194481423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c0caf00 0x7ff71c0cb310 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 --2- 172.21.15.64:0/2194481423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0b4e00 0x7ff71c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 -- 172.21.15.64:0/2194481423 >> 172.21.15.64:0/2194481423 conn(0x7ff71c06d570 msgr2=0x7ff71c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 -- 172.21.15.64:0/2194481423 shutdown_connections 2024-09-21T07:38:16.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.970+0000 7ff721400640 1 -- 172.21.15.64:0/2194481423 wait complete. 2024-09-21T07:38:16.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 Processor -- start 2024-09-21T07:38:16.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- start start 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c06fae0 0x7ff71c0c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0caf00 0x7ff71c1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c168f00 con 0x7ff71c0c5d60 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c168d80 con 0x7ff71c06fae0 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c169080 con 0x7ff71c0caf00 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45202/0 (socket says 172.21.15.64:45202) 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c06fae0 0x7ff71c0c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:16.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 -- 172.21.15.64:0/2883748789 learned_addr learned my addr 172.21.15.64:0/2883748789 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff711e00640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0caf00 0x7ff71c1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 -- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0caf00 msgr2=0x7ff71c1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0caf00 0x7ff71c1513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 -- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c06fae0 msgr2=0x7ff71c0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c06fae0 0x7ff71c0c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 -- 172.21.15.64:0/2883748789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c14f800 con 0x7ff71c0c5d60 2024-09-21T07:38:16.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff71b200640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7ff714009b10 tx=0x7ff714009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140bb070 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff714004b40 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140b2040 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c14fae0 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.974+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c14fdc0 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71c0732b0 con 0x7ff71c0c5d60 2024-09-21T07:38:16.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff7140be070 con 0x7ff71c0c5d60 2024-09-21T07:38:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff713400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 0x7ff6f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 6187+0+0 (secure 0 0 0) 0x7ff71412de40 con 0x7ff71c0c5d60 2024-09-21T07:38:16.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff71a800640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 0x7ff6f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:16.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.978+0000 7ff71a800640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 0x7ff6f8075710 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007fd0 tx=0x7ff70c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:16.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:16.982+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff714016790 con 0x7ff71c0c5d60 2024-09-21T07:38:17.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.166+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff71c0d10d0 con 0x7ff71c0c5d60 2024-09-21T07:38:17.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.782+0000 7ff713400640 1 -- 172.21.15.64:0/2883748789 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v220) ==== 181+0+0 (secure 0 0 0) 0x7ff7140f8590 con 0x7ff71c0c5d60 2024-09-21T07:38:17.784 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:38:17.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 msgr2=0x7ff6f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:17.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 0x7ff6f8075710 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007fd0 tx=0x7ff70c009040 comp rx=0 tx=0).stop 2024-09-21T07:38:17.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 msgr2=0x7ff71c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:17.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7ff714009b10 tx=0x7ff714009200 comp rx=0 tx=0).stop 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 shutdown_connections 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff6f8073200 0x7ff6f8075710 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff71c0c5d60 0x7ff71c1518e0 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff71c0caf00 0x7ff71c1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 --2- 172.21.15.64:0/2883748789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff71c06fae0 0x7ff71c0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.790+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 >> 172.21.15.64:0/2883748789 conn(0x7ff71c06d570 msgr2=0x7ff71c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.794+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 shutdown_connections 2024-09-21T07:38:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.794+0000 7ff721400640 1 -- 172.21.15.64:0/2883748789 wait complete. 2024-09-21T07:38:17.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- 172.21.15.64:0/1059007660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e40b4e00 msgr2=0x7f89e40af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 --2- 172.21.15.64:0/1059007660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e40b4e00 0x7f89e40af790 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f89e4070d40 tx=0x7f89cc01c800 comp rx=0 tx=0).stop 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- 172.21.15.64:0/1059007660 shutdown_connections 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 --2- 172.21.15.64:0/1059007660 >> v2:172.21.15.90:3300/0 conn(0x7f89e40caf00 0x7f89e40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 --2- 172.21.15.64:0/1059007660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e40b4e00 0x7f89e40af790 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- 172.21.15.64:0/1059007660 >> 172.21.15.64:0/1059007660 conn(0x7f89e406d570 msgr2=0x7f89e40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- 172.21.15.64:0/1059007660 shutdown_connections 2024-09-21T07:38:17.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- 172.21.15.64:0/1059007660 wait complete. 2024-09-21T07:38:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 Processor -- start 2024-09-21T07:38:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.982+0000 7f89e9600640 1 -- start start 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e40caf00 0x7f89e40c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89e40c9dd0 0x7f89e40c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4168e60 con 0x7f89e406fae0 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4168ce0 con 0x7f89e40caf00 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f89e4168fe0 con 0x7f89e40c9dd0 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45222/0 (socket says 172.21.15.64:45222) 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 -- 172.21.15.64:0/3977292076 learned_addr learned my addr 172.21.15.64:0/3977292076 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e3400640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89e40c9dd0 0x7f89e40c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:17.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89da000640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e40caf00 0x7f89e40c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 -- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89e40c9dd0 msgr2=0x7f89e40c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89e40c9dd0 0x7f89e40c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 -- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e40caf00 msgr2=0x7f89e40c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e40caf00 0x7f89e40c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 -- 172.21.15.64:0/3977292076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e40c6df0 con 0x7f89e406fae0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e2a00640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f89d4001ec0 tx=0x7f89d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4017070 con 0x7f89e406fae0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89d4003600 con 0x7f89e406fae0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e40998b0 con 0x7f89e406fae0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4003a50 con 0x7f89e406fae0 2024-09-21T07:38:17.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e415e8d0 con 0x7f89e406fae0 2024-09-21T07:38:17.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.986+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e40af790 con 0x7f89e406fae0 2024-09-21T07:38:17.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.990+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89d401a070 con 0x7f89e406fae0 2024-09-21T07:38:17.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.990+0000 7f89db400640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:17.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.990+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(220..220 src has 1..220) ==== 5749+0+0 (secure 0 0 0) 0x7f89d40935f0 con 0x7f89e406fae0 2024-09-21T07:38:17.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.990+0000 7f89da000640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:17.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.990+0000 7f89da000640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 0x7f89c0075740 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0af000 tx=0x7f89cc01b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:17.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:17.994+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f89d405e540 con 0x7f89e406fae0 2024-09-21T07:38:18.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.170+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89e4156160 con 0x7f89e406fae0 2024-09-21T07:38:18.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.786+0000 7f89db400640 1 -- 172.21.15.64:0/3977292076 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v221) ==== 169+0+0 (secure 0 0 0) 0x7f89d405de40 con 0x7f89e406fae0 2024-09-21T07:38:18.786 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:38:18.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.790+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 msgr2=0x7f89c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:18.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.790+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 0x7f89c0075740 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0af000 tx=0x7f89cc01b040 comp rx=0 tx=0).stop 2024-09-21T07:38:18.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.790+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 msgr2=0x7f89e415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:18.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.790+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f89d4001ec0 tx=0x7f89d400c890 comp rx=0 tx=0).stop 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 shutdown_connections 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f89e40c9dd0 0x7f89e40c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e40caf00 0x7f89e40c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 --2- 172.21.15.64:0/3977292076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89e406fae0 0x7f89e415edf0 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 >> 172.21.15.64:0/3977292076 conn(0x7f89e406d570 msgr2=0x7f89e40d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 shutdown_connections 2024-09-21T07:38:18.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.794+0000 7f89e9600640 1 -- 172.21.15.64:0/3977292076 wait complete. 2024-09-21T07:38:18.829 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:38:18.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- 172.21.15.64:0/2621674398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 msgr2=0x7fdef8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:18.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 --2- 172.21.15.64:0/2621674398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdef8004c20 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c2e0 tx=0x7fdefc01f660 comp rx=0 tx=0).stop 2024-09-21T07:38:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- 172.21.15.64:0/2621674398 shutdown_connections 2024-09-21T07:38:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 --2- 172.21.15.64:0/2621674398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdef8004c20 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- 172.21.15.64:0/2621674398 >> 172.21.15.64:0/2621674398 conn(0x7fdf100d24f0 msgr2=0x7fdf100d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- 172.21.15.64:0/2621674398 shutdown_connections 2024-09-21T07:38:18.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- 172.21.15.64:0/2621674398 wait complete. 2024-09-21T07:38:18.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 Processor -- start 2024-09-21T07:38:18.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 -- start start 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:18.998+0000 7fdf17600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf100cb560 0x7fdf100c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf100cb970 0x7fdf100c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100b5860 con 0x7fdef8004810 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100b56e0 con 0x7fdf100cb560 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100b59e0 con 0x7fdf100cb970 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45238/0 (socket says 172.21.15.64:45238) 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 -- 172.21.15.64:0/3511579346 learned_addr learned my addr 172.21.15.64:0/3511579346 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf0fe00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf100cb560 0x7fdf100c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf15600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf100cb970 0x7fdf100c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 -- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf100cb970 msgr2=0x7fdf100c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf100cb970 0x7fdf100c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 -- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf100cb560 msgr2=0x7fdf100c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf100cb560 0x7fdf100c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 -- 172.21.15.64:0/3511579346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf100cc9e0 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf14c00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003e80 tx=0x7fdf04001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04015070 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf04011840 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011c70 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf100cc140 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf100cc700 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf100b6200 con 0x7fdef8004810 2024-09-21T07:38:19.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.002+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdf04018070 con 0x7fdef8004810 2024-09-21T07:38:19.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.006+0000 7fdf0cc00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 0x7fdef0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.006+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7fdf04094d60 con 0x7fdef8004810 2024-09-21T07:38:19.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.006+0000 7fdf0fe00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 0x7fdef0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.006+0000 7fdf0fe00640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 0x7fdef0075740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0b0000 tx=0x7fdefc01c4a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.010+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdf0405fe50 con 0x7fdef8004810 2024-09-21T07:38:19.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.186+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fdf100cd910 con 0x7fdef8004810 2024-09-21T07:38:19.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.190+0000 7fdf0cc00640 1 -- 172.21.15.64:0/3511579346 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v67) ==== 71+0+0 (secure 0 0 0) 0x7fdf0405f750 con 0x7fdef8004810 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 msgr2=0x7fdef0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 0x7fdef0075740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0b0000 tx=0x7fdefc01c4a0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 msgr2=0x7fdf1014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003e80 tx=0x7fdf04001640 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 shutdown_connections 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdef0073230 0x7fdef0075740 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdf100cb970 0x7fdf100c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf100cb560 0x7fdf100c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 --2- 172.21.15.64:0/3511579346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef8004810 0x7fdf1014fa50 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 >> 172.21.15.64:0/3511579346 conn(0x7fdf100d24f0 msgr2=0x7fdf100726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 shutdown_connections 2024-09-21T07:38:19.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.194+0000 7fdf17600640 1 -- 172.21.15.64:0/3511579346 wait complete. 2024-09-21T07:38:19.213 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 -- 172.21.15.64:0/3200254975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0caf00 msgr2=0x7f29fc0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 --2- 172.21.15.64:0/3200254975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0caf00 0x7f29fc0cb310 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009bf0 tx=0x7f29f401cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 -- 172.21.15.64:0/3200254975 shutdown_connections 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 --2- 172.21.15.64:0/3200254975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0caf00 0x7f29fc0cb310 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 --2- 172.21.15.64:0/3200254975 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc06fae0 0x7f29fc0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 -- 172.21.15.64:0/3200254975 >> 172.21.15.64:0/3200254975 conn(0x7f29fc06d570 msgr2=0x7f29fc0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:19.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 -- 172.21.15.64:0/3200254975 shutdown_connections 2024-09-21T07:38:19.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.370+0000 7f2a03800640 1 -- 172.21.15.64:0/3200254975 wait complete. 2024-09-21T07:38:19.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 Processor -- start 2024-09-21T07:38:19.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 -- start start 2024-09-21T07:38:19.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0b46f0 0x7f29fc154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc0caf00 0x7f29fc155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc168e60 con 0x7f29fc06fae0 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc168ce0 con 0x7f29fc0b46f0 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a03800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc168fe0 con 0x7f29fc0caf00 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45240/0 (socket says 172.21.15.64:45240) 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 -- 172.21.15.64:0/3407110274 learned_addr learned my addr 172.21.15.64:0/3407110274 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a01800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc0caf00 0x7f29fc155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f29fbe00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0b46f0 0x7f29fc154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 -- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc0caf00 msgr2=0x7f29fc155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc0caf00 0x7f29fc155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 -- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0b46f0 msgr2=0x7f29fc154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0b46f0 0x7f29fc154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 -- 172.21.15.64:0/3407110274 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc0ad630 con 0x7f29fc06fae0 2024-09-21T07:38:19.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.374+0000 7f2a00e00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e970 tx=0x7f29f000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000cd80 con 0x7f29fc06fae0 2024-09-21T07:38:19.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f0004020 con 0x7f29fc06fae0 2024-09-21T07:38:19.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0004470 con 0x7f29fc06fae0 2024-09-21T07:38:19.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29fc0ad910 con 0x7f29fc06fae0 2024-09-21T07:38:19.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29fc0aded0 con 0x7f29fc06fae0 2024-09-21T07:38:19.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29fc0af790 con 0x7f29fc06fae0 2024-09-21T07:38:19.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f29f0003600 con 0x7f29fc06fae0 2024-09-21T07:38:19.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.378+0000 7f29f8c00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 0x7f29dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.382+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7f29f0094950 con 0x7f29fc06fae0 2024-09-21T07:38:19.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.382+0000 7f29fbe00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 0x7f29dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.382+0000 7f29fbe00640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 0x7f29dc075710 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f29fc1fc480 tx=0x7f29e8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.386+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f29f005f4a0 con 0x7f29fc06fae0 2024-09-21T07:38:19.621 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.622+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f29fc159be0 con 0x7f29fc06fae0 2024-09-21T07:38:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.798+0000 7f29f8c00640 1 -- 172.21.15.64:0/3407110274 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v737) ==== 147+0+0 (secure 0 0 0) 0x7f29f0063ed0 con 0x7f29fc06fae0 2024-09-21T07:38:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 msgr2=0x7f29dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 0x7f29dc075710 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f29fc1fc480 tx=0x7f29e8009040 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 msgr2=0x7f29fc0c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e970 tx=0x7f29f000ee30 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 shutdown_connections 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f29dc073200 0x7f29dc075710 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29fc0caf00 0x7f29fc155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29fc0b46f0 0x7f29fc154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 --2- 172.21.15.64:0/3407110274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29fc06fae0 0x7f29fc0c5650 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 >> 172.21.15.64:0/3407110274 conn(0x7f29fc06d570 msgr2=0x7f29fc0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 shutdown_connections 2024-09-21T07:38:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.802+0000 7f2a03800640 1 -- 172.21.15.64:0/3407110274 wait complete. 2024-09-21T07:38:19.821 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-21T07:38:19.822 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2024-09-21T07:38:19.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- 172.21.15.64:0/3317171621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0b4e00 msgr2=0x7f0e5c0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 --2- 172.21.15.64:0/3317171621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0b4e00 0x7f0e5c0af790 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009840 tx=0x7f0e4401c740 comp rx=0 tx=0).stop 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- 172.21.15.64:0/3317171621 shutdown_connections 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 --2- 172.21.15.64:0/3317171621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0b4e00 0x7f0e5c0af790 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- 172.21.15.64:0/3317171621 >> 172.21.15.64:0/3317171621 conn(0x7f0e5c06d570 msgr2=0x7f0e5c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- 172.21.15.64:0/3317171621 shutdown_connections 2024-09-21T07:38:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- 172.21.15.64:0/3317171621 wait complete. 2024-09-21T07:38:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 Processor -- start 2024-09-21T07:38:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.986+0000 7f0e62000640 1 -- start start 2024-09-21T07:38:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e5c06fae0 0x7f0e5c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0aea40 0x7f0e5c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c169eb0 con 0x7f0e5c0caf00 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c169d30 con 0x7f0e5c0aea40 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c16a030 con 0x7f0e5c06fae0 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45248/0 (socket says 172.21.15.64:45248) 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 -- 172.21.15.64:0/895679083 learned_addr learned my addr 172.21.15.64:0/895679083 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e5be00640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0aea40 0x7f0e5c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e5b400640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e5c06fae0 0x7f0e5c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 -- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e5c06fae0 msgr2=0x7f0e5c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e5c06fae0 0x7f0e5c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 -- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0aea40 msgr2=0x7f0e5c0c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0aea40 0x7f0e5c0c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 -- 172.21.15.64:0/895679083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c1f9510 con 0x7f0e5c0caf00 2024-09-21T07:38:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53e00640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f0e44000c10 tx=0x7f0e44005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440047d0 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e44004970 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c0ca690 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004d60 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c0adf60 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.990+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c0af790 con 0x7f0e5c0caf00 2024-09-21T07:38:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.994+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0e440a6570 con 0x7f0e5c0caf00 2024-09-21T07:38:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.994+0000 7f0e53400640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 0x7f0e38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.994+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7f0e4412e0b0 con 0x7f0e5c0caf00 2024-09-21T07:38:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.994+0000 7f0e5b400640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 0x7f0e38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.994+0000 7f0e5b400640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 0x7f0e38075710 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c001230 tx=0x7f0e4c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:19.998+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0e440ac030 con 0x7f0e5c0caf00 2024-09-21T07:38:20.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.178+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e5c0cc440 con 0x7f0e5c0caf00 2024-09-21T07:38:20.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.178+0000 7f0e53400640 1 -- 172.21.15.64:0/895679083 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v221) ==== 74+0+13265 (secure 0 0 0) 0x7f0e44016330 con 0x7f0e5c0caf00 2024-09-21T07:38:20.179 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:20.179 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":221,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:38:18.787595+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/619754157":"2024-09-22T07:38:15.713054+0000","172.21.15.64:6834/619754157":"2024-09-22T07:38:15.713054+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 msgr2=0x7f0e38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 0x7f0e38075710 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c001230 tx=0x7f0e4c009040 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 msgr2=0x7f0e5c0c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f0e44000c10 tx=0x7f0e44005dc0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 shutdown_connections 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0e38073200 0x7f0e38075710 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e5c0aea40 0x7f0e5c0c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c0caf00 0x7f0e5c0c8910 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 --2- 172.21.15.64:0/895679083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e5c06fae0 0x7f0e5c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 >> 172.21.15.64:0/895679083 conn(0x7f0e5c06d570 msgr2=0x7f0e5c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:20.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 shutdown_connections 2024-09-21T07:38:20.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.182+0000 7f0e62000640 1 -- 172.21.15.64:0/895679083 wait complete. 2024-09-21T07:38:20.202 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:22:37.490222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:38:20.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 -- 172.21.15.64:0/2717775780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd415af70 msgr2=0x7f2fd406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 --2- 172.21.15.64:0/2717775780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd415af70 0x7f2fd406f0d0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40cfff0 tx=0x7f2fc801c880 comp rx=0 tx=0).stop 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 -- 172.21.15.64:0/2717775780 shutdown_connections 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 --2- 172.21.15.64:0/2717775780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd4074af0 0x7f2fd40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 --2- 172.21.15.64:0/2717775780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd415af70 0x7f2fd406f0d0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 -- 172.21.15.64:0/2717775780 >> 172.21.15.64:0/2717775780 conn(0x7f2fd406d570 msgr2=0x7f2fd40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 -- 172.21.15.64:0/2717775780 shutdown_connections 2024-09-21T07:38:20.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.362+0000 7f2fdb800640 1 -- 172.21.15.64:0/2717775780 wait complete. 2024-09-21T07:38:20.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 Processor -- start 2024-09-21T07:38:20.366 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 -- start start 2024-09-21T07:38:20.367 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fd406f610 0x7f2fd4153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd415af70 0x7f2fd4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4165dc0 con 0x7f2fd4074af0 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4165c40 con 0x7f2fd406f610 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fdb800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd4165f40 con 0x7f2fd415af70 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45270/0 (socket says 172.21.15.64:45270) 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fd8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fd406f610 0x7f2fd4153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fd3e00640 1 -- 172.21.15.64:0/1045680071 learned_addr learned my addr 172.21.15.64:0/1045680071 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:20.368 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.366+0000 7f2fd9800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd415af70 0x7f2fd4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 -- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd415af70 msgr2=0x7f2fd4154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd415af70 0x7f2fd4154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 -- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fd406f610 msgr2=0x7f2fd4153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fd406f610 0x7f2fd4153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 -- 172.21.15.64:0/1045680071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd40c64d0 con 0x7f2fd4074af0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd3e00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c3c0 tx=0x7f2fc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0017070 con 0x7f2fd4074af0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fc00053c0 con 0x7f2fd4074af0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0003860 con 0x7f2fd4074af0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd4153e20 con 0x7f2fd4074af0 2024-09-21T07:38:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd4152580 con 0x7f2fd4074af0 2024-09-21T07:38:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd41540a0 con 0x7f2fd4074af0 2024-09-21T07:38:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.370+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2fc001a070 con 0x7f2fd4074af0 2024-09-21T07:38:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.374+0000 7f2fd0c00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 0x7f2fb4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.374+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7f2fc0093370 con 0x7f2fd4074af0 2024-09-21T07:38:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.374+0000 7f2fd8e00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 0x7f2fb4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.374+0000 7f2fd8e00640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 0x7f2fb4075740 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80af000 tx=0x7f2fc801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.378+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2fd40c64d0 con 0x7f2fd4074af0 2024-09-21T07:38:20.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.550+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fd406f0d0 con 0x7f2fd4074af0 2024-09-21T07:38:20.551 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.550+0000 7f2fd0c00640 1 -- 172.21.15.64:0/1045680071 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v221) ==== 93+0+10 (secure 0 0 0) 0x7f2fc005dea0 con 0x7f2fd4074af0 2024-09-21T07:38:20.552 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 msgr2=0x7f2fb4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 0x7f2fb4075740 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80af000 tx=0x7f2fc801b120 comp rx=0 tx=0).stop 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 msgr2=0x7f2fd41538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c3c0 tx=0x7f2fc000c880 comp rx=0 tx=0).stop 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 shutdown_connections 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2fb4073230 0x7f2fb4075740 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fd415af70 0x7f2fd4154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fd4074af0 0x7f2fd41538e0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 --2- 172.21.15.64:0/1045680071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fd406f610 0x7f2fd4153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 >> 172.21.15.64:0/1045680071 conn(0x7f2fd406d570 msgr2=0x7f2fd4074f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 shutdown_connections 2024-09-21T07:38:20.555 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.554+0000 7f2fdb800640 1 -- 172.21.15.64:0/1045680071 wait complete. 2024-09-21T07:38:20.575 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-21T07:38:20.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- 172.21.15.64:0/4283816174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 msgr2=0x7fe4540cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 --2- 172.21.15.64:0/4283816174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540cb610 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009bc0 tx=0x7fe44c01cb70 comp rx=0 tx=0).stop 2024-09-21T07:38:20.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- 172.21.15.64:0/4283816174 shutdown_connections 2024-09-21T07:38:20.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 --2- 172.21.15.64:0/4283816174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540cb610 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- 172.21.15.64:0/4283816174 >> 172.21.15.64:0/4283816174 conn(0x7fe45406d570 msgr2=0x7fe4540b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:20.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- 172.21.15.64:0/4283816174 shutdown_connections 2024-09-21T07:38:20.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- 172.21.15.64:0/4283816174 wait complete. 2024-09-21T07:38:20.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 Processor -- start 2024-09-21T07:38:20.736 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.734+0000 7fe45b600640 1 -- start start 2024-09-21T07:38:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 0x7fe4541f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe454073120 0x7fe454073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe454169d70 con 0x7fe4540af790 2024-09-21T07:38:20.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe454169bf0 con 0x7fe45406fae0 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe454169ef0 con 0x7fe454073120 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45290/0 (socket says 172.21.15.64:45290) 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 -- 172.21.15.64:0/766959257 learned_addr learned my addr 172.21.15.64:0/766959257 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe459600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe454073120 0x7fe454073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe458c00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 0x7fe4541f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 -- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe454073120 msgr2=0x7fe454073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe454073120 0x7fe454073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 -- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 msgr2=0x7fe4541f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 0x7fe4541f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 -- 172.21.15.64:0/766959257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe454073a70 con 0x7fe4540af790 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe458c00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 0x7fe4541f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe44be00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3f0 tx=0x7fe43c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:20.742 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c017070 con 0x7fe4540af790 2024-09-21T07:38:20.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe43c0053c0 con 0x7fe4540af790 2024-09-21T07:38:20.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003860 con 0x7fe4540af790 2024-09-21T07:38:20.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4541f7670 con 0x7fe4540af790 2024-09-21T07:38:20.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4540c9dd0 con 0x7fe4540af790 2024-09-21T07:38:20.743 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.738+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4540b46f0 con 0x7fe4540af790 2024-09-21T07:38:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.742+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe43c01a070 con 0x7fe4540af790 2024-09-21T07:38:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.742+0000 7fe451600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 0x7fe430075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.742+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7fe43c093220 con 0x7fe4540af790 2024-09-21T07:38:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.742+0000 7fe458c00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 0x7fe430075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:20.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.742+0000 7fe458c00640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 0x7fe430075710 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe4440046c0 tx=0x7fe444009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:20.747 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.746+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe454073a70 con 0x7fe4540af790 2024-09-21T07:38:20.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:20.986+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7fe4541552d0 con 0x7fe4540af790 2024-09-21T07:38:21.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.806+0000 7fe451600640 1 -- 172.21.15.64:0/766959257 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v739) ==== 136+0+0 (secure 0 0 0) 0x7fe4540ccbc0 con 0x7fe4540af790 2024-09-21T07:38:21.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 msgr2=0x7fe430075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 0x7fe430075710 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe4440046c0 tx=0x7fe444009040 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 msgr2=0x7fe4540c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3f0 tx=0x7fe43c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 shutdown_connections 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe430073200 0x7fe430075710 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe454073120 0x7fe454073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4540af790 0x7fe4540c5d10 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 --2- 172.21.15.64:0/766959257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45406fae0 0x7fe4541f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 >> 172.21.15.64:0/766959257 conn(0x7fe45406d570 msgr2=0x7fe4540c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:21.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 shutdown_connections 2024-09-21T07:38:21.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.810+0000 7fe45b600640 1 -- 172.21.15.64:0/766959257 wait complete. 2024-09-21T07:38:21.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:38:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- 172.21.15.64:0/2553264236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b46f0 msgr2=0x7fcb340b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 --2- 172.21.15.64:0/2553264236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b46f0 0x7fcb340b4b00 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009870 tx=0x7fcb1c01c7c0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- 172.21.15.64:0/2553264236 shutdown_connections 2024-09-21T07:38:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 --2- 172.21.15.64:0/2553264236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b46f0 0x7fcb340b4b00 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 --2- 172.21.15.64:0/2553264236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3406fae0 0x7fcb340af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- 172.21.15.64:0/2553264236 >> 172.21.15.64:0/2553264236 conn(0x7fcb3406d570 msgr2=0x7fcb340b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- 172.21.15.64:0/2553264236 shutdown_connections 2024-09-21T07:38:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- 172.21.15.64:0/2553264236 wait complete. 2024-09-21T07:38:21.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 Processor -- start 2024-09-21T07:38:21.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:21.998+0000 7fcb3b000640 1 -- start start 2024-09-21T07:38:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 0x7fcb340999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb340b46f0 0x7fcb341fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34169380 con 0x7fcb340b3170 2024-09-21T07:38:22.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34169200 con 0x7fcb3406fae0 2024-09-21T07:38:22.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fcb34169500 con 0x7fcb340b46f0 2024-09-21T07:38:22.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45308/0 (socket says 172.21.15.64:45308) 2024-09-21T07:38:22.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 -- 172.21.15.64:0/870813861 learned_addr learned my addr 172.21.15.64:0/870813861 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:22.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb33e00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 0x7fcb340999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb39000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb340b46f0 0x7fcb341fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 -- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb340b46f0 msgr2=0x7fcb341fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb340b46f0 0x7fcb341fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 -- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 msgr2=0x7fcb340999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 0x7fcb340999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 -- 172.21.15.64:0/870813861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb340c6db0 con 0x7fcb340b3170 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb33e00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 0x7fcb340999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb2be00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009790 tx=0x7fcb1c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0b2040 con 0x7fcb340b3170 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb1c004130 con 0x7fcb340b3170 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb340c7dd0 con 0x7fcb340b3170 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c003600 con 0x7fcb340b3170 2024-09-21T07:38:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb340c7570 con 0x7fcb340b3170 2024-09-21T07:38:22.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.002+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb341f7ae0 con 0x7fcb340b3170 2024-09-21T07:38:22.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.006+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb1c0bd060 con 0x7fcb340b3170 2024-09-21T07:38:22.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.006+0000 7fcb30c00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 0x7fcb10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.006+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7fcb1c12d850 con 0x7fcb340b3170 2024-09-21T07:38:22.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.006+0000 7fcb33e00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 0x7fcb10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.006 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.006+0000 7fcb33e00640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 0x7fcb10075710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009b90 tx=0x7fcb240091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:22.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.010+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fcb340c6db0 con 0x7fcb340b3170 2024-09-21T07:38:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.190+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcb340af790 con 0x7fcb340b3170 2024-09-21T07:38:22.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.190+0000 7fcb30c00640 1 -- 172.21.15.64:0/870813861 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v67) ==== 59+0+2294 (secure 0 0 0) 0x7fcb1c016410 con 0x7fcb340b3170 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_client 20/20 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4643.458710 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6432.347152 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4682.409635 2024-09-21T07:38:22.191 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7395.070112 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4225.925827 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4349.394176 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4084.844469 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7172.909019 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds 20/20 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced debug_ms 2/2 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_frag true 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds dev mds_verify_scatter true 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:38:22.192 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced client_mount_timeout 600 2024-09-21T07:38:22.193 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_client 20/20 2024-09-21T07:38:22.193 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced debug_ms 1/1 2024-09-21T07:38:22.193 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:38:22.193 INFO:teuthology.orchestra.run.smithi064.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:38:22.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 msgr2=0x7fcb10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 0x7fcb10075710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009b90 tx=0x7fcb240091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 msgr2=0x7fcb340c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009790 tx=0x7fcb1c005760 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 shutdown_connections 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fcb10073200 0x7fcb10075710 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb340b46f0 0x7fcb341fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb340b3170 0x7fcb340c5d30 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 --2- 172.21.15.64:0/870813861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3406fae0 0x7fcb340999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 >> 172.21.15.64:0/870813861 conn(0x7fcb3406d570 msgr2=0x7fcb34158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 shutdown_connections 2024-09-21T07:38:22.194 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.194+0000 7fcb3b000640 1 -- 172.21.15.64:0/870813861 wait complete. 2024-09-21T07:38:22.213 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 -- 172.21.15.64:0/1382299237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e00b4180 msgr2=0x7fc4e0073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1382299237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e00b4180 0x7fc4e0073ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c801c7d0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 -- 172.21.15.64:0/1382299237 shutdown_connections 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1382299237 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e00b4180 0x7fc4e0073ae0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 -- 172.21.15.64:0/1382299237 >> 172.21.15.64:0/1382299237 conn(0x7fc4e006d570 msgr2=0x7fc4e00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:22.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 -- 172.21.15.64:0/1382299237 shutdown_connections 2024-09-21T07:38:22.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.374+0000 7fc4e5400640 1 -- 172.21.15.64:0/1382299237 wait complete. 2024-09-21T07:38:22.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.378+0000 7fc4e5400640 1 Processor -- start 2024-09-21T07:38:22.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.378+0000 7fc4e5400640 1 -- start start 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.378+0000 7fc4e5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.378+0000 7fc4e5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e00b4180 0x7fc4e00c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e015af70 0x7fc4e009b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0168c60 con 0x7fc4e006f7e0 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e00b2c40 con 0x7fc4e00b4180 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e0168de0 con 0x7fc4e015af70 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45324/0 (socket says 172.21.15.64:45324) 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 -- 172.21.15.64:0/1786970436 learned_addr learned my addr 172.21.15.64:0/1786970436 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4d5e00640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e00b4180 0x7fc4e00c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4df200640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e015af70 0x7fc4e009b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 -- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e015af70 msgr2=0x7fc4e009b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e015af70 0x7fc4e009b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 -- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e00b4180 msgr2=0x7fc4e00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e00b4180 0x7fc4e00c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 -- 172.21.15.64:0/1786970436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e01f7100 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4de800640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c430 tx=0x7fc4d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0017070 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4d00053c0 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e009a840 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0003860 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e009ae00 con 0x7fc4e006f7e0 2024-09-21T07:38:22.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e006f0d0 con 0x7fc4e006f7e0 2024-09-21T07:38:22.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.382+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4d001a070 con 0x7fc4e006f7e0 2024-09-21T07:38:22.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.386+0000 7fc4d7400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 0x7fc4bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:22.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.386+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7fc4d0093430 con 0x7fc4e006f7e0 2024-09-21T07:38:22.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.386+0000 7fc4d5e00640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 0x7fc4bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:22.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.386+0000 7fc4d5e00640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 0x7fc4bc075710 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80af000 tx=0x7fc4c801b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:22.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.390+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc4d005df70 con 0x7fc4e006f7e0 2024-09-21T07:38:22.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.566+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc4e00ae950 con 0x7fc4e006f7e0 2024-09-21T07:38:22.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.570+0000 7fc4d7400640 1 -- 172.21.15.64:0/1786970436 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v68)=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7fc4d00629a0 con 0x7fc4e006f7e0 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 msgr2=0x7fc4bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 0x7fc4bc075710 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80af000 tx=0x7fc4c801b070 comp rx=0 tx=0).stop 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 msgr2=0x7fc4e01f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c430 tx=0x7fc4d000c8f0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 shutdown_connections 2024-09-21T07:38:22.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc4bc073200 0x7fc4bc075710 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e015af70 0x7fc4e009b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e00b4180 0x7fc4e00c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 --2- 172.21.15.64:0/1786970436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e006f7e0 0x7fc4e01f6bc0 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 >> 172.21.15.64:0/1786970436 conn(0x7fc4e006d570 msgr2=0x7fc4e00ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 shutdown_connections 2024-09-21T07:38:22.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:22.574+0000 7fc4e5400640 1 -- 172.21.15.64:0/1786970436 wait complete. 2024-09-21T07:38:22.594 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:38:22.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:38:22.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:38:22.785 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:38:22.785 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:22.785 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:22.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:38:22.794 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:38:22.794 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:22.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:38:22.803 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:22.803 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:22.850 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:38:22.850 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:38:22.851 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:22.860 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:38:22.860 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:38:22.860 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:23.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 -- 172.21.15.64:0/141806830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80b4e00 msgr2=0x7f46f80af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 --2- 172.21.15.64:0/141806830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80b4e00 0x7f46f80af790 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009840 tx=0x7f46e001c820 comp rx=0 tx=0).stop 2024-09-21T07:38:23.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 -- 172.21.15.64:0/141806830 shutdown_connections 2024-09-21T07:38:23.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 --2- 172.21.15.64:0/141806830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80b4e00 0x7f46f80af790 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 -- 172.21.15.64:0/141806830 >> 172.21.15.64:0/141806830 conn(0x7f46f806d570 msgr2=0x7f46f80b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:23.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 -- 172.21.15.64:0/141806830 shutdown_connections 2024-09-21T07:38:23.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.050+0000 7f46ff400640 1 -- 172.21.15.64:0/141806830 wait complete. 2024-09-21T07:38:23.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 Processor -- start 2024-09-21T07:38:23.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- start start 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46f806fae0 0x7f46f8166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46f80c6940 0x7f46f80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8169f50 con 0x7f46f80caf00 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8169dd0 con 0x7f46f806fae0 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f46f816a0d0 con 0x7f46f80c6940 2024-09-21T07:38:23.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45336/0 (socket says 172.21.15.64:45336) 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 -- 172.21.15.64:0/3540636005 learned_addr learned my addr 172.21.15.64:0/3540636005 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46fd400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46f80c6940 0x7f46f80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46fca00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46f806fae0 0x7f46f8166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 -- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46f80c6940 msgr2=0x7f46f80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46f80c6940 0x7f46f80ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 -- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46f806fae0 msgr2=0x7f46f8166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46f806fae0 0x7f46f8166f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 -- 172.21.15.64:0/3540636005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f8158c10 con 0x7f46f80caf00 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46efe00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009790 tx=0x7f46e0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e00bb070 con 0x7f46f80caf00 2024-09-21T07:38:23.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e0005030 con 0x7f46f80caf00 2024-09-21T07:38:23.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f8158ef0 con 0x7f46f80caf00 2024-09-21T07:38:23.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e00b2040 con 0x7f46f80caf00 2024-09-21T07:38:23.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f81594b0 con 0x7f46f80caf00 2024-09-21T07:38:23.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.054+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f80af790 con 0x7f46f80caf00 2024-09-21T07:38:23.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.058+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f46e00be070 con 0x7f46f80caf00 2024-09-21T07:38:23.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.058+0000 7f46f5600640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 0x7f46d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.058+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7f46e012dd10 con 0x7f46f80caf00 2024-09-21T07:38:23.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.058+0000 7f46fca00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 0x7f46d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.058+0000 7f46fca00640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 0x7f46d4075710 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f46e8001650 tx=0x7f46e8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:23.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.062+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f46e0016410 con 0x7f46f80caf00 2024-09-21T07:38:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.278+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46f80b1df0 con 0x7f46f80caf00 2024-09-21T07:38:23.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.278+0000 7f46f5600640 1 -- 172.21.15.64:0/3540636005 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) ==== 95+0+3917 (secure 0 0 0) 0x7f46e00f8f10 con 0x7f46f80caf00 2024-09-21T07:38:23.278 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:23.278 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":162,"btime":"2024-09-21T07:38:16:770239+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3395837632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3395837632},{"type":"v1","addr":"172.21.15.90:6836","nonce":3395837632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10648,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3834072207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3834072207},{"type":"v1","addr":"172.21.15.90:6837","nonce":3834072207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/620305583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":620305583},{"type":"v1","addr":"172.21.15.64:6833","nonce":620305583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3144224199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3144224199},{"type":"v1","addr":"172.21.15.64:6835","nonce":3144224199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162}],"filesystems":[]} 2024-09-21T07:38:23.279 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 162 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 msgr2=0x7f46d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 0x7f46d4075710 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f46e8001650 tx=0x7f46e8009040 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 msgr2=0x7f46f80aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009790 tx=0x7f46e0004040 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 shutdown_connections 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f46d4073200 0x7f46d4075710 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46f80c6940 0x7f46f80ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f80caf00 0x7f46f80aeb60 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 --2- 172.21.15.64:0/3540636005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46f806fae0 0x7f46f8166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 >> 172.21.15.64:0/3540636005 conn(0x7f46f806d570 msgr2=0x7f46f80740d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 shutdown_connections 2024-09-21T07:38:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.282+0000 7f46ff400640 1 -- 172.21.15.64:0/3540636005 wait complete. 2024-09-21T07:38:23.301 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:38:23.301 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:38:23.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:38:23.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:38:23.302 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:38:23.302 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:38:23.302 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:38:23.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:38:23.302 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:38:23.302 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:38:23.302 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:38:23.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:38:23.303 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:38:23.303 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:38:23.303 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:38:23.303 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:38:23.313 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:38:23.313 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:38:23.318 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:38:23.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:38:23.319 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:38:23.319 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:38:23.322 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:38:23.322 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:38:23.365 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:38:23.365 DEBUG:teuthology.parallel:result is None 2024-09-21T07:38:23.367 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:38:23.367 DEBUG:teuthology.parallel:result is None 2024-09-21T07:38:23.370 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:38:23.370 DEBUG:teuthology.parallel:result is None 2024-09-21T07:38:23.372 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:38:23.372 DEBUG:teuthology.parallel:result is None 2024-09-21T07:38:23.373 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:38:23.472 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:38:23.473 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:38:23.474 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2024-09-21T07:38:23.475 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 -- 172.21.15.64:0/4287484467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0d08a0 msgr2=0x7fd4dc0b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 --2- 172.21.15.64:0/4287484467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0d08a0 0x7fd4dc0b1d20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009840 tx=0x7fd4c801c820 comp rx=0 tx=0).stop 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 -- 172.21.15.64:0/4287484467 shutdown_connections 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 --2- 172.21.15.64:0/4287484467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0d08a0 0x7fd4dc0b1d20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 --2- 172.21.15.64:0/4287484467 >> v2:172.21.15.90:3300/0 conn(0x7fd4dc0d0fe0 0x7fd4dc0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 -- 172.21.15.64:0/4287484467 >> 172.21.15.64:0/4287484467 conn(0x7fd4dc0cef80 msgr2=0x7fd4dc0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 -- 172.21.15.64:0/4287484467 shutdown_connections 2024-09-21T07:38:23.540 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.538+0000 7fd4e4000640 1 -- 172.21.15.64:0/4287484467 wait complete. 2024-09-21T07:38:23.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 Processor -- start 2024-09-21T07:38:23.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 -- start start 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0b2260 0x7fd4dc15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4dc0d08a0 0x7fd4dc06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc16a380 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc16a200 con 0x7fd4dc0d08a0 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e4000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd4dc16a500 con 0x7fd4dc0b2260 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e2000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45400/0 (socket says 172.21.15.64:45400) 2024-09-21T07:38:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e2000640 1 -- 172.21.15.64:0/2252479989 learned_addr learned my addr 172.21.15.64:0/2252479989 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e0c00640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4dc0d08a0 0x7fd4dc06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e1600640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0b2260 0x7fd4dc15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e2000640 1 -- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0b2260 msgr2=0x7fd4dc15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.542+0000 7fd4e2000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0b2260 0x7fd4dc15ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e2000640 1 -- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4dc0d08a0 msgr2=0x7fd4dc06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e2000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4dc0d08a0 0x7fd4dc06fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e2000640 1 -- 172.21.15.64:0/2252479989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc155a60 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e2000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400cab0 tx=0x7fd4d400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4016020 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4d400a8f0 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400ad40 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4dc155d40 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4dc06df40 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4dc06e170 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.547 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd4d4019020 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.546+0000 7fd4d9600640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 0x7fd4bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.550+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 5335+0+0 (secure 0 0 0) 0x7fd4d40941a0 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.550+0000 7fd4e1600640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 0x7fd4bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:23.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.550+0000 7fd4e1600640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 0x7fd4bc075740 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009600 tx=0x7fd4d00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:23.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.554+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd4dc06e170 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.740 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.738+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd4dc0b1d20 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4d9600640 1 -- 172.21.15.64:0/2252479989 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v223) ==== 97+0+0 (secure 0 0 0) 0x7fd4d4020020 con 0x7fd4dc0d0fe0 2024-09-21T07:38:23.825 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 msgr2=0x7fd4bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 0x7fd4bc075740 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009600 tx=0x7fd4d00091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 msgr2=0x7fd4dc157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400cab0 tx=0x7fd4d400cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 shutdown_connections 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd4bc073230 0x7fd4bc075740 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4dc0d0fe0 0x7fd4dc157be0 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4dc0d08a0 0x7fd4dc06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 --2- 172.21.15.64:0/2252479989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4dc0b2260 0x7fd4dc15ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.826+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 >> 172.21.15.64:0/2252479989 conn(0x7fd4dc0cef80 msgr2=0x7fd4dc0713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.830+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 shutdown_connections 2024-09-21T07:38:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:23.830+0000 7fd4e4000640 1 -- 172.21.15.64:0/2252479989 wait complete. 2024-09-21T07:38:23.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- 172.21.15.64:0/666136660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb200b4e00 msgr2=0x7ffb200af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 --2- 172.21.15.64:0/666136660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb200b4e00 0x7ffb200af790 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009840 tx=0x7ffb0801c820 comp rx=0 tx=0).stop 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- 172.21.15.64:0/666136660 shutdown_connections 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 --2- 172.21.15.64:0/666136660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb200b4e00 0x7ffb200af790 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- 172.21.15.64:0/666136660 >> 172.21.15.64:0/666136660 conn(0x7ffb2006d570 msgr2=0x7ffb200b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:24.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- 172.21.15.64:0/666136660 shutdown_connections 2024-09-21T07:38:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- 172.21.15.64:0/666136660 wait complete. 2024-09-21T07:38:24.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 Processor -- start 2024-09-21T07:38:24.016 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.014+0000 7ffb25e00640 1 -- start start 2024-09-21T07:38:24.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb200caf00 0x7ffb200b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb200b1480 0x7ffb200b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20169f70 con 0x7ffb2006fae0 2024-09-21T07:38:24.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20169df0 con 0x7ffb200caf00 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2016a0f0 con 0x7ffb200b1480 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45420/0 (socket says 172.21.15.64:45420) 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 -- 172.21.15.64:0/3497022774 learned_addr learned my addr 172.21.15.64:0/3497022774 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb16000640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb200caf00 0x7ffb200b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1f400640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb200b1480 0x7ffb200b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 -- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb200b1480 msgr2=0x7ffb200b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb200b1480 0x7ffb200b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 -- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb200caf00 msgr2=0x7ffb200b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb200caf00 0x7ffb200b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 -- 172.21.15.64:0/3497022774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb200aff80 con 0x7ffb2006fae0 2024-09-21T07:38:24.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb1ea00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c7c0 tx=0x7ffb1000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10003b80 con 0x7ffb2006fae0 2024-09-21T07:38:24.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb10003d20 con 0x7ffb2006fae0 2024-09-21T07:38:24.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000aa90 con 0x7ffb2006fae0 2024-09-21T07:38:24.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb200b2120 con 0x7ffb2006fae0 2024-09-21T07:38:24.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb20156f90 con 0x7ffb2006fae0 2024-09-21T07:38:24.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.018+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb200af790 con 0x7ffb2006fae0 2024-09-21T07:38:24.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.022+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffb1000ac30 con 0x7ffb2006fae0 2024-09-21T07:38:24.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.022+0000 7ffb17e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 0x7ffafc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.022+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 5249+0+0 (secure 0 0 0) 0x7ffb10093e00 con 0x7ffb2006fae0 2024-09-21T07:38:24.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.022+0000 7ffb16000640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 0x7ffafc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.022+0000 7ffb16000640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 0x7ffafc075740 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ffb080af000 tx=0x7ffb0801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.026+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ffb200ccbc0 con 0x7ffb2006fae0 2024-09-21T07:38:24.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.262+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffb2015a2d0 con 0x7ffb2006fae0 2024-09-21T07:38:24.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb17e00640 1 -- 172.21.15.64:0/3497022774 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) ==== 80+0+5304 (secure 0 0 0) 0x7ffb1005e8f0 con 0x7ffb2006fae0 2024-09-21T07:38:24.264 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:24.264 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:24.264 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2024-09-21T07:38:24.264 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mHxhMORAAYKVfpoO/w9eClbySzqKXHA==", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5m8QrSChAArzgPDkk4oS/1xDbKEqTrKA==", 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.265 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5my+2FBRAA10XX+XJ8lUKddfZ0s0pu3A==", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:38:24.266 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mNhm5EhAAk9OAr0hoJhfzHfOF7yedmg==", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2024-09-21T07:38:24.267 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAIdO5mjj1cFxAA3mMJGp0ArMltviLDmMcWrw==", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQALdO5mXHBrMBAALpw4Ixjdzy751rduI3OIbQ==", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.268 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAPdO5mXEN6CRAAEbjTsBdfe1gvIZsVFw87xw==", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQASdO5m8lKSHhAAWzNSF5jiV24674GQ5aAPSw==", 2024-09-21T07:38:24.269 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAYdO5mr+MNJBAAE7E7DVbNT5MDfn9mN0mGpw==", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.270 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAbdO5mRPAXORAApoNNpHQzprDx+/66TSnK5w==", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAfdO5mBin6FRAAEdgi/ENMRyLKzJlPveS+gQ==", 2024-09-21T07:38:24.271 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAidO5m9V1PKRAAHQTCZR4hy3c73Xt3nEiAqQ==", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.272 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA==", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow r", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mAOSeHxAAHB0AM4mZcZu6uTZIMVaWIA==", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.273 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mWWKTGxAAJx+H/YVQ7JeTI1o5gMg0Qg==", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.274 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAFdO5mRfW1IxAAi198LGuzQ7ORRkNxUMFLmw==", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mfiAhHBAAPOWLyzt+9SrexBJAXSabSg==", 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mZ+lHNBAAko7yzFSXWrSCvtEPdhSAJg==", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.276 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQAEdO5mwpb+LxAAotj8pVC3zzl5kOOgl1qJvg==", 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-21T07:38:24.277 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 msgr2=0x7ffafc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 0x7ffafc075740 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ffb080af000 tx=0x7ffb0801b060 comp rx=0 tx=0).stop 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 msgr2=0x7ffb20156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c7c0 tx=0x7ffb1000cc80 comp rx=0 tx=0).stop 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 shutdown_connections 2024-09-21T07:38:24.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ffafc073230 0x7ffafc075740 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb200b1480 0x7ffb200b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb200caf00 0x7ffb200b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 --2- 172.21.15.64:0/3497022774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb2006fae0 0x7ffb20156a50 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 >> 172.21.15.64:0/3497022774 conn(0x7ffb2006d570 msgr2=0x7ffb200ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 shutdown_connections 2024-09-21T07:38:24.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.266+0000 7ffb25e00640 1 -- 172.21.15.64:0/3497022774 wait complete. 2024-09-21T07:38:24.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 -- 172.21.15.64:0/2260647993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a006fae0 msgr2=0x7fe7a00af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 --2- 172.21.15.64:0/2260647993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a006fae0 0x7fe7a00af790 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7fe790009960 tx=0x7fe79001eab0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 -- 172.21.15.64:0/2260647993 shutdown_connections 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 --2- 172.21.15.64:0/2260647993 >> v2:172.21.15.90:3300/0 conn(0x7fe7a00b3170 0x7fe7a00b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 --2- 172.21.15.64:0/2260647993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b46f0 0x7fe7a00b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 --2- 172.21.15.64:0/2260647993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a006fae0 0x7fe7a00af790 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 -- 172.21.15.64:0/2260647993 >> 172.21.15.64:0/2260647993 conn(0x7fe7a006d570 msgr2=0x7fe7a00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 -- 172.21.15.64:0/2260647993 shutdown_connections 2024-09-21T07:38:24.447 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.446+0000 7fe7a7800640 1 -- 172.21.15.64:0/2260647993 wait complete. 2024-09-21T07:38:24.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 Processor -- start 2024-09-21T07:38:24.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- start start 2024-09-21T07:38:24.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7a006fae0 0x7fe7a015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b3170 0x7fe7a00c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.450 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00cda50 con 0x7fe7a00b46f0 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00cd8d0 con 0x7fe7a006fae0 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a00cdbd0 con 0x7fe7a00b3170 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe797e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b3170 0x7fe7a00c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7a006fae0 0x7fe7a015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45438/0 (socket says 172.21.15.64:45438) 2024-09-21T07:38:24.451 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 -- 172.21.15.64:0/1736587731 learned_addr learned my addr 172.21.15.64:0/1736587731 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 -- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b3170 msgr2=0x7fe7a00c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b3170 0x7fe7a00c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 -- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7a006fae0 msgr2=0x7fe7a015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7a006fae0 0x7fe7a015b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 -- 172.21.15.64:0/1736587731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a01f5360 con 0x7fe7a00b46f0 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a5800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fe79800caa0 tx=0x7fe79800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79800adf0 con 0x7fe7a00b46f0 2024-09-21T07:38:24.452 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe798003a70 con 0x7fe7a00b46f0 2024-09-21T07:38:24.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798004030 con 0x7fe7a00b46f0 2024-09-21T07:38:24.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a01f5640 con 0x7fe7a00b46f0 2024-09-21T07:38:24.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.450+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a00c5480 con 0x7fe7a00b46f0 2024-09-21T07:38:24.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a00b3580 con 0x7fe7a00b46f0 2024-09-21T07:38:24.453 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe7980041d0 con 0x7fe7a00b46f0 2024-09-21T07:38:24.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe79d600640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 0x7fe77c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 5249+0+0 (secure 0 0 0) 0x7fe7980948b0 con 0x7fe7a00b46f0 2024-09-21T07:38:24.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe7a4e00640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 0x7fe77c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.454+0000 7fe7a4e00640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 0x7fe77c075740 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b1000 tx=0x7fe79001d2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.458+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe798014070 con 0x7fe7a00b46f0 2024-09-21T07:38:24.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe7a0155d40 con 0x7fe7a00b46f0 2024-09-21T07:38:24.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe79d600640 1 -- 172.21.15.64:0/1736587731 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v225) ==== 84+0+65 (secure 0 0 0) 0x7fe79805f3a0 con 0x7fe7a00b46f0 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout: { 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:24.638 INFO:teuthology.orchestra.run.smithi064.stdout:] 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 msgr2=0x7fe77c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 0x7fe77c075740 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b1000 tx=0x7fe79001d2f0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 msgr2=0x7fe7a00c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fe79800caa0 tx=0x7fe79800cf60 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 shutdown_connections 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe77c073230 0x7fe77c075740 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe7a00b46f0 0x7fe7a00c4cf0 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7a00b3170 0x7fe7a00c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 --2- 172.21.15.64:0/1736587731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7a006fae0 0x7fe7a015b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 >> 172.21.15.64:0/1736587731 conn(0x7fe7a006d570 msgr2=0x7fe7a0074a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:24.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 shutdown_connections 2024-09-21T07:38:24.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.638+0000 7fe7a7800640 1 -- 172.21.15.64:0/1736587731 wait complete. 2024-09-21T07:38:24.660 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:38:24.660 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:38:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 -- 172.21.15.64:0/1703196245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc074af0 msgr2=0x7f3adc0b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1703196245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc074af0 0x7f3adc0b3880 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0728a0 tx=0x7f3ad401ca90 comp rx=0 tx=0).stop 2024-09-21T07:38:24.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 -- 172.21.15.64:0/1703196245 shutdown_connections 2024-09-21T07:38:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1703196245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc074af0 0x7f3adc0b3880 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1703196245 >> v2:172.21.15.90:3300/0 conn(0x7f3adc15af70 0x7f3adc06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.822+0000 7f3ae3600640 1 -- 172.21.15.64:0/1703196245 >> 172.21.15.64:0/1703196245 conn(0x7f3adc06d570 msgr2=0x7f3adc0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.826+0000 7f3ae3600640 1 -- 172.21.15.64:0/1703196245 shutdown_connections 2024-09-21T07:38:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.826+0000 7f3ae3600640 1 -- 172.21.15.64:0/1703196245 wait complete. 2024-09-21T07:38:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.826+0000 7f3ae3600640 1 Processor -- start 2024-09-21T07:38:24.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.826+0000 7f3ae3600640 1 -- start start 2024-09-21T07:38:24.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3adc074af0 0x7f3adc167040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3adc15af70 0x7f3adc167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc165fd0 con 0x7f3adc06f610 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc165e50 con 0x7f3adc15af70 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc166150 con 0x7f3adc074af0 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45456/0 (socket says 172.21.15.64:45456) 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 -- 172.21.15.64:0/1378097311 learned_addr learned my addr 172.21.15.64:0/1378097311 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ad3e00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3adc074af0 0x7f3adc167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae1600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3adc15af70 0x7f3adc167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 -- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3adc074af0 msgr2=0x7f3adc167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3adc074af0 0x7f3adc167040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 -- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3adc15af70 msgr2=0x7f3adc167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3adc15af70 0x7f3adc167580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 -- 172.21.15.64:0/1378097311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc1f8fb0 con 0x7f3adc06f610 2024-09-21T07:38:24.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae0c00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00d720 tx=0x7f3acc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc017070 con 0x7f3adc06f610 2024-09-21T07:38:24.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc1f9290 con 0x7f3adc06f610 2024-09-21T07:38:24.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3acc009d20 con 0x7f3adc06f610 2024-09-21T07:38:24.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc005280 con 0x7f3adc06f610 2024-09-21T07:38:24.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.830+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc1f9850 con 0x7f3adc06f610 2024-09-21T07:38:24.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.834+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc06f0d0 con 0x7f3adc06f610 2024-09-21T07:38:24.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.834+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3acc005420 con 0x7f3adc06f610 2024-09-21T07:38:24.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.834+0000 7f3ad9600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 0x7f3ab8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:24.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.834+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 5249+0+0 (secure 0 0 0) 0x7f3acc094220 con 0x7f3adc06f610 2024-09-21T07:38:24.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.834+0000 7f3ad3e00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 0x7f3ab8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:24.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.838+0000 7f3ad3e00640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 0x7f3ab8075710 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3adc157ab0 tx=0x7f3ac4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:24.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:24.838+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3acc05ec90 con 0x7f3adc06f610 2024-09-21T07:38:25.018 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.018+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3adc076820 con 0x7f3adc06f610 2024-09-21T07:38:25.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.838+0000 7f3ad9600640 1 -- 172.21.15.64:0/1378097311 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v226) ==== 138+0+0 (secure 0 0 0) 0x7f3acc0636c0 con 0x7f3adc06f610 2024-09-21T07:38:25.839 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2024-09-21T07:38:25.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 msgr2=0x7f3ab8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:25.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 0x7f3ab8075710 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3adc157ab0 tx=0x7f3ac4009040 comp rx=0 tx=0).stop 2024-09-21T07:38:25.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 msgr2=0x7f3adc09db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:25.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00d720 tx=0x7f3acc00dbe0 comp rx=0 tx=0).stop 2024-09-21T07:38:25.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 shutdown_connections 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3ab8073200 0x7f3ab8075710 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3adc15af70 0x7f3adc167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3adc074af0 0x7f3adc167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 --2- 172.21.15.64:0/1378097311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3adc06f610 0x7f3adc09db00 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 >> 172.21.15.64:0/1378097311 conn(0x7f3adc06d570 msgr2=0x7f3adc15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 shutdown_connections 2024-09-21T07:38:25.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:25.842+0000 7f3ae3600640 1 -- 172.21.15.64:0/1378097311 wait complete. 2024-09-21T07:38:25.871 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 -- 172.21.15.64:0/3323568311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000cf8d0 msgr2=0x7fee0015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 --2- 172.21.15.64:0/3323568311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000cf8d0 0x7fee0015ae00 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009900 tx=0x7fedf001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 -- 172.21.15.64:0/3323568311 shutdown_connections 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 --2- 172.21.15.64:0/3323568311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000d0950 0x7fee000ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 --2- 172.21.15.64:0/3323568311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000cf8d0 0x7fee0015ae00 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 -- 172.21.15.64:0/3323568311 >> 172.21.15.64:0/3323568311 conn(0x7fee0006d490 msgr2=0x7fee000d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:26.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 -- 172.21.15.64:0/3323568311 shutdown_connections 2024-09-21T07:38:26.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.038+0000 7fee06600640 1 -- 172.21.15.64:0/3323568311 wait complete. 2024-09-21T07:38:26.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 Processor -- start 2024-09-21T07:38:26.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 -- start start 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000cf8d0 0x7fee000c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 0x7fee000c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fee00169360 con 0x7fee000d0950 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee001691e0 con 0x7fee000d0d60 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fee06600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fee001694e0 con 0x7fee000cf8d0 2024-09-21T07:38:26.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55436/0 (socket says 172.21.15.64:55436) 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fedf6a00640 1 -- 172.21.15.64:0/292653839 learned_addr learned my addr 172.21.15.64:0/292653839 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.042+0000 7fedff400640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000cf8d0 0x7fee000c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedffe00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 0x7fee000c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 -- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000cf8d0 msgr2=0x7fee000c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000cf8d0 0x7fee000c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 -- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 msgr2=0x7fee000c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 0x7fee000c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 -- 172.21.15.64:0/292653839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee00156120 con 0x7fee000d0950 2024-09-21T07:38:26.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedffe00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 0x7fee000c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:26.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf6a00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7c0 tx=0x7fede800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:26.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede800ccc0 con 0x7fee000d0950 2024-09-21T07:38:26.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fede800ce80 con 0x7fee000d0950 2024-09-21T07:38:26.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee00156400 con 0x7fee000d0950 2024-09-21T07:38:26.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8005280 con 0x7fee000d0950 2024-09-21T07:38:26.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee000c61b0 con 0x7fee000d0950 2024-09-21T07:38:26.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0015ae00 con 0x7fee000d0950 2024-09-21T07:38:26.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.046+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fede8005420 con 0x7fee000d0950 2024-09-21T07:38:26.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.050+0000 7fedf7e00640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 0x7feddc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:26.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.050+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5619+0+0 (secure 0 0 0) 0x7fede8094ff0 con 0x7fee000d0950 2024-09-21T07:38:26.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.050+0000 7fedff400640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 0x7feddc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:26.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.050+0000 7fedff400640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 0x7feddc075740 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fedf00af000 tx=0x7fedf001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:26.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.054+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fede8060060 con 0x7fee000d0950 2024-09-21T07:38:26.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.234+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fee00070ee0 con 0x7fee000d0950 2024-09-21T07:38:26.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.842+0000 7fedf7e00640 1 -- 172.21.15.64:0/292653839 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v227) ==== 170+0+0 (secure 0 0 0) 0x7fede805f960 con 0x7fee000d0950 2024-09-21T07:38:26.842 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 msgr2=0x7feddc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 0x7feddc075740 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fedf00af000 tx=0x7fedf001b120 comp rx=0 tx=0).stop 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 msgr2=0x7fee000c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7c0 tx=0x7fede800ec80 comp rx=0 tx=0).stop 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 shutdown_connections 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feddc073230 0x7feddc075740 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee000d0d60 0x7fee000c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee000d0950 0x7fee000c7f40 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 --2- 172.21.15.64:0/292653839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee000cf8d0 0x7fee000c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:26.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 >> 172.21.15.64:0/292653839 conn(0x7fee0006d490 msgr2=0x7fee0015cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:26.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 shutdown_connections 2024-09-21T07:38:26.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:26.846+0000 7fee06600640 1 -- 172.21.15.64:0/292653839 wait complete. 2024-09-21T07:38:26.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:38:27.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 -- 172.21.15.64:0/454775748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc015fc60 msgr2=0x7fedc00d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:27.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 --2- 172.21.15.64:0/454775748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc015fc60 0x7fedc00d0380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009900 tx=0x7fedb401c820 comp rx=0 tx=0).stop 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 -- 172.21.15.64:0/454775748 shutdown_connections 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 --2- 172.21.15.64:0/454775748 >> v2:172.21.15.90:3300/0 conn(0x7fedc0071680 0x7fedc0071a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 --2- 172.21.15.64:0/454775748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc015fc60 0x7fedc00d0380 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 -- 172.21.15.64:0/454775748 >> 172.21.15.64:0/454775748 conn(0x7fedc00b29e0 msgr2=0x7fedc00b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 -- 172.21.15.64:0/454775748 shutdown_connections 2024-09-21T07:38:27.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.046+0000 7fedc7c00640 1 -- 172.21.15.64:0/454775748 wait complete. 2024-09-21T07:38:27.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 Processor -- start 2024-09-21T07:38:27.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 -- start start 2024-09-21T07:38:27.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc0071680 0x7fedc013e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:27.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:27.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedc015fc60 0x7fedc0154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00b4e80 con 0x7fedc0151d90 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00b4d00 con 0x7fedc015fc60 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc7c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00b5000 con 0x7fedc0071680 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55450/0 (socket says 172.21.15.64:55450) 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 -- 172.21.15.64:0/528384400 learned_addr learned my addr 172.21.15.64:0/528384400 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc5200640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc0071680 0x7fedc013e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:27.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedc5c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedc015fc60 0x7fedc0154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:27.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 -- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc0071680 msgr2=0x7fedc013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:27.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc0071680 0x7fedc013e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 -- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedc015fc60 msgr2=0x7fedc0154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:27.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedc015fc60 0x7fedc0154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.050+0000 7fedbfe00640 1 -- 172.21.15.64:0/528384400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc0140e00 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedbfe00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7fedac00ea20 tx=0x7fedac00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac00cd80 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc01410e0 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedac004020 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac004450 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01416a0 con 0x7fedc0151d90 2024-09-21T07:38:27.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc0071a90 con 0x7fedc0151d90 2024-09-21T07:38:27.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.054+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fedac0047b0 con 0x7fedc0151d90 2024-09-21T07:38:27.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.058+0000 7fedbcc00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 0x7feda0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:27.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.058+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 6001+0+0 (secure 0 0 0) 0x7fedac094c00 con 0x7fedc0151d90 2024-09-21T07:38:27.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.058+0000 7fedc5200640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 0x7feda0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:27.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.058+0000 7fedc5200640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 0x7feda0075710 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fedb40af000 tx=0x7fedb401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:27.059 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.058+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fedac05f520 con 0x7fedc0151d90 2024-09-21T07:38:27.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.278+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fedc00cd070 con 0x7fedc0151d90 2024-09-21T07:38:27.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.862+0000 7fedbcc00640 1 -- 172.21.15.64:0/528384400 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v165) ==== 174+0+0 (secure 0 0 0) 0x7fedac063f50 con 0x7fedc0151d90 2024-09-21T07:38:27.860 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 33 and data pool 34 2024-09-21T07:38:27.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.862+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 msgr2=0x7feda0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.862+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 0x7feda0075710 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fedb40af000 tx=0x7fedb401b060 comp rx=0 tx=0).stop 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.862+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 msgr2=0x7fedc0166660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.862+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7fedac00ea20 tx=0x7fedac00eee0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 shutdown_connections 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feda0073200 0x7feda0075710 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedc015fc60 0x7fedc0154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fedc0151d90 0x7fedc0166660 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 --2- 172.21.15.64:0/528384400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedc0071680 0x7fedc013e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:27.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 >> 172.21.15.64:0/528384400 conn(0x7fedc00b29e0 msgr2=0x7fedc0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:27.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 shutdown_connections 2024-09-21T07:38:27.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:27.866+0000 7fedc7c00640 1 -- 172.21.15.64:0/528384400 wait complete. 2024-09-21T07:38:27.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:28.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 -- 172.21.15.64:0/2895645861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 msgr2=0x7fa3700af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 --2- 172.21.15.64:0/2895645861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3700af790 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fa360009840 tx=0x7fa36001c820 comp rx=0 tx=0).stop 2024-09-21T07:38:28.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 -- 172.21.15.64:0/2895645861 shutdown_connections 2024-09-21T07:38:28.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 --2- 172.21.15.64:0/2895645861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3700af790 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 -- 172.21.15.64:0/2895645861 >> 172.21.15.64:0/2895645861 conn(0x7fa37006d570 msgr2=0x7fa3700b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:28.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 -- 172.21.15.64:0/2895645861 shutdown_connections 2024-09-21T07:38:28.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.086+0000 7fa374c00640 1 -- 172.21.15.64:0/2895645861 wait complete. 2024-09-21T07:38:28.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 Processor -- start 2024-09-21T07:38:28.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 -- start start 2024-09-21T07:38:28.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3700b46f0 0x7fa3701f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3700caf00 0x7fa3700b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa370169ea0 con 0x7fa37006fae0 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa370169d20 con 0x7fa3700caf00 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa37016a020 con 0x7fa3700b46f0 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55460/0 (socket says 172.21.15.64:55460) 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 -- 172.21.15.64:0/3166211557 learned_addr learned my addr 172.21.15.64:0/3166211557 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 -- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3700b46f0 msgr2=0x7fa3701f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3700b46f0 0x7fa3701f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 -- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3700caf00 msgr2=0x7fa3700b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3700caf00 0x7fa3700b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 -- 172.21.15.64:0/3166211557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3701f79e0 con 0x7fa37006fae0 2024-09-21T07:38:28.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa36de00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fa3600982f0 tx=0x7fa3600a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3600b2040 con 0x7fa37006fae0 2024-09-21T07:38:28.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3600bc070 con 0x7fa37006fae0 2024-09-21T07:38:28.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3700b1b90 con 0x7fa37006fae0 2024-09-21T07:38:28.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.090+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360003600 con 0x7fa37006fae0 2024-09-21T07:38:28.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3701f6ca0 con 0x7fa37006fae0 2024-09-21T07:38:28.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3700af790 con 0x7fa37006fae0 2024-09-21T07:38:28.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa3600037a0 con 0x7fa37006fae0 2024-09-21T07:38:28.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa366a00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 0x7fa34c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 6101+0+0 (secure 0 0 0) 0x7fa36012eb30 con 0x7fa37006fae0 2024-09-21T07:38:28.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.094+0000 7fa365400640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 0x7fa34c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.098+0000 7fa365400640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 0x7fa34c075740 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa358007fd0 tx=0x7fa358007980 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.098+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa360016410 con 0x7fa37006fae0 2024-09-21T07:38:28.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.278+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3700ce4f0 con 0x7fa37006fae0 2024-09-21T07:38:28.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.278+0000 7fa366a00640 1 -- 172.21.15.64:0/3166211557 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v228) ==== 74+0+16913 (secure 0 0 0) 0x7fa3600f9930 con 0x7fa37006fae0 2024-09-21T07:38:28.278 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:28.278 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":228,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:38:27.281862+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:38:25.032965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-21T07:38:26.246990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:28.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 msgr2=0x7fa34c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 0x7fa34c075740 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa358007fd0 tx=0x7fa358007980 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 msgr2=0x7fa3701530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fa3600982f0 tx=0x7fa3600a5730 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 shutdown_connections 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa34c073230 0x7fa34c075740 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3700caf00 0x7fa3700b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3700b46f0 0x7fa3701f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 --2- 172.21.15.64:0/3166211557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa37006fae0 0x7fa3701530b0 unknown :-1 s=CLOSED pgs=2525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 >> 172.21.15.64:0/3166211557 conn(0x7fa37006d570 msgr2=0x7fa3700c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 shutdown_connections 2024-09-21T07:38:28.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.282+0000 7fa374c00640 1 -- 172.21.15.64:0/3166211557 wait complete. 2024-09-21T07:38:28.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:28.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 -- 172.21.15.64:0/3811679990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a840b28e0 msgr2=0x7f0a8415c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 --2- 172.21.15.64:0/3811679990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a840b28e0 0x7f0a8415c6f0 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009840 tx=0x7f0a7401c820 comp rx=0 tx=0).stop 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 -- 172.21.15.64:0/3811679990 shutdown_connections 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 --2- 172.21.15.64:0/3811679990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a840b28e0 0x7f0a8415c6f0 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 -- 172.21.15.64:0/3811679990 >> 172.21.15.64:0/3811679990 conn(0x7f0a8406d570 msgr2=0x7f0a840b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 -- 172.21.15.64:0/3811679990 shutdown_connections 2024-09-21T07:38:28.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.458+0000 7f0a8a800640 1 -- 172.21.15.64:0/3811679990 wait complete. 2024-09-21T07:38:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 Processor -- start 2024-09-21T07:38:28.461 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 -- start start 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 0x7f0a84099440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a840b3170 0x7f0a840c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8416b600 con 0x7f0a841593f0 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8416b480 con 0x7f0a840b28e0 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a8a800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8416b780 con 0x7f0a840b3170 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55476/0 (socket says 172.21.15.64:55476) 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 -- 172.21.15.64:0/668093320 learned_addr learned my addr 172.21.15.64:0/668093320 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:28.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83400640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 0x7f0a84099440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a7be00640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a840b3170 0x7f0a840c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 -- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a840b3170 msgr2=0x7f0a840c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a840b3170 0x7f0a840c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 -- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 msgr2=0x7f0a84099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 0x7f0a84099440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.462+0000 7f0a83e00640 1 -- 172.21.15.64:0/668093320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a841fcab0 con 0x7f0a841593f0 2024-09-21T07:38:28.465 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a83400640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 0x7f0a84099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a83e00640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00cb10 tx=0x7f0a7c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c016020 con 0x7f0a841593f0 2024-09-21T07:38:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a7c00ce50 con 0x7f0a841593f0 2024-09-21T07:38:28.466 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00ad80 con 0x7f0a841593f0 2024-09-21T07:38:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a841fcd50 con 0x7f0a841593f0 2024-09-21T07:38:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841fd310 con 0x7f0a841593f0 2024-09-21T07:38:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a840c32b0 con 0x7f0a841593f0 2024-09-21T07:38:28.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0a7c019020 con 0x7f0a841593f0 2024-09-21T07:38:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 0x7f0a60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.466+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 6101+0+0 (secure 0 0 0) 0x7f0a7c094680 con 0x7f0a841593f0 2024-09-21T07:38:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.470+0000 7f0a83400640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 0x7f0a60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.470+0000 7f0a83400640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 0x7f0a60075710 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0a740af000 tx=0x7f0a7401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.474+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f0a7c020020 con 0x7f0a841593f0 2024-09-21T07:38:28.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.650+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a8415c6f0 con 0x7f0a841593f0 2024-09-21T07:38:28.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.650+0000 7f0a7b400640 1 -- 172.21.15.64:0/668093320 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v228) ==== 74+0+16913 (secure 0 0 0) 0x7f0a7c05f470 con 0x7f0a841593f0 2024-09-21T07:38:28.651 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:28.651 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":228,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:38:27.281862+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:38:25.032965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-21T07:38:26.246990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 msgr2=0x7f0a60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 0x7f0a60075710 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0a740af000 tx=0x7f0a7401b060 comp rx=0 tx=0).stop 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 msgr2=0x7f0a840c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00cb10 tx=0x7f0a7c00cc00 comp rx=0 tx=0).stop 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 shutdown_connections 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0a60073200 0x7f0a60075710 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a841593f0 0x7f0a840c9fe0 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a840b3170 0x7f0a840c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 --2- 172.21.15.64:0/668093320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a840b28e0 0x7f0a84099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 >> 172.21.15.64:0/668093320 conn(0x7f0a8406d570 msgr2=0x7f0a840b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:28.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 shutdown_connections 2024-09-21T07:38:28.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.654+0000 7f0a8a800640 1 -- 172.21.15.64:0/668093320 wait complete. 2024-09-21T07:38:28.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:38:28.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- 172.21.15.64:0/2453216938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c15af70 msgr2=0x7fe23c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- 172.21.15.64:0/2453216938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c15af70 0x7fe23c06f0d0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0cfff0 tx=0x7fe22c01c7f0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- 172.21.15.64:0/2453216938 shutdown_connections 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- 172.21.15.64:0/2453216938 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c06f610 0x7fe23c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- 172.21.15.64:0/2453216938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c15af70 0x7fe23c06f0d0 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- 172.21.15.64:0/2453216938 >> 172.21.15.64:0/2453216938 conn(0x7fe23c06d570 msgr2=0x7fe23c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- 172.21.15.64:0/2453216938 shutdown_connections 2024-09-21T07:38:28.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- 172.21.15.64:0/2453216938 wait complete. 2024-09-21T07:38:28.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 Processor -- start 2024-09-21T07:38:28.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- start start 2024-09-21T07:38:28.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe23c06f610 0x7fe23c1fa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.841 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 0x7fe23c09bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c165fd0 con 0x7fe23c0b36b0 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c165e50 con 0x7fe23c06f610 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.838+0000 7fe241600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c166150 con 0x7fe23c15af70 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55484/0 (socket says 172.21.15.64:55484) 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 -- 172.21.15.64:0/1256249776 learned_addr learned my addr 172.21.15.64:0/1256249776 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe23aa00640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe23c06f610 0x7fe23c1fa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe23b400640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 0x7fe23c09bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 -- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 msgr2=0x7fe23c09bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 0x7fe23c09bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 -- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe23c06f610 msgr2=0x7fe23c1fa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe23c06f610 0x7fe23c1fa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:28.842 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 -- 172.21.15.64:0/1256249776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c158c70 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe23b400640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 0x7fe23c09bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe232000640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d720 tx=0x7fe22400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224017070 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe224009cc0 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224005280 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c09a8f0 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c09aeb0 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23c0b3170 con 0x7fe23c0b36b0 2024-09-21T07:38:28.843 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.842+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe224005420 con 0x7fe23c0b36b0 2024-09-21T07:38:28.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.846+0000 7fe233400640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 0x7fe218075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:28.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.846+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 6101+0+0 (secure 0 0 0) 0x7fe224094300 con 0x7fe23c0b36b0 2024-09-21T07:38:28.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.846+0000 7fe23aa00640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 0x7fe218075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:28.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.846+0000 7fe23aa00640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 0x7fe218075740 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0af000 tx=0x7fe22c0a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:28.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:28.850+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe22405ebc0 con 0x7fe23c0b36b0 2024-09-21T07:38:29.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.066+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe23c070af0 con 0x7fe23c0b36b0 2024-09-21T07:38:29.836 INFO:tasks.ceph.mds.a.smithi064.stderr:2024-09-21T07:38:29.838+0000 7fd146600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:38:29.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.890+0000 7fe233400640 1 -- 172.21.15.64:0/1256249776 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v168) ==== 118+0+0 (secure 0 0 0) 0x7fe2240635f0 con 0x7fe23c0b36b0 2024-09-21T07:38:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 msgr2=0x7fe218075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 0x7fe218075740 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0af000 tx=0x7fe22c0a7040 comp rx=0 tx=0).stop 2024-09-21T07:38:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 msgr2=0x7fe23c09b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d720 tx=0x7fe22400dbe0 comp rx=0 tx=0).stop 2024-09-21T07:38:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 shutdown_connections 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe218073230 0x7fe218075740 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe23c15af70 0x7fe23c09bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe23c0b36b0 0x7fe23c09b990 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 --2- 172.21.15.64:0/1256249776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe23c06f610 0x7fe23c1fa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 >> 172.21.15.64:0/1256249776 conn(0x7fe23c06d570 msgr2=0x7fe23c0b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 shutdown_connections 2024-09-21T07:38:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:29.894+0000 7fe241600640 1 -- 172.21.15.64:0/1256249776 wait complete. 2024-09-21T07:38:29.916 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:38:29.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:38:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- 172.21.15.64:0/322293064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8024003a10 msgr2=0x7f8024003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 --2- 172.21.15.64:0/322293064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8024003a10 0x7f8024003e80 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f8030009b60 tx=0x7f803001d250 comp rx=0 tx=0).stop 2024-09-21T07:38:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f803e800640 1 -- 172.21.15.64:0/322293064 reap_dead start 2024-09-21T07:38:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- 172.21.15.64:0/322293064 shutdown_connections 2024-09-21T07:38:30.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- 172.21.15.64:0/322293064 >> 172.21.15.64:0/322293064 conn(0x7f804006d570 msgr2=0x7f80400b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:30.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- 172.21.15.64:0/322293064 shutdown_connections 2024-09-21T07:38:30.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- 172.21.15.64:0/322293064 wait complete. 2024-09-21T07:38:30.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 Processor -- start 2024-09-21T07:38:30.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.082+0000 7f8044e00640 1 -- start start 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8024003a10 0x7f804009dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80400c3050 0x7f80401f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80401665d0 con 0x7f80400c3460 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8040166450 con 0x7f80400c3050 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8040166750 con 0x7f8024003a10 2024-09-21T07:38:30.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55498/0 (socket says 172.21.15.64:55498) 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 -- 172.21.15.64:0/1475144864 learned_addr learned my addr 172.21.15.64:0/1475144864 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803de00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8024003a10 0x7f804009dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8035400640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80400c3050 0x7f80401f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 -- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8024003a10 msgr2=0x7f804009dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8024003a10 0x7f804009dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 -- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80400c3050 msgr2=0x7f80401f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80400c3050 0x7f80401f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 -- 172.21.15.64:0/1475144864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8040151da0 con 0x7f80400c3460 2024-09-21T07:38:30.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f803e800640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f80400b5370 tx=0x7f8038010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:30.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038017070 con 0x7f80400c3460 2024-09-21T07:38:30.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8038015070 con 0x7f80400c3460 2024-09-21T07:38:30.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80401f6c80 con 0x7f80400c3460 2024-09-21T07:38:30.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038004d90 con 0x7f80400c3460 2024-09-21T07:38:30.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804009e160 con 0x7f80400c3460 2024-09-21T07:38:30.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.086+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80400b2580 con 0x7f80400c3460 2024-09-21T07:38:30.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.090+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f803800e910 con 0x7f80400c3460 2024-09-21T07:38:30.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.090+0000 7f8036a00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 0x7f801c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:30.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.090+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7f80380947f0 con 0x7f80400c3460 2024-09-21T07:38:30.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.090+0000 7f803de00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 0x7f801c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:30.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.090+0000 7f803de00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 0x7f801c075710 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8030009b60 tx=0x7f803001a050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:30.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.094+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f803805f0b0 con 0x7f80400c3460 2024-09-21T07:38:30.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.306+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f80400b0e50 con 0x7f80400c3460 2024-09-21T07:38:30.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.898+0000 7f8036a00640 1 -- 172.21.15.64:0/1475144864 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v169) ==== 122+0+0 (secure 0 0 0) 0x7f8038063ae0 con 0x7f80400c3460 2024-09-21T07:38:30.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 msgr2=0x7f801c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:30.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 0x7f801c075710 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8030009b60 tx=0x7f803001a050 comp rx=0 tx=0).stop 2024-09-21T07:38:30.902 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 msgr2=0x7f80401f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f80400b5370 tx=0x7f8038010e70 comp rx=0 tx=0).stop 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 shutdown_connections 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f801c073200 0x7f801c075710 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80400c3460 0x7f80401f7860 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80400c3050 0x7f80401f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 --2- 172.21.15.64:0/1475144864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8024003a10 0x7f804009dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 >> 172.21.15.64:0/1475144864 conn(0x7f804006d570 msgr2=0x7f8040099820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 shutdown_connections 2024-09-21T07:38:30.903 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:30.902+0000 7f8044e00640 1 -- 172.21.15.64:0/1475144864 wait complete. 2024-09-21T07:38:30.923 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:38:30.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 -- 172.21.15.64:0/783636039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab44005310 msgr2=0x7fab4400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 --2- 172.21.15.64:0/783636039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab44005310 0x7fab4400b9d0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7fab600ce8c0 tx=0x7fab5801caf0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 -- 172.21.15.64:0/783636039 shutdown_connections 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 --2- 172.21.15.64:0/783636039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab44005310 0x7fab4400b9d0 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 -- 172.21.15.64:0/783636039 >> 172.21.15.64:0/783636039 conn(0x7fab6006d570 msgr2=0x7fab600b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 -- 172.21.15.64:0/783636039 shutdown_connections 2024-09-21T07:38:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.082+0000 7fab64c00640 1 -- 172.21.15.64:0/783636039 wait complete. 2024-09-21T07:38:31.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 Processor -- start 2024-09-21T07:38:31.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 -- start start 2024-09-21T07:38:31.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44005310 0x7fab600b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab600b3a70 0x7fab600b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fab6015c870 con 0x7fab601f2ca0 2024-09-21T07:38:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab6015c6f0 con 0x7fab600b3a70 2024-09-21T07:38:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab64c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fab6015c9f0 con 0x7fab44005310 2024-09-21T07:38:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab55400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab55400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55506/0 (socket says 172.21.15.64:55506) 2024-09-21T07:38:31.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab55400640 1 -- 172.21.15.64:0/2049146117 learned_addr learned my addr 172.21.15.64:0/2049146117 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab5de00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44005310 0x7fab600b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.086+0000 7fab5e800640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab600b3a70 0x7fab600b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 -- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44005310 msgr2=0x7fab600b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44005310 0x7fab600b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 -- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab600b3a70 msgr2=0x7fab600b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab600b3a70 0x7fab600b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 -- 172.21.15.64:0/2049146117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab600b43c0 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab55400640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7fab48003f20 tx=0x7fab4800ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48005220 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab480053c0 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab600ae7f0 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480047b0 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab600aedb0 con 0x7fab601f2ca0 2024-09-21T07:38:31.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab600cd140 con 0x7fab601f2ca0 2024-09-21T07:38:31.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fab48004970 con 0x7fab601f2ca0 2024-09-21T07:38:31.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 0x7fab3c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.090+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fab48094f80 con 0x7fab601f2ca0 2024-09-21T07:38:31.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.094+0000 7fab5de00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 0x7fab3c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.094+0000 7fab5de00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 0x7fab3c075740 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fab50001020 tx=0x7fab500067e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.098+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fab600b43c0 con 0x7fab601f2ca0 2024-09-21T07:38:31.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab60074c40 con 0x7fab601f2ca0 2024-09-21T07:38:31.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab56a00640 1 -- 172.21.15.64:0/2049146117 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7fab4805fd70 con 0x7fab601f2ca0 2024-09-21T07:38:31.309 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:31.309 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":169,"btime":"2024-09-21T07:38:30:894787+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":11670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:30.310331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11676":{"gid":11676,"name":"a","rank":0,"incarnation":165,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/3686989750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3686989750},{"type":"v1","addr":"172.21.15.64:6835","nonce":3686989750}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11676,"qdb_cluster":[11676]},"id":16}]} 2024-09-21T07:38:31.309 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 169 2024-09-21T07:38:31.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 msgr2=0x7fab3c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 0x7fab3c075740 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fab50001020 tx=0x7fab500067e0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 msgr2=0x7fab601f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7fab48003f20 tx=0x7fab4800ba80 comp rx=0 tx=0).stop 2024-09-21T07:38:31.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 shutdown_connections 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fab3c073230 0x7fab3c075740 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab600b3a70 0x7fab600b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab601f2ca0 0x7fab601f30b0 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 --2- 172.21.15.64:0/2049146117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab44005310 0x7fab600b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 >> 172.21.15.64:0/2049146117 conn(0x7fab6006d570 msgr2=0x7fab600742c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 shutdown_connections 2024-09-21T07:38:31.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.310+0000 7fab64c00640 1 -- 172.21.15.64:0/2049146117 wait complete. 2024-09-21T07:38:31.332 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- 172.21.15.64:0/2449868249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 msgr2=0x7fbda80cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 --2- 172.21.15.64:0/2449868249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda80cf330 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7fbda806fcb0 tx=0x7fbd9801c630 comp rx=0 tx=0).stop 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- 172.21.15.64:0/2449868249 shutdown_connections 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 --2- 172.21.15.64:0/2449868249 >> v2:172.21.15.90:3300/0 conn(0x7fbda80b41a0 0x7fbda80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 --2- 172.21.15.64:0/2449868249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda80cf330 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- 172.21.15.64:0/2449868249 >> 172.21.15.64:0/2449868249 conn(0x7fbda809a9e0 msgr2=0x7fbda80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:31.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- 172.21.15.64:0/2449868249 shutdown_connections 2024-09-21T07:38:31.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- 172.21.15.64:0/2449868249 wait complete. 2024-09-21T07:38:31.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 Processor -- start 2024-09-21T07:38:31.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.490+0000 7fbdae000640 1 -- start start 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbda80b41a0 0x7fbda81fc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbda80b4af0 0x7fbda809dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8169040 con 0x7fbda80cef20 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80cceb0 con 0x7fbda80b41a0 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbda81691c0 con 0x7fbda80b4af0 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55522/0 (socket says 172.21.15.64:55522) 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 -- 172.21.15.64:0/2859996465 learned_addr learned my addr 172.21.15.64:0/2859996465 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:31.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbd9fe00640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbda80b4af0 0x7fbda809dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7400640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbda80b41a0 0x7fbda81fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 -- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbda80b4af0 msgr2=0x7fbda809dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbda80b4af0 0x7fbda809dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 -- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbda80b41a0 msgr2=0x7fbda81fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbda80b41a0 0x7fbda81fc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 -- 172.21.15.64:0/2859996465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda81fcf10 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbda7e00640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fbda000b9e0 tx=0x7fbda000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0003b80 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbda0003e10 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81fd1f0 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda000cb80 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81f9130 con 0x7fbda80cef20 2024-09-21T07:38:31.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.494+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda80b45b0 con 0x7fbda80cef20 2024-09-21T07:38:31.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.498+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbda0006d10 con 0x7fbda80cef20 2024-09-21T07:38:31.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.498+0000 7fbd9f400640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 0x7fbd84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.498+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fbda0094060 con 0x7fbda80cef20 2024-09-21T07:38:31.498 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.498+0000 7fbda7400640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 0x7fbd84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.498+0000 7fbda7400640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 0x7fbd84075710 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fbd980ae000 tx=0x7fbd9801ae70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.502+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbda005edd0 con 0x7fbda80cef20 2024-09-21T07:38:31.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbda80ae570 con 0x7fbda80cef20 2024-09-21T07:38:31.681 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbd9f400640 1 -- 172.21.15.64:0/2859996465 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v229) ==== 74+0+16900 (secure 0 0 0) 0x7fbda005e6d0 con 0x7fbda80cef20 2024-09-21T07:38:31.682 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:31.682 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":229,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:38:28.875130+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:38:25.032965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-21T07:38:26.246990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"229","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 msgr2=0x7fbd84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 0x7fbd84075710 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fbd980ae000 tx=0x7fbd9801ae70 comp rx=0 tx=0).stop 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 msgr2=0x7fbda81f9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fbda000b9e0 tx=0x7fbda000bea0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 shutdown_connections 2024-09-21T07:38:31.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbd84073200 0x7fbd84075710 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbda80cef20 0x7fbda81f9930 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbda80b4af0 0x7fbda809dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 --2- 172.21.15.64:0/2859996465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbda80b41a0 0x7fbda81fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.682+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 >> 172.21.15.64:0/2859996465 conn(0x7fbda809a9e0 msgr2=0x7fbda8166630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.686+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 shutdown_connections 2024-09-21T07:38:31.685 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.686+0000 7fbdae000640 1 -- 172.21.15.64:0/2859996465 wait complete. 2024-09-21T07:38:31.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:38:31.704 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 -- 172.21.15.64:0/3676425428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 msgr2=0x7fa8d40747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3676425428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d40747d0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009bc0 tx=0x7fa8cc01cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 -- 172.21.15.64:0/3676425428 shutdown_connections 2024-09-21T07:38:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3676425428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d40747d0 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 -- 172.21.15.64:0/3676425428 >> 172.21.15.64:0/3676425428 conn(0x7fa8d40d1200 msgr2=0x7fa8d40d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 -- 172.21.15.64:0/3676425428 shutdown_connections 2024-09-21T07:38:31.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.862+0000 7fa8d3200640 1 -- 172.21.15.64:0/3676425428 wait complete. 2024-09-21T07:38:31.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 Processor -- start 2024-09-21T07:38:31.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 -- start start 2024-09-21T07:38:31.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 0x7fa8d4161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d40b2ea0 0x7fa8d40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d416d010 con 0x7fa8d415eb00 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d416ce90 con 0x7fa8d40b2ea0 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d3200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d416d190 con 0x7fa8d40b65c0 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55536/0 (socket says 172.21.15.64:55536) 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 -- 172.21.15.64:0/3781108132 learned_addr learned my addr 172.21.15.64:0/3781108132 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d1e00640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 0x7fa8d4161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d2800640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d40b2ea0 0x7fa8d40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 -- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 msgr2=0x7fa8d4161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 0x7fa8d4161ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 -- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d40b2ea0 msgr2=0x7fa8d40b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:31.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d40b2ea0 0x7fa8d40b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:31.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8c9400640 1 -- 172.21.15.64:0/3781108132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d40b37f0 con 0x7fa8d415eb00 2024-09-21T07:38:31.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.866+0000 7fa8d1e00640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 0x7fa8d4161ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:31.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8c9400640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b3c0 tx=0x7fa8bc00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011830 con 0x7fa8d415eb00 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8bc016070 con 0x7fa8d415eb00 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011d80 con 0x7fa8d415eb00 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d415fd70 con 0x7fa8d415eb00 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d4160330 con 0x7fa8d415eb00 2024-09-21T07:38:31.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d40b2130 con 0x7fa8d415eb00 2024-09-21T07:38:31.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.870+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa8bc01b460 con 0x7fa8d415eb00 2024-09-21T07:38:31.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.874+0000 7fa8caa00640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 0x7fa8b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:31.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.874+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fa8bc093cd0 con 0x7fa8d415eb00 2024-09-21T07:38:31.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.874+0000 7fa8d1e00640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 0x7fa8b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:31.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.874+0000 7fa8d1e00640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 0x7fa8b0075740 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4007fd0 tx=0x7fa8c4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:31.877 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:31.878+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa8bc020020 con 0x7fa8d415eb00 2024-09-21T07:38:32.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.054+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8d415fb20 con 0x7fa8b0073230 2024-09-21T07:38:32.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.062+0000 7fa8caa00640 1 -- 172.21.15.64:0/3781108132 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248632 (secure 0 0 0) 0x7fa8d415fb20 con 0x7fa8b0073230 2024-09-21T07:38:32.063 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:32.065 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 msgr2=0x7fa8b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 0x7fa8b0075740 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4007fd0 tx=0x7fa8c4009040 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 msgr2=0x7fa8d4151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b3c0 tx=0x7fa8bc00b880 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 shutdown_connections 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa8b0073230 0x7fa8b0075740 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8d40b2ea0 0x7fa8d40b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8d415eb00 0x7fa8d4151bc0 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 --2- 172.21.15.64:0/3781108132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8d40b65c0 0x7fa8d4161ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 >> 172.21.15.64:0/3781108132 conn(0x7fa8d40d1200 msgr2=0x7fa8d40aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 shutdown_connections 2024-09-21T07:38:32.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.066+0000 7fa8d3200640 1 -- 172.21.15.64:0/3781108132 wait complete. 2024-09-21T07:38:32.085 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-09-21T07:38:31.683267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":121,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":470172,"kb_used_data":23596,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754504548,"statfs":{"total":773094113280,"available":772612657152,"internally_reserved":0,"allocated":24162304,"data_stored":12044182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.838108"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857711+0000","last_change":"2024-09-21T07:38:26.857711+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857711+0000","last_undegraded":"2024-09-21T07:38:26.857711+0000","last_fullsized":"2024-09-21T07:38:26.857711+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859628+0000","last_change":"2024-09-21T07:38:26.859628+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859628+0000","last_undegraded":"2024-09-21T07:38:26.859628+0000","last_fullsized":"2024-09-21T07:38:26.859628+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857134+0000","last_change":"2024-09-21T07:38:26.857134+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857134+0000","last_undegraded":"2024-09-21T07:38:26.857134+0000","last_fullsized":"2024-09-21T07:38:26.857134+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880663+0000","last_change":"2024-09-21T07:38:27.902273+0000","last_active":"2024-09-21T07:38:28.880663+0000","last_peered":"2024-09-21T07:38:28.880663+0000","last_clean":"2024-09-21T07:38:28.880663+0000","last_became_active":"2024-09-21T07:38:27.901903+0000","last_became_peered":"2024-09-21T07:38:27.901903+0000","last_unstale":"2024-09-21T07:38:28.880663+0000","last_undegraded":"2024-09-21T07:38:28.880663+0000","last_fullsized":"2024-09-21T07:38:28.880663+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:58.406221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853011+0000","last_change":"2024-09-21T07:38:26.853011+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853011+0000","last_undegraded":"2024-09-21T07:38:26.853011+0000","last_fullsized":"2024-09-21T07:38:26.853011+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880971+0000","last_change":"2024-09-21T07:38:27.890574+0000","last_active":"2024-09-21T07:38:28.880971+0000","last_peered":"2024-09-21T07:38:28.880971+0000","last_clean":"2024-09-21T07:38:28.880971+0000","last_became_active":"2024-09-21T07:38:27.887320+0000","last_became_peered":"2024-09-21T07:38:27.887320+0000","last_unstale":"2024-09-21T07:38:28.880971+0000","last_undegraded":"2024-09-21T07:38:28.880971+0000","last_fullsized":"2024-09-21T07:38:28.880971+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:40.556500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.856159+0000","last_change":"2024-09-21T07:38:26.856159+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.856159+0000","last_undegraded":"2024-09-21T07:38:26.856159+0000","last_fullsized":"2024-09-21T07:38:26.856159+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879529+0000","last_change":"2024-09-21T07:38:27.907654+0000","last_active":"2024-09-21T07:38:28.879529+0000","last_peered":"2024-09-21T07:38:28.879529+0000","last_clean":"2024-09-21T07:38:28.879529+0000","last_became_active":"2024-09-21T07:38:27.906066+0000","last_became_peered":"2024-09-21T07:38:27.906066+0000","last_unstale":"2024-09-21T07:38:28.879529+0000","last_undegraded":"2024-09-21T07:38:28.879529+0000","last_fullsized":"2024-09-21T07:38:28.879529+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:24.486499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881469+0000","last_change":"2024-09-21T07:38:27.897228+0000","last_active":"2024-09-21T07:38:28.881469+0000","last_peered":"2024-09-21T07:38:28.881469+0000","last_clean":"2024-09-21T07:38:28.881469+0000","last_became_active":"2024-09-21T07:38:27.896883+0000","last_became_peered":"2024-09-21T07:38:27.896883+0000","last_unstale":"2024-09-21T07:38:28.881469+0000","last_undegraded":"2024-09-21T07:38:28.881469+0000","last_fullsized":"2024-09-21T07:38:28.881469+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:51.166601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849670+0000","last_change":"2024-09-21T07:38:26.849670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849670+0000","last_undegraded":"2024-09-21T07:38:26.849670+0000","last_fullsized":"2024-09-21T07:38:26.849670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858207+0000","last_change":"2024-09-21T07:38:26.858207+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858207+0000","last_undegraded":"2024-09-21T07:38:26.858207+0000","last_fullsized":"2024-09-21T07:38:26.858207+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881624+0000","last_change":"2024-09-21T07:38:27.895619+0000","last_active":"2024-09-21T07:38:28.881624+0000","last_peered":"2024-09-21T07:38:28.881624+0000","last_clean":"2024-09-21T07:38:28.881624+0000","last_became_active":"2024-09-21T07:38:27.895269+0000","last_became_peered":"2024-09-21T07:38:27.895269+0000","last_unstale":"2024-09-21T07:38:28.881624+0000","last_undegraded":"2024-09-21T07:38:28.881624+0000","last_fullsized":"2024-09-21T07:38:28.881624+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:48.794383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879845+0000","last_change":"2024-09-21T07:38:27.908331+0000","last_active":"2024-09-21T07:38:28.879845+0000","last_peered":"2024-09-21T07:38:28.879845+0000","last_clean":"2024-09-21T07:38:28.879845+0000","last_became_active":"2024-09-21T07:38:27.906446+0000","last_became_peered":"2024-09-21T07:38:27.906446+0000","last_unstale":"2024-09-21T07:38:28.879845+0000","last_undegraded":"2024-09-21T07:38:28.879845+0000","last_fullsized":"2024-09-21T07:38:28.879845+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:24.108120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859755+0000","last_change":"2024-09-21T07:38:26.859755+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859755+0000","last_undegraded":"2024-09-21T07:38:26.859755+0000","last_fullsized":"2024-09-21T07:38:26.859755+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.866161+0000","last_change":"2024-09-21T07:38:26.866161+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.866161+0000","last_undegraded":"2024-09-21T07:38:26.866161+0000","last_fullsized":"2024-09-21T07:38:26.866161+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849053+0000","last_change":"2024-09-21T07:38:26.849053+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849053+0000","last_undegraded":"2024-09-21T07:38:26.849053+0000","last_fullsized":"2024-09-21T07:38:26.849053+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849929+0000","last_change":"2024-09-21T07:38:26.849929+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849929+0000","last_undegraded":"2024-09-21T07:38:26.849929+0000","last_fullsized":"2024-09-21T07:38:26.849929+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858040+0000","last_change":"2024-09-21T07:38:26.858040+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858040+0000","last_undegraded":"2024-09-21T07:38:26.858040+0000","last_fullsized":"2024-09-21T07:38:26.858040+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849583+0000","last_change":"2024-09-21T07:38:26.849583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849583+0000","last_undegraded":"2024-09-21T07:38:26.849583+0000","last_fullsized":"2024-09-21T07:38:26.849583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881493+0000","last_change":"2024-09-21T07:38:27.896082+0000","last_active":"2024-09-21T07:38:28.881493+0000","last_peered":"2024-09-21T07:38:28.881493+0000","last_clean":"2024-09-21T07:38:28.881493+0000","last_became_active":"2024-09-21T07:38:27.895767+0000","last_became_peered":"2024-09-21T07:38:27.895767+0000","last_unstale":"2024-09-21T07:38:28.881493+0000","last_undegraded":"2024-09-21T07:38:28.881493+0000","last_fullsized":"2024-09-21T07:38:28.881493+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:04.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852499+0000","last_change":"2024-09-21T07:38:26.852499+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852499+0000","last_undegraded":"2024-09-21T07:38:26.852499+0000","last_fullsized":"2024-09-21T07:38:26.852499+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852856+0000","last_change":"2024-09-21T07:38:26.852856+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852856+0000","last_undegraded":"2024-09-21T07:38:26.852856+0000","last_fullsized":"2024-09-21T07:38:26.852856+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.862531+0000","last_change":"2024-09-21T07:38:26.862531+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.862531+0000","last_undegraded":"2024-09-21T07:38:26.862531+0000","last_fullsized":"2024-09-21T07:38:26.862531+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852913+0000","last_change":"2024-09-21T07:38:26.852913+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852913+0000","last_undegraded":"2024-09-21T07:38:26.852913+0000","last_fullsized":"2024-09-21T07:38:26.852913+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858632+0000","last_change":"2024-09-21T07:38:26.858632+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858632+0000","last_undegraded":"2024-09-21T07:38:26.858632+0000","last_fullsized":"2024-09-21T07:38:26.858632+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858231+0000","last_change":"2024-09-21T07:38:26.858231+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858231+0000","last_undegraded":"2024-09-21T07:38:26.858231+0000","last_fullsized":"2024-09-21T07:38:26.858231+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857655+0000","last_change":"2024-09-21T07:38:26.857655+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857655+0000","last_undegraded":"2024-09-21T07:38:26.857655+0000","last_fullsized":"2024-09-21T07:38:26.857655+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855526+0000","last_change":"2024-09-21T07:38:26.855526+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855526+0000","last_undegraded":"2024-09-21T07:38:26.855526+0000","last_fullsized":"2024-09-21T07:38:26.855526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881690+0000","last_change":"2024-09-21T07:38:27.899491+0000","last_active":"2024-09-21T07:38:28.881690+0000","last_peered":"2024-09-21T07:38:28.881690+0000","last_clean":"2024-09-21T07:38:28.881690+0000","last_became_active":"2024-09-21T07:38:27.898923+0000","last_became_peered":"2024-09-21T07:38:27.898923+0000","last_unstale":"2024-09-21T07:38:28.881690+0000","last_undegraded":"2024-09-21T07:38:28.881690+0000","last_fullsized":"2024-09-21T07:38:28.881690+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:25.337677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858670+0000","last_change":"2024-09-21T07:38:26.858670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858670+0000","last_undegraded":"2024-09-21T07:38:26.858670+0000","last_fullsized":"2024-09-21T07:38:26.858670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.865286+0000","last_change":"2024-09-21T07:38:26.865286+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.865286+0000","last_undegraded":"2024-09-21T07:38:26.865286+0000","last_fullsized":"2024-09-21T07:38:26.865286+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849079+0000","last_change":"2024-09-21T07:38:26.849079+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849079+0000","last_undegraded":"2024-09-21T07:38:26.849079+0000","last_fullsized":"2024-09-21T07:38:26.849079+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880901+0000","last_change":"2024-09-21T07:38:26.876175+0000","last_active":"2024-09-21T07:38:26.880901+0000","last_peered":"2024-09-21T07:38:26.880901+0000","last_clean":"2024-09-21T07:38:26.880901+0000","last_became_active":"2024-09-21T07:38:26.875734+0000","last_became_peered":"2024-09-21T07:38:26.875734+0000","last_unstale":"2024-09-21T07:38:26.880901+0000","last_undegraded":"2024-09-21T07:38:26.880901+0000","last_fullsized":"2024-09-21T07:38:26.880901+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:16.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855959+0000","last_change":"2024-09-21T07:38:26.855959+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855959+0000","last_undegraded":"2024-09-21T07:38:26.855959+0000","last_fullsized":"2024-09-21T07:38:26.855959+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866550+0000","last_change":"2024-09-21T07:38:26.863994+0000","last_active":"2024-09-21T07:38:26.866550+0000","last_peered":"2024-09-21T07:38:26.866550+0000","last_clean":"2024-09-21T07:38:26.866550+0000","last_became_active":"2024-09-21T07:38:26.863529+0000","last_became_peered":"2024-09-21T07:38:26.863529+0000","last_unstale":"2024-09-21T07:38:26.866550+0000","last_undegraded":"2024-09-21T07:38:26.866550+0000","last_fullsized":"2024-09-21T07:38:26.866550+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857583+0000","last_change":"2024-09-21T07:38:26.857583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857583+0000","last_undegraded":"2024-09-21T07:38:26.857583+0000","last_fullsized":"2024-09-21T07:38:26.857583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.869635+0000","last_change":"2024-09-21T07:38:26.866652+0000","last_active":"2024-09-21T07:38:26.869635+0000","last_peered":"2024-09-21T07:38:26.869635+0000","last_clean":"2024-09-21T07:38:26.869635+0000","last_became_active":"2024-09-21T07:38:26.866286+0000","last_became_peered":"2024-09-21T07:38:26.866286+0000","last_unstale":"2024-09-21T07:38:26.869635+0000","last_undegraded":"2024-09-21T07:38:26.869635+0000","last_fullsized":"2024-09-21T07:38:26.869635+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:47.671946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857091+0000","last_change":"2024-09-21T07:38:26.857091+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857091+0000","last_undegraded":"2024-09-21T07:38:26.857091+0000","last_fullsized":"2024-09-21T07:38:26.857091+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865580+0000","last_change":"2024-09-21T07:38:26.861984+0000","last_active":"2024-09-21T07:38:26.865580+0000","last_peered":"2024-09-21T07:38:26.865580+0000","last_clean":"2024-09-21T07:38:26.865580+0000","last_became_active":"2024-09-21T07:38:26.861625+0000","last_became_peered":"2024-09-21T07:38:26.861625+0000","last_unstale":"2024-09-21T07:38:26.865580+0000","last_undegraded":"2024-09-21T07:38:26.865580+0000","last_fullsized":"2024-09-21T07:38:26.865580+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:08.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864715+0000","last_change":"2024-09-21T07:38:26.864715+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864715+0000","last_undegraded":"2024-09-21T07:38:26.864715+0000","last_fullsized":"2024-09-21T07:38:26.864715+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867748+0000","last_change":"2024-09-21T07:38:26.863298+0000","last_active":"2024-09-21T07:38:26.867748+0000","last_peered":"2024-09-21T07:38:26.867748+0000","last_clean":"2024-09-21T07:38:26.867748+0000","last_became_active":"2024-09-21T07:38:26.862983+0000","last_became_peered":"2024-09-21T07:38:26.862983+0000","last_unstale":"2024-09-21T07:38:26.867748+0000","last_undegraded":"2024-09-21T07:38:26.867748+0000","last_fullsized":"2024-09-21T07:38:26.867748+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:08.126208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858155+0000","last_change":"2024-09-21T07:38:26.858155+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858155+0000","last_undegraded":"2024-09-21T07:38:26.858155+0000","last_fullsized":"2024-09-21T07:38:26.858155+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.879179+0000","last_change":"2024-09-21T07:38:26.874143+0000","last_active":"2024-09-21T07:38:26.879179+0000","last_peered":"2024-09-21T07:38:26.879179+0000","last_clean":"2024-09-21T07:38:26.879179+0000","last_became_active":"2024-09-21T07:38:26.873839+0000","last_became_peered":"2024-09-21T07:38:26.873839+0000","last_unstale":"2024-09-21T07:38:26.879179+0000","last_undegraded":"2024-09-21T07:38:26.879179+0000","last_fullsized":"2024-09-21T07:38:26.879179+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.415543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858915+0000","last_change":"2024-09-21T07:38:26.858915+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858915+0000","last_undegraded":"2024-09-21T07:38:26.858915+0000","last_fullsized":"2024-09-21T07:38:26.858915+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865553+0000","last_change":"2024-09-21T07:38:26.861747+0000","last_active":"2024-09-21T07:38:26.865553+0000","last_peered":"2024-09-21T07:38:26.865553+0000","last_clean":"2024-09-21T07:38:26.865553+0000","last_became_active":"2024-09-21T07:38:26.861414+0000","last_became_peered":"2024-09-21T07:38:26.861414+0000","last_unstale":"2024-09-21T07:38:26.865553+0000","last_undegraded":"2024-09-21T07:38:26.865553+0000","last_fullsized":"2024-09-21T07:38:26.865553+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:27.620630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880150+0000","last_change":"2024-09-21T07:38:27.908116+0000","last_active":"2024-09-21T07:38:28.880150+0000","last_peered":"2024-09-21T07:38:28.880150+0000","last_clean":"2024-09-21T07:38:28.880150+0000","last_became_active":"2024-09-21T07:38:27.906137+0000","last_became_peered":"2024-09-21T07:38:27.906137+0000","last_unstale":"2024-09-21T07:38:28.880150+0000","last_undegraded":"2024-09-21T07:38:28.880150+0000","last_fullsized":"2024-09-21T07:38:28.880150+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:28.691558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864102+0000","last_change":"2024-09-21T07:38:26.857528+0000","last_active":"2024-09-21T07:38:26.864102+0000","last_peered":"2024-09-21T07:38:26.864102+0000","last_clean":"2024-09-21T07:38:26.864102+0000","last_became_active":"2024-09-21T07:38:26.857087+0000","last_became_peered":"2024-09-21T07:38:26.857087+0000","last_unstale":"2024-09-21T07:38:26.864102+0000","last_undegraded":"2024-09-21T07:38:26.864102+0000","last_fullsized":"2024-09-21T07:38:26.864102+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:43.048249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880475+0000","last_change":"2024-09-21T07:38:27.900713+0000","last_active":"2024-09-21T07:38:28.880475+0000","last_peered":"2024-09-21T07:38:28.880475+0000","last_clean":"2024-09-21T07:38:28.880475+0000","last_became_active":"2024-09-21T07:38:27.900385+0000","last_became_peered":"2024-09-21T07:38:27.900385+0000","last_unstale":"2024-09-21T07:38:28.880475+0000","last_undegraded":"2024-09-21T07:38:28.880475+0000","last_fullsized":"2024-09-21T07:38:28.880475+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:55.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880521+0000","last_change":"2024-09-21T07:38:26.874002+0000","last_active":"2024-09-21T07:38:28.880521+0000","last_peered":"2024-09-21T07:38:28.880521+0000","last_clean":"2024-09-21T07:38:28.880521+0000","last_became_active":"2024-09-21T07:38:26.873678+0000","last_became_peered":"2024-09-21T07:38:26.873678+0000","last_unstale":"2024-09-21T07:38:28.880521+0000","last_undegraded":"2024-09-21T07:38:28.880521+0000","last_fullsized":"2024-09-21T07:38:28.880521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:35.150025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855334+0000","last_change":"2024-09-21T07:38:26.855334+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855334+0000","last_undegraded":"2024-09-21T07:38:26.855334+0000","last_fullsized":"2024-09-21T07:38:26.855334+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866521+0000","last_change":"2024-09-21T07:38:26.863704+0000","last_active":"2024-09-21T07:38:26.866521+0000","last_peered":"2024-09-21T07:38:26.866521+0000","last_clean":"2024-09-21T07:38:26.866521+0000","last_became_active":"2024-09-21T07:38:26.863365+0000","last_became_peered":"2024-09-21T07:38:26.863365+0000","last_unstale":"2024-09-21T07:38:26.866521+0000","last_undegraded":"2024-09-21T07:38:26.866521+0000","last_fullsized":"2024-09-21T07:38:26.866521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881302+0000","last_change":"2024-09-21T07:38:27.903378+0000","last_active":"2024-09-21T07:38:28.881302+0000","last_peered":"2024-09-21T07:38:28.881302+0000","last_clean":"2024-09-21T07:38:28.881302+0000","last_became_active":"2024-09-21T07:38:27.903151+0000","last_became_peered":"2024-09-21T07:38:27.903151+0000","last_unstale":"2024-09-21T07:38:28.881302+0000","last_undegraded":"2024-09-21T07:38:28.881302+0000","last_fullsized":"2024-09-21T07:38:28.881302+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:13.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"228'3","reported_seq":18,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880327+0000","last_change":"2024-09-21T07:38:26.873389+0000","last_active":"2024-09-21T07:38:28.880327+0000","last_peered":"2024-09-21T07:38:28.880327+0000","last_clean":"2024-09-21T07:38:28.880327+0000","last_became_active":"2024-09-21T07:38:26.872013+0000","last_became_peered":"2024-09-21T07:38:26.872013+0000","last_unstale":"2024-09-21T07:38:28.880327+0000","last_undegraded":"2024-09-21T07:38:28.880327+0000","last_fullsized":"2024-09-21T07:38:28.880327+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854167+0000","last_change":"2024-09-21T07:38:26.854167+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854167+0000","last_undegraded":"2024-09-21T07:38:26.854167+0000","last_fullsized":"2024-09-21T07:38:26.854167+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880860+0000","last_change":"2024-09-21T07:38:26.878447+0000","last_active":"2024-09-21T07:38:26.880860+0000","last_peered":"2024-09-21T07:38:26.880860+0000","last_clean":"2024-09-21T07:38:26.880860+0000","last_became_active":"2024-09-21T07:38:26.873257+0000","last_became_peered":"2024-09-21T07:38:26.873257+0000","last_unstale":"2024-09-21T07:38:26.880860+0000","last_undegraded":"2024-09-21T07:38:26.880860+0000","last_fullsized":"2024-09-21T07:38:26.880860+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.766779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850719+0000","last_change":"2024-09-21T07:38:26.850719+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850719+0000","last_undegraded":"2024-09-21T07:38:26.850719+0000","last_fullsized":"2024-09-21T07:38:26.850719+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867671+0000","last_change":"2024-09-21T07:38:26.861682+0000","last_active":"2024-09-21T07:38:26.867671+0000","last_peered":"2024-09-21T07:38:26.867671+0000","last_clean":"2024-09-21T07:38:26.867671+0000","last_became_active":"2024-09-21T07:38:26.861289+0000","last_became_peered":"2024-09-21T07:38:26.861289+0000","last_unstale":"2024-09-21T07:38:26.867671+0000","last_undegraded":"2024-09-21T07:38:26.867671+0000","last_fullsized":"2024-09-21T07:38:26.867671+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:45.530457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854420+0000","last_change":"2024-09-21T07:38:26.854420+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854420+0000","last_undegraded":"2024-09-21T07:38:26.854420+0000","last_fullsized":"2024-09-21T07:38:26.854420+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879903+0000","last_change":"2024-09-21T07:38:26.878489+0000","last_active":"2024-09-21T07:38:28.879903+0000","last_peered":"2024-09-21T07:38:28.879903+0000","last_clean":"2024-09-21T07:38:28.879903+0000","last_became_active":"2024-09-21T07:38:26.876983+0000","last_became_peered":"2024-09-21T07:38:26.876983+0000","last_unstale":"2024-09-21T07:38:28.879903+0000","last_undegraded":"2024-09-21T07:38:28.879903+0000","last_fullsized":"2024-09-21T07:38:28.879903+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:52.976040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850596+0000","last_change":"2024-09-21T07:38:26.850596+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850596+0000","last_undegraded":"2024-09-21T07:38:26.850596+0000","last_fullsized":"2024-09-21T07:38:26.850596+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879576+0000","last_change":"2024-09-21T07:38:26.874628+0000","last_active":"2024-09-21T07:38:28.879576+0000","last_peered":"2024-09-21T07:38:28.879576+0000","last_clean":"2024-09-21T07:38:28.879576+0000","last_became_active":"2024-09-21T07:38:26.874332+0000","last_became_peered":"2024-09-21T07:38:26.874332+0000","last_unstale":"2024-09-21T07:38:28.879576+0000","last_undegraded":"2024-09-21T07:38:28.879576+0000","last_fullsized":"2024-09-21T07:38:28.879576+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:59.212092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.851931+0000","last_change":"2024-09-21T07:38:26.851931+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.851931+0000","last_undegraded":"2024-09-21T07:38:26.851931+0000","last_fullsized":"2024-09-21T07:38:26.851931+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"228'8","reported_seq":23,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879702+0000","last_change":"2024-09-21T07:38:26.878210+0000","last_active":"2024-09-21T07:38:28.879702+0000","last_peered":"2024-09-21T07:38:28.879702+0000","last_clean":"2024-09-21T07:38:28.879702+0000","last_became_active":"2024-09-21T07:38:26.875824+0000","last_became_peered":"2024-09-21T07:38:26.875824+0000","last_unstale":"2024-09-21T07:38:28.879702+0000","last_undegraded":"2024-09-21T07:38:28.879702+0000","last_fullsized":"2024-09-21T07:38:28.879702+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:18.519770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853027+0000","last_change":"2024-09-21T07:38:26.853027+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853027+0000","last_undegraded":"2024-09-21T07:38:26.853027+0000","last_fullsized":"2024-09-21T07:38:26.853027+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881574+0000","last_change":"2024-09-21T07:38:26.873212+0000","last_active":"2024-09-21T07:38:28.881574+0000","last_peered":"2024-09-21T07:38:28.881574+0000","last_clean":"2024-09-21T07:38:28.881574+0000","last_became_active":"2024-09-21T07:38:26.872886+0000","last_became_peered":"2024-09-21T07:38:26.872886+0000","last_unstale":"2024-09-21T07:38:28.881574+0000","last_undegraded":"2024-09-21T07:38:28.881574+0000","last_fullsized":"2024-09-21T07:38:28.881574+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:26.601076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853930+0000","last_change":"2024-09-21T07:38:26.853930+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853930+0000","last_undegraded":"2024-09-21T07:38:26.853930+0000","last_fullsized":"2024-09-21T07:38:26.853930+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880815+0000","last_change":"2024-09-21T07:38:26.878845+0000","last_active":"2024-09-21T07:38:26.880815+0000","last_peered":"2024-09-21T07:38:26.880815+0000","last_clean":"2024-09-21T07:38:26.880815+0000","last_became_active":"2024-09-21T07:38:26.878455+0000","last_became_peered":"2024-09-21T07:38:26.878455+0000","last_unstale":"2024-09-21T07:38:26.880815+0000","last_undegraded":"2024-09-21T07:38:26.880815+0000","last_fullsized":"2024-09-21T07:38:26.880815+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:49.951734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880473+0000","last_change":"2024-09-21T07:38:27.905110+0000","last_active":"2024-09-21T07:38:28.880473+0000","last_peered":"2024-09-21T07:38:28.880473+0000","last_clean":"2024-09-21T07:38:28.880473+0000","last_became_active":"2024-09-21T07:38:27.904752+0000","last_became_peered":"2024-09-21T07:38:27.904752+0000","last_unstale":"2024-09-21T07:38:28.880473+0000","last_undegraded":"2024-09-21T07:38:28.880473+0000","last_fullsized":"2024-09-21T07:38:28.880473+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:04.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871766+0000","last_change":"2024-09-21T07:38:26.868486+0000","last_active":"2024-09-21T07:38:26.871766+0000","last_peered":"2024-09-21T07:38:26.871766+0000","last_clean":"2024-09-21T07:38:26.871766+0000","last_became_active":"2024-09-21T07:38:26.867803+0000","last_became_peered":"2024-09-21T07:38:26.867803+0000","last_unstale":"2024-09-21T07:38:26.871766+0000","last_undegraded":"2024-09-21T07:38:26.871766+0000","last_fullsized":"2024-09-21T07:38:26.871766+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:14.221292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853064+0000","last_change":"2024-09-21T07:38:26.853064+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853064+0000","last_undegraded":"2024-09-21T07:38:26.853064+0000","last_fullsized":"2024-09-21T07:38:26.853064+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882850+0000","last_change":"2024-09-21T07:38:26.879661+0000","last_active":"2024-09-21T07:38:26.882850+0000","last_peered":"2024-09-21T07:38:26.882850+0000","last_clean":"2024-09-21T07:38:26.882850+0000","last_became_active":"2024-09-21T07:38:26.879329+0000","last_became_peered":"2024-09-21T07:38:26.879329+0000","last_unstale":"2024-09-21T07:38:26.882850+0000","last_undegraded":"2024-09-21T07:38:26.882850+0000","last_fullsized":"2024-09-21T07:38:26.882850+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:47.557653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864172+0000","last_change":"2024-09-21T07:38:26.864172+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864172+0000","last_undegraded":"2024-09-21T07:38:26.864172+0000","last_fullsized":"2024-09-21T07:38:26.864172+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882042+0000","last_change":"2024-09-21T07:38:26.881447+0000","last_active":"2024-09-21T07:38:26.882042+0000","last_peered":"2024-09-21T07:38:26.882042+0000","last_clean":"2024-09-21T07:38:26.882042+0000","last_became_active":"2024-09-21T07:38:26.880826+0000","last_became_peered":"2024-09-21T07:38:26.880826+0000","last_unstale":"2024-09-21T07:38:26.882042+0000","last_undegraded":"2024-09-21T07:38:26.882042+0000","last_fullsized":"2024-09-21T07:38:26.882042+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.334645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853830+0000","last_change":"2024-09-21T07:38:26.853830+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853830+0000","last_undegraded":"2024-09-21T07:38:26.853830+0000","last_fullsized":"2024-09-21T07:38:26.853830+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864311+0000","last_change":"2024-09-21T07:38:26.855037+0000","last_active":"2024-09-21T07:38:26.864311+0000","last_peered":"2024-09-21T07:38:26.864311+0000","last_clean":"2024-09-21T07:38:26.864311+0000","last_became_active":"2024-09-21T07:38:26.854720+0000","last_became_peered":"2024-09-21T07:38:26.854720+0000","last_unstale":"2024-09-21T07:38:26.864311+0000","last_undegraded":"2024-09-21T07:38:26.864311+0000","last_fullsized":"2024-09-21T07:38:26.864311+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:46.787656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879939+0000","last_change":"2024-09-21T07:38:27.906211+0000","last_active":"2024-09-21T07:38:28.879939+0000","last_peered":"2024-09-21T07:38:28.879939+0000","last_clean":"2024-09-21T07:38:28.879939+0000","last_became_active":"2024-09-21T07:38:27.905909+0000","last_became_peered":"2024-09-21T07:38:27.905909+0000","last_unstale":"2024-09-21T07:38:28.879939+0000","last_undegraded":"2024-09-21T07:38:28.879939+0000","last_fullsized":"2024-09-21T07:38:28.879939+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:33.469346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872191+0000","last_change":"2024-09-21T07:38:26.870394+0000","last_active":"2024-09-21T07:38:26.872191+0000","last_peered":"2024-09-21T07:38:26.872191+0000","last_clean":"2024-09-21T07:38:26.872191+0000","last_became_active":"2024-09-21T07:38:26.869897+0000","last_became_peered":"2024-09-21T07:38:26.869897+0000","last_unstale":"2024-09-21T07:38:26.872191+0000","last_undegraded":"2024-09-21T07:38:26.872191+0000","last_fullsized":"2024-09-21T07:38:26.872191+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:16.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858677+0000","last_change":"2024-09-21T07:38:26.858677+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858677+0000","last_undegraded":"2024-09-21T07:38:26.858677+0000","last_fullsized":"2024-09-21T07:38:26.858677+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879707+0000","last_change":"2024-09-21T07:38:26.877812+0000","last_active":"2024-09-21T07:38:28.879707+0000","last_peered":"2024-09-21T07:38:28.879707+0000","last_clean":"2024-09-21T07:38:28.879707+0000","last_became_active":"2024-09-21T07:38:26.877017+0000","last_became_peered":"2024-09-21T07:38:26.877017+0000","last_unstale":"2024-09-21T07:38:28.879707+0000","last_undegraded":"2024-09-21T07:38:28.879707+0000","last_fullsized":"2024-09-21T07:38:28.879707+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:31.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881705+0000","last_change":"2024-09-21T07:38:27.896317+0000","last_active":"2024-09-21T07:38:28.881705+0000","last_peered":"2024-09-21T07:38:28.881705+0000","last_clean":"2024-09-21T07:38:28.881705+0000","last_became_active":"2024-09-21T07:38:27.895976+0000","last_became_peered":"2024-09-21T07:38:27.895976+0000","last_unstale":"2024-09-21T07:38:28.881705+0000","last_undegraded":"2024-09-21T07:38:28.881705+0000","last_fullsized":"2024-09-21T07:38:28.881705+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:35.460608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880453+0000","last_change":"2024-09-21T07:38:26.877423+0000","last_active":"2024-09-21T07:38:28.880453+0000","last_peered":"2024-09-21T07:38:28.880453+0000","last_clean":"2024-09-21T07:38:28.880453+0000","last_became_active":"2024-09-21T07:38:26.875883+0000","last_became_peered":"2024-09-21T07:38:26.875883+0000","last_unstale":"2024-09-21T07:38:28.880453+0000","last_undegraded":"2024-09-21T07:38:28.880453+0000","last_fullsized":"2024-09-21T07:38:28.880453+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:12.421136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881526+0000","last_change":"2024-09-21T07:38:27.904807+0000","last_active":"2024-09-21T07:38:28.881526+0000","last_peered":"2024-09-21T07:38:28.881526+0000","last_clean":"2024-09-21T07:38:28.881526+0000","last_became_active":"2024-09-21T07:38:27.904462+0000","last_became_peered":"2024-09-21T07:38:27.904462+0000","last_unstale":"2024-09-21T07:38:28.881526+0000","last_undegraded":"2024-09-21T07:38:28.881526+0000","last_fullsized":"2024-09-21T07:38:28.881526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:30.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880783+0000","last_change":"2024-09-21T07:38:26.876682+0000","last_active":"2024-09-21T07:38:26.880783+0000","last_peered":"2024-09-21T07:38:26.880783+0000","last_clean":"2024-09-21T07:38:26.880783+0000","last_became_active":"2024-09-21T07:38:26.874751+0000","last_became_peered":"2024-09-21T07:38:26.874751+0000","last_unstale":"2024-09-21T07:38:26.880783+0000","last_undegraded":"2024-09-21T07:38:26.880783+0000","last_fullsized":"2024-09-21T07:38:26.880783+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:47.312008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858393+0000","last_change":"2024-09-21T07:38:26.858393+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858393+0000","last_undegraded":"2024-09-21T07:38:26.858393+0000","last_fullsized":"2024-09-21T07:38:26.858393+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871738+0000","last_change":"2024-09-21T07:38:26.868126+0000","last_active":"2024-09-21T07:38:26.871738+0000","last_peered":"2024-09-21T07:38:26.871738+0000","last_clean":"2024-09-21T07:38:26.871738+0000","last_became_active":"2024-09-21T07:38:26.867386+0000","last_became_peered":"2024-09-21T07:38:26.867386+0000","last_unstale":"2024-09-21T07:38:26.871738+0000","last_undegraded":"2024-09-21T07:38:26.871738+0000","last_fullsized":"2024-09-21T07:38:26.871738+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881462+0000","last_change":"2024-09-21T07:38:27.900241+0000","last_active":"2024-09-21T07:38:28.881462+0000","last_peered":"2024-09-21T07:38:28.881462+0000","last_clean":"2024-09-21T07:38:28.881462+0000","last_became_active":"2024-09-21T07:38:27.899917+0000","last_became_peered":"2024-09-21T07:38:27.899917+0000","last_unstale":"2024-09-21T07:38:28.881462+0000","last_undegraded":"2024-09-21T07:38:28.881462+0000","last_fullsized":"2024-09-21T07:38:28.881462+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:19.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.870995+0000","last_change":"2024-09-21T07:38:26.867671+0000","last_active":"2024-09-21T07:38:26.870995+0000","last_peered":"2024-09-21T07:38:26.870995+0000","last_clean":"2024-09-21T07:38:26.870995+0000","last_became_active":"2024-09-21T07:38:26.867315+0000","last_became_peered":"2024-09-21T07:38:26.867315+0000","last_unstale":"2024-09-21T07:38:26.870995+0000","last_undegraded":"2024-09-21T07:38:26.870995+0000","last_fullsized":"2024-09-21T07:38:26.870995+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879528+0000","last_change":"2024-09-21T07:38:27.906372+0000","last_active":"2024-09-21T07:38:28.879528+0000","last_peered":"2024-09-21T07:38:28.879528+0000","last_clean":"2024-09-21T07:38:28.879528+0000","last_became_active":"2024-09-21T07:38:27.905712+0000","last_became_peered":"2024-09-21T07:38:27.905712+0000","last_unstale":"2024-09-21T07:38:28.879528+0000","last_undegraded":"2024-09-21T07:38:28.879528+0000","last_fullsized":"2024-09-21T07:38:28.879528+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:07.010954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880736+0000","last_change":"2024-09-21T07:38:26.876537+0000","last_active":"2024-09-21T07:38:26.880736+0000","last_peered":"2024-09-21T07:38:26.880736+0000","last_clean":"2024-09-21T07:38:26.880736+0000","last_became_active":"2024-09-21T07:38:26.874643+0000","last_became_peered":"2024-09-21T07:38:26.874643+0000","last_unstale":"2024-09-21T07:38:26.880736+0000","last_undegraded":"2024-09-21T07:38:26.880736+0000","last_fullsized":"2024-09-21T07:38:26.880736+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:04.010256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857653+0000","last_change":"2024-09-21T07:38:26.857653+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857653+0000","last_undegraded":"2024-09-21T07:38:26.857653+0000","last_fullsized":"2024-09-21T07:38:26.857653+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880370+0000","last_change":"2024-09-21T07:38:26.875309+0000","last_active":"2024-09-21T07:38:26.880370+0000","last_peered":"2024-09-21T07:38:26.880370+0000","last_clean":"2024-09-21T07:38:26.880370+0000","last_became_active":"2024-09-21T07:38:26.874985+0000","last_became_peered":"2024-09-21T07:38:26.874985+0000","last_unstale":"2024-09-21T07:38:26.880370+0000","last_undegraded":"2024-09-21T07:38:26.880370+0000","last_fullsized":"2024-09-21T07:38:26.880370+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:34.340576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858330+0000","last_change":"2024-09-21T07:38:26.858330+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858330+0000","last_undegraded":"2024-09-21T07:38:26.858330+0000","last_fullsized":"2024-09-21T07:38:26.858330+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872132+0000","last_change":"2024-09-21T07:38:26.871500+0000","last_active":"2024-09-21T07:38:26.872132+0000","last_peered":"2024-09-21T07:38:26.872132+0000","last_clean":"2024-09-21T07:38:26.872132+0000","last_became_active":"2024-09-21T07:38:26.871155+0000","last_became_peered":"2024-09-21T07:38:26.871155+0000","last_unstale":"2024-09-21T07:38:26.872132+0000","last_undegraded":"2024-09-21T07:38:26.872132+0000","last_fullsized":"2024-09-21T07:38:26.872132+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:10.567311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.848808+0000","last_change":"2024-09-21T07:38:26.848808+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.848808+0000","last_undegraded":"2024-09-21T07:38:26.848808+0000","last_fullsized":"2024-09-21T07:38:26.848808+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871618+0000","last_change":"2024-09-21T07:38:26.862884+0000","last_active":"2024-09-21T07:38:26.871618+0000","last_peered":"2024-09-21T07:38:26.871618+0000","last_clean":"2024-09-21T07:38:26.871618+0000","last_became_active":"2024-09-21T07:38:26.861444+0000","last_became_peered":"2024-09-21T07:38:26.861444+0000","last_unstale":"2024-09-21T07:38:26.871618+0000","last_undegraded":"2024-09-21T07:38:26.871618+0000","last_fullsized":"2024-09-21T07:38:26.871618+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:22.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879863+0000","last_change":"2024-09-21T07:38:27.909367+0000","last_active":"2024-09-21T07:38:28.879863+0000","last_peered":"2024-09-21T07:38:28.879863+0000","last_clean":"2024-09-21T07:38:28.879863+0000","last_became_active":"2024-09-21T07:38:27.907346+0000","last_became_peered":"2024-09-21T07:38:27.907346+0000","last_unstale":"2024-09-21T07:38:28.879863+0000","last_undegraded":"2024-09-21T07:38:28.879863+0000","last_fullsized":"2024-09-21T07:38:28.879863+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:41.726703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":490,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880588+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:38:28.880588+0000","last_peered":"2024-09-21T07:38:28.880588+0000","last_clean":"2024-09-21T07:38:28.880588+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:38:28.880588+0000","last_undegraded":"2024-09-21T07:38:28.880588+0000","last_fullsized":"2024-09-21T07:38:28.880588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56184,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315656,"statfs":{"total":96636764160,"available":96579231744,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47864,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323976,"statfs":{"total":96636764160,"available":96587751424,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60364,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311476,"statfs":{"total":96636764160,"available":96574951424,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47876,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323964,"statfs":{"total":96636764160,"available":96587739136,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56780,"kb_used_data":3380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315060,"statfs":{"total":96636764160,"available":96578621440,"internally_reserved":0,"allocated":3461120,"data_stored":1946414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56808,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315032,"statfs":{"total":96636764160,"available":96578592768,"internally_reserved":0,"allocated":3493888,"data_stored":1960877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88096,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283744,"statfs":{"total":96636764160,"available":96546553856,"internally_reserved":0,"allocated":2895872,"data_stored":1369995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:32.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- 172.21.15.64:0/2065826753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00b3170 msgr2=0x7f83b00b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 --2- 172.21.15.64:0/2065826753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00b3170 0x7f83b00b3580 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f83b015ce30 tx=0x7f839c01c800 comp rx=0 tx=0).stop 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- 172.21.15.64:0/2065826753 shutdown_connections 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 --2- 172.21.15.64:0/2065826753 >> v2:172.21.15.90:3300/0 conn(0x7f83b00ccd30 0x7f83b00cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 --2- 172.21.15.64:0/2065826753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00b3170 0x7f83b00b3580 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- 172.21.15.64:0/2065826753 >> 172.21.15.64:0/2065826753 conn(0x7f83b006d570 msgr2=0x7f83b00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- 172.21.15.64:0/2065826753 shutdown_connections 2024-09-21T07:38:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- 172.21.15.64:0/2065826753 wait complete. 2024-09-21T07:38:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 Processor -- start 2024-09-21T07:38:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.290+0000 7f83b8400640 1 -- start start 2024-09-21T07:38:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 0x7f83b0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 0x7f83b00ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0169e90 con 0x7f83b00ccd30 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0169d10 con 0x7f83b00b3170 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f83b016a010 con 0x7f83b00b28e0 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55568/0 (socket says 172.21.15.64:55568) 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 -- 172.21.15.64:0/2073619858 learned_addr learned my addr 172.21.15.64:0/2073619858 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b5a00640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 0x7f83b0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b5000640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 0x7f83b00ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 -- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 msgr2=0x7f83b0155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 0x7f83b0155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 -- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 msgr2=0x7f83b00ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 0x7f83b00ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 -- 172.21.15.64:0/2073619858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b0156080 con 0x7f83b00ccd30 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b5a00640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 0x7f83b0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:32.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b5000640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 0x7f83b00ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b6400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a800ce20 con 0x7f83b00ccd30 2024-09-21T07:38:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a8004b30 con 0x7f83b00ccd30 2024-09-21T07:38:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8005020 con 0x7f83b00ccd30 2024-09-21T07:38:32.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b01670b0 con 0x7f83b00ccd30 2024-09-21T07:38:32.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b0156430 con 0x7f83b00ccd30 2024-09-21T07:38:32.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.294+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b00c5010 con 0x7f83b00ccd30 2024-09-21T07:38:32.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.298+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f83a80051c0 con 0x7f83b00ccd30 2024-09-21T07:38:32.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.298+0000 7f83ad600640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 0x7f8390075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.298+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7f83a8094ff0 con 0x7f83b00ccd30 2024-09-21T07:38:32.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.298+0000 7f83b5a00640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 0x7f8390075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.298+0000 7f83b5a00640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 0x7f8390075740 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f83a4000f70 tx=0x7f83a4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:32.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.302+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f83b00c5010 con 0x7f83b00ccd30 2024-09-21T07:38:32.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.478+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83b0166ea0 con 0x7f8390073230 2024-09-21T07:38:32.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.482+0000 7f83ad600640 1 -- 172.21.15.64:0/2073619858 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248632 (secure 0 0 0) 0x7f83b0166ea0 con 0x7f8390073230 2024-09-21T07:38:32.486 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:32.487 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 msgr2=0x7f8390075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 0x7f8390075740 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f83a4000f70 tx=0x7f83a4009040 comp rx=0 tx=0).stop 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 msgr2=0x7f83b00aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a800ef10 comp rx=0 tx=0).stop 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 shutdown_connections 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8390073230 0x7f8390075740 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83b00ccd30 0x7f83b00aed30 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b00b3170 0x7f83b00ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 --2- 172.21.15.64:0/2073619858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f83b00b28e0 0x7f83b0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 >> 172.21.15.64:0/2073619858 conn(0x7f83b006d570 msgr2=0x7f83b00b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 shutdown_connections 2024-09-21T07:38:32.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.486+0000 7f83b8400640 1 -- 172.21.15.64:0/2073619858 wait complete. 2024-09-21T07:38:32.507 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-09-21T07:38:31.683267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":121,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":470172,"kb_used_data":23596,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754504548,"statfs":{"total":773094113280,"available":772612657152,"internally_reserved":0,"allocated":24162304,"data_stored":12044182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.838108"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857711+0000","last_change":"2024-09-21T07:38:26.857711+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857711+0000","last_undegraded":"2024-09-21T07:38:26.857711+0000","last_fullsized":"2024-09-21T07:38:26.857711+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859628+0000","last_change":"2024-09-21T07:38:26.859628+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859628+0000","last_undegraded":"2024-09-21T07:38:26.859628+0000","last_fullsized":"2024-09-21T07:38:26.859628+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857134+0000","last_change":"2024-09-21T07:38:26.857134+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857134+0000","last_undegraded":"2024-09-21T07:38:26.857134+0000","last_fullsized":"2024-09-21T07:38:26.857134+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880663+0000","last_change":"2024-09-21T07:38:27.902273+0000","last_active":"2024-09-21T07:38:28.880663+0000","last_peered":"2024-09-21T07:38:28.880663+0000","last_clean":"2024-09-21T07:38:28.880663+0000","last_became_active":"2024-09-21T07:38:27.901903+0000","last_became_peered":"2024-09-21T07:38:27.901903+0000","last_unstale":"2024-09-21T07:38:28.880663+0000","last_undegraded":"2024-09-21T07:38:28.880663+0000","last_fullsized":"2024-09-21T07:38:28.880663+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:58.406221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853011+0000","last_change":"2024-09-21T07:38:26.853011+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853011+0000","last_undegraded":"2024-09-21T07:38:26.853011+0000","last_fullsized":"2024-09-21T07:38:26.853011+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880971+0000","last_change":"2024-09-21T07:38:27.890574+0000","last_active":"2024-09-21T07:38:28.880971+0000","last_peered":"2024-09-21T07:38:28.880971+0000","last_clean":"2024-09-21T07:38:28.880971+0000","last_became_active":"2024-09-21T07:38:27.887320+0000","last_became_peered":"2024-09-21T07:38:27.887320+0000","last_unstale":"2024-09-21T07:38:28.880971+0000","last_undegraded":"2024-09-21T07:38:28.880971+0000","last_fullsized":"2024-09-21T07:38:28.880971+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:40.556500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.856159+0000","last_change":"2024-09-21T07:38:26.856159+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.856159+0000","last_undegraded":"2024-09-21T07:38:26.856159+0000","last_fullsized":"2024-09-21T07:38:26.856159+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879529+0000","last_change":"2024-09-21T07:38:27.907654+0000","last_active":"2024-09-21T07:38:28.879529+0000","last_peered":"2024-09-21T07:38:28.879529+0000","last_clean":"2024-09-21T07:38:28.879529+0000","last_became_active":"2024-09-21T07:38:27.906066+0000","last_became_peered":"2024-09-21T07:38:27.906066+0000","last_unstale":"2024-09-21T07:38:28.879529+0000","last_undegraded":"2024-09-21T07:38:28.879529+0000","last_fullsized":"2024-09-21T07:38:28.879529+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:24.486499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881469+0000","last_change":"2024-09-21T07:38:27.897228+0000","last_active":"2024-09-21T07:38:28.881469+0000","last_peered":"2024-09-21T07:38:28.881469+0000","last_clean":"2024-09-21T07:38:28.881469+0000","last_became_active":"2024-09-21T07:38:27.896883+0000","last_became_peered":"2024-09-21T07:38:27.896883+0000","last_unstale":"2024-09-21T07:38:28.881469+0000","last_undegraded":"2024-09-21T07:38:28.881469+0000","last_fullsized":"2024-09-21T07:38:28.881469+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:51.166601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849670+0000","last_change":"2024-09-21T07:38:26.849670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849670+0000","last_undegraded":"2024-09-21T07:38:26.849670+0000","last_fullsized":"2024-09-21T07:38:26.849670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858207+0000","last_change":"2024-09-21T07:38:26.858207+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858207+0000","last_undegraded":"2024-09-21T07:38:26.858207+0000","last_fullsized":"2024-09-21T07:38:26.858207+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881624+0000","last_change":"2024-09-21T07:38:27.895619+0000","last_active":"2024-09-21T07:38:28.881624+0000","last_peered":"2024-09-21T07:38:28.881624+0000","last_clean":"2024-09-21T07:38:28.881624+0000","last_became_active":"2024-09-21T07:38:27.895269+0000","last_became_peered":"2024-09-21T07:38:27.895269+0000","last_unstale":"2024-09-21T07:38:28.881624+0000","last_undegraded":"2024-09-21T07:38:28.881624+0000","last_fullsized":"2024-09-21T07:38:28.881624+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:48.794383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879845+0000","last_change":"2024-09-21T07:38:27.908331+0000","last_active":"2024-09-21T07:38:28.879845+0000","last_peered":"2024-09-21T07:38:28.879845+0000","last_clean":"2024-09-21T07:38:28.879845+0000","last_became_active":"2024-09-21T07:38:27.906446+0000","last_became_peered":"2024-09-21T07:38:27.906446+0000","last_unstale":"2024-09-21T07:38:28.879845+0000","last_undegraded":"2024-09-21T07:38:28.879845+0000","last_fullsized":"2024-09-21T07:38:28.879845+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:24.108120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859755+0000","last_change":"2024-09-21T07:38:26.859755+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859755+0000","last_undegraded":"2024-09-21T07:38:26.859755+0000","last_fullsized":"2024-09-21T07:38:26.859755+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.866161+0000","last_change":"2024-09-21T07:38:26.866161+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.866161+0000","last_undegraded":"2024-09-21T07:38:26.866161+0000","last_fullsized":"2024-09-21T07:38:26.866161+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849053+0000","last_change":"2024-09-21T07:38:26.849053+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849053+0000","last_undegraded":"2024-09-21T07:38:26.849053+0000","last_fullsized":"2024-09-21T07:38:26.849053+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849929+0000","last_change":"2024-09-21T07:38:26.849929+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849929+0000","last_undegraded":"2024-09-21T07:38:26.849929+0000","last_fullsized":"2024-09-21T07:38:26.849929+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858040+0000","last_change":"2024-09-21T07:38:26.858040+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858040+0000","last_undegraded":"2024-09-21T07:38:26.858040+0000","last_fullsized":"2024-09-21T07:38:26.858040+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849583+0000","last_change":"2024-09-21T07:38:26.849583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849583+0000","last_undegraded":"2024-09-21T07:38:26.849583+0000","last_fullsized":"2024-09-21T07:38:26.849583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881493+0000","last_change":"2024-09-21T07:38:27.896082+0000","last_active":"2024-09-21T07:38:28.881493+0000","last_peered":"2024-09-21T07:38:28.881493+0000","last_clean":"2024-09-21T07:38:28.881493+0000","last_became_active":"2024-09-21T07:38:27.895767+0000","last_became_peered":"2024-09-21T07:38:27.895767+0000","last_unstale":"2024-09-21T07:38:28.881493+0000","last_undegraded":"2024-09-21T07:38:28.881493+0000","last_fullsized":"2024-09-21T07:38:28.881493+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:04.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852499+0000","last_change":"2024-09-21T07:38:26.852499+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852499+0000","last_undegraded":"2024-09-21T07:38:26.852499+0000","last_fullsized":"2024-09-21T07:38:26.852499+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852856+0000","last_change":"2024-09-21T07:38:26.852856+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852856+0000","last_undegraded":"2024-09-21T07:38:26.852856+0000","last_fullsized":"2024-09-21T07:38:26.852856+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.862531+0000","last_change":"2024-09-21T07:38:26.862531+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.862531+0000","last_undegraded":"2024-09-21T07:38:26.862531+0000","last_fullsized":"2024-09-21T07:38:26.862531+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852913+0000","last_change":"2024-09-21T07:38:26.852913+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852913+0000","last_undegraded":"2024-09-21T07:38:26.852913+0000","last_fullsized":"2024-09-21T07:38:26.852913+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858632+0000","last_change":"2024-09-21T07:38:26.858632+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858632+0000","last_undegraded":"2024-09-21T07:38:26.858632+0000","last_fullsized":"2024-09-21T07:38:26.858632+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858231+0000","last_change":"2024-09-21T07:38:26.858231+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858231+0000","last_undegraded":"2024-09-21T07:38:26.858231+0000","last_fullsized":"2024-09-21T07:38:26.858231+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857655+0000","last_change":"2024-09-21T07:38:26.857655+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857655+0000","last_undegraded":"2024-09-21T07:38:26.857655+0000","last_fullsized":"2024-09-21T07:38:26.857655+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855526+0000","last_change":"2024-09-21T07:38:26.855526+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855526+0000","last_undegraded":"2024-09-21T07:38:26.855526+0000","last_fullsized":"2024-09-21T07:38:26.855526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881690+0000","last_change":"2024-09-21T07:38:27.899491+0000","last_active":"2024-09-21T07:38:28.881690+0000","last_peered":"2024-09-21T07:38:28.881690+0000","last_clean":"2024-09-21T07:38:28.881690+0000","last_became_active":"2024-09-21T07:38:27.898923+0000","last_became_peered":"2024-09-21T07:38:27.898923+0000","last_unstale":"2024-09-21T07:38:28.881690+0000","last_undegraded":"2024-09-21T07:38:28.881690+0000","last_fullsized":"2024-09-21T07:38:28.881690+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:25.337677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858670+0000","last_change":"2024-09-21T07:38:26.858670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858670+0000","last_undegraded":"2024-09-21T07:38:26.858670+0000","last_fullsized":"2024-09-21T07:38:26.858670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.865286+0000","last_change":"2024-09-21T07:38:26.865286+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.865286+0000","last_undegraded":"2024-09-21T07:38:26.865286+0000","last_fullsized":"2024-09-21T07:38:26.865286+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849079+0000","last_change":"2024-09-21T07:38:26.849079+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849079+0000","last_undegraded":"2024-09-21T07:38:26.849079+0000","last_fullsized":"2024-09-21T07:38:26.849079+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880901+0000","last_change":"2024-09-21T07:38:26.876175+0000","last_active":"2024-09-21T07:38:26.880901+0000","last_peered":"2024-09-21T07:38:26.880901+0000","last_clean":"2024-09-21T07:38:26.880901+0000","last_became_active":"2024-09-21T07:38:26.875734+0000","last_became_peered":"2024-09-21T07:38:26.875734+0000","last_unstale":"2024-09-21T07:38:26.880901+0000","last_undegraded":"2024-09-21T07:38:26.880901+0000","last_fullsized":"2024-09-21T07:38:26.880901+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:16.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855959+0000","last_change":"2024-09-21T07:38:26.855959+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855959+0000","last_undegraded":"2024-09-21T07:38:26.855959+0000","last_fullsized":"2024-09-21T07:38:26.855959+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866550+0000","last_change":"2024-09-21T07:38:26.863994+0000","last_active":"2024-09-21T07:38:26.866550+0000","last_peered":"2024-09-21T07:38:26.866550+0000","last_clean":"2024-09-21T07:38:26.866550+0000","last_became_active":"2024-09-21T07:38:26.863529+0000","last_became_peered":"2024-09-21T07:38:26.863529+0000","last_unstale":"2024-09-21T07:38:26.866550+0000","last_undegraded":"2024-09-21T07:38:26.866550+0000","last_fullsized":"2024-09-21T07:38:26.866550+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857583+0000","last_change":"2024-09-21T07:38:26.857583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857583+0000","last_undegraded":"2024-09-21T07:38:26.857583+0000","last_fullsized":"2024-09-21T07:38:26.857583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.869635+0000","last_change":"2024-09-21T07:38:26.866652+0000","last_active":"2024-09-21T07:38:26.869635+0000","last_peered":"2024-09-21T07:38:26.869635+0000","last_clean":"2024-09-21T07:38:26.869635+0000","last_became_active":"2024-09-21T07:38:26.866286+0000","last_became_peered":"2024-09-21T07:38:26.866286+0000","last_unstale":"2024-09-21T07:38:26.869635+0000","last_undegraded":"2024-09-21T07:38:26.869635+0000","last_fullsized":"2024-09-21T07:38:26.869635+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:47.671946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857091+0000","last_change":"2024-09-21T07:38:26.857091+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857091+0000","last_undegraded":"2024-09-21T07:38:26.857091+0000","last_fullsized":"2024-09-21T07:38:26.857091+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865580+0000","last_change":"2024-09-21T07:38:26.861984+0000","last_active":"2024-09-21T07:38:26.865580+0000","last_peered":"2024-09-21T07:38:26.865580+0000","last_clean":"2024-09-21T07:38:26.865580+0000","last_became_active":"2024-09-21T07:38:26.861625+0000","last_became_peered":"2024-09-21T07:38:26.861625+0000","last_unstale":"2024-09-21T07:38:26.865580+0000","last_undegraded":"2024-09-21T07:38:26.865580+0000","last_fullsized":"2024-09-21T07:38:26.865580+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:08.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864715+0000","last_change":"2024-09-21T07:38:26.864715+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864715+0000","last_undegraded":"2024-09-21T07:38:26.864715+0000","last_fullsized":"2024-09-21T07:38:26.864715+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867748+0000","last_change":"2024-09-21T07:38:26.863298+0000","last_active":"2024-09-21T07:38:26.867748+0000","last_peered":"2024-09-21T07:38:26.867748+0000","last_clean":"2024-09-21T07:38:26.867748+0000","last_became_active":"2024-09-21T07:38:26.862983+0000","last_became_peered":"2024-09-21T07:38:26.862983+0000","last_unstale":"2024-09-21T07:38:26.867748+0000","last_undegraded":"2024-09-21T07:38:26.867748+0000","last_fullsized":"2024-09-21T07:38:26.867748+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:08.126208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858155+0000","last_change":"2024-09-21T07:38:26.858155+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858155+0000","last_undegraded":"2024-09-21T07:38:26.858155+0000","last_fullsized":"2024-09-21T07:38:26.858155+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.879179+0000","last_change":"2024-09-21T07:38:26.874143+0000","last_active":"2024-09-21T07:38:26.879179+0000","last_peered":"2024-09-21T07:38:26.879179+0000","last_clean":"2024-09-21T07:38:26.879179+0000","last_became_active":"2024-09-21T07:38:26.873839+0000","last_became_peered":"2024-09-21T07:38:26.873839+0000","last_unstale":"2024-09-21T07:38:26.879179+0000","last_undegraded":"2024-09-21T07:38:26.879179+0000","last_fullsized":"2024-09-21T07:38:26.879179+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.415543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858915+0000","last_change":"2024-09-21T07:38:26.858915+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858915+0000","last_undegraded":"2024-09-21T07:38:26.858915+0000","last_fullsized":"2024-09-21T07:38:26.858915+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865553+0000","last_change":"2024-09-21T07:38:26.861747+0000","last_active":"2024-09-21T07:38:26.865553+0000","last_peered":"2024-09-21T07:38:26.865553+0000","last_clean":"2024-09-21T07:38:26.865553+0000","last_became_active":"2024-09-21T07:38:26.861414+0000","last_became_peered":"2024-09-21T07:38:26.861414+0000","last_unstale":"2024-09-21T07:38:26.865553+0000","last_undegraded":"2024-09-21T07:38:26.865553+0000","last_fullsized":"2024-09-21T07:38:26.865553+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:27.620630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880150+0000","last_change":"2024-09-21T07:38:27.908116+0000","last_active":"2024-09-21T07:38:28.880150+0000","last_peered":"2024-09-21T07:38:28.880150+0000","last_clean":"2024-09-21T07:38:28.880150+0000","last_became_active":"2024-09-21T07:38:27.906137+0000","last_became_peered":"2024-09-21T07:38:27.906137+0000","last_unstale":"2024-09-21T07:38:28.880150+0000","last_undegraded":"2024-09-21T07:38:28.880150+0000","last_fullsized":"2024-09-21T07:38:28.880150+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:28.691558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864102+0000","last_change":"2024-09-21T07:38:26.857528+0000","last_active":"2024-09-21T07:38:26.864102+0000","last_peered":"2024-09-21T07:38:26.864102+0000","last_clean":"2024-09-21T07:38:26.864102+0000","last_became_active":"2024-09-21T07:38:26.857087+0000","last_became_peered":"2024-09-21T07:38:26.857087+0000","last_unstale":"2024-09-21T07:38:26.864102+0000","last_undegraded":"2024-09-21T07:38:26.864102+0000","last_fullsized":"2024-09-21T07:38:26.864102+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:43.048249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880475+0000","last_change":"2024-09-21T07:38:27.900713+0000","last_active":"2024-09-21T07:38:28.880475+0000","last_peered":"2024-09-21T07:38:28.880475+0000","last_clean":"2024-09-21T07:38:28.880475+0000","last_became_active":"2024-09-21T07:38:27.900385+0000","last_became_peered":"2024-09-21T07:38:27.900385+0000","last_unstale":"2024-09-21T07:38:28.880475+0000","last_undegraded":"2024-09-21T07:38:28.880475+0000","last_fullsized":"2024-09-21T07:38:28.880475+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:55.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880521+0000","last_change":"2024-09-21T07:38:26.874002+0000","last_active":"2024-09-21T07:38:28.880521+0000","last_peered":"2024-09-21T07:38:28.880521+0000","last_clean":"2024-09-21T07:38:28.880521+0000","last_became_active":"2024-09-21T07:38:26.873678+0000","last_became_peered":"2024-09-21T07:38:26.873678+0000","last_unstale":"2024-09-21T07:38:28.880521+0000","last_undegraded":"2024-09-21T07:38:28.880521+0000","last_fullsized":"2024-09-21T07:38:28.880521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:35.150025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855334+0000","last_change":"2024-09-21T07:38:26.855334+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855334+0000","last_undegraded":"2024-09-21T07:38:26.855334+0000","last_fullsized":"2024-09-21T07:38:26.855334+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866521+0000","last_change":"2024-09-21T07:38:26.863704+0000","last_active":"2024-09-21T07:38:26.866521+0000","last_peered":"2024-09-21T07:38:26.866521+0000","last_clean":"2024-09-21T07:38:26.866521+0000","last_became_active":"2024-09-21T07:38:26.863365+0000","last_became_peered":"2024-09-21T07:38:26.863365+0000","last_unstale":"2024-09-21T07:38:26.866521+0000","last_undegraded":"2024-09-21T07:38:26.866521+0000","last_fullsized":"2024-09-21T07:38:26.866521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881302+0000","last_change":"2024-09-21T07:38:27.903378+0000","last_active":"2024-09-21T07:38:28.881302+0000","last_peered":"2024-09-21T07:38:28.881302+0000","last_clean":"2024-09-21T07:38:28.881302+0000","last_became_active":"2024-09-21T07:38:27.903151+0000","last_became_peered":"2024-09-21T07:38:27.903151+0000","last_unstale":"2024-09-21T07:38:28.881302+0000","last_undegraded":"2024-09-21T07:38:28.881302+0000","last_fullsized":"2024-09-21T07:38:28.881302+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:13.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"228'3","reported_seq":18,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880327+0000","last_change":"2024-09-21T07:38:26.873389+0000","last_active":"2024-09-21T07:38:28.880327+0000","last_peered":"2024-09-21T07:38:28.880327+0000","last_clean":"2024-09-21T07:38:28.880327+0000","last_became_active":"2024-09-21T07:38:26.872013+0000","last_became_peered":"2024-09-21T07:38:26.872013+0000","last_unstale":"2024-09-21T07:38:28.880327+0000","last_undegraded":"2024-09-21T07:38:28.880327+0000","last_fullsized":"2024-09-21T07:38:28.880327+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854167+0000","last_change":"2024-09-21T07:38:26.854167+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854167+0000","last_undegraded":"2024-09-21T07:38:26.854167+0000","last_fullsized":"2024-09-21T07:38:26.854167+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880860+0000","last_change":"2024-09-21T07:38:26.878447+0000","last_active":"2024-09-21T07:38:26.880860+0000","last_peered":"2024-09-21T07:38:26.880860+0000","last_clean":"2024-09-21T07:38:26.880860+0000","last_became_active":"2024-09-21T07:38:26.873257+0000","last_became_peered":"2024-09-21T07:38:26.873257+0000","last_unstale":"2024-09-21T07:38:26.880860+0000","last_undegraded":"2024-09-21T07:38:26.880860+0000","last_fullsized":"2024-09-21T07:38:26.880860+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.766779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850719+0000","last_change":"2024-09-21T07:38:26.850719+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850719+0000","last_undegraded":"2024-09-21T07:38:26.850719+0000","last_fullsized":"2024-09-21T07:38:26.850719+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867671+0000","last_change":"2024-09-21T07:38:26.861682+0000","last_active":"2024-09-21T07:38:26.867671+0000","last_peered":"2024-09-21T07:38:26.867671+0000","last_clean":"2024-09-21T07:38:26.867671+0000","last_became_active":"2024-09-21T07:38:26.861289+0000","last_became_peered":"2024-09-21T07:38:26.861289+0000","last_unstale":"2024-09-21T07:38:26.867671+0000","last_undegraded":"2024-09-21T07:38:26.867671+0000","last_fullsized":"2024-09-21T07:38:26.867671+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:45.530457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854420+0000","last_change":"2024-09-21T07:38:26.854420+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854420+0000","last_undegraded":"2024-09-21T07:38:26.854420+0000","last_fullsized":"2024-09-21T07:38:26.854420+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879903+0000","last_change":"2024-09-21T07:38:26.878489+0000","last_active":"2024-09-21T07:38:28.879903+0000","last_peered":"2024-09-21T07:38:28.879903+0000","last_clean":"2024-09-21T07:38:28.879903+0000","last_became_active":"2024-09-21T07:38:26.876983+0000","last_became_peered":"2024-09-21T07:38:26.876983+0000","last_unstale":"2024-09-21T07:38:28.879903+0000","last_undegraded":"2024-09-21T07:38:28.879903+0000","last_fullsized":"2024-09-21T07:38:28.879903+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:52.976040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850596+0000","last_change":"2024-09-21T07:38:26.850596+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850596+0000","last_undegraded":"2024-09-21T07:38:26.850596+0000","last_fullsized":"2024-09-21T07:38:26.850596+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879576+0000","last_change":"2024-09-21T07:38:26.874628+0000","last_active":"2024-09-21T07:38:28.879576+0000","last_peered":"2024-09-21T07:38:28.879576+0000","last_clean":"2024-09-21T07:38:28.879576+0000","last_became_active":"2024-09-21T07:38:26.874332+0000","last_became_peered":"2024-09-21T07:38:26.874332+0000","last_unstale":"2024-09-21T07:38:28.879576+0000","last_undegraded":"2024-09-21T07:38:28.879576+0000","last_fullsized":"2024-09-21T07:38:28.879576+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:59.212092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.851931+0000","last_change":"2024-09-21T07:38:26.851931+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.851931+0000","last_undegraded":"2024-09-21T07:38:26.851931+0000","last_fullsized":"2024-09-21T07:38:26.851931+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"228'8","reported_seq":23,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879702+0000","last_change":"2024-09-21T07:38:26.878210+0000","last_active":"2024-09-21T07:38:28.879702+0000","last_peered":"2024-09-21T07:38:28.879702+0000","last_clean":"2024-09-21T07:38:28.879702+0000","last_became_active":"2024-09-21T07:38:26.875824+0000","last_became_peered":"2024-09-21T07:38:26.875824+0000","last_unstale":"2024-09-21T07:38:28.879702+0000","last_undegraded":"2024-09-21T07:38:28.879702+0000","last_fullsized":"2024-09-21T07:38:28.879702+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:18.519770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853027+0000","last_change":"2024-09-21T07:38:26.853027+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853027+0000","last_undegraded":"2024-09-21T07:38:26.853027+0000","last_fullsized":"2024-09-21T07:38:26.853027+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881574+0000","last_change":"2024-09-21T07:38:26.873212+0000","last_active":"2024-09-21T07:38:28.881574+0000","last_peered":"2024-09-21T07:38:28.881574+0000","last_clean":"2024-09-21T07:38:28.881574+0000","last_became_active":"2024-09-21T07:38:26.872886+0000","last_became_peered":"2024-09-21T07:38:26.872886+0000","last_unstale":"2024-09-21T07:38:28.881574+0000","last_undegraded":"2024-09-21T07:38:28.881574+0000","last_fullsized":"2024-09-21T07:38:28.881574+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:26.601076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853930+0000","last_change":"2024-09-21T07:38:26.853930+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853930+0000","last_undegraded":"2024-09-21T07:38:26.853930+0000","last_fullsized":"2024-09-21T07:38:26.853930+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880815+0000","last_change":"2024-09-21T07:38:26.878845+0000","last_active":"2024-09-21T07:38:26.880815+0000","last_peered":"2024-09-21T07:38:26.880815+0000","last_clean":"2024-09-21T07:38:26.880815+0000","last_became_active":"2024-09-21T07:38:26.878455+0000","last_became_peered":"2024-09-21T07:38:26.878455+0000","last_unstale":"2024-09-21T07:38:26.880815+0000","last_undegraded":"2024-09-21T07:38:26.880815+0000","last_fullsized":"2024-09-21T07:38:26.880815+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:49.951734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880473+0000","last_change":"2024-09-21T07:38:27.905110+0000","last_active":"2024-09-21T07:38:28.880473+0000","last_peered":"2024-09-21T07:38:28.880473+0000","last_clean":"2024-09-21T07:38:28.880473+0000","last_became_active":"2024-09-21T07:38:27.904752+0000","last_became_peered":"2024-09-21T07:38:27.904752+0000","last_unstale":"2024-09-21T07:38:28.880473+0000","last_undegraded":"2024-09-21T07:38:28.880473+0000","last_fullsized":"2024-09-21T07:38:28.880473+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:04.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871766+0000","last_change":"2024-09-21T07:38:26.868486+0000","last_active":"2024-09-21T07:38:26.871766+0000","last_peered":"2024-09-21T07:38:26.871766+0000","last_clean":"2024-09-21T07:38:26.871766+0000","last_became_active":"2024-09-21T07:38:26.867803+0000","last_became_peered":"2024-09-21T07:38:26.867803+0000","last_unstale":"2024-09-21T07:38:26.871766+0000","last_undegraded":"2024-09-21T07:38:26.871766+0000","last_fullsized":"2024-09-21T07:38:26.871766+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:14.221292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853064+0000","last_change":"2024-09-21T07:38:26.853064+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853064+0000","last_undegraded":"2024-09-21T07:38:26.853064+0000","last_fullsized":"2024-09-21T07:38:26.853064+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882850+0000","last_change":"2024-09-21T07:38:26.879661+0000","last_active":"2024-09-21T07:38:26.882850+0000","last_peered":"2024-09-21T07:38:26.882850+0000","last_clean":"2024-09-21T07:38:26.882850+0000","last_became_active":"2024-09-21T07:38:26.879329+0000","last_became_peered":"2024-09-21T07:38:26.879329+0000","last_unstale":"2024-09-21T07:38:26.882850+0000","last_undegraded":"2024-09-21T07:38:26.882850+0000","last_fullsized":"2024-09-21T07:38:26.882850+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:47.557653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864172+0000","last_change":"2024-09-21T07:38:26.864172+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864172+0000","last_undegraded":"2024-09-21T07:38:26.864172+0000","last_fullsized":"2024-09-21T07:38:26.864172+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882042+0000","last_change":"2024-09-21T07:38:26.881447+0000","last_active":"2024-09-21T07:38:26.882042+0000","last_peered":"2024-09-21T07:38:26.882042+0000","last_clean":"2024-09-21T07:38:26.882042+0000","last_became_active":"2024-09-21T07:38:26.880826+0000","last_became_peered":"2024-09-21T07:38:26.880826+0000","last_unstale":"2024-09-21T07:38:26.882042+0000","last_undegraded":"2024-09-21T07:38:26.882042+0000","last_fullsized":"2024-09-21T07:38:26.882042+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.334645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853830+0000","last_change":"2024-09-21T07:38:26.853830+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853830+0000","last_undegraded":"2024-09-21T07:38:26.853830+0000","last_fullsized":"2024-09-21T07:38:26.853830+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864311+0000","last_change":"2024-09-21T07:38:26.855037+0000","last_active":"2024-09-21T07:38:26.864311+0000","last_peered":"2024-09-21T07:38:26.864311+0000","last_clean":"2024-09-21T07:38:26.864311+0000","last_became_active":"2024-09-21T07:38:26.854720+0000","last_became_peered":"2024-09-21T07:38:26.854720+0000","last_unstale":"2024-09-21T07:38:26.864311+0000","last_undegraded":"2024-09-21T07:38:26.864311+0000","last_fullsized":"2024-09-21T07:38:26.864311+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:46.787656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879939+0000","last_change":"2024-09-21T07:38:27.906211+0000","last_active":"2024-09-21T07:38:28.879939+0000","last_peered":"2024-09-21T07:38:28.879939+0000","last_clean":"2024-09-21T07:38:28.879939+0000","last_became_active":"2024-09-21T07:38:27.905909+0000","last_became_peered":"2024-09-21T07:38:27.905909+0000","last_unstale":"2024-09-21T07:38:28.879939+0000","last_undegraded":"2024-09-21T07:38:28.879939+0000","last_fullsized":"2024-09-21T07:38:28.879939+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:33.469346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872191+0000","last_change":"2024-09-21T07:38:26.870394+0000","last_active":"2024-09-21T07:38:26.872191+0000","last_peered":"2024-09-21T07:38:26.872191+0000","last_clean":"2024-09-21T07:38:26.872191+0000","last_became_active":"2024-09-21T07:38:26.869897+0000","last_became_peered":"2024-09-21T07:38:26.869897+0000","last_unstale":"2024-09-21T07:38:26.872191+0000","last_undegraded":"2024-09-21T07:38:26.872191+0000","last_fullsized":"2024-09-21T07:38:26.872191+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:16.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858677+0000","last_change":"2024-09-21T07:38:26.858677+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858677+0000","last_undegraded":"2024-09-21T07:38:26.858677+0000","last_fullsized":"2024-09-21T07:38:26.858677+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879707+0000","last_change":"2024-09-21T07:38:26.877812+0000","last_active":"2024-09-21T07:38:28.879707+0000","last_peered":"2024-09-21T07:38:28.879707+0000","last_clean":"2024-09-21T07:38:28.879707+0000","last_became_active":"2024-09-21T07:38:26.877017+0000","last_became_peered":"2024-09-21T07:38:26.877017+0000","last_unstale":"2024-09-21T07:38:28.879707+0000","last_undegraded":"2024-09-21T07:38:28.879707+0000","last_fullsized":"2024-09-21T07:38:28.879707+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:31.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881705+0000","last_change":"2024-09-21T07:38:27.896317+0000","last_active":"2024-09-21T07:38:28.881705+0000","last_peered":"2024-09-21T07:38:28.881705+0000","last_clean":"2024-09-21T07:38:28.881705+0000","last_became_active":"2024-09-21T07:38:27.895976+0000","last_became_peered":"2024-09-21T07:38:27.895976+0000","last_unstale":"2024-09-21T07:38:28.881705+0000","last_undegraded":"2024-09-21T07:38:28.881705+0000","last_fullsized":"2024-09-21T07:38:28.881705+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:35.460608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880453+0000","last_change":"2024-09-21T07:38:26.877423+0000","last_active":"2024-09-21T07:38:28.880453+0000","last_peered":"2024-09-21T07:38:28.880453+0000","last_clean":"2024-09-21T07:38:28.880453+0000","last_became_active":"2024-09-21T07:38:26.875883+0000","last_became_peered":"2024-09-21T07:38:26.875883+0000","last_unstale":"2024-09-21T07:38:28.880453+0000","last_undegraded":"2024-09-21T07:38:28.880453+0000","last_fullsized":"2024-09-21T07:38:28.880453+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:12.421136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881526+0000","last_change":"2024-09-21T07:38:27.904807+0000","last_active":"2024-09-21T07:38:28.881526+0000","last_peered":"2024-09-21T07:38:28.881526+0000","last_clean":"2024-09-21T07:38:28.881526+0000","last_became_active":"2024-09-21T07:38:27.904462+0000","last_became_peered":"2024-09-21T07:38:27.904462+0000","last_unstale":"2024-09-21T07:38:28.881526+0000","last_undegraded":"2024-09-21T07:38:28.881526+0000","last_fullsized":"2024-09-21T07:38:28.881526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:30.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880783+0000","last_change":"2024-09-21T07:38:26.876682+0000","last_active":"2024-09-21T07:38:26.880783+0000","last_peered":"2024-09-21T07:38:26.880783+0000","last_clean":"2024-09-21T07:38:26.880783+0000","last_became_active":"2024-09-21T07:38:26.874751+0000","last_became_peered":"2024-09-21T07:38:26.874751+0000","last_unstale":"2024-09-21T07:38:26.880783+0000","last_undegraded":"2024-09-21T07:38:26.880783+0000","last_fullsized":"2024-09-21T07:38:26.880783+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:47.312008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858393+0000","last_change":"2024-09-21T07:38:26.858393+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858393+0000","last_undegraded":"2024-09-21T07:38:26.858393+0000","last_fullsized":"2024-09-21T07:38:26.858393+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871738+0000","last_change":"2024-09-21T07:38:26.868126+0000","last_active":"2024-09-21T07:38:26.871738+0000","last_peered":"2024-09-21T07:38:26.871738+0000","last_clean":"2024-09-21T07:38:26.871738+0000","last_became_active":"2024-09-21T07:38:26.867386+0000","last_became_peered":"2024-09-21T07:38:26.867386+0000","last_unstale":"2024-09-21T07:38:26.871738+0000","last_undegraded":"2024-09-21T07:38:26.871738+0000","last_fullsized":"2024-09-21T07:38:26.871738+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881462+0000","last_change":"2024-09-21T07:38:27.900241+0000","last_active":"2024-09-21T07:38:28.881462+0000","last_peered":"2024-09-21T07:38:28.881462+0000","last_clean":"2024-09-21T07:38:28.881462+0000","last_became_active":"2024-09-21T07:38:27.899917+0000","last_became_peered":"2024-09-21T07:38:27.899917+0000","last_unstale":"2024-09-21T07:38:28.881462+0000","last_undegraded":"2024-09-21T07:38:28.881462+0000","last_fullsized":"2024-09-21T07:38:28.881462+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:19.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.870995+0000","last_change":"2024-09-21T07:38:26.867671+0000","last_active":"2024-09-21T07:38:26.870995+0000","last_peered":"2024-09-21T07:38:26.870995+0000","last_clean":"2024-09-21T07:38:26.870995+0000","last_became_active":"2024-09-21T07:38:26.867315+0000","last_became_peered":"2024-09-21T07:38:26.867315+0000","last_unstale":"2024-09-21T07:38:26.870995+0000","last_undegraded":"2024-09-21T07:38:26.870995+0000","last_fullsized":"2024-09-21T07:38:26.870995+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879528+0000","last_change":"2024-09-21T07:38:27.906372+0000","last_active":"2024-09-21T07:38:28.879528+0000","last_peered":"2024-09-21T07:38:28.879528+0000","last_clean":"2024-09-21T07:38:28.879528+0000","last_became_active":"2024-09-21T07:38:27.905712+0000","last_became_peered":"2024-09-21T07:38:27.905712+0000","last_unstale":"2024-09-21T07:38:28.879528+0000","last_undegraded":"2024-09-21T07:38:28.879528+0000","last_fullsized":"2024-09-21T07:38:28.879528+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:07.010954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880736+0000","last_change":"2024-09-21T07:38:26.876537+0000","last_active":"2024-09-21T07:38:26.880736+0000","last_peered":"2024-09-21T07:38:26.880736+0000","last_clean":"2024-09-21T07:38:26.880736+0000","last_became_active":"2024-09-21T07:38:26.874643+0000","last_became_peered":"2024-09-21T07:38:26.874643+0000","last_unstale":"2024-09-21T07:38:26.880736+0000","last_undegraded":"2024-09-21T07:38:26.880736+0000","last_fullsized":"2024-09-21T07:38:26.880736+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:04.010256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857653+0000","last_change":"2024-09-21T07:38:26.857653+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857653+0000","last_undegraded":"2024-09-21T07:38:26.857653+0000","last_fullsized":"2024-09-21T07:38:26.857653+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880370+0000","last_change":"2024-09-21T07:38:26.875309+0000","last_active":"2024-09-21T07:38:26.880370+0000","last_peered":"2024-09-21T07:38:26.880370+0000","last_clean":"2024-09-21T07:38:26.880370+0000","last_became_active":"2024-09-21T07:38:26.874985+0000","last_became_peered":"2024-09-21T07:38:26.874985+0000","last_unstale":"2024-09-21T07:38:26.880370+0000","last_undegraded":"2024-09-21T07:38:26.880370+0000","last_fullsized":"2024-09-21T07:38:26.880370+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:34.340576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858330+0000","last_change":"2024-09-21T07:38:26.858330+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858330+0000","last_undegraded":"2024-09-21T07:38:26.858330+0000","last_fullsized":"2024-09-21T07:38:26.858330+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872132+0000","last_change":"2024-09-21T07:38:26.871500+0000","last_active":"2024-09-21T07:38:26.872132+0000","last_peered":"2024-09-21T07:38:26.872132+0000","last_clean":"2024-09-21T07:38:26.872132+0000","last_became_active":"2024-09-21T07:38:26.871155+0000","last_became_peered":"2024-09-21T07:38:26.871155+0000","last_unstale":"2024-09-21T07:38:26.872132+0000","last_undegraded":"2024-09-21T07:38:26.872132+0000","last_fullsized":"2024-09-21T07:38:26.872132+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:10.567311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.848808+0000","last_change":"2024-09-21T07:38:26.848808+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.848808+0000","last_undegraded":"2024-09-21T07:38:26.848808+0000","last_fullsized":"2024-09-21T07:38:26.848808+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871618+0000","last_change":"2024-09-21T07:38:26.862884+0000","last_active":"2024-09-21T07:38:26.871618+0000","last_peered":"2024-09-21T07:38:26.871618+0000","last_clean":"2024-09-21T07:38:26.871618+0000","last_became_active":"2024-09-21T07:38:26.861444+0000","last_became_peered":"2024-09-21T07:38:26.861444+0000","last_unstale":"2024-09-21T07:38:26.871618+0000","last_undegraded":"2024-09-21T07:38:26.871618+0000","last_fullsized":"2024-09-21T07:38:26.871618+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:22.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879863+0000","last_change":"2024-09-21T07:38:27.909367+0000","last_active":"2024-09-21T07:38:28.879863+0000","last_peered":"2024-09-21T07:38:28.879863+0000","last_clean":"2024-09-21T07:38:28.879863+0000","last_became_active":"2024-09-21T07:38:27.907346+0000","last_became_peered":"2024-09-21T07:38:27.907346+0000","last_unstale":"2024-09-21T07:38:28.879863+0000","last_undegraded":"2024-09-21T07:38:28.879863+0000","last_fullsized":"2024-09-21T07:38:28.879863+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:41.726703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":490,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880588+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:38:28.880588+0000","last_peered":"2024-09-21T07:38:28.880588+0000","last_clean":"2024-09-21T07:38:28.880588+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:38:28.880588+0000","last_undegraded":"2024-09-21T07:38:28.880588+0000","last_fullsized":"2024-09-21T07:38:28.880588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56184,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315656,"statfs":{"total":96636764160,"available":96579231744,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47864,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323976,"statfs":{"total":96636764160,"available":96587751424,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60364,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311476,"statfs":{"total":96636764160,"available":96574951424,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47876,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323964,"statfs":{"total":96636764160,"available":96587739136,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56780,"kb_used_data":3380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315060,"statfs":{"total":96636764160,"available":96578621440,"internally_reserved":0,"allocated":3461120,"data_stored":1946414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56808,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315032,"statfs":{"total":96636764160,"available":96578592768,"internally_reserved":0,"allocated":3493888,"data_stored":1960877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88096,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283744,"statfs":{"total":96636764160,"available":96546553856,"internally_reserved":0,"allocated":2895872,"data_stored":1369995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:32.511 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:32.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- 172.21.15.64:0/3983691288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40b3170 msgr2=0x7f5fc40b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 --2- 172.21.15.64:0/3983691288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40b3170 0x7f5fc40b3580 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40ccc80 tx=0x7f5fac01c8c0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- 172.21.15.64:0/3983691288 shutdown_connections 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 --2- 172.21.15.64:0/3983691288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40ccd30 0x7f5fc40cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 --2- 172.21.15.64:0/3983691288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40b3170 0x7f5fc40b3580 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 --2- 172.21.15.64:0/3983691288 >> v2:172.21.15.90:3300/0 conn(0x7f5fc40b28e0 0x7f5fc415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- 172.21.15.64:0/3983691288 >> 172.21.15.64:0/3983691288 conn(0x7f5fc406d570 msgr2=0x7f5fc40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- 172.21.15.64:0/3983691288 shutdown_connections 2024-09-21T07:38:32.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- 172.21.15.64:0/3983691288 wait complete. 2024-09-21T07:38:32.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 Processor -- start 2024-09-21T07:38:32.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.710+0000 7f5fc9200640 1 -- start start 2024-09-21T07:38:32.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 0x7f5fc41f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40b3170 0x7f5fc41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 0x7f5fc40c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4168cf0 con 0x7f5fc40ccd30 2024-09-21T07:38:32.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4168b70 con 0x7f5fc40b28e0 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc4168e70 con 0x7f5fc40b3170 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 0x7f5fc41f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 0x7f5fc40c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 0x7f5fc41f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:37158/0 (socket says 172.21.15.64:37158) 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc1e00640 1 -- 172.21.15.64:0/1992802423 learned_addr learned my addr 172.21.15.64:0/1992802423 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:32.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fbbe00640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40b3170 0x7f5fc41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 -- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40b3170 msgr2=0x7f5fc41582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40b3170 0x7f5fc41582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 -- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 msgr2=0x7f5fc41f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 0x7f5fc41f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 -- 172.21.15.64:0/1992802423 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc41f8030 con 0x7f5fc40ccd30 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc2800640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 0x7f5fc40c42a0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00e990 tx=0x7f5fbc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc004d30 con 0x7f5fc40ccd30 2024-09-21T07:38:32.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fbc00caa0 con 0x7f5fc40ccd30 2024-09-21T07:38:32.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc005020 con 0x7f5fc40ccd30 2024-09-21T07:38:32.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41f4f90 con 0x7f5fc40ccd30 2024-09-21T07:38:32.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41f5550 con 0x7f5fc40ccd30 2024-09-21T07:38:32.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.714+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40b4ea0 con 0x7f5fc40ccd30 2024-09-21T07:38:32.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.718+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5fbc0051c0 con 0x7f5fc40ccd30 2024-09-21T07:38:32.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.718+0000 7f5fba000640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 0x7f5fa0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:32.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.718+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7f5fbc094b50 con 0x7f5fc40ccd30 2024-09-21T07:38:32.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.718+0000 7f5fc1e00640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 0x7f5fa0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:32.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.718+0000 7f5fc1e00640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 0x7f5fa0075740 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005fd0 tx=0x7f5fb400a2d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:32.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.722+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f5fc40b4ea0 con 0x7f5fc40ccd30 2024-09-21T07:38:32.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.894+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fc40b3580 con 0x7f5fa0073230 2024-09-21T07:38:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fba000640 1 -- 172.21.15.64:0/1992802423 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248632 (secure 0 0 0) 0x7f5fc40b3580 con 0x7f5fa0073230 2024-09-21T07:38:32.903 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:32.904 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:32.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 msgr2=0x7f5fa0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 0x7f5fa0075740 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005fd0 tx=0x7f5fb400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 msgr2=0x7f5fc40c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:32.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 0x7f5fc40c42a0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00e990 tx=0x7f5fbc00ee50 comp rx=0 tx=0).stop 2024-09-21T07:38:32.905 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 shutdown_connections 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5fa0073230 0x7f5fa0075740 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.902+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fc40ccd30 0x7f5fc40c42a0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.906+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5fc40b3170 0x7f5fc41582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.906+0000 7f5fc9200640 1 --2- 172.21.15.64:0/1992802423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc40b28e0 0x7f5fc41f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.906+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 >> 172.21.15.64:0/1992802423 conn(0x7f5fc406d570 msgr2=0x7f5fc40b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.906+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 shutdown_connections 2024-09-21T07:38:32.906 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:32.906+0000 7f5fc9200640 1 -- 172.21.15.64:0/1992802423 wait complete. 2024-09-21T07:38:32.925 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-09-21T07:38:31.683267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":121,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":470172,"kb_used_data":23596,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754504548,"statfs":{"total":773094113280,"available":772612657152,"internally_reserved":0,"allocated":24162304,"data_stored":12044182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.838108"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857711+0000","last_change":"2024-09-21T07:38:26.857711+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857711+0000","last_undegraded":"2024-09-21T07:38:26.857711+0000","last_fullsized":"2024-09-21T07:38:26.857711+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859628+0000","last_change":"2024-09-21T07:38:26.859628+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859628+0000","last_undegraded":"2024-09-21T07:38:26.859628+0000","last_fullsized":"2024-09-21T07:38:26.859628+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857134+0000","last_change":"2024-09-21T07:38:26.857134+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857134+0000","last_undegraded":"2024-09-21T07:38:26.857134+0000","last_fullsized":"2024-09-21T07:38:26.857134+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880663+0000","last_change":"2024-09-21T07:38:27.902273+0000","last_active":"2024-09-21T07:38:28.880663+0000","last_peered":"2024-09-21T07:38:28.880663+0000","last_clean":"2024-09-21T07:38:28.880663+0000","last_became_active":"2024-09-21T07:38:27.901903+0000","last_became_peered":"2024-09-21T07:38:27.901903+0000","last_unstale":"2024-09-21T07:38:28.880663+0000","last_undegraded":"2024-09-21T07:38:28.880663+0000","last_fullsized":"2024-09-21T07:38:28.880663+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:58.406221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853011+0000","last_change":"2024-09-21T07:38:26.853011+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853011+0000","last_undegraded":"2024-09-21T07:38:26.853011+0000","last_fullsized":"2024-09-21T07:38:26.853011+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880971+0000","last_change":"2024-09-21T07:38:27.890574+0000","last_active":"2024-09-21T07:38:28.880971+0000","last_peered":"2024-09-21T07:38:28.880971+0000","last_clean":"2024-09-21T07:38:28.880971+0000","last_became_active":"2024-09-21T07:38:27.887320+0000","last_became_peered":"2024-09-21T07:38:27.887320+0000","last_unstale":"2024-09-21T07:38:28.880971+0000","last_undegraded":"2024-09-21T07:38:28.880971+0000","last_fullsized":"2024-09-21T07:38:28.880971+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:40.556500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.856159+0000","last_change":"2024-09-21T07:38:26.856159+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.856159+0000","last_undegraded":"2024-09-21T07:38:26.856159+0000","last_fullsized":"2024-09-21T07:38:26.856159+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879529+0000","last_change":"2024-09-21T07:38:27.907654+0000","last_active":"2024-09-21T07:38:28.879529+0000","last_peered":"2024-09-21T07:38:28.879529+0000","last_clean":"2024-09-21T07:38:28.879529+0000","last_became_active":"2024-09-21T07:38:27.906066+0000","last_became_peered":"2024-09-21T07:38:27.906066+0000","last_unstale":"2024-09-21T07:38:28.879529+0000","last_undegraded":"2024-09-21T07:38:28.879529+0000","last_fullsized":"2024-09-21T07:38:28.879529+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:24.486499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881469+0000","last_change":"2024-09-21T07:38:27.897228+0000","last_active":"2024-09-21T07:38:28.881469+0000","last_peered":"2024-09-21T07:38:28.881469+0000","last_clean":"2024-09-21T07:38:28.881469+0000","last_became_active":"2024-09-21T07:38:27.896883+0000","last_became_peered":"2024-09-21T07:38:27.896883+0000","last_unstale":"2024-09-21T07:38:28.881469+0000","last_undegraded":"2024-09-21T07:38:28.881469+0000","last_fullsized":"2024-09-21T07:38:28.881469+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:51.166601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849670+0000","last_change":"2024-09-21T07:38:26.849670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849670+0000","last_undegraded":"2024-09-21T07:38:26.849670+0000","last_fullsized":"2024-09-21T07:38:26.849670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858207+0000","last_change":"2024-09-21T07:38:26.858207+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858207+0000","last_undegraded":"2024-09-21T07:38:26.858207+0000","last_fullsized":"2024-09-21T07:38:26.858207+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881624+0000","last_change":"2024-09-21T07:38:27.895619+0000","last_active":"2024-09-21T07:38:28.881624+0000","last_peered":"2024-09-21T07:38:28.881624+0000","last_clean":"2024-09-21T07:38:28.881624+0000","last_became_active":"2024-09-21T07:38:27.895269+0000","last_became_peered":"2024-09-21T07:38:27.895269+0000","last_unstale":"2024-09-21T07:38:28.881624+0000","last_undegraded":"2024-09-21T07:38:28.881624+0000","last_fullsized":"2024-09-21T07:38:28.881624+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:48.794383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879845+0000","last_change":"2024-09-21T07:38:27.908331+0000","last_active":"2024-09-21T07:38:28.879845+0000","last_peered":"2024-09-21T07:38:28.879845+0000","last_clean":"2024-09-21T07:38:28.879845+0000","last_became_active":"2024-09-21T07:38:27.906446+0000","last_became_peered":"2024-09-21T07:38:27.906446+0000","last_unstale":"2024-09-21T07:38:28.879845+0000","last_undegraded":"2024-09-21T07:38:28.879845+0000","last_fullsized":"2024-09-21T07:38:28.879845+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:24.108120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.859755+0000","last_change":"2024-09-21T07:38:26.859755+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.859755+0000","last_undegraded":"2024-09-21T07:38:26.859755+0000","last_fullsized":"2024-09-21T07:38:26.859755+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.866161+0000","last_change":"2024-09-21T07:38:26.866161+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.866161+0000","last_undegraded":"2024-09-21T07:38:26.866161+0000","last_fullsized":"2024-09-21T07:38:26.866161+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849053+0000","last_change":"2024-09-21T07:38:26.849053+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849053+0000","last_undegraded":"2024-09-21T07:38:26.849053+0000","last_fullsized":"2024-09-21T07:38:26.849053+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849929+0000","last_change":"2024-09-21T07:38:26.849929+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849929+0000","last_undegraded":"2024-09-21T07:38:26.849929+0000","last_fullsized":"2024-09-21T07:38:26.849929+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858040+0000","last_change":"2024-09-21T07:38:26.858040+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858040+0000","last_undegraded":"2024-09-21T07:38:26.858040+0000","last_fullsized":"2024-09-21T07:38:26.858040+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849583+0000","last_change":"2024-09-21T07:38:26.849583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849583+0000","last_undegraded":"2024-09-21T07:38:26.849583+0000","last_fullsized":"2024-09-21T07:38:26.849583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881493+0000","last_change":"2024-09-21T07:38:27.896082+0000","last_active":"2024-09-21T07:38:28.881493+0000","last_peered":"2024-09-21T07:38:28.881493+0000","last_clean":"2024-09-21T07:38:28.881493+0000","last_became_active":"2024-09-21T07:38:27.895767+0000","last_became_peered":"2024-09-21T07:38:27.895767+0000","last_unstale":"2024-09-21T07:38:28.881493+0000","last_undegraded":"2024-09-21T07:38:28.881493+0000","last_fullsized":"2024-09-21T07:38:28.881493+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:04.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852499+0000","last_change":"2024-09-21T07:38:26.852499+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852499+0000","last_undegraded":"2024-09-21T07:38:26.852499+0000","last_fullsized":"2024-09-21T07:38:26.852499+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852856+0000","last_change":"2024-09-21T07:38:26.852856+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852856+0000","last_undegraded":"2024-09-21T07:38:26.852856+0000","last_fullsized":"2024-09-21T07:38:26.852856+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.862531+0000","last_change":"2024-09-21T07:38:26.862531+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.862531+0000","last_undegraded":"2024-09-21T07:38:26.862531+0000","last_fullsized":"2024-09-21T07:38:26.862531+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.852913+0000","last_change":"2024-09-21T07:38:26.852913+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.852913+0000","last_undegraded":"2024-09-21T07:38:26.852913+0000","last_fullsized":"2024-09-21T07:38:26.852913+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858632+0000","last_change":"2024-09-21T07:38:26.858632+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858632+0000","last_undegraded":"2024-09-21T07:38:26.858632+0000","last_fullsized":"2024-09-21T07:38:26.858632+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858231+0000","last_change":"2024-09-21T07:38:26.858231+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858231+0000","last_undegraded":"2024-09-21T07:38:26.858231+0000","last_fullsized":"2024-09-21T07:38:26.858231+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857655+0000","last_change":"2024-09-21T07:38:26.857655+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857655+0000","last_undegraded":"2024-09-21T07:38:26.857655+0000","last_fullsized":"2024-09-21T07:38:26.857655+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855526+0000","last_change":"2024-09-21T07:38:26.855526+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855526+0000","last_undegraded":"2024-09-21T07:38:26.855526+0000","last_fullsized":"2024-09-21T07:38:26.855526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881690+0000","last_change":"2024-09-21T07:38:27.899491+0000","last_active":"2024-09-21T07:38:28.881690+0000","last_peered":"2024-09-21T07:38:28.881690+0000","last_clean":"2024-09-21T07:38:28.881690+0000","last_became_active":"2024-09-21T07:38:27.898923+0000","last_became_peered":"2024-09-21T07:38:27.898923+0000","last_unstale":"2024-09-21T07:38:28.881690+0000","last_undegraded":"2024-09-21T07:38:28.881690+0000","last_fullsized":"2024-09-21T07:38:28.881690+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:25.337677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858670+0000","last_change":"2024-09-21T07:38:26.858670+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858670+0000","last_undegraded":"2024-09-21T07:38:26.858670+0000","last_fullsized":"2024-09-21T07:38:26.858670+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.865286+0000","last_change":"2024-09-21T07:38:26.865286+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.865286+0000","last_undegraded":"2024-09-21T07:38:26.865286+0000","last_fullsized":"2024-09-21T07:38:26.865286+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.849079+0000","last_change":"2024-09-21T07:38:26.849079+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.849079+0000","last_undegraded":"2024-09-21T07:38:26.849079+0000","last_fullsized":"2024-09-21T07:38:26.849079+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880901+0000","last_change":"2024-09-21T07:38:26.876175+0000","last_active":"2024-09-21T07:38:26.880901+0000","last_peered":"2024-09-21T07:38:26.880901+0000","last_clean":"2024-09-21T07:38:26.880901+0000","last_became_active":"2024-09-21T07:38:26.875734+0000","last_became_peered":"2024-09-21T07:38:26.875734+0000","last_unstale":"2024-09-21T07:38:26.880901+0000","last_undegraded":"2024-09-21T07:38:26.880901+0000","last_fullsized":"2024-09-21T07:38:26.880901+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:16.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855959+0000","last_change":"2024-09-21T07:38:26.855959+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855959+0000","last_undegraded":"2024-09-21T07:38:26.855959+0000","last_fullsized":"2024-09-21T07:38:26.855959+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866550+0000","last_change":"2024-09-21T07:38:26.863994+0000","last_active":"2024-09-21T07:38:26.866550+0000","last_peered":"2024-09-21T07:38:26.866550+0000","last_clean":"2024-09-21T07:38:26.866550+0000","last_became_active":"2024-09-21T07:38:26.863529+0000","last_became_peered":"2024-09-21T07:38:26.863529+0000","last_unstale":"2024-09-21T07:38:26.866550+0000","last_undegraded":"2024-09-21T07:38:26.866550+0000","last_fullsized":"2024-09-21T07:38:26.866550+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857583+0000","last_change":"2024-09-21T07:38:26.857583+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857583+0000","last_undegraded":"2024-09-21T07:38:26.857583+0000","last_fullsized":"2024-09-21T07:38:26.857583+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.869635+0000","last_change":"2024-09-21T07:38:26.866652+0000","last_active":"2024-09-21T07:38:26.869635+0000","last_peered":"2024-09-21T07:38:26.869635+0000","last_clean":"2024-09-21T07:38:26.869635+0000","last_became_active":"2024-09-21T07:38:26.866286+0000","last_became_peered":"2024-09-21T07:38:26.866286+0000","last_unstale":"2024-09-21T07:38:26.869635+0000","last_undegraded":"2024-09-21T07:38:26.869635+0000","last_fullsized":"2024-09-21T07:38:26.869635+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:47.671946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857091+0000","last_change":"2024-09-21T07:38:26.857091+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857091+0000","last_undegraded":"2024-09-21T07:38:26.857091+0000","last_fullsized":"2024-09-21T07:38:26.857091+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865580+0000","last_change":"2024-09-21T07:38:26.861984+0000","last_active":"2024-09-21T07:38:26.865580+0000","last_peered":"2024-09-21T07:38:26.865580+0000","last_clean":"2024-09-21T07:38:26.865580+0000","last_became_active":"2024-09-21T07:38:26.861625+0000","last_became_peered":"2024-09-21T07:38:26.861625+0000","last_unstale":"2024-09-21T07:38:26.865580+0000","last_undegraded":"2024-09-21T07:38:26.865580+0000","last_fullsized":"2024-09-21T07:38:26.865580+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:08.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864715+0000","last_change":"2024-09-21T07:38:26.864715+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864715+0000","last_undegraded":"2024-09-21T07:38:26.864715+0000","last_fullsized":"2024-09-21T07:38:26.864715+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867748+0000","last_change":"2024-09-21T07:38:26.863298+0000","last_active":"2024-09-21T07:38:26.867748+0000","last_peered":"2024-09-21T07:38:26.867748+0000","last_clean":"2024-09-21T07:38:26.867748+0000","last_became_active":"2024-09-21T07:38:26.862983+0000","last_became_peered":"2024-09-21T07:38:26.862983+0000","last_unstale":"2024-09-21T07:38:26.867748+0000","last_undegraded":"2024-09-21T07:38:26.867748+0000","last_fullsized":"2024-09-21T07:38:26.867748+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:08.126208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858155+0000","last_change":"2024-09-21T07:38:26.858155+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858155+0000","last_undegraded":"2024-09-21T07:38:26.858155+0000","last_fullsized":"2024-09-21T07:38:26.858155+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.879179+0000","last_change":"2024-09-21T07:38:26.874143+0000","last_active":"2024-09-21T07:38:26.879179+0000","last_peered":"2024-09-21T07:38:26.879179+0000","last_clean":"2024-09-21T07:38:26.879179+0000","last_became_active":"2024-09-21T07:38:26.873839+0000","last_became_peered":"2024-09-21T07:38:26.873839+0000","last_unstale":"2024-09-21T07:38:26.879179+0000","last_undegraded":"2024-09-21T07:38:26.879179+0000","last_fullsized":"2024-09-21T07:38:26.879179+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.415543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858915+0000","last_change":"2024-09-21T07:38:26.858915+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858915+0000","last_undegraded":"2024-09-21T07:38:26.858915+0000","last_fullsized":"2024-09-21T07:38:26.858915+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.865553+0000","last_change":"2024-09-21T07:38:26.861747+0000","last_active":"2024-09-21T07:38:26.865553+0000","last_peered":"2024-09-21T07:38:26.865553+0000","last_clean":"2024-09-21T07:38:26.865553+0000","last_became_active":"2024-09-21T07:38:26.861414+0000","last_became_peered":"2024-09-21T07:38:26.861414+0000","last_unstale":"2024-09-21T07:38:26.865553+0000","last_undegraded":"2024-09-21T07:38:26.865553+0000","last_fullsized":"2024-09-21T07:38:26.865553+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:27.620630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880150+0000","last_change":"2024-09-21T07:38:27.908116+0000","last_active":"2024-09-21T07:38:28.880150+0000","last_peered":"2024-09-21T07:38:28.880150+0000","last_clean":"2024-09-21T07:38:28.880150+0000","last_became_active":"2024-09-21T07:38:27.906137+0000","last_became_peered":"2024-09-21T07:38:27.906137+0000","last_unstale":"2024-09-21T07:38:28.880150+0000","last_undegraded":"2024-09-21T07:38:28.880150+0000","last_fullsized":"2024-09-21T07:38:28.880150+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:28.691558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864102+0000","last_change":"2024-09-21T07:38:26.857528+0000","last_active":"2024-09-21T07:38:26.864102+0000","last_peered":"2024-09-21T07:38:26.864102+0000","last_clean":"2024-09-21T07:38:26.864102+0000","last_became_active":"2024-09-21T07:38:26.857087+0000","last_became_peered":"2024-09-21T07:38:26.857087+0000","last_unstale":"2024-09-21T07:38:26.864102+0000","last_undegraded":"2024-09-21T07:38:26.864102+0000","last_fullsized":"2024-09-21T07:38:26.864102+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:43.048249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880475+0000","last_change":"2024-09-21T07:38:27.900713+0000","last_active":"2024-09-21T07:38:28.880475+0000","last_peered":"2024-09-21T07:38:28.880475+0000","last_clean":"2024-09-21T07:38:28.880475+0000","last_became_active":"2024-09-21T07:38:27.900385+0000","last_became_peered":"2024-09-21T07:38:27.900385+0000","last_unstale":"2024-09-21T07:38:28.880475+0000","last_undegraded":"2024-09-21T07:38:28.880475+0000","last_fullsized":"2024-09-21T07:38:28.880475+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:55.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880521+0000","last_change":"2024-09-21T07:38:26.874002+0000","last_active":"2024-09-21T07:38:28.880521+0000","last_peered":"2024-09-21T07:38:28.880521+0000","last_clean":"2024-09-21T07:38:28.880521+0000","last_became_active":"2024-09-21T07:38:26.873678+0000","last_became_peered":"2024-09-21T07:38:26.873678+0000","last_unstale":"2024-09-21T07:38:28.880521+0000","last_undegraded":"2024-09-21T07:38:28.880521+0000","last_fullsized":"2024-09-21T07:38:28.880521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:35.150025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.855334+0000","last_change":"2024-09-21T07:38:26.855334+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.855334+0000","last_undegraded":"2024-09-21T07:38:26.855334+0000","last_fullsized":"2024-09-21T07:38:26.855334+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.866521+0000","last_change":"2024-09-21T07:38:26.863704+0000","last_active":"2024-09-21T07:38:26.866521+0000","last_peered":"2024-09-21T07:38:26.866521+0000","last_clean":"2024-09-21T07:38:26.866521+0000","last_became_active":"2024-09-21T07:38:26.863365+0000","last_became_peered":"2024-09-21T07:38:26.863365+0000","last_unstale":"2024-09-21T07:38:26.866521+0000","last_undegraded":"2024-09-21T07:38:26.866521+0000","last_fullsized":"2024-09-21T07:38:26.866521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881302+0000","last_change":"2024-09-21T07:38:27.903378+0000","last_active":"2024-09-21T07:38:28.881302+0000","last_peered":"2024-09-21T07:38:28.881302+0000","last_clean":"2024-09-21T07:38:28.881302+0000","last_became_active":"2024-09-21T07:38:27.903151+0000","last_became_peered":"2024-09-21T07:38:27.903151+0000","last_unstale":"2024-09-21T07:38:28.881302+0000","last_undegraded":"2024-09-21T07:38:28.881302+0000","last_fullsized":"2024-09-21T07:38:28.881302+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:13.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"228'3","reported_seq":18,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880327+0000","last_change":"2024-09-21T07:38:26.873389+0000","last_active":"2024-09-21T07:38:28.880327+0000","last_peered":"2024-09-21T07:38:28.880327+0000","last_clean":"2024-09-21T07:38:28.880327+0000","last_became_active":"2024-09-21T07:38:26.872013+0000","last_became_peered":"2024-09-21T07:38:26.872013+0000","last_unstale":"2024-09-21T07:38:28.880327+0000","last_undegraded":"2024-09-21T07:38:28.880327+0000","last_fullsized":"2024-09-21T07:38:28.880327+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854167+0000","last_change":"2024-09-21T07:38:26.854167+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854167+0000","last_undegraded":"2024-09-21T07:38:26.854167+0000","last_fullsized":"2024-09-21T07:38:26.854167+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880860+0000","last_change":"2024-09-21T07:38:26.878447+0000","last_active":"2024-09-21T07:38:26.880860+0000","last_peered":"2024-09-21T07:38:26.880860+0000","last_clean":"2024-09-21T07:38:26.880860+0000","last_became_active":"2024-09-21T07:38:26.873257+0000","last_became_peered":"2024-09-21T07:38:26.873257+0000","last_unstale":"2024-09-21T07:38:26.880860+0000","last_undegraded":"2024-09-21T07:38:26.880860+0000","last_fullsized":"2024-09-21T07:38:26.880860+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.766779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850719+0000","last_change":"2024-09-21T07:38:26.850719+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850719+0000","last_undegraded":"2024-09-21T07:38:26.850719+0000","last_fullsized":"2024-09-21T07:38:26.850719+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.867671+0000","last_change":"2024-09-21T07:38:26.861682+0000","last_active":"2024-09-21T07:38:26.867671+0000","last_peered":"2024-09-21T07:38:26.867671+0000","last_clean":"2024-09-21T07:38:26.867671+0000","last_became_active":"2024-09-21T07:38:26.861289+0000","last_became_peered":"2024-09-21T07:38:26.861289+0000","last_unstale":"2024-09-21T07:38:26.867671+0000","last_undegraded":"2024-09-21T07:38:26.867671+0000","last_fullsized":"2024-09-21T07:38:26.867671+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:45.530457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.854420+0000","last_change":"2024-09-21T07:38:26.854420+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.854420+0000","last_undegraded":"2024-09-21T07:38:26.854420+0000","last_fullsized":"2024-09-21T07:38:26.854420+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879903+0000","last_change":"2024-09-21T07:38:26.878489+0000","last_active":"2024-09-21T07:38:28.879903+0000","last_peered":"2024-09-21T07:38:28.879903+0000","last_clean":"2024-09-21T07:38:28.879903+0000","last_became_active":"2024-09-21T07:38:26.876983+0000","last_became_peered":"2024-09-21T07:38:26.876983+0000","last_unstale":"2024-09-21T07:38:28.879903+0000","last_undegraded":"2024-09-21T07:38:28.879903+0000","last_fullsized":"2024-09-21T07:38:28.879903+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:52.976040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.850596+0000","last_change":"2024-09-21T07:38:26.850596+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.850596+0000","last_undegraded":"2024-09-21T07:38:26.850596+0000","last_fullsized":"2024-09-21T07:38:26.850596+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879576+0000","last_change":"2024-09-21T07:38:26.874628+0000","last_active":"2024-09-21T07:38:28.879576+0000","last_peered":"2024-09-21T07:38:28.879576+0000","last_clean":"2024-09-21T07:38:28.879576+0000","last_became_active":"2024-09-21T07:38:26.874332+0000","last_became_peered":"2024-09-21T07:38:26.874332+0000","last_unstale":"2024-09-21T07:38:28.879576+0000","last_undegraded":"2024-09-21T07:38:28.879576+0000","last_fullsized":"2024-09-21T07:38:28.879576+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:59.212092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.851931+0000","last_change":"2024-09-21T07:38:26.851931+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.851931+0000","last_undegraded":"2024-09-21T07:38:26.851931+0000","last_fullsized":"2024-09-21T07:38:26.851931+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"228'8","reported_seq":23,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879702+0000","last_change":"2024-09-21T07:38:26.878210+0000","last_active":"2024-09-21T07:38:28.879702+0000","last_peered":"2024-09-21T07:38:28.879702+0000","last_clean":"2024-09-21T07:38:28.879702+0000","last_became_active":"2024-09-21T07:38:26.875824+0000","last_became_peered":"2024-09-21T07:38:26.875824+0000","last_unstale":"2024-09-21T07:38:28.879702+0000","last_undegraded":"2024-09-21T07:38:28.879702+0000","last_fullsized":"2024-09-21T07:38:28.879702+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:18.519770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853027+0000","last_change":"2024-09-21T07:38:26.853027+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853027+0000","last_undegraded":"2024-09-21T07:38:26.853027+0000","last_fullsized":"2024-09-21T07:38:26.853027+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881574+0000","last_change":"2024-09-21T07:38:26.873212+0000","last_active":"2024-09-21T07:38:28.881574+0000","last_peered":"2024-09-21T07:38:28.881574+0000","last_clean":"2024-09-21T07:38:28.881574+0000","last_became_active":"2024-09-21T07:38:26.872886+0000","last_became_peered":"2024-09-21T07:38:26.872886+0000","last_unstale":"2024-09-21T07:38:28.881574+0000","last_undegraded":"2024-09-21T07:38:28.881574+0000","last_fullsized":"2024-09-21T07:38:28.881574+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:26.601076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853930+0000","last_change":"2024-09-21T07:38:26.853930+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853930+0000","last_undegraded":"2024-09-21T07:38:26.853930+0000","last_fullsized":"2024-09-21T07:38:26.853930+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880815+0000","last_change":"2024-09-21T07:38:26.878845+0000","last_active":"2024-09-21T07:38:26.880815+0000","last_peered":"2024-09-21T07:38:26.880815+0000","last_clean":"2024-09-21T07:38:26.880815+0000","last_became_active":"2024-09-21T07:38:26.878455+0000","last_became_peered":"2024-09-21T07:38:26.878455+0000","last_unstale":"2024-09-21T07:38:26.880815+0000","last_undegraded":"2024-09-21T07:38:26.880815+0000","last_fullsized":"2024-09-21T07:38:26.880815+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:49.951734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880473+0000","last_change":"2024-09-21T07:38:27.905110+0000","last_active":"2024-09-21T07:38:28.880473+0000","last_peered":"2024-09-21T07:38:28.880473+0000","last_clean":"2024-09-21T07:38:28.880473+0000","last_became_active":"2024-09-21T07:38:27.904752+0000","last_became_peered":"2024-09-21T07:38:27.904752+0000","last_unstale":"2024-09-21T07:38:28.880473+0000","last_undegraded":"2024-09-21T07:38:28.880473+0000","last_fullsized":"2024-09-21T07:38:28.880473+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:04.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871766+0000","last_change":"2024-09-21T07:38:26.868486+0000","last_active":"2024-09-21T07:38:26.871766+0000","last_peered":"2024-09-21T07:38:26.871766+0000","last_clean":"2024-09-21T07:38:26.871766+0000","last_became_active":"2024-09-21T07:38:26.867803+0000","last_became_peered":"2024-09-21T07:38:26.867803+0000","last_unstale":"2024-09-21T07:38:26.871766+0000","last_undegraded":"2024-09-21T07:38:26.871766+0000","last_fullsized":"2024-09-21T07:38:26.871766+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:14.221292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853064+0000","last_change":"2024-09-21T07:38:26.853064+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853064+0000","last_undegraded":"2024-09-21T07:38:26.853064+0000","last_fullsized":"2024-09-21T07:38:26.853064+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882850+0000","last_change":"2024-09-21T07:38:26.879661+0000","last_active":"2024-09-21T07:38:26.882850+0000","last_peered":"2024-09-21T07:38:26.882850+0000","last_clean":"2024-09-21T07:38:26.882850+0000","last_became_active":"2024-09-21T07:38:26.879329+0000","last_became_peered":"2024-09-21T07:38:26.879329+0000","last_unstale":"2024-09-21T07:38:26.882850+0000","last_undegraded":"2024-09-21T07:38:26.882850+0000","last_fullsized":"2024-09-21T07:38:26.882850+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:47.557653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.864172+0000","last_change":"2024-09-21T07:38:26.864172+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.864172+0000","last_undegraded":"2024-09-21T07:38:26.864172+0000","last_fullsized":"2024-09-21T07:38:26.864172+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.882042+0000","last_change":"2024-09-21T07:38:26.881447+0000","last_active":"2024-09-21T07:38:26.882042+0000","last_peered":"2024-09-21T07:38:26.882042+0000","last_clean":"2024-09-21T07:38:26.882042+0000","last_became_active":"2024-09-21T07:38:26.880826+0000","last_became_peered":"2024-09-21T07:38:26.880826+0000","last_unstale":"2024-09-21T07:38:26.882042+0000","last_undegraded":"2024-09-21T07:38:26.882042+0000","last_fullsized":"2024-09-21T07:38:26.882042+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.334645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.853830+0000","last_change":"2024-09-21T07:38:26.853830+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.853830+0000","last_undegraded":"2024-09-21T07:38:26.853830+0000","last_fullsized":"2024-09-21T07:38:26.853830+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.864311+0000","last_change":"2024-09-21T07:38:26.855037+0000","last_active":"2024-09-21T07:38:26.864311+0000","last_peered":"2024-09-21T07:38:26.864311+0000","last_clean":"2024-09-21T07:38:26.864311+0000","last_became_active":"2024-09-21T07:38:26.854720+0000","last_became_peered":"2024-09-21T07:38:26.854720+0000","last_unstale":"2024-09-21T07:38:26.864311+0000","last_undegraded":"2024-09-21T07:38:26.864311+0000","last_fullsized":"2024-09-21T07:38:26.864311+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:46.787656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879939+0000","last_change":"2024-09-21T07:38:27.906211+0000","last_active":"2024-09-21T07:38:28.879939+0000","last_peered":"2024-09-21T07:38:28.879939+0000","last_clean":"2024-09-21T07:38:28.879939+0000","last_became_active":"2024-09-21T07:38:27.905909+0000","last_became_peered":"2024-09-21T07:38:27.905909+0000","last_unstale":"2024-09-21T07:38:28.879939+0000","last_undegraded":"2024-09-21T07:38:28.879939+0000","last_fullsized":"2024-09-21T07:38:28.879939+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:33.469346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872191+0000","last_change":"2024-09-21T07:38:26.870394+0000","last_active":"2024-09-21T07:38:26.872191+0000","last_peered":"2024-09-21T07:38:26.872191+0000","last_clean":"2024-09-21T07:38:26.872191+0000","last_became_active":"2024-09-21T07:38:26.869897+0000","last_became_peered":"2024-09-21T07:38:26.869897+0000","last_unstale":"2024-09-21T07:38:26.872191+0000","last_undegraded":"2024-09-21T07:38:26.872191+0000","last_fullsized":"2024-09-21T07:38:26.872191+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:16.404903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858677+0000","last_change":"2024-09-21T07:38:26.858677+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858677+0000","last_undegraded":"2024-09-21T07:38:26.858677+0000","last_fullsized":"2024-09-21T07:38:26.858677+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879707+0000","last_change":"2024-09-21T07:38:26.877812+0000","last_active":"2024-09-21T07:38:28.879707+0000","last_peered":"2024-09-21T07:38:28.879707+0000","last_clean":"2024-09-21T07:38:28.879707+0000","last_became_active":"2024-09-21T07:38:26.877017+0000","last_became_peered":"2024-09-21T07:38:26.877017+0000","last_unstale":"2024-09-21T07:38:28.879707+0000","last_undegraded":"2024-09-21T07:38:28.879707+0000","last_fullsized":"2024-09-21T07:38:28.879707+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:31.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881705+0000","last_change":"2024-09-21T07:38:27.896317+0000","last_active":"2024-09-21T07:38:28.881705+0000","last_peered":"2024-09-21T07:38:28.881705+0000","last_clean":"2024-09-21T07:38:28.881705+0000","last_became_active":"2024-09-21T07:38:27.895976+0000","last_became_peered":"2024-09-21T07:38:27.895976+0000","last_unstale":"2024-09-21T07:38:28.881705+0000","last_undegraded":"2024-09-21T07:38:28.881705+0000","last_fullsized":"2024-09-21T07:38:28.881705+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:35.460608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880453+0000","last_change":"2024-09-21T07:38:26.877423+0000","last_active":"2024-09-21T07:38:28.880453+0000","last_peered":"2024-09-21T07:38:28.880453+0000","last_clean":"2024-09-21T07:38:28.880453+0000","last_became_active":"2024-09-21T07:38:26.875883+0000","last_became_peered":"2024-09-21T07:38:26.875883+0000","last_unstale":"2024-09-21T07:38:28.880453+0000","last_undegraded":"2024-09-21T07:38:28.880453+0000","last_fullsized":"2024-09-21T07:38:28.880453+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:12.421136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881526+0000","last_change":"2024-09-21T07:38:27.904807+0000","last_active":"2024-09-21T07:38:28.881526+0000","last_peered":"2024-09-21T07:38:28.881526+0000","last_clean":"2024-09-21T07:38:28.881526+0000","last_became_active":"2024-09-21T07:38:27.904462+0000","last_became_peered":"2024-09-21T07:38:27.904462+0000","last_unstale":"2024-09-21T07:38:28.881526+0000","last_undegraded":"2024-09-21T07:38:28.881526+0000","last_fullsized":"2024-09-21T07:38:28.881526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:30.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880783+0000","last_change":"2024-09-21T07:38:26.876682+0000","last_active":"2024-09-21T07:38:26.880783+0000","last_peered":"2024-09-21T07:38:26.880783+0000","last_clean":"2024-09-21T07:38:26.880783+0000","last_became_active":"2024-09-21T07:38:26.874751+0000","last_became_peered":"2024-09-21T07:38:26.874751+0000","last_unstale":"2024-09-21T07:38:26.880783+0000","last_undegraded":"2024-09-21T07:38:26.880783+0000","last_fullsized":"2024-09-21T07:38:26.880783+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:47.312008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858393+0000","last_change":"2024-09-21T07:38:26.858393+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858393+0000","last_undegraded":"2024-09-21T07:38:26.858393+0000","last_fullsized":"2024-09-21T07:38:26.858393+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871738+0000","last_change":"2024-09-21T07:38:26.868126+0000","last_active":"2024-09-21T07:38:26.871738+0000","last_peered":"2024-09-21T07:38:26.871738+0000","last_clean":"2024-09-21T07:38:26.871738+0000","last_became_active":"2024-09-21T07:38:26.867386+0000","last_became_peered":"2024-09-21T07:38:26.867386+0000","last_unstale":"2024-09-21T07:38:26.871738+0000","last_undegraded":"2024-09-21T07:38:26.871738+0000","last_fullsized":"2024-09-21T07:38:26.871738+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:46.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881462+0000","last_change":"2024-09-21T07:38:27.900241+0000","last_active":"2024-09-21T07:38:28.881462+0000","last_peered":"2024-09-21T07:38:28.881462+0000","last_clean":"2024-09-21T07:38:28.881462+0000","last_became_active":"2024-09-21T07:38:27.899917+0000","last_became_peered":"2024-09-21T07:38:27.899917+0000","last_unstale":"2024-09-21T07:38:28.881462+0000","last_undegraded":"2024-09-21T07:38:28.881462+0000","last_fullsized":"2024-09-21T07:38:28.881462+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:19.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.870995+0000","last_change":"2024-09-21T07:38:26.867671+0000","last_active":"2024-09-21T07:38:26.870995+0000","last_peered":"2024-09-21T07:38:26.870995+0000","last_clean":"2024-09-21T07:38:26.870995+0000","last_became_active":"2024-09-21T07:38:26.867315+0000","last_became_peered":"2024-09-21T07:38:26.867315+0000","last_unstale":"2024-09-21T07:38:26.870995+0000","last_undegraded":"2024-09-21T07:38:26.870995+0000","last_fullsized":"2024-09-21T07:38:26.870995+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:17.009739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879528+0000","last_change":"2024-09-21T07:38:27.906372+0000","last_active":"2024-09-21T07:38:28.879528+0000","last_peered":"2024-09-21T07:38:28.879528+0000","last_clean":"2024-09-21T07:38:28.879528+0000","last_became_active":"2024-09-21T07:38:27.905712+0000","last_became_peered":"2024-09-21T07:38:27.905712+0000","last_unstale":"2024-09-21T07:38:28.879528+0000","last_undegraded":"2024-09-21T07:38:28.879528+0000","last_fullsized":"2024-09-21T07:38:28.879528+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:07.010954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880736+0000","last_change":"2024-09-21T07:38:26.876537+0000","last_active":"2024-09-21T07:38:26.880736+0000","last_peered":"2024-09-21T07:38:26.880736+0000","last_clean":"2024-09-21T07:38:26.880736+0000","last_became_active":"2024-09-21T07:38:26.874643+0000","last_became_peered":"2024-09-21T07:38:26.874643+0000","last_unstale":"2024-09-21T07:38:26.880736+0000","last_undegraded":"2024-09-21T07:38:26.880736+0000","last_fullsized":"2024-09-21T07:38:26.880736+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:04.010256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.857653+0000","last_change":"2024-09-21T07:38:26.857653+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.857653+0000","last_undegraded":"2024-09-21T07:38:26.857653+0000","last_fullsized":"2024-09-21T07:38:26.857653+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.880370+0000","last_change":"2024-09-21T07:38:26.875309+0000","last_active":"2024-09-21T07:38:26.880370+0000","last_peered":"2024-09-21T07:38:26.880370+0000","last_clean":"2024-09-21T07:38:26.880370+0000","last_became_active":"2024-09-21T07:38:26.874985+0000","last_became_peered":"2024-09-21T07:38:26.874985+0000","last_unstale":"2024-09-21T07:38:26.880370+0000","last_undegraded":"2024-09-21T07:38:26.880370+0000","last_fullsized":"2024-09-21T07:38:26.880370+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:34.340576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.858330+0000","last_change":"2024-09-21T07:38:26.858330+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.858330+0000","last_undegraded":"2024-09-21T07:38:26.858330+0000","last_fullsized":"2024-09-21T07:38:26.858330+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.872132+0000","last_change":"2024-09-21T07:38:26.871500+0000","last_active":"2024-09-21T07:38:26.872132+0000","last_peered":"2024-09-21T07:38:26.872132+0000","last_clean":"2024-09-21T07:38:26.872132+0000","last_became_active":"2024-09-21T07:38:26.871155+0000","last_became_peered":"2024-09-21T07:38:26.871155+0000","last_unstale":"2024-09-21T07:38:26.872132+0000","last_undegraded":"2024-09-21T07:38:26.872132+0000","last_fullsized":"2024-09-21T07:38:26.872132+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:10.567311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":1,"reported_epoch":227,"state":"creating+peering","last_fresh":"2024-09-21T07:38:26.848808+0000","last_change":"2024-09-21T07:38:26.848808+0000","last_active":"2024-09-21T07:38:26.842728+0000","last_peered":"2024-09-21T07:38:26.842728+0000","last_clean":"2024-09-21T07:38:26.842728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:38:26.848808+0000","last_undegraded":"2024-09-21T07:38:26.848808+0000","last_fullsized":"2024-09-21T07:38:26.848808+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":227,"state":"active+clean","last_fresh":"2024-09-21T07:38:26.871618+0000","last_change":"2024-09-21T07:38:26.862884+0000","last_active":"2024-09-21T07:38:26.871618+0000","last_peered":"2024-09-21T07:38:26.871618+0000","last_clean":"2024-09-21T07:38:26.871618+0000","last_became_active":"2024-09-21T07:38:26.861444+0000","last_became_peered":"2024-09-21T07:38:26.861444+0000","last_unstale":"2024-09-21T07:38:26.871618+0000","last_undegraded":"2024-09-21T07:38:26.871618+0000","last_fullsized":"2024-09-21T07:38:26.871618+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:22.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879863+0000","last_change":"2024-09-21T07:38:27.909367+0000","last_active":"2024-09-21T07:38:28.879863+0000","last_peered":"2024-09-21T07:38:28.879863+0000","last_clean":"2024-09-21T07:38:28.879863+0000","last_became_active":"2024-09-21T07:38:27.907346+0000","last_became_peered":"2024-09-21T07:38:27.907346+0000","last_unstale":"2024-09-21T07:38:28.879863+0000","last_undegraded":"2024-09-21T07:38:28.879863+0000","last_fullsized":"2024-09-21T07:38:28.879863+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:41.726703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":490,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880588+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:38:28.880588+0000","last_peered":"2024-09-21T07:38:28.880588+0000","last_clean":"2024-09-21T07:38:28.880588+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:38:28.880588+0000","last_undegraded":"2024-09-21T07:38:28.880588+0000","last_fullsized":"2024-09-21T07:38:28.880588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56184,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315656,"statfs":{"total":96636764160,"available":96579231744,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47864,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323976,"statfs":{"total":96636764160,"available":96587751424,"internally_reserved":0,"allocated":2854912,"data_stored":1349379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60364,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311476,"statfs":{"total":96636764160,"available":96574951424,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47876,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323964,"statfs":{"total":96636764160,"available":96587739136,"internally_reserved":0,"allocated":2867200,"data_stored":1356046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56780,"kb_used_data":3380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315060,"statfs":{"total":96636764160,"available":96578621440,"internally_reserved":0,"allocated":3461120,"data_stored":1946414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56808,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315032,"statfs":{"total":96636764160,"available":96578592768,"internally_reserved":0,"allocated":3493888,"data_stored":1960877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88096,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283744,"statfs":{"total":96636764160,"available":96546553856,"internally_reserved":0,"allocated":2895872,"data_stored":1369995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:PG 34.3f is not active+clean 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857711+0000', 'last_change': '2024-09-21T07:38:26.857711+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857711+0000', 'last_undegraded': '2024-09-21T07:38:26.857711+0000', 'last_fullsized': '2024-09-21T07:38:26.857711+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:PG 34.3e is not active+clean 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.859628+0000', 'last_change': '2024-09-21T07:38:26.859628+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.859628+0000', 'last_undegraded': '2024-09-21T07:38:26.859628+0000', 'last_fullsized': '2024-09-21T07:38:26.859628+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:PG 34.3d is not active+clean 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857134+0000', 'last_change': '2024-09-21T07:38:26.857134+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857134+0000', 'last_undegraded': '2024-09-21T07:38:26.857134+0000', 'last_fullsized': '2024-09-21T07:38:26.857134+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:PG 34.3b is not active+clean 2024-09-21T07:38:32.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.853011+0000', 'last_change': '2024-09-21T07:38:26.853011+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.853011+0000', 'last_undegraded': '2024-09-21T07:38:26.853011+0000', 'last_fullsized': '2024-09-21T07:38:26.853011+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.39 is not active+clean 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.856159+0000', 'last_change': '2024-09-21T07:38:26.856159+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.856159+0000', 'last_undegraded': '2024-09-21T07:38:26.856159+0000', 'last_fullsized': '2024-09-21T07:38:26.856159+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.36 is not active+clean 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.849670+0000', 'last_change': '2024-09-21T07:38:26.849670+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.849670+0000', 'last_undegraded': '2024-09-21T07:38:26.849670+0000', 'last_fullsized': '2024-09-21T07:38:26.849670+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.35 is not active+clean 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858207+0000', 'last_change': '2024-09-21T07:38:26.858207+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858207+0000', 'last_undegraded': '2024-09-21T07:38:26.858207+0000', 'last_fullsized': '2024-09-21T07:38:26.858207+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.32 is not active+clean 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.859755+0000', 'last_change': '2024-09-21T07:38:26.859755+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.859755+0000', 'last_undegraded': '2024-09-21T07:38:26.859755+0000', 'last_fullsized': '2024-09-21T07:38:26.859755+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.31 is not active+clean 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.866161+0000', 'last_change': '2024-09-21T07:38:26.866161+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.866161+0000', 'last_undegraded': '2024-09-21T07:38:26.866161+0000', 'last_fullsized': '2024-09-21T07:38:26.866161+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.930 INFO:tasks.ceph.ceph_manager.ceph:PG 34.30 is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.849053+0000', 'last_change': '2024-09-21T07:38:26.849053+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.849053+0000', 'last_undegraded': '2024-09-21T07:38:26.849053+0000', 'last_fullsized': '2024-09-21T07:38:26.849053+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2f is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.849929+0000', 'last_change': '2024-09-21T07:38:26.849929+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.849929+0000', 'last_undegraded': '2024-09-21T07:38:26.849929+0000', 'last_fullsized': '2024-09-21T07:38:26.849929+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2e is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858040+0000', 'last_change': '2024-09-21T07:38:26.858040+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858040+0000', 'last_undegraded': '2024-09-21T07:38:26.858040+0000', 'last_fullsized': '2024-09-21T07:38:26.858040+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2d is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.849583+0000', 'last_change': '2024-09-21T07:38:26.849583+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.849583+0000', 'last_undegraded': '2024-09-21T07:38:26.849583+0000', 'last_fullsized': '2024-09-21T07:38:26.849583+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2b is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.852499+0000', 'last_change': '2024-09-21T07:38:26.852499+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.852499+0000', 'last_undegraded': '2024-09-21T07:38:26.852499+0000', 'last_fullsized': '2024-09-21T07:38:26.852499+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2a is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.852856+0000', 'last_change': '2024-09-21T07:38:26.852856+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.852856+0000', 'last_undegraded': '2024-09-21T07:38:26.852856+0000', 'last_fullsized': '2024-09-21T07:38:26.852856+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:PG 34.29 is not active+clean 2024-09-21T07:38:32.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.862531+0000', 'last_change': '2024-09-21T07:38:26.862531+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.862531+0000', 'last_undegraded': '2024-09-21T07:38:26.862531+0000', 'last_fullsized': '2024-09-21T07:38:26.862531+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.28 is not active+clean 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.852913+0000', 'last_change': '2024-09-21T07:38:26.852913+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.852913+0000', 'last_undegraded': '2024-09-21T07:38:26.852913+0000', 'last_fullsized': '2024-09-21T07:38:26.852913+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.27 is not active+clean 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858632+0000', 'last_change': '2024-09-21T07:38:26.858632+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858632+0000', 'last_undegraded': '2024-09-21T07:38:26.858632+0000', 'last_fullsized': '2024-09-21T07:38:26.858632+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.26 is not active+clean 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858231+0000', 'last_change': '2024-09-21T07:38:26.858231+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858231+0000', 'last_undegraded': '2024-09-21T07:38:26.858231+0000', 'last_fullsized': '2024-09-21T07:38:26.858231+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.25 is not active+clean 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857655+0000', 'last_change': '2024-09-21T07:38:26.857655+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857655+0000', 'last_undegraded': '2024-09-21T07:38:26.857655+0000', 'last_fullsized': '2024-09-21T07:38:26.857655+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.24 is not active+clean 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.855526+0000', 'last_change': '2024-09-21T07:38:26.855526+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.855526+0000', 'last_undegraded': '2024-09-21T07:38:26.855526+0000', 'last_fullsized': '2024-09-21T07:38:26.855526+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.932 INFO:tasks.ceph.ceph_manager.ceph:PG 34.21 is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858670+0000', 'last_change': '2024-09-21T07:38:26.858670+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858670+0000', 'last_undegraded': '2024-09-21T07:38:26.858670+0000', 'last_fullsized': '2024-09-21T07:38:26.858670+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.20 is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.865286+0000', 'last_change': '2024-09-21T07:38:26.865286+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.865286+0000', 'last_undegraded': '2024-09-21T07:38:26.865286+0000', 'last_fullsized': '2024-09-21T07:38:26.865286+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1c is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.849079+0000', 'last_change': '2024-09-21T07:38:26.849079+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.849079+0000', 'last_undegraded': '2024-09-21T07:38:26.849079+0000', 'last_fullsized': '2024-09-21T07:38:26.849079+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1d is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.855959+0000', 'last_change': '2024-09-21T07:38:26.855959+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.855959+0000', 'last_undegraded': '2024-09-21T07:38:26.855959+0000', 'last_fullsized': '2024-09-21T07:38:26.855959+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1e is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857583+0000', 'last_change': '2024-09-21T07:38:26.857583+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857583+0000', 'last_undegraded': '2024-09-21T07:38:26.857583+0000', 'last_fullsized': '2024-09-21T07:38:26.857583+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1f is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857091+0000', 'last_change': '2024-09-21T07:38:26.857091+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857091+0000', 'last_undegraded': '2024-09-21T07:38:26.857091+0000', 'last_fullsized': '2024-09-21T07:38:26.857091+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:PG 34.18 is not active+clean 2024-09-21T07:38:32.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.864715+0000', 'last_change': '2024-09-21T07:38:26.864715+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.864715+0000', 'last_undegraded': '2024-09-21T07:38:26.864715+0000', 'last_fullsized': '2024-09-21T07:38:26.864715+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.19 is not active+clean 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858155+0000', 'last_change': '2024-09-21T07:38:26.858155+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858155+0000', 'last_undegraded': '2024-09-21T07:38:26.858155+0000', 'last_fullsized': '2024-09-21T07:38:26.858155+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1a is not active+clean 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858915+0000', 'last_change': '2024-09-21T07:38:26.858915+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858915+0000', 'last_undegraded': '2024-09-21T07:38:26.858915+0000', 'last_fullsized': '2024-09-21T07:38:26.858915+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.15 is not active+clean 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.855334+0000', 'last_change': '2024-09-21T07:38:26.855334+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.855334+0000', 'last_undegraded': '2024-09-21T07:38:26.855334+0000', 'last_fullsized': '2024-09-21T07:38:26.855334+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.17 is not active+clean 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.854167+0000', 'last_change': '2024-09-21T07:38:26.854167+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.854167+0000', 'last_undegraded': '2024-09-21T07:38:26.854167+0000', 'last_fullsized': '2024-09-21T07:38:26.854167+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.10 is not active+clean 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.850719+0000', 'last_change': '2024-09-21T07:38:26.850719+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.850719+0000', 'last_undegraded': '2024-09-21T07:38:26.850719+0000', 'last_fullsized': '2024-09-21T07:38:26.850719+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:38:32.934 INFO:tasks.ceph.ceph_manager.ceph:PG 34.11 is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.854420+0000', 'last_change': '2024-09-21T07:38:26.854420+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.854420+0000', 'last_undegraded': '2024-09-21T07:38:26.854420+0000', 'last_fullsized': '2024-09-21T07:38:26.854420+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.12 is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.850596+0000', 'last_change': '2024-09-21T07:38:26.850596+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.850596+0000', 'last_undegraded': '2024-09-21T07:38:26.850596+0000', 'last_fullsized': '2024-09-21T07:38:26.850596+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.13 is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.851931+0000', 'last_change': '2024-09-21T07:38:26.851931+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.851931+0000', 'last_undegraded': '2024-09-21T07:38:26.851931+0000', 'last_fullsized': '2024-09-21T07:38:26.851931+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.c is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.853027+0000', 'last_change': '2024-09-21T07:38:26.853027+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.853027+0000', 'last_undegraded': '2024-09-21T07:38:26.853027+0000', 'last_fullsized': '2024-09-21T07:38:26.853027+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.d is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.853930+0000', 'last_change': '2024-09-21T07:38:26.853930+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.853930+0000', 'last_undegraded': '2024-09-21T07:38:26.853930+0000', 'last_fullsized': '2024-09-21T07:38:26.853930+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.f is not active+clean 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.853064+0000', 'last_change': '2024-09-21T07:38:26.853064+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.853064+0000', 'last_undegraded': '2024-09-21T07:38:26.853064+0000', 'last_fullsized': '2024-09-21T07:38:26.853064+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.935 INFO:tasks.ceph.ceph_manager.ceph:PG 34.8 is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.864172+0000', 'last_change': '2024-09-21T07:38:26.864172+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.864172+0000', 'last_undegraded': '2024-09-21T07:38:26.864172+0000', 'last_fullsized': '2024-09-21T07:38:26.864172+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:PG 34.9 is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.853830+0000', 'last_change': '2024-09-21T07:38:26.853830+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.853830+0000', 'last_undegraded': '2024-09-21T07:38:26.853830+0000', 'last_fullsized': '2024-09-21T07:38:26.853830+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:PG 34.b is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858677+0000', 'last_change': '2024-09-21T07:38:26.858677+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858677+0000', 'last_undegraded': '2024-09-21T07:38:26.858677+0000', 'last_fullsized': '2024-09-21T07:38:26.858677+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:PG 34.6 is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858393+0000', 'last_change': '2024-09-21T07:38:26.858393+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858393+0000', 'last_undegraded': '2024-09-21T07:38:26.858393+0000', 'last_fullsized': '2024-09-21T07:38:26.858393+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:PG 34.1 is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.857653+0000', 'last_change': '2024-09-21T07:38:26.857653+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.857653+0000', 'last_undegraded': '2024-09-21T07:38:26.857653+0000', 'last_fullsized': '2024-09-21T07:38:26.857653+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:PG 34.2 is not active+clean 2024-09-21T07:38:32.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.858330+0000', 'last_change': '2024-09-21T07:38:26.858330+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.858330+0000', 'last_undegraded': '2024-09-21T07:38:26.858330+0000', 'last_fullsized': '2024-09-21T07:38:26.858330+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:38:32.937 INFO:tasks.ceph.ceph_manager.ceph:PG 34.3 is not active+clean 2024-09-21T07:38:32.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '34.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 227, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:38:26.848808+0000', 'last_change': '2024-09-21T07:38:26.848808+0000', 'last_active': '2024-09-21T07:38:26.842728+0000', 'last_peered': '2024-09-21T07:38:26.842728+0000', 'last_clean': '2024-09-21T07:38:26.842728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:38:26.848808+0000', 'last_undegraded': '2024-09-21T07:38:26.848808+0000', 'last_fullsized': '2024-09-21T07:38:26.848808+0000', 'mapping_epoch': 227, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 227, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'last_clean_scrub_stamp': '2024-09-21T07:38:26.842728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:38:32.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:38:33.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 -- 172.21.15.64:0/1023145474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb64c003a10 msgr2=0x7fb64c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 --2- 172.21.15.64:0/1023145474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb64c003a10 0x7fb64c003e80 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c310 tx=0x7fb65801cfc0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb667e00640 1 -- 172.21.15.64:0/1023145474 reap_dead start 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 -- 172.21.15.64:0/1023145474 shutdown_connections 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 -- 172.21.15.64:0/1023145474 >> 172.21.15.64:0/1023145474 conn(0x7fb6680b1c60 msgr2=0x7fb6680b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 -- 172.21.15.64:0/1023145474 shutdown_connections 2024-09-21T07:38:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.130+0000 7fb66d200640 1 -- 172.21.15.64:0/1023145474 wait complete. 2024-09-21T07:38:33.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 Processor -- start 2024-09-21T07:38:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 -- start start 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb64c003a10 0x7fb668161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6680b0c80 0x7fb6681f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb668070b40 con 0x7fb6681f7f10 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680709c0 con 0x7fb64c003a10 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb668070cc0 con 0x7fb6680b0c80 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb64c003a10 0x7fb668161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55602/0 (socket says 172.21.15.64:55602) 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 -- 172.21.15.64:0/1527485370 learned_addr learned my addr 172.21.15.64:0/1527485370 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb65ea00640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6680b0c80 0x7fb6681f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 -- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6680b0c80 msgr2=0x7fb6681f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6680b0c80 0x7fb6681f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 -- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb64c003a10 msgr2=0x7fb668161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb64c003a10 0x7fb668161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 -- 172.21.15.64:0/1527485370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6681f8860 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb667e00640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fb668070f00 tx=0x7fb660010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66000ee40 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb660015070 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660003d10 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.134+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb668161fe0 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681625a0 con 0x7fb6681f7f10 2024-09-21T07:38:33.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb668161d50 con 0x7fb6681f7f10 2024-09-21T07:38:33.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb660004030 con 0x7fb6681f7f10 2024-09-21T07:38:33.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb65fe00640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 0x7fb644075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb660094a80 con 0x7fb6681f7f10 2024-09-21T07:38:33.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.138+0000 7fb667400640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 0x7fb644075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.142+0000 7fb667400640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 0x7fb644075740 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb6580ac000 tx=0x7fb658019e00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:33.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.142+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb660096e20 con 0x7fb6681f7f10 2024-09-21T07:38:33.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb6680b2070 con 0x7fb6681f7f10 2024-09-21T07:38:33.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb65fe00640 1 -- 172.21.15.64:0/1527485370 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2630 (secure 0 0 0) 0x7fb66005f2b0 con 0x7fb6681f7f10 2024-09-21T07:38:33.385 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:33.385 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":971,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":229,"num_osds":8,"num_up_osds":8,"osd_up_since":1726903357,"num_in_osds":8,"osd_in_since":1726903346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":51},{"state_name":"creating+peering","count":46}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590480,"bytes_used":481456128,"bytes_avail":772612657152,"bytes_total":773094113280,"inactive_pgs_ratio":0.47422680258750916,"write_bytes_sec":350,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":169,"btime":"2024-09-21T07:38:30:894787+0000","id":16,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":16,"rank":0,"name":"a","status":"up:active","gid":11676}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":35,"modified":"2024-09-21T07:38:29.682754+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 msgr2=0x7fb644075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 0x7fb644075740 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb6580ac000 tx=0x7fb658019e00 comp rx=0 tx=0).stop 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 msgr2=0x7fb6681f8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fb668070f00 tx=0x7fb660010f20 comp rx=0 tx=0).stop 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 shutdown_connections 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb644073230 0x7fb644075740 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6681f7f10 0x7fb6681f8320 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6680b0c80 0x7fb6681f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 --2- 172.21.15.64:0/1527485370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb64c003a10 0x7fb668161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 >> 172.21.15.64:0/1527485370 conn(0x7fb6680b1c60 msgr2=0x7fb6680d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:33.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 shutdown_connections 2024-09-21T07:38:33.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.386+0000 7fb66d200640 1 -- 172.21.15.64:0/1527485370 wait complete. 2024-09-21T07:38:33.408 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:38:33.408 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 -- 172.21.15.64:0/320174775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700ce030 msgr2=0x7fb5700ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 --2- 172.21.15.64:0/320174775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700ce030 0x7fb5700ce440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb560009900 tx=0x7fb56001c8e0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 -- 172.21.15.64:0/320174775 shutdown_connections 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 --2- 172.21.15.64:0/320174775 >> v2:172.21.15.90:3300/0 conn(0x7fb5700b0bf0 0x7fb5700b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 --2- 172.21.15.64:0/320174775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700ce030 0x7fb5700ce440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 -- 172.21.15.64:0/320174775 >> 172.21.15.64:0/320174775 conn(0x7fb5700b2f80 msgr2=0x7fb5700b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 -- 172.21.15.64:0/320174775 shutdown_connections 2024-09-21T07:38:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.566+0000 7fb575600640 1 -- 172.21.15.64:0/320174775 wait complete. 2024-09-21T07:38:33.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 Processor -- start 2024-09-21T07:38:33.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 -- start start 2024-09-21T07:38:33.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b0bf0 0x7fb5701f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5700b1540 0x7fb570163860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb570169140 con 0x7fb5700ce030 2024-09-21T07:38:33.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700cd380 con 0x7fb5700b1540 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb575600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb5701692c0 con 0x7fb5700b0bf0 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55614/0 (socket says 172.21.15.64:55614) 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 -- 172.21.15.64:0/2672695144 learned_addr learned my addr 172.21.15.64:0/2672695144 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56ea00640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b0bf0 0x7fb5701f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb566000640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5700b1540 0x7fb570163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 -- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b0bf0 msgr2=0x7fb5701f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b0bf0 0x7fb5701f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 -- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5700b1540 msgr2=0x7fb570163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5700b1540 0x7fb570163860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 -- 172.21.15.64:0/2672695144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5700cae00 con 0x7fb5700ce030 2024-09-21T07:38:33.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.570+0000 7fb56f400640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c680 tx=0x7fb56800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:33.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568003b80 con 0x7fb5700ce030 2024-09-21T07:38:33.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb568003d40 con 0x7fb5700ce030 2024-09-21T07:38:33.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568005330 con 0x7fb5700ce030 2024-09-21T07:38:33.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5700cb0e0 con 0x7fb5700ce030 2024-09-21T07:38:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5700cb6a0 con 0x7fb5700ce030 2024-09-21T07:38:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5700b1000 con 0x7fb5700ce030 2024-09-21T07:38:33.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb5680054d0 con 0x7fb5700ce030 2024-09-21T07:38:33.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:33.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb568093fc0 con 0x7fb5700ce030 2024-09-21T07:38:33.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.574+0000 7fb56ea00640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:33.576 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.578+0000 7fb56ea00640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb5600af000 tx=0x7fb56001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:33.579 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.578+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb56805e880 con 0x7fb5700ce030 2024-09-21T07:38:33.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.754+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb57009f3d0 con 0x7fb54c073200 2024-09-21T07:38:33.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.758+0000 7fb567400640 1 -- 172.21.15.64:0/2672695144 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7fb5600f9a60 con 0x7fb54c073200 2024-09-21T07:38:33.760 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:33.761 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:33.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 msgr2=0x7fb54c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb5600af000 tx=0x7fb56001b120 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 msgr2=0x7fb570163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c680 tx=0x7fb56800cb40 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 shutdown_connections 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb54c073200 0x7fb54c075710 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5700ce030 0x7fb570163da0 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5700b1540 0x7fb570163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 --2- 172.21.15.64:0/2672695144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5700b0bf0 0x7fb5701f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 >> 172.21.15.64:0/2672695144 conn(0x7fb5700b2f80 msgr2=0x7fb5700b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 shutdown_connections 2024-09-21T07:38:33.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:33.762+0000 7fb575600640 1 -- 172.21.15.64:0/2672695144 wait complete. 2024-09-21T07:38:33.781 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":701,"stamp":"2024-09-21T07:38:33.684002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":470388,"kb_used_data":23816,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754504332,"statfs":{"total":773094113280,"available":772612435968,"internally_reserved":0,"allocated":24387584,"data_stored":12144796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.837760"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879359+0000","last_change":"2024-09-21T07:38:27.879589+0000","last_active":"2024-09-21T07:38:28.879359+0000","last_peered":"2024-09-21T07:38:28.879359+0000","last_clean":"2024-09-21T07:38:28.879359+0000","last_became_active":"2024-09-21T07:38:27.878983+0000","last_became_peered":"2024-09-21T07:38:27.878983+0000","last_unstale":"2024-09-21T07:38:28.879359+0000","last_undegraded":"2024-09-21T07:38:28.879359+0000","last_fullsized":"2024-09-21T07:38:28.879359+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:31.673862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610476+0000","last_change":"2024-09-21T07:38:27.896661+0000","last_active":"2024-09-21T07:38:29.610476+0000","last_peered":"2024-09-21T07:38:29.610476+0000","last_clean":"2024-09-21T07:38:29.610476+0000","last_became_active":"2024-09-21T07:38:27.894676+0000","last_became_peered":"2024-09-21T07:38:27.894676+0000","last_unstale":"2024-09-21T07:38:29.610476+0000","last_undegraded":"2024-09-21T07:38:29.610476+0000","last_fullsized":"2024-09-21T07:38:29.610476+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:11.319538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607982+0000","last_change":"2024-09-21T07:38:27.885425+0000","last_active":"2024-09-21T07:38:29.607982+0000","last_peered":"2024-09-21T07:38:29.607982+0000","last_clean":"2024-09-21T07:38:29.607982+0000","last_became_active":"2024-09-21T07:38:27.885036+0000","last_became_peered":"2024-09-21T07:38:27.885036+0000","last_unstale":"2024-09-21T07:38:29.607982+0000","last_undegraded":"2024-09-21T07:38:29.607982+0000","last_fullsized":"2024-09-21T07:38:29.607982+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:37.642858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880663+0000","last_change":"2024-09-21T07:38:27.902273+0000","last_active":"2024-09-21T07:38:28.880663+0000","last_peered":"2024-09-21T07:38:28.880663+0000","last_clean":"2024-09-21T07:38:28.880663+0000","last_became_active":"2024-09-21T07:38:27.901903+0000","last_became_peered":"2024-09-21T07:38:27.901903+0000","last_unstale":"2024-09-21T07:38:28.880663+0000","last_undegraded":"2024-09-21T07:38:28.880663+0000","last_fullsized":"2024-09-21T07:38:28.880663+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:58.406221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608625+0000","last_change":"2024-09-21T07:38:27.902541+0000","last_active":"2024-09-21T07:38:29.608625+0000","last_peered":"2024-09-21T07:38:29.608625+0000","last_clean":"2024-09-21T07:38:29.608625+0000","last_became_active":"2024-09-21T07:38:27.901895+0000","last_became_peered":"2024-09-21T07:38:27.901895+0000","last_unstale":"2024-09-21T07:38:29.608625+0000","last_undegraded":"2024-09-21T07:38:29.608625+0000","last_fullsized":"2024-09-21T07:38:29.608625+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:49.529775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880971+0000","last_change":"2024-09-21T07:38:27.890574+0000","last_active":"2024-09-21T07:38:28.880971+0000","last_peered":"2024-09-21T07:38:28.880971+0000","last_clean":"2024-09-21T07:38:28.880971+0000","last_became_active":"2024-09-21T07:38:27.887320+0000","last_became_peered":"2024-09-21T07:38:27.887320+0000","last_unstale":"2024-09-21T07:38:28.880971+0000","last_undegraded":"2024-09-21T07:38:28.880971+0000","last_fullsized":"2024-09-21T07:38:28.880971+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:40.556500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607269+0000","last_change":"2024-09-21T07:38:27.882423+0000","last_active":"2024-09-21T07:38:29.607269+0000","last_peered":"2024-09-21T07:38:29.607269+0000","last_clean":"2024-09-21T07:38:29.607269+0000","last_became_active":"2024-09-21T07:38:27.882093+0000","last_became_peered":"2024-09-21T07:38:27.882093+0000","last_unstale":"2024-09-21T07:38:29.607269+0000","last_undegraded":"2024-09-21T07:38:29.607269+0000","last_fullsized":"2024-09-21T07:38:29.607269+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:31.161287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879529+0000","last_change":"2024-09-21T07:38:27.907654+0000","last_active":"2024-09-21T07:38:28.879529+0000","last_peered":"2024-09-21T07:38:28.879529+0000","last_clean":"2024-09-21T07:38:28.879529+0000","last_became_active":"2024-09-21T07:38:27.906066+0000","last_became_peered":"2024-09-21T07:38:27.906066+0000","last_unstale":"2024-09-21T07:38:28.879529+0000","last_undegraded":"2024-09-21T07:38:28.879529+0000","last_fullsized":"2024-09-21T07:38:28.879529+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:24.486499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881469+0000","last_change":"2024-09-21T07:38:27.897228+0000","last_active":"2024-09-21T07:38:28.881469+0000","last_peered":"2024-09-21T07:38:28.881469+0000","last_clean":"2024-09-21T07:38:28.881469+0000","last_became_active":"2024-09-21T07:38:27.896883+0000","last_became_peered":"2024-09-21T07:38:27.896883+0000","last_unstale":"2024-09-21T07:38:28.881469+0000","last_undegraded":"2024-09-21T07:38:28.881469+0000","last_fullsized":"2024-09-21T07:38:28.881469+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:51.166601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608154+0000","last_change":"2024-09-21T07:38:27.890067+0000","last_active":"2024-09-21T07:38:29.608154+0000","last_peered":"2024-09-21T07:38:29.608154+0000","last_clean":"2024-09-21T07:38:29.608154+0000","last_became_active":"2024-09-21T07:38:27.888565+0000","last_became_peered":"2024-09-21T07:38:27.888565+0000","last_unstale":"2024-09-21T07:38:29.608154+0000","last_undegraded":"2024-09-21T07:38:29.608154+0000","last_fullsized":"2024-09-21T07:38:29.608154+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:26.031547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879448+0000","last_change":"2024-09-21T07:38:27.886035+0000","last_active":"2024-09-21T07:38:28.879448+0000","last_peered":"2024-09-21T07:38:28.879448+0000","last_clean":"2024-09-21T07:38:28.879448+0000","last_became_active":"2024-09-21T07:38:27.885689+0000","last_became_peered":"2024-09-21T07:38:27.885689+0000","last_unstale":"2024-09-21T07:38:28.879448+0000","last_undegraded":"2024-09-21T07:38:28.879448+0000","last_fullsized":"2024-09-21T07:38:28.879448+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:27.514856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881624+0000","last_change":"2024-09-21T07:38:27.895619+0000","last_active":"2024-09-21T07:38:28.881624+0000","last_peered":"2024-09-21T07:38:28.881624+0000","last_clean":"2024-09-21T07:38:28.881624+0000","last_became_active":"2024-09-21T07:38:27.895269+0000","last_became_peered":"2024-09-21T07:38:27.895269+0000","last_unstale":"2024-09-21T07:38:28.881624+0000","last_undegraded":"2024-09-21T07:38:28.881624+0000","last_fullsized":"2024-09-21T07:38:28.881624+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:48.794383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879845+0000","last_change":"2024-09-21T07:38:27.908331+0000","last_active":"2024-09-21T07:38:28.879845+0000","last_peered":"2024-09-21T07:38:28.879845+0000","last_clean":"2024-09-21T07:38:28.879845+0000","last_became_active":"2024-09-21T07:38:27.906446+0000","last_became_peered":"2024-09-21T07:38:27.906446+0000","last_unstale":"2024-09-21T07:38:28.879845+0000","last_undegraded":"2024-09-21T07:38:28.879845+0000","last_fullsized":"2024-09-21T07:38:28.879845+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:24.108120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610015+0000","last_change":"2024-09-21T07:38:27.912053+0000","last_active":"2024-09-21T07:38:29.610015+0000","last_peered":"2024-09-21T07:38:29.610015+0000","last_clean":"2024-09-21T07:38:29.610015+0000","last_became_active":"2024-09-21T07:38:27.911752+0000","last_became_peered":"2024-09-21T07:38:27.911752+0000","last_unstale":"2024-09-21T07:38:29.610015+0000","last_undegraded":"2024-09-21T07:38:29.610015+0000","last_fullsized":"2024-09-21T07:38:29.610015+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:24.239626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609598+0000","last_change":"2024-09-21T07:38:27.880386+0000","last_active":"2024-09-21T07:38:29.609598+0000","last_peered":"2024-09-21T07:38:29.609598+0000","last_clean":"2024-09-21T07:38:29.609598+0000","last_became_active":"2024-09-21T07:38:27.880045+0000","last_became_peered":"2024-09-21T07:38:27.880045+0000","last_unstale":"2024-09-21T07:38:29.609598+0000","last_undegraded":"2024-09-21T07:38:29.609598+0000","last_fullsized":"2024-09-21T07:38:29.609598+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:28.219566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607029+0000","last_change":"2024-09-21T07:38:27.881175+0000","last_active":"2024-09-21T07:38:29.607029+0000","last_peered":"2024-09-21T07:38:29.607029+0000","last_clean":"2024-09-21T07:38:29.607029+0000","last_became_active":"2024-09-21T07:38:27.880863+0000","last_became_peered":"2024-09-21T07:38:27.880863+0000","last_unstale":"2024-09-21T07:38:29.607029+0000","last_undegraded":"2024-09-21T07:38:29.607029+0000","last_fullsized":"2024-09-21T07:38:29.607029+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.521724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607715+0000","last_change":"2024-09-21T07:38:27.896418+0000","last_active":"2024-09-21T07:38:29.607715+0000","last_peered":"2024-09-21T07:38:29.607715+0000","last_clean":"2024-09-21T07:38:29.607715+0000","last_became_active":"2024-09-21T07:38:27.894616+0000","last_became_peered":"2024-09-21T07:38:27.894616+0000","last_unstale":"2024-09-21T07:38:29.607715+0000","last_undegraded":"2024-09-21T07:38:29.607715+0000","last_fullsized":"2024-09-21T07:38:29.607715+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:21.664750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608434+0000","last_change":"2024-09-21T07:38:27.897524+0000","last_active":"2024-09-21T07:38:29.608434+0000","last_peered":"2024-09-21T07:38:29.608434+0000","last_clean":"2024-09-21T07:38:29.608434+0000","last_became_active":"2024-09-21T07:38:27.897054+0000","last_became_peered":"2024-09-21T07:38:27.897054+0000","last_unstale":"2024-09-21T07:38:29.608434+0000","last_undegraded":"2024-09-21T07:38:29.608434+0000","last_fullsized":"2024-09-21T07:38:29.608434+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.145381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607590+0000","last_change":"2024-09-21T07:38:27.872053+0000","last_active":"2024-09-21T07:38:29.607590+0000","last_peered":"2024-09-21T07:38:29.607590+0000","last_clean":"2024-09-21T07:38:29.607590+0000","last_became_active":"2024-09-21T07:38:27.871619+0000","last_became_peered":"2024-09-21T07:38:27.871619+0000","last_unstale":"2024-09-21T07:38:29.607590+0000","last_undegraded":"2024-09-21T07:38:29.607590+0000","last_fullsized":"2024-09-21T07:38:29.607590+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.949314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881493+0000","last_change":"2024-09-21T07:38:27.896082+0000","last_active":"2024-09-21T07:38:28.881493+0000","last_peered":"2024-09-21T07:38:28.881493+0000","last_clean":"2024-09-21T07:38:28.881493+0000","last_became_active":"2024-09-21T07:38:27.895767+0000","last_became_peered":"2024-09-21T07:38:27.895767+0000","last_unstale":"2024-09-21T07:38:28.881493+0000","last_undegraded":"2024-09-21T07:38:28.881493+0000","last_fullsized":"2024-09-21T07:38:28.881493+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:04.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608898+0000","last_change":"2024-09-21T07:38:27.902213+0000","last_active":"2024-09-21T07:38:29.608898+0000","last_peered":"2024-09-21T07:38:29.608898+0000","last_clean":"2024-09-21T07:38:29.608898+0000","last_became_active":"2024-09-21T07:38:27.901458+0000","last_became_peered":"2024-09-21T07:38:27.901458+0000","last_unstale":"2024-09-21T07:38:29.608898+0000","last_undegraded":"2024-09-21T07:38:29.608898+0000","last_fullsized":"2024-09-21T07:38:29.608898+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:47.079031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879102+0000","last_change":"2024-09-21T07:38:27.884168+0000","last_active":"2024-09-21T07:38:28.879102+0000","last_peered":"2024-09-21T07:38:28.879102+0000","last_clean":"2024-09-21T07:38:28.879102+0000","last_became_active":"2024-09-21T07:38:27.883864+0000","last_became_peered":"2024-09-21T07:38:27.883864+0000","last_unstale":"2024-09-21T07:38:28.879102+0000","last_undegraded":"2024-09-21T07:38:28.879102+0000","last_fullsized":"2024-09-21T07:38:28.879102+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:09.906489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609651+0000","last_change":"2024-09-21T07:38:27.888188+0000","last_active":"2024-09-21T07:38:29.609651+0000","last_peered":"2024-09-21T07:38:29.609651+0000","last_clean":"2024-09-21T07:38:29.609651+0000","last_became_active":"2024-09-21T07:38:27.887676+0000","last_became_peered":"2024-09-21T07:38:27.887676+0000","last_unstale":"2024-09-21T07:38:29.609651+0000","last_undegraded":"2024-09-21T07:38:29.609651+0000","last_fullsized":"2024-09-21T07:38:29.609651+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:09.545773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879189+0000","last_change":"2024-09-21T07:38:27.876966+0000","last_active":"2024-09-21T07:38:28.879189+0000","last_peered":"2024-09-21T07:38:28.879189+0000","last_clean":"2024-09-21T07:38:28.879189+0000","last_became_active":"2024-09-21T07:38:27.876560+0000","last_became_peered":"2024-09-21T07:38:27.876560+0000","last_unstale":"2024-09-21T07:38:28.879189+0000","last_undegraded":"2024-09-21T07:38:28.879189+0000","last_fullsized":"2024-09-21T07:38:28.879189+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:33.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608127+0000","last_change":"2024-09-21T07:38:27.889131+0000","last_active":"2024-09-21T07:38:29.608127+0000","last_peered":"2024-09-21T07:38:29.608127+0000","last_clean":"2024-09-21T07:38:29.608127+0000","last_became_active":"2024-09-21T07:38:27.888745+0000","last_became_peered":"2024-09-21T07:38:27.888745+0000","last_unstale":"2024-09-21T07:38:29.608127+0000","last_undegraded":"2024-09-21T07:38:29.608127+0000","last_fullsized":"2024-09-21T07:38:29.608127+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:16.033670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610683+0000","last_change":"2024-09-21T07:38:27.888329+0000","last_active":"2024-09-21T07:38:29.610683+0000","last_peered":"2024-09-21T07:38:29.610683+0000","last_clean":"2024-09-21T07:38:29.610683+0000","last_became_active":"2024-09-21T07:38:27.887673+0000","last_became_peered":"2024-09-21T07:38:27.887673+0000","last_unstale":"2024-09-21T07:38:29.610683+0000","last_undegraded":"2024-09-21T07:38:29.610683+0000","last_fullsized":"2024-09-21T07:38:29.610683+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:00.475124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879713+0000","last_change":"2024-09-21T07:38:27.882021+0000","last_active":"2024-09-21T07:38:28.879713+0000","last_peered":"2024-09-21T07:38:28.879713+0000","last_clean":"2024-09-21T07:38:28.879713+0000","last_became_active":"2024-09-21T07:38:27.881074+0000","last_became_peered":"2024-09-21T07:38:27.881074+0000","last_unstale":"2024-09-21T07:38:28.879713+0000","last_undegraded":"2024-09-21T07:38:28.879713+0000","last_fullsized":"2024-09-21T07:38:28.879713+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:18.019845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879639+0000","last_change":"2024-09-21T07:38:27.877328+0000","last_active":"2024-09-21T07:38:28.879639+0000","last_peered":"2024-09-21T07:38:28.879639+0000","last_clean":"2024-09-21T07:38:28.879639+0000","last_became_active":"2024-09-21T07:38:27.876997+0000","last_became_peered":"2024-09-21T07:38:27.876997+0000","last_unstale":"2024-09-21T07:38:28.879639+0000","last_undegraded":"2024-09-21T07:38:28.879639+0000","last_fullsized":"2024-09-21T07:38:28.879639+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.630735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881690+0000","last_change":"2024-09-21T07:38:27.899491+0000","last_active":"2024-09-21T07:38:28.881690+0000","last_peered":"2024-09-21T07:38:28.881690+0000","last_clean":"2024-09-21T07:38:28.881690+0000","last_became_active":"2024-09-21T07:38:27.898923+0000","last_became_peered":"2024-09-21T07:38:27.898923+0000","last_unstale":"2024-09-21T07:38:28.881690+0000","last_undegraded":"2024-09-21T07:38:28.881690+0000","last_fullsized":"2024-09-21T07:38:28.881690+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:25.337677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609927+0000","last_change":"2024-09-21T07:38:27.899304+0000","last_active":"2024-09-21T07:38:29.609927+0000","last_peered":"2024-09-21T07:38:29.609927+0000","last_clean":"2024-09-21T07:38:29.609927+0000","last_became_active":"2024-09-21T07:38:27.898964+0000","last_became_peered":"2024-09-21T07:38:27.898964+0000","last_unstale":"2024-09-21T07:38:29.609927+0000","last_undegraded":"2024-09-21T07:38:29.609927+0000","last_fullsized":"2024-09-21T07:38:29.609927+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:57.667593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608015+0000","last_change":"2024-09-21T07:38:27.895116+0000","last_active":"2024-09-21T07:38:29.608015+0000","last_peered":"2024-09-21T07:38:29.608015+0000","last_clean":"2024-09-21T07:38:29.608015+0000","last_became_active":"2024-09-21T07:38:27.894796+0000","last_became_peered":"2024-09-21T07:38:27.894796+0000","last_unstale":"2024-09-21T07:38:29.608015+0000","last_undegraded":"2024-09-21T07:38:29.608015+0000","last_fullsized":"2024-09-21T07:38:29.608015+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:10.283133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607011+0000","last_change":"2024-09-21T07:38:27.887596+0000","last_active":"2024-09-21T07:38:29.607011+0000","last_peered":"2024-09-21T07:38:29.607011+0000","last_clean":"2024-09-21T07:38:29.607011+0000","last_became_active":"2024-09-21T07:38:27.887296+0000","last_became_peered":"2024-09-21T07:38:27.887296+0000","last_unstale":"2024-09-21T07:38:29.607011+0000","last_undegraded":"2024-09-21T07:38:29.607011+0000","last_fullsized":"2024-09-21T07:38:29.607011+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:55.792122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"228'4","reported_seq":19,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608612+0000","last_change":"2024-09-21T07:38:26.876175+0000","last_active":"2024-09-21T07:38:29.608612+0000","last_peered":"2024-09-21T07:38:29.608612+0000","last_clean":"2024-09-21T07:38:29.608612+0000","last_became_active":"2024-09-21T07:38:26.875734+0000","last_became_peered":"2024-09-21T07:38:26.875734+0000","last_unstale":"2024-09-21T07:38:29.608612+0000","last_undegraded":"2024-09-21T07:38:29.608612+0000","last_fullsized":"2024-09-21T07:38:29.608612+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:12.542862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608297+0000","last_change":"2024-09-21T07:38:27.895082+0000","last_active":"2024-09-21T07:38:29.608297+0000","last_peered":"2024-09-21T07:38:29.608297+0000","last_clean":"2024-09-21T07:38:29.608297+0000","last_became_active":"2024-09-21T07:38:27.894770+0000","last_became_peered":"2024-09-21T07:38:27.894770+0000","last_unstale":"2024-09-21T07:38:29.608297+0000","last_undegraded":"2024-09-21T07:38:29.608297+0000","last_fullsized":"2024-09-21T07:38:29.608297+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:45.238573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608217+0000","last_change":"2024-09-21T07:38:26.863994+0000","last_active":"2024-09-21T07:38:29.608217+0000","last_peered":"2024-09-21T07:38:29.608217+0000","last_clean":"2024-09-21T07:38:29.608217+0000","last_became_active":"2024-09-21T07:38:26.863529+0000","last_became_peered":"2024-09-21T07:38:26.863529+0000","last_unstale":"2024-09-21T07:38:29.608217+0000","last_undegraded":"2024-09-21T07:38:29.608217+0000","last_fullsized":"2024-09-21T07:38:29.608217+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:10.567311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608987+0000","last_change":"2024-09-21T07:38:27.911196+0000","last_active":"2024-09-21T07:38:29.608987+0000","last_peered":"2024-09-21T07:38:29.608987+0000","last_clean":"2024-09-21T07:38:29.608987+0000","last_became_active":"2024-09-21T07:38:27.910875+0000","last_became_peered":"2024-09-21T07:38:27.910875+0000","last_unstale":"2024-09-21T07:38:29.608987+0000","last_undegraded":"2024-09-21T07:38:29.608987+0000","last_fullsized":"2024-09-21T07:38:29.608987+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:14.981031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879891+0000","last_change":"2024-09-21T07:38:26.866652+0000","last_active":"2024-09-21T07:38:28.879891+0000","last_peered":"2024-09-21T07:38:28.879891+0000","last_clean":"2024-09-21T07:38:28.879891+0000","last_became_active":"2024-09-21T07:38:26.866286+0000","last_became_peered":"2024-09-21T07:38:26.866286+0000","last_unstale":"2024-09-21T07:38:28.879891+0000","last_undegraded":"2024-09-21T07:38:28.879891+0000","last_fullsized":"2024-09-21T07:38:28.879891+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:52.630117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610769+0000","last_change":"2024-09-21T07:38:27.899792+0000","last_active":"2024-09-21T07:38:29.610769+0000","last_peered":"2024-09-21T07:38:29.610769+0000","last_clean":"2024-09-21T07:38:29.610769+0000","last_became_active":"2024-09-21T07:38:27.899377+0000","last_became_peered":"2024-09-21T07:38:27.899377+0000","last_unstale":"2024-09-21T07:38:29.610769+0000","last_undegraded":"2024-09-21T07:38:29.610769+0000","last_fullsized":"2024-09-21T07:38:29.610769+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:23.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607242+0000","last_change":"2024-09-21T07:38:26.861984+0000","last_active":"2024-09-21T07:38:29.607242+0000","last_peered":"2024-09-21T07:38:29.607242+0000","last_clean":"2024-09-21T07:38:29.607242+0000","last_became_active":"2024-09-21T07:38:26.861625+0000","last_became_peered":"2024-09-21T07:38:26.861625+0000","last_unstale":"2024-09-21T07:38:29.607242+0000","last_undegraded":"2024-09-21T07:38:29.607242+0000","last_fullsized":"2024-09-21T07:38:29.607242+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:53.379186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608134+0000","last_change":"2024-09-21T07:38:27.892850+0000","last_active":"2024-09-21T07:38:29.608134+0000","last_peered":"2024-09-21T07:38:29.608134+0000","last_clean":"2024-09-21T07:38:29.608134+0000","last_became_active":"2024-09-21T07:38:27.892540+0000","last_became_peered":"2024-09-21T07:38:27.892540+0000","last_unstale":"2024-09-21T07:38:29.608134+0000","last_undegraded":"2024-09-21T07:38:29.608134+0000","last_fullsized":"2024-09-21T07:38:29.608134+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:11.041215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609320+0000","last_change":"2024-09-21T07:38:26.863298+0000","last_active":"2024-09-21T07:38:29.609320+0000","last_peered":"2024-09-21T07:38:29.609320+0000","last_clean":"2024-09-21T07:38:29.609320+0000","last_became_active":"2024-09-21T07:38:26.862983+0000","last_became_peered":"2024-09-21T07:38:26.862983+0000","last_unstale":"2024-09-21T07:38:29.609320+0000","last_undegraded":"2024-09-21T07:38:29.609320+0000","last_fullsized":"2024-09-21T07:38:29.609320+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:49.468254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609965+0000","last_change":"2024-09-21T07:38:27.889318+0000","last_active":"2024-09-21T07:38:29.609965+0000","last_peered":"2024-09-21T07:38:29.609965+0000","last_clean":"2024-09-21T07:38:29.609965+0000","last_became_active":"2024-09-21T07:38:27.888973+0000","last_became_peered":"2024-09-21T07:38:27.888973+0000","last_unstale":"2024-09-21T07:38:29.609965+0000","last_undegraded":"2024-09-21T07:38:29.609965+0000","last_fullsized":"2024-09-21T07:38:29.609965+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.057340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610476+0000","last_change":"2024-09-21T07:38:26.874143+0000","last_active":"2024-09-21T07:38:29.610476+0000","last_peered":"2024-09-21T07:38:29.610476+0000","last_clean":"2024-09-21T07:38:29.610476+0000","last_became_active":"2024-09-21T07:38:26.873839+0000","last_became_peered":"2024-09-21T07:38:26.873839+0000","last_unstale":"2024-09-21T07:38:29.610476+0000","last_undegraded":"2024-09-21T07:38:29.610476+0000","last_fullsized":"2024-09-21T07:38:29.610476+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:50.780045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607793+0000","last_change":"2024-09-21T07:38:27.887611+0000","last_active":"2024-09-21T07:38:29.607793+0000","last_peered":"2024-09-21T07:38:29.607793+0000","last_clean":"2024-09-21T07:38:29.607793+0000","last_became_active":"2024-09-21T07:38:27.887295+0000","last_became_peered":"2024-09-21T07:38:27.887295+0000","last_unstale":"2024-09-21T07:38:29.607793+0000","last_undegraded":"2024-09-21T07:38:29.607793+0000","last_fullsized":"2024-09-21T07:38:29.607793+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:01.482431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.606880+0000","last_change":"2024-09-21T07:38:26.861747+0000","last_active":"2024-09-21T07:38:29.606880+0000","last_peered":"2024-09-21T07:38:29.606880+0000","last_clean":"2024-09-21T07:38:29.606880+0000","last_became_active":"2024-09-21T07:38:26.861414+0000","last_became_peered":"2024-09-21T07:38:26.861414+0000","last_unstale":"2024-09-21T07:38:29.606880+0000","last_undegraded":"2024-09-21T07:38:29.606880+0000","last_fullsized":"2024-09-21T07:38:29.606880+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:14.221292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880150+0000","last_change":"2024-09-21T07:38:27.908116+0000","last_active":"2024-09-21T07:38:28.880150+0000","last_peered":"2024-09-21T07:38:28.880150+0000","last_clean":"2024-09-21T07:38:28.880150+0000","last_became_active":"2024-09-21T07:38:27.906137+0000","last_became_peered":"2024-09-21T07:38:27.906137+0000","last_unstale":"2024-09-21T07:38:28.880150+0000","last_undegraded":"2024-09-21T07:38:28.880150+0000","last_fullsized":"2024-09-21T07:38:28.880150+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:28.691558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608666+0000","last_change":"2024-09-21T07:38:26.857528+0000","last_active":"2024-09-21T07:38:29.608666+0000","last_peered":"2024-09-21T07:38:29.608666+0000","last_clean":"2024-09-21T07:38:29.608666+0000","last_became_active":"2024-09-21T07:38:26.857087+0000","last_became_peered":"2024-09-21T07:38:26.857087+0000","last_unstale":"2024-09-21T07:38:29.608666+0000","last_undegraded":"2024-09-21T07:38:29.608666+0000","last_fullsized":"2024-09-21T07:38:29.608666+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:56.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880475+0000","last_change":"2024-09-21T07:38:27.900713+0000","last_active":"2024-09-21T07:38:28.880475+0000","last_peered":"2024-09-21T07:38:28.880475+0000","last_clean":"2024-09-21T07:38:28.880475+0000","last_became_active":"2024-09-21T07:38:27.900385+0000","last_became_peered":"2024-09-21T07:38:27.900385+0000","last_unstale":"2024-09-21T07:38:28.880475+0000","last_undegraded":"2024-09-21T07:38:28.880475+0000","last_fullsized":"2024-09-21T07:38:28.880475+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:55.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880521+0000","last_change":"2024-09-21T07:38:26.874002+0000","last_active":"2024-09-21T07:38:28.880521+0000","last_peered":"2024-09-21T07:38:28.880521+0000","last_clean":"2024-09-21T07:38:28.880521+0000","last_became_active":"2024-09-21T07:38:26.873678+0000","last_became_peered":"2024-09-21T07:38:26.873678+0000","last_unstale":"2024-09-21T07:38:28.880521+0000","last_undegraded":"2024-09-21T07:38:28.880521+0000","last_fullsized":"2024-09-21T07:38:28.880521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:35.150025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609070+0000","last_change":"2024-09-21T07:38:27.892140+0000","last_active":"2024-09-21T07:38:29.609070+0000","last_peered":"2024-09-21T07:38:29.609070+0000","last_clean":"2024-09-21T07:38:29.609070+0000","last_became_active":"2024-09-21T07:38:27.891752+0000","last_became_peered":"2024-09-21T07:38:27.891752+0000","last_unstale":"2024-09-21T07:38:29.609070+0000","last_undegraded":"2024-09-21T07:38:29.609070+0000","last_fullsized":"2024-09-21T07:38:29.609070+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:37.821445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608337+0000","last_change":"2024-09-21T07:38:26.863704+0000","last_active":"2024-09-21T07:38:29.608337+0000","last_peered":"2024-09-21T07:38:29.608337+0000","last_clean":"2024-09-21T07:38:29.608337+0000","last_became_active":"2024-09-21T07:38:26.863365+0000","last_became_peered":"2024-09-21T07:38:26.863365+0000","last_unstale":"2024-09-21T07:38:29.608337+0000","last_undegraded":"2024-09-21T07:38:29.608337+0000","last_fullsized":"2024-09-21T07:38:29.608337+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:37.651147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881302+0000","last_change":"2024-09-21T07:38:27.903378+0000","last_active":"2024-09-21T07:38:28.881302+0000","last_peered":"2024-09-21T07:38:28.881302+0000","last_clean":"2024-09-21T07:38:28.881302+0000","last_became_active":"2024-09-21T07:38:27.903151+0000","last_became_peered":"2024-09-21T07:38:27.903151+0000","last_unstale":"2024-09-21T07:38:28.881302+0000","last_undegraded":"2024-09-21T07:38:28.881302+0000","last_fullsized":"2024-09-21T07:38:28.881302+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:13.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"228'3","reported_seq":18,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880327+0000","last_change":"2024-09-21T07:38:26.873389+0000","last_active":"2024-09-21T07:38:28.880327+0000","last_peered":"2024-09-21T07:38:28.880327+0000","last_clean":"2024-09-21T07:38:28.880327+0000","last_became_active":"2024-09-21T07:38:26.872013+0000","last_became_peered":"2024-09-21T07:38:26.872013+0000","last_unstale":"2024-09-21T07:38:28.880327+0000","last_undegraded":"2024-09-21T07:38:28.880327+0000","last_fullsized":"2024-09-21T07:38:28.880327+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880289+0000","last_change":"2024-09-21T07:38:27.890847+0000","last_active":"2024-09-21T07:38:28.880289+0000","last_peered":"2024-09-21T07:38:28.880289+0000","last_clean":"2024-09-21T07:38:28.880289+0000","last_became_active":"2024-09-21T07:38:27.890507+0000","last_became_peered":"2024-09-21T07:38:27.890507+0000","last_unstale":"2024-09-21T07:38:28.880289+0000","last_undegraded":"2024-09-21T07:38:28.880289+0000","last_fullsized":"2024-09-21T07:38:28.880289+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:15.231397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"228'6","reported_seq":21,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608816+0000","last_change":"2024-09-21T07:38:26.878447+0000","last_active":"2024-09-21T07:38:29.608816+0000","last_peered":"2024-09-21T07:38:29.608816+0000","last_clean":"2024-09-21T07:38:29.608816+0000","last_became_active":"2024-09-21T07:38:26.873257+0000","last_became_peered":"2024-09-21T07:38:26.873257+0000","last_unstale":"2024-09-21T07:38:29.608816+0000","last_undegraded":"2024-09-21T07:38:29.608816+0000","last_fullsized":"2024-09-21T07:38:29.608816+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608526+0000","last_change":"2024-09-21T07:38:27.885087+0000","last_active":"2024-09-21T07:38:29.608526+0000","last_peered":"2024-09-21T07:38:29.608526+0000","last_clean":"2024-09-21T07:38:29.608526+0000","last_became_active":"2024-09-21T07:38:27.884736+0000","last_became_peered":"2024-09-21T07:38:27.884736+0000","last_unstale":"2024-09-21T07:38:29.608526+0000","last_undegraded":"2024-09-21T07:38:29.608526+0000","last_fullsized":"2024-09-21T07:38:29.608526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609452+0000","last_change":"2024-09-21T07:38:26.861682+0000","last_active":"2024-09-21T07:38:29.609452+0000","last_peered":"2024-09-21T07:38:29.609452+0000","last_clean":"2024-09-21T07:38:29.609452+0000","last_became_active":"2024-09-21T07:38:26.861289+0000","last_became_peered":"2024-09-21T07:38:26.861289+0000","last_unstale":"2024-09-21T07:38:29.609452+0000","last_undegraded":"2024-09-21T07:38:29.609452+0000","last_fullsized":"2024-09-21T07:38:29.609452+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:53.971300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.878941+0000","last_change":"2024-09-21T07:38:27.883877+0000","last_active":"2024-09-21T07:38:28.878941+0000","last_peered":"2024-09-21T07:38:28.878941+0000","last_clean":"2024-09-21T07:38:28.878941+0000","last_became_active":"2024-09-21T07:38:27.883545+0000","last_became_peered":"2024-09-21T07:38:27.883545+0000","last_unstale":"2024-09-21T07:38:28.878941+0000","last_undegraded":"2024-09-21T07:38:28.878941+0000","last_fullsized":"2024-09-21T07:38:28.878941+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:17.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879903+0000","last_change":"2024-09-21T07:38:26.878489+0000","last_active":"2024-09-21T07:38:28.879903+0000","last_peered":"2024-09-21T07:38:28.879903+0000","last_clean":"2024-09-21T07:38:28.879903+0000","last_became_active":"2024-09-21T07:38:26.876983+0000","last_became_peered":"2024-09-21T07:38:26.876983+0000","last_unstale":"2024-09-21T07:38:28.879903+0000","last_undegraded":"2024-09-21T07:38:28.879903+0000","last_fullsized":"2024-09-21T07:38:28.879903+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:52.976040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608578+0000","last_change":"2024-09-21T07:38:27.890069+0000","last_active":"2024-09-21T07:38:29.608578+0000","last_peered":"2024-09-21T07:38:29.608578+0000","last_clean":"2024-09-21T07:38:29.608578+0000","last_became_active":"2024-09-21T07:38:27.889714+0000","last_became_peered":"2024-09-21T07:38:27.889714+0000","last_unstale":"2024-09-21T07:38:29.608578+0000","last_undegraded":"2024-09-21T07:38:29.608578+0000","last_fullsized":"2024-09-21T07:38:29.608578+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:19.806030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879576+0000","last_change":"2024-09-21T07:38:26.874628+0000","last_active":"2024-09-21T07:38:28.879576+0000","last_peered":"2024-09-21T07:38:28.879576+0000","last_clean":"2024-09-21T07:38:28.879576+0000","last_became_active":"2024-09-21T07:38:26.874332+0000","last_became_peered":"2024-09-21T07:38:26.874332+0000","last_unstale":"2024-09-21T07:38:28.879576+0000","last_undegraded":"2024-09-21T07:38:28.879576+0000","last_fullsized":"2024-09-21T07:38:28.879576+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:59.212092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609139+0000","last_change":"2024-09-21T07:38:27.887846+0000","last_active":"2024-09-21T07:38:29.609139+0000","last_peered":"2024-09-21T07:38:29.609139+0000","last_clean":"2024-09-21T07:38:29.609139+0000","last_became_active":"2024-09-21T07:38:27.887479+0000","last_became_peered":"2024-09-21T07:38:27.887479+0000","last_unstale":"2024-09-21T07:38:29.609139+0000","last_undegraded":"2024-09-21T07:38:29.609139+0000","last_fullsized":"2024-09-21T07:38:29.609139+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:24.745605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"228'8","reported_seq":23,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879702+0000","last_change":"2024-09-21T07:38:26.878210+0000","last_active":"2024-09-21T07:38:28.879702+0000","last_peered":"2024-09-21T07:38:28.879702+0000","last_clean":"2024-09-21T07:38:28.879702+0000","last_became_active":"2024-09-21T07:38:26.875824+0000","last_became_peered":"2024-09-21T07:38:26.875824+0000","last_unstale":"2024-09-21T07:38:28.879702+0000","last_undegraded":"2024-09-21T07:38:28.879702+0000","last_fullsized":"2024-09-21T07:38:28.879702+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:18.519770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879610+0000","last_change":"2024-09-21T07:38:27.886965+0000","last_active":"2024-09-21T07:38:28.879610+0000","last_peered":"2024-09-21T07:38:28.879610+0000","last_clean":"2024-09-21T07:38:28.879610+0000","last_became_active":"2024-09-21T07:38:27.886576+0000","last_became_peered":"2024-09-21T07:38:27.886576+0000","last_unstale":"2024-09-21T07:38:28.879610+0000","last_undegraded":"2024-09-21T07:38:28.879610+0000","last_fullsized":"2024-09-21T07:38:28.879610+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:09.644730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881574+0000","last_change":"2024-09-21T07:38:26.873212+0000","last_active":"2024-09-21T07:38:28.881574+0000","last_peered":"2024-09-21T07:38:28.881574+0000","last_clean":"2024-09-21T07:38:28.881574+0000","last_became_active":"2024-09-21T07:38:26.872886+0000","last_became_peered":"2024-09-21T07:38:26.872886+0000","last_unstale":"2024-09-21T07:38:28.881574+0000","last_undegraded":"2024-09-21T07:38:28.881574+0000","last_fullsized":"2024-09-21T07:38:28.881574+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:26.601076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879909+0000","last_change":"2024-09-21T07:38:27.888113+0000","last_active":"2024-09-21T07:38:28.879909+0000","last_peered":"2024-09-21T07:38:28.879909+0000","last_clean":"2024-09-21T07:38:28.879909+0000","last_became_active":"2024-09-21T07:38:27.887808+0000","last_became_peered":"2024-09-21T07:38:27.887808+0000","last_unstale":"2024-09-21T07:38:28.879909+0000","last_undegraded":"2024-09-21T07:38:28.879909+0000","last_fullsized":"2024-09-21T07:38:28.879909+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:47.025027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608671+0000","last_change":"2024-09-21T07:38:26.878845+0000","last_active":"2024-09-21T07:38:29.608671+0000","last_peered":"2024-09-21T07:38:29.608671+0000","last_clean":"2024-09-21T07:38:29.608671+0000","last_became_active":"2024-09-21T07:38:26.878455+0000","last_became_peered":"2024-09-21T07:38:26.878455+0000","last_unstale":"2024-09-21T07:38:29.608671+0000","last_undegraded":"2024-09-21T07:38:29.608671+0000","last_fullsized":"2024-09-21T07:38:29.608671+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.675782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880473+0000","last_change":"2024-09-21T07:38:27.905110+0000","last_active":"2024-09-21T07:38:28.880473+0000","last_peered":"2024-09-21T07:38:28.880473+0000","last_clean":"2024-09-21T07:38:28.880473+0000","last_became_active":"2024-09-21T07:38:27.904752+0000","last_became_peered":"2024-09-21T07:38:27.904752+0000","last_unstale":"2024-09-21T07:38:28.880473+0000","last_undegraded":"2024-09-21T07:38:28.880473+0000","last_fullsized":"2024-09-21T07:38:28.880473+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:04.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607894+0000","last_change":"2024-09-21T07:38:26.868486+0000","last_active":"2024-09-21T07:38:29.607894+0000","last_peered":"2024-09-21T07:38:29.607894+0000","last_clean":"2024-09-21T07:38:29.607894+0000","last_became_active":"2024-09-21T07:38:26.867803+0000","last_became_peered":"2024-09-21T07:38:26.867803+0000","last_unstale":"2024-09-21T07:38:29.607894+0000","last_undegraded":"2024-09-21T07:38:29.607894+0000","last_fullsized":"2024-09-21T07:38:29.607894+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:48.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880538+0000","last_change":"2024-09-21T07:38:27.879254+0000","last_active":"2024-09-21T07:38:28.880538+0000","last_peered":"2024-09-21T07:38:28.880538+0000","last_clean":"2024-09-21T07:38:28.880538+0000","last_became_active":"2024-09-21T07:38:27.878635+0000","last_became_peered":"2024-09-21T07:38:27.878635+0000","last_unstale":"2024-09-21T07:38:28.880538+0000","last_undegraded":"2024-09-21T07:38:28.880538+0000","last_fullsized":"2024-09-21T07:38:28.880538+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:11.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608238+0000","last_change":"2024-09-21T07:38:26.879661+0000","last_active":"2024-09-21T07:38:29.608238+0000","last_peered":"2024-09-21T07:38:29.608238+0000","last_clean":"2024-09-21T07:38:29.608238+0000","last_became_active":"2024-09-21T07:38:26.879329+0000","last_became_peered":"2024-09-21T07:38:26.879329+0000","last_unstale":"2024-09-21T07:38:29.608238+0000","last_undegraded":"2024-09-21T07:38:29.608238+0000","last_fullsized":"2024-09-21T07:38:29.608238+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:38.606190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609616+0000","last_change":"2024-09-21T07:38:27.887670+0000","last_active":"2024-09-21T07:38:29.609616+0000","last_peered":"2024-09-21T07:38:29.609616+0000","last_clean":"2024-09-21T07:38:29.609616+0000","last_became_active":"2024-09-21T07:38:27.887331+0000","last_became_peered":"2024-09-21T07:38:27.887331+0000","last_unstale":"2024-09-21T07:38:29.609616+0000","last_undegraded":"2024-09-21T07:38:29.609616+0000","last_fullsized":"2024-09-21T07:38:29.609616+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.716999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609549+0000","last_change":"2024-09-21T07:38:26.881447+0000","last_active":"2024-09-21T07:38:29.609549+0000","last_peered":"2024-09-21T07:38:29.609549+0000","last_clean":"2024-09-21T07:38:29.609549+0000","last_became_active":"2024-09-21T07:38:26.880826+0000","last_became_peered":"2024-09-21T07:38:26.880826+0000","last_unstale":"2024-09-21T07:38:29.609549+0000","last_undegraded":"2024-09-21T07:38:29.609549+0000","last_fullsized":"2024-09-21T07:38:29.609549+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:05.538164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879014+0000","last_change":"2024-09-21T07:38:27.898273+0000","last_active":"2024-09-21T07:38:28.879014+0000","last_peered":"2024-09-21T07:38:28.879014+0000","last_clean":"2024-09-21T07:38:28.879014+0000","last_became_active":"2024-09-21T07:38:27.897709+0000","last_became_peered":"2024-09-21T07:38:27.897709+0000","last_unstale":"2024-09-21T07:38:28.879014+0000","last_undegraded":"2024-09-21T07:38:28.879014+0000","last_fullsized":"2024-09-21T07:38:28.879014+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.163585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608592+0000","last_change":"2024-09-21T07:38:26.855037+0000","last_active":"2024-09-21T07:38:29.608592+0000","last_peered":"2024-09-21T07:38:29.608592+0000","last_clean":"2024-09-21T07:38:29.608592+0000","last_became_active":"2024-09-21T07:38:26.854720+0000","last_became_peered":"2024-09-21T07:38:26.854720+0000","last_unstale":"2024-09-21T07:38:29.608592+0000","last_undegraded":"2024-09-21T07:38:29.608592+0000","last_fullsized":"2024-09-21T07:38:29.608592+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:36.231632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879939+0000","last_change":"2024-09-21T07:38:27.906211+0000","last_active":"2024-09-21T07:38:28.879939+0000","last_peered":"2024-09-21T07:38:28.879939+0000","last_clean":"2024-09-21T07:38:28.879939+0000","last_became_active":"2024-09-21T07:38:27.905909+0000","last_became_peered":"2024-09-21T07:38:27.905909+0000","last_unstale":"2024-09-21T07:38:28.879939+0000","last_undegraded":"2024-09-21T07:38:28.879939+0000","last_fullsized":"2024-09-21T07:38:28.879939+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:33.469346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610395+0000","last_change":"2024-09-21T07:38:26.870394+0000","last_active":"2024-09-21T07:38:29.610395+0000","last_peered":"2024-09-21T07:38:29.610395+0000","last_clean":"2024-09-21T07:38:29.610395+0000","last_became_active":"2024-09-21T07:38:26.869897+0000","last_became_peered":"2024-09-21T07:38:26.869897+0000","last_unstale":"2024-09-21T07:38:29.610395+0000","last_undegraded":"2024-09-21T07:38:29.610395+0000","last_fullsized":"2024-09-21T07:38:29.610395+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:53.627605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610160+0000","last_change":"2024-09-21T07:38:27.897596+0000","last_active":"2024-09-21T07:38:29.610160+0000","last_peered":"2024-09-21T07:38:29.610160+0000","last_clean":"2024-09-21T07:38:29.610160+0000","last_became_active":"2024-09-21T07:38:27.897268+0000","last_became_peered":"2024-09-21T07:38:27.897268+0000","last_unstale":"2024-09-21T07:38:29.610160+0000","last_undegraded":"2024-09-21T07:38:29.610160+0000","last_fullsized":"2024-09-21T07:38:29.610160+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:52.817770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879707+0000","last_change":"2024-09-21T07:38:26.877812+0000","last_active":"2024-09-21T07:38:28.879707+0000","last_peered":"2024-09-21T07:38:28.879707+0000","last_clean":"2024-09-21T07:38:28.879707+0000","last_became_active":"2024-09-21T07:38:26.877017+0000","last_became_peered":"2024-09-21T07:38:26.877017+0000","last_unstale":"2024-09-21T07:38:28.879707+0000","last_undegraded":"2024-09-21T07:38:28.879707+0000","last_fullsized":"2024-09-21T07:38:28.879707+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:31.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881705+0000","last_change":"2024-09-21T07:38:27.896317+0000","last_active":"2024-09-21T07:38:28.881705+0000","last_peered":"2024-09-21T07:38:28.881705+0000","last_clean":"2024-09-21T07:38:28.881705+0000","last_became_active":"2024-09-21T07:38:27.895976+0000","last_became_peered":"2024-09-21T07:38:27.895976+0000","last_unstale":"2024-09-21T07:38:28.881705+0000","last_undegraded":"2024-09-21T07:38:28.881705+0000","last_fullsized":"2024-09-21T07:38:28.881705+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:35.460608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880453+0000","last_change":"2024-09-21T07:38:26.877423+0000","last_active":"2024-09-21T07:38:28.880453+0000","last_peered":"2024-09-21T07:38:28.880453+0000","last_clean":"2024-09-21T07:38:28.880453+0000","last_became_active":"2024-09-21T07:38:26.875883+0000","last_became_peered":"2024-09-21T07:38:26.875883+0000","last_unstale":"2024-09-21T07:38:28.880453+0000","last_undegraded":"2024-09-21T07:38:28.880453+0000","last_fullsized":"2024-09-21T07:38:28.880453+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:12.421136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881526+0000","last_change":"2024-09-21T07:38:27.904807+0000","last_active":"2024-09-21T07:38:28.881526+0000","last_peered":"2024-09-21T07:38:28.881526+0000","last_clean":"2024-09-21T07:38:28.881526+0000","last_became_active":"2024-09-21T07:38:27.904462+0000","last_became_peered":"2024-09-21T07:38:27.904462+0000","last_unstale":"2024-09-21T07:38:28.881526+0000","last_undegraded":"2024-09-21T07:38:28.881526+0000","last_fullsized":"2024-09-21T07:38:28.881526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:30.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"229'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608961+0000","last_change":"2024-09-21T07:38:26.876682+0000","last_active":"2024-09-21T07:38:29.608961+0000","last_peered":"2024-09-21T07:38:29.608961+0000","last_clean":"2024-09-21T07:38:29.608961+0000","last_became_active":"2024-09-21T07:38:26.874751+0000","last_became_peered":"2024-09-21T07:38:26.874751+0000","last_unstale":"2024-09-21T07:38:29.608961+0000","last_undegraded":"2024-09-21T07:38:29.608961+0000","last_fullsized":"2024-09-21T07:38:29.608961+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:34.005502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607549+0000","last_change":"2024-09-21T07:38:27.890376+0000","last_active":"2024-09-21T07:38:29.607549+0000","last_peered":"2024-09-21T07:38:29.607549+0000","last_clean":"2024-09-21T07:38:29.607549+0000","last_became_active":"2024-09-21T07:38:27.888071+0000","last_became_peered":"2024-09-21T07:38:27.888071+0000","last_unstale":"2024-09-21T07:38:29.607549+0000","last_undegraded":"2024-09-21T07:38:29.607549+0000","last_fullsized":"2024-09-21T07:38:29.607549+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:19.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608005+0000","last_change":"2024-09-21T07:38:26.868126+0000","last_active":"2024-09-21T07:38:29.608005+0000","last_peered":"2024-09-21T07:38:29.608005+0000","last_clean":"2024-09-21T07:38:29.608005+0000","last_became_active":"2024-09-21T07:38:26.867386+0000","last_became_peered":"2024-09-21T07:38:26.867386+0000","last_unstale":"2024-09-21T07:38:29.608005+0000","last_undegraded":"2024-09-21T07:38:29.608005+0000","last_fullsized":"2024-09-21T07:38:29.608005+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:44.795985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881462+0000","last_change":"2024-09-21T07:38:27.900241+0000","last_active":"2024-09-21T07:38:28.881462+0000","last_peered":"2024-09-21T07:38:28.881462+0000","last_clean":"2024-09-21T07:38:28.881462+0000","last_became_active":"2024-09-21T07:38:27.899917+0000","last_became_peered":"2024-09-21T07:38:27.899917+0000","last_unstale":"2024-09-21T07:38:28.881462+0000","last_undegraded":"2024-09-21T07:38:28.881462+0000","last_fullsized":"2024-09-21T07:38:28.881462+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:19.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607820+0000","last_change":"2024-09-21T07:38:26.867671+0000","last_active":"2024-09-21T07:38:29.607820+0000","last_peered":"2024-09-21T07:38:29.607820+0000","last_clean":"2024-09-21T07:38:29.607820+0000","last_became_active":"2024-09-21T07:38:26.867315+0000","last_became_peered":"2024-09-21T07:38:26.867315+0000","last_unstale":"2024-09-21T07:38:29.607820+0000","last_undegraded":"2024-09-21T07:38:29.607820+0000","last_fullsized":"2024-09-21T07:38:29.607820+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:37.651147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879528+0000","last_change":"2024-09-21T07:38:27.906372+0000","last_active":"2024-09-21T07:38:28.879528+0000","last_peered":"2024-09-21T07:38:28.879528+0000","last_clean":"2024-09-21T07:38:28.879528+0000","last_became_active":"2024-09-21T07:38:27.905712+0000","last_became_peered":"2024-09-21T07:38:27.905712+0000","last_unstale":"2024-09-21T07:38:28.879528+0000","last_undegraded":"2024-09-21T07:38:28.879528+0000","last_fullsized":"2024-09-21T07:38:28.879528+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:07.010954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608228+0000","last_change":"2024-09-21T07:38:26.876537+0000","last_active":"2024-09-21T07:38:29.608228+0000","last_peered":"2024-09-21T07:38:29.608228+0000","last_clean":"2024-09-21T07:38:29.608228+0000","last_became_active":"2024-09-21T07:38:26.874643+0000","last_became_peered":"2024-09-21T07:38:26.874643+0000","last_unstale":"2024-09-21T07:38:29.608228+0000","last_undegraded":"2024-09-21T07:38:29.608228+0000","last_fullsized":"2024-09-21T07:38:29.608228+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:59.439652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610406+0000","last_change":"2024-09-21T07:38:27.895714+0000","last_active":"2024-09-21T07:38:29.610406+0000","last_peered":"2024-09-21T07:38:29.610406+0000","last_clean":"2024-09-21T07:38:29.610406+0000","last_became_active":"2024-09-21T07:38:27.895366+0000","last_became_peered":"2024-09-21T07:38:27.895366+0000","last_unstale":"2024-09-21T07:38:29.610406+0000","last_undegraded":"2024-09-21T07:38:29.610406+0000","last_fullsized":"2024-09-21T07:38:29.610406+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:36.085587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608007+0000","last_change":"2024-09-21T07:38:26.875309+0000","last_active":"2024-09-21T07:38:29.608007+0000","last_peered":"2024-09-21T07:38:29.608007+0000","last_clean":"2024-09-21T07:38:29.608007+0000","last_became_active":"2024-09-21T07:38:26.874985+0000","last_became_peered":"2024-09-21T07:38:26.874985+0000","last_unstale":"2024-09-21T07:38:29.608007+0000","last_undegraded":"2024-09-21T07:38:29.608007+0000","last_fullsized":"2024-09-21T07:38:29.608007+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:38.761653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610100+0000","last_change":"2024-09-21T07:38:27.909935+0000","last_active":"2024-09-21T07:38:29.610100+0000","last_peered":"2024-09-21T07:38:29.610100+0000","last_clean":"2024-09-21T07:38:29.610100+0000","last_became_active":"2024-09-21T07:38:27.909628+0000","last_became_peered":"2024-09-21T07:38:27.909628+0000","last_unstale":"2024-09-21T07:38:29.610100+0000","last_undegraded":"2024-09-21T07:38:29.610100+0000","last_fullsized":"2024-09-21T07:38:29.610100+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:40.519170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607347+0000","last_change":"2024-09-21T07:38:26.871500+0000","last_active":"2024-09-21T07:38:29.607347+0000","last_peered":"2024-09-21T07:38:29.607347+0000","last_clean":"2024-09-21T07:38:29.607347+0000","last_became_active":"2024-09-21T07:38:26.871155+0000","last_became_peered":"2024-09-21T07:38:26.871155+0000","last_unstale":"2024-09-21T07:38:29.607347+0000","last_undegraded":"2024-09-21T07:38:29.607347+0000","last_fullsized":"2024-09-21T07:38:29.607347+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:53.379186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607200+0000","last_change":"2024-09-21T07:38:27.893796+0000","last_active":"2024-09-21T07:38:29.607200+0000","last_peered":"2024-09-21T07:38:29.607200+0000","last_clean":"2024-09-21T07:38:29.607200+0000","last_became_active":"2024-09-21T07:38:27.892406+0000","last_became_peered":"2024-09-21T07:38:27.892406+0000","last_unstale":"2024-09-21T07:38:29.607200+0000","last_undegraded":"2024-09-21T07:38:29.607200+0000","last_fullsized":"2024-09-21T07:38:29.607200+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:02.165837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608011+0000","last_change":"2024-09-21T07:38:26.862884+0000","last_active":"2024-09-21T07:38:29.608011+0000","last_peered":"2024-09-21T07:38:29.608011+0000","last_clean":"2024-09-21T07:38:29.608011+0000","last_became_active":"2024-09-21T07:38:26.861444+0000","last_became_peered":"2024-09-21T07:38:26.861444+0000","last_unstale":"2024-09-21T07:38:29.608011+0000","last_undegraded":"2024-09-21T07:38:29.608011+0000","last_fullsized":"2024-09-21T07:38:29.608011+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:32.785876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879863+0000","last_change":"2024-09-21T07:38:27.909367+0000","last_active":"2024-09-21T07:38:28.879863+0000","last_peered":"2024-09-21T07:38:28.879863+0000","last_clean":"2024-09-21T07:38:28.879863+0000","last_became_active":"2024-09-21T07:38:27.907346+0000","last_became_peered":"2024-09-21T07:38:27.907346+0000","last_unstale":"2024-09-21T07:38:28.879863+0000","last_undegraded":"2024-09-21T07:38:28.879863+0000","last_fullsized":"2024-09-21T07:38:28.879863+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:41.726703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":490,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880588+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:38:28.880588+0000","last_peered":"2024-09-21T07:38:28.880588+0000","last_clean":"2024-09-21T07:38:28.880588+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:38:28.880588+0000","last_undegraded":"2024-09-21T07:38:28.880588+0000","last_fullsized":"2024-09-21T07:38:28.880588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509635,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56228,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315612,"statfs":{"total":96636764160,"available":96579186688,"internally_reserved":0,"allocated":2895872,"data_stored":1369939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56224,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315616,"statfs":{"total":96636764160,"available":96579190784,"internally_reserved":0,"allocated":2895872,"data_stored":1369975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":2904064,"data_stored":1371517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509635,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60404,"kb_used_data":2844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311436,"statfs":{"total":96636764160,"available":96574910464,"internally_reserved":0,"allocated":2912256,"data_stored":1372121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":2899968,"data_stored":1370029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509635,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56804,"kb_used_data":3408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315036,"statfs":{"total":96636764160,"available":96578596864,"internally_reserved":0,"allocated":3489792,"data_stored":1960343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56808,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315032,"statfs":{"total":96636764160,"available":96578592768,"internally_reserved":0,"allocated":3493888,"data_stored":1960877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88096,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283744,"statfs":{"total":96636764160,"available":96546553856,"internally_reserved":0,"allocated":2895872,"data_stored":1369995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:36.786 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 -- 172.21.15.64:0/759458994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 msgr2=0x7fb2940b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 --2- 172.21.15.64:0/759458994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb2940b6b50 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fb2940cfb30 tx=0x7fb28401c5d0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 -- 172.21.15.64:0/759458994 shutdown_connections 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 --2- 172.21.15.64:0/759458994 >> v2:172.21.15.90:3300/0 conn(0x7fb2940d0af0 0x7fb2940cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 --2- 172.21.15.64:0/759458994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940afcd0 0x7fb2940d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 --2- 172.21.15.64:0/759458994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb2940b6b50 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 -- 172.21.15.64:0/759458994 >> 172.21.15.64:0/759458994 conn(0x7fb2940b2f80 msgr2=0x7fb2940b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:36.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 -- 172.21.15.64:0/759458994 shutdown_connections 2024-09-21T07:38:36.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.958+0000 7fb29a600640 1 -- 172.21.15.64:0/759458994 wait complete. 2024-09-21T07:38:36.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 Processor -- start 2024-09-21T07:38:36.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 -- start start 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 0x7fb29409eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940d0af0 0x7fb29409cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940b1740 con 0x7fb2940b2580 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940b15c0 con 0x7fb2940afcd0 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb29a600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb2940b18c0 con 0x7fb2940d0af0 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb28be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:36.964 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb28be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35052/0 (socket says 172.21.15.64:35052) 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb28be00640 1 -- 172.21.15.64:0/3937481775 learned_addr learned my addr 172.21.15.64:0/3937481775 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb293400640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 0x7fb29409eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.962+0000 7fb293e00640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940d0af0 0x7fb29409cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 -- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940d0af0 msgr2=0x7fb29409cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940d0af0 0x7fb29409cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 -- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 msgr2=0x7fb29409eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 0x7fb29409eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 -- 172.21.15.64:0/3937481775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29409bf70 con 0x7fb2940b2580 2024-09-21T07:38:36.965 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb293400640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 0x7fb29409eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28be00640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d690 tx=0x7fb27c00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c017070 con 0x7fb2940b2580 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29409c250 con 0x7fb2940b2580 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27c009b10 con 0x7fb2940b2580 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c010460 con 0x7fb2940b2580 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29415f930 con 0x7fb2940b2580 2024-09-21T07:38:36.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2940b1d70 con 0x7fb2940b2580 2024-09-21T07:38:36.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.966+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb27c01a070 con 0x7fb2940b2580 2024-09-21T07:38:36.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.970+0000 7fb28b400640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 0x7fb270075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:36.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.970+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb27c0944a0 con 0x7fb2940b2580 2024-09-21T07:38:36.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.970+0000 7fb293400640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 0x7fb270075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:36.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.970+0000 7fb293400640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 0x7fb270075710 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2840ae000 tx=0x7fb28401ae10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:36.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:36.974+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb27c05f340 con 0x7fb2940b2580 2024-09-21T07:38:37.168 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.166+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb294169520 con 0x7fb270073200 2024-09-21T07:38:37.172 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.174+0000 7fb28b400640 1 -- 172.21.15.64:0/3937481775 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7fb294169520 con 0x7fb270073200 2024-09-21T07:38:37.175 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:37.177 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 msgr2=0x7fb270075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 0x7fb270075710 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2840ae000 tx=0x7fb28401ae10 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 msgr2=0x7fb29415f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d690 tx=0x7fb27c00db50 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 shutdown_connections 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb270073200 0x7fb270075710 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2940d0af0 0x7fb29409cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2940b2580 0x7fb29415f3f0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 --2- 172.21.15.64:0/3937481775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2940afcd0 0x7fb29409eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 >> 172.21.15.64:0/3937481775 conn(0x7fb2940b2f80 msgr2=0x7fb2940b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:37.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 shutdown_connections 2024-09-21T07:38:37.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.178+0000 7fb29a600640 1 -- 172.21.15.64:0/3937481775 wait complete. 2024-09-21T07:38:37.197 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":702,"stamp":"2024-09-21T07:38:35.684693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":470388,"kb_used_data":23816,"kb_used_omap":12,"kb_used_meta":446387,"kb_avail":754504332,"statfs":{"total":773094113280,"available":772612435968,"internally_reserved":0,"allocated":24387584,"data_stored":12144796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":457100851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002544"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879359+0000","last_change":"2024-09-21T07:38:27.879589+0000","last_active":"2024-09-21T07:38:28.879359+0000","last_peered":"2024-09-21T07:38:28.879359+0000","last_clean":"2024-09-21T07:38:28.879359+0000","last_became_active":"2024-09-21T07:38:27.878983+0000","last_became_peered":"2024-09-21T07:38:27.878983+0000","last_unstale":"2024-09-21T07:38:28.879359+0000","last_undegraded":"2024-09-21T07:38:28.879359+0000","last_fullsized":"2024-09-21T07:38:28.879359+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:31.673862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610476+0000","last_change":"2024-09-21T07:38:27.896661+0000","last_active":"2024-09-21T07:38:29.610476+0000","last_peered":"2024-09-21T07:38:29.610476+0000","last_clean":"2024-09-21T07:38:29.610476+0000","last_became_active":"2024-09-21T07:38:27.894676+0000","last_became_peered":"2024-09-21T07:38:27.894676+0000","last_unstale":"2024-09-21T07:38:29.610476+0000","last_undegraded":"2024-09-21T07:38:29.610476+0000","last_fullsized":"2024-09-21T07:38:29.610476+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:11.319538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607982+0000","last_change":"2024-09-21T07:38:27.885425+0000","last_active":"2024-09-21T07:38:29.607982+0000","last_peered":"2024-09-21T07:38:29.607982+0000","last_clean":"2024-09-21T07:38:29.607982+0000","last_became_active":"2024-09-21T07:38:27.885036+0000","last_became_peered":"2024-09-21T07:38:27.885036+0000","last_unstale":"2024-09-21T07:38:29.607982+0000","last_undegraded":"2024-09-21T07:38:29.607982+0000","last_fullsized":"2024-09-21T07:38:29.607982+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:37.642858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880663+0000","last_change":"2024-09-21T07:38:27.902273+0000","last_active":"2024-09-21T07:38:28.880663+0000","last_peered":"2024-09-21T07:38:28.880663+0000","last_clean":"2024-09-21T07:38:28.880663+0000","last_became_active":"2024-09-21T07:38:27.901903+0000","last_became_peered":"2024-09-21T07:38:27.901903+0000","last_unstale":"2024-09-21T07:38:28.880663+0000","last_undegraded":"2024-09-21T07:38:28.880663+0000","last_fullsized":"2024-09-21T07:38:28.880663+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:58.406221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608625+0000","last_change":"2024-09-21T07:38:27.902541+0000","last_active":"2024-09-21T07:38:29.608625+0000","last_peered":"2024-09-21T07:38:29.608625+0000","last_clean":"2024-09-21T07:38:29.608625+0000","last_became_active":"2024-09-21T07:38:27.901895+0000","last_became_peered":"2024-09-21T07:38:27.901895+0000","last_unstale":"2024-09-21T07:38:29.608625+0000","last_undegraded":"2024-09-21T07:38:29.608625+0000","last_fullsized":"2024-09-21T07:38:29.608625+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:49.529775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880971+0000","last_change":"2024-09-21T07:38:27.890574+0000","last_active":"2024-09-21T07:38:28.880971+0000","last_peered":"2024-09-21T07:38:28.880971+0000","last_clean":"2024-09-21T07:38:28.880971+0000","last_became_active":"2024-09-21T07:38:27.887320+0000","last_became_peered":"2024-09-21T07:38:27.887320+0000","last_unstale":"2024-09-21T07:38:28.880971+0000","last_undegraded":"2024-09-21T07:38:28.880971+0000","last_fullsized":"2024-09-21T07:38:28.880971+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:40.556500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607269+0000","last_change":"2024-09-21T07:38:27.882423+0000","last_active":"2024-09-21T07:38:29.607269+0000","last_peered":"2024-09-21T07:38:29.607269+0000","last_clean":"2024-09-21T07:38:29.607269+0000","last_became_active":"2024-09-21T07:38:27.882093+0000","last_became_peered":"2024-09-21T07:38:27.882093+0000","last_unstale":"2024-09-21T07:38:29.607269+0000","last_undegraded":"2024-09-21T07:38:29.607269+0000","last_fullsized":"2024-09-21T07:38:29.607269+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:31.161287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879529+0000","last_change":"2024-09-21T07:38:27.907654+0000","last_active":"2024-09-21T07:38:28.879529+0000","last_peered":"2024-09-21T07:38:28.879529+0000","last_clean":"2024-09-21T07:38:28.879529+0000","last_became_active":"2024-09-21T07:38:27.906066+0000","last_became_peered":"2024-09-21T07:38:27.906066+0000","last_unstale":"2024-09-21T07:38:28.879529+0000","last_undegraded":"2024-09-21T07:38:28.879529+0000","last_fullsized":"2024-09-21T07:38:28.879529+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:24.486499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881469+0000","last_change":"2024-09-21T07:38:27.897228+0000","last_active":"2024-09-21T07:38:28.881469+0000","last_peered":"2024-09-21T07:38:28.881469+0000","last_clean":"2024-09-21T07:38:28.881469+0000","last_became_active":"2024-09-21T07:38:27.896883+0000","last_became_peered":"2024-09-21T07:38:27.896883+0000","last_unstale":"2024-09-21T07:38:28.881469+0000","last_undegraded":"2024-09-21T07:38:28.881469+0000","last_fullsized":"2024-09-21T07:38:28.881469+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:51.166601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608154+0000","last_change":"2024-09-21T07:38:27.890067+0000","last_active":"2024-09-21T07:38:29.608154+0000","last_peered":"2024-09-21T07:38:29.608154+0000","last_clean":"2024-09-21T07:38:29.608154+0000","last_became_active":"2024-09-21T07:38:27.888565+0000","last_became_peered":"2024-09-21T07:38:27.888565+0000","last_unstale":"2024-09-21T07:38:29.608154+0000","last_undegraded":"2024-09-21T07:38:29.608154+0000","last_fullsized":"2024-09-21T07:38:29.608154+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:26.031547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879448+0000","last_change":"2024-09-21T07:38:27.886035+0000","last_active":"2024-09-21T07:38:28.879448+0000","last_peered":"2024-09-21T07:38:28.879448+0000","last_clean":"2024-09-21T07:38:28.879448+0000","last_became_active":"2024-09-21T07:38:27.885689+0000","last_became_peered":"2024-09-21T07:38:27.885689+0000","last_unstale":"2024-09-21T07:38:28.879448+0000","last_undegraded":"2024-09-21T07:38:28.879448+0000","last_fullsized":"2024-09-21T07:38:28.879448+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:27.514856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881624+0000","last_change":"2024-09-21T07:38:27.895619+0000","last_active":"2024-09-21T07:38:28.881624+0000","last_peered":"2024-09-21T07:38:28.881624+0000","last_clean":"2024-09-21T07:38:28.881624+0000","last_became_active":"2024-09-21T07:38:27.895269+0000","last_became_peered":"2024-09-21T07:38:27.895269+0000","last_unstale":"2024-09-21T07:38:28.881624+0000","last_undegraded":"2024-09-21T07:38:28.881624+0000","last_fullsized":"2024-09-21T07:38:28.881624+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:48.794383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879845+0000","last_change":"2024-09-21T07:38:27.908331+0000","last_active":"2024-09-21T07:38:28.879845+0000","last_peered":"2024-09-21T07:38:28.879845+0000","last_clean":"2024-09-21T07:38:28.879845+0000","last_became_active":"2024-09-21T07:38:27.906446+0000","last_became_peered":"2024-09-21T07:38:27.906446+0000","last_unstale":"2024-09-21T07:38:28.879845+0000","last_undegraded":"2024-09-21T07:38:28.879845+0000","last_fullsized":"2024-09-21T07:38:28.879845+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:24.108120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610015+0000","last_change":"2024-09-21T07:38:27.912053+0000","last_active":"2024-09-21T07:38:29.610015+0000","last_peered":"2024-09-21T07:38:29.610015+0000","last_clean":"2024-09-21T07:38:29.610015+0000","last_became_active":"2024-09-21T07:38:27.911752+0000","last_became_peered":"2024-09-21T07:38:27.911752+0000","last_unstale":"2024-09-21T07:38:29.610015+0000","last_undegraded":"2024-09-21T07:38:29.610015+0000","last_fullsized":"2024-09-21T07:38:29.610015+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:24.239626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609598+0000","last_change":"2024-09-21T07:38:27.880386+0000","last_active":"2024-09-21T07:38:29.609598+0000","last_peered":"2024-09-21T07:38:29.609598+0000","last_clean":"2024-09-21T07:38:29.609598+0000","last_became_active":"2024-09-21T07:38:27.880045+0000","last_became_peered":"2024-09-21T07:38:27.880045+0000","last_unstale":"2024-09-21T07:38:29.609598+0000","last_undegraded":"2024-09-21T07:38:29.609598+0000","last_fullsized":"2024-09-21T07:38:29.609598+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:28.219566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607029+0000","last_change":"2024-09-21T07:38:27.881175+0000","last_active":"2024-09-21T07:38:29.607029+0000","last_peered":"2024-09-21T07:38:29.607029+0000","last_clean":"2024-09-21T07:38:29.607029+0000","last_became_active":"2024-09-21T07:38:27.880863+0000","last_became_peered":"2024-09-21T07:38:27.880863+0000","last_unstale":"2024-09-21T07:38:29.607029+0000","last_undegraded":"2024-09-21T07:38:29.607029+0000","last_fullsized":"2024-09-21T07:38:29.607029+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.521724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607715+0000","last_change":"2024-09-21T07:38:27.896418+0000","last_active":"2024-09-21T07:38:29.607715+0000","last_peered":"2024-09-21T07:38:29.607715+0000","last_clean":"2024-09-21T07:38:29.607715+0000","last_became_active":"2024-09-21T07:38:27.894616+0000","last_became_peered":"2024-09-21T07:38:27.894616+0000","last_unstale":"2024-09-21T07:38:29.607715+0000","last_undegraded":"2024-09-21T07:38:29.607715+0000","last_fullsized":"2024-09-21T07:38:29.607715+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:21.664750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608434+0000","last_change":"2024-09-21T07:38:27.897524+0000","last_active":"2024-09-21T07:38:29.608434+0000","last_peered":"2024-09-21T07:38:29.608434+0000","last_clean":"2024-09-21T07:38:29.608434+0000","last_became_active":"2024-09-21T07:38:27.897054+0000","last_became_peered":"2024-09-21T07:38:27.897054+0000","last_unstale":"2024-09-21T07:38:29.608434+0000","last_undegraded":"2024-09-21T07:38:29.608434+0000","last_fullsized":"2024-09-21T07:38:29.608434+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.145381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607590+0000","last_change":"2024-09-21T07:38:27.872053+0000","last_active":"2024-09-21T07:38:29.607590+0000","last_peered":"2024-09-21T07:38:29.607590+0000","last_clean":"2024-09-21T07:38:29.607590+0000","last_became_active":"2024-09-21T07:38:27.871619+0000","last_became_peered":"2024-09-21T07:38:27.871619+0000","last_unstale":"2024-09-21T07:38:29.607590+0000","last_undegraded":"2024-09-21T07:38:29.607590+0000","last_fullsized":"2024-09-21T07:38:29.607590+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.949314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881493+0000","last_change":"2024-09-21T07:38:27.896082+0000","last_active":"2024-09-21T07:38:28.881493+0000","last_peered":"2024-09-21T07:38:28.881493+0000","last_clean":"2024-09-21T07:38:28.881493+0000","last_became_active":"2024-09-21T07:38:27.895767+0000","last_became_peered":"2024-09-21T07:38:27.895767+0000","last_unstale":"2024-09-21T07:38:28.881493+0000","last_undegraded":"2024-09-21T07:38:28.881493+0000","last_fullsized":"2024-09-21T07:38:28.881493+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:04.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608898+0000","last_change":"2024-09-21T07:38:27.902213+0000","last_active":"2024-09-21T07:38:29.608898+0000","last_peered":"2024-09-21T07:38:29.608898+0000","last_clean":"2024-09-21T07:38:29.608898+0000","last_became_active":"2024-09-21T07:38:27.901458+0000","last_became_peered":"2024-09-21T07:38:27.901458+0000","last_unstale":"2024-09-21T07:38:29.608898+0000","last_undegraded":"2024-09-21T07:38:29.608898+0000","last_fullsized":"2024-09-21T07:38:29.608898+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:47.079031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879102+0000","last_change":"2024-09-21T07:38:27.884168+0000","last_active":"2024-09-21T07:38:28.879102+0000","last_peered":"2024-09-21T07:38:28.879102+0000","last_clean":"2024-09-21T07:38:28.879102+0000","last_became_active":"2024-09-21T07:38:27.883864+0000","last_became_peered":"2024-09-21T07:38:27.883864+0000","last_unstale":"2024-09-21T07:38:28.879102+0000","last_undegraded":"2024-09-21T07:38:28.879102+0000","last_fullsized":"2024-09-21T07:38:28.879102+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:09.906489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609651+0000","last_change":"2024-09-21T07:38:27.888188+0000","last_active":"2024-09-21T07:38:29.609651+0000","last_peered":"2024-09-21T07:38:29.609651+0000","last_clean":"2024-09-21T07:38:29.609651+0000","last_became_active":"2024-09-21T07:38:27.887676+0000","last_became_peered":"2024-09-21T07:38:27.887676+0000","last_unstale":"2024-09-21T07:38:29.609651+0000","last_undegraded":"2024-09-21T07:38:29.609651+0000","last_fullsized":"2024-09-21T07:38:29.609651+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:09.545773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879189+0000","last_change":"2024-09-21T07:38:27.876966+0000","last_active":"2024-09-21T07:38:28.879189+0000","last_peered":"2024-09-21T07:38:28.879189+0000","last_clean":"2024-09-21T07:38:28.879189+0000","last_became_active":"2024-09-21T07:38:27.876560+0000","last_became_peered":"2024-09-21T07:38:27.876560+0000","last_unstale":"2024-09-21T07:38:28.879189+0000","last_undegraded":"2024-09-21T07:38:28.879189+0000","last_fullsized":"2024-09-21T07:38:28.879189+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:33.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608127+0000","last_change":"2024-09-21T07:38:27.889131+0000","last_active":"2024-09-21T07:38:29.608127+0000","last_peered":"2024-09-21T07:38:29.608127+0000","last_clean":"2024-09-21T07:38:29.608127+0000","last_became_active":"2024-09-21T07:38:27.888745+0000","last_became_peered":"2024-09-21T07:38:27.888745+0000","last_unstale":"2024-09-21T07:38:29.608127+0000","last_undegraded":"2024-09-21T07:38:29.608127+0000","last_fullsized":"2024-09-21T07:38:29.608127+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:16.033670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610683+0000","last_change":"2024-09-21T07:38:27.888329+0000","last_active":"2024-09-21T07:38:29.610683+0000","last_peered":"2024-09-21T07:38:29.610683+0000","last_clean":"2024-09-21T07:38:29.610683+0000","last_became_active":"2024-09-21T07:38:27.887673+0000","last_became_peered":"2024-09-21T07:38:27.887673+0000","last_unstale":"2024-09-21T07:38:29.610683+0000","last_undegraded":"2024-09-21T07:38:29.610683+0000","last_fullsized":"2024-09-21T07:38:29.610683+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:00.475124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879713+0000","last_change":"2024-09-21T07:38:27.882021+0000","last_active":"2024-09-21T07:38:28.879713+0000","last_peered":"2024-09-21T07:38:28.879713+0000","last_clean":"2024-09-21T07:38:28.879713+0000","last_became_active":"2024-09-21T07:38:27.881074+0000","last_became_peered":"2024-09-21T07:38:27.881074+0000","last_unstale":"2024-09-21T07:38:28.879713+0000","last_undegraded":"2024-09-21T07:38:28.879713+0000","last_fullsized":"2024-09-21T07:38:28.879713+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:18.019845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879639+0000","last_change":"2024-09-21T07:38:27.877328+0000","last_active":"2024-09-21T07:38:28.879639+0000","last_peered":"2024-09-21T07:38:28.879639+0000","last_clean":"2024-09-21T07:38:28.879639+0000","last_became_active":"2024-09-21T07:38:27.876997+0000","last_became_peered":"2024-09-21T07:38:27.876997+0000","last_unstale":"2024-09-21T07:38:28.879639+0000","last_undegraded":"2024-09-21T07:38:28.879639+0000","last_fullsized":"2024-09-21T07:38:28.879639+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.630735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881690+0000","last_change":"2024-09-21T07:38:27.899491+0000","last_active":"2024-09-21T07:38:28.881690+0000","last_peered":"2024-09-21T07:38:28.881690+0000","last_clean":"2024-09-21T07:38:28.881690+0000","last_became_active":"2024-09-21T07:38:27.898923+0000","last_became_peered":"2024-09-21T07:38:27.898923+0000","last_unstale":"2024-09-21T07:38:28.881690+0000","last_undegraded":"2024-09-21T07:38:28.881690+0000","last_fullsized":"2024-09-21T07:38:28.881690+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:25.337677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609927+0000","last_change":"2024-09-21T07:38:27.899304+0000","last_active":"2024-09-21T07:38:29.609927+0000","last_peered":"2024-09-21T07:38:29.609927+0000","last_clean":"2024-09-21T07:38:29.609927+0000","last_became_active":"2024-09-21T07:38:27.898964+0000","last_became_peered":"2024-09-21T07:38:27.898964+0000","last_unstale":"2024-09-21T07:38:29.609927+0000","last_undegraded":"2024-09-21T07:38:29.609927+0000","last_fullsized":"2024-09-21T07:38:29.609927+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:57.667593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608015+0000","last_change":"2024-09-21T07:38:27.895116+0000","last_active":"2024-09-21T07:38:29.608015+0000","last_peered":"2024-09-21T07:38:29.608015+0000","last_clean":"2024-09-21T07:38:29.608015+0000","last_became_active":"2024-09-21T07:38:27.894796+0000","last_became_peered":"2024-09-21T07:38:27.894796+0000","last_unstale":"2024-09-21T07:38:29.608015+0000","last_undegraded":"2024-09-21T07:38:29.608015+0000","last_fullsized":"2024-09-21T07:38:29.608015+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:10.283133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607011+0000","last_change":"2024-09-21T07:38:27.887596+0000","last_active":"2024-09-21T07:38:29.607011+0000","last_peered":"2024-09-21T07:38:29.607011+0000","last_clean":"2024-09-21T07:38:29.607011+0000","last_became_active":"2024-09-21T07:38:27.887296+0000","last_became_peered":"2024-09-21T07:38:27.887296+0000","last_unstale":"2024-09-21T07:38:29.607011+0000","last_undegraded":"2024-09-21T07:38:29.607011+0000","last_fullsized":"2024-09-21T07:38:29.607011+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:55.792122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"228'4","reported_seq":19,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608612+0000","last_change":"2024-09-21T07:38:26.876175+0000","last_active":"2024-09-21T07:38:29.608612+0000","last_peered":"2024-09-21T07:38:29.608612+0000","last_clean":"2024-09-21T07:38:29.608612+0000","last_became_active":"2024-09-21T07:38:26.875734+0000","last_became_peered":"2024-09-21T07:38:26.875734+0000","last_unstale":"2024-09-21T07:38:29.608612+0000","last_undegraded":"2024-09-21T07:38:29.608612+0000","last_fullsized":"2024-09-21T07:38:29.608612+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:12.542862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608297+0000","last_change":"2024-09-21T07:38:27.895082+0000","last_active":"2024-09-21T07:38:29.608297+0000","last_peered":"2024-09-21T07:38:29.608297+0000","last_clean":"2024-09-21T07:38:29.608297+0000","last_became_active":"2024-09-21T07:38:27.894770+0000","last_became_peered":"2024-09-21T07:38:27.894770+0000","last_unstale":"2024-09-21T07:38:29.608297+0000","last_undegraded":"2024-09-21T07:38:29.608297+0000","last_fullsized":"2024-09-21T07:38:29.608297+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:45.238573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608217+0000","last_change":"2024-09-21T07:38:26.863994+0000","last_active":"2024-09-21T07:38:29.608217+0000","last_peered":"2024-09-21T07:38:29.608217+0000","last_clean":"2024-09-21T07:38:29.608217+0000","last_became_active":"2024-09-21T07:38:26.863529+0000","last_became_peered":"2024-09-21T07:38:26.863529+0000","last_unstale":"2024-09-21T07:38:29.608217+0000","last_undegraded":"2024-09-21T07:38:29.608217+0000","last_fullsized":"2024-09-21T07:38:29.608217+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:10.567311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608987+0000","last_change":"2024-09-21T07:38:27.911196+0000","last_active":"2024-09-21T07:38:29.608987+0000","last_peered":"2024-09-21T07:38:29.608987+0000","last_clean":"2024-09-21T07:38:29.608987+0000","last_became_active":"2024-09-21T07:38:27.910875+0000","last_became_peered":"2024-09-21T07:38:27.910875+0000","last_unstale":"2024-09-21T07:38:29.608987+0000","last_undegraded":"2024-09-21T07:38:29.608987+0000","last_fullsized":"2024-09-21T07:38:29.608987+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:48:14.981031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879891+0000","last_change":"2024-09-21T07:38:26.866652+0000","last_active":"2024-09-21T07:38:28.879891+0000","last_peered":"2024-09-21T07:38:28.879891+0000","last_clean":"2024-09-21T07:38:28.879891+0000","last_became_active":"2024-09-21T07:38:26.866286+0000","last_became_peered":"2024-09-21T07:38:26.866286+0000","last_unstale":"2024-09-21T07:38:28.879891+0000","last_undegraded":"2024-09-21T07:38:28.879891+0000","last_fullsized":"2024-09-21T07:38:28.879891+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:52.630117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610769+0000","last_change":"2024-09-21T07:38:27.899792+0000","last_active":"2024-09-21T07:38:29.610769+0000","last_peered":"2024-09-21T07:38:29.610769+0000","last_clean":"2024-09-21T07:38:29.610769+0000","last_became_active":"2024-09-21T07:38:27.899377+0000","last_became_peered":"2024-09-21T07:38:27.899377+0000","last_unstale":"2024-09-21T07:38:29.610769+0000","last_undegraded":"2024-09-21T07:38:29.610769+0000","last_fullsized":"2024-09-21T07:38:29.610769+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:23.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607242+0000","last_change":"2024-09-21T07:38:26.861984+0000","last_active":"2024-09-21T07:38:29.607242+0000","last_peered":"2024-09-21T07:38:29.607242+0000","last_clean":"2024-09-21T07:38:29.607242+0000","last_became_active":"2024-09-21T07:38:26.861625+0000","last_became_peered":"2024-09-21T07:38:26.861625+0000","last_unstale":"2024-09-21T07:38:29.607242+0000","last_undegraded":"2024-09-21T07:38:29.607242+0000","last_fullsized":"2024-09-21T07:38:29.607242+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:53.379186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608134+0000","last_change":"2024-09-21T07:38:27.892850+0000","last_active":"2024-09-21T07:38:29.608134+0000","last_peered":"2024-09-21T07:38:29.608134+0000","last_clean":"2024-09-21T07:38:29.608134+0000","last_became_active":"2024-09-21T07:38:27.892540+0000","last_became_peered":"2024-09-21T07:38:27.892540+0000","last_unstale":"2024-09-21T07:38:29.608134+0000","last_undegraded":"2024-09-21T07:38:29.608134+0000","last_fullsized":"2024-09-21T07:38:29.608134+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:11.041215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609320+0000","last_change":"2024-09-21T07:38:26.863298+0000","last_active":"2024-09-21T07:38:29.609320+0000","last_peered":"2024-09-21T07:38:29.609320+0000","last_clean":"2024-09-21T07:38:29.609320+0000","last_became_active":"2024-09-21T07:38:26.862983+0000","last_became_peered":"2024-09-21T07:38:26.862983+0000","last_unstale":"2024-09-21T07:38:29.609320+0000","last_undegraded":"2024-09-21T07:38:29.609320+0000","last_fullsized":"2024-09-21T07:38:29.609320+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:49.468254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609965+0000","last_change":"2024-09-21T07:38:27.889318+0000","last_active":"2024-09-21T07:38:29.609965+0000","last_peered":"2024-09-21T07:38:29.609965+0000","last_clean":"2024-09-21T07:38:29.609965+0000","last_became_active":"2024-09-21T07:38:27.888973+0000","last_became_peered":"2024-09-21T07:38:27.888973+0000","last_unstale":"2024-09-21T07:38:29.609965+0000","last_undegraded":"2024-09-21T07:38:29.609965+0000","last_fullsized":"2024-09-21T07:38:29.609965+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.057340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610476+0000","last_change":"2024-09-21T07:38:26.874143+0000","last_active":"2024-09-21T07:38:29.610476+0000","last_peered":"2024-09-21T07:38:29.610476+0000","last_clean":"2024-09-21T07:38:29.610476+0000","last_became_active":"2024-09-21T07:38:26.873839+0000","last_became_peered":"2024-09-21T07:38:26.873839+0000","last_unstale":"2024-09-21T07:38:29.610476+0000","last_undegraded":"2024-09-21T07:38:29.610476+0000","last_fullsized":"2024-09-21T07:38:29.610476+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:50.780045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607793+0000","last_change":"2024-09-21T07:38:27.887611+0000","last_active":"2024-09-21T07:38:29.607793+0000","last_peered":"2024-09-21T07:38:29.607793+0000","last_clean":"2024-09-21T07:38:29.607793+0000","last_became_active":"2024-09-21T07:38:27.887295+0000","last_became_peered":"2024-09-21T07:38:27.887295+0000","last_unstale":"2024-09-21T07:38:29.607793+0000","last_undegraded":"2024-09-21T07:38:29.607793+0000","last_fullsized":"2024-09-21T07:38:29.607793+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:01.482431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.606880+0000","last_change":"2024-09-21T07:38:26.861747+0000","last_active":"2024-09-21T07:38:29.606880+0000","last_peered":"2024-09-21T07:38:29.606880+0000","last_clean":"2024-09-21T07:38:29.606880+0000","last_became_active":"2024-09-21T07:38:26.861414+0000","last_became_peered":"2024-09-21T07:38:26.861414+0000","last_unstale":"2024-09-21T07:38:29.606880+0000","last_undegraded":"2024-09-21T07:38:29.606880+0000","last_fullsized":"2024-09-21T07:38:29.606880+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:14.221292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880150+0000","last_change":"2024-09-21T07:38:27.908116+0000","last_active":"2024-09-21T07:38:28.880150+0000","last_peered":"2024-09-21T07:38:28.880150+0000","last_clean":"2024-09-21T07:38:28.880150+0000","last_became_active":"2024-09-21T07:38:27.906137+0000","last_became_peered":"2024-09-21T07:38:27.906137+0000","last_unstale":"2024-09-21T07:38:28.880150+0000","last_undegraded":"2024-09-21T07:38:28.880150+0000","last_fullsized":"2024-09-21T07:38:28.880150+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:28.691558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608666+0000","last_change":"2024-09-21T07:38:26.857528+0000","last_active":"2024-09-21T07:38:29.608666+0000","last_peered":"2024-09-21T07:38:29.608666+0000","last_clean":"2024-09-21T07:38:29.608666+0000","last_became_active":"2024-09-21T07:38:26.857087+0000","last_became_peered":"2024-09-21T07:38:26.857087+0000","last_unstale":"2024-09-21T07:38:29.608666+0000","last_undegraded":"2024-09-21T07:38:29.608666+0000","last_fullsized":"2024-09-21T07:38:29.608666+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:56.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880475+0000","last_change":"2024-09-21T07:38:27.900713+0000","last_active":"2024-09-21T07:38:28.880475+0000","last_peered":"2024-09-21T07:38:28.880475+0000","last_clean":"2024-09-21T07:38:28.880475+0000","last_became_active":"2024-09-21T07:38:27.900385+0000","last_became_peered":"2024-09-21T07:38:27.900385+0000","last_unstale":"2024-09-21T07:38:28.880475+0000","last_undegraded":"2024-09-21T07:38:28.880475+0000","last_fullsized":"2024-09-21T07:38:28.880475+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:55.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880521+0000","last_change":"2024-09-21T07:38:26.874002+0000","last_active":"2024-09-21T07:38:28.880521+0000","last_peered":"2024-09-21T07:38:28.880521+0000","last_clean":"2024-09-21T07:38:28.880521+0000","last_became_active":"2024-09-21T07:38:26.873678+0000","last_became_peered":"2024-09-21T07:38:26.873678+0000","last_unstale":"2024-09-21T07:38:28.880521+0000","last_undegraded":"2024-09-21T07:38:28.880521+0000","last_fullsized":"2024-09-21T07:38:28.880521+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:35.150025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609070+0000","last_change":"2024-09-21T07:38:27.892140+0000","last_active":"2024-09-21T07:38:29.609070+0000","last_peered":"2024-09-21T07:38:29.609070+0000","last_clean":"2024-09-21T07:38:29.609070+0000","last_became_active":"2024-09-21T07:38:27.891752+0000","last_became_peered":"2024-09-21T07:38:27.891752+0000","last_unstale":"2024-09-21T07:38:29.609070+0000","last_undegraded":"2024-09-21T07:38:29.609070+0000","last_fullsized":"2024-09-21T07:38:29.609070+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:37.821445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608337+0000","last_change":"2024-09-21T07:38:26.863704+0000","last_active":"2024-09-21T07:38:29.608337+0000","last_peered":"2024-09-21T07:38:29.608337+0000","last_clean":"2024-09-21T07:38:29.608337+0000","last_became_active":"2024-09-21T07:38:26.863365+0000","last_became_peered":"2024-09-21T07:38:26.863365+0000","last_unstale":"2024-09-21T07:38:29.608337+0000","last_undegraded":"2024-09-21T07:38:29.608337+0000","last_fullsized":"2024-09-21T07:38:29.608337+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:37.651147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881302+0000","last_change":"2024-09-21T07:38:27.903378+0000","last_active":"2024-09-21T07:38:28.881302+0000","last_peered":"2024-09-21T07:38:28.881302+0000","last_clean":"2024-09-21T07:38:28.881302+0000","last_became_active":"2024-09-21T07:38:27.903151+0000","last_became_peered":"2024-09-21T07:38:27.903151+0000","last_unstale":"2024-09-21T07:38:28.881302+0000","last_undegraded":"2024-09-21T07:38:28.881302+0000","last_fullsized":"2024-09-21T07:38:28.881302+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:13.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"228'3","reported_seq":18,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880327+0000","last_change":"2024-09-21T07:38:26.873389+0000","last_active":"2024-09-21T07:38:28.880327+0000","last_peered":"2024-09-21T07:38:28.880327+0000","last_clean":"2024-09-21T07:38:28.880327+0000","last_became_active":"2024-09-21T07:38:26.872013+0000","last_became_peered":"2024-09-21T07:38:26.872013+0000","last_unstale":"2024-09-21T07:38:28.880327+0000","last_undegraded":"2024-09-21T07:38:28.880327+0000","last_fullsized":"2024-09-21T07:38:28.880327+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880289+0000","last_change":"2024-09-21T07:38:27.890847+0000","last_active":"2024-09-21T07:38:28.880289+0000","last_peered":"2024-09-21T07:38:28.880289+0000","last_clean":"2024-09-21T07:38:28.880289+0000","last_became_active":"2024-09-21T07:38:27.890507+0000","last_became_peered":"2024-09-21T07:38:27.890507+0000","last_unstale":"2024-09-21T07:38:28.880289+0000","last_undegraded":"2024-09-21T07:38:28.880289+0000","last_fullsized":"2024-09-21T07:38:28.880289+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:15.231397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"228'6","reported_seq":21,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608816+0000","last_change":"2024-09-21T07:38:26.878447+0000","last_active":"2024-09-21T07:38:29.608816+0000","last_peered":"2024-09-21T07:38:29.608816+0000","last_clean":"2024-09-21T07:38:29.608816+0000","last_became_active":"2024-09-21T07:38:26.873257+0000","last_became_peered":"2024-09-21T07:38:26.873257+0000","last_unstale":"2024-09-21T07:38:29.608816+0000","last_undegraded":"2024-09-21T07:38:29.608816+0000","last_fullsized":"2024-09-21T07:38:29.608816+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608526+0000","last_change":"2024-09-21T07:38:27.885087+0000","last_active":"2024-09-21T07:38:29.608526+0000","last_peered":"2024-09-21T07:38:29.608526+0000","last_clean":"2024-09-21T07:38:29.608526+0000","last_became_active":"2024-09-21T07:38:27.884736+0000","last_became_peered":"2024-09-21T07:38:27.884736+0000","last_unstale":"2024-09-21T07:38:29.608526+0000","last_undegraded":"2024-09-21T07:38:29.608526+0000","last_fullsized":"2024-09-21T07:38:29.608526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609452+0000","last_change":"2024-09-21T07:38:26.861682+0000","last_active":"2024-09-21T07:38:29.609452+0000","last_peered":"2024-09-21T07:38:29.609452+0000","last_clean":"2024-09-21T07:38:29.609452+0000","last_became_active":"2024-09-21T07:38:26.861289+0000","last_became_peered":"2024-09-21T07:38:26.861289+0000","last_unstale":"2024-09-21T07:38:29.609452+0000","last_undegraded":"2024-09-21T07:38:29.609452+0000","last_fullsized":"2024-09-21T07:38:29.609452+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:53.971300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.878941+0000","last_change":"2024-09-21T07:38:27.883877+0000","last_active":"2024-09-21T07:38:28.878941+0000","last_peered":"2024-09-21T07:38:28.878941+0000","last_clean":"2024-09-21T07:38:28.878941+0000","last_became_active":"2024-09-21T07:38:27.883545+0000","last_became_peered":"2024-09-21T07:38:27.883545+0000","last_unstale":"2024-09-21T07:38:28.878941+0000","last_undegraded":"2024-09-21T07:38:28.878941+0000","last_fullsized":"2024-09-21T07:38:28.878941+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:17.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879903+0000","last_change":"2024-09-21T07:38:26.878489+0000","last_active":"2024-09-21T07:38:28.879903+0000","last_peered":"2024-09-21T07:38:28.879903+0000","last_clean":"2024-09-21T07:38:28.879903+0000","last_became_active":"2024-09-21T07:38:26.876983+0000","last_became_peered":"2024-09-21T07:38:26.876983+0000","last_unstale":"2024-09-21T07:38:28.879903+0000","last_undegraded":"2024-09-21T07:38:28.879903+0000","last_fullsized":"2024-09-21T07:38:28.879903+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:52.976040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608578+0000","last_change":"2024-09-21T07:38:27.890069+0000","last_active":"2024-09-21T07:38:29.608578+0000","last_peered":"2024-09-21T07:38:29.608578+0000","last_clean":"2024-09-21T07:38:29.608578+0000","last_became_active":"2024-09-21T07:38:27.889714+0000","last_became_peered":"2024-09-21T07:38:27.889714+0000","last_unstale":"2024-09-21T07:38:29.608578+0000","last_undegraded":"2024-09-21T07:38:29.608578+0000","last_fullsized":"2024-09-21T07:38:29.608578+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:19.806030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879576+0000","last_change":"2024-09-21T07:38:26.874628+0000","last_active":"2024-09-21T07:38:28.879576+0000","last_peered":"2024-09-21T07:38:28.879576+0000","last_clean":"2024-09-21T07:38:28.879576+0000","last_became_active":"2024-09-21T07:38:26.874332+0000","last_became_peered":"2024-09-21T07:38:26.874332+0000","last_unstale":"2024-09-21T07:38:28.879576+0000","last_undegraded":"2024-09-21T07:38:28.879576+0000","last_fullsized":"2024-09-21T07:38:28.879576+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:59.212092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609139+0000","last_change":"2024-09-21T07:38:27.887846+0000","last_active":"2024-09-21T07:38:29.609139+0000","last_peered":"2024-09-21T07:38:29.609139+0000","last_clean":"2024-09-21T07:38:29.609139+0000","last_became_active":"2024-09-21T07:38:27.887479+0000","last_became_peered":"2024-09-21T07:38:27.887479+0000","last_unstale":"2024-09-21T07:38:29.609139+0000","last_undegraded":"2024-09-21T07:38:29.609139+0000","last_fullsized":"2024-09-21T07:38:29.609139+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:24.745605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"228'8","reported_seq":23,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879702+0000","last_change":"2024-09-21T07:38:26.878210+0000","last_active":"2024-09-21T07:38:28.879702+0000","last_peered":"2024-09-21T07:38:28.879702+0000","last_clean":"2024-09-21T07:38:28.879702+0000","last_became_active":"2024-09-21T07:38:26.875824+0000","last_became_peered":"2024-09-21T07:38:26.875824+0000","last_unstale":"2024-09-21T07:38:28.879702+0000","last_undegraded":"2024-09-21T07:38:28.879702+0000","last_fullsized":"2024-09-21T07:38:28.879702+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:18.519770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879610+0000","last_change":"2024-09-21T07:38:27.886965+0000","last_active":"2024-09-21T07:38:28.879610+0000","last_peered":"2024-09-21T07:38:28.879610+0000","last_clean":"2024-09-21T07:38:28.879610+0000","last_became_active":"2024-09-21T07:38:27.886576+0000","last_became_peered":"2024-09-21T07:38:27.886576+0000","last_unstale":"2024-09-21T07:38:28.879610+0000","last_undegraded":"2024-09-21T07:38:28.879610+0000","last_fullsized":"2024-09-21T07:38:28.879610+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:09.644730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881574+0000","last_change":"2024-09-21T07:38:26.873212+0000","last_active":"2024-09-21T07:38:28.881574+0000","last_peered":"2024-09-21T07:38:28.881574+0000","last_clean":"2024-09-21T07:38:28.881574+0000","last_became_active":"2024-09-21T07:38:26.872886+0000","last_became_peered":"2024-09-21T07:38:26.872886+0000","last_unstale":"2024-09-21T07:38:28.881574+0000","last_undegraded":"2024-09-21T07:38:28.881574+0000","last_fullsized":"2024-09-21T07:38:28.881574+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:26.601076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879909+0000","last_change":"2024-09-21T07:38:27.888113+0000","last_active":"2024-09-21T07:38:28.879909+0000","last_peered":"2024-09-21T07:38:28.879909+0000","last_clean":"2024-09-21T07:38:28.879909+0000","last_became_active":"2024-09-21T07:38:27.887808+0000","last_became_peered":"2024-09-21T07:38:27.887808+0000","last_unstale":"2024-09-21T07:38:28.879909+0000","last_undegraded":"2024-09-21T07:38:28.879909+0000","last_fullsized":"2024-09-21T07:38:28.879909+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:47.025027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608671+0000","last_change":"2024-09-21T07:38:26.878845+0000","last_active":"2024-09-21T07:38:29.608671+0000","last_peered":"2024-09-21T07:38:29.608671+0000","last_clean":"2024-09-21T07:38:29.608671+0000","last_became_active":"2024-09-21T07:38:26.878455+0000","last_became_peered":"2024-09-21T07:38:26.878455+0000","last_unstale":"2024-09-21T07:38:29.608671+0000","last_undegraded":"2024-09-21T07:38:29.608671+0000","last_fullsized":"2024-09-21T07:38:29.608671+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.675782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880473+0000","last_change":"2024-09-21T07:38:27.905110+0000","last_active":"2024-09-21T07:38:28.880473+0000","last_peered":"2024-09-21T07:38:28.880473+0000","last_clean":"2024-09-21T07:38:28.880473+0000","last_became_active":"2024-09-21T07:38:27.904752+0000","last_became_peered":"2024-09-21T07:38:27.904752+0000","last_unstale":"2024-09-21T07:38:28.880473+0000","last_undegraded":"2024-09-21T07:38:28.880473+0000","last_fullsized":"2024-09-21T07:38:28.880473+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:04.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"228'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607894+0000","last_change":"2024-09-21T07:38:26.868486+0000","last_active":"2024-09-21T07:38:29.607894+0000","last_peered":"2024-09-21T07:38:29.607894+0000","last_clean":"2024-09-21T07:38:29.607894+0000","last_became_active":"2024-09-21T07:38:26.867803+0000","last_became_peered":"2024-09-21T07:38:26.867803+0000","last_unstale":"2024-09-21T07:38:29.607894+0000","last_undegraded":"2024-09-21T07:38:29.607894+0000","last_fullsized":"2024-09-21T07:38:29.607894+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:48.319341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880538+0000","last_change":"2024-09-21T07:38:27.879254+0000","last_active":"2024-09-21T07:38:28.880538+0000","last_peered":"2024-09-21T07:38:28.880538+0000","last_clean":"2024-09-21T07:38:28.880538+0000","last_became_active":"2024-09-21T07:38:27.878635+0000","last_became_peered":"2024-09-21T07:38:27.878635+0000","last_unstale":"2024-09-21T07:38:28.880538+0000","last_undegraded":"2024-09-21T07:38:28.880538+0000","last_fullsized":"2024-09-21T07:38:28.880538+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:11.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608238+0000","last_change":"2024-09-21T07:38:26.879661+0000","last_active":"2024-09-21T07:38:29.608238+0000","last_peered":"2024-09-21T07:38:29.608238+0000","last_clean":"2024-09-21T07:38:29.608238+0000","last_became_active":"2024-09-21T07:38:26.879329+0000","last_became_peered":"2024-09-21T07:38:26.879329+0000","last_unstale":"2024-09-21T07:38:29.608238+0000","last_undegraded":"2024-09-21T07:38:29.608238+0000","last_fullsized":"2024-09-21T07:38:29.608238+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:38.606190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609616+0000","last_change":"2024-09-21T07:38:27.887670+0000","last_active":"2024-09-21T07:38:29.609616+0000","last_peered":"2024-09-21T07:38:29.609616+0000","last_clean":"2024-09-21T07:38:29.609616+0000","last_became_active":"2024-09-21T07:38:27.887331+0000","last_became_peered":"2024-09-21T07:38:27.887331+0000","last_unstale":"2024-09-21T07:38:29.609616+0000","last_undegraded":"2024-09-21T07:38:29.609616+0000","last_fullsized":"2024-09-21T07:38:29.609616+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.716999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.609549+0000","last_change":"2024-09-21T07:38:26.881447+0000","last_active":"2024-09-21T07:38:29.609549+0000","last_peered":"2024-09-21T07:38:29.609549+0000","last_clean":"2024-09-21T07:38:29.609549+0000","last_became_active":"2024-09-21T07:38:26.880826+0000","last_became_peered":"2024-09-21T07:38:26.880826+0000","last_unstale":"2024-09-21T07:38:29.609549+0000","last_undegraded":"2024-09-21T07:38:29.609549+0000","last_fullsized":"2024-09-21T07:38:29.609549+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:05.538164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879014+0000","last_change":"2024-09-21T07:38:27.898273+0000","last_active":"2024-09-21T07:38:28.879014+0000","last_peered":"2024-09-21T07:38:28.879014+0000","last_clean":"2024-09-21T07:38:28.879014+0000","last_became_active":"2024-09-21T07:38:27.897709+0000","last_became_peered":"2024-09-21T07:38:27.897709+0000","last_unstale":"2024-09-21T07:38:28.879014+0000","last_undegraded":"2024-09-21T07:38:28.879014+0000","last_fullsized":"2024-09-21T07:38:28.879014+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:35.163585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608592+0000","last_change":"2024-09-21T07:38:26.855037+0000","last_active":"2024-09-21T07:38:29.608592+0000","last_peered":"2024-09-21T07:38:29.608592+0000","last_clean":"2024-09-21T07:38:29.608592+0000","last_became_active":"2024-09-21T07:38:26.854720+0000","last_became_peered":"2024-09-21T07:38:26.854720+0000","last_unstale":"2024-09-21T07:38:29.608592+0000","last_undegraded":"2024-09-21T07:38:29.608592+0000","last_fullsized":"2024-09-21T07:38:29.608592+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:36.231632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879939+0000","last_change":"2024-09-21T07:38:27.906211+0000","last_active":"2024-09-21T07:38:28.879939+0000","last_peered":"2024-09-21T07:38:28.879939+0000","last_clean":"2024-09-21T07:38:28.879939+0000","last_became_active":"2024-09-21T07:38:27.905909+0000","last_became_peered":"2024-09-21T07:38:27.905909+0000","last_unstale":"2024-09-21T07:38:28.879939+0000","last_undegraded":"2024-09-21T07:38:28.879939+0000","last_fullsized":"2024-09-21T07:38:28.879939+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:33.469346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610395+0000","last_change":"2024-09-21T07:38:26.870394+0000","last_active":"2024-09-21T07:38:29.610395+0000","last_peered":"2024-09-21T07:38:29.610395+0000","last_clean":"2024-09-21T07:38:29.610395+0000","last_became_active":"2024-09-21T07:38:26.869897+0000","last_became_peered":"2024-09-21T07:38:26.869897+0000","last_unstale":"2024-09-21T07:38:29.610395+0000","last_undegraded":"2024-09-21T07:38:29.610395+0000","last_fullsized":"2024-09-21T07:38:29.610395+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:53.627605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610160+0000","last_change":"2024-09-21T07:38:27.897596+0000","last_active":"2024-09-21T07:38:29.610160+0000","last_peered":"2024-09-21T07:38:29.610160+0000","last_clean":"2024-09-21T07:38:29.610160+0000","last_became_active":"2024-09-21T07:38:27.897268+0000","last_became_peered":"2024-09-21T07:38:27.897268+0000","last_unstale":"2024-09-21T07:38:29.610160+0000","last_undegraded":"2024-09-21T07:38:29.610160+0000","last_fullsized":"2024-09-21T07:38:29.610160+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:52.817770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879707+0000","last_change":"2024-09-21T07:38:26.877812+0000","last_active":"2024-09-21T07:38:28.879707+0000","last_peered":"2024-09-21T07:38:28.879707+0000","last_clean":"2024-09-21T07:38:28.879707+0000","last_became_active":"2024-09-21T07:38:26.877017+0000","last_became_peered":"2024-09-21T07:38:26.877017+0000","last_unstale":"2024-09-21T07:38:28.879707+0000","last_undegraded":"2024-09-21T07:38:28.879707+0000","last_fullsized":"2024-09-21T07:38:28.879707+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:31.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881705+0000","last_change":"2024-09-21T07:38:27.896317+0000","last_active":"2024-09-21T07:38:28.881705+0000","last_peered":"2024-09-21T07:38:28.881705+0000","last_clean":"2024-09-21T07:38:28.881705+0000","last_became_active":"2024-09-21T07:38:27.895976+0000","last_became_peered":"2024-09-21T07:38:27.895976+0000","last_unstale":"2024-09-21T07:38:28.881705+0000","last_undegraded":"2024-09-21T07:38:28.881705+0000","last_fullsized":"2024-09-21T07:38:28.881705+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:35.460608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"228'2","reported_seq":17,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880453+0000","last_change":"2024-09-21T07:38:26.877423+0000","last_active":"2024-09-21T07:38:28.880453+0000","last_peered":"2024-09-21T07:38:28.880453+0000","last_clean":"2024-09-21T07:38:28.880453+0000","last_became_active":"2024-09-21T07:38:26.875883+0000","last_became_peered":"2024-09-21T07:38:26.875883+0000","last_unstale":"2024-09-21T07:38:28.880453+0000","last_undegraded":"2024-09-21T07:38:28.880453+0000","last_fullsized":"2024-09-21T07:38:28.880453+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:12.421136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881526+0000","last_change":"2024-09-21T07:38:27.904807+0000","last_active":"2024-09-21T07:38:28.881526+0000","last_peered":"2024-09-21T07:38:28.881526+0000","last_clean":"2024-09-21T07:38:28.881526+0000","last_became_active":"2024-09-21T07:38:27.904462+0000","last_became_peered":"2024-09-21T07:38:27.904462+0000","last_unstale":"2024-09-21T07:38:28.881526+0000","last_undegraded":"2024-09-21T07:38:28.881526+0000","last_fullsized":"2024-09-21T07:38:28.881526+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:30.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"229'1","reported_seq":16,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608961+0000","last_change":"2024-09-21T07:38:26.876682+0000","last_active":"2024-09-21T07:38:29.608961+0000","last_peered":"2024-09-21T07:38:29.608961+0000","last_clean":"2024-09-21T07:38:29.608961+0000","last_became_active":"2024-09-21T07:38:26.874751+0000","last_became_peered":"2024-09-21T07:38:26.874751+0000","last_unstale":"2024-09-21T07:38:29.608961+0000","last_undegraded":"2024-09-21T07:38:29.608961+0000","last_fullsized":"2024-09-21T07:38:29.608961+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:34.005502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607549+0000","last_change":"2024-09-21T07:38:27.890376+0000","last_active":"2024-09-21T07:38:29.607549+0000","last_peered":"2024-09-21T07:38:29.607549+0000","last_clean":"2024-09-21T07:38:29.607549+0000","last_became_active":"2024-09-21T07:38:27.888071+0000","last_became_peered":"2024-09-21T07:38:27.888071+0000","last_unstale":"2024-09-21T07:38:29.607549+0000","last_undegraded":"2024-09-21T07:38:29.607549+0000","last_fullsized":"2024-09-21T07:38:29.607549+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:19.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608005+0000","last_change":"2024-09-21T07:38:26.868126+0000","last_active":"2024-09-21T07:38:29.608005+0000","last_peered":"2024-09-21T07:38:29.608005+0000","last_clean":"2024-09-21T07:38:29.608005+0000","last_became_active":"2024-09-21T07:38:26.867386+0000","last_became_peered":"2024-09-21T07:38:26.867386+0000","last_unstale":"2024-09-21T07:38:29.608005+0000","last_undegraded":"2024-09-21T07:38:29.608005+0000","last_fullsized":"2024-09-21T07:38:29.608005+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:44.795985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.881462+0000","last_change":"2024-09-21T07:38:27.900241+0000","last_active":"2024-09-21T07:38:28.881462+0000","last_peered":"2024-09-21T07:38:28.881462+0000","last_clean":"2024-09-21T07:38:28.881462+0000","last_became_active":"2024-09-21T07:38:27.899917+0000","last_became_peered":"2024-09-21T07:38:27.899917+0000","last_unstale":"2024-09-21T07:38:28.881462+0000","last_undegraded":"2024-09-21T07:38:28.881462+0000","last_fullsized":"2024-09-21T07:38:28.881462+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:19.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607820+0000","last_change":"2024-09-21T07:38:26.867671+0000","last_active":"2024-09-21T07:38:29.607820+0000","last_peered":"2024-09-21T07:38:29.607820+0000","last_clean":"2024-09-21T07:38:29.607820+0000","last_became_active":"2024-09-21T07:38:26.867315+0000","last_became_peered":"2024-09-21T07:38:26.867315+0000","last_unstale":"2024-09-21T07:38:29.607820+0000","last_undegraded":"2024-09-21T07:38:29.607820+0000","last_fullsized":"2024-09-21T07:38:29.607820+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:37.651147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879528+0000","last_change":"2024-09-21T07:38:27.906372+0000","last_active":"2024-09-21T07:38:28.879528+0000","last_peered":"2024-09-21T07:38:28.879528+0000","last_clean":"2024-09-21T07:38:28.879528+0000","last_became_active":"2024-09-21T07:38:27.905712+0000","last_became_peered":"2024-09-21T07:38:27.905712+0000","last_unstale":"2024-09-21T07:38:28.879528+0000","last_undegraded":"2024-09-21T07:38:28.879528+0000","last_fullsized":"2024-09-21T07:38:28.879528+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:07.010954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608228+0000","last_change":"2024-09-21T07:38:26.876537+0000","last_active":"2024-09-21T07:38:29.608228+0000","last_peered":"2024-09-21T07:38:29.608228+0000","last_clean":"2024-09-21T07:38:29.608228+0000","last_became_active":"2024-09-21T07:38:26.874643+0000","last_became_peered":"2024-09-21T07:38:26.874643+0000","last_unstale":"2024-09-21T07:38:29.608228+0000","last_undegraded":"2024-09-21T07:38:29.608228+0000","last_fullsized":"2024-09-21T07:38:29.608228+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:59.439652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610406+0000","last_change":"2024-09-21T07:38:27.895714+0000","last_active":"2024-09-21T07:38:29.610406+0000","last_peered":"2024-09-21T07:38:29.610406+0000","last_clean":"2024-09-21T07:38:29.610406+0000","last_became_active":"2024-09-21T07:38:27.895366+0000","last_became_peered":"2024-09-21T07:38:27.895366+0000","last_unstale":"2024-09-21T07:38:29.610406+0000","last_undegraded":"2024-09-21T07:38:29.610406+0000","last_fullsized":"2024-09-21T07:38:29.610406+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:36.085587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608007+0000","last_change":"2024-09-21T07:38:26.875309+0000","last_active":"2024-09-21T07:38:29.608007+0000","last_peered":"2024-09-21T07:38:29.608007+0000","last_clean":"2024-09-21T07:38:29.608007+0000","last_became_active":"2024-09-21T07:38:26.874985+0000","last_became_peered":"2024-09-21T07:38:26.874985+0000","last_unstale":"2024-09-21T07:38:29.608007+0000","last_undegraded":"2024-09-21T07:38:29.608007+0000","last_fullsized":"2024-09-21T07:38:29.608007+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:38.761653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.610100+0000","last_change":"2024-09-21T07:38:27.909935+0000","last_active":"2024-09-21T07:38:29.610100+0000","last_peered":"2024-09-21T07:38:29.610100+0000","last_clean":"2024-09-21T07:38:29.610100+0000","last_became_active":"2024-09-21T07:38:27.909628+0000","last_became_peered":"2024-09-21T07:38:27.909628+0000","last_unstale":"2024-09-21T07:38:29.610100+0000","last_undegraded":"2024-09-21T07:38:29.610100+0000","last_fullsized":"2024-09-21T07:38:29.610100+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:40.519170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607347+0000","last_change":"2024-09-21T07:38:26.871500+0000","last_active":"2024-09-21T07:38:29.607347+0000","last_peered":"2024-09-21T07:38:29.607347+0000","last_clean":"2024-09-21T07:38:29.607347+0000","last_became_active":"2024-09-21T07:38:26.871155+0000","last_became_peered":"2024-09-21T07:38:26.871155+0000","last_unstale":"2024-09-21T07:38:29.607347+0000","last_undegraded":"2024-09-21T07:38:29.607347+0000","last_fullsized":"2024-09-21T07:38:29.607347+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:53.379186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.607200+0000","last_change":"2024-09-21T07:38:27.893796+0000","last_active":"2024-09-21T07:38:29.607200+0000","last_peered":"2024-09-21T07:38:29.607200+0000","last_clean":"2024-09-21T07:38:29.607200+0000","last_became_active":"2024-09-21T07:38:27.892406+0000","last_became_peered":"2024-09-21T07:38:27.892406+0000","last_unstale":"2024-09-21T07:38:29.607200+0000","last_undegraded":"2024-09-21T07:38:29.607200+0000","last_fullsized":"2024-09-21T07:38:29.607200+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:02.165837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":15,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:29.608011+0000","last_change":"2024-09-21T07:38:26.862884+0000","last_active":"2024-09-21T07:38:29.608011+0000","last_peered":"2024-09-21T07:38:29.608011+0000","last_clean":"2024-09-21T07:38:29.608011+0000","last_became_active":"2024-09-21T07:38:26.861444+0000","last_became_peered":"2024-09-21T07:38:26.861444+0000","last_unstale":"2024-09-21T07:38:29.608011+0000","last_undegraded":"2024-09-21T07:38:29.608011+0000","last_fullsized":"2024-09-21T07:38:29.608011+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":226,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:25.832623+0000","last_clean_scrub_stamp":"2024-09-21T07:38:25.832623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:32.785876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.879863+0000","last_change":"2024-09-21T07:38:27.909367+0000","last_active":"2024-09-21T07:38:28.879863+0000","last_peered":"2024-09-21T07:38:28.879863+0000","last_clean":"2024-09-21T07:38:28.879863+0000","last_became_active":"2024-09-21T07:38:27.907346+0000","last_became_peered":"2024-09-21T07:38:27.907346+0000","last_unstale":"2024-09-21T07:38:28.879863+0000","last_undegraded":"2024-09-21T07:38:28.879863+0000","last_fullsized":"2024-09-21T07:38:28.879863+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":227,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:38:26.842728+0000","last_clean_scrub_stamp":"2024-09-21T07:38:26.842728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:41.726703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":490,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-21T07:38:28.880588+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:38:28.880588+0000","last_peered":"2024-09-21T07:38:28.880588+0000","last_clean":"2024-09-21T07:38:28.880588+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:38:28.880588+0000","last_undegraded":"2024-09-21T07:38:28.880588+0000","last_fullsized":"2024-09-21T07:38:28.880588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509635,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56228,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315612,"statfs":{"total":96636764160,"available":96579186688,"internally_reserved":0,"allocated":2895872,"data_stored":1369939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56224,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315616,"statfs":{"total":96636764160,"available":96579190784,"internally_reserved":0,"allocated":2895872,"data_stored":1369975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":2904064,"data_stored":1371517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509635,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60404,"kb_used_data":2844,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311436,"statfs":{"total":96636764160,"available":96574910464,"internally_reserved":0,"allocated":2912256,"data_stored":1372121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":2899968,"data_stored":1370029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509635,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56804,"kb_used_data":3408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315036,"statfs":{"total":96636764160,"available":96578596864,"internally_reserved":0,"allocated":3489792,"data_stored":1960343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56808,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315032,"statfs":{"total":96636764160,"available":96578592768,"internally_reserved":0,"allocated":3493888,"data_stored":1960877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88096,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283744,"statfs":{"total":96636764160,"available":96546553856,"internally_reserved":0,"allocated":2895872,"data_stored":1369995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:38:37.200 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:38:37.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:38:37.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- 172.21.15.64:0/1470300118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64a0004e00 msgr2=0x7f64a00052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 --2- 172.21.15.64:0/1470300118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64a0004e00 0x7f64a00052d0 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0ccc90 tx=0x7f64b401d260 comp rx=0 tx=0).stop 2024-09-21T07:38:37.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64bbe00640 1 -- 172.21.15.64:0/1470300118 reap_dead start 2024-09-21T07:38:37.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- 172.21.15.64:0/1470300118 shutdown_connections 2024-09-21T07:38:37.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- 172.21.15.64:0/1470300118 >> 172.21.15.64:0/1470300118 conn(0x7f64bc06d490 msgr2=0x7f64bc0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:37.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- 172.21.15.64:0/1470300118 shutdown_connections 2024-09-21T07:38:37.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- 172.21.15.64:0/1470300118 wait complete. 2024-09-21T07:38:37.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 Processor -- start 2024-09-21T07:38:37.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.406+0000 7f64c2200640 1 -- start start 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a0004e00 0x7f64bc0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 0x7f64bc0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc073dc0 con 0x7f64bc15e280 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc073c40 con 0x7f64bc0c72f0 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f64bc073f40 con 0x7f64a0004e00 2024-09-21T07:38:37.410 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35078/0 (socket says 172.21.15.64:35078) 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 -- 172.21.15.64:0/3223113511 learned_addr learned my addr 172.21.15.64:0/3223113511 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64bb400640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a0004e00 0x7f64bc0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64bbe00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 0x7f64bc0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 -- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a0004e00 msgr2=0x7f64bc0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a0004e00 0x7f64bc0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 -- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 msgr2=0x7f64bc0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 0x7f64bc0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 -- 172.21.15.64:0/3223113511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc1f66a0 con 0x7f64bc15e280 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64bbe00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 0x7f64bc0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b2a00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f64a40118b0 tx=0x7f64a4011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a400f9a0 con 0x7f64bc15e280 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64a400fb40 con 0x7f64bc15e280 2024-09-21T07:38:37.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64bc0b3280 con 0x7f64bc15e280 2024-09-21T07:38:37.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4005020 con 0x7f64bc15e280 2024-09-21T07:38:37.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64bc0b3840 con 0x7f64bc15e280 2024-09-21T07:38:37.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.410+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64bc0b3070 con 0x7f64bc15e280 2024-09-21T07:38:37.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.414+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f64a40051c0 con 0x7f64bc15e280 2024-09-21T07:38:37.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.414+0000 7f64b3e00640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 0x7f6498075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.414+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7f64a4094ff0 con 0x7f64bc15e280 2024-09-21T07:38:37.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.414+0000 7f64bb400640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 0x7f6498075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.414+0000 7f64bb400640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 0x7f6498075740 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f64ac006fd0 tx=0x7f64ac006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:37.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.418+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f64a405f790 con 0x7f64bc15e280 2024-09-21T07:38:37.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.658+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f64bc073530 con 0x7f64bc15e280 2024-09-21T07:38:37.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.662+0000 7f64b3e00640 1 -- 172.21.15.64:0/3223113511 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v40) ==== 190+0+147 (secure 0 0 0) 0x7f64a40641c0 con 0x7f64bc15e280 2024-09-21T07:38:37.662 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-09-21T07:38:37.662 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAFdO5mQqVkFxAAK42vCNCaQA0C9/gmqRxOnA== 2024-09-21T07:38:37.662 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2024-09-21T07:38:37.662 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2024-09-21T07:38:37.663 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:38:37.663 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2024-09-21T07:38:37.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 msgr2=0x7f6498075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 0x7f6498075740 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f64ac006fd0 tx=0x7f64ac006b20 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 msgr2=0x7f64bc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f64a40118b0 tx=0x7f64a4011d70 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 shutdown_connections 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6498073230 0x7f6498075740 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64bc0c72f0 0x7f64bc0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64bc15e280 0x7f64bc15e690 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 --2- 172.21.15.64:0/3223113511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a0004e00 0x7f64bc0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 >> 172.21.15.64:0/3223113511 conn(0x7f64bc06d490 msgr2=0x7f64bc0acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 shutdown_connections 2024-09-21T07:38:37.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.666+0000 7f64c2200640 1 -- 172.21.15.64:0/3223113511 wait complete. 2024-09-21T07:38:37.685 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 -- 172.21.15.64:0/2350275462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 msgr2=0x7fb43c0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 --2- 172.21.15.64:0/2350275462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0b3170 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0728a0 tx=0x7fb42401c7d0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 -- 172.21.15.64:0/2350275462 shutdown_connections 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 --2- 172.21.15.64:0/2350275462 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0b3170 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 --2- 172.21.15.64:0/2350275462 >> v2:172.21.15.90:3300/0 conn(0x7fb43c15af70 0x7fb43c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 -- 172.21.15.64:0/2350275462 >> 172.21.15.64:0/2350275462 conn(0x7fb43c06d570 msgr2=0x7fb43c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 -- 172.21.15.64:0/2350275462 shutdown_connections 2024-09-21T07:38:37.844 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.842+0000 7fb442800640 1 -- 172.21.15.64:0/2350275462 wait complete. 2024-09-21T07:38:37.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 Processor -- start 2024-09-21T07:38:37.845 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 -- start start 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 0x7fb43c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43c15af70 0x7fb43c1f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c165dc0 con 0x7fb43c06f610 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c165c40 con 0x7fb43c15af70 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb442800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c165f40 con 0x7fb43c0b36b0 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35104/0 (socket says 172.21.15.64:35104) 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 -- 172.21.15.64:0/3579314069 learned_addr learned my addr 172.21.15.64:0/3579314069 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43be00640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43c15af70 0x7fb43c1f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb433e00640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 0x7fb43c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 -- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 msgr2=0x7fb43c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 0x7fb43c0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 -- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43c15af70 msgr2=0x7fb43c1f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43c15af70 0x7fb43c1f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb43b400640 1 -- 172.21.15.64:0/3579314069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c1540d0 con 0x7fb43c06f610 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.846+0000 7fb433e00640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 0x7fb43c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:37.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb43b400640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c9f0 tx=0x7fb42c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c007bb0 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb42c007e40 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00f690 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c0c6210 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c069190 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c0c6000 con 0x7fb43c06f610 2024-09-21T07:38:37.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb42c00f830 con 0x7fb43c06f610 2024-09-21T07:38:37.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 0x7fb418075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:37.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.850+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb42c094b60 con 0x7fb43c06f610 2024-09-21T07:38:37.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.854+0000 7fb433e00640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 0x7fb418075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:37.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.854+0000 7fb433e00640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 0x7fb418075710 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb4240af000 tx=0x7fb42401b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:37.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:37.854+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb42c014030 con 0x7fb43c06f610 2024-09-21T07:38:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.066+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb43c0b3170 con 0x7fb43c06f610 2024-09-21T07:38:38.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.066+0000 7fb433400640 1 -- 172.21.15.64:0/3579314069 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7fb42c05f9e0 con 0x7fb43c06f610 2024-09-21T07:38:38.068 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:38.068 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":169,"btime":"2024-09-21T07:38:30:894787+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":11670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:30.310331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11676":{"gid":11676,"name":"a","rank":0,"incarnation":165,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/3686989750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3686989750},{"type":"v1","addr":"172.21.15.64:6835","nonce":3686989750}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11676,"qdb_cluster":[11676]},"id":16}]} 2024-09-21T07:38:38.068 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 169 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 msgr2=0x7fb418075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 0x7fb418075710 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb4240af000 tx=0x7fb42401b070 comp rx=0 tx=0).stop 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 msgr2=0x7fb43c0c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c9f0 tx=0x7fb42c00ceb0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 shutdown_connections 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb418073200 0x7fb418075710 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43c15af70 0x7fb43c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb43c0b36b0 0x7fb43c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 --2- 172.21.15.64:0/3579314069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb43c06f610 0x7fb43c0c4ea0 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 >> 172.21.15.64:0/3579314069 conn(0x7fb43c06d570 msgr2=0x7fb43c166c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 shutdown_connections 2024-09-21T07:38:38.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.070+0000 7fb442800640 1 -- 172.21.15.64:0/3579314069 wait complete. 2024-09-21T07:38:38.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 169, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:38:27.281818+0000', 'modified': '2024-09-21T07:38:30.310331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11676}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11676': {'gid': 11676, 'name': 'a', 'rank': 0, 'incarnation': 165, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/3686989750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 3686989750}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3686989750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11676, 'qdb_cluster': [11676]} 2024-09-21T07:38:38.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:38:38.495 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:38:38.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.654+0000 7fb07dc00640 1 -- 172.21.15.64:0/1532923238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0780b7a50 msgr2=0x7fb0780d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.654+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1532923238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0780b7a50 0x7fb0780d0ad0 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7fb0680098f0 tx=0x7fb06801c810 comp rx=0 tx=0).stop 2024-09-21T07:38:38.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- 172.21.15.64:0/1532923238 shutdown_connections 2024-09-21T07:38:38.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1532923238 >> v2:172.21.15.90:3300/0 conn(0x7fb078161470 0x7fb078167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1532923238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0780b7a50 0x7fb0780d0ad0 unknown :-1 s=CLOSED pgs=2558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- 172.21.15.64:0/1532923238 >> 172.21.15.64:0/1532923238 conn(0x7fb0780cef10 msgr2=0x7fb0780cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- 172.21.15.64:0/1532923238 shutdown_connections 2024-09-21T07:38:38.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- 172.21.15.64:0/1532923238 wait complete. 2024-09-21T07:38:38.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 Processor -- start 2024-09-21T07:38:38.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- start start 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 0x7fb078158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb078161470 0x7fb0780b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780b7fe0 con 0x7fb078160950 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780b7e60 con 0x7fb0780b7a50 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.658+0000 7fb07dc00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb0780d20f0 con 0x7fb078161470 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35118/0 (socket says 172.21.15.64:35118) 2024-09-21T07:38:38.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 -- 172.21.15.64:0/1894998931 learned_addr learned my addr 172.21.15.64:0/1894998931 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb076a00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 0x7fb078158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb077400640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb078161470 0x7fb0780b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 -- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb078161470 msgr2=0x7fb0780b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb078161470 0x7fb0780b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 -- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 msgr2=0x7fb078158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 0x7fb078158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 -- 172.21.15.64:0/1894998931 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07815b790 con 0x7fb078160950 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb076a00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 0x7fb078158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06fe00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c390 tx=0x7fb06000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06ea00640 1 -- 172.21.15.64:0/1894998931 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060017070 con 0x7fb078160950 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06ea00640 1 -- 172.21.15.64:0/1894998931 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0600053c0 con 0x7fb078160950 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0781f9b30 con 0x7fb078160950 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb06ea00640 1 -- 172.21.15.64:0/1894998931 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060003840 con 0x7fb078160950 2024-09-21T07:38:38.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.662+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07815b2b0 con 0x7fb078160950 2024-09-21T07:38:38.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb06ea00640 1 -- 172.21.15.64:0/1894998931 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb06001a070 con 0x7fb078160950 2024-09-21T07:38:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 Processor -- start 2024-09-21T07:38:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb06ea00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 0x7fb054075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 -- start start 2024-09-21T07:38:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb06ea00640 1 -- 172.21.15.64:0/1894998931 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb060093670 con 0x7fb078160950 2024-09-21T07:38:38.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb077400640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 0x7fb054075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb077400640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 0x7fb054075710 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb0780d15e0 tx=0x7fb070009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e80828be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 0x559e80829120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559e806fd410 con 0x559e802e7460 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559e8063ab40 con 0x559e806c0ca0 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559e80629f70 con 0x559e806d7950 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb076a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb076a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35128/0 (socket says 172.21.15.64:35128) 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb076a00640 1 -- 172.21.15.64:0/4146650733 learned_addr learned my addr 172.21.15.64:0/4146650733 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb06fe00640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e80828be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.666+0000 7fb077400640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 0x559e80829120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 -- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 msgr2=0x559e80828be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e80828be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 -- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 msgr2=0x559e80829120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 0x559e80829120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 -- 172.21.15.64:0/4146650733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e805f15b0 con 0x559e802e7460 2024-09-21T07:38:38.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb077400640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 0x559e80829120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb076a00640 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fb06801a440 tx=0x7fb0680195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9208a1eea15e3bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb067400640 1 -- 172.21.15.64:0/4146650733 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0680b2040 con 0x559e802e7460 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb067400640 1 -- 172.21.15.64:0/4146650733 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb068004240 con 0x559e802e7460 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb067400640 1 -- 172.21.15.64:0/4146650733 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0680a58d0 con 0x559e802e7460 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- 172.21.15.64:0/4146650733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 msgr2=0x559e808286a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fb06801a440 tx=0x7fb0680195b0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- 172.21.15.64:0/4146650733 shutdown_connections 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806c0ca0 0x559e80829120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e80828be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4146650733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e808286a0 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- 172.21.15.64:0/4146650733 >> 172.21.15.64:0/4146650733 conn(0x559e807add90 msgr2=0x559e807dd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- 172.21.15.64:0/4146650733 shutdown_connections 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- 172.21.15.64:0/4146650733 wait complete. 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 -- start start 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.670+0000 7fb0853e7000 1 Processor -- start 2024-09-21T07:38:38.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8082fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.674 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 0x559e808303a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559e805c45f0 con 0x559e802e7460 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559e8062dd80 con 0x559e806d7950 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559e805d0520 con 0x559e806c0ca0 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 10 client.0 _ll_register_callbacks cb 0x559e805d4830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35144/0 (socket says 172.21.15.64:35144) 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 -- 172.21.15.64:0/4019917033 learned_addr learned my addr 172.21.15.64:0/4019917033 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb06fe00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8082fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb077400640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 0x559e808303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 -- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 msgr2=0x559e8082fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8082fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 -- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 msgr2=0x559e808303a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 0x559e808303a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 -- 172.21.15.64:0/4019917033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e805c8190 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb077400640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 0x559e808303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb076a00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7fb068000c10 tx=0x7fb0680a6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44c4e78ea3a043b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0680b2030 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e805c2110 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb068004230 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fb0680c4050 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 10 client.11820 fetch_fsmap learned FSMap version 169 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x559e806aef10 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559e805c2110 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fb0680c7020 con 0x559e802e7460 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 10 client.11820 fetch_fsmap finished waiting for FSMap version 169 2024-09-21T07:38:38.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 10 client.11820 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:38:38.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 20 client.11820 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:38.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802cc7d0 0x559e80839d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 4 client.11820 mds_command: new command op to 11676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:38.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 --> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e8063ca90 con 0x559e802cc7d0 2024-09-21T07:38:38.677 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb06fe00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802cc7d0 0x559e80839d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb06fe00640 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802cc7d0 0x559e80839d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de4de9a2213839b server_cookie=14d84d77362ae214 in_seq=0 out_seq=0 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.674+0000 7fb05be00640 10 client.11820 ms_handle_connect on v2:172.21.15.64:6833/3686989750 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb05be00640 1 -- 172.21.15.64:0/4019917033 <== mds.0 v2:172.21.15.64:6833/3686989750 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e8063ca90 con 0x559e802cc7d0 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb05be00640 10 client.11820 handle_command_reply: tid=0 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 client.11820 shutdown 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 msgr2=0x559e8082f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7fb068000c10 tx=0x7fb0680a6d20 comp rx=0 tx=0).stop 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 shutdown_connections 2024-09-21T07:38:38.678 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802cc7d0 0x559e80839d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e806d7950 0x559e808303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8082fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 --2- 172.21.15.64:0/4019917033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e802e7460 0x559e8082f920 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb05be00640 0 client.11820 ms_handle_reset on v2:172.21.15.64:6833/3686989750 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 >> 172.21.15.64:0/4019917033 conn(0x559e807add90 msgr2=0x559e807e4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 shutdown_connections 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 1 -- 172.21.15.64:0/4019917033 wait complete. 2024-09-21T07:38:38.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.678+0000 7fb0853e7000 20 client.11820 trim_cache size 0 max 16384 2024-09-21T07:38:38.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.694+0000 7fb0853e7000 1 Processor -- start 2024-09-21T07:38:38.696 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.694+0000 7fb0853e7000 1 -- start start 2024-09-21T07:38:38.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e8089b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb078205b70 con 0x559e806c0ca0 2024-09-21T07:38:38.697 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb078204b80 con 0x559e802e7460 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb0781f9890 con 0x559e806d7950 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35146/0 (socket says 172.21.15.64:35146) 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 -- 172.21.15.64:0/3924702166 learned_addr learned my addr 172.21.15.64:0/3924702166 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb076a00640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.698 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb077400640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e8089b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 -- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 msgr2=0x559e8089b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e8089b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 -- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 msgr2=0x559e8089a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 -- 172.21.15.64:0/3924702166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e80685db0 con 0x559e806c0ca0 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb077400640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e8089b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb076a00640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:38.699 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb06fe00640 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fb06005dc20 tx=0x7fb060065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d122b3fa36245b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb066a00640 1 -- 172.21.15.64:0/3924702166 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0600678b0 con 0x559e806c0ca0 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb066a00640 1 -- 172.21.15.64:0/3924702166 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb060077030 con 0x559e806c0ca0 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb066a00640 1 -- 172.21.15.64:0/3924702166 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060063b90 con 0x559e806c0ca0 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- 172.21.15.64:0/3924702166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 msgr2=0x559e8089ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fb06005dc20 tx=0x7fb060065040 comp rx=0 tx=0).stop 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- 172.21.15.64:0/3924702166 shutdown_connections 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806d7950 0x559e8089b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806c0ca0 0x559e8089ab60 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 --2- 172.21.15.64:0/3924702166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- 172.21.15.64:0/3924702166 >> 172.21.15.64:0/3924702166 conn(0x559e807add90 msgr2=0x559e80826620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- 172.21.15.64:0/3924702166 shutdown_connections 2024-09-21T07:38:38.700 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.698+0000 7fb0853e7000 1 -- 172.21.15.64:0/3924702166 wait complete. 2024-09-21T07:38:38.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- start start 2024-09-21T07:38:38.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 Processor -- start 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806d7950 0x559e8089ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559e8062d090 con 0x559e806d7950 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559e806323b0 con 0x559e802e7460 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x559e806e9750 con 0x559e806c0ca0 2024-09-21T07:38:38.702 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 10 client.0 _ll_register_callbacks cb 0x7fb06005a5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:38.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb077400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806d7950 0x559e8089ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb076a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:51236/0 (socket says 172.21.15.64:51236) 2024-09-21T07:38:38.703 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 -- 172.21.15.64:0/2466952201 learned_addr learned my addr 172.21.15.64:0/2466952201 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 -- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 msgr2=0x559e8089e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.705 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 -- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806d7950 msgr2=0x559e8089ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806d7950 0x559e8089ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 -- 172.21.15.64:0/2466952201 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559e805f0ab0 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb06fe00640 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb060091a70 tx=0x7fb060078300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba288fa9113fcdfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0600678b0 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fb06007acc0 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb060077030 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fb06007aec0 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 10 client.9674 fetch_fsmap learned FSMap version 169 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x559e805cf070 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb060077030 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.702+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fb060063b90 con 0x559e806c0ca0 2024-09-21T07:38:38.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 10 client.9674 fetch_fsmap finished waiting for FSMap version 169 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 10 client.9674 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 20 client.9674 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802ba830 0x559e8085a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 4 client.9674 mds_command: new command op to 11676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 --> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] -- command(tid 0: {"prefix": "status"}) -- 0x559e80638540 con 0x559e802ba830 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb076a00640 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802ba830 0x559e8085a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb076a00640 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802ba830 0x559e8085a610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08fe4bf2bab70b server_cookie=afee6e315d51f076 in_seq=0 out_seq=0 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb05be00640 10 client.9674 ms_handle_connect on v2:172.21.15.64:6833/3686989750 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb05be00640 1 -- 172.21.15.64:0/2466952201 <== mds.0 v2:172.21.15.64:6833/3686989750 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x559e80638540 con 0x559e802ba830 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb05be00640 10 client.9674 handle_command_reply: tid=0 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 client.9674 shutdown 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 msgr2=0x559e8089e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb060091a70 tx=0x7fb060078300 comp rx=0 tx=0).stop 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 shutdown_connections 2024-09-21T07:38:38.707 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:6833/3686989750,v1:172.21.15.64:6835/3686989750] conn(0x559e802ba830 0x559e8085a610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559e806d7950 0x559e8089ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e806c0ca0 0x559e8089e8d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 --2- 172.21.15.64:0/2466952201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e802e7460 0x559e8089e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb05be00640 0 client.9674 ms_handle_reset on v2:172.21.15.64:6833/3686989750 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 >> 172.21.15.64:0/2466952201 conn(0x559e807add90 msgr2=0x559e80826fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 shutdown_connections 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 1 -- 172.21.15.64:0/2466952201 wait complete. 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb0853e7000 20 client.9674 trim_cache size 0 max 16384 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:38:38.708 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 11676, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 10.843848210000001, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 169, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 229, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 229, 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.227271885 2024-09-21T07:38:38.709 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 msgr2=0x7fb054075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 0x7fb054075710 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb0780d15e0 tx=0x7fb070009500 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 msgr2=0x7fb0781577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c390 tx=0x7fb06000c850 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 shutdown_connections 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb054073200 0x7fb054075710 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb078161470 0x7fb0780b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb078160950 0x7fb0781577b0 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 --2- 172.21.15.64:0/1894998931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780b7a50 0x7fb078158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 >> 172.21.15.64:0/1894998931 conn(0x7fb0780cef10 msgr2=0x7fb078072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 shutdown_connections 2024-09-21T07:38:38.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.706+0000 7fb07dc00640 1 -- 172.21.15.64:0/1894998931 wait complete. 2024-09-21T07:38:38.726 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:38:38.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 -- 172.21.15.64:0/2359697774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 msgr2=0x7fd53800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 --2- 172.21.15.64:0/2359697774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd53800b9d0 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00e400 tx=0x7fd54c01d770 comp rx=0 tx=0).stop 2024-09-21T07:38:38.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 -- 172.21.15.64:0/2359697774 shutdown_connections 2024-09-21T07:38:38.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 --2- 172.21.15.64:0/2359697774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd53800b9d0 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 -- 172.21.15.64:0/2359697774 >> 172.21.15.64:0/2359697774 conn(0x7fd5540b3ff0 msgr2=0x7fd5540b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:38.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 -- 172.21.15.64:0/2359697774 shutdown_connections 2024-09-21T07:38:38.887 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.886+0000 7fd559e00640 1 -- 172.21.15.64:0/2359697774 wait complete. 2024-09-21T07:38:38.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 Processor -- start 2024-09-21T07:38:38.888 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- start start 2024-09-21T07:38:38.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5541fa380 0x7fd5541564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5541f97e0 0x7fd5541f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd55409af70 con 0x7fd538005290 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd55409adf0 con 0x7fd5541fa380 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fd55409b0f0 con 0x7fd5541f97e0 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35174/0 (socket says 172.21.15.64:35174) 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 -- 172.21.15.64:0/633426204 learned_addr learned my addr 172.21.15.64:0/633426204 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd54a000640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5541fa380 0x7fd5541564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd553400640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5541f97e0 0x7fd5541f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 -- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5541f97e0 msgr2=0x7fd5541f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5541f97e0 0x7fd5541f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 -- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5541fa380 msgr2=0x7fd5541564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5541fa380 0x7fd5541564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:38.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 -- 172.21.15.64:0/633426204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5541fa130 con 0x7fd538005290 2024-09-21T07:38:38.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd552a00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fd544001a40 tx=0x7fd5440129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544013920 con 0x7fd538005290 2024-09-21T07:38:38.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd544013ac0 con 0x7fd538005290 2024-09-21T07:38:38.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544010480 con 0x7fd538005290 2024-09-21T07:38:38.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55415d660 con 0x7fd538005290 2024-09-21T07:38:38.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.890+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55415dc20 con 0x7fd538005290 2024-09-21T07:38:38.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5540b55d0 con 0x7fd538005290 2024-09-21T07:38:38.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd544010620 con 0x7fd538005290 2024-09-21T07:38:38.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd54be00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 0x7fd530075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:38.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fd544098140 con 0x7fd538005290 2024-09-21T07:38:38.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd54a000640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 0x7fd530075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:38.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.894+0000 7fd54a000640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 0x7fd530075760 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd53c000c10 tx=0x7fd53c006b20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:38.899 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:38.898+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fd5541fa130 con 0x7fd538005290 2024-09-21T07:38:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.118+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd55409b6a0 con 0x7fd538005290 2024-09-21T07:38:39.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.118+0000 7fd54be00640 1 -- 172.21.15.64:0/633426204 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v169) ==== 53+0+73 (secure 0 0 0) 0x7fd55409b330 con 0x7fd538005290 2024-09-21T07:38:39.119 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:38:39.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 msgr2=0x7fd530075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 0x7fd530075760 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd53c000c10 tx=0x7fd53c006b20 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 msgr2=0x7fd55415b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fd544001a40 tx=0x7fd5440129e0 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 shutdown_connections 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fd530073250 0x7fd530075760 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5541f97e0 0x7fd5541f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5541fa380 0x7fd5541564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 --2- 172.21.15.64:0/633426204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd538005290 0x7fd55415b940 unknown :-1 s=CLOSED pgs=2565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 >> 172.21.15.64:0/633426204 conn(0x7fd5540b3ff0 msgr2=0x7fd5540cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 shutdown_connections 2024-09-21T07:38:39.121 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39.122+0000 7fd559e00640 1 -- 172.21.15.64:0/633426204 wait complete. 2024-09-21T07:38:39.138 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:38:39.139 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:39.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.139 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-09-21T07:38:39.149 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 41464sec preferred_lft 41464sec 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9e:37:bf:f7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-21T07:38:39.150 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:38:39.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.152 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:38:39.209 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-09-21T07:38:39.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.214 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-09-21T07:38:39.267 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-09-21T07:38:39.267 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:38:39.267 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-21T07:38:39.267 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-21T07:38:39.268 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:38:39.268 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:38:39.268 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-09-21T07:38:39.268 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:38:39.268 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:38:39.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:38:39.269 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-09-21T07:38:39.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:38:39.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:38:39.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.406 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:38:39.418 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:38:39.418 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:38:39.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:39.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.418 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-09-21T07:38:39.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:38:39.479 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:39.527 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:38:39.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:38:39.528 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:39.579 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:38:39.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:39.680 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:39.680 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:38:39.695 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:38:39.695 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:38:39.695 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.90:3300,172.21.15.90:3301" 2024-09-21T07:38:39.695 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with new device syntax: 0@be0ccda5-3d1a-4615-9c09-c8d9d4461231.cephfs=/ 2024-09-21T07:38:39.695 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.64:3300/172.21.15.90:3300/172.21.15.90:3301" will pass to kernel 2024-09-21T07:38:39.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:38:39.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:39.720 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:38:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:38:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:38:39.828 INFO:teuthology.orchestra.run.smithi064.stdout:client9680 2024-09-21T07:38:39.829 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:39.829 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:39.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.839 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-09-21T07:38:39.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:39.894 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-09-21T07:38:39.946 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:39.946 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:40.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:40.000 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-21T07:38:40.132 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records in 2024-09-21T07:38:40.133 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records out 2024-09-21T07:38:40.133 INFO:teuthology.orchestra.run.smithi064.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0765859 s, 82.1 MB/s 2024-09-21T07:38:40.134 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:40.134 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:40.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:40.143 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-21T07:38:40.272 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records in 2024-09-21T07:38:40.272 INFO:teuthology.orchestra.run.smithi064.stderr:6+0 records out 2024-09-21T07:38:40.272 INFO:teuthology.orchestra.run.smithi064.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0757424 s, 83.1 MB/s 2024-09-21T07:38:40.274 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:38:40.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:38:40.317 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.318 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:38:40.319 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-09-21T07:38:40.320 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-09-21T07:38:40.321 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-09-21T07:38:40.322 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-09-21T07:38:40.323 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-09-21T07:38:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.325 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-09-21T07:38:40.326 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout: mds cache max size = 1000 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout: mds log max segments = 1 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = False 2024-09-21T07:38:40.327 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = False 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T07:38:40.328 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:38:40.329 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.330 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.331 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.332 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-09-21T07:38:40.333 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.334 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.335 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T07:38:40.336 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: mds cache max size = 1000 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: mds log max segments = 1 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = False 2024-09-21T07:38:40.337 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = False 2024-09-21T07:38:40.339 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:38:40.386 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.426 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.427 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:38:40.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.429 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-09-21T07:38:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-09-21T07:38:40.431 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.432 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-09-21T07:38:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:38:40.434 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-09-21T07:38:40.435 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout: mds cache max size = 1000 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout: mds log max segments = 1 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = False 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = False 2024-09-21T07:38:40.436 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.437 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T07:38:40.438 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.64,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = be0ccda5-3d1a-4615-9c09-c8d9d4461231 2024-09-21T07:38:40.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T07:38:40.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T07:38:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T07:38:40.442 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T07:38:40.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T07:38:40.445 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout: mds cache max size = 1000 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout: mds log max segments = 1 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = False 2024-09-21T07:38:40.446 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = False 2024-09-21T07:38:40.447 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:40.447 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:40.500 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:38:40.500 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:38:40.555 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:38:40.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 -- 172.21.15.64:0/3002884548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c06fae0 msgr2=0x7f858c0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:40.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 --2- 172.21.15.64:0/3002884548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c06fae0 0x7f858c0af790 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f858c0725c0 tx=0x7f858001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 -- 172.21.15.64:0/3002884548 shutdown_connections 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 --2- 172.21.15.64:0/3002884548 >> v2:172.21.15.90:3300/0 conn(0x7f858c0b46f0 0x7f858c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 --2- 172.21.15.64:0/3002884548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c06fae0 0x7f858c0af790 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 -- 172.21.15.64:0/3002884548 >> 172.21.15.64:0/3002884548 conn(0x7f858c06d570 msgr2=0x7f858c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 -- 172.21.15.64:0/3002884548 shutdown_connections 2024-09-21T07:38:40.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.758+0000 7f8594400640 1 -- 172.21.15.64:0/3002884548 wait complete. 2024-09-21T07:38:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 Processor -- start 2024-09-21T07:38:40.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- start start 2024-09-21T07:38:40.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 0x7f858c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f858c0b46f0 0x7f858c0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f858c169390 con 0x7f858c0b3170 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f858c169210 con 0x7f858c0b46f0 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f858c169510 con 0x7f858c06fae0 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35198/0 (socket says 172.21.15.64:35198) 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 -- 172.21.15.64:0/1777154840 learned_addr learned my addr 172.21.15.64:0/1777154840 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591a00640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 0x7f858c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 -- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 msgr2=0x7f858c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 0x7f858c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 -- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f858c0b46f0 msgr2=0x7f858c0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f858c0b46f0 0x7f858c0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 -- 172.21.15.64:0/1777154840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c099e20 con 0x7f858c0b3170 2024-09-21T07:38:40.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591a00640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 0x7f858c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:38:40.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8591000640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f857800ca20 tx=0x7f857800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:40.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007c10 con 0x7f858c0b3170 2024-09-21T07:38:40.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857800f450 con 0x7f858c0b3170 2024-09-21T07:38:40.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c0c8e90 con 0x7f858c0b3170 2024-09-21T07:38:40.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857800f8a0 con 0x7f858c0b3170 2024-09-21T07:38:40.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.762+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c0c9450 con 0x7f858c0b3170 2024-09-21T07:38:40.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c0c8c00 con 0x7f858c0b3170 2024-09-21T07:38:40.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f857800fa40 con 0x7f858c0b3170 2024-09-21T07:38:40.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8589600640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 0x7f856c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:40.766 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7f8578094b80 con 0x7f858c0b3170 2024-09-21T07:38:40.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8591a00640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 0x7f856c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:40.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.766+0000 7f8591a00640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 0x7f856c075710 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f85800af000 tx=0x7f858001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:40.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.770+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f8578014030 con 0x7f858c0b3170 2024-09-21T07:38:40.879 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:40.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:40.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.958+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f858c076840 con 0x7f858c0b3170 2024-09-21T07:38:40.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.958+0000 7f8589600640 1 -- 172.21.15.64:0/1777154840 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v229) ==== 80+0+0 (secure 0 0 0) 0x7f857805f970 con 0x7f858c0b3170 2024-09-21T07:38:40.959 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2024-09-21T07:38:40.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 msgr2=0x7f856c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:40.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 0x7f856c075710 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f85800af000 tx=0x7f858001b100 comp rx=0 tx=0).stop 2024-09-21T07:38:40.961 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 msgr2=0x7f858c0998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f857800ca20 tx=0x7f857800cee0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 shutdown_connections 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f856c073200 0x7f856c075710 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f858c0b46f0 0x7f858c0b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f858c0b3170 0x7f858c0998e0 unknown :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 --2- 172.21.15.64:0/1777154840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f858c06fae0 0x7f858c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 >> 172.21.15.64:0/1777154840 conn(0x7f858c06d570 msgr2=0x7f858c0cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 shutdown_connections 2024-09-21T07:38:40.962 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:40.962+0000 7f8594400640 1 -- 172.21.15.64:0/1777154840 wait complete. 2024-09-21T07:38:40.981 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:38:40.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:40.981 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:38:41.099 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:38:41.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:41.099 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:38:41.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 -- 172.21.15.64:0/1040771438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b3170 msgr2=0x7fdd4c0b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 --2- 172.21.15.64:0/1040771438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b3170 0x7fdd4c0b3580 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009c80 tx=0x7fdd4401cd60 comp rx=0 tx=0).stop 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 -- 172.21.15.64:0/1040771438 shutdown_connections 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 --2- 172.21.15.64:0/1040771438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b3170 0x7fdd4c0b3580 unknown :-1 s=CLOSED pgs=2568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 --2- 172.21.15.64:0/1040771438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b46f0 0x7fdd4c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 --2- 172.21.15.64:0/1040771438 >> v2:172.21.15.90:3300/0 conn(0x7fdd4c06fae0 0x7fdd4c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 -- 172.21.15.64:0/1040771438 >> 172.21.15.64:0/1040771438 conn(0x7fdd4c06d570 msgr2=0x7fdd4c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:41.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 -- 172.21.15.64:0/1040771438 shutdown_connections 2024-09-21T07:38:41.323 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 -- 172.21.15.64:0/1040771438 wait complete. 2024-09-21T07:38:41.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.322+0000 7fdd54400640 1 Processor -- start 2024-09-21T07:38:41.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- start start 2024-09-21T07:38:41.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b3170 0x7fdd4c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 0x7fdd4c1fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cbc60 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cbae0 con 0x7fdd4c06fae0 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cbde0 con 0x7fdd4c0b3170 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 0x7fdd4c1fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd51a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd51a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:46334/0 (socket says 172.21.15.64:46334) 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd51a00640 1 -- 172.21.15.64:0/2116930812 learned_addr learned my addr 172.21.15.64:0/2116930812 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd51000640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b3170 0x7fdd4c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 -- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b3170 msgr2=0x7fdd4c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b3170 0x7fdd4c156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 -- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 msgr2=0x7fdd4c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 -- 172.21.15.64:0/2116930812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c1fd4b0 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd51a00640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:38:41.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd52400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 0x7fdd4c1fc670 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fdd440ac000 tx=0x7fdd44005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:41.328 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440bc070 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd44003fc0 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440b2040 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c0c5640 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.326+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c0b1e60 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c0b3580 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.329 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdd440043f0 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd49600640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 0x7fdd2c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fdd4412dff0 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd51a00640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 0x7fdd2c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.330+0000 7fdd51a00640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 0x7fdd2c075740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009680 tx=0x7fdd400091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:41.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.334+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fdd44016950 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.546+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd4c0af9b0 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.546+0000 7fdd49600640 1 -- 172.21.15.64:0/2116930812 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7fdd440f8830 con 0x7fdd4c0b46f0 2024-09-21T07:38:41.546 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":169,"btime":"2024-09-21T07:38:30:894787+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":11670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:30.310331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11676":{"gid":11676,"name":"a","rank":0,"incarnation":165,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/3686989750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3686989750},{"type":"v1","addr":"172.21.15.64:6835","nonce":3686989750}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11676,"qdb_cluster":[11676]},"id":16}]} 2024-09-21T07:38:41.547 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 169 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 msgr2=0x7fdd2c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 0x7fdd2c075740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009680 tx=0x7fdd400091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 msgr2=0x7fdd4c1fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 0x7fdd4c1fc670 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fdd440ac000 tx=0x7fdd44005a80 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 shutdown_connections 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdd2c073230 0x7fdd2c075740 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd4c0b46f0 0x7fdd4c1fc670 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd4c0b3170 0x7fdd4c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 --2- 172.21.15.64:0/2116930812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd4c06fae0 0x7fdd4c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 >> 172.21.15.64:0/2116930812 conn(0x7fdd4c06d570 msgr2=0x7fdd4c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:41.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 shutdown_connections 2024-09-21T07:38:41.550 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.550+0000 7fdd54400640 1 -- 172.21.15.64:0/2116930812 wait complete. 2024-09-21T07:38:41.569 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-21T07:38:41.751 INFO:teuthology.orchestra.run.smithi064.stdout:{"message":"","return_code":0} 2024-09-21T07:38:41.751 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-21T07:38:41.751 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 -- 172.21.15.64:0/3405920914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac280d04b0 msgr2=0x7fac28073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 --2- 172.21.15.64:0/3405920914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac280d04b0 0x7fac28073960 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fac18009900 tx=0x7fac1801c8e0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 -- 172.21.15.64:0/3405920914 shutdown_connections 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 --2- 172.21.15.64:0/3405920914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac28073ea0 0x7fac2815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 --2- 172.21.15.64:0/3405920914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac280d04b0 0x7fac28073960 unknown :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 -- 172.21.15.64:0/3405920914 >> 172.21.15.64:0/3405920914 conn(0x7fac280b29e0 msgr2=0x7fac280b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 -- 172.21.15.64:0/3405920914 shutdown_connections 2024-09-21T07:38:41.912 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.910+0000 7fac2d600640 1 -- 172.21.15.64:0/3405920914 wait complete. 2024-09-21T07:38:41.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 Processor -- start 2024-09-21T07:38:41.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 -- start start 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac280d04b0 0x7fac28151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2815d2b0 0x7fac281fa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac28169df0 con 0x7fac28073ea0 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac28169c70 con 0x7fac2815d2b0 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac2d600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fac28169f70 con 0x7fac280d04b0 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35212/0 (socket says 172.21.15.64:35212) 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 -- 172.21.15.64:0/2801467166 learned_addr learned my addr 172.21.15.64:0/2801467166 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:41.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac27400640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2815d2b0 0x7fac281fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26000640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac280d04b0 0x7fac28151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 -- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac280d04b0 msgr2=0x7fac28151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac280d04b0 0x7fac28151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 -- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2815d2b0 msgr2=0x7fac281fa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2815d2b0 0x7fac281fa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.914+0000 7fac26a00640 1 -- 172.21.15.64:0/2801467166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac281480f0 con 0x7fac28073ea0 2024-09-21T07:38:41.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac26a00640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fac18009850 tx=0x7fac180a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180b2040 con 0x7fac28073ea0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac180043b0 con 0x7fac28073ea0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac281483d0 con 0x7fac28073ea0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18005290 con 0x7fac28073ea0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac28148990 con 0x7fac28073ea0 2024-09-21T07:38:41.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2815cd70 con 0x7fac28073ea0 2024-09-21T07:38:41.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac18005430 con 0x7fac28073ea0 2024-09-21T07:38:41.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.918+0000 7fac1ea00640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 0x7fac08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:41.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.922+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 6101+0+0 (secure 0 0 0) 0x7fac1812d9e0 con 0x7fac28073ea0 2024-09-21T07:38:41.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.922+0000 7fac26000640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 0x7fac08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:41.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.922+0000 7fac26000640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 0x7fac08075710 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fac2814c1e0 tx=0x7fac1400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:41.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:41.926+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fac180164d0 con 0x7fac28073ea0 2024-09-21T07:38:42.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.138+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fac28073a00 con 0x7fac28073ea0 2024-09-21T07:38:42.139 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:38:42.138+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:38:42.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.142+0000 7fac1ea00640 1 -- 172.21.15.64:0/2801467166 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v170) ==== 161+0+0 (secure 0 0 0) 0x7fac180f8220 con 0x7fac28073ea0 2024-09-21T07:38:42.141 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:38:42.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 msgr2=0x7fac08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 0x7fac08075710 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fac2814c1e0 tx=0x7fac1400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 msgr2=0x7fac2814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fac18009850 tx=0x7fac180a5650 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 shutdown_connections 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fac08073200 0x7fac08075710 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2815d2b0 0x7fac281fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fac280d04b0 0x7fac28151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 --2- 172.21.15.64:0/2801467166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac28073ea0 0x7fac2814d610 secure :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fac18009850 tx=0x7fac180a5650 comp rx=0 tx=0).stop 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 >> 172.21.15.64:0/2801467166 conn(0x7fac280b29e0 msgr2=0x7fac280af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 shutdown_connections 2024-09-21T07:38:42.147 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.146+0000 7fac2d600640 1 -- 172.21.15.64:0/2801467166 wait complete. 2024-09-21T07:38:42.156 INFO:tasks.ceph.mds.a.smithi064.stderr: -6384> 2024-09-21T07:38:29.838+0000 7fd146600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:38:42.168 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2024-09-21T07:38:42.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 Processor -- start 2024-09-21T07:38:42.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 -- start start 2024-09-21T07:38:42.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3b5820 0x56392a3b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a46fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56392a303a00 con 0x56392a3fcc90 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56392a361f40 con 0x56392a471ff0 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f35961a0080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56392a3e37a0 con 0x56392a3b5820 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35242/0 (socket says 172.21.15.64:35242) 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358f400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3b5820 0x56392a3b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 -- 172.21.15.64:0/1724170563 learned_addr learned my addr 172.21.15.64:0/1724170563 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358fe00640 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a46fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 -- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3b5820 msgr2=0x56392a3b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3b5820 0x56392a3b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 -- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 msgr2=0x56392a46fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:42.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a46fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 -- 172.21.15.64:0/1724170563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56392a2dcc10 con 0x56392a3fcc90 2024-09-21T07:38:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358ea00640 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f357c01b700 tx=0x7f357c01a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3f56a053a5fa2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358d600640 1 -- 172.21.15.64:0/1724170563 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a7b70 con 0x56392a3fcc90 2024-09-21T07:38:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358d600640 1 -- 172.21.15.64:0/1724170563 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f357c0a7d10 con 0x56392a3fcc90 2024-09-21T07:38:42.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.230+0000 7f358d600640 1 -- 172.21.15.64:0/1724170563 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0b06d0 con 0x56392a3fcc90 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- 172.21.15.64:0/1724170563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 msgr2=0x56392a50fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f357c01b700 tx=0x7f357c01a870 comp rx=0 tx=0).stop 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- 172.21.15.64:0/1724170563 shutdown_connections 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a46fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3fcc90 0x56392a50fba0 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- 172.21.15.64:0/1724170563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3b5820 0x56392a3b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- 172.21.15.64:0/1724170563 >> 172.21.15.64:0/1724170563 conn(0x56392a3a1da0 msgr2=0x56392a4710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- 172.21.15.64:0/1724170563 shutdown_connections 2024-09-21T07:38:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- 172.21.15.64:0/1724170563 wait complete. 2024-09-21T07:38:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 Processor -- start 2024-09-21T07:38:42.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- start start 2024-09-21T07:38:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 0x56392a46ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3fcc90 0x56392a457550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a3fa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56392a3e1410 con 0x56392a3b5820 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56392a3e16b0 con 0x56392a471ff0 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f35961a0080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56392a3e1950 con 0x56392a3fcc90 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 0x56392a46ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358ea00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3fcc90 0x56392a457550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 0x56392a46ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35250/0 (socket says 172.21.15.64:35250) 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 -- 172.21.15.64:0/517919173 learned_addr learned my addr 172.21.15.64:0/517919173 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358fe00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a3fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 -- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3fcc90 msgr2=0x56392a457550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.238 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56392a3fcc90 0x56392a457550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 -- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 msgr2=0x56392a3fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56392a471ff0 0x56392a3fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.234+0000 7f358f400640 1 -- 172.21.15.64:0/517919173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56392a46f380 con 0x56392a3b5820 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f358f400640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 0x56392a46ee40 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7f3580008780 tx=0x7f3580008c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 -- 172.21.15.64:0/517919173 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358001a070 con 0x56392a3b5820 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 -- 172.21.15.64:0/517919173 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358000add0 con 0x56392a3b5820 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 -- 172.21.15.64:0/517919173 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580015680 con 0x56392a3b5820 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56392a45c870 con 0x56392a3b5820 2024-09-21T07:38:42.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56392a45a060 con 0x56392a3b5820 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 -- 172.21.15.64:0/517919173 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f358001d070 con 0x56392a3b5820 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3570071c10 0x7f3570074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.238+0000 7f3587e00640 1 -- 172.21.15.64:0/517919173 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f3580093260 con 0x56392a3b5820 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358ea00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3570071c10 0x7f3570074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56392a45ace0 0x56392a45b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- osd_op(unknown.0.0:1 33.10 33:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e230) -- 0x56392a517ec0 con 0x56392a45ace0 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358fe00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56392a45ace0 0x56392a45b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358ea00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3570071c10 0x7f3570074120 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f357c0b8000 tx=0x7f357c002040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358fe00640 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56392a45ace0 0x56392a45b0f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358fe00640 1 -- 172.21.15.64:0/517919173 <== osd.3 v2:172.21.15.64:6800/2986416528 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=535b] v0'0 uv10 ondisk = 0) ==== 164+0+535 (crc 0 0 0) 0x7f35880025a0 con 0x56392a45ace0 2024-09-21T07:38:42.242 INFO:teuthology.orchestra.run.smithi064.stderr:Writing to - 2024-09-21T07:38:42.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56392a45ace0 msgr2=0x56392a45b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56392a45ace0 0x56392a45b0f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.243 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3570071c10 msgr2=0x7f3570074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3570071c10 0x7f3570074120 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f357c0b8000 tx=0x7f357c002040 comp rx=0 tx=0).stop 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 msgr2=0x56392a46ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 --2- 172.21.15.64:0/517919173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56392a3b5820 0x56392a46ee40 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7f3580008780 tx=0x7f3580008c40 comp rx=0 tx=0).stop 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f358fe00640 1 -- 172.21.15.64:0/517919173 reap_dead start 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 shutdown_connections 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 >> 172.21.15.64:0/517919173 conn(0x56392a3a1da0 msgr2=0x56392a470a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 shutdown_connections 2024-09-21T07:38:42.244 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.242+0000 7f35961a0080 1 -- 172.21.15.64:0/517919173 wait complete. 2024-09-21T07:38:42.247 INFO:teuthology.orchestra.run.smithi064.stdout:i���x�f�d����@@"`��������x�f�dx�f�>(8`x�f�d8`x�f�d��������x�f�>����`�������� 2024-09-21T07:38:42.247 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2024-09-21T07:38:42.286 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2024-09-21T07:38:42.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.306+0000 7efda960d080 1 Processor -- start 2024-09-21T07:38:42.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.306+0000 7efda960d080 1 -- start start 2024-09-21T07:38:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bd30c90 0x56306bce73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 0x56306be503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56306bc37a00 con 0x56306bda5ff0 2024-09-21T07:38:42.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56306bc95f40 con 0x56306bd30c90 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56306bda6400 con 0x56306bce78e0 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35300/0 (socket says 172.21.15.64:35300) 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 -- 172.21.15.64:0/4099244589 learned_addr learned my addr 172.21.15.64:0/4099244589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda2800640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bd30c90 0x56306bce73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda3200640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 0x56306be503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 -- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 msgr2=0x56306be503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 0x56306be503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 -- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bd30c90 msgr2=0x56306bce73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bd30c90 0x56306bce73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 -- 172.21.15.64:0/4099244589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56306bc10c10 con 0x56306bda5ff0 2024-09-21T07:38:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda3200640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 0x56306be503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda1e00640 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7efd9000a440 tx=0x7efd9000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2e92aaba87bb3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda0a00640 1 -- 172.21.15.64:0/4099244589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9000b930 con 0x56306bda5ff0 2024-09-21T07:38:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda0a00640 1 -- 172.21.15.64:0/4099244589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd9000f070 con 0x56306bda5ff0 2024-09-21T07:38:42.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda0a00640 1 -- 172.21.15.64:0/4099244589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90014470 con 0x56306bda5ff0 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- 172.21.15.64:0/4099244589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 msgr2=0x56306be4fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7efd9000a440 tx=0x7efd9000a900 comp rx=0 tx=0).stop 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- 172.21.15.64:0/4099244589 shutdown_connections 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bce78e0 0x56306be503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bda5ff0 0x56306be4fe80 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 --2- 172.21.15.64:0/4099244589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bd30c90 0x56306bce73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- 172.21.15.64:0/4099244589 >> 172.21.15.64:0/4099244589 conn(0x56306bcd5da0 msgr2=0x56306bd15550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- 172.21.15.64:0/4099244589 shutdown_connections 2024-09-21T07:38:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- 172.21.15.64:0/4099244589 wait complete. 2024-09-21T07:38:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 Processor -- start 2024-09-21T07:38:42.313 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.310+0000 7efda960d080 1 -- start start 2024-09-21T07:38:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 0x56306bda2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bd30c90 0x56306bda1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.314 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bda5ff0 0x56306bda27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56306bd2bd50 con 0x56306bce78e0 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56306bdbc6d0 con 0x56306bda5ff0 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x56306bd2bff0 con 0x56306bd30c90 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 0x56306bda2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 0x56306bda2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35302/0 (socket says 172.21.15.64:35302) 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 -- 172.21.15.64:0/345262962 learned_addr learned my addr 172.21.15.64:0/345262962 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda1e00640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bd30c90 0x56306bda1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda3200640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bda5ff0 0x56306bda27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 -- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bd30c90 msgr2=0x56306bda1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56306bd30c90 0x56306bda1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.315 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 -- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bda5ff0 msgr2=0x56306bda27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56306bda5ff0 0x56306bda27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 -- 172.21.15.64:0/345262962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56306be54430 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda2800640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 0x56306bda2080 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7efd9409a380 tx=0x7efd940a7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efd9b400640 1 -- 172.21.15.64:0/345262962 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b0a40 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efd9b400640 1 -- 172.21.15.64:0/345262962 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd940b0be0 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efd9b400640 1 -- 172.21.15.64:0/345262962 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940bc410 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56306be546d0 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.314+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56306be54c10 con 0x56306bce78e0 2024-09-21T07:38:42.316 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efd9b400640 1 -- 172.21.15.64:0/345262962 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd940ba030 con 0x56306bce78e0 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efd9b400640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd84071be0 0x7efd840740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efd9b400640 1 -- 172.21.15.64:0/345262962 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7efd94130d30 con 0x56306bce78e0 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda1e00640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd84071be0 0x7efd840740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda960d080 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56306be55350 0x56306be55760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- osd_op(unknown.0.0:1 33.10 33:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=531b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e230) -- 0x56306be4a000 con 0x56306be55350 2024-09-21T07:38:42.318 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda3200640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56306be55350 0x56306be55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda1e00640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd84071be0 0x7efd840740f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7efd90000c10 tx=0x7efd90002ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.319 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.318+0000 7efda3200640 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56306be55350 0x56306be55760 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda3200640 1 -- 172.21.15.64:0/345262962 <== osd.3 v2:172.21.15.64:6800/2986416528 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v230'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7efd9c00eae0 con 0x56306be55350 2024-09-21T07:38:42.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56306be55350 msgr2=0x56306be55760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.320 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x56306be55350 0x56306be55760 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd84071be0 msgr2=0x7efd840740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7efd84071be0 0x7efd840740f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7efd90000c10 tx=0x7efd90002ff0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 msgr2=0x56306bda2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 --2- 172.21.15.64:0/345262962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56306bce78e0 0x56306bda2080 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7efd9409a380 tx=0x7efd940a7920 comp rx=0 tx=0).stop 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda3200640 1 -- 172.21.15.64:0/345262962 reap_dead start 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 shutdown_connections 2024-09-21T07:38:42.321 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 >> 172.21.15.64:0/345262962 conn(0x56306bcd5da0 msgr2=0x56306bd2edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 shutdown_connections 2024-09-21T07:38:42.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.322+0000 7efda960d080 1 -- 172.21.15.64:0/345262962 wait complete. 2024-09-21T07:38:42.326 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2024-09-21T07:38:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- 172.21.15.64:0/2456280236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 msgr2=0x7f98980b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 --2- 172.21.15.64:0/2456280236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f98980b5710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9890009bc0 tx=0x7f989001cba0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- 172.21.15.64:0/2456280236 shutdown_connections 2024-09-21T07:38:42.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 --2- 172.21.15.64:0/2456280236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f98980b5710 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 --2- 172.21.15.64:0/2456280236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98980cff30 0x7f98980b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- 172.21.15.64:0/2456280236 >> 172.21.15.64:0/2456280236 conn(0x7f98980b2ff0 msgr2=0x7f98980b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- 172.21.15.64:0/2456280236 shutdown_connections 2024-09-21T07:38:42.530 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- 172.21.15.64:0/2456280236 wait complete. 2024-09-21T07:38:42.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 Processor -- start 2024-09-21T07:38:42.531 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.530+0000 7f989e200640 1 -- start start 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f989815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 0x7f98980afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f98981690a0 con 0x7f98980cff30 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9898168f20 con 0x7f98980b5300 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9898169220 con 0x7f989815efa0 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35306/0 (socket says 172.21.15.64:35306) 2024-09-21T07:38:42.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988fe00640 1 -- 172.21.15.64:0/97773493 learned_addr learned my addr 172.21.15.64:0/97773493 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897400640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f989815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 0x7f98980afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 -- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 msgr2=0x7f989815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f989815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 -- 172.21.15.64:0/97773493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 msgr2=0x7f98980af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 -- 172.21.15.64:0/97773493 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989815beb0 con 0x7f989815efa0 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988fe00640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:38:42.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f9897e00640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 0x7f98980afb90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9898074370 tx=0x7f9890009200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900bb070 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9890004d40 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98980c93a0 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900b2040 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98980aeb70 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.534+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98980b5710 con 0x7f989815efa0 2024-09-21T07:38:42.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.538+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9890004220 con 0x7f989815efa0 2024-09-21T07:38:42.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.538+0000 7f988f400640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 0x7f9874075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.538+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f989012e850 con 0x7f989815efa0 2024-09-21T07:38:42.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.538+0000 7f9897400640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 0x7f9874075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.538+0000 7f9897400640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 0x7f9874075740 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9888007d70 tx=0x7f9888007d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.542+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f98900a5e20 con 0x7f989815efa0 2024-09-21T07:38:42.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.718+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) -- 0x7f989809cc90 con 0x7f989815efa0 2024-09-21T07:38:42.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.722+0000 7f988f400640 1 -- 172.21.15.64:0/97773493 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v69)=0 v69) ==== 140+0+0 (secure 0 0 0) 0x7f9890016790 con 0x7f989815efa0 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 msgr2=0x7f9874075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 0x7f9874075740 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9888007d70 tx=0x7f9888007d00 comp rx=0 tx=0).stop 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 msgr2=0x7f98980afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 0x7f98980afb90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9898074370 tx=0x7f9890009200 comp rx=0 tx=0).stop 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 shutdown_connections 2024-09-21T07:38:42.725 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9874073230 0x7f9874075740 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f989815efa0 0x7f98980afb90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98980cff30 0x7f98980af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 --2- 172.21.15.64:0/97773493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98980b5300 0x7f989815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 >> 172.21.15.64:0/97773493 conn(0x7f98980b2ff0 msgr2=0x7f98980b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 shutdown_connections 2024-09-21T07:38:42.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.726+0000 7f989e200640 1 -- 172.21.15.64:0/97773493 wait complete. 2024-09-21T07:38:42.745 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- 172.21.15.64:0/76778595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840d0fe0 msgr2=0x7f57840d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 --2- 172.21.15.64:0/76778595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840d0fe0 0x7f57840d0360 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5774009840 tx=0x7f577401c820 comp rx=0 tx=0).stop 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- 172.21.15.64:0/76778595 shutdown_connections 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 --2- 172.21.15.64:0/76778595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840b2430 0x7f57840cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 --2- 172.21.15.64:0/76778595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840d0fe0 0x7f57840d0360 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- 172.21.15.64:0/76778595 >> 172.21.15.64:0/76778595 conn(0x7f57840cef80 msgr2=0x7f57840cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- 172.21.15.64:0/76778595 shutdown_connections 2024-09-21T07:38:42.909 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- 172.21.15.64:0/76778595 wait complete. 2024-09-21T07:38:42.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 Processor -- start 2024-09-21T07:38:42.911 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.910+0000 7f578aa00640 1 -- start start 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840b2430 0x7f578415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840d0fe0 0x7f5784157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f578416a190 con 0x7f57840d08a0 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f578416a010 con 0x7f57840b2430 2024-09-21T07:38:42.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f578416a310 con 0x7f57840d0fe0 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35322/0 (socket says 172.21.15.64:35322) 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 -- 172.21.15.64:0/552014213 learned_addr learned my addr 172.21.15.64:0/552014213 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f5783e00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840b2430 0x7f578415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f5788a00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840d0fe0 0x7f5784157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 -- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840d0fe0 msgr2=0x7f5784157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840d0fe0 0x7f5784157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 -- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840b2430 msgr2=0x7f578415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840b2430 0x7f578415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:42.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 -- 172.21.15.64:0/552014213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5784159fa0 con 0x7f57840d08a0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f577be00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c410 tx=0x7f576c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c011790 con 0x7f57840d08a0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f576c017070 con 0x7f57840d08a0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578415f870 con 0x7f57840d08a0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c011ce0 con 0x7f57840d08a0 2024-09-21T07:38:42.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578415fe30 con 0x7f57840d08a0 2024-09-21T07:38:42.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.914+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57840cd010 con 0x7f57840d08a0 2024-09-21T07:38:42.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.918+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f576c01c460 con 0x7f57840d08a0 2024-09-21T07:38:42.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.918+0000 7f5780c00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 0x7f5760075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:42.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.918+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f576c094110 con 0x7f57840d08a0 2024-09-21T07:38:42.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.918+0000 7f5783e00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 0x7f5760075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:42.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.918+0000 7f5783e00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 0x7f5760075710 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f57740af000 tx=0x7f577401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:42.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:42.922+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f576c05e860 con 0x7f57840d08a0 2024-09-21T07:38:43.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:43.142+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f57840d0680 con 0x7f57840d08a0 2024-09-21T07:38:44.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f5780c00640 1 -- 172.21.15.64:0/552014213 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v172) ==== 162+0+0 (secure 0 0 0) 0x7f576c063290 con 0x7f57840d08a0 2024-09-21T07:38:44.152 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-21T07:38:44.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 msgr2=0x7f5760075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 0x7f5760075710 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f57740af000 tx=0x7f577401b060 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 msgr2=0x7f578415c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c410 tx=0x7f576c00c8d0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 shutdown_connections 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5760073200 0x7f5760075710 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840d0fe0 0x7f5784157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57840d08a0 0x7f578415c460 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 --2- 172.21.15.64:0/552014213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840b2430 0x7f578415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 >> 172.21.15.64:0/552014213 conn(0x7f57840cef80 msgr2=0x7f5784158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 shutdown_connections 2024-09-21T07:38:44.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.154+0000 7f578aa00640 1 -- 172.21.15.64:0/552014213 wait complete. 2024-09-21T07:38:44.184 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 -- 172.21.15.64:0/32061584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40ccd30 msgr2=0x7f21f40cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 --2- 172.21.15.64:0/32061584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40ccd30 0x7f21f40cd140 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009c80 tx=0x7f21ec01cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 -- 172.21.15.64:0/32061584 shutdown_connections 2024-09-21T07:38:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 --2- 172.21.15.64:0/32061584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40ccd30 0x7f21f40cd140 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 --2- 172.21.15.64:0/32061584 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 0x7f21f40b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 -- 172.21.15.64:0/32061584 >> 172.21.15.64:0/32061584 conn(0x7f21f406d570 msgr2=0x7f21f40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 -- 172.21.15.64:0/32061584 shutdown_connections 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.346+0000 7f21fae00640 1 -- 172.21.15.64:0/32061584 wait complete. 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 Processor -- start 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 -- start start 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 0x7f21f40c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 0x7f21f41f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4169f80 con 0x7f21f40b28e0 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4169e00 con 0x7f21f40ccd30 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f21f416a100 con 0x7f21f40b3170 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35338/0 (socket says 172.21.15.64:35338) 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 -- 172.21.15.64:0/3619656566 learned_addr learned my addr 172.21.15.64:0/3619656566 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21ebe00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 0x7f21f40c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f8e00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 0x7f21f41f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 -- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 msgr2=0x7f21f40c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 0x7f21f40c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 -- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 msgr2=0x7f21f41f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 0x7f21f41f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 -- 172.21.15.64:0/3619656566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f4154b80 con 0x7f21f40b28e0 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f8e00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 0x7f21f41f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f3e00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c3f0 tx=0x7f21e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4017070 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21e40053c0 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4003860 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.350+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f40b2090 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f41fc210 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f40b3580 con 0x7f21f40b28e0 2024-09-21T07:38:44.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f21e401a070 con 0x7f21f40b28e0 2024-09-21T07:38:44.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21f0c00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 0x7f21d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:44.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f21e4093670 con 0x7f21f40b28e0 2024-09-21T07:38:44.355 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.354+0000 7f21ebe00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 0x7f21d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:44.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.358+0000 7f21ebe00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 0x7f21d0075740 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f21f40d1290 tx=0x7f21dc0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:44.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.358+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f21f40cd680 con 0x7f21f40b28e0 2024-09-21T07:38:44.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.570+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21f415a100 con 0x7f21f40b28e0 2024-09-21T07:38:44.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21f0c00640 1 -- 172.21.15.64:0/3619656566 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 173 v173) ==== 95+0+5229 (secure 0 0 0) 0x7f21e405de50 con 0x7f21f40b28e0 2024-09-21T07:38:44.572 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:44.572 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":173,"btime":"2024-09-21T07:38:44:159166+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":173,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:44.159149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:replay","state_seq":1,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-21T07:38:44.572 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 173 2024-09-21T07:38:44.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 msgr2=0x7f21d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 0x7f21d0075740 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f21f40d1290 tx=0x7f21dc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 msgr2=0x7f21f41544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c3f0 tx=0x7f21e400c8b0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 shutdown_connections 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f21d0073230 0x7f21d0075740 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21f40ccd30 0x7f21f41f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f21f40b3170 0x7f21f40c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 --2- 172.21.15.64:0/3619656566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21f40b28e0 0x7f21f41544c0 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 >> 172.21.15.64:0/3619656566 conn(0x7f21f406d570 msgr2=0x7f21f4158070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 shutdown_connections 2024-09-21T07:38:44.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:44.574+0000 7f21fae00640 1 -- 172.21.15.64:0/3619656566 wait complete. 2024-09-21T07:38:44.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 173, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:38:27.281818+0000', 'modified': '2024-09-21T07:38:44.159149+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 230, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11670': {'gid': 11670, 'name': 'c', 'rank': 0, 'incarnation': 173, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.64:6834/2784366860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2784366860}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2784366860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:38:44.998 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11670:up:replay 2024-09-21T07:38:45.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:46.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- 172.21.15.64:0/3610755810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 msgr2=0x7fa2200ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:46.173 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 --2- 172.21.15.64:0/3610755810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa2200ce440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009870 tx=0x7fa20c01c860 comp rx=0 tx=0).stop 2024-09-21T07:38:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- 172.21.15.64:0/3610755810 shutdown_connections 2024-09-21T07:38:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 --2- 172.21.15.64:0/3610755810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa2200ce440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- 172.21.15.64:0/3610755810 >> 172.21.15.64:0/3610755810 conn(0x7fa2200b2f80 msgr2=0x7fa2200b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- 172.21.15.64:0/3610755810 shutdown_connections 2024-09-21T07:38:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- 172.21.15.64:0/3610755810 wait complete. 2024-09-21T07:38:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 Processor -- start 2024-09-21T07:38:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.174+0000 7fa227400640 1 -- start start 2024-09-21T07:38:46.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa22009b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2200ce030 0x7fa2200702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa22016aa70 con 0x7fa2200b1300 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa22016a8f0 con 0x7fa2200ce030 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa22016abf0 con 0x7fa2200cd170 2024-09-21T07:38:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:46.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47184/0 (socket says 172.21.15.64:47184) 2024-09-21T07:38:46.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 -- 172.21.15.64:0/199615098 learned_addr learned my addr 172.21.15.64:0/199615098 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:46.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa21fe00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa22009b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:46.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa225400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2200ce030 0x7fa2200702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:46.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 -- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 msgr2=0x7fa22009b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:46.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa22009b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 -- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2200ce030 msgr2=0x7fa2200702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:46.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2200ce030 0x7fa2200702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.182 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 -- 172.21.15.64:0/199615098 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22009f360 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa224a00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c460 tx=0x7fa21400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214016020 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa214012940 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214012d90 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa220162fe0 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22009e5a0 con 0x7fa2200b1300 2024-09-21T07:38:46.183 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.178+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22009e040 con 0x7fa2200b1300 2024-09-21T07:38:46.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.182+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa214019020 con 0x7fa2200b1300 2024-09-21T07:38:46.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.182+0000 7fa21cc00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 0x7fa200075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:46.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.182+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7fa214093ee0 con 0x7fa2200b1300 2024-09-21T07:38:46.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.182+0000 7fa21fe00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 0x7fa200075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:46.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.182+0000 7fa21fe00640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 0x7fa200075710 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0af000 tx=0x7fa20c01b0a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:46.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.186+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa22009e040 con 0x7fa2200b1300 2024-09-21T07:38:46.403 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.402+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2200ce440 con 0x7fa2200b1300 2024-09-21T07:38:46.404 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.402+0000 7fa21cc00640 1 -- 172.21.15.64:0/199615098 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5229 (secure 0 0 0) 0x7fa214020030 con 0x7fa2200b1300 2024-09-21T07:38:46.404 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:46.404 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":175,"btime":"2024-09-21T07:38:46:166757+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:45.168573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-21T07:38:46.404 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 175 2024-09-21T07:38:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 msgr2=0x7fa200075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 0x7fa200075710 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0af000 tx=0x7fa20c01b0a0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 msgr2=0x7fa220152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c460 tx=0x7fa21400c920 comp rx=0 tx=0).stop 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 shutdown_connections 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa200073200 0x7fa200075710 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2200ce030 0x7fa2200702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa2200cd170 0x7fa22009b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 --2- 172.21.15.64:0/199615098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2200b1300 0x7fa220152960 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 >> 172.21.15.64:0/199615098 conn(0x7fa2200b2f80 msgr2=0x7fa2200cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 shutdown_connections 2024-09-21T07:38:46.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:46.406+0000 7fa227400640 1 -- 172.21.15.64:0/199615098 wait complete. 2024-09-21T07:38:46.829 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 175, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:38:27.281818+0000', 'modified': '2024-09-21T07:38:45.168573+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 230, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11670': {'gid': 11670, 'name': 'c', 'rank': 0, 'incarnation': 173, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.64:6834/2784366860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2784366860}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2784366860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:38:46.829 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11670:up:rejoin 2024-09-21T07:38:47.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 -- 172.21.15.64:0/3444714002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac806fae0 msgr2=0x7f9ac80af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 --2- 172.21.15.64:0/3444714002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac806fae0 0x7f9ac80af790 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009870 tx=0x7f9ab801c7c0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 -- 172.21.15.64:0/3444714002 shutdown_connections 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 --2- 172.21.15.64:0/3444714002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac80b46f0 0x7f9ac80b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 --2- 172.21.15.64:0/3444714002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac806fae0 0x7f9ac80af790 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 -- 172.21.15.64:0/3444714002 >> 172.21.15.64:0/3444714002 conn(0x7f9ac806d570 msgr2=0x7f9ac80b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 -- 172.21.15.64:0/3444714002 shutdown_connections 2024-09-21T07:38:48.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.002+0000 7f9ace200640 1 -- 172.21.15.64:0/3444714002 wait complete. 2024-09-21T07:38:48.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 Processor -- start 2024-09-21T07:38:48.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 -- start start 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac806fae0 0x7f9ac815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac80b46f0 0x7f9ac80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8169380 con 0x7f9ac80b3170 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8169200 con 0x7f9ac80b46f0 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac8169500 con 0x7f9ac806fae0 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47204/0 (socket says 172.21.15.64:47204) 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 -- 172.21.15.64:0/132532124 learned_addr learned my addr 172.21.15.64:0/132532124 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac7400640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac806fae0 0x7f9ac815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac7e00640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac80b46f0 0x7f9ac80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 -- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac806fae0 msgr2=0x7f9ac815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac806fae0 0x7f9ac815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 -- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac80b46f0 msgr2=0x7f9ac80c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac80b46f0 0x7f9ac80c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 -- 172.21.15.64:0/132532124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac80d0d30 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ac6a00640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400ca20 tx=0x7f9ab400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4007c70 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab400f450 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400f8a0 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.006+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac815b2e0 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac80d0850 con 0x7f9ac80b3170 2024-09-21T07:38:48.009 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac80d0aa0 con 0x7f9ac80b3170 2024-09-21T07:38:48.010 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ab400fa40 con 0x7f9ac80b3170 2024-09-21T07:38:48.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9abf400640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 0x7f9aa8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f9ab4094c00 con 0x7f9ac80b3170 2024-09-21T07:38:48.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.010+0000 7f9ac7400640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 0x7f9aa8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.014+0000 7f9ac7400640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 0x7f9aa8075740 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80af000 tx=0x7f9ab801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.015 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.014+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9ab4014030 con 0x7f9ac80b3170 2024-09-21T07:38:48.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.226+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac80af790 con 0x7f9ac80b3170 2024-09-21T07:38:48.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9abf400640 1 -- 172.21.15.64:0/132532124 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7f9ab405f9a0 con 0x7f9ac80b3170 2024-09-21T07:38:48.229 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:38:48.229 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:38:48.229 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:38:48.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 msgr2=0x7f9aa8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 0x7f9aa8075740 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80af000 tx=0x7f9ab801b060 comp rx=0 tx=0).stop 2024-09-21T07:38:48.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 msgr2=0x7f9ac80b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400ca20 tx=0x7f9ab400cee0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 shutdown_connections 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9aa8073230 0x7f9aa8075740 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac80b46f0 0x7f9ac80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ac80b3170 0x7f9ac80b7f30 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 --2- 172.21.15.64:0/132532124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ac806fae0 0x7f9ac815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 >> 172.21.15.64:0/132532124 conn(0x7f9ac806d570 msgr2=0x7f9ac8154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 shutdown_connections 2024-09-21T07:38:48.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.230+0000 7f9ace200640 1 -- 172.21.15.64:0/132532124 wait complete. 2024-09-21T07:38:48.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 176, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:38:27.281818+0000', 'modified': '2024-09-21T07:38:47.175871+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 230, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11670': {'gid': 11670, 'name': 'c', 'rank': 0, 'incarnation': 173, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.64:6834/2784366860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2784366860}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2784366860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11670, 'qdb_cluster': [11670]} 2024-09-21T07:38:48.654 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:38:48.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:38:48.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- 172.21.15.64:0/1823456800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 msgr2=0x7f5c540af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.817 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1823456800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c540af790 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7f5c540725c0 tx=0x7f5c4801c8c0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- 172.21.15.64:0/1823456800 shutdown_connections 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1823456800 >> v2:172.21.15.90:3300/0 conn(0x7f5c540b46f0 0x7f5c540b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1823456800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c540af790 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- 172.21.15.64:0/1823456800 >> 172.21.15.64:0/1823456800 conn(0x7f5c5406d570 msgr2=0x7f5c540b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- 172.21.15.64:0/1823456800 shutdown_connections 2024-09-21T07:38:48.818 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- 172.21.15.64:0/1823456800 wait complete. 2024-09-21T07:38:48.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 Processor -- start 2024-09-21T07:38:48.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.818+0000 7f5c5c800640 1 -- start start 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c540b3170 0x7f5c5415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 0x7f5c5415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54169330 con 0x7f5c5406fae0 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c541691b0 con 0x7f5c540b46f0 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5c541694b0 con 0x7f5c540b3170 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47216/0 (socket says 172.21.15.64:47216) 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 -- 172.21.15.64:0/1900363706 learned_addr learned my addr 172.21.15.64:0/1900363706 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59400640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c540b3170 0x7f5c5415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.822 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5a800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 0x7f5c5415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 -- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c540b3170 msgr2=0x7f5c5415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c540b3170 0x7f5c5415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 -- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 msgr2=0x7f5c5415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 0x7f5c5415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 -- 172.21.15.64:0/1900363706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c541fc240 con 0x7f5c5406fae0 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5a800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 0x7f5c5415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:48.823 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c59e00640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f5c480b0040 tx=0x7f5c480a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c4e000640 1 -- 172.21.15.64:0/1900363706 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480b2040 con 0x7f5c5406fae0 2024-09-21T07:38:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c4e000640 1 -- 172.21.15.64:0/1900363706 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c480042b0 con 0x7f5c5406fae0 2024-09-21T07:38:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5415f930 con 0x7f5c5406fae0 2024-09-21T07:38:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c4e000640 1 -- 172.21.15.64:0/1900363706 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48003600 con 0x7f5c5406fae0 2024-09-21T07:38:48.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.822+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c541fc7e0 con 0x7f5c5406fae0 2024-09-21T07:38:48.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c4e000640 1 -- 172.21.15.64:0/1900363706 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5c480bf020 con 0x7f5c5406fae0 2024-09-21T07:38:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c4e000640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 0x7f5c38075730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 Processor -- start 2024-09-21T07:38:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c4e000640 1 -- 172.21.15.64:0/1900363706 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f5c4812e820 con 0x7f5c5406fae0 2024-09-21T07:38:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 -- start start 2024-09-21T07:38:48.826 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c59400640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 0x7f5c38075730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c59400640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 0x7f5c38075730 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5c54160d40 tx=0x7f5c4400a250 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 0x55c1764b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c17634dca0 0x55c1764b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c17638a410 con 0x55c176364950 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c1762c7b40 con 0x55c175f74460 2024-09-21T07:38:48.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c1762b6f70 con 0x55c17634dca0 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47226/0 (socket says 172.21.15.64:47226) 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.826+0000 7f5c59400640 1 -- 172.21.15.64:0/3556371525 learned_addr learned my addr 172.21.15.64:0/3556371525 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59e00640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 0x55c1764b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c5a800640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c17634dca0 0x55c1764b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 -- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c17634dca0 msgr2=0x55c1764b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c17634dca0 0x55c1764b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 -- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 msgr2=0x55c1764b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 0x55c1764b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 -- 172.21.15.64:0/3556371525 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17627e5b0 con 0x55c176364950 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59e00640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 0x55c1764b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:48.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c59400640 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400fee0 tx=0x7f5c44012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3dd2aa82ac8261 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c42600640 1 -- 172.21.15.64:0/3556371525 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44016070 con 0x55c176364950 2024-09-21T07:38:48.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c42600640 1 -- 172.21.15.64:0/3556371525 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c44025630 con 0x55c176364950 2024-09-21T07:38:48.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c42600640 1 -- 172.21.15.64:0/3556371525 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44025a40 con 0x55c176364950 2024-09-21T07:38:48.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- 172.21.15.64:0/3556371525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 msgr2=0x55c1764b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.830 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400fee0 tx=0x7f5c44012000 comp rx=0 tx=0).stop 2024-09-21T07:38:48.831 INFO:tasks.ceph.mds.c.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f8dade00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:38:48.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- 172.21.15.64:0/3556371525 shutdown_connections 2024-09-21T07:38:48.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c17634dca0 0x55c1764b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c1764b5be0 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3556371525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c175f74460 0x55c1764b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- 172.21.15.64:0/3556371525 >> 172.21.15.64:0/3556371525 conn(0x55c17643ad90 msgr2=0x55c17646a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- 172.21.15.64:0/3556371525 shutdown_connections 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- 172.21.15.64:0/3556371525 wait complete. 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 -- start start 2024-09-21T07:38:48.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.830+0000 7f5c63fee000 1 Processor -- start 2024-09-21T07:38:48.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c1764bc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c1764bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c1762515f0 con 0x55c17634dca0 2024-09-21T07:38:48.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c1762bad80 con 0x55c176364950 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c17625d520 con 0x55c175f74460 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 10 client.0 _ll_register_callbacks cb 0x55c176261830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47234/0 (socket says 172.21.15.64:47234) 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 -- 172.21.15.64:0/3423185027 learned_addr learned my addr 172.21.15.64:0/3423185027 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59e00640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c1764bc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c5a800640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c1764bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 -- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 msgr2=0x55c1764bc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c1764bc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 -- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 msgr2=0x55c1764bd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c1764bd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 -- 172.21.15.64:0/3423185027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c176255190 con 0x55c17634dca0 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c5a800640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c1764bd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:48.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59400640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400f790 tx=0x7f5c44025660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3450e9428a61bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44034060 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f5c44025a60 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c17624f110 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f5c4403a050 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 10 client.11919 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55c17633bf10 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c17624f110 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f5c44025c80 con 0x55c17634dca0 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 10 client.11919 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 10 client.11919 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 20 client.11919 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f597d0 0x55c1764c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.837 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 4 client.11919 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:48.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1762c9a90 con 0x55c175f597d0 2024-09-21T07:38:48.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59e00640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f597d0 0x55c1764c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c36a00640 10 client.11919 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:48.838 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.834+0000 7f5c59e00640 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f597d0 0x55c1764c6d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ce5ac33c18376dc server_cookie=6add463d1ee93a7e in_seq=0 out_seq=0 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c36a00640 1 -- 172.21.15.64:0/3423185027 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1762c9a90 con 0x55c175f597d0 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c36a00640 10 client.11919 handle_command_reply: tid=0 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 client.11919 shutdown 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 msgr2=0x55c1764bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400f790 tx=0x7f5c44025660 comp rx=0 tx=0).stop 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 shutdown_connections 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c1764bd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f597d0 0x55c1764c6d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1764bce60 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 --2- 172.21.15.64:0/3423185027 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c1764bc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c36a00640 0 client.11919 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:48.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 >> 172.21.15.64:0/3423185027 conn(0x55c17643ad90 msgr2=0x55c176471440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 shutdown_connections 2024-09-21T07:38:48.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 1 -- 172.21.15.64:0/3423185027 wait complete. 2024-09-21T07:38:48.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.838+0000 7f5c63fee000 20 client.11919 trim_cache size 0 max 16384 2024-09-21T07:38:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 Processor -- start 2024-09-21T07:38:48.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- start start 2024-09-21T07:38:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c176527070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c176527af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54206140 con 0x55c17634dca0 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c542051a0 con 0x55c176364950 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f5c542045d0 con 0x55c175f74460 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47236/0 (socket says 172.21.15.64:47236) 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 -- 172.21.15.64:0/966439363 learned_addr learned my addr 172.21.15.64:0/966439363 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59e00640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c176527070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c5a800640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c176527af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 -- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 msgr2=0x55c176527070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c176527070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 -- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 msgr2=0x55c176527af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c176527af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 -- 172.21.15.64:0/966439363 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c176312db0 con 0x55c17634dca0 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c5a800640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c176527af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c59400640 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400a330 tx=0x7f5c44012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60808715aa79f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c41c00640 1 -- 172.21.15.64:0/966439363 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44043070 con 0x55c17634dca0 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c41c00640 1 -- 172.21.15.64:0/966439363 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c44025a60 con 0x55c17634dca0 2024-09-21T07:38:48.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c41c00640 1 -- 172.21.15.64:0/966439363 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44029030 con 0x55c17634dca0 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- 172.21.15.64:0/966439363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 msgr2=0x55c1765275b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400a330 tx=0x7f5c44012000 comp rx=0 tx=0).stop 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- 172.21.15.64:0/966439363 shutdown_connections 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c176364950 0x55c176527af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c17634dca0 0x55c1765275b0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 --2- 172.21.15.64:0/966439363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c176527070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- 172.21.15.64:0/966439363 >> 172.21.15.64:0/966439363 conn(0x55c17643ad90 msgr2=0x55c1764770f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- 172.21.15.64:0/966439363 shutdown_connections 2024-09-21T07:38:48.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.858+0000 7f5c63fee000 1 -- 172.21.15.64:0/966439363 wait complete. 2024-09-21T07:38:48.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 -- start start 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 Processor -- start 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c17652b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c17634dca0 0x55c17652b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c1762bf3b0 con 0x55c176364950 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c17633ba80 con 0x55c17634dca0 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55c1762ba090 con 0x55c175f74460 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 10 client.0 _ll_register_callbacks cb 0x7f5c4400fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:48.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c59e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c17652b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47252/0 (socket says 172.21.15.64:47252) 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 -- 172.21.15.64:0/829641969 learned_addr learned my addr 172.21.15.64:0/829641969 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c59e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c17652b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.64:38176/0 (socket says 172.21.15.64:38176) 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c59400640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c17634dca0 0x55c17652b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 -- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 msgr2=0x55c17652b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c17652b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 -- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c17634dca0 msgr2=0x55c17652b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c17634dca0 0x55c17652b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 -- 172.21.15.64:0/829641969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c17627dab0 con 0x55c176364950 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c5a800640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000bfa0 tx=0x7f5c5000a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dec0e1bf176d5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c36a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5001c020 con 0x55c176364950 2024-09-21T07:38:48.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f5c50018600 con 0x55c176364950 2024-09-21T07:38:48.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c44025a60 con 0x55c176364950 2024-09-21T07:38:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f5c50026050 con 0x55c176364950 2024-09-21T07:38:48.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.862+0000 7f5c63fee000 10 client.11925 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55c17625c070 con 0x55c176364950 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c44025a60 con 0x55c176364950 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f5c50029020 con 0x55c176364950 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 10 client.11925 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 10 client.11925 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 20 client.11925 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f47830 0x55c1764e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 4 client.11925 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "status"}) -- 0x55c1762c5540 con 0x55c175f47830 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c59e00640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f47830 0x55c1764e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c59e00640 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f47830 0x55c1764e7b50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ebecc9b25dc2fa5 server_cookie=faab9ff34879aa26 in_seq=0 out_seq=0 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 10 client.11925 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 1 -- 172.21.15.64:0/829641969 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55c1762c5540 con 0x55c175f47830 2024-09-21T07:38:48.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 10 client.11925 handle_command_reply: tid=0 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 client.11925 shutdown 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 msgr2=0x55c17652bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000bfa0 tx=0x7f5c5000a7b0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 shutdown_connections 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55c175f47830 0x55c1764e7b50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c176364950 0x55c17652bb50 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c17634dca0 0x55c17652b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c36a00640 0 client.11925 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 --2- 172.21.15.64:0/829641969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c175f74460 0x55c17652b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 >> 172.21.15.64:0/829641969 conn(0x55c17643ad90 msgr2=0x55c1764c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 shutdown_connections 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 1 -- 172.21.15.64:0/829641969 wait complete. 2024-09-21T07:38:48.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c63fee000 20 client.11925 trim_cache size 0 max 16384 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 11670, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 4.7039123509999996, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 176, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 230, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 230, 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 25.388611834999999 2024-09-21T07:38:48.870 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 msgr2=0x7f5c38075730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 0x7f5c38075730 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5c54160d40 tx=0x7f5c4400a250 comp rx=0 tx=0).stop 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 msgr2=0x7f5c5415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f5c480b0040 tx=0x7f5c480a5790 comp rx=0 tx=0).stop 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 shutdown_connections 2024-09-21T07:38:48.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f5c38073220 0x7f5c38075730 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c540b46f0 0x7f5c5415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c540b3170 0x7f5c5415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 --2- 172.21.15.64:0/1900363706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c5406fae0 0x7f5c5415a490 unknown :-1 s=CLOSED pgs=2591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 >> 172.21.15.64:0/1900363706 conn(0x7f5c5406d570 msgr2=0x7f5c540b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 shutdown_connections 2024-09-21T07:38:48.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:48.866+0000 7f5c5c800640 1 -- 172.21.15.64:0/1900363706 wait complete. 2024-09-21T07:38:48.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:48.886 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-21T07:38:49.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 -- 172.21.15.64:0/4103651108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0074af0 msgr2=0x7f51e00b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 --2- 172.21.15.64:0/4103651108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0074af0 0x7f51e00b3880 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7f51e00728a0 tx=0x7f51d801cc90 comp rx=0 tx=0).stop 2024-09-21T07:38:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 -- 172.21.15.64:0/4103651108 shutdown_connections 2024-09-21T07:38:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 --2- 172.21.15.64:0/4103651108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e0074af0 0x7f51e00b3880 unknown :-1 s=CLOSED pgs=2596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 --2- 172.21.15.64:0/4103651108 >> v2:172.21.15.90:3300/0 conn(0x7f51e015af70 0x7f51e006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 -- 172.21.15.64:0/4103651108 >> 172.21.15.64:0/4103651108 conn(0x7f51e006d570 msgr2=0x7f51e00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.046+0000 7f51e8600640 1 -- 172.21.15.64:0/4103651108 shutdown_connections 2024-09-21T07:38:49.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 -- 172.21.15.64:0/4103651108 wait complete. 2024-09-21T07:38:49.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 Processor -- start 2024-09-21T07:38:49.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 -- start start 2024-09-21T07:38:49.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e0074af0 0x7f51e01f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e015af70 0x7f51e014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00b2700 con 0x7f51e006f610 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00b2580 con 0x7f51e0074af0 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e8600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f51e00b2880 con 0x7f51e015af70 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47264/0 (socket says 172.21.15.64:47264) 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.050+0000 7f51e5c00640 1 -- 172.21.15.64:0/541397085 learned_addr learned my addr 172.21.15.64:0/541397085 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e6600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e015af70 0x7f51e014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5200640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e0074af0 0x7f51e01f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 -- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e015af70 msgr2=0x7f51e014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e015af70 0x7f51e014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 -- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e0074af0 msgr2=0x7f51e01f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e0074af0 0x7f51e01f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.053 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 -- 172.21.15.64:0/541397085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e01fac80 con 0x7f51e006f610 2024-09-21T07:38:49.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e5c00640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c9f0 tx=0x7f51d400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51dd600640 1 -- 172.21.15.64:0/541397085 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4007bb0 con 0x7f51e006f610 2024-09-21T07:38:49.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51dd600640 1 -- 172.21.15.64:0/541397085 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51d4007e40 con 0x7f51e006f610 2024-09-21T07:38:49.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51dd600640 1 -- 172.21.15.64:0/541397085 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d400f690 con 0x7f51e006f610 2024-09-21T07:38:49.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e01faf60 con 0x7f51e006f610 2024-09-21T07:38:49.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e01f7c00 con 0x7f51e006f610 2024-09-21T07:38:49.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.054+0000 7f51dd600640 1 -- 172.21.15.64:0/541397085 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f51d400f830 con 0x7f51e006f610 2024-09-21T07:38:49.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51dd600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 0x7f51c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51dd600640 1 -- 172.21.15.64:0/541397085 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f51d4094c90 con 0x7f51e006f610 2024-09-21T07:38:49.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5200640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 0x7f51c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.057 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 Processor -- start 2024-09-21T07:38:49.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 -- start start 2024-09-21T07:38:49.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5200640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 0x7f51c0075740 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f51e00c67d0 tx=0x7f51cc008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f0ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f10520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e6f4cd0bd0 con 0x55e6f4dc21a0 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6f4cc1430 con 0x55e6f4da4970 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e6f4d1ece0 con 0x55e6f4dbaae0 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47266/0 (socket says 172.21.15.64:47266) 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5c00640 1 -- 172.21.15.64:0/1233994523 learned_addr learned my addr 172.21.15.64:0/1233994523 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e5200640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f0ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.058+0000 7f51e6600640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f10520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 -- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 msgr2=0x55e6f4f0ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f0ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.061 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 -- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 msgr2=0x55e6f4f10520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f10520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 -- 172.21.15.64:0/1233994523 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f4cc2d80 con 0x55e6f4dc21a0 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5200640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f0ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e6600640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f10520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51e5c00640 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005830 tx=0x7f51d405ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab5d3168398e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51d2000640 1 -- 172.21.15.64:0/1233994523 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d401d040 con 0x55e6f4dc21a0 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51d2000640 1 -- 172.21.15.64:0/1233994523 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51d4063e10 con 0x55e6f4dc21a0 2024-09-21T07:38:49.062 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51d2000640 1 -- 172.21.15.64:0/1233994523 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4068b00 con 0x55e6f4dc21a0 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- 172.21.15.64:0/1233994523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 msgr2=0x55e6f4f0faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005830 tx=0x7f51d405ee40 comp rx=0 tx=0).stop 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- 172.21.15.64:0/1233994523 shutdown_connections 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f10520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f0ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 --2- 172.21.15.64:0/1233994523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f0faa0 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- 172.21.15.64:0/1233994523 >> 172.21.15.64:0/1233994523 conn(0x55e6f4dc88c0 msgr2=0x55e6f4ec04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- 172.21.15.64:0/1233994523 shutdown_connections 2024-09-21T07:38:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- 172.21.15.64:0/1233994523 wait complete. 2024-09-21T07:38:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 -- start start 2024-09-21T07:38:49.064 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.062+0000 7f51efbd5000 1 Processor -- start 2024-09-21T07:38:49.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.065 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f16bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f17130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e6f4d11f20 con 0x55e6f4dc21a0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6f4d0e110 con 0x55e6f4da4970 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e6f4cb36d0 con 0x55e6f4dbaae0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 10 client.0 _ll_register_callbacks cb 0x55e6f4cb2330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e6600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f17130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f16bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:53238/0 (socket says 172.21.15.64:53238) 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5c00640 1 -- 172.21.15.64:0/3874579147 learned_addr learned my addr 172.21.15.64:0/3874579147 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 -- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 msgr2=0x55e6f4f166b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f166b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 -- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 msgr2=0x55e6f4f17130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f17130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 -- 172.21.15.64:0/3874579147 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f4cac310 con 0x55e6f4dbaae0 2024-09-21T07:38:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e6600640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f17130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:38:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5200640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f16bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51e015a020 tx=0x7f51cc004690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d166d4b2a6943a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3301/0 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc020420 con 0x55e6f4dbaae0 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mon.2 v2:172.21.15.90:3301/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f51cc00f040 con 0x55e6f4dbaae0 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6f4ca6450 con 0x55e6f4dbaae0 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f51cc005920 con 0x55e6f4dbaae0 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 10 client.9761 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55e6f4cc9f60 con 0x55e6f4dbaae0 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mon.2 v2:172.21.15.90:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e6f4ca6450 con 0x55e6f4dbaae0 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mon.2 v2:172.21.15.90:3301/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f51cc030080 con 0x55e6f4dbaae0 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 10 client.9761 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 10 client.9761 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 20 client.9761 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f49b0b80 0x55e6f4f20a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 4 client.9761 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6f4d20c30 con 0x55e6f49b0b80 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5c00640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f49b0b80 0x55e6f4f20a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51e5c00640 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f49b0b80 0x55e6f4f20a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1417489638e05544 server_cookie=35d51eb39e53408 in_seq=0 out_seq=0 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.066+0000 7f51c6a00640 10 client.9761 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51c6a00640 1 -- 172.21.15.64:0/3874579147 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6f4d20c30 con 0x55e6f49b0b80 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51c6a00640 10 client.9761 handle_command_reply: tid=0 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 client.9761 shutdown 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 msgr2=0x55e6f4f16bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f16bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51e015a020 tx=0x7f51cc004690 comp rx=0 tx=0).stop 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 shutdown_connections 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f49b0b80 0x55e6f4f20a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f17130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f16bf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3874579147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4da4970 0x55e6f4f166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51c6a00640 0 client.9761 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 >> 172.21.15.64:0/3874579147 conn(0x55e6f4dc88c0 msgr2=0x55e6f4ec69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 shutdown_connections 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 1 -- 172.21.15.64:0/3874579147 wait complete. 2024-09-21T07:38:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.070+0000 7f51efbd5000 20 client.9761 trim_cache size 0 max 16384 2024-09-21T07:38:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 Processor -- start 2024-09-21T07:38:49.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- start start 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f81320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f81860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0201a10 con 0x55e6f4da4970 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00ae9b0 con 0x55e6f4dc21a0 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f51e0157c50 con 0x55e6f4dbaae0 2024-09-21T07:38:49.090 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47288/0 (socket says 172.21.15.64:47288) 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 -- 172.21.15.64:0/3215084820 learned_addr learned my addr 172.21.15.64:0/3215084820 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5200640 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f81320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e6600640 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f81860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 -- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 msgr2=0x55e6f4f81320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f81320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 -- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 msgr2=0x55e6f4f81860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f81860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 -- 172.21.15.64:0/3215084820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f4d92f30 con 0x55e6f4da4970 2024-09-21T07:38:49.092 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51e5c00640 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018fd0 tx=0x7f51d405ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f177431fd61333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51d1600640 1 -- 172.21.15.64:0/3215084820 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d401d040 con 0x55e6f4da4970 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51d1600640 1 -- 172.21.15.64:0/3215084820 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51d40688c0 con 0x55e6f4da4970 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51d1600640 1 -- 172.21.15.64:0/3215084820 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d405e590 con 0x55e6f4da4970 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- 172.21.15.64:0/3215084820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 msgr2=0x55e6f4f80de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018fd0 tx=0x7f51d405ba00 comp rx=0 tx=0).stop 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- 172.21.15.64:0/3215084820 shutdown_connections 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f81860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f81320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 --2- 172.21.15.64:0/3215084820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f80de0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- 172.21.15.64:0/3215084820 >> 172.21.15.64:0/3215084820 conn(0x55e6f4dc88c0 msgr2=0x55e6f4f1bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- 172.21.15.64:0/3215084820 shutdown_connections 2024-09-21T07:38:49.093 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.090+0000 7f51efbd5000 1 -- 172.21.15.64:0/3215084820 wait complete. 2024-09-21T07:38:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- start start 2024-09-21T07:38:49.094 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 Processor -- start 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f1d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00ae360 con 0x55e6f4da4970 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6f4d92aa0 con 0x55e6f4dc21a0 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55e6f4f25ae0 con 0x55e6f4dbaae0 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 10 client.0 _ll_register_callbacks cb 0x7f51cc00b150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47294/0 (socket says 172.21.15.64:47294) 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 -- 172.21.15.64:0/72250893 learned_addr learned my addr 172.21.15.64:0/72250893 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5200640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f1d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e6600640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 -- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 msgr2=0x55e6f4f1d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f1d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 -- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 msgr2=0x55e6f4f230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 -- 172.21.15.64:0/72250893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f4d69dd0 con 0x55e6f4da4970 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51e5c00640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018fd0 tx=0x7f51d4063f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640d12b81c5d400f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d401d040 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f51d405e590 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d40688c0 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f51d4070050 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 10 client.11943 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.094+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55e6f4ca4840 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51d40688c0 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f51d4073020 con 0x55e6f4da4970 2024-09-21T07:38:49.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 10 client.11943 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 10 client.11943 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 20 client.11943 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f499ebe0 0x55e6f4f23ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 4 client.11943 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55e6f4efa380 con 0x55e6f499ebe0 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51e5200640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f499ebe0 0x55e6f4f23ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51e5200640 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f499ebe0 0x55e6f4f23ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aedc268c335f8905 server_cookie=2f07fc052e461bfc in_seq=0 out_seq=0 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 10 client.11943 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 1 -- 172.21.15.64:0/72250893 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6f4efa380 con 0x55e6f499ebe0 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 10 client.11943 handle_command_reply: tid=0 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 client.11943 shutdown 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 msgr2=0x55e6f4f1cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018fd0 tx=0x7f51d4063f30 comp rx=0 tx=0).stop 2024-09-21T07:38:49.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 shutdown_connections 2024-09-21T07:38:49.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6f4dc21a0 0x55e6f4f230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e6f4dbaae0 0x55e6f4f1d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55e6f499ebe0 0x55e6f4f23ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.100 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 --2- 172.21.15.64:0/72250893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e6f4da4970 0x55e6f4f1cd20 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51c6a00640 0 client.11943 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 >> 172.21.15.64:0/72250893 conn(0x55e6f4dc88c0 msgr2=0x55e6f4ec04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 shutdown_connections 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 1 -- 172.21.15.64:0/72250893 wait complete. 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.098+0000 7f51efbd5000 20 client.11943 trim_cache size 0 max 16384 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "4b2e2927-d354-4e8f-a048-46d03c6956e5", 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:38:49.101 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:49.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 msgr2=0x7f51c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 0x7f51c0075740 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f51e00c67d0 tx=0x7f51cc008040 comp rx=0 tx=0).stop 2024-09-21T07:38:49.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 msgr2=0x7f51e01fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c9f0 tx=0x7f51d400ceb0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 shutdown_connections 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f51c0073230 0x7f51c0075740 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f51e015af70 0x7f51e014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51e0074af0 0x7f51e01f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 --2- 172.21.15.64:0/541397085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51e006f610 0x7f51e01fa310 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 >> 172.21.15.64:0/541397085 conn(0x7f51e006d570 msgr2=0x7f51e0074f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 shutdown_connections 2024-09-21T07:38:49.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.102+0000 7f51e8600640 1 -- 172.21.15.64:0/541397085 wait complete. 2024-09-21T07:38:49.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:38:49.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 -- 172.21.15.64:0/1639741815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c0caf00 msgr2=0x7f6b9c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 --2- 172.21.15.64:0/1639741815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c0cb310 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009cb0 tx=0x7f6b9401cda0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 -- 172.21.15.64:0/1639741815 shutdown_connections 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 --2- 172.21.15.64:0/1639741815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c0cb310 unknown :-1 s=CLOSED pgs=2601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 --2- 172.21.15.64:0/1639741815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c0b4e00 0x7f6b9c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 -- 172.21.15.64:0/1639741815 >> 172.21.15.64:0/1639741815 conn(0x7f6b9c06d570 msgr2=0x7f6b9c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 -- 172.21.15.64:0/1639741815 shutdown_connections 2024-09-21T07:38:49.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.282+0000 7f6ba1800640 1 -- 172.21.15.64:0/1639741815 wait complete. 2024-09-21T07:38:49.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 Processor -- start 2024-09-21T07:38:49.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 -- start start 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c1f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c154d10 0x7f6b9c155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c168f00 con 0x7f6b9c06fae0 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c168d80 con 0x7f6b9c0caf00 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6ba1800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c169080 con 0x7f6b9c154d10 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47310/0 (socket says 172.21.15.64:47310) 2024-09-21T07:38:49.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6b9aa00640 1 -- 172.21.15.64:0/2518842850 learned_addr learned my addr 172.21.15.64:0/2518842850 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6b93e00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c1f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.286+0000 7f6b9b400640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c154d10 0x7f6b9c155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 -- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c154d10 msgr2=0x7f6b9c155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c154d10 0x7f6b9c155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 -- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c0caf00 msgr2=0x7f6b9c1f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c1f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 -- 172.21.15.64:0/2518842850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c155660 con 0x7f6b9c06fae0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3f0 tx=0x7f6b8c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b92a00640 1 -- 172.21.15.64:0/2518842850 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c017070 con 0x7f6b9c06fae0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b92a00640 1 -- 172.21.15.64:0/2518842850 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c0053c0 con 0x7f6b9c06fae0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b92a00640 1 -- 172.21.15.64:0/2518842850 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c003860 con 0x7f6b9c06fae0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c1f9030 con 0x7f6b9c06fae0 2024-09-21T07:38:49.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c14aee0 con 0x7f6b9c06fae0 2024-09-21T07:38:49.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.290+0000 7f6b92a00640 1 -- 172.21.15.64:0/2518842850 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6b8c01a070 con 0x7f6b9c06fae0 2024-09-21T07:38:49.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b92a00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 0x7f6b78075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b92a00640 1 -- 172.21.15.64:0/2518842850 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f6b8c093710 con 0x7f6b9c06fae0 2024-09-21T07:38:49.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b93e00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 0x7f6b78075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 Processor -- start 2024-09-21T07:38:49.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 -- start start 2024-09-21T07:38:49.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b93e00640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 0x7f6b78075740 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0d05d0 tx=0x7f6b840091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b4189f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8af03890 0x55cc8b418f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cc8b2b7cd0 con 0x55cc8afc7aa0 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cc8b1cd330 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cc8b22abb0 con 0x55cc8af03890 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b4189f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47322/0 (socket says 172.21.15.64:47322) 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b93e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8af03890 0x55cc8b418f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 -- 172.21.15.64:0/840339660 learned_addr learned my addr 172.21.15.64:0/840339660 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b4189f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.64:53266/0 (socket says 172.21.15.64:53266) 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 -- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8af03890 msgr2=0x55cc8b418f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8af03890 0x55cc8b418f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 -- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 msgr2=0x55cc8b4189f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b4189f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 -- 172.21.15.64:0/840339660 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc8b1cec80 con 0x55cc8afc7aa0 2024-09-21T07:38:49.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b9b400640 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f6b9401a9d0 tx=0x7f6b94019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9488b76ee5bb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b8b400640 1 -- 172.21.15.64:0/840339660 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940a6e60 con 0x55cc8afc7aa0 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b8b400640 1 -- 172.21.15.64:0/840339660 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b94004a50 con 0x55cc8afc7aa0 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.294+0000 7f6b8b400640 1 -- 172.21.15.64:0/840339660 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940b2040 con 0x55cc8afc7aa0 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- 172.21.15.64:0/840339660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 msgr2=0x55cc8b419470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f6b9401a9d0 tx=0x7f6b94019b40 comp rx=0 tx=0).stop 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- 172.21.15.64:0/840339660 shutdown_connections 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8afc7aa0 0x55cc8b419470 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8af03890 0x55cc8b418f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- 172.21.15.64:0/840339660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b4189f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- 172.21.15.64:0/840339660 >> 172.21.15.64:0/840339660 conn(0x55cc8aed75c0 msgr2=0x55cc8b3d5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- 172.21.15.64:0/840339660 shutdown_connections 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- 172.21.15.64:0/840339660 wait complete. 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- start start 2024-09-21T07:38:49.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 Processor -- start 2024-09-21T07:38:49.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8afc7aa0 0x55cc8b3d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8b2ac6d0 0x55cc8b3db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cc8b21ddf0 con 0x55cc8af03890 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cc8b219fe0 con 0x55cc8afc7aa0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cc8b1bf4d0 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6ba9015000 10 client.0 _ll_register_callbacks cb 0x55cc8b19d7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47324/0 (socket says 172.21.15.64:47324) 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6b9aa00640 1 -- 172.21.15.64:0/4276738287 learned_addr learned my addr 172.21.15.64:0/4276738287 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6b93e00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8afc7aa0 0x55cc8b3d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.298+0000 7f6b9b400640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8b2ac6d0 0x55cc8b3db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 -- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8b2ac6d0 msgr2=0x55cc8b3db5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8b2ac6d0 0x55cc8b3db5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 -- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8afc7aa0 msgr2=0x55cc8b3d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8afc7aa0 0x55cc8b3d4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 -- 172.21.15.64:0/4276738287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8b1b8210 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c05dbf0 tx=0x7f6b8c05ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8037d395a1a1d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c060070 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f6b8c059840 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc8b1b2350 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c062920 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 10 client.11955 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55cc8b19efc0 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cc8b1b2350 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8c059a40 con 0x55cc8af03890 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 10 client.11955 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 10 client.11955 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:38:49.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 20 client.11955 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:49.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aebc930 0x55cc8b41fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 4 client.11955 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:38:49.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc8b22cb00 con 0x55cc8aebc930 2024-09-21T07:38:49.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b93e00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aebc930 0x55cc8b41fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b93e00640 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aebc930 0x55cc8b41fe80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc7c7fc13160c78f server_cookie=c6ec2301562efdd2 in_seq=0 out_seq=0 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 10 client.11955 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 1 -- 172.21.15.64:0/4276738287 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc8b22cb00 con 0x55cc8aebc930 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 10 client.11955 handle_command_reply: tid=0 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 client.11955 shutdown 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 msgr2=0x55cc8b3d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c05dbf0 tx=0x7f6b8c05ddd0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 shutdown_connections 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8b2ac6d0 0x55cc8b3db5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8afc7aa0 0x55cc8b3d4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aebc930 0x55cc8b41fe80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 --2- 172.21.15.64:0/4276738287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b3d49c0 unknown :-1 s=CLOSED pgs=2604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6b7fe00640 0 client.11955 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 >> 172.21.15.64:0/4276738287 conn(0x55cc8aed75c0 msgr2=0x55cc8b3cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 shutdown_connections 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 1 -- 172.21.15.64:0/4276738287 wait complete. 2024-09-21T07:38:49.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.302+0000 7f6ba9015000 20 client.11955 trim_cache size 0 max 16384 2024-09-21T07:38:49.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 Processor -- start 2024-09-21T07:38:49.322 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 -- start start 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8af03890 0x55cc8b489de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55cc8b3d3ae0 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c205d60 con 0x55cc8af03890 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c0ad520 con 0x55cc8afc7aa0 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b9b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b9b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47340/0 (socket says 172.21.15.64:47340) 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b9b400640 1 -- 172.21.15.64:0/3372563472 learned_addr learned my addr 172.21.15.64:0/3372563472 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b93e00640 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8af03890 0x55cc8b489de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.322+0000 7f6b9b400640 1 -- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 msgr2=0x55cc8b48a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b9b400640 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b9b400640 1 -- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8af03890 msgr2=0x55cc8b489de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b9b400640 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8af03890 0x55cc8b489de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b9b400640 1 -- 172.21.15.64:0/3372563472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc8b277680 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.325 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b9b400640 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f6b940ba040 tx=0x7f6b940095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e63af4a8b85d692 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b8aa00640 1 -- 172.21.15.64:0/3372563472 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940c5070 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b8aa00640 1 -- 172.21.15.64:0/3372563472 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b940a5e50 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.326 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6b8aa00640 1 -- 172.21.15.64:0/3372563472 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940b2070 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- 172.21.15.64:0/3372563472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 msgr2=0x55cc8b48a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f6b940ba040 tx=0x7f6b940095c0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- 172.21.15.64:0/3372563472 shutdown_connections 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48a860 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 --2- 172.21.15.64:0/3372563472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8af03890 0x55cc8b489de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- 172.21.15.64:0/3372563472 >> 172.21.15.64:0/3372563472 conn(0x55cc8aed75c0 msgr2=0x55cc8b429d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- 172.21.15.64:0/3372563472 shutdown_connections 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- 172.21.15.64:0/3372563472 wait complete. 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 -- start start 2024-09-21T07:38:49.327 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.326+0000 7f6ba9015000 1 Processor -- start 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0c6480 con 0x55cc8af03890 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1fd3e0 con 0x55cc8b2ac6d0 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55cc8aedf680 con 0x55cc8afc7aa0 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 10 client.0 _ll_register_callbacks cb 0x7f6b8c059df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:38:49.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47348/0 (socket says 172.21.15.64:47348) 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1228578360 learned_addr learned my addr 172.21.15.64:0/1228578360 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b93e00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9b400640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 msgr2=0x55cc8b48e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 msgr2=0x55cc8b48e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 -- 172.21.15.64:0/1228578360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8b1e40b0 con 0x55cc8af03890 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b9aa00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3c0 tx=0x7f6b8c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a541eefe85218c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c060020 con 0x55cc8af03890 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b940a5e50 con 0x55cc8af03890 2024-09-21T07:38:49.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f6b8c07f4e0 con 0x55cc8af03890 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c0677d0 con 0x55cc8af03890 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 10 client.11961 fetch_fsmap learned FSMap version 176 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55cc8b1b0610 con 0x55cc8af03890 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b940a5e50 con 0x55cc8af03890 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8c063ab0 con 0x55cc8af03890 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 10 client.11961 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 10 client.11961 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 20 client.11961 populate_metadata read hostname 'smithi064' 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aeaa990 0x55cc8b449800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 4 client.11961 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc8b2285b0 con 0x55cc8aeaa990 2024-09-21T07:38:49.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b93e00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aeaa990 0x55cc8b449800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:38:49.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b93e00640 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aeaa990 0x55cc8b449800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40060ace1947d1d1 server_cookie=254a4493488fb50a in_seq=0 out_seq=0 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 10 client.11961 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 1 -- 172.21.15.64:0/1228578360 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x55cc8b2285b0 con 0x55cc8aeaa990 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 10 client.11961 handle_command_reply: tid=0 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 client.11961 shutdown 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 msgr2=0x55cc8b48df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3c0 tx=0x7f6b8c00cf20 comp rx=0 tx=0).stop 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 shutdown_connections 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc8b2ac6d0 0x55cc8b48e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cc8afc7aa0 0x55cc8b48e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55cc8aeaa990 0x55cc8b449800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 --2- 172.21.15.64:0/1228578360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55cc8af03890 0x55cc8b48df70 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 >> 172.21.15.64:0/1228578360 conn(0x55cc8aed75c0 msgr2=0x55cc8b3da5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6b7fe00640 0 client.11961 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:38:49.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 shutdown_connections 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 1 -- 172.21.15.64:0/1228578360 wait complete. 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.330+0000 7f6ba9015000 20 client.11961 trim_cache size 0 max 16384 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "4b2e2927-d354-4e8f-a048-46d03c6956e5": { 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "4b2e2927-d354-4e8f-a048-46d03c6956e5", 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive,repair" 2024-09-21T07:38:49.335 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "4b2e2927-d354-4e8f-a048-46d03c6956e5": { 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:38:49.098316+0000", 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:38:49.336 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 msgr2=0x7f6b78075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 0x7f6b78075740 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0d05d0 tx=0x7f6b840091e0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 msgr2=0x7f6b9c0ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3f0 tx=0x7f6b8c00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 shutdown_connections 2024-09-21T07:38:49.338 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6b78073230 0x7f6b78075740 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b9c154d10 0x7f6b9c155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c0caf00 0x7f6b9c1f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 --2- 172.21.15.64:0/2518842850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b9c06fae0 0x7f6b9c0ae670 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 >> 172.21.15.64:0/2518842850 conn(0x7f6b9c06d570 msgr2=0x7f6b9c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 shutdown_connections 2024-09-21T07:38:49.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:38:49.334+0000 7f6ba1800640 1 -- 172.21.15.64:0/2518842850 wait complete. 2024-09-21T07:38:49.351 INFO:tasks.cephfs.filesystem:scrub status for tag:4b2e2927-d354-4e8f-a048-46d03c6956e5 - {'path': '/', 'tag': '4b2e2927-d354-4e8f-a048-46d03c6956e5', 'options': 'recursive,repair'} 2024-09-21T07:39:10.930 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:10.934 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:19.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:19.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 -- 172.21.15.64:0/4029272916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b2409ba20 msgr2=0x7f0b240b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 --2- 172.21.15.64:0/4029272916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b2409ba20 0x7f0b240b3950 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009840 tx=0x7f0b1401c820 comp rx=0 tx=0).stop 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 -- 172.21.15.64:0/4029272916 shutdown_connections 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 --2- 172.21.15.64:0/4029272916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b2409ba20 0x7f0b240b3950 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 -- 172.21.15.64:0/4029272916 >> 172.21.15.64:0/4029272916 conn(0x7f0b240b3ff0 msgr2=0x7f0b240b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 -- 172.21.15.64:0/4029272916 shutdown_connections 2024-09-21T07:39:19.518 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.517+0000 7f0b29000640 1 -- 172.21.15.64:0/4029272916 wait complete. 2024-09-21T07:39:19.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 Processor -- start 2024-09-21T07:39:19.520 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- start start 2024-09-21T07:39:19.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2409ba20 0x7f0b24160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.523 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b240b5760 0x7f0b24143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2416b3b0 con 0x7f0b240b5350 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2416b230 con 0x7f0b2409ba20 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2416b530 con 0x7f0b240b5760 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57582/0 (socket says 172.21.15.64:57582) 2024-09-21T07:39:19.524 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 -- 172.21.15.64:0/1324275433 learned_addr learned my addr 172.21.15.64:0/1324275433 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b22800640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b240b5760 0x7f0b24143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2409ba20 0x7f0b24160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 -- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b240b5760 msgr2=0x7f0b24143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b240b5760 0x7f0b24143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 -- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2409ba20 msgr2=0x7f0b24160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2409ba20 0x7f0b24160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 -- 172.21.15.64:0/1324275433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2409f2f0 con 0x7f0b240b5350 2024-09-21T07:39:19.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b21400640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c3f0 tx=0x7f0b1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b1a000640 1 -- 172.21.15.64:0/1324275433 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011790 con 0x7f0b240b5350 2024-09-21T07:39:19.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b1a000640 1 -- 172.21.15.64:0/1324275433 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b10017070 con 0x7f0b240b5350 2024-09-21T07:39:19.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b1a000640 1 -- 172.21.15.64:0/1324275433 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011cc0 con 0x7f0b240b5350 2024-09-21T07:39:19.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2409f5d0 con 0x7f0b240b5350 2024-09-21T07:39:19.527 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.521+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2409fb90 con 0x7f0b240b5350 2024-09-21T07:39:19.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b1a000640 1 -- 172.21.15.64:0/1324275433 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0b1001c460 con 0x7f0b240b5350 2024-09-21T07:39:19.532 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b1a000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 0x7f0b04079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b1a000640 1 -- 172.21.15.64:0/1324275433 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0b100940f0 con 0x7f0b240b5350 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 0x7f0b04079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b30587000 1 Processor -- start 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.525+0000 7f0b30587000 1 -- start start 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 0x7f0b04079b50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0b140af000 tx=0x7f0b1401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.533 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10b559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b55f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556b109f4cd0 con 0x556b10704aa0 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b1090a330 con 0x556b10640890 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556b10967bb0 con 0x556b109e96d0 2024-09-21T07:39:19.534 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57592/0 (socket says 172.21.15.64:57592) 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 -- 172.21.15.64:0/2685274493 learned_addr learned my addr 172.21.15.64:0/2685274493 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b21400640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b55f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b21e00640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10b559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 -- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 msgr2=0x556b10b559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10b559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.535 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 -- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 msgr2=0x556b10b55f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b55f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 -- 172.21.15.64:0/2685274493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1090bc80 con 0x556b10704aa0 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b21e00640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10b559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b22800640 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009f70 tx=0x7f0b1c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ee926661e28551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b0ea00640 1 -- 172.21.15.64:0/2685274493 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c003980 con 0x556b10704aa0 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b0ea00640 1 -- 172.21.15.64:0/2685274493 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b1c003b20 con 0x556b10704aa0 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b0ea00640 1 -- 172.21.15.64:0/2685274493 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00a6b0 con 0x556b10704aa0 2024-09-21T07:39:19.536 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- 172.21.15.64:0/2685274493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 msgr2=0x556b10b56470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009f70 tx=0x7f0b1c009630 comp rx=0 tx=0).stop 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- 172.21.15.64:0/2685274493 shutdown_connections 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10b56470 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b55f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 --2- 172.21.15.64:0/2685274493 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10b559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.537 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- 172.21.15.64:0/2685274493 >> 172.21.15.64:0/2685274493 conn(0x556b106145c0 msgr2=0x556b10b12ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- 172.21.15.64:0/2685274493 shutdown_connections 2024-09-21T07:39:19.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.529+0000 7f0b30587000 1 -- 172.21.15.64:0/2685274493 wait complete. 2024-09-21T07:39:19.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- start start 2024-09-21T07:39:19.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 Processor -- start 2024-09-21T07:39:19.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b11a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10b11f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.541 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556b1095adf0 con 0x556b109e96d0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b10956fe0 con 0x556b10640890 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556b108fc4d0 con 0x556b10704aa0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 10 client.0 _ll_register_callbacks cb 0x556b108da7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57604/0 (socket says 172.21.15.64:57604) 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 -- 172.21.15.64:0/1846072678 learned_addr learned my addr 172.21.15.64:0/1846072678 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b11a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b21400640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10b11f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 -- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 msgr2=0x556b10b11f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10b11f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 -- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 msgr2=0x556b10b11a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b11a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 -- 172.21.15.64:0/1846072678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b108f5210 con 0x556b109e96d0 2024-09-21T07:39:19.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b11a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b22800640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x556b10a0a760 tx=0x7f0b1c003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47203f188f9d1623 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00a6b0 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0b1c00a850 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b108ef350 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0b1c02d050 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 10 client.11976 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x556b108dbfc0 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556b108ef350 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0b1c030020 con 0x556b109e96d0 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 10 client.11976 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 10 client.11976 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 20 client.11976 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.533+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105f9930 0x556b10b5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 4 client.11976 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:39:19.543 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b10969b00 con 0x556b105f9930 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105f9930 0x556b10b5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b21e00640 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105f9930 0x556b10b5ce80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a208132df828c8b1 server_cookie=2400c76b4e460e28 in_seq=0 out_seq=0 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b03400640 10 client.11976 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b03400640 1 -- 172.21.15.64:0/1846072678 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b10969b00 con 0x556b105f9930 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b03400640 10 client.11976 handle_command_reply: tid=0 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 client.11976 shutdown 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 msgr2=0x556b10b185f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x556b10a0a760 tx=0x7f0b1c003cf0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 shutdown_connections 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105f9930 0x556b10b5ce80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10b185f0 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10b11f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 --2- 172.21.15.64:0/1846072678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10b11a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b03400640 0 client.11976 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 >> 172.21.15.64:0/1846072678 conn(0x556b106145c0 msgr2=0x556b10b0ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 shutdown_connections 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 1 -- 172.21.15.64:0/1846072678 wait complete. 2024-09-21T07:39:19.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.537+0000 7f0b30587000 20 client.11976 trim_cache size 0 max 16384 2024-09-21T07:39:19.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 Processor -- start 2024-09-21T07:39:19.556 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 -- start start 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bc7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10bc7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556b10b10b20 con 0x556b109e96d0 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2415e1e0 con 0x556b10640890 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0b24145c10 con 0x556b10704aa0 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57618/0 (socket says 172.21.15.64:57618) 2024-09-21T07:39:19.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 -- 172.21.15.64:0/834988596 learned_addr learned my addr 172.21.15.64:0/834988596 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b21e00640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bc7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b21400640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10bc7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 -- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 msgr2=0x556b10bc7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10bc7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 -- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 msgr2=0x556b10bc7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bc7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 -- 172.21.15.64:0/834988596 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b109b4680 con 0x556b109e96d0 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b21e00640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bc7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:19.560 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b21400640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10bc7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b22800640 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00afb0 tx=0x7f0b1c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e33fa6d942d70e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b0e000640 1 -- 172.21.15.64:0/834988596 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c036070 con 0x556b109e96d0 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b0e000640 1 -- 172.21.15.64:0/834988596 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b1c00a6b0 con 0x556b109e96d0 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.557+0000 7f0b0e000640 1 -- 172.21.15.64:0/834988596 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00a220 con 0x556b109e96d0 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- 172.21.15.64:0/834988596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 msgr2=0x556b10bc7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00afb0 tx=0x7f0b1c009e20 comp rx=0 tx=0).stop 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- 172.21.15.64:0/834988596 shutdown_connections 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b109e96d0 0x556b10bc7e80 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b10704aa0 0x556b10bc7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- 172.21.15.64:0/834988596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bc7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- 172.21.15.64:0/834988596 >> 172.21.15.64:0/834988596 conn(0x556b106145c0 msgr2=0x556b10b67fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- 172.21.15.64:0/834988596 shutdown_connections 2024-09-21T07:39:19.561 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- 172.21.15.64:0/834988596 wait complete. 2024-09-21T07:39:19.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- start start 2024-09-21T07:39:19.562 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 Processor -- start 2024-09-21T07:39:19.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bcb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.564 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10bcc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2406fb40 con 0x556b10704aa0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2406f4f0 con 0x556b10640890 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x556b1061c680 con 0x556b109e96d0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b30587000 10 client.0 _ll_register_callbacks cb 0x7f0b1005ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57630/0 (socket says 172.21.15.64:57630) 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 -- 172.21.15.64:0/3909539460 learned_addr learned my addr 172.21.15.64:0/3909539460 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b22800640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10bcc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21e00640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bcb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 -- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 msgr2=0x556b10bcc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10bcc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.565 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 -- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 msgr2=0x556b10bcb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bcb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 -- 172.21.15.64:0/3909539460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b109210b0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b21400640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001000 tx=0x7f0b1005e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b75e8a2863a06b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.561+0000 7f0b03400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1005dca0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b1c00a6b0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0b1005a190 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0b100681b0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 10 client.11982 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x556b108ed610 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b1c00a6b0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0b10078ce0 con 0x556b10704aa0 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 10 client.11982 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:19.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 10 client.11982 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 20 client.11982 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105e7990 0x556b10b0cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 4 client.11982 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:39:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b109655b0 con 0x556b105e7990 2024-09-21T07:39:19.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b21e00640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105e7990 0x556b10b0cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b21e00640 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105e7990 0x556b10b0cbb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454e049474e69e1d server_cookie=340dd9d7227ab5d7 in_seq=0 out_seq=0 2024-09-21T07:39:19.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 10 client.11982 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 1 -- 172.21.15.64:0/3909539460 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x556b109655b0 con 0x556b105e7990 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 10 client.11982 handle_command_reply: tid=0 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 client.11982 shutdown 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 msgr2=0x556b10bcbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001000 tx=0x7f0b1005e840 comp rx=0 tx=0).stop 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 shutdown_connections 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556b109e96d0 0x556b10bcc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x556b105e7990 0x556b10b0cbb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556b10704aa0 0x556b10bcbb90 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 --2- 172.21.15.64:0/3909539460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b10640890 0x556b10bcb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b03400640 0 client.11982 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 >> 172.21.15.64:0/3909539460 conn(0x556b106145c0 msgr2=0x556b10b175a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 shutdown_connections 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 1 -- 172.21.15.64:0/3909539460 wait complete. 2024-09-21T07:39:19.570 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b30587000 20 client.11982 trim_cache size 0 max 16384 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "4b2e2927-d354-4e8f-a048-46d03c6956e5": { 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:38:49.098316+0000", 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:19.572 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:19.572 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:39:19.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 msgr2=0x7f0b04079b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 0x7f0b04079b50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0b140af000 tx=0x7f0b1401b060 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 msgr2=0x7f0b24142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c3f0 tx=0x7f0b1000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 shutdown_connections 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0b04077640 0x7f0b04079b50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b240b5760 0x7f0b24143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b240b5350 0x7f0b24142fc0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 --2- 172.21.15.64:0/1324275433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2409ba20 0x7f0b24160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 >> 172.21.15.64:0/1324275433 conn(0x7f0b240b3ff0 msgr2=0x7f0b240c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 shutdown_connections 2024-09-21T07:39:19.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.565+0000 7f0b29000640 1 -- 172.21.15.64:0/1324275433 wait complete. 2024-09-21T07:39:19.585 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:39:19.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:19.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 -- 172.21.15.64:0/1570442302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897815af70 msgr2=0x7f897806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 --2- 172.21.15.64:0/1570442302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897815af70 0x7f897806f0d0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7f896800a950 tx=0x7f896801da80 comp rx=0 tx=0).stop 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 -- 172.21.15.64:0/1570442302 shutdown_connections 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 --2- 172.21.15.64:0/1570442302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897815af70 0x7f897806f0d0 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 -- 172.21.15.64:0/1570442302 >> 172.21.15.64:0/1570442302 conn(0x7f897806d570 msgr2=0x7f89780b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 -- 172.21.15.64:0/1570442302 shutdown_connections 2024-09-21T07:39:19.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.745+0000 7f897d400640 1 -- 172.21.15.64:0/1570442302 wait complete. 2024-09-21T07:39:19.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 Processor -- start 2024-09-21T07:39:19.750 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 -- start start 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978074af0 0x7f8978154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f897815af70 0x7f8978154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8978169040 con 0x7f897806f610 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8978168ec0 con 0x7f8978074af0 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.749+0000 7f897d400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f89781691c0 con 0x7f897815af70 2024-09-21T07:39:19.752 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57660/0 (socket says 172.21.15.64:57660) 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 -- 172.21.15.64:0/3942381316 learned_addr learned my addr 172.21.15.64:0/3942381316 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 -- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f897815af70 msgr2=0x7f8978154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f897815af70 0x7f8978154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 -- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978074af0 msgr2=0x7f8978154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978074af0 0x7f8978154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 -- 172.21.15.64:0/3942381316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89781660b0 con 0x7f897806f610 2024-09-21T07:39:19.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f8976800640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7f896800a8a0 tx=0x7f89680038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f896f400640 1 -- 172.21.15.64:0/3942381316 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89680b3040 con 0x7f897806f610 2024-09-21T07:39:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f896f400640 1 -- 172.21.15.64:0/3942381316 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8968003d90 con 0x7f897806f610 2024-09-21T07:39:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f896f400640 1 -- 172.21.15.64:0/3942381316 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968005290 con 0x7f897806f610 2024-09-21T07:39:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8978166390 con 0x7f897806f610 2024-09-21T07:39:19.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89781655b0 con 0x7f897806f610 2024-09-21T07:39:19.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.753+0000 7f896f400640 1 -- 172.21.15.64:0/3942381316 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8968005430 con 0x7f897806f610 2024-09-21T07:39:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f896f400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 0x7f8954075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f896f400640 1 -- 172.21.15.64:0/3942381316 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f896812f1b0 con 0x7f897806f610 2024-09-21T07:39:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f896de00640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 0x7f8954075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 Processor -- start 2024-09-21T07:39:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 -- start start 2024-09-21T07:39:19.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f896de00640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 0x7f8954075740 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f70 tx=0x7f89600079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d63ae0 0x558752eb4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752eb50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558752c79bd0 con 0x558752d6b1a0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558752c6a430 con 0x558752d4d970 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558752cc7ce0 con 0x558752d63ae0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57676/0 (socket says 172.21.15.64:57676) 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 -- 172.21.15.64:0/936093473 learned_addr learned my addr 172.21.15.64:0/936093473 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 -- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d63ae0 msgr2=0x558752eb4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d63ae0 0x558752eb4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 -- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 msgr2=0x558752eb50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752eb50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 -- 172.21.15.64:0/936093473 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558752c6bd80 con 0x558752d6b1a0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.757+0000 7f8976800640 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f89680f97e0 tx=0x7f89680f91a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7711e61a93edd58a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8967000640 1 -- 172.21.15.64:0/936093473 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89680fe100 con 0x558752d6b1a0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8967000640 1 -- 172.21.15.64:0/936093473 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89680f9f50 con 0x558752d6b1a0 2024-09-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8967000640 1 -- 172.21.15.64:0/936093473 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89680f9850 con 0x558752d6b1a0 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- 172.21.15.64:0/936093473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 msgr2=0x558752eb4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f89680f97e0 tx=0x7f89680f91a0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- 172.21.15.64:0/936093473 shutdown_connections 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752eb50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d63ae0 0x558752eb4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- 172.21.15.64:0/936093473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752eb4640 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- 172.21.15.64:0/936093473 >> 172.21.15.64:0/936093473 conn(0x558752d718c0 msgr2=0x558752e694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- 172.21.15.64:0/936093473 shutdown_connections 2024-09-21T07:39:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- 172.21.15.64:0/936093473 wait complete. 2024-09-21T07:39:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- start start 2024-09-21T07:39:19.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 Processor -- start 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752e70640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e9ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558752cbaf20 con 0x558752d63ae0 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558752cb7110 con 0x558752d4d970 2024-09-21T07:39:19.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558752c5c6d0 con 0x558752d6b1a0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.761+0000 7f8984b46000 10 client.0 _ll_register_callbacks cb 0x558752c5b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57678/0 (socket says 172.21.15.64:57678) 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 -- 172.21.15.64:0/3952233976 learned_addr learned my addr 172.21.15.64:0/3952233976 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8977200640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e9ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8976800640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752e70640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 -- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 msgr2=0x558752e9ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e9ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 -- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 msgr2=0x558752e70640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752e70640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 -- 172.21.15.64:0/3952233976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558752c55310 con 0x558752d63ae0 2024-09-21T07:39:19.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8977200640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e9ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f896de00640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f8960016ee0 tx=0x7f8960000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d50398886dee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960013e40 con 0x558752d63ae0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558752c4f450 con 0x558752d63ae0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f89600162e0 con 0x558752d63ae0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f89600050d0 con 0x558752d63ae0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 10 client.11997 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x558752c72f60 con 0x558752d63ae0 2024-09-21T07:39:19.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558752c4f450 con 0x558752d63ae0 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f8960005270 con 0x558752d63ae0 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 10 client.11997 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 10 client.11997 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 20 client.11997 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752959b80 0x558752ebb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 4 client.11997 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558752cc9c30 con 0x558752959b80 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8976800640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752959b80 0x558752ebb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 10 client.11997 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8976800640 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752959b80 0x558752ebb8c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb0c358730f7446 server_cookie=ed7dd9240c81314 in_seq=0 out_seq=0 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 1 -- 172.21.15.64:0/3952233976 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558752cc9c30 con 0x558752959b80 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f895b400640 10 client.11997 handle_command_reply: tid=0 2024-09-21T07:39:19.768 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 client.11997 shutdown 2024-09-21T07:39:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 msgr2=0x558752e70b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.765+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f8960016ee0 tx=0x7f8960000ee0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.769 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 shutdown_connections 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e9ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752959b80 0x558752ebb8c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d63ae0 0x558752e70b80 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 --2- 172.21.15.64:0/3952233976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d4d970 0x558752e70640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f895b400640 0 client.11997 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 >> 172.21.15.64:0/3952233976 conn(0x558752d718c0 msgr2=0x558752e69c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 shutdown_connections 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 1 -- 172.21.15.64:0/3952233976 wait complete. 2024-09-21T07:39:19.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.769+0000 7f8984b46000 20 client.11997 trim_cache size 0 max 16384 2024-09-21T07:39:19.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.785+0000 7f8984b46000 1 Processor -- start 2024-09-21T07:39:19.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.785+0000 7f8984b46000 1 -- start start 2024-09-21T07:39:19.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752ecc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e68af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f897820a500 con 0x558752d4d970 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8978209560 con 0x558752d63ae0 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f8978201740 con 0x558752d6b1a0 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57686/0 (socket says 172.21.15.64:57686) 2024-09-21T07:39:19.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 -- 172.21.15.64:0/1628594376 learned_addr learned my addr 172.21.15.64:0/1628594376 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 -- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 msgr2=0x558752e68af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e68af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 -- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 msgr2=0x558752ecc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752ecc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 -- 172.21.15.64:0/1628594376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558752d3bf30 con 0x558752d4d970 2024-09-21T07:39:19.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8976800640 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f896801d4f0 tx=0x7f89680bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c4ffbb97d09269 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8966600640 1 -- 172.21.15.64:0/1628594376 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89680fe330 con 0x558752d4d970 2024-09-21T07:39:19.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8966600640 1 -- 172.21.15.64:0/1628594376 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8968103270 con 0x558752d4d970 2024-09-21T07:39:19.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8966600640 1 -- 172.21.15.64:0/1628594376 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89680f9850 con 0x558752d4d970 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- 172.21.15.64:0/1628594376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 msgr2=0x558752ecc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f896801d4f0 tx=0x7f89680bb040 comp rx=0 tx=0).stop 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- 172.21.15.64:0/1628594376 shutdown_connections 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d6b1a0 0x558752e68af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752ecc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 --2- 172.21.15.64:0/1628594376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d4d970 0x558752ecc280 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- 172.21.15.64:0/1628594376 >> 172.21.15.64:0/1628594376 conn(0x558752d718c0 msgr2=0x558752eb3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- 172.21.15.64:0/1628594376 shutdown_connections 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- 172.21.15.64:0/1628594376 wait complete. 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 -- start start 2024-09-21T07:39:19.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.789+0000 7f8984b46000 1 Processor -- start 2024-09-21T07:39:19.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d4d970 0x558752f2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752f2a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558752cba230 con 0x558752d6b1a0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558752cb7110 con 0x558752d63ae0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x558752d3baa0 con 0x558752d4d970 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8984b46000 10 client.0 _ll_register_callbacks cb 0x7f8960001230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57692/0 (socket says 172.21.15.64:57692) 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f896de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752f2a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 -- 172.21.15.64:0/4156847855 learned_addr learned my addr 172.21.15.64:0/4156847855 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8976800640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d4d970 0x558752f2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 -- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d4d970 msgr2=0x558752f2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d4d970 0x558752f2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 -- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 msgr2=0x558752f2a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752f2a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 -- 172.21.15.64:0/4156847855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558752d12dd0 con 0x558752d6b1a0 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f8977200640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f897000e700 tx=0x7f897000e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8a5af05889b4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.793+0000 7f895b400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700135f0 con 0x558752d6b1a0 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f8970013790 con 0x558752d6b1a0 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8968103270 con 0x558752d6b1a0 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f8970021050 con 0x558752d6b1a0 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 10 client.12003 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:19.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x558752c4d840 con 0x558752d6b1a0 2024-09-21T07:39:19.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8968103270 con 0x558752d6b1a0 2024-09-21T07:39:19.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f8970024020 con 0x558752d6b1a0 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 10 client.12003 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 10 client.12003 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 20 client.12003 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752947be0 0x558752e6c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 4 client.12003 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x558752cc56e0 con 0x558752947be0 2024-09-21T07:39:19.798 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8976800640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752947be0 0x558752e6c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8976800640 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752947be0 0x558752e6c3c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7ccb62782663b5a server_cookie=3cc9f204e9394619 in_seq=0 out_seq=0 2024-09-21T07:39:19.799 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 10 client.12003 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 1 -- 172.21.15.64:0/4156847855 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558752cc56e0 con 0x558752947be0 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 10 client.12003 handle_command_reply: tid=0 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 client.12003 shutdown 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 msgr2=0x558752f2ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f897000e700 tx=0x7f897000e7f0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 shutdown_connections 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x558752947be0 0x558752e6c3c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558752d6b1a0 0x558752f2ab10 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558752d63ae0 0x558752f2a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.800 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 --2- 172.21.15.64:0/4156847855 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x558752d4d970 0x558752f2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f895b400640 0 client.12003 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 >> 172.21.15.64:0/4156847855 conn(0x558752d718c0 msgr2=0x558752ecb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 shutdown_connections 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 1 -- 172.21.15.64:0/4156847855 wait complete. 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.797+0000 7f8984b46000 20 client.12003 trim_cache size 0 max 16384 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stdout: "return_code": 0, 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_tag": "ac89eda7-26be-4718-b986-627051c88541", 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stdout: "mode": "asynchronous" 2024-09-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:39:19.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 msgr2=0x7f8954075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 0x7f8954075740 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f70 tx=0x7f89600079c0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 msgr2=0x7f89781fdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7f896800a8a0 tx=0x7f89680038b0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 shutdown_connections 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f8954073230 0x7f8954075740 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f897815af70 0x7f8978154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978074af0 0x7f8978154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 --2- 172.21.15.64:0/3942381316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f897806f610 0x7f89781fdde0 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 >> 172.21.15.64:0/3942381316 conn(0x7f897806d570 msgr2=0x7f89781555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 shutdown_connections 2024-09-21T07:39:19.803 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.801+0000 7f897d400640 1 -- 172.21.15.64:0/3942381316 wait complete. 2024-09-21T07:39:19.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:19.819 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-21T07:39:19.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- 172.21.15.64:0/1629642179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf015af70 msgr2=0x7f0bf00b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 --2- 172.21.15.64:0/1629642179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf015af70 0x7f0bf00b2580 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00cfff0 tx=0x7f0be001c650 comp rx=0 tx=0).stop 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- 172.21.15.64:0/1629642179 shutdown_connections 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 --2- 172.21.15.64:0/1629642179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 0x7f0bf006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 --2- 172.21.15.64:0/1629642179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf015af70 0x7f0bf00b2580 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- 172.21.15.64:0/1629642179 >> 172.21.15.64:0/1629642179 conn(0x7f0bf006d570 msgr2=0x7f0bf00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- 172.21.15.64:0/1629642179 shutdown_connections 2024-09-21T07:39:19.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- 172.21.15.64:0/1629642179 wait complete. 2024-09-21T07:39:19.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 Processor -- start 2024-09-21T07:39:19.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.981+0000 7f0bf5000640 1 -- start start 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 0x7f0bf00c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf0073ae0 0x7f0bf00c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0168de0 con 0x7f0bf015af70 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0168c60 con 0x7f0bf0073ae0 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf0168f60 con 0x7f0bf006f0d0 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57698/0 (socket says 172.21.15.64:57698) 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 -- 172.21.15.64:0/3133382758 learned_addr learned my addr 172.21.15.64:0/3133382758 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bede00640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 0x7f0bf00c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0be7e00640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf0073ae0 0x7f0bf00c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 -- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 msgr2=0x7f0bf00c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 0x7f0bf00c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 -- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf0073ae0 msgr2=0x7f0bf00c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf0073ae0 0x7f0bf00c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 -- 172.21.15.64:0/3133382758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf00ca060 con 0x7f0bf015af70 2024-09-21T07:39:19.986 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bee800640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f0be800cbe0 tx=0x7f0be800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0be6000640 1 -- 172.21.15.64:0/3133382758 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8016020 con 0x7f0bf015af70 2024-09-21T07:39:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0be6000640 1 -- 172.21.15.64:0/3133382758 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be800ab00 con 0x7f0bf015af70 2024-09-21T07:39:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf00ad280 con 0x7f0bf015af70 2024-09-21T07:39:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0be6000640 1 -- 172.21.15.64:0/3133382758 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8012420 con 0x7f0bf015af70 2024-09-21T07:39:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.985+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf00ad840 con 0x7f0bf015af70 2024-09-21T07:39:19.988 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0be6000640 1 -- 172.21.15.64:0/3133382758 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0be8019020 con 0x7f0bf015af70 2024-09-21T07:39:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0be6000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 0x7f0bcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 Processor -- start 2024-09-21T07:39:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0be6000640 1 -- 172.21.15.64:0/3133382758 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0be8094620 con 0x7f0bf015af70 2024-09-21T07:39:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 -- start start 2024-09-21T07:39:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bede00640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 0x7f0bcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bede00640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 0x7f0bcc075710 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0be00ae000 tx=0x7f0be00b3040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e91d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 0x55884e91df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55884e7bccd0 con 0x55884e4ccaa0 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55884e6d2330 con 0x55884e408890 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55884e72fbb0 con 0x55884e7b16d0 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57714/0 (socket says 172.21.15.64:57714) 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 -- 172.21.15.64:0/2836313005 learned_addr learned my addr 172.21.15.64:0/2836313005 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0be7e00640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 0x55884e91df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 -- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 msgr2=0x55884e91d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bede00640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e91d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e91d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 -- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 msgr2=0x55884e91df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 0x55884e91df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 -- 172.21.15.64:0/2836313005 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55884e6d3c80 con 0x55884e4ccaa0 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0be7e00640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 0x55884e91df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bede00640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e91d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.989+0000 7f0bee800640 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f0be805ee20 tx=0x7f0be80016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbb61ae9129ea6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bdea00640 1 -- 172.21.15.64:0/2836313005 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be80638c0 con 0x55884e4ccaa0 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bdea00640 1 -- 172.21.15.64:0/2836313005 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be8068770 con 0x55884e4ccaa0 2024-09-21T07:39:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bdea00640 1 -- 172.21.15.64:0/2836313005 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8066db0 con 0x55884e4ccaa0 2024-09-21T07:39:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2836313005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 msgr2=0x55884e91e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f0be805ee20 tx=0x7f0be80016a0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2836313005 shutdown_connections 2024-09-21T07:39:19.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e4ccaa0 0x55884e91e470 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e408890 0x55884e91df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2836313005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e91d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2836313005 >> 172.21.15.64:0/2836313005 conn(0x55884e3dc5c0 msgr2=0x55884e8daae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2836313005 shutdown_connections 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2836313005 wait complete. 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- start start 2024-09-21T07:39:19.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 Processor -- start 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e8d9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e8e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55884e722df0 con 0x55884e408890 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55884e71efe0 con 0x55884e7b16d0 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.993+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55884e6c44d0 con 0x55884e4ccaa0 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 10 client.0 _ll_register_callbacks cb 0x55884e6a27f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57720/0 (socket says 172.21.15.64:57720) 2024-09-21T07:39:19.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 -- 172.21.15.64:0/2075685973 learned_addr learned my addr 172.21.15.64:0/2075685973 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0be7e00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e8d9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bee800640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e8e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 -- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 msgr2=0x55884e8d9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e8d9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 -- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 msgr2=0x55884e8e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e8e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 -- 172.21.15.64:0/2075685973 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55884e6bd210 con 0x55884e408890 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bede00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009790 tx=0x7f0be001aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a2f322fb8898a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00cc060 con 0x55884e408890 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55884e6b7350 con 0x55884e408890 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0be00a67d0 con 0x55884e408890 2024-09-21T07:39:19.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0be00d2050 con 0x55884e408890 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 10 client.12015 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55884e6a3fc0 con 0x55884e408890 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55884e6b7350 con 0x55884e408890 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0be00d5020 con 0x55884e408890 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 10 client.12015 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 10 client.12015 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 20 client.12015 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3c1930 0x55884e924e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 4 client.12015 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:39:20.000 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55884e731b00 con 0x55884e3c1930 2024-09-21T07:39:20.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0be7e00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3c1930 0x55884e924e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0be7e00640 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3c1930 0x55884e924e80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c25c59c770a9343 server_cookie=61816141642e5af in_seq=0 out_seq=0 2024-09-21T07:39:20.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 10 client.12015 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 1 -- 172.21.15.64:0/2075685973 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55884e731b00 con 0x55884e3c1930 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:19.997+0000 7f0bd3400640 10 client.12015 handle_command_reply: tid=0 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 client.12015 shutdown 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 msgr2=0x55884e8d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009790 tx=0x7f0be001aef0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 shutdown_connections 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e8e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e8d9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3c1930 0x55884e924e80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/2075685973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e8d9a10 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 >> 172.21.15.64:0/2075685973 conn(0x55884e3dc5c0 msgr2=0x55884e8d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:20.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bd3400640 0 client.12015 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:20.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 shutdown_connections 2024-09-21T07:39:20.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/2075685973 wait complete. 2024-09-21T07:39:20.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.001+0000 7f0bfc6f8000 20 client.12015 trim_cache size 0 max 16384 2024-09-21T07:39:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.017+0000 7f0bfc6f8000 1 Processor -- start 2024-09-21T07:39:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.017+0000 7f0bfc6f8000 1 -- start start 2024-09-21T07:39:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 0x55884e98f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e98fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55884e8d8b30 con 0x55884e408890 2024-09-21T07:39:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0205930 con 0x55884e4ccaa0 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf02049b0 con 0x55884e7b16d0 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57736/0 (socket says 172.21.15.64:57736) 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 -- 172.21.15.64:0/4017392385 learned_addr learned my addr 172.21.15.64:0/4017392385 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0be7e00640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 0x55884e98f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 -- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 msgr2=0x55884e98fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bee800640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e98fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e98fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 -- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 msgr2=0x55884e98f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 0x55884e98f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 -- 172.21.15.64:0/4017392385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55884e77c680 con 0x55884e408890 2024-09-21T07:39:20.022 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bee800640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e98fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:20.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0be7e00640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 0x55884e98f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:20.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bede00640 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f0be001cef0 tx=0x7f0be0019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34e6654f309557 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:20.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bde000640 1 -- 172.21.15.64:0/4017392385 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00a67d0 con 0x55884e408890 2024-09-21T07:39:20.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bde000640 1 -- 172.21.15.64:0/4017392385 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be00b1450 con 0x55884e408890 2024-09-21T07:39:20.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bde000640 1 -- 172.21.15.64:0/4017392385 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b18a0 con 0x55884e408890 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/4017392385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 msgr2=0x55884e98f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f0be001cef0 tx=0x7f0be0019450 comp rx=0 tx=0).stop 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/4017392385 shutdown_connections 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e7b16d0 0x55884e98fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e4ccaa0 0x55884e98f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/4017392385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e98f400 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/4017392385 >> 172.21.15.64:0/4017392385 conn(0x55884e3dc5c0 msgr2=0x55884e92ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/4017392385 shutdown_connections 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/4017392385 wait complete. 2024-09-21T07:39:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 -- start start 2024-09-21T07:39:20.025 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.021+0000 7f0bfc6f8000 1 Processor -- start 2024-09-21T07:39:20.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.026 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e993b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e9940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0204360 con 0x55884e408890 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf00aeb70 con 0x55884e7b16d0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55884e3e4680 con 0x55884e4ccaa0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 10 client.0 _ll_register_callbacks cb 0x7f0bd8005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57744/0 (socket says 172.21.15.64:57744) 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 -- 172.21.15.64:0/3021413716 learned_addr learned my addr 172.21.15.64:0/3021413716 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0be7e00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e993b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bee800640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e9940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 -- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 msgr2=0x55884e993b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e993b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 -- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 msgr2=0x55884e9940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e9940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 -- 172.21.15.64:0/3021413716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55884e6e90b0 con 0x55884e408890 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bede00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f0be001cb30 tx=0x7f0be00a6960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688c7104166f6aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b1810 con 0x55884e408890 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 6187+0+0 (secure 0 0 0) 0x7f0be00bdc90 con 0x55884e408890 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be00b1450 con 0x55884e408890 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0be00e6050 con 0x55884e408890 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 10 client.12021 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55884e6b5610 con 0x55884e408890 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be00b1450 con 0x55884e408890 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0be00e9020 con 0x55884e408890 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 10 client.12021 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 10 client.12021 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 20 client.12021 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3af990 0x55884e8d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 4 client.12021 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55884e72d5b0 con 0x55884e3af990 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.025+0000 7f0be7e00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3af990 0x55884e8d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0be7e00640 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3af990 0x55884e8d47d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba1d9be8f383a38 server_cookie=d682cc93708209a9 in_seq=0 out_seq=0 2024-09-21T07:39:20.030 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bd3400640 10 client.12021 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bd3400640 1 -- 172.21.15.64:0/3021413716 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+855 (crc 0 0 0) 0x55884e72d5b0 con 0x55884e3af990 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bd3400640 10 client.12021 handle_command_reply: tid=0 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 client.12021 shutdown 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 msgr2=0x55884e993650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f0be001cb30 tx=0x7f0be00a6960 comp rx=0 tx=0).stop 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 shutdown_connections 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55884e7b16d0 0x55884e9940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55884e4ccaa0 0x55884e993b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55884e3af990 0x55884e8d47d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 --2- 172.21.15.64:0/3021413716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55884e408890 0x55884e993650 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 >> 172.21.15.64:0/3021413716 conn(0x55884e3dc5c0 msgr2=0x55884e8df5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bd3400640 0 client.12021 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 shutdown_connections 2024-09-21T07:39:20.031 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 1 -- 172.21.15.64:0/3021413716 wait complete. 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bfc6f8000 20 client.12021 trim_cache size 0 max 16384 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": { 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "ac89eda7-26be-4718-b986-627051c88541": { 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "tag": "ac89eda7-26be-4718-b986-627051c88541", 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "options": "recursive,repair" 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:39:20.032 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "ac89eda7-26be-4718-b986-627051c88541": { 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:39:19.797903+0000", 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "4b2e2927-d354-4e8f-a048-46d03c6956e5": { 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:38:49.098316+0000", 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:39:20.033 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:39:20.034 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:39:20.034 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:39:20.034 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:20.034 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:20.034 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 msgr2=0x7f0bcc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 0x7f0bcc075710 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0be00ae000 tx=0x7f0be00b3040 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 msgr2=0x7f0bf01f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f0be800cbe0 tx=0x7f0be800ccd0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 shutdown_connections 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0bcc073200 0x7f0bcc075710 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bf015af70 0x7f0bf01f86b0 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf0073ae0 0x7f0bf00c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 --2- 172.21.15.64:0/3133382758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bf006f0d0 0x7f0bf00c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 >> 172.21.15.64:0/3133382758 conn(0x7f0bf006d570 msgr2=0x7f0bf0074f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:20.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 shutdown_connections 2024-09-21T07:39:20.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:20.029+0000 7f0bf5000640 1 -- 172.21.15.64:0/3133382758 wait complete. 2024-09-21T07:39:20.049 INFO:tasks.cephfs.filesystem:scrub status for tag:ac89eda7-26be-4718-b986-627051c88541 - {'path': '/', 'tag': 'ac89eda7-26be-4718-b986-627051c88541', 'options': 'recursive,repair'} 2024-09-21T07:39:40.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:40.994 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:50.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:50.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 -- 172.21.15.64:0/3921389380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 msgr2=0x7f30780b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 --2- 172.21.15.64:0/3921389380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30780b3580 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f30780ca900 tx=0x7f306401c8c0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 -- 172.21.15.64:0/3921389380 shutdown_connections 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 --2- 172.21.15.64:0/3921389380 >> v2:172.21.15.90:3300/0 conn(0x7f30780ccd30 0x7f30780cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 --2- 172.21.15.64:0/3921389380 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30780b3580 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 --2- 172.21.15.64:0/3921389380 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 0x7f307815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 -- 172.21.15.64:0/3921389380 >> 172.21.15.64:0/3921389380 conn(0x7f307806d570 msgr2=0x7f30780b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 -- 172.21.15.64:0/3921389380 shutdown_connections 2024-09-21T07:39:50.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.217+0000 7f3080400640 1 -- 172.21.15.64:0/3921389380 wait complete. 2024-09-21T07:39:50.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 Processor -- start 2024-09-21T07:39:50.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- start start 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 0x7f30781548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30780ccd30 0x7f30780cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3078168d40 con 0x7f30780b3170 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3078168bc0 con 0x7f30780ccd30 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3078168ec0 con 0x7f30780b28e0 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35482/0 (socket says 172.21.15.64:35482) 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 -- 172.21.15.64:0/873622591 learned_addr learned my addr 172.21.15.64:0/873622591 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307da00640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 0x7f30781548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307e400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30780ccd30 0x7f30780cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.222 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 -- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 msgr2=0x7f30781548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 0x7f30781548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 -- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30780ccd30 msgr2=0x7f30780cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30780ccd30 0x7f30780cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 -- 172.21.15.64:0/873622591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3078154de0 con 0x7f30780b3170 2024-09-21T07:39:50.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f307d000640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f30640b0040 tx=0x7f30640a5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3075600640 1 -- 172.21.15.64:0/873622591 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640b2040 con 0x7f30780b3170 2024-09-21T07:39:50.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3075600640 1 -- 172.21.15.64:0/873622591 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3064004430 con 0x7f30780b3170 2024-09-21T07:39:50.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3075600640 1 -- 172.21.15.64:0/873622591 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064005290 con 0x7f30780b3170 2024-09-21T07:39:50.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30780745e0 con 0x7f30780b3170 2024-09-21T07:39:50.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.221+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30780c9b60 con 0x7f30780b3170 2024-09-21T07:39:50.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f3075600640 1 -- 172.21.15.64:0/873622591 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f30640bd060 con 0x7f30780b3170 2024-09-21T07:39:50.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f3075600640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 0x7f3058075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f3075600640 1 -- 172.21.15.64:0/873622591 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f306412dae0 con 0x7f30780b3170 2024-09-21T07:39:50.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f307da00640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 0x7f3058075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f30879a7000 1 Processor -- start 2024-09-21T07:39:50.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f30879a7000 1 -- start start 2024-09-21T07:39:50.227 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.225+0000 7f307da00640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 0x7f3058075740 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f306c005fd0 tx=0x7f306c005d80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f106cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f106cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564f1056dcd0 con 0x564f105626d0 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564f10483330 con 0x564f101b9890 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564f104e0bb0 con 0x564f1027daa0 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35492/0 (socket says 172.21.15.64:35492) 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 -- 172.21.15.64:0/1067397821 learned_addr learned my addr 172.21.15.64:0/1067397821 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307d000640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f106cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307e400640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f106cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 -- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 msgr2=0x564f106cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f106cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 -- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 msgr2=0x564f106cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f106cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 -- 172.21.15.64:0/1067397821 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f10484c80 con 0x564f105626d0 2024-09-21T07:39:50.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307e400640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f106cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:50.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f307da00640 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f306c00fde0 tx=0x7f306c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e67d5fa8c8d39d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f306a000640 1 -- 172.21.15.64:0/1067397821 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c022070 con 0x564f105626d0 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f306a000640 1 -- 172.21.15.64:0/1067397821 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f306c01e460 con 0x564f105626d0 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f306a000640 1 -- 172.21.15.64:0/1067397821 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c01e870 con 0x564f105626d0 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- 172.21.15.64:0/1067397821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 msgr2=0x564f106ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f306c00fde0 tx=0x7f306c012000 comp rx=0 tx=0).stop 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- 172.21.15.64:0/1067397821 shutdown_connections 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f106cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f106cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 --2- 172.21.15.64:0/1067397821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f106ce9f0 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- 172.21.15.64:0/1067397821 >> 172.21.15.64:0/1067397821 conn(0x564f1018d5c0 msgr2=0x564f1068bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- 172.21.15.64:0/1067397821 shutdown_connections 2024-09-21T07:39:50.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- 172.21.15.64:0/1067397821 wait complete. 2024-09-21T07:39:50.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 -- start start 2024-09-21T07:39:50.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.229+0000 7f30879a7000 1 Processor -- start 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f1068aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f105626d0 0x564f106915f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564f104d3df0 con 0x564f101b9890 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564f104cffe0 con 0x564f105626d0 2024-09-21T07:39:50.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564f104754d0 con 0x564f1027daa0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 10 client.0 _ll_register_callbacks cb 0x564f104537f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35508/0 (socket says 172.21.15.64:35508) 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 -- 172.21.15.64:0/4108886706 learned_addr learned my addr 172.21.15.64:0/4108886706 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307d000640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f1068aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307e400640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f105626d0 0x564f106915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 -- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 msgr2=0x564f1068aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f1068aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 -- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f105626d0 msgr2=0x564f106915f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f105626d0 0x564f106915f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 -- 172.21.15.64:0/4108886706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1046e210 con 0x564f101b9890 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f307da00640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f306c00d6f0 tx=0x7f306c01f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543e459c37a091c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:50.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c022070 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f10468350 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f306c01fd00 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f306c038050 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 10 client.12033 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x564f10454fc0 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564f10468350 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f306c03b020 con 0x564f101b9890 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 10 client.12033 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 10 client.12033 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 20 client.12033 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10172930 0x564f106d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 4 client.12033 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.233+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f104e2b00 con 0x564f10172930 2024-09-21T07:39:50.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f307d000640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10172930 0x564f106d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f307d000640 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10172930 0x564f106d5e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d61d6e24f3fcdd4 server_cookie=cc2637379150be70 in_seq=0 out_seq=0 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f305ea00640 10 client.12033 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f305ea00640 1 -- 172.21.15.64:0/4108886706 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f104e2b00 con 0x564f10172930 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f305ea00640 10 client.12033 handle_command_reply: tid=0 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 client.12033 shutdown 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 msgr2=0x564f1068a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f306c00d6f0 tx=0x7f306c01f700 comp rx=0 tx=0).stop 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 shutdown_connections 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f105626d0 0x564f106915f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f1027daa0 0x564f1068aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10172930 0x564f106d5e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 --2- 172.21.15.64:0/4108886706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f101b9890 0x564f1068a9b0 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 >> 172.21.15.64:0/4108886706 conn(0x564f1018d5c0 msgr2=0x564f10683d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f305ea00640 0 client.12033 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 shutdown_connections 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 1 -- 172.21.15.64:0/4108886706 wait complete. 2024-09-21T07:39:50.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.237+0000 7f30879a7000 20 client.12033 trim_cache size 0 max 16384 2024-09-21T07:39:50.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 Processor -- start 2024-09-21T07:39:50.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- start start 2024-09-21T07:39:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 0x564f10740400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 0x564f10740940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564f10689b20 con 0x564f105626d0 2024-09-21T07:39:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3078205ee0 con 0x564f1027daa0 2024-09-21T07:39:50.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3078204ec0 con 0x564f101b9890 2024-09-21T07:39:50.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35524/0 (socket says 172.21.15.64:35524) 2024-09-21T07:39:50.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 -- 172.21.15.64:0/3147861623 learned_addr learned my addr 172.21.15.64:0/3147861623 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307da00640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 0x564f10740400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 -- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 msgr2=0x564f10740400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.259 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 0x564f10740400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 -- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 msgr2=0x564f10740940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307d000640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 0x564f10740940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 0x564f10740940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 -- 172.21.15.64:0/3147861623 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1052d680 con 0x564f105626d0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307da00640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 0x564f10740400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307d000640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 0x564f10740940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f307e400640 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f3070009f40 tx=0x7f30700128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c34056f65ecbb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f3069600640 1 -- 172.21.15.64:0/3147861623 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070003980 con 0x564f105626d0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f3069600640 1 -- 172.21.15.64:0/3147861623 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3070003b20 con 0x564f105626d0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f3069600640 1 -- 172.21.15.64:0/3147861623 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070004020 con 0x564f105626d0 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- 172.21.15.64:0/3147861623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 msgr2=0x564f10740e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f3070009f40 tx=0x7f30700128e0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- 172.21.15.64:0/3147861623 shutdown_connections 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f105626d0 0x564f10740e80 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f1027daa0 0x564f10740940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 --2- 172.21.15.64:0/3147861623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f101b9890 0x564f10740400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- 172.21.15.64:0/3147861623 >> 172.21.15.64:0/3147861623 conn(0x564f1018d5c0 msgr2=0x564f106e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- 172.21.15.64:0/3147861623 shutdown_connections 2024-09-21T07:39:50.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.257+0000 7f30879a7000 1 -- 172.21.15.64:0/3147861623 wait complete. 2024-09-21T07:39:50.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- start start 2024-09-21T07:39:50.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 Processor -- start 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f10744650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 0x564f107450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3078157680 con 0x564f1027daa0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30780c8ae0 con 0x564f101b9890 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x564f10195680 con 0x564f105626d0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 10 client.0 _ll_register_callbacks cb 0x7f306c00fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35536/0 (socket says 172.21.15.64:35536) 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 -- 172.21.15.64:0/3351441746 learned_addr learned my addr 172.21.15.64:0/3351441746 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307da00640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f10744650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307e400640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 0x564f107450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 -- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 msgr2=0x564f107450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.264 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 0x564f107450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 -- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 msgr2=0x564f10744650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f10744650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 -- 172.21.15.64:0/3351441746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1049a0b0 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307e400640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 0x564f107450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f307d000640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7f306401af70 tx=0x7f30640f4110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e62ab7b464f606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f305ea00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640f81b0 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f30640f4420 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3070003b20 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f30640fcc90 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 10 client.12039 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.261+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x564f10466610 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3070003b20 con 0x564f1027daa0 2024-09-21T07:39:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f3064005430 con 0x564f1027daa0 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 10 client.12039 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 10 client.12039 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 20 client.12039 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10160990 0x564f10685cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 4 client.12039 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:39:50.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f104de5b0 con 0x564f10160990 2024-09-21T07:39:50.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f307da00640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10160990 0x564f10685cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 10 client.12039 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:50.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f307da00640 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10160990 0x564f10685cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2187ef2e40d7d0e server_cookie=c0029401527ea0bb in_seq=0 out_seq=0 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 1 -- 172.21.15.64:0/3351441746 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x564f104de5b0 con 0x564f10160990 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 10 client.12039 handle_command_reply: tid=0 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 client.12039 shutdown 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 msgr2=0x564f10744b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7f306401af70 tx=0x7f30640f4110 comp rx=0 tx=0).stop 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 shutdown_connections 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x564f105626d0 0x564f107450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x564f10160990 0x564f10685cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564f1027daa0 0x564f10744b90 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 --2- 172.21.15.64:0/3351441746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564f101b9890 0x564f10744650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f305ea00640 0 client.12039 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 >> 172.21.15.64:0/3351441746 conn(0x564f1018d5c0 msgr2=0x564f106905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 shutdown_connections 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 1 -- 172.21.15.64:0/3351441746 wait complete. 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f30879a7000 20 client.12039 trim_cache size 0 max 16384 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "status": "no active scrubs running", 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "scrubs": {}, 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_stats": { 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "ac89eda7-26be-4718-b986-627051c88541": { 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:39:19.797903+0000", 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:50.269 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "4b2e2927-d354-4e8f-a048-46d03c6956e5": { 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "start_time": "2024-09-21T07:38:49.098316+0000", 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "path": "/", 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_started": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_passed": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_failed": 0, 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: "uninline_skipped": 0 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-21T07:39:50.270 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:39:50.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 msgr2=0x7f3058075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 0x7f3058075740 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f306c005fd0 tx=0x7f306c005d80 comp rx=0 tx=0).stop 2024-09-21T07:39:50.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 msgr2=0x7f30781f94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.271 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f30640b0040 tx=0x7f30640a5740 comp rx=0 tx=0).stop 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 shutdown_connections 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3058073230 0x7f3058075740 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30780ccd30 0x7f30780cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30780b3170 0x7f30781f94b0 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 --2- 172.21.15.64:0/873622591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30780b28e0 0x7f30781548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 >> 172.21.15.64:0/873622591 conn(0x7f307806d570 msgr2=0x7f3078158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 shutdown_connections 2024-09-21T07:39:50.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.265+0000 7f3080400640 1 -- 172.21.15.64:0/873622591 wait complete. 2024-09-21T07:39:50.285 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:39:50.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:39:50.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- 172.21.15.64:0/2066883932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 msgr2=0x7f11c0160d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2066883932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0160d60 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009840 tx=0x7f11a801c750 comp rx=0 tx=0).stop 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- 172.21.15.64:0/2066883932 shutdown_connections 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2066883932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0160d60 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2066883932 >> v2:172.21.15.90:3300/0 conn(0x7f11c00b7a50 0x7f11c00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- 172.21.15.64:0/2066883932 >> 172.21.15.64:0/2066883932 conn(0x7f11c00cef10 msgr2=0x7f11c00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- 172.21.15.64:0/2066883932 shutdown_connections 2024-09-21T07:39:50.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- 172.21.15.64:0/2066883932 wait complete. 2024-09-21T07:39:50.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 Processor -- start 2024-09-21T07:39:50.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.849+0000 7f11c4e00640 1 -- start start 2024-09-21T07:39:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11c00b7a50 0x7f11c006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 0x7f11c01f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00d1190 con 0x7f11c0160950 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00d1010 con 0x7f11c00b7a50 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f11c00b7e60 con 0x7f11c01612a0 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35568/0 (socket says 172.21.15.64:35568) 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 -- 172.21.15.64:0/2339382568 learned_addr learned my addr 172.21.15.64:0/2339382568 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11bde00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11c00b7a50 0x7f11c006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11be800640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 0x7f11c01f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 -- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 msgr2=0x7f11c01f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 0x7f11c01f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 -- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11c00b7a50 msgr2=0x7f11c006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11c00b7a50 0x7f11c006fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 -- 172.21.15.64:0/2339382568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c01fd550 con 0x7f11c0160950 2024-09-21T07:39:50.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11be800640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 0x7f11c01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b7e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f11a80b0040 tx=0x7f11a8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80b2040 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a8004040 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c01fc790 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004470 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01fcd50 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.853+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c015eee0 con 0x7f11c0160950 2024-09-21T07:39:50.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.857+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f11a80bd030 con 0x7f11c0160950 2024-09-21T07:39:50.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.857+0000 7f11b6000640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 0x7f119c075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:50.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.857+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f11a812df10 con 0x7f11c0160950 2024-09-21T07:39:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.857+0000 7f11bde00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 0x7f119c075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.857+0000 7f11bde00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 0x7f119c075770 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f11b0005fd0 tx=0x7f11b0005f40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:50.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:50.861+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f11a80c4060 con 0x7f11c0160950 2024-09-21T07:39:51.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.073+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c01f9dc0 con 0x7f11c0160950 2024-09-21T07:39:51.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.073+0000 7f11b6000640 1 -- 172.21.15.64:0/2339382568 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7f11a80163d0 con 0x7f11c0160950 2024-09-21T07:39:51.074 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:51.074 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:39:51.074 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 msgr2=0x7f119c075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 0x7f119c075770 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f11b0005fd0 tx=0x7f11b0005f40 comp rx=0 tx=0).stop 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 msgr2=0x7f11c0146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f11a80b0040 tx=0x7f11a8005d40 comp rx=0 tx=0).stop 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 shutdown_connections 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f119c073260 0x7f119c075770 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11c01612a0 0x7f11c01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11c0160950 0x7f11c0146380 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 --2- 172.21.15.64:0/2339382568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11c00b7a50 0x7f11c006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 >> 172.21.15.64:0/2339382568 conn(0x7f11c00cef10 msgr2=0x7f11c00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 shutdown_connections 2024-09-21T07:39:51.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.077+0000 7f11c4e00640 1 -- 172.21.15.64:0/2339382568 wait complete. 2024-09-21T07:39:51.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 176, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:38:27.281818+0000', 'modified': '2024-09-21T07:38:47.175871+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 230, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11670': {'gid': 11670, 'name': 'c', 'rank': 0, 'incarnation': 173, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.64:6834/2784366860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6832', 'nonce': 2784366860}, {'type': 'v1', 'addr': '172.21.15.64:6834', 'nonce': 2784366860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11670, 'qdb_cluster': [11670]} 2024-09-21T07:39:51.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:39:51.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T07:39:51.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- 172.21.15.64:0/361320007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc06fae0 msgr2=0x7f0ddc0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 --2- 172.21.15.64:0/361320007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0af790 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0725c0 tx=0x7f0dcc01c800 comp rx=0 tx=0).stop 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- 172.21.15.64:0/361320007 shutdown_connections 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 --2- 172.21.15.64:0/361320007 >> v2:172.21.15.90:3300/0 conn(0x7f0ddc0b46f0 0x7f0ddc0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 --2- 172.21.15.64:0/361320007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0af790 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- 172.21.15.64:0/361320007 >> 172.21.15.64:0/361320007 conn(0x7f0ddc06d570 msgr2=0x7f0ddc0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- 172.21.15.64:0/361320007 shutdown_connections 2024-09-21T07:39:51.272 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- 172.21.15.64:0/361320007 wait complete. 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 Processor -- start 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.257+0000 7f0de2a00640 1 -- start start 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ddc0b3170 0x7f0ddc1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc169390 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc169210 con 0x7f0ddc06fae0 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0ddc169510 con 0x7f0ddc0b3170 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35596/0 (socket says 172.21.15.64:35596) 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 -- 172.21.15.64:0/616970902 learned_addr learned my addr 172.21.15.64:0/616970902 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.280 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ddc0b3170 0x7f0ddc1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 -- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ddc0b3170 msgr2=0x7f0ddc1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ddc0b3170 0x7f0ddc1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 -- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ddc06fae0 msgr2=0x7f0ddc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 -- 172.21.15.64:0/616970902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc15ef70 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de0a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c790 tx=0x7f0dd400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0dd8c00640 1 -- 172.21.15.64:0/616970902 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4003db0 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0dd8c00640 1 -- 172.21.15.64:0/616970902 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dd400ce40 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0dd8c00640 1 -- 172.21.15.64:0/616970902 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40052d0 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc15ec90 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.261+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc0ca0d0 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0dd8c00640 1 -- 172.21.15.64:0/616970902 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0dd4005470 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0dd8c00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 0x7f0db8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0dd8c00640 1 -- 172.21.15.64:0/616970902 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f0dd40940a0 con 0x7f0ddc0b46f0 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0de9fcb000 1 Processor -- start 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0de9fcb000 1 -- start start 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 0x7f0db8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.265+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 0x7f0db8075740 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0af000 tx=0x7f0dcc01b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa9416dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa9416e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55aa94042410 con 0x55aa93c2c460 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa93f7fb40 con 0x55aa94005ca0 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55aa93f6ef70 con 0x55aa9401c950 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35608/0 (socket says 172.21.15.64:35608) 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2205437422 learned_addr learned my addr 172.21.15.64:0/2205437422 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa9416dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa9416e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 msgr2=0x55aa9416dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa9416dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 msgr2=0x55aa9416e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa9416e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2205437422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa93f365b0 con 0x55aa93c2c460 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc019410 tx=0x7f0dcc0b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22d93bd13c9d3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0dcbe00640 1 -- 172.21.15.64:0/2205437422 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b2040 con 0x55aa93c2c460 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0dcbe00640 1 -- 172.21.15.64:0/2205437422 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dcc0c6070 con 0x55aa93c2c460 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0dcbe00640 1 -- 172.21.15.64:0/2205437422 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc005040 con 0x55aa93c2c460 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2205437422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 msgr2=0x55aa9416d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc019410 tx=0x7f0dcc0b6000 comp rx=0 tx=0).stop 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2205437422 shutdown_connections 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa9416e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa9416dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2205437422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa9416d6a0 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2205437422 >> 172.21.15.64:0/2205437422 conn(0x55aa940f2d90 msgr2=0x55aa94122690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2205437422 shutdown_connections 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2205437422 wait complete. 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 -- start start 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.269+0000 7f0de9fcb000 1 Processor -- start 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa94174920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa94174e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55aa93f095f0 con 0x55aa9401c950 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa93f72d80 con 0x55aa94005ca0 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55aa93f15520 con 0x55aa93c2c460 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 10 client.0 _ll_register_callbacks cb 0x55aa93f19830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35614/0 (socket says 172.21.15.64:35614) 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 -- 172.21.15.64:0/2786706928 learned_addr learned my addr 172.21.15.64:0/2786706928 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa94174e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa94174920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 -- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 msgr2=0x55aa94174920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa94174920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 -- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 msgr2=0x55aa94174e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa94174e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 -- 172.21.15.64:0/2786706928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa93f0d190 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa94174e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c760 tx=0x7f0dd405e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251f9520e4716645 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4078070 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f0dd405da90 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa93f07110 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0dd4063260 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 10 client.12063 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55aa93ff3f10 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55aa93f07110 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0dd405a180 con 0x55aa9401c950 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 10 client.12063 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:51.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 10 client.12063 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 20 client.12063 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93c117d0 0x55aa9417ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 4 client.12063 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa93f81a90 con 0x55aa93c117d0 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.273+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93c117d0 0x55aa9417ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93c117d0 0x55aa9417ed00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6665f393c550d79 server_cookie=5f02f7117b4ac79d in_seq=0 out_seq=0 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0dc8c00640 10 client.12063 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0dc8c00640 1 -- 172.21.15.64:0/2786706928 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa93f81a90 con 0x55aa93c117d0 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0dc8c00640 10 client.12063 handle_command_reply: tid=0 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 client.12063 shutdown 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 msgr2=0x55aa941753a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c760 tx=0x7f0dd405e400 comp rx=0 tx=0).stop 2024-09-21T07:39:51.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 shutdown_connections 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93c117d0 0x55aa9417ed00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa9401c950 0x55aa941753a0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa94174e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2786706928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa94174920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0dc8c00640 0 client.12063 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 >> 172.21.15.64:0/2786706928 conn(0x55aa940f2d90 msgr2=0x55aa94129440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 shutdown_connections 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2786706928 wait complete. 2024-09-21T07:39:51.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.277+0000 7f0de9fcb000 20 client.12063 trim_cache size 0 max 16384 2024-09-21T07:39:51.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 Processor -- start 2024-09-21T07:39:51.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 -- start start 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa941dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa941e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc2062b0 con 0x55aa93c2c460 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc205290 con 0x55aa94005ca0 2024-09-21T07:39:51.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f0ddc1fd2e0 con 0x55aa9401c950 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35626/0 (socket says 172.21.15.64:35626) 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2112344293 learned_addr learned my addr 172.21.15.64:0/2112344293 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa941e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa941dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 msgr2=0x55aa941e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa941e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 msgr2=0x55aa941dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa941dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 -- 172.21.15.64:0/2112344293 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa93fcadb0 con 0x55aa93c2c460 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de0a00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa941e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:51.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc01c840 tx=0x7f0dcc0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfa392da1976fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0dcb400640 1 -- 172.21.15.64:0/2112344293 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b2040 con 0x55aa93c2c460 2024-09-21T07:39:51.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0dcb400640 1 -- 172.21.15.64:0/2112344293 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dcc0c6040 con 0x55aa93c2c460 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0dcb400640 1 -- 172.21.15.64:0/2112344293 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0046d0 con 0x55aa93c2c460 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2112344293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 msgr2=0x55aa941df840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.297+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc01c840 tx=0x7f0dcc0091e0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2112344293 shutdown_connections 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa9401c950 0x55aa941e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa94005ca0 0x55aa941dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/2112344293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa93c2c460 0x55aa941df840 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2112344293 >> 172.21.15.64:0/2112344293 conn(0x55aa940f2d90 msgr2=0x55aa94121cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2112344293 shutdown_connections 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- 172.21.15.64:0/2112344293 wait complete. 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- start start 2024-09-21T07:39:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 Processor -- start 2024-09-21T07:39:51.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa941e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa9401c950 0x55aa941e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55aa93f773b0 con 0x55aa94005ca0 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa93ff3a80 con 0x55aa9401c950 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x55aa9402e750 con 0x55aa93c2c460 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de9fcb000 10 client.0 _ll_register_callbacks cb 0x7f0dd405a750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35636/0 (socket says 172.21.15.64:35636) 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 -- 172.21.15.64:0/3886660680 learned_addr learned my addr 172.21.15.64:0/3886660680 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa941e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0de0a00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa9401c950 0x55aa941e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 -- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 msgr2=0x55aa941e37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa941e37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 -- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa9401c950 msgr2=0x55aa941e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa9401c950 0x55aa941e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 -- 172.21.15.64:0/3886660680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa93f35ab0 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dd3e00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40114e0 tx=0x7f0dc40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56514e898eb26f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.301+0000 7f0dc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4004220 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f0dc40043c0 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dcc0c6040 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f0dc4026050 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 10 client.12069 fetch_fsmap learned FSMap version 176 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=2+}) -- 0x55aa93f14070 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dcc0c6040 con 0x55aa94005ca0 2024-09-21T07:39:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 176) ==== 3502+0+0 (secure 0 0 0) 0x7f0dc4029020 con 0x55aa94005ca0 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 10 client.12069 fetch_fsmap finished waiting for FSMap version 176 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 10 client.12069 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 20 client.12069 populate_metadata read hostname 'smithi064' 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93bff830 0x55aa9419f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 4 client.12069 mds_command: new command op to 11670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 --> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] -- command(tid 0: {"prefix": "status"}) -- 0x55aa93f7d540 con 0x55aa93bff830 2024-09-21T07:39:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93bff830 0x55aa9419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0ddbe00640 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93bff830 0x55aa9419f290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e365815bac8cf256 server_cookie=fe3f995909def74e in_seq=0 out_seq=0 2024-09-21T07:39:51.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 10 client.12069 ms_handle_connect on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:51.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 1 -- 172.21.15.64:0/3886660680 <== mds.0 v2:172.21.15.64:6832/2784366860 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55aa93f7d540 con 0x55aa93bff830 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 10 client.12069 handle_command_reply: tid=0 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 client.12069 shutdown 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 msgr2=0x55aa941e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40114e0 tx=0x7f0dc40119a0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 shutdown_connections 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa9401c950 0x55aa941e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:6832/2784366860,v1:172.21.15.64:6834/2784366860] conn(0x55aa93bff830 0x55aa9419f290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55aa94005ca0 0x55aa941e3d30 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 --2- 172.21.15.64:0/3886660680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55aa93c2c460 0x55aa941e37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0dc8c00640 0 client.12069 ms_handle_reset on v2:172.21.15.64:6832/2784366860 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 >> 172.21.15.64:0/3886660680 conn(0x55aa940f2d90 msgr2=0x55aa94122690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 shutdown_connections 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 1 -- 172.21.15.64:0/3886660680 wait complete. 2024-09-21T07:39:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de9fcb000 20 client.12069 trim_cache size 0 max 16384 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "be0ccda5-3d1a-4615-9c09-c8d9d4461231", 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 11670, 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 67.144266907000002, 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 176, 2024-09-21T07:39:51.309 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 232, 2024-09-21T07:39:51.310 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 230, 2024-09-21T07:39:51.310 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 87.828967117000005 2024-09-21T07:39:51.310 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:39:51.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 msgr2=0x7f0db8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 0x7f0db8075740 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0af000 tx=0x7f0dcc01b040 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 msgr2=0x7f0ddc15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c790 tx=0x7f0dd400cc50 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 shutdown_connections 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f0db8073230 0x7f0db8075740 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ddc0b46f0 0x7f0ddc15bfc0 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ddc0b3170 0x7f0ddc1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 --2- 172.21.15.64:0/616970902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ddc06fae0 0x7f0ddc0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 >> 172.21.15.64:0/616970902 conn(0x7f0ddc06d570 msgr2=0x7f0ddc074820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 shutdown_connections 2024-09-21T07:39:51.311 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.305+0000 7f0de2a00640 1 -- 172.21.15.64:0/616970902 wait complete. 2024-09-21T07:39:51.326 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:39:51.326 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:39:51.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:39:51.513 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:39:51.513 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:39:51.513 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:39:51.513 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:51.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:39:51.523 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:39:51.523 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:39:51.523 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:51.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:39:51.532 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:39:51.532 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:39:51.532 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:51.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:39:51.576 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:39:51.577 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:39:51.577 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:51.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:39:51.587 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:39:51.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 -- 172.21.15.64:0/4020338267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c0748c0 msgr2=0x7ff57c0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 --2- 172.21.15.64:0/4020338267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c0748c0 0x7ff57c0cc990 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7ff57400acd0 tx=0x7ff57401def0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 -- 172.21.15.64:0/4020338267 shutdown_connections 2024-09-21T07:39:51.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 --2- 172.21.15.64:0/4020338267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c0748c0 0x7ff57c0cc990 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.778 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 -- 172.21.15.64:0/4020338267 >> 172.21.15.64:0/4020338267 conn(0x7ff57c06d570 msgr2=0x7ff57c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:51.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 -- 172.21.15.64:0/4020338267 shutdown_connections 2024-09-21T07:39:51.779 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.777+0000 7ff582200640 1 -- 172.21.15.64:0/4020338267 wait complete. 2024-09-21T07:39:51.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 Processor -- start 2024-09-21T07:39:51.780 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- start start 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c0748c0 0x7ff57c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 0x7ff57c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c1692f0 con 0x7ff57c06f0d0 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c169170 con 0x7ff57c0748c0 2024-09-21T07:39:51.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c169470 con 0x7ff57c0cf620 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35652/0 (socket says 172.21.15.64:35652) 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 -- 172.21.15.64:0/4257611531 learned_addr learned my addr 172.21.15.64:0/4257611531 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff572a00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c0748c0 0x7ff57c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57be00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 0x7ff57c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 -- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 msgr2=0x7ff57c0c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 0x7ff57c0c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 -- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c0748c0 msgr2=0x7ff57c0c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c0748c0 0x7ff57c0c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 -- 172.21.15.64:0/4257611531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c165e00 con 0x7ff57c06f0d0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57be00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 0x7ff57c0c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff57b400640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c3c0 tx=0x7ff56c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c017070 con 0x7ff57c06f0d0 2024-09-21T07:39:51.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff56c0053c0 con 0x7ff57c06f0d0 2024-09-21T07:39:51.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c1665a0 con 0x7ff57c06f0d0 2024-09-21T07:39:51.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c003860 con 0x7ff57c06f0d0 2024-09-21T07:39:51.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.781+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c0cc440 con 0x7ff57c06f0d0 2024-09-21T07:39:51.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c0cc990 con 0x7ff57c06f0d0 2024-09-21T07:39:51.785 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff56c01a070 con 0x7ff57c06f0d0 2024-09-21T07:39:51.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff573e00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 0x7ff558075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:51.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7ff56c093860 con 0x7ff57c06f0d0 2024-09-21T07:39:51.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff572a00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 0x7ff558075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:51.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.785+0000 7ff572a00640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 0x7ff558075710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff57c075030 tx=0x7ff564009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:51.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:51.789+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7ff56c05e5a0 con 0x7ff57c06f0d0 2024-09-21T07:39:52.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff57c159320 con 0x7ff57c06f0d0 2024-09-21T07:39:52.005 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff573e00640 1 -- 172.21.15.64:0/4257611531 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7ff56c05dea0 con 0x7ff57c06f0d0 2024-09-21T07:39:52.005 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:52.005 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:39:52.005 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:39:52.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 msgr2=0x7ff558075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 0x7ff558075710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff57c075030 tx=0x7ff564009040 comp rx=0 tx=0).stop 2024-09-21T07:39:52.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 msgr2=0x7ff57c099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c3c0 tx=0x7ff56c00c880 comp rx=0 tx=0).stop 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 shutdown_connections 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff558073200 0x7ff558075710 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0cf620 0x7ff57c0c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c0748c0 0x7ff57c0c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 --2- 172.21.15.64:0/4257611531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57c06f0d0 0x7ff57c099ab0 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 >> 172.21.15.64:0/4257611531 conn(0x7ff57c06d570 msgr2=0x7ff57c0c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 shutdown_connections 2024-09-21T07:39:52.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.005+0000 7ff582200640 1 -- 172.21.15.64:0/4257611531 wait complete. 2024-09-21T07:39:52.028 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:39:52.190 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 -- 172.21.15.64:0/709876485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d44003a10 msgr2=0x7f9d44003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 --2- 172.21.15.64:0/709876485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d44003a10 0x7f9d44003e80 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000c310 tx=0x7f9d5001cfc0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d5e800640 1 -- 172.21.15.64:0/709876485 reap_dead start 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 -- 172.21.15.64:0/709876485 shutdown_connections 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 -- 172.21.15.64:0/709876485 >> 172.21.15.64:0/709876485 conn(0x7f9d600d1430 msgr2=0x7f9d600d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 -- 172.21.15.64:0/709876485 shutdown_connections 2024-09-21T07:39:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.189+0000 7f9d64c00640 1 -- 172.21.15.64:0/709876485 wait complete. 2024-09-21T07:39:52.192 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 Processor -- start 2024-09-21T07:39:52.193 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 -- start start 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 0x7f9d60152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 0x7f9d600caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60167960 con 0x7f9d600c6920 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601677e0 con 0x7f9d600c6d30 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d64c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9d60167ae0 con 0x7f9d44003a10 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35664/0 (socket says 172.21.15.64:35664) 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 -- 172.21.15.64:0/2758537123 learned_addr learned my addr 172.21.15.64:0/2758537123 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5de00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 0x7f9d60152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5e800640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 0x7f9d600caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 -- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 msgr2=0x7f9d60152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 0x7f9d60152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 -- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 msgr2=0x7f9d600caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 0x7f9d600caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5d400640 1 -- 172.21.15.64:0/2758537123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601f6440 con 0x7f9d600c6920 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5de00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 0x7f9d60152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.193+0000 7f9d5e800640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 0x7f9d600caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d5d400640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c011b30 tx=0x7f9d4c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c01e070 con 0x7f9d600c6920 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c00fd40 con 0x7f9d600c6920 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c019650 con 0x7f9d600c6920 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d60152e50 con 0x7f9d600c6920 2024-09-21T07:39:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601f6990 con 0x7f9d600c6920 2024-09-21T07:39:52.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d600cd150 con 0x7f9d600c6920 2024-09-21T07:39:52.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d4c021070 con 0x7f9d600c6920 2024-09-21T07:39:52.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 0x7f9d40075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.197+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f9d4c094e50 con 0x7f9d600c6920 2024-09-21T07:39:52.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.201+0000 7f9d5de00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 0x7f9d40075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.201+0000 7f9d5de00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 0x7f9d40075740 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ac000 tx=0x7f9d50019e00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.205+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9d60152e50 con 0x7f9d600c6920 2024-09-21T07:39:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d600b11c0 con 0x7f9d600c6920 2024-09-21T07:39:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d56000640 1 -- 172.21.15.64:0/2758537123 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7f9d4c05f5c0 con 0x7f9d600c6920 2024-09-21T07:39:52.416 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:52.416 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:39:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:39:52.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 msgr2=0x7f9d40075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 0x7f9d40075740 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ac000 tx=0x7f9d50019e00 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 msgr2=0x7f9d600caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c011b30 tx=0x7f9d4c00f3c0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 shutdown_connections 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9d40073230 0x7f9d40075740 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d600c6d30 0x7f9d600caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d600c6920 0x7f9d600caa20 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 --2- 172.21.15.64:0/2758537123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d44003a10 0x7f9d60152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 >> 172.21.15.64:0/2758537123 conn(0x7f9d600d1430 msgr2=0x7f9d600d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 shutdown_connections 2024-09-21T07:39:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.417+0000 7f9d64c00640 1 -- 172.21.15.64:0/2758537123 wait complete. 2024-09-21T07:39:52.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 -- 172.21.15.64:0/2654838140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb38406fae0 msgr2=0x7fb3840af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 --2- 172.21.15.64:0/2654838140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb38406fae0 0x7fb3840af790 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7fb3840725c0 tx=0x7fb37401cd80 comp rx=0 tx=0).stop 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 -- 172.21.15.64:0/2654838140 shutdown_connections 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 --2- 172.21.15.64:0/2654838140 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb3840b3170 0x7fb3840b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 --2- 172.21.15.64:0/2654838140 >> v2:172.21.15.90:3300/0 conn(0x7fb3840b46f0 0x7fb3840b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 --2- 172.21.15.64:0/2654838140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb38406fae0 0x7fb3840af790 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 -- 172.21.15.64:0/2654838140 >> 172.21.15.64:0/2654838140 conn(0x7fb38406d570 msgr2=0x7fb3840b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 -- 172.21.15.64:0/2654838140 shutdown_connections 2024-09-21T07:39:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.597+0000 7fb388a00640 1 -- 172.21.15.64:0/2654838140 wait complete. 2024-09-21T07:39:52.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 Processor -- start 2024-09-21T07:39:52.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- start start 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb38406fae0 0x7fb38415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3840b3170 0x7fb38415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840cdae0 con 0x7fb3840b46f0 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840cd960 con 0x7fb3840b3170 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb3840caf00 con 0x7fb38406fae0 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35688/0 (socket says 172.21.15.64:35688) 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 -- 172.21.15.64:0/2422235802 learned_addr learned my addr 172.21.15.64:0/2422235802 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb381e00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb38406fae0 0x7fb38415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb379400640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3840b3170 0x7fb38415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 -- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb38406fae0 msgr2=0x7fb38415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb38406fae0 0x7fb38415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 -- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3840b3170 msgr2=0x7fb38415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3840b3170 0x7fb38415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 -- 172.21.15.64:0/2422235802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb384098a90 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb382800640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00d610 tx=0x7fb37c00dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c005220 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb37c0054d0 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb384098d00 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c004a10 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.601+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3840992c0 con 0x7fb3840b46f0 2024-09-21T07:39:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.605+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3840b3580 con 0x7fb3840b46f0 2024-09-21T07:39:52.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.605+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb37c004bb0 con 0x7fb3840b46f0 2024-09-21T07:39:52.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.605+0000 7fb37aa00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 0x7fb360075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.605+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7fb37c094910 con 0x7fb3840b46f0 2024-09-21T07:39:52.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.605+0000 7fb381e00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 0x7fb360075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.609+0000 7fb381e00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 0x7fb360075740 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fb3740af000 tx=0x7fb37401b5c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.609+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb37c05f110 con 0x7fb3840b46f0 2024-09-21T07:39:52.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.789+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb384155cb0 con 0x7fb3840b46f0 2024-09-21T07:39:52.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.789+0000 7fb37aa00640 1 -- 172.21.15.64:0/2422235802 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v232) ==== 74+0+17170 (secure 0 0 0) 0x7fb37c063b40 con 0x7fb3840b46f0 2024-09-21T07:39:52.791 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:52.791 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":232,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:39:32.138237+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:38:25.032965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-21T07:38:26.246990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"229","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.1","mappings":[{"from":0,"to":1}]},{"pgid":"34.18","mappings":[{"from":0,"to":2}]},{"pgid":"34.1a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/3686989750":"2024-09-22T07:38:42.143425+0000","172.21.15.64:6833/3686989750":"2024-09-22T07:38:42.143425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:39:52.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 msgr2=0x7fb360075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 0x7fb360075740 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fb3740af000 tx=0x7fb37401b5c0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 msgr2=0x7fb38415b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00d610 tx=0x7fb37c00dad0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 shutdown_connections 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb360073230 0x7fb360075740 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3840b46f0 0x7fb38415b580 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3840b3170 0x7fb38415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 --2- 172.21.15.64:0/2422235802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb38406fae0 0x7fb38415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 >> 172.21.15.64:0/2422235802 conn(0x7fb38406d570 msgr2=0x7fb3840cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 shutdown_connections 2024-09-21T07:39:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.793+0000 7fb388a00640 1 -- 172.21.15.64:0/2422235802 wait complete. 2024-09-21T07:39:52.814 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:39:52.814 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:39:52.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- 172.21.15.64:0/3537231441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 msgr2=0x7feb000af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 --2- 172.21.15.64:0/3537231441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb000af790 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009900 tx=0x7feaf001c8a0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- 172.21.15.64:0/3537231441 shutdown_connections 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 --2- 172.21.15.64:0/3537231441 >> v2:172.21.15.90:3300/0 conn(0x7feb000b3170 0x7feb000b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 --2- 172.21.15.64:0/3537231441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b46f0 0x7feb000b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 --2- 172.21.15.64:0/3537231441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb000af790 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- 172.21.15.64:0/3537231441 >> 172.21.15.64:0/3537231441 conn(0x7feb0006d570 msgr2=0x7feb000b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- 172.21.15.64:0/3537231441 shutdown_connections 2024-09-21T07:39:52.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- 172.21.15.64:0/3537231441 wait complete. 2024-09-21T07:39:52.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 Processor -- start 2024-09-21T07:39:52.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.973+0000 7feb07800640 1 -- start start 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b3170 0x7feb000c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 0x7feb000c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb000cda50 con 0x7feb0006fae0 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb000cd8d0 con 0x7feb000b46f0 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7feb000cdbd0 con 0x7feb000b3170 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35696/0 (socket says 172.21.15.64:35696) 2024-09-21T07:39:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 -- 172.21.15.64:0/967001406 learned_addr learned my addr 172.21.15.64:0/967001406 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:52.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feaf7e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b3170 0x7feb000c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb05800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 0x7feb000c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 -- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b3170 msgr2=0x7feb000c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b3170 0x7feb000c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 -- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 msgr2=0x7feb000c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 0x7feb000c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 -- 172.21.15.64:0/967001406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb001f7570 con 0x7feb0006fae0 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb05800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 0x7feb000c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb04e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009850 tx=0x7feaf0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00b2040 con 0x7feb0006fae0 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaf0004330 con 0x7feb0006fae0 2024-09-21T07:39:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0005280 con 0x7feb0006fae0 2024-09-21T07:39:52.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb001f7850 con 0x7feb0006fae0 2024-09-21T07:39:52.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb000c5480 con 0x7feb0006fae0 2024-09-21T07:39:52.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.977+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb000c5270 con 0x7feb0006fae0 2024-09-21T07:39:52.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.981+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feaf0005420 con 0x7feb0006fae0 2024-09-21T07:39:52.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.981+0000 7feafd600640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 0x7feadc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:52.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.981+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7feaf00bd070 con 0x7feb0006fae0 2024-09-21T07:39:52.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.981+0000 7feaf7e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 0x7feadc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:52.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.981+0000 7feaf7e00640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 0x7feadc075740 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7feb000cc700 tx=0x7feae800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:52.985+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7feaf0016490 con 0x7feb0006fae0 2024-09-21T07:39:53.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.197+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb000b3580 con 0x7feb0006fae0 2024-09-21T07:39:53.200 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feafd600640 1 -- 172.21.15.64:0/967001406 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7feaf00f8fd0 con 0x7feb0006fae0 2024-09-21T07:39:53.200 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:53.200 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:39:53.200 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 msgr2=0x7feadc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 0x7feadc075740 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7feb000cc700 tx=0x7feae800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 msgr2=0x7feb0015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009850 tx=0x7feaf0005e70 comp rx=0 tx=0).stop 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 shutdown_connections 2024-09-21T07:39:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7feadc073230 0x7feadc075740 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb000b46f0 0x7feb000c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb000b3170 0x7feb000c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 --2- 172.21.15.64:0/967001406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb0006fae0 0x7feb0015b520 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 >> 172.21.15.64:0/967001406 conn(0x7feb0006d570 msgr2=0x7feb00074a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 shutdown_connections 2024-09-21T07:39:53.203 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.201+0000 7feb07800640 1 -- 172.21.15.64:0/967001406 wait complete. 2024-09-21T07:39:53.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:39:53.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- 172.21.15.64:0/3914143663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb80b46f0 msgr2=0x7f9fb80b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3914143663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb80b46f0 0x7f9fb80b4b00 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80712c0 tx=0x7f9fa001c8c0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- 172.21.15.64:0/3914143663 shutdown_connections 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3914143663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb80b46f0 0x7f9fb80b4b00 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3914143663 >> v2:172.21.15.90:3300/0 conn(0x7f9fb806fae0 0x7f9fb80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- 172.21.15.64:0/3914143663 >> 172.21.15.64:0/3914143663 conn(0x7f9fb806d570 msgr2=0x7f9fb80b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- 172.21.15.64:0/3914143663 shutdown_connections 2024-09-21T07:39:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- 172.21.15.64:0/3914143663 wait complete. 2024-09-21T07:39:53.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 Processor -- start 2024-09-21T07:39:53.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.381+0000 7f9fbd600640 1 -- start start 2024-09-21T07:39:53.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb80b3170 0x7f9fb8165c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 0x7f9fb81542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8169390 con 0x7f9fb806fae0 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8169210 con 0x7f9fb80b3170 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb8169510 con 0x7f9fb80b46f0 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35718/0 (socket says 172.21.15.64:35718) 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 -- 172.21.15.64:0/3385167109 learned_addr learned my addr 172.21.15.64:0/3385167109 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fafe00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb80b3170 0x7f9fb8165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb7400640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 0x7f9fb81542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 -- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 msgr2=0x7f9fb81542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 0x7f9fb81542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 -- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb80b3170 msgr2=0x7f9fb8165c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb80b3170 0x7f9fb8165c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 -- 172.21.15.64:0/3385167109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80aec20 con 0x7f9fb806fae0 2024-09-21T07:39:53.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb7400640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 0x7f9fb81542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:53.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fb6a00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b440 tx=0x7f9fa800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8015020 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fa80119a0 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8011df0 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb80adb80 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb80ae140 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.385+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb80af790 con 0x7f9fb806fae0 2024-09-21T07:39:53.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.389+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9fa8018020 con 0x7f9fb806fae0 2024-09-21T07:39:53.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.389+0000 7f9faea00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 0x7f9f94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.388 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.389+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f9fa80945a0 con 0x7f9fb806fae0 2024-09-21T07:39:53.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.389+0000 7f9fafe00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 0x7f9f94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.389+0000 7f9fafe00640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 0x7f9f94075710 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00af000 tx=0x7f9fa001b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:53.393 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.393+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f9fa801f020 con 0x7f9fb806fae0 2024-09-21T07:39:53.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.601+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb815a010 con 0x7f9fb806fae0 2024-09-21T07:39:53.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.601+0000 7f9faea00640 1 -- 172.21.15.64:0/3385167109 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) ==== 95+0+5238 (secure 0 0 0) 0x7f9fa800d040 con 0x7f9fb806fae0 2024-09-21T07:39:53.604 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:53.604 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":176,"btime":"2024-09-21T07:38:47:175880+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:38:27.281818+0000","modified":"2024-09-21T07:38:47.175871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":230,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11670":{"gid":11670,"name":"c","rank":0,"incarnation":173,"state":"up:active","state_seq":9,"addr":"172.21.15.64:6834/2784366860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2784366860},{"type":"v1","addr":"172.21.15.64:6834","nonce":2784366860}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11670,"qdb_cluster":[11670]},"id":16}]} 2024-09-21T07:39:53.604 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 176 2024-09-21T07:39:53.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 msgr2=0x7f9f94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 0x7f9f94075710 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00af000 tx=0x7f9fa001b100 comp rx=0 tx=0).stop 2024-09-21T07:39:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 msgr2=0x7f9fb80ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b440 tx=0x7f9fa800b900 comp rx=0 tx=0).stop 2024-09-21T07:39:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 shutdown_connections 2024-09-21T07:39:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f9f94073200 0x7f9f94075710 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fb80b46f0 0x7f9fb81542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb80b3170 0x7f9fb8165c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 --2- 172.21.15.64:0/3385167109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9fb806fae0 0x7f9fb80ad150 unknown :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 >> 172.21.15.64:0/3385167109 conn(0x7f9fb806d570 msgr2=0x7f9fb80c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 shutdown_connections 2024-09-21T07:39:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.605+0000 7f9fbd600640 1 -- 172.21.15.64:0/3385167109 wait complete. 2024-09-21T07:39:53.625 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- 172.21.15.64:0/432843628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b26b0 msgr2=0x7f0630167c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- 172.21.15.64:0/432843628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b26b0 0x7f0630167c10 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f0628009c80 tx=0x7f062801ccd0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- 172.21.15.64:0/432843628 shutdown_connections 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- 172.21.15.64:0/432843628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b26b0 0x7f0630167c10 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- 172.21.15.64:0/432843628 >> v2:172.21.15.90:3300/0 conn(0x7f06300b1d60 0x7f06300b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- 172.21.15.64:0/432843628 >> 172.21.15.64:0/432843628 conn(0x7f06300cef10 msgr2=0x7f06300cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- 172.21.15.64:0/432843628 shutdown_connections 2024-09-21T07:39:53.784 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- 172.21.15.64:0/432843628 wait complete. 2024-09-21T07:39:53.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 Processor -- start 2024-09-21T07:39:53.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- start start 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06300b26b0 0x7f06300b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06300b7a50 0x7f06301553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f06300b2c40 con 0x7f06300b1d60 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06300b2ac0 con 0x7f06300b7a50 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.785+0000 7f0637000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f06300b7e60 con 0x7f06300b26b0 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35740/0 (socket says 172.21.15.64:35740) 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 -- 172.21.15.64:0/3041980589 learned_addr learned my addr 172.21.15.64:0/3041980589 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f0635000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06300b7a50 0x7f06301553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f0627400640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06300b26b0 0x7f06300b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 -- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06300b26b0 msgr2=0x7f06300b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06300b26b0 0x7f06300b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 -- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06300b7a50 msgr2=0x7f06301553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06300b7a50 0x7f06301553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 -- 172.21.15.64:0/3041980589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06300af180 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062fe00640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f062000c3a0 tx=0x7f062000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620017070 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06200053c0 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06301fca10 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06200038b0 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06301fcfd0 con 0x7f06300b1d60 2024-09-21T07:39:53.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06301fd690 con 0x7f06300b1d60 2024-09-21T07:39:53.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.789+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f062001a070 con 0x7f06300b1d60 2024-09-21T07:39:53.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.793+0000 7f062cc00640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 0x7f060c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:53.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.793+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7f06200937f0 con 0x7f06300b1d60 2024-09-21T07:39:53.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.793+0000 7f0627400640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 0x7f060c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:53.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.793+0000 7f0627400640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 0x7f060c075710 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f063006a990 tx=0x7f061800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:53.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.797+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f06301fd690 con 0x7f06300b1d60 2024-09-21T07:39:53.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.973+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06300b1710 con 0x7f06300b1d60 2024-09-21T07:39:53.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.973+0000 7f062cc00640 1 -- 172.21.15.64:0/3041980589 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v232) ==== 74+0+17170 (secure 0 0 0) 0x7f062005df70 con 0x7f06300b1d60 2024-09-21T07:39:53.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:39:53.975 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":232,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:39:32.138237+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:38:25.032965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"228","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-21T07:38:26.246990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"229","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.1","mappings":[{"from":0,"to":1}]},{"pgid":"34.18","mappings":[{"from":0,"to":2}]},{"pgid":"34.1a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/3686989750":"2024-09-22T07:38:42.143425+0000","172.21.15.64:6833/3686989750":"2024-09-22T07:38:42.143425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 msgr2=0x7f060c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 0x7f060c075710 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f063006a990 tx=0x7f061800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 msgr2=0x7f063006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f062000c3a0 tx=0x7f062000c860 comp rx=0 tx=0).stop 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 shutdown_connections 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f060c073200 0x7f060c075710 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06300b7a50 0x7f06301553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06300b26b0 0x7f06300b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 --2- 172.21.15.64:0/3041980589 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06300b1d60 0x7f063006f160 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:53.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 >> 172.21.15.64:0/3041980589 conn(0x7f06300cef10 msgr2=0x7f06300ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:53.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 shutdown_connections 2024-09-21T07:39:53.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:53.977+0000 7f0637000640 1 -- 172.21.15.64:0/3041980589 wait complete. 2024-09-21T07:39:53.997 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:39:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- 172.21.15.64:0/296830946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee4006fae0 msgr2=0x7fee400af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 --2- 172.21.15.64:0/296830946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee4006fae0 0x7fee400af790 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7fee30009c80 tx=0x7fee3001cda0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- 172.21.15.64:0/296830946 shutdown_connections 2024-09-21T07:39:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 --2- 172.21.15.64:0/296830946 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 0x7fee400cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 --2- 172.21.15.64:0/296830946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee4006fae0 0x7fee400af790 unknown :-1 s=CLOSED pgs=2657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- 172.21.15.64:0/296830946 >> 172.21.15.64:0/296830946 conn(0x7fee4006d570 msgr2=0x7fee400b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:54.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- 172.21.15.64:0/296830946 shutdown_connections 2024-09-21T07:39:54.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- 172.21.15.64:0/296830946 wait complete. 2024-09-21T07:39:54.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 Processor -- start 2024-09-21T07:39:54.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.157+0000 7fee46600640 1 -- start start 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 0x7fee4015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 0x7fee400b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fee40168eb0 con 0x7fee400b46f0 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee40168d30 con 0x7fee4006fae0 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fee40169030 con 0x7fee400caf00 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee36a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee36a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35762/0 (socket says 172.21.15.64:35762) 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee36a00640 1 -- 172.21.15.64:0/328321687 learned_addr learned my addr 172.21.15.64:0/328321687 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 0x7fee4015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3fe00640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 0x7fee400b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.162 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 -- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 msgr2=0x7fee400b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 0x7fee400b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 -- 172.21.15.64:0/328321687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 msgr2=0x7fee401f9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 -- 172.21.15.64:0/328321687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee401f9da0 con 0x7fee4006fae0 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee36a00640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:39:54.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee3f400640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 0x7fee4015a390 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fee300ac000 tx=0x7fee300093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee300bc070 con 0x7fee4006fae0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee30004290 con 0x7fee4006fae0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4015fc00 con 0x7fee4006fae0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee300b2040 con 0x7fee4006fae0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.161+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401fa240 con 0x7fee4006fae0 2024-09-21T07:39:54.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee400af790 con 0x7fee4006fae0 2024-09-21T07:39:54.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fee300046e0 con 0x7fee4006fae0 2024-09-21T07:39:54.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee37e00640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 0x7fee1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(232..232 src has 1..232) ==== 6274+0+0 (secure 0 0 0) 0x7fee3012e440 con 0x7fee4006fae0 2024-09-21T07:39:54.166 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee36a00640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 0x7fee1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.165+0000 7fee36a00640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 0x7fee1c075710 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fee400ca590 tx=0x7fee28009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:54.169 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.169+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fee30016990 con 0x7fee4006fae0 2024-09-21T07:39:54.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.381+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fee4015a9c0 con 0x7fee4006fae0 2024-09-21T07:39:54.385 INFO:tasks.ceph.mon.a.smithi064.stderr:2024-09-21T07:39:54.385+0000 7fae8e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:39:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee37e00640 1 -- 172.21.15.64:0/328321687 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v177) ==== 161+0+0 (secure 0 0 0) 0x7fee300f8bc0 con 0x7fee4006fae0 2024-09-21T07:39:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:39:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 msgr2=0x7fee1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 0x7fee1c075710 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fee400ca590 tx=0x7fee28009040 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 msgr2=0x7fee4015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 0x7fee4015a390 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fee300ac000 tx=0x7fee300093d0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 shutdown_connections 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fee1c073200 0x7fee1c075710 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee400caf00 0x7fee400b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee400b46f0 0x7fee401f9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 --2- 172.21.15.64:0/328321687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee4006fae0 0x7fee4015a390 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 >> 172.21.15.64:0/328321687 conn(0x7fee4006d570 msgr2=0x7fee4015b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:54.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 shutdown_connections 2024-09-21T07:39:54.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.397+0000 7fee46600640 1 -- 172.21.15.64:0/328321687 wait complete. 2024-09-21T07:39:54.400 INFO:tasks.ceph.mds.c.smithi064.stderr: -3433> 2024-09-21T07:38:48.830+0000 7f8dade00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:39:54.419 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:39:54.522 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2024-09-21T07:39:54.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 -- 172.21.15.64:0/3020179062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 msgr2=0x7fe42c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 --2- 172.21.15.64:0/3020179062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0cb310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe424009bc0 tx=0x7fe42401cba0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 -- 172.21.15.64:0/3020179062 shutdown_connections 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 --2- 172.21.15.64:0/3020179062 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0cb310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 --2- 172.21.15.64:0/3020179062 >> v2:172.21.15.90:3300/0 conn(0x7fe42c06fae0 0x7fe42c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 -- 172.21.15.64:0/3020179062 >> 172.21.15.64:0/3020179062 conn(0x7fe42c06d570 msgr2=0x7fe42c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 -- 172.21.15.64:0/3020179062 shutdown_connections 2024-09-21T07:39:54.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.581+0000 7fe430c00640 1 -- 172.21.15.64:0/3020179062 wait complete. 2024-09-21T07:39:54.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 Processor -- start 2024-09-21T07:39:54.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 -- start start 2024-09-21T07:39:54.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c06fae0 0x7fe42c165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c168e10 con 0x7fe42c0b46f0 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c168c90 con 0x7fe42c06fae0 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe430c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c168f90 con 0x7fe42c0caf00 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35792/0 (socket says 172.21.15.64:35792) 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 -- 172.21.15.64:0/1445578646 learned_addr learned my addr 172.21.15.64:0/1445578646 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe42a800640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe429e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c06fae0 0x7fe42c165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 -- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 msgr2=0x7fe42c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 -- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c06fae0 msgr2=0x7fe42c165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c06fae0 0x7fe42c165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 -- 172.21.15.64:0/1445578646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c099b70 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.585+0000 7fe423e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c460 tx=0x7fe41400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414016020 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe414012940 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0c98d0 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414012d90 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c0c77b0 con 0x7fe42c0b46f0 2024-09-21T07:39:54.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0c7500 con 0x7fe42c0b46f0 2024-09-21T07:39:54.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe414019020 con 0x7fe42c0b46f0 2024-09-21T07:39:54.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 0x7fe408075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:54.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(233..233 src has 1..233) ==== 6360+0+0 (secure 0 0 0) 0x7fe414094110 con 0x7fe42c0b46f0 2024-09-21T07:39:54.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.589+0000 7fe429e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 0x7fe408075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:54.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.593+0000 7fe429e00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 0x7fe408075740 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009b40 tx=0x7fe41c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:54.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.593+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe414020030 con 0x7fe42c0b46f0 2024-09-21T07:39:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:54.805+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe42c0af790 con 0x7fe42c0b46f0 2024-09-21T07:39:55.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.389+0000 7fe422000640 1 -- 172.21.15.64:0/1445578646 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v178) ==== 104+0+0 (secure 0 0 0) 0x7fe41405e870 con 0x7fe42c0b46f0 2024-09-21T07:39:55.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 msgr2=0x7fe408075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:55.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 0x7fe408075740 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009b40 tx=0x7fe41c0091e0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 msgr2=0x7fe42c0c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:55.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c460 tx=0x7fe41400c920 comp rx=0 tx=0).stop 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 shutdown_connections 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe408073230 0x7fe408075740 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42c0caf00 0x7fe42c0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe42c0b46f0 0x7fe42c0c5970 unknown :-1 s=CLOSED pgs=2661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 --2- 172.21.15.64:0/1445578646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c06fae0 0x7fe42c165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 >> 172.21.15.64:0/1445578646 conn(0x7fe42c06d570 msgr2=0x7fe42c0744b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 shutdown_connections 2024-09-21T07:39:55.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.393+0000 7fe430c00640 1 -- 172.21.15.64:0/1445578646 wait complete. 2024-09-21T07:39:55.418 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:39:55.582 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 -- 172.21.15.64:0/1744304080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c15af70 msgr2=0x7fc29c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 --2- 172.21.15.64:0/1744304080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c15af70 0x7fc29c06f0d0 secure :-1 s=READY pgs=2663 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00a950 tx=0x7fc28c01da80 comp rx=0 tx=0).stop 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 -- 172.21.15.64:0/1744304080 shutdown_connections 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 --2- 172.21.15.64:0/1744304080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c15af70 0x7fc29c06f0d0 unknown :-1 s=CLOSED pgs=2663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 -- 172.21.15.64:0/1744304080 >> 172.21.15.64:0/1744304080 conn(0x7fc29c06d570 msgr2=0x7fc29c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 -- 172.21.15.64:0/1744304080 shutdown_connections 2024-09-21T07:39:55.583 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.581+0000 7fc2a1400640 1 -- 172.21.15.64:0/1744304080 wait complete. 2024-09-21T07:39:55.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 Processor -- start 2024-09-21T07:39:55.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 -- start start 2024-09-21T07:39:55.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc29c06f610 0x7fc29c1f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 0x7fc29c0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c169040 con 0x7fc29c074af0 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c168ec0 con 0x7fc29c06f610 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc2a1400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c1691c0 con 0x7fc29c15af70 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49786/0 (socket says 172.21.15.64:49786) 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 -- 172.21.15.64:0/3598430965 learned_addr learned my addr 172.21.15.64:0/3598430965 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc29a800640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc29c06f610 0x7fc29c1f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc29b200640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 0x7fc29c0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 -- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 msgr2=0x7fc29c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 0x7fc29c0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 -- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc29c06f610 msgr2=0x7fc29c1f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc29c06f610 0x7fc29c1f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:55.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 -- 172.21.15.64:0/3598430965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c155370 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc29b200640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 0x7fc29c0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc299e00640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c430 tx=0x7fc28800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.585+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288011790 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc288017070 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288011cc0 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c155650 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c155c10 con 0x7fc29c074af0 2024-09-21T07:39:55.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c06f0d0 con 0x7fc29c074af0 2024-09-21T07:39:55.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc288004030 con 0x7fc29c074af0 2024-09-21T07:39:55.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc292a00640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 0x7fc27c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:55.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(233..233 src has 1..233) ==== 6360+0+0 (secure 0 0 0) 0x7fc288094450 con 0x7fc29c074af0 2024-09-21T07:39:55.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.589+0000 7fc29a800640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 0x7fc27c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:55.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.593+0000 7fc29a800640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 0x7fc27c075710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0b0000 tx=0x7fc28c01c320 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:55.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.593+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc28805f2e0 con 0x7fc29c074af0 2024-09-21T07:39:55.771 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:55.769+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc29c0742a0 con 0x7fc29c074af0 2024-09-21T07:39:56.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.397+0000 7fc292a00640 1 -- 172.21.15.64:0/3598430965 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v234) ==== 181+0+0 (secure 0 0 0) 0x7fc28805ebe0 con 0x7fc29c074af0 2024-09-21T07:39:56.398 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:39:56.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 msgr2=0x7fc27c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 0x7fc27c075710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0b0000 tx=0x7fc28c01c320 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 msgr2=0x7fc29c0b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c430 tx=0x7fc28800c8f0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 shutdown_connections 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc27c073200 0x7fc27c075710 secure :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0b0000 tx=0x7fc28c01c320 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc29c15af70 0x7fc29c0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc29c074af0 0x7fc29c0b6740 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 --2- 172.21.15.64:0/3598430965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc29c06f610 0x7fc29c1f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.401 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 >> 172.21.15.64:0/3598430965 conn(0x7fc29c06d570 msgr2=0x7fc29c153120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:56.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 shutdown_connections 2024-09-21T07:39:56.402 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.401+0000 7fc2a1400640 1 -- 172.21.15.64:0/3598430965 wait complete. 2024-09-21T07:39:56.424 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.585+0000 7fa3e5a00640 1 -- 172.21.15.64:0/3953930588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e006fa50 msgr2=0x7fa3e0165b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.585+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/3953930588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e006fa50 0x7fa3e0165b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009bc0 tx=0x7fa3d801cae0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- 172.21.15.64:0/3953930588 shutdown_connections 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/3953930588 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e006fa50 0x7fa3e0165b00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/3953930588 >> v2:172.21.15.90:3300/0 conn(0x7fa3e015af40 0x7fa3e00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- 172.21.15.64:0/3953930588 >> 172.21.15.64:0/3953930588 conn(0x7fa3e00b1c60 msgr2=0x7fa3e00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:56.588 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- 172.21.15.64:0/3953930588 shutdown_connections 2024-09-21T07:39:56.589 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- 172.21.15.64:0/3953930588 wait complete. 2024-09-21T07:39:56.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 Processor -- start 2024-09-21T07:39:56.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- start start 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 0x7fa3e01fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e015af40 0x7fa3e01fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0168bf0 con 0x7fa3e006ef30 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0168a70 con 0x7fa3e006fa50 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.589+0000 7fa3e5a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e0168d70 con 0x7fa3e015af40 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49796/0 (socket says 172.21.15.64:49796) 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 -- 172.21.15.64:0/1225952542 learned_addr learned my addr 172.21.15.64:0/1225952542 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3e5000640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e015af40 0x7fa3e01fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:56.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3d7e00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 0x7fa3e01fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 -- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e015af40 msgr2=0x7fa3e01fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e015af40 0x7fa3e01fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 -- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 msgr2=0x7fa3e01fbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 0x7fa3e01fbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 -- 172.21.15.64:0/1225952542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e014bcb0 con 0x7fa3e006ef30 2024-09-21T07:39:56.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3d7e00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 0x7fa3e01fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dfe00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 secure :-1 s=READY pgs=2665 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9a0 tx=0x7fa3d000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000cd80 con 0x7fa3e006ef30 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3d0004020 con 0x7fa3e006ef30 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004450 con 0x7fa3e006ef30 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e01555a0 con 0x7fa3e006ef30 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e00c6680 con 0x7fa3e006ef30 2024-09-21T07:39:56.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e00ccb90 con 0x7fa3e006ef30 2024-09-21T07:39:56.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.593+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa3d0003600 con 0x7fa3e006ef30 2024-09-21T07:39:56.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.597+0000 7fa3dcc00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 0x7fa3bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:56.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.597+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(234..234 src has 1..234) ==== 5922+0+0 (secure 0 0 0) 0x7fa3d0094d90 con 0x7fa3e006ef30 2024-09-21T07:39:56.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.597+0000 7fa3d7e00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 0x7fa3bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:56.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.597+0000 7fa3d7e00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 0x7fa3bc075710 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0165c80 tx=0x7fa3c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:56.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.597+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fa3d005fdd0 con 0x7fa3e006ef30 2024-09-21T07:39:56.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:56.777+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3e00b5200 con 0x7fa3e006ef30 2024-09-21T07:39:57.400 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.401+0000 7fa3dcc00640 1 -- 172.21.15.64:0/1225952542 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v235) ==== 169+0+0 (secure 0 0 0) 0x7fa3d005f6d0 con 0x7fa3e006ef30 2024-09-21T07:39:57.400 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 msgr2=0x7fa3bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 0x7fa3bc075710 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0165c80 tx=0x7fa3c8009040 comp rx=0 tx=0).stop 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 msgr2=0x7fa3e014b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 secure :-1 s=READY pgs=2665 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9a0 tx=0x7fa3d000ee60 comp rx=0 tx=0).stop 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 shutdown_connections 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fa3bc073200 0x7fa3bc075710 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3e015af40 0x7fa3e01fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e006fa50 0x7fa3e01fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.405 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 --2- 172.21.15.64:0/1225952542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3e006ef30 0x7fa3e014b770 secure :-1 s=CLOSED pgs=2665 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9a0 tx=0x7fa3d000ee60 comp rx=0 tx=0).stop 2024-09-21T07:39:57.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 >> 172.21.15.64:0/1225952542 conn(0x7fa3e00b1c60 msgr2=0x7fa3e00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:57.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 shutdown_connections 2024-09-21T07:39:57.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.405+0000 7fa3e5a00640 1 -- 172.21.15.64:0/1225952542 wait complete. 2024-09-21T07:39:57.431 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- 172.21.15.64:0/7006610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 msgr2=0x7f84c80ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 --2- 172.21.15.64:0/7006610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80ce440 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009840 tx=0x7f84b401c740 comp rx=0 tx=0).stop 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- 172.21.15.64:0/7006610 shutdown_connections 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 --2- 172.21.15.64:0/7006610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80ce440 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- 172.21.15.64:0/7006610 >> 172.21.15.64:0/7006610 conn(0x7f84c80b2f80 msgr2=0x7f84c80b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- 172.21.15.64:0/7006610 shutdown_connections 2024-09-21T07:39:57.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- 172.21.15.64:0/7006610 wait complete. 2024-09-21T07:39:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 Processor -- start 2024-09-21T07:39:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- start start 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 0x7f84c8163740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84c816a8e0 con 0x7f84c80b1300 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84c816a760 con 0x7f84c80cd170 2024-09-21T07:39:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.593+0000 7f84d0600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f84c816aa60 con 0x7f84c80ce030 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49808/0 (socket says 172.21.15.64:49808) 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 -- 172.21.15.64:0/61242658 learned_addr learned my addr 172.21.15.64:0/61242658 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cd200640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84ce600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 0x7f84c8163740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 -- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 msgr2=0x7f84c8163740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 0x7f84c8163740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 -- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 msgr2=0x7f84c80af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 -- 172.21.15.64:0/61242658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c80afa60 con 0x7f84c80b1300 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84ce600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 0x7f84c8163740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:39:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84cdc00640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00c430 tx=0x7f84bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:57.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc017070 con 0x7f84c80b1300 2024-09-21T07:39:57.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84bc0053c0 con 0x7f84c80b1300 2024-09-21T07:39:57.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c80ae400 con 0x7f84c80b1300 2024-09-21T07:39:57.598 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc003860 con 0x7f84c80b1300 2024-09-21T07:39:57.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c80ae9c0 con 0x7f84c80b1300 2024-09-21T07:39:57.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c80ce440 con 0x7f84c80b1300 2024-09-21T07:39:57.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.597+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f84bc01a070 con 0x7f84c80b1300 2024-09-21T07:39:57.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.601+0000 7f84c5600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 0x7f84a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.601+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f84bc0935d0 con 0x7f84c80b1300 2024-09-21T07:39:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.601+0000 7f84cd200640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 0x7f84a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.601+0000 7f84cd200640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 0x7f84a8075710 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f84b40af000 tx=0x7f84b40b2040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:57.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.605+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f84c80afa60 con 0x7f84c80b1300 2024-09-21T07:39:57.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.781+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f84c80b2d60 con 0x7f84c80b1300 2024-09-21T07:39:57.786 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.785+0000 7f84c5600640 1 -- 172.21.15.64:0/61242658 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v70) ==== 71+0+0 (secure 0 0 0) 0x7f84bc05e670 con 0x7f84c80b1300 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 msgr2=0x7f84a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 0x7f84a8075710 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f84b40af000 tx=0x7f84b40b2040 comp rx=0 tx=0).stop 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 msgr2=0x7f84c809cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00c430 tx=0x7f84bc00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 shutdown_connections 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f84a8073200 0x7f84a8075710 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84c80ce030 0x7f84c8163740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.789 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c80cd170 0x7f84c80af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 --2- 172.21.15.64:0/61242658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c80b1300 0x7f84c809cfe0 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 >> 172.21.15.64:0/61242658 conn(0x7f84c80b2f80 msgr2=0x7f84c8070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 shutdown_connections 2024-09-21T07:39:57.790 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.789+0000 7f84d0600640 1 -- 172.21.15.64:0/61242658 wait complete. 2024-09-21T07:39:57.815 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-21T07:39:57.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 -- 172.21.15.64:0/719396851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4220004d50 msgr2=0x7f4220005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 --2- 172.21.15.64:0/719396851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4220004d50 0x7f4220005160 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7f423c0c73a0 tx=0x7f423401d550 comp rx=0 tx=0).stop 2024-09-21T07:39:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f423b200640 1 -- 172.21.15.64:0/719396851 reap_dead start 2024-09-21T07:39:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 -- 172.21.15.64:0/719396851 shutdown_connections 2024-09-21T07:39:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 -- 172.21.15.64:0/719396851 >> 172.21.15.64:0/719396851 conn(0x7f423c06d570 msgr2=0x7f423c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 -- 172.21.15.64:0/719396851 shutdown_connections 2024-09-21T07:39:57.975 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.973+0000 7f4241400640 1 -- 172.21.15.64:0/719396851 wait complete. 2024-09-21T07:39:57.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 Processor -- start 2024-09-21T07:39:57.976 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 -- start start 2024-09-21T07:39:57.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4220004d50 0x7f423c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c14de40 0x7f423c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f423c0cb720 con 0x7f423c1f3c20 2024-09-21T07:39:57.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f423c0cb5a0 con 0x7f4220004d50 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4241400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f423c0cb8a0 con 0x7f423c14de40 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49822/0 (socket says 172.21.15.64:49822) 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 -- 172.21.15.64:0/2395257726 learned_addr learned my addr 172.21.15.64:0/2395257726 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423a800640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4220004d50 0x7f423c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.979 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4233e00640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c14de40 0x7f423c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 -- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c14de40 msgr2=0x7f423c1f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c14de40 0x7f423c1f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 -- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4220004d50 msgr2=0x7f423c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4220004d50 0x7f423c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 -- 172.21.15.64:0/2395257726 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c0c9960 con 0x7f423c1f3c20 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f423b200640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7f4234099080 tx=0x7f4234009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:57.980 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340bc070 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.977+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42340aaaf0 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c0c9c40 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340ae070 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c1e64f0 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c0af790 con 0x7f423c1f3c20 2024-09-21T07:39:57.981 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42340bf070 con 0x7f423c1f3c20 2024-09-21T07:39:57.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4232a00640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 0x7f4218075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:39:57.982 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f423412eb80 con 0x7f423c1f3c20 2024-09-21T07:39:57.983 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.981+0000 7f423a800640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 0x7f4218075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:39:57.984 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.985+0000 7f423a800640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 0x7f4218075740 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f422c000fc0 tx=0x7f422c001ba0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:39:57.987 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:57.985+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f42340172a0 con 0x7f423c1f3c20 2024-09-21T07:39:58.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.233+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7f423c1e8770 con 0x7f423c1f3c20 2024-09-21T07:39:58.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4232a00640 1 -- 172.21.15.64:0/2395257726 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v806) ==== 133+0+0 (secure 0 0 0) 0x7f42340f9660 con 0x7f423c1f3c20 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 msgr2=0x7f4218075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 0x7f4218075740 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f422c000fc0 tx=0x7f422c001ba0 comp rx=0 tx=0).stop 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 msgr2=0x7f423c14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7f4234099080 tx=0x7f4234009760 comp rx=0 tx=0).stop 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 shutdown_connections 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4218073230 0x7f4218075740 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:58.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f423c1f3c20 0x7f423c14d080 unknown :-1 s=CLOSED pgs=2670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f423c14de40 0x7f423c1f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 --2- 172.21.15.64:0/2395257726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4220004d50 0x7f423c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:39:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 >> 172.21.15.64:0/2395257726 conn(0x7f423c06d570 msgr2=0x7f423c0743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:39:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 shutdown_connections 2024-09-21T07:39:58.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:39:58.409+0000 7f4241400640 1 -- 172.21.15.64:0/2395257726 wait complete. 2024-09-21T07:39:58.431 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-21T07:39:58.431 INFO:tasks.cephfs_test_runner: 2024-09-21T07:39:58.431 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T07:39:58.432 INFO:tasks.cephfs_test_runner:Ran 15 tests in 996.779s 2024-09-21T07:39:58.432 INFO:tasks.cephfs_test_runner: 2024-09-21T07:39:58.432 INFO:tasks.cephfs_test_runner:OK 2024-09-21T07:39:58.432 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T07:39:58.443 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T07:39:58.452 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T07:39:58.452 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:39:58.452 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:58.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:39:58.462 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-21T07:39:58.462 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:58.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350264k,nr_inodes=4087566,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5602 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:39:58.516 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:39:58.516 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:58.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:39:58.525 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T07:39:58.525 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:39:58.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350176k,nr_inodes=4087544,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3152 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274968k,nr_inodes=818742,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274972k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:39:58.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:58.579 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:39:58.588 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:39:58.588 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:39:58.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:58.588 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:39:58.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:58.653 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:39:59.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.089 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-09-21T07:39:59.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.226 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-09-21T07:39:59.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.235 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-09-21T07:39:59.739 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-09-21T07:39:59.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:39:59.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.742 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:39:59.752 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:39:59.752 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T07:39:59.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.752 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:39:59.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:39:59.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:40:00.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:40:00.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T07:40:00.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:40:00.453 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T07:40:00.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:40:00.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T07:40:00.928 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-21T07:40:00.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:40:00.930 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T07:40:00.945 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:40:00.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:40:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 -- 172.21.15.64:0/3779594751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad740b4e00 msgr2=0x7fad740af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 --2- 172.21.15.64:0/3779594751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad740b4e00 0x7fad740af790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009930 tx=0x7fad5c01c8e0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 -- 172.21.15.64:0/3779594751 shutdown_connections 2024-09-21T07:40:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 --2- 172.21.15.64:0/3779594751 >> v2:172.21.15.90:3300/0 conn(0x7fad740caf00 0x7fad740cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.118 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 --2- 172.21.15.64:0/3779594751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad740b4e00 0x7fad740af790 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 -- 172.21.15.64:0/3779594751 >> 172.21.15.64:0/3779594751 conn(0x7fad7406d570 msgr2=0x7fad740b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 -- 172.21.15.64:0/3779594751 shutdown_connections 2024-09-21T07:40:01.119 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.117+0000 7fad7a200640 1 -- 172.21.15.64:0/3779594751 wait complete. 2024-09-21T07:40:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 Processor -- start 2024-09-21T07:40:01.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- start start 2024-09-21T07:40:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad7406fae0 0x7fad7415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 0x7fad740c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.124 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad74168e60 con 0x7fad740caf00 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad74168ce0 con 0x7fad740c7590 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fad74168fe0 con 0x7fad7406fae0 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49824/0 (socket says 172.21.15.64:49824) 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 -- 172.21.15.64:0/3331109661 learned_addr learned my addr 172.21.15.64:0/3331109661 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:01.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad73400640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad7406fae0 0x7fad7415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad73e00640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 0x7fad740c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 -- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad7406fae0 msgr2=0x7fad7415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad7406fae0 0x7fad7415a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 -- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 msgr2=0x7fad740c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 0x7fad740c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 -- 172.21.15.64:0/3331109661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad741593d0 con 0x7fad740caf00 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad73e00640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 0x7fad740c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6be00640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01a510 tx=0x7fad5c0a5690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0bc070 con 0x7fad740caf00 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad5c0043b0 con 0x7fad740caf00 2024-09-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741596b0 con 0x7fad740caf00 2024-09-21T07:40:01.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0b2040 con 0x7fad740caf00 2024-09-21T07:40:01.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.121+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad74159c70 con 0x7fad740caf00 2024-09-21T07:40:01.128 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.125+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad740af790 con 0x7fad740caf00 2024-09-21T07:40:01.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.125+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad5c0bf070 con 0x7fad740caf00 2024-09-21T07:40:01.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.125+0000 7fad6b400640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 0x7fad50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.125+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fad5c12da10 con 0x7fad740caf00 2024-09-21T07:40:01.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.125+0000 7fad73400640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 0x7fad50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.130 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.129+0000 7fad73400640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 0x7fad50075710 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fad64001650 tx=0x7fad64009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.129+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fad5c0164d0 con 0x7fad740caf00 2024-09-21T07:40:01.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.305+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad74165c40 con 0x7fad50073200 2024-09-21T07:40:01.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.305+0000 7fad6b400640 1 -- 172.21.15.64:0/3331109661 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13463 (secure 0 0 0) 0x7fad74165c40 con 0x7fad50073200 2024-09-21T07:40:01.306 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:01.306 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:40:01.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 msgr2=0x7fad50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 0x7fad50075710 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fad64001650 tx=0x7fad64009040 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 msgr2=0x7fad740c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01a510 tx=0x7fad5c0a5690 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 shutdown_connections 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fad50073200 0x7fad50075710 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad740c7590 0x7fad740c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad740caf00 0x7fad740c61a0 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 --2- 172.21.15.64:0/3331109661 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad7406fae0 0x7fad7415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 >> 172.21.15.64:0/3331109661 conn(0x7fad7406d570 msgr2=0x7fad740ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 shutdown_connections 2024-09-21T07:40:01.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.309+0000 7fad7a200640 1 -- 172.21.15.64:0/3331109661 wait complete. 2024-09-21T07:40:01.328 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":750,"stamp":"2024-09-21T07:39:59.710627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":495492,"kb_used_data":44768,"kb_used_omap":12,"kb_used_meta":450547,"kb_avail":754479228,"statfs":{"total":773094113280,"available":772586729472,"internally_reserved":0,"allocated":45842432,"data_stored":33392694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":461360691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12621766,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-94,"num_write_kb":-12354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001694"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":499,"reported_epoch":233,"state":"active+clean","last_fresh":"2024-09-21T07:39:54.889109+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:39:54.889109+0000","last_peered":"2024-09-21T07:39:54.889109+0000","last_clean":"2024-09-21T07:39:54.889109+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:39:54.889109+0000","last_undegraded":"2024-09-21T07:39:54.889109+0000","last_fullsized":"2024-09-21T07:39:54.889109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509652,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2945024,"data_stored":1396153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54108,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317732,"statfs":{"total":96636764160,"available":96581357568,"internally_reserved":0,"allocated":9248768,"data_stored":7694107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62532,"kb_used_data":4976,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309308,"statfs":{"total":96636764160,"available":96572731392,"internally_reserved":0,"allocated":5095424,"data_stored":3531879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509651,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":11080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":11345920,"data_stored":9791259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58912,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312928,"statfs":{"total":96636764160,"available":96576438272,"internally_reserved":0,"allocated":5648384,"data_stored":4090171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542356,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":3460,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":3543040,"data_stored":1987055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90192,"kb_used_data":4924,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94281648,"statfs":{"total":96636764160,"available":96544407552,"internally_reserved":0,"allocated":5042176,"data_stored":3493325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:40:01.329 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:40:01.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 -- 172.21.15.64:0/1821704743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 msgr2=0x7f48380b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 --2- 172.21.15.64:0/1821704743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48380b4b00 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f482001c7c0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 -- 172.21.15.64:0/1821704743 shutdown_connections 2024-09-21T07:40:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 --2- 172.21.15.64:0/1821704743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48380b4b00 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 --2- 172.21.15.64:0/1821704743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f48380af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 -- 172.21.15.64:0/1821704743 >> 172.21.15.64:0/1821704743 conn(0x7f483806d570 msgr2=0x7f48380b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 -- 172.21.15.64:0/1821704743 shutdown_connections 2024-09-21T07:40:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.485+0000 7f483ce00640 1 -- 172.21.15.64:0/1821704743 wait complete. 2024-09-21T07:40:01.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 Processor -- start 2024-09-21T07:40:01.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 -- start start 2024-09-21T07:40:01.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f4838099990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48380b3170 0x7f4838154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4838169340 con 0x7f48380b46f0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48381691c0 con 0x7f48380b3170 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f483ce00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f48381694c0 con 0x7f483806fae0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f4836800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f4836800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49838/0 (socket says 172.21.15.64:49838) 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.489+0000 7f4836800640 1 -- 172.21.15.64:0/25596370 learned_addr learned my addr 172.21.15.64:0/25596370 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f482fe00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48380b3170 0x7f4838154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4835e00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f4838099990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 -- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 msgr2=0x7f4838099990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f4838099990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 -- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48380b3170 msgr2=0x7f4838154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48380b3170 0x7f4838154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 -- 172.21.15.64:0/25596370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380af150 con 0x7f48380b46f0 2024-09-21T07:40:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4835e00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f4838099990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f4836800640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f483000ca80 tx=0x7f483000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830016020 con 0x7f48380b46f0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483000a930 con 0x7f48380b46f0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483000ad60 con 0x7f48380b46f0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48380b23b0 con 0x7f48380b46f0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48380aee70 con 0x7f48380b46f0 2024-09-21T07:40:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48380b2120 con 0x7f48380b46f0 2024-09-21T07:40:01.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.493+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4830019020 con 0x7f48380b46f0 2024-09-21T07:40:01.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.497+0000 7f482e000640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 0x7f4814075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.497+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f4830093ee0 con 0x7f48380b46f0 2024-09-21T07:40:01.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.497+0000 7f4835e00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 0x7f4814075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.497+0000 7f4835e00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 0x7f4814075710 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4828009ac0 tx=0x7f48280091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.501 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.501+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f4830020030 con 0x7f48380b46f0 2024-09-21T07:40:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.673+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48380af790 con 0x7f4814073200 2024-09-21T07:40:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f482e000640 1 -- 172.21.15.64:0/25596370 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13463 (secure 0 0 0) 0x7f48380af790 con 0x7f4814073200 2024-09-21T07:40:01.676 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 msgr2=0x7f4814075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 0x7f4814075710 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4828009ac0 tx=0x7f48280091e0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 msgr2=0x7f48381554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f483000ca80 tx=0x7f483000cb70 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 shutdown_connections 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f4814073200 0x7f4814075710 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48380b46f0 0x7f48381554c0 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48380b3170 0x7f4838154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 --2- 172.21.15.64:0/25596370 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f483806fae0 0x7f4838099990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 >> 172.21.15.64:0/25596370 conn(0x7f483806d570 msgr2=0x7f4838156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 shutdown_connections 2024-09-21T07:40:01.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.677+0000 7f483ce00640 1 -- 172.21.15.64:0/25596370 wait complete. 2024-09-21T07:40:01.698 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":750,"stamp":"2024-09-21T07:39:59.710627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":495492,"kb_used_data":44768,"kb_used_omap":12,"kb_used_meta":450547,"kb_avail":754479228,"statfs":{"total":773094113280,"available":772586729472,"internally_reserved":0,"allocated":45842432,"data_stored":33392694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":461360691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12621766,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-94,"num_write_kb":-12354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001694"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":499,"reported_epoch":233,"state":"active+clean","last_fresh":"2024-09-21T07:39:54.889109+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:39:54.889109+0000","last_peered":"2024-09-21T07:39:54.889109+0000","last_clean":"2024-09-21T07:39:54.889109+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:39:54.889109+0000","last_undegraded":"2024-09-21T07:39:54.889109+0000","last_fullsized":"2024-09-21T07:39:54.889109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509652,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2945024,"data_stored":1396153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54108,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317732,"statfs":{"total":96636764160,"available":96581357568,"internally_reserved":0,"allocated":9248768,"data_stored":7694107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62532,"kb_used_data":4976,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309308,"statfs":{"total":96636764160,"available":96572731392,"internally_reserved":0,"allocated":5095424,"data_stored":3531879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509651,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":11080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":11345920,"data_stored":9791259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58912,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312928,"statfs":{"total":96636764160,"available":96576438272,"internally_reserved":0,"allocated":5648384,"data_stored":4090171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542356,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":3460,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":3543040,"data_stored":1987055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90192,"kb_used_data":4924,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94281648,"statfs":{"total":96636764160,"available":96544407552,"internally_reserved":0,"allocated":5042176,"data_stored":3493325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:40:01.699 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:40:01.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:40:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 -- 172.21.15.64:0/164284814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2ec003a10 msgr2=0x7fb2ec003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 --2- 172.21.15.64:0/164284814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2ec003a10 0x7fb2ec003e40 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006f80 tx=0x7fb2f801cf00 comp rx=0 tx=0).stop 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 -- 172.21.15.64:0/164284814 shutdown_connections 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 --2- 172.21.15.64:0/164284814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2ec003a10 0x7fb2ec003e40 unknown :-1 s=CLOSED pgs=2676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 -- 172.21.15.64:0/164284814 >> 172.21.15.64:0/164284814 conn(0x7fb3080d1430 msgr2=0x7fb3080d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 -- 172.21.15.64:0/164284814 shutdown_connections 2024-09-21T07:40:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.857+0000 7fb30f800640 1 -- 172.21.15.64:0/164284814 wait complete. 2024-09-21T07:40:01.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 Processor -- start 2024-09-21T07:40:01.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 -- start start 2024-09-21T07:40:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2ec003a10 0x7fb3080c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb30815b890 0x7fb3081fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb3080cdc70 con 0x7fb30815b480 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3080b2140 con 0x7fb30815b890 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb3080cddf0 con 0x7fb2ec003a10 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49850/0 (socket says 172.21.15.64:49850) 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 -- 172.21.15.64:0/602560665 learned_addr learned my addr 172.21.15.64:0/602560665 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30ce00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2ec003a10 0x7fb3080c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb30d800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb30815b890 0x7fb3081fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 -- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2ec003a10 msgr2=0x7fb3080c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2ec003a10 0x7fb3080c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 -- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb30815b890 msgr2=0x7fb3081fc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb30815b890 0x7fb3081fc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.861+0000 7fb2ffe00640 1 -- 172.21.15.64:0/602560665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3080c5e70 con 0x7fb30815b480 2024-09-21T07:40:01.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb2ffe00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00011f0 tx=0x7fb2f0001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0015020 con 0x7fb30815b480 2024-09-21T07:40:01.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2f0011750 con 0x7fb30815b480 2024-09-21T07:40:01.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011ba0 con 0x7fb30815b480 2024-09-21T07:40:01.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3080c6150 con 0x7fb30815b480 2024-09-21T07:40:01.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3080b4260 con 0x7fb30815b480 2024-09-21T07:40:01.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3080ce350 con 0x7fb30815b480 2024-09-21T07:40:01.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.865+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb2f0018020 con 0x7fb30815b480 2024-09-21T07:40:01.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.869+0000 7fb305600640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 0x7fb2e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:01.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.869+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fb2f00949c0 con 0x7fb30815b480 2024-09-21T07:40:01.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.869+0000 7fb30ce00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 0x7fb2e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.869+0000 7fb30ce00640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 0x7fb2e4075710 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80aa000 tx=0x7fb2f8019d40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:01.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:01.873+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb2f001f020 con 0x7fb30815b480 2024-09-21T07:40:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.045+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3080ca070 con 0x7fb2e4073200 2024-09-21T07:40:02.046 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.045+0000 7fb305600640 1 -- 172.21.15.64:0/602560665 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7fb3080ca070 con 0x7fb2e4073200 2024-09-21T07:40:02.047 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:02.047 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 msgr2=0x7fb2e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 0x7fb2e4075710 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80aa000 tx=0x7fb2f8019d40 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 msgr2=0x7fb3081fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00011f0 tx=0x7fb2f0001740 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 shutdown_connections 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb2e4073200 0x7fb2e4075710 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb30815b890 0x7fb3081fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb30815b480 0x7fb3081fbe90 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 --2- 172.21.15.64:0/602560665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2ec003a10 0x7fb3080c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 >> 172.21.15.64:0/602560665 conn(0x7fb3080d1430 msgr2=0x7fb3081e8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:02.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 shutdown_connections 2024-09-21T07:40:02.050 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.049+0000 7fb30f800640 1 -- 172.21.15.64:0/602560665 wait complete. 2024-09-21T07:40:02.069 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":751,"stamp":"2024-09-21T07:40:01.711089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":493500,"kb_used_data":42772,"kb_used_omap":12,"kb_used_meta":450547,"kb_avail":754481220,"statfs":{"total":773094113280,"available":772588769280,"internally_reserved":0,"allocated":43798528,"data_stored":31320172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":461360691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12621766,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-94,"num_write_kb":-12354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.317025"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":503,"reported_epoch":235,"state":"active+clean","last_fresh":"2024-09-21T07:39:58.221609+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:39:58.221609+0000","last_peered":"2024-09-21T07:39:58.221609+0000","last_clean":"2024-09-21T07:39:58.221609+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:39:58.221609+0000","last_undegraded":"2024-09-21T07:39:58.221609+0000","last_fullsized":"2024-09-21T07:39:58.221609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509652,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2945024,"data_stored":1396153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509652,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54108,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317732,"statfs":{"total":96636764160,"available":96581357568,"internally_reserved":0,"allocated":9248768,"data_stored":7694107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62532,"kb_used_data":4976,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309308,"statfs":{"total":96636764160,"available":96572731392,"internally_reserved":0,"allocated":5095424,"data_stored":3531879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509651,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":11080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":11345920,"data_stored":9791259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58912,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312928,"statfs":{"total":96636764160,"available":96576438272,"internally_reserved":0,"allocated":5648384,"data_stored":4090171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542357,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61044,"kb_used_data":3484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310796,"statfs":{"total":96636764160,"available":96574255104,"internally_reserved":0,"allocated":3567616,"data_stored":1999113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88172,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283668,"statfs":{"total":96636764160,"available":96546476032,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:40:02.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:40:02.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.225+0000 7f2e73000640 1 -- 172.21.15.64:0/273329637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b2670 msgr2=0x7f2e6c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.225+0000 7f2e73000640 1 --2- 172.21.15.64:0/273329637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c0cd010 secure :-1 s=READY pgs=2679 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0741b0 tx=0x7f2e6401cb80 comp rx=0 tx=0).stop 2024-09-21T07:40:02.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- 172.21.15.64:0/273329637 shutdown_connections 2024-09-21T07:40:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 --2- 172.21.15.64:0/273329637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c0cd010 unknown :-1 s=CLOSED pgs=2679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 --2- 172.21.15.64:0/273329637 >> v2:172.21.15.90:3300/0 conn(0x7f2e6c0b1d20 0x7f2e6c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- 172.21.15.64:0/273329637 >> 172.21.15.64:0/273329637 conn(0x7f2e6c0cef80 msgr2=0x7f2e6c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- 172.21.15.64:0/273329637 shutdown_connections 2024-09-21T07:40:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- 172.21.15.64:0/273329637 wait complete. 2024-09-21T07:40:02.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 Processor -- start 2024-09-21T07:40:02.230 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- start start 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c09f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e6c0d0fe0 0x7f2e6c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c16a1e0 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c16a060 con 0x7f2e6c0b2670 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.229+0000 7f2e73000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c16a360 con 0x7f2e6c0d0fe0 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49864/0 (socket says 172.21.15.64:49864) 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 -- 172.21.15.64:0/3892219412 learned_addr learned my addr 172.21.15.64:0/3892219412 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e63400640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c09f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e71000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e6c0d0fe0 0x7f2e6c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 -- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e6c0d0fe0 msgr2=0x7f2e6c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e6c0d0fe0 0x7f2e6c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 -- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e6c0b2670 msgr2=0x7f2e6c09f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c09f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 -- 172.21.15.64:0/3892219412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c155390 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e6be00640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c3c0 tx=0x7f2e5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011790 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e5c017070 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011d40 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c1fabb0 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c1fb170 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c0b2130 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.233+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e5c01c460 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.237+0000 7f2e68c00640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 0x7f2e48075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.237+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f2e5c093dc0 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.237+0000 7f2e63400640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 0x7f2e48075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:02.237 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.237+0000 7f2e63400640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 0x7f2e48075740 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c160620 tx=0x7f2e5400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:02.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.241+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f2e5c05e810 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.421+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e6c072180 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.421+0000 7f2e68c00640 1 -- 172.21.15.64:0/3892219412 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v235) ==== 74+0+13397 (secure 0 0 0) 0x7f2e5c063240 con 0x7f2e6c0b1d20 2024-09-21T07:40:02.422 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:02.422 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":235,"fsid":"be0ccda5-3d1a-4615-9c09-c8d9d4461231","created":"2024-09-21T07:22:21.964531+0000","modified":"2024-09-21T07:39:57.402509+0000","last_up_change":"2024-09-21T07:22:37.037688+0000","last_in_change":"2024-09-21T07:22:26.723063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:22:37.490222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27e52307-21f7-43a7-b61a-f64c8573c9d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6817","nonce":3519639794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6819","nonce":3519639794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6823","nonce":3519639794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3519639794},{"type":"v1","addr":"172.21.15.64:6821","nonce":3519639794}]},"public_addr":"172.21.15.64:6817/3519639794","cluster_addr":"172.21.15.64:6819/3519639794","heartbeat_back_addr":"172.21.15.64:6823/3519639794","heartbeat_front_addr":"172.21.15.64:6821/3519639794","state":["exists","up"]},{"osd":1,"uuid":"2f4c4f24-c0bb-4dbf-bde9-31ab3bc57006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6825","nonce":1622648472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6827","nonce":1622648472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6831","nonce":1622648472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1622648472},{"type":"v1","addr":"172.21.15.64:6829","nonce":1622648472}]},"public_addr":"172.21.15.64:6825/1622648472","cluster_addr":"172.21.15.64:6827/1622648472","heartbeat_back_addr":"172.21.15.64:6831/1622648472","heartbeat_front_addr":"172.21.15.64:6829/1622648472","state":["exists","up"]},{"osd":2,"uuid":"cee34831-35ea-494f-8a6c-72dd9ecf8203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6809","nonce":3196938996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6811","nonce":3196938996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6815","nonce":3196938996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3196938996},{"type":"v1","addr":"172.21.15.64:6813","nonce":3196938996}]},"public_addr":"172.21.15.64:6809/3196938996","cluster_addr":"172.21.15.64:6811/3196938996","heartbeat_back_addr":"172.21.15.64:6815/3196938996","heartbeat_front_addr":"172.21.15.64:6813/3196938996","state":["exists","up"]},{"osd":3,"uuid":"d4aa6c7b-2f58-4ddd-a247-ae16f169e9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6801","nonce":2986416528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6803","nonce":2986416528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6807","nonce":2986416528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2986416528},{"type":"v1","addr":"172.21.15.64:6805","nonce":2986416528}]},"public_addr":"172.21.15.64:6801/2986416528","cluster_addr":"172.21.15.64:6803/2986416528","heartbeat_back_addr":"172.21.15.64:6807/2986416528","heartbeat_front_addr":"172.21.15.64:6805/2986416528","state":["exists","up"]},{"osd":4,"uuid":"65586954-a471-4591-b349-4e1b5876d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6811","nonce":2460854441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6813","nonce":2460854441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6817","nonce":2460854441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2460854441},{"type":"v1","addr":"172.21.15.90:6815","nonce":2460854441}]},"public_addr":"172.21.15.90:6811/2460854441","cluster_addr":"172.21.15.90:6813/2460854441","heartbeat_back_addr":"172.21.15.90:6817/2460854441","heartbeat_front_addr":"172.21.15.90:6815/2460854441","state":["exists","up"]},{"osd":5,"uuid":"05b54446-204d-4776-9dc0-441779bcd20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6827","nonce":3363919567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6829","nonce":3363919567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6833","nonce":3363919567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3363919567},{"type":"v1","addr":"172.21.15.90:6831","nonce":3363919567}]},"public_addr":"172.21.15.90:6827/3363919567","cluster_addr":"172.21.15.90:6829/3363919567","heartbeat_back_addr":"172.21.15.90:6833/3363919567","heartbeat_front_addr":"172.21.15.90:6831/3363919567","state":["exists","up"]},{"osd":6,"uuid":"1b037aae-7625-47c5-8813-f6ea51348b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6819","nonce":1592578093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6821","nonce":1592578093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6825","nonce":1592578093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1592578093},{"type":"v1","addr":"172.21.15.90:6823","nonce":1592578093}]},"public_addr":"172.21.15.90:6819/1592578093","cluster_addr":"172.21.15.90:6821/1592578093","heartbeat_back_addr":"172.21.15.90:6825/1592578093","heartbeat_front_addr":"172.21.15.90:6823/1592578093","state":["exists","up"]},{"osd":7,"uuid":"ae4f006c-9cff-4a93-bdfa-40f07b109aa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":227,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6803","nonce":46023510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6805","nonce":46023510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6809","nonce":46023510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":46023510},{"type":"v1","addr":"172.21.15.90:6807","nonce":46023510}]},"public_addr":"172.21.15.90:6803/46023510","cluster_addr":"172.21.15.90:6805/46023510","heartbeat_back_addr":"172.21.15.90:6809/46023510","heartbeat_front_addr":"172.21.15.90:6807/46023510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.838907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.602887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.252860+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.496920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.721660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:34.219963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.746666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:22:33.503556+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6834/2784366860":"2024-09-22T07:39:54.388941+0000","172.21.15.64:6832/2784366860":"2024-09-22T07:39:54.388941+0000","172.21.15.64:6835/3686989750":"2024-09-22T07:38:42.143425+0000","172.21.15.64:6833/3686989750":"2024-09-22T07:38:42.143425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:40:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 msgr2=0x7f2e48075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 0x7f2e48075740 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c160620 tx=0x7f2e5400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 msgr2=0x7f2e6c1fa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c3c0 tx=0x7f2e5c00c880 comp rx=0 tx=0).stop 2024-09-21T07:40:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 shutdown_connections 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2e48073230 0x7f2e48075740 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2e6c0d0fe0 0x7f2e6c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e6c0b2670 0x7f2e6c09f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 --2- 172.21.15.64:0/3892219412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e6c0b1d20 0x7f2e6c1fa360 unknown :-1 s=CLOSED pgs=2680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 >> 172.21.15.64:0/3892219412 conn(0x7f2e6c0cef80 msgr2=0x7f2e6c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 shutdown_connections 2024-09-21T07:40:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:02.425+0000 7f2e73000640 1 -- 172.21.15.64:0/3892219412 wait complete. 2024-09-21T07:40:03.445 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T07:40:03.446 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:03.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 -- 172.21.15.64:0/170566290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3838003fa0 msgr2=0x7f3838004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.623 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 --2- 172.21.15.64:0/170566290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3838003fa0 0x7f3838004810 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 crypto rx=0x7f383c009b40 tx=0x7f383c01d270 comp rx=0 tx=0).stop 2024-09-21T07:40:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3853200640 1 -- 172.21.15.64:0/170566290 reap_dead start 2024-09-21T07:40:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 -- 172.21.15.64:0/170566290 shutdown_connections 2024-09-21T07:40:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 -- 172.21.15.64:0/170566290 >> 172.21.15.64:0/170566290 conn(0x7f38540b2f80 msgr2=0x7f38540b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 -- 172.21.15.64:0/170566290 shutdown_connections 2024-09-21T07:40:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.621+0000 7f3859400640 1 -- 172.21.15.64:0/170566290 wait complete. 2024-09-21T07:40:03.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 Processor -- start 2024-09-21T07:40:03.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 -- start start 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3838003fa0 0x7f38541e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c4270 0x7f38540cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 0x7f38540cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38540b1710 con 0x7f38540c4680 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38540b21a0 con 0x7f38540c4270 2024-09-21T07:40:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3859400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f38540b1890 con 0x7f3838003fa0 2024-09-21T07:40:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.625+0000 7f3853200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 0x7f38540cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 0x7f38540cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49876/0 (socket says 172.21.15.64:49876) 2024-09-21T07:40:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 -- 172.21.15.64:0/3673514685 learned_addr learned my addr 172.21.15.64:0/3673514685 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3849e00640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c4270 0x7f38540cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3852800640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3838003fa0 0x7f38541e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 -- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3838003fa0 msgr2=0x7f38541e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3838003fa0 0x7f38541e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 -- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c4270 msgr2=0x7f38540cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c4270 0x7f38540cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38540709c0 con 0x7f38540c4680 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3853200640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 0x7f38540cc610 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f3854075470 tx=0x7f384c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c013650 con 0x7f38540c4680 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f384c0138e0 con 0x7f38540c4680 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c013d30 con 0x7f38540c4680 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38540c96e0 con 0x7f38540c4680 2024-09-21T07:40:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38540c9ca0 con 0x7f38540c4680 2024-09-21T07:40:03.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38540ce600 con 0x7f38540c4680 2024-09-21T07:40:03.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.629+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f384c020470 con 0x7f38540c4680 2024-09-21T07:40:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073230 0x7f3830075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f384c098630 con 0x7f38540c4680 2024-09-21T07:40:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7f38300797c0 0x7f383007bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f384c017e70 con 0x7f38300797c0 2024-09-21T07:40:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7f384c0989e0 con 0x7f38540c4680 2024-09-21T07:40:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f3852800640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073230 0x7f3830075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f3849e00640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7f38300797c0 0x7f383007bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f3849e00640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7f38300797c0 0x7f383007bc50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f3852800640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073230 0x7f3830075740 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3844001250 tx=0x7f38440067b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:03.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.633+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== osd.0 v2:172.21.15.64:6816/3519639794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f384c017e70 con 0x7f38300797c0 2024-09-21T07:40:03.646 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.645+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 --> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38540b2d60 con 0x7f38300797c0 2024-09-21T07:40:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.645+0000 7f384b400640 1 -- 172.21.15.64:0/3673514685 <== osd.0 v2:172.21.15.64:6816/3519639794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f38540b2d60 con 0x7f38300797c0 2024-09-21T07:40:03.647 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:03.647 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:03.647 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7f38300797c0 msgr2=0x7f383007bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:6816/3519639794,v1:172.21.15.64:6817/3519639794] conn(0x7f38300797c0 0x7f383007bc50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073230 msgr2=0x7f3830075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3830073230 0x7f3830075740 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3844001250 tx=0x7f38440067b0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 msgr2=0x7f38540cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 --2- 172.21.15.64:0/3673514685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38540c4680 0x7f38540cc610 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f3854075470 tx=0x7f384c00f6c0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3853200640 1 -- 172.21.15.64:0/3673514685 reap_dead start 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 shutdown_connections 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 >> 172.21.15.64:0/3673514685 conn(0x7f38540b2f80 msgr2=0x7f38540b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 shutdown_connections 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.649+0000 7f3859400640 1 -- 172.21.15.64:0/3673514685 wait complete. 2024-09-21T07:40:03.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 -- 172.21.15.64:0/242913889 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163806f610 msgr2=0x7f1638165c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 --2- 172.21.15.64:0/242913889 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163806f610 0x7f1638165c40 secure :-1 s=READY pgs=2685 cs=0 l=1 rev1=1 crypto rx=0x7f163815eb60 tx=0x7f163001cac0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 -- 172.21.15.64:0/242913889 shutdown_connections 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 --2- 172.21.15.64:0/242913889 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f163806f610 0x7f1638165c40 unknown :-1 s=CLOSED pgs=2685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 --2- 172.21.15.64:0/242913889 >> v2:172.21.15.90:3300/0 conn(0x7f1638074af0 0x7f163806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 -- 172.21.15.64:0/242913889 >> 172.21.15.64:0/242913889 conn(0x7f163806d570 msgr2=0x7f16380b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 -- 172.21.15.64:0/242913889 shutdown_connections 2024-09-21T07:40:03.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.825+0000 7f163e000640 1 -- 172.21.15.64:0/242913889 wait complete. 2024-09-21T07:40:03.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 Processor -- start 2024-09-21T07:40:03.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 -- start start 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f163806f610 0x7f16381544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f163815af70 0x7f16381fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1638168b20 con 0x7f1638074af0 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16381689a0 con 0x7f163806f610 2024-09-21T07:40:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f1638168ca0 con 0x7f163815af70 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49884/0 (socket says 172.21.15.64:49884) 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 -- 172.21.15.64:0/3881448524 learned_addr learned my addr 172.21.15.64:0/3881448524 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1637400640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f163806f610 0x7f16381544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1637e00640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f163815af70 0x7f16381fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 -- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f163815af70 msgr2=0x7f16381fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f163815af70 0x7f16381fc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 -- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f163806f610 msgr2=0x7f16381544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:03.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f163806f610 0x7f16381544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 -- 172.21.15.64:0/3881448524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16380b1470 con 0x7f1638074af0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f1636a00640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f162400e7a0 tx=0x7f162400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162400ccc0 con 0x7f1638074af0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1624010430 con 0x7f1638074af0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.829+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1638158db0 con 0x7f1638074af0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.833+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1624010860 con 0x7f1638074af0 2024-09-21T07:40:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.833+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16380ad3a0 con 0x7f1638074af0 2024-09-21T07:40:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.833+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163806f0d0 con 0x7f1638074af0 2024-09-21T07:40:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.833+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1624010a00 con 0x7f1638074af0 2024-09-21T07:40:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.833+0000 7f162f400640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 0x7f1618075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.837+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f1624094c50 con 0x7f1638074af0 2024-09-21T07:40:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.837+0000 7f1637400640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 0x7f1618075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.837+0000 7f1637400640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 0x7f1618075710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1628001640 tx=0x7f1628009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:03.841+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f162405fcf0 con 0x7f1638074af0 2024-09-21T07:40:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1638158b60 con 0x7f1618073200 2024-09-21T07:40:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f162f400640 1 -- 172.21.15.64:0/3881448524 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1638158b60 con 0x7f1618073200 2024-09-21T07:40:04.020 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 msgr2=0x7f1618075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 0x7f1618075710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1628001640 tx=0x7f1628009040 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 msgr2=0x7f16381fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f162400e7a0 tx=0x7f162400ec60 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 shutdown_connections 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f1618073200 0x7f1618075710 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f163815af70 0x7f16381fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1638074af0 0x7f16381fbed0 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 --2- 172.21.15.64:0/3881448524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f163806f610 0x7f16381544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.023 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 >> 172.21.15.64:0/3881448524 conn(0x7f163806d570 msgr2=0x7f163815a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 shutdown_connections 2024-09-21T07:40:04.024 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.021+0000 7f163e000640 1 -- 172.21.15.64:0/3881448524 wait complete. 2024-09-21T07:40:04.044 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T07:40:04.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- 172.21.15.64:0/3468859866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce18004010 msgr2=0x7fce18004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 --2- 172.21.15.64:0/3468859866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce18004010 0x7fce18004810 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0016f0 tx=0x7fce1c01c5d0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce32800640 1 -- 172.21.15.64:0/3468859866 reap_dead start 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- 172.21.15.64:0/3468859866 shutdown_connections 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- 172.21.15.64:0/3468859866 >> 172.21.15.64:0/3468859866 conn(0x7fce3406d570 msgr2=0x7fce340b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- 172.21.15.64:0/3468859866 shutdown_connections 2024-09-21T07:40:04.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- 172.21.15.64:0/3468859866 wait complete. 2024-09-21T07:40:04.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 Processor -- start 2024-09-21T07:40:04.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.209+0000 7fce39000640 1 -- start start 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce18004010 0x7fce34157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce3415ebd0 0x7fce340c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 0x7fce340c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce340cba20 con 0x7fce340c7ce0 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce340afc10 con 0x7fce18004010 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fce340cbba0 con 0x7fce3415ebd0 2024-09-21T07:40:04.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 0x7fce340c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 0x7fce340c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49896/0 (socket says 172.21.15.64:49896) 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 -- 172.21.15.64:0/830413122 learned_addr learned my addr 172.21.15.64:0/830413122 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce31e00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce18004010 0x7fce34157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce2be00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce3415ebd0 0x7fce340c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 -- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce3415ebd0 msgr2=0x7fce340c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce3415ebd0 0x7fce340c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 -- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce18004010 msgr2=0x7fce34157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce18004010 0x7fce34157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340c9860 con 0x7fce340c7ce0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce2be00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fce3415ebd0 0x7fce340c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce32800640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 0x7fce340c80f0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7fce2c006fd0 tx=0x7fce2c012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c013860 con 0x7fce340c7ce0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce2c013a00 con 0x7fce340c7ce0 2024-09-21T07:40:04.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce340c9b40 con 0x7fce340c7ce0 2024-09-21T07:40:04.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c013df0 con 0x7fce340c7ce0 2024-09-21T07:40:04.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3415c0f0 con 0x7fce340c7ce0 2024-09-21T07:40:04.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.213+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce340cc0e0 con 0x7fce340c7ce0 2024-09-21T07:40:04.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce2c010480 con 0x7fce340c7ce0 2024-09-21T07:40:04.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce10073200 0x7fce10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fce2c097ee0 con 0x7fce340c7ce0 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7fce10079790 0x7fce1007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce2c015e50 con 0x7fce10079790 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fce2c09a500 con 0x7fce340c7ce0 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce31e00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce10073200 0x7fce10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2be00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7fce10079790 0x7fce1007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2be00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7fce10079790 0x7fce1007bc20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce31e00640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce10073200 0x7fce10075710 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fce24009ba0 tx=0x7fce240091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.217+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== osd.1 v2:172.21.15.64:6824/1622648472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce2c015e50 con 0x7fce10079790 2024-09-21T07:40:04.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 --> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fce340c9610 con 0x7fce10079790 2024-09-21T07:40:04.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce2a000640 1 -- 172.21.15.64:0/830413122 <== osd.1 v2:172.21.15.64:6824/1622648472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fce340c9610 con 0x7fce10079790 2024-09-21T07:40:04.233 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:04.233 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:04.233 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7fce10079790 msgr2=0x7fce1007bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:6824/1622648472,v1:172.21.15.64:6825/1622648472] conn(0x7fce10079790 0x7fce1007bc20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce10073200 msgr2=0x7fce10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fce10073200 0x7fce10075710 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fce24009ba0 tx=0x7fce240091e0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 msgr2=0x7fce340c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.234 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 --2- 172.21.15.64:0/830413122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce340c7ce0 0x7fce340c80f0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7fce2c006fd0 tx=0x7fce2c012870 comp rx=0 tx=0).stop 2024-09-21T07:40:04.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce32800640 1 -- 172.21.15.64:0/830413122 reap_dead start 2024-09-21T07:40:04.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 shutdown_connections 2024-09-21T07:40:04.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 >> 172.21.15.64:0/830413122 conn(0x7fce3406d570 msgr2=0x7fce34074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 shutdown_connections 2024-09-21T07:40:04.235 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.233+0000 7fce39000640 1 -- 172.21.15.64:0/830413122 wait complete. 2024-09-21T07:40:04.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.409+0000 7fe6ac000640 1 -- 172.21.15.64:0/2019372555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a406f610 msgr2=0x7fe6a40b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.409+0000 7fe6ac000640 1 --2- 172.21.15.64:0/2019372555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a406f610 0x7fe6a40b3170 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40cfff0 tx=0x7fe69001c730 comp rx=0 tx=0).stop 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- 172.21.15.64:0/2019372555 shutdown_connections 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 --2- 172.21.15.64:0/2019372555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a406f610 0x7fe6a40b3170 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 --2- 172.21.15.64:0/2019372555 >> v2:172.21.15.90:3300/0 conn(0x7fe6a415af70 0x7fe6a406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- 172.21.15.64:0/2019372555 >> 172.21.15.64:0/2019372555 conn(0x7fe6a406d570 msgr2=0x7fe6a40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- 172.21.15.64:0/2019372555 shutdown_connections 2024-09-21T07:40:04.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- 172.21.15.64:0/2019372555 wait complete. 2024-09-21T07:40:04.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 Processor -- start 2024-09-21T07:40:04.414 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- start start 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6a406f610 0x7fe6a409d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 0x7fe6a409a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4167dd0 con 0x7fe6a40b36b0 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4167c50 con 0x7fe6a406f610 2024-09-21T07:40:04.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.413+0000 7fe6ac000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a4167f50 con 0x7fe6a415af70 2024-09-21T07:40:04.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49906/0 (socket says 172.21.15.64:49906) 2024-09-21T07:40:04.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 -- 172.21.15.64:0/789778504 learned_addr learned my addr 172.21.15.64:0/789778504 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a9600640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6a406f610 0x7fe6a409d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6aa000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 0x7fe6a409a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 -- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 msgr2=0x7fe6a409a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 0x7fe6a409a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 -- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6a406f610 msgr2=0x7fe6a409d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6a406f610 0x7fe6a409d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 -- 172.21.15.64:0/789778504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a4157f10 con 0x7fe6a40b36b0 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6aa000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 0x7fe6a409a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a8c00640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7fe690098330 tx=0x7fe6900a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900b2040 con 0x7fe6a40b36b0 2024-09-21T07:40:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6900bb070 con 0x7fe6a40b36b0 2024-09-21T07:40:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a41596d0 con 0x7fe6a40b36b0 2024-09-21T07:40:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690004370 con 0x7fe6a40b36b0 2024-09-21T07:40:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a4159c50 con 0x7fe6a40b36b0 2024-09-21T07:40:04.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a40b3170 con 0x7fe6a40b36b0 2024-09-21T07:40:04.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.417+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe690003600 con 0x7fe6a40b36b0 2024-09-21T07:40:04.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.421+0000 7fe6a1600640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 0x7fe684075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.421+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fe69012e5b0 con 0x7fe6a40b36b0 2024-09-21T07:40:04.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.421+0000 7fe6a9600640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 0x7fe684075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.421+0000 7fe6a9600640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 0x7fe684075710 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a580 tx=0x7fe698010040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.424 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.425+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe690016410 con 0x7fe6a40b36b0 2024-09-21T07:40:04.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.601+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe6a40c5540 con 0x7fe684073200 2024-09-21T07:40:04.601 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.601+0000 7fe6a1600640 1 -- 172.21.15.64:0/789778504 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe6a40c5540 con 0x7fe684073200 2024-09-21T07:40:04.601 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 msgr2=0x7fe684075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 0x7fe684075710 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a580 tx=0x7fe698010040 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 msgr2=0x7fe6a40c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7fe690098330 tx=0x7fe6900a5f90 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 shutdown_connections 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe684073200 0x7fe684075710 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe6a415af70 0x7fe6a409a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6a40b36b0 0x7fe6a40c5000 unknown :-1 s=CLOSED pgs=2691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 --2- 172.21.15.64:0/789778504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6a406f610 0x7fe6a409d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.604 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 >> 172.21.15.64:0/789778504 conn(0x7fe6a406d570 msgr2=0x7fe6a4153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 shutdown_connections 2024-09-21T07:40:04.605 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.605+0000 7fe6ac000640 1 -- 172.21.15.64:0/789778504 wait complete. 2024-09-21T07:40:04.624 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T07:40:04.624 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 -- 172.21.15.64:0/4082035607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 msgr2=0x7ff3f40d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 --2- 172.21.15.64:0/4082035607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f40d0ad0 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40b3f50 tx=0x7ff3e801c810 comp rx=0 tx=0).stop 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 -- 172.21.15.64:0/4082035607 shutdown_connections 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 --2- 172.21.15.64:0/4082035607 >> v2:172.21.15.90:3300/0 conn(0x7ff3f41612a0 0x7ff3f40b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 --2- 172.21.15.64:0/4082035607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f4160950 0x7ff3f4160d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 --2- 172.21.15.64:0/4082035607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f40d0ad0 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 -- 172.21.15.64:0/4082035607 >> 172.21.15.64:0/4082035607 conn(0x7ff3f40cef10 msgr2=0x7ff3f40cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 -- 172.21.15.64:0/4082035607 shutdown_connections 2024-09-21T07:40:04.787 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.785+0000 7ff3fc400640 1 -- 172.21.15.64:0/4082035607 wait complete. 2024-09-21T07:40:04.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 Processor -- start 2024-09-21T07:40:04.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 -- start start 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f41600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f4160950 0x7ff3f41fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f41612a0 0x7ff3f41fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40d1190 con 0x7ff3f40b7a50 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40d1010 con 0x7ff3f4160950 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fc400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f40b7e60 con 0x7ff3f41612a0 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f41600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.791 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f41600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49916/0 (socket says 172.21.15.64:49916) 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 -- 172.21.15.64:0/1561595324 learned_addr learned my addr 172.21.15.64:0/1561595324 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9000640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f4160950 0x7ff3f41fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fa400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f41612a0 0x7ff3f41fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 -- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f41612a0 msgr2=0x7ff3f41fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f41612a0 0x7ff3f41fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 -- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f4160950 msgr2=0x7ff3f41fc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3f4160950 0x7ff3f41fc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3f9a00640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f4159f40 con 0x7ff3f40b7a50 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.789+0000 7ff3fa400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff3f41612a0 0x7ff3f41fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:04.792 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f9a00640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f41600c0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7ff3e801aec0 tx=0x7ff3e8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80b2040 con 0x7ff3f40b7a50 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e80bb070 con 0x7ff3f40b7a50 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f4161a90 con 0x7ff3f40b7a50 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80043b0 con 0x7ff3f40b7a50 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f415de30 con 0x7ff3f40b7a50 2024-09-21T07:40:04.793 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3f415e210 con 0x7ff3f40b7a50 2024-09-21T07:40:04.794 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3e8003600 con 0x7ff3f40b7a50 2024-09-21T07:40:04.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d4073200 0x7ff3d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7ff3e812ec60 con 0x7ff3f40b7a50 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7ff3d4079790 0x7ff3d407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3e80a5890 con 0x7ff3d4079790 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7ff3e812f0f0 con 0x7ff3f40b7a50 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.793+0000 7ff3f9000640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d4073200 0x7ff3d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.797+0000 7ff3fa400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7ff3d4079790 0x7ff3d407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.797+0000 7ff3fa400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7ff3d4079790 0x7ff3d407bc20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.796 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.797+0000 7ff3f9000640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d4073200 0x7ff3d4075710 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff3f415dd20 tx=0x7ff3e00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.797 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.797+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== osd.2 v2:172.21.15.64:6808/3196938996 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3e80a5890 con 0x7ff3d4079790 2024-09-21T07:40:04.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 --> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff3f40d20f0 con 0x7ff3d4079790 2024-09-21T07:40:04.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3f1600640 1 -- 172.21.15.64:0/1561595324 <== osd.2 v2:172.21.15.64:6808/3196938996 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff3f40d20f0 con 0x7ff3d4079790 2024-09-21T07:40:04.810 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:04.811 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:04.811 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:04.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7ff3d4079790 msgr2=0x7ff3d407bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:6808/3196938996,v1:172.21.15.64:6809/3196938996] conn(0x7ff3d4079790 0x7ff3d407bc20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d4073200 msgr2=0x7ff3d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff3d4073200 0x7ff3d4075710 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff3f415dd20 tx=0x7ff3e00091e0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 msgr2=0x7ff3f41600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 --2- 172.21.15.64:0/1561595324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3f40b7a50 0x7ff3f41600c0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7ff3e801aec0 tx=0x7ff3e8005760 comp rx=0 tx=0).stop 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fa400640 1 -- 172.21.15.64:0/1561595324 reap_dead start 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 shutdown_connections 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 >> 172.21.15.64:0/1561595324 conn(0x7ff3f40cef10 msgr2=0x7ff3f4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 shutdown_connections 2024-09-21T07:40:04.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.809+0000 7ff3fc400640 1 -- 172.21.15.64:0/1561595324 wait complete. 2024-09-21T07:40:04.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- 172.21.15.64:0/453125721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b28e0 msgr2=0x7f61ac15c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 --2- 172.21.15.64:0/453125721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b28e0 0x7f61ac15c6f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f619c009840 tx=0x7f619c01c820 comp rx=0 tx=0).stop 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- 172.21.15.64:0/453125721 shutdown_connections 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 --2- 172.21.15.64:0/453125721 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b3170 0x7f61ac0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 --2- 172.21.15.64:0/453125721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b28e0 0x7f61ac15c6f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.989 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- 172.21.15.64:0/453125721 >> 172.21.15.64:0/453125721 conn(0x7f61ac06d570 msgr2=0x7f61ac0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:04.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- 172.21.15.64:0/453125721 shutdown_connections 2024-09-21T07:40:04.990 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- 172.21.15.64:0/453125721 wait complete. 2024-09-21T07:40:04.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 Processor -- start 2024-09-21T07:40:04.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.989+0000 7f61b3400640 1 -- start start 2024-09-21T07:40:04.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b28e0 0x7f61ac1f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b3170 0x7f61ac1f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac169f80 con 0x7f61ac0ccd30 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac169e00 con 0x7f61ac0b3170 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac16a100 con 0x7f61ac0b28e0 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41448/0 (socket says 172.21.15.64:41448) 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 -- 172.21.15.64:0/1263133879 learned_addr learned my addr 172.21.15.64:0/1263133879 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b0a00640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b28e0 0x7f61ac1f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61a3e00640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b3170 0x7f61ac1f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 -- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b28e0 msgr2=0x7f61ac1f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b28e0 0x7f61ac1f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 -- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b3170 msgr2=0x7f61ac1f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:04.994 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b3170 0x7f61ac1f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:04.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 -- 172.21.15.64:0/1263133879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac15b140 con 0x7f61ac0ccd30 2024-09-21T07:40:04.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b1400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cb10 tx=0x7f61a400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:04.995 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4016020 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac15b420 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a400ce50 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a400ade0 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac1f9e70 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.993+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac15c6f0 con 0x7f61ac0ccd30 2024-09-21T07:40:04.996 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.997+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f61a4019020 con 0x7f61ac0ccd30 2024-09-21T07:40:04.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.997+0000 7f61a9600640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 0x7f6188075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:04.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.997+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f61a4094310 con 0x7f61ac0ccd30 2024-09-21T07:40:04.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.997+0000 7f61b0a00640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 0x7f6188075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:04.999 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:04.997+0000 7f61b0a00640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 0x7f6188075740 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c01b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.001+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f61a4020020 con 0x7f61ac0ccd30 2024-09-21T07:40:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.177+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f61ac0cc940 con 0x7f6188073230 2024-09-21T07:40:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.177+0000 7f61a9600640 1 -- 172.21.15.64:0/1263133879 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f61ac0cc940 con 0x7f6188073230 2024-09-21T07:40:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T07:40:05.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 msgr2=0x7f6188075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 0x7f6188075740 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c01b060 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 msgr2=0x7f61ac1fa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cb10 tx=0x7f61a400cc00 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 shutdown_connections 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6188073230 0x7f6188075740 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61ac0ccd30 0x7f61ac1fa0e0 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61ac0b3170 0x7f61ac1f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 --2- 172.21.15.64:0/1263133879 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61ac0b28e0 0x7f61ac1f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 >> 172.21.15.64:0/1263133879 conn(0x7f61ac06d570 msgr2=0x7f61ac0ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 shutdown_connections 2024-09-21T07:40:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.181+0000 7f61b3400640 1 -- 172.21.15.64:0/1263133879 wait complete. 2024-09-21T07:40:05.200 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T07:40:05.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:05.363 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 -- 172.21.15.64:0/18538135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d0d30 msgr2=0x7f298c0d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 --2- 172.21.15.64:0/18538135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d0d30 0x7f298c0d1140 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7f298c075000 tx=0x7f297401c5e0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 -- 172.21.15.64:0/18538135 shutdown_connections 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 --2- 172.21.15.64:0/18538135 >> v2:172.21.15.90:3300/0 conn(0x7f298c0d1680 0x7f298c160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 --2- 172.21.15.64:0/18538135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d0d30 0x7f298c0d1140 unknown :-1 s=CLOSED pgs=2695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 --2- 172.21.15.64:0/18538135 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 0x7f298c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 -- 172.21.15.64:0/18538135 >> 172.21.15.64:0/18538135 conn(0x7f298c071150 msgr2=0x7f298c071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 -- 172.21.15.64:0/18538135 shutdown_connections 2024-09-21T07:40:05.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.361+0000 7f298be00640 1 -- 172.21.15.64:0/18538135 wait complete. 2024-09-21T07:40:05.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 Processor -- start 2024-09-21T07:40:05.365 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 -- start start 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0d0d30 0x7f298c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 0x7f298c0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 0x7f298c0b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0cf400 con 0x7f298c0d1680 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0cf280 con 0x7f298c0d0d30 2024-09-21T07:40:05.369 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298be00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0cf580 con 0x7f298c15c720 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f2982000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 0x7f298c0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f2982000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 0x7f298c0b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41470/0 (socket says 172.21.15.64:41470) 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f2982000640 1 -- 172.21.15.64:0/1961762391 learned_addr learned my addr 172.21.15.64:0/1961762391 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.365+0000 7f298aa00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0d0d30 0x7f298c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f298b400640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 0x7f298c0b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 -- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 msgr2=0x7f298c0b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 0x7f298c0b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 -- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0d0d30 msgr2=0x7f298c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0d0d30 0x7f298c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c1f9330 con 0x7f298c0d1680 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f298b400640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f298c15c720 0x7f298c0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2982000640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 0x7f298c0b6590 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f2974009850 tx=0x7f29740a9570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740ad070 con 0x7f298c0d1680 2024-09-21T07:40:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29740a9db0 con 0x7f298c0d1680 2024-09-21T07:40:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974005280 con 0x7f298c0d1680 2024-09-21T07:40:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c0b1460 con 0x7f298c0d1680 2024-09-21T07:40:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c1f95d0 con 0x7f298c0d1680 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f298c0ca0b0 con 0x7f298c0d1680 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.369+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f29740b0070 con 0x7f298c0d1680 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2968073200 0x7f2968075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f297412de80 con 0x7f298c0d1680 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f2968079790 0x7f296807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29740abe50 con 0x7f2968079790 2024-09-21T07:40:05.373 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7f29741304a0 con 0x7f298c0d1680 2024-09-21T07:40:05.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f298aa00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2968073200 0x7f2968075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f298b400640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f2968079790 0x7f296807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f298aa00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2968073200 0x7f2968075710 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f297c005fd0 tx=0x7f297c00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f298b400640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f2968079790 0x7f296807bc20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.373+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== osd.3 v2:172.21.15.64:6800/2986416528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29740abe50 con 0x7f2968079790 2024-09-21T07:40:05.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.385+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 --> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f298c1f9810 con 0x7f2968079790 2024-09-21T07:40:05.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.385+0000 7f2983e00640 1 -- 172.21.15.64:0/1961762391 <== osd.3 v2:172.21.15.64:6800/2986416528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f298c1f9810 con 0x7f2968079790 2024-09-21T07:40:05.387 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:05.388 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:05.388 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.385+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f2968079790 msgr2=0x7f296807bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.385+0000 7f298be00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:6800/2986416528,v1:172.21.15.64:6801/2986416528] conn(0x7f2968079790 0x7f296807bc20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2968073200 msgr2=0x7f2968075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2968073200 0x7f2968075710 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f297c005fd0 tx=0x7f297c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 msgr2=0x7f298c0b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 --2- 172.21.15.64:0/1961762391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f298c0d1680 0x7f298c0b6590 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f2974009850 tx=0x7f29740a9570 comp rx=0 tx=0).stop 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298b400640 1 -- 172.21.15.64:0/1961762391 reap_dead start 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 shutdown_connections 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 >> 172.21.15.64:0/1961762391 conn(0x7f298c071150 msgr2=0x7f298c068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 shutdown_connections 2024-09-21T07:40:05.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.389+0000 7f298be00640 1 -- 172.21.15.64:0/1961762391 wait complete. 2024-09-21T07:40:05.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T07:40:05.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 -- 172.21.15.64:0/2535160706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b40caf00 msgr2=0x7f73b40cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 --2- 172.21.15.64:0/2535160706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b40caf00 0x7f73b40cb310 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7f73b40725c0 tx=0x7f73ac01cb80 comp rx=0 tx=0).stop 2024-09-21T07:40:05.566 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 -- 172.21.15.64:0/2535160706 shutdown_connections 2024-09-21T07:40:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 --2- 172.21.15.64:0/2535160706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b40caf00 0x7f73b40cb310 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 --2- 172.21.15.64:0/2535160706 >> v2:172.21.15.90:3300/0 conn(0x7f73b40b4e00 0x7f73b40af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 -- 172.21.15.64:0/2535160706 >> 172.21.15.64:0/2535160706 conn(0x7f73b406d570 msgr2=0x7f73b40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 -- 172.21.15.64:0/2535160706 shutdown_connections 2024-09-21T07:40:05.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.565+0000 7f73ba200640 1 -- 172.21.15.64:0/2535160706 wait complete. 2024-09-21T07:40:05.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 Processor -- start 2024-09-21T07:40:05.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- start start 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73b40caf00 0x7f73b40b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73b414e860 0x7f73b40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4168e10 con 0x7f73b406fae0 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4168c90 con 0x7f73b414e860 2024-09-21T07:40:05.571 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f73b4168f90 con 0x7f73b40caf00 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41490/0 (socket says 172.21.15.64:41490) 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 -- 172.21.15.64:0/3879433387 learned_addr learned my addr 172.21.15.64:0/3879433387 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73abe00640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73b40caf00 0x7f73b40b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3e00640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73b414e860 0x7f73b40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 -- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73b40caf00 msgr2=0x7f73b40b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73b40caf00 0x7f73b40b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 -- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73b414e860 msgr2=0x7f73b40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73b414e860 0x7f73b40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 -- 172.21.15.64:0/3879433387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b40c9530 con 0x7f73b406fae0 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73b3400640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c430 tx=0x7f73a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.572 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4011790 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a4017070 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b40c9810 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4011ce0 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.569+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b40c9dd0 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b40c9290 con 0x7f73b406fae0 2024-09-21T07:40:05.573 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f73a401c460 con 0x7f73b406fae0 2024-09-21T07:40:05.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73ab400640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 0x7f7390075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f73a4093e30 con 0x7f73b406fae0 2024-09-21T07:40:05.574 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73abe00640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 0x7f7390075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.575 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.573+0000 7f73abe00640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 0x7f7390075710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f73b40ae980 tx=0x7f739c00b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.578 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.577+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f73b40c9290 con 0x7f73b406fae0 2024-09-21T07:40:05.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f73b40cc6a0 con 0x7f7390073200 2024-09-21T07:40:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ab400640 1 -- 172.21.15.64:0/3879433387 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f73b40cc6a0 con 0x7f7390073200 2024-09-21T07:40:05.757 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T07:40:05.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 msgr2=0x7f7390075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 0x7f7390075710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f73b40ae980 tx=0x7f739c00b390 comp rx=0 tx=0).stop 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 msgr2=0x7f73b40c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c430 tx=0x7f73a400c8f0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 shutdown_connections 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f7390073200 0x7f7390075710 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73b414e860 0x7f73b40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73b40caf00 0x7f73b40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 --2- 172.21.15.64:0/3879433387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73b406fae0 0x7f73b40c62a0 unknown :-1 s=CLOSED pgs=2699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 >> 172.21.15.64:0/3879433387 conn(0x7f73b406d570 msgr2=0x7f73b415aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.757+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 shutdown_connections 2024-09-21T07:40:05.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.761+0000 7f73ba200640 1 -- 172.21.15.64:0/3879433387 wait complete. 2024-09-21T07:40:05.780 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T07:40:05.781 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:05.944 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- 172.21.15.64:0/3211581584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc414003c40 msgr2=0x7fc414004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 --2- 172.21.15.64:0/3211581584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc414003c40 0x7fc414004090 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fa0 tx=0x7fc42001f680 comp rx=0 tx=0).stop 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- 172.21.15.64:0/3211581584 shutdown_connections 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 --2- 172.21.15.64:0/3211581584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc414003c40 0x7fc414004090 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- 172.21.15.64:0/3211581584 >> 172.21.15.64:0/3211581584 conn(0x7fc42c06d570 msgr2=0x7fc42c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- 172.21.15.64:0/3211581584 shutdown_connections 2024-09-21T07:40:05.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- 172.21.15.64:0/3211581584 wait complete. 2024-09-21T07:40:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 Processor -- start 2024-09-21T07:40:05.947 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.945+0000 7fc434600640 1 -- start start 2024-09-21T07:40:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 0x7fc42c0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc42c0ad150 0x7fc42c0ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc42c0adaa0 0x7fc42c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0b4a80 con 0x7fc414003c40 2024-09-21T07:40:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0b4900 con 0x7fc42c0adaa0 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0b4c00 con 0x7fc42c0ad150 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 0x7fc42c0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 0x7fc42c0aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41510/0 (socket says 172.21.15.64:41510) 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 -- 172.21.15.64:0/515331499 learned_addr learned my addr 172.21.15.64:0/515331499 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431200640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc42c0ad150 0x7fc42c0ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc432600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc42c0adaa0 0x7fc42c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 -- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc42c0ad150 msgr2=0x7fc42c0ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc42c0ad150 0x7fc42c0ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 -- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc42c0adaa0 msgr2=0x7fc42c0c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc42c0adaa0 0x7fc42c0c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c15ed90 con 0x7fc414003c40 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc432600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc42c0adaa0 0x7fc42c0c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc431c00640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 0x7fc42c0aeba0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b1040 tx=0x7fc420006bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420006440 con 0x7fc414003c40 2024-09-21T07:40:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc420003600 con 0x7fc414003c40 2024-09-21T07:40:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c0c91a0 con 0x7fc414003c40 2024-09-21T07:40:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420003a30 con 0x7fc414003c40 2024-09-21T07:40:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c0c9760 con 0x7fc414003c40 2024-09-21T07:40:05.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.949+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc42c0b3170 con 0x7fc414003c40 2024-09-21T07:40:05.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4200c0030 con 0x7fc414003c40 2024-09-21T07:40:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc40c073200 0x7fc40c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fc420132b70 con 0x7fc414003c40 2024-09-21T07:40:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7fc40c079790 0x7fc40c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4200cbe50 con 0x7fc40c079790 2024-09-21T07:40:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fc420132f20 con 0x7fc414003c40 2024-09-21T07:40:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc431200640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc40c073200 0x7fc40c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc432600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7fc40c079790 0x7fc40c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc431200640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc40c073200 0x7fc40c075710 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0c68a0 tx=0x7fc418001ac0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.953+0000 7fc432600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7fc40c079790 0x7fc40c07bc20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.957+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== osd.4 v2:172.21.15.90:6810/2460854441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4200cbe50 con 0x7fc40c079790 2024-09-21T07:40:05.969 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 --> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc42c0cbee0 con 0x7fc40c079790 2024-09-21T07:40:05.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc429600640 1 -- 172.21.15.64:0/515331499 <== osd.4 v2:172.21.15.90:6810/2460854441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc42c0cbee0 con 0x7fc40c079790 2024-09-21T07:40:05.970 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:05.970 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:05.970 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:05.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7fc40c079790 msgr2=0x7fc40c07bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6810/2460854441,v1:172.21.15.90:6811/2460854441] conn(0x7fc40c079790 0x7fc40c07bc20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc40c073200 msgr2=0x7fc40c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc40c073200 0x7fc40c075710 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0c68a0 tx=0x7fc418001ac0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 msgr2=0x7fc42c0aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 --2- 172.21.15.64:0/515331499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc414003c40 0x7fc42c0aeba0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b1040 tx=0x7fc420006bc0 comp rx=0 tx=0).stop 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc432600640 1 -- 172.21.15.64:0/515331499 reap_dead start 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 shutdown_connections 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 >> 172.21.15.64:0/515331499 conn(0x7fc42c06d570 msgr2=0x7fc42c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 shutdown_connections 2024-09-21T07:40:05.972 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:05.969+0000 7fc434600640 1 -- 172.21.15.64:0/515331499 wait complete. 2024-09-21T07:40:05.989 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- 172.21.15.64:0/4065341388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 msgr2=0x7fe94406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 --2- 172.21.15.64:0/4065341388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe94406f0d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe9440cfff0 tx=0x7fe93401c730 comp rx=0 tx=0).stop 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- 172.21.15.64:0/4065341388 shutdown_connections 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 --2- 172.21.15.64:0/4065341388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 0x7fe9440b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 --2- 172.21.15.64:0/4065341388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe94406f0d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- 172.21.15.64:0/4065341388 >> 172.21.15.64:0/4065341388 conn(0x7fe94406d570 msgr2=0x7fe9440b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.152 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- 172.21.15.64:0/4065341388 shutdown_connections 2024-09-21T07:40:06.153 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- 172.21.15.64:0/4065341388 wait complete. 2024-09-21T07:40:06.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 Processor -- start 2024-09-21T07:40:06.154 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.153+0000 7fe94b200640 1 -- start start 2024-09-21T07:40:06.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 0x7fe9440ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe9441f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe944167e60 con 0x7fe9440b36b0 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9440b4420 con 0x7fe94415af70 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe944167fe0 con 0x7fe94406f610 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41518/0 (socket says 172.21.15.64:41518) 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 -- 172.21.15.64:0/62076664 learned_addr learned my addr 172.21.15.64:0/62076664 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe943e00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 0x7fe9440ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe949200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe9441f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 -- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 msgr2=0x7fe9440ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 0x7fe9440ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 -- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 msgr2=0x7fe9441f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe9441f94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 -- 172.21.15.64:0/62076664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9441f8d40 con 0x7fe9440b36b0 2024-09-21T07:40:06.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe949200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe9441f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:06.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe93be00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00e970 tx=0x7fe92c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00cd80 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe92c004020 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9440ad690 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c004470 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9441f8fb0 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9440b3170 con 0x7fe9440b36b0 2024-09-21T07:40:06.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.157+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe92c003600 con 0x7fe9440b36b0 2024-09-21T07:40:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.161+0000 7fe940c00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 0x7fe920075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.161+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fe92c094aa0 con 0x7fe9440b36b0 2024-09-21T07:40:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.161+0000 7fe943e00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 0x7fe920075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.161+0000 7fe943e00640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 0x7fe920075710 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe9340af000 tx=0x7fe93401afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.164 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.165+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fe92c05fbd0 con 0x7fe9440b36b0 2024-09-21T07:40:06.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.341+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe9440aef70 con 0x7fe920073200 2024-09-21T07:40:06.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.341+0000 7fe940c00640 1 -- 172.21.15.64:0/62076664 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9440aef70 con 0x7fe920073200 2024-09-21T07:40:06.342 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 msgr2=0x7fe920075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 0x7fe920075710 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe9340af000 tx=0x7fe93401afd0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 msgr2=0x7fe9441535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00e970 tx=0x7fe92c00ee30 comp rx=0 tx=0).stop 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 shutdown_connections 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe920073200 0x7fe920075710 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94415af70 0x7fe9441f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9440b36b0 0x7fe9441535b0 unknown :-1 s=CLOSED pgs=2702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 --2- 172.21.15.64:0/62076664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe94406f610 0x7fe9440ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 >> 172.21.15.64:0/62076664 conn(0x7fe94406d570 msgr2=0x7fe9440992f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 shutdown_connections 2024-09-21T07:40:06.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.345+0000 7fe94b200640 1 -- 172.21.15.64:0/62076664 wait complete. 2024-09-21T07:40:06.364 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T07:40:06.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:06.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- 172.21.15.64:0/2104917629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe0c0062e0 msgr2=0x7fbe0c00cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 --2- 172.21.15.64:0/2104917629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe0c0062e0 0x7fbe0c00cae0 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7fbe20001e60 tx=0x7fbe2001cc00 comp rx=0 tx=0).stop 2024-09-21T07:40:06.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- 172.21.15.64:0/2104917629 shutdown_connections 2024-09-21T07:40:06.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 --2- 172.21.15.64:0/2104917629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe0c0062e0 0x7fbe0c00cae0 unknown :-1 s=CLOSED pgs=2704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- 172.21.15.64:0/2104917629 >> 172.21.15.64:0/2104917629 conn(0x7fbe2806d570 msgr2=0x7fbe280b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- 172.21.15.64:0/2104917629 shutdown_connections 2024-09-21T07:40:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- 172.21.15.64:0/2104917629 wait complete. 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 Processor -- start 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.529+0000 7fbe2e200640 1 -- start start 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe0c0062e0 0x7fbe2815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe281ecfe0 0x7fbe281587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 0x7fbe28157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2806f250 con 0x7fbe28158d30 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2806f0d0 con 0x7fbe281ecfe0 2024-09-21T07:40:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2806f3d0 con 0x7fbe0c0062e0 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 0x7fbe28157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 0x7fbe28157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41524/0 (socket says 172.21.15.64:41524) 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 -- 172.21.15.64:0/1451861966 learned_addr learned my addr 172.21.15.64:0/1451861966 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe1fe00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe281ecfe0 0x7fbe281587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe0c0062e0 0x7fbe2815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 -- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe0c0062e0 msgr2=0x7fbe2815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe0c0062e0 0x7fbe2815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 -- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe281ecfe0 msgr2=0x7fbe281587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe281ecfe0 0x7fbe281587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe281f3670 con 0x7fbe28158d30 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe1fe00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe281ecfe0 0x7fbe281587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe0c0062e0 0x7fbe2815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe27e00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 0x7fbe28157340 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7fbe2001ca30 tx=0x7fbe200015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20006c50 con 0x7fbe28158d30 2024-09-21T07:40:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe200b9070 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20006470 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe281f3950 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe281f3f10 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.533+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe28156ef0 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbe20006610 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbe04073200 0x7fbe04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fbe2012f300 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7fbe04079790 0x7fbe0407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe200ade90 con 0x7fbe04079790 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fbe2012f6b0 con 0x7fbe28158d30 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe27400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbe04073200 0x7fbe04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1fe00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7fbe04079790 0x7fbe0407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe27400640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbe04073200 0x7fbe04075710 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbe280b4830 tx=0x7fbe180067e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.537+0000 7fbe1fe00640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7fbe04079790 0x7fbe0407bc20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.541+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== osd.5 v2:172.21.15.90:6826/3363919567 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe200ade90 con 0x7fbe04079790 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 --> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe280b2660 con 0x7fbe04079790 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe1f400640 1 -- 172.21.15.64:0/1451861966 <== osd.5 v2:172.21.15.90:6826/3363919567 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe280b2660 con 0x7fbe04079790 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:06.593 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:06.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7fbe04079790 msgr2=0x7fbe0407bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.594 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6826/3363919567,v1:172.21.15.90:6827/3363919567] conn(0x7fbe04079790 0x7fbe0407bc20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbe04073200 msgr2=0x7fbe04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbe04073200 0x7fbe04075710 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbe280b4830 tx=0x7fbe180067e0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 msgr2=0x7fbe28157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 --2- 172.21.15.64:0/1451861966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe28158d30 0x7fbe28157340 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7fbe2001ca30 tx=0x7fbe200015a0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe27e00640 1 -- 172.21.15.64:0/1451861966 reap_dead start 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 shutdown_connections 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 >> 172.21.15.64:0/1451861966 conn(0x7fbe2806d570 msgr2=0x7fbe280b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 shutdown_connections 2024-09-21T07:40:06.595 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.553+0000 7fbe2e200640 1 -- 172.21.15.64:0/1451861966 wait complete. 2024-09-21T07:40:06.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- 172.21.15.64:0/3214750535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64071680 msgr2=0x7f6a64071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 --2- 172.21.15.64:0/3214750535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64071680 0x7f6a64071a90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009870 tx=0x7f6a4c01c620 comp rx=0 tx=0).stop 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- 172.21.15.64:0/3214750535 shutdown_connections 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 --2- 172.21.15.64:0/3214750535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64151d90 0x7f6a641521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 --2- 172.21.15.64:0/3214750535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64071680 0x7f6a64071a90 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- 172.21.15.64:0/3214750535 >> 172.21.15.64:0/3214750535 conn(0x7f6a640b29e0 msgr2=0x7f6a640b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- 172.21.15.64:0/3214750535 shutdown_connections 2024-09-21T07:40:06.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- 172.21.15.64:0/3214750535 wait complete. 2024-09-21T07:40:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 Processor -- start 2024-09-21T07:40:06.758 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.757+0000 7f6a69a00640 1 -- start start 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 0x7f6a64141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64151d90 0x7f6a64160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640b4ea0 con 0x7f6a6415fc60 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640b4d20 con 0x7f6a64151d90 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f6a640b5020 con 0x7f6a64071680 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41540/0 (socket says 172.21.15.64:41540) 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 -- 172.21.15.64:0/567192955 learned_addr learned my addr 172.21.15.64:0/567192955 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a62a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 0x7f6a64141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.760 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a5a000640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64151d90 0x7f6a64160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 -- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 msgr2=0x7f6a64141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 0x7f6a64141440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.761 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 -- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64151d90 msgr2=0x7f6a64160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64151d90 0x7f6a64160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 -- 172.21.15.64:0/567192955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a641faf80 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a62a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 0x7f6a64141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a63400640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00ea80 tx=0x7f6a5c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c004b30 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a5c004cf0 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a641fb220 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c005280 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6414fe90 con 0x7f6a6415fc60 2024-09-21T07:40:06.762 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.761+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a64150170 con 0x7f6a6415fc60 2024-09-21T07:40:06.763 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6a5c005420 con 0x7f6a6415fc60 2024-09-21T07:40:06.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a5b400640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 0x7f6a40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:06.764 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f6a5c095100 con 0x7f6a6415fc60 2024-09-21T07:40:06.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a62a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 0x7f6a40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:06.765 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a62a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 0x7f6a40075710 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007d90 tx=0x7f6a540012e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:06.767 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.765+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f6a5c05fc60 con 0x7f6a6415fc60 2024-09-21T07:40:06.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.945+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6a640cd070 con 0x7f6a40073200 2024-09-21T07:40:06.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.945+0000 7f6a5b400640 1 -- 172.21.15.64:0/567192955 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a640cd070 con 0x7f6a40073200 2024-09-21T07:40:06.946 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 msgr2=0x7f6a40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 0x7f6a40075710 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007d90 tx=0x7f6a540012e0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 msgr2=0x7f6a64160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00ea80 tx=0x7f6a5c00ef40 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 shutdown_connections 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f6a40073200 0x7f6a40075710 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a6415fc60 0x7f6a64160f40 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a64151d90 0x7f6a64160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 --2- 172.21.15.64:0/567192955 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6a64071680 0x7f6a64141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 >> 172.21.15.64:0/567192955 conn(0x7f6a640b29e0 msgr2=0x7f6a6415a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 shutdown_connections 2024-09-21T07:40:06.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:06.949+0000 7f6a69a00640 1 -- 172.21.15.64:0/567192955 wait complete. 2024-09-21T07:40:06.969 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T07:40:06.969 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 -- 172.21.15.64:0/3511023541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe67806d540 msgr2=0x7fe6780cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 --2- 172.21.15.64:0/3511023541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe67806d540 0x7fe6780cd150 secure :-1 s=READY pgs=2709 cs=0 l=1 rev1=1 crypto rx=0x7fe6780b0a00 tx=0x7fe66001c6e0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 -- 172.21.15.64:0/3511023541 shutdown_connections 2024-09-21T07:40:07.131 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 --2- 172.21.15.64:0/3511023541 >> v2:172.21.15.90:3300/0 conn(0x7fe67806d950 0x7fe6780cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 --2- 172.21.15.64:0/3511023541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe67806d540 0x7fe6780cd150 unknown :-1 s=CLOSED pgs=2709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 -- 172.21.15.64:0/3511023541 >> 172.21.15.64:0/3511023541 conn(0x7fe6780d1430 msgr2=0x7fe6780d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 -- 172.21.15.64:0/3511023541 shutdown_connections 2024-09-21T07:40:07.132 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.129+0000 7fe67f800640 1 -- 172.21.15.64:0/3511023541 wait complete. 2024-09-21T07:40:07.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 Processor -- start 2024-09-21T07:40:07.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 -- start start 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67806d540 0x7fe6781fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67806d950 0x7fe6781f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 0x7fe678165ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe678169f00 con 0x7fe6780b6950 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe678169d80 con 0x7fe67806d950 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67f800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fe67816a080 con 0x7fe67806d540 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 0x7fe678165ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.133+0000 7fe67d800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 0x7fe678165ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41558/0 (socket says 172.21.15.64:41558) 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 -- 172.21.15.64:0/1379573989 learned_addr learned my addr 172.21.15.64:0/1379573989 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:07.136 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe66fe00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67806d950 0x7fe6781f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67ce00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67806d540 0x7fe6781fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 -- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67806d540 msgr2=0x7fe6781fc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67806d540 0x7fe6781fc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 -- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67806d950 msgr2=0x7fe6781f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67806d950 0x7fe6781f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67809eb50 con 0x7fe6780b6950 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67ce00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67806d540 0x7fe6781fc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:07.137 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67d800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 0x7fe678165ba0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fe67000da10 tx=0x7fe67000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670017070 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe670004b30 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67809ee30 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67000be60 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781fc3b0 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe67806ce30 con 0x7fe6780b6950 2024-09-21T07:40:07.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.137+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe670004fe0 con 0x7fe6780b6950 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe654073200 0x7fe654075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fe670094c40 con 0x7fe6780b6950 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7fe654079790 0x7fe65407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe67001de50 con 0x7fe654079790 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7fe670094ff0 con 0x7fe6780b6950 2024-09-21T07:40:07.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe67ce00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe654073200 0x7fe654075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe66fe00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7fe654079790 0x7fe65407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe67ce00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe654073200 0x7fe654075710 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f70 tx=0x7fe668009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe66fe00640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7fe654079790 0x7fe65407bc20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.141+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== osd.6 v2:172.21.15.90:6818/1592578093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe67001de50 con 0x7fe654079790 2024-09-21T07:40:07.155 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 --> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe67809e900 con 0x7fe654079790 2024-09-21T07:40:07.156 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe675600640 1 -- 172.21.15.64:0/1379573989 <== osd.6 v2:172.21.15.90:6818/1592578093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe67809e900 con 0x7fe654079790 2024-09-21T07:40:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:07.157 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:07.157 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7fe654079790 msgr2=0x7fe65407bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6818/1592578093,v1:172.21.15.90:6819/1592578093] conn(0x7fe654079790 0x7fe65407bc20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe654073200 msgr2=0x7fe654075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fe654073200 0x7fe654075710 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f70 tx=0x7fe668009040 comp rx=0 tx=0).stop 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 msgr2=0x7fe678165ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 --2- 172.21.15.64:0/1379573989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6780b6950 0x7fe678165ba0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fe67000da10 tx=0x7fe67000ded0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67d800640 1 -- 172.21.15.64:0/1379573989 reap_dead start 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 shutdown_connections 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 >> 172.21.15.64:0/1379573989 conn(0x7fe6780d1430 msgr2=0x7fe6780701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 shutdown_connections 2024-09-21T07:40:07.158 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.157+0000 7fe67f800640 1 -- 172.21.15.64:0/1379573989 wait complete. 2024-09-21T07:40:07.175 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- 172.21.15.64:0/3122447193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 msgr2=0x7fbf18004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 --2- 172.21.15.64:0/3122447193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf18004810 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009b10 tx=0x7fbf1c01d250 comp rx=0 tx=0).stop 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf33400640 1 -- 172.21.15.64:0/3122447193 reap_dead start 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- 172.21.15.64:0/3122447193 shutdown_connections 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- 172.21.15.64:0/3122447193 >> 172.21.15.64:0/3122447193 conn(0x7fbf3406d570 msgr2=0x7fbf340b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- 172.21.15.64:0/3122447193 shutdown_connections 2024-09-21T07:40:07.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- 172.21.15.64:0/3122447193 wait complete. 2024-09-21T07:40:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 Processor -- start 2024-09-21T07:40:07.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.337+0000 7fbf39e00640 1 -- start start 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf341f6b20 0x7fbf340730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 0x7fbf340735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3406fd00 con 0x7fbf18004240 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3406fb80 con 0x7fbf34157dd0 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3406fe80 con 0x7fbf341f6b20 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41580/0 (socket says 172.21.15.64:41580) 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 -- 172.21.15.64:0/4277966869 learned_addr learned my addr 172.21.15.64:0/4277966869 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf33400640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 0x7fbf340735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf2a000640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf341f6b20 0x7fbf340730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.342 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 -- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf341f6b20 msgr2=0x7fbf340730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf341f6b20 0x7fbf340730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 -- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 msgr2=0x7fbf340735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 0x7fbf340735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 -- 172.21.15.64:0/4277966869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf341f59f0 con 0x7fbf18004240 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf33400640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 0x7fbf340735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf32a00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005f80 tx=0x7fbf24011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24005320 con 0x7fbf18004240 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf24018020 con 0x7fbf18004240 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf341f8fe0 con 0x7fbf18004240 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24003860 con 0x7fbf18004240 2024-09-21T07:40:07.343 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf341f9730 con 0x7fbf18004240 2024-09-21T07:40:07.344 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.341+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3415c6f0 con 0x7fbf18004240 2024-09-21T07:40:07.345 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.345+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf24003a00 con 0x7fbf18004240 2024-09-21T07:40:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.345+0000 7fbf2be00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 0x7fbf10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.345+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fbf24097e80 con 0x7fbf18004240 2024-09-21T07:40:07.346 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.345+0000 7fbf2a000640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 0x7fbf10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.347 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.345+0000 7fbf2a000640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 0x7fbf10075710 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0ad000 tx=0x7fbf1c019ff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.349+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fbf24022020 con 0x7fbf18004240 2024-09-21T07:40:07.525 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.525+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbf340af9c0 con 0x7fbf10073200 2024-09-21T07:40:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.525+0000 7fbf2be00640 1 -- 172.21.15.64:0/4277966869 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbf340af9c0 con 0x7fbf10073200 2024-09-21T07:40:07.526 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 msgr2=0x7fbf10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 0x7fbf10075710 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0ad000 tx=0x7fbf1c019ff0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 msgr2=0x7fbf34157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005f80 tx=0x7fbf24011800 comp rx=0 tx=0).stop 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 shutdown_connections 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fbf10073200 0x7fbf10075710 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.528 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf34157dd0 0x7fbf340735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbf341f6b20 0x7fbf340730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 --2- 172.21.15.64:0/4277966869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf18004240 0x7fbf34157580 unknown :-1 s=CLOSED pgs=2713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 >> 172.21.15.64:0/4277966869 conn(0x7fbf3406d570 msgr2=0x7fbf340ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 shutdown_connections 2024-09-21T07:40:07.529 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.529+0000 7fbf39e00640 1 -- 172.21.15.64:0/4277966869 wait complete. 2024-09-21T07:40:07.548 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T07:40:07.548 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:40:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 -- 172.21.15.64:0/1810790668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1180b6b80 msgr2=0x7ff118160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 --2- 172.21.15.64:0/1810790668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1180b6b80 0x7ff118160580 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 crypto rx=0x7ff104009840 tx=0x7ff10401c700 comp rx=0 tx=0).stop 2024-09-21T07:40:07.710 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 -- 172.21.15.64:0/1810790668 shutdown_connections 2024-09-21T07:40:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 --2- 172.21.15.64:0/1810790668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1180b6b80 0x7ff118160580 unknown :-1 s=CLOSED pgs=2715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 -- 172.21.15.64:0/1810790668 >> 172.21.15.64:0/1810790668 conn(0x7ff1180b2f80 msgr2=0x7ff1180b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 -- 172.21.15.64:0/1810790668 shutdown_connections 2024-09-21T07:40:07.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.709+0000 7ff11fe00640 1 -- 172.21.15.64:0/1810790668 wait complete. 2024-09-21T07:40:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 Processor -- start 2024-09-21T07:40:07.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- start start 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1180b6b80 0x7ff1180afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1180cd940 0x7ff118158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 0x7ff11815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff11815ca40 con 0x7ff118160ac0 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff11815c8c0 con 0x7ff1180cd940 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7ff11815cbc0 con 0x7ff1180b6b80 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 0x7ff11815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 0x7ff11815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41598/0 (socket says 172.21.15.64:41598) 2024-09-21T07:40:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 -- 172.21.15.64:0/3362629170 learned_addr learned my addr 172.21.15.64:0/3362629170 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11ca00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1180cd940 0x7ff118158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.715 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11d400640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1180b6b80 0x7ff1180afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 -- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1180b6b80 msgr2=0x7ff1180afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1180b6b80 0x7ff1180afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 -- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1180cd940 msgr2=0x7ff118158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1180cd940 0x7ff118158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff118146a60 con 0x7ff118160ac0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11ca00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1180cd940 0x7ff118158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11de00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 0x7ff11815b300 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c760 tx=0x7ff11000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110003b80 con 0x7ff118160ac0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff110003d20 con 0x7ff118160ac0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff118146d40 con 0x7ff118160ac0 2024-09-21T07:40:07.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11000aab0 con 0x7ff118160ac0 2024-09-21T07:40:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.713+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff118147300 con 0x7ff118160ac0 2024-09-21T07:40:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1181fbda0 con 0x7ff118160ac0 2024-09-21T07:40:07.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff11000ac50 con 0x7ff118160ac0 2024-09-21T07:40:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff0f8073200 0x7ff0f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7ff110094890 con 0x7ff118160ac0 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7ff0f8079790 0x7ff0f807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff110014e50 con 0x7ff0f8079790 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (secure 0 0 0) 0x7ff110094d20 con 0x7ff118160ac0 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff11d400640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff0f8073200 0x7ff0f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.717+0000 7ff11ca00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7ff0f8079790 0x7ff0f807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.721+0000 7ff11d400640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff0f8073200 0x7ff0f8075710 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff10c000f70 tx=0x7ff10c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.721+0000 7ff11ca00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7ff0f8079790 0x7ff0f807bc20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.721+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== osd.7 v2:172.21.15.90:6802/46023510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff110014e50 con 0x7ff0f8079790 2024-09-21T07:40:07.734 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.733+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 --> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff118160580 con 0x7ff0f8079790 2024-09-21T07:40:07.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.733+0000 7ff115600640 1 -- 172.21.15.64:0/3362629170 <== osd.7 v2:172.21.15.90:6802/46023510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff118160580 con 0x7ff0f8079790 2024-09-21T07:40:07.736 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-21T07:40:07.736 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:40:07.736 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7ff0f8079790 msgr2=0x7ff0f807bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6802/46023510,v1:172.21.15.90:6803/46023510] conn(0x7ff0f8079790 0x7ff0f807bc20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff0f8073200 msgr2=0x7ff0f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7ff0f8073200 0x7ff0f8075710 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff10c000f70 tx=0x7ff10c009040 comp rx=0 tx=0).stop 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 msgr2=0x7ff11815b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 --2- 172.21.15.64:0/3362629170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff118160ac0 0x7ff11815b300 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c760 tx=0x7ff11000cc20 comp rx=0 tx=0).stop 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11de00640 1 -- 172.21.15.64:0/3362629170 reap_dead start 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 shutdown_connections 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 >> 172.21.15.64:0/3362629170 conn(0x7ff1180b2f80 msgr2=0x7ff1180cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 shutdown_connections 2024-09-21T07:40:07.739 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.737+0000 7ff11fe00640 1 -- 172.21.15.64:0/3362629170 wait complete. 2024-09-21T07:40:07.755 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T07:40:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 -- 172.21.15.64:0/2231821912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb75806f610 msgr2=0x7fb7580b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 --2- 172.21.15.64:0/2231821912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb75806f610 0x7fb7580b3170 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7fb7580cfff0 tx=0x7fb74401c7f0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 -- 172.21.15.64:0/2231821912 shutdown_connections 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 --2- 172.21.15.64:0/2231821912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb75806f610 0x7fb7580b3170 unknown :-1 s=CLOSED pgs=2717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 --2- 172.21.15.64:0/2231821912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75815af70 0x7fb75806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 -- 172.21.15.64:0/2231821912 >> 172.21.15.64:0/2231821912 conn(0x7fb75806d570 msgr2=0x7fb7580b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 -- 172.21.15.64:0/2231821912 shutdown_connections 2024-09-21T07:40:07.915 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.913+0000 7fb75d600640 1 -- 172.21.15.64:0/2231821912 wait complete. 2024-09-21T07:40:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 Processor -- start 2024-09-21T07:40:07.916 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 -- start start 2024-09-21T07:40:07.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75806f610 0x7fb7580c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.921 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb75815af70 0x7fb7580adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb758167e60 con 0x7fb7580b36b0 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7580b4420 con 0x7fb75815af70 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb75d600640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fb758167fe0 con 0x7fb75806f610 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41612/0 (socket says 172.21.15.64:41612) 2024-09-21T07:40:07.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 -- 172.21.15.64:0/3359985691 learned_addr learned my addr 172.21.15.64:0/3359985691 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756a00640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75806f610 0x7fb7580c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb757400640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb75815af70 0x7fb7580adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 -- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75806f610 msgr2=0x7fb7580c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75806f610 0x7fb7580c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 -- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb75815af70 msgr2=0x7fb7580adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:07.923 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb75815af70 0x7fb7580adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 -- 172.21.15.64:0/3359985691 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7581fce20 con 0x7fb7580b36b0 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.917+0000 7fb756000640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7fb74401a480 tx=0x7fb7440a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440bb070 con 0x7fb7580b36b0 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7440043b0 con 0x7fb7580b36b0 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b2040 con 0x7fb7580b36b0 2024-09-21T07:40:07.924 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7581fd0e0 con 0x7fb7580b36b0 2024-09-21T07:40:07.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7580aecc0 con 0x7fb7580b36b0 2024-09-21T07:40:07.925 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7580b3170 con 0x7fb7580b36b0 2024-09-21T07:40:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb7440052d0 con 0x7fb7580b36b0 2024-09-21T07:40:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 0x7fb738075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:07.926 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fb74412da00 con 0x7fb7580b36b0 2024-09-21T07:40:07.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.921+0000 7fb756a00640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 0x7fb738075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:07.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.925+0000 7fb756a00640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 0x7fb738075710 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb74800abb0 tx=0x7fb748010040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:07.927 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:07.925+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fb7440164d0 con 0x7fb7580b36b0 2024-09-21T07:40:08.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.101+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb7580c6ad0 con 0x7fb738073200 2024-09-21T07:40:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.101+0000 7fb74ea00640 1 -- 172.21.15.64:0/3359985691 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb7580c6ad0 con 0x7fb738073200 2024-09-21T07:40:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 msgr2=0x7fb738075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 0x7fb738075710 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb74800abb0 tx=0x7fb748010040 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 msgr2=0x7fb7580999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7fb74401a480 tx=0x7fb7440a55f0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 shutdown_connections 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fb738073200 0x7fb738075710 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb75815af70 0x7fb7580adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7580b36b0 0x7fb7580999a0 unknown :-1 s=CLOSED pgs=2718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 --2- 172.21.15.64:0/3359985691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb75806f610 0x7fb7580c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 >> 172.21.15.64:0/3359985691 conn(0x7fb75806d570 msgr2=0x7fb75815a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 shutdown_connections 2024-09-21T07:40:08.106 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.105+0000 7fb75d600640 1 -- 172.21.15.64:0/3359985691 wait complete. 2024-09-21T07:40:08.125 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 -- 172.21.15.64:0/1623020981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 msgr2=0x7f23640cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 --2- 172.21.15.64:0/1623020981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640cfbc0 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 crypto rx=0x7f2354005fd0 tx=0x7f235401c820 comp rx=0 tx=0).stop 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 -- 172.21.15.64:0/1623020981 shutdown_connections 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 --2- 172.21.15.64:0/1623020981 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b0a30 0x7f23640b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 --2- 172.21.15.64:0/1623020981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640cfbc0 unknown :-1 s=CLOSED pgs=2720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 -- 172.21.15.64:0/1623020981 >> 172.21.15.64:0/1623020981 conn(0x7f236409a9e0 msgr2=0x7f23640d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 -- 172.21.15.64:0/1623020981 shutdown_connections 2024-09-21T07:40:08.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.281+0000 7f2363200640 1 -- 172.21.15.64:0/1623020981 wait complete. 2024-09-21T07:40:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 Processor -- start 2024-09-21T07:40:08.285 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 -- start start 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23640b0a30 0x7f236415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b1380 0x7f23640af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2364168f10 con 0x7f23640cf7b0 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23640b65b0 con 0x7f23640b0a30 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2363200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f2364169090 con 0x7f23640b1380 2024-09-21T07:40:08.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41640/0 (socket says 172.21.15.64:41640) 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 -- 172.21.15.64:0/1598097135 learned_addr learned my addr 172.21.15.64:0/1598097135 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2361e00640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23640b0a30 0x7f236415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2359400640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b1380 0x7f23640af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 -- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b1380 msgr2=0x7f23640af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b1380 0x7f23640af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 -- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23640b0a30 msgr2=0x7f236415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23640b0a30 0x7f236415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.285+0000 7f2362800640 1 -- 172.21.15.64:0/1598097135 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23640c8ff0 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f2362800640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c6e0 tx=0x7f235c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c017070 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f235c003c70 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c003e60 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23641666c0 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23640ca9d0 con 0x7f23640cf7b0 2024-09-21T07:40:08.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23640b0e40 con 0x7f23640cf7b0 2024-09-21T07:40:08.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f235c01a070 con 0x7f23640cf7b0 2024-09-21T07:40:08.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 0x7f2340075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:08.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.289+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f235c093700 con 0x7f23640cf7b0 2024-09-21T07:40:08.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.293+0000 7f2361e00640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 0x7f2340075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:08.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.293+0000 7f2361e00640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 0x7f2340075710 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f23540ae000 tx=0x7f235401b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:08.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.297+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f235c05e270 con 0x7f23640cf7b0 2024-09-21T07:40:08.467 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.465+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2364166470 con 0x7f2340073200 2024-09-21T07:40:08.468 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f235aa00640 1 -- 172.21.15.64:0/1598097135 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13388 (secure 0 0 0) 0x7f2364166470 con 0x7f2340073200 2024-09-21T07:40:08.468 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:08.469 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 msgr2=0x7f2340075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 0x7f2340075710 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f23540ae000 tx=0x7f235401b060 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 msgr2=0x7f23640afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c6e0 tx=0x7f235c00cba0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 shutdown_connections 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f2340073200 0x7f2340075710 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23640cf7b0 0x7f23640afb10 unknown :-1 s=CLOSED pgs=2721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23640b1380 0x7f23640af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 --2- 172.21.15.64:0/1598097135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23640b0a30 0x7f236415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:08.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 >> 172.21.15.64:0/1598097135 conn(0x7f236409a9e0 msgr2=0x7f236406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 shutdown_connections 2024-09-21T07:40:08.472 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:08.469+0000 7f2363200640 1 -- 172.21.15.64:0/1598097135 wait complete. 2024-09-21T07:40:08.491 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":754,"stamp":"2024-09-21T07:40:07.712558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":475132,"kb_used_data":24392,"kb_used_omap":12,"kb_used_meta":450547,"kb_avail":754499588,"statfs":{"total":773094113280,"available":772607578112,"internally_reserved":0,"allocated":24977408,"data_stored":12450696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":461360691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.308014"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":503,"reported_epoch":235,"state":"active+clean","last_fresh":"2024-09-21T07:39:58.221609+0000","last_change":"2024-09-21T07:22:39.773868+0000","last_active":"2024-09-21T07:39:58.221609+0000","last_peered":"2024-09-21T07:39:58.221609+0000","last_clean":"2024-09-21T07:39:58.221609+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:39:58.221609+0000","last_undegraded":"2024-09-21T07:39:58.221609+0000","last_fullsized":"2024-09-21T07:39:58.221609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:22:38.040546+0000","last_clean_scrub_stamp":"2024-09-21T07:22:38.040546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:04.568554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56300,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315540,"statfs":{"total":96636764160,"available":96579112960,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47980,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47984,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323856,"statfs":{"total":96636764160,"available":96587628544,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509654,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56884,"kb_used_data":3484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314956,"statfs":{"total":96636764160,"available":96578514944,"internally_reserved":0,"allocated":3567616,"data_stored":1999113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542358,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61044,"kb_used_data":3484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310796,"statfs":{"total":96636764160,"available":96574255104,"internally_reserved":0,"allocated":3567616,"data_stored":1999113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88172,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283668,"statfs":{"total":96636764160,"available":96546476032,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:40:08.494 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T07:22:38.040546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=7, tm_min=22, tm_sec=38, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=7, tm_min=40, tm_sec=2, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T07:40:08.494 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T07:40:11.049 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:11.053 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:28.495 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:40:28.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 -- 172.21.15.64:0/3265475544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc06fae0 msgr2=0x7fddbc0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 --2- 172.21.15.64:0/3265475544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc06fae0 0x7fddbc0af790 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009840 tx=0x7fddb001c820 comp rx=0 tx=0).stop 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 -- 172.21.15.64:0/3265475544 shutdown_connections 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 --2- 172.21.15.64:0/3265475544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 0x7fddbc0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 --2- 172.21.15.64:0/3265475544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc06fae0 0x7fddbc0af790 unknown :-1 s=CLOSED pgs=2723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 -- 172.21.15.64:0/3265475544 >> 172.21.15.64:0/3265475544 conn(0x7fddbc06d570 msgr2=0x7fddbc0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 -- 172.21.15.64:0/3265475544 shutdown_connections 2024-09-21T07:40:28.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.665+0000 7fddc4800640 1 -- 172.21.15.64:0/3265475544 wait complete. 2024-09-21T07:40:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 Processor -- start 2024-09-21T07:40:28.668 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 -- start start 2024-09-21T07:40:28.670 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc06fae0 0x7fddbc0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 0x7fddbc15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc168e10 con 0x7fddbc0b46f0 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc168c90 con 0x7fddbc06fae0 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc4800640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc168f90 con 0x7fddbc0caf00 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43628/0 (socket says 172.21.15.64:43628) 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 -- 172.21.15.64:0/3267826120 learned_addr learned my addr 172.21.15.64:0/3267826120 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1e00640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc06fae0 0x7fddbc0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc2800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 0x7fddbc15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 -- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 msgr2=0x7fddbc15e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:28.671 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 0x7fddbc15e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 -- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc06fae0 msgr2=0x7fddbc0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc06fae0 0x7fddbc0c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.672 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 -- 172.21.15.64:0/3267826120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc1fa040 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.669+0000 7fddc1400640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c460 tx=0x7fddac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac016020 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddac012940 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc0c8a70 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac012d90 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc0c8ff0 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc160000 con 0x7fddbc0b46f0 2024-09-21T07:40:28.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fddac019020 con 0x7fddbc0b46f0 2024-09-21T07:40:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fddac093c70 con 0x7fddbc0b46f0 2024-09-21T07:40:28.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.673+0000 7fddc1e00640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:28.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.677+0000 7fddc1e00640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fddb00af000 tx=0x7fddb001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:28.679 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.681+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fddac020030 con 0x7fddbc0b46f0 2024-09-21T07:40:28.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.853+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 --> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fddbc0af790 con 0x7fdda0073230 2024-09-21T07:40:28.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.853+0000 7fddb6000640 1 -- 172.21.15.64:0/3267826120 <== mgr.4120 v2:172.21.15.90:6800/3453127412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13371 (secure 0 0 0) 0x7fddbc0af790 con 0x7fdda0073230 2024-09-21T07:40:28.854 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:28.855 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 msgr2=0x7fdda0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fddb00af000 tx=0x7fddb001b060 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 msgr2=0x7fddbc15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c460 tx=0x7fddac00c920 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 shutdown_connections 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fdda0073230 0x7fdda0075740 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddbc0caf00 0x7fddbc15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddbc0b46f0 0x7fddbc15a4b0 unknown :-1 s=CLOSED pgs=2724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 --2- 172.21.15.64:0/3267826120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc06fae0 0x7fddbc0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 >> 172.21.15.64:0/3267826120 conn(0x7fddbc06d570 msgr2=0x7fddbc0aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:28.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 shutdown_connections 2024-09-21T07:40:28.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:28.857+0000 7fddc4800640 1 -- 172.21.15.64:0/3267826120 wait complete. 2024-09-21T07:40:28.877 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":764,"stamp":"2024-09-21T07:40:27.717600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":475116,"kb_used_data":24392,"kb_used_omap":12,"kb_used_meta":450547,"kb_avail":754499604,"statfs":{"total":773094113280,"available":772607594496,"internally_reserved":0,"allocated":24977408,"data_stored":12450696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":461360691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003178"},"pg_stats":[{"pgid":"1.0","version":"235'74","reported_seq":513,"reported_epoch":235,"state":"active+clean","last_fresh":"2024-09-21T07:40:08.760741+0000","last_change":"2024-09-21T07:40:08.760741+0000","last_active":"2024-09-21T07:40:08.760741+0000","last_peered":"2024-09-21T07:40:08.760741+0000","last_clean":"2024-09-21T07:40:08.760741+0000","last_became_active":"2024-09-21T07:22:39.772620+0000","last_became_peered":"2024-09-21T07:22:39.772620+0000","last_unstale":"2024-09-21T07:40:08.760741+0000","last_undegraded":"2024-09-21T07:40:08.760741+0000","last_fullsized":"2024-09-21T07:40:08.760741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"235'74","last_scrub_stamp":"2024-09-21T07:40:08.760650+0000","last_deep_scrub":"235'74","last_deep_scrub_stamp":"2024-09-21T07:40:08.760650+0000","last_clean_scrub_stamp":"2024-09-21T07:40:08.760650+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:13.827560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56300,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315540,"statfs":{"total":96636764160,"available":96579112960,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47980,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509656,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47984,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323856,"statfs":{"total":96636764160,"available":96587628544,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509658,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56876,"kb_used_data":3484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314964,"statfs":{"total":96636764160,"available":96578523136,"internally_reserved":0,"allocated":3567616,"data_stored":1999113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542362,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61036,"kb_used_data":3484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310804,"statfs":{"total":96636764160,"available":96574263296,"internally_reserved":0,"allocated":3567616,"data_stored":1999113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88172,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94283668,"statfs":{"total":96636764160,"available":96546476032,"internally_reserved":0,"allocated":2973696,"data_stored":1408745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:40:28.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T07:40:29.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 -- 172.21.15.64:0/234376232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 msgr2=0x7f3e6015ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 --2- 172.21.15.64:0/234376232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e6015ea70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009870 tx=0x7f3e5001cfe0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 -- 172.21.15.64:0/234376232 shutdown_connections 2024-09-21T07:40:29.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 --2- 172.21.15.64:0/234376232 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e6015ea70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 -- 172.21.15.64:0/234376232 >> 172.21.15.64:0/234376232 conn(0x7f3e600d13b0 msgr2=0x7f3e600d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:29.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.033+0000 7f3e67200640 1 -- 172.21.15.64:0/234376232 shutdown_connections 2024-09-21T07:40:29.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 -- 172.21.15.64:0/234376232 wait complete. 2024-09-21T07:40:29.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 Processor -- start 2024-09-21T07:40:29.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 -- start start 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e600c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e600d0630 0x7f3e600aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6016dc60 con 0x7f3e600b0c70 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6016dae0 con 0x7f3e600d0630 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.037+0000 7f3e67200640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6016dde0 con 0x7f3e600b6730 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43644/0 (socket says 172.21.15.64:43644) 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 -- 172.21.15.64:0/1539194625 learned_addr learned my addr 172.21.15.64:0/1539194625 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:29.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e57400640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e600c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e65200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e600d0630 0x7f3e600aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 -- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 msgr2=0x7f3e600c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e600c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 -- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e600d0630 msgr2=0x7f3e600aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e600d0630 0x7f3e600aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 -- 172.21.15.64:0/1539194625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600c6850 con 0x7f3e600b0c70 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e57400640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e600c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:29.041 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5fe00640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f3e5001ce20 tx=0x7f3e50005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005470 con 0x7f3e600b0c70 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e50005610 con 0x7f3e600b0c70 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e500a9920 con 0x7f3e600b0c70 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e601568a0 con 0x7f3e600b0c70 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e601578a0 con 0x7f3e600b0c70 2024-09-21T07:40:29.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6015ea70 con 0x7f3e600b0c70 2024-09-21T07:40:29.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.041+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e500a9ac0 con 0x7f3e600b0c70 2024-09-21T07:40:29.043 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.045+0000 7f3e5cc00640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.045+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7f3e5012e480 con 0x7f3e600b0c70 2024-09-21T07:40:29.044 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.045+0000 7f3e57400640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.045 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.045+0000 7f3e57400640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 0x7f3e3c075710 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3e60159ea0 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:29.048 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.049+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7f3e500ad020 con 0x7f3e600b0c70 2024-09-21T07:40:29.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.225+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3e600c6a80 con 0x7f3e600b0c70 2024-09-21T07:40:29.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.229+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v71)=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7f3e50016350 con 0x7f3e600b0c70 2024-09-21T07:40:29.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.229+0000 7f3e5cc00640 1 -- 172.21.15.64:0/1539194625 <== mon.0 v2:172.21.15.64:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3e5012ce50 con 0x7f3e600b0c70 2024-09-21T07:40:29.231 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 msgr2=0x7f3e3c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 0x7f3e3c075710 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3e60159ea0 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 msgr2=0x7f3e601503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f3e5001ce20 tx=0x7f3e50005300 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 shutdown_connections 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e600d0630 0x7f3e600aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e600b6730 0x7f3e600c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 --2- 172.21.15.64:0/1539194625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e600b0c70 0x7f3e601503e0 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 >> 172.21.15.64:0/1539194625 conn(0x7f3e600d13b0 msgr2=0x7f3e600d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 shutdown_connections 2024-09-21T07:40:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.233+0000 7f3e67200640 1 -- 172.21.15.64:0/1539194625 wait complete. 2024-09-21T07:40:29.252 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:40:29.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 -- 172.21.15.64:0/901770668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc21006fae0 msgr2=0x7fc2100af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 --2- 172.21.15.64:0/901770668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc21006fae0 0x7fc2100af790 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7fc210070d40 tx=0x7fc20001c800 comp rx=0 tx=0).stop 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 -- 172.21.15.64:0/901770668 shutdown_connections 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 --2- 172.21.15.64:0/901770668 >> v2:172.21.15.90:3300/0 conn(0x7fc2100caf00 0x7fc2100cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 --2- 172.21.15.64:0/901770668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc21006fae0 0x7fc2100af790 unknown :-1 s=CLOSED pgs=2728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.411 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 -- 172.21.15.64:0/901770668 >> 172.21.15.64:0/901770668 conn(0x7fc21006d570 msgr2=0x7fc2100b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:29.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 -- 172.21.15.64:0/901770668 shutdown_connections 2024-09-21T07:40:29.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.409+0000 7fc215e00640 1 -- 172.21.15.64:0/901770668 wait complete. 2024-09-21T07:40:29.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 Processor -- start 2024-09-21T07:40:29.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 -- start start 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc21006fae0 0x7fc2100c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2100caf00 0x7fc2100c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc210168f10 con 0x7fc2100b46f0 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc210168d90 con 0x7fc2100caf00 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc215e00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 -- 0x7fc210169090 con 0x7fc21006fae0 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc206000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.416 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc206000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43652/0 (socket says 172.21.15.64:43652) 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc206000640 1 -- 172.21.15.64:0/3450014971 learned_addr learned my addr 172.21.15.64:0/3450014971 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc20ea00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc21006fae0 0x7fc2100c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.413+0000 7fc20f400640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2100caf00 0x7fc2100c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 -- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc21006fae0 msgr2=0x7fc2100c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc21006fae0 0x7fc2100c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 -- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2100caf00 msgr2=0x7fc2100c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2100caf00 0x7fc2100c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 -- 172.21.15.64:0/3450014971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2101f90e0 con 0x7fc2100b46f0 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc206000640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001ec0 tx=0x7fc1f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8017070 con 0x7fc2100b46f0 2024-09-21T07:40:29.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc1f8003600 con 0x7fc2100b46f0 2024-09-21T07:40:29.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2101f93c0 con 0x7fc2100b46f0 2024-09-21T07:40:29.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8003a70 con 0x7fc2100b46f0 2024-09-21T07:40:29.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2101f9980 con 0x7fc2100b46f0 2024-09-21T07:40:29.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2100af790 con 0x7fc2100b46f0 2024-09-21T07:40:29.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc1f801a070 con 0x7fc2100b46f0 2024-09-21T07:40:29.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.417+0000 7fc207e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 0x7fc1ec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:29.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.421+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 5421+0+0 (secure 0 0 0) 0x7fc1f8093540 con 0x7fc2100b46f0 2024-09-21T07:40:29.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.421+0000 7fc20ea00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 0x7fc1ec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:29.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.421+0000 7fc20ea00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 0x7fc1ec075740 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc2000af000 tx=0x7fc2000195a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:29.423 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.425+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+189041 (secure 0 0 0) 0x7fc1f805df10 con 0x7fc2100b46f0 2024-09-21T07:40:29.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.633+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2100d0e30 con 0x7fc2100b46f0 2024-09-21T07:40:29.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.633+0000 7fc207e00640 1 -- 172.21.15.64:0/3450014971 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 178 v178) ==== 95+0+3915 (secure 0 0 0) 0x7fc1f8062940 con 0x7fc2100b46f0 2024-09-21T07:40:29.634 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-21T07:40:29.634 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":178,"btime":"2024-09-21T07:39:55:392844+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/996473059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":996473059},{"type":"v1","addr":"172.21.15.90:6837","nonce":996473059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":9704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3273305900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":3273305900},{"type":"v1","addr":"172.21.15.64:6835","nonce":3273305900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":10960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/3868829063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3868829063},{"type":"v1","addr":"172.21.15.90:6836","nonce":3868829063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":12120,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1678941793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1678941793},{"type":"v1","addr":"172.21.15.64:6834","nonce":1678941793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":178}],"filesystems":[]} 2024-09-21T07:40:29.634 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 178 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 msgr2=0x7fc1ec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 0x7fc1ec075740 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc2000af000 tx=0x7fc2000195a0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 msgr2=0x7fc21015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001ec0 tx=0x7fc1f800c890 comp rx=0 tx=0).stop 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 shutdown_connections 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:6800/3453127412,v1:172.21.15.90:6801/3453127412] conn(0x7fc1ec073230 0x7fc1ec075740 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2100caf00 0x7fc2100c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.636 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2100b46f0 0x7fc21015e8d0 unknown :-1 s=CLOSED pgs=2729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 --2- 172.21.15.64:0/3450014971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc21006fae0 0x7fc2100c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:29.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 >> 172.21.15.64:0/3450014971 conn(0x7fc21006d570 msgr2=0x7fc210155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:29.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 shutdown_connections 2024-09-21T07:40:29.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-21T07:40:29.637+0000 7fc215e00640 1 -- 172.21.15.64:0/3450014971 wait complete. 2024-09-21T07:40:29.655 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T07:40:29.656 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T07:40:29.656 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:40:29.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:29.676 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:40:29.676 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:40:29.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:29.738 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:40:29.739 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:40:29.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:29.754 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:40:29.754 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:40:29.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:29.812 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:40:29.812 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T07:40:29.812 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T07:40:29.813 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:29.910 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T07:40:29.910 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T07:40:29.910 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:32.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-21T07:40:36.012 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T07:40:36.012 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T07:40:36.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:36.089 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T07:40:36.089 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T07:40:36.089 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:38.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-21T07:40:38.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-21T07:40:41.118 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:41.122 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:42.191 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T07:40:42.191 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T07:40:42.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:42.289 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T07:40:42.289 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T07:40:42.289 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:44.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-21T07:40:44.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-21T07:40:48.391 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T07:40:48.391 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T07:40:48.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.486 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T07:40:48.486 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T07:40:48.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.582 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T07:40:48.582 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T07:40:48.583 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T07:40:48.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.645 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T07:40:48.645 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T07:40:48.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.707 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T07:40:48.707 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T07:40:48.707 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T07:40:48.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.730 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T07:40:48.730 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T07:40:48.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.746 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T07:40:48.746 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T07:40:48.746 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:40:48.812 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T07:40:48.812 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T07:40:48.812 DEBUG:teuthology.orchestra.run.smithi064:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-21T07:40:48.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:40:48.852 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T07:40:49.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:40:49.132 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T07:40:49.346 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:40:49.347 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T07:40:49.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-21T07:40:49.676 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:40:49.676 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T07:40:49.849 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:40:49.849 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T07:40:50.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:40:50.143 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T07:40:50.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:40:50.403 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T07:40:50.645 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:40:50.645 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T07:40:50.851 INFO:tasks.ceph:Archiving mon data... 2024-09-21T07:40:50.852 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/data/mon.a.tgz 2024-09-21T07:40:50.852 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-09-21T07:40:50.861 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.Cy4EmiPvKD 2024-09-21T07:40:50.862 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Cy4EmiPvKD 2024-09-21T07:40:51.022 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.Cy4EmiPvKD 2024-09-21T07:40:51.099 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.Cy4EmiPvKD is 472KB 2024-09-21T07:40:51.165 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.Cy4EmiPvKD 2024-09-21T07:40:51.174 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/data/mon.b.tgz 2024-09-21T07:40:51.174 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-21T07:40:51.182 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.oIaorbMpci 2024-09-21T07:40:51.182 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oIaorbMpci 2024-09-21T07:40:51.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.oIaorbMpci 2024-09-21T07:40:51.405 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.oIaorbMpci is 473KB 2024-09-21T07:40:51.468 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.oIaorbMpci 2024-09-21T07:40:51.476 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/data/mon.c.tgz 2024-09-21T07:40:51.477 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-21T07:40:51.525 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.F3R2rpwb1k 2024-09-21T07:40:51.526 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.F3R2rpwb1k 2024-09-21T07:40:51.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.F3R2rpwb1k 2024-09-21T07:40:51.750 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.F3R2rpwb1k is 473KB 2024-09-21T07:40:51.812 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.F3R2rpwb1k 2024-09-21T07:40:51.820 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T07:40:51.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:40:51.824 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:40:51.896 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:40:51.937 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:40:51.937 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T07:40:51.939 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi064/crash 2024-09-21T07:40:51.940 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:40:51.963 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi090/crash 2024-09-21T07:40:51.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:40:51.995 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T07:40:51.995 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:52.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:52.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:52.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:52.148 INFO:tasks.ceph:Compressing logs... 2024-09-21T07:40:52.148 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:40:52.157 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:40:52.179 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2024-09-21T07:40:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86968.log 2024-09-21T07:40:52.180 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53749.log 2024-09-21T07:40:52.181 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2024-09-21T07:40:52.181 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36331.log 2024-09-21T07:40:52.181 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86968.log.gz 2024-09-21T07:40:52.182 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78262.log 2024-09-21T07:40:52.182 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53749.log.gz 2024-09-21T07:40:52.183 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90647.log 2024-09-21T07:40:52.183 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36331.log.gz 2024-09-21T07:40:52.184 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58286.log 2024-09-21T07:40:52.184 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78262.log.gz 2024-09-21T07:40:52.185 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2024-09-21T07:40:52.185 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90647.log.gz 2024-09-21T07:40:52.186 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84223.log 2024-09-21T07:40:52.186 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58286.log.gz 2024-09-21T07:40:52.187 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93065.log 2024-09-21T07:40:52.187 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz 2024-09-21T07:40:52.187 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2024-09-21T07:40:52.187 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84223.log.gz 2024-09-21T07:40:52.188 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77770.log 2024-09-21T07:40:52.188 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93065.log.gz 2024-09-21T07:40:52.189 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80214.log 2024-09-21T07:40:52.189 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2024-09-21T07:40:52.190 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77006.log 2024-09-21T07:40:52.190 INFO:teuthology.orchestra.run.smithi064.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.77770.log.gz 2024-09-21T07:40:52.191 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29101.log 2024-09-21T07:40:52.192 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80214.log.gz 2024-09-21T07:40:52.192 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50519.log 2024-09-21T07:40:52.192 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77006.log.gz 2024-09-21T07:40:52.192 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87899.log 2024-09-21T07:40:52.193 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.29101.log.gz 2024-09-21T07:40:52.194 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28944.log 2024-09-21T07:40:52.194 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50519.log.gz 2024-09-21T07:40:52.194 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77999.log 2024-09-21T07:40:52.194 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87899.log.gz 2024-09-21T07:40:52.195 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28944.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28944.log.gz -5 2024-09-21T07:40:52.195 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-09-21T07:40:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35023.log 2024-09-21T07:40:52.196 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77999.log.gz 2024-09-21T07:40:52.196 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83472.log 2024-09-21T07:40:52.197 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-09-21T07:40:52.197 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-09-21T07:40:52.198 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35023.log.gz 2024-09-21T07:40:52.198 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54047.log 2024-09-21T07:40:52.198 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83472.log.gz 2024-09-21T07:40:52.199 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52429.log 2024-09-21T07:40:52.199 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-09-21T07:40:52.200 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93299.log 2024-09-21T07:40:52.200 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54047.log.gz 2024-09-21T07:40:52.201 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88664.log 2024-09-21T07:40:52.201 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52429.log.gz 2024-09-21T07:40:52.201 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75074.log 2024-09-21T07:40:52.202 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93299.log.gz 2024-09-21T07:40:52.203 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36037.log 2024-09-21T07:40:52.203 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88664.log.gz 2024-09-21T07:40:52.203 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55326.log 2024-09-21T07:40:52.203 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75074.log.gz 2024-09-21T07:40:52.204 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.2.36037.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.2.36037.log.gz 2024-09-21T07:40:52.204 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.92087.log 2024-09-21T07:40:52.205 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56155.log 2024-09-21T07:40:52.205 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55326.log.gz 2024-09-21T07:40:52.206 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79908.log 2024-09-21T07:40:52.206 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92087.log.gz 2024-09-21T07:40:52.206 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57197.log 2024-09-21T07:40:52.207 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.79908.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56155.log.gz 2024-09-21T07:40:52.207 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34997.log 2024-09-21T07:40:52.208 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79908.log.gz 2024-09-21T07:40:52.208 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77471.log 2024-09-21T07:40:52.208 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57197.log.gz 2024-09-21T07:40:52.209 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77973.log 2024-09-21T07:40:52.209 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34997.log.gz 2024-09-21T07:40:52.210 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81064.log 2024-09-21T07:40:52.210 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77471.log.gz 2024-09-21T07:40:52.210 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91517.log 2024-09-21T07:40:52.211 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77973.log.gz 2024-09-21T07:40:52.211 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85867.log 2024-09-21T07:40:52.211 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81064.log.gz 2024-09-21T07:40:52.212 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2024-09-21T07:40:52.212 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91517.log.gz 2024-09-21T07:40:52.213 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2024-09-21T07:40:52.213 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.85867.log.gz 2024-09-21T07:40:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T07:40:52.215 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88933.log 2024-09-21T07:40:52.215 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2024-09-21T07:40:52.215 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88560.log 2024-09-21T07:40:52.215 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29115.log 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29019.log 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29115.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29115.log.gz 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34570.log 2024-09-21T07:40:52.218 INFO:teuthology.orchestra.run.smithi090.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29019.log.gz 2024-09-21T07:40:52.219 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86404.log 2024-09-21T07:40:52.219 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88933.log.gz 2024-09-21T07:40:52.219 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72044.log 2024-09-21T07:40:52.219 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88560.log.gz 2024-09-21T07:40:52.219 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2024-09-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86404.log.gz 2024-09-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72044.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72044.log.gz 2024-09-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87550.log 2024-09-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2024-09-21T07:40:52.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29043.log 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.1.34570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34570.log.gz 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29043.log: /var/log/ceph/ceph-mgr.x.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29043.log.gz 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29164.log 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29091.log 2024-09-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90822.log 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53567.log 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87550.log.gz 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90822.log.gz 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54810.log 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53567.log.gz 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58487.log 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2024-09-21T07:40:52.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-09-21T07:40:52.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29140.log 2024-09-21T07:40:52.226 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29164.log.gz 2024-09-21T07:40:52.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29091.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T07:40:52.226 INFO:teuthology.orchestra.run.smithi090.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29091.log.gz 2024-09-21T07:40:52.226 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54810.log.gz 2024-09-21T07:40:52.226 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92779.log 2024-09-21T07:40:52.227 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58487.log.gz 2024-09-21T07:40:52.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80316.log 2024-09-21T07:40:52.227 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-09-21T07:40:52.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57880.log 2024-09-21T07:40:52.227 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92779.log.gz 2024-09-21T07:40:52.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29140.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:40:52.228 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29140.log.gz 2024-09-21T07:40:52.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80999.log 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.80316.log.gz 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50571.log 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57880.log.gz 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53197.log 2024-09-21T07:40:52.229 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80999.log.gz 2024-09-21T07:40:52.230 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:40:52.230 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28988.log 2024-09-21T07:40:52.231 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84249.log 2024-09-21T07:40:52.231 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50571.log.gz 2024-09-21T07:40:52.231 INFO:teuthology.orchestra.run.smithi064.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T07:40:52.231 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-09-21T07:40:52.231 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53197.log.gz 2024-09-21T07:40:52.232 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34945.log 2024-09-21T07:40:52.232 INFO:teuthology.orchestra.run.smithi064.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.84249.log.gz 2024-09-21T07:40:52.232 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78433.log 2024-09-21T07:40:52.233 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-09-21T07:40:52.233 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.28988.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28988.log.gz 2024-09-21T07:40:52.233 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T07:40:52.234 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71966.log 2024-09-21T07:40:52.234 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34945.log.gz 2024-09-21T07:40:52.234 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54695.log 2024-09-21T07:40:52.234 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78433.log.gz 2024-09-21T07:40:52.234 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-09-21T07:40:52.235 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71966.log.gz 2024-09-21T07:40:52.235 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74840.log 2024-09-21T07:40:52.235 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54695.log.gz 2024-09-21T07:40:52.236 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76980.log 2024-09-21T07:40:52.236 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-09-21T07:40:52.237 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72715.log 2024-09-21T07:40:52.237 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74840.log.gz 2024-09-21T07:40:52.237 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.76980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92630.log 2024-09-21T07:40:52.238 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.b.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:40:52.238 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T07:40:52.238 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76980.log.gz 2024-09-21T07:40:52.238 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53483.log 2024-09-21T07:40:52.238 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.72715.log.gz 2024-09-21T07:40:52.239 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T07:40:52.240 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87020.log 2024-09-21T07:40:52.240 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92630.log.gz 2024-09-21T07:40:52.240 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92526.log 2024-09-21T07:40:52.240 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53483.log.gz 2024-09-21T07:40:52.240 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75458.log 2024-09-21T07:40:52.241 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87020.log.gz 2024-09-21T07:40:52.241 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93351.log 2024-09-21T07:40:52.241 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92526.log.gz 2024-09-21T07:40:52.242 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-09-21T07:40:52.242 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75458.log.gz 2024-09-21T07:40:52.243 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88217.log 2024-09-21T07:40:52.243 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93351.log.gz 2024-09-21T07:40:52.244 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54665.log 2024-09-21T07:40:52.244 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-09-21T07:40:52.245 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51669.log 2024-09-21T07:40:52.245 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88217.log.gz 2024-09-21T07:40:52.245 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84405.log 2024-09-21T07:40:52.245 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54665.log.gz 2024-09-21T07:40:52.246 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90848.log 2024-09-21T07:40:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.4.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T07:40:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29067.log 2024-09-21T07:40:52.247 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89643.log 2024-09-21T07:40:52.247 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51669.log.gz 2024-09-21T07:40:52.247 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84405.log.gz 2024-09-21T07:40:52.248 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34672.log 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89202.log 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90848.log.gz 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52834.log 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89643.log.gz 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91331.log 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89202.log.gz 2024-09-21T07:40:52.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56959.log 2024-09-21T07:40:52.252 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52834.log.gz 2024-09-21T07:40:52.252 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2024-09-21T07:40:52.252 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91331.log.gz 2024-09-21T07:40:52.253 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.3.34672.log: /var/log/ceph/ceph-client.admin.29067.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29067.log.gz 2024-09-21T07:40:52.253 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34672.log.gz 2024-09-21T07:40:52.256 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-09-21T07:40:52.256 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56959.log.gz 2024-09-21T07:40:52.256 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2024-09-21T07:40:52.256 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2024-09-21T07:40:52.256 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34312.log 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59053.log 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34312.log.gz 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78084.log 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59053.log.gz 2024-09-21T07:40:52.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81641.log 2024-09-21T07:40:52.258 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2024-09-21T07:40:52.258 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72890.log 2024-09-21T07:40:52.258 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78084.log.gz 2024-09-21T07:40:52.258 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80530.log 2024-09-21T07:40:52.259 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.72890.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.81641.log.gz 2024-09-21T07:40:52.259 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59235.log 2024-09-21T07:40:52.259 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72890.log.gz 2024-09-21T07:40:52.259 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91744.log 2024-09-21T07:40:52.260 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80530.log.gz 2024-09-21T07:40:52.260 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59235.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59235.log.gz 2024-09-21T07:40:52.261 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84301.log 2024-09-21T07:40:52.261 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.91744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.91744.log.gz 2024-09-21T07:40:52.261 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59105.log 2024-09-21T07:40:52.262 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58619.log 2024-09-21T07:40:52.262 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.84301.log.gz 2024-09-21T07:40:52.263 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59105.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T07:40:52.263 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59105.log.gz 2024-09-21T07:40:52.263 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34785.log 2024-09-21T07:40:52.264 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58619.log.gz 2024-09-21T07:40:52.264 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-21T07:40:52.265 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91215.log 2024-09-21T07:40:52.265 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34785.log.gz 2024-09-21T07:40:52.266 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84379.log 2024-09-21T07:40:52.266 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-21T07:40:52.267 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87496.log 2024-09-21T07:40:52.267 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91215.log.gz 2024-09-21T07:40:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84379.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.57823.log 2024-09-21T07:40:52.268 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84379.log.gz 2024-09-21T07:40:52.268 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90077.log 2024-09-21T07:40:52.269 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57823.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87496.log.gz 2024-09-21T07:40:52.269 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74814.log 2024-09-21T07:40:52.269 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57823.log.gz 2024-09-21T07:40:52.270 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93143.log 2024-09-21T07:40:52.270 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90077.log.gz 2024-09-21T07:40:52.271 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77162.log 2024-09-21T07:40:52.271 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74814.log.gz 2024-09-21T07:40:52.271 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91491.log 2024-09-21T07:40:52.272 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93143.log.gz 2024-09-21T07:40:52.272 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78290.log 2024-09-21T07:40:52.273 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91491.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.77162.log.gz 2024-09-21T07:40:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74892.log 2024-09-21T07:40:52.274 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91491.log.gz 2024-09-21T07:40:52.274 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74424.log 2024-09-21T07:40:52.275 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78290.log.gz 2024-09-21T07:40:52.275 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83784.log 2024-09-21T07:40:52.275 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74892.log: /var/log/ceph/ceph-client.admin.74424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74892.log.gz 2024-09-21T07:40:52.276 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89364.log 2024-09-21T07:40:52.276 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74424.log.gz 2024-09-21T07:40:52.277 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-09-21T07:40:52.277 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83784.log.gz 2024-09-21T07:40:52.277 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88391.log 2024-09-21T07:40:52.278 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89364.log.gz 2024-09-21T07:40:52.278 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50629.log 2024-09-21T07:40:52.278 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-09-21T07:40:52.279 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56724.log 2024-09-21T07:40:52.279 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88391.log.gz 2024-09-21T07:40:52.280 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72585.log 2024-09-21T07:40:52.280 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50629.log.gz 2024-09-21T07:40:52.281 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72425.log 2024-09-21T07:40:52.281 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56724.log.gz 2024-09-21T07:40:52.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85778.log 2024-09-21T07:40:52.282 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72585.log.gz 2024-09-21T07:40:52.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92239.log 2024-09-21T07:40:52.283 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72425.log.gz 2024-09-21T07:40:52.283 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52501.log 2024-09-21T07:40:52.284 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85778.log.gz 2024-09-21T07:40:52.284 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91160.log 2024-09-21T07:40:52.285 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92239.log.gz 2024-09-21T07:40:52.285 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86994.log 2024-09-21T07:40:52.286 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91160.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52501.log.gz 2024-09-21T07:40:52.286 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91160.log.gz 2024-09-21T07:40:52.286 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88152.log 2024-09-21T07:40:52.286 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2024-09-21T07:40:52.287 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86994.log.gz 2024-09-21T07:40:52.288 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72741.log 2024-09-21T07:40:52.288 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88152.log.gz 2024-09-21T07:40:52.288 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2024-09-21T07:40:52.289 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz 2024-09-21T07:40:52.289 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91439.log 2024-09-21T07:40:52.289 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72741.log.gz 2024-09-21T07:40:52.290 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50690.log 2024-09-21T07:40:52.290 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2024-09-21T07:40:52.291 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84167.log 2024-09-21T07:40:52.291 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91439.log.gz 2024-09-21T07:40:52.292 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50690.log.gz 2024-09-21T07:40:52.292 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-09-21T07:40:52.293 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83301.log 2024-09-21T07:40:52.293 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84167.log.gz 2024-09-21T07:40:52.293 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80614.log 2024-09-21T07:40:52.294 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-09-21T07:40:52.294 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55681.log 2024-09-21T07:40:52.295 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83301.log.gz 2024-09-21T07:40:52.295 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80614.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80614.log.gz 2024-09-21T07:40:52.295 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56469.log 2024-09-21T07:40:52.296 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86121.log 2024-09-21T07:40:52.296 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55681.log.gz 2024-09-21T07:40:52.297 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87230.log 2024-09-21T07:40:52.297 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56469.log.gz 2024-09-21T07:40:52.298 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93433.log 2024-09-21T07:40:52.298 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86121.log.gz 2024-09-21T07:40:52.299 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78459.log 2024-09-21T07:40:52.299 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87230.log.gz 2024-09-21T07:40:52.299 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51032.log 2024-09-21T07:40:52.299 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93433.log.gz 2024-09-21T07:40:52.300 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57674.log 2024-09-21T07:40:52.300 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78459.log.gz 2024-09-21T07:40:52.301 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84193.log 2024-09-21T07:40:52.301 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51032.log.gz 2024-09-21T07:40:52.302 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37338.log 2024-09-21T07:40:52.302 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57674.log.gz 2024-09-21T07:40:52.303 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57530.log 2024-09-21T07:40:52.303 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84193.log.gz 2024-09-21T07:40:52.304 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56547.log 2024-09-21T07:40:52.304 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37338.log.gz 2024-09-21T07:40:52.304 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.57530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90051.log 2024-09-21T07:40:52.304 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57530.log.gz 2024-09-21T07:40:52.305 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74710.log 2024-09-21T07:40:52.306 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56547.log.gz 2024-09-21T07:40:52.306 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58567.log 2024-09-21T07:40:52.306 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90051.log.gz 2024-09-21T07:40:52.307 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2024-09-21T07:40:52.307 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74710.log.gz 2024-09-21T07:40:52.308 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83137.log 2024-09-21T07:40:52.308 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58567.log.gz 2024-09-21T07:40:52.309 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2024-09-21T07:40:52.309 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2024-09-21T07:40:52.309 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78377.log 2024-09-21T07:40:52.310 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83137.log.gz 2024-09-21T07:40:52.310 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-09-21T07:40:52.311 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2024-09-21T07:40:52.311 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-21T07:40:52.311 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78377.log.gz 2024-09-21T07:40:52.312 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86430.log 2024-09-21T07:40:52.312 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-09-21T07:40:52.313 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74509.log 2024-09-21T07:40:52.313 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-21T07:40:52.314 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90537.log 2024-09-21T07:40:52.314 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86430.log.gz 2024-09-21T07:40:52.314 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84561.log 2024-09-21T07:40:52.315 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74509.log.gz 2024-09-21T07:40:52.315 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72214.log 2024-09-21T07:40:52.316 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90537.log.gz 2024-09-21T07:40:52.316 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89539.log 2024-09-21T07:40:52.316 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84561.log.gz 2024-09-21T07:40:52.317 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55629.log 2024-09-21T07:40:52.317 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72214.log.gz 2024-09-21T07:40:52.318 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51006.log 2024-09-21T07:40:52.318 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89539.log.gz 2024-09-21T07:40:52.319 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72559.log 2024-09-21T07:40:52.319 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55629.log.gz 2024-09-21T07:40:52.319 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75633.log 2024-09-21T07:40:52.320 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51006.log.gz 2024-09-21T07:40:52.320 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29481.log 2024-09-21T07:40:52.321 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72559.log.gz 2024-09-21T07:40:52.321 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.75633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75633.log.gz 2024-09-21T07:40:52.321 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35147.log 2024-09-21T07:40:52.322 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-09-21T07:40:52.322 INFO:teuthology.orchestra.run.smithi064.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29481.log.gz 2024-09-21T07:40:52.323 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2024-09-21T07:40:52.323 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35147.log.gz 2024-09-21T07:40:52.323 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80666.log 2024-09-21T07:40:52.324 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-09-21T07:40:52.324 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86534.log 2024-09-21T07:40:52.324 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz 2024-09-21T07:40:52.325 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80640.log 2024-09-21T07:40:52.325 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80666.log.gz 2024-09-21T07:40:52.326 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53145.log 2024-09-21T07:40:52.326 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86534.log.gz 2024-09-21T07:40:52.327 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53983.log 2024-09-21T07:40:52.327 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80640.log.gz 2024-09-21T07:40:52.327 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92552.log 2024-09-21T07:40:52.328 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53145.log.gz 2024-09-21T07:40:52.328 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92469.log 2024-09-21T07:40:52.329 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53983.log.gz 2024-09-21T07:40:52.329 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-09-21T07:40:52.329 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92552.log.gz 2024-09-21T07:40:52.330 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54559.log 2024-09-21T07:40:52.330 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92469.log.gz 2024-09-21T07:40:52.331 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92909.log 2024-09-21T07:40:52.331 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-09-21T07:40:52.332 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35623.log 2024-09-21T07:40:52.332 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54559.log.gz 2024-09-21T07:40:52.332 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92909.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24042.log 2024-09-21T07:40:52.333 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92909.log.gz 2024-09-21T07:40:52.333 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77084.log 2024-09-21T07:40:52.334 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35623.log.gz 2024-09-21T07:40:52.334 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.tmp-client.admin.24042.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24042.log.gz 2024-09-21T07:40:52.334 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72793.log 2024-09-21T07:40:52.335 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34522.log 2024-09-21T07:40:52.335 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77084.log.gz 2024-09-21T07:40:52.336 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52777.log 2024-09-21T07:40:52.336 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72793.log.gz 2024-09-21T07:40:52.336 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53223.log 2024-09-21T07:40:52.337 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52777.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34522.log.gz 2024-09-21T07:40:52.337 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87098.log 2024-09-21T07:40:52.338 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52777.log.gz 2024-09-21T07:40:52.338 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36063.log 2024-09-21T07:40:52.339 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53223.log.gz 2024-09-21T07:40:52.339 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72122.log 2024-09-21T07:40:52.339 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87098.log.gz 2024-09-21T07:40:52.340 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-09-21T07:40:52.340 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36063.log.gz 2024-09-21T07:40:52.341 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83219.log 2024-09-21T07:40:52.341 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72122.log.gz 2024-09-21T07:40:52.341 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72070.log 2024-09-21T07:40:52.342 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-09-21T07:40:52.342 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81781.log 2024-09-21T07:40:52.342 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83219.log.gz 2024-09-21T07:40:52.343 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-09-21T07:40:52.343 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72070.log.gz 2024-09-21T07:40:52.344 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77718.log 2024-09-21T07:40:52.344 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81781.log.gz 2024-09-21T07:40:52.345 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29017.log 2024-09-21T07:40:52.345 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-09-21T07:40:52.346 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-09-21T07:40:52.346 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77718.log.gz 2024-09-21T07:40:52.346 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87873.log 2024-09-21T07:40:52.347 INFO:teuthology.orchestra.run.smithi064.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29017.log.gz 2024-09-21T07:40:52.347 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81511.log 2024-09-21T07:40:52.347 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-09-21T07:40:52.348 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56646.log 2024-09-21T07:40:52.348 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87873.log.gz 2024-09-21T07:40:52.349 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79858.log 2024-09-21T07:40:52.349 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81511.log.gz 2024-09-21T07:40:52.350 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51412.log 2024-09-21T07:40:52.350 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56646.log.gz 2024-09-21T07:40:52.350 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.79858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50664.log 2024-09-21T07:40:52.351 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79858.log.gz 2024-09-21T07:40:52.352 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35141.log 2024-09-21T07:40:52.352 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51412.log.gz 2024-09-21T07:40:52.352 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80112.log 2024-09-21T07:40:52.353 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50664.log.gz 2024-09-21T07:40:52.353 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77366.log 2024-09-21T07:40:52.353 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35141.log.gz 2024-09-21T07:40:52.354 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87178.log 2024-09-21T07:40:52.354 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80112.log.gz 2024-09-21T07:40:52.355 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77366.log: gzip -5 --verbose 87.1% -- -- replaced with /var/log/ceph/ceph-client.admin.77366.log.gz /var/log/ceph/ceph-client.admin.55469.log 2024-09-21T07:40:52.355 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:52.356 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37544.log 2024-09-21T07:40:52.356 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87178.log.gz 2024-09-21T07:40:52.357 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72333.log 2024-09-21T07:40:52.357 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55469.log.gz 2024-09-21T07:40:52.357 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-09-21T07:40:52.358 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37544.log.gz 2024-09-21T07:40:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35137.log 2024-09-21T07:40:52.358 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72333.log.gz 2024-09-21T07:40:52.359 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83273.log 2024-09-21T07:40:52.359 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2024-09-21T07:40:52.360 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34392.log 2024-09-21T07:40:52.360 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35137.log.gz 2024-09-21T07:40:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29037.log 2024-09-21T07:40:52.361 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83273.log.gz 2024-09-21T07:40:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74684.log 2024-09-21T07:40:52.362 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz 2024-09-21T07:40:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29037.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T07:40:52.362 INFO:teuthology.orchestra.run.smithi064.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.29037.log.gz 2024-09-21T07:40:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74483.log 2024-09-21T07:40:52.363 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74684.log.gz 2024-09-21T07:40:52.364 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91853.log 2024-09-21T07:40:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53302.log 2024-09-21T07:40:52.365 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74483.log.gz 2024-09-21T07:40:52.366 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74788.log 2024-09-21T07:40:52.366 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91853.log.gz 2024-09-21T07:40:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89800.log 2024-09-21T07:40:52.367 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53302.log.gz 2024-09-21T07:40:52.368 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71765.log 2024-09-21T07:40:52.368 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74788.log.gz 2024-09-21T07:40:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89565.log 2024-09-21T07:40:52.369 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89800.log.gz 2024-09-21T07:40:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71765.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71765.log.gz 2024-09-21T07:40:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86508.log 2024-09-21T07:40:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90874.log 2024-09-21T07:40:52.371 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89565.log.gz 2024-09-21T07:40:52.371 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88426.log 2024-09-21T07:40:52.372 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86508.log.gz 2024-09-21T07:40:52.372 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56672.log 2024-09-21T07:40:52.373 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90874.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90874.log.gz 2024-09-21T07:40:52.373 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83061.log 2024-09-21T07:40:52.373 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88426.log.gz 2024-09-21T07:40:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-09-21T07:40:52.374 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2024-09-21T07:40:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55655.log 2024-09-21T07:40:52.375 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.83061.log.gz 2024-09-21T07:40:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57582.log 2024-09-21T07:40:52.377 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-09-21T07:40:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55655.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55655.log.gz 2024-09-21T07:40:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34919.log 2024-09-21T07:40:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-09-21T07:40:52.378 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57582.log.gz 2024-09-21T07:40:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81182.log 2024-09-21T07:40:52.380 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34919.log.gz 2024-09-21T07:40:52.380 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51362.log 2024-09-21T07:40:52.381 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-09-21T07:40:52.381 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81182.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.81182.log.gz 2024-09-21T07:40:52.381 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.86677.log 2024-09-21T07:40:52.382 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93117.log 2024-09-21T07:40:52.383 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86677.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51362.log.gz 2024-09-21T07:40:52.383 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77666.log 2024-09-21T07:40:52.384 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86677.log.gz 2024-09-21T07:40:52.384 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57119.log 2024-09-21T07:40:52.384 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93117.log.gz 2024-09-21T07:40:52.385 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83329.log 2024-09-21T07:40:52.385 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77666.log.gz 2024-09-21T07:40:52.386 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89035.log 2024-09-21T07:40:52.386 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57119.log.gz 2024-09-21T07:40:52.387 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72148.log 2024-09-21T07:40:52.387 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83329.log.gz 2024-09-21T07:40:52.388 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91134.log 2024-09-21T07:40:52.388 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89035.log.gz 2024-09-21T07:40:52.389 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80867.log 2024-09-21T07:40:52.389 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72148.log.gz 2024-09-21T07:40:52.390 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80008.log 2024-09-21T07:40:52.390 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91134.log.gz 2024-09-21T07:40:52.390 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87124.log 2024-09-21T07:40:52.391 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80867.log.gz 2024-09-21T07:40:52.392 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51462.log 2024-09-21T07:40:52.392 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80008.log.gz 2024-09-21T07:40:52.392 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74613.log 2024-09-21T07:40:52.392 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87124.log.gz 2024-09-21T07:40:52.393 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75536.log 2024-09-21T07:40:52.394 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51462.log.gz 2024-09-21T07:40:52.394 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74613.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74613.log.gz 2024-09-21T07:40:52.394 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50206.log 2024-09-21T07:40:52.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84485.log 2024-09-21T07:40:52.396 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75536.log.gz 2024-09-21T07:40:52.396 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89513.log 2024-09-21T07:40:52.397 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50206.log.gz 2024-09-21T07:40:52.397 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2024-09-21T07:40:52.397 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84485.log.gz 2024-09-21T07:40:52.398 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81325.log 2024-09-21T07:40:52.398 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89513.log.gz 2024-09-21T07:40:52.399 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57483.log 2024-09-21T07:40:52.399 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz 2024-09-21T07:40:52.400 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88185.log 2024-09-21T07:40:52.400 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81325.log.gz 2024-09-21T07:40:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75194.log 2024-09-21T07:40:52.401 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57483.log.gz 2024-09-21T07:40:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86912.log 2024-09-21T07:40:52.402 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88185.log.gz 2024-09-21T07:40:52.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-09-21T07:40:52.403 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75194.log.gz 2024-09-21T07:40:52.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72533.log 2024-09-21T07:40:52.404 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86912.log.gz 2024-09-21T07:40:52.404 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34247.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T07:40:52.404 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-09-21T07:40:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2024-09-21T07:40:52.405 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72533.log.gz 2024-09-21T07:40:52.406 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93039.log 2024-09-21T07:40:52.407 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36849.log 2024-09-21T07:40:52.407 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2024-09-21T07:40:52.408 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93039.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93039.log.gz 2024-09-21T07:40:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78537.log 2024-09-21T07:40:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78686.log/var/log/ceph/ceph-client.admin.36849.log: 2024-09-21T07:40:52.410 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36849.log.gz 2024-09-21T07:40:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83995.log 2024-09-21T07:40:52.411 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78537.log.gz 2024-09-21T07:40:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.78686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78686.log.gz 2024-09-21T07:40:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93013.log 2024-09-21T07:40:52.413 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.83995.log: -- /var/log/ceph/ceph-client.admin.89943.log 2024-09-21T07:40:52.413 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83995.log.gz 2024-09-21T07:40:52.414 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92656.log 2024-09-21T07:40:52.414 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93013.log.gz 2024-09-21T07:40:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75048.log 2024-09-21T07:40:52.415 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89943.log.gz 2024-09-21T07:40:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72843.log 2024-09-21T07:40:52.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92656.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92656.log.gz 2024-09-21T07:40:52.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92031.log 2024-09-21T07:40:52.417 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75048.log.gz 2024-09-21T07:40:52.418 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86793.log 2024-09-21T07:40:52.418 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72843.log.gz 2024-09-21T07:40:52.419 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53171.log 2024-09-21T07:40:52.420 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92031.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92031.log.gz 2024-09-21T07:40:52.420 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55143.log 2024-09-21T07:40:52.420 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86793.log.gz 2024-09-21T07:40:52.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88281.log 2024-09-21T07:40:52.421 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53171.log.gz 2024-09-21T07:40:52.422 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89338.log 2024-09-21T07:40:52.423 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55143.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55143.log.gz 2024-09-21T07:40:52.423 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56521.log 2024-09-21T07:40:52.423 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88281.log.gz 2024-09-21T07:40:52.424 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90699.log 2024-09-21T07:40:52.424 INFO:teuthology.orchestra.run.smithi064.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.89338.log.gz 2024-09-21T07:40:52.425 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90361.log 2024-09-21T07:40:52.426 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56521.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56521.log.gz 2024-09-21T07:40:52.426 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-09-21T07:40:52.426 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90699.log.gz 2024-09-21T07:40:52.427 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58312.log 2024-09-21T07:40:52.427 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90361.log.gz 2024-09-21T07:40:52.428 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-09-21T07:40:52.429 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36526.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-09-21T07:40:52.429 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92339.log 2024-09-21T07:40:52.429 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58312.log.gz 2024-09-21T07:40:52.430 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-09-21T07:40:52.430 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-09-21T07:40:52.431 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57433.log 2024-09-21T07:40:52.433 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92339.log: /var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55707.log 2024-09-21T07:40:52.433 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92339.log.gz 2024-09-21T07:40:52.433 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-09-21T07:40:52.433 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77523.log 2024-09-21T07:40:52.434 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57433.log.gz 2024-09-21T07:40:52.434 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88534.log 2024-09-21T07:40:52.436 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77523.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55707.log.gz 2024-09-21T07:40:52.436 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-09-21T07:40:52.436 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77523.log.gz 2024-09-21T07:40:52.437 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55202.log 2024-09-21T07:40:52.437 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88534.log.gz 2024-09-21T07:40:52.438 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86456.log 2024-09-21T07:40:52.438 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36675.log: /var/log/ceph/ceph-client.admin.55202.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-09-21T07:40:52.439 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84511.log 2024-09-21T07:40:52.439 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55202.log.gz 2024-09-21T07:40:52.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88478.log 2024-09-21T07:40:52.440 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86456.log.gz 2024-09-21T07:40:52.441 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-09-21T07:40:52.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84511.log: /var/log/ceph/ceph-client.admin.88478.log: 91.0% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84511.log.gzgzip 2024-09-21T07:40:52.442 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88478.log.gz 2024-09-21T07:40:52.442 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55408.log 2024-09-21T07:40:52.443 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29089.log 2024-09-21T07:40:52.443 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-09-21T07:40:52.444 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.55408.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.90025.log 2024-09-21T07:40:52.444 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55408.log.gz 2024-09-21T07:40:52.445 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29089.log.gz 2024-09-21T07:40:52.445 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90796.log 2024-09-21T07:40:52.446 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87795.log 2024-09-21T07:40:52.446 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90025.log.gz 2024-09-21T07:40:52.447 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-09-21T07:40:52.447 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90796.log.gz 2024-09-21T07:40:52.448 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83706.log 2024-09-21T07:40:52.449 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87795.log: /var/log/ceph/ceph-client.admin.29536.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87795.log.gz 2024-09-21T07:40:52.449 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91941.log 2024-09-21T07:40:52.449 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-09-21T07:40:52.450 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83680.log 2024-09-21T07:40:52.450 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83706.log.gz 2024-09-21T07:40:52.451 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86209.log 2024-09-21T07:40:52.452 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91941.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91941.log.gz 2024-09-21T07:40:52.452 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83576.log 2024-09-21T07:40:52.452 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83680.log.gz 2024-09-21T07:40:52.453 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81032.log 2024-09-21T07:40:52.454 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86209.log.gz 2024-09-21T07:40:52.454 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-09-21T07:40:52.455 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83576.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83576.log.gz 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58830.log 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81032.log.gz 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54836.log 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84047.log 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58830.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58830.log.gz 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58749.log 2024-09-21T07:40:52.459 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54836.log.gz 2024-09-21T07:40:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58858.log 2024-09-21T07:40:52.460 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84047.log.gz 2024-09-21T07:40:52.460 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91465.log 2024-09-21T07:40:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58749.log: /var/log/ceph/ceph-client.admin.58858.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58749.log.gz 2024-09-21T07:40:52.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2024-09-21T07:40:52.462 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58858.log.gz 2024-09-21T07:40:52.463 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56099.log 2024-09-21T07:40:52.463 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91465.log.gz 2024-09-21T07:40:52.464 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-21T07:40:52.464 INFO:teuthology.orchestra.run.smithi090.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T07:40:52.465 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56099.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2024-09-21T07:40:52.465 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-09-21T07:40:52.465 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56099.log.gz 2024-09-21T07:40:52.466 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88844.log 2024-09-21T07:40:52.466 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz 2024-09-21T07:40:52.467 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2024-09-21T07:40:52.467 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35649.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-09-21T07:40:52.468 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89169.log 2024-09-21T07:40:52.468 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88844.log.gz 2024-09-21T07:40:52.469 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34191.log 2024-09-21T07:40:52.469 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2024-09-21T07:40:52.470 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54190.log 2024-09-21T07:40:52.470 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89169.log: /var/log/ceph/ceph-client.admin.34191.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89169.log.gz 2024-09-21T07:40:52.471 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37468.log 2024-09-21T07:40:52.471 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34191.log.gz 2024-09-21T07:40:52.472 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88716.log 2024-09-21T07:40:52.472 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54190.log.gz 2024-09-21T07:40:52.473 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80366.log 2024-09-21T07:40:52.473 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37468.log.gz 2024-09-21T07:40:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-09-21T07:40:52.475 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88716.log.gz 2024-09-21T07:40:52.475 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37178.log 2024-09-21T07:40:52.476 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80366.log.gz 2024-09-21T07:40:52.476 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58182.log 2024-09-21T07:40:52.477 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-09-21T07:40:52.478 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54457.log 2024-09-21T07:40:52.478 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37178.log.gz 2024-09-21T07:40:52.479 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2024-09-21T07:40:52.479 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58182.log.gz 2024-09-21T07:40:52.480 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86235.log 2024-09-21T07:40:52.480 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54457.log.gz 2024-09-21T07:40:52.481 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75432.log 2024-09-21T07:40:52.481 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2024-09-21T07:40:52.482 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57551.log 2024-09-21T07:40:52.482 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86235.log.gz 2024-09-21T07:40:52.483 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.75432.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75276.log 2024-09-21T07:40:52.484 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75432.log.gz 2024-09-21T07:40:52.484 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50545.log 2024-09-21T07:40:52.484 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57551.log.gz 2024-09-21T07:40:52.485 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75276.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.78351.log -- replaced with /var/log/ceph/ceph-client.admin.75276.log.gz 2024-09-21T07:40:52.485 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:52.486 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75250.log 2024-09-21T07:40:52.487 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50545.log.gz 2024-09-21T07:40:52.487 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34165.log 2024-09-21T07:40:52.487 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78351.log.gz 2024-09-21T07:40:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86287.log 2024-09-21T07:40:52.488 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75250.log.gz 2024-09-21T07:40:52.489 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35154.log 2024-09-21T07:40:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34165.log: 87.5%/var/log/ceph/ceph-client.admin.86287.log: -- replaced with /var/log/ceph/ceph-client.admin.34165.log.gz 2024-09-21T07:40:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-09-21T07:40:52.490 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86287.log.gz 2024-09-21T07:40:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35154.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35154.log.gz 2024-09-21T07:40:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53541.log 2024-09-21T07:40:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83355.log 2024-09-21T07:40:52.493 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36604.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-09-21T07:40:52.494 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-09-21T07:40:52.494 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53541.log.gz 2024-09-21T07:40:52.495 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87743.log 2024-09-21T07:40:52.495 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83355.log.gz 2024-09-21T07:40:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-09-21T07:40:52.497 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49758.log: /var/log/ceph/ceph-client.admin.87743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71420.log 90.8% 2024-09-21T07:40:52.497 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-09-21T07:40:52.497 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87743.log.gz 2024-09-21T07:40:52.498 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2024-09-21T07:40:52.498 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-09-21T07:40:52.499 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77640.log 2024-09-21T07:40:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71420.log: /var/log/ceph/ceph-client.admin.28959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51741.log 2024-09-21T07:40:52.500 INFO:teuthology.orchestra.run.smithi064.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2024-09-21T07:40:52.500 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71420.log.gz 2024-09-21T07:40:52.500 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83732.log 2024-09-21T07:40:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77640.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77640.log.gz 2024-09-21T07:40:52.501 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-09-21T07:40:52.503 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51741.log.gz 2024-09-21T07:40:52.503 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80468.log 2024-09-21T07:40:52.503 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83732.log.gz 2024-09-21T07:40:52.504 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53775.log 2024-09-21T07:40:52.504 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-09-21T07:40:52.505 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56443.log 2024-09-21T07:40:52.505 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80468.log.gz 2024-09-21T07:40:52.506 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54914.log 2024-09-21T07:40:52.506 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53775.log.gz 2024-09-21T07:40:52.507 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50336.log 2024-09-21T07:40:52.507 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56443.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56443.log.gz 2024-09-21T07:40:52.508 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84075.log 2024-09-21T07:40:52.509 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54914.log.gz 2024-09-21T07:40:52.509 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83864.log 2024-09-21T07:40:52.509 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50336.log.gz 2024-09-21T07:40:52.510 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53335.log 2024-09-21T07:40:52.511 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84075.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84075.log.gz 2024-09-21T07:40:52.511 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-09-21T07:40:52.511 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83864.log.gz 2024-09-21T07:40:52.512 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77744.log 2024-09-21T07:40:52.512 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53335.log.gz 2024-09-21T07:40:52.513 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2024-09-21T07:40:52.514 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36500.log: /var/log/ceph/ceph-client.admin.77744.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-09-21T07:40:52.514 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-09-21T07:40:52.514 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77744.log.gz 2024-09-21T07:40:52.515 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90900.log 2024-09-21T07:40:52.515 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2024-09-21T07:40:52.516 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53907.log 2024-09-21T07:40:52.517 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37152.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-09-21T07:40:52.517 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-09-21T07:40:52.517 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90900.log.gz 2024-09-21T07:40:52.518 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35793.log 2024-09-21T07:40:52.519 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53907.log.gz 2024-09-21T07:40:52.519 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77419.log 2024-09-21T07:40:52.520 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-09-21T07:40:52.520 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56417.log 2024-09-21T07:40:52.521 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35793.log.gz 2024-09-21T07:40:52.521 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74866.log 2024-09-21T07:40:52.522 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77419.log.gz 2024-09-21T07:40:52.522 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89234.log/var/log/ceph/ceph-client.admin.56417.log: 2024-09-21T07:40:52.523 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56417.log.gz 2024-09-21T07:40:52.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58515.log 2024-09-21T07:40:52.524 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74866.log.gz 2024-09-21T07:40:52.524 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50083.log 2024-09-21T07:40:52.525 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89234.log.gz 2024-09-21T07:40:52.526 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93403.log 2024-09-21T07:40:52.526 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58515.log.gz 2024-09-21T07:40:52.527 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81485.log 2024-09-21T07:40:52.528 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50083.log.gz 2024-09-21T07:40:52.529 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86767.log 2024-09-21T07:40:52.529 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93403.log.gz 2024-09-21T07:40:52.529 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77841.log 2024-09-21T07:40:52.531 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81485.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81485.log.gz 2024-09-21T07:40:52.531 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37364.log 2024-09-21T07:40:52.531 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86767.log.gz 2024-09-21T07:40:52.533 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37286.log 2024-09-21T07:40:52.533 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77841.log.gz 2024-09-21T07:40:52.533 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-client.admin.37364.log: --verbose -- /var/log/ceph/ceph-client.admin.58008.log 2024-09-21T07:40:52.533 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37364.log.gz 2024-09-21T07:40:52.535 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92604.log 2024-09-21T07:40:52.535 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37286.log.gz 2024-09-21T07:40:52.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75022.log 2024-09-21T07:40:52.536 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58008.log.gz 2024-09-21T07:40:52.536 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57275.log 2024-09-21T07:40:52.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92604.log.gz 2024-09-21T07:40:52.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82961.log 2024-09-21T07:40:52.539 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75022.log.gz 2024-09-21T07:40:52.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80973.log 2024-09-21T07:40:52.539 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57275.log.gz 2024-09-21T07:40:52.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.82961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77895.log 2024-09-21T07:40:52.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80973.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.82961.log.gz 2024-09-21T07:40:52.541 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52017.log 2024-09-21T07:40:52.541 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80973.log.gz 2024-09-21T07:40:52.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80562.log 2024-09-21T07:40:52.542 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77895.log.gz 2024-09-21T07:40:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74391.log 2024-09-21T07:40:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80562.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52017.log.gz 2024-09-21T07:40:52.543 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86586.log 2024-09-21T07:40:52.543 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80562.log.gz 2024-09-21T07:40:52.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74391.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74391.log.gz 2024-09-21T07:40:52.544 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91004.log 2024-09-21T07:40:52.545 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53619.log 2024-09-21T07:40:52.546 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86586.log: /var/log/ceph/ceph-client.admin.91004.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86586.log.gz 2024-09-21T07:40:52.546 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91004.log.gz 2024-09-21T07:40:52.546 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-09-21T07:40:52.547 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53619.log: -- /var/log/ceph/ceph-client.admin.71470.log 2024-09-21T07:40:52.547 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53619.log.gz 2024-09-21T07:40:52.548 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-09-21T07:40:52.548 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81238.log 2024-09-21T07:40:52.549 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54483.log 2024-09-21T07:40:52.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71470.log: /var/log/ceph/ceph-client.admin.81238.log: gzip -5 --verbose -- 90.8% /var/log/ceph/ceph-client.admin.52220.log -- replaced with /var/log/ceph/ceph-client.admin.71470.log.gz 2024-09-21T07:40:52.551 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:52.551 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81238.log.gz 2024-09-21T07:40:52.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81130.log 2024-09-21T07:40:52.552 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52220.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54483.log.gz 2024-09-21T07:40:52.552 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T07:40:52.552 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2024-09-21T07:40:52.553 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34841.log 2024-09-21T07:40:52.554 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81130.log.gz 2024-09-21T07:40:52.554 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-09-21T07:40:52.555 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.34841.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34841.log.gz -5 2024-09-21T07:40:52.555 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77549.log 2024-09-21T07:40:52.556 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78563.log 2024-09-21T07:40:52.557 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36474.log: /var/log/ceph/ceph-client.admin.77549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-09-21T07:40:52.557 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58945.log 2024-09-21T07:40:52.557 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77549.log.gz 2024-09-21T07:40:52.558 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35909.log 2024-09-21T07:40:52.558 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78563.log.gz 2024-09-21T07:40:52.559 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74925.log 2024-09-21T07:40:52.560 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58945.log.gz 2024-09-21T07:40:52.560 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.35909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35909.log.gz 2024-09-21T07:40:52.560 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71895.log 2024-09-21T07:40:52.561 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.74925.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36362.log 2024-09-21T07:40:52.562 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74925.log.gz 2024-09-21T07:40:52.563 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-09-21T07:40:52.563 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71895.log.gz 2024-09-21T07:40:52.563 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58145.log 2024-09-21T07:40:52.564 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36362.log.gz 2024-09-21T07:40:52.564 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93325.log 2024-09-21T07:40:52.565 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34572.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-09-21T07:40:52.566 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2024-09-21T07:40:52.566 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58145.log.gz 2024-09-21T07:40:52.567 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81563.log 2024-09-21T07:40:52.567 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93325.log.gz 2024-09-21T07:40:52.567 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92187.log 2024-09-21T07:40:52.568 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50980.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2024-09-21T07:40:52.569 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50824.log 2024-09-21T07:40:52.569 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81563.log.gz 2024-09-21T07:40:52.570 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80060.log 2024-09-21T07:40:52.570 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92187.log.gz 2024-09-21T07:40:52.571 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74587.log 2024-09-21T07:40:52.571 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50824.log.gz 2024-09-21T07:40:52.572 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-09-21T07:40:52.572 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80060.log.gz 2024-09-21T07:40:52.573 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87072.log 2024-09-21T07:40:52.573 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74587.log.gz 2024-09-21T07:40:52.574 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80290.log 2024-09-21T07:40:52.576 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34700.log: /var/log/ceph/ceph-client.admin.87072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88742.log 2024-09-21T07:40:52.576 INFO:teuthology.orchestra.run.smithi064.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.87072.log.gz 2024-09-21T07:40:52.576 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80290.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-09-21T07:40:52.576 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80290.log.gz 2024-09-21T07:40:52.578 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75220.log 2024-09-21T07:40:52.578 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37208.log 2024-09-21T07:40:52.578 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88742.log.gz 2024-09-21T07:40:52.579 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53829.log 2024-09-21T07:40:52.579 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75220.log.gz 2024-09-21T07:40:52.580 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89140.log 2024-09-21T07:40:52.581 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37208.log.gz 2024-09-21T07:40:52.581 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72663.log 2024-09-21T07:40:52.581 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53829.log.gz 2024-09-21T07:40:52.582 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72307.log 2024-09-21T07:40:52.583 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89140.log.gz 2024-09-21T07:40:52.583 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55830.log 2024-09-21T07:40:52.583 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72663.log.gz 2024-09-21T07:40:52.584 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-09-21T07:40:52.584 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72307.log.gz 2024-09-21T07:40:52.585 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50720.log 2024-09-21T07:40:52.585 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55830.log.gz 2024-09-21T07:40:52.586 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72390.log 2024-09-21T07:40:52.587 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-09-21T07:40:52.587 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50720.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50720.log.gz 2024-09-21T07:40:52.587 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75586.log 2024-09-21T07:40:52.588 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.72390.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74762.log 2024-09-21T07:40:52.589 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72390.log.gz 2024-09-21T07:40:52.590 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72507.log 2024-09-21T07:40:52.590 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75586.log.gz 2024-09-21T07:40:52.591 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80815.log 2024-09-21T07:40:52.592 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74762.log.gz 2024-09-21T07:40:52.592 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89669.log 2024-09-21T07:40:52.592 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72507.log.gz 2024-09-21T07:40:52.593 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77921.log 2024-09-21T07:40:52.593 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80815.log.gz 2024-09-21T07:40:52.594 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54985.log 2024-09-21T07:40:52.594 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89669.log.gz 2024-09-21T07:40:52.595 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35146.log 2024-09-21T07:40:52.595 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77921.log.gz 2024-09-21T07:40:52.596 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54129.log 2024-09-21T07:40:52.596 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54985.log.gz 2024-09-21T07:40:52.597 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88586.log 2024-09-21T07:40:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35146.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35146.log.gz 2024-09-21T07:40:52.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91186.log 2024-09-21T07:40:52.599 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54129.log.gz 2024-09-21T07:40:52.599 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54245.log 2024-09-21T07:40:52.599 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88586.log.gz 2024-09-21T07:40:52.600 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2024-09-21T07:40:52.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91186.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91186.log.gz 2024-09-21T07:40:52.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89826.log 2024-09-21T07:40:52.602 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54245.log.gz 2024-09-21T07:40:52.602 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74457.log 2024-09-21T07:40:52.602 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2024-09-21T07:40:52.603 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81156.log 2024-09-21T07:40:52.604 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89826.log.gz 2024-09-21T07:40:52.604 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86482.log 2024-09-21T07:40:52.605 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74457.log.gz 2024-09-21T07:40:52.606 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87685.log 2024-09-21T07:40:52.606 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81156.log.gz 2024-09-21T07:40:52.606 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75354.log 2024-09-21T07:40:52.607 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86482.log.gz 2024-09-21T07:40:52.608 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87685.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87685.log.gz 2024-09-21T07:40:52.608 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81537.log 2024-09-21T07:40:52.608 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84459.log 2024-09-21T07:40:52.609 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75354.log.gz 2024-09-21T07:40:52.610 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36875.log 2024-09-21T07:40:52.610 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81537.log.gz 2024-09-21T07:40:52.611 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51841.log 2024-09-21T07:40:52.611 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84459.log.gz 2024-09-21T07:40:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58260.log 2024-09-21T07:40:52.612 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2024-09-21T07:40:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2024-09-21T07:40:52.614 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51841.log.gz 2024-09-21T07:40:52.614 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57670.log 2024-09-21T07:40:52.615 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58260.log.gz 2024-09-21T07:40:52.615 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86851.log 2024-09-21T07:40:52.616 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz 2024-09-21T07:40:52.616 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57670.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57670.log.gz 2024-09-21T07:40:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90408.log 2024-09-21T07:40:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84141.log 2024-09-21T07:40:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86851.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86851.log.gz 2024-09-21T07:40:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.90408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90408.log.gz 2024-09-21T07:40:52.619 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-21T07:40:52.620 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55923.log 2024-09-21T07:40:52.620 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84141.log.gz 2024-09-21T07:40:52.621 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57093.log 2024-09-21T07:40:52.621 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-21T07:40:52.621 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.55923.log: -- /var/log/ceph/ceph-client.admin.57041.log 2024-09-21T07:40:52.622 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55923.log.gz 2024-09-21T07:40:52.623 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50284.log 2024-09-21T07:40:52.623 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57093.log.gz 2024-09-21T07:40:52.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58652.log 2024-09-21T07:40:52.624 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57041.log.gz 2024-09-21T07:40:52.625 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-09-21T07:40:52.625 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50284.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50284.log.gz 2024-09-21T07:40:52.626 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92708.log 2024-09-21T07:40:52.626 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58652.log.gz 2024-09-21T07:40:52.627 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37063.log 2024-09-21T07:40:52.627 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-09-21T07:40:52.628 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35571.log 2024-09-21T07:40:52.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92708.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92708.log.gz 2024-09-21T07:40:52.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87970.log 2024-09-21T07:40:52.629 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37063.log.gz 2024-09-21T07:40:52.630 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83498.log 2024-09-21T07:40:52.630 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35571.log.gz 2024-09-21T07:40:52.631 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-client.admin.87970.log: --verbose -- /var/log/ceph/ceph-client.admin.91305.log 2024-09-21T07:40:52.632 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87970.log.gz 2024-09-21T07:40:52.633 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-09-21T07:40:52.633 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83498.log.gz 2024-09-21T07:40:52.634 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57906.log 2024-09-21T07:40:52.634 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91305.log.gz 2024-09-21T07:40:52.634 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76904.log 2024-09-21T07:40:52.635 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-09-21T07:40:52.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81381.log 2024-09-21T07:40:52.636 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57906.log.gz 2024-09-21T07:40:52.637 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.76904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2024-09-21T07:40:52.638 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76904.log.gz 2024-09-21T07:40:52.638 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87769.log 2024-09-21T07:40:52.638 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81381.log.gz 2024-09-21T07:40:52.639 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85918.log 2024-09-21T07:40:52.640 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2024-09-21T07:40:52.640 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87769.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87769.log.gz 2024-09-21T07:40:52.641 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74561.log 2024-09-21T07:40:52.641 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85918.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T07:40:52.643 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74561.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85918.log.gz 2024-09-21T07:40:52.643 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57327.log 2024-09-21T07:40:52.643 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74561.log.gz 2024-09-21T07:40:52.643 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85841.log 2024-09-21T07:40:52.644 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57327.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57327.log.gz 2024-09-21T07:40:52.645 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80744.log 2024-09-21T07:40:52.645 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-client.admin.85841.log: --verbose -- /var/log/ceph/ceph-client.admin.55603.log 2024-09-21T07:40:52.646 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85841.log.gz 2024-09-21T07:40:52.647 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80744.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80744.log.gz 2024-09-21T07:40:52.647 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80919.log 2024-09-21T07:40:52.648 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55603.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55603.log.gz 2024-09-21T07:40:52.649 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77340.log 2024-09-21T07:40:52.650 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89312.log 2024-09-21T07:40:52.650 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80919.log.gz 2024-09-21T07:40:52.651 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77796.log 2024-09-21T07:40:52.651 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77340.log.gz 2024-09-21T07:40:52.652 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91791.log 2024-09-21T07:40:52.652 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89312.log.gz 2024-09-21T07:40:52.653 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77796.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77796.log.gz 2024-09-21T07:40:52.654 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2024-09-21T07:40:52.655 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91791.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91791.log.gz 2024-09-21T07:40:52.655 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77262.log 2024-09-21T07:40:52.656 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49952.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz -5 2024-09-21T07:40:52.657 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55495.log 2024-09-21T07:40:52.657 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.77262.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-09-21T07:40:52.658 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77262.log.gz 2024-09-21T07:40:52.659 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59375.log 2024-09-21T07:40:52.659 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55495.log.gz 2024-09-21T07:40:52.662 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log 2024-09-21T07:40:52.662 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-09-21T07:40:52.662 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88638.log 2024-09-21T07:40:52.662 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59375.log.gz 2024-09-21T07:40:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52996.log 2024-09-21T07:40:52.663 INFO:teuthology.orchestra.run.smithi064.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-09-21T07:40:52.663 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88638.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88638.log.gz 2024-09-21T07:40:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52996.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52996.log.gz 2024-09-21T07:40:52.665 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92935.log 2024-09-21T07:40:52.666 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87847.log 2024-09-21T07:40:52.667 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29457.log 2024-09-21T07:40:52.668 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92935.log.gz 2024-09-21T07:40:52.668 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87847.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87847.log.gz 2024-09-21T07:40:52.669 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29457.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29457.log.gz 2024-09-21T07:40:52.670 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91569.log 2024-09-21T07:40:52.671 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80494.log 2024-09-21T07:40:52.672 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56495.log 2024-09-21T07:40:52.672 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91569.log.gz 2024-09-21T07:40:52.673 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80494.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80494.log.gz 2024-09-21T07:40:52.675 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56495.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56495.log.gz 2024-09-21T07:40:52.675 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93169.log 2024-09-21T07:40:52.676 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74365.log 2024-09-21T07:40:52.677 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92137.log 2024-09-21T07:40:52.677 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93169.log.gz 2024-09-21T07:40:52.678 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2024-09-21T07:40:52.679 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74365.log.gz 2024-09-21T07:40:52.680 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77393.log 2024-09-21T07:40:52.680 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92137.log.gz/var/log/ceph/ceph-client.admin.51312.log: 2024-09-21T07:40:52.681 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2024-09-21T07:40:52.682 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84353.log 2024-09-21T07:40:52.682 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77393.log.gz 2024-09-21T07:40:52.683 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72477.log 2024-09-21T07:40:52.684 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74161.log 2024-09-21T07:40:52.684 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84353.log.gz 2024-09-21T07:40:52.686 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83446.log 2024-09-21T07:40:52.686 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72477.log.gz 2024-09-21T07:40:52.687 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88048.log 2024-09-21T07:40:52.687 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74161.log.gz 2024-09-21T07:40:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83446.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83446.log.gz 2024-09-21T07:40:52.688 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75168.log 2024-09-21T07:40:52.689 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77947.log 2024-09-21T07:40:52.690 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88048.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88048.log.gz 2024-09-21T07:40:52.690 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75168.log.gz 2024-09-21T07:40:52.691 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93457.log 2024-09-21T07:40:52.691 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77947.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77947.log.gz 2024-09-21T07:40:52.692 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84608.log 2024-09-21T07:40:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93457.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93457.log.gz 2024-09-21T07:40:52.693 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50601.log 2024-09-21T07:40:52.694 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88022.log/var/log/ceph/ceph-client.0.84608.log: 2024-09-21T07:40:52.694 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84608.log.gz 2024-09-21T07:40:52.695 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34815.log 2024-09-21T07:40:52.696 INFO:teuthology.orchestra.run.smithi064.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50601.log.gz 2024-09-21T07:40:52.697 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72281.log 2024-09-21T07:40:52.697 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88022.log.gz 2024-09-21T07:40:52.698 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78234.log 2024-09-21T07:40:52.698 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34815.log.gz 2024-09-21T07:40:52.699 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75406.log 2024-09-21T07:40:52.699 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72281.log.gz 2024-09-21T07:40:52.700 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78234.log: gzip -5 --verbose 87.3% -- -- replaced with /var/log/ceph/ceph-client.admin.78234.log.gz /var/log/ceph/ceph-client.admin.90751.log 2024-09-21T07:40:52.700 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:52.702 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71624.log 2024-09-21T07:40:52.702 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75406.log.gz 2024-09-21T07:40:52.703 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58409.log 2024-09-21T07:40:52.703 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90751.log.gz 2024-09-21T07:40:52.704 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2024-09-21T07:40:52.705 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1%/var/log/ceph/ceph-client.admin.58409.log: -- replaced with /var/log/ceph/ceph-client.admin.71624.log.gz 2024-09-21T07:40:52.705 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-09-21T07:40:52.705 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58409.log.gz 2024-09-21T07:40:52.706 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93273.log 2024-09-21T07:40:52.707 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2024-09-21T07:40:52.707 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59183.log 2024-09-21T07:40:52.707 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-09-21T07:40:52.709 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93273.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93273.log.gz 2024-09-21T07:40:52.709 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72451.log 2024-09-21T07:40:52.710 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59183.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59183.log.gz 2024-09-21T07:40:52.710 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50928.log 2024-09-21T07:40:52.711 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37591.log 2024-09-21T07:40:52.712 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72451.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72451.log.gz 2024-09-21T07:40:52.712 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50928.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz 2024-09-21T07:40:52.713 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92833.log 2024-09-21T07:40:52.713 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.37591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37591.log.gz 2024-09-21T07:40:52.714 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55577.log 2024-09-21T07:40:52.716 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29043.log 2024-09-21T07:40:52.716 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92833.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92833.log.gz 2024-09-21T07:40:52.717 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55577.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55577.log.gz 2024-09-21T07:40:52.717 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90259.log 2024-09-21T07:40:52.718 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29043.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29043.log.gz 2024-09-21T07:40:52.718 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52375.log 2024-09-21T07:40:52.720 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90259.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90259.log.gz 2024-09-21T07:40:52.720 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72611.log 2024-09-21T07:40:52.720 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51791.log 2024-09-21T07:40:52.722 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52375.log: /var/log/ceph/ceph-client.admin.72611.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-09-21T07:40:52.722 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72611.log.gz 2024-09-21T07:40:52.723 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56802.log 2024-09-21T07:40:52.723 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51791.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51791.log.gz 2024-09-21T07:40:52.723 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83810.log 2024-09-21T07:40:52.724 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57407.log 2024-09-21T07:40:52.725 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56802.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56802.log.gz 2024-09-21T07:40:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83810.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83810.log.gz 2024-09-21T07:40:52.726 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90103.log 2024-09-21T07:40:52.727 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57407.log.gz 2024-09-21T07:40:52.728 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2024-09-21T07:40:52.728 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2024-09-21T07:40:52.729 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90103.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90103.log.gz 2024-09-21T07:40:52.730 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53119.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2024-09-21T07:40:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-09-21T07:40:52.731 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58775.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2024-09-21T07:40:52.732 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56271.log 2024-09-21T07:40:52.733 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91069.log 2024-09-21T07:40:52.733 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-09-21T07:40:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55352.log 2024-09-21T07:40:52.735 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56271.log.gz 2024-09-21T07:40:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58461.log 2024-09-21T07:40:52.735 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91069.log.gz 2024-09-21T07:40:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55352.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55352.log.gz 2024-09-21T07:40:52.737 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55924.log 2024-09-21T07:40:52.738 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58461.log.gz 2024-09-21T07:40:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50772.log 2024-09-21T07:40:52.739 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52727.log 2024-09-21T07:40:52.740 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55924.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55924.log.gz 2024-09-21T07:40:52.741 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50772.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50772.log.gz 2024-09-21T07:40:52.741 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28898.log 2024-09-21T07:40:52.742 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52727.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52727.log.gz 2024-09-21T07:40:52.743 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56391.log 2024-09-21T07:40:52.743 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28898.log: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.28898.log.gz 2024-09-21T07:40:52.744 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81615.log 2024-09-21T07:40:52.745 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56391.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56391.log.gz 2024-09-21T07:40:52.745 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2024-09-21T07:40:52.746 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.81615.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.88100.log 2024-09-21T07:40:52.747 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81615.log.gz 2024-09-21T07:40:52.747 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35346.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2024-09-21T07:40:52.748 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80418.log 2024-09-21T07:40:52.749 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88100.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88100.log.gz 2024-09-21T07:40:52.749 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54585.log 2024-09-21T07:40:52.751 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91243.log 2024-09-21T07:40:52.751 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80418.log.gz 2024-09-21T07:40:52.752 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81691.log 2024-09-21T07:40:52.752 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54585.log.gz 2024-09-21T07:40:52.753 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91243.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91243.log.gz 2024-09-21T07:40:52.754 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83163.log 2024-09-21T07:40:52.754 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81691.log.gz 2024-09-21T07:40:52.755 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87717.log 2024-09-21T07:40:52.756 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54250.log 2024-09-21T07:40:52.757 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83163.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83163.log.gz 2024-09-21T07:40:52.757 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87717.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87717.log.gz 2024-09-21T07:40:52.758 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80789.log 2024-09-21T07:40:52.758 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54250.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54250.log.gz 2024-09-21T07:40:52.759 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35151.log 2024-09-21T07:40:52.760 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89995.log 2024-09-21T07:40:52.760 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80789.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.80789.log.gz 2024-09-21T07:40:52.761 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35151.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35151.log.gz 2024-09-21T07:40:52.762 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91876.log 2024-09-21T07:40:52.762 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89995.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89995.log.gz 2024-09-21T07:40:52.763 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84021.log 2024-09-21T07:40:52.764 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71791.log 2024-09-21T07:40:52.765 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91876.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91876.log.gz 2024-09-21T07:40:52.765 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84021.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84021.log.gz 2024-09-21T07:40:52.766 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74211.log 2024-09-21T07:40:52.766 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71791.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71791.log.gz 2024-09-21T07:40:52.767 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90621.log 2024-09-21T07:40:52.768 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86560.log 2024-09-21T07:40:52.769 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74211.log: /var/log/ceph/ceph-client.admin.90621.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74211.log.gz 2024-09-21T07:40:52.769 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90621.log.gz 2024-09-21T07:40:52.770 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90311.log 2024-09-21T07:40:52.770 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86560.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.86560.log.gz 2024-09-21T07:40:52.771 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78485.log 2024-09-21T07:40:52.772 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:40:52.773 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90311.log: /var/log/ceph/ceph-client.admin.78485.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.90311.log.gz 2024-09-21T07:40:52.773 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78485.log.gz 2024-09-21T07:40:52.774 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55525.log 2024-09-21T07:40:52.775 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92883.log 2024-09-21T07:40:52.777 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55525.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55525.log.gz 2024-09-21T07:40:52.777 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92883.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92883.log.gz 2024-09-21T07:40:52.778 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84433.log 2024-09-21T07:40:52.778 INFO:teuthology.orchestra.run.smithi064.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:40:52.779 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57673.log 2024-09-21T07:40:52.780 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58541.log 2024-09-21T07:40:52.780 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84433.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84433.log.gz 2024-09-21T07:40:52.781 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57673.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57673.log.gz 2024-09-21T07:40:52.782 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71681.log 2024-09-21T07:40:52.782 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58541.log.gz 2024-09-21T07:40:52.783 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75510.log 2024-09-21T07:40:52.784 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71681.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71681.log.gz 2024-09-21T07:40:52.784 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93483.log 2024-09-21T07:40:52.785 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89088.log 2024-09-21T07:40:52.786 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75510.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75510.log.gz 2024-09-21T07:40:52.786 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93483.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93483.log.gz 2024-09-21T07:40:52.787 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86942.log 2024-09-21T07:40:52.788 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71739.log 2024-09-21T07:40:52.788 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89088.log.gz 2024-09-21T07:40:52.789 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86156.log 2024-09-21T07:40:52.789 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86942.log.gz 2024-09-21T07:40:52.790 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35101.log 2024-09-21T07:40:52.791 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71739.log.gz 2024-09-21T07:40:52.792 INFO:teuthology.orchestra.run.smithi090.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T07:40:52.792 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90285.log 2024-09-21T07:40:52.792 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86156.log.gz 2024-09-21T07:40:52.793 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91898.log 2024-09-21T07:40:52.793 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35101.log.gz 2024-09-21T07:40:52.794 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35049.log 2024-09-21T07:40:52.794 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90285.log.gz 2024-09-21T07:40:52.795 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89461.log 2024-09-21T07:40:52.796 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91898.log.gz 2024-09-21T07:40:52.797 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2024-09-21T07:40:52.797 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35049.log.gz 2024-09-21T07:40:52.798 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2024-09-21T07:40:52.798 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89461.log.gz 2024-09-21T07:40:52.799 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 87.4% 2024-09-21T07:40:52.799 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gz 2024-09-21T07:40:52.800 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2024-09-21T07:40:52.801 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2024-09-21T07:40:52.801 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29624.log 2024-09-21T07:40:52.801 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-09-21T07:40:52.802 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz -- 2024-09-21T07:40:52.802 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.36219.log 2024-09-21T07:40:52.804 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81299.log 2024-09-21T07:40:52.804 INFO:teuthology.orchestra.run.smithi064.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29624.log.gz 2024-09-21T07:40:52.805 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36219.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-09-21T07:40:52.806 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.81299.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37009.log 2024-09-21T07:40:52.806 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81299.log.gz 2024-09-21T07:40:52.807 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74261.log 2024-09-21T07:40:52.808 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83654.log 2024-09-21T07:40:52.809 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37009.log: 87.5%/var/log/ceph/ceph-client.admin.74261.log: -- replaced with /var/log/ceph/ceph-client.admin.37009.log.gz 2024-09-21T07:40:52.809 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74261.log.gz 2024-09-21T07:40:52.809 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78639.log 2024-09-21T07:40:52.810 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83654.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83654.log.gz 2024-09-21T07:40:52.811 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53249.log 2024-09-21T07:40:52.812 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78639.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78639.log.gz 2024-09-21T07:40:52.812 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83189.log 2024-09-21T07:40:52.813 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-client.admin.53249.log: --verbose -- /var/log/ceph/ceph-client.admin.74111.log 2024-09-21T07:40:52.813 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53249.log.gz 2024-09-21T07:40:52.814 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83189.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83189.log.gz 2024-09-21T07:40:52.814 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78407.log 2024-09-21T07:40:52.816 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80692.log 2024-09-21T07:40:52.816 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.74111.log.gz 2024-09-21T07:40:52.817 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74639.log 2024-09-21T07:40:52.817 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78407.log.gz 2024-09-21T07:40:52.818 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34340.log 2024-09-21T07:40:52.819 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80692.log.gz 2024-09-21T07:40:52.820 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59001.log 2024-09-21T07:40:52.820 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74639.log.gz 2024-09-21T07:40:52.821 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34340.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89416.log 2024-09-21T07:40:52.821 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34340.log.gz 2024-09-21T07:40:52.822 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71869.log 2024-09-21T07:40:52.822 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59001.log.gz 2024-09-21T07:40:52.823 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77032.log 2024-09-21T07:40:52.824 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89416.log.gz 2024-09-21T07:40:52.824 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92961.log 2024-09-21T07:40:52.824 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71869.log.gz 2024-09-21T07:40:52.825 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34758.log 2024-09-21T07:40:52.825 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77032.log.gz 2024-09-21T07:40:52.827 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-09-21T07:40:52.827 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92961.log.gz 2024-09-21T07:40:52.828 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57956.log 2024-09-21T07:40:52.828 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34758.log.gz 2024-09-21T07:40:52.829 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54615.log 2024-09-21T07:40:52.829 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57956.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-09-21T07:40:52.830 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57956.log.gz 2024-09-21T07:40:52.831 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52866.log 2024-09-21T07:40:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54615.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54615.log.gz 2024-09-21T07:40:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81738.log 2024-09-21T07:40:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90428.log 2024-09-21T07:40:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52866.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52866.log.gz 2024-09-21T07:40:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.81738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81738.log.gz 2024-09-21T07:40:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80264.log 2024-09-21T07:40:52.836 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80588.log 2024-09-21T07:40:52.836 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.90428.log.gz 2024-09-21T07:40:52.837 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90595.log 2024-09-21T07:40:52.837 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80264.log.gz 2024-09-21T07:40:52.838 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80588.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80588.log.gz 2024-09-21T07:40:52.839 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83524.log 2024-09-21T07:40:52.839 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90595.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90595.log.gz 2024-09-21T07:40:52.840 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-09-21T07:40:52.841 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75380.log 2024-09-21T07:40:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83524.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83524.log.gz 2024-09-21T07:40:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81589.log 2024-09-21T07:40:52.843 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz/var/log/ceph/ceph-client.admin.75380.log: 2024-09-21T07:40:52.843 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75380.log.gz 2024-09-21T07:40:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81589.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81589.log.gz 2024-09-21T07:40:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71843.log 2024-09-21T07:40:52.846 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88363.log 2024-09-21T07:40:52.847 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89617.log 2024-09-21T07:40:52.847 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71843.log.gz 2024-09-21T07:40:52.848 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88363.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88363.log.gz 2024-09-21T07:40:52.848 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34073.log 2024-09-21T07:40:52.849 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76854.log 2024-09-21T07:40:52.849 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89617.log.gz 2024-09-21T07:40:52.851 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86340.log 2024-09-21T07:40:52.851 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34073.log.gz 2024-09-21T07:40:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.76854.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.76854.log.gz 2024-09-21T07:40:52.853 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86340.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86340.log.gz 2024-09-21T07:40:52.853 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80718.log 2024-09-21T07:40:52.854 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75105.log 2024-09-21T07:40:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90926.log 2024-09-21T07:40:52.856 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.80718.log.gz 2024-09-21T07:40:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75105.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75105.log.gz 2024-09-21T07:40:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90926.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90926.log.gz 2024-09-21T07:40:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56073.log 2024-09-21T07:40:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87821.log 2024-09-21T07:40:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-09-21T07:40:52.861 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56073.log.gz 2024-09-21T07:40:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87821.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87821.log.gz 2024-09-21T07:40:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55013.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-09-21T07:40:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88768.log 2024-09-21T07:40:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92005.log 2024-09-21T07:40:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91037.log 2024-09-21T07:40:52.866 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88768.log.gz 2024-09-21T07:40:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92005.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92005.log.gz 2024-09-21T07:40:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91037.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91037.log.gz 2024-09-21T07:40:52.869 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55919.log 2024-09-21T07:40:52.869 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57982.log 2024-09-21T07:40:52.871 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55443.log 2024-09-21T07:40:52.871 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55919.log.gz 2024-09-21T07:40:52.872 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57982.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57982.log.gz 2024-09-21T07:40:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55443.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55443.log.gz 2024-09-21T07:40:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53457.log 2024-09-21T07:40:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57612.log 2024-09-21T07:40:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83550.log 2024-09-21T07:40:52.876 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53457.log.gz 2024-09-21T07:40:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57612.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57612.log.gz 2024-09-21T07:40:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83550.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83550.log.gz 2024-09-21T07:40:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49920.log 2024-09-21T07:40:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83246.log 2024-09-21T07:40:52.881 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87306.log 2024-09-21T07:40:52.881 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49920.log.gz 2024-09-21T07:40:52.882 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83246.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89908.log 2024-09-21T07:40:52.882 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83246.log.gz 2024-09-21T07:40:52.883 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-09-21T07:40:52.884 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87306.log.gz 2024-09-21T07:40:52.884 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-21T07:40:52.884 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89908.log.gz 2024-09-21T07:40:52.885 INFO:teuthology.orchestra.run.smithi090.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T07:40:52.885 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78325.log 2024-09-21T07:40:52.885 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-09-21T07:40:52.886 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58208.log 2024-09-21T07:40:52.889 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0%/var/log/ceph/ceph-client.admin.78325.log: -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-21T07:40:52.890 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78325.log.gz 2024-09-21T07:40:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58064.log 2024-09-21T07:40:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58208.log.gz 2024-09-21T07:40:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87370.log 2024-09-21T07:40:52.890 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87150.log 2024-09-21T07:40:52.891 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58064.log: /var/log/ceph/ceph-client.admin.87370.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58064.log.gz 2024-09-21T07:40:52.892 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87150.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87370.log.gz 2024-09-21T07:40:52.893 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72096.log 2024-09-21T07:40:52.893 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87150.log.gz 2024-09-21T07:40:52.893 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88074.log 2024-09-21T07:40:52.894 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72096.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72096.log.gz 2024-09-21T07:40:52.895 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87600.log 2024-09-21T07:40:52.896 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77110.log 2024-09-21T07:40:52.897 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88074.log.gz 2024-09-21T07:40:52.898 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87600.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87600.log.gz 2024-09-21T07:40:52.898 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92061.log 2024-09-21T07:40:52.898 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77110.log.gz 2024-09-21T07:40:52.899 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89591.log 2024-09-21T07:40:52.901 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55804.log 2024-09-21T07:40:52.901 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92061.log.gz 2024-09-21T07:40:52.902 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87996.log 2024-09-21T07:40:52.902 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89591.log.gz 2024-09-21T07:40:52.902 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.55804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55804.log.gz 2024-09-21T07:40:52.903 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83628.log 2024-09-21T07:40:52.904 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87996.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87996.log.gz 2024-09-21T07:40:52.904 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75133.log 2024-09-21T07:40:52.905 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77445.log 2024-09-21T07:40:52.906 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83628.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83628.log.gz 2024-09-21T07:40:52.906 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-09-21T07:40:52.906 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75133.log.gz 2024-09-21T07:40:52.907 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77445.log.gz 2024-09-21T07:40:52.908 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81355.log 2024-09-21T07:40:52.908 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86823.log 2024-09-21T07:40:52.909 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36141.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2024-09-21T07:40:52.910 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81355.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81355.log.gz 2024-09-21T07:40:52.910 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80086.log 2024-09-21T07:40:52.911 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86823.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86823.log.gz 2024-09-21T07:40:52.911 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91647.log 2024-09-21T07:40:52.912 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56365.log 2024-09-21T07:40:52.913 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80086.log.gz 2024-09-21T07:40:52.914 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91647.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91647.log.gz 2024-09-21T07:40:52.915 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93195.log 2024-09-21T07:40:52.915 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56365.log.gz 2024-09-21T07:40:52.915 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51891.log 2024-09-21T07:40:52.917 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72182.log 2024-09-21T07:40:52.917 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93195.log.gz 2024-09-21T07:40:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90129.log 2024-09-21T07:40:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72182.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51891.log.gz 2024-09-21T07:40:52.919 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90978.log 2024-09-21T07:40:52.920 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72182.log.gz 2024-09-21T07:40:52.921 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87944.log 2024-09-21T07:40:52.921 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90129.log.gz 2024-09-21T07:40:52.922 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90181.log 2024-09-21T07:40:52.922 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90978.log.gz 2024-09-21T07:40:52.923 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87944.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87944.log.gz 2024-09-21T07:40:52.924 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54959.log 2024-09-21T07:40:52.924 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90181.log.gz 2024-09-21T07:40:52.925 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75328.log 2024-09-21T07:40:52.926 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72018.log 2024-09-21T07:40:52.926 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54959.log.gz 2024-09-21T07:40:52.928 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33966.log 2024-09-21T07:40:52.928 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75328.log.gz 2024-09-21T07:40:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72018.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72018.log.gz 2024-09-21T07:40:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56867.log 2024-09-21T07:40:52.929 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.33966.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33966.log.gz 2024-09-21T07:40:52.930 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90155.log 2024-09-21T07:40:52.931 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-09-21T07:40:52.932 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56867.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56867.log.gz 2024-09-21T07:40:52.933 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90155.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90155.log.gz 2024-09-21T07:40:52.933 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54030.log 2024-09-21T07:40:52.934 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-09-21T07:40:52.934 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86741.log 2024-09-21T07:40:52.935 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.54030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54030.log.gz 2024-09-21T07:40:52.936 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53801.log 2024-09-21T07:40:52.937 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56835.log 2024-09-21T07:40:52.937 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86741.log.gz 2024-09-21T07:40:52.938 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53801.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53801.log.gz 2024-09-21T07:40:52.938 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55860.log 2024-09-21T07:40:52.939 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56835.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56835.log.gz 2024-09-21T07:40:52.939 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-09-21T07:40:52.940 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35075.log 2024-09-21T07:40:52.941 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55860.log.gz 2024-09-21T07:40:52.941 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59209.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-09-21T07:40:52.942 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89702.log 2024-09-21T07:40:52.943 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35075.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35075.log.gz 2024-09-21T07:40:52.943 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80034.log 2024-09-21T07:40:52.944 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74339.log 2024-09-21T07:40:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89702.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89702.log.gz 2024-09-21T07:40:52.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80034.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80034.log.gz 2024-09-21T07:40:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-09-21T07:40:52.946 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74339.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74339.log.gz 2024-09-21T07:40:52.947 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-09-21T07:40:52.948 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.50798.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56933.log 2024-09-21T07:40:52.948 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-09-21T07:40:52.949 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35155.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-09-21T07:40:52.950 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59079.log 2024-09-21T07:40:52.950 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56933.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56933.log.gz 2024-09-21T07:40:52.951 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-09-21T07:40:52.952 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87650.log 2024-09-21T07:40:52.952 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59079.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59079.log.gz 2024-09-21T07:40:52.954 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49813.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-09-21T07:40:52.954 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87046.log 2024-09-21T07:40:52.954 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87650.log.gz 2024-09-21T07:40:52.955 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83381.log 2024-09-21T07:40:52.956 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93247.log 2024-09-21T07:40:52.957 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87046.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87046.log.gz 2024-09-21T07:40:52.957 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83381.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83381.log.gz 2024-09-21T07:40:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83011.log 2024-09-21T07:40:52.958 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93247.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93247.log.gz 2024-09-21T07:40:52.959 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-09-21T07:40:52.960 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90480.log 2024-09-21T07:40:52.961 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83011.log: /var/log/ceph/ceph-client.admin.34418.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.83011.log.gz 2024-09-21T07:40:52.961 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-09-21T07:40:52.962 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86645.log 2024-09-21T07:40:52.963 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90480.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.90480.log.gz 2024-09-21T07:40:52.964 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-09-21T07:40:52.964 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86645.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86645.log.gz 2024-09-21T07:40:52.965 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91361.log 2024-09-21T07:40:52.966 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74736.log 2024-09-21T07:40:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50954.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-09-21T07:40:52.967 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91361.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91361.log.gz 2024-09-21T07:40:52.968 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89969.log 2024-09-21T07:40:52.968 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74736.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74736.log.gz 2024-09-21T07:40:52.969 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55551.log 2024-09-21T07:40:52.970 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78180.log 2024-09-21T07:40:52.971 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89969.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89969.log.gz 2024-09-21T07:40:52.971 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55551.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55551.log.gz 2024-09-21T07:40:52.972 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88333.log 2024-09-21T07:40:52.972 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78180.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78180.log.gz 2024-09-21T07:40:52.973 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57355.log 2024-09-21T07:40:52.974 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29079.log 2024-09-21T07:40:52.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88333.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88333.log.gz 2024-09-21T07:40:52.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57355.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57355.log.gz 2024-09-21T07:40:52.976 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35363.log 2024-09-21T07:40:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29079.log: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.29079.log.gz 2024-09-21T07:40:52.977 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56252.log 2024-09-21T07:40:52.978 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:40:52.978 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35363.log.gz 2024-09-21T07:40:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.56252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56252.log.gz 2024-09-21T07:40:52.979 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90233.log 2024-09-21T07:40:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2024-09-21T07:40:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90233.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90233.log.gz 2024-09-21T07:40:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57249.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2024-09-21T07:40:52.983 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T07:40:52.984 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:40:52.985 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87420.log 2024-09-21T07:40:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29132.log 2024-09-21T07:40:52.987 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87420.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87420.log.gz 2024-09-21T07:40:52.988 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29132.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29132.log.gz 2024-09-21T07:40:52.988 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2024-09-21T07:40:52.989 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-09-21T07:40:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53881.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2024-09-21T07:40:52.991 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-09-21T07:40:52.992 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34971.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-09-21T07:40:52.993 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87256.log 2024-09-21T07:40:52.994 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52476.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-09-21T07:40:52.995 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-09-21T07:40:52.996 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87256.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87256.log.gz 2024-09-21T07:40:52.997 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58919.log 2024-09-21T07:40:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36297.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-09-21T07:40:52.998 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52892.log 2024-09-21T07:40:52.999 INFO:teuthology.orchestra.run.smithi090.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T07:40:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58919.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58919.log.gz 2024-09-21T07:40:53.000 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88126.log 2024-09-21T07:40:53.001 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52892.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52892.log.gz 2024-09-21T07:40:53.002 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T07:40:53.003 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88126.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88126.log.gz 2024-09-21T07:40:53.004 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-09-21T07:40:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.29145.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-09-21T07:40:53.007 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2024-09-21T07:40:53.010 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53671.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-09-21T07:40:53.010 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58034.log 2024-09-21T07:40:53.013 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58034.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58034.log.gz 2024-09-21T07:40:53.013 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29055.log 2024-09-21T07:40:53.014 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77614.log 2024-09-21T07:40:53.015 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29055.log.gz 2024-09-21T07:40:53.016 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2024-09-21T07:40:53.019 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54073.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2024-09-21T07:40:53.019 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77058.log 2024-09-21T07:40:53.021 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77614.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77614.log.gz 2024-09-21T07:40:53.021 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58593.log 2024-09-21T07:40:53.022 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77058.log.gz 2024-09-21T07:40:53.024 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56698.log 2024-09-21T07:40:53.026 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58593.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29121.log 2024-09-21T07:40:53.026 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56698.log.gz 2024-09-21T07:40:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29121.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.29121.log.gz 2024-09-21T07:40:53.030 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56129.log 2024-09-21T07:40:53.033 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56129.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56129.log.gz 2024-09-21T07:40:53.033 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36903.log 2024-09-21T07:40:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36903.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36903.log.gz 2024-09-21T07:40:53.036 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88690.log 2024-09-21T07:40:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88690.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88690.log.gz 2024-09-21T07:40:53.039 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80841.log 2024-09-21T07:40:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80841.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80841.log.gz 2024-09-21T07:40:53.042 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78206.log 2024-09-21T07:40:53.047 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2024-09-21T07:40:53.047 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78206.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78206.log.gz 2024-09-21T07:40:53.047 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78025.log 2024-09-21T07:40:53.047 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2024-09-21T07:40:53.050 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78025.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78025.log.gz 2024-09-21T07:40:53.051 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88452.log 2024-09-21T07:40:53.053 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83897.log 2024-09-21T07:40:53.054 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88452.log.gz 2024-09-21T07:40:53.055 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36823.log 2024-09-21T07:40:53.057 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83897.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83897.log.gz 2024-09-21T07:40:53.059 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57067.log 2024-09-21T07:40:53.061 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36823.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36823.log.gz 2024-09-21T07:40:53.063 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log 2024-09-21T07:40:53.064 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57067.log.gz 2024-09-21T07:40:53.066 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78511.log 2024-09-21T07:40:53.067 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2024-09-21T07:40:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50004.log 2024-09-21T07:40:53.071 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.78511.log.gz 2024-09-21T07:40:53.072 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58114.log 2024-09-21T07:40:53.074 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50004.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz 2024-09-21T07:40:53.077 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58114.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58114.log.gz 2024-09-21T07:40:53.077 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88612.log 2024-09-21T07:40:53.079 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2024-09-21T07:40:53.080 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88612.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88612.log.gz 2024-09-21T07:40:53.082 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-21T07:40:53.087 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51967.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-21T07:40:53.087 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50746.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2024-09-21T07:40:53.087 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53697.log 2024-09-21T07:40:53.090 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53697.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53697.log.gz 2024-09-21T07:40:53.090 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-09-21T07:40:53.093 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34366.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-09-21T07:40:53.093 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78116.log 2024-09-21T07:40:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57381.log 2024-09-21T07:40:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78116.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78116.log.gz 2024-09-21T07:40:53.096 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78051.log 2024-09-21T07:40:53.096 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57381.log.gz 2024-09-21T07:40:53.099 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78051.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.78051.log.gz 2024-09-21T07:40:53.100 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72637.log 2024-09-21T07:40:53.101 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-09-21T07:40:53.102 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72637.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72637.log.gz 2024-09-21T07:40:53.105 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-09-21T07:40:53.106 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-09-21T07:40:53.108 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83758.log 2024-09-21T07:40:53.110 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2024-09-21T07:40:53.112 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54784.log 2024-09-21T07:40:53.116 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54784.log.gz 2024-09-21T07:40:53.116 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83758.log.gz 2024-09-21T07:40:53.116 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-09-21T07:40:53.119 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35362.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-09-21T07:40:53.119 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91823.log 2024-09-21T07:40:53.122 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91823.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91823.log.gz 2024-09-21T07:40:53.122 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75302.log 2024-09-21T07:40:53.125 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75302.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75302.log.gz 2024-09-21T07:40:53.125 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92443.log 2024-09-21T07:40:53.128 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34867.log 2024-09-21T07:40:53.128 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92443.log.gz 2024-09-21T07:40:53.128 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89390.log 2024-09-21T07:40:53.133 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34867.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34867.log.gz 2024-09-21T07:40:53.133 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89390.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89390.log.gz 2024-09-21T07:40:53.133 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74061.log 2024-09-21T07:40:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74061.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.74061.log.gz 2024-09-21T07:40:53.137 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74535.log 2024-09-21T07:40:53.139 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74535.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74535.log.gz 2024-09-21T07:40:53.139 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84327.log 2024-09-21T07:40:53.141 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-09-21T07:40:53.145 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35348.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-09-21T07:40:53.145 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84327.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.84327.log.gz 2024-09-21T07:40:53.146 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-09-21T07:40:53.148 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54888.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-09-21T07:40:53.148 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59027.log 2024-09-21T07:40:53.151 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59027.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59027.log.gz 2024-09-21T07:40:53.151 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56776.log 2024-09-21T07:40:53.154 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91279.log 2024-09-21T07:40:53.154 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56776.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56776.log.gz 2024-09-21T07:40:53.157 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91279.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91279.log.gz 2024-09-21T07:40:53.157 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88960.log 2024-09-21T07:40:53.160 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88960.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88960.log.gz 2024-09-21T07:40:53.160 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2024-09-21T07:40:53.163 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91413.log 2024-09-21T07:40:53.163 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36701.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gz 2024-09-21T07:40:53.166 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91413.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91413.log.gz 2024-09-21T07:40:53.166 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72689.log 2024-09-21T07:40:53.168 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72689.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72689.log.gz 2024-09-21T07:40:53.169 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-09-21T07:40:53.172 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28981.log 2024-09-21T07:40:53.172 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-09-21T07:40:53.172 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28981.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28981.log.gz 2024-09-21T07:40:53.173 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-09-21T07:40:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51163.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-09-21T07:40:53.176 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92289.log 2024-09-21T07:40:53.179 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92289.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.92289.log.gz 2024-09-21T07:40:53.179 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71992.log 2024-09-21T07:40:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71992.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71992.log.gz 2024-09-21T07:40:53.182 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76954.log 2024-09-21T07:40:53.187 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2024-09-21T07:40:53.187 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.76954.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76954.log.gz 2024-09-21T07:40:53.187 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92393.log 2024-09-21T07:40:53.187 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2024-09-21T07:40:53.191 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92393.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92393.log.gz 2024-09-21T07:40:53.191 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71520.log 2024-09-21T07:40:53.194 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71520.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71520.log.gz 2024-09-21T07:40:53.195 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86313.log 2024-09-21T07:40:53.196 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56593.log 2024-09-21T07:40:53.199 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86313.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86313.log.gz 2024-09-21T07:40:53.199 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88508.log 2024-09-21T07:40:53.200 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56593.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56593.log.gz 2024-09-21T07:40:53.201 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86065.log 2024-09-21T07:40:53.202 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88508.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88508.log.gz 2024-09-21T07:40:53.206 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86065.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86065.log.gz 2024-09-21T07:40:53.206 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50180.log 2024-09-21T07:40:53.209 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55921.log 2024-09-21T07:40:53.210 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50180.log.gz 2024-09-21T07:40:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2024-09-21T07:40:53.213 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55921.log.gz 2024-09-21T07:40:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.52944.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2024-09-21T07:40:53.216 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.83414.log 2024-09-21T07:40:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83414.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83414.log.gz 2024-09-21T07:40:53.219 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90725.log 2024-09-21T07:40:53.222 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90725.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90725.log.gz 2024-09-21T07:40:53.222 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58686.log 2024-09-21T07:40:53.227 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79958.log 2024-09-21T07:40:53.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58686.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58686.log.gz 2024-09-21T07:40:53.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.79958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71713.log 2024-09-21T07:40:53.228 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79958.log.gz 2024-09-21T07:40:53.230 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71713.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71713.log.gz 2024-09-21T07:40:53.231 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74957.log 2024-09-21T07:40:53.233 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2024-09-21T07:40:53.235 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74957.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28893.log 2024-09-21T07:40:53.236 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50057.log: 2024-09-21T07:40:53.237 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2024-09-21T07:40:53.239 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.28893.log: -5 --verbose -- /var/log/ceph/ceph-client.0.88891.log 2024-09-21T07:40:53.241 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.88891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.88891.log.gz 2024-09-21T07:40:53.241 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37234.log 2024-09-21T07:40:53.242 INFO:teuthology.orchestra.run.smithi064.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.28893.log.gz 2024-09-21T07:40:53.244 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93221.log 2024-09-21T07:40:53.248 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93221.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93221.log.gz 2024-09-21T07:40:53.248 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37234.log.gz 2024-09-21T07:40:53.248 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59157.log 2024-09-21T07:40:53.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59157.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59157.log.gz 2024-09-21T07:40:53.251 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37035.log 2024-09-21T07:40:53.254 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37035.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37035.log.gz 2024-09-21T07:40:53.254 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81273.log 2024-09-21T07:40:53.257 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2024-09-21T07:40:53.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81273.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81273.log.gz 2024-09-21T07:40:53.261 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51564.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2024-09-21T07:40:53.261 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86612.log 2024-09-21T07:40:53.264 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86612.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86612.log.gz 2024-09-21T07:40:53.264 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89734.log 2024-09-21T07:40:53.267 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89734.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89734.log.gz 2024-09-21T07:40:53.267 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56750.log 2024-09-21T07:40:53.268 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74287.log 2024-09-21T07:40:53.270 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56750.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56750.log.gz 2024-09-21T07:40:53.274 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74287.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74287.log.gz 2024-09-21T07:40:53.274 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86886.log 2024-09-21T07:40:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86886.log.gz 2024-09-21T07:40:53.276 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57672.log 2024-09-21T07:40:53.279 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58338.log 2024-09-21T07:40:53.279 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57672.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57672.log.gz 2024-09-21T07:40:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58338.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58338.log.gz 2024-09-21T07:40:53.282 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92807.log 2024-09-21T07:40:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92807.log.gz 2024-09-21T07:40:53.285 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2024-09-21T07:40:53.288 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49863.log 2024-09-21T07:40:53.288 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51941.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2024-09-21T07:40:53.288 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80164.log 2024-09-21T07:40:53.289 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49863.log.gz 2024-09-21T07:40:53.292 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80164.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.80164.log.gz 2024-09-21T07:40:53.292 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89286.log 2024-09-21T07:40:53.295 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50031.log 2024-09-21T07:40:53.297 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50031.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50031.log.gz 2024-09-21T07:40:53.297 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59358.log 2024-09-21T07:40:53.299 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89286.log.gz 2024-09-21T07:40:53.301 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.59358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28993.log 2024-09-21T07:40:53.301 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59358.log.gz 2024-09-21T07:40:53.302 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77212.log 2024-09-21T07:40:53.306 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28993.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.28993.log.gz 2024-09-21T07:40:53.306 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77212.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.77212.log.gz 2024-09-21T07:40:53.306 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88307.log 2024-09-21T07:40:53.309 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88307.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88307.log.gz 2024-09-21T07:40:53.309 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84275.log 2024-09-21T07:40:53.310 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86261.log 2024-09-21T07:40:53.312 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84275.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84275.log.gz 2024-09-21T07:40:53.312 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77692.log 2024-09-21T07:40:53.313 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86261.log.gz 2024-09-21T07:40:53.315 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77692.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77692.log.gz 2024-09-21T07:40:53.316 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59261.log 2024-09-21T07:40:53.319 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59261.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59261.log.gz 2024-09-21T07:40:53.319 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90207.log 2024-09-21T07:40:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90207.log.gz 2024-09-21T07:40:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77582.log 2024-09-21T07:40:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77582.log.gz 2024-09-21T07:40:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78589.log 2024-09-21T07:40:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35343.log 2024-09-21T07:40:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.78589.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78589.log.gz 2024-09-21T07:40:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35343.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35343.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71817.log 2024-09-21T07:40:53.332 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81210.log 2024-09-21T07:40:53.335 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71817.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71817.log.gz 2024-09-21T07:40:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81210.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81210.log.gz 2024-09-21T07:40:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-09-21T07:40:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37091.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-09-21T07:40:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80893.log 2024-09-21T07:40:53.344 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80893.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80893.log.gz 2024-09-21T07:40:53.344 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72362.log 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77288.log 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72362.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72362.log.gz 2024-09-21T07:40:53.349 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-09-21T07:40:53.350 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77288.log.gz 2024-09-21T07:40:53.354 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log/var/log/ceph/ceph-client.admin.54732.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-09-21T07:40:53.354 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:40:53.357 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51512.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2024-09-21T07:40:53.357 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53645.log 2024-09-21T07:40:53.360 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53645.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53645.log.gz 2024-09-21T07:40:53.360 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86182.log 2024-09-21T07:40:53.361 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51129.log 2024-09-21T07:40:53.363 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86182.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86182.log.gz 2024-09-21T07:40:53.365 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.51129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51129.log.gz 2024-09-21T07:40:53.365 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87446.log 2024-09-21T07:40:53.367 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88985.log 2024-09-21T07:40:53.369 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87446.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87446.log.gz 2024-09-21T07:40:53.373 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88985.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.88985.log.gz 2024-09-21T07:40:53.373 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28932.log 2024-09-21T07:40:53.376 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28932.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28932.log.gz 2024-09-21T07:40:53.376 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54427.log 2024-09-21T07:40:53.378 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93091.log 2024-09-21T07:40:53.379 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54427.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54427.log.gz 2024-09-21T07:40:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93091.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93091.log.gz 2024-09-21T07:40:53.381 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-21T07:40:53.384 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36727.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-21T07:40:53.385 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58893.log 2024-09-21T07:40:53.386 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90569.log 2024-09-21T07:40:53.388 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58893.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58893.log.gz 2024-09-21T07:40:53.388 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77497.log 2024-09-21T07:40:53.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90569.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90569.log.gz 2024-09-21T07:40:53.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77497.log.gz 2024-09-21T07:40:53.395 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85967.log 2024-09-21T07:40:53.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85967.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85967.log.gz 2024-09-21T07:40:53.396 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92753.log 2024-09-21T07:40:53.397 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92753.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92753.log.gz 2024-09-21T07:40:53.398 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91595.log 2024-09-21T07:40:53.400 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2024-09-21T07:40:53.401 INFO:teuthology.orchestra.run.smithi064.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91595.log.gz 2024-09-21T07:40:53.403 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56985.log 2024-09-21T07:40:53.405 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49658.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2024-09-21T07:40:53.407 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2024-09-21T07:40:53.409 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56985.log.gz 2024-09-21T07:40:53.410 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54533.log 2024-09-21T07:40:53.413 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54533.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54533.log.gz 2024-09-21T07:40:53.414 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37416.log 2024-09-21T07:40:53.417 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1%gzip -5/var/log/ceph/ceph-client.admin.37416.log: --verbose -- /var/log/ceph/ceph-client.admin.55065.log 2024-09-21T07:40:53.417 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2024-09-21T07:40:53.417 INFO:teuthology.orchestra.run.smithi064.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37416.log.gz 2024-09-21T07:40:53.421 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-09-21T07:40:53.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55065.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55065.log.gz 2024-09-21T07:40:53.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56205.log 2024-09-21T07:40:53.421 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-09-21T07:40:53.423 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-09-21T07:40:53.423 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56205.log.gz 2024-09-21T07:40:53.425 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72767.log 2024-09-21T07:40:53.430 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.72767.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72767.log.gz 2024-09-21T07:40:53.430 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37126.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-09-21T07:40:53.430 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90952.log 2024-09-21T07:40:53.433 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90952.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90952.log.gz 2024-09-21T07:40:53.433 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50388.log 2024-09-21T07:40:53.436 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50388.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50388.log.gz 2024-09-21T07:40:53.436 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76804.log 2024-09-21T07:40:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90673.log 2024-09-21T07:40:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.76804.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76804.log.gz 2024-09-21T07:40:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51082.log 2024-09-21T07:40:53.441 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90673.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90673.log.gz 2024-09-21T07:40:53.443 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37608.log 2024-09-21T07:40:53.445 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.51082.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51082.log.gz 2024-09-21T07:40:53.447 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92578.log 2024-09-21T07:40:53.448 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37608.log.gz 2024-09-21T07:40:53.450 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83111.log 2024-09-21T07:40:53.454 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83111.log.gz 2024-09-21T07:40:53.454 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92578.log.gz 2024-09-21T07:40:53.455 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2024-09-21T07:40:53.458 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50109.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2024-09-21T07:40:53.458 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55300.log 2024-09-21T07:40:53.460 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2024-09-21T07:40:53.460 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55300.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55300.log.gz 2024-09-21T07:40:53.463 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50421.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2024-09-21T07:40:53.464 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54401.log 2024-09-21T07:40:53.466 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54401.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54401.log.gz 2024-09-21T07:40:53.466 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57301.log 2024-09-21T07:40:53.471 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91621.log 2024-09-21T07:40:53.471 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57301.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57301.log.gz 2024-09-21T07:40:53.471 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50258.log 2024-09-21T07:40:53.471 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91621.log.gz 2024-09-21T07:40:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.50258.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50258.log.gz 2024-09-21T07:40:53.475 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2024-09-21T07:40:53.477 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74313.log 2024-09-21T07:40:53.478 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2024-09-21T07:40:53.479 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29005.log 2024-09-21T07:40:53.482 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.74313.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74313.log.gz 2024-09-21T07:40:53.483 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36759.log 2024-09-21T07:40:53.486 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29005.log: /var/log/ceph/ceph-client.admin.36759.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36759.log.gz 2024-09-21T07:40:53.488 INFO:teuthology.orchestra.run.smithi064.stderr: 76.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89880.log 2024-09-21T07:40:53.488 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29005.log.gz 2024-09-21T07:40:53.491 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89880.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89880.log.gz 2024-09-21T07:40:53.491 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89487.log 2024-09-21T07:40:53.494 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89487.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89487.log.gz 2024-09-21T07:40:53.494 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53513.log 2024-09-21T07:40:53.496 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.53513.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53513.log.gz 2024-09-21T07:40:53.497 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71940.log 2024-09-21T07:40:53.499 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-09-21T07:40:53.500 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71940.log.gz 2024-09-21T07:40:53.501 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55234.log 2024-09-21T07:40:53.505 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55234.log: /var/log/ceph/ceph-client.admin.52322.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55234.log.gz 2024-09-21T07:40:53.505 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35951.log 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35951.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gz 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89260.log 2024-09-21T07:40:53.514 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89260.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89260.log.gz 2024-09-21T07:40:53.514 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57013.log 2024-09-21T07:40:53.514 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.57013.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57013.log.gz 2024-09-21T07:40:53.514 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28896.log 2024-09-21T07:40:53.516 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28896.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.28896.log.gz 2024-09-21T07:40:53.517 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75484.log 2024-09-21T07:40:53.518 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91543.log 2024-09-21T07:40:53.521 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.75484.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.75484.log.gz 2024-09-21T07:40:53.521 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87204.log 2024-09-21T07:40:53.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81459.log 2024-09-21T07:40:53.524 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91543.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87204.log.gz 2024-09-21T07:40:53.524 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91543.log.gz 2024-09-21T07:40:53.526 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-09-21T07:40:53.528 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81459.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81459.log.gz 2024-09-21T07:40:53.528 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58234.log 2024-09-21T07:40:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.55169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gz 2024-09-21T07:40:53.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58234.log.gz 2024-09-21T07:40:53.532 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93377.log 2024-09-21T07:40:53.535 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93377.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93377.log.gz 2024-09-21T07:40:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83931.log 2024-09-21T07:40:53.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83931.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83931.log.gz 2024-09-21T07:40:53.538 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87353.log 2024-09-21T07:40:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.87353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87353.log.gz 2024-09-21T07:40:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85804.log 2024-09-21T07:40:53.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85804.log.gz 2024-09-21T07:40:53.544 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81407.log 2024-09-21T07:40:53.547 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-09-21T07:40:53.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81407.log.gz 2024-09-21T07:40:53.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37260.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-09-21T07:40:53.550 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84106.log 2024-09-21T07:40:53.553 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.84106.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.84106.log.gz 2024-09-21T07:40:53.553 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59311.log 2024-09-21T07:40:53.555 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.59311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2024-09-21T07:40:53.556 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59311.log.gz 2024-09-21T07:40:53.557 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77136.log 2024-09-21T07:40:53.559 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.49978.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2024-09-21T07:40:53.560 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2024-09-21T07:40:53.561 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77136.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77136.log.gz 2024-09-21T07:40:53.564 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54099.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 2024-09-21T07:40:53.564 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81433.log 2024-09-21T07:40:53.567 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81433.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81433.log.gz 2024-09-21T07:40:53.567 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54252.log 2024-09-21T07:40:53.570 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.54252.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54252.log.gz 2024-09-21T07:40:53.570 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91967.log 2024-09-21T07:40:53.572 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91967.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91967.log.gz 2024-09-21T07:40:53.573 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88794.log 2024-09-21T07:40:53.575 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.88794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83602.log 2024-09-21T07:40:53.576 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88794.log.gz 2024-09-21T07:40:53.578 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55757.log 2024-09-21T07:40:53.584 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83602.log: /var/log/ceph/ceph-client.admin.55757.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83602.log.gz 2024-09-21T07:40:53.584 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52170.log 2024-09-21T07:40:53.584 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55757.log.gz 2024-09-21T07:40:53.584 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52170.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52170.log.gz 2024-09-21T07:40:53.584 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29067.log 2024-09-21T07:40:53.586 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.29067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29067.log.gz 2024-09-21T07:40:53.586 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77314.log 2024-09-21T07:40:53.587 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92682.log 2024-09-21T07:40:53.589 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77314.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77314.log.gz 2024-09-21T07:40:53.592 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92682.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92682.log.gz 2024-09-21T07:40:53.592 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80945.log 2024-09-21T07:40:53.595 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80945.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80945.log.gz 2024-09-21T07:40:53.595 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92987.log 2024-09-21T07:40:53.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92987.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92987.log.gz 2024-09-21T07:40:53.598 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28912.log 2024-09-21T07:40:53.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.28912.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.28912.log.gz 2024-09-21T07:40:53.601 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80138.log 2024-09-21T07:40:53.602 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34893.log 2024-09-21T07:40:53.604 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.80138.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80138.log.gz 2024-09-21T07:40:53.604 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58975.log 2024-09-21T07:40:53.604 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34893.log.gz 2024-09-21T07:40:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.58975.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58975.log.gz 2024-09-21T07:40:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89852.log 2024-09-21T07:40:53.610 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89852.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89852.log.gz 2024-09-21T07:40:53.611 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36630.log 2024-09-21T07:40:53.615 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71574.log 2024-09-21T07:40:53.615 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.36630.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36630.log.gz 2024-09-21T07:40:53.615 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.71574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2024-09-21T07:40:53.618 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71574.log.gz 2024-09-21T07:40:53.618 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81755.log 2024-09-21T07:40:53.619 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52071.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2024-09-21T07:40:53.623 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.81755.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81755.log.gz 2024-09-21T07:40:53.623 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83838.log 2024-09-21T07:40:53.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.83838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86016.log 2024-09-21T07:40:53.626 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83838.log.gz 2024-09-21T07:40:53.628 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.86016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59131.log 2024-09-21T07:40:53.631 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1%gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59131.log: /var/log/ceph/ceph-client.admin.37312.log 2024-09-21T07:40:53.631 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86016.log.gz 2024-09-21T07:40:53.635 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59131.log.gz 2024-09-21T07:40:53.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.37312.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-09-21T07:40:53.635 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77867.log 2024-09-21T07:40:53.637 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.77867.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77867.log.gz 2024-09-21T07:40:53.637 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2024-09-21T07:40:53.639 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.52701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91697.log 2024-09-21T07:40:53.640 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2024-09-21T07:40:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91387.log 2024-09-21T07:40:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91697.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91697.log.gz 2024-09-21T07:40:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56619.log 2024-09-21T07:40:53.646 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91387.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91387.log.gz 2024-09-21T07:40:53.647 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.56619.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56619.log.gz 2024-09-21T07:40:53.946 INFO:teuthology.orchestra.run.smithi064.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T07:40:57.051 INFO:teuthology.orchestra.run.smithi090.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T07:40:57.231 INFO:teuthology.orchestra.run.smithi090.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T07:40:57.457 INFO:teuthology.orchestra.run.smithi090.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T07:40:57.835 INFO:teuthology.orchestra.run.smithi090.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T07:40:57.870 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-21T07:40:57.871 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m5.641s 2024-09-21T07:40:57.871 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m21.280s 2024-09-21T07:40:57.871 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m1.660s 2024-09-21T07:40:59.542 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T07:40:59.613 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T07:41:00.005 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T07:41:00.514 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T07:41:01.229 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T07:41:44.449 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T07:41:44.451 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-21T07:41:44.451 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m52.290s 2024-09-21T07:41:44.451 INFO:teuthology.orchestra.run.smithi064.stderr:user 1m25.606s 2024-09-21T07:41:44.451 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m7.925s 2024-09-21T07:41:44.452 INFO:tasks.ceph:Archiving logs... 2024-09-21T07:41:44.453 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi064/log 2024-09-21T07:41:44.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:41:53.796 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi090/log 2024-09-21T07:41:53.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:41:56.441 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:41:56.468 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:41:56.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:41:56.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:41:56.540 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:41:56.548 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:41:56.548 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:41:56.552 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:41:56.564 INFO:teuthology.orchestra.run.smithi064.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T07:41:56.564 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================== 2024-09-21T07:41:56.564 INFO:teuthology.orchestra.run.smithi064.stdout:*hv01.front.sepi 67.205.162.81 3 u 7 64 377 0.099 -5.236 1.138 2024-09-21T07:41:56.564 INFO:teuthology.orchestra.run.smithi064.stdout:+hv02.front.sepi 63.231.80.2 3 u 64 64 377 0.088 -3.449 0.810 2024-09-21T07:41:56.565 INFO:teuthology.orchestra.run.smithi064.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.084 -3.877 0.989 2024-09-21T07:41:56.565 INFO:teuthology.orchestra.run.smithi064.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-21T07:41:56.566 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T07:41:56.566 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2024-09-21T07:41:56.566 INFO:teuthology.orchestra.run.smithi090.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.083 -3.122 0.458 2024-09-21T07:41:56.566 INFO:teuthology.orchestra.run.smithi090.stdout:*hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.096 -2.785 0.396 2024-09-21T07:41:56.566 INFO:teuthology.orchestra.run.smithi090.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.101 -3.407 0.627 2024-09-21T07:41:56.567 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-21T07:41:56.567 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:41:56.575 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:41:56.575 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:41:56.584 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:41:56.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:41:56.599 INFO:teuthology.task.internal:Duration was 1888.256120 seconds 2024-09-21T07:41:56.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:41:56.607 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:41:56.607 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:41:56.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:41:56.692 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:41:56.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-09-21T07:41:56.693 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:41:56.713 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T07:41:56.713 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:41:56.733 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:41:56.733 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:41:56.761 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:41:56.815 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:41:56.815 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:41:56.849 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:41:56.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:41:56.956 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:41:56.957 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:41:56.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:41:56.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:41:57.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:41:57.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:41:57.035 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-09-21T07:41:57.055 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-21T07:41:57.072 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:41:57.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:41:57.105 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:41:57.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:41:57.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:41:57.135 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:41:57.136 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi064 2024-09-21T07:41:57.136 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:41:57.177 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913586/remote/smithi090 2024-09-21T07:41:57.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:41:57.203 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:41:57.203 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:41:57.217 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:41:57.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:41:57.268 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:41:57.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:41:57.277 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:41:57.278 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:41:57.281 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:41:57.286 INFO:teuthology.orchestra.run.smithi064.stdout: 655431 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:41 /home/ubuntu/cephtest 2024-09-21T07:41:57.302 INFO:teuthology.orchestra.run.smithi090.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:41 /home/ubuntu/cephtest 2024-09-21T07:41:57.304 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:41:57.314 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:41:57.337 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} duration: 1888.256119966507 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T07:41:57.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:41:57.426 INFO:teuthology.run:pass